2023-11-28T20:21:52.021 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T20:21:52.021 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} --archive /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469646 --owner scheduled_vshankar@teuthology --name vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469646/orig.config.yaml 2023-11-28T20:21:52.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T20:21:52.165 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469646 branch: wip-vshankar-testing-20231127.102914 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} email: vshankar@redhat.com first_in_suite: false job_id: '7469646' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102914 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: false mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - overall HEALTH_ - \(MON_DOWN\) sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102914 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 owner: scheduled_vshankar@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 8377 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 sleep_before_teardown: 0 subset: 462/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102914 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCskwrcA6DOeqohfyTpjn6+o9LJSy77pb11BWaHeEcM0PRjoe3f4efl6E+iFd4mCFvkldYfxnmFIacpjmZzTBjc= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOKLRvfGw2YW10yLVu2DIExNmriE9uosktgdOhIBkDg6gim+KBbqdKaykwn/XN8Y1ejjRvkJ/m8UVYK6dPFpuuU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_06:29:14 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T20:21:52.166 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa; will attempt to use it 2023-11-28T20:21:52.167 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks 2023-11-28T20:21:52.167 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T20:21:52.168 INFO:teuthology.task.internal:Checking packages... 2023-11-28T20:21:52.192 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '43dd94c190073cf16cff1e711dd7f5a7b1cbc883' 2023-11-28T20:21:52.192 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T20:21:52.192 INFO:teuthology.packaging:ref: None 2023-11-28T20:21:52.192 INFO:teuthology.packaging:tag: None 2023-11-28T20:21:52.192 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102914 2023-11-28T20:21:52.192 INFO:teuthology.packaging:sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:21:52.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102914 2023-11-28T20:21:52.408 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:21:52.408 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T20:21:52.415 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T20:21:52.415 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T20:21:52.437 INFO:teuthology.task.internal:Saving configuration 2023-11-28T20:21:52.465 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T20:21:52.470 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T20:21:52.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469646', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 20:15:51.367043', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEgN4N8huRGUwmULC7tCsJQyF19GkXOfwytqH2ga0cm5'} 2023-11-28T20:21:52.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469646', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 20:15:51.368644', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFthq4qCDarEuM1LkWgv6Iat2wcV16hnX1hdJl7MZrBa'} 2023-11-28T20:21:52.521 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T20:21:52.536 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-11-28T20:21:52.536 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-11-28T20:21:52.536 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T20:21:52.608 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff789d5d040>, signals=[15]) 2023-11-28T20:21:52.610 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T20:21:52.615 INFO:teuthology.task.internal:Opening connections... 2023-11-28T20:21:52.615 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T20:21:52.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:21:52.695 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2023-11-28T20:21:52.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:21:52.772 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T20:21:52.779 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-11-28T20:21:52.785 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-11-28T20:21:52.785 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-11-28T20:21:52.831 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T20:21:52.831 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-11-28T20:21:52.831 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="22.04" 2023-11-28T20:21:52.831 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T20:21:52.831 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=jammy 2023-11-28T20:21:52.831 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-11-28T20:21:52.832 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-11-28T20:21:52.832 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T20:21:52.832 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T20:21:52.832 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T20:21:52.832 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T20:21:52.832 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=jammy 2023-11-28T20:21:52.832 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-11-28T20:21:52.861 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-11-28T20:21:52.875 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-11-28T20:21:52.875 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-11-28T20:21:52.921 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="22.04" 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=jammy 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T20:21:52.922 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=jammy 2023-11-28T20:21:52.923 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-11-28T20:21:52.944 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T20:21:52.953 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T20:21:53.014 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T20:21:53.014 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2023-11-28T20:21:53.017 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2023-11-28T20:21:53.021 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T20:21:53.027 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T20:21:53.028 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2023-11-28T20:21:53.064 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2023-11-28T20:21:53.071 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T20:21:53.120 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T20:21:53.160 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-28T20:21:53.160 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-11-28T20:21:53.160 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-11-28T20:21:53.161 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T20:21:53.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:21:53.166 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-28T20:21:53.380 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:21:53.380 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T20:21:53.380 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-11-28T20:21:53.386 INFO:teuthology.orchestra.run.smithi167.stdout:5.15.0-56-generic 2023-11-28T20:21:53.386 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:21:53.413 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T20:21:53.414 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-28T20:21:53.414 DEBUG:teuthology.orchestra.run.smithi167:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T20:21:53.447 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T20:21:53.590 INFO:teuthology.orchestra.run.smithi167.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T20:21:53.591 INFO:teuthology.orchestra.run.smithi167.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T20:21:53.591 INFO:teuthology.orchestra.run.smithi167.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T20:21:53.591 INFO:teuthology.orchestra.run.smithi167.stderr:hint: 2023-11-28T20:21:53.591 INFO:teuthology.orchestra.run.smithi167.stderr:hint: git config --global init.defaultBranch 2023-11-28T20:21:53.591 INFO:teuthology.orchestra.run.smithi167.stderr:hint: 2023-11-28T20:21:53.591 INFO:teuthology.orchestra.run.smithi167.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T20:21:53.592 INFO:teuthology.orchestra.run.smithi167.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T20:21:53.592 INFO:teuthology.orchestra.run.smithi167.stderr:hint: 2023-11-28T20:21:53.592 INFO:teuthology.orchestra.run.smithi167.stderr:hint: git branch -m 2023-11-28T20:21:53.592 INFO:teuthology.orchestra.run.smithi167.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T20:21:53.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T20:21:53.663 DEBUG:teuthology.orchestra.run.smithi167:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T20:21:53.725 DEBUG:teuthology.orchestra.run.smithi167:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T20:22:46.602 INFO:teuthology.orchestra.run.smithi167.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T20:22:46.602 INFO:teuthology.orchestra.run.smithi167.stderr: * [new branch] main -> origin/main 2023-11-28T20:22:46.639 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T20:22:46.639 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T20:22:46.640 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T20:22:46.640 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T20:22:46.640 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T20:22:46.640 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T20:22:46.640 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T20:22:46.641 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T20:22:46.642 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T20:22:46.643 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T20:22:46.643 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T20:22:46.643 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T20:22:46.643 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T20:22:46.643 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T20:22:46.643 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T20:22:46.643 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T20:22:46.643 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T20:22:46.644 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T20:22:46.644 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T20:22:46.644 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T20:22:46.644 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T20:22:46.644 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T20:22:46.644 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T20:22:46.645 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T20:22:46.645 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T20:22:46.645 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T20:22:46.645 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T20:22:46.645 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T20:22:46.645 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T20:22:50.634 INFO:teuthology.orchestra.run.smithi167.stderr:Updating files: 51% (1666/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 64% (2111/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2650/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T20:22:50.639 INFO:teuthology.orchestra.run.smithi167.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T20:22:50.660 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T20:22:50.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:22:50.884 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T20:22:50.885 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T20:22:50.887 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi167.front.sepia.ceph.com to complete... 2023-11-28T20:22:52.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28 20:22:52 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T20:22:52.410 INFO:teuthology.orchestra.run.smithi167.stderr:FINISHED --2023-11-28 20:22:52-- 2023-11-28T20:22:52.410 INFO:teuthology.orchestra.run.smithi167.stderr:Total wall clock time: 1.5s 2023-11-28T20:22:52.410 INFO:teuthology.orchestra.run.smithi167.stderr:Downloaded: 1 files, 37M in 1.4s (26.9 MB/s) 2023-11-28T20:22:52.413 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T20:22:52.413 DEBUG:teuthology.orchestra.run.smithi167:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T20:22:52.661 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T20:22:54.716 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T20:22:54.721 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T20:22:54.868 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T20:22:58.458 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T20:22:58.571 INFO:teuthology.orchestra.run.smithi167.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T20:23:19.572 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub' 2023-11-28T20:23:19.587 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T20:23:19.619 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2023-11-28T20:23:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T20:23:20.067 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T20:23:20.480 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T20:23:20.496 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T20:23:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T20:23:20.566 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T20:23:20.722 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T20:23:20.722 INFO:teuthology.orchestra.run.smithi167.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T20:23:20.722 INFO:teuthology.orchestra.run.smithi167.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T20:23:20.766 INFO:teuthology.orchestra.run.smithi167.stderr:done 2023-11-28T20:23:20.947 DEBUG:teuthology.orchestra.run.smithi167:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T20:23:20.955 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T20:23:20.955 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T20:23:20.955 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T20:23:20.966 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T20:23:20.967 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T20:23:20.986 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T20:23:20.986 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T20:23:20.986 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T20:23:20.987 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T20:23:20.990 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T20:23:20.990 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T20:23:20.990 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T20:23:20.990 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T20:23:20.990 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T20:23:20.990 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T20:23:20.990 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T20:23:20.991 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T20:23:20.992 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T20:23:20.992 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T20:23:20.992 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T20:23:20.992 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T20:23:20.992 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T20:23:20.992 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T20:23:20.992 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T20:23:20.992 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T20:23:20.992 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T20:23:20.993 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T20:23:20.993 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T20:23:21.073 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T20:23:21.074 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T20:23:21.074 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T20:23:21.074 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T20:23:21.074 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T20:23:21.074 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T20:23:21.074 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T20:23:21.075 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T20:23:21.076 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T20:23:21.076 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T20:23:21.076 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T20:23:21.076 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T20:23:21.076 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T20:23:21.076 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T20:23:21.076 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T20:23:21.076 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T20:23:21.077 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T20:23:21.078 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T20:23:21.079 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T20:23:21.080 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T20:23:21.080 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T20:23:21.080 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T20:23:21.080 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T20:23:21.080 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T20:23:21.080 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T20:23:21.080 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T20:23:21.081 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T20:23:21.081 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T20:23:21.081 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T20:23:21.081 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T20:23:21.081 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T20:23:21.081 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T20:23:21.081 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T20:23:21.082 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T20:23:21.082 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T20:23:21.083 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T20:23:21.083 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T20:23:21.083 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T20:23:21.083 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T20:23:21.083 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T20:23:21.083 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T20:23:21.083 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T20:23:21.083 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T20:23:21.084 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T20:23:21.085 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T20:23:21.085 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T20:23:21.085 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T20:23:21.085 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T20:23:21.085 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T20:23:21.085 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T20:23:21.085 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T20:23:21.086 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T20:23:21.086 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T20:23:21.086 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T20:23:21.086 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T20:23:21.086 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T20:23:21.086 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T20:23:21.086 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T20:23:21.087 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T20:23:21.087 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T20:23:21.087 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T20:23:21.087 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T20:23:21.087 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T20:23:21.087 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T20:23:21.087 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T20:23:21.087 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T20:23:21.087 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T20:23:21.088 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T20:23:21.088 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T20:23:21.088 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T20:23:21.088 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T20:23:21.088 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T20:23:21.088 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T20:23:21.088 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T20:23:21.088 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T20:23:21.089 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T20:23:21.089 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T20:23:21.089 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T20:23:21.089 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T20:23:21.089 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T20:23:21.089 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T20:23:21.090 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T20:23:21.090 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T20:23:21.090 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T20:23:21.090 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T20:23:21.090 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T20:23:21.090 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T20:23:21.090 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T20:23:21.090 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T20:23:21.091 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T20:23:21.091 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T20:23:21.091 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T20:23:21.091 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T20:23:21.091 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T20:23:21.091 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T20:23:21.091 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T20:23:21.091 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T20:23:21.091 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T20:23:21.092 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T20:23:21.092 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T20:23:21.092 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T20:23:21.092 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T20:23:21.092 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T20:23:21.093 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T20:23:21.093 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T20:23:21.093 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T20:23:21.093 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T20:23:21.093 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T20:23:21.093 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T20:23:21.093 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T20:23:21.094 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T20:23:21.094 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T20:23:21.094 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T20:23:21.094 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T20:23:21.094 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T20:23:21.094 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T20:23:21.095 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T20:23:21.095 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T20:23:21.095 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T20:23:21.095 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T20:23:21.096 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T20:23:21.097 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T20:23:21.098 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T20:23:21.099 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T20:23:21.100 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T20:23:21.101 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T20:23:21.102 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T20:23:21.102 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T20:23:21.102 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T20:23:21.102 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T20:23:21.102 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T20:23:21.102 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T20:23:21.103 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T20:23:21.104 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T20:23:21.105 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T20:23:21.106 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T20:23:21.107 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T20:23:21.108 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T20:23:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T20:23:21.110 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T20:23:21.111 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T20:23:21.112 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T20:23:21.113 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T20:23:21.114 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T20:23:21.115 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T20:23:21.116 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T20:23:21.117 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T20:23:21.118 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T20:23:21.119 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T20:23:21.120 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T20:23:21.121 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T20:23:21.122 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T20:23:21.123 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T20:23:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T20:23:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T20:23:21.126 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T20:23:21.127 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T20:23:21.128 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T20:23:21.129 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T20:23:21.130 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T20:23:21.131 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T20:23:21.132 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T20:23:21.132 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T20:23:21.132 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T20:23:21.132 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T20:23:21.132 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T20:23:21.132 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T20:23:21.132 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T20:23:21.133 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T20:23:21.134 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T20:23:21.135 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T20:23:21.136 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T20:23:21.137 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T20:23:21.138 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T20:23:21.139 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T20:23:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T20:23:21.141 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T20:23:21.142 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T20:23:21.143 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T20:23:21.144 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T20:23:21.145 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T20:23:21.146 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T20:23:21.147 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T20:23:21.148 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T20:23:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T20:23:21.150 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T20:23:21.151 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T20:23:21.152 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T20:23:21.224 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T20:23:21.224 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T20:23:21.224 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T20:23:21.224 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T20:23:21.224 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T20:23:21.225 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T20:23:21.226 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T20:23:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T20:23:21.228 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T20:23:21.229 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T20:23:21.230 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T20:23:21.231 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T20:23:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T20:23:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T20:23:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T20:23:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T20:23:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T20:23:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T20:23:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T20:23:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T20:23:21.232 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T20:23:21.233 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T20:23:21.234 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T20:23:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T20:23:21.236 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T20:23:21.237 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T20:23:21.238 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T20:23:21.239 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T20:23:21.240 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T20:23:21.241 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T20:23:21.242 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T20:23:21.243 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T20:23:21.244 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T20:23:21.245 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T20:23:21.246 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T20:23:21.247 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T20:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T20:23:21.249 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T20:23:21.250 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T20:23:21.250 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T20:23:21.250 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T20:23:21.250 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T20:23:21.250 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T20:23:21.250 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T20:23:21.250 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T20:23:21.250 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T20:23:21.251 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T20:23:21.252 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T20:23:21.253 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T20:23:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T20:23:21.255 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T20:23:21.256 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T20:23:21.257 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T20:23:21.258 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T20:23:21.259 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T20:23:21.260 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T20:23:21.261 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T20:23:21.262 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T20:23:21.263 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T20:23:21.264 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T20:23:21.265 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T20:23:21.266 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T20:23:21.267 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T20:23:21.268 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T20:23:21.269 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T20:23:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T20:23:21.271 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T20:23:21.272 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T20:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T20:23:21.274 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T20:23:21.275 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T20:23:21.276 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T20:23:21.277 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T20:23:21.278 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T20:23:21.279 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T20:23:21.280 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T20:23:21.281 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T20:23:21.282 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T20:23:21.283 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T20:23:21.284 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T20:23:21.285 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T20:23:21.286 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T20:23:21.287 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T20:23:21.288 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T20:23:21.289 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T20:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T20:23:21.291 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T20:23:21.292 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T20:23:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T20:23:21.294 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T20:23:21.295 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T20:23:21.296 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T20:23:21.297 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T20:23:21.298 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T20:23:21.299 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T20:23:21.300 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T20:23:21.301 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T20:23:21.302 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T20:23:21.303 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T20:23:21.338 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T20:23:21.338 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T20:23:21.338 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T20:23:21.338 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T20:23:21.338 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T20:23:21.338 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T20:23:21.338 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T20:23:21.338 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T20:23:21.339 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T20:23:21.340 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T20:23:21.341 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T20:23:21.342 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T20:23:21.343 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T20:23:21.344 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T20:23:21.345 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T20:23:21.346 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T20:23:21.347 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T20:23:21.348 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T20:23:21.349 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T20:23:21.350 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T20:23:21.351 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T20:23:21.352 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T20:23:21.353 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T20:23:21.354 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T20:23:21.355 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T20:23:21.356 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T20:23:21.357 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T20:23:21.358 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T20:23:21.359 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T20:23:21.360 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T20:23:21.361 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T20:23:21.362 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T20:23:21.363 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T20:23:21.364 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T20:23:21.365 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T20:23:21.366 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T20:23:21.367 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T20:23:21.368 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T20:23:21.369 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T20:23:21.370 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T20:23:21.371 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T20:23:21.373 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T20:23:21.373 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T20:23:21.373 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T20:23:21.373 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T20:23:21.373 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T20:23:21.373 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T20:23:21.373 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T20:23:21.373 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T20:23:21.374 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T20:23:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T20:23:21.376 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T20:23:21.377 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T20:23:21.378 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T20:23:21.378 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T20:23:21.378 DEBUG:teuthology.orchestra.run.smithi167:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T20:23:21.387 INFO:teuthology.orchestra.run.smithi167.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T20:23:21.387 INFO:teuthology.orchestra.run.smithi167.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T20:23:21.387 INFO:teuthology.orchestra.run.smithi167.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T20:23:21.388 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T20:23:21.388 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T20:23:21.388 DEBUG:teuthology.orchestra.run.smithi167:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T20:23:21.432 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi167.front.sepia.ceph.com to complete... 2023-11-28T20:23:21.898 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub' 2023-11-28T20:23:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T20:23:21.912 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2023-11-28T20:23:22.168 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T20:23:22.173 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T20:23:22.517 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T20:23:22.522 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T20:23:22.565 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T20:23:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T20:23:22.713 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T20:23:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T20:23:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T20:23:22.723 INFO:teuthology.orchestra.run.smithi167.stderr:done 2023-11-28T20:23:53.842 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-28T20:23:53.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-28T20:23:53.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:24:28.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-28T20:24:37.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-28T20:24:37.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:24:55.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-28T20:25:07.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-28T20:25:07.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:25:08.935 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-11-28T20:25:23.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-28T20:25:23.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:25:24.181 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-11-28T20:25:24.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-28T20:25:24.813 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-28T20:25:24.813 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-11-28T20:25:24.868 INFO:teuthology.orchestra.run.smithi167.stdout:6.6.0-g8247bbb5b470 2023-11-28T20:25:24.868 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T20:25:24.868 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T20:25:24.868 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T20:25:25.869 DEBUG:teuthology.parallel:result is None 2023-11-28T20:25:25.870 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T20:25:25.878 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T20:25:25.878 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T20:25:25.882 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T20:25:25.888 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T20:25:25.921 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T20:25:25.931 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T20:25:25.932 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T20:25:25.935 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T20:25:26.041 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T20:25:26.049 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T20:25:26.049 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T20:25:26.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:25:26.055 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T20:25:26.058 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T20:25:26.116 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T20:25:26.123 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T20:25:26.136 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T20:25:26.139 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T20:25:26.141 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T20:25:26.148 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T20:25:26.149 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T20:25:26.152 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T20:25:26.200 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T20:25:26.208 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T20:25:26.209 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T20:25:26.219 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T20:25:26.248 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T20:25:26.277 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T20:25:26.332 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:25:26.333 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T20:25:26.407 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T20:25:26.413 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T20:25:26.460 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:25:26.460 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T20:25:26.521 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2023-11-28T20:25:26.525 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2023-11-28T20:25:26.627 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T20:25:26.635 INFO:teuthology.task.internal:Starting timer... 2023-11-28T20:25:26.635 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T20:25:26.654 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T20:25:26.664 DEBUG:teuthology.task.selinux:Excluding smithi167: OS 'ubuntu' does not support SELinux 2023-11-28T20:25:26.664 DEBUG:teuthology.task.selinux:Excluding smithi178: OS 'ubuntu' does not support SELinux 2023-11-28T20:25:26.664 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T20:25:26.664 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T20:25:26.664 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T20:25:26.664 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T20:25:26.674 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-28T20:25:26.674 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T20:25:26.692 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T20:25:26.693 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi167.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T20:34:08.124 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi167.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2023-11-28T20:34:08.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-28T20:34:08.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:34:08.207 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-11-28T20:34:08.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-11-28T20:34:08.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-11-28T20:34:08.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:34:08.402 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-11-28T20:34:08.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-11-28T20:34:08.498 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T20:34:08.512 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T20:34:08.512 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T20:34:08.513 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T20:34:08.516 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T20:34:08.517 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T20:34:08.552 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T20:34:08.553 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: Command line: ntpd -gq 2023-11-28T20:34:08.553 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: ---------------------------------------------------- 2023-11-28T20:34:08.553 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T20:34:08.553 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T20:34:08.553 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: corporation. Support and training for ntp-4 are 2023-11-28T20:34:08.553 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: available at https://www.nwtime.org/support 2023-11-28T20:34:08.553 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: ---------------------------------------------------- 2023-11-28T20:34:08.554 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: proto: precision = 0.041 usec (-24) 2023-11-28T20:34:08.554 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: basedate set to 2022-02-04 2023-11-28T20:34:08.554 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: gps base set to 2022-02-06 (week 2196) 2023-11-28T20:34:08.554 INFO:teuthology.orchestra.run.smithi167.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T20:34:08.555 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T20:34:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T20:34:08.556 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T20:34:08.556 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T20:34:08.556 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T20:34:08.556 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T20:34:08.557 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: Listen normally on 3 enp3s0f1 172.21.15.167:123 2023-11-28T20:34:08.557 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: Listen normally on 4 lo [::1]:123 2023-11-28T20:34:08.557 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7309%5]:123 2023-11-28T20:34:08.557 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:08 ntpd[27975]: Listening on routing socket on fd #22 for interface updates 2023-11-28T20:34:08.573 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T20:34:08.573 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: Command line: ntpd -gq 2023-11-28T20:34:08.573 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: ---------------------------------------------------- 2023-11-28T20:34:08.573 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T20:34:08.573 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T20:34:08.573 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: corporation. Support and training for ntp-4 are 2023-11-28T20:34:08.573 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: available at https://www.nwtime.org/support 2023-11-28T20:34:08.573 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: ---------------------------------------------------- 2023-11-28T20:34:08.573 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: proto: precision = 0.045 usec (-24) 2023-11-28T20:34:08.574 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: basedate set to 2022-02-04 2023-11-28T20:34:08.574 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: gps base set to 2022-02-06 (week 2196) 2023-11-28T20:34:08.574 INFO:teuthology.orchestra.run.smithi178.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T20:34:08.575 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T20:34:08.575 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T20:34:08.575 INFO:teuthology.orchestra.run.smithi178.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T20:34:08.576 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T20:34:08.576 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T20:34:08.576 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T20:34:08.576 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: Listen normally on 3 enp3s0f1 172.21.15.178:123 2023-11-28T20:34:08.576 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: Listen normally on 4 lo [::1]:123 2023-11-28T20:34:08.576 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ef9%5]:123 2023-11-28T20:34:08.576 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:08 ntpd[28423]: Listening on routing socket on fd #22 for interface updates 2023-11-28T20:34:09.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:09 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:09.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:09 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:09.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:09 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:09.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:09 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:09.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:09 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:09.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:09 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:09.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:09.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:09.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:09.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:09.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:09.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:09.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:09.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:09.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:09.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:09.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:09.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:09 ntpd[28423]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:11.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:11 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:11.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:11 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:11.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:11 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:11.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:11 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:11.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:11 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:11.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:11 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:11.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:11.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:11.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:11.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:11.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:11.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:11.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:11.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:11.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:11.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:11.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:11.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:11.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:11.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:11 ntpd[28423]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:12.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:12 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:12.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:12 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:12.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:12 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:12.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:12 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:12.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:12 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:12.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:12 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:12.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:12 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:12.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:12 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:12.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:12 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:12.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:12 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:12.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:12 ntpd[28423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:12.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:12 ntpd[28423]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:13 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:13.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:13.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:13.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:13 ntpd[28423]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:14.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:14 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:14.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:14 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:14.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:14 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:14.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:14 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:14.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:14 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:14.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:14 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:14.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:14 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:14.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:14 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:14.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:14 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:14.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:14 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:14.573 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:14 ntpd[28423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:14.574 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:14 ntpd[28423]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:15.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:15.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:15.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:15.553 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:15.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:15.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:15.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:15.554 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:15.554 INFO:teuthology.orchestra.run.smithi167.stdout:28 Nov 20:34:15 ntpd[27975]: ntpd: time slew -0.000952 s 2023-11-28T20:34:15.554 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd: time slew -0.000952s 2023-11-28T20:34:15.555 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T20:34:15.555 INFO:teuthology.orchestra.run.smithi167.stderr:28 Nov 20:34:15 ntpd[27975]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T20:34:15.575 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:15.576 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:15.577 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:15.577 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:15.578 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T20:34:15.578 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T20:34:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T20:34:15.579 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T20:34:15.580 INFO:teuthology.orchestra.run.smithi178.stdout:28 Nov 20:34:15 ntpd[28423]: ntpd: time slew -0.004311 s 2023-11-28T20:34:15.580 INFO:teuthology.orchestra.run.smithi178.stdout:ntpd: time slew -0.004311s 2023-11-28T20:34:15.583 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T20:34:15.584 INFO:teuthology.orchestra.run.smithi178.stderr:28 Nov 20:34:15 ntpd[28423]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T20:34:15.645 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T20:34:15.645 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2023-11-28T20:34:15.645 INFO:teuthology.orchestra.run.smithi178.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:34:15.646 INFO:teuthology.orchestra.run.smithi178.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:34:15.646 INFO:teuthology.orchestra.run.smithi178.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:34:15.646 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:34:15.660 INFO:teuthology.orchestra.run.smithi167.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T20:34:15.660 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================== 2023-11-28T20:34:15.661 INFO:teuthology.orchestra.run.smithi167.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:34:15.661 INFO:teuthology.orchestra.run.smithi167.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:34:15.661 INFO:teuthology.orchestra.run.smithi167.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:34:15.661 INFO:teuthology.orchestra.run.smithi167.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T20:34:15.662 INFO:teuthology.run_tasks:Running task install... 2023-11-28T20:34:15.670 DEBUG:teuthology.task.install:project ceph 2023-11-28T20:34:15.670 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}} 2023-11-28T20:34:15.670 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'} 2023-11-28T20:34:15.670 INFO:teuthology.task.install:Using flavor: default 2023-11-28T20:34:15.676 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T20:34:15.676 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T20:34:15.677 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-key list | grep Ceph 2023-11-28T20:34:15.677 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-key list | grep Ceph 2023-11-28T20:34:15.740 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T20:34:15.766 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T20:34:15.766 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T20:34:15.767 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T20:34:15.767 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T20:34:15.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:34:15.812 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T20:34:15.865 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T20:34:15.866 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T20:34:15.867 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T20:34:15.867 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T20:34:15.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:34:15.915 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T20:34:15.916 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:34:16.029 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:34:16.029 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T20:34:16.046 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2023-11-28T20:34:16.089 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T20:34:16.089 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:34:16.204 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:34:16.204 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T20:34:16.225 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2023-11-28T20:34:16.239 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T20:34:16.340 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T20:34:16.376 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T20:34:16.413 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T20:34:16.413 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T20:34:16.414 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T20:34:16.419 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T20:34:16.435 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T20:34:16.450 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T20:34:16.467 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T20:34:16.484 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T20:34:16.495 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T20:34:16.505 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T20:34:16.526 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T20:34:16.559 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T20:34:17.017 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 27.9 kB in 1s (49.1 kB/s) 2023-11-28T20:34:17.952 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2023-11-28T20:34:17.966 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:34:18.041 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2023-11-28T20:34:18.207 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2023-11-28T20:34:18.208 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2023-11-28T20:34:18.362 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T20:34:18.362 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T20:34:18.362 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T20:34:18.362 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T20:34:18.362 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T20:34:18.363 INFO:teuthology.orchestra.run.smithi167.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T20:34:18.363 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T20:34:18.363 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2023-11-28T20:34:18.363 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T20:34:18.364 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T20:34:18.365 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T20:34:18.366 INFO:teuthology.orchestra.run.smithi167.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout:Recommended packages: 2023-11-28T20:34:18.367 INFO:teuthology.orchestra.run.smithi167.stdout: btrfs-tools 2023-11-28T20:34:18.511 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2023-11-28T20:34:18.511 INFO:teuthology.orchestra.run.smithi167.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T20:34:18.511 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T20:34:18.511 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T20:34:18.511 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T20:34:18.511 INFO:teuthology.orchestra.run.smithi167.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T20:34:18.511 INFO:teuthology.orchestra.run.smithi167.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T20:34:18.511 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T20:34:18.511 INFO:teuthology.orchestra.run.smithi167.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T20:34:18.513 INFO:teuthology.orchestra.run.smithi167.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T20:34:18.514 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T20:34:18.514 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T20:34:18.514 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T20:34:18.514 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T20:34:18.514 INFO:teuthology.orchestra.run.smithi167.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T20:34:18.514 INFO:teuthology.orchestra.run.smithi167.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T20:34:18.514 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T20:34:18.514 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T20:34:18.514 INFO:teuthology.orchestra.run.smithi167.stdout: socat unzip xmlstarlet zip 2023-11-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi167.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 187 MB of archives. 2023-11-28T20:34:18.578 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T20:34:18.579 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T20:34:18.596 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T20:34:18.605 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T20:34:18.648 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T20:34:18.668 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T20:34:18.671 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T20:34:18.683 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T20:34:18.720 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T20:34:18.722 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T20:34:18.729 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T20:34:18.732 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T20:34:18.733 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T20:34:18.741 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T20:34:18.741 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T20:34:18.741 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T20:34:18.742 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T20:34:18.743 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T20:34:18.744 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T20:34:18.756 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T20:34:18.757 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T20:34:18.759 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T20:34:18.759 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T20:34:18.772 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T20:34:18.773 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T20:34:18.773 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T20:34:18.774 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T20:34:18.774 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T20:34:18.775 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T20:34:18.789 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T20:34:18.790 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T20:34:18.791 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T20:34:18.792 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T20:34:18.806 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T20:34:18.806 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T20:34:18.807 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T20:34:18.807 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T20:34:18.807 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T20:34:18.809 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T20:34:18.823 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T20:34:18.823 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T20:34:18.830 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T20:34:18.831 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T20:34:18.840 INFO:teuthology.orchestra.run.smithi167.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T20:34:18.841 INFO:teuthology.orchestra.run.smithi167.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T20:34:18.841 INFO:teuthology.orchestra.run.smithi167.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T20:34:18.843 INFO:teuthology.orchestra.run.smithi167.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T20:34:18.843 INFO:teuthology.orchestra.run.smithi167.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T20:34:18.845 INFO:teuthology.orchestra.run.smithi167.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T20:34:18.857 INFO:teuthology.orchestra.run.smithi167.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T20:34:18.858 INFO:teuthology.orchestra.run.smithi167.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T20:34:18.859 INFO:teuthology.orchestra.run.smithi167.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T20:34:18.860 INFO:teuthology.orchestra.run.smithi167.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T20:34:18.874 INFO:teuthology.orchestra.run.smithi167.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T20:34:18.918 INFO:teuthology.orchestra.run.smithi167.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T20:34:18.919 INFO:teuthology.orchestra.run.smithi167.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T20:34:18.920 INFO:teuthology.orchestra.run.smithi167.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T20:34:18.920 INFO:teuthology.orchestra.run.smithi167.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T20:34:18.921 INFO:teuthology.orchestra.run.smithi167.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T20:34:18.940 INFO:teuthology.orchestra.run.smithi167.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T20:34:18.942 INFO:teuthology.orchestra.run.smithi167.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T20:34:18.943 INFO:teuthology.orchestra.run.smithi167.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T20:34:18.959 INFO:teuthology.orchestra.run.smithi167.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T20:34:18.960 INFO:teuthology.orchestra.run.smithi167.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T20:34:18.960 INFO:teuthology.orchestra.run.smithi167.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T20:34:18.961 INFO:teuthology.orchestra.run.smithi167.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T20:34:18.961 INFO:teuthology.orchestra.run.smithi167.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T20:34:18.962 INFO:teuthology.orchestra.run.smithi167.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T20:34:18.971 INFO:teuthology.orchestra.run.smithi167.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T20:34:18.971 INFO:teuthology.orchestra.run.smithi167.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T20:34:18.974 INFO:teuthology.orchestra.run.smithi167.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T20:34:18.987 INFO:teuthology.orchestra.run.smithi167.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T20:34:18.988 INFO:teuthology.orchestra.run.smithi167.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T20:34:18.989 INFO:teuthology.orchestra.run.smithi167.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T20:34:18.992 INFO:teuthology.orchestra.run.smithi167.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T20:34:18.998 INFO:teuthology.orchestra.run.smithi167.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T20:34:18.998 INFO:teuthology.orchestra.run.smithi167.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T20:34:18.998 INFO:teuthology.orchestra.run.smithi167.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T20:34:19.003 INFO:teuthology.orchestra.run.smithi167.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T20:34:19.008 INFO:teuthology.orchestra.run.smithi167.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T20:34:19.009 INFO:teuthology.orchestra.run.smithi167.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T20:34:19.021 INFO:teuthology.orchestra.run.smithi167.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T20:34:19.021 INFO:teuthology.orchestra.run.smithi167.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T20:34:19.022 INFO:teuthology.orchestra.run.smithi167.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T20:34:19.023 INFO:teuthology.orchestra.run.smithi167.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T20:34:19.023 INFO:teuthology.orchestra.run.smithi167.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T20:34:19.024 INFO:teuthology.orchestra.run.smithi167.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T20:34:19.031 INFO:teuthology.orchestra.run.smithi167.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T20:34:19.037 INFO:teuthology.orchestra.run.smithi167.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T20:34:19.037 INFO:teuthology.orchestra.run.smithi167.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T20:34:19.039 INFO:teuthology.orchestra.run.smithi167.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T20:34:19.053 INFO:teuthology.orchestra.run.smithi167.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T20:34:20.586 INFO:teuthology.orchestra.run.smithi167.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T20:34:20.872 INFO:teuthology.orchestra.run.smithi167.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T20:34:20.885 INFO:teuthology.orchestra.run.smithi167.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T20:34:20.911 INFO:teuthology.orchestra.run.smithi167.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T20:34:20.912 INFO:teuthology.orchestra.run.smithi167.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T20:34:20.914 INFO:teuthology.orchestra.run.smithi167.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T20:34:20.915 INFO:teuthology.orchestra.run.smithi167.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T20:34:20.942 INFO:teuthology.orchestra.run.smithi167.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T20:34:21.171 INFO:teuthology.orchestra.run.smithi167.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T20:34:21.172 INFO:teuthology.orchestra.run.smithi167.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T20:34:21.185 INFO:teuthology.orchestra.run.smithi167.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T20:34:21.957 INFO:teuthology.orchestra.run.smithi167.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T20:34:22.178 INFO:teuthology.orchestra.run.smithi167.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T20:34:22.183 INFO:teuthology.orchestra.run.smithi167.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T20:34:22.186 INFO:teuthology.orchestra.run.smithi167.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T20:34:22.236 INFO:teuthology.orchestra.run.smithi167.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T20:34:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T20:34:24.519 INFO:teuthology.orchestra.run.smithi167.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T20:34:24.519 INFO:teuthology.orchestra.run.smithi167.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T20:34:24.662 INFO:teuthology.orchestra.run.smithi167.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T20:34:24.737 INFO:teuthology.orchestra.run.smithi167.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T20:34:24.803 INFO:teuthology.orchestra.run.smithi167.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T20:34:24.808 INFO:teuthology.orchestra.run.smithi167.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T20:34:24.955 INFO:teuthology.orchestra.run.smithi167.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T20:34:25.614 INFO:teuthology.orchestra.run.smithi167.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T20:34:25.614 INFO:teuthology.orchestra.run.smithi167.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T20:34:26.757 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T20:34:26.773 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T20:34:26.790 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T20:34:27.055 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 27.9 kB in 11s (2,575 B/s) 2023-11-28T20:34:27.951 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2023-11-28T20:34:27.966 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:34:28.025 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2023-11-28T20:34:28.211 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2023-11-28T20:34:28.211 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2023-11-28T20:34:28.371 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T20:34:28.372 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T20:34:28.372 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T20:34:28.373 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T20:34:28.373 INFO:teuthology.orchestra.run.smithi178.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-28T20:34:28.373 INFO:teuthology.orchestra.run.smithi178.stdout: python2.7-minimal 2023-11-28T20:34:28.373 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T20:34:28.373 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2023-11-28T20:34:28.373 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T20:34:28.373 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T20:34:28.374 INFO:teuthology.orchestra.run.smithi178.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T20:34:28.375 INFO:teuthology.orchestra.run.smithi178.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T20:34:28.376 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T20:34:28.376 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T20:34:28.376 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T20:34:28.376 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T20:34:28.376 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T20:34:28.376 INFO:teuthology.orchestra.run.smithi178.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T20:34:28.376 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T20:34:28.376 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T20:34:28.376 INFO:teuthology.orchestra.run.smithi178.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T20:34:28.377 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2023-11-28T20:34:28.377 INFO:teuthology.orchestra.run.smithi178.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T20:34:28.377 INFO:teuthology.orchestra.run.smithi178.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T20:34:28.377 INFO:teuthology.orchestra.run.smithi178.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T20:34:28.377 INFO:teuthology.orchestra.run.smithi178.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T20:34:28.377 INFO:teuthology.orchestra.run.smithi178.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T20:34:28.378 INFO:teuthology.orchestra.run.smithi178.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T20:34:28.378 INFO:teuthology.orchestra.run.smithi178.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T20:34:28.378 INFO:teuthology.orchestra.run.smithi178.stdout:Recommended packages: 2023-11-28T20:34:28.378 INFO:teuthology.orchestra.run.smithi178.stdout: btrfs-tools 2023-11-28T20:34:28.480 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2023-11-28T20:34:28.480 INFO:teuthology.orchestra.run.smithi178.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T20:34:28.480 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T20:34:28.480 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T20:34:28.480 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T20:34:28.481 INFO:teuthology.orchestra.run.smithi178.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T20:34:28.481 INFO:teuthology.orchestra.run.smithi178.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T20:34:28.481 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T20:34:28.481 INFO:teuthology.orchestra.run.smithi178.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T20:34:28.481 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T20:34:28.481 INFO:teuthology.orchestra.run.smithi178.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T20:34:28.482 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T20:34:28.482 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T20:34:28.482 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T20:34:28.482 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T20:34:28.482 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T20:34:28.483 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T20:34:28.483 INFO:teuthology.orchestra.run.smithi178.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T20:34:28.483 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T20:34:28.483 INFO:teuthology.orchestra.run.smithi178.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T20:34:28.483 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T20:34:28.483 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T20:34:28.484 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T20:34:28.484 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T20:34:28.484 INFO:teuthology.orchestra.run.smithi178.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T20:34:28.484 INFO:teuthology.orchestra.run.smithi178.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T20:34:28.484 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T20:34:28.484 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T20:34:28.485 INFO:teuthology.orchestra.run.smithi178.stdout: socat unzip xmlstarlet zip 2023-11-28T20:34:28.537 INFO:teuthology.orchestra.run.smithi178.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T20:34:28.537 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 187 MB of archives. 2023-11-28T20:34:28.537 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T20:34:28.537 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T20:34:28.554 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T20:34:28.564 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T20:34:28.604 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T20:34:28.628 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T20:34:28.628 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T20:34:28.638 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T20:34:28.689 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T20:34:28.693 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T20:34:28.704 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T20:34:28.708 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T20:34:28.709 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T20:34:28.717 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T20:34:28.719 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T20:34:28.721 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T20:34:28.722 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T20:34:28.723 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T20:34:28.726 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T20:34:28.728 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T20:34:28.742 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T20:34:28.743 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T20:34:28.743 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T20:34:28.744 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T20:34:28.744 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T20:34:28.745 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T20:34:28.746 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T20:34:28.746 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T20:34:28.760 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T20:34:28.760 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T20:34:28.777 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T20:34:28.777 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T20:34:28.777 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T20:34:28.778 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T20:34:28.778 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T20:34:28.779 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T20:34:28.779 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T20:34:28.780 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T20:34:28.793 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T20:34:28.794 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T20:34:28.810 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T20:34:28.810 INFO:teuthology.orchestra.run.smithi178.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T20:34:28.811 INFO:teuthology.orchestra.run.smithi178.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T20:34:28.811 INFO:teuthology.orchestra.run.smithi178.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T20:34:28.812 INFO:teuthology.orchestra.run.smithi178.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T20:34:28.814 INFO:teuthology.orchestra.run.smithi178.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T20:34:28.815 INFO:teuthology.orchestra.run.smithi178.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T20:34:28.816 INFO:teuthology.orchestra.run.smithi178.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T20:34:28.827 INFO:teuthology.orchestra.run.smithi178.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T20:34:28.829 INFO:teuthology.orchestra.run.smithi178.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T20:34:28.843 INFO:teuthology.orchestra.run.smithi178.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T20:34:28.844 INFO:teuthology.orchestra.run.smithi178.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T20:34:28.846 INFO:teuthology.orchestra.run.smithi178.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T20:34:28.889 INFO:teuthology.orchestra.run.smithi178.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T20:34:28.897 INFO:teuthology.orchestra.run.smithi178.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T20:34:28.911 INFO:teuthology.orchestra.run.smithi178.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T20:34:28.912 INFO:teuthology.orchestra.run.smithi178.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T20:34:28.912 INFO:teuthology.orchestra.run.smithi178.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T20:34:28.913 INFO:teuthology.orchestra.run.smithi178.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T20:34:28.932 INFO:teuthology.orchestra.run.smithi178.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T20:34:28.934 INFO:teuthology.orchestra.run.smithi178.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T20:34:28.934 INFO:teuthology.orchestra.run.smithi178.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T20:34:28.950 INFO:teuthology.orchestra.run.smithi178.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T20:34:28.950 INFO:teuthology.orchestra.run.smithi178.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T20:34:28.951 INFO:teuthology.orchestra.run.smithi178.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T20:34:28.951 INFO:teuthology.orchestra.run.smithi178.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T20:34:28.952 INFO:teuthology.orchestra.run.smithi178.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T20:34:28.952 INFO:teuthology.orchestra.run.smithi178.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T20:34:28.963 INFO:teuthology.orchestra.run.smithi178.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T20:34:28.963 INFO:teuthology.orchestra.run.smithi178.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T20:34:28.966 INFO:teuthology.orchestra.run.smithi178.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T20:34:28.979 INFO:teuthology.orchestra.run.smithi178.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T20:34:28.982 INFO:teuthology.orchestra.run.smithi178.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T20:34:28.982 INFO:teuthology.orchestra.run.smithi178.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T20:34:28.984 INFO:teuthology.orchestra.run.smithi178.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T20:34:28.987 INFO:teuthology.orchestra.run.smithi178.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T20:34:28.987 INFO:teuthology.orchestra.run.smithi178.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T20:34:28.988 INFO:teuthology.orchestra.run.smithi178.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T20:34:28.996 INFO:teuthology.orchestra.run.smithi178.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T20:34:29.000 INFO:teuthology.orchestra.run.smithi178.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T20:34:29.001 INFO:teuthology.orchestra.run.smithi178.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T20:34:29.013 INFO:teuthology.orchestra.run.smithi178.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T20:34:29.013 INFO:teuthology.orchestra.run.smithi178.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T20:34:29.014 INFO:teuthology.orchestra.run.smithi178.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T20:34:29.014 INFO:teuthology.orchestra.run.smithi178.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T20:34:29.015 INFO:teuthology.orchestra.run.smithi178.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T20:34:29.016 INFO:teuthology.orchestra.run.smithi178.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T20:34:29.022 INFO:teuthology.orchestra.run.smithi178.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T20:34:29.029 INFO:teuthology.orchestra.run.smithi178.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T20:34:29.030 INFO:teuthology.orchestra.run.smithi178.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T20:34:29.032 INFO:teuthology.orchestra.run.smithi178.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T20:34:29.047 INFO:teuthology.orchestra.run.smithi178.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T20:34:29.518 INFO:teuthology.orchestra.run.smithi167.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T20:34:29.528 INFO:teuthology.orchestra.run.smithi167.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T20:34:29.548 INFO:teuthology.orchestra.run.smithi167.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T20:34:29.553 INFO:teuthology.orchestra.run.smithi167.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T20:34:29.557 INFO:teuthology.orchestra.run.smithi167.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T20:34:29.562 INFO:teuthology.orchestra.run.smithi167.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T20:34:29.637 INFO:teuthology.orchestra.run.smithi178.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T20:34:30.023 INFO:teuthology.orchestra.run.smithi178.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T20:34:30.095 INFO:teuthology.orchestra.run.smithi178.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T20:34:30.155 INFO:teuthology.orchestra.run.smithi178.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T20:34:30.156 INFO:teuthology.orchestra.run.smithi178.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T20:34:30.163 INFO:teuthology.orchestra.run.smithi178.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T20:34:30.166 INFO:teuthology.orchestra.run.smithi178.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T20:34:30.222 INFO:teuthology.orchestra.run.smithi178.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T20:34:30.989 INFO:teuthology.orchestra.run.smithi178.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T20:34:30.992 INFO:teuthology.orchestra.run.smithi178.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T20:34:31.058 INFO:teuthology.orchestra.run.smithi178.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T20:34:31.249 INFO:teuthology.orchestra.run.smithi167.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T20:34:31.888 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 187 MB in 13s (14.7 MB/s) 2023-11-28T20:34:32.044 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T20:34:32.111 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T20:34:32.114 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T20:34:32.166 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T20:34:32.560 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T20:34:32.573 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T20:34:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T20:34:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T20:34:33.027 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T20:34:33.080 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T20:34:33.249 INFO:teuthology.orchestra.run.smithi178.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T20:34:33.516 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T20:34:33.531 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T20:34:33.633 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T20:34:33.796 INFO:teuthology.orchestra.run.smithi178.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T20:34:33.832 INFO:teuthology.orchestra.run.smithi178.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T20:34:33.835 INFO:teuthology.orchestra.run.smithi178.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T20:34:33.972 INFO:teuthology.orchestra.run.smithi178.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T20:34:33.995 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T20:34:34.010 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T20:34:34.053 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T20:34:34.481 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T20:34:34.496 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T20:34:34.548 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T20:34:34.929 INFO:teuthology.orchestra.run.smithi178.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T20:34:35.076 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T20:34:35.091 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:34:35.151 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:34:35.588 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T20:34:35.603 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:34:35.647 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:34:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T20:34:35.998 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:34:36.041 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:34:36.377 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T20:34:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T20:34:36.427 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T20:34:36.714 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librados2. 2023-11-28T20:34:36.728 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:36.772 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:37.201 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librbd1. 2023-11-28T20:34:37.215 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:37.279 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:37.636 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T20:34:37.650 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:37.846 INFO:teuthology.orchestra.run.smithi178.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T20:34:37.928 INFO:teuthology.orchestra.run.smithi178.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T20:34:37.938 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rados. 2023-11-28T20:34:37.944 INFO:teuthology.orchestra.run.smithi178.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T20:34:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:37.997 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:38.042 INFO:teuthology.orchestra.run.smithi178.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T20:34:38.108 INFO:teuthology.orchestra.run.smithi178.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T20:34:38.152 INFO:teuthology.orchestra.run.smithi178.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T20:34:38.294 INFO:teuthology.orchestra.run.smithi178.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T20:34:38.342 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T20:34:38.356 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:34:38.399 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:38.635 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T20:34:38.650 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:38.694 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:38.955 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T20:34:38.969 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:34:39.004 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:39.100 INFO:teuthology.orchestra.run.smithi178.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T20:34:39.100 INFO:teuthology.orchestra.run.smithi178.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T20:34:39.325 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T20:34:39.340 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T20:34:39.375 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T20:34:39.635 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T20:34:39.650 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:39.694 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:40.038 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T20:34:40.054 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T20:34:40.122 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T20:34:40.358 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T20:34:40.372 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T20:34:40.408 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T20:34:40.670 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T20:34:40.683 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T20:34:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T20:34:41.067 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua5.1. 2023-11-28T20:34:41.082 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T20:34:41.130 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T20:34:41.425 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua-any. 2023-11-28T20:34:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T20:34:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T20:34:41.678 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package zip. 2023-11-28T20:34:41.693 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T20:34:41.728 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T20:34:42.264 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package unzip. 2023-11-28T20:34:42.279 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T20:34:42.322 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T20:34:42.736 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package luarocks. 2023-11-28T20:34:42.750 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T20:34:42.793 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T20:34:43.184 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librgw2. 2023-11-28T20:34:43.199 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:43.234 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:43.695 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T20:34:43.709 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:43.753 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:43.893 INFO:teuthology.orchestra.run.smithi178.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T20:34:43.895 INFO:teuthology.orchestra.run.smithi178.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T20:34:43.899 INFO:teuthology.orchestra.run.smithi178.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T20:34:43.900 INFO:teuthology.orchestra.run.smithi178.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T20:34:43.901 INFO:teuthology.orchestra.run.smithi178.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T20:34:43.902 INFO:teuthology.orchestra.run.smithi178.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T20:34:44.115 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T20:34:44.129 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T20:34:44.173 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T20:34:44.428 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T20:34:44.442 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:44.478 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:44.711 INFO:teuthology.orchestra.run.smithi178.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T20:34:44.914 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-common. 2023-11-28T20:34:44.929 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:44.973 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:45.310 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 187 MB in 16s (11.5 MB/s) 2023-11-28T20:34:45.457 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T20:34:45.538 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2023-11-28T20:34:45.543 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T20:34:45.589 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T20:34:45.883 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T20:34:45.903 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T20:34:45.941 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T20:34:46.003 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-base. 2023-11-28T20:34:46.018 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:46.070 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:46.244 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T20:34:46.264 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T20:34:46.302 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T20:34:46.622 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T20:34:46.643 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T20:34:46.706 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T20:34:46.765 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T20:34:46.780 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T20:34:46.842 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T20:34:47.109 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T20:34:47.129 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T20:34:47.143 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T20:34:47.157 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T20:34:47.177 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T20:34:47.202 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T20:34:47.521 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T20:34:47.536 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T20:34:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T20:34:47.579 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T20:34:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T20:34:47.637 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T20:34:47.849 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T20:34:47.863 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T20:34:47.907 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T20:34:48.202 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T20:34:48.207 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T20:34:48.216 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T20:34:48.227 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:34:48.260 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T20:34:48.282 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:34:48.546 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T20:34:48.561 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T20:34:48.604 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T20:34:48.768 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T20:34:48.789 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:34:48.835 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:34:48.916 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-portend. 2023-11-28T20:34:48.930 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T20:34:48.966 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T20:34:49.180 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T20:34:49.200 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T20:34:49.230 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:34:49.244 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T20:34:49.259 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T20:34:49.302 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T20:34:49.583 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T20:34:49.603 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T20:34:49.638 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T20:34:49.649 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T20:34:49.653 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T20:34:49.696 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T20:34:49.986 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librados2. 2023-11-28T20:34:50.006 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:50.033 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T20:34:50.043 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:50.047 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T20:34:50.091 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T20:34:50.370 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T20:34:50.384 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T20:34:50.428 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T20:34:50.513 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librbd1. 2023-11-28T20:34:50.535 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:50.571 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:50.739 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T20:34:50.753 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T20:34:50.798 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T20:34:50.949 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T20:34:50.960 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:50.990 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:51.100 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-mako. 2023-11-28T20:34:51.115 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T20:34:51.158 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T20:34:51.276 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rados. 2023-11-28T20:34:51.297 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:51.334 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:51.512 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T20:34:51.526 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T20:34:51.662 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T20:34:51.683 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:34:51.729 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:51.998 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T20:34:52.019 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:52.057 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:52.213 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T20:34:52.309 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T20:34:52.326 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:34:52.359 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:52.628 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T20:34:52.649 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T20:34:52.683 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T20:34:52.687 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T20:34:52.697 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T20:34:52.732 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T20:34:52.964 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T20:34:52.985 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:53.001 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webob. 2023-11-28T20:34:53.016 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T20:34:53.022 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:53.059 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T20:34:53.376 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T20:34:53.396 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T20:34:53.429 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T20:34:53.434 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T20:34:53.444 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T20:34:53.490 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T20:34:53.711 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T20:34:53.723 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T20:34:53.753 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T20:34:53.798 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T20:34:53.812 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T20:34:53.856 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T20:34:54.056 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T20:34:54.077 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T20:34:54.114 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T20:34:54.143 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-paste. 2023-11-28T20:34:54.157 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T20:34:54.201 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T20:34:54.451 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua5.1. 2023-11-28T20:34:54.471 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T20:34:54.509 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T20:34:54.546 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T20:34:54.560 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T20:34:54.604 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T20:34:54.820 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-any. 2023-11-28T20:34:54.841 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T20:34:54.878 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T20:34:54.906 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T20:34:54.920 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T20:34:54.965 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T20:34:55.081 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package zip. 2023-11-28T20:34:55.093 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T20:34:55.131 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T20:34:55.276 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T20:34:55.290 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T20:34:55.326 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T20:34:55.451 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package unzip. 2023-11-28T20:34:55.471 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T20:34:55.509 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T20:34:55.604 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T20:34:55.618 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T20:34:55.662 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T20:34:55.881 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package luarocks. 2023-11-28T20:34:55.900 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T20:34:55.938 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T20:34:55.975 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T20:34:55.989 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T20:34:56.033 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T20:34:56.287 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librgw2. 2023-11-28T20:34:56.308 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:56.336 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:56.395 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-idna. 2023-11-28T20:34:56.408 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T20:34:56.453 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T20:34:56.764 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T20:34:56.778 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T20:34:56.823 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T20:34:56.856 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T20:34:56.876 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:56.914 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:57.167 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-requests. 2023-11-28T20:34:57.181 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T20:34:57.225 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T20:34:57.242 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T20:34:57.263 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T20:34:57.300 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T20:34:57.545 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T20:34:57.559 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T20:34:57.569 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T20:34:57.581 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:57.595 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T20:34:57.611 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:57.873 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T20:34:57.887 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:34:57.931 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:58.015 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-common. 2023-11-28T20:34:58.035 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:58.073 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:58.346 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T20:34:58.360 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:58.403 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:58.706 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T20:34:58.720 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T20:34:58.764 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T20:34:59.091 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T20:34:59.105 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T20:34:59.150 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T20:34:59.429 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-base. 2023-11-28T20:34:59.448 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:59.469 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T20:34:59.483 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:59.495 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:59.528 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:34:59.906 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T20:34:59.920 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:34:59.989 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:00.240 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T20:35:00.261 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T20:35:00.298 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T20:35:00.601 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T20:35:00.622 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T20:35:00.659 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T20:35:00.793 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T20:35:00.808 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:00.884 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:00.996 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T20:35:01.016 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T20:35:01.054 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T20:35:01.349 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T20:35:01.369 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T20:35:01.407 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T20:35:01.710 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T20:35:01.730 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T20:35:01.768 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T20:35:02.013 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T20:35:02.033 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T20:35:02.062 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T20:35:02.121 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph. 2023-11-28T20:35:02.136 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:02.179 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:02.365 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-portend. 2023-11-28T20:35:02.386 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T20:35:02.423 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T20:35:02.498 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T20:35:02.513 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:02.699 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:03.085 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T20:35:03.100 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:03.151 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:03.385 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T20:35:03.406 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T20:35:03.443 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T20:35:03.529 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephadm. 2023-11-28T20:35:03.544 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:03.596 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:03.705 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T20:35:03.725 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T20:35:03.754 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T20:35:03.924 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T20:35:03.939 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T20:35:03.982 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T20:35:04.093 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T20:35:04.112 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T20:35:04.149 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T20:35:04.268 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T20:35:04.283 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T20:35:04.326 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T20:35:04.486 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T20:35:04.506 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T20:35:04.544 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T20:35:04.855 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T20:35:04.876 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T20:35:04.913 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T20:35:05.183 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-mako. 2023-11-28T20:35:05.203 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T20:35:05.241 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T20:35:05.323 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-babel. 2023-11-28T20:35:05.337 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T20:35:05.381 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T20:35:05.552 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T20:35:05.573 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T20:35:05.610 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T20:35:05.725 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T20:35:05.739 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T20:35:05.784 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T20:35:05.922 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T20:35:05.943 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T20:35:05.980 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T20:35:06.129 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T20:35:06.143 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:06.187 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:06.283 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webob. 2023-11-28T20:35:06.303 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T20:35:06.341 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T20:35:06.498 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T20:35:06.513 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T20:35:06.573 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T20:35:06.694 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T20:35:06.714 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T20:35:06.747 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T20:35:06.876 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-routes. 2023-11-28T20:35:06.890 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T20:35:06.934 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T20:35:07.097 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T20:35:07.118 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T20:35:07.155 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T20:35:07.270 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T20:35:07.284 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:07.329 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:07.458 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-paste. 2023-11-28T20:35:07.479 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T20:35:07.516 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T20:35:07.723 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T20:35:07.737 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T20:35:07.807 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T20:35:07.828 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T20:35:07.849 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T20:35:07.877 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T20:35:08.172 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T20:35:08.194 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T20:35:08.230 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T20:35:08.319 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T20:35:08.333 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T20:35:08.377 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T20:35:08.558 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T20:35:08.580 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T20:35:08.616 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T20:35:08.772 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T20:35:08.787 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T20:35:08.908 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T20:35:08.928 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T20:35:08.949 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T20:35:08.986 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T20:35:09.219 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T20:35:09.233 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T20:35:09.277 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T20:35:09.307 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T20:35:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T20:35:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T20:35:09.635 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-idna. 2023-11-28T20:35:09.656 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T20:35:09.685 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T20:35:09.936 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T20:35:09.950 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:09.994 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:10.004 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T20:35:10.026 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T20:35:10.062 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T20:35:10.391 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests. 2023-11-28T20:35:10.412 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T20:35:10.449 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T20:35:10.760 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T20:35:10.781 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T20:35:10.818 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T20:35:10.981 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T20:35:10.996 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T20:35:11.039 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T20:35:11.096 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T20:35:11.108 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:11.155 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:11.300 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T20:35:11.316 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T20:35:11.358 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T20:35:11.526 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T20:35:11.547 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:11.584 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:11.704 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T20:35:11.718 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T20:35:11.762 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T20:35:11.912 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T20:35:11.924 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T20:35:11.962 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T20:35:12.081 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T20:35:12.096 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T20:35:12.140 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T20:35:12.250 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T20:35:12.272 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T20:35:12.300 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T20:35:12.485 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T20:35:12.500 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T20:35:12.543 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T20:35:12.670 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T20:35:12.691 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:12.728 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:12.863 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T20:35:12.878 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T20:35:12.921 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T20:35:13.148 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T20:35:13.169 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:13.199 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T20:35:13.206 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:13.214 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T20:35:13.249 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T20:35:13.569 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T20:35:13.584 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T20:35:13.636 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T20:35:14.160 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T20:35:14.182 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:14.218 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:14.277 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T20:35:14.292 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:14.341 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:14.644 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T20:35:14.658 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T20:35:14.702 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T20:35:15.022 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T20:35:15.036 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T20:35:15.072 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T20:35:15.332 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package jq. 2023-11-28T20:35:15.347 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T20:35:15.391 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T20:35:15.643 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package socat. 2023-11-28T20:35:15.658 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T20:35:15.702 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T20:35:15.980 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T20:35:15.994 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T20:35:16.038 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T20:35:16.121 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph. 2023-11-28T20:35:16.133 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:16.171 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:16.401 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-test. 2023-11-28T20:35:16.415 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:16.459 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:16.507 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T20:35:16.529 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:16.565 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:16.936 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T20:35:16.957 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:16.994 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:17.380 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephadm. 2023-11-28T20:35:17.401 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:17.438 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:17.775 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T20:35:17.796 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T20:35:17.833 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T20:35:18.311 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T20:35:18.332 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T20:35:18.377 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T20:35:18.530 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T20:35:18.546 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:18.588 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:18.975 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T20:35:18.990 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:19.034 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:19.378 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T20:35:19.394 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T20:35:19.436 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T20:35:19.450 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-babel. 2023-11-28T20:35:19.471 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T20:35:19.508 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T20:35:19.697 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T20:35:19.713 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:19.747 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:19.975 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T20:35:19.990 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:19.997 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T20:35:20.019 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T20:35:20.066 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:20.269 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T20:35:20.319 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T20:35:20.334 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:20.377 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:20.648 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T20:35:20.668 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:20.688 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T20:35:20.704 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T20:35:20.705 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:20.746 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T20:35:21.034 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T20:35:21.056 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T20:35:21.101 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T20:35:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T20:35:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T20:35:21.167 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T20:35:21.404 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-routes. 2023-11-28T20:35:21.425 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T20:35:21.462 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T20:35:21.530 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T20:35:21.545 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T20:35:21.588 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T20:35:21.799 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T20:35:21.820 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:21.857 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:21.993 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package pkg-config. 2023-11-28T20:35:22.007 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T20:35:22.051 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T20:35:22.294 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T20:35:22.306 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T20:35:22.312 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T20:35:22.327 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T20:35:22.344 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T20:35:22.370 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T20:35:22.790 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T20:35:22.804 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T20:35:22.865 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T20:35:22.865 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T20:35:22.886 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T20:35:22.931 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T20:35:23.151 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T20:35:23.166 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T20:35:23.209 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T20:35:23.301 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T20:35:23.323 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T20:35:23.462 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T20:35:23.490 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T20:35:23.503 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T20:35:23.549 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T20:35:23.757 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T20:35:23.778 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T20:35:23.823 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T20:35:23.869 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T20:35:23.881 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T20:35:23.925 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T20:35:24.245 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-py. 2023-11-28T20:35:24.260 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T20:35:24.303 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T20:35:24.583 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T20:35:24.599 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T20:35:24.605 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:24.613 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T20:35:24.641 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:24.676 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T20:35:25.103 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T20:35:25.118 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T20:35:25.161 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T20:35:25.472 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-toml. 2023-11-28T20:35:25.486 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T20:35:25.538 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T20:35:25.661 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T20:35:25.683 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T20:35:25.728 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T20:35:25.833 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T20:35:25.848 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T20:35:25.883 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T20:35:26.031 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T20:35:26.053 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T20:35:26.098 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T20:35:26.211 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T20:35:26.226 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T20:35:26.270 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T20:35:26.426 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T20:35:26.449 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T20:35:26.493 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T20:35:26.540 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T20:35:26.554 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T20:35:26.623 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T20:35:26.804 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T20:35:26.826 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T20:35:26.862 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T20:35:27.158 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T20:35:27.180 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T20:35:27.225 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T20:35:27.310 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package radosgw. 2023-11-28T20:35:27.325 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:27.368 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:27.537 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T20:35:27.559 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T20:35:27.595 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T20:35:27.890 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T20:35:27.911 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T20:35:27.954 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T20:35:27.956 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T20:35:27.969 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:28.005 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:28.268 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T20:35:28.289 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T20:35:28.290 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T20:35:28.335 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T20:35:28.585 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T20:35:28.711 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T20:35:28.971 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T20:35:29.058 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T20:35:29.068 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:29.107 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:29.367 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T20:35:29.427 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T20:35:29.449 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T20:35:29.494 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T20:35:29.780 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T20:35:29.802 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T20:35:29.838 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T20:35:29.988 INFO:teuthology.orchestra.run.smithi167.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T20:35:30.038 INFO:teuthology.orchestra.run.smithi167.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T20:35:30.108 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package jq. 2023-11-28T20:35:30.130 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T20:35:30.147 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:30.174 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T20:35:30.428 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package socat. 2023-11-28T20:35:30.446 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T20:35:30.485 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T20:35:30.709 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user cephadm....done 2023-11-28T20:35:30.806 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T20:35:30.827 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T20:35:30.870 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T20:35:30.872 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T20:35:31.138 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T20:35:31.243 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-test. 2023-11-28T20:35:31.256 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:31.293 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:31.415 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T20:35:31.541 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T20:35:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T20:35:32.118 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T20:35:32.244 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T20:35:32.582 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T20:35:32.940 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T20:35:33.208 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T20:35:33.501 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T20:35:33.581 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T20:35:33.605 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:33.647 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:33.994 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T20:35:34.016 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:34.052 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:34.085 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T20:35:34.378 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T20:35:34.380 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T20:35:34.402 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T20:35:34.447 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T20:35:34.630 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T20:35:34.717 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T20:35:34.738 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:34.783 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:34.890 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T20:35:35.028 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T20:35:35.050 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T20:35:35.094 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:35.178 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:35.364 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T20:35:35.376 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:35.414 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:35.450 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T20:35:35.576 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T20:35:35.702 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T20:35:35.742 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T20:35:35.764 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T20:35:35.809 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T20:35:35.969 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T20:35:36.114 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T20:35:36.120 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T20:35:36.126 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T20:35:36.155 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T20:35:36.372 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T20:35:36.535 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T20:35:36.557 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T20:35:36.601 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T20:35:36.804 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T20:35:36.836 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T20:35:36.900 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T20:35:37.015 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package pkg-config. 2023-11-28T20:35:37.037 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T20:35:37.051 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T20:35:37.074 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T20:35:37.335 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T20:35:37.348 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T20:35:37.385 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T20:35:37.461 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T20:35:37.578 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T20:35:37.814 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T20:35:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T20:35:37.835 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T20:35:37.880 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T20:35:38.106 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T20:35:38.183 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T20:35:38.205 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T20:35:38.250 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T20:35:38.441 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T20:35:38.537 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T20:35:38.559 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T20:35:38.567 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T20:35:38.595 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T20:35:38.815 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T20:35:38.837 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T20:35:38.873 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T20:35:39.218 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-py. 2023-11-28T20:35:39.240 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T20:35:39.252 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T20:35:39.284 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T20:35:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T20:35:39.613 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T20:35:39.635 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T20:35:39.637 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T20:35:39.679 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T20:35:39.738 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T20:35:40.082 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T20:35:40.176 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T20:35:40.198 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T20:35:40.242 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T20:35:40.483 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T20:35:40.562 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-toml. 2023-11-28T20:35:40.586 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T20:35:40.628 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T20:35:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T20:35:40.932 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T20:35:40.953 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T20:35:40.998 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T20:35:41.178 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T20:35:41.369 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T20:35:41.391 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T20:35:41.452 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T20:35:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T20:35:41.722 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T20:35:41.734 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T20:35:41.772 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T20:35:41.780 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T20:35:42.123 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T20:35:42.382 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T20:35:42.508 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:42.560 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package radosgw. 2023-11-28T20:35:42.581 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:42.626 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:42.818 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T20:35:43.169 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T20:35:43.396 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T20:35:43.408 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T20:35:43.437 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:43.740 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T20:35:43.993 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T20:35:44.119 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T20:35:44.383 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T20:35:44.401 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T20:35:44.677 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:35:44.740 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T20:35:44.820 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T20:35:45.104 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T20:35:45.206 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T20:35:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T20:35:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:45.315 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T20:35:45.617 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T20:35:45.814 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user cephadm....done 2023-11-28T20:35:45.893 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T20:35:45.969 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T20:35:46.160 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:35:46.246 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T20:35:46.278 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T20:35:46.505 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T20:35:46.580 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T20:35:46.631 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T20:35:46.848 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T20:35:46.891 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T20:35:47.115 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T20:35:47.159 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T20:35:47.285 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T20:35:47.383 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T20:35:47.587 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T20:35:47.643 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T20:35:47.927 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T20:35:47.947 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T20:35:48.053 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T20:35:48.206 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T20:35:48.346 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T20:35:48.447 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T20:35:48.474 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T20:35:48.732 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T20:35:48.751 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T20:35:49.041 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T20:35:49.053 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T20:35:49.309 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T20:35:49.320 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T20:35:49.435 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T20:35:49.561 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T20:35:49.638 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T20:35:49.650 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T20:35:49.888 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T20:35:49.922 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:50.014 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T20:35:50.199 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T20:35:50.325 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T20:35:50.432 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T20:35:50.451 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T20:35:50.708 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T20:35:50.710 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T20:35:50.834 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T20:35:51.102 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:35:51.220 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T20:35:51.256 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T20:35:51.521 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T20:35:51.529 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T20:35:51.814 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T20:35:51.939 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T20:35:51.969 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T20:35:52.033 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T20:35:52.099 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T20:35:52.159 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T20:35:52.319 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T20:35:52.544 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T20:35:52.603 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T20:35:52.695 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T20:35:52.880 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T20:35:52.979 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T20:35:53.173 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T20:35:53.256 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T20:35:53.549 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T20:35:53.591 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T20:35:53.717 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T20:35:53.842 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T20:35:54.220 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T20:35:54.355 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:54.456 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:54.460 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T20:35:54.574 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T20:35:54.728 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T20:35:54.854 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T20:35:54.960 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:54.980 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T20:35:55.078 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:55.179 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T20:35:55.306 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T20:35:55.464 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:55.582 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:55.708 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:55.743 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T20:35:55.950 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T20:35:55.950 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T20:35:55.994 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T20:35:56.379 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T20:35:56.592 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:56.688 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T20:35:56.743 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:56.869 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:56.996 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:57.014 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T20:35:57.105 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T20:35:57.341 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T20:35:57.634 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T20:35:57.760 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:58.053 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T20:35:58.359 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:58.378 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T20:35:58.485 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:58.644 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:58.770 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:58.897 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:59.014 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:35:59.568 INFO:teuthology.orchestra.run.smithi167.stdout:Adding group ceph....done 2023-11-28T20:35:59.593 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T20:35:59.870 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:35:59.927 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user ceph....done 2023-11-28T20:36:00.029 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T20:36:00.097 INFO:teuthology.orchestra.run.smithi167.stdout:Setting system user ceph properties....done 2023-11-28T20:36:00.119 INFO:teuthology.orchestra.run.smithi167.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T20:36:00.259 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T20:36:00.313 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T20:36:00.464 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T20:36:00.616 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T20:36:00.665 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T20:36:00.925 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T20:36:01.185 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T20:36:01.355 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:01.461 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:36:01.567 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T20:36:01.567 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T20:36:01.645 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T20:36:01.971 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T20:36:02.234 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:02.239 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T20:36:02.377 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:02.515 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T20:36:02.783 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T20:36:02.952 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T20:36:02.952 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T20:36:03.067 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T20:36:03.335 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T20:36:03.469 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T20:36:03.652 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:03.770 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T20:36:03.896 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T20:36:04.138 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T20:36:04.197 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T20:36:04.507 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T20:36:04.786 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T20:36:04.820 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:04.926 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T20:36:05.036 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T20:36:05.036 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T20:36:05.052 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T20:36:05.159 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T20:36:05.412 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T20:36:05.538 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T20:36:05.706 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:05.919 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T20:36:05.919 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T20:36:05.931 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T20:36:06.207 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T20:36:06.333 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T20:36:06.582 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:06.592 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T20:36:06.718 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T20:36:06.905 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T20:36:06.905 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T20:36:07.053 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T20:36:07.362 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T20:36:07.542 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:07.655 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T20:36:07.668 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:07.803 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:07.858 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T20:36:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T20:36:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T20:36:08.126 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T20:36:08.410 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T20:36:08.612 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:08.678 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T20:36:08.730 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:08.881 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:09.024 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:09.071 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T20:36:09.356 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T20:36:09.377 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T20:36:09.486 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T20:36:09.621 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T20:36:09.755 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T20:36:09.885 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:10.028 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:10.195 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T20:36:10.372 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T20:36:10.598 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:10.749 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:10.900 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T20:36:11.070 INFO:teuthology.orchestra.run.smithi167.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T20:36:11.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T20:36:11.150 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2023-11-28T20:36:11.202 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:11.316 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2023-11-28T20:36:11.317 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2023-11-28T20:36:11.336 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:11.471 INFO:teuthology.orchestra.run.smithi167.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T20:36:11.471 INFO:teuthology.orchestra.run.smithi167.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T20:36:11.471 INFO:teuthology.orchestra.run.smithi167.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T20:36:11.471 INFO:teuthology.orchestra.run.smithi167.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T20:36:11.471 INFO:teuthology.orchestra.run.smithi167.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T20:36:11.471 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T20:36:11.471 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T20:36:11.472 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T20:36:11.472 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T20:36:11.472 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T20:36:11.473 INFO:teuthology.orchestra.run.smithi167.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T20:36:11.473 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T20:36:11.473 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2023-11-28T20:36:11.473 INFO:teuthology.orchestra.run.smithi167.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T20:36:11.473 INFO:teuthology.orchestra.run.smithi167.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T20:36:11.473 INFO:teuthology.orchestra.run.smithi167.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T20:36:11.474 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T20:36:11.474 INFO:teuthology.orchestra.run.smithi167.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T20:36:11.474 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2023-11-28T20:36:11.474 INFO:teuthology.orchestra.run.smithi167.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T20:36:11.474 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T20:36:11.475 INFO:teuthology.orchestra.run.smithi167.stdout: libengine-pkcs11-openssl 2023-11-28T20:36:11.487 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:11.523 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2023-11-28T20:36:11.524 INFO:teuthology.orchestra.run.smithi167.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T20:36:11.524 INFO:teuthology.orchestra.run.smithi167.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T20:36:11.524 INFO:teuthology.orchestra.run.smithi167.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T20:36:11.524 INFO:teuthology.orchestra.run.smithi167.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T20:36:11.524 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T20:36:11.525 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T20:36:11.525 INFO:teuthology.orchestra.run.smithi167.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T20:36:11.525 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages will be upgraded: 2023-11-28T20:36:11.526 INFO:teuthology.orchestra.run.smithi167.stdout: libssl3 2023-11-28T20:36:11.586 INFO:teuthology.orchestra.run.smithi167.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T20:36:11.587 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 54.6 MB of archives. 2023-11-28T20:36:11.587 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T20:36:11.587 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T20:36:11.707 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T20:36:11.742 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T20:36:11.742 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T20:36:11.773 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T20:36:11.783 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T20:36:11.783 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T20:36:11.785 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T20:36:11.787 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T20:36:11.788 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T20:36:11.789 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T20:36:11.790 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T20:36:11.790 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T20:36:11.794 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T20:36:11.811 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T20:36:12.152 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T20:36:12.154 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T20:36:12.154 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T20:36:12.157 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T20:36:12.157 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T20:36:12.162 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T20:36:12.164 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T20:36:12.172 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T20:36:12.172 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T20:36:12.197 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T20:36:12.200 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T20:36:12.212 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T20:36:12.239 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T20:36:12.243 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T20:36:12.243 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T20:36:12.244 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T20:36:12.245 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T20:36:12.257 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T20:36:12.258 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T20:36:12.313 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:12.448 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:12.531 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T20:36:12.531 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T20:36:12.531 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T20:36:12.531 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T20:36:12.532 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T20:36:12.532 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T20:36:12.572 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T20:36:12.572 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T20:36:12.573 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:12.700 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:12.826 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T20:36:12.957 INFO:teuthology.orchestra.run.smithi167.stdout:Preconfiguring packages ... 2023-11-28T20:36:13.112 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 54.6 MB in 1s (52.5 MB/s) 2023-11-28T20:36:13.221 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package flex. 2023-11-28T20:36:13.293 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-11-28T20:36:13.296 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T20:36:13.344 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T20:36:13.914 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T20:36:14.063 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:14.092 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T20:36:14.172 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:14.298 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:14.424 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:14.474 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:36:14.559 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:14.684 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:15.028 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package bison. 2023-11-28T20:36:15.101 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-11-28T20:36:15.104 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T20:36:15.147 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T20:36:15.354 INFO:teuthology.orchestra.run.smithi178.stdout:Adding group ceph....done 2023-11-28T20:36:15.531 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T20:36:15.546 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T20:36:15.581 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T20:36:15.722 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user ceph....done 2023-11-28T20:36:15.893 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package dump. 2023-11-28T20:36:15.899 INFO:teuthology.orchestra.run.smithi178.stdout:Setting system user ceph properties....done 2023-11-28T20:36:15.907 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T20:36:15.917 INFO:teuthology.orchestra.run.smithi178.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T20:36:15.951 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T20:36:16.055 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T20:36:16.230 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package indent. 2023-11-28T20:36:16.244 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:16.288 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T20:36:16.370 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T20:36:16.557 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T20:36:16.572 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T20:36:16.607 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T20:36:16.862 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:16.911 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T20:36:16.925 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T20:36:16.969 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T20:36:17.171 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T20:36:17.171 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T20:36:17.230 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T20:36:17.244 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T20:36:17.289 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T20:36:17.634 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T20:36:17.648 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T20:36:17.680 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:17.684 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T20:36:17.780 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:17.911 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T20:36:17.926 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T20:36:17.969 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T20:36:18.222 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T20:36:18.237 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T20:36:18.250 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T20:36:18.250 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T20:36:18.298 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T20:36:18.609 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T20:36:18.624 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T20:36:18.667 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T20:36:18.950 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:19.314 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T20:36:19.835 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:20.076 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T20:36:20.077 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T20:36:20.128 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T20:36:20.144 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T20:36:20.187 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:36:20.439 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T20:36:20.455 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T20:36:20.490 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:36:20.817 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T20:36:20.833 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T20:36:20.858 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:20.875 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:36:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T20:36:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T20:36:21.211 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T20:36:21.227 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T20:36:21.270 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T20:36:21.598 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T20:36:21.613 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T20:36:21.626 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:21.681 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T20:36:22.009 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T20:36:22.009 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T20:36:22.017 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T20:36:22.033 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:22.067 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:22.420 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T20:36:22.435 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:22.478 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:36:22.480 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:22.700 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:22.806 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T20:36:22.822 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:22.864 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:36:22.911 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:23.116 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T20:36:23.132 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T20:36:23.173 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T20:36:23.173 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T20:36:23.175 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:36:23.654 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T20:36:23.668 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T20:36:23.699 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:23.703 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T20:36:23.859 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:23.985 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:24.048 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package modemmanager. 2023-11-28T20:36:24.063 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T20:36:24.107 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:36:24.144 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T20:36:24.506 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T20:36:24.598 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T20:36:24.755 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package network-manager. 2023-11-28T20:36:24.767 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T20:36:24.770 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T20:36:24.821 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T20:36:25.454 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ppp. 2023-11-28T20:36:25.469 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T20:36:25.609 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T20:36:25.810 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T20:36:26.117 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T20:36:26.131 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T20:36:26.175 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T20:36:26.234 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T20:36:26.237 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T20:36:26.290 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2023-11-28T20:36:26.444 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T20:36:26.458 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T20:36:26.477 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2023-11-28T20:36:26.478 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2023-11-28T20:36:26.503 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T20:36:26.645 INFO:teuthology.orchestra.run.smithi178.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T20:36:26.646 INFO:teuthology.orchestra.run.smithi178.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T20:36:26.646 INFO:teuthology.orchestra.run.smithi178.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T20:36:26.646 INFO:teuthology.orchestra.run.smithi178.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T20:36:26.646 INFO:teuthology.orchestra.run.smithi178.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T20:36:26.646 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T20:36:26.646 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T20:36:26.646 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T20:36:26.647 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T20:36:26.647 INFO:teuthology.orchestra.run.smithi178.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-28T20:36:26.647 INFO:teuthology.orchestra.run.smithi178.stdout: python2.7-minimal 2023-11-28T20:36:26.647 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T20:36:26.647 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2023-11-28T20:36:26.648 INFO:teuthology.orchestra.run.smithi178.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T20:36:26.648 INFO:teuthology.orchestra.run.smithi178.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T20:36:26.648 INFO:teuthology.orchestra.run.smithi178.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T20:36:26.648 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T20:36:26.648 INFO:teuthology.orchestra.run.smithi178.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T20:36:26.649 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2023-11-28T20:36:26.649 INFO:teuthology.orchestra.run.smithi178.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T20:36:26.649 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T20:36:26.649 INFO:teuthology.orchestra.run.smithi178.stdout: libengine-pkcs11-openssl 2023-11-28T20:36:26.687 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2023-11-28T20:36:26.688 INFO:teuthology.orchestra.run.smithi178.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T20:36:26.688 INFO:teuthology.orchestra.run.smithi178.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T20:36:26.688 INFO:teuthology.orchestra.run.smithi178.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T20:36:26.688 INFO:teuthology.orchestra.run.smithi178.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T20:36:26.689 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T20:36:26.689 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T20:36:26.689 INFO:teuthology.orchestra.run.smithi178.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T20:36:26.690 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages will be upgraded: 2023-11-28T20:36:26.690 INFO:teuthology.orchestra.run.smithi178.stdout: libssl3 2023-11-28T20:36:26.839 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T20:36:26.853 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T20:36:26.871 INFO:teuthology.orchestra.run.smithi178.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T20:36:26.871 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 54.6 MB of archives. 2023-11-28T20:36:26.872 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T20:36:26.872 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T20:36:26.889 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T20:36:27.201 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T20:36:27.216 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:27.260 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:27.348 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T20:36:27.605 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T20:36:27.640 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T20:36:27.642 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T20:36:27.647 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T20:36:27.650 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T20:36:27.651 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T20:36:27.654 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T20:36:27.656 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T20:36:27.657 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T20:36:27.821 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T20:36:27.840 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T20:36:27.854 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T20:36:27.916 INFO:teuthology.orchestra.run.smithi167.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T20:36:27.947 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-common (238) ... 2023-11-28T20:36:28.133 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T20:36:28.447 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T20:36:28.462 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:28.508 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:29.293 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T20:36:29.297 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T20:36:29.351 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T20:36:29.357 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T20:36:29.357 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T20:36:29.369 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T20:36:29.372 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T20:36:29.390 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T20:36:29.390 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T20:36:29.592 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql. 2023-11-28T20:36:29.599 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T20:36:29.608 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T20:36:29.651 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql (14+238) ... 2023-11-28T20:36:29.681 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T20:36:29.870 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T20:36:29.884 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T20:36:29.928 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T20:36:30.163 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T20:36:30.197 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T20:36:30.227 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T20:36:30.255 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T20:36:30.292 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T20:36:30.304 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T20:36:30.306 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T20:36:30.307 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T20:36:30.308 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T20:36:30.341 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T20:36:30.345 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T20:36:30.574 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T20:36:30.589 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T20:36:30.633 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T20:36:30.837 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T20:36:30.886 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package tcl. 2023-11-28T20:36:30.901 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T20:36:30.940 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T20:36:31.080 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T20:36:31.165 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T20:36:31.165 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T20:36:31.246 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T20:36:31.255 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T20:36:31.314 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T20:36:31.329 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T20:36:31.372 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T20:36:31.702 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T20:36:31.716 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T20:36:31.717 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T20:36:31.718 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T20:36:31.761 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T20:36:32.124 INFO:teuthology.orchestra.run.smithi178.stdout:Preconfiguring packages ... 2023-11-28T20:36:32.180 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T20:36:32.196 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T20:36:32.239 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T20:36:32.287 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 54.6 MB in 5s (10.9 MB/s) 2023-11-28T20:36:32.415 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package flex. 2023-11-28T20:36:32.497 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T20:36:32.503 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138139 files and directories currently installed.) 2023-11-28T20:36:32.507 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T20:36:32.547 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T20:36:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T20:36:32.838 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T20:36:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T20:36:33.123 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T20:36:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T20:36:33.302 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T20:36:33.341 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:33.752 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:36:34.304 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package bison. 2023-11-28T20:36:34.345 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T20:36:34.390 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138212 files and directories currently installed.) 2023-11-28T20:36:34.395 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T20:36:34.440 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T20:36:34.447 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T20:36:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T20:36:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T20:36:34.864 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T20:36:34.886 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T20:36:34.931 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T20:36:35.276 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package dump. 2023-11-28T20:36:35.298 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T20:36:35.334 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T20:36:35.604 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package indent. 2023-11-28T20:36:35.617 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T20:36:35.654 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T20:36:35.777 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:36:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T20:36:35.924 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T20:36:35.946 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T20:36:35.999 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T20:36:36.029 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T20:36:36.155 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T20:36:36.281 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T20:36:36.311 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T20:36:36.333 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T20:36:36.377 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T20:36:36.407 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T20:36:36.621 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T20:36:36.634 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T20:36:36.671 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T20:36:37.034 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T20:36:37.056 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T20:36:37.071 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T20:36:37.100 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T20:36:37.197 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T20:36:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T20:36:37.352 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T20:36:37.357 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:36:37.365 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T20:36:37.402 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T20:36:37.483 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T20:36:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T20:36:37.647 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T20:36:37.669 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T20:36:37.705 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T20:36:37.761 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T20:36:37.887 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T20:36:37.977 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T20:36:38.008 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T20:36:38.030 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T20:36:38.038 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T20:36:38.075 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T20:36:38.156 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T20:36:38.349 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T20:36:38.475 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:36:38.618 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T20:36:38.794 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T20:36:38.920 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T20:36:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:36:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T20:36:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:which means they are currently configured by ifupdown: 2023-11-28T20:36:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:- enp3s0f1 2023-11-28T20:36:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T20:36:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T20:36:39.522 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:36:39.655 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T20:36:39.769 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T20:36:39.791 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T20:36:39.827 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:36:40.073 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T20:36:40.130 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T20:36:40.152 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T20:36:40.196 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:36:40.476 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T20:36:40.533 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T20:36:40.555 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T20:36:40.599 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:36:40.960 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T20:36:40.982 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T20:36:41.018 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T20:36:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:36:41.316 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T20:36:41.338 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T20:36:41.360 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T20:36:41.405 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T20:36:41.450 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T20:36:41.577 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-common (238) ... 2023-11-28T20:36:41.766 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T20:36:41.788 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:41.832 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:42.185 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T20:36:42.208 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:42.252 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:36:42.513 INFO:teuthology.orchestra.run.smithi167.stdout:Adding user postgres to group ssl-cert 2023-11-28T20:36:42.596 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T20:36:42.618 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:42.663 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:36:42.791 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:36:42.791 INFO:teuthology.orchestra.run.smithi167.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T20:36:42.873 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T20:36:42.886 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T20:36:42.923 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:36:43.055 INFO:teuthology.orchestra.run.smithi167.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T20:36:43.055 INFO:teuthology.orchestra.run.smithi167.stdout:Removing obsolete dictionary files: 2023-11-28T20:36:43.427 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T20:36:43.449 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T20:36:43.494 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T20:36:43.792 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T20:36:43.813 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package modemmanager. 2023-11-28T20:36:43.836 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T20:36:43.880 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:36:44.270 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:44.536 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package network-manager. 2023-11-28T20:36:44.558 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T20:36:44.601 INFO:teuthology.orchestra.run.smithi167.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T20:36:44.611 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T20:36:44.632 INFO:teuthology.orchestra.run.smithi167.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T20:36:44.687 INFO:teuthology.orchestra.run.smithi167.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T20:36:44.687 INFO:teuthology.orchestra.run.smithi167.stdout:This user must also own the server process. 2023-11-28T20:36:44.687 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:36:44.687 INFO:teuthology.orchestra.run.smithi167.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T20:36:44.687 INFO:teuthology.orchestra.run.smithi167.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T20:36:44.687 INFO:teuthology.orchestra.run.smithi167.stdout:The default text search configuration will be set to "english". 2023-11-28T20:36:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:36:44.688 INFO:teuthology.orchestra.run.smithi167.stdout:Data page checksums are disabled. 2023-11-28T20:36:44.688 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:36:44.688 INFO:teuthology.orchestra.run.smithi167.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T20:36:44.689 INFO:teuthology.orchestra.run.smithi167.stdout:creating subdirectories ... ok 2023-11-28T20:36:44.689 INFO:teuthology.orchestra.run.smithi167.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T20:36:44.713 INFO:teuthology.orchestra.run.smithi167.stdout:selecting default max_connections ... 100 2023-11-28T20:36:44.748 INFO:teuthology.orchestra.run.smithi167.stdout:selecting default shared_buffers ... 128MB 2023-11-28T20:36:44.762 INFO:teuthology.orchestra.run.smithi167.stdout:selecting default time zone ... Etc/UTC 2023-11-28T20:36:44.762 INFO:teuthology.orchestra.run.smithi167.stdout:creating configuration files ... ok 2023-11-28T20:36:44.931 INFO:teuthology.orchestra.run.smithi167.stdout:running bootstrap script ... ok 2023-11-28T20:36:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ppp. 2023-11-28T20:36:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T20:36:45.496 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T20:36:45.559 INFO:teuthology.orchestra.run.smithi167.stdout:performing post-bootstrap initialization ... ok 2023-11-28T20:36:45.790 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T20:36:45.802 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T20:36:45.841 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T20:36:46.046 INFO:teuthology.orchestra.run.smithi167.stdout:syncing data to disk ... ok 2023-11-28T20:36:46.093 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T20:36:46.105 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T20:36:46.142 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T20:36:46.445 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T20:36:46.468 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T20:36:46.512 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T20:36:46.579 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T20:36:46.844 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T20:36:46.865 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:46.910 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:47.498 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T20:36:47.520 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T20:36:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T20:36:47.603 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-common (238) ... 2023-11-28T20:36:48.205 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T20:36:48.228 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T20:36:48.275 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:49.599 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql. 2023-11-28T20:36:49.623 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T20:36:49.666 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql (14+238) ... 2023-11-28T20:36:49.902 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T20:36:49.924 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T20:36:49.937 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:36:49.968 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T20:36:50.063 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T20:36:50.189 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql (14+238) ... 2023-11-28T20:36:50.195 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T20:36:50.209 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T20:36:50.245 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T20:36:50.315 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:36:50.441 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:36:50.565 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T20:36:50.587 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T20:36:50.631 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T20:36:50.701 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T20:36:50.701 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T20:36:50.942 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package tcl. 2023-11-28T20:36:50.955 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T20:36:51.013 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T20:36:51.354 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T20:36:51.376 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T20:36:51.420 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T20:36:51.469 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T20:36:51.779 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T20:36:51.807 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T20:36:51.821 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T20:36:51.858 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T20:36:51.931 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T20:36:52.253 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T20:36:52.275 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T20:36:52.327 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T20:36:52.606 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T20:36:53.217 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T20:36:53.293 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T20:36:53.317 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T20:36:53.459 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T20:36:53.585 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:53.695 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T20:36:53.821 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T20:36:53.889 INFO:teuthology.orchestra.run.smithi167.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T20:36:53.894 DEBUG:teuthology.parallel:result is None 2023-11-28T20:36:53.946 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:36:54.437 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T20:36:54.518 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T20:36:54.908 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T20:36:54.908 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T20:36:55.454 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T20:36:55.580 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T20:36:55.706 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T20:36:55.832 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T20:36:55.957 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T20:36:56.067 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T20:36:56.193 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T20:36:56.839 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T20:36:56.965 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T20:36:57.059 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T20:36:57.117 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:36:57.243 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T20:36:57.369 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T20:36:57.495 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T20:36:57.621 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T20:36:57.710 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T20:36:57.781 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T20:36:57.949 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T20:36:58.117 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T20:36:58.226 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:36:58.335 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T20:36:59.146 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T20:36:59.271 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T20:36:59.734 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:36:59.734 INFO:teuthology.orchestra.run.smithi178.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T20:36:59.734 INFO:teuthology.orchestra.run.smithi178.stdout:which means they are currently configured by ifupdown: 2023-11-28T20:36:59.734 INFO:teuthology.orchestra.run.smithi178.stdout:- enp3s0f1 2023-11-28T20:36:59.734 INFO:teuthology.orchestra.run.smithi178.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T20:36:59.735 INFO:teuthology.orchestra.run.smithi178.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T20:36:59.735 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:36:59.845 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T20:37:00.199 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T20:37:00.557 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T20:37:01.149 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T20:37:01.309 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T20:37:01.435 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T20:37:01.553 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-common (238) ... 2023-11-28T20:37:02.411 INFO:teuthology.orchestra.run.smithi178.stdout:Adding user postgres to group ssl-cert 2023-11-28T20:37:02.602 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:02.602 INFO:teuthology.orchestra.run.smithi178.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T20:37:02.799 INFO:teuthology.orchestra.run.smithi178.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T20:37:02.799 INFO:teuthology.orchestra.run.smithi178.stdout:Removing obsolete dictionary files: 2023-11-28T20:37:03.392 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T20:37:03.829 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T20:37:04.160 INFO:teuthology.orchestra.run.smithi178.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T20:37:04.180 INFO:teuthology.orchestra.run.smithi178.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T20:37:04.233 INFO:teuthology.orchestra.run.smithi178.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T20:37:04.233 INFO:teuthology.orchestra.run.smithi178.stdout:This user must also own the server process. 2023-11-28T20:37:04.233 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:04.233 INFO:teuthology.orchestra.run.smithi178.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T20:37:04.234 INFO:teuthology.orchestra.run.smithi178.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T20:37:04.234 INFO:teuthology.orchestra.run.smithi178.stdout:The default text search configuration will be set to "english". 2023-11-28T20:37:04.234 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:04.234 INFO:teuthology.orchestra.run.smithi178.stdout:Data page checksums are disabled. 2023-11-28T20:37:04.234 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:04.234 INFO:teuthology.orchestra.run.smithi178.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T20:37:04.235 INFO:teuthology.orchestra.run.smithi178.stdout:creating subdirectories ... ok 2023-11-28T20:37:04.235 INFO:teuthology.orchestra.run.smithi178.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T20:37:04.249 INFO:teuthology.orchestra.run.smithi178.stdout:selecting default max_connections ... 100 2023-11-28T20:37:04.270 INFO:teuthology.orchestra.run.smithi178.stdout:selecting default shared_buffers ... 128MB 2023-11-28T20:37:04.280 INFO:teuthology.orchestra.run.smithi178.stdout:selecting default time zone ... Etc/UTC 2023-11-28T20:37:04.280 INFO:teuthology.orchestra.run.smithi178.stdout:creating configuration files ... ok 2023-11-28T20:37:04.394 INFO:teuthology.orchestra.run.smithi178.stdout:running bootstrap script ... ok 2023-11-28T20:37:05.028 INFO:teuthology.orchestra.run.smithi178.stdout:performing post-bootstrap initialization ... ok 2023-11-28T20:37:05.857 INFO:teuthology.orchestra.run.smithi178.stdout:syncing data to disk ... ok 2023-11-28T20:37:06.283 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T20:37:09.086 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:37:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T20:37:09.338 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql (14+238) ... 2023-11-28T20:37:09.464 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T20:37:09.590 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T20:37:09.850 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T20:37:09.851 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T20:37:10.442 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T20:37:10.753 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T20:37:10.921 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T20:37:12.390 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T20:37:12.498 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T20:37:12.980 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T20:37:12.983 DEBUG:teuthology.parallel:result is None 2023-11-28T20:37:12.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:37:13.134 DEBUG:teuthology.orchestra.run.smithi167:> dpkg-query -W -f '${Version}' ceph 2023-11-28T20:37:13.158 INFO:teuthology.orchestra.run.smithi167.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:37:13.159 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:37:13.159 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T20:37:13.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:37:13.418 DEBUG:teuthology.orchestra.run.smithi178:> dpkg-query -W -f '${Version}' ceph 2023-11-28T20:37:13.438 INFO:teuthology.orchestra.run.smithi178.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:37:13.438 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:37:13.438 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T20:37:13.438 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T20:37:13.439 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:13.439 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T20:37:13.462 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:13.462 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T20:37:13.492 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T20:37:13.492 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:13.492 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T20:37:13.524 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T20:37:13.591 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:13.592 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T20:37:13.605 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T20:37:13.659 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T20:37:13.659 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:13.659 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T20:37:13.681 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T20:37:13.743 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:13.743 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T20:37:13.756 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T20:37:13.810 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T20:37:13.810 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:13.810 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T20:37:13.832 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T20:37:13.898 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:13.899 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T20:37:13.912 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T20:37:13.966 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T20:37:14.031 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T20:37:14.031 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2023-11-28T20:37:14.035 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2023-11-28T20:37:14.052 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T20:37:14.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T20:37:14.097 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T20:37:14.115 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T20:37:14.115 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T20:37:14.161 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T20:37:14.186 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T20:37:14.187 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T20:37:14.187 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T20:37:14.187 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:14.187 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T20:37:14.231 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T20:37:14.328 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:14.328 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T20:37:14.334 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T20:37:14.416 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T20:37:14.416 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T20:37:14.417 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469646', 'branch': 'wip-vshankar-testing-20231127.102914', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7469646', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102914'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102914', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8377, 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'sleep_before_teardown': 0, 'subset': '462/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102914', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCskwrcA6DOeqohfyTpjn6+o9LJSy77pb11BWaHeEcM0PRjoe3f4efl6E+iFd4mCFvkldYfxnmFIacpjmZzTBjc=', 'smithi178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOKLRvfGw2YW10yLVu2DIExNmriE9uosktgdOhIBkDg6gim+KBbqdKaykwn/XN8Y1ejjRvkJ/m8UVYK6dPFpuuU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'cluster': 'ceph'}}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_06:29:14', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T20:37:14.417 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T20:37:14.421 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T20:37:14.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T20:37:14.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T20:37:14.516 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:14.516 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T20:37:14.542 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T20:37:14.542 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2023-11-28T20:37:14.599 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T20:37:14.599 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:37:14.599 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 891 Links: 1 2023-11-28T20:37:14.599 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:37:14.599 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-28 20:30:33.413820566 +0000 2023-11-28T20:37:14.599 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-28 20:30:33.025824032 +0000 2023-11-28T20:37:14.599 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-28 20:30:33.025824032 +0000 2023-11-28T20:37:14.599 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-11-28 20:30:33.025824032 +0000 2023-11-28T20:37:14.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T20:37:14.660 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-28T20:37:14.661 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-28T20:37:14.661 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000645799 s, 793 kB/s 2023-11-28T20:37:14.662 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T20:37:14.716 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2023-11-28T20:37:14.770 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T20:37:14.770 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:37:14.771 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 907 Links: 1 2023-11-28T20:37:14.771 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:37:14.771 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-28 20:30:33.685818137 +0000 2023-11-28T20:37:14.771 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-28 20:30:33.681818173 +0000 2023-11-28T20:37:14.771 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-28 20:30:33.681818173 +0000 2023-11-28T20:37:14.771 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-11-28 20:30:33.681818173 +0000 2023-11-28T20:37:14.771 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T20:37:14.837 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-28T20:37:14.837 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-28T20:37:14.837 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000344949 s, 1.5 MB/s 2023-11-28T20:37:14.839 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T20:37:14.896 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2023-11-28T20:37:14.946 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T20:37:14.947 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:37:14.947 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 926 Links: 1 2023-11-28T20:37:14.947 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:37:14.947 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-28 20:30:34.789808276 +0000 2023-11-28T20:37:14.947 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-28 20:30:34.381811920 +0000 2023-11-28T20:37:14.947 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-28 20:30:34.381811920 +0000 2023-11-28T20:37:14.947 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-11-28 20:30:34.381811920 +0000 2023-11-28T20:37:14.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T20:37:15.008 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-28T20:37:15.008 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-28T20:37:15.008 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000370214 s, 1.4 MB/s 2023-11-28T20:37:15.010 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T20:37:15.065 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2023-11-28T20:37:15.119 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T20:37:15.119 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:37:15.119 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 941 Links: 1 2023-11-28T20:37:15.119 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:37:15.119 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-11-28 20:30:35.469802201 +0000 2023-11-28T20:37:15.119 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-28 20:30:35.057805881 +0000 2023-11-28T20:37:15.119 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-28 20:30:35.057805881 +0000 2023-11-28T20:37:15.119 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-11-28 20:30:35.057805881 +0000 2023-11-28T20:37:15.120 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T20:37:15.185 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-11-28T20:37:15.185 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-11-28T20:37:15.185 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000369259 s, 1.4 MB/s 2023-11-28T20:37:15.187 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T20:37:15.240 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:15.240 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:15.240 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T20:37:15.246 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T20:37:15.247 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2023-11-28T20:37:15.295 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T20:37:15.296 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:37:15.296 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 875 Links: 1 2023-11-28T20:37:15.296 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:37:15.296 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-11-28 20:30:04.734417635 +0000 2023-11-28T20:37:15.296 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-11-28 20:30:04.330421244 +0000 2023-11-28T20:37:15.296 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-11-28 20:30:04.330421244 +0000 2023-11-28T20:37:15.296 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-11-28T20:37:15.296 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T20:37:15.351 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-11-28T20:37:15.351 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-11-28T20:37:15.351 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000275997 s, 1.9 MB/s 2023-11-28T20:37:15.352 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T20:37:15.401 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2023-11-28T20:37:15.447 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T20:37:15.447 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:37:15.447 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 896 Links: 1 2023-11-28T20:37:15.447 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:37:15.447 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-11-28 20:30:05.322412383 +0000 2023-11-28T20:37:15.447 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-11-28 20:30:04.966415563 +0000 2023-11-28T20:37:15.447 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-11-28 20:30:04.966415563 +0000 2023-11-28T20:37:15.448 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-11-28T20:37:15.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T20:37:15.500 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-11-28T20:37:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-11-28T20:37:15.501 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.0002178 s, 2.4 MB/s 2023-11-28T20:37:15.502 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T20:37:15.552 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2023-11-28T20:37:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T20:37:15.599 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:37:15.599 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-11-28T20:37:15.600 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:37:15.600 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-11-28 20:30:05.934406917 +0000 2023-11-28T20:37:15.600 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-11-28 20:30:05.546410382 +0000 2023-11-28T20:37:15.600 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-11-28 20:30:05.546410382 +0000 2023-11-28T20:37:15.600 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-11-28T20:37:15.600 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T20:37:15.653 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-11-28T20:37:15.654 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-11-28T20:37:15.654 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000328128 s, 1.6 MB/s 2023-11-28T20:37:15.655 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T20:37:15.705 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2023-11-28T20:37:15.751 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T20:37:15.751 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T20:37:15.751 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 926 Links: 1 2023-11-28T20:37:15.751 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:37:15.751 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-11-28 20:30:06.578401165 +0000 2023-11-28T20:37:15.751 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-11-28 20:30:06.166404844 +0000 2023-11-28T20:37:15.751 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-11-28 20:30:06.166404844 +0000 2023-11-28T20:37:15.751 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-11-28T20:37:15.752 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T20:37:15.806 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-11-28T20:37:15.806 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-11-28T20:37:15.806 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.00033166 s, 1.5 MB/s 2023-11-28T20:37:15.807 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T20:37:15.856 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:15.857 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T20:37:15.857 INFO:tasks.ceph:Generating config... 2023-11-28T20:37:15.858 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T20:37:15.858 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2023-11-28T20:37:15.858 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T20:37:15.858 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T20:37:15.858 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T20:37:15.858 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T20:37:15.859 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] mds bal merge size = 5 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] mds bal split bits = 3 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] mds bal split size = 100 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = False 2023-11-28T20:37:15.859 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] ms inject delay max = 1 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T20:37:15.860 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T20:37:15.861 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T20:37:15.861 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T20:37:15.861 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T20:37:15.861 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T20:37:15.861 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T20:37:15.861 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T20:37:15.861 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T20:37:15.861 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T20:37:15.861 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-28T20:37:15.861 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-28T20:37:15.861 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T20:37:15.861 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] ms inject delay max = 1 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T20:37:15.862 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-11-28T20:37:15.863 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T20:37:15.863 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T20:37:15.863 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T20:37:15.863 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T20:37:15.909 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T20:37:15.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T20:37:16.019 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T20:37:16.039 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.167'), ('mon.b', '172.21.15.178'), ('mon.c', '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]')] 2023-11-28T20:37:16.040 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.167,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T20:37:16.040 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:16.041 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T20:37:16.091 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.167 --add b 172.21.15.178 --addv c '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:16.181 INFO:teuthology.orchestra.run.smithi167.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:16.182 INFO:teuthology.orchestra.run.smithi167.stdout:monmaptool: generated fsid 4f385093-4252-4ae9-94ab-503723a001fd 2023-11-28T20:37:16.182 INFO:teuthology.orchestra.run.smithi167.stdout:setting min_mon_release = pacific 2023-11-28T20:37:16.182 INFO:teuthology.orchestra.run.smithi167.stdout:epoch 0 2023-11-28T20:37:16.182 INFO:teuthology.orchestra.run.smithi167.stdout:fsid 4f385093-4252-4ae9-94ab-503723a001fd 2023-11-28T20:37:16.182 INFO:teuthology.orchestra.run.smithi167.stdout:last_changed 2023-11-28T20:37:16.182016+0000 2023-11-28T20:37:16.182 INFO:teuthology.orchestra.run.smithi167.stdout:created 2023-11-28T20:37:16.182016+0000 2023-11-28T20:37:16.182 INFO:teuthology.orchestra.run.smithi167.stdout:min_mon_release 16 (pacific) 2023-11-28T20:37:16.182 INFO:teuthology.orchestra.run.smithi167.stdout:election_strategy: 1 2023-11-28T20:37:16.182 INFO:teuthology.orchestra.run.smithi167.stdout:0: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.a 2023-11-28T20:37:16.183 INFO:teuthology.orchestra.run.smithi167.stdout:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2023-11-28T20:37:16.183 INFO:teuthology.orchestra.run.smithi167.stdout:2: [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] mon.c 2023-11-28T20:37:16.183 INFO:teuthology.orchestra.run.smithi167.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T20:37:16.185 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T20:37:16.193 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4f385093-4252-4ae9-94ab-503723a001fd... 2023-11-28T20:37:16.194 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T20:37:16.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T20:37:16.268 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2023-11-28T20:37:16.268 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2023-11-28T20:37:16.268 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2023-11-28T20:37:16.269 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2023-11-28T20:37:16.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.271 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.167,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 4f385093-4252-4ae9-94ab-503723a001fd 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2023-11-28T20:37:16.272 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2023-11-28T20:37:16.273 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.274 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 20 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 20 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 10 2023-11-28T20:37:16.275 INFO:teuthology.orchestra.run.smithi178.stdout: mon client directed command retry = 5 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: ms inject delay max = 1 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: ms inject delay probability = 0.005 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: ms inject delay type = client mds 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: ms inject socket failures = 2500 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: osd blocked scrub grace period = 3600 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: osd max markdown count = 1000 2023-11-28T20:37:16.276 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.277 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-11-28T20:37:16.278 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.279 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: client_shutdown_timeout = 120 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2023-11-28T20:37:16.280 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.e] 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.f] 2023-11-28T20:37:16.281 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: mds bal fragment size max = 10000 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: mds bal merge size = 5 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: mds bal split bits = 3 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: mds bal split size = 100 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: mds oft prefetch dirfrags = False 2023-11-28T20:37:16.282 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = True 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: mds_dir_prefetch = True 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: mds_sleep_rank_change = 5000000.0 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: mon client directed command retry = 5 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: ms inject delay max = 1 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: ms inject delay probability = 0.005 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: ms inject delay type = client mds osd 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: ms inject socket failures = 2500 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-11-28T20:37:16.283 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-11-28T20:37:16.284 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2023-11-28T20:37:16.284 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2023-11-28T20:37:16.284 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T20:37:16.284 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2023-11-28T20:37:16.284 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T20:37:16.285 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2023-11-28T20:37:16.286 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2023-11-28T20:37:16.287 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.167,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = 4f385093-4252-4ae9-94ab-503723a001fd 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2023-11-28T20:37:16.288 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2023-11-28T20:37:16.289 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2023-11-28T20:37:16.290 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: mon client directed command retry = 5 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: ms inject delay max = 1 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: ms inject delay probability = 0.005 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: ms inject delay type = client mds 2023-11-28T20:37:16.291 INFO:teuthology.orchestra.run.smithi167.stdout: ms inject socket failures = 2500 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: osd blocked scrub grace period = 3600 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: osd max markdown count = 1000 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-11-28T20:37:16.292 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-11-28T20:37:16.293 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T20:37:16.294 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T20:37:16.295 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout: client_shutdown_timeout = 120 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2023-11-28T20:37:16.296 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.e] 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.f] 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout: mds bal fragment size max = 10000 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout: mds bal merge size = 5 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout: mds bal split bits = 3 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout: mds bal split size = 100 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2023-11-28T20:37:16.297 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: mds oft prefetch dirfrags = False 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: mds_dir_prefetch = True 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: mds_sleep_rank_change = 5000000.0 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: mon client directed command retry = 5 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: ms inject delay max = 1 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: ms inject delay probability = 0.005 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: ms inject delay type = client mds osd 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: ms inject socket failures = 2500 2023-11-28T20:37:16.298 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2023-11-28T20:37:16.299 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2023-11-28T20:37:16.299 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2023-11-28T20:37:16.300 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T20:37:16.300 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T20:37:16.400 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T20:37:16.400 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:16.400 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T20:37:16.409 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:16.409 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T20:37:16.463 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T20:37:16.463 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:16.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T20:37:16.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T20:37:16.538 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:16.538 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:16.590 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2023-11-28T20:37:16.591 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:16.591 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T20:37:16.591 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T20:37:16.615 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:16.615 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:16.663 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T20:37:16.664 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T20:37:16.664 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T20:37:16.719 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T20:37:16.724 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T20:37:16.768 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T20:37:16.785 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T20:37:16.786 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T20:37:16.841 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T20:37:16.845 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T20:37:16.866 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T20:37:16.965 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T20:37:16.970 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T20:37:16.991 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-11-28T20:37:17.089 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-11-28T20:37:17.093 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-11-28T20:37:17.114 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T20:37:17.159 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T20:37:17.162 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T20:37:17.175 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T20:37:17.256 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T20:37:17.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T20:37:17.315 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-11-28T20:37:17.399 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-11-28T20:37:17.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-11-28T20:37:17.457 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T20:37:17.458 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T20:37:17.502 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T20:37:17.519 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T20:37:17.519 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T20:37:17.519 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T20:37:17.585 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:17.586 INFO:tasks.ceph:role: osd.0 2023-11-28T20:37:17.586 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T20:37:17.586 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T20:37:17.654 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:37:17.654 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:37:17.654 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:37:17.655 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:37:17.655 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:37:17.655 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:37:17.655 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:37:17.656 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:37:17.656 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:37:17.656 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:37:18.113 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-28T20:37:18.116 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-28T20:37:18.116 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T20:37:18.223 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T20:37:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:37:18.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:37:18.241 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T20:37:18.302 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:18.302 INFO:tasks.ceph:role: osd.1 2023-11-28T20:37:18.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T20:37:18.302 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T20:37:18.369 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:37:18.370 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:37:18.370 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:37:18.370 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:37:18.370 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:37:18.370 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:37:18.370 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:37:18.370 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:37:18.370 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:37:18.370 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:37:18.855 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-28T20:37:18.858 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-28T20:37:18.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T20:37:19.012 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T20:37:19.029 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:37:19.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:37:19.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T20:37:19.090 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:19.090 INFO:tasks.ceph:role: osd.2 2023-11-28T20:37:19.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T20:37:19.091 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:37:19.163 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:37:19.641 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-28T20:37:19.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-28T20:37:19.643 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T20:37:19.782 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T20:37:19.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:37:19.802 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:37:19.802 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T20:37:19.868 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:19.869 INFO:tasks.ceph:role: osd.3 2023-11-28T20:37:19.869 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T20:37:19.869 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T20:37:19.939 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:37:19.939 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:37:19.940 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:37:19.940 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:37:19.940 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:37:19.940 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:37:19.940 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:37:19.940 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:37:19.940 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:37:19.940 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:37:20.382 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2023-11-28T20:37:20.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-11-28T20:37:20.386 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T20:37:20.487 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T20:37:20.505 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:37:20.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:37:20.507 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:20.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:20.625+0000 7f7beac2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T20:37:20.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:20.629+0000 7f7beac2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T20:37:20.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:20.629+0000 7f7beac2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T20:37:20.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:20.629+0000 7f7beac2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T20:37:20.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:20.629+0000 7f7beac2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T20:37:20.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:20.633+0000 7f7beac2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T20:37:23.614 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T20:37:23.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:23.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:23.729+0000 7f7cbd57e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T20:37:23.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:23.729+0000 7f7cbd57e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T20:37:23.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:23.729+0000 7f7cbd57e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T20:37:23.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:23.729+0000 7f7cbd57e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T20:37:23.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:23.729+0000 7f7cbd57e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T20:37:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:23.733+0000 7f7cbd57e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T20:37:26.726 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T20:37:26.748 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:26.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:26.845+0000 7fe35ae2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T20:37:26.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:26.845+0000 7fe35ae2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T20:37:26.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:26.845+0000 7fe35ae2b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T20:37:26.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:26.845+0000 7fe35ae2b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T20:37:26.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:26.845+0000 7fe35ae2b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T20:37:26.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:26.849+0000 7fe35ae2b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T20:37:29.859 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T20:37:29.881 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:29.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:29.977+0000 7facc4a60640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T20:37:29.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:29.977+0000 7facc4a60640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T20:37:29.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:29.977+0000 7facc4a60640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T20:37:29.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:29.977+0000 7facc4a60640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T20:37:29.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:29.977+0000 7facc4a60640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T20:37:29.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:29.977+0000 7facc4a60640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T20:37:32.965 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T20:37:32.986 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T20:37:33.000 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:33.001 INFO:tasks.ceph:role: osd.4 2023-11-28T20:37:33.001 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2023-11-28T20:37:33.001 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T20:37:33.059 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:37:33.059 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:37:33.059 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:37:33.060 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:37:33.060 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:37:33.060 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:37:33.060 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:37:33.060 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:37:33.060 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:37:33.060 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:37:33.083 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-11-28T20:37:33.084 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-11-28T20:37:33.085 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T20:37:33.145 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T20:37:33.195 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:37:33.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:37:33.196 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T20:37:33.250 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:33.250 INFO:tasks.ceph:role: osd.5 2023-11-28T20:37:33.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2023-11-28T20:37:33.251 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T20:37:33.306 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:37:33.306 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:37:33.306 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:37:33.306 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:37:33.306 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:37:33.306 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:37:33.307 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:37:33.307 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:37:33.307 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:37:33.307 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:37:33.330 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-11-28T20:37:33.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-11-28T20:37:33.331 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T20:37:33.394 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T20:37:33.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:37:33.448 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:37:33.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T20:37:33.502 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:33.502 INFO:tasks.ceph:role: osd.6 2023-11-28T20:37:33.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2023-11-28T20:37:33.502 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T20:37:33.555 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:37:33.555 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:37:33.555 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:37:33.555 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:37:33.555 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:37:33.556 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:37:33.556 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:37:33.556 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:37:33.556 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:37:33.556 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:37:33.579 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-11-28T20:37:33.581 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-11-28T20:37:33.581 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T20:37:33.637 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T20:37:33.688 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:37:33.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:37:33.690 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T20:37:33.743 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T20:37:33.744 INFO:tasks.ceph:role: osd.7 2023-11-28T20:37:33.744 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com 2023-11-28T20:37:33.744 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T20:37:33.798 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T20:37:33.798 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T20:37:33.798 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T20:37:33.798 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T20:37:33.798 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T20:37:33.799 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-11-28T20:37:33.799 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T20:37:33.799 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T20:37:33.799 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T20:37:33.799 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T20:37:33.822 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-11-28T20:37:33.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-11-28T20:37:33.824 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T20:37:33.883 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T20:37:33.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:37:33.936 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T20:37:33.936 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:34.044 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:34.042+0000 7f5e8f9d7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T20:37:34.044 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:34.042+0000 7f5e8f9d7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T20:37:34.044 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:34.042+0000 7f5e8f9d7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T20:37:34.045 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:34.042+0000 7f5e8f9d7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T20:37:34.045 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:34.042+0000 7f5e8f9d7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T20:37:34.045 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:34.042+0000 7f5e8f9d7640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T20:37:37.039 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T20:37:37.053 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:37.133 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:37.130+0000 7f1e2ec0a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T20:37:37.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:37.130+0000 7f1e2ec0a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T20:37:37.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:37.130+0000 7f1e2ec0a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T20:37:37.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:37.130+0000 7f1e2ec0a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T20:37:37.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:37.130+0000 7f1e2ec0a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T20:37:37.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:37.130+0000 7f1e2ec0a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T20:37:40.139 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T20:37:40.197 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:40.279 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:40.278+0000 7f0923abe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T20:37:40.279 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:40.278+0000 7f0923abe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T20:37:40.280 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:40.278+0000 7f0923abe640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T20:37:40.280 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:40.278+0000 7f0923abe640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T20:37:40.280 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:40.278+0000 7f0923abe640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T20:37:40.280 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:40.278+0000 7f0923abe640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T20:37:43.282 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T20:37:43.339 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:43.422 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:43.418+0000 7f6ebd4da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T20:37:43.423 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:43.418+0000 7f6ebd4da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T20:37:43.423 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:43.418+0000 7f6ebd4da640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T20:37:43.423 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:43.418+0000 7f6ebd4da640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T20:37:43.423 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:43.418+0000 7f6ebd4da640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T20:37:43.423 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:43.422+0000 7f6ebd4da640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T20:37:44.419 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:37:44.423 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:37:46.414 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T20:37:46.428 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T20:37:46.428 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:46.428 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T20:37:46.451 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:46.451 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T20:37:46.516 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:46.516 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T20:37:46.579 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:46.580 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-11-28T20:37:46.643 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:46.643 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T20:37:46.711 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:46.711 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T20:37:46.775 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:46.775 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T20:37:46.838 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:46.839 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T20:37:46.903 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:46.903 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T20:37:46.916 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:46.916 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T20:37:46.970 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:46.970 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T20:37:47.021 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:47.022 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-11-28T20:37:47.076 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:47.077 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T20:37:47.129 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:47.130 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T20:37:47.182 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:47.182 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T20:37:47.237 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:47.237 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T20:37:47.290 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:47.290 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T20:37:47.299 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T20:37:47.299 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T20:37:47.349 DEBUG:teuthology.orchestra.run.smithi178:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T20:37:47.360 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.y] 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB8T2Zlu17oKhAAFkrVA4Dx1kkrtZ5+zcSTQA== 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB8T2Zl8DUpMhAAV6ze0ZFg7hg1qjKHWJAmbw== 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB8T2Zl4YiTORAAcSDiiUGQAz9ut2l/2UG5jA== 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.e] 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB9T2Zl/ZtQBRAAsSR+D3nmQnRjd+xjRUA+wg== 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCAT2ZlyTmCJRAAKP764s5/2UWjam0CEAfkPg== 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2023-11-28T20:37:47.361 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCDT2ZlltXFKxAAJVbOrAyYr7k/aHWwmyOKFw== 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCGT2ZlkP2XMhAAA8DQLTjlPXbAXv1Wq3qulQ== 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.3] 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCJT2Zl9rJqOhAA8QFXuAuV3AmNJkQ/tYWQxw== 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.x] 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB8T2ZlEpLWLRAA5hxKbq7dXessUW4/2Rcf9g== 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB9T2Zlr7CICRAAQnZfzp8XGV2MSMxuOlfI1Q== 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB9T2ZlNgBODxAA95p/H3bnTNSTPNF5AsMa+g== 2023-11-28T20:37:47.362 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.f] 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB9T2ZlYGraFxAAK494macCmmLjYTGjUVEa8A== 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.4] 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCOT2ZlGdinAhAAm6AHvFtKb25tArxHRvySMA== 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.5] 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCRT2Zlt774BxAAgUdph/aPAqiFuZCYymiv7Q== 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.6] 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCUT2ZlgR6oEBAAl0XU50xdYjI/EZiVoz13jQ== 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.7] 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCXT2ZlWbE1GRAAtiosVBEOJ8K3u+v5mjm0NQ== 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout:[client.0] 2023-11-28T20:37:47.363 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB9T2Zl36j2HRAAHJo1QpOp8dlHqhzkUtNFzg== 2023-11-28T20:37:47.365 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2023-11-28T20:37:47.365 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB8T2Zlu17oKhAAFkrVA4Dx1kkrtZ5+zcSTQA== 2023-11-28T20:37:47.365 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2023-11-28T20:37:47.365 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB8T2Zl8DUpMhAAV6ze0ZFg7hg1qjKHWJAmbw== 2023-11-28T20:37:47.365 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2023-11-28T20:37:47.365 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB8T2Zl4YiTORAAcSDiiUGQAz9ut2l/2UG5jA== 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.e] 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB9T2Zl/ZtQBRAAsSR+D3nmQnRjd+xjRUA+wg== 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCAT2ZlyTmCJRAAKP764s5/2UWjam0CEAfkPg== 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCDT2ZlltXFKxAAJVbOrAyYr7k/aHWwmyOKFw== 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCGT2ZlkP2XMhAAA8DQLTjlPXbAXv1Wq3qulQ== 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCJT2Zl9rJqOhAA8QFXuAuV3AmNJkQ/tYWQxw== 2023-11-28T20:37:47.366 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB8T2ZlEpLWLRAA5hxKbq7dXessUW4/2Rcf9g== 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB9T2Zlr7CICRAAQnZfzp8XGV2MSMxuOlfI1Q== 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB9T2ZlNgBODxAA95p/H3bnTNSTPNF5AsMa+g== 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.f] 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB9T2ZlYGraFxAAK494macCmmLjYTGjUVEa8A== 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCOT2ZlGdinAhAAm6AHvFtKb25tArxHRvySMA== 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCRT2Zlt774BxAAgUdph/aPAqiFuZCYymiv7Q== 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2023-11-28T20:37:47.367 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCUT2ZlgR6oEBAAl0XU50xdYjI/EZiVoz13jQ== 2023-11-28T20:37:47.368 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2023-11-28T20:37:47.368 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCXT2ZlWbE1GRAAtiosVBEOJ8K3u+v5mjm0NQ== 2023-11-28T20:37:47.368 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2023-11-28T20:37:47.368 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB9T2Zl36j2HRAAHJo1QpOp8dlHqhzkUtNFzg== 2023-11-28T20:37:47.369 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T20:37:47.414 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T20:37:47.467 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:47.470 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:47.525 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:47.528 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:47.601 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:47.605 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:47.687 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:47.691 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:47.775 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:47.779 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:47.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:47.833 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:47.900 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:47.903 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:47.983 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T20:37:47.987 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T20:37:48.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:48.071 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:48.157 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:48.161 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:48.214 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:48.218 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T20:37:48.284 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:48.288 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:48.364 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:48.368 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:48.446 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:48.450 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:48.537 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:48.541 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T20:37:48.621 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:37:48.625 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T20:37:48.707 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T20:37:48.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T20:37:48.728 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T20:37:48.841 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T20:37:48.863 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T20:37:48.878 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T20:37:48.975 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T20:37:48.988 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T20:37:49.045 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T20:37:49.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T20:37:49.151 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:49.155 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T20:37:49.198 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T20:37:49.198 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T20:37:49.198 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T20:37:49.209 INFO:tasks.ceph.mon.a:Started 2023-11-28T20:37:49.210 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T20:37:49.210 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T20:37:49.244 INFO:tasks.ceph.mon.b:Started 2023-11-28T20:37:49.244 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:37:49.244 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:37:49.246 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:37:49.246 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T20:37:49.246 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T20:37:49.247 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T20:37:49.250 INFO:tasks.ceph.mgr.y:Started 2023-11-28T20:37:49.251 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T20:37:49.251 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T20:37:49.253 INFO:tasks.ceph.mgr.x:Started 2023-11-28T20:37:49.253 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T20:37:49.253 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T20:37:49.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.389+0000 7fa16fed6640 1 Processor -- start 2023-11-28T20:37:49.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.389+0000 7fa16fed6640 1 -- start start 2023-11-28T20:37:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16fed6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16fed6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16fed6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16fed6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1680c6ac0 con 0x7fa1680c6ff0 2023-11-28T20:37:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16fed6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1680c6500 con 0x7fa1680c5be0 2023-11-28T20:37:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16fed6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680c67e0 con 0x7fa168150b40 2023-11-28T20:37:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16d471640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16d471640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37204/0 (socket says 172.21.15.167:37204) 2023-11-28T20:37:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 learned_addr learned my addr 172.21.15.167:0/1636956439 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:37:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 msgr2=0x7fa1680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:37:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 msgr2=0x7fa1680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:37:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16e473640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 msgr2=0x7fa16806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:37:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16e473640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 msgr2=0x7fa16806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16dc72640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 msgr2=0x7fa168157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:37:49.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:49.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16dc72640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 msgr2=0x7fa168157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:49.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:49.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:37:49.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.393+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:37:49.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:49.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 msgr2=0x7fa1680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:37:49.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 msgr2=0x7fa1680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16e473640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 msgr2=0x7fa16806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16e473640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 msgr2=0x7fa16806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16dc72640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 msgr2=0x7fa168157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16dc72640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 msgr2=0x7fa168157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:37:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:49.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:49.597+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:37:50.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:50.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 msgr2=0x7fa1680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 msgr2=0x7fa1680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16dc72640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 msgr2=0x7fa168157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16e473640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 msgr2=0x7fa16806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16dc72640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 msgr2=0x7fa168157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16e473640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 msgr2=0x7fa16806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:37:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.001+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:37:50.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:50.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 msgr2=0x7fa1680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:37:50.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 msgr2=0x7fa1680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16e473640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 msgr2=0x7fa16806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16e473640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 msgr2=0x7fa16806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16dc72640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 msgr2=0x7fa168157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16dc72640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 msgr2=0x7fa168157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:37:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:50.805+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:37:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:52.393+0000 7fa15f7fe640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 msgr2=0x7fa168157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:37:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:52.393+0000 7fa15f7fe640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa168150b40 0x7fa168157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:52.393+0000 7fa15f7fe640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 msgr2=0x7fa16806a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:37:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:52.393+0000 7fa15f7fe640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.178:3300/0 conn(0x7fa1680c5be0 0x7fa16806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:52.393+0000 7fa15f7fe640 1 -- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 msgr2=0x7fa1680c4510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:37:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:52.393+0000 7fa15f7fe640 1 --2- 172.21.15.167:0/1636956439 >> v2:172.21.15.167:3300/0 conn(0x7fa1680c6ff0 0x7fa1680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:52.393+0000 7fa15f7fe640 1 -- 172.21.15.167:0/1636956439 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa168156a80 con 0x7fa154007310 2023-11-28T20:37:52.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:52.393+0000 7fa15f7fe640 1 -- 172.21.15.167:0/1636956439 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15400c080 con 0x7fa1540036a0 2023-11-28T20:37:54.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956263234 0 0) 0x7fa168156a80 con 0x7fa154007310 2023-11-28T20:37:54.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa14c003530 con 0x7fa154007310 2023-11-28T20:37:54.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730912274 0 0) 0x7fa14c003530 con 0x7fa154007310 2023-11-28T20:37:54.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 >> v1:172.21.15.178:6789/0 conn(0x7fa1540036a0 legacy=0x7fa154005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:54.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15400d280 con 0x7fa154007310 2023-11-28T20:37:54.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fa1580107a0 con 0x7fa154007310 2023-11-28T20:37:54.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 >> v1:172.21.15.167:6789/0 conn(0x7fa154007310 legacy=0x7fa1540097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16e473640 1 -- 172.21.15.167:0/1636956439 reap_dead start 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa14c003a50 0x7fa14c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c0047d0 0x7fa14c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c009980 0x7fa14c00bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c00c360 con 0x7fa14c0047d0 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c00c4d0 con 0x7fa14c003a50 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.605+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c00c690 con 0x7fa14c009980 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.609+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c0047d0 0x7fa14c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.609+0000 7fa16e473640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c009980 0x7fa14c00bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.609+0000 7fa16dc72640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa14c003a50 0x7fa14c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:54.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.609+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c009980 msgr2=0x7fa14c00bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:54.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.609+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c009980 0x7fa14c00bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.609+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa14c003a50 msgr2=0x7fa14c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:54.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.609+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa14c003a50 0x7fa14c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.609+0000 7fa16d471640 1 -- 172.21.15.167:0/1636956439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c003530 con 0x7fa14c0047d0 2023-11-28T20:37:54.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16d471640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c0047d0 0x7fa14c004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa158013740 tx=0x7fa15801f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ad00c22d68428b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:54.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1580a8510 con 0x7fa14c0047d0 2023-11-28T20:37:54.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15800c040 con 0x7fa14c0047d0 2023-11-28T20:37:54.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16cc70640 1 -- 172.21.15.167:0/1636956439 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1580a88d0 con 0x7fa14c0047d0 2023-11-28T20:37:54.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16fed6640 1 -- 172.21.15.167:0/1636956439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c0047d0 msgr2=0x7fa14c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:54.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16fed6640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c0047d0 0x7fa14c004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa158013740 tx=0x7fa15801f880 comp rx=0 tx=0).stop 2023-11-28T20:37:54.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16fed6640 1 -- 172.21.15.167:0/1636956439 shutdown_connections 2023-11-28T20:37:54.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16fed6640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c009980 0x7fa14c00bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16fed6640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c0047d0 0x7fa14c004c50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16fed6640 1 --2- 172.21.15.167:0/1636956439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa14c003a50 0x7fa14c003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16fed6640 1 -- 172.21.15.167:0/1636956439 >> 172.21.15.167:0/1636956439 conn(0x7fa1680cb1e0 msgr2=0x7fa1680cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:54.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16fed6640 1 -- 172.21.15.167:0/1636956439 shutdown_connections 2023-11-28T20:37:54.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.613+0000 7fa16fed6640 1 -- 172.21.15.167:0/1636956439 wait complete. 2023-11-28T20:37:54.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 Processor -- start 2023-11-28T20:37:54.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 -- start start 2023-11-28T20:37:54.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c003a50 0x7fa168157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c0047d0 0x7fa1680c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa14c009980 0x7fa168153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1681f2e70 con 0x7fa14c003a50 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa168158270 con 0x7fa14c009980 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1681f2230 con 0x7fa14c0047d0 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16d471640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c0047d0 0x7fa1680c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16d471640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c0047d0 0x7fa1680c1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:59844/0 (socket says 172.21.15.167:59844) 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16d471640 1 -- 172.21.15.167:0/2234932281 learned_addr learned my addr 172.21.15.167:0/2234932281 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16d471640 1 -- 172.21.15.167:0/2234932281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa14c009980 msgr2=0x7fa168153c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16d471640 1 --2- 172.21.15.167:0/2234932281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa14c009980 0x7fa168153c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16d471640 1 -- 172.21.15.167:0/2234932281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c003a50 msgr2=0x7fa168157c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:37:54.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16d471640 1 --2- 172.21.15.167:0/2234932281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c003a50 0x7fa168157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16d471640 1 -- 172.21.15.167:0/2234932281 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1681f24d0 con 0x7fa14c0047d0 2023-11-28T20:37:54.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16d471640 1 --2- 172.21.15.167:0/2234932281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c0047d0 0x7fa1680c1fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1580b2040 tx=0x7fa14c005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:54.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa15e7fc640 1 -- 172.21.15.167:0/2234932281 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1580105a0 con 0x7fa14c0047d0 2023-11-28T20:37:54.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa15e7fc640 1 -- 172.21.15.167:0/2234932281 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa158010720 con 0x7fa14c0047d0 2023-11-28T20:37:54.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa15e7fc640 1 -- 172.21.15.167:0/2234932281 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158004020 con 0x7fa14c0047d0 2023-11-28T20:37:54.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 -- 172.21.15.167:0/2234932281 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1681f27b0 con 0x7fa14c0047d0 2023-11-28T20:37:54.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa16fed6640 1 -- 172.21.15.167:0/2234932281 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa168154550 con 0x7fa14c0047d0 2023-11-28T20:37:54.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa15e7fc640 1 -- 172.21.15.167:0/2234932281 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa158003620 con 0x7fa14c0047d0 2023-11-28T20:37:54.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.617+0000 7fa15e7fc640 1 -- 172.21.15.167:0/2234932281 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa1580a8850 con 0x7fa14c0047d0 2023-11-28T20:37:54.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.621+0000 7fa16fed6640 1 -- 172.21.15.167:0/2234932281 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1680682c0 con 0x7fa14c0047d0 2023-11-28T20:37:54.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.625+0000 7fa15e7fc640 1 -- 172.21.15.167:0/2234932281 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa1580bd030 con 0x7fa14c0047d0 2023-11-28T20:37:54.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.685+0000 7fa16fed6640 1 -- 172.21.15.167:0/2234932281 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa1680682c0 con 0x7fa14c0047d0 2023-11-28T20:37:54.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.693+0000 7fa15e7fc640 1 -- 172.21.15.167:0/2234932281 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa158013410 con 0x7fa14c0047d0 2023-11-28T20:37:54.697 INFO:teuthology.orchestra.run.smithi167.stderr:adjusted tunables profile to default 2023-11-28T20:37:54.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.693+0000 7fa16fed6640 1 -- 172.21.15.167:0/2234932281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c0047d0 msgr2=0x7fa1680c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:54.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.693+0000 7fa16fed6640 1 --2- 172.21.15.167:0/2234932281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c0047d0 0x7fa1680c1fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1580b2040 tx=0x7fa14c005800 comp rx=0 tx=0).stop 2023-11-28T20:37:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.693+0000 7fa16fed6640 1 -- 172.21.15.167:0/2234932281 shutdown_connections 2023-11-28T20:37:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.693+0000 7fa16fed6640 1 --2- 172.21.15.167:0/2234932281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa14c009980 0x7fa168153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.693+0000 7fa16fed6640 1 --2- 172.21.15.167:0/2234932281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa14c0047d0 0x7fa1680c1fd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.693+0000 7fa16fed6640 1 --2- 172.21.15.167:0/2234932281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa14c003a50 0x7fa168157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.693+0000 7fa16fed6640 1 -- 172.21.15.167:0/2234932281 >> 172.21.15.167:0/2234932281 conn(0x7fa1680cb1e0 msgr2=0x7fa1681547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.693+0000 7fa16fed6640 1 -- 172.21.15.167:0/2234932281 shutdown_connections 2023-11-28T20:37:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:54.697+0000 7fa16fed6640 1 -- 172.21.15.167:0/2234932281 wait complete. 2023-11-28T20:37:54.718 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T20:37:54.718 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T20:37:54.718 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:54.718 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T20:37:54.739 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:54.739 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T20:37:54.802 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:54.802 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T20:37:54.826 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:54.821+0000 7fa907447180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T20:37:54.847 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:37:54.847 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T20:37:54.910 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:54.911 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T20:37:54.925 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:54.926 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T20:37:54.977 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:54.973+0000 7f310c3e1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T20:37:54.979 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:54.979 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T20:37:55.033 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-11-28T20:37:55.033 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T20:37:55.087 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 8a0f86cc-d969-4253-a608-79a4910723d5 0 2023-11-28T20:37:55.249 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47bd13f640 1 Processor -- start 2023-11-28T20:37:55.249 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47bd13f640 1 -- start start 2023-11-28T20:37:55.250 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47bd13f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f47b80c6d00 0x7f47b8157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.250 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47bd13f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f47b80c85f0 0x7f47b8158310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47bd13f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b80c74d0 con 0x7f47b8151f70 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47bd13f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b80c71f0 con 0x7f47b80c6d00 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47bd13f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b806a620 con 0x7f47b80c85f0 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47b759e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f47b80c85f0 0x7f47b8158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47b759e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f47b80c85f0 0x7f47b8158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:49538/0 (socket says 172.21.15.178:49538) 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.245+0000 7f47b759e640 1 -- 172.21.15.178:0/1585173750 learned_addr learned my addr 172.21.15.178:0/1585173750 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47b659c640 1 --2- 172.21.15.178:0/1585173750 >> v2:172.21.15.167:3300/0 conn(0x7f47b80c6d00 0x7f47b8157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47b759e640 1 -- 172.21.15.178:0/1585173750 >> v2:172.21.15.167:3300/0 conn(0x7f47b80c6d00 msgr2=0x7f47b8157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47b759e640 1 --2- 172.21.15.178:0/1585173750 >> v2:172.21.15.167:3300/0 conn(0x7f47b80c6d00 0x7f47b8157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47b759e640 1 -- 172.21.15.178:0/1585173750 >> v1:172.21.15.167:6789/0 conn(0x7f47b8151f70 legacy=0x7f47b80c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:55.252 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47b759e640 1 -- 172.21.15.178:0/1585173750 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b806a900 con 0x7f47b80c85f0 2023-11-28T20:37:55.253 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47b759e640 1 --2- 172.21.15.178:0/1585173750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b80c85f0 0x7f47b8158310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f47b80c7c50 tx=0x7f47b001c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1f61b42e152172 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:55.253 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47b5d9b640 1 -- 172.21.15.178:0/1585173750 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00a5870 con 0x7f47b80c85f0 2023-11-28T20:37:55.253 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47b5d9b640 1 -- 172.21.15.178:0/1585173750 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b00a59d0 con 0x7f47b80c85f0 2023-11-28T20:37:55.253 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47b5d9b640 1 -- 172.21.15.178:0/1585173750 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00a5d60 con 0x7f47b80c85f0 2023-11-28T20:37:55.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47bd13f640 1 -- 172.21.15.178:0/1585173750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b80c85f0 msgr2=0x7f47b8158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47bd13f640 1 --2- 172.21.15.178:0/1585173750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b80c85f0 0x7f47b8158310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f47b80c7c50 tx=0x7f47b001c990 comp rx=0 tx=0).stop 2023-11-28T20:37:55.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47bd13f640 1 -- 172.21.15.178:0/1585173750 shutdown_connections 2023-11-28T20:37:55.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47bd13f640 1 --2- 172.21.15.178:0/1585173750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b80c85f0 0x7f47b8158310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47bd13f640 1 --2- 172.21.15.178:0/1585173750 >> v2:172.21.15.167:3300/0 conn(0x7f47b80c6d00 0x7f47b8157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47bd13f640 1 -- 172.21.15.178:0/1585173750 >> 172.21.15.178:0/1585173750 conn(0x7f47b80cc300 msgr2=0x7f47b80cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:55.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47bd13f640 1 -- 172.21.15.178:0/1585173750 shutdown_connections 2023-11-28T20:37:55.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.249+0000 7f47bd13f640 1 -- 172.21.15.178:0/1585173750 wait complete. 2023-11-28T20:37:55.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 Processor -- start 2023-11-28T20:37:55.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 -- start start 2023-11-28T20:37:55.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b80c6d00 0x7f47b8156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47b80c85f0 0x7f47b8146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b8151f70 0x7f47b8159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8156950 con 0x7f47b80c6d00 2023-11-28T20:37:55.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8157320 con 0x7f47b8151f70 2023-11-28T20:37:55.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8155a60 con 0x7f47b80c85f0 2023-11-28T20:37:55.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b659c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47b80c85f0 0x7f47b8146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b759e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b8151f70 0x7f47b8159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b759e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b8151f70 0x7f47b8159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:49548/0 (socket says 172.21.15.178:49548) 2023-11-28T20:37:55.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b659c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47b80c85f0 0x7f47b8146dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:51058/0 (socket says 172.21.15.178:51058) 2023-11-28T20:37:55.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b759e640 1 -- 172.21.15.178:0/1749386994 learned_addr learned my addr 172.21.15.178:0/1749386994 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:55.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b6d9d640 1 --2- 172.21.15.178:0/1749386994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b80c6d00 0x7f47b8156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b759e640 1 -- 172.21.15.178:0/1749386994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47b80c85f0 msgr2=0x7f47b8146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b759e640 1 --2- 172.21.15.178:0/1749386994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47b80c85f0 0x7f47b8146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b759e640 1 -- 172.21.15.178:0/1749386994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b80c6d00 msgr2=0x7f47b8156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b759e640 1 --2- 172.21.15.178:0/1749386994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b80c6d00 0x7f47b8156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b759e640 1 -- 172.21.15.178:0/1749386994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009b30 con 0x7f47b8151f70 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b659c640 1 --2- 172.21.15.178:0/1749386994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47b80c85f0 0x7f47b8146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47b759e640 1 --2- 172.21.15.178:0/1749386994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b8151f70 0x7f47b8159060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f47b001a5c0 tx=0x7f47b0019730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f479f7fe640 1 -- 172.21.15.178:0/1749386994 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b8670 con 0x7f47b8151f70 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f479f7fe640 1 -- 172.21.15.178:0/1749386994 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b00b87f0 con 0x7f47b8151f70 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 -- 172.21.15.178:0/1749386994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b8155d40 con 0x7f47b8151f70 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f479f7fe640 1 -- 172.21.15.178:0/1749386994 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00b8ba0 con 0x7f47b8151f70 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 -- 172.21.15.178:0/1749386994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b8156300 con 0x7f47b8151f70 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f479f7fe640 1 -- 172.21.15.178:0/1749386994 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f47b00c3460 con 0x7f47b8151f70 2023-11-28T20:37:55.259 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f479f7fe640 1 -- 172.21.15.178:0/1749386994 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f47b00b65b0 con 0x7f47b8151f70 2023-11-28T20:37:55.260 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.253+0000 7f47bd13f640 1 -- 172.21.15.178:0/1749386994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b8156ac0 con 0x7f47b8151f70 2023-11-28T20:37:55.260 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.257+0000 7f479f7fe640 1 -- 172.21.15.178:0/1749386994 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f47b00b67c0 con 0x7f47b8151f70 2023-11-28T20:37:55.328 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.325+0000 7f47bd13f640 1 -- 172.21.15.178:0/1749386994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8a0f86cc-d969-4253-a608-79a4910723d5", "id": 0} v 0) v1 -- 0x7f47b8156ac0 con 0x7f47b8151f70 2023-11-28T20:37:55.335 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f479f7fe640 1 -- 172.21.15.178:0/1749386994 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a0f86cc-d969-4253-a608-79a4910723d5", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47b00b6a20 con 0x7f47b8151f70 2023-11-28T20:37:55.336 INFO:teuthology.orchestra.run.smithi178.stdout:0 2023-11-28T20:37:55.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f47bd13f640 1 -- 172.21.15.178:0/1749386994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b8151f70 msgr2=0x7f47b8159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f47bd13f640 1 --2- 172.21.15.178:0/1749386994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b8151f70 0x7f47b8159060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f47b001a5c0 tx=0x7f47b0019730 comp rx=0 tx=0).stop 2023-11-28T20:37:55.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f47bd13f640 1 -- 172.21.15.178:0/1749386994 shutdown_connections 2023-11-28T20:37:55.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f47bd13f640 1 --2- 172.21.15.178:0/1749386994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47b8151f70 0x7f47b8159060 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f47bd13f640 1 --2- 172.21.15.178:0/1749386994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47b80c85f0 0x7f47b8146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f47bd13f640 1 --2- 172.21.15.178:0/1749386994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b80c6d00 0x7f47b8156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.338 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f47bd13f640 1 -- 172.21.15.178:0/1749386994 >> 172.21.15.178:0/1749386994 conn(0x7f47b80cc300 msgr2=0x7f47b814fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:55.338 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f47bd13f640 1 -- 172.21.15.178:0/1749386994 shutdown_connections 2023-11-28T20:37:55.338 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.333+0000 7f47bd13f640 1 -- 172.21.15.178:0/1749386994 wait complete. 2023-11-28T20:37:55.353 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new a3334ea7-c714-4f46-babe-4b5383cdeed9 1 2023-11-28T20:37:55.355 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:55.353+0000 7fa907447180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T20:37:55.475 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333e904640 1 Processor -- start 2023-11-28T20:37:55.475 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333e904640 1 -- start start 2023-11-28T20:37:55.476 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333e904640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3338151fb0 0x7f33380c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333e904640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f333815b540 0x7f333815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333e904640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3338152390 con 0x7f33380c8080 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333e904640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333815bf10 con 0x7f333815b540 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333e904640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33380c91b0 con 0x7f3338151fb0 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333cea1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f333815b540 0x7f333815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333cea1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f333815b540 0x7f333815b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:49558/0 (socket says 172.21.15.178:49558) 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333cea1640 1 -- 172.21.15.178:0/4230504233 learned_addr learned my addr 172.21.15.178:0/4230504233 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f3337fff640 1 --2- 172.21.15.178:0/4230504233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3338151fb0 0x7f33380c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333cea1640 1 -- 172.21.15.178:0/4230504233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3338151fb0 msgr2=0x7f33380c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:55.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333cea1640 1 --2- 172.21.15.178:0/4230504233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3338151fb0 0x7f33380c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.478 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333cea1640 1 -- 172.21.15.178:0/4230504233 >> v1:172.21.15.167:6789/0 conn(0x7f33380c8080 legacy=0x7f3338066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.478 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.473+0000 7f333cea1640 1 -- 172.21.15.178:0/4230504233 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33380c9490 con 0x7f333815b540 2023-11-28T20:37:55.480 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333cea1640 1 --2- 172.21.15.178:0/4230504233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333815b540 0x7f333815b9d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3328009870 tx=0x7f332801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf53a1a639e81123 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:55.480 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f3336ffd640 1 -- 172.21.15.178:0/4230504233 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280a8a30 con 0x7f333815b540 2023-11-28T20:37:55.480 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f3336ffd640 1 -- 172.21.15.178:0/4230504233 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33280a8b90 con 0x7f333815b540 2023-11-28T20:37:55.480 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f3336ffd640 1 -- 172.21.15.178:0/4230504233 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280b0440 con 0x7f333815b540 2023-11-28T20:37:55.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 -- 172.21.15.178:0/4230504233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333815b540 msgr2=0x7f333815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 --2- 172.21.15.178:0/4230504233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333815b540 0x7f333815b9d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3328009870 tx=0x7f332801ed30 comp rx=0 tx=0).stop 2023-11-28T20:37:55.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 -- 172.21.15.178:0/4230504233 shutdown_connections 2023-11-28T20:37:55.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 --2- 172.21.15.178:0/4230504233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333815b540 0x7f333815b9d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 --2- 172.21.15.178:0/4230504233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3338151fb0 0x7f33380c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 -- 172.21.15.178:0/4230504233 >> 172.21.15.178:0/4230504233 conn(0x7f333806fac0 msgr2=0x7f333806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:55.482 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 -- 172.21.15.178:0/4230504233 shutdown_connections 2023-11-28T20:37:55.482 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 -- 172.21.15.178:0/4230504233 wait complete. 2023-11-28T20:37:55.484 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 Processor -- start 2023-11-28T20:37:55.484 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.477+0000 7f333e904640 1 -- start start 2023-11-28T20:37:55.484 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333e904640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c8080 0x7f3338147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333e904640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338151fb0 0x7f33380cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333e904640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333815b540 0x7f33380ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333e904640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333815a3a0 con 0x7f333815b540 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333e904640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33380cc6c0 con 0x7f3338151fb0 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333e904640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33380cd650 con 0x7f33380c8080 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f33377fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338151fb0 0x7f33380cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f3337fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c8080 0x7f3338147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f33377fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338151fb0 0x7f33380cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:49566/0 (socket says 172.21.15.178:49566) 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f33377fe640 1 -- 172.21.15.178:0/2610176704 learned_addr learned my addr 172.21.15.178:0/2610176704 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333cea1640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333815b540 0x7f33380ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f33377fe640 1 -- 172.21.15.178:0/2610176704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c8080 msgr2=0x7f3338147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f33377fe640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c8080 0x7f3338147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f33377fe640 1 -- 172.21.15.178:0/2610176704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333815b540 msgr2=0x7f33380ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f33377fe640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333815b540 0x7f33380ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f33377fe640 1 -- 172.21.15.178:0/2610176704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280094d0 con 0x7f3338151fb0 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f3337fff640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c8080 0x7f3338147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333cea1640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333815b540 0x7f33380ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f33377fe640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338151fb0 0x7f33380cdae0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f332c00c530 tx=0x7f332c00c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f3334ff9640 1 -- 172.21.15.178:0/2610176704 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c005220 con 0x7f3338151fb0 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f3334ff9640 1 -- 172.21.15.178:0/2610176704 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c005380 con 0x7f3338151fb0 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333e904640 1 -- 172.21.15.178:0/2610176704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333814d470 con 0x7f3338151fb0 2023-11-28T20:37:55.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f3334ff9640 1 -- 172.21.15.178:0/2610176704 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c007270 con 0x7f3338151fb0 2023-11-28T20:37:55.487 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333e904640 1 -- 172.21.15.178:0/2610176704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33380ccd20 con 0x7f3338151fb0 2023-11-28T20:37:55.487 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f3334ff9640 1 -- 172.21.15.178:0/2610176704 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f332c0067e0 con 0x7f3338151fb0 2023-11-28T20:37:55.487 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f3334ff9640 1 -- 172.21.15.178:0/2610176704 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f332c012a80 con 0x7f3338151fb0 2023-11-28T20:37:55.487 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.481+0000 7f333e904640 1 -- 172.21.15.178:0/2610176704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3338067c00 con 0x7f3338151fb0 2023-11-28T20:37:55.488 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.485+0000 7f3334ff9640 1 -- 172.21.15.178:0/2610176704 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f332c016020 con 0x7f3338151fb0 2023-11-28T20:37:55.506 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:55.505+0000 7f310c3e1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T20:37:55.556 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.553+0000 7f333e904640 1 -- 172.21.15.178:0/2610176704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a3334ea7-c714-4f46-babe-4b5383cdeed9", "id": 1} v 0) v1 -- 0x7f3338075c90 con 0x7f3338151fb0 2023-11-28T20:37:55.560 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f3334ff9640 1 -- 172.21.15.178:0/2610176704 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a3334ea7-c714-4f46-babe-4b5383cdeed9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f332c02a0b0 con 0x7f3338151fb0 2023-11-28T20:37:55.560 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-11-28T20:37:55.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f333e904640 1 -- 172.21.15.178:0/2610176704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338151fb0 msgr2=0x7f33380cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f333e904640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338151fb0 0x7f33380cdae0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f332c00c530 tx=0x7f332c00c9f0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f333e904640 1 -- 172.21.15.178:0/2610176704 shutdown_connections 2023-11-28T20:37:55.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f333e904640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333815b540 0x7f33380ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f333e904640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338151fb0 0x7f33380cdae0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f333e904640 1 --2- 172.21.15.178:0/2610176704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c8080 0x7f3338147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f333e904640 1 -- 172.21.15.178:0/2610176704 >> 172.21.15.178:0/2610176704 conn(0x7f333806fac0 msgr2=0x7f3338070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:55.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f333e904640 1 -- 172.21.15.178:0/2610176704 shutdown_connections 2023-11-28T20:37:55.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.557+0000 7f333e904640 1 -- 172.21.15.178:0/2610176704 wait complete. 2023-11-28T20:37:55.578 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4 2 2023-11-28T20:37:55.580 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:55.577+0000 7fa907447180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T20:37:55.687 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:55.685+0000 7f310c3e1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T20:37:55.689 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.685+0000 7fae5126b640 1 Processor -- start 2023-11-28T20:37:55.690 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.685+0000 7fae5126b640 1 -- start start 2023-11-28T20:37:55.691 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c5620 0x7fae4c0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.691 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0c2a20 con 0x7fae4c0c88e0 2023-11-28T20:37:55.691 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c0c7b40 con 0x7fae4c150c90 2023-11-28T20:37:55.691 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c0c7de0 con 0x7fae4c0c5620 2023-11-28T20:37:55.691 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae4a7fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c5620 0x7fae4c0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.692 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae4affd640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fae4c150c90 0x7fae4c0c2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:58982/0 (socket says 172.21.15.178:58982) 2023-11-28T20:37:55.692 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae4affd640 1 -- 172.21.15.178:0/3325857242 learned_addr learned my addr 172.21.15.178:0/3325857242 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-11-28T20:37:55.692 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae4a7fc640 1 -- 172.21.15.178:0/3325857242 >> v1:172.21.15.178:6789/0 conn(0x7fae4c150c90 legacy=0x7fae4c0c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.692 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae4a7fc640 1 -- 172.21.15.178:0/3325857242 >> v1:172.21.15.167:6789/0 conn(0x7fae4c0c88e0 legacy=0x7fae4c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:55.692 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae4a7fc640 1 -- 172.21.15.178:0/3325857242 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0c80c0 con 0x7fae4c0c5620 2023-11-28T20:37:55.693 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae4a7fc640 1 --2- 172.21.15.178:0/3325857242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c5620 0x7fae4c0c83a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae340097f0 tx=0x7fae3401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce31ee64276f78e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:55.693 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae49ffb640 1 -- 172.21.15.178:0/3325857242 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340a8970 con 0x7fae4c0c5620 2023-11-28T20:37:55.693 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae49ffb640 1 -- 172.21.15.178:0/3325857242 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae340a8ad0 con 0x7fae4c0c5620 2023-11-28T20:37:55.693 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae49ffb640 1 -- 172.21.15.178:0/3325857242 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340a8e60 con 0x7fae4c0c5620 2023-11-28T20:37:55.694 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 -- 172.21.15.178:0/3325857242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c5620 msgr2=0x7fae4c0c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.694 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 --2- 172.21.15.178:0/3325857242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c5620 0x7fae4c0c83a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae340097f0 tx=0x7fae3401ec70 comp rx=0 tx=0).stop 2023-11-28T20:37:55.694 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 -- 172.21.15.178:0/3325857242 shutdown_connections 2023-11-28T20:37:55.694 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 --2- 172.21.15.178:0/3325857242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c5620 0x7fae4c0c83a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.694 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 -- 172.21.15.178:0/3325857242 >> 172.21.15.178:0/3325857242 conn(0x7fae4c0cb9a0 msgr2=0x7fae4c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:55.694 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 -- 172.21.15.178:0/3325857242 shutdown_connections 2023-11-28T20:37:55.695 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.689+0000 7fae5126b640 1 -- 172.21.15.178:0/3325857242 wait complete. 2023-11-28T20:37:55.695 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 Processor -- start 2023-11-28T20:37:55.695 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 -- start start 2023-11-28T20:37:55.697 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae4c0c5620 0x7fae4c149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.697 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c88e0 0x7fae4c1ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.697 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae4c150c90 0x7fae4c13d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.697 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c06e790 con 0x7fae4c0c5620 2023-11-28T20:37:55.697 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c06e980 con 0x7fae4c150c90 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c06ec60 con 0x7fae4c0c88e0 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4a7fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c88e0 0x7fae4c1ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4b7fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae4c150c90 0x7fae4c13d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4a7fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c88e0 0x7fae4c1ed630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:51092/0 (socket says 172.21.15.178:51092) 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4a7fc640 1 -- 172.21.15.178:0/3397350842 learned_addr learned my addr 172.21.15.178:0/3397350842 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4affd640 1 --2- 172.21.15.178:0/3397350842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae4c0c5620 0x7fae4c149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4b7fe640 1 -- 172.21.15.178:0/3397350842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c88e0 msgr2=0x7fae4c1ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4b7fe640 1 --2- 172.21.15.178:0/3397350842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c88e0 0x7fae4c1ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4b7fe640 1 -- 172.21.15.178:0/3397350842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae4c0c5620 msgr2=0x7fae4c149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4b7fe640 1 --2- 172.21.15.178:0/3397350842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae4c0c5620 0x7fae4c149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.698 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4b7fe640 1 -- 172.21.15.178:0/3397350842 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34009420 con 0x7fae4c150c90 2023-11-28T20:37:55.699 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4a7fc640 1 --2- 172.21.15.178:0/3397350842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c88e0 0x7fae4c1ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:37:55.699 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae4b7fe640 1 --2- 172.21.15.178:0/3397350842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae4c150c90 0x7fae4c13d390 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c780 tx=0x7fae4400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:55.699 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae437fe640 1 -- 172.21.15.178:0/3397350842 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4400aa50 con 0x7fae4c150c90 2023-11-28T20:37:55.699 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae437fe640 1 -- 172.21.15.178:0/3397350842 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4400abb0 con 0x7fae4c150c90 2023-11-28T20:37:55.699 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 -- 172.21.15.178:0/3397350842 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c1f0c40 con 0x7fae4c150c90 2023-11-28T20:37:55.699 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae437fe640 1 -- 172.21.15.178:0/3397350842 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4400ce30 con 0x7fae4c150c90 2023-11-28T20:37:55.699 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 -- 172.21.15.178:0/3397350842 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c1f1200 con 0x7fae4c150c90 2023-11-28T20:37:55.699 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae437fe640 1 -- 172.21.15.178:0/3397350842 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fae44012720 con 0x7fae4c150c90 2023-11-28T20:37:55.699 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae437fe640 1 -- 172.21.15.178:0/3397350842 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fae4401bc30 con 0x7fae4c150c90 2023-11-28T20:37:55.700 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.693+0000 7fae5126b640 1 -- 172.21.15.178:0/3397350842 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c075c90 con 0x7fae4c150c90 2023-11-28T20:37:55.701 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.697+0000 7fae437fe640 1 -- 172.21.15.178:0/3397350842 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fae4403ace0 con 0x7fae4c150c90 2023-11-28T20:37:55.769 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.765+0000 7fae5126b640 1 -- 172.21.15.178:0/3397350842 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4", "id": 2} v 0) v1 -- 0x7fae4c0cb380 con 0x7fae4c150c90 2023-11-28T20:37:55.774 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae437fe640 1 -- 172.21.15.178:0/3397350842 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae44029070 con 0x7fae4c150c90 2023-11-28T20:37:55.775 INFO:teuthology.orchestra.run.smithi178.stdout:2 2023-11-28T20:37:55.776 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae5126b640 1 -- 172.21.15.178:0/3397350842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae4c150c90 msgr2=0x7fae4c13d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.776 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae5126b640 1 --2- 172.21.15.178:0/3397350842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae4c150c90 0x7fae4c13d390 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c780 tx=0x7fae4400cc40 comp rx=0 tx=0).stop 2023-11-28T20:37:55.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae5126b640 1 -- 172.21.15.178:0/3397350842 shutdown_connections 2023-11-28T20:37:55.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae5126b640 1 --2- 172.21.15.178:0/3397350842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae4c150c90 0x7fae4c13d390 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae5126b640 1 --2- 172.21.15.178:0/3397350842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae4c0c88e0 0x7fae4c1ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae5126b640 1 --2- 172.21.15.178:0/3397350842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae4c0c5620 0x7fae4c149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae5126b640 1 -- 172.21.15.178:0/3397350842 >> 172.21.15.178:0/3397350842 conn(0x7fae4c0cb9a0 msgr2=0x7fae4c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:55.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae5126b640 1 -- 172.21.15.178:0/3397350842 shutdown_connections 2023-11-28T20:37:55.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.773+0000 7fae5126b640 1 -- 172.21.15.178:0/3397350842 wait complete. 2023-11-28T20:37:55.796 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new e511ed6d-d15e-4e1d-b624-77f89c872381 3 2023-11-28T20:37:55.916 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e2b7ff640 1 Processor -- start 2023-11-28T20:37:55.917 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e2b7ff640 1 -- start start 2023-11-28T20:37:55.918 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e2b7ff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2415d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.918 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e2b7ff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e240c2910 0x7f8e2415d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.918 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e2b7ff640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e240cb4c0 con 0x7f8e24153ee0 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e2b7ff640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e240c7f60 con 0x7f8e240c2910 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e2b7ff640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240c9ee0 con 0x7f8e240c7680 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e28d9a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e28d9a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2415d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:51104/0 (socket says 172.21.15.178:51104) 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e28d9a640 1 -- 172.21.15.178:0/1934240333 learned_addr learned my addr 172.21.15.178:0/1934240333 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e29d9c640 1 --2- 172.21.15.178:0/1934240333 >> v2:172.21.15.167:3300/0 conn(0x7f8e240c2910 0x7f8e2415d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e28d9a640 1 -- 172.21.15.178:0/1934240333 >> v2:172.21.15.167:3300/0 conn(0x7f8e240c2910 msgr2=0x7f8e2415d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e28d9a640 1 --2- 172.21.15.178:0/1934240333 >> v2:172.21.15.167:3300/0 conn(0x7f8e240c2910 0x7f8e2415d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e28d9a640 1 -- 172.21.15.178:0/1934240333 >> v1:172.21.15.167:6789/0 conn(0x7f8e24153ee0 legacy=0x7f8e240c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e28d9a640 1 -- 172.21.15.178:0/1934240333 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240cb190 con 0x7f8e240c7680 2023-11-28T20:37:55.919 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.913+0000 7f8e29d9c640 1 --2- 172.21.15.178:0/1934240333 >> v2:172.21.15.167:3300/0 conn(0x7f8e240c2910 0x7f8e2415d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:37:55.920 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e28d9a640 1 --2- 172.21.15.178:0/1934240333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2415d220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e140098a0 tx=0x7f8e1401ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ba35c0df5708aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:55.921 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e1bfff640 1 -- 172.21.15.178:0/1934240333 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140a8a10 con 0x7f8e240c7680 2023-11-28T20:37:55.921 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e1bfff640 1 -- 172.21.15.178:0/1934240333 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e140a8b70 con 0x7f8e240c7680 2023-11-28T20:37:55.921 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e1bfff640 1 -- 172.21.15.178:0/1934240333 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140b0440 con 0x7f8e240c7680 2023-11-28T20:37:55.922 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/1934240333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 msgr2=0x7f8e2415d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.922 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e2b7ff640 1 --2- 172.21.15.178:0/1934240333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2415d220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e140098a0 tx=0x7f8e1401ed10 comp rx=0 tx=0).stop 2023-11-28T20:37:55.922 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/1934240333 shutdown_connections 2023-11-28T20:37:55.922 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e2b7ff640 1 --2- 172.21.15.178:0/1934240333 >> v2:172.21.15.167:3300/0 conn(0x7f8e240c2910 0x7f8e2415d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.922 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e2b7ff640 1 --2- 172.21.15.178:0/1934240333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2415d220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.922 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/1934240333 >> 172.21.15.178:0/1934240333 conn(0x7f8e240cb9a0 msgr2=0x7f8e240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:55.922 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/1934240333 shutdown_connections 2023-11-28T20:37:55.922 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.917+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/1934240333 wait complete. 2023-11-28T20:37:55.923 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 Processor -- start 2023-11-28T20:37:55.923 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 -- start start 2023-11-28T20:37:55.925 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e240c2910 0x7f8e241f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.925 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.925 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e24153ee0 0x7f8e24148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:55.925 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e241f06f0 con 0x7f8e240c2910 2023-11-28T20:37:55.925 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2414e170 con 0x7f8e24153ee0 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2414e730 con 0x7f8e240c7680 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e28d9a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e28d9a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2414ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:51112/0 (socket says 172.21.15.178:51112) 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e28d9a640 1 -- 172.21.15.178:0/3666688362 learned_addr learned my addr 172.21.15.178:0/3666688362 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e29d9c640 1 --2- 172.21.15.178:0/3666688362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e24153ee0 0x7f8e24148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2959b640 1 --2- 172.21.15.178:0/3666688362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e240c2910 0x7f8e241f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e28d9a640 1 -- 172.21.15.178:0/3666688362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e24153ee0 msgr2=0x7f8e24148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e28d9a640 1 --2- 172.21.15.178:0/3666688362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e24153ee0 0x7f8e24148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e28d9a640 1 -- 172.21.15.178:0/3666688362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e240c2910 msgr2=0x7f8e241f01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e28d9a640 1 --2- 172.21.15.178:0/3666688362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e240c2910 0x7f8e241f01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:55.926 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e28d9a640 1 -- 172.21.15.178:0/3666688362 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140094d0 con 0x7f8e240c7680 2023-11-28T20:37:55.927 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e28d9a640 1 --2- 172.21.15.178:0/3666688362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2414ebc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8e140b3040 tx=0x7f8e1401bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:55.927 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e19ffb640 1 -- 172.21.15.178:0/3666688362 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140be070 con 0x7f8e240c7680 2023-11-28T20:37:55.927 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e19ffb640 1 -- 172.21.15.178:0/3666688362 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e140ba400 con 0x7f8e240c7680 2023-11-28T20:37:55.927 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/3666688362 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e24154ee0 con 0x7f8e240c7680 2023-11-28T20:37:55.927 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e19ffb640 1 -- 172.21.15.178:0/3666688362 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140ba7d0 con 0x7f8e240c7680 2023-11-28T20:37:55.927 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/3666688362 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2414fb80 con 0x7f8e240c7680 2023-11-28T20:37:55.927 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e19ffb640 1 -- 172.21.15.178:0/3666688362 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8e140bac30 con 0x7f8e240c7680 2023-11-28T20:37:55.927 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e19ffb640 1 -- 172.21.15.178:0/3666688362 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8e140c23c0 con 0x7f8e240c7680 2023-11-28T20:37:55.928 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.921+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/3666688362 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e24075c90 con 0x7f8e240c7680 2023-11-28T20:37:55.928 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.925+0000 7f8e19ffb640 1 -- 172.21.15.178:0/3666688362 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8e140b5070 con 0x7f8e240c7680 2023-11-28T20:37:55.995 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.993+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/3666688362 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e511ed6d-d15e-4e1d-b624-77f89c872381", "id": 3} v 0) v1 -- 0x7f8e2414e870 con 0x7f8e240c7680 2023-11-28T20:37:56.000 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e19ffb640 1 -- 172.21.15.178:0/3666688362 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e511ed6d-d15e-4e1d-b624-77f89c872381", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e140d10b0 con 0x7f8e240c7680 2023-11-28T20:37:56.000 INFO:teuthology.orchestra.run.smithi178.stdout:3 2023-11-28T20:37:56.001 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/3666688362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 msgr2=0x7f8e2414ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.002 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e2b7ff640 1 --2- 172.21.15.178:0/3666688362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2414ebc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8e140b3040 tx=0x7f8e1401bab0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.002 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/3666688362 shutdown_connections 2023-11-28T20:37:56.002 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e2b7ff640 1 --2- 172.21.15.178:0/3666688362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e24153ee0 0x7f8e24148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.002 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e2b7ff640 1 --2- 172.21.15.178:0/3666688362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e240c7680 0x7f8e2414ebc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.002 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e2b7ff640 1 --2- 172.21.15.178:0/3666688362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e240c2910 0x7f8e241f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.002 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/3666688362 >> 172.21.15.178:0/3666688362 conn(0x7f8e240cb9a0 msgr2=0x7f8e24070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:56.002 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/3666688362 shutdown_connections 2023-11-28T20:37:56.002 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:55.997+0000 7f8e2b7ff640 1 -- 172.21.15.178:0/3666688362 wait complete. 2023-11-28T20:37:56.018 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new ee2a0e49-a098-4bb4-921f-842eb9c68bb0 4 2023-11-28T20:37:56.132 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f9003303640 1 Processor -- start 2023-11-28T20:37:56.132 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f9003303640 1 -- start start 2023-11-28T20:37:56.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f9003303640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f9003303640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ffc0c6d70 0x7f8ffc0c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f9003303640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc0c3800 con 0x7f8ffc15acd0 2023-11-28T20:37:56.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f9003303640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc0c4ff0 con 0x7f8ffc0c6d70 2023-11-28T20:37:56.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f9003303640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0c3fd0 con 0x7f8ffc150e50 2023-11-28T20:37:56.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f900109f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f900089e640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f8ffc15acd0 0x7f8ffc071ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:58436/0 (socket says 172.21.15.178:58436) 2023-11-28T20:37:56.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f900089e640 1 -- 172.21.15.178:0/351924948 learned_addr learned my addr 172.21.15.178:0/351924948 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-11-28T20:37:56.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f90018a0640 1 --2- 172.21.15.178:0/351924948 >> v2:172.21.15.167:3300/0 conn(0x7f8ffc0c6d70 0x7f8ffc0c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f8ff3fff640 1 -- 172.21.15.178:0/351924948 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920886876 0 0) 0x7f8ffc0c3800 con 0x7f8ffc15acd0 2023-11-28T20:37:56.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f8ff3fff640 1 -- 172.21.15.178:0/351924948 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe8003530 con 0x7f8ffc15acd0 2023-11-28T20:37:56.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f900109f640 1 -- 172.21.15.178:0/351924948 >> v2:172.21.15.167:3300/0 conn(0x7f8ffc0c6d70 msgr2=0x7f8ffc0c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:56.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f900109f640 1 --2- 172.21.15.178:0/351924948 >> v2:172.21.15.167:3300/0 conn(0x7f8ffc0c6d70 0x7f8ffc0c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f900109f640 1 -- 172.21.15.178:0/351924948 >> v1:172.21.15.178:6789/0 conn(0x7f8ffc15acd0 legacy=0x7f8ffc071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.129+0000 7f900109f640 1 -- 172.21.15.178:0/351924948 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc15a840 con 0x7f8ffc150e50 2023-11-28T20:37:56.136 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f900109f640 1 --2- 172.21.15.178:0/351924948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc156b30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80097c0 tx=0x7f8ff801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7d979be0e2f58f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:56.136 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f8ff3fff640 1 -- 172.21.15.178:0/351924948 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80ab600 con 0x7f8ffc150e50 2023-11-28T20:37:56.136 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f8ff3fff640 1 -- 172.21.15.178:0/351924948 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80a7050 con 0x7f8ffc150e50 2023-11-28T20:37:56.136 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f8ff3fff640 1 -- 172.21.15.178:0/351924948 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80ab980 con 0x7f8ffc150e50 2023-11-28T20:37:56.137 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 -- 172.21.15.178:0/351924948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 msgr2=0x7f8ffc156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.137 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 --2- 172.21.15.178:0/351924948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc156b30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80097c0 tx=0x7f8ff801c3f0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.137 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 -- 172.21.15.178:0/351924948 shutdown_connections 2023-11-28T20:37:56.137 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 --2- 172.21.15.178:0/351924948 >> v2:172.21.15.167:3300/0 conn(0x7f8ffc0c6d70 0x7f8ffc0c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.137 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 --2- 172.21.15.178:0/351924948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc156b30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.137 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 -- 172.21.15.178:0/351924948 >> 172.21.15.178:0/351924948 conn(0x7f8ffc0cc300 msgr2=0x7f8ffc0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:56.138 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 -- 172.21.15.178:0/351924948 shutdown_connections 2023-11-28T20:37:56.138 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 -- 172.21.15.178:0/351924948 wait complete. 2023-11-28T20:37:56.140 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 Processor -- start 2023-11-28T20:37:56.140 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.133+0000 7f9003303640 1 -- start start 2023-11-28T20:37:56.140 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f9003303640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ffc0c6d70 0x7f8ffc1f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.140 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f9003303640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.140 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f9003303640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc15acd0 0x7f8ffc158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f9003303640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc1f3220 con 0x7f8ffc15acd0 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f9003303640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc1f5c10 con 0x7f8ffc0c6d70 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f9003303640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc1f5ef0 con 0x7f8ffc150e50 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900089e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900109f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ffc0c6d70 0x7f8ffc1f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900089e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc0c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:53344/0 (socket says 172.21.15.178:53344) 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900089e640 1 -- 172.21.15.178:0/3028707370 learned_addr learned my addr 172.21.15.178:0/3028707370 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900109f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ffc0c6d70 0x7f8ffc1f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:35982/0 (socket says 172.21.15.178:35982) 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f90018a0640 1 --2- 172.21.15.178:0/3028707370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc15acd0 0x7f8ffc158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900089e640 1 -- 172.21.15.178:0/3028707370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ffc0c6d70 msgr2=0x7f8ffc1f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.141 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900089e640 1 --2- 172.21.15.178:0/3028707370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ffc0c6d70 0x7f8ffc1f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900089e640 1 -- 172.21.15.178:0/3028707370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc15acd0 msgr2=0x7f8ffc158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900089e640 1 --2- 172.21.15.178:0/3028707370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc15acd0 0x7f8ffc158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900089e640 1 -- 172.21.15.178:0/3028707370 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8009420 con 0x7f8ffc150e50 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f90018a0640 1 --2- 172.21.15.178:0/3028707370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc15acd0 0x7f8ffc158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f900089e640 1 --2- 172.21.15.178:0/3028707370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc0c8ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c4d0 tx=0x7f8fec00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f8ff1ffb640 1 -- 172.21.15.178:0/3028707370 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec005cf0 con 0x7f8ffc150e50 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f8ff1ffb640 1 -- 172.21.15.178:0/3028707370 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec005e50 con 0x7f8ffc150e50 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f9003303640 1 -- 172.21.15.178:0/3028707370 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc1f61d0 con 0x7f8ffc150e50 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f8ff1ffb640 1 -- 172.21.15.178:0/3028707370 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec007270 con 0x7f8ffc150e50 2023-11-28T20:37:56.142 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f9003303640 1 -- 172.21.15.178:0/3028707370 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc157e30 con 0x7f8ffc150e50 2023-11-28T20:37:56.143 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f8ff1ffb640 1 -- 172.21.15.178:0/3028707370 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8fec01c440 con 0x7f8ffc150e50 2023-11-28T20:37:56.143 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f8ff1ffb640 1 -- 172.21.15.178:0/3028707370 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f8fec012910 con 0x7f8ffc150e50 2023-11-28T20:37:56.143 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f9003303640 1 -- 172.21.15.178:0/3028707370 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ffc1f66f0 con 0x7f8ffc150e50 2023-11-28T20:37:56.143 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.137+0000 7f8ff1ffb640 1 -- 172.21.15.178:0/3028707370 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8ffc1f66f0 con 0x7f8ffc150e50 2023-11-28T20:37:56.205 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:56.201+0000 7fa907447180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T20:37:56.209 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.205+0000 7f9003303640 1 -- 172.21.15.178:0/3028707370 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ee2a0e49-a098-4bb4-921f-842eb9c68bb0", "id": 4} v 0) v1 -- 0x7f8ffc157c90 con 0x7f8ffc150e50 2023-11-28T20:37:56.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.209+0000 7f8ff1ffb640 1 -- 172.21.15.178:0/3028707370 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee2a0e49-a098-4bb4-921f-842eb9c68bb0", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ffc157c90 con 0x7f8ffc150e50 2023-11-28T20:37:56.215 INFO:teuthology.orchestra.run.smithi178.stdout:4 2023-11-28T20:37:56.216 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.213+0000 7f9003303640 1 -- 172.21.15.178:0/3028707370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 msgr2=0x7f8ffc0c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.216 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.213+0000 7f9003303640 1 --2- 172.21.15.178:0/3028707370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc0c8ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c4d0 tx=0x7f8fec00c990 comp rx=0 tx=0).stop 2023-11-28T20:37:56.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.213+0000 7f9003303640 1 -- 172.21.15.178:0/3028707370 shutdown_connections 2023-11-28T20:37:56.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.213+0000 7f9003303640 1 --2- 172.21.15.178:0/3028707370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc15acd0 0x7f8ffc158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.213+0000 7f9003303640 1 --2- 172.21.15.178:0/3028707370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ffc150e50 0x7f8ffc0c8ff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.213+0000 7f9003303640 1 --2- 172.21.15.178:0/3028707370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ffc0c6d70 0x7f8ffc1f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.213+0000 7f9003303640 1 -- 172.21.15.178:0/3028707370 >> 172.21.15.178:0/3028707370 conn(0x7f8ffc0cc300 msgr2=0x7f8ffc160ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:56.218 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.213+0000 7f9003303640 1 -- 172.21.15.178:0/3028707370 shutdown_connections 2023-11-28T20:37:56.218 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.213+0000 7f9003303640 1 -- 172.21.15.178:0/3028707370 wait complete. 2023-11-28T20:37:56.231 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new db07d3fe-f253-4d06-835e-69591c096694 5 2023-11-28T20:37:56.268 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:56.265+0000 7fa907447180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T20:37:56.296 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:56.293+0000 7f310c3e1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T20:37:56.327 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:56.325+0000 7fa907447180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T20:37:56.346 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.341+0000 7ff2fb0df640 1 Processor -- start 2023-11-28T20:37:56.346 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.341+0000 7ff2fb0df640 1 -- start start 2023-11-28T20:37:56.347 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2fb0df640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff2f415acd0 0x7ff2f4071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2fb0df640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2f4072010 0x7ff2f40c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2fb0df640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f40c3800 con 0x7ff2f4150e50 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2fb0df640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f40c4ff0 con 0x7ff2f415acd0 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2fb0df640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f40c3fd0 con 0x7ff2f4072010 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f967c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2f4072010 0x7ff2f40c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f967c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2f4072010 0x7ff2f40c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:35998/0 (socket says 172.21.15.178:35998) 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f967c640 1 -- 172.21.15.178:0/767545823 learned_addr learned my addr 172.21.15.178:0/767545823 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f3fff640 1 --2- 172.21.15.178:0/767545823 >> v2:172.21.15.167:3300/0 conn(0x7ff2f415acd0 0x7ff2f4071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f967c640 1 -- 172.21.15.178:0/767545823 >> v2:172.21.15.167:3300/0 conn(0x7ff2f415acd0 msgr2=0x7ff2f4071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f967c640 1 --2- 172.21.15.178:0/767545823 >> v2:172.21.15.167:3300/0 conn(0x7ff2f415acd0 0x7ff2f4071ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.348 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f967c640 1 -- 172.21.15.178:0/767545823 >> v1:172.21.15.178:6789/0 conn(0x7ff2f4150e50 legacy=0x7ff2f4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.349 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f37fe640 1 -- 172.21.15.178:0/767545823 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064030495 0 0) 0x7ff2f40c3800 con 0x7ff2f4150e50 2023-11-28T20:37:56.349 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f967c640 1 -- 172.21.15.178:0/767545823 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f415a840 con 0x7ff2f4072010 2023-11-28T20:37:56.350 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f967c640 1 --2- 172.21.15.178:0/767545823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4072010 0x7ff2f40c55c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff2f406cb80 tx=0x7ff2ec01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db9c5c5c7e7979fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:56.350 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f37fe640 1 -- 172.21.15.178:0/767545823 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0a5800 con 0x7ff2f4072010 2023-11-28T20:37:56.350 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f37fe640 1 -- 172.21.15.178:0/767545823 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec0a5960 con 0x7ff2f4072010 2023-11-28T20:37:56.350 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.345+0000 7ff2f37fe640 1 -- 172.21.15.178:0/767545823 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0a5cf0 con 0x7ff2f4072010 2023-11-28T20:37:56.351 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- 172.21.15.178:0/767545823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4072010 msgr2=0x7ff2f40c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.351 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 --2- 172.21.15.178:0/767545823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4072010 0x7ff2f40c55c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff2f406cb80 tx=0x7ff2ec01c940 comp rx=0 tx=0).stop 2023-11-28T20:37:56.351 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- 172.21.15.178:0/767545823 shutdown_connections 2023-11-28T20:37:56.351 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 --2- 172.21.15.178:0/767545823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4072010 0x7ff2f40c55c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.352 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 --2- 172.21.15.178:0/767545823 >> v2:172.21.15.167:3300/0 conn(0x7ff2f415acd0 0x7ff2f4071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.352 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- 172.21.15.178:0/767545823 >> 172.21.15.178:0/767545823 conn(0x7ff2f40cc300 msgr2=0x7ff2f40cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:56.352 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- 172.21.15.178:0/767545823 shutdown_connections 2023-11-28T20:37:56.352 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- 172.21.15.178:0/767545823 wait complete. 2023-11-28T20:37:56.352 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:56.349+0000 7f310c3e1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T20:37:56.354 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 Processor -- start 2023-11-28T20:37:56.354 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- start start 2023-11-28T20:37:56.354 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f4072010 0x7ff2f41523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4150e50 0x7ff2f40c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2f415acd0 0x7ff2f4142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4143680 con 0x7ff2f4072010 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4143920 con 0x7ff2f4150e50 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40c8f40 con 0x7ff2f415acd0 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f3fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4150e50 0x7ff2f40c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f3fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4150e50 0x7ff2f40c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:36012/0 (socket says 172.21.15.178:36012) 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f3fff640 1 -- 172.21.15.178:0/1236324391 learned_addr learned my addr 172.21.15.178:0/1236324391 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f967c640 1 --2- 172.21.15.178:0/1236324391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2f415acd0 0x7ff2f4142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f8e7b640 1 --2- 172.21.15.178:0/1236324391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f4072010 0x7ff2f41523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f3fff640 1 -- 172.21.15.178:0/1236324391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2f415acd0 msgr2=0x7ff2f4142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.355 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f3fff640 1 --2- 172.21.15.178:0/1236324391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2f415acd0 0x7ff2f4142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f3fff640 1 -- 172.21.15.178:0/1236324391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f4072010 msgr2=0x7ff2f41523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f3fff640 1 --2- 172.21.15.178:0/1236324391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f4072010 0x7ff2f41523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f3fff640 1 -- 172.21.15.178:0/1236324391 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec009b30 con 0x7ff2f4150e50 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f3fff640 1 --2- 172.21.15.178:0/1236324391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4150e50 0x7ff2f40c8560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000d5f0 tx=0x7ff2e000dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f17fa640 1 -- 172.21.15.178:0/1236324391 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00125f0 con 0x7ff2f4150e50 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f17fa640 1 -- 172.21.15.178:0/1236324391 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0012750 con 0x7ff2f4150e50 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- 172.21.15.178:0/1236324391 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f414e880 con 0x7ff2f4150e50 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f17fa640 1 -- 172.21.15.178:0/1236324391 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0012ae0 con 0x7ff2f4150e50 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- 172.21.15.178:0/1236324391 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f414d6d0 con 0x7ff2f4150e50 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f17fa640 1 -- 172.21.15.178:0/1236324391 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff2e001e460 con 0x7ff2f4150e50 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2f17fa640 1 -- 172.21.15.178:0/1236324391 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff2e0014aa0 con 0x7ff2f4150e50 2023-11-28T20:37:56.356 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.349+0000 7ff2fb0df640 1 -- 172.21.15.178:0/1236324391 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f4075c90 con 0x7ff2f4150e50 2023-11-28T20:37:56.357 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.353+0000 7ff2f17fa640 1 -- 172.21.15.178:0/1236324391 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff2e0014d20 con 0x7ff2f4150e50 2023-11-28T20:37:56.406 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:56.401+0000 7f310c3e1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T20:37:56.415 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:56.413+0000 7fa907447180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T20:37:56.425 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.421+0000 7ff2fb0df640 1 -- 172.21.15.178:0/1236324391 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "db07d3fe-f253-4d06-835e-69591c096694", "id": 5} v 0) v1 -- 0x7ff2f4067bb0 con 0x7ff2f4150e50 2023-11-28T20:37:56.431 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2f17fa640 1 -- 172.21.15.178:0/1236324391 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db07d3fe-f253-4d06-835e-69591c096694", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff2e0014520 con 0x7ff2f4150e50 2023-11-28T20:37:56.431 INFO:teuthology.orchestra.run.smithi178.stdout:5 2023-11-28T20:37:56.433 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2fb0df640 1 -- 172.21.15.178:0/1236324391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4150e50 msgr2=0x7ff2f40c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.433 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2fb0df640 1 --2- 172.21.15.178:0/1236324391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4150e50 0x7ff2f40c8560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000d5f0 tx=0x7ff2e000dab0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.433 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2fb0df640 1 -- 172.21.15.178:0/1236324391 shutdown_connections 2023-11-28T20:37:56.433 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2fb0df640 1 --2- 172.21.15.178:0/1236324391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2f415acd0 0x7ff2f4142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.433 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2fb0df640 1 --2- 172.21.15.178:0/1236324391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f4150e50 0x7ff2f40c8560 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.433 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2fb0df640 1 --2- 172.21.15.178:0/1236324391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f4072010 0x7ff2f41523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.433 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2fb0df640 1 -- 172.21.15.178:0/1236324391 >> 172.21.15.178:0/1236324391 conn(0x7ff2f40cc300 msgr2=0x7ff2f406af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:56.434 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2fb0df640 1 -- 172.21.15.178:0/1236324391 shutdown_connections 2023-11-28T20:37:56.434 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.429+0000 7ff2fb0df640 1 -- 172.21.15.178:0/1236324391 wait complete. 2023-11-28T20:37:56.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new f0e6673c-6f52-4eac-a615-2d7656938515 6 2023-11-28T20:37:56.476 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:56.473+0000 7fa907447180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T20:37:56.487 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:56.485+0000 7f310c3e1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T20:37:56.541 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:56.537+0000 7f310c3e1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T20:37:56.556 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf6b613640 1 Processor -- start 2023-11-28T20:37:56.557 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf6b613640 1 -- start start 2023-11-28T20:37:56.558 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf6b613640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf640cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.558 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf6b613640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faf64151ff0 0x7faf640c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.558 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf6b613640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf64157b30 con 0x7faf640c97a0 2023-11-28T20:37:56.558 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf6b613640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6406f6e0 con 0x7faf64151ff0 2023-11-28T20:37:56.558 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf6b613640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c67c0 con 0x7faf64151c10 2023-11-28T20:37:56.558 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf693af640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf640cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf693af640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf640cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:53362/0 (socket says 172.21.15.178:53362) 2023-11-28T20:37:56.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf693af640 1 -- 172.21.15.178:0/2712801205 learned_addr learned my addr 172.21.15.178:0/2712801205 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:56.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf69bb0640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7faf640c97a0 0x7faf64157ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:58454/0 (socket says 172.21.15.178:58454) 2023-11-28T20:37:56.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf68bae640 1 --2- 172.21.15.178:0/2712801205 >> v2:172.21.15.167:3300/0 conn(0x7faf64151ff0 0x7faf640c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf693af640 1 -- 172.21.15.178:0/2712801205 >> v2:172.21.15.167:3300/0 conn(0x7faf64151ff0 msgr2=0x7faf640c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:56.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf693af640 1 --2- 172.21.15.178:0/2712801205 >> v2:172.21.15.167:3300/0 conn(0x7faf64151ff0 0x7faf640c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf693af640 1 -- 172.21.15.178:0/2712801205 >> v1:172.21.15.178:6789/0 conn(0x7faf640c97a0 legacy=0x7faf64157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf5bfff640 1 -- 172.21.15.178:0/2712801205 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854513814 0 0) 0x7faf64157b30 con 0x7faf640c97a0 2023-11-28T20:37:56.559 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.553+0000 7faf693af640 1 -- 172.21.15.178:0/2712801205 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6406e9c0 con 0x7faf64151c10 2023-11-28T20:37:56.560 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf693af640 1 --2- 172.21.15.178:0/2712801205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf640cb340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faf54009870 tx=0x7faf5401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbe6c5d8a7f6adc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:56.560 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf5bfff640 1 -- 172.21.15.178:0/2712801205 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540a8a30 con 0x7faf64151c10 2023-11-28T20:37:56.560 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf5bfff640 1 -- 172.21.15.178:0/2712801205 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf540a8b90 con 0x7faf64151c10 2023-11-28T20:37:56.560 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf5bfff640 1 -- 172.21.15.178:0/2712801205 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540b0440 con 0x7faf64151c10 2023-11-28T20:37:56.561 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf6b613640 1 -- 172.21.15.178:0/2712801205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 msgr2=0x7faf640cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.561 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf6b613640 1 --2- 172.21.15.178:0/2712801205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf640cb340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faf54009870 tx=0x7faf5401ed30 comp rx=0 tx=0).stop 2023-11-28T20:37:56.561 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf6b613640 1 -- 172.21.15.178:0/2712801205 shutdown_connections 2023-11-28T20:37:56.561 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf6b613640 1 --2- 172.21.15.178:0/2712801205 >> v2:172.21.15.167:3300/0 conn(0x7faf64151ff0 0x7faf640c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf6b613640 1 --2- 172.21.15.178:0/2712801205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf640cb340 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf6b613640 1 -- 172.21.15.178:0/2712801205 >> 172.21.15.178:0/2712801205 conn(0x7faf640cb9a0 msgr2=0x7faf640cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:56.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf6b613640 1 -- 172.21.15.178:0/2712801205 shutdown_connections 2023-11-28T20:37:56.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf6b613640 1 -- 172.21.15.178:0/2712801205 wait complete. 2023-11-28T20:37:56.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.557+0000 7faf6b613640 1 Processor -- start 2023-11-28T20:37:56.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 -- start start 2023-11-28T20:37:56.564 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf640c97a0 0x7faf6414f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf64145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf64151ff0 0x7faf64146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf641ed580 con 0x7faf640c97a0 2023-11-28T20:37:56.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf641eddc0 con 0x7faf64151ff0 2023-11-28T20:37:56.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6414fc30 con 0x7faf64151c10 2023-11-28T20:37:56.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf68bae640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf64145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf69bb0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf64151ff0 0x7faf64146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf68bae640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf64145dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:53378/0 (socket says 172.21.15.178:53378) 2023-11-28T20:37:56.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf69bb0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf64151ff0 0x7faf64146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:36020/0 (socket says 172.21.15.178:36020) 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf68bae640 1 -- 172.21.15.178:0/1666048171 learned_addr learned my addr 172.21.15.178:0/1666048171 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf693af640 1 --2- 172.21.15.178:0/1666048171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf640c97a0 0x7faf6414f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf68bae640 1 -- 172.21.15.178:0/1666048171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf64151ff0 msgr2=0x7faf64146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf68bae640 1 --2- 172.21.15.178:0/1666048171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf64151ff0 0x7faf64146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf68bae640 1 -- 172.21.15.178:0/1666048171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf640c97a0 msgr2=0x7faf6414f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf68bae640 1 --2- 172.21.15.178:0/1666048171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf640c97a0 0x7faf6414f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf68bae640 1 -- 172.21.15.178:0/1666048171 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540094d0 con 0x7faf64151c10 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf69bb0640 1 --2- 172.21.15.178:0/1666048171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf64151ff0 0x7faf64146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf68bae640 1 --2- 172.21.15.178:0/1666048171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf64145dc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faf6000d7d0 tx=0x7faf6000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:56.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf59ffb640 1 -- 172.21.15.178:0/1666048171 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000b6c0 con 0x7faf64151c10 2023-11-28T20:37:56.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf59ffb640 1 -- 172.21.15.178:0/1666048171 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6000b840 con 0x7faf64151c10 2023-11-28T20:37:56.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 -- 172.21.15.178:0/1666048171 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf64146840 con 0x7faf64151c10 2023-11-28T20:37:56.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf59ffb640 1 -- 172.21.15.178:0/1666048171 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000bbf0 con 0x7faf64151c10 2023-11-28T20:37:56.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 -- 172.21.15.178:0/1666048171 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf641f1880 con 0x7faf64151c10 2023-11-28T20:37:56.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf59ffb640 1 -- 172.21.15.178:0/1666048171 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faf6000bd50 con 0x7faf64151c10 2023-11-28T20:37:56.567 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf59ffb640 1 -- 172.21.15.178:0/1666048171 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7faf60014b10 con 0x7faf64151c10 2023-11-28T20:37:56.567 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:56.561+0000 7fa907447180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T20:37:56.568 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.561+0000 7faf6b613640 1 -- 172.21.15.178:0/1666048171 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf64075c90 con 0x7faf64151c10 2023-11-28T20:37:56.569 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.565+0000 7faf59ffb640 1 -- 172.21.15.178:0/1666048171 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7faf60014cd0 con 0x7faf64151c10 2023-11-28T20:37:56.623 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:56.621+0000 7f310c3e1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T20:37:56.625 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:56.621+0000 7fa907447180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T20:37:56.633 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.629+0000 7faf6b613640 1 -- 172.21.15.178:0/1666048171 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0e6673c-6f52-4eac-a615-2d7656938515", "id": 6} v 0) v1 -- 0x7faf641edf00 con 0x7faf64151c10 2023-11-28T20:37:56.639 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf59ffb640 1 -- 172.21.15.178:0/1666048171 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0e6673c-6f52-4eac-a615-2d7656938515", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7faf60014520 con 0x7faf64151c10 2023-11-28T20:37:56.639 INFO:teuthology.orchestra.run.smithi178.stdout:6 2023-11-28T20:37:56.640 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf6b613640 1 -- 172.21.15.178:0/1666048171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 msgr2=0x7faf64145dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.640 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf6b613640 1 --2- 172.21.15.178:0/1666048171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf64145dc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faf6000d7d0 tx=0x7faf6000dc90 comp rx=0 tx=0).stop 2023-11-28T20:37:56.640 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf6b613640 1 -- 172.21.15.178:0/1666048171 shutdown_connections 2023-11-28T20:37:56.640 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf6b613640 1 --2- 172.21.15.178:0/1666048171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf64151ff0 0x7faf64146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.641 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf6b613640 1 --2- 172.21.15.178:0/1666048171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf64151c10 0x7faf64145dc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.641 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf6b613640 1 --2- 172.21.15.178:0/1666048171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf640c97a0 0x7faf6414f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.641 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf6b613640 1 -- 172.21.15.178:0/1666048171 >> 172.21.15.178:0/1666048171 conn(0x7faf640cb9a0 msgr2=0x7faf6414e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:56.641 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf6b613640 1 -- 172.21.15.178:0/1666048171 shutdown_connections 2023-11-28T20:37:56.641 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.637+0000 7faf6b613640 1 -- 172.21.15.178:0/1666048171 wait complete. 2023-11-28T20:37:56.655 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 359243a1-c3b8-4c25-9376-b964dcfe2d7b 7 2023-11-28T20:37:56.677 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:56.673+0000 7f310c3e1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T20:37:56.782 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:56.777+0000 7fa907447180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T20:37:56.783 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b1792d640 1 Processor -- start 2023-11-28T20:37:56.783 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b1792d640 1 -- start start 2023-11-28T20:37:56.784 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b1792d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2b10151fb0 0x7f2b100c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.784 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b1792d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2b100c8080 0x7f2b10066340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.784 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b1792d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b10152390 con 0x7f2b10066880 2023-11-28T20:37:56.784 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b1792d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b100c91b0 con 0x7f2b100c8080 2023-11-28T20:37:56.784 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b1792d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b100c9490 con 0x7f2b10151fb0 2023-11-28T20:37:56.785 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b156c9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2b10151fb0 0x7f2b100c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.785 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b156c9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2b10151fb0 0x7f2b100c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:36032/0 (socket says 172.21.15.178:36032) 2023-11-28T20:37:56.785 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b156c9640 1 -- 172.21.15.178:0/1052811059 learned_addr learned my addr 172.21.15.178:0/1052811059 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:56.785 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b14ec8640 1 --2- 172.21.15.178:0/1052811059 >> v2:172.21.15.167:3300/0 conn(0x7f2b100c8080 0x7f2b10066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.785 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b156c9640 1 -- 172.21.15.178:0/1052811059 >> v2:172.21.15.167:3300/0 conn(0x7f2b100c8080 msgr2=0x7f2b10066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:56.785 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b156c9640 1 --2- 172.21.15.178:0/1052811059 >> v2:172.21.15.167:3300/0 conn(0x7f2b100c8080 0x7f2b10066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.785 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b156c9640 1 -- 172.21.15.178:0/1052811059 >> v1:172.21.15.167:6789/0 conn(0x7f2b10066880 legacy=0x7f2b1015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:56.785 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b156c9640 1 -- 172.21.15.178:0/1052811059 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b100c9770 con 0x7f2b10151fb0 2023-11-28T20:37:56.786 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b156c9640 1 --2- 172.21.15.178:0/1052811059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b10151fb0 0x7f2b100c38c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2b100ca610 tx=0x7f2b0c01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=126e34c3b8ddacd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:56.786 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b07fff640 1 -- 172.21.15.178:0/1052811059 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0a89b0 con 0x7f2b10151fb0 2023-11-28T20:37:56.786 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b07fff640 1 -- 172.21.15.178:0/1052811059 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c0a8b10 con 0x7f2b10151fb0 2023-11-28T20:37:56.786 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.781+0000 7f2b07fff640 1 -- 172.21.15.178:0/1052811059 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0a8ea0 con 0x7f2b10151fb0 2023-11-28T20:37:56.787 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- 172.21.15.178:0/1052811059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b10151fb0 msgr2=0x7f2b100c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.787 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 --2- 172.21.15.178:0/1052811059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b10151fb0 0x7f2b100c38c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2b100ca610 tx=0x7f2b0c01ecb0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.787 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- 172.21.15.178:0/1052811059 shutdown_connections 2023-11-28T20:37:56.787 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 --2- 172.21.15.178:0/1052811059 >> v2:172.21.15.167:3300/0 conn(0x7f2b100c8080 0x7f2b10066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.787 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 --2- 172.21.15.178:0/1052811059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b10151fb0 0x7f2b100c38c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.788 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- 172.21.15.178:0/1052811059 >> 172.21.15.178:0/1052811059 conn(0x7f2b1006fac0 msgr2=0x7f2b1006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:56.788 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- 172.21.15.178:0/1052811059 shutdown_connections 2023-11-28T20:37:56.788 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- 172.21.15.178:0/1052811059 wait complete. 2023-11-28T20:37:56.790 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 Processor -- start 2023-11-28T20:37:56.790 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- start start 2023-11-28T20:37:56.790 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b10066880 0x7f2b1015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.790 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b100c8080 0x7f2b101474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.790 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b10151fb0 0x7f2b101479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1015b060 con 0x7f2b10151fb0 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b10147020 con 0x7f2b100c8080 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b101597e0 con 0x7f2b10066880 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b156c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b10066880 0x7f2b1015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b14ec8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b100c8080 0x7f2b101474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b156c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b10066880 0x7f2b1015a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:53394/0 (socket says 172.21.15.178:53394) 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b156c9640 1 -- 172.21.15.178:0/1959701686 learned_addr learned my addr 172.21.15.178:0/1959701686 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b15eca640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b10151fb0 0x7f2b101479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b156c9640 1 -- 172.21.15.178:0/1959701686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b100c8080 msgr2=0x7f2b101474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.791 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b156c9640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b100c8080 0x7f2b101474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b156c9640 1 -- 172.21.15.178:0/1959701686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b10151fb0 msgr2=0x7f2b101479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b156c9640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b10151fb0 0x7f2b101479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b156c9640 1 -- 172.21.15.178:0/1959701686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c0094d0 con 0x7f2b10066880 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b14ec8640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b100c8080 0x7f2b101474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b15eca640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b10151fb0 0x7f2b101479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b156c9640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b10066880 0x7f2b1015a4f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c01d360 tx=0x7f2b0c01ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b05ffb640 1 -- 172.21.15.178:0/1959701686 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0ba600 con 0x7f2b10066880 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b05ffb640 1 -- 172.21.15.178:0/1959701686 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c0ba760 con 0x7f2b10066880 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- 172.21.15.178:0/1959701686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b100c8620 con 0x7f2b10066880 2023-11-28T20:37:56.792 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b05ffb640 1 -- 172.21.15.178:0/1959701686 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0bab10 con 0x7f2b10066880 2023-11-28T20:37:56.793 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b1792d640 1 -- 172.21.15.178:0/1959701686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1015ad80 con 0x7f2b10066880 2023-11-28T20:37:56.793 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b05ffb640 1 -- 172.21.15.178:0/1959701686 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2b0c0c4460 con 0x7f2b10066880 2023-11-28T20:37:56.793 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.785+0000 7f2b05ffb640 1 -- 172.21.15.178:0/1959701686 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2b0c0c3a20 con 0x7f2b10066880 2023-11-28T20:37:56.793 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.789+0000 7f2b1792d640 1 -- 172.21.15.178:0/1959701686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b10067c00 con 0x7f2b10066880 2023-11-28T20:37:56.793 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.789+0000 7f2b05ffb640 1 -- 172.21.15.178:0/1959701686 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2b0c0b5070 con 0x7f2b10066880 2023-11-28T20:37:56.832 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:56.829+0000 7f310c3e1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T20:37:56.850 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:56.849+0000 7fa907447180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T20:37:56.867 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.865+0000 7f2b1792d640 1 -- 172.21.15.178:0/1959701686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "359243a1-c3b8-4c25-9376-b964dcfe2d7b", "id": 7} v 0) v1 -- 0x7f2b10067c00 con 0x7f2b10066880 2023-11-28T20:37:56.873 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b05ffb640 1 -- 172.21.15.178:0/1959701686 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "359243a1-c3b8-4c25-9376-b964dcfe2d7b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b0c0c3c30 con 0x7f2b10066880 2023-11-28T20:37:56.873 INFO:teuthology.orchestra.run.smithi178.stdout:7 2023-11-28T20:37:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b1792d640 1 -- 172.21.15.178:0/1959701686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b10066880 msgr2=0x7f2b1015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b1792d640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b10066880 0x7f2b1015a4f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c01d360 tx=0x7f2b0c01ba50 comp rx=0 tx=0).stop 2023-11-28T20:37:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b1792d640 1 -- 172.21.15.178:0/1959701686 shutdown_connections 2023-11-28T20:37:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b1792d640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b10151fb0 0x7f2b101479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.874 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b1792d640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b100c8080 0x7f2b101474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b1792d640 1 --2- 172.21.15.178:0/1959701686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b10066880 0x7f2b1015a4f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b1792d640 1 -- 172.21.15.178:0/1959701686 >> 172.21.15.178:0/1959701686 conn(0x7f2b1006fac0 msgr2=0x7f2b1014c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b1792d640 1 -- 172.21.15.178:0/1959701686 shutdown_connections 2023-11-28T20:37:56.875 INFO:teuthology.orchestra.run.smithi178.stderr:2023-11-28T20:37:56.869+0000 7f2b1792d640 1 -- 172.21.15.178:0/1959701686 wait complete. 2023-11-28T20:37:56.889 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T20:37:56.890 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T20:37:56.893 INFO:tasks.ceph.osd.0:Started 2023-11-28T20:37:56.893 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T20:37:56.894 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T20:37:56.894 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:56.893+0000 7f310c3e1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T20:37:56.897 INFO:tasks.ceph.osd.1:Started 2023-11-28T20:37:56.898 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T20:37:56.898 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T20:37:56.901 INFO:tasks.ceph.osd.2:Started 2023-11-28T20:37:56.902 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T20:37:56.902 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T20:37:56.907 INFO:tasks.ceph.osd.3:Started 2023-11-28T20:37:56.907 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T20:37:56.907 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T20:37:56.909 INFO:tasks.ceph.osd.4:Started 2023-11-28T20:37:56.910 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T20:37:56.910 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T20:37:56.912 INFO:tasks.ceph.osd.5:Started 2023-11-28T20:37:56.912 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T20:37:56.912 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T20:37:56.915 INFO:tasks.ceph.osd.6:Started 2023-11-28T20:37:56.915 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T20:37:56.915 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T20:37:56.917 INFO:tasks.ceph.osd.7:Started 2023-11-28T20:37:56.918 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:37:57.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f091706b640 1 Processor -- start 2023-11-28T20:37:57.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f091706b640 1 -- start start 2023-11-28T20:37:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f091706b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0910151f60 0x7f09100c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f091706b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09100c5c90 0x7f09100c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f091706b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091015b220 con 0x7f091006a580 2023-11-28T20:37:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f091706b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100c4da0 con 0x7f0910151f60 2023-11-28T20:37:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f091706b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100c60f0 con 0x7f09100c5c90 2023-11-28T20:37:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f0914e07640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0910151f60 0x7f09100c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f0914e07640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0910151f60 0x7f09100c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46470/0 (socket says 172.21.15.167:46470) 2023-11-28T20:37:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f0914e07640 1 -- 172.21.15.167:0/214177385 learned_addr learned my addr 172.21.15.167:0/214177385 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:37:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f0915608640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f091006a580 0x7f091006ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45482/0 (socket says 172.21.15.167:45482) 2023-11-28T20:37:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f0907fff640 1 --2- 172.21.15.167:0/214177385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09100c5c90 0x7f09100c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:57.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f0914e07640 1 -- 172.21.15.167:0/214177385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09100c5c90 msgr2=0x7f09100c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:57.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f0914e07640 1 --2- 172.21.15.167:0/214177385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09100c5c90 0x7f09100c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f0914e07640 1 -- 172.21.15.167:0/214177385 >> v1:172.21.15.167:6789/0 conn(0x7f091006a580 legacy=0x7f091006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:57.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.085+0000 7f0914e07640 1 -- 172.21.15.167:0/214177385 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910152340 con 0x7f0910151f60 2023-11-28T20:37:57.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f0914e07640 1 --2- 172.21.15.167:0/214177385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0910151f60 0x7f09100c75c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f090c009870 tx=0x7f090c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8658a7563343b635 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:57.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f09077fe640 1 -- 172.21.15.167:0/214177385 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ac600 con 0x7f0910151f60 2023-11-28T20:37:57.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f09077fe640 1 -- 172.21.15.167:0/214177385 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0a8050 con 0x7f0910151f60 2023-11-28T20:37:57.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f09077fe640 1 -- 172.21.15.167:0/214177385 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ac980 con 0x7f0910151f60 2023-11-28T20:37:57.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f091706b640 1 -- 172.21.15.167:0/214177385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0910151f60 msgr2=0x7f09100c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:57.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f091706b640 1 --2- 172.21.15.167:0/214177385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0910151f60 0x7f09100c75c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f090c009870 tx=0x7f090c01c4b0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f091706b640 1 -- 172.21.15.167:0/214177385 shutdown_connections 2023-11-28T20:37:57.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f091706b640 1 --2- 172.21.15.167:0/214177385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09100c5c90 0x7f09100c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f091706b640 1 --2- 172.21.15.167:0/214177385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0910151f60 0x7f09100c75c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f091706b640 1 -- 172.21.15.167:0/214177385 >> 172.21.15.167:0/214177385 conn(0x7f09100cb1e0 msgr2=0x7f09100cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:57.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f091706b640 1 -- 172.21.15.167:0/214177385 shutdown_connections 2023-11-28T20:37:57.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.089+0000 7f091706b640 1 -- 172.21.15.167:0/214177385 wait complete. 2023-11-28T20:37:57.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 Processor -- start 2023-11-28T20:37:57.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 -- start start 2023-11-28T20:37:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f091006a580 0x7f091014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09100c5c90 0x7f09101615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0910151f60 0x7f0910161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910161160 con 0x7f091006a580 2023-11-28T20:37:57.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091015a9c0 con 0x7f09100c5c90 2023-11-28T20:37:57.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09101f3710 con 0x7f0910151f60 2023-11-28T20:37:57.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0914e07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f091006a580 0x7f091014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:57.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0914e07640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f091006a580 0x7f091014d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46486/0 (socket says 172.21.15.167:46486) 2023-11-28T20:37:57.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0914e07640 1 -- 172.21.15.167:0/3052304770 learned_addr learned my addr 172.21.15.167:0/3052304770 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:37:57.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0907fff640 1 --2- 172.21.15.167:0/3052304770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09100c5c90 0x7f09101615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:57.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0915608640 1 --2- 172.21.15.167:0/3052304770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0910151f60 0x7f0910161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:57.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0914e07640 1 -- 172.21.15.167:0/3052304770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0910151f60 msgr2=0x7f0910161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:57.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0914e07640 1 --2- 172.21.15.167:0/3052304770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0910151f60 0x7f0910161b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0914e07640 1 -- 172.21.15.167:0/3052304770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09100c5c90 msgr2=0x7f09101615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:57.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0914e07640 1 --2- 172.21.15.167:0/3052304770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09100c5c90 0x7f09101615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0914e07640 1 -- 172.21.15.167:0/3052304770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c0094d0 con 0x7f091006a580 2023-11-28T20:37:57.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f0914e07640 1 --2- 172.21.15.167:0/3052304770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f091006a580 0x7f091014d7f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f090c01ab60 tx=0x7f090c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:57.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f09057fa640 1 -- 172.21.15.167:0/3052304770 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0b7450 con 0x7f091006a580 2023-11-28T20:37:57.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f09057fa640 1 -- 172.21.15.167:0/3052304770 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0b75b0 con 0x7f091006a580 2023-11-28T20:37:57.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 -- 172.21.15.167:0/3052304770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09101f2b90 con 0x7f091006a580 2023-11-28T20:37:57.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f09057fa640 1 -- 172.21.15.167:0/3052304770 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0b7940 con 0x7f091006a580 2023-11-28T20:37:57.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.093+0000 7f091706b640 1 -- 172.21.15.167:0/3052304770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09101f3150 con 0x7f091006a580 2023-11-28T20:37:57.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.097+0000 7f09057fa640 1 -- 172.21.15.167:0/3052304770 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f090c0b3070 con 0x7f091006a580 2023-11-28T20:37:57.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.097+0000 7f09057fa640 1 -- 172.21.15.167:0/3052304770 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f090c0c0b30 con 0x7f091006a580 2023-11-28T20:37:57.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.097+0000 7f091706b640 1 -- 172.21.15.167:0/3052304770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09100682c0 con 0x7f091006a580 2023-11-28T20:37:57.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.097+0000 7f09057fa640 1 -- 172.21.15.167:0/3052304770 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f090c0bb020 con 0x7f091006a580 2023-11-28T20:37:57.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.153+0000 7f091706b640 1 -- 172.21.15.167:0/3052304770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0910160f80 con 0x7f091006a580 2023-11-28T20:37:57.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.153+0000 7f09057fa640 1 -- 172.21.15.167:0/3052304770 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f090c0b1070 con 0x7f091006a580 2023-11-28T20:37:57.158 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:37:57.158 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":10,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:37:56.868471+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:37:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.157+0000 7f091706b640 1 -- 172.21.15.167:0/3052304770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f091006a580 msgr2=0x7f091014d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.157+0000 7f091706b640 1 --2- 172.21.15.167:0/3052304770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f091006a580 0x7f091014d7f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f090c01ab60 tx=0x7f090c01acf0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.157+0000 7f091706b640 1 -- 172.21.15.167:0/3052304770 shutdown_connections 2023-11-28T20:37:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.157+0000 7f091706b640 1 --2- 172.21.15.167:0/3052304770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0910151f60 0x7f0910161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.157+0000 7f091706b640 1 --2- 172.21.15.167:0/3052304770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09100c5c90 0x7f09101615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.157+0000 7f091706b640 1 --2- 172.21.15.167:0/3052304770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f091006a580 0x7f091014d7f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:57.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.157+0000 7f091706b640 1 -- 172.21.15.167:0/3052304770 >> 172.21.15.167:0/3052304770 conn(0x7f09100cb1e0 msgr2=0x7f091014fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:57.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.157+0000 7f091706b640 1 -- 172.21.15.167:0/3052304770 shutdown_connections 2023-11-28T20:37:57.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:37:57.157+0000 7f091706b640 1 -- 172.21.15.167:0/3052304770 wait complete. 2023-11-28T20:37:57.177 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T20:37:57.178 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T20:37:57.520 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-28T20:37:57.517+0000 7f878ee60640 -1 Falling back to public interface 2023-11-28T20:37:57.527 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-28T20:37:57.525+0000 7faf1bad1640 -1 Falling back to public interface 2023-11-28T20:37:57.535 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-28T20:37:57.533+0000 7f0f0ee27640 -1 Falling back to public interface 2023-11-28T20:37:57.535 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-28T20:37:57.533+0000 7f270abc2640 -1 Falling back to public interface 2023-11-28T20:37:57.536 INFO:tasks.ceph.osd.0.smithi167.stderr:2023-11-28T20:37:57.533+0000 7fc1ecdbd640 -1 Falling back to public interface 2023-11-28T20:37:57.549 INFO:tasks.ceph.mgr.y.smithi167.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T20:37:57.549 INFO:tasks.ceph.mgr.y.smithi167.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T20:37:57.549 INFO:tasks.ceph.mgr.y.smithi167.stderr: from numpy import show_config as show_numpy_config 2023-11-28T20:37:57.560 INFO:tasks.ceph.mgr.x.smithi178.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T20:37:57.560 INFO:tasks.ceph.mgr.x.smithi178.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T20:37:57.560 INFO:tasks.ceph.mgr.x.smithi178.stderr: from numpy import show_config as show_numpy_config 2023-11-28T20:37:57.579 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-11-28T20:37:57.577+0000 7f0d0e070640 -1 Falling back to public interface 2023-11-28T20:37:57.591 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-11-28T20:37:57.589+0000 7ff4203a2640 -1 Falling back to public interface 2023-11-28T20:37:57.598 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:57.597+0000 7fa907447180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T20:37:57.603 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:57.601+0000 7f310c3e1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T20:37:57.623 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-11-28T20:37:57.621+0000 7fbb9a592640 -1 Falling back to public interface 2023-11-28T20:37:57.737 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:57.733+0000 7fa907447180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T20:37:57.750 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:57.745+0000 7f310c3e1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T20:37:57.906 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:57.901+0000 7fa907447180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T20:37:57.913 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:57.909+0000 7f310c3e1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T20:37:57.983 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:57.981+0000 7f310c3e1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T20:37:57.983 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T20:37:57.984 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:57.981+0000 7fa907447180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T20:37:58.111 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb1488fe640 1 Processor -- start 2023-11-28T20:37:58.111 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb1488fe640 1 -- start start 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb1488fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1440b0b70 0x7fb14406d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb1488fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1440c6780 0x7fb1440c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb1488fe640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14415a910 con 0x7fb144153e50 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb1488fe640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb144159e10 con 0x7fb1440b0b70 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb1488fe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440b1420 con 0x7fb1440c6780 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb13bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1440b0b70 0x7fb14406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb13bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1440b0b70 0x7fb14406d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46494/0 (socket says 172.21.15.167:46494) 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb13bfff640 1 -- 172.21.15.167:0/2452310837 learned_addr learned my addr 172.21.15.167:0/2452310837 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb14259c640 1 --1- 172.21.15.167:0/2452310837 >> v1:172.21.15.167:6789/0 conn(0x7fb144153e50 0x7fb14415d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45490/0 (socket says 172.21.15.167:45490) 2023-11-28T20:37:58.114 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb142d9d640 1 --2- 172.21.15.167:0/2452310837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1440c6780 0x7fb1440c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:58.115 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb13bfff640 1 -- 172.21.15.167:0/2452310837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1440c6780 msgr2=0x7fb1440c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:37:58.115 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb13bfff640 1 --2- 172.21.15.167:0/2452310837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1440c6780 0x7fb1440c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:58.115 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb13bfff640 1 -- 172.21.15.167:0/2452310837 >> v1:172.21.15.167:6789/0 conn(0x7fb144153e50 legacy=0x7fb14415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:58.115 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb13bfff640 1 -- 172.21.15.167:0/2452310837 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440c9c60 con 0x7fb1440b0b70 2023-11-28T20:37:58.115 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.109+0000 7fb141d9b640 1 -- 172.21.15.167:0/2452310837 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541708254 0 0) 0x7fb14415a910 con 0x7fb144153e50 2023-11-28T20:37:58.117 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb13bfff640 1 --2- 172.21.15.167:0/2452310837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 0x7fb14406d350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009870 tx=0x7fb12c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651c8ec8d7538f6a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:58.117 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb141d9b640 1 -- 172.21.15.167:0/2452310837 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0a7070 con 0x7fb1440b0b70 2023-11-28T20:37:58.117 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb141d9b640 1 -- 172.21.15.167:0/2452310837 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c0ab430 con 0x7fb1440b0b70 2023-11-28T20:37:58.117 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb141d9b640 1 -- 172.21.15.167:0/2452310837 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0ab7c0 con 0x7fb1440b0b70 2023-11-28T20:37:58.118 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:58.113+0000 7f310c3e1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T20:37:58.119 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb1488fe640 1 -- 172.21.15.167:0/2452310837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 msgr2=0x7fb14406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:58.119 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb1488fe640 1 --2- 172.21.15.167:0/2452310837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 0x7fb14406d350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009870 tx=0x7fb12c01c540 comp rx=0 tx=0).stop 2023-11-28T20:37:58.119 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb1488fe640 1 -- 172.21.15.167:0/2452310837 shutdown_connections 2023-11-28T20:37:58.119 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb1488fe640 1 --2- 172.21.15.167:0/2452310837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 0x7fb14406d350 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:58.119 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb1488fe640 1 --2- 172.21.15.167:0/2452310837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1440c6780 0x7fb1440c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:58.119 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb1488fe640 1 -- 172.21.15.167:0/2452310837 >> 172.21.15.167:0/2452310837 conn(0x7fb1440cbd80 msgr2=0x7fb1440cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:58.119 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb1488fe640 1 -- 172.21.15.167:0/2452310837 shutdown_connections 2023-11-28T20:37:58.119 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.113+0000 7fb1488fe640 1 -- 172.21.15.167:0/2452310837 wait complete. 2023-11-28T20:37:58.121 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.117+0000 7fb1488fe640 1 Processor -- start 2023-11-28T20:37:58.121 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.117+0000 7fb1488fe640 1 -- start start 2023-11-28T20:37:58.125 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb1488fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 0x7fb1441596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:58.125 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb1488fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1440c6780 0x7fb14414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:58.125 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb1488fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb144153e50 0x7fb144148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:37:58.126 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb1488fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440b01a0 con 0x7fb1440b0b70 2023-11-28T20:37:58.126 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb1488fe640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb144159c00 con 0x7fb1440c6780 2023-11-28T20:37:58.126 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb1488fe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14415d670 con 0x7fb144153e50 2023-11-28T20:37:58.126 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb14259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 0x7fb1441596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:58.127 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb14259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 0x7fb1441596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46508/0 (socket says 172.21.15.167:46508) 2023-11-28T20:37:58.127 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb14259c640 1 -- 172.21.15.167:0/3841705051 learned_addr learned my addr 172.21.15.167:0/3841705051 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:37:58.127 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb142d9d640 1 --2- 172.21.15.167:0/3841705051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb144153e50 0x7fb144148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:58.127 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb13bfff640 1 --2- 172.21.15.167:0/3841705051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1440c6780 0x7fb14414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:37:58.127 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb14259c640 1 -- 172.21.15.167:0/3841705051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb144153e50 msgr2=0x7fb144148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:58.127 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb14259c640 1 --2- 172.21.15.167:0/3841705051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb144153e50 0x7fb144148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:58.128 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb14259c640 1 -- 172.21.15.167:0/3841705051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1440c6780 msgr2=0x7fb14414ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:58.128 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb14259c640 1 --2- 172.21.15.167:0/3841705051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1440c6780 0x7fb14414ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:58.128 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb14259c640 1 -- 172.21.15.167:0/3841705051 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c0094d0 con 0x7fb1440b0b70 2023-11-28T20:37:58.128 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb14259c640 1 --2- 172.21.15.167:0/3841705051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 0x7fb1441596c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1340011f0 tx=0x7fb13400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:37:58.128 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb13affd640 1 -- 172.21.15.167:0/3841705051 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1340074e0 con 0x7fb1440b0b70 2023-11-28T20:37:58.129 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb13affd640 1 -- 172.21.15.167:0/3841705051 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134007640 con 0x7fb1440b0b70 2023-11-28T20:37:58.129 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb13affd640 1 -- 172.21.15.167:0/3841705051 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134004a10 con 0x7fb1440b0b70 2023-11-28T20:37:58.129 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb1488fe640 1 -- 172.21.15.167:0/3841705051 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1440cb600 con 0x7fb1440b0b70 2023-11-28T20:37:58.129 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb1488fe640 1 -- 172.21.15.167:0/3841705051 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14415d390 con 0x7fb1440b0b70 2023-11-28T20:37:58.129 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb13affd640 1 -- 172.21.15.167:0/3841705051 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb134012400 con 0x7fb1440b0b70 2023-11-28T20:37:58.130 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb13affd640 1 -- 172.21.15.167:0/3841705051 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb134012d80 con 0x7fb1440b0b70 2023-11-28T20:37:58.130 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.121+0000 7fb1488fe640 1 -- 172.21.15.167:0/3841705051 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1441f2500 con 0x7fb1440b0b70 2023-11-28T20:37:58.131 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.125+0000 7fb13affd640 1 -- 172.21.15.167:0/3841705051 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb134018070 con 0x7fb1440b0b70 2023-11-28T20:37:58.131 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:58.125+0000 7fa907447180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T20:37:58.183 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 -- 172.21.15.167:0/3841705051 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb14404e930 con 0x7fb1440b0b70 2023-11-28T20:37:58.184 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb13affd640 1 -- 172.21.15.167:0/3841705051 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb134012820 con 0x7fb1440b0b70 2023-11-28T20:37:58.184 INFO:teuthology.misc.health.smithi167.stdout: 2023-11-28T20:37:58.184 INFO:teuthology.misc.health.smithi167.stdout:{"epoch":10,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:37:56.868471+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:37:58.185 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 -- 172.21.15.167:0/3841705051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 msgr2=0x7fb1441596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:37:58.185 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 --2- 172.21.15.167:0/3841705051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 0x7fb1441596c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1340011f0 tx=0x7fb13400c9b0 comp rx=0 tx=0).stop 2023-11-28T20:37:58.186 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 -- 172.21.15.167:0/3841705051 shutdown_connections 2023-11-28T20:37:58.186 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 --2- 172.21.15.167:0/3841705051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb144153e50 0x7fb144148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:58.186 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 --2- 172.21.15.167:0/3841705051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1440c6780 0x7fb14414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:58.186 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 --2- 172.21.15.167:0/3841705051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1440b0b70 0x7fb1441596c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:37:58.186 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 -- 172.21.15.167:0/3841705051 >> 172.21.15.167:0/3841705051 conn(0x7fb1440cbd80 msgr2=0x7fb1440cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:37:58.186 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 -- 172.21.15.167:0/3841705051 shutdown_connections 2023-11-28T20:37:58.186 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:37:58.181+0000 7fb1488fe640 1 -- 172.21.15.167:0/3841705051 wait complete. 2023-11-28T20:37:58.203 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T20:37:58.728 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:58.725+0000 7f310c3e1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T20:37:58.803 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:58.801+0000 7f310c3e1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T20:37:58.815 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:58.813+0000 7fa907447180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T20:37:58.902 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:58.897+0000 7fa907447180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T20:37:58.973 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:58.969+0000 7f310c3e1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T20:37:59.046 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:59.041+0000 7f310c3e1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T20:37:59.092 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:59.089+0000 7fa907447180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T20:37:59.177 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:59.173+0000 7fa907447180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T20:37:59.334 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:59.333+0000 7f310c3e1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T20:37:59.393 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:37:59.389+0000 7f310c3e1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T20:37:59.509 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:59.505+0000 7fa907447180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T20:37:59.578 INFO:tasks.ceph.mgr.y.smithi167.stderr:2023-11-28T20:37:59.573+0000 7fa907447180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T20:38:00.430 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:38:00.425+0000 7f30b3b69640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T20:38:00.433 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-11-28T20:38:00.429+0000 7f30b3b69640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T20:38:01.128 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-28T20:38:01.125+0000 7faf1bad1640 -1 osd.7 0 log_to_monitors true 2023-11-28T20:38:01.154 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-28T20:38:01.149+0000 7f0f0ee27640 -1 osd.5 0 log_to_monitors true 2023-11-28T20:38:01.310 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-28T20:38:01.309+0000 7f878ee60640 -1 osd.4 0 log_to_monitors true 2023-11-28T20:38:01.389 INFO:tasks.ceph.osd.0.smithi167.stderr:2023-11-28T20:38:01.385+0000 7fc1ecdbd640 -1 osd.0 0 log_to_monitors true 2023-11-28T20:38:01.512 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-28T20:38:01.509+0000 7f270abc2640 -1 osd.6 0 log_to_monitors true 2023-11-28T20:38:01.541 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-11-28T20:38:01.537+0000 7ff4203a2640 -1 osd.2 0 log_to_monitors true 2023-11-28T20:38:01.562 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-11-28T20:38:01.557+0000 7f0d0e070640 -1 osd.1 0 log_to_monitors true 2023-11-28T20:38:01.601 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-11-28T20:38:01.597+0000 7fbb9a592640 -1 osd.3 0 log_to_monitors true 2023-11-28T20:38:03.399 INFO:tasks.ceph.osd.0.smithi167.stderr:2023-11-28T20:38:03.397+0000 7fc1e8d66640 -1 osd.0 0 waiting for initial osdmap 2023-11-28T20:38:03.428 INFO:tasks.ceph.osd.0.smithi167.stderr:2023-11-28T20:38:03.425+0000 7fc1e0ba1640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:38:03.683 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-28T20:38:03.677+0000 7f878ae09640 -1 osd.4 0 waiting for initial osdmap 2023-11-28T20:38:03.708 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-11-28T20:38:03.705+0000 7f8782c44640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:38:03.719 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-28T20:38:03.717+0000 7faf17a7a640 -1 osd.7 0 waiting for initial osdmap 2023-11-28T20:38:03.743 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-11-28T20:38:03.741+0000 7faf0f8b5640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:38:03.751 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-28T20:38:03.749+0000 7f0f0add0640 -1 osd.5 0 waiting for initial osdmap 2023-11-28T20:38:03.776 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-11-28T20:38:03.773+0000 7f0f02c0b640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:38:04.274 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-28T20:38:04.273+0000 7f2706b6b640 -1 osd.6 0 waiting for initial osdmap 2023-11-28T20:38:04.315 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-11-28T20:38:04.313+0000 7f26fe9a6640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:38:05.010 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:05.230 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.225+0000 7f65cd565640 1 Processor -- start 2023-11-28T20:38:05.230 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.225+0000 7f65cd565640 1 -- start start 2023-11-28T20:38:05.232 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65cd565640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f65c8150af0 0x7f65c8157470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:05.232 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65cd565640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f65c80cb170 0x7f65c80cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:05.232 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65cd565640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c80c7a90 con 0x7f65c80c6ed0 2023-11-28T20:38:05.232 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65cd565640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80cbac0 con 0x7f65c8150af0 2023-11-28T20:38:05.232 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65cd565640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80c6d40 con 0x7f65c80cb170 2023-11-28T20:38:05.233 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65c67fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f65c80c6ed0 0x7f65c80c6630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46568/0 (socket says 172.21.15.167:46568) 2023-11-28T20:38:05.233 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65c67fc640 1 -- 172.21.15.167:0/2224799834 learned_addr learned my addr 172.21.15.167:0/2224799834 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:05.233 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65c77fe640 1 --2- 172.21.15.167:0/2224799834 >> v2:172.21.15.178:3300/0 conn(0x7f65c80cb170 0x7f65c80cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:05.233 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65c6ffd640 1 --2- 172.21.15.167:0/2224799834 >> v2:172.21.15.167:3300/0 conn(0x7f65c8150af0 0x7f65c8157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:05.234 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65c5ffb640 1 -- 172.21.15.167:0/2224799834 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174899704 0 0) 0x7f65b0001120 con 0x7f65c80c6ed0 2023-11-28T20:38:05.234 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65c77fe640 1 -- 172.21.15.167:0/2224799834 >> v2:172.21.15.167:3300/0 conn(0x7f65c8150af0 msgr2=0x7f65c8157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:05.234 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65c77fe640 1 --2- 172.21.15.167:0/2224799834 >> v2:172.21.15.167:3300/0 conn(0x7f65c8150af0 0x7f65c8157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.234 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65c77fe640 1 -- 172.21.15.167:0/2224799834 >> v1:172.21.15.167:6789/0 conn(0x7f65c80c6ed0 legacy=0x7f65c80c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:05.234 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.229+0000 7f65c77fe640 1 -- 172.21.15.167:0/2224799834 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80c56a0 con 0x7f65c80cb170 2023-11-28T20:38:05.237 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.233+0000 7f65c77fe640 1 --2- 172.21.15.167:0/2224799834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c80cb170 0x7f65c80cb580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f65c81545a0 tx=0x7f65c001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0274fce49372332 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:05.238 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.233+0000 7f65c5ffb640 1 -- 172.21.15.167:0/2224799834 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00a6670 con 0x7f65c80cb170 2023-11-28T20:38:05.238 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65c5ffb640 1 -- 172.21.15.167:0/2224799834 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c00a67d0 con 0x7f65c80cb170 2023-11-28T20:38:05.238 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65c5ffb640 1 -- 172.21.15.167:0/2224799834 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00a6b60 con 0x7f65c80cb170 2023-11-28T20:38:05.239 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65cd565640 1 -- 172.21.15.167:0/2224799834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c80cb170 msgr2=0x7f65c80cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:05.239 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65cd565640 1 --2- 172.21.15.167:0/2224799834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c80cb170 0x7f65c80cb580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f65c81545a0 tx=0x7f65c001c8c0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.240 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65cd565640 1 -- 172.21.15.167:0/2224799834 shutdown_connections 2023-11-28T20:38:05.240 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65cd565640 1 --2- 172.21.15.167:0/2224799834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c80cb170 0x7f65c80cb580 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.240 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65cd565640 1 --2- 172.21.15.167:0/2224799834 >> v2:172.21.15.167:3300/0 conn(0x7f65c8150af0 0x7f65c8157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.240 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65cd565640 1 -- 172.21.15.167:0/2224799834 >> 172.21.15.167:0/2224799834 conn(0x7f65c806a580 msgr2=0x7f65c806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:05.241 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65cd565640 1 -- 172.21.15.167:0/2224799834 shutdown_connections 2023-11-28T20:38:05.241 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.237+0000 7f65cd565640 1 -- 172.21.15.167:0/2224799834 wait complete. 2023-11-28T20:38:05.248 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.241+0000 7f65cd565640 1 Processor -- start 2023-11-28T20:38:05.248 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.241+0000 7f65cd565640 1 -- start start 2023-11-28T20:38:05.248 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65cd565640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65c80c6ed0 0x7f65c814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:05.248 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65cd565640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c80cb170 0x7f65c80c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:05.248 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65cd565640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c8150af0 0x7f65c815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:05.248 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65cd565640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c81f7760 con 0x7f65c80cb170 2023-11-28T20:38:05.248 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65cd565640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c814f0c0 con 0x7f65c8150af0 2023-11-28T20:38:05.248 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65cd565640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c814f3a0 con 0x7f65c80c6ed0 2023-11-28T20:38:05.249 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c67fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c80cb170 0x7f65c80c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:05.249 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c67fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c80cb170 0x7f65c80c0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42164/0 (socket says 172.21.15.167:42164) 2023-11-28T20:38:05.249 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c67fc640 1 -- 172.21.15.167:0/1885095076 learned_addr learned my addr 172.21.15.167:0/1885095076 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:05.249 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c77fe640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c8150af0 0x7f65c815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:05.250 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c6ffd640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65c80c6ed0 0x7f65c814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:05.250 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c67fc640 1 -- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65c80c6ed0 msgr2=0x7f65c814e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:05.250 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c67fc640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65c80c6ed0 0x7f65c814e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.250 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c67fc640 1 -- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c8150af0 msgr2=0x7f65c815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:05.250 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c67fc640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c8150af0 0x7f65c815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.251 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c67fc640 1 -- 172.21.15.167:0/1885095076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c0009a70 con 0x7f65c80cb170 2023-11-28T20:38:05.251 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c6ffd640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65c80c6ed0 0x7f65c814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:05.251 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c77fe640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c8150af0 0x7f65c815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:05.251 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65c67fc640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c80cb170 0x7f65c80c0710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65b0007fd0 tx=0x7f65b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:05.251 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65bf7fe640 1 -- 172.21.15.167:0/1885095076 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0005cf0 con 0x7f65c80cb170 2023-11-28T20:38:05.251 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65bf7fe640 1 -- 172.21.15.167:0/1885095076 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b0005e50 con 0x7f65c80cb170 2023-11-28T20:38:05.251 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.245+0000 7f65bf7fe640 1 -- 172.21.15.167:0/1885095076 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0005cf0 con 0x7f65c80cb170 2023-11-28T20:38:05.253 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.249+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c814f680 con 0x7f65c80cb170 2023-11-28T20:38:05.258 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.249+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c81f7420 con 0x7f65c80cb170 2023-11-28T20:38:05.258 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.253+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c814fb30 con 0x7f65c80cb170 2023-11-28T20:38:05.258 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.253+0000 7f65bf7fe640 1 -- 172.21.15.167:0/1885095076 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f65b0007070 con 0x7f65c80cb170 2023-11-28T20:38:05.259 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.257+0000 7f65bf7fe640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65a8066470 0x7f65a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:05.259 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.257+0000 7f65bf7fe640 1 -- 172.21.15.167:0/1885095076 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3631+0+0 (secure 0 0 0) 0x7f65b00825a0 con 0x7f65c80cb170 2023-11-28T20:38:05.259 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.257+0000 7f65c6ffd640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65a8066470 0x7f65a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:05.260 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.257+0000 7f65c6ffd640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65a8066470 0x7f65a8068930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009a40 tx=0x7f65b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:05.269 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.265+0000 7f65bf7fe640 1 -- 172.21.15.167:0/1885095076 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65b00502a0 con 0x7f65c80cb170 2023-11-28T20:38:05.364 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-11-28T20:38:05.357+0000 7f0d0a019640 -1 osd.1 0 waiting for initial osdmap 2023-11-28T20:38:05.377 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-11-28T20:38:05.373+0000 7ff41cb5d640 -1 osd.2 0 waiting for initial osdmap 2023-11-28T20:38:05.384 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-11-28T20:38:05.381+0000 7fbb96d4d640 -1 osd.3 0 waiting for initial osdmap 2023-11-28T20:38:05.400 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-11-28T20:38:05.397+0000 7f0d01e54640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:38:05.412 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-11-28T20:38:05.409+0000 7ff414186640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:38:05.412 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-11-28T20:38:05.409+0000 7fbb8e376640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T20:38:05.480 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.477+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65c80c7a90 con 0x7f65c80cb170 2023-11-28T20:38:05.509 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.505+0000 7f65bf7fe640 1 -- 172.21.15.167:0/1885095076 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9474 (secure 0 0 0) 0x7f65c80c7a90 con 0x7f65c80cb170 2023-11-28T20:38:05.509 INFO:teuthology.misc.health.smithi167.stdout: 2023-11-28T20:38:05.509 INFO:teuthology.misc.health.smithi167.stdout:{"epoch":14,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:04.428392+0000","last_up_change":"2023-11-28T20:38:04.428392+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:05.512 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65a8066470 msgr2=0x7f65a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:05.512 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65a8066470 0x7f65a8068930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009a40 tx=0x7f65b8008040 comp rx=0 tx=0).stop 2023-11-28T20:38:05.512 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c80cb170 msgr2=0x7f65c80c0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:05.512 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c80cb170 0x7f65c80c0710 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65b0007fd0 tx=0x7f65b000c8e0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.513 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 shutdown_connections 2023-11-28T20:38:05.513 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65a8066470 0x7f65a8068930 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.513 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65c8150af0 0x7f65c815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.513 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65c80cb170 0x7f65c80c0710 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.513 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 --2- 172.21.15.167:0/1885095076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65c80c6ed0 0x7f65c814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:05.513 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 >> 172.21.15.167:0/1885095076 conn(0x7f65c806a580 msgr2=0x7f65c815c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:05.513 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 shutdown_connections 2023-11-28T20:38:05.513 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:05.509+0000 7f65cd565640 1 -- 172.21.15.167:0/1885095076 wait complete. 2023-11-28T20:38:05.535 DEBUG:teuthology.misc:5 of 8 OSDs are up 2023-11-28T20:38:12.343 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:12.481 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.477+0000 7f02216fd640 1 Processor -- start 2023-11-28T20:38:12.481 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.477+0000 7f02216fd640 1 -- start start 2023-11-28T20:38:12.483 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.477+0000 7f02216fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 0x7f021c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.483 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.477+0000 7f02216fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c15adb0 con 0x7f021c0cbbc0 2023-11-28T20:38:12.483 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.477+0000 7f02216fd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c15a510 con 0x7f021c153fb0 2023-11-28T20:38:12.483 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.477+0000 7f02216fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c15a7f0 con 0x7f021c154390 2023-11-28T20:38:12.483 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.477+0000 7f02127fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f021c0cbbc0 0x7f021c0cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46570/0 (socket says 172.21.15.167:46570) 2023-11-28T20:38:12.484 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.477+0000 7f02127fc640 1 -- 172.21.15.167:0/3352481531 learned_addr learned my addr 172.21.15.167:0/3352481531 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:12.484 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.477+0000 7f021b7fe640 1 --2- 172.21.15.167:0/3352481531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 0x7f021c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.484 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.481+0000 7f021b7fe640 1 -- 172.21.15.167:0/3352481531 >> v1:172.21.15.178:6789/0 conn(0x7f021c153fb0 legacy=0x7f021c15dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.484 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.481+0000 7f021b7fe640 1 -- 172.21.15.167:0/3352481531 >> v1:172.21.15.167:6789/0 conn(0x7f021c0cbbc0 legacy=0x7f021c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.484 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.481+0000 7f021b7fe640 1 -- 172.21.15.167:0/3352481531 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c15aad0 con 0x7f021c154390 2023-11-28T20:38:12.497 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f021b7fe640 1 --2- 172.21.15.167:0/3352481531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 0x7f021c159e60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0214009dc0 tx=0x7f021401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bdbe497938a3a2b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:12.497 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f021a7fc640 1 -- 172.21.15.167:0/3352481531 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140a5a00 con 0x7f021c154390 2023-11-28T20:38:12.497 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f021a7fc640 1 -- 172.21.15.167:0/3352481531 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02140a5b60 con 0x7f021c154390 2023-11-28T20:38:12.497 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f021a7fc640 1 -- 172.21.15.167:0/3352481531 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140ad440 con 0x7f021c154390 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f02216fd640 1 -- 172.21.15.167:0/3352481531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 msgr2=0x7f021c159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f02216fd640 1 --2- 172.21.15.167:0/3352481531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 0x7f021c159e60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0214009dc0 tx=0x7f021401c940 comp rx=0 tx=0).stop 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f02216fd640 1 -- 172.21.15.167:0/3352481531 shutdown_connections 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f02216fd640 1 --2- 172.21.15.167:0/3352481531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 0x7f021c159e60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f02216fd640 1 -- 172.21.15.167:0/3352481531 >> 172.21.15.167:0/3352481531 conn(0x7f021c071e80 msgr2=0x7f021c06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f02216fd640 1 -- 172.21.15.167:0/3352481531 shutdown_connections 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f02216fd640 1 -- 172.21.15.167:0/3352481531 wait complete. 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f02216fd640 1 Processor -- start 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.485+0000 7f02216fd640 1 -- start start 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02216fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c0cbbc0 0x7f021c1f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02216fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c153fb0 0x7f021c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.498 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02216fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 0x7f021c0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02216fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0ce340 con 0x7f021c0cbbc0 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02216fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1f46a0 con 0x7f021c153fb0 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02216fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0cf920 con 0x7f021c154390 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c0cbbc0 0x7f021c1f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c0cbbc0 0x7f021c1f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42180/0 (socket says 172.21.15.167:42180) 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021affd640 1 -- 172.21.15.167:0/203830607 learned_addr learned my addr 172.21.15.167:0/203830607 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02127fc640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c153fb0 0x7f021c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021b7fe640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 0x7f021c0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021affd640 1 -- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 msgr2=0x7f021c0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021affd640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 0x7f021c0cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.499 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021affd640 1 -- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c153fb0 msgr2=0x7f021c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021affd640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c153fb0 0x7f021c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021affd640 1 -- 172.21.15.167:0/203830607 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214009a70 con 0x7f021c0cbbc0 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f021affd640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c0cbbc0 0x7f021c1f4160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f020c00c530 tx=0x7f020c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f0213fff640 1 -- 172.21.15.167:0/203830607 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c005220 con 0x7f021c0cbbc0 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f0213fff640 1 -- 172.21.15.167:0/203830607 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c005380 con 0x7f021c0cbbc0 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f0213fff640 1 -- 172.21.15.167:0/203830607 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c007270 con 0x7f021c0cbbc0 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c15cd70 con 0x7f021c0cbbc0 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0ce060 con 0x7f021c0cbbc0 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c0b4b70 con 0x7f021c0cbbc0 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.489+0000 7f0213fff640 1 -- 172.21.15.167:0/203830607 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f020c0073d0 con 0x7f021c0cbbc0 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.493+0000 7f0213fff640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02000664a0 0x7f0200068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.500 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.493+0000 7f0213fff640 1 -- 172.21.15.167:0/203830607 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f020c0833a0 con 0x7f021c0cbbc0 2023-11-28T20:38:12.501 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.493+0000 7f02127fc640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02000664a0 0x7f0200068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.501 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.493+0000 7f02127fc640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02000664a0 0x7f0200068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f021c158a30 tx=0x7f0204009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:12.501 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.497+0000 7f0213fff640 1 -- 172.21.15.167:0/203830607 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f020c050b90 con 0x7f021c0cbbc0 2023-11-28T20:38:12.653 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.649+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f021c04e930 con 0x7f021c0cbbc0 2023-11-28T20:38:12.686 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.649+0000 7f0213fff640 1 -- 172.21.15.167:0/203830607 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f020c0541b0 con 0x7f021c0cbbc0 2023-11-28T20:38:12.686 INFO:teuthology.misc.health.smithi167.stdout: 2023-11-28T20:38:12.686 INFO:teuthology.misc.health.smithi167.stdout:{"epoch":17,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:07.526381+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:12.687 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02000664a0 msgr2=0x7f0200068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.688 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02000664a0 0x7f0200068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f021c158a30 tx=0x7f0204009040 comp rx=0 tx=0).stop 2023-11-28T20:38:12.688 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c0cbbc0 msgr2=0x7f021c1f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.688 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c0cbbc0 0x7f021c1f4160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f020c00c530 tx=0x7f020c00c9f0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.688 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 shutdown_connections 2023-11-28T20:38:12.688 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02000664a0 0x7f0200068960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.688 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c154390 0x7f021c0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.688 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c153fb0 0x7f021c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.689 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 --2- 172.21.15.167:0/203830607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f021c0cbbc0 0x7f021c1f4160 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.689 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 >> 172.21.15.167:0/203830607 conn(0x7f021c071e80 msgr2=0x7f021c159420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:12.689 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 shutdown_connections 2023-11-28T20:38:12.689 INFO:teuthology.misc.health.smithi167.stderr:2023-11-28T20:38:12.653+0000 7f02216fd640 1 -- 172.21.15.167:0/203830607 wait complete. 2023-11-28T20:38:12.690 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T20:38:12.690 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T20:38:12.690 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T20:38:12.690 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T20:38:12.698 INFO:tasks.ceph.mds.a:Started 2023-11-28T20:38:12.698 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T20:38:12.698 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T20:38:12.702 INFO:tasks.ceph.mds.c:Started 2023-11-28T20:38:12.702 INFO:tasks.ceph.mds.e:Restarting daemon 2023-11-28T20:38:12.703 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2023-11-28T20:38:12.706 INFO:tasks.ceph.mds.e:Started 2023-11-28T20:38:12.707 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T20:38:12.707 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T20:38:12.710 INFO:tasks.ceph.mds.b:Started 2023-11-28T20:38:12.710 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T20:38:12.710 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T20:38:12.713 INFO:tasks.ceph.mds.d:Started 2023-11-28T20:38:12.713 INFO:tasks.ceph.mds.f:Restarting daemon 2023-11-28T20:38:12.714 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2023-11-28T20:38:12.717 INFO:tasks.ceph.mds.f:Started 2023-11-28T20:38:12.720 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T20:38:12.721 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:12.789 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-11-28T20:38:12.799 INFO:tasks.ceph.mds.f.smithi178.stdout:starting mds.f at 2023-11-28T20:38:12.799 INFO:tasks.ceph.mds.e.smithi167.stdout:starting mds.e at 2023-11-28T20:38:12.799 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-11-28T20:38:12.799 INFO:tasks.ceph.mds.a.smithi167.stdout:starting mds.a at 2023-11-28T20:38:12.800 INFO:tasks.ceph.mds.e.smithi167.stderr:2023-11-28T20:38:12.797+0000 7efc1e79d640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6833/0: (98) Address already in use 2023-11-28T20:38:12.814 INFO:tasks.ceph.mds.c.smithi167.stdout:starting mds.c at 2023-11-28T20:38:12.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.881+0000 7f408b3e4640 1 Processor -- start 2023-11-28T20:38:12.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.881+0000 7f408b3e4640 1 -- start start 2023-11-28T20:38:12.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f408b3e4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084159b20 0x7f40840c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f408b3e4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40840c5fb0 0x7f40840cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f408b3e4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4084159f40 con 0x7f4084153d20 2023-11-28T20:38:12.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f408b3e4640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408415a1b0 con 0x7f40840c5fb0 2023-11-28T20:38:12.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f408b3e4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408415a450 con 0x7f4084159b20 2023-11-28T20:38:12.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f408a3e2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4084153d20 0x7f40840ca3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53166/0 (socket says 172.21.15.167:53166) 2023-11-28T20:38:12.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f408a3e2640 1 -- 172.21.15.167:0/1194063422 learned_addr learned my addr 172.21.15.167:0/1194063422 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:12.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f4089be1640 1 --2- 172.21.15.167:0/1194063422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084159b20 0x7f40840c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f408abe3640 1 --2- 172.21.15.167:0/1194063422 >> v2:172.21.15.178:3300/0 conn(0x7f40840c5fb0 0x7f40840cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f40893e0640 1 -- 172.21.15.167:0/1194063422 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465235454 0 0) 0x7f4084159f40 con 0x7f4084153d20 2023-11-28T20:38:12.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f40893e0640 1 -- 172.21.15.167:0/1194063422 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4070003530 con 0x7f4084153d20 2023-11-28T20:38:12.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f4089be1640 1 -- 172.21.15.167:0/1194063422 >> v2:172.21.15.178:3300/0 conn(0x7f40840c5fb0 msgr2=0x7f40840cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:12.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f4089be1640 1 --2- 172.21.15.167:0/1194063422 >> v2:172.21.15.178:3300/0 conn(0x7f40840c5fb0 0x7f40840cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f4089be1640 1 -- 172.21.15.167:0/1194063422 >> v1:172.21.15.167:6789/0 conn(0x7f4084153d20 legacy=0x7f40840ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f4089be1640 1 -- 172.21.15.167:0/1194063422 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408415a710 con 0x7f4084159b20 2023-11-28T20:38:12.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.885+0000 7f408abe3640 1 --2- 172.21.15.167:0/1194063422 >> v2:172.21.15.178:3300/0 conn(0x7f40840c5fb0 0x7f40840cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:12.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f4089be1640 1 --2- 172.21.15.167:0/1194063422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084159b20 0x7f40840c5a70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f40740097c0 tx=0x7f407401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a87c8ba1ef76fcd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:12.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f40893e0640 1 -- 172.21.15.167:0/1194063422 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40740a8970 con 0x7f4084159b20 2023-11-28T20:38:12.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f40893e0640 1 -- 172.21.15.167:0/1194063422 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40740a8ad0 con 0x7f4084159b20 2023-11-28T20:38:12.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f40893e0640 1 -- 172.21.15.167:0/1194063422 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40740a8e40 con 0x7f4084159b20 2023-11-28T20:38:12.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f408b3e4640 1 -- 172.21.15.167:0/1194063422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084159b20 msgr2=0x7f40840c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f408b3e4640 1 --2- 172.21.15.167:0/1194063422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084159b20 0x7f40840c5a70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f40740097c0 tx=0x7f407401ec70 comp rx=0 tx=0).stop 2023-11-28T20:38:12.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f408b3e4640 1 -- 172.21.15.167:0/1194063422 shutdown_connections 2023-11-28T20:38:12.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f408b3e4640 1 --2- 172.21.15.167:0/1194063422 >> v2:172.21.15.178:3300/0 conn(0x7f40840c5fb0 0x7f40840cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f408b3e4640 1 --2- 172.21.15.167:0/1194063422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084159b20 0x7f40840c5a70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f408b3e4640 1 -- 172.21.15.167:0/1194063422 >> 172.21.15.167:0/1194063422 conn(0x7f408406b800 msgr2=0x7f408406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:12.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f408b3e4640 1 -- 172.21.15.167:0/1194063422 shutdown_connections 2023-11-28T20:38:12.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.889+0000 7f408b3e4640 1 -- 172.21.15.167:0/1194063422 wait complete. 2023-11-28T20:38:12.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 Processor -- start 2023-11-28T20:38:12.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 -- start start 2023-11-28T20:38:12.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40840c5fb0 0x7f4084146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084153d20 0x7f40841f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4084159b20 0x7f4084143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4084145ae0 con 0x7f40840c5fb0 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40841f2d00 con 0x7f4084159b20 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4084146930 con 0x7f4084153d20 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408a3e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40840c5fb0 0x7f4084146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408a3e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40840c5fb0 0x7f4084146eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38106/0 (socket says 172.21.15.167:38106) 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408a3e2640 1 -- 172.21.15.167:0/837422821 learned_addr learned my addr 172.21.15.167:0/837422821 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408abe3640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4084159b20 0x7f4084143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f4089be1640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084153d20 0x7f40841f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408a3e2640 1 -- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084153d20 msgr2=0x7f40841f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408a3e2640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084153d20 0x7f40841f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408a3e2640 1 -- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4084159b20 msgr2=0x7f4084143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:12.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408a3e2640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4084159b20 0x7f4084143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:12.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408a3e2640 1 -- 172.21.15.167:0/837422821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c009a70 con 0x7f40840c5fb0 2023-11-28T20:38:12.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408a3e2640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40840c5fb0 0x7f4084146eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f408000c480 tx=0x7f408000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:12.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f407affd640 1 -- 172.21.15.167:0/837422821 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080005cf0 con 0x7f40840c5fb0 2023-11-28T20:38:12.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f407affd640 1 -- 172.21.15.167:0/837422821 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4080005e50 con 0x7f40840c5fb0 2023-11-28T20:38:12.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f407affd640 1 -- 172.21.15.167:0/837422821 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080007290 con 0x7f40840c5fb0 2023-11-28T20:38:12.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4074009420 con 0x7f40840c5fb0 2023-11-28T20:38:12.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4084144f30 con 0x7f40840c5fb0 2023-11-28T20:38:12.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.893+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408404e850 con 0x7f40840c5fb0 2023-11-28T20:38:12.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.897+0000 7f407affd640 1 -- 172.21.15.167:0/837422821 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40800073f0 con 0x7f40840c5fb0 2023-11-28T20:38:12.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.897+0000 7f407affd640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4068066470 0x7f4068068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:12.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.897+0000 7f407affd640 1 -- 172.21.15.167:0/837422821 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4080083180 con 0x7f40840c5fb0 2023-11-28T20:38:12.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.897+0000 7f4089be1640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4068066470 0x7f4068068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:12.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.897+0000 7f4089be1640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4068066470 0x7f4068068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f40740b2000 tx=0x7f40740aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:12.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:12.901+0000 7f407affd640 1 -- 172.21.15.167:0/837422821 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4080050940 con 0x7f40840c5fb0 2023-11-28T20:38:13.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4084157770 con 0x7f40840c5fb0 2023-11-28T20:38:13.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f407affd640 1 -- 172.21.15.167:0/837422821 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f4080017090 con 0x7f40840c5fb0 2023-11-28T20:38:13.056 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:13.056 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":17,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:07.526381+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:13.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4068066470 msgr2=0x7f4068068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4068066470 0x7f4068068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f40740b2000 tx=0x7f40740aa070 comp rx=0 tx=0).stop 2023-11-28T20:38:13.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40840c5fb0 msgr2=0x7f4084146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40840c5fb0 0x7f4084146eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f408000c480 tx=0x7f408000c940 comp rx=0 tx=0).stop 2023-11-28T20:38:13.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 shutdown_connections 2023-11-28T20:38:13.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4068066470 0x7f4068068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4084159b20 0x7f4084143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4084153d20 0x7f40841f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 --2- 172.21.15.167:0/837422821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40840c5fb0 0x7f4084146eb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 >> 172.21.15.167:0/837422821 conn(0x7f408406b800 msgr2=0x7f40840cc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:13.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 shutdown_connections 2023-11-28T20:38:13.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.053+0000 7f408b3e4640 1 -- 172.21.15.167:0/837422821 wait complete. 2023-11-28T20:38:13.077 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:38:05.507993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:38:13.077 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:38:13.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.213+0000 7f3f64f2a640 1 Processor -- start 2023-11-28T20:38:13.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.213+0000 7f3f64f2a640 1 -- start start 2023-11-28T20:38:13.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f64f2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f60072630 0x7f3f60161b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f64f2a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f601571d0 con 0x7f3f6006e030 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f64f2a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f60071a90 con 0x7f3f60070480 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f64f2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600c70d0 con 0x7f3f60072630 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5e59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3f6006e030 0x7f3f601500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53170/0 (socket says 172.21.15.167:53170) 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5e59c640 1 -- 172.21.15.167:0/2751577557 learned_addr learned my addr 172.21.15.167:0/2751577557 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5ed9d640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f60072630 0x7f3f60161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835568699 0 0) 0x7f3f601571d0 con 0x7f3f6006e030 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f48003530 con 0x7f3f6006e030 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4025979423 0 0) 0x7f3f48003530 con 0x7f3f6006e030 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f60072630 msgr2=0x7f3f60161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f60072630 0x7f3f60161b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 >> v1:172.21.15.178:6789/0 conn(0x7f3f60070480 legacy=0x7f3f60071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f600c73b0 con 0x7f3f6006e030 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f3f50001680 con 0x7f3f6006e030 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 >> v1:172.21.15.167:6789/0 conn(0x7f3f6006e030 legacy=0x7f3f601500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f480039b0 0x7f3f48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f60072630 0x7f3f480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f48004d10 0x7f3f48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600c70d0 con 0x7f3f48004d10 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4800ba40 con 0x7f3f480039b0 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4800bc00 con 0x7f3f60072630 2023-11-28T20:38:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5ed9d640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f48004d10 0x7f3f48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5e59c640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f480039b0 0x7f3f48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5dd9b640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f60072630 0x7f3f480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5ed9d640 1 -- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f60072630 msgr2=0x7f3f480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5ed9d640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f60072630 0x7f3f480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5ed9d640 1 -- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f480039b0 msgr2=0x7f3f48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5ed9d640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f480039b0 0x7f3f48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.217+0000 7f3f5ed9d640 1 -- 172.21.15.167:0/2751577557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48003530 con 0x7f3f48004d10 2023-11-28T20:38:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f5ed9d640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f48004d10 0x7f3f48005190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f6006c2a0 tx=0x7f3f5801dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e818ea4fd7301d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5800a2d0 con 0x7f3f48004d10 2023-11-28T20:38:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58010040 con 0x7f3f48004d10 2023-11-28T20:38:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f5d59a640 1 -- 172.21.15.167:0/2751577557 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580a6d00 con 0x7f3f48004d10 2023-11-28T20:38:13.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f64f2a640 1 -- 172.21.15.167:0/2751577557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f48004d10 msgr2=0x7f3f48005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f64f2a640 1 --2- 172.21.15.167:0/2751577557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f48004d10 0x7f3f48005190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f6006c2a0 tx=0x7f3f5801dcc0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f5ed9d640 1 -- 172.21.15.167:0/2751577557 reap_dead start 2023-11-28T20:38:13.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f64f2a640 1 -- 172.21.15.167:0/2751577557 shutdown_connections 2023-11-28T20:38:13.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f64f2a640 1 -- 172.21.15.167:0/2751577557 >> 172.21.15.167:0/2751577557 conn(0x7f3f600cb1e0 msgr2=0x7f3f600cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:13.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f64f2a640 1 -- 172.21.15.167:0/2751577557 shutdown_connections 2023-11-28T20:38:13.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f64f2a640 1 -- 172.21.15.167:0/2751577557 wait complete. 2023-11-28T20:38:13.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f64f2a640 1 Processor -- start 2023-11-28T20:38:13.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.221+0000 7f3f64f2a640 1 -- start start 2023-11-28T20:38:13.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f64f2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f48004d10 0x7f3f601f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f64f2a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f601ef690 0x7f3f6014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f64f2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6014b960 0x7f3f6014ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f64f2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f601f3b20 con 0x7f3f6014b960 2023-11-28T20:38:13.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f64f2a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6014c1b0 con 0x7f3f601ef690 2023-11-28T20:38:13.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f64f2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f601e23a0 con 0x7f3f48004d10 2023-11-28T20:38:13.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6014b960 0x7f3f6014ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6014b960 0x7f3f6014ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38132/0 (socket says 172.21.15.167:38132) 2023-11-28T20:38:13.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5ed9d640 1 -- 172.21.15.167:0/4226195158 learned_addr learned my addr 172.21.15.167:0/4226195158 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:13.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5e59c640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f48004d10 0x7f3f601f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5dd9b640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f601ef690 0x7f3f6014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5ed9d640 1 -- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f48004d10 msgr2=0x7f3f601f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5ed9d640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f48004d10 0x7f3f601f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5ed9d640 1 -- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f601ef690 msgr2=0x7f3f6014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5ed9d640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f601ef690 0x7f3f6014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5ed9d640 1 -- 172.21.15.167:0/4226195158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6014c450 con 0x7f3f6014b960 2023-11-28T20:38:13.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f5ed9d640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6014b960 0x7f3f6014ead0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3f580b0040 tx=0x7f3f5800a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:13.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f4effd640 1 -- 172.21.15.167:0/4226195158 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5800a300 con 0x7f3f6014b960 2023-11-28T20:38:13.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f4effd640 1 -- 172.21.15.167:0/4226195158 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58003ba0 con 0x7f3f6014b960 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f4effd640 1 -- 172.21.15.167:0/4226195158 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58008650 con 0x7f3f6014b960 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6014c730 con 0x7f3f6014b960 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6014a940 con 0x7f3f6014b960 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.225+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f600682c0 con 0x7f3f6014b960 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.229+0000 7f3f4effd640 1 -- 172.21.15.167:0/4226195158 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f580087b0 con 0x7f3f6014b960 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.229+0000 7f3f4effd640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f400664a0 0x7f3f40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.229+0000 7f3f4effd640 1 -- 172.21.15.167:0/4226195158 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f5811e0a0 con 0x7f3f6014b960 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.229+0000 7f3f5e59c640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f400664a0 0x7f3f40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.229+0000 7f3f5e59c640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f400664a0 0x7f3f40068960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3f50001060 tx=0x7f3f50000f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:13.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.233+0000 7f3f4effd640 1 -- 172.21.15.167:0/4226195158 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f580eb880 con 0x7f3f6014b960 2023-11-28T20:38:13.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f60075c90 con 0x7f3f6014b960 2023-11-28T20:38:13.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f4effd640 1 -- 172.21.15.167:0/4226195158 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f580bd0a0 con 0x7f3f6014b960 2023-11-28T20:38:13.388 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2023-11-28T20:38:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f400664a0 msgr2=0x7f3f40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f400664a0 0x7f3f40068960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3f50001060 tx=0x7f3f50000f90 comp rx=0 tx=0).stop 2023-11-28T20:38:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6014b960 msgr2=0x7f3f6014ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6014b960 0x7f3f6014ead0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3f580b0040 tx=0x7f3f5800a860 comp rx=0 tx=0).stop 2023-11-28T20:38:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 shutdown_connections 2023-11-28T20:38:13.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f400664a0 0x7f3f40068960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f6014b960 0x7f3f6014ead0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f601ef690 0x7f3f6014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 --2- 172.21.15.167:0/4226195158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f48004d10 0x7f3f601f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 >> 172.21.15.167:0/4226195158 conn(0x7f3f600cb1e0 msgr2=0x7f3f600c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:13.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 shutdown_connections 2023-11-28T20:38:13.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.385+0000 7f3f64f2a640 1 -- 172.21.15.167:0/4226195158 wait complete. 2023-11-28T20:38:13.408 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:38:13.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4ec54640 1 Processor -- start 2023-11-28T20:38:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4ec54640 1 -- start start 2023-11-28T20:38:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4ec54640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 0x7faa480c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4ec54640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faa480c5c90 0x7faa480c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4ec54640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4815b220 con 0x7faa4806a580 2023-11-28T20:38:13.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4ec54640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa480c4da0 con 0x7faa480c5c90 2023-11-28T20:38:13.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4ec54640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa480c60f0 con 0x7faa48151f60 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4d1f1640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7faa4806a580 0x7faa4806ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53184/0 (socket says 172.21.15.167:53184) 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4d1f1640 1 -- 172.21.15.167:0/1755255110 learned_addr learned my addr 172.21.15.167:0/1755255110 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4c9f0640 1 --2- 172.21.15.167:0/1755255110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 0x7faa480c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa47fff640 1 --2- 172.21.15.167:0/1755255110 >> v2:172.21.15.178:3300/0 conn(0x7faa480c5c90 0x7faa480c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa477fe640 1 -- 172.21.15.167:0/1755255110 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185941465 0 0) 0x7faa4815b220 con 0x7faa4806a580 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa477fe640 1 -- 172.21.15.167:0/1755255110 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa38003530 con 0x7faa4806a580 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa477fe640 1 -- 172.21.15.167:0/1755255110 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865767332 0 0) 0x7faa38003530 con 0x7faa4806a580 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4c9f0640 1 -- 172.21.15.167:0/1755255110 >> v2:172.21.15.178:3300/0 conn(0x7faa480c5c90 msgr2=0x7faa480c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4c9f0640 1 --2- 172.21.15.167:0/1755255110 >> v2:172.21.15.178:3300/0 conn(0x7faa480c5c90 0x7faa480c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4c9f0640 1 -- 172.21.15.167:0/1755255110 >> v1:172.21.15.167:6789/0 conn(0x7faa4806a580 legacy=0x7faa4806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.545+0000 7faa4c9f0640 1 -- 172.21.15.167:0/1755255110 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48152340 con 0x7faa48151f60 2023-11-28T20:38:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa4c9f0640 1 --2- 172.21.15.167:0/1755255110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 0x7faa480c75c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009d90 tx=0x7faa3c01c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0da9554f9b1736 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa477fe640 1 -- 172.21.15.167:0/1755255110 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40001680 con 0x7faa48151f60 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa477fe640 1 -- 172.21.15.167:0/1755255110 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c0a64e0 con 0x7faa48151f60 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa477fe640 1 -- 172.21.15.167:0/1755255110 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0a6850 con 0x7faa48151f60 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa4ec54640 1 -- 172.21.15.167:0/1755255110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 msgr2=0x7faa480c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa4ec54640 1 --2- 172.21.15.167:0/1755255110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 0x7faa480c75c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009d90 tx=0x7faa3c01c7e0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa4ec54640 1 -- 172.21.15.167:0/1755255110 shutdown_connections 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa4ec54640 1 --2- 172.21.15.167:0/1755255110 >> v2:172.21.15.178:3300/0 conn(0x7faa480c5c90 0x7faa480c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa4ec54640 1 --2- 172.21.15.167:0/1755255110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 0x7faa480c75c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa4ec54640 1 -- 172.21.15.167:0/1755255110 >> 172.21.15.167:0/1755255110 conn(0x7faa480cb1e0 msgr2=0x7faa480cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa4ec54640 1 -- 172.21.15.167:0/1755255110 shutdown_connections 2023-11-28T20:38:13.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.549+0000 7faa4ec54640 1 -- 172.21.15.167:0/1755255110 wait complete. 2023-11-28T20:38:13.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 Processor -- start 2023-11-28T20:38:13.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 -- start start 2023-11-28T20:38:13.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa4806a580 0x7faa4815a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa480c5c90 0x7faa480ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 0x7faa481f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa48158f10 con 0x7faa480c5c90 2023-11-28T20:38:13.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa481f2930 con 0x7faa4806a580 2023-11-28T20:38:13.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa481f6020 con 0x7faa48151f60 2023-11-28T20:38:13.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa47fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa480c5c90 0x7faa480ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa47fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa480c5c90 0x7faa480ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38148/0 (socket says 172.21.15.167:38148) 2023-11-28T20:38:13.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa47fff640 1 -- 172.21.15.167:0/3038298188 learned_addr learned my addr 172.21.15.167:0/3038298188 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:13.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4c9f0640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa4806a580 0x7faa4815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4d1f1640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 0x7faa481f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa47fff640 1 -- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 msgr2=0x7faa481f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa47fff640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 0x7faa481f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa47fff640 1 -- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa4806a580 msgr2=0x7faa4815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa47fff640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa4806a580 0x7faa4815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa47fff640 1 -- 172.21.15.167:0/3038298188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009a70 con 0x7faa480c5c90 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa47fff640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa480c5c90 0x7faa480ca830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e930 tx=0x7faa3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa457fa640 1 -- 172.21.15.167:0/3038298188 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34009690 con 0x7faa480c5c90 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa457fa640 1 -- 172.21.15.167:0/3038298188 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3400ca00 con 0x7faa480c5c90 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa481f6300 con 0x7faa480c5c90 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa457fa640 1 -- 172.21.15.167:0/3038298188 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400cd70 con 0x7faa480c5c90 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa481f68c0 con 0x7faa480c5c90 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.553+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa480682c0 con 0x7faa480c5c90 2023-11-28T20:38:13.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.557+0000 7faa457fa640 1 -- 172.21.15.167:0/3038298188 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa34013470 con 0x7faa480c5c90 2023-11-28T20:38:13.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.557+0000 7faa457fa640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 0x7faa2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:13.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.557+0000 7faa457fa640 1 -- 172.21.15.167:0/3038298188 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa34083f30 con 0x7faa480c5c90 2023-11-28T20:38:13.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.557+0000 7faa4c9f0640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 0x7faa2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:13.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.557+0000 7faa4c9f0640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 0x7faa2c068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0af000 tx=0x7faa3c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:13.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.561+0000 7faa457fa640 1 -- 172.21.15.167:0/3038298188 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa34051690 con 0x7faa480c5c90 2023-11-28T20:38:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.741+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa481f2b50 con 0x7faa480c5c90 2023-11-28T20:38:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.741+0000 7faa457fa640 1 -- 172.21.15.167:0/3038298188 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7faa34021090 con 0x7faa480c5c90 2023-11-28T20:38:13.746 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:13.746 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T20:38:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 2 2023-11-28T20:38:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 msgr2=0x7faa2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 0x7faa2c068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0af000 tx=0x7faa3c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:38:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa480c5c90 msgr2=0x7faa480ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa480c5c90 0x7faa480ca830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e930 tx=0x7faa3400edf0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 shutdown_connections 2023-11-28T20:38:13.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 0x7faa2c068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa48151f60 0x7faa481f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa480c5c90 0x7faa480ca830 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 --2- 172.21.15.167:0/3038298188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa4806a580 0x7faa4815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:13.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 >> 172.21.15.167:0/3038298188 conn(0x7faa480cb1e0 msgr2=0x7faa480cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:13.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 shutdown_connections 2023-11-28T20:38:13.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:13.745+0000 7faa4ec54640 1 -- 172.21.15.167:0/3038298188 wait complete. 2023-11-28T20:38:14.495 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:38:14.499 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:38:15.767 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:38:15.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc453c32640 1 Processor -- start 2023-11-28T20:38:15.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc453c32640 1 -- start start 2023-11-28T20:38:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc453c32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cb770 0x7fc44c15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc453c32640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44c15ac00 con 0x7fc44c0cfc40 2023-11-28T20:38:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc453c32640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44c0cbd60 con 0x7fc44c0cf860 2023-11-28T20:38:15.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc453c32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c159ff0 con 0x7fc44c0cb770 2023-11-28T20:38:15.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4511cd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc44c0cfc40 0x7fc44c153ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53200/0 (socket says 172.21.15.167:53200) 2023-11-28T20:38:15.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4511cd640 1 -- 172.21.15.167:0/1656333871 learned_addr learned my addr 172.21.15.167:0/1656333871 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:15.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4521cf640 1 --2- 172.21.15.167:0/1656333871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cb770 0x7fc44c15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:15.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4509cc640 1 -- 172.21.15.167:0/1656333871 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082914170 0 0) 0x7fc44c15ac00 con 0x7fc44c0cfc40 2023-11-28T20:38:15.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4509cc640 1 -- 172.21.15.167:0/1656333871 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc438003530 con 0x7fc44c0cfc40 2023-11-28T20:38:15.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4509cc640 1 -- 172.21.15.167:0/1656333871 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391206821 0 0) 0x7fc44c0cbd60 con 0x7fc44c0cf860 2023-11-28T20:38:15.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4509cc640 1 -- 172.21.15.167:0/1656333871 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc44c15ac00 con 0x7fc44c0cf860 2023-11-28T20:38:15.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4521cf640 1 -- 172.21.15.167:0/1656333871 >> v1:172.21.15.178:6789/0 conn(0x7fc44c0cf860 legacy=0x7fc44c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:15.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4521cf640 1 -- 172.21.15.167:0/1656333871 >> v1:172.21.15.167:6789/0 conn(0x7fc44c0cfc40 legacy=0x7fc44c153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:15.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4509cc640 1 -- 172.21.15.167:0/1656333871 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1072153281 0 0) 0x7fc438003530 con 0x7fc44c0cfc40 2023-11-28T20:38:15.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.913+0000 7fc4521cf640 1 -- 172.21.15.167:0/1656333871 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c15a2d0 con 0x7fc44c0cb770 2023-11-28T20:38:15.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.917+0000 7fc4521cf640 1 --2- 172.21.15.167:0/1656333871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cb770 0x7fc44c15d4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc444009dc0 tx=0x7fc44401c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c57b5b2736f539 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.917+0000 7fc4509cc640 1 -- 172.21.15.167:0/1656333871 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c001680 con 0x7fc44c0cb770 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.917+0000 7fc4509cc640 1 -- 172.21.15.167:0/1656333871 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4440a56a0 con 0x7fc44c0cb770 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.917+0000 7fc4509cc640 1 -- 172.21.15.167:0/1656333871 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440a5a10 con 0x7fc44c0cb770 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.917+0000 7fc453c32640 1 -- 172.21.15.167:0/1656333871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cb770 msgr2=0x7fc44c15d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.917+0000 7fc453c32640 1 --2- 172.21.15.167:0/1656333871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cb770 0x7fc44c15d4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc444009dc0 tx=0x7fc44401c860 comp rx=0 tx=0).stop 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.917+0000 7fc453c32640 1 -- 172.21.15.167:0/1656333871 shutdown_connections 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.917+0000 7fc453c32640 1 --2- 172.21.15.167:0/1656333871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cb770 0x7fc44c15d4d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.917+0000 7fc453c32640 1 -- 172.21.15.167:0/1656333871 >> 172.21.15.167:0/1656333871 conn(0x7fc44c06c1f0 msgr2=0x7fc44c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 -- 172.21.15.167:0/1656333871 shutdown_connections 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 -- 172.21.15.167:0/1656333871 wait complete. 2023-11-28T20:38:15.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 Processor -- start 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 -- start start 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc44c0cb770 0x7fc44c0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc44c0cf860 0x7fc44c149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cfc40 0x7fc44c145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c158b50 con 0x7fc44c0cb770 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c157c60 con 0x7fc44c0cf860 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c157f40 con 0x7fc44c0cfc40 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4519ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc44c0cb770 0x7fc44c0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4519ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc44c0cb770 0x7fc44c0c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38164/0 (socket says 172.21.15.167:38164) 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4519ce640 1 -- 172.21.15.167:0/2131776179 learned_addr learned my addr 172.21.15.167:0/2131776179 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:15.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4511cd640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc44c0cf860 0x7fc44c149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4521cf640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cfc40 0x7fc44c145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4519ce640 1 -- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cfc40 msgr2=0x7fc44c145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4519ce640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cfc40 0x7fc44c145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4519ce640 1 -- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc44c0cf860 msgr2=0x7fc44c149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4519ce640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc44c0cf860 0x7fc44c149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4519ce640 1 -- 172.21.15.167:0/2131776179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc444009a70 con 0x7fc44c0cb770 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4519ce640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc44c0cb770 0x7fc44c0c7e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c430 tx=0x7fc44800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4427fc640 1 -- 172.21.15.167:0/2131776179 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4480052d0 con 0x7fc44c0cb770 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc4427fc640 1 -- 172.21.15.167:0/2131776179 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc448005450 con 0x7fc44c0cb770 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.921+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c158220 con 0x7fc44c0cb770 2023-11-28T20:38:15.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.925+0000 7fc4427fc640 1 -- 172.21.15.167:0/2131776179 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448003840 con 0x7fc44c0cb770 2023-11-28T20:38:15.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.925+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c1587e0 con 0x7fc44c0cb770 2023-11-28T20:38:15.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.925+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c067c40 con 0x7fc44c0cb770 2023-11-28T20:38:15.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.925+0000 7fc4427fc640 1 -- 172.21.15.167:0/2131776179 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4480039a0 con 0x7fc44c0cb770 2023-11-28T20:38:15.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.925+0000 7fc4427fc640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc430066470 0x7fc430068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:15.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.925+0000 7fc4427fc640 1 -- 172.21.15.167:0/2131776179 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc448083150 con 0x7fc44c0cb770 2023-11-28T20:38:15.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.925+0000 7fc4511cd640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc430066470 0x7fc430068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:15.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.929+0000 7fc4511cd640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc430066470 0x7fc430068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0c4f50 tx=0x7fc43c001680 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:15.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:15.929+0000 7fc4427fc640 1 -- 172.21.15.167:0/2131776179 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc448050930 con 0x7fc44c0cb770 2023-11-28T20:38:16.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.109+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc44c075c90 con 0x7fc44c0cb770 2023-11-28T20:38:16.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.109+0000 7fc4427fc640 1 -- 172.21.15.167:0/2131776179 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5292 (secure 0 0 0) 0x7fc448053f50 con 0x7fc44c0cb770 2023-11-28T20:38:16.114 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:16.114 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1234930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1234930245},{"type":"v1","addr":"172.21.15.167:6837","nonce":1234930245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-28T20:38:16.114 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 3 2023-11-28T20:38:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc430066470 msgr2=0x7fc430068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc430066470 0x7fc430068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0c4f50 tx=0x7fc43c001680 comp rx=0 tx=0).stop 2023-11-28T20:38:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc44c0cb770 msgr2=0x7fc44c0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc44c0cb770 0x7fc44c0c7e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c430 tx=0x7fc44800c8f0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 shutdown_connections 2023-11-28T20:38:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc430066470 0x7fc430068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc44c0cfc40 0x7fc44c145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc44c0cf860 0x7fc44c149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 --2- 172.21.15.167:0/2131776179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc44c0cb770 0x7fc44c0c7e60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 >> 172.21.15.167:0/2131776179 conn(0x7fc44c06c1f0 msgr2=0x7fc44c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:16.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 shutdown_connections 2023-11-28T20:38:16.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.113+0000 7fc453c32640 1 -- 172.21.15.167:0/2131776179 wait complete. 2023-11-28T20:38:16.135 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.269+0000 7f30ac632640 1 Processor -- start 2023-11-28T20:38:16.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.269+0000 7f30ac632640 1 -- start start 2023-11-28T20:38:16.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30ac632640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f30a4150b40 0x7f30a4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30ac632640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f30a40c6ff0 0x7f30a40c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30ac632640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a40c6ac0 con 0x7f30a40c5be0 2023-11-28T20:38:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30ac632640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40c6500 con 0x7f30a4150b40 2023-11-28T20:38:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30ac632640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40c67e0 con 0x7f30a40c6ff0 2023-11-28T20:38:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30aa3ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f30a4150b40 0x7f30a4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30a9bcd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f30a40c6ff0 0x7f30a40c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30aa3ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f30a4150b40 0x7f30a4157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38176/0 (socket says 172.21.15.167:38176) 2023-11-28T20:38:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30aabcf640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f30a40c5be0 0x7f30a406a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:47392/0 (socket says 172.21.15.167:47392) 2023-11-28T20:38:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30aabcf640 1 -- 172.21.15.167:0/3387107014 learned_addr learned my addr 172.21.15.167:0/3387107014 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30a9bcd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f30a40c6ff0 0x7f30a40c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:56750/0 (socket says 172.21.15.167:56750) 2023-11-28T20:38:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30aa3ce640 1 -- 172.21.15.167:0/3387107014 >> v2:172.21.15.178:3300/0 conn(0x7f30a40c6ff0 msgr2=0x7f30a40c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30aa3ce640 1 --2- 172.21.15.167:0/3387107014 >> v2:172.21.15.178:3300/0 conn(0x7f30a40c6ff0 0x7f30a40c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30aa3ce640 1 -- 172.21.15.167:0/3387107014 >> v1:172.21.15.178:6789/0 conn(0x7f30a40c5be0 legacy=0x7f30a406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30aa3ce640 1 -- 172.21.15.167:0/3387107014 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a4156a80 con 0x7f30a4150b40 2023-11-28T20:38:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.273+0000 7f30aa3ce640 1 --2- 172.21.15.167:0/3387107014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a4150b40 0x7f30a4157560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f30a406bba0 tx=0x7f30a001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968d3c444aacdf46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30a93cc640 1 -- 172.21.15.167:0/3387107014 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00ab600 con 0x7f30a4150b40 2023-11-28T20:38:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30a93cc640 1 -- 172.21.15.167:0/3387107014 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a00a7050 con 0x7f30a4150b40 2023-11-28T20:38:16.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30a93cc640 1 -- 172.21.15.167:0/3387107014 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00ab980 con 0x7f30a4150b40 2023-11-28T20:38:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 -- 172.21.15.167:0/3387107014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a4150b40 msgr2=0x7f30a4157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 --2- 172.21.15.167:0/3387107014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a4150b40 0x7f30a4157560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f30a406bba0 tx=0x7f30a001c430 comp rx=0 tx=0).stop 2023-11-28T20:38:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 -- 172.21.15.167:0/3387107014 shutdown_connections 2023-11-28T20:38:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 --2- 172.21.15.167:0/3387107014 >> v2:172.21.15.178:3300/0 conn(0x7f30a40c6ff0 0x7f30a40c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 --2- 172.21.15.167:0/3387107014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a4150b40 0x7f30a4157560 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 -- 172.21.15.167:0/3387107014 >> 172.21.15.167:0/3387107014 conn(0x7f30a40cb1e0 msgr2=0x7f30a40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 -- 172.21.15.167:0/3387107014 shutdown_connections 2023-11-28T20:38:16.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 -- 172.21.15.167:0/3387107014 wait complete. 2023-11-28T20:38:16.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 Processor -- start 2023-11-28T20:38:16.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 -- start start 2023-11-28T20:38:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a40c5be0 0x7f30a41589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a40c6ff0 0x7f30a4159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a4150b40 0x7f30a40ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a41f65a0 con 0x7f30a40c5be0 2023-11-28T20:38:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4157d00 con 0x7f30a4150b40 2023-11-28T20:38:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30ac632640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40ca2b0 con 0x7f30a40c6ff0 2023-11-28T20:38:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30aa3ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a40c5be0 0x7f30a41589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30aa3ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a40c5be0 0x7f30a41589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38184/0 (socket says 172.21.15.167:38184) 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.277+0000 7f30aa3ce640 1 -- 172.21.15.167:0/1153397643 learned_addr learned my addr 172.21.15.167:0/1153397643 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30a9bcd640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a40c6ff0 0x7f30a4159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30aabcf640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a4150b40 0x7f30a40ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30aa3ce640 1 -- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a40c6ff0 msgr2=0x7f30a4159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30aa3ce640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a40c6ff0 0x7f30a4159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30aa3ce640 1 -- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a4150b40 msgr2=0x7f30a40ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30aa3ce640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a4150b40 0x7f30a40ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30aa3ce640 1 -- 172.21.15.167:0/1153397643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0009420 con 0x7f30a40c5be0 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30aabcf640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a4150b40 0x7f30a40ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30aa3ce640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a40c5be0 0x7f30a41589d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f30a001a060 tx=0x7f30a00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f309affd640 1 -- 172.21.15.167:0/1153397643 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a0006e20 con 0x7f30a40c5be0 2023-11-28T20:38:16.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f309affd640 1 -- 172.21.15.167:0/1153397643 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a00b4400 con 0x7f30a40c5be0 2023-11-28T20:38:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f309affd640 1 -- 172.21.15.167:0/1153397643 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a00b47b0 con 0x7f30a40c5be0 2023-11-28T20:38:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a414edd0 con 0x7f30a40c5be0 2023-11-28T20:38:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a40c9c60 con 0x7f30a40c5be0 2023-11-28T20:38:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a40682c0 con 0x7f30a40c5be0 2023-11-28T20:38:16.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f309affd640 1 -- 172.21.15.167:0/1153397643 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30a00b2040 con 0x7f30a40c5be0 2023-11-28T20:38:16.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f309affd640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30880664a0 0x7f3088068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.281+0000 7f309affd640 1 -- 172.21.15.167:0/1153397643 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f30a011da80 con 0x7f30a40c5be0 2023-11-28T20:38:16.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.285+0000 7f30a9bcd640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30880664a0 0x7f3088068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.285+0000 7f30a9bcd640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30880664a0 0x7f3088068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f309400b240 tx=0x7f309400b3a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:16.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.285+0000 7f309affd640 1 -- 172.21.15.167:0/1153397643 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30a00eb240 con 0x7f30a40c5be0 2023-11-28T20:38:16.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.437+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30a4075c90 con 0x7f30a40c5be0 2023-11-28T20:38:16.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.437+0000 7f309affd640 1 -- 172.21.15.167:0/1153397643 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f30a00b0020 con 0x7f30a40c5be0 2023-11-28T20:38:16.441 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:16.441 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":17,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:07.526381+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30880664a0 msgr2=0x7f3088068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30880664a0 0x7f3088068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f309400b240 tx=0x7f309400b3a0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a40c5be0 msgr2=0x7f30a41589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a40c5be0 0x7f30a41589d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f30a001a060 tx=0x7f30a00191d0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 shutdown_connections 2023-11-28T20:38:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30880664a0 0x7f3088068960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a4150b40 0x7f30a40ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a40c6ff0 0x7f30a4159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 --2- 172.21.15.167:0/1153397643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30a40c5be0 0x7f30a41589d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 >> 172.21.15.167:0/1153397643 conn(0x7f30a40cb1e0 msgr2=0x7f30a4071610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 shutdown_connections 2023-11-28T20:38:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.441+0000 7f30ac632640 1 -- 172.21.15.167:0/1153397643 wait complete. 2023-11-28T20:38:16.463 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:38:05.507993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T20:38:16.464 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:38:16.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90cb8dd640 1 Processor -- start 2023-11-28T20:38:16.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90cb8dd640 1 -- start start 2023-11-28T20:38:16.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90cb8dd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90c41585d0 0x7f90c40c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90cb8dd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415e130 0x7f90c4161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90cb8dd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c415e5e0 con 0x7f90c40c7720 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90cb8dd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c415f160 con 0x7f90c41585d0 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90cb8dd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c415e8c0 con 0x7f90c415e130 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c9e7a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f90c40c7720 0x7f90c406a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53208/0 (socket says 172.21.15.167:53208) 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c9e7a640 1 -- 172.21.15.167:0/3868107056 learned_addr learned my addr 172.21.15.167:0/3868107056 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c9679640 1 --2- 172.21.15.167:0/3868107056 >> v2:172.21.15.178:3300/0 conn(0x7f90c41585d0 0x7f90c40c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c8e78640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415e130 0x7f90c4161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674027747 0 0) 0x7f90c415e5e0 con 0x7f90c40c7720 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b0003530 con 0x7f90c40c7720 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937216020 0 0) 0x7f90b0003530 con 0x7f90c40c7720 2023-11-28T20:38:16.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415e130 msgr2=0x7f90c4161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415e130 0x7f90c4161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 >> v2:172.21.15.178:3300/0 conn(0x7f90c41585d0 msgr2=0x7f90c40c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 --2- 172.21.15.167:0/3868107056 >> v2:172.21.15.178:3300/0 conn(0x7f90c41585d0 0x7f90c40c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c415eba0 con 0x7f90c40c7720 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f90bc001a00 con 0x7f90c40c7720 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 >> v1:172.21.15.167:6789/0 conn(0x7f90c40c7720 legacy=0x7f90c406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90b0003980 0x7f90b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415e130 0x7f90b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c415f160 con 0x7f90b00047d0 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c415e8c0 con 0x7f90b0003980 2023-11-28T20:38:16.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b000b990 con 0x7f90c415e130 2023-11-28T20:38:16.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c8e78640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c9679640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90b0003980 0x7f90b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c9e7a640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415e130 0x7f90b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c8e78640 1 -- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415e130 msgr2=0x7f90b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:16.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c8e78640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415e130 0x7f90b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c8e78640 1 -- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90b0003980 msgr2=0x7f90b0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:16.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c8e78640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90b0003980 0x7f90b0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.605+0000 7f90c8e78640 1 -- 172.21.15.167:0/3868107056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0003530 con 0x7f90b00047d0 2023-11-28T20:38:16.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90c8e78640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90b0004c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009ab0 tx=0x7f90b401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f773f707e0440c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:16.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b40a5510 con 0x7f90b00047d0 2023-11-28T20:38:16.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b40a5670 con 0x7f90b00047d0 2023-11-28T20:38:16.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90bbfff640 1 -- 172.21.15.167:0/3868107056 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b40a5a20 con 0x7f90b00047d0 2023-11-28T20:38:16.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90cb8dd640 1 -- 172.21.15.167:0/3868107056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 msgr2=0x7f90b0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90cb8dd640 1 --2- 172.21.15.167:0/3868107056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90b0004c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009ab0 tx=0x7f90b401c9a0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90c9e7a640 1 -- 172.21.15.167:0/3868107056 reap_dead start 2023-11-28T20:38:16.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90cb8dd640 1 -- 172.21.15.167:0/3868107056 shutdown_connections 2023-11-28T20:38:16.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90cb8dd640 1 -- 172.21.15.167:0/3868107056 >> 172.21.15.167:0/3868107056 conn(0x7f90c40cb1e0 msgr2=0x7f90c40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:16.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90cb8dd640 1 -- 172.21.15.167:0/3868107056 shutdown_connections 2023-11-28T20:38:16.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.609+0000 7f90cb8dd640 1 -- 172.21.15.167:0/3868107056 wait complete. 2023-11-28T20:38:16.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 Processor -- start 2023-11-28T20:38:16.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 -- start start 2023-11-28T20:38:16.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90c40c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90c4154430 0x7f90c415c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415f2f0 0x7f90c415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c41534e0 con 0x7f90b00047d0 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4160750 con 0x7f90c4154430 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c41e9d00 con 0x7f90c415f2f0 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9679640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90c40c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9679640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90c40c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38204/0 (socket says 172.21.15.167:38204) 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9679640 1 -- 172.21.15.167:0/524149833 learned_addr learned my addr 172.21.15.167:0/524149833 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c8e78640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90c4154430 0x7f90c415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9e7a640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415f2f0 0x7f90c415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9679640 1 -- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415f2f0 msgr2=0x7f90c415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9679640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415f2f0 0x7f90c415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9679640 1 -- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90c4154430 msgr2=0x7f90c415c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9679640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90c4154430 0x7f90c415c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9679640 1 -- 172.21.15.167:0/524149833 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c41e6e40 con 0x7f90b00047d0 2023-11-28T20:38:16.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90c9679640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90c40c9310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90c0011660 tx=0x7f90c0011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:16.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90b9ffb640 1 -- 172.21.15.167:0/524149833 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c000f960 con 0x7f90b00047d0 2023-11-28T20:38:16.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90b9ffb640 1 -- 172.21.15.167:0/524149833 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c000fac0 con 0x7f90b00047d0 2023-11-28T20:38:16.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c41f7a00 con 0x7f90b00047d0 2023-11-28T20:38:16.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90b9ffb640 1 -- 172.21.15.167:0/524149833 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c000fe30 con 0x7f90b00047d0 2023-11-28T20:38:16.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.613+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c4152b40 con 0x7f90b00047d0 2023-11-28T20:38:16.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.617+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c40682c0 con 0x7f90b00047d0 2023-11-28T20:38:16.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.617+0000 7f90b9ffb640 1 -- 172.21.15.167:0/524149833 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90c0015460 con 0x7f90b00047d0 2023-11-28T20:38:16.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.617+0000 7f90b9ffb640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90a8066470 0x7f90a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.617+0000 7f90b9ffb640 1 -- 172.21.15.167:0/524149833 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f90c0083e60 con 0x7f90b00047d0 2023-11-28T20:38:16.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.617+0000 7f90c8e78640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90a8066470 0x7f90a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.617+0000 7f90c8e78640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90a8066470 0x7f90a8068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90b40af000 tx=0x7f90b40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:16.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.621+0000 7f90b9ffb640 1 -- 172.21.15.167:0/524149833 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90c0051630 con 0x7f90b00047d0 2023-11-28T20:38:16.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.769+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90c4067c40 con 0x7f90b00047d0 2023-11-28T20:38:16.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90b9ffb640 1 -- 172.21.15.167:0/524149833 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90c00220a0 con 0x7f90b00047d0 2023-11-28T20:38:16.774 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2023-11-28T20:38:16.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90a8066470 msgr2=0x7f90a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90a8066470 0x7f90a8068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90b40af000 tx=0x7f90b40046d0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 msgr2=0x7f90c40c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90c40c9310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90c0011660 tx=0x7f90c0011b20 comp rx=0 tx=0).stop 2023-11-28T20:38:16.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 shutdown_connections 2023-11-28T20:38:16.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90a8066470 0x7f90a8068930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90c415f2f0 0x7f90c415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90c4154430 0x7f90c415c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 --2- 172.21.15.167:0/524149833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90b00047d0 0x7f90c40c9310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 >> 172.21.15.167:0/524149833 conn(0x7f90c40cb1e0 msgr2=0x7f90c4071bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:16.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 shutdown_connections 2023-11-28T20:38:16.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.773+0000 7f90cb8dd640 1 -- 172.21.15.167:0/524149833 wait complete. 2023-11-28T20:38:16.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T20:38:16.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3778b80640 1 Processor -- start 2023-11-28T20:38:16.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3778b80640 1 -- start start 2023-11-28T20:38:16.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3778b80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774072630 0x7f3774161b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3778b80640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37741571d0 con 0x7f3774070480 2023-11-28T20:38:16.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3778b80640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3774071a90 con 0x7f377406e030 2023-11-28T20:38:16.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3778b80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37740c70d0 con 0x7f3774072630 2023-11-28T20:38:16.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3771d9b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3774070480 0x7f3774071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53222/0 (socket says 172.21.15.167:53222) 2023-11-28T20:38:16.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3771d9b640 1 -- 172.21.15.167:0/2846998758 learned_addr learned my addr 172.21.15.167:0/2846998758 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:16.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3772d9d640 1 --2- 172.21.15.167:0/2846998758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774072630 0x7f3774161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f377159a640 1 -- 172.21.15.167:0/2846998758 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192590537 0 0) 0x7f37741571d0 con 0x7f3774070480 2023-11-28T20:38:16.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f377159a640 1 -- 172.21.15.167:0/2846998758 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f375c003530 con 0x7f3774070480 2023-11-28T20:38:16.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f377159a640 1 -- 172.21.15.167:0/2846998758 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3582206931 0 0) 0x7f375c003530 con 0x7f3774070480 2023-11-28T20:38:16.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3772d9d640 1 -- 172.21.15.167:0/2846998758 >> v1:172.21.15.178:6789/0 conn(0x7f377406e030 legacy=0x7f37741500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3772d9d640 1 -- 172.21.15.167:0/2846998758 >> v1:172.21.15.167:6789/0 conn(0x7f3774070480 legacy=0x7f3774071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.933+0000 7f3772d9d640 1 -- 172.21.15.167:0/2846998758 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37740c73b0 con 0x7f3774072630 2023-11-28T20:38:16.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f3772d9d640 1 --2- 172.21.15.167:0/2846998758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774072630 0x7f3774161b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f376c009dc0 tx=0x7f376c01c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec1c5526bffa5eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:16.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f377159a640 1 -- 172.21.15.167:0/2846998758 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768001680 con 0x7f3774072630 2023-11-28T20:38:16.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f377159a640 1 -- 172.21.15.167:0/2846998758 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0a56a0 con 0x7f3774072630 2023-11-28T20:38:16.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f377159a640 1 -- 172.21.15.167:0/2846998758 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0a5a30 con 0x7f3774072630 2023-11-28T20:38:16.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f3778b80640 1 -- 172.21.15.167:0/2846998758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774072630 msgr2=0x7f3774161b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f3778b80640 1 --2- 172.21.15.167:0/2846998758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774072630 0x7f3774161b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f376c009dc0 tx=0x7f376c01c860 comp rx=0 tx=0).stop 2023-11-28T20:38:16.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f3778b80640 1 -- 172.21.15.167:0/2846998758 shutdown_connections 2023-11-28T20:38:16.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f3778b80640 1 --2- 172.21.15.167:0/2846998758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774072630 0x7f3774161b80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f3778b80640 1 -- 172.21.15.167:0/2846998758 >> 172.21.15.167:0/2846998758 conn(0x7f37740cb1e0 msgr2=0x7f37740cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:16.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f3778b80640 1 -- 172.21.15.167:0/2846998758 shutdown_connections 2023-11-28T20:38:16.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.937+0000 7f3778b80640 1 -- 172.21.15.167:0/2846998758 wait complete. 2023-11-28T20:38:16.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 Processor -- start 2023-11-28T20:38:16.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 -- start start 2023-11-28T20:38:16.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377406e030 0x7f3774151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774070480 0x7f37741f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3774072630 0x7f37741f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774146f60 con 0x7f377406e030 2023-11-28T20:38:16.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37741f0e90 con 0x7f3774072630 2023-11-28T20:38:16.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37741f4c40 con 0x7f3774070480 2023-11-28T20:38:16.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f377259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377406e030 0x7f3774151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f377259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377406e030 0x7f3774151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38216/0 (socket says 172.21.15.167:38216) 2023-11-28T20:38:16.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f377259c640 1 -- 172.21.15.167:0/534669581 learned_addr learned my addr 172.21.15.167:0/534669581 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3771d9b640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774070480 0x7f37741f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3772d9d640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3774072630 0x7f37741f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f377259c640 1 -- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774070480 msgr2=0x7f37741f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f377259c640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774070480 0x7f37741f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f377259c640 1 -- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3774072630 msgr2=0x7f37741f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f377259c640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3774072630 0x7f37741f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f377259c640 1 -- 172.21.15.167:0/534669581 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c009a70 con 0x7f377406e030 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3772d9d640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3774072630 0x7f37741f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3771d9b640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774070480 0x7f37741f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:16.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f377259c640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377406e030 0x7f3774151190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f376400c500 tx=0x7f376400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:16.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3762ffd640 1 -- 172.21.15.167:0/534669581 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764005220 con 0x7f377406e030 2023-11-28T20:38:16.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3762ffd640 1 -- 172.21.15.167:0/534669581 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764005380 con 0x7f377406e030 2023-11-28T20:38:16.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37741471b0 con 0x7f377406e030 2023-11-28T20:38:16.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3762ffd640 1 -- 172.21.15.167:0/534669581 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764007270 con 0x7f377406e030 2023-11-28T20:38:16.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3774147770 con 0x7f377406e030 2023-11-28T20:38:16.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.941+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37740682c0 con 0x7f377406e030 2023-11-28T20:38:16.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.945+0000 7f3762ffd640 1 -- 172.21.15.167:0/534669581 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37640073d0 con 0x7f377406e030 2023-11-28T20:38:16.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.945+0000 7f3762ffd640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37540664a0 0x7f3754068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:16.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.945+0000 7f3762ffd640 1 -- 172.21.15.167:0/534669581 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3764082f10 con 0x7f377406e030 2023-11-28T20:38:16.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.945+0000 7f3771d9b640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37540664a0 0x7f3754068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:16.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.945+0000 7f3771d9b640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37540664a0 0x7f3754068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f377415a850 tx=0x7f3768009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:16.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:16.949+0000 7f3762ffd640 1 -- 172.21.15.167:0/534669581 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3764050650 con 0x7f377406e030 2023-11-28T20:38:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.101+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3774075c90 con 0x7f377406e030 2023-11-28T20:38:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.101+0000 7f3762ffd640 1 -- 172.21.15.167:0/534669581 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3764053c70 con 0x7f377406e030 2023-11-28T20:38:17.105 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:17.105 INFO:teuthology.orchestra.run.smithi167.stdout:[ 2023-11-28T20:38:17.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:38:17.105 INFO:teuthology.orchestra.run.smithi167.stdout: "poolnum": 1, 2023-11-28T20:38:17.105 INFO:teuthology.orchestra.run.smithi167.stdout: "poolname": ".mgr" 2023-11-28T20:38:17.105 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:38:17.105 INFO:teuthology.orchestra.run.smithi167.stdout:] 2023-11-28T20:38:17.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37540664a0 msgr2=0x7f3754068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37540664a0 0x7f3754068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f377415a850 tx=0x7f3768009040 comp rx=0 tx=0).stop 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377406e030 msgr2=0x7f3774151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377406e030 0x7f3774151190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f376400c500 tx=0x7f376400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 shutdown_connections 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37540664a0 0x7f3754068960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3774072630 0x7f37741f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3774070480 0x7f37741f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 --2- 172.21.15.167:0/534669581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377406e030 0x7f3774151190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 >> 172.21.15.167:0/534669581 conn(0x7f37740cb1e0 msgr2=0x7f3774156370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 shutdown_connections 2023-11-28T20:38:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.105+0000 7f3778b80640 1 -- 172.21.15.167:0/534669581 wait complete. 2023-11-28T20:38:17.125 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T20:38:17.125 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T20:38:17.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.261+0000 7ff223d57640 1 Processor -- start 2023-11-28T20:38:17.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.261+0000 7ff223d57640 1 -- start start 2023-11-28T20:38:17.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff223d57640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff21c06abc0 0x7ff21c06b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff223d57640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21c157110 con 0x7ff21c06b0f0 2023-11-28T20:38:17.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff223d57640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21c0c44c0 con 0x7ff21c06a7e0 2023-11-28T20:38:17.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff223d57640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21c071260 con 0x7ff21c06abc0 2023-11-28T20:38:17.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2212f2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff21c06b0f0 0x7ff21c14fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53226/0 (socket says 172.21.15.167:53226) 2023-11-28T20:38:17.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2212f2640 1 -- 172.21.15.167:0/3558593118 learned_addr learned my addr 172.21.15.167:0/3558593118 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:17.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2222f4640 1 --2- 172.21.15.167:0/3558593118 >> v2:172.21.15.178:3300/0 conn(0x7ff21c06abc0 0x7ff21c06b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354089524 0 0) 0x7ff21c157110 con 0x7ff21c06b0f0 2023-11-28T20:38:17.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff208003530 con 0x7ff21c06b0f0 2023-11-28T20:38:17.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1462478049 0 0) 0x7ff208003530 con 0x7ff21c06b0f0 2023-11-28T20:38:17.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 >> v2:172.21.15.178:3300/0 conn(0x7ff21c06abc0 msgr2=0x7ff21c06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:17.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 --2- 172.21.15.167:0/3558593118 >> v2:172.21.15.178:3300/0 conn(0x7ff21c06abc0 0x7ff21c06b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 >> v1:172.21.15.178:6789/0 conn(0x7ff21c06a7e0 legacy=0x7ff21c0c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c070650 con 0x7ff21c06b0f0 2023-11-28T20:38:17.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7ff20c001680 con 0x7ff21c06b0f0 2023-11-28T20:38:17.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 >> v1:172.21.15.167:6789/0 conn(0x7ff21c06b0f0 legacy=0x7ff21c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff208003980 0x7ff208003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff208004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff208005190 0x7ff20800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c071260 con 0x7ff2080047d0 2023-11-28T20:38:17.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20800c030 con 0x7ff208005190 2023-11-28T20:38:17.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20800c1f0 con 0x7ff208003980 2023-11-28T20:38:17.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2212f2640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff208004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2222f4640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff208005190 0x7ff20800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff221af3640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff208003980 0x7ff208003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2212f2640 1 -- 172.21.15.167:0/3558593118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff208003980 msgr2=0x7ff208003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:17.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2212f2640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff208003980 0x7ff208003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2212f2640 1 -- 172.21.15.167:0/3558593118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff208005190 msgr2=0x7ff20800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:17.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2212f2640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff208005190 0x7ff20800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2212f2640 1 -- 172.21.15.167:0/3558593118 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208003530 con 0x7ff2080047d0 2023-11-28T20:38:17.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.265+0000 7ff2222f4640 1 -- 172.21.15.167:0/3558593118 reap_dead start 2023-11-28T20:38:17.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff2212f2640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff208004c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff21c072130 tx=0x7ff20c021630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db88ca7df52c7419 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:17.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c005ae0 con 0x7ff2080047d0 2023-11-28T20:38:17.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c005c40 con 0x7ff2080047d0 2023-11-28T20:38:17.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff220af1640 1 -- 172.21.15.167:0/3558593118 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0072b0 con 0x7ff2080047d0 2023-11-28T20:38:17.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff223d57640 1 -- 172.21.15.167:0/3558593118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 msgr2=0x7ff208004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff223d57640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff208004c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff21c072130 tx=0x7ff20c021630 comp rx=0 tx=0).stop 2023-11-28T20:38:17.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff223d57640 1 -- 172.21.15.167:0/3558593118 shutdown_connections 2023-11-28T20:38:17.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff223d57640 1 --2- 172.21.15.167:0/3558593118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff208004c50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff223d57640 1 -- 172.21.15.167:0/3558593118 >> 172.21.15.167:0/3558593118 conn(0x7ff21c06e030 msgr2=0x7ff21c06e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:17.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff223d57640 1 -- 172.21.15.167:0/3558593118 shutdown_connections 2023-11-28T20:38:17.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.269+0000 7ff223d57640 1 -- 172.21.15.167:0/3558593118 wait complete. 2023-11-28T20:38:17.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 Processor -- start 2023-11-28T20:38:17.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 -- start start 2023-11-28T20:38:17.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff21c0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c06e840 0x7ff21c1f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c1f2da0 0x7ff21c1e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0cb190 con 0x7ff2080047d0 2023-11-28T20:38:17.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c1efdc0 con 0x7ff21c06e840 2023-11-28T20:38:17.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c1f0250 con 0x7ff21c1f2da0 2023-11-28T20:38:17.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff221af3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff21c0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff221af3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff21c0c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38240/0 (socket says 172.21.15.167:38240) 2023-11-28T20:38:17.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff221af3640 1 -- 172.21.15.167:0/3348590493 learned_addr learned my addr 172.21.15.167:0/3348590493 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:17.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff2212f2640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c06e840 0x7ff21c1f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff2222f4640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c1f2da0 0x7ff21c1e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff221af3640 1 -- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c1f2da0 msgr2=0x7ff21c1e36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff221af3640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c1f2da0 0x7ff21c1e36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff221af3640 1 -- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c06e840 msgr2=0x7ff21c1f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff221af3640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c06e840 0x7ff21c1f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff221af3640 1 -- 172.21.15.167:0/3348590493 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c0caeb0 con 0x7ff2080047d0 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff2212f2640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c06e840 0x7ff21c1f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff2222f4640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c1f2da0 0x7ff21c1e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff221af3640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff21c0c65a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff21800e410 tx=0x7ff21800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff2127fc640 1 -- 172.21.15.167:0/3348590493 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2180052e0 con 0x7ff2080047d0 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff2127fc640 1 -- 172.21.15.167:0/3348590493 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff218005440 con 0x7ff2080047d0 2023-11-28T20:38:17.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c1ef490 con 0x7ff2080047d0 2023-11-28T20:38:17.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff2127fc640 1 -- 172.21.15.167:0/3348590493 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218003820 con 0x7ff2080047d0 2023-11-28T20:38:17.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c1efa50 con 0x7ff2080047d0 2023-11-28T20:38:17.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.273+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21c075c90 con 0x7ff2080047d0 2023-11-28T20:38:17.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.277+0000 7ff2127fc640 1 -- 172.21.15.167:0/3348590493 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff218003980 con 0x7ff2080047d0 2023-11-28T20:38:17.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.277+0000 7ff2127fc640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff200066470 0x7ff200068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.277+0000 7ff2127fc640 1 -- 172.21.15.167:0/3348590493 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff218083210 con 0x7ff2080047d0 2023-11-28T20:38:17.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.277+0000 7ff2212f2640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff200066470 0x7ff200068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.277+0000 7ff2212f2640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff200066470 0x7ff200068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0b2000 tx=0x7ff20c0ad000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:17.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.281+0000 7ff2127fc640 1 -- 172.21.15.167:0/3348590493 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2180509f0 con 0x7ff2080047d0 2023-11-28T20:38:17.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.429+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff21c0c44c0 con 0x7ff2080047d0 2023-11-28T20:38:17.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff2127fc640 1 -- 172.21.15.167:0/3348590493 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff21c0c44c0 con 0x7ff2080047d0 2023-11-28T20:38:17.499 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_metadata' created 2023-11-28T20:38:17.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff200066470 msgr2=0x7ff200068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff200066470 0x7ff200068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0b2000 tx=0x7ff20c0ad000 comp rx=0 tx=0).stop 2023-11-28T20:38:17.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 msgr2=0x7ff21c0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff21c0c65a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff21800e410 tx=0x7ff21800e8d0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 shutdown_connections 2023-11-28T20:38:17.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff200066470 0x7ff200068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c1f2da0 0x7ff21c1e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c06e840 0x7ff21c1f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 --2- 172.21.15.167:0/3348590493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2080047d0 0x7ff21c0c65a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 >> 172.21.15.167:0/3348590493 conn(0x7ff21c06e030 msgr2=0x7ff21c073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:17.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 shutdown_connections 2023-11-28T20:38:17.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.497+0000 7ff223d57640 1 -- 172.21.15.167:0/3348590493 wait complete. 2023-11-28T20:38:17.526 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-28T20:38:17.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d076d6640 1 Processor -- start 2023-11-28T20:38:17.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d076d6640 1 -- start start 2023-11-28T20:38:17.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d076d6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d00153be0 0x7f2d0015d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d076d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 0x7f2d0015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d076d6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d0006a580 0x7f2d0006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d076d6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d000c2dd0 con 0x7f2d0006a580 2023-11-28T20:38:17.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d076d6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0015e280 con 0x7f2d00153be0 2023-11-28T20:38:17.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d076d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d00071110 con 0x7f2d00153fc0 2023-11-28T20:38:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05c73640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d0006a580 0x7f2d0006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05c73640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d0006a580 0x7f2d0006aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38256/0 (socket says 172.21.15.167:38256) 2023-11-28T20:38:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05c73640 1 -- 172.21.15.167:0/2374483565 learned_addr learned my addr 172.21.15.167:0/2374483565 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d04c71640 1 --2- 172.21.15.167:0/2374483565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 0x7f2d0015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05472640 1 --2- 172.21.15.167:0/2374483565 >> v2:172.21.15.178:3300/0 conn(0x7f2d00153be0 0x7f2d0015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05c73640 1 -- 172.21.15.167:0/2374483565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 msgr2=0x7f2d0015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05c73640 1 --2- 172.21.15.167:0/2374483565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 0x7f2d0015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05c73640 1 -- 172.21.15.167:0/2374483565 >> v2:172.21.15.178:3300/0 conn(0x7f2d00153be0 msgr2=0x7f2d0015d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05c73640 1 --2- 172.21.15.167:0/2374483565 >> v2:172.21.15.178:3300/0 conn(0x7f2d00153be0 0x7f2d0015d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05c73640 1 -- 172.21.15.167:0/2374483565 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0015ad00 con 0x7f2d0006a580 2023-11-28T20:38:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.669+0000 7f2d05472640 1 --2- 172.21.15.167:0/2374483565 >> v2:172.21.15.178:3300/0 conn(0x7f2d00153be0 0x7f2d0015d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:17.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d05c73640 1 --2- 172.21.15.167:0/2374483565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d0006a580 0x7f2d0006aa10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d0006fe00 tx=0x7f2cf801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c20ba80c1223c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:17.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2cf7fff640 1 -- 172.21.15.167:0/2374483565 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80a5820 con 0x7f2d0006a580 2023-11-28T20:38:17.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2cf7fff640 1 -- 172.21.15.167:0/2374483565 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf80a5980 con 0x7f2d0006a580 2023-11-28T20:38:17.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2cf7fff640 1 -- 172.21.15.167:0/2374483565 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80a5d10 con 0x7f2d0006a580 2023-11-28T20:38:17.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d076d6640 1 -- 172.21.15.167:0/2374483565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d0006a580 msgr2=0x7f2d0006aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d076d6640 1 --2- 172.21.15.167:0/2374483565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d0006a580 0x7f2d0006aa10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d0006fe00 tx=0x7f2cf801c9a0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d076d6640 1 -- 172.21.15.167:0/2374483565 shutdown_connections 2023-11-28T20:38:17.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d076d6640 1 --2- 172.21.15.167:0/2374483565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d0006a580 0x7f2d0006aa10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d076d6640 1 --2- 172.21.15.167:0/2374483565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 0x7f2d0015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d076d6640 1 --2- 172.21.15.167:0/2374483565 >> v2:172.21.15.178:3300/0 conn(0x7f2d00153be0 0x7f2d0015d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d076d6640 1 -- 172.21.15.167:0/2374483565 >> 172.21.15.167:0/2374483565 conn(0x7f2d000cb1e0 msgr2=0x7f2d000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:17.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d076d6640 1 -- 172.21.15.167:0/2374483565 shutdown_connections 2023-11-28T20:38:17.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.673+0000 7f2d076d6640 1 -- 172.21.15.167:0/2374483565 wait complete. 2023-11-28T20:38:17.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 Processor -- start 2023-11-28T20:38:17.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 -- start start 2023-11-28T20:38:17.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006a580 0x7f2d00158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d00153be0 0x7f2d0015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 0x7f2d001f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0015b6b0 con 0x7f2d00153be0 2023-11-28T20:38:17.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d001f5e70 con 0x7f2d0006a580 2023-11-28T20:38:17.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0015b3d0 con 0x7f2d00153fc0 2023-11-28T20:38:17.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d04c71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d00153be0 0x7f2d0015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d04c71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d00153be0 0x7f2d0015a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38268/0 (socket says 172.21.15.167:38268) 2023-11-28T20:38:17.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d04c71640 1 -- 172.21.15.167:0/1336986604 learned_addr learned my addr 172.21.15.167:0/1336986604 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:17.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d05472640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006a580 0x7f2d00158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d05c73640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 0x7f2d001f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d04c71640 1 -- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 msgr2=0x7f2d001f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d04c71640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 0x7f2d001f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d04c71640 1 -- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006a580 msgr2=0x7f2d00158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:17.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d04c71640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006a580 0x7f2d00158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:17.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d04c71640 1 -- 172.21.15.167:0/1336986604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf8009b30 con 0x7f2d00153be0 2023-11-28T20:38:17.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d04c71640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d00153be0 0x7f2d0015a180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000d5f0 tx=0x7f2cf000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:17.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2cf5ffb640 1 -- 172.21.15.167:0/1336986604 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00125f0 con 0x7f2d00153be0 2023-11-28T20:38:17.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2cf5ffb640 1 -- 172.21.15.167:0/1336986604 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf0012750 con 0x7f2d00153be0 2023-11-28T20:38:17.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2cf5ffb640 1 -- 172.21.15.167:0/1336986604 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0012ae0 con 0x7f2d00153be0 2023-11-28T20:38:17.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d001f50b0 con 0x7f2d00153be0 2023-11-28T20:38:17.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.677+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d001f5670 con 0x7f2d00153be0 2023-11-28T20:38:17.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.681+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d000682c0 con 0x7f2d00153be0 2023-11-28T20:38:17.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.681+0000 7f2cf5ffb640 1 -- 172.21.15.167:0/1336986604 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cf0012c40 con 0x7f2d00153be0 2023-11-28T20:38:17.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.681+0000 7f2cf5ffb640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ce4066470 0x7f2ce4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:17.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.681+0000 7f2cf5ffb640 1 -- 172.21.15.167:0/1336986604 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2cf0084110 con 0x7f2d00153be0 2023-11-28T20:38:17.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.681+0000 7f2d05472640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ce4066470 0x7f2ce4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:17.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.681+0000 7f2d05472640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ce4066470 0x7f2ce4068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c880 tx=0x7f2cfc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:17.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.685+0000 7f2cf5ffb640 1 -- 172.21.15.167:0/1336986604 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2cf0051800 con 0x7f2d00153be0 2023-11-28T20:38:17.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:17.837+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f2d00075c90 con 0x7f2d00153be0 2023-11-28T20:38:18.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.505+0000 7f2cf5ffb640 1 -- 172.21.15.167:0/1336986604 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f2cf0007380 con 0x7f2d00153be0 2023-11-28T20:38:18.510 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_data' created 2023-11-28T20:38:18.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ce4066470 msgr2=0x7f2ce4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ce4066470 0x7f2ce4068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00c880 tx=0x7f2cfc008040 comp rx=0 tx=0).stop 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d00153be0 msgr2=0x7f2d0015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d00153be0 0x7f2d0015a180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000d5f0 tx=0x7f2cf000dab0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 shutdown_connections 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ce4066470 0x7f2ce4068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d00153fc0 0x7f2d001f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d00153be0 0x7f2d0015a180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 --2- 172.21.15.167:0/1336986604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006a580 0x7f2d00158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 >> 172.21.15.167:0/1336986604 conn(0x7f2d000cb1e0 msgr2=0x7f2d00152680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 shutdown_connections 2023-11-28T20:38:18.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.509+0000 7f2d076d6640 1 -- 172.21.15.167:0/1336986604 wait complete. 2023-11-28T20:38:18.551 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T20:38:18.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.693+0000 7f2d97fc3640 1 Processor -- start 2023-11-28T20:38:18.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.693+0000 7f2d97fc3640 1 -- start start 2023-11-28T20:38:18.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.693+0000 7f2d97fc3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d90150500 0x7f2d90156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:18.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.693+0000 7f2d97fc3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c7220 0x7f2d900c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:18.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.693+0000 7f2d97fc3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d90157170 con 0x7f2d900c6960 2023-11-28T20:38:18.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.693+0000 7f2d97fc3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d900c7bf0 con 0x7f2d90150500 2023-11-28T20:38:18.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.693+0000 7f2d97fc3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d901598f0 con 0x7f2d900c7220 2023-11-28T20:38:18.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d95d5f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d90150500 0x7f2d90156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:18.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d9555e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2d900c6960 0x7f2d900c9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53230/0 (socket says 172.21.15.167:53230) 2023-11-28T20:38:18.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d9555e640 1 -- 172.21.15.167:0/386248091 learned_addr learned my addr 172.21.15.167:0/386248091 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:18.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d96560640 1 --2- 172.21.15.167:0/386248091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c7220 0x7f2d900c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:18.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d95d5f640 1 -- 172.21.15.167:0/386248091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c7220 msgr2=0x7f2d900c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:18.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d95d5f640 1 --2- 172.21.15.167:0/386248091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c7220 0x7f2d900c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d95d5f640 1 -- 172.21.15.167:0/386248091 >> v1:172.21.15.167:6789/0 conn(0x7f2d900c6960 legacy=0x7f2d900c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:18.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d95d5f640 1 -- 172.21.15.167:0/386248091 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90159b90 con 0x7f2d90150500 2023-11-28T20:38:18.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d94d5d640 1 -- 172.21.15.167:0/386248091 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204161377 0 0) 0x7f2d90157170 con 0x7f2d900c6960 2023-11-28T20:38:18.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d95d5f640 1 --2- 172.21.15.167:0/386248091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90150500 0x7f2d90156c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0097f0 tx=0x7f2d8c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67008afb0d484f74 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:18.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d94d5d640 1 -- 172.21.15.167:0/386248091 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0ab600 con 0x7f2d90150500 2023-11-28T20:38:18.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d94d5d640 1 -- 172.21.15.167:0/386248091 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c0a7050 con 0x7f2d90150500 2023-11-28T20:38:18.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.697+0000 7f2d94d5d640 1 -- 172.21.15.167:0/386248091 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c0ab980 con 0x7f2d90150500 2023-11-28T20:38:18.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 -- 172.21.15.167:0/386248091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90150500 msgr2=0x7f2d90156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:18.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 --2- 172.21.15.167:0/386248091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90150500 0x7f2d90156c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0097f0 tx=0x7f2d8c01c3f0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 -- 172.21.15.167:0/386248091 shutdown_connections 2023-11-28T20:38:18.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 --2- 172.21.15.167:0/386248091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c7220 0x7f2d900c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 --2- 172.21.15.167:0/386248091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90150500 0x7f2d90156c30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 -- 172.21.15.167:0/386248091 >> 172.21.15.167:0/386248091 conn(0x7f2d9006a580 msgr2=0x7f2d9006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:18.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 -- 172.21.15.167:0/386248091 shutdown_connections 2023-11-28T20:38:18.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 -- 172.21.15.167:0/386248091 wait complete. 2023-11-28T20:38:18.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 Processor -- start 2023-11-28T20:38:18.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 -- start start 2023-11-28T20:38:18.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c6960 0x7f2d90149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:18.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d900c7220 0x7f2d9015f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:18.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90150500 0x7f2d9015f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:18.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d901f2090 con 0x7f2d900c7220 2023-11-28T20:38:18.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900c4d20 con 0x7f2d90150500 2023-11-28T20:38:18.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d97fc3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900c5000 con 0x7f2d900c6960 2023-11-28T20:38:18.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d9555e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d900c7220 0x7f2d9015f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:18.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d9555e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d900c7220 0x7f2d9015f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38292/0 (socket says 172.21.15.167:38292) 2023-11-28T20:38:18.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d9555e640 1 -- 172.21.15.167:0/2105512257 learned_addr learned my addr 172.21.15.167:0/2105512257 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:18.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d95d5f640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c6960 0x7f2d90149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:18.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d96560640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90150500 0x7f2d9015f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:18.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d9555e640 1 -- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c6960 msgr2=0x7f2d90149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:18.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d9555e640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c6960 0x7f2d90149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.701+0000 7f2d9555e640 1 -- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90150500 msgr2=0x7f2d9015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:18.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d9555e640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90150500 0x7f2d9015f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:18.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d9555e640 1 -- 172.21.15.167:0/2105512257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c009420 con 0x7f2d900c7220 2023-11-28T20:38:18.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d9555e640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d900c7220 0x7f2d9015f1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c480 tx=0x7f2d8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:18.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d867fc640 1 -- 172.21.15.167:0/2105512257 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800074e0 con 0x7f2d900c7220 2023-11-28T20:38:18.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d867fc640 1 -- 172.21.15.167:0/2105512257 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80007660 con 0x7f2d900c7220 2023-11-28T20:38:18.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d867fc640 1 -- 172.21.15.167:0/2105512257 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80004a30 con 0x7f2d900c7220 2023-11-28T20:38:18.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d900c52e0 con 0x7f2d900c7220 2023-11-28T20:38:18.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9015ef40 con 0x7f2d900c7220 2023-11-28T20:38:18.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d90075c90 con 0x7f2d900c7220 2023-11-28T20:38:18.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d867fc640 1 -- 172.21.15.167:0/2105512257 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d8001b360 con 0x7f2d900c7220 2023-11-28T20:38:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d867fc640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d74066470 0x7f2d74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.705+0000 7f2d867fc640 1 -- 172.21.15.167:0/2105512257 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2d80083150 con 0x7f2d900c7220 2023-11-28T20:38:18.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.709+0000 7f2d95d5f640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d74066470 0x7f2d74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:18.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.709+0000 7f2d95d5f640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d74066470 0x7f2d74068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0ad000 tx=0x7f2d8c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:18.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.709+0000 7f2d867fc640 1 -- 172.21.15.167:0/2105512257 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d80050850 con 0x7f2d900c7220 2023-11-28T20:38:18.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:18.889+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2d900cab30 con 0x7f2d900c7220 2023-11-28T20:38:19.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.509+0000 7f2d867fc640 1 -- 172.21.15.167:0/2105512257 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2d800180c0 con 0x7f2d900c7220 2023-11-28T20:38:19.512 INFO:teuthology.orchestra.run.smithi167.stderr:new fs with metadata pool 2 and data pool 3 2023-11-28T20:38:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d74066470 msgr2=0x7f2d74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d74066470 0x7f2d74068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0ad000 tx=0x7f2d8c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:38:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d900c7220 msgr2=0x7f2d9015f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d900c7220 0x7f2d9015f1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c480 tx=0x7f2d8000c940 comp rx=0 tx=0).stop 2023-11-28T20:38:19.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 shutdown_connections 2023-11-28T20:38:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d74066470 0x7f2d74068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90150500 0x7f2d9015f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d900c7220 0x7f2d9015f1b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 --2- 172.21.15.167:0/2105512257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d900c6960 0x7f2d90149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 >> 172.21.15.167:0/2105512257 conn(0x7f2d9006a580 msgr2=0x7f2d90071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 shutdown_connections 2023-11-28T20:38:19.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.513+0000 7f2d97fc3640 1 -- 172.21.15.167:0/2105512257 wait complete. 2023-11-28T20:38:19.536 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-28T20:38:19.537 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-28T20:38:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.677+0000 7f627d11d640 1 Processor -- start 2023-11-28T20:38:19.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.677+0000 7f627d11d640 1 -- start start 2023-11-28T20:38:19.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627d11d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62781584c0 0x7f62780c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627d11d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6278162040 0x7f62780c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627d11d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6278162510 con 0x7f62780c7320 2023-11-28T20:38:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627d11d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62780c50d0 con 0x7f6278162040 2023-11-28T20:38:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627d11d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627806b240 con 0x7f62781584c0 2023-11-28T20:38:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627759e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6278162040 0x7f62780c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f626ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f62780c7320 0x7f62780c7f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53240/0 (socket says 172.21.15.167:53240) 2023-11-28T20:38:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f626ffff640 1 -- 172.21.15.167:0/1699409655 learned_addr learned my addr 172.21.15.167:0/1699409655 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:19.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f6276d9d640 1 --2- 172.21.15.167:0/1699409655 >> v2:172.21.15.178:3300/0 conn(0x7f62781584c0 0x7f62780c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:19.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627759e640 1 -- 172.21.15.167:0/1699409655 >> v2:172.21.15.178:3300/0 conn(0x7f62781584c0 msgr2=0x7f62780c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:19.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627759e640 1 --2- 172.21.15.167:0/1699409655 >> v2:172.21.15.178:3300/0 conn(0x7f62781584c0 0x7f62780c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627759e640 1 -- 172.21.15.167:0/1699409655 >> v1:172.21.15.167:6789/0 conn(0x7f62780c7320 legacy=0x7f62780c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:19.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627759e640 1 -- 172.21.15.167:0/1699409655 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627806a690 con 0x7f6278162040 2023-11-28T20:38:19.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.681+0000 7f627659c640 1 -- 172.21.15.167:0/1699409655 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648013238 0 0) 0x7f6278162510 con 0x7f62780c7320 2023-11-28T20:38:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627759e640 1 --2- 172.21.15.167:0/1699409655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6278162040 0x7f62780c6cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f627806fd90 tx=0x7f627001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79b3cb3e2f26125 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627659c640 1 -- 172.21.15.167:0/1699409655 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700b0440 con 0x7f6278162040 2023-11-28T20:38:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627659c640 1 -- 172.21.15.167:0/1699409655 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62700b05a0 con 0x7f6278162040 2023-11-28T20:38:19.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627659c640 1 -- 172.21.15.167:0/1699409655 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700b0930 con 0x7f6278162040 2023-11-28T20:38:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 -- 172.21.15.167:0/1699409655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6278162040 msgr2=0x7f62780c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 --2- 172.21.15.167:0/1699409655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6278162040 0x7f62780c6cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f627806fd90 tx=0x7f627001f0f0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 -- 172.21.15.167:0/1699409655 shutdown_connections 2023-11-28T20:38:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 --2- 172.21.15.167:0/1699409655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6278162040 0x7f62780c6cb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 --2- 172.21.15.167:0/1699409655 >> v2:172.21.15.178:3300/0 conn(0x7f62781584c0 0x7f62780c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 -- 172.21.15.167:0/1699409655 >> 172.21.15.167:0/1699409655 conn(0x7f627806e030 msgr2=0x7f627806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 -- 172.21.15.167:0/1699409655 shutdown_connections 2023-11-28T20:38:19.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 -- 172.21.15.167:0/1699409655 wait complete. 2023-11-28T20:38:19.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 Processor -- start 2023-11-28T20:38:19.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.685+0000 7f627d11d640 1 -- start start 2023-11-28T20:38:19.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627d11d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62780c7320 0x7f62780ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627d11d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62781584c0 0x7f62781524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627d11d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6278162040 0x7f6278152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627d11d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6278153460 con 0x7f62780c7320 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627d11d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62781589d0 con 0x7f6278162040 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627d11d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6278159df0 con 0x7f62781584c0 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f6276d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62780c7320 0x7f62780ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f6276d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62780c7320 0x7f62780ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38322/0 (socket says 172.21.15.167:38322) 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f6276d9d640 1 -- 172.21.15.167:0/2950628202 learned_addr learned my addr 172.21.15.167:0/2950628202 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f626ffff640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62781584c0 0x7f62781524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:19.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627759e640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6278162040 0x7f6278152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f6276d9d640 1 -- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62781584c0 msgr2=0x7f62781524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f6276d9d640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62781584c0 0x7f62781524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f6276d9d640 1 -- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6278162040 msgr2=0x7f6278152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f6276d9d640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6278162040 0x7f6278152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f6276d9d640 1 -- 172.21.15.167:0/2950628202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270009a70 con 0x7f62780c7320 2023-11-28T20:38:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627759e640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6278162040 0x7f6278152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:19.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f6276d9d640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62780c7320 0x7f62780ca6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f626800e960 tx=0x7f626800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f626f7fe640 1 -- 172.21.15.167:0/2950628202 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268009690 con 0x7f62780c7320 2023-11-28T20:38:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f626f7fe640 1 -- 172.21.15.167:0/2950628202 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800ca00 con 0x7f62780c7320 2023-11-28T20:38:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f626f7fe640 1 -- 172.21.15.167:0/2950628202 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800cd70 con 0x7f62780c7320 2023-11-28T20:38:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627815a0d0 con 0x7f62780c7320 2023-11-28T20:38:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627815a690 con 0x7f62780c7320 2023-11-28T20:38:19.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6278070500 con 0x7f62780c7320 2023-11-28T20:38:19.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.689+0000 7f626f7fe640 1 -- 172.21.15.167:0/2950628202 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6268013470 con 0x7f62780c7320 2023-11-28T20:38:19.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.693+0000 7f626f7fe640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62580664a0 0x7f6258068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:19.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.693+0000 7f626f7fe640 1 -- 172.21.15.167:0/2950628202 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62680841b0 con 0x7f62780c7320 2023-11-28T20:38:19.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.693+0000 7f626ffff640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62580664a0 0x7f6258068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:19.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.693+0000 7f626ffff640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62580664a0 0x7f6258068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6278159be0 tx=0x7f6260007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:19.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.697+0000 7f626f7fe640 1 -- 172.21.15.167:0/2950628202 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6278070500 con 0x7f62780c7320 2023-11-28T20:38:19.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:19.853+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f6278070500 con 0x7f62780c7320 2023-11-28T20:38:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.345+0000 7f626f7fe640 1 -- 172.21.15.167:0/2950628202 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f6278070500 con 0x7f62780c7320 2023-11-28T20:38:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62580664a0 msgr2=0x7f6258068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62580664a0 0x7f6258068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6278159be0 tx=0x7f6260007b60 comp rx=0 tx=0).stop 2023-11-28T20:38:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62780c7320 msgr2=0x7f62780ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62780c7320 0x7f62780ca6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f626800e960 tx=0x7f626800ee20 comp rx=0 tx=0).stop 2023-11-28T20:38:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 shutdown_connections 2023-11-28T20:38:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62580664a0 0x7f6258068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6278162040 0x7f6278152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62781584c0 0x7f62781524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 --2- 172.21.15.167:0/2950628202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62780c7320 0x7f62780ca6c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 >> 172.21.15.167:0/2950628202 conn(0x7f627806e030 msgr2=0x7f62781606c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 shutdown_connections 2023-11-28T20:38:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.349+0000 7f627d11d640 1 -- 172.21.15.167:0/2950628202 wait complete. 2023-11-28T20:38:20.372 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T20:38:20.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.517+0000 7fdb5f0c9640 1 Processor -- start 2023-11-28T20:38:20.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.517+0000 7fdb5f0c9640 1 -- start start 2023-11-28T20:38:20.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.517+0000 7fdb5f0c9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb58154170 0x7fdb580c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:20.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5f0c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdb58159d50 0x7fdb5806c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:20.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5f0c9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5806ba10 con 0x7fdb58070970 2023-11-28T20:38:20.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5f0c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb580c87d0 con 0x7fdb58159d50 2023-11-28T20:38:20.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5f0c9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb580704e0 con 0x7fdb58154170 2023-11-28T20:38:20.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5d666640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdb58159d50 0x7fdb5806c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:20.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5d666640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdb58159d50 0x7fdb5806c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38324/0 (socket says 172.21.15.167:38324) 2023-11-28T20:38:20.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5ce65640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb58154170 0x7fdb580c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:20.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5d666640 1 -- 172.21.15.167:0/1096683996 learned_addr learned my addr 172.21.15.167:0/1096683996 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:20.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5d666640 1 -- 172.21.15.167:0/1096683996 >> v2:172.21.15.178:3300/0 conn(0x7fdb58154170 msgr2=0x7fdb580c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:20.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5d666640 1 --2- 172.21.15.167:0/1096683996 >> v2:172.21.15.178:3300/0 conn(0x7fdb58154170 0x7fdb580c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5d666640 1 -- 172.21.15.167:0/1096683996 >> v1:172.21.15.178:6789/0 conn(0x7fdb58070970 legacy=0x7fdb580c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:20.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5d666640 1 -- 172.21.15.167:0/1096683996 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5806fed0 con 0x7fdb58159d50 2023-11-28T20:38:20.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.521+0000 7fdb5d666640 1 --2- 172.21.15.167:0/1096683996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 0x7fdb5806c050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb58072be0 tx=0x7fdb5001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b33714e5012833 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:20.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb577fe640 1 -- 172.21.15.167:0/1096683996 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500af400 con 0x7fdb58159d50 2023-11-28T20:38:20.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb577fe640 1 -- 172.21.15.167:0/1096683996 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500ab050 con 0x7fdb58159d50 2023-11-28T20:38:20.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb577fe640 1 -- 172.21.15.167:0/1096683996 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500af780 con 0x7fdb58159d50 2023-11-28T20:38:20.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1096683996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 msgr2=0x7fdb5806c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:20.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 --2- 172.21.15.167:0/1096683996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 0x7fdb5806c050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb58072be0 tx=0x7fdb5001f1c0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1096683996 shutdown_connections 2023-11-28T20:38:20.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 --2- 172.21.15.167:0/1096683996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 0x7fdb5806c050 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 --2- 172.21.15.167:0/1096683996 >> v2:172.21.15.178:3300/0 conn(0x7fdb58154170 0x7fdb580c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1096683996 >> 172.21.15.167:0/1096683996 conn(0x7fdb580cd890 msgr2=0x7fdb580cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:20.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1096683996 shutdown_connections 2023-11-28T20:38:20.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1096683996 wait complete. 2023-11-28T20:38:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 Processor -- start 2023-11-28T20:38:20.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 -- start start 2023-11-28T20:38:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb58070970 0x7fdb581e5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:20.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb58154170 0x7fdb581f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 0x7fdb5815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb581f37c0 con 0x7fdb58159d50 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58154680 con 0x7fdb58070970 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.525+0000 7fdb5f0c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb581e5e60 con 0x7fdb58154170 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5d666640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 0x7fdb5815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5d666640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 0x7fdb5815d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38330/0 (socket says 172.21.15.167:38330) 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5d666640 1 -- 172.21.15.167:0/1302018931 learned_addr learned my addr 172.21.15.167:0/1302018931 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5ce65640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb58070970 0x7fdb581e5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb57fff640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb58154170 0x7fdb581f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5d666640 1 -- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb58154170 msgr2=0x7fdb581f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5d666640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb58154170 0x7fdb581f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5d666640 1 -- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb58070970 msgr2=0x7fdb581e5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:20.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5d666640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb58070970 0x7fdb581e5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5d666640 1 -- 172.21.15.167:0/1302018931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009b30 con 0x7fdb58159d50 2023-11-28T20:38:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5ce65640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb58070970 0x7fdb581e5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5d666640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 0x7fdb5815d550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdb500b2040 tx=0x7fdb5001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb557fa640 1 -- 172.21.15.167:0/1302018931 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500afd10 con 0x7fdb58159d50 2023-11-28T20:38:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb557fa640 1 -- 172.21.15.167:0/1302018931 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500afe90 con 0x7fdb58159d50 2023-11-28T20:38:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb557fa640 1 -- 172.21.15.167:0/1302018931 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500ba660 con 0x7fdb58159d50 2023-11-28T20:38:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb581548d0 con 0x7fdb58159d50 2023-11-28T20:38:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb581f33e0 con 0x7fdb58159d50 2023-11-28T20:38:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb581f3900 con 0x7fdb58159d50 2023-11-28T20:38:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb557fa640 1 -- 172.21.15.167:0/1302018931 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb500b6040 con 0x7fdb58159d50 2023-11-28T20:38:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb557fa640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb3c066470 0x7fdb3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.529+0000 7fdb557fa640 1 -- 172.21.15.167:0/1302018931 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fdb50121fb0 con 0x7fdb58159d50 2023-11-28T20:38:20.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.533+0000 7fdb5ce65640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb3c066470 0x7fdb3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:20.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.533+0000 7fdb5ce65640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb3c066470 0x7fdb3c068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009bb0 tx=0x7fdb4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:20.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.533+0000 7fdb557fa640 1 -- 172.21.15.167:0/1302018931 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb581f3900 con 0x7fdb58159d50 2023-11-28T20:38:20.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:20.685+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdb581f3900 con 0x7fdb58159d50 2023-11-28T20:38:22.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.537+0000 7fdb557fa640 1 -- 172.21.15.167:0/1302018931 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fdb581f3900 con 0x7fdb58159d50 2023-11-28T20:38:22.541 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_data_ec' created 2023-11-28T20:38:22.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb3c066470 msgr2=0x7fdb3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:22.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb3c066470 0x7fdb3c068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009bb0 tx=0x7fdb4c008040 comp rx=0 tx=0).stop 2023-11-28T20:38:22.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 msgr2=0x7fdb5815d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:22.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 0x7fdb5815d550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdb500b2040 tx=0x7fdb5001bf60 comp rx=0 tx=0).stop 2023-11-28T20:38:22.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 shutdown_connections 2023-11-28T20:38:22.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb3c066470 0x7fdb3c068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:22.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb58159d50 0x7fdb5815d550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:22.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb58154170 0x7fdb581f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:22.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 --2- 172.21.15.167:0/1302018931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb58070970 0x7fdb581e5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:22.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.541+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 >> 172.21.15.167:0/1302018931 conn(0x7fdb580cd890 msgr2=0x7fdb58158c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:22.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.545+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 shutdown_connections 2023-11-28T20:38:22.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.545+0000 7fdb5f0c9640 1 -- 172.21.15.167:0/1302018931 wait complete. 2023-11-28T20:38:22.578 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-28T20:38:22.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12e7f5640 1 Processor -- start 2023-11-28T20:38:22.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12e7f5640 1 -- start start 2023-11-28T20:38:22.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12e7f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb128157d60 0x7fb128158210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:22.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12e7f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb128158750 con 0x7fb128070520 2023-11-28T20:38:22.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12e7f5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12806baa0 con 0x7fb128151ed0 2023-11-28T20:38:22.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12e7f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1280c5f20 con 0x7fb128157d60 2023-11-28T20:38:22.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12cd92640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb128157d60 0x7fb128158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:22.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb1277fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb128070520 0x7fb128071530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53248/0 (socket says 172.21.15.167:53248) 2023-11-28T20:38:22.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb1277fe640 1 -- 172.21.15.167:0/1736640302 learned_addr learned my addr 172.21.15.167:0/1736640302 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12cd92640 1 -- 172.21.15.167:0/1736640302 >> v1:172.21.15.178:6789/0 conn(0x7fb128151ed0 legacy=0x7fb12806a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12cd92640 1 -- 172.21.15.167:0/1736640302 >> v1:172.21.15.167:6789/0 conn(0x7fb128070520 legacy=0x7fb128071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.721+0000 7fb12cd92640 1 -- 172.21.15.167:0/1736640302 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12806b4e0 con 0x7fb128157d60 2023-11-28T20:38:22.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12cd92640 1 --2- 172.21.15.167:0/1736640302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 0x7fb128158210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb120009d90 tx=0x7fb12001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a7310de6706a03 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb126ffd640 1 -- 172.21.15.167:0/1736640302 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1200a5950 con 0x7fb128157d60 2023-11-28T20:38:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb126ffd640 1 -- 172.21.15.167:0/1736640302 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1200a5ab0 con 0x7fb128157d60 2023-11-28T20:38:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb126ffd640 1 -- 172.21.15.167:0/1736640302 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1200a5e40 con 0x7fb128157d60 2023-11-28T20:38:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1736640302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 msgr2=0x7fb128158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12e7f5640 1 --2- 172.21.15.167:0/1736640302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 0x7fb128158210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb120009d90 tx=0x7fb12001c890 comp rx=0 tx=0).stop 2023-11-28T20:38:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1736640302 shutdown_connections 2023-11-28T20:38:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12e7f5640 1 --2- 172.21.15.167:0/1736640302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 0x7fb128158210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1736640302 >> 172.21.15.167:0/1736640302 conn(0x7fb12806e030 msgr2=0x7fb12806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1736640302 shutdown_connections 2023-11-28T20:38:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1736640302 wait complete. 2023-11-28T20:38:22.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12e7f5640 1 Processor -- start 2023-11-28T20:38:22.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.725+0000 7fb12e7f5640 1 -- start start 2023-11-28T20:38:22.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12e7f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb128070520 0x7fb12814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:22.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12e7f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb128151ed0 0x7fb128147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12e7f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 0x7fb128147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12e7f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280ca2d0 con 0x7fb128157d60 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12e7f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128159b30 con 0x7fb128151ed0 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12e7f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280cb300 con 0x7fb128070520 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12cd92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 0x7fb128147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12cd92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 0x7fb128147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38348/0 (socket says 172.21.15.167:38348) 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12cd92640 1 -- 172.21.15.167:0/1278847944 learned_addr learned my addr 172.21.15.167:0/1278847944 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb1277fe640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb128151ed0 0x7fb128147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb127fff640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb128070520 0x7fb12814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12cd92640 1 -- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb128070520 msgr2=0x7fb12814e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:22.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12cd92640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb128070520 0x7fb12814e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:22.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12cd92640 1 -- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb128151ed0 msgr2=0x7fb128147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:22.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12cd92640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb128151ed0 0x7fb128147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:22.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12cd92640 1 -- 172.21.15.167:0/1278847944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120009a70 con 0x7fb128157d60 2023-11-28T20:38:22.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb1277fe640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb128151ed0 0x7fb128147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:22.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12cd92640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 0x7fb128147b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1200b0040 tx=0x7fb120019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:22.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb124ff9640 1 -- 172.21.15.167:0/1278847944 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1200ade40 con 0x7fb128157d60 2023-11-28T20:38:22.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb124ff9640 1 -- 172.21.15.167:0/1278847944 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1200b9450 con 0x7fb128157d60 2023-11-28T20:38:22.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb124ff9640 1 -- 172.21.15.167:0/1278847944 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1200b9800 con 0x7fb128157d60 2023-11-28T20:38:22.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280cb5e0 con 0x7fb128157d60 2023-11-28T20:38:22.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1280cbba0 con 0x7fb128157d60 2023-11-28T20:38:22.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.729+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1280cbd90 con 0x7fb128157d60 2023-11-28T20:38:22.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.733+0000 7fb124ff9640 1 -- 172.21.15.167:0/1278847944 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1200b9960 con 0x7fb128157d60 2023-11-28T20:38:22.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.733+0000 7fb124ff9640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1140664a0 0x7fb114068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:22.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.733+0000 7fb124ff9640 1 -- 172.21.15.167:0/1278847944 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb12011fa90 con 0x7fb128157d60 2023-11-28T20:38:22.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.733+0000 7fb127fff640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1140664a0 0x7fb114068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:22.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.733+0000 7fb127fff640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1140664a0 0x7fb114068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb118000f70 tx=0x7fb118009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:22.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.737+0000 7fb124ff9640 1 -- 172.21.15.167:0/1278847944 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1200eccf0 con 0x7fb128157d60 2023-11-28T20:38:22.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:22.889+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fb128075c90 con 0x7fb128157d60 2023-11-28T20:38:23.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.549+0000 7fb124ff9640 1 -- 172.21.15.167:0/1278847944 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb1200f0310 con 0x7fb128157d60 2023-11-28T20:38:23.551 INFO:teuthology.orchestra.run.smithi167.stderr:set pool 4 allow_ec_overwrites to true 2023-11-28T20:38:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1140664a0 msgr2=0x7fb114068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1140664a0 0x7fb114068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb118000f70 tx=0x7fb118009040 comp rx=0 tx=0).stop 2023-11-28T20:38:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 msgr2=0x7fb128147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:23.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 0x7fb128147b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1200b0040 tx=0x7fb120019630 comp rx=0 tx=0).stop 2023-11-28T20:38:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 shutdown_connections 2023-11-28T20:38:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1140664a0 0x7fb114068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb128157d60 0x7fb128147b50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb128151ed0 0x7fb128147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 --2- 172.21.15.167:0/1278847944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb128070520 0x7fb12814e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:23.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.553+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 >> 172.21.15.167:0/1278847944 conn(0x7fb12806e030 msgr2=0x7fb1280c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:23.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.557+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 shutdown_connections 2023-11-28T20:38:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.557+0000 7fb12e7f5640 1 -- 172.21.15.167:0/1278847944 wait complete. 2023-11-28T20:38:23.597 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-28T20:38:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2ea6679640 1 Processor -- start 2023-11-28T20:38:23.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2ea6679640 1 -- start start 2023-11-28T20:38:23.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2ea6679640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea0150b40 0x7f2ea0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:23.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2ea6679640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ea00c6ff0 0x7f2ea00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:23.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2ea6679640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea00c6ac0 con 0x7f2ea00c5be0 2023-11-28T20:38:23.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2ea6679640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea00c6500 con 0x7f2ea00c6ff0 2023-11-28T20:38:23.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2ea6679640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00c67e0 con 0x7f2ea0150b40 2023-11-28T20:38:23.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2e9ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea0150b40 0x7f2ea0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:23.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2ea4c16640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2ea00c5be0 0x7f2ea006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:34554/0 (socket says 172.21.15.167:34554) 2023-11-28T20:38:23.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2e9ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea0150b40 0x7f2ea0157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:32792/0 (socket says 172.21.15.167:32792) 2023-11-28T20:38:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2ea4c16640 1 -- 172.21.15.167:0/3602421923 learned_addr learned my addr 172.21.15.167:0/3602421923 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2e9f7fe640 1 --2- 172.21.15.167:0/3602421923 >> v2:172.21.15.178:3300/0 conn(0x7f2ea00c6ff0 0x7f2ea00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2e9ffff640 1 -- 172.21.15.167:0/3602421923 >> v2:172.21.15.178:3300/0 conn(0x7f2ea00c6ff0 msgr2=0x7f2ea00c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2e9ffff640 1 --2- 172.21.15.167:0/3602421923 >> v2:172.21.15.178:3300/0 conn(0x7f2ea00c6ff0 0x7f2ea00c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2e9ffff640 1 -- 172.21.15.167:0/3602421923 >> v1:172.21.15.178:6789/0 conn(0x7f2ea00c5be0 legacy=0x7f2ea006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2e9ffff640 1 -- 172.21.15.167:0/3602421923 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0156a80 con 0x7f2ea0150b40 2023-11-28T20:38:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.741+0000 7f2e9effd640 1 -- 172.21.15.167:0/3602421923 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621459308 0 0) 0x7f2ea00c6ac0 con 0x7f2ea00c5be0 2023-11-28T20:38:23.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2e9ffff640 1 --2- 172.21.15.167:0/3602421923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea0150b40 0x7f2ea0157560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2e900097c0 tx=0x7f2e9001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c717318a6b11cff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:23.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2e9effd640 1 -- 172.21.15.167:0/3602421923 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90004230 con 0x7f2ea0150b40 2023-11-28T20:38:23.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2e9effd640 1 -- 172.21.15.167:0/3602421923 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e900a7050 con 0x7f2ea0150b40 2023-11-28T20:38:23.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2e9effd640 1 -- 172.21.15.167:0/3602421923 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90003620 con 0x7f2ea0150b40 2023-11-28T20:38:23.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2ea6679640 1 -- 172.21.15.167:0/3602421923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea0150b40 msgr2=0x7f2ea0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2ea6679640 1 --2- 172.21.15.167:0/3602421923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea0150b40 0x7f2ea0157560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2e900097c0 tx=0x7f2e9001c450 comp rx=0 tx=0).stop 2023-11-28T20:38:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2ea6679640 1 -- 172.21.15.167:0/3602421923 shutdown_connections 2023-11-28T20:38:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2ea6679640 1 --2- 172.21.15.167:0/3602421923 >> v2:172.21.15.178:3300/0 conn(0x7f2ea00c6ff0 0x7f2ea00c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2ea6679640 1 --2- 172.21.15.167:0/3602421923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea0150b40 0x7f2ea0157560 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2ea6679640 1 -- 172.21.15.167:0/3602421923 >> 172.21.15.167:0/3602421923 conn(0x7f2ea00cb1e0 msgr2=0x7f2ea00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2ea6679640 1 -- 172.21.15.167:0/3602421923 shutdown_connections 2023-11-28T20:38:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.745+0000 7f2ea6679640 1 -- 172.21.15.167:0/3602421923 wait complete. 2023-11-28T20:38:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 Processor -- start 2023-11-28T20:38:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 -- start start 2023-11-28T20:38:23.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00c5be0 0x7f2ea015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:23.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00c6ff0 0x7f2ea0146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:23.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea0150b40 0x7f2ea0146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:23.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea01603a0 con 0x7f2ea0150b40 2023-11-28T20:38:23.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea01463b0 con 0x7f2ea00c6ff0 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea013f4f0 con 0x7f2ea00c5be0 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea4c16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea0150b40 0x7f2ea0146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea4c16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea0150b40 0x7f2ea0146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53812/0 (socket says 172.21.15.167:53812) 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea4c16640 1 -- 172.21.15.167:0/387349207 learned_addr learned my addr 172.21.15.167:0/387349207 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2e9f7fe640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00c6ff0 0x7f2ea0146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2e9ffff640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00c5be0 0x7f2ea015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea4c16640 1 -- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00c5be0 msgr2=0x7f2ea015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea4c16640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00c5be0 0x7f2ea015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea4c16640 1 -- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00c6ff0 msgr2=0x7f2ea0146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea4c16640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00c6ff0 0x7f2ea0146800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea4c16640 1 -- 172.21.15.167:0/387349207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90009420 con 0x7f2ea0150b40 2023-11-28T20:38:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea4c16640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea0150b40 0x7f2ea0146d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c7b0 tx=0x7f2e9800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2e9cff9640 1 -- 172.21.15.167:0/387349207 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800a640 con 0x7f2ea0150b40 2023-11-28T20:38:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2e9cff9640 1 -- 172.21.15.167:0/387349207 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9800a7c0 con 0x7f2ea0150b40 2023-11-28T20:38:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea015f600 con 0x7f2ea0150b40 2023-11-28T20:38:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2e9cff9640 1 -- 172.21.15.167:0/387349207 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800ab70 con 0x7f2ea0150b40 2023-11-28T20:38:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.749+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea0160890 con 0x7f2ea0150b40 2023-11-28T20:38:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.753+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea00682c0 con 0x7f2ea0150b40 2023-11-28T20:38:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.753+0000 7f2e9cff9640 1 -- 172.21.15.167:0/387349207 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2e9800acd0 con 0x7f2ea0150b40 2023-11-28T20:38:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.753+0000 7f2e9cff9640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2e8c066470 0x7f2e8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.753+0000 7f2e9cff9640 1 -- 172.21.15.167:0/387349207 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f2e980838e0 con 0x7f2ea0150b40 2023-11-28T20:38:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.753+0000 7f2e9ffff640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2e8c066470 0x7f2e8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.753+0000 7f2e9ffff640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2e8c066470 0x7f2e8c068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e900ad000 tx=0x7f2e90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.757+0000 7f2e9cff9640 1 -- 172.21.15.167:0/387349207 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2e98050ab0 con 0x7f2ea0150b40 2023-11-28T20:38:23.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:23.949+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f2ea0146520 con 0x7f2ea0150b40 2023-11-28T20:38:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2e9cff9640 1 -- 172.21.15.167:0/387349207 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2ea0146520 con 0x7f2ea0150b40 2023-11-28T20:38:24.559 INFO:teuthology.orchestra.run.smithi167.stderr:added data pool 4 to fsmap 2023-11-28T20:38:24.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2e8c066470 msgr2=0x7f2e8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:24.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2e8c066470 0x7f2e8c068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e900ad000 tx=0x7f2e90008040 comp rx=0 tx=0).stop 2023-11-28T20:38:24.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea0150b40 msgr2=0x7f2ea0146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:24.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea0150b40 0x7f2ea0146d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c7b0 tx=0x7f2e9800cc70 comp rx=0 tx=0).stop 2023-11-28T20:38:24.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 shutdown_connections 2023-11-28T20:38:24.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2e8c066470 0x7f2e8c068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ea0150b40 0x7f2ea0146d40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ea00c6ff0 0x7f2ea0146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 --2- 172.21.15.167:0/387349207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ea00c5be0 0x7f2ea015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 >> 172.21.15.167:0/387349207 conn(0x7f2ea00cb1e0 msgr2=0x7f2ea00c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:24.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 shutdown_connections 2023-11-28T20:38:24.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.557+0000 7f2ea6679640 1 -- 172.21.15.167:0/387349207 wait complete. 2023-11-28T20:38:24.582 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:38:24.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f452fd640 1 Processor -- start 2023-11-28T20:38:24.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f452fd640 1 -- start start 2023-11-28T20:38:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f452fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f4006e030 0x7f2f401500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f452fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f401571d0 con 0x7f2f40070480 2023-11-28T20:38:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f452fd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f40071a90 con 0x7f2f40072630 2023-11-28T20:38:24.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f452fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f400c70d0 con 0x7f2f4006e030 2023-11-28T20:38:24.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f367fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2f40070480 0x7f2f40071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34006/0 (socket says 172.21.15.167:34006) 2023-11-28T20:38:24.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f367fc640 1 -- 172.21.15.167:0/1234392994 learned_addr learned my addr 172.21.15.167:0/1234392994 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:24.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f3effd640 1 --2- 172.21.15.167:0/1234392994 >> v2:172.21.15.167:3300/0 conn(0x7f2f4006e030 0x7f2f401500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f3e7fc640 1 -- 172.21.15.167:0/1234392994 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740547287 0 0) 0x7f2f401571d0 con 0x7f2f40070480 2023-11-28T20:38:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f3e7fc640 1 -- 172.21.15.167:0/1234392994 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f2c003530 con 0x7f2f40070480 2023-11-28T20:38:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f3effd640 1 -- 172.21.15.167:0/1234392994 >> v1:172.21.15.178:6789/0 conn(0x7f2f40072630 legacy=0x7f2f40160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f3effd640 1 -- 172.21.15.167:0/1234392994 >> v1:172.21.15.167:6789/0 conn(0x7f2f40070480 legacy=0x7f2f40071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.717+0000 7f2f3effd640 1 -- 172.21.15.167:0/1234392994 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f400c73b0 con 0x7f2f4006e030 2023-11-28T20:38:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f3effd640 1 --2- 172.21.15.167:0/1234392994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f4006e030 0x7f2f401500b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f300097c0 tx=0x7f2f3001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e30a152bc9d929e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f3e7fc640 1 -- 172.21.15.167:0/1234392994 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f300ab650 con 0x7f2f4006e030 2023-11-28T20:38:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f3e7fc640 1 -- 172.21.15.167:0/1234392994 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f300ab7b0 con 0x7f2f4006e030 2023-11-28T20:38:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f3e7fc640 1 -- 172.21.15.167:0/1234392994 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f300abb40 con 0x7f2f4006e030 2023-11-28T20:38:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f452fd640 1 -- 172.21.15.167:0/1234392994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f4006e030 msgr2=0x7f2f401500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f452fd640 1 --2- 172.21.15.167:0/1234392994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f4006e030 0x7f2f401500b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f300097c0 tx=0x7f2f3001c450 comp rx=0 tx=0).stop 2023-11-28T20:38:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f452fd640 1 -- 172.21.15.167:0/1234392994 shutdown_connections 2023-11-28T20:38:24.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f452fd640 1 --2- 172.21.15.167:0/1234392994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f4006e030 0x7f2f401500b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f452fd640 1 -- 172.21.15.167:0/1234392994 >> 172.21.15.167:0/1234392994 conn(0x7f2f400cb1e0 msgr2=0x7f2f400cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f452fd640 1 -- 172.21.15.167:0/1234392994 shutdown_connections 2023-11-28T20:38:24.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.721+0000 7f2f452fd640 1 -- 172.21.15.167:0/1234392994 wait complete. 2023-11-28T20:38:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f452fd640 1 Processor -- start 2023-11-28T20:38:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f452fd640 1 -- start start 2023-11-28T20:38:24.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f452fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f4006e030 0x7f2f401578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:24.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f452fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f40070480 0x7f2f40146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:24.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f452fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f40072630 0x7f2f40147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:24.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f452fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4014ab70 con 0x7f2f40072630 2023-11-28T20:38:24.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f452fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f401ea0d0 con 0x7f2f40070480 2023-11-28T20:38:24.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f452fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40147830 con 0x7f2f4006e030 2023-11-28T20:38:24.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f40072630 0x7f2f40147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f40072630 0x7f2f40147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53840/0 (socket says 172.21.15.167:53840) 2023-11-28T20:38:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3f7fe640 1 -- 172.21.15.167:0/1363658936 learned_addr learned my addr 172.21.15.167:0/1363658936 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3effd640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f4006e030 0x7f2f401578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f367fc640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f40070480 0x7f2f40146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3f7fe640 1 -- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f4006e030 msgr2=0x7f2f401578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:24.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3f7fe640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f4006e030 0x7f2f401578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3f7fe640 1 -- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f40070480 msgr2=0x7f2f40146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3f7fe640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f40070480 0x7f2f40146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3f7fe640 1 -- 172.21.15.167:0/1363658936 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30009420 con 0x7f2f40072630 2023-11-28T20:38:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.725+0000 7f2f3f7fe640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f40072630 0x7f2f40147fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800c430 tx=0x7f2f3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f37fff640 1 -- 172.21.15.167:0/1363658936 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f380052d0 con 0x7f2f40072630 2023-11-28T20:38:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f37fff640 1 -- 172.21.15.167:0/1363658936 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f38005430 con 0x7f2f40072630 2023-11-28T20:38:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f40147b10 con 0x7f2f40072630 2023-11-28T20:38:24.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f37fff640 1 -- 172.21.15.167:0/1363658936 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38003800 con 0x7f2f40072630 2023-11-28T20:38:24.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f401f1510 con 0x7f2f40072630 2023-11-28T20:38:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f400682c0 con 0x7f2f40072630 2023-11-28T20:38:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f37fff640 1 -- 172.21.15.167:0/1363658936 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f38003960 con 0x7f2f40072630 2023-11-28T20:38:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f37fff640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f20066470 0x7f2f20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f37fff640 1 -- 172.21.15.167:0/1363658936 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f38083680 con 0x7f2f40072630 2023-11-28T20:38:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.729+0000 7f2f3effd640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f20066470 0x7f2f20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:24.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.733+0000 7f2f3effd640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f20066470 0x7f2f20068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f300af000 tx=0x7f2f300a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:24.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.733+0000 7f2f37fff640 1 -- 172.21.15.167:0/1363658936 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f38050790 con 0x7f2f40072630 2023-11-28T20:38:24.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.920+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f40147ca0 con 0x7f2f40072630 2023-11-28T20:38:24.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.920+0000 7f2f37fff640 1 -- 172.21.15.167:0/1363658936 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+6507 (secure 0 0 0) 0x7f2f38053db0 con 0x7f2f40072630 2023-11-28T20:38:24.925 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:24.925 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1234930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1234930245},{"type":"v1","addr":"172.21.15.167:6837","nonce":1234930245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T20:38:24.536940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-28T20:38:24.925 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 6 2023-11-28T20:38:24.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.920+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f20066470 msgr2=0x7f2f20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:24.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.920+0000 7f2f452fd640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f20066470 0x7f2f20068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f300af000 tx=0x7f2f300a7000 comp rx=0 tx=0).stop 2023-11-28T20:38:24.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.920+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f40072630 msgr2=0x7f2f40147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.920+0000 7f2f452fd640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f40072630 0x7f2f40147fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800c430 tx=0x7f2f3800c8f0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.920+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 shutdown_connections 2023-11-28T20:38:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.920+0000 7f2f452fd640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f20066470 0x7f2f20068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.924+0000 7f2f452fd640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f40072630 0x7f2f40147fa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.924+0000 7f2f452fd640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f40070480 0x7f2f40146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.924+0000 7f2f452fd640 1 --2- 172.21.15.167:0/1363658936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f4006e030 0x7f2f401578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.924+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 >> 172.21.15.167:0/1363658936 conn(0x7f2f400cb1e0 msgr2=0x7f2f400c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.924+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 shutdown_connections 2023-11-28T20:38:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:24.924+0000 7f2f452fd640 1 -- 172.21.15.167:0/1363658936 wait complete. 2023-11-28T20:38:24.945 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1be52a640 1 Processor -- start 2023-11-28T20:38:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1be52a640 1 -- start start 2023-11-28T20:38:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1be52a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1b80cf860 0x7fb1b80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1be52a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb1b80cfc40 0x7fb1b80ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1be52a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b815ac00 con 0x7fb1b8153ae0 2023-11-28T20:38:25.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1be52a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b80cbd60 con 0x7fb1b80cf860 2023-11-28T20:38:25.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1be52a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b8159ff0 con 0x7fb1b80cfc40 2023-11-28T20:38:25.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1b7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1b80cf860 0x7fb1b80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1bcac7640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb1b8153ae0 0x7fb1b815d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34008/0 (socket says 172.21.15.167:34008) 2023-11-28T20:38:25.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1bcac7640 1 -- 172.21.15.167:0/3434846364 learned_addr learned my addr 172.21.15.167:0/3434846364 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:25.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1b77fe640 1 --2- 172.21.15.167:0/3434846364 >> v2:172.21.15.178:3300/0 conn(0x7fb1b80cfc40 0x7fb1b80ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1b7fff640 1 -- 172.21.15.167:0/3434846364 >> v2:172.21.15.178:3300/0 conn(0x7fb1b80cfc40 msgr2=0x7fb1b80ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:25.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1b7fff640 1 --2- 172.21.15.167:0/3434846364 >> v2:172.21.15.178:3300/0 conn(0x7fb1b80cfc40 0x7fb1b80ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1b7fff640 1 -- 172.21.15.167:0/3434846364 >> v1:172.21.15.167:6789/0 conn(0x7fb1b8153ae0 legacy=0x7fb1b815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1b7fff640 1 -- 172.21.15.167:0/3434846364 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b815a2d0 con 0x7fb1b80cf860 2023-11-28T20:38:25.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.080+0000 7fb1b6ffd640 1 -- 172.21.15.167:0/3434846364 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881946410 0 0) 0x7fb1b815ac00 con 0x7fb1b8153ae0 2023-11-28T20:38:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1b7fff640 1 --2- 172.21.15.167:0/3434846364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cf860 0x7fb1b80cb770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80c9c50 tx=0x7fb1a801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fedde2fd3762276 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:25.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1b6ffd640 1 -- 172.21.15.167:0/3434846364 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80a7070 con 0x7fb1b80cf860 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1b6ffd640 1 -- 172.21.15.167:0/3434846364 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a80ab430 con 0x7fb1b80cf860 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1b6ffd640 1 -- 172.21.15.167:0/3434846364 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80ab7c0 con 0x7fb1b80cf860 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1be52a640 1 -- 172.21.15.167:0/3434846364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cf860 msgr2=0x7fb1b80cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1be52a640 1 --2- 172.21.15.167:0/3434846364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cf860 0x7fb1b80cb770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80c9c50 tx=0x7fb1a801c430 comp rx=0 tx=0).stop 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1be52a640 1 -- 172.21.15.167:0/3434846364 shutdown_connections 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1be52a640 1 --2- 172.21.15.167:0/3434846364 >> v2:172.21.15.178:3300/0 conn(0x7fb1b80cfc40 0x7fb1b80ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1be52a640 1 --2- 172.21.15.167:0/3434846364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cf860 0x7fb1b80cb770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1be52a640 1 -- 172.21.15.167:0/3434846364 >> 172.21.15.167:0/3434846364 conn(0x7fb1b806c1f0 msgr2=0x7fb1b8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1be52a640 1 -- 172.21.15.167:0/3434846364 shutdown_connections 2023-11-28T20:38:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.084+0000 7fb1be52a640 1 -- 172.21.15.167:0/3434846364 wait complete. 2023-11-28T20:38:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 Processor -- start 2023-11-28T20:38:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 -- start start 2023-11-28T20:38:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b80cf860 0x7fb1b81f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cfc40 0x7fb1b8154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b8153ae0 0x7fb1b8158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b81f3280 con 0x7fb1b80cfc40 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8150e00 con 0x7fb1b80cf860 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8150610 con 0x7fb1b8153ae0 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cfc40 0x7fb1b8154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cfc40 0x7fb1b8154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53854/0 (socket says 172.21.15.167:53854) 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b77fe640 1 -- 172.21.15.167:0/2682206732 learned_addr learned my addr 172.21.15.167:0/2682206732 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b7fff640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b80cf860 0x7fb1b81f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1bcac7640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b8153ae0 0x7fb1b8158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b77fe640 1 -- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b8153ae0 msgr2=0x7fb1b8158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b77fe640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b8153ae0 0x7fb1b8158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b77fe640 1 -- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b80cf860 msgr2=0x7fb1b81f7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b77fe640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b80cf860 0x7fb1b81f7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b77fe640 1 -- 172.21.15.167:0/2682206732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8009420 con 0x7fb1b80cfc40 2023-11-28T20:38:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b77fe640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cfc40 0x7fb1b8154590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00d830 tx=0x7fb1ac00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b4ff9640 1 -- 172.21.15.167:0/2682206732 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00b6c0 con 0x7fb1b80cfc40 2023-11-28T20:38:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b4ff9640 1 -- 172.21.15.167:0/2682206732 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00b820 con 0x7fb1b80cfc40 2023-11-28T20:38:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1b4ff9640 1 -- 172.21.15.167:0/2682206732 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00bb90 con 0x7fb1b80cfc40 2023-11-28T20:38:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b81f7740 con 0x7fb1b80cfc40 2023-11-28T20:38:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.088+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b8154ad0 con 0x7fb1b80cfc40 2023-11-28T20:38:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.092+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b8075c90 con 0x7fb1b80cfc40 2023-11-28T20:38:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.092+0000 7fb1b4ff9640 1 -- 172.21.15.167:0/2682206732 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1ac01e460 con 0x7fb1b80cfc40 2023-11-28T20:38:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.092+0000 7fb1b4ff9640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1a40664a0 0x7fb1a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.092+0000 7fb1b4ff9640 1 -- 172.21.15.167:0/2682206732 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1ac084870 con 0x7fb1b80cfc40 2023-11-28T20:38:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.092+0000 7fb1b7fff640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1a40664a0 0x7fb1a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.092+0000 7fb1b7fff640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1a40664a0 0x7fb1a4068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80af000 tx=0x7fb1a80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:25.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.096+0000 7fb1b4ff9640 1 -- 172.21.15.167:0/2682206732 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1ac0518d0 con 0x7fb1b80cfc40 2023-11-28T20:38:25.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.248+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1b81f7740 con 0x7fb1b80cfc40 2023-11-28T20:38:25.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.248+0000 7fb1b4ff9640 1 -- 172.21.15.167:0/2682206732 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7fb1b81f7740 con 0x7fb1b80cfc40 2023-11-28T20:38:25.253 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:25.253 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:25.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1a40664a0 msgr2=0x7fb1a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1a40664a0 0x7fb1a4068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80af000 tx=0x7fb1a80a7000 comp rx=0 tx=0).stop 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cfc40 msgr2=0x7fb1b8154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cfc40 0x7fb1b8154590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00d830 tx=0x7fb1ac00dcf0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 shutdown_connections 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1a40664a0 0x7fb1a4068960 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b8153ae0 0x7fb1b8158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1b80cfc40 0x7fb1b8154590 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 --2- 172.21.15.167:0/2682206732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b80cf860 0x7fb1b81f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 >> 172.21.15.167:0/2682206732 conn(0x7fb1b806c1f0 msgr2=0x7fb1b815d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 shutdown_connections 2023-11-28T20:38:25.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.252+0000 7fb1be52a640 1 -- 172.21.15.167:0/2682206732 wait complete. 2023-11-28T20:38:25.274 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7fabb12fe640 1 Processor -- start 2023-11-28T20:38:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7fabb12fe640 1 -- start start 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7fabb12fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fabac0cfc40 0x7fabac0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7fabb12fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 0x7fabac153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7fabb12fe640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabac15ac00 con 0x7fabac0cf860 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7fabb12fe640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabac0cbd60 con 0x7fabac0cfc40 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7fabb12fe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac159ff0 con 0x7fabac153ae0 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7faba27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fabac0cfc40 0x7fabac0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7faba27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fabac0cfc40 0x7fabac0cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53862/0 (socket says 172.21.15.167:53862) 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7faba27fc640 1 -- 172.21.15.167:0/1110824622 learned_addr learned my addr 172.21.15.167:0/1110824622 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7fabab7fe640 1 --2- 172.21.15.167:0/1110824622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 0x7fabac153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7faba27fc640 1 -- 172.21.15.167:0/1110824622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 msgr2=0x7fabac153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:25.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7faba27fc640 1 --2- 172.21.15.167:0/1110824622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 0x7fabac153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7faba27fc640 1 -- 172.21.15.167:0/1110824622 >> v1:172.21.15.178:6789/0 conn(0x7fabac0cf860 legacy=0x7fabac0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7faba27fc640 1 -- 172.21.15.167:0/1110824622 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac15a2d0 con 0x7fabac0cfc40 2023-11-28T20:38:25.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.408+0000 7fabab7fe640 1 --2- 172.21.15.167:0/1110824622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 0x7fabac153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:25.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7faba27fc640 1 --2- 172.21.15.167:0/1110824622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 0x7fabac0cb770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab94009870 tx=0x7fab9401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883a3c6badc2d0da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:25.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabaa7fc640 1 -- 172.21.15.167:0/1110824622 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940a9400 con 0x7fabac0cfc40 2023-11-28T20:38:25.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabaa7fc640 1 -- 172.21.15.167:0/1110824622 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940a9560 con 0x7fabac0cfc40 2023-11-28T20:38:25.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabaa7fc640 1 -- 172.21.15.167:0/1110824622 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940a98f0 con 0x7fabac0cfc40 2023-11-28T20:38:25.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabb12fe640 1 -- 172.21.15.167:0/1110824622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 msgr2=0x7fabac0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabb12fe640 1 --2- 172.21.15.167:0/1110824622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 0x7fabac0cb770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab94009870 tx=0x7fab9401c540 comp rx=0 tx=0).stop 2023-11-28T20:38:25.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabb12fe640 1 -- 172.21.15.167:0/1110824622 shutdown_connections 2023-11-28T20:38:25.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabb12fe640 1 --2- 172.21.15.167:0/1110824622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 0x7fabac153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabb12fe640 1 --2- 172.21.15.167:0/1110824622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 0x7fabac0cb770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabb12fe640 1 -- 172.21.15.167:0/1110824622 >> 172.21.15.167:0/1110824622 conn(0x7fabac06c1f0 msgr2=0x7fabac071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:25.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabb12fe640 1 -- 172.21.15.167:0/1110824622 shutdown_connections 2023-11-28T20:38:25.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.412+0000 7fabb12fe640 1 -- 172.21.15.167:0/1110824622 wait complete. 2023-11-28T20:38:25.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 Processor -- start 2023-11-28T20:38:25.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 -- start start 2023-11-28T20:38:25.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac0cf860 0x7fabac15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 0x7fabac157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 0x7fabac159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac15ce50 con 0x7fabac0cfc40 2023-11-28T20:38:25.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac15b250 con 0x7fabac0cf860 2023-11-28T20:38:25.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac13ecb0 con 0x7fabac153ae0 2023-11-28T20:38:25.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 0x7fabac157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 0x7fabac157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53872/0 (socket says 172.21.15.167:53872) 2023-11-28T20:38:25.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba27fc640 1 -- 172.21.15.167:0/1353901223 learned_addr learned my addr 172.21.15.167:0/1353901223 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:25.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabab7fe640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 0x7fabac159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabaaffd640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac0cf860 0x7fabac15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba27fc640 1 -- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 msgr2=0x7fabac159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba27fc640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 0x7fabac159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba27fc640 1 -- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac0cf860 msgr2=0x7fabac15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba27fc640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac0cf860 0x7fabac15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba27fc640 1 -- 172.21.15.167:0/1353901223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab940094d0 con 0x7fabac0cfc40 2023-11-28T20:38:25.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba27fc640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 0x7fabac157b50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab9401abf0 tx=0x7fab9401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:25.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba3fff640 1 -- 172.21.15.167:0/1353901223 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940bc450 con 0x7fabac0cfc40 2023-11-28T20:38:25.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba3fff640 1 -- 172.21.15.167:0/1353901223 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940bc5d0 con 0x7fabac0cfc40 2023-11-28T20:38:25.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7faba3fff640 1 -- 172.21.15.167:0/1353901223 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940bc980 con 0x7fabac0cfc40 2023-11-28T20:38:25.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac15af70 con 0x7fabac0cfc40 2023-11-28T20:38:25.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.416+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac13e9d0 con 0x7fabac0cfc40 2023-11-28T20:38:25.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.420+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac15c510 con 0x7fabac0cfc40 2023-11-28T20:38:25.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.420+0000 7faba3fff640 1 -- 172.21.15.167:0/1353901223 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab940bcae0 con 0x7fabac0cfc40 2023-11-28T20:38:25.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.420+0000 7faba3fff640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab8c0664a0 0x7fab8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.420+0000 7faba3fff640 1 -- 172.21.15.167:0/1353901223 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab9411e490 con 0x7fabac0cfc40 2023-11-28T20:38:25.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.420+0000 7fabaaffd640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab8c0664a0 0x7fab8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.420+0000 7fabaaffd640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab8c0664a0 0x7fab8c068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0012f0 tx=0x7fab9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:25.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.424+0000 7faba3fff640 1 -- 172.21.15.167:0/1353901223 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab940eb750 con 0x7fabac0cfc40 2023-11-28T20:38:25.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.576+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabac075c90 con 0x7fabac0cfc40 2023-11-28T20:38:25.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.576+0000 7faba3fff640 1 -- 172.21.15.167:0/1353901223 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7fab940eed70 con 0x7fabac0cfc40 2023-11-28T20:38:25.581 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:25.582 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab8c0664a0 msgr2=0x7fab8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab8c0664a0 0x7fab8c068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0012f0 tx=0x7fab9c009040 comp rx=0 tx=0).stop 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 msgr2=0x7fabac157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 0x7fabac157b50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab9401abf0 tx=0x7fab9401ad80 comp rx=0 tx=0).stop 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 shutdown_connections 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab8c0664a0 0x7fab8c068960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabac153ae0 0x7fabac159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabac0cfc40 0x7fabac157b50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 --2- 172.21.15.167:0/1353901223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabac0cf860 0x7fabac15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 >> 172.21.15.167:0/1353901223 conn(0x7fabac06c1f0 msgr2=0x7fabac0ce360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 shutdown_connections 2023-11-28T20:38:25.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.580+0000 7fabb12fe640 1 -- 172.21.15.167:0/1353901223 wait complete. 2023-11-28T20:38:25.617 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:38:25.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.752+0000 7fbae349e640 1 Processor -- start 2023-11-28T20:38:25.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.752+0000 7fbae349e640 1 -- start start 2023-11-28T20:38:25.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae349e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc150b40 0x7fbadc157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae349e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbadc0c6ff0 0x7fbadc0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae349e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbadc0c6ac0 con 0x7fbadc0c5be0 2023-11-28T20:38:25.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae349e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbadc0c6500 con 0x7fbadc0c6ff0 2023-11-28T20:38:25.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae349e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc0c67e0 con 0x7fbadc150b40 2023-11-28T20:38:25.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae0a39640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbadc0c6ff0 0x7fbadc0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae1a3b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbadc0c5be0 0x7fbadc06a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34022/0 (socket says 172.21.15.167:34022) 2023-11-28T20:38:25.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae1a3b640 1 -- 172.21.15.167:0/3052237539 learned_addr learned my addr 172.21.15.167:0/3052237539 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:25.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae123a640 1 --2- 172.21.15.167:0/3052237539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc150b40 0x7fbadc157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae0a39640 1 -- 172.21.15.167:0/3052237539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc150b40 msgr2=0x7fbadc157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:25.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae0a39640 1 --2- 172.21.15.167:0/3052237539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc150b40 0x7fbadc157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae0a39640 1 -- 172.21.15.167:0/3052237539 >> v1:172.21.15.167:6789/0 conn(0x7fbadc0c5be0 legacy=0x7fbadc06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae0a39640 1 -- 172.21.15.167:0/3052237539 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc156a80 con 0x7fbadc0c6ff0 2023-11-28T20:38:25.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbae123a640 1 --2- 172.21.15.167:0/3052237539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc150b40 0x7fbadc157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:25.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.756+0000 7fbad3fff640 1 -- 172.21.15.167:0/3052237539 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425365567 0 0) 0x7fbadc0c6ac0 con 0x7fbadc0c5be0 2023-11-28T20:38:25.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae0a39640 1 --2- 172.21.15.167:0/3052237539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c6ff0 0x7fbadc0c4510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0097c0 tx=0x7fbacc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6256931cbda09a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:25.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbad3fff640 1 -- 172.21.15.167:0/3052237539 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0ab650 con 0x7fbadc0c6ff0 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbad3fff640 1 -- 172.21.15.167:0/3052237539 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc0ab7b0 con 0x7fbadc0c6ff0 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbad3fff640 1 -- 172.21.15.167:0/3052237539 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0abb40 con 0x7fbadc0c6ff0 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 -- 172.21.15.167:0/3052237539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c6ff0 msgr2=0x7fbadc0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 --2- 172.21.15.167:0/3052237539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c6ff0 0x7fbadc0c4510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0097c0 tx=0x7fbacc01c450 comp rx=0 tx=0).stop 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 -- 172.21.15.167:0/3052237539 shutdown_connections 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 --2- 172.21.15.167:0/3052237539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c6ff0 0x7fbadc0c4510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 --2- 172.21.15.167:0/3052237539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc150b40 0x7fbadc157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 -- 172.21.15.167:0/3052237539 >> 172.21.15.167:0/3052237539 conn(0x7fbadc0cb1e0 msgr2=0x7fbadc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 -- 172.21.15.167:0/3052237539 shutdown_connections 2023-11-28T20:38:25.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 -- 172.21.15.167:0/3052237539 wait complete. 2023-11-28T20:38:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 Processor -- start 2023-11-28T20:38:25.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.760+0000 7fbae349e640 1 -- start start 2023-11-28T20:38:25.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae349e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c5be0 0x7fbadc143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae349e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc0c6ff0 0x7fbadc1447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae349e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbadc150b40 0x7fbadc13e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae349e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc142c10 con 0x7fbadc0c5be0 2023-11-28T20:38:25.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae349e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc142790 con 0x7fbadc150b40 2023-11-28T20:38:25.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae349e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc142e40 con 0x7fbadc0c6ff0 2023-11-28T20:38:25.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae123a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c5be0 0x7fbadc143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae123a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c5be0 0x7fbadc143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53882/0 (socket says 172.21.15.167:53882) 2023-11-28T20:38:25.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae123a640 1 -- 172.21.15.167:0/3351491082 learned_addr learned my addr 172.21.15.167:0/3351491082 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:25.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae0a39640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc0c6ff0 0x7fbadc1447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae1a3b640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbadc150b40 0x7fbadc13e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae123a640 1 -- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc0c6ff0 msgr2=0x7fbadc1447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae123a640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc0c6ff0 0x7fbadc1447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae123a640 1 -- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbadc150b40 msgr2=0x7fbadc13e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae123a640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbadc150b40 0x7fbadc13e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae123a640 1 -- 172.21.15.167:0/3351491082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc009420 con 0x7fbadc0c5be0 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae0a39640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc0c6ff0 0x7fbadc1447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae123a640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c5be0 0x7fbadc143af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbad800d800 tx=0x7fbad800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbad1ffb640 1 -- 172.21.15.167:0/3351491082 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800b6c0 con 0x7fbadc0c5be0 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbad1ffb640 1 -- 172.21.15.167:0/3351491082 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800b820 con 0x7fbadc0c5be0 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbadc1607c0 con 0x7fbadc0c5be0 2023-11-28T20:38:25.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbad1ffb640 1 -- 172.21.15.167:0/3351491082 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800bbd0 con 0x7fbadc0c5be0 2023-11-28T20:38:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbadc160a60 con 0x7fbadc0c5be0 2023-11-28T20:38:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbadc0682c0 con 0x7fbadc0c5be0 2023-11-28T20:38:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.764+0000 7fbad1ffb640 1 -- 172.21.15.167:0/3351491082 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbad800bd30 con 0x7fbadc0c5be0 2023-11-28T20:38:25.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.768+0000 7fbad1ffb640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbac00664a0 0x7fbac0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.768+0000 7fbad1ffb640 1 -- 172.21.15.167:0/3351491082 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbad8084740 con 0x7fbadc0c5be0 2023-11-28T20:38:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.768+0000 7fbae0a39640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbac00664a0 0x7fbac0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:25.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.768+0000 7fbae0a39640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbac00664a0 0x7fbac0068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0af000 tx=0x7fbacc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:25.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.772+0000 7fbad1ffb640 1 -- 172.21.15.167:0/3351491082 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbad8051830 con 0x7fbadc0c5be0 2023-11-28T20:38:25.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.948+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbadc075c90 con 0x7fbadc0c5be0 2023-11-28T20:38:25.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbad1ffb640 1 -- 172.21.15.167:0/3351491082 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+6507 (secure 0 0 0) 0x7fbad8054e50 con 0x7fbadc0c5be0 2023-11-28T20:38:25.955 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:25.955 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1234930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1234930245},{"type":"v1","addr":"172.21.15.167:6837","nonce":1234930245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T20:38:24.536940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-28T20:38:25.955 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 6 2023-11-28T20:38:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbac00664a0 msgr2=0x7fbac0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbac00664a0 0x7fbac0068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0af000 tx=0x7fbacc008040 comp rx=0 tx=0).stop 2023-11-28T20:38:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c5be0 msgr2=0x7fbadc143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c5be0 0x7fbadc143af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbad800d800 tx=0x7fbad800dcc0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 shutdown_connections 2023-11-28T20:38:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbac00664a0 0x7fbac0068960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbadc150b40 0x7fbadc13e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbadc0c6ff0 0x7fbadc1447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 --2- 172.21.15.167:0/3351491082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbadc0c5be0 0x7fbadc143af0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:25.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 >> 172.21.15.167:0/3351491082 conn(0x7fbadc0cb1e0 msgr2=0x7fbadc06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:25.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 shutdown_connections 2023-11-28T20:38:25.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:25.952+0000 7fbae349e640 1 -- 172.21.15.167:0/3351491082 wait complete. 2023-11-28T20:38:25.975 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:26.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb710679640 1 Processor -- start 2023-11-28T20:38:26.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb710679640 1 -- start start 2023-11-28T20:38:26.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb710679640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 0x7fb7080c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:26.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb710679640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70815b220 con 0x7fb70806a580 2023-11-28T20:38:26.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb710679640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7080c7a20 con 0x7fb708151f60 2023-11-28T20:38:26.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb710679640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c4da0 con 0x7fb7080c75c0 2023-11-28T20:38:26.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb70ec16640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb70806a580 0x7fb7081625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34036/0 (socket says 172.21.15.167:34036) 2023-11-28T20:38:26.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb70ec16640 1 -- 172.21.15.167:0/3301904616 learned_addr learned my addr 172.21.15.167:0/3301904616 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:26.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb70dc14640 1 --2- 172.21.15.167:0/3301904616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 0x7fb7080c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:26.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.108+0000 7fb70d413640 1 -- 172.21.15.167:0/3301904616 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945342401 0 0) 0x7fb70815b220 con 0x7fb70806a580 2023-11-28T20:38:26.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70d413640 1 -- 172.21.15.167:0/3301904616 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f4003530 con 0x7fb70806a580 2023-11-28T20:38:26.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70d413640 1 -- 172.21.15.167:0/3301904616 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825413565 0 0) 0x7fb7080c7a20 con 0x7fb708151f60 2023-11-28T20:38:26.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70d413640 1 -- 172.21.15.167:0/3301904616 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70815b220 con 0x7fb708151f60 2023-11-28T20:38:26.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70dc14640 1 -- 172.21.15.167:0/3301904616 >> v1:172.21.15.178:6789/0 conn(0x7fb708151f60 legacy=0x7fb7080c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:26.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70dc14640 1 -- 172.21.15.167:0/3301904616 >> v1:172.21.15.167:6789/0 conn(0x7fb70806a580 legacy=0x7fb7081625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:26.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70dc14640 1 -- 172.21.15.167:0/3301904616 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708152340 con 0x7fb7080c75c0 2023-11-28T20:38:26.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70dc14640 1 --2- 172.21.15.167:0/3301904616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 0x7fb7080c5c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80097f0 tx=0x7fb6f801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a17a8df864281b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:26.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70d413640 1 -- 172.21.15.167:0/3301904616 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80ab600 con 0x7fb7080c75c0 2023-11-28T20:38:26.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70d413640 1 -- 172.21.15.167:0/3301904616 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80a7050 con 0x7fb7080c75c0 2023-11-28T20:38:26.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.112+0000 7fb70d413640 1 -- 172.21.15.167:0/3301904616 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80ab960 con 0x7fb7080c75c0 2023-11-28T20:38:26.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 -- 172.21.15.167:0/3301904616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 msgr2=0x7fb7080c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:26.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 --2- 172.21.15.167:0/3301904616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 0x7fb7080c5c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80097f0 tx=0x7fb6f801c430 comp rx=0 tx=0).stop 2023-11-28T20:38:26.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 -- 172.21.15.167:0/3301904616 shutdown_connections 2023-11-28T20:38:26.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 --2- 172.21.15.167:0/3301904616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 0x7fb7080c5c90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:26.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 -- 172.21.15.167:0/3301904616 >> 172.21.15.167:0/3301904616 conn(0x7fb7080cb1e0 msgr2=0x7fb7080cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:26.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 -- 172.21.15.167:0/3301904616 shutdown_connections 2023-11-28T20:38:26.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 -- 172.21.15.167:0/3301904616 wait complete. 2023-11-28T20:38:26.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 Processor -- start 2023-11-28T20:38:26.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 -- start start 2023-11-28T20:38:26.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70806a580 0x7fb708149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:26.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 0x7fb7081f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:26.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb708151f60 0x7fb708142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:26.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7081418e0 con 0x7fb708151f60 2023-11-28T20:38:26.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb708141bc0 con 0x7fb70806a580 2023-11-28T20:38:26.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb710679640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb708141ea0 con 0x7fb7080c75c0 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70ec16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb708151f60 0x7fb708142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70ec16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb708151f60 0x7fb708142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53888/0 (socket says 172.21.15.167:53888) 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70ec16640 1 -- 172.21.15.167:0/2593142723 learned_addr learned my addr 172.21.15.167:0/2593142723 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70dc14640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 0x7fb7081f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70e415640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70806a580 0x7fb708149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70ec16640 1 -- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 msgr2=0x7fb7081f0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70ec16640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 0x7fb7081f0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70ec16640 1 -- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70806a580 msgr2=0x7fb708149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70ec16640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70806a580 0x7fb708149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70ec16640 1 -- 172.21.15.167:0/2593142723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f8009420 con 0x7fb708151f60 2023-11-28T20:38:26.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.116+0000 7fb70ec16640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb708151f60 0x7fb708142c60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb70000cba0 tx=0x7fb70000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:26.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb6feffd640 1 -- 172.21.15.167:0/2593142723 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000ace0 con 0x7fb708151f60 2023-11-28T20:38:26.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb6feffd640 1 -- 172.21.15.167:0/2593142723 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000ae40 con 0x7fb708151f60 2023-11-28T20:38:26.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb6feffd640 1 -- 172.21.15.167:0/2593142723 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700012620 con 0x7fb708151f60 2023-11-28T20:38:26.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb708142180 con 0x7fb708151f60 2023-11-28T20:38:26.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb708142740 con 0x7fb708151f60 2023-11-28T20:38:26.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7080682c0 con 0x7fb708151f60 2023-11-28T20:38:26.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb6feffd640 1 -- 172.21.15.167:0/2593142723 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb700007070 con 0x7fb708151f60 2023-11-28T20:38:26.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb6feffd640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec0664a0 0x7fb6ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:26.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb6feffd640 1 -- 172.21.15.167:0/2593142723 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7000842e0 con 0x7fb708151f60 2023-11-28T20:38:26.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.120+0000 7fb70e415640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec0664a0 0x7fb6ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:26.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.124+0000 7fb70e415640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec0664a0 0x7fb6ec068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb7040015e0 tx=0x7fb704009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:26.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.124+0000 7fb6feffd640 1 -- 172.21.15.167:0/2593142723 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb700054dd0 con 0x7fb708151f60 2023-11-28T20:38:26.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.276+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb708142930 con 0x7fb708151f60 2023-11-28T20:38:26.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.276+0000 7fb6feffd640 1 -- 172.21.15.167:0/2593142723 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7fb700017090 con 0x7fb708151f60 2023-11-28T20:38:26.280 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:26.280 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:26.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.276+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec0664a0 msgr2=0x7fb6ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:26.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.276+0000 7fb710679640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec0664a0 0x7fb6ec068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb7040015e0 tx=0x7fb704009040 comp rx=0 tx=0).stop 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.276+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb708151f60 msgr2=0x7fb708142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.276+0000 7fb710679640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb708151f60 0x7fb708142c60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb70000cba0 tx=0x7fb70000a430 comp rx=0 tx=0).stop 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.280+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 shutdown_connections 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.280+0000 7fb710679640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec0664a0 0x7fb6ec068960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.280+0000 7fb710679640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb708151f60 0x7fb708142c60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.280+0000 7fb710679640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080c75c0 0x7fb7081f0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.280+0000 7fb710679640 1 --2- 172.21.15.167:0/2593142723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70806a580 0x7fb708149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.280+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 >> 172.21.15.167:0/2593142723 conn(0x7fb7080cb1e0 msgr2=0x7fb7080c5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.280+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 shutdown_connections 2023-11-28T20:38:26.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:26.280+0000 7fb710679640 1 -- 172.21.15.167:0/2593142723 wait complete. 2023-11-28T20:38:26.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T20:38:18.895715+0000', 'modified': '2023-11-28T20:38:24.536940+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.178:6839/4165916206', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6837', 'nonce': 4165916206}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 4165916206}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-28T20:38:26.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T20:38:26.905 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-28T20:38:27.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46953aa640 1 Processor -- start 2023-11-28T20:38:27.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46953aa640 1 -- start start 2023-11-28T20:38:27.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46953aa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4690151f60 0x7f46900c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46953aa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f46900c5c90 0x7f46900c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46953aa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46900c6120 con 0x7f469006a580 2023-11-28T20:38:27.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46953aa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46900c4da0 con 0x7f46900c5c90 2023-11-28T20:38:27.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46953aa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469015b220 con 0x7f4690151f60 2023-11-28T20:38:27.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46867fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f46900c5c90 0x7f46900c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46867fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f46900c5c90 0x7f46900c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53896/0 (socket says 172.21.15.167:53896) 2023-11-28T20:38:27.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46867fc640 1 -- 172.21.15.167:0/3600261218 learned_addr learned my addr 172.21.15.167:0/3600261218 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:27.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f468effd640 1 --2- 172.21.15.167:0/3600261218 >> v2:172.21.15.178:3300/0 conn(0x7f4690151f60 0x7f46900c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46867fc640 1 -- 172.21.15.167:0/3600261218 >> v2:172.21.15.178:3300/0 conn(0x7f4690151f60 msgr2=0x7f46900c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:27.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46867fc640 1 --2- 172.21.15.167:0/3600261218 >> v2:172.21.15.178:3300/0 conn(0x7f4690151f60 0x7f46900c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46867fc640 1 -- 172.21.15.167:0/3600261218 >> v1:172.21.15.178:6789/0 conn(0x7f469006a580 legacy=0x7f469006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:27.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.040+0000 7f46867fc640 1 -- 172.21.15.167:0/3600261218 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4690152340 con 0x7f46900c5c90 2023-11-28T20:38:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f46867fc640 1 --2- 172.21.15.167:0/3600261218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46900c5c90 0x7f46900c26e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f46900c62c0 tx=0x7f468001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8adaa8820a2e6f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f468e7fc640 1 -- 172.21.15.167:0/3600261218 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46800ab600 con 0x7f46900c5c90 2023-11-28T20:38:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f468e7fc640 1 -- 172.21.15.167:0/3600261218 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46800a7050 con 0x7f46900c5c90 2023-11-28T20:38:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f468e7fc640 1 -- 172.21.15.167:0/3600261218 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46800ab980 con 0x7f46900c5c90 2023-11-28T20:38:27.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f46953aa640 1 -- 172.21.15.167:0/3600261218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46900c5c90 msgr2=0x7f46900c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:27.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f46953aa640 1 --2- 172.21.15.167:0/3600261218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46900c5c90 0x7f46900c26e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f46900c62c0 tx=0x7f468001c430 comp rx=0 tx=0).stop 2023-11-28T20:38:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f46953aa640 1 -- 172.21.15.167:0/3600261218 shutdown_connections 2023-11-28T20:38:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f46953aa640 1 --2- 172.21.15.167:0/3600261218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46900c5c90 0x7f46900c26e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f46953aa640 1 --2- 172.21.15.167:0/3600261218 >> v2:172.21.15.178:3300/0 conn(0x7f4690151f60 0x7f46900c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f46953aa640 1 -- 172.21.15.167:0/3600261218 >> 172.21.15.167:0/3600261218 conn(0x7f46900cb1e0 msgr2=0x7f46900cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f46953aa640 1 -- 172.21.15.167:0/3600261218 shutdown_connections 2023-11-28T20:38:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.044+0000 7f46953aa640 1 -- 172.21.15.167:0/3600261218 wait complete. 2023-11-28T20:38:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 Processor -- start 2023-11-28T20:38:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 -- start start 2023-11-28T20:38:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469006a580 0x7f4690162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46900c5c90 0x7f469013da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4690151f60 0x7f469013df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4690145670 con 0x7f4690151f60 2023-11-28T20:38:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46901f3670 con 0x7f46900c5c90 2023-11-28T20:38:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46901f2810 con 0x7f469006a580 2023-11-28T20:38:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4690151f60 0x7f469013df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4690151f60 0x7f469013df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53906/0 (socket says 172.21.15.167:53906) 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468f7fe640 1 -- 172.21.15.167:0/647496849 learned_addr learned my addr 172.21.15.167:0/647496849 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46867fc640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46900c5c90 0x7f469013da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468effd640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469006a580 0x7f4690162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468f7fe640 1 -- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469006a580 msgr2=0x7f4690162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468f7fe640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469006a580 0x7f4690162ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468f7fe640 1 -- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46900c5c90 msgr2=0x7f469013da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468f7fe640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46900c5c90 0x7f469013da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468f7fe640 1 -- 172.21.15.167:0/647496849 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800094d0 con 0x7f4690151f60 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46867fc640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46900c5c90 0x7f469013da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f468f7fe640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4690151f60 0x7f469013df80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f468800c780 tx=0x7f468800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f4687fff640 1 -- 172.21.15.167:0/647496849 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688004b70 con 0x7f4690151f60 2023-11-28T20:38:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f4687fff640 1 -- 172.21.15.167:0/647496849 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468800ce90 con 0x7f4690151f60 2023-11-28T20:38:27.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 -- 172.21.15.167:0/647496849 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46901f2af0 con 0x7f4690151f60 2023-11-28T20:38:27.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f4687fff640 1 -- 172.21.15.167:0/647496849 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468800a850 con 0x7f4690151f60 2023-11-28T20:38:27.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.048+0000 7f46953aa640 1 -- 172.21.15.167:0/647496849 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46901f30b0 con 0x7f4690151f60 2023-11-28T20:38:27.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f4687fff640 1 -- 172.21.15.167:0/647496849 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f468800a9b0 con 0x7f4690151f60 2023-11-28T20:38:27.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f4687fff640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4670066470 0x7f4670068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f4687fff640 1 -- 172.21.15.167:0/647496849 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46880843f0 con 0x7f4690151f60 2023-11-28T20:38:27.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f468effd640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4670066470 0x7f4670068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f469870f000 1 Processor -- start 2023-11-28T20:38:27.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f469870f000 1 -- start start 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f468effd640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4670066470 0x7f4670068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f467800b930 tx=0x7f4678008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f469870f000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x55915799fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f469870f000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 0x5591579a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f469870f000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a5310 0x5591579a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f469870f000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591577ce130 con 0x55915799f930 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f469870f000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591577bb9a0 con 0x5591579a5310 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.052+0000 7f469870f000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591577b8ed0 con 0x5591579a49f0 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x55915799fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x55915799fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53922/0 (socket says 172.21.15.167:53922) 2023-11-28T20:38:27.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468effd640 1 -- 172.21.15.167:0/2335551716 learned_addr learned my addr 172.21.15.167:0/2335551716 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:27.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f46867fc640 1 --2- 172.21.15.167:0/2335551716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 0x5591579a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468f7fe640 1 --2- 172.21.15.167:0/2335551716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a5310 0x5591579a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468effd640 1 -- 172.21.15.167:0/2335551716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 msgr2=0x5591579a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:27.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468effd640 1 --2- 172.21.15.167:0/2335551716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 0x5591579a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468effd640 1 -- 172.21.15.167:0/2335551716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a5310 msgr2=0x5591579a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:27.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468effd640 1 --2- 172.21.15.167:0/2335551716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a5310 0x5591579a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468effd640 1 -- 172.21.15.167:0/2335551716 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591574ac890 con 0x55915799f930 2023-11-28T20:38:27.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f468effd640 1 --2- 172.21.15.167:0/2335551716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x55915799fd10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f467800b2d0 tx=0x7f4678012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939d09d6876ffe76 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:27.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f4684ff9640 1 -- 172.21.15.167:0/2335551716 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800b170 con 0x55915799f930 2023-11-28T20:38:27.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f4684ff9640 1 -- 172.21.15.167:0/2335551716 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4678019070 con 0x55915799f930 2023-11-28T20:38:27.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f4684ff9640 1 -- 172.21.15.167:0/2335551716 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678014de0 con 0x55915799f930 2023-11-28T20:38:27.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 -- 172.21.15.167:0/2335551716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 msgr2=0x55915799fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 --2- 172.21.15.167:0/2335551716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x55915799fd10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f467800b2d0 tx=0x7f4678012000 comp rx=0 tx=0).stop 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 -- 172.21.15.167:0/2335551716 shutdown_connections 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 --2- 172.21.15.167:0/2335551716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a5310 0x5591579a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 --2- 172.21.15.167:0/2335551716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 0x5591579a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 --2- 172.21.15.167:0/2335551716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x55915799fd10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 -- 172.21.15.167:0/2335551716 >> 172.21.15.167:0/2335551716 conn(0x5591579a07a0 msgr2=0x5591579a2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 -- 172.21.15.167:0/2335551716 shutdown_connections 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 -- 172.21.15.167:0/2335551716 wait complete. 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 -- start start 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 Processor -- start 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55915799f930 0x55915799ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 0x55915799f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579ae990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591577b47c0 con 0x5591579a5310 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55915776cbf0 con 0x55915799f930 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x559157772a90 con 0x5591579a49f0 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.056+0000 7f469870f000 10 client.0 _ll_register_callbacks cb 0x55915794f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f46867fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 0x55915799f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53938/0 (socket says 172.21.15.167:53938) 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468f7fe640 1 -- 172.21.15.167:0/3301246967 learned_addr learned my addr 172.21.15.167:0/3301246967 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:27.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468effd640 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55915799f930 0x55915799ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468f7fe640 1 -- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 msgr2=0x55915799f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:27.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468f7fe640 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 0x55915799f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468f7fe640 1 -- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55915799f930 msgr2=0x55915799ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:27.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468f7fe640 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55915799f930 0x55915799ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:27.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468f7fe640 1 -- 172.21.15.167:0/3301246967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467800e040 con 0x5591579a5310 2023-11-28T20:38:27.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468f7fe640 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579ae990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4688055130 tx=0x7f46880593b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429c3d083466073c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:27.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f466dffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-28T20:38:27.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f466dffb640 1 -- 172.21.15.167:0/3301246967 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880590b0 con 0x5591579a5310 2023-11-28T20:38:27.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f466dffb640 1 -- 172.21.15.167:0/3301246967 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4688082270 con 0x5591579a5310 2023-11-28T20:38:27.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f469870f000 1 -- 172.21.15.167:0/3301246967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559157776470 con 0x5591579a5310 2023-11-28T20:38:27.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f466dffb640 1 -- 172.21.15.167:0/3301246967 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46880518b0 con 0x5591579a5310 2023-11-28T20:38:27.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f469870f000 10 client.4419 fetch_fsmap learned FSMap version 6 2023-11-28T20:38:27.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f469870f000 1 -- 172.21.15.167:0/3301246967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x559157775190 con 0x5591579a5310 2023-11-28T20:38:27.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f466dffb640 1 -- 172.21.15.167:0/3301246967 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559157776470 con 0x5591579a5310 2023-11-28T20:38:27.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f466dffb640 1 -- 172.21.15.167:0/3301246967 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 6) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f4688019070 con 0x5591579a5310 2023-11-28T20:38:27.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f469870f000 10 client.4419 fetch_fsmap finished waiting for FSMap version 6 2023-11-28T20:38:27.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f469870f000 10 client.4419 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T20:38:27.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f469870f000 20 client.4419 populate_metadata read hostname 'smithi167' 2023-11-28T20:38:27.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f469870f000 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x5591579af6d0 0x5591579afab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:27.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f469870f000 4 client.4419 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:38:27.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f469870f000 1 -- 172.21.15.167:0/3301246967 --> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559157779b50 con 0x5591579af6d0 2023-11-28T20:38:27.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468effd640 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x5591579af6d0 0x5591579afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:27.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f466dffb640 10 client.4419 ms_handle_connect on v2:172.21.15.178:6837/4165916206 2023-11-28T20:38:27.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:27.060+0000 7f468effd640 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x5591579af6d0 0x5591579afab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca0483dfb4ccdcd0 server_cookie=49cf207f5381b404 in_seq=0 out_seq=0 2023-11-28T20:38:29.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f466dffb640 1 -- 172.21.15.167:0/3301246967 <== mds.0 v2:172.21.15.178:6837/4165916206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559157779b50 con 0x5591579af6d0 2023-11-28T20:38:29.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f466dffb640 10 client.4419 handle_command_reply: tid=0 2023-11-28T20:38:29.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 client.4419 shutdown 2023-11-28T20:38:29.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 -- 172.21.15.167:0/3301246967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 msgr2=0x5591579ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579ae990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4688055130 tx=0x7f46880593b0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 -- 172.21.15.167:0/3301246967 shutdown_connections 2023-11-28T20:38:29.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x5591579af6d0 0x5591579afab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579ae990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a49f0 0x55915799f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 --2- 172.21.15.167:0/3301246967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55915799f930 0x55915799ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f466dffb640 0 client.4419 ms_handle_reset on v2:172.21.15.178:6837/4165916206 2023-11-28T20:38:29.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 -- 172.21.15.167:0/3301246967 >> 172.21.15.167:0/3301246967 conn(0x5591579a07a0 msgr2=0x559157969ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:29.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 -- 172.21.15.167:0/3301246967 shutdown_connections 2023-11-28T20:38:29.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 1 -- 172.21.15.167:0/3301246967 wait complete. 2023-11-28T20:38:29.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.560+0000 7f469870f000 20 client.4419 trim_cache size 0 max 16384 2023-11-28T20:38:29.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.576+0000 7f469870f000 1 Processor -- start 2023-11-28T20:38:29.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.576+0000 7f469870f000 1 -- start start 2023-11-28T20:38:29.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.576+0000 7f469870f000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55915799f930 0x5591579a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.576+0000 7f469870f000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 0x5591579ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.576+0000 7f469870f000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.576+0000 7f469870f000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55915746d940 con 0x5591579a5310 2023-11-28T20:38:29.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.576+0000 7f469870f000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591577b0130 con 0x5591579a49f0 2023-11-28T20:38:29.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.576+0000 7f469870f000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55915777e2e0 con 0x55915799f930 2023-11-28T20:38:29.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53946/0 (socket says 172.21.15.167:53946) 2023-11-28T20:38:29.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468f7fe640 1 -- 172.21.15.167:0/167820182 learned_addr learned my addr 172.21.15.167:0/167820182 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:29.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f46867fc640 1 --2- 172.21.15.167:0/167820182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 0x5591579ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468effd640 1 --2- 172.21.15.167:0/167820182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55915799f930 0x5591579a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468f7fe640 1 -- 172.21.15.167:0/167820182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55915799f930 msgr2=0x5591579a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:29.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468f7fe640 1 --2- 172.21.15.167:0/167820182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55915799f930 0x5591579a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468f7fe640 1 -- 172.21.15.167:0/167820182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 msgr2=0x5591579ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:29.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468f7fe640 1 --2- 172.21.15.167:0/167820182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 0x5591579ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468f7fe640 1 -- 172.21.15.167:0/167820182 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55915775b490 con 0x5591579a5310 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f468f7fe640 1 --2- 172.21.15.167:0/167820182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579aeb80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4688054c70 tx=0x7f4688069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785413a3ce5c5d14 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f46857fa640 1 -- 172.21.15.167:0/167820182 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880518b0 con 0x5591579a5310 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f46857fa640 1 -- 172.21.15.167:0/167820182 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4688082270 con 0x5591579a5310 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f46857fa640 1 -- 172.21.15.167:0/167820182 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880590b0 con 0x5591579a5310 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 -- 172.21.15.167:0/167820182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 msgr2=0x5591579aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 --2- 172.21.15.167:0/167820182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579aeb80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4688054c70 tx=0x7f4688069000 comp rx=0 tx=0).stop 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 -- 172.21.15.167:0/167820182 shutdown_connections 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 --2- 172.21.15.167:0/167820182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591579a5310 0x5591579aeb80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 --2- 172.21.15.167:0/167820182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 0x5591579ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 --2- 172.21.15.167:0/167820182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55915799f930 0x5591579a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 -- 172.21.15.167:0/167820182 >> 172.21.15.167:0/167820182 conn(0x5591579a07a0 msgr2=0x5591579b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:29.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 -- 172.21.15.167:0/167820182 shutdown_connections 2023-11-28T20:38:29.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 -- 172.21.15.167:0/167820182 wait complete. 2023-11-28T20:38:29.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 -- start start 2023-11-28T20:38:29.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.580+0000 7f469870f000 1 Processor -- start 2023-11-28T20:38:29.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x559157a04220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 0x559157a04760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a5310 0x5591579662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591577f6140 con 0x55915799f930 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55915783bfa0 con 0x5591579a49f0 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591577b1fd0 con 0x5591579a5310 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 10 client.0 _ll_register_callbacks cb 0x55915792fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x559157a04220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x559157a04220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53952/0 (socket says 172.21.15.167:53952) 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468effd640 1 -- 172.21.15.167:0/2437148913 learned_addr learned my addr 172.21.15.167:0/2437148913 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f46867fc640 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 0x559157a04760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468f7fe640 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a5310 0x5591579662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468effd640 1 -- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a5310 msgr2=0x5591579662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:29.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468effd640 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a5310 0x5591579662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468effd640 1 -- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 msgr2=0x559157a04760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:29.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468effd640 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 0x559157a04760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468effd640 1 -- 172.21.15.167:0/2437148913 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559157775190 con 0x55915799f930 2023-11-28T20:38:29.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f468effd640 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x559157a04220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4678021000 tx=0x7f4678004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b185d0104a29598e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:29.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f466dffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-28T20:38:29.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f466dffb640 1 -- 172.21.15.167:0/2437148913 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467802f040 con 0x55915799f930 2023-11-28T20:38:29.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f466dffb640 1 -- 172.21.15.167:0/2437148913 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4678035380 con 0x55915799f930 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 -- 172.21.15.167:0/2437148913 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591577b3110 con 0x55915799f930 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f466dffb640 1 -- 172.21.15.167:0/2437148913 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4678035540 con 0x55915799f930 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 10 client.4425 fetch_fsmap learned FSMap version 6 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 -- 172.21.15.167:0/2437148913 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5591574accc0 con 0x55915799f930 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f466dffb640 1 -- 172.21.15.167:0/2437148913 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5591577b3110 con 0x55915799f930 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f466dffb640 1 -- 172.21.15.167:0/2437148913 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 6) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f46780356a0 con 0x55915799f930 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 10 client.4425 fetch_fsmap finished waiting for FSMap version 6 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 10 client.4425 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 20 client.4425 populate_metadata read hostname 'smithi167' 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x559157a11710 0x559157966df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 4 client.4425 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f469870f000 1 -- 172.21.15.167:0/2437148913 --> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5591577e29a0 con 0x559157a11710 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.584+0000 7f46867fc640 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x559157a11710 0x559157966df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46867fc640 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x559157a11710 0x559157966df0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43621220a9a12a9c server_cookie=ce657b7f978b558e in_seq=0 out_seq=0 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f466dffb640 10 client.4425 ms_handle_connect on v2:172.21.15.178:6837/4165916206 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f466dffb640 1 -- 172.21.15.167:0/2437148913 <== mds.0 v2:172.21.15.178:6837/4165916206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5591577e29a0 con 0x559157a11710 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f466dffb640 10 client.4425 handle_command_reply: tid=0 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 client.4425 shutdown 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46867fc640 1 -- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x559157a11710 msgr2=0x559157966df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46867fc640 1 -- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x559157a11710 msgr2=0x559157966df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46867fc640 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x559157a11710 0x559157966df0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46867fc640 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x559157a11710 0x559157966df0 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2023-11-28T20:38:29.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 -- 172.21.15.167:0/2437148913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 msgr2=0x559157a04220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x559157a04220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4678021000 tx=0x7f4678004740 comp rx=0 tx=0).stop 2023-11-28T20:38:29.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 -- 172.21.15.167:0/2437148913 shutdown_connections 2023-11-28T20:38:29.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x559157a11710 0x559157966df0 unknown :-1 s=START_CONNECT pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5591579a5310 0x5591579662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5591579a49f0 0x559157a04760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f466dffb640 0 client.4425 ms_handle_reset on v2:172.21.15.178:6837/4165916206 2023-11-28T20:38:29.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 --2- 172.21.15.167:0/2437148913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55915799f930 0x559157a04220 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 -- 172.21.15.167:0/2437148913 >> 172.21.15.167:0/2437148913 conn(0x5591579a07a0 msgr2=0x5591579a3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:29.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 -- 172.21.15.167:0/2437148913 shutdown_connections 2023-11-28T20:38:29.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 1 -- 172.21.15.167:0/2437148913 wait complete. 2023-11-28T20:38:29.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f469870f000 20 client.4425 trim_cache size 0 max 16384 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout: "cluster_fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout: "whoami": 0, 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4279, 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout: "want_state": "up:active", 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "up:active", 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs", 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout: "rank_uptime": 10.076693048999999, 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsmap_epoch": 5, 2023-11-28T20:38:29.597 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch": 25, 2023-11-28T20:38:29.598 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch_barrier": 25, 2023-11-28T20:38:29.598 INFO:teuthology.orchestra.run.smithi167.stdout: "uptime": 16.790685785000001 2023-11-28T20:38:29.598 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 -- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4670066470 msgr2=0x7f4670068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4670066470 0x7f4670068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f467800b930 tx=0x7f4678008040 comp rx=0 tx=0).stop 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 -- 172.21.15.167:0/647496849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4690151f60 msgr2=0x7f469013df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4690151f60 0x7f469013df80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f468800c780 tx=0x7f468800cc40 comp rx=0 tx=0).stop 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 -- 172.21.15.167:0/647496849 shutdown_connections 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4670066470 0x7f4670068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4690151f60 0x7f469013df80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46900c5c90 0x7f469013da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 --2- 172.21.15.167:0/647496849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469006a580 0x7f4690162ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 -- 172.21.15.167:0/647496849 >> 172.21.15.167:0/647496849 conn(0x7f46900cb1e0 msgr2=0x7f469006ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:29.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 -- 172.21.15.167:0/647496849 shutdown_connections 2023-11-28T20:38:29.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.588+0000 7f46953aa640 1 -- 172.21.15.167:0/647496849 wait complete. 2023-11-28T20:38:29.615 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T20:38:29.615 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-28T20:38:29.616 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:38:29.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.752+0000 7f478ebe6640 1 Processor -- start 2023-11-28T20:38:29.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.752+0000 7f478ebe6640 1 -- start start 2023-11-28T20:38:29.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478ebe6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47880c6ff0 0x7f4788157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478ebe6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f47880c4510 0x7f478806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478ebe6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47880c4940 con 0x7f4788150b40 2023-11-28T20:38:29.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478ebe6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47880c62f0 con 0x7f47880c4510 2023-11-28T20:38:29.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478ebe6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880c6ac0 con 0x7f47880c6ff0 2023-11-28T20:38:29.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478c982640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4788150b40 0x7f47880c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34040/0 (socket says 172.21.15.167:34040) 2023-11-28T20:38:29.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478c982640 1 -- 172.21.15.167:0/3714511911 learned_addr learned my addr 172.21.15.167:0/3714511911 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:29.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478d183640 1 --2- 172.21.15.167:0/3714511911 >> v2:172.21.15.178:3300/0 conn(0x7f47880c4510 0x7f478806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477ffff640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47880c6ff0 0x7f4788157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166513350 0 0) 0x7f47880c4940 con 0x7f4788150b40 2023-11-28T20:38:29.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4770005740 con 0x7f4788150b40 2023-11-28T20:38:29.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 727084199 0 0) 0x7f4770005740 con 0x7f4788150b40 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47880c6ff0 msgr2=0x7f4788157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47880c6ff0 0x7f4788157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 >> v2:172.21.15.178:3300/0 conn(0x7f47880c4510 msgr2=0x7f478806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 --2- 172.21.15.167:0/3714511911 >> v2:172.21.15.178:3300/0 conn(0x7f47880c4510 0x7f478806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880c6500 con 0x7f4788150b40 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f4784001680 con 0x7f4788150b40 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 >> v1:172.21.15.167:6789/0 conn(0x7f4788150b40 legacy=0x7f47880c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47880c6ff0 0x7f4770005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4770006160 0x7f47700069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47700073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880c62f0 con 0x7f4770006f20 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880c6ac0 con 0x7f4770006160 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477000dba0 con 0x7f47880c6ff0 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478d183640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47700073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f477ffff640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4770006160 0x7f47700069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478c982640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47880c6ff0 0x7f4770005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478d183640 1 -- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47880c6ff0 msgr2=0x7f4770005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478d183640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47880c6ff0 0x7f4770005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478d183640 1 -- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4770006160 msgr2=0x7f47700069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478d183640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4770006160 0x7f47700069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.756+0000 7f478d183640 1 -- 172.21.15.167:0/3714511911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770005740 con 0x7f4770006f20 2023-11-28T20:38:29.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f478d183640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47700073a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f478000e170 tx=0x7f478001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3ffb1565fb487b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:29.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47800a5c90 con 0x7f4770006f20 2023-11-28T20:38:29.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478000f040 con 0x7f4770006f20 2023-11-28T20:38:29.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f477f7fe640 1 -- 172.21.15.167:0/3714511911 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47800ad440 con 0x7f4770006f20 2023-11-28T20:38:29.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f478ebe6640 1 -- 172.21.15.167:0/3714511911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 msgr2=0x7f47700073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f478ebe6640 1 --2- 172.21.15.167:0/3714511911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47700073a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f478000e170 tx=0x7f478001cc80 comp rx=0 tx=0).stop 2023-11-28T20:38:29.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f478d183640 1 -- 172.21.15.167:0/3714511911 reap_dead start 2023-11-28T20:38:29.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f478ebe6640 1 -- 172.21.15.167:0/3714511911 shutdown_connections 2023-11-28T20:38:29.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f478ebe6640 1 -- 172.21.15.167:0/3714511911 >> 172.21.15.167:0/3714511911 conn(0x7f47880cb1e0 msgr2=0x7f47880cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:29.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f478ebe6640 1 -- 172.21.15.167:0/3714511911 shutdown_connections 2023-11-28T20:38:29.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.760+0000 7f478ebe6640 1 -- 172.21.15.167:0/3714511911 wait complete. 2023-11-28T20:38:29.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 Processor -- start 2023-11-28T20:38:29.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 -- start start 2023-11-28T20:38:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47881f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f478815aa60 0x7f47880c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47880c1c60 0x7f47881ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880c20e0 con 0x7f4770006f20 2023-11-28T20:38:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4788151be0 con 0x7f47880c1c60 2023-11-28T20:38:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4788151ec0 con 0x7f478815aa60 2023-11-28T20:38:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478c982640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47881f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478c982640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47881f05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53978/0 (socket says 172.21.15.167:53978) 2023-11-28T20:38:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478c982640 1 -- 172.21.15.167:0/393082321 learned_addr learned my addr 172.21.15.167:0/393082321 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f477ffff640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f478815aa60 0x7f47880c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478d183640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47880c1c60 0x7f47881ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478c982640 1 -- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f478815aa60 msgr2=0x7f47880c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478c982640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f478815aa60 0x7f47880c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478c982640 1 -- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47880c1c60 msgr2=0x7f47881ef400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478c982640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47880c1c60 0x7f47881ef400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478c982640 1 -- 172.21.15.167:0/393082321 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47881521a0 con 0x7f4770006f20 2023-11-28T20:38:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f477ffff640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f478815aa60 0x7f47880c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478c982640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47881f05c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4784007290 tx=0x7f4784007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f477d7fa640 1 -- 172.21.15.167:0/393082321 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400f9c0 con 0x7f4770006f20 2023-11-28T20:38:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f477d7fa640 1 -- 172.21.15.167:0/393082321 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400fb60 con 0x7f4770006f20 2023-11-28T20:38:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f477d7fa640 1 -- 172.21.15.167:0/393082321 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840133f0 con 0x7f4770006f20 2023-11-28T20:38:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4788152480 con 0x7f4770006f20 2023-11-28T20:38:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4788153bf0 con 0x7f4770006f20 2023-11-28T20:38:29.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.764+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47880682c0 con 0x7f4770006f20 2023-11-28T20:38:29.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.768+0000 7f477d7fa640 1 -- 172.21.15.167:0/393082321 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4784013550 con 0x7f4770006f20 2023-11-28T20:38:29.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.768+0000 7f477d7fa640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4774066470 0x7f4774068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:29.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.768+0000 7f477d7fa640 1 -- 172.21.15.167:0/393082321 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4784084570 con 0x7f4770006f20 2023-11-28T20:38:29.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.768+0000 7f477ffff640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4774066470 0x7f4774068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:29.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.768+0000 7f477ffff640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4774066470 0x7f4774068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47881f2620 tx=0x7f4778008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:29.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.772+0000 7f477d7fa640 1 -- 172.21.15.167:0/393082321 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47840515d0 con 0x7f4770006f20 2023-11-28T20:38:29.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.952+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4788075c90 con 0x7f4770006f20 2023-11-28T20:38:29.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.952+0000 7f477d7fa640 1 -- 172.21.15.167:0/393082321 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4784054bf0 con 0x7f4770006f20 2023-11-28T20:38:29.958 INFO:teuthology.orchestra.run.smithi167.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T20:38:29.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4774066470 msgr2=0x7f4774068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4774066470 0x7f4774068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47881f2620 tx=0x7f4778008040 comp rx=0 tx=0).stop 2023-11-28T20:38:29.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 msgr2=0x7f47881f05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:29.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47881f05c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4784007290 tx=0x7f4784007750 comp rx=0 tx=0).stop 2023-11-28T20:38:29.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 shutdown_connections 2023-11-28T20:38:29.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4774066470 0x7f4774068930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47880c1c60 0x7f47881ef400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f478815aa60 0x7f47880c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 --2- 172.21.15.167:0/393082321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4770006f20 0x7f47881f05c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:29.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 >> 172.21.15.167:0/393082321 conn(0x7f47880cb1e0 msgr2=0x7f478806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:29.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 shutdown_connections 2023-11-28T20:38:29.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:29.956+0000 7f478ebe6640 1 -- 172.21.15.167:0/393082321 wait complete. 2023-11-28T20:38:29.979 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T20:38:29.979 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:38:29.979 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2023-11-28T20:38:29.979 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-28T20:38:29.979 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-28T20:38:29.980 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T20:38:29.980 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:38:29.980 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:38:29.980 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-28T20:38:29.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:29.980 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2023-11-28T20:38:29.989 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:38:29.989 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:38:29.989 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:38:29.989 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:29.990 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:38:29.991 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:29.991 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:38:29.991 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42399sec preferred_lft 42399sec 2023-11-28T20:38:29.991 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link 2023-11-28T20:38:29.991 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:38:29.991 INFO:teuthology.orchestra.run.smithi167.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:38:29.991 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 02:42:1a:f0:da:9c brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:29.991 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:38:29.991 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:38:29.992 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T20:38:29.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:29.993 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:29.993 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:29.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2023-11-28T20:38:29.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2023-11-28T20:38:29.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2023-11-28T20:38:29.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T20:38:29.993 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:30.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:30.105 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:38:30.124 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-11-28T20:38:30.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:30.127 DEBUG:teuthology.orchestra.run.smithi167:> route 2023-11-28T20:38:31.135 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2023-11-28T20:38:31.136 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:38:31.136 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:38:31.136 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:38:31.136 INFO:teuthology.orchestra.run.smithi167.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:38:31.136 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:38:31.136 INFO:teuthology.orchestra.run.smithi167.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:38:31.136 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:38:31.136 INFO:teuthology.orchestra.run.smithi167.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:38:31.136 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:38:31.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:31.137 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:31.137 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:31.137 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:38:31.137 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:38:31.137 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:38:31.137 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:31.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:31.194 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-11-28T20:38:31.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:31.204 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2023-11-28T20:38:31.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:31.255 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:31.255 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:31.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T20:38:31.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-28T20:38:31.255 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:31.340 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-28T20:38:31.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:31.341 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:31.341 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:31.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-28T20:38:31.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T20:38:31.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-28T20:38:31.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-28T20:38:31.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-28T20:38:31.341 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:31.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:31.516 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:31.516 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:31.516 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2023-11-28T20:38:31.516 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T20:38:31.516 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:31.558 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-28T20:38:31.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:38:31.558 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-28T20:38:31.614 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-28T20:38:31.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:38:31.615 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-28T20:38:31.665 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-11-28T20:38:31.727 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:38:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2023-11-28T20:38:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2023-11-28T20:38:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2023-11-28T20:38:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2023-11-28T20:38:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2023-11-28T20:38:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2023-11-28T20:38:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2023-11-28T20:38:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/run/lock 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/fs/nfsd 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2023-11-28T20:38:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/run/rpc_pipefs 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T20:38:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T20:38:31.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:31.789 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-11-28T20:38:31.838 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T20:38:31.838 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-28T20:38:31.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-11-28T20:38:31.906 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:38:31.964 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2023-11-28T20:38:31.964 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2023-11-28T20:38:31.964 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2023-11-28T20:38:31.964 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2023-11-28T20:38:31.964 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2023-11-28T20:38:31.964 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2023-11-28T20:38:31.964 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/run/lock 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/fs/nfsd 2023-11-28T20:38:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/run/rpc_pipefs 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2023-11-28T20:38:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T20:38:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T20:38:31.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:31.968 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-11-28T20:38:31.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi167.stderr:2023-11-28T20:38:31.988+0000 7f2bdb603580 -1 init, newargv = 0x559468b1c3e0 newargc=15 2023-11-28T20:38:31.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi167.stderr:ceph-fuse[44166]: starting ceph client 2023-11-28T20:38:32.003 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi167.stderr:ceph-fuse[44166]: starting fuse 2023-11-28T20:38:33.103 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2023-11-28T20:38:33.128 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T20:38:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2023-11-28T20:38:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2023-11-28T20:38:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2023-11-28T20:38:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2023-11-28T20:38:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2023-11-28T20:38:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2023-11-28T20:38:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/run/lock 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/fs/nfsd 2023-11-28T20:38:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/run/rpc_pipefs 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T20:38:33.187 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T20:38:33.188 INFO:teuthology.orchestra.run.smithi167.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-28T20:38:33.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:33.189 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2023-11-28T20:38:33.239 INFO:teuthology.orchestra.run.smithi167.stdout:43 2023-11-28T20:38:33.239 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T20:38:33.239 DEBUG:teuthology.orchestra.run.smithi167:> sudo stdin-killer -- python3 -c ' 2023-11-28T20:38:33.239 DEBUG:teuthology.orchestra.run.smithi167:> import glob 2023-11-28T20:38:33.239 DEBUG:teuthology.orchestra.run.smithi167:> import re 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> import os 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> import subprocess 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> def _find_admin_socket(client_name): 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> files = glob.glob(asok_path) 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> # Given a non-glob path, it better be there 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> if "*" not in asok_path: 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> assert(len(files) == 1) 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> return files[0] 2023-11-28T20:38:33.240 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> for f in files: 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> contents = proc_f.read() 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> if mountpoint in contents: 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> return f 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> print(_find_admin_socket("client.admin")) 2023-11-28T20:38:33.241 DEBUG:teuthology.orchestra.run.smithi167:> ' 2023-11-28T20:38:33.372 INFO:teuthology.orchestra.run.smithi167.stdout:/var/run/ceph/ceph-client.admin.44166.asok 2023-11-28T20:38:33.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T20:38:33.385 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44166.asok 2023-11-28T20:38:33.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:33.385 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44166.asok status 2023-11-28T20:38:33.557 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:38:33.557 INFO:teuthology.orchestra.run.smithi167.stdout: "metadata": { 2023-11-28T20:38:33.557 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T20:38:33.558 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T20:38:33.558 INFO:teuthology.orchestra.run.smithi167.stdout: "entity_id": "admin", 2023-11-28T20:38:33.558 INFO:teuthology.orchestra.run.smithi167.stdout: "hostname": "smithi167", 2023-11-28T20:38:33.558 INFO:teuthology.orchestra.run.smithi167.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-28T20:38:33.558 INFO:teuthology.orchestra.run.smithi167.stdout: "pid": "44166", 2023-11-28T20:38:33.558 INFO:teuthology.orchestra.run.smithi167.stdout: "root": "/" 2023-11-28T20:38:33.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:38:33.558 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_count": 0, 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_pinned_count": 0, 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4440, 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "inst": { 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "name": { 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "client", 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4440 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 2819325905 2023-11-28T20:38:33.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 2819325905 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "inst_str": "client.4440 192.168.0.1:0/2819325905", 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "addr_str": "192.168.0.1:0/2819325905", 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "inode_count": 1, 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_epoch": 5, 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch": 25, 2023-11-28T20:38:33.560 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch_barrier": 0, 2023-11-28T20:38:33.561 INFO:teuthology.orchestra.run.smithi167.stdout: "blocklisted": false, 2023-11-28T20:38:33.561 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs" 2023-11-28T20:38:33.561 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:38:33.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:33.572 DEBUG:teuthology.orchestra.run.smithi167:> stat --file-system '--printf=%T 2023-11-28T20:38:33.572 DEBUG:teuthology.orchestra.run.smithi167:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-28T20:38:33.582 INFO:teuthology.orchestra.run.smithi167.stdout:fuseblk 2023-11-28T20:38:33.582 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-28T20:38:33.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:33.582 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-28T20:38:33.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:33.652 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-28T20:38:33.834 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-11-28T20:38:33.833+0000 7fa6aa4cf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T20:38:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:# file: . 2023-11-28T20:38:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-28T20:38:33.998 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:34.000 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:38:34.000 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:38:34.009 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:34.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b33891640 1 Processor -- start 2023-11-28T20:38:34.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b33891640 1 -- start start 2023-11-28T20:38:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b33891640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c0cb770 0x7f3b2c15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b33891640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c15ac00 con 0x7f3b2c0cf860 2023-11-28T20:38:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b33891640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0cbd60 con 0x7f3b2c0cfc40 2023-11-28T20:38:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b33891640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c159ff0 con 0x7f3b2c0cb770 2023-11-28T20:38:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b3162d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3b2c0cf860 0x7f3b2c0ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34656/0 (socket says 172.21.15.167:34656) 2023-11-28T20:38:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b3162d640 1 -- 172.21.15.167:0/277178579 learned_addr learned my addr 172.21.15.167:0/277178579 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b31e2e640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c0cb770 0x7f3b2c15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126727916 0 0) 0x7f3b2c15ac00 con 0x7f3b2c0cf860 2023-11-28T20:38:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b18003530 con 0x7f3b2c0cf860 2023-11-28T20:38:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944329542 0 0) 0x7f3b2c0cbd60 con 0x7f3b2c0cfc40 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b2c15ac00 con 0x7f3b2c0cfc40 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860932437 0 0) 0x7f3b18003530 con 0x7f3b2c0cf860 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c0cb770 msgr2=0x7f3b2c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.184+0000 7f3b23fff640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c0cb770 0x7f3b2c15d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 >> v1:172.21.15.178:6789/0 conn(0x7f3b2c0cfc40 legacy=0x7f3b2c153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c15a2d0 con 0x7f3b2c0cf860 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f3b28001680 con 0x7f3b2c0cf860 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 >> v1:172.21.15.167:6789/0 conn(0x7f3b2c0cf860 legacy=0x7f3b2c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c0cb770 0x7f3b18003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b180040a0 0x7f3b180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b18004d10 0x7f3b18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c159ff0 con 0x7f3b18004d10 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1800ba70 con 0x7f3b180040a0 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1800bc30 con 0x7f3b2c0cb770 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b31e2e640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b18004d10 0x7f3b18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b3162d640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c0cb770 0x7f3b18003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b30e2c640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b180040a0 0x7f3b180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b31e2e640 1 -- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c0cb770 msgr2=0x7f3b18003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b31e2e640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c0cb770 0x7f3b18003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b31e2e640 1 -- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b180040a0 msgr2=0x7f3b180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b31e2e640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b180040a0 0x7f3b180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b31e2e640 1 -- 172.21.15.167:0/277178579 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18003530 con 0x7f3b18004d10 2023-11-28T20:38:34.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b31e2e640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b18004d10 0x7f3b18005190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009fc0 tx=0x7f3b2401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a44ca8ecbb6742 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:34.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240a5b60 con 0x7f3b18004d10 2023-11-28T20:38:34.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400f040 con 0x7f3b18004d10 2023-11-28T20:38:34.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.188+0000 7f3b23fff640 1 -- 172.21.15.167:0/277178579 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240ad440 con 0x7f3b18004d10 2023-11-28T20:38:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 -- 172.21.15.167:0/277178579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b18004d10 msgr2=0x7f3b18005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 --2- 172.21.15.167:0/277178579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b18004d10 0x7f3b18005190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009fc0 tx=0x7f3b2401cc60 comp rx=0 tx=0).stop 2023-11-28T20:38:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b31e2e640 1 -- 172.21.15.167:0/277178579 reap_dead start 2023-11-28T20:38:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 -- 172.21.15.167:0/277178579 shutdown_connections 2023-11-28T20:38:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 -- 172.21.15.167:0/277178579 >> 172.21.15.167:0/277178579 conn(0x7f3b2c06c1f0 msgr2=0x7f3b2c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 -- 172.21.15.167:0/277178579 shutdown_connections 2023-11-28T20:38:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 -- 172.21.15.167:0/277178579 wait complete. 2023-11-28T20:38:34.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 Processor -- start 2023-11-28T20:38:34.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 -- start start 2023-11-28T20:38:34.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b18004d10 0x7f3b2c148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c1521f0 0x7f3b2c0b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c1f0c20 0x7f3b2c1f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1513d0 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c151cb0 con 0x7f3b18004d10 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b33891640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0b4200 con 0x7f3b2c1521f0 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b31e2e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c1f0c20 0x7f3b2c1f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b31e2e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c1f0c20 0x7f3b2c1f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48646/0 (socket says 172.21.15.167:48646) 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b31e2e640 1 -- 172.21.15.167:0/2055624047 learned_addr learned my addr 172.21.15.167:0/2055624047 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b30e2c640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c1521f0 0x7f3b2c0b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.192+0000 7f3b3162d640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b18004d10 0x7f3b2c148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b31e2e640 1 -- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c1521f0 msgr2=0x7f3b2c0b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b31e2e640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c1521f0 0x7f3b2c0b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b31e2e640 1 -- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b18004d10 msgr2=0x7f3b2c148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b31e2e640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b18004d10 0x7f3b2c148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b31e2e640 1 -- 172.21.15.167:0/2055624047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0b44e0 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b3162d640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b18004d10 0x7f3b2c148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b31e2e640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c1f0c20 0x7f3b2c1f10a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b240b0040 tx=0x7f3b24009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b21ffb640 1 -- 172.21.15.167:0/2055624047 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240039a0 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b21ffb640 1 -- 172.21.15.167:0/2055624047 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24003b00 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b21ffb640 1 -- 172.21.15.167:0/2055624047 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24003e70 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c0b47c0 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c0b4d80 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c075c90 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b21ffb640 1 -- 172.21.15.167:0/2055624047 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b240b4040 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b21ffb640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b10066470 0x7f3b10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b21ffb640 1 -- 172.21.15.167:0/2055624047 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b240a5e40 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.196+0000 7f3b3162d640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b10066470 0x7f3b10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.200+0000 7f3b3162d640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b10066470 0x7f3b10068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b28000c10 tx=0x7f3b28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:34.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.200+0000 7f3b21ffb640 1 -- 172.21.15.167:0/2055624047 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b240eb4d0 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.352+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b2c067bb0 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b21ffb640 1 -- 172.21.15.167:0/2055624047 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7f3b240be020 con 0x7f3b2c1f0c20 2023-11-28T20:38:34.360 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:34.361 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b10066470 msgr2=0x7f3b10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b10066470 0x7f3b10068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b28000c10 tx=0x7f3b28009040 comp rx=0 tx=0).stop 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c1f0c20 msgr2=0x7f3b2c1f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c1f0c20 0x7f3b2c1f10a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3b240b0040 tx=0x7f3b24009750 comp rx=0 tx=0).stop 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 shutdown_connections 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b10066470 0x7f3b10068930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b2c1f0c20 0x7f3b2c1f10a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c1521f0 0x7f3b2c0b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 --2- 172.21.15.167:0/2055624047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b18004d10 0x7f3b2c148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 >> 172.21.15.167:0/2055624047 conn(0x7f3b2c06c1f0 msgr2=0x7f3b2c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:34.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 shutdown_connections 2023-11-28T20:38:34.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.356+0000 7f3b33891640 1 -- 172.21.15.167:0/2055624047 wait complete. 2023-11-28T20:38:34.381 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:38:05.507993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:38:17.477871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:38:17.884061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T20:38:21.578587+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T20:38:34.382 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:38:34.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe052c17640 1 Processor -- start 2023-11-28T20:38:34.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe052c17640 1 -- start start 2023-11-28T20:38:34.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe052c17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 0x7fe04c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe052c17640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe04c0c6ff0 0x7fe04c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe052c17640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c0c6ac0 con 0x7fe04c0c5be0 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe052c17640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0c6500 con 0x7fe04c0c6ff0 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe052c17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0c67e0 con 0x7fe04c150b40 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe043fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe04c0c6ff0 0x7fe04c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe043fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe04c0c6ff0 0x7fe04c0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48660/0 (socket says 172.21.15.167:48660) 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe043fff640 1 -- 172.21.15.167:0/2370089654 learned_addr learned my addr 172.21.15.167:0/2370089654 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe0509b3640 1 --2- 172.21.15.167:0/2370089654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 0x7fe04c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe043fff640 1 -- 172.21.15.167:0/2370089654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 msgr2=0x7fe04c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe043fff640 1 --2- 172.21.15.167:0/2370089654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 0x7fe04c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe043fff640 1 -- 172.21.15.167:0/2370089654 >> v1:172.21.15.178:6789/0 conn(0x7fe04c0c5be0 legacy=0x7fe04c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe043fff640 1 -- 172.21.15.167:0/2370089654 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c156a80 con 0x7fe04c0c6ff0 2023-11-28T20:38:34.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.520+0000 7fe0509b3640 1 --2- 172.21.15.167:0/2370089654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 0x7fe04c157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:34.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe043fff640 1 --2- 172.21.15.167:0/2370089654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c6ff0 0x7fe04c0c4510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009870 tx=0x7fe03c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a9a00c702a70 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:34.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe0437fe640 1 -- 172.21.15.167:0/2370089654 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0aa670 con 0x7fe04c0c6ff0 2023-11-28T20:38:34.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe0437fe640 1 -- 172.21.15.167:0/2370089654 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c0aa7d0 con 0x7fe04c0c6ff0 2023-11-28T20:38:34.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe0437fe640 1 -- 172.21.15.167:0/2370089654 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0aab60 con 0x7fe04c0c6ff0 2023-11-28T20:38:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe052c17640 1 -- 172.21.15.167:0/2370089654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c6ff0 msgr2=0x7fe04c0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe052c17640 1 --2- 172.21.15.167:0/2370089654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c6ff0 0x7fe04c0c4510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009870 tx=0x7fe03c01c510 comp rx=0 tx=0).stop 2023-11-28T20:38:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe052c17640 1 -- 172.21.15.167:0/2370089654 shutdown_connections 2023-11-28T20:38:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe052c17640 1 --2- 172.21.15.167:0/2370089654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c6ff0 0x7fe04c0c4510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe052c17640 1 --2- 172.21.15.167:0/2370089654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 0x7fe04c157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe052c17640 1 -- 172.21.15.167:0/2370089654 >> 172.21.15.167:0/2370089654 conn(0x7fe04c0cb1e0 msgr2=0x7fe04c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe052c17640 1 -- 172.21.15.167:0/2370089654 shutdown_connections 2023-11-28T20:38:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe052c17640 1 -- 172.21.15.167:0/2370089654 wait complete. 2023-11-28T20:38:34.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.524+0000 7fe052c17640 1 Processor -- start 2023-11-28T20:38:34.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 -- start start 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c5be0 0x7fe04c0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04c0c6ff0 0x7fe04c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 0x7fe04c148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c14ae40 con 0x7fe04c0c5be0 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c159360 con 0x7fe04c0c6ff0 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c14a1a0 con 0x7fe04c150b40 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0509b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c5be0 0x7fe04c0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0509b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c5be0 0x7fe04c0ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48674/0 (socket says 172.21.15.167:48674) 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0509b3640 1 -- 172.21.15.167:0/708940785 learned_addr learned my addr 172.21.15.167:0/708940785 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe043fff640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04c0c6ff0 0x7fe04c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0511b4640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 0x7fe04c148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0509b3640 1 -- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 msgr2=0x7fe04c148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0509b3640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 0x7fe04c148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0509b3640 1 -- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04c0c6ff0 msgr2=0x7fe04c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0509b3640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04c0c6ff0 0x7fe04c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0509b3640 1 -- 172.21.15.167:0/708940785 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0094d0 con 0x7fe04c0c5be0 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0509b3640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c5be0 0x7fe04c0ca800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe04800d830 tx=0x7fe04800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0417fa640 1 -- 172.21.15.167:0/708940785 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800b6c0 con 0x7fe04c0c5be0 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0417fa640 1 -- 172.21.15.167:0/708940785 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04800b820 con 0x7fe04c0c5be0 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c14a880 con 0x7fe04c0c5be0 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe0417fa640 1 -- 172.21.15.167:0/708940785 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800bbd0 con 0x7fe04c0c5be0 2023-11-28T20:38:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c149b50 con 0x7fe04c0c5be0 2023-11-28T20:38:34.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.528+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c0682c0 con 0x7fe04c0c5be0 2023-11-28T20:38:34.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.532+0000 7fe0417fa640 1 -- 172.21.15.167:0/708940785 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe04801e460 con 0x7fe04c0c5be0 2023-11-28T20:38:34.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.532+0000 7fe0417fa640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe038066470 0x7fe038068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.532+0000 7fe0417fa640 1 -- 172.21.15.167:0/708940785 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe048084980 con 0x7fe04c0c5be0 2023-11-28T20:38:34.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.532+0000 7fe043fff640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe038066470 0x7fe038068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.532+0000 7fe043fff640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe038066470 0x7fe038068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0ae000 tx=0x7fe03c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:34.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.536+0000 7fe0417fa640 1 -- 172.21.15.167:0/708940785 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe048051a70 con 0x7fe04c0c5be0 2023-11-28T20:38:34.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.688+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe04c075c90 con 0x7fe04c0c5be0 2023-11-28T20:38:34.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.688+0000 7fe0417fa640 1 -- 172.21.15.167:0/708940785 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe048055090 con 0x7fe04c0c5be0 2023-11-28T20:38:34.693 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2023-11-28T20:38:34.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe038066470 msgr2=0x7fe038068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe038066470 0x7fe038068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0ae000 tx=0x7fe03c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:38:34.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c5be0 msgr2=0x7fe04c0ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c5be0 0x7fe04c0ca800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe04800d830 tx=0x7fe04800dcf0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 shutdown_connections 2023-11-28T20:38:34.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe038066470 0x7fe038068930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe04c150b40 0x7fe04c148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04c0c6ff0 0x7fe04c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 --2- 172.21.15.167:0/708940785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe04c0c5be0 0x7fe04c0ca800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 >> 172.21.15.167:0/708940785 conn(0x7fe04c0cb1e0 msgr2=0x7fe04c071230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 shutdown_connections 2023-11-28T20:38:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.692+0000 7fe052c17640 1 -- 172.21.15.167:0/708940785 wait complete. 2023-11-28T20:38:34.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:38:34.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.848+0000 7ff4a41d1640 1 Processor -- start 2023-11-28T20:38:34.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.848+0000 7ff4a41d1640 1 -- start start 2023-11-28T20:38:34.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a41d1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff49c0c75c0 0x7ff49c0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a41d1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff49c06a580 0x7ff49c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a41d1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c0c7a50 con 0x7ff49c151f60 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a41d1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c06aed0 con 0x7ff49c0c75c0 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a41d1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c0c4da0 con 0x7ff49c06a580 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a176c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff49c0c75c0 0x7ff49c0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a176c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff49c0c75c0 0x7ff49c0c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48688/0 (socket says 172.21.15.167:48688) 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a176c640 1 -- 172.21.15.167:0/586289328 learned_addr learned my addr 172.21.15.167:0/586289328 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a276e640 1 --2- 172.21.15.167:0/586289328 >> v2:172.21.15.178:3300/0 conn(0x7ff49c06a580 0x7ff49c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a176c640 1 -- 172.21.15.167:0/586289328 >> v2:172.21.15.178:3300/0 conn(0x7ff49c06a580 msgr2=0x7ff49c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a176c640 1 --2- 172.21.15.167:0/586289328 >> v2:172.21.15.178:3300/0 conn(0x7ff49c06a580 0x7ff49c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a176c640 1 -- 172.21.15.167:0/586289328 >> v1:172.21.15.178:6789/0 conn(0x7ff49c151f60 legacy=0x7ff49c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.852+0000 7ff4a176c640 1 -- 172.21.15.167:0/586289328 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c15b220 con 0x7ff49c0c75c0 2023-11-28T20:38:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a176c640 1 --2- 172.21.15.167:0/586289328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c0c75c0 0x7ff49c0c5c90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0c5580 tx=0x7ff48c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c3f5b6db6518af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:34.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a0f6b640 1 -- 172.21.15.167:0/586289328 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0ab600 con 0x7ff49c0c75c0 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a0f6b640 1 -- 172.21.15.167:0/586289328 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c0a7050 con 0x7ff49c0c75c0 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a0f6b640 1 -- 172.21.15.167:0/586289328 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0ab980 con 0x7ff49c0c75c0 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 -- 172.21.15.167:0/586289328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c0c75c0 msgr2=0x7ff49c0c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 --2- 172.21.15.167:0/586289328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c0c75c0 0x7ff49c0c5c90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0c5580 tx=0x7ff48c01c470 comp rx=0 tx=0).stop 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 -- 172.21.15.167:0/586289328 shutdown_connections 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 --2- 172.21.15.167:0/586289328 >> v2:172.21.15.178:3300/0 conn(0x7ff49c06a580 0x7ff49c06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 --2- 172.21.15.167:0/586289328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c0c75c0 0x7ff49c0c5c90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 -- 172.21.15.167:0/586289328 >> 172.21.15.167:0/586289328 conn(0x7ff49c0cb1e0 msgr2=0x7ff49c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 -- 172.21.15.167:0/586289328 shutdown_connections 2023-11-28T20:38:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 -- 172.21.15.167:0/586289328 wait complete. 2023-11-28T20:38:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 Processor -- start 2023-11-28T20:38:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.856+0000 7ff4a41d1640 1 -- start start 2023-11-28T20:38:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a41d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c06a580 0x7ff49c13fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a41d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0c75c0 0x7ff49c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a41d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c151f60 0x7ff49c1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a41d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c143580 con 0x7ff49c06a580 2023-11-28T20:38:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a41d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c1576f0 con 0x7ff49c0c75c0 2023-11-28T20:38:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a41d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c13eae0 con 0x7ff49c151f60 2023-11-28T20:38:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a1f6d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c06a580 0x7ff49c13fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a1f6d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c06a580 0x7ff49c13fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48700/0 (socket says 172.21.15.167:48700) 2023-11-28T20:38:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a1f6d640 1 -- 172.21.15.167:0/2253392353 learned_addr learned my addr 172.21.15.167:0/2253392353 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a276e640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c151f60 0x7ff49c1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a176c640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0c75c0 0x7ff49c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a1f6d640 1 -- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c151f60 msgr2=0x7ff49c1571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a1f6d640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c151f60 0x7ff49c1571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a1f6d640 1 -- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0c75c0 msgr2=0x7ff49c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a1f6d640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0c75c0 0x7ff49c070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a1f6d640 1 -- 172.21.15.167:0/2253392353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0094d0 con 0x7ff49c06a580 2023-11-28T20:38:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a276e640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c151f60 0x7ff49c1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a1f6d640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c06a580 0x7ff49c13fb40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c500 tx=0x7ff49800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4927fc640 1 -- 172.21.15.167:0/2253392353 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498005220 con 0x7ff49c06a580 2023-11-28T20:38:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4927fc640 1 -- 172.21.15.167:0/2253392353 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff498005380 con 0x7ff49c06a580 2023-11-28T20:38:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c157940 con 0x7ff49c06a580 2023-11-28T20:38:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4927fc640 1 -- 172.21.15.167:0/2253392353 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498007270 con 0x7ff49c06a580 2023-11-28T20:38:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c13f060 con 0x7ff49c06a580 2023-11-28T20:38:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c0682c0 con 0x7ff49c06a580 2023-11-28T20:38:34.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.860+0000 7ff4927fc640 1 -- 172.21.15.167:0/2253392353 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4980073d0 con 0x7ff49c06a580 2023-11-28T20:38:34.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.864+0000 7ff4927fc640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff480066470 0x7ff480068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:34.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.864+0000 7ff4927fc640 1 -- 172.21.15.167:0/2253392353 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff498083570 con 0x7ff49c06a580 2023-11-28T20:38:34.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.864+0000 7ff4a176c640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff480066470 0x7ff480068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:34.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.864+0000 7ff4a176c640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff480066470 0x7ff480068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0ad000 tx=0x7ff48c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:34.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:34.868+0000 7ff4927fc640 1 -- 172.21.15.167:0/2253392353 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff498050680 con 0x7ff49c06a580 2023-11-28T20:38:35.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff49c075c90 con 0x7ff49c06a580 2023-11-28T20:38:35.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4927fc640 1 -- 172.21.15.167:0/2253392353 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff498053ca0 con 0x7ff49c06a580 2023-11-28T20:38:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:38:35.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff480066470 msgr2=0x7ff480068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff480066470 0x7ff480068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0ad000 tx=0x7ff48c008040 comp rx=0 tx=0).stop 2023-11-28T20:38:35.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c06a580 msgr2=0x7ff49c13fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c06a580 0x7ff49c13fb40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c500 tx=0x7ff49800c9c0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 shutdown_connections 2023-11-28T20:38:35.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff480066470 0x7ff480068930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c151f60 0x7ff49c1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0c75c0 0x7ff49c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 --2- 172.21.15.167:0/2253392353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff49c06a580 0x7ff49c13fb40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 >> 172.21.15.167:0/2253392353 conn(0x7ff49c0cb1e0 msgr2=0x7ff49c140e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:35.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 shutdown_connections 2023-11-28T20:38:35.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.016+0000 7ff4a41d1640 1 -- 172.21.15.167:0/2253392353 wait complete. 2023-11-28T20:38:35.040 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:38:35.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe611de6640 1 Processor -- start 2023-11-28T20:38:35.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe611de6640 1 -- start start 2023-11-28T20:38:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe611de6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 0x7fe60c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe611de6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c0c4940 con 0x7fe60c0c4510 2023-11-28T20:38:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe611de6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c0c6ac0 con 0x7fe60c150b40 2023-11-28T20:38:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe611de6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0c62f0 con 0x7fe60c0c6ff0 2023-11-28T20:38:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe60c0c4510 0x7fe60c06a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34662/0 (socket says 172.21.15.167:34662) 2023-11-28T20:38:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60bfff640 1 -- 172.21.15.167:0/2565809486 learned_addr learned my addr 172.21.15.167:0/2565809486 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60affd640 1 --2- 172.21.15.167:0/2565809486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 0x7fe60c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60a7fc640 1 -- 172.21.15.167:0/2565809486 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030700664 0 0) 0x7fe60c0c4940 con 0x7fe60c0c4510 2023-11-28T20:38:35.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60a7fc640 1 -- 172.21.15.167:0/2565809486 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f4003530 con 0x7fe60c0c4510 2023-11-28T20:38:35.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60a7fc640 1 -- 172.21.15.167:0/2565809486 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270796414 0 0) 0x7fe60c0c6ac0 con 0x7fe60c150b40 2023-11-28T20:38:35.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60a7fc640 1 -- 172.21.15.167:0/2565809486 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe60c0c4940 con 0x7fe60c150b40 2023-11-28T20:38:35.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60a7fc640 1 -- 172.21.15.167:0/2565809486 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126418552 0 0) 0x7fe5f4003530 con 0x7fe60c0c4510 2023-11-28T20:38:35.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60affd640 1 -- 172.21.15.167:0/2565809486 >> v1:172.21.15.178:6789/0 conn(0x7fe60c150b40 legacy=0x7fe60c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60affd640 1 -- 172.21.15.167:0/2565809486 >> v1:172.21.15.167:6789/0 conn(0x7fe60c0c4510 legacy=0x7fe60c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.176+0000 7fe60affd640 1 -- 172.21.15.167:0/2565809486 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0c6500 con 0x7fe60c0c6ff0 2023-11-28T20:38:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe60affd640 1 --2- 172.21.15.167:0/2565809486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 0x7fe60c157560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe6000097f0 tx=0x7fe60001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d96882815328266 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:35.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe60a7fc640 1 -- 172.21.15.167:0/2565809486 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604001a00 con 0x7fe60c0c6ff0 2023-11-28T20:38:35.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe60a7fc640 1 -- 172.21.15.167:0/2565809486 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6000a7050 con 0x7fe60c0c6ff0 2023-11-28T20:38:35.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe60a7fc640 1 -- 172.21.15.167:0/2565809486 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000ab620 con 0x7fe60c0c6ff0 2023-11-28T20:38:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe611de6640 1 -- 172.21.15.167:0/2565809486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 msgr2=0x7fe60c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe611de6640 1 --2- 172.21.15.167:0/2565809486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 0x7fe60c157560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe6000097f0 tx=0x7fe60001c3b0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe611de6640 1 -- 172.21.15.167:0/2565809486 shutdown_connections 2023-11-28T20:38:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe611de6640 1 --2- 172.21.15.167:0/2565809486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 0x7fe60c157560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe611de6640 1 -- 172.21.15.167:0/2565809486 >> 172.21.15.167:0/2565809486 conn(0x7fe60c0cb1e0 msgr2=0x7fe60c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe611de6640 1 -- 172.21.15.167:0/2565809486 shutdown_connections 2023-11-28T20:38:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.180+0000 7fe611de6640 1 -- 172.21.15.167:0/2565809486 wait complete. 2023-11-28T20:38:35.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 Processor -- start 2023-11-28T20:38:35.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 -- start start 2023-11-28T20:38:35.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c0c4510 0x7fe60c155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 0x7fe60c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60c150b40 0x7fe60c147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c147250 con 0x7fe60c150b40 2023-11-28T20:38:35.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c146940 con 0x7fe60c0c4510 2023-11-28T20:38:35.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0c9b90 con 0x7fe60c0c6ff0 2023-11-28T20:38:35.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60c150b40 0x7fe60c147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60c150b40 0x7fe60c147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48710/0 (socket says 172.21.15.167:48710) 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60bfff640 1 -- 172.21.15.167:0/677015742 learned_addr learned my addr 172.21.15.167:0/677015742 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60affd640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 0x7fe60c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60b7fe640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c0c4510 0x7fe60c155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60bfff640 1 -- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 msgr2=0x7fe60c156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60bfff640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 0x7fe60c156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60bfff640 1 -- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c0c4510 msgr2=0x7fe60c155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60bfff640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c0c4510 0x7fe60c155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60bfff640 1 -- 172.21.15.167:0/677015742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009420 con 0x7fe60c150b40 2023-11-28T20:38:35.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe60bfff640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60c150b40 0x7fe60c147670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe604001f90 tx=0x7fe60400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:35.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe5f3fff640 1 -- 172.21.15.167:0/677015742 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604012400 con 0x7fe60c150b40 2023-11-28T20:38:35.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe5f3fff640 1 -- 172.21.15.167:0/677015742 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe604012560 con 0x7fe60c150b40 2023-11-28T20:38:35.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe5f3fff640 1 -- 172.21.15.167:0/677015742 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6040128f0 con 0x7fe60c150b40 2023-11-28T20:38:35.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c0c9e70 con 0x7fe60c150b40 2023-11-28T20:38:35.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.184+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c146e70 con 0x7fe60c150b40 2023-11-28T20:38:35.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.188+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c0682c0 con 0x7fe60c150b40 2023-11-28T20:38:35.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.188+0000 7fe5f3fff640 1 -- 172.21.15.167:0/677015742 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe604012a50 con 0x7fe60c150b40 2023-11-28T20:38:35.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.188+0000 7fe5f3fff640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe5f8066470 0x7fe5f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.188+0000 7fe5f3fff640 1 -- 172.21.15.167:0/677015742 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe604084960 con 0x7fe60c150b40 2023-11-28T20:38:35.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.188+0000 7fe60b7fe640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe5f8066470 0x7fe5f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.188+0000 7fe60b7fe640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe5f8066470 0x7fe5f8068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc000f70 tx=0x7fe5fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:35.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.192+0000 7fe5f3fff640 1 -- 172.21.15.167:0/677015742 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6040519c0 con 0x7fe60c150b40 2023-11-28T20:38:35.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.340+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe60c147390 con 0x7fe60c150b40 2023-11-28T20:38:35.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.340+0000 7fe5f3fff640 1 -- 172.21.15.167:0/677015742 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe60c147390 con 0x7fe60c150b40 2023-11-28T20:38:35.345 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2023-11-28T20:38:35.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe5f8066470 msgr2=0x7fe5f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe5f8066470 0x7fe5f8068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc000f70 tx=0x7fe5fc009040 comp rx=0 tx=0).stop 2023-11-28T20:38:35.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60c150b40 msgr2=0x7fe60c147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60c150b40 0x7fe60c147670 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe604001f90 tx=0x7fe60400a430 comp rx=0 tx=0).stop 2023-11-28T20:38:35.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 shutdown_connections 2023-11-28T20:38:35.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe5f8066470 0x7fe5f8068930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe60c150b40 0x7fe60c147670 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe60c0c6ff0 0x7fe60c156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 --2- 172.21.15.167:0/677015742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe60c0c4510 0x7fe60c155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 >> 172.21.15.167:0/677015742 conn(0x7fe60c0cb1e0 msgr2=0x7fe60c071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:35.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 shutdown_connections 2023-11-28T20:38:35.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.344+0000 7fe611de6640 1 -- 172.21.15.167:0/677015742 wait complete. 2023-11-28T20:38:35.367 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T20:38:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f417ac79640 1 Processor -- start 2023-11-28T20:38:35.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f417ac79640 1 -- start start 2023-11-28T20:38:35.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f417ac79640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4174151f60 0x7f41740c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f417ac79640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f417406a580 0x7f417406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f417ac79640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41740c6120 con 0x7f41740c5c90 2023-11-28T20:38:35.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f417ac79640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417406aed0 con 0x7f417406a580 2023-11-28T20:38:35.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f417ac79640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41740c4da0 con 0x7f4174151f60 2023-11-28T20:38:35.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f4179216640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f417406a580 0x7f417406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f4179216640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f417406a580 0x7f417406a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48718/0 (socket says 172.21.15.167:48718) 2023-11-28T20:38:35.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f4179216640 1 -- 172.21.15.167:0/3616525909 learned_addr learned my addr 172.21.15.167:0/3616525909 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:35.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f4178a15640 1 --2- 172.21.15.167:0/3616525909 >> v2:172.21.15.178:3300/0 conn(0x7f4174151f60 0x7f41740c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f4179216640 1 -- 172.21.15.167:0/3616525909 >> v2:172.21.15.178:3300/0 conn(0x7f4174151f60 msgr2=0x7f41740c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:35.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f4179216640 1 --2- 172.21.15.167:0/3616525909 >> v2:172.21.15.178:3300/0 conn(0x7f4174151f60 0x7f41740c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f4179216640 1 -- 172.21.15.167:0/3616525909 >> v1:172.21.15.178:6789/0 conn(0x7f41740c5c90 legacy=0x7f41740c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f4179216640 1 -- 172.21.15.167:0/3616525909 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417415b220 con 0x7f417406a580 2023-11-28T20:38:35.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.512+0000 7f4178a15640 1 --2- 172.21.15.167:0/3616525909 >> v2:172.21.15.178:3300/0 conn(0x7f4174151f60 0x7f41740c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:35.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f4179216640 1 --2- 172.21.15.167:0/3616525909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f417406a580 0x7f417406a990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f41740c62c0 tx=0x7f416c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa36733910dfc05 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:35.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f41737fe640 1 -- 172.21.15.167:0/3616525909 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0a5600 con 0x7f417406a580 2023-11-28T20:38:35.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f41737fe640 1 -- 172.21.15.167:0/3616525909 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c0a5760 con 0x7f417406a580 2023-11-28T20:38:35.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f41737fe640 1 -- 172.21.15.167:0/3616525909 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0a5af0 con 0x7f417406a580 2023-11-28T20:38:35.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 -- 172.21.15.167:0/3616525909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f417406a580 msgr2=0x7f417406a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 --2- 172.21.15.167:0/3616525909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f417406a580 0x7f417406a990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f41740c62c0 tx=0x7f416c01c940 comp rx=0 tx=0).stop 2023-11-28T20:38:35.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 -- 172.21.15.167:0/3616525909 shutdown_connections 2023-11-28T20:38:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 --2- 172.21.15.167:0/3616525909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f417406a580 0x7f417406a990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 --2- 172.21.15.167:0/3616525909 >> v2:172.21.15.178:3300/0 conn(0x7f4174151f60 0x7f41740c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 -- 172.21.15.167:0/3616525909 >> 172.21.15.167:0/3616525909 conn(0x7f41740cb1e0 msgr2=0x7f41740cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 -- 172.21.15.167:0/3616525909 shutdown_connections 2023-11-28T20:38:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 -- 172.21.15.167:0/3616525909 wait complete. 2023-11-28T20:38:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 Processor -- start 2023-11-28T20:38:35.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.516+0000 7f417ac79640 1 -- start start 2023-11-28T20:38:35.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f417ac79640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f417406a580 0x7f4174070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f417ac79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41740c5c90 0x7f4174156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f417ac79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4174151f60 0x7f41740ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f417ac79640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41740718b0 con 0x7f4174151f60 2023-11-28T20:38:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f417ac79640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417414fde0 con 0x7f417406a580 2023-11-28T20:38:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f417ac79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41740709c0 con 0x7f41740c5c90 2023-11-28T20:38:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4179216640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4174151f60 0x7f41740ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4179216640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4174151f60 0x7f41740ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48728/0 (socket says 172.21.15.167:48728) 2023-11-28T20:38:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4179216640 1 -- 172.21.15.167:0/1236855102 learned_addr learned my addr 172.21.15.167:0/1236855102 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4178a15640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f417406a580 0x7f4174070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4173fff640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41740c5c90 0x7f4174156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4179216640 1 -- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41740c5c90 msgr2=0x7f4174156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4179216640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41740c5c90 0x7f4174156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4179216640 1 -- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f417406a580 msgr2=0x7f4174070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4179216640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f417406a580 0x7f4174070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4179216640 1 -- 172.21.15.167:0/1236855102 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c009b30 con 0x7f4174151f60 2023-11-28T20:38:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4173fff640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41740c5c90 0x7f4174156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:35.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f4179216640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4174151f60 0x7f41740ca290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f416c0af040 tx=0x7f416c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:35.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f41717fa640 1 -- 172.21.15.167:0/1236855102 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0b8670 con 0x7f4174151f60 2023-11-28T20:38:35.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f41717fa640 1 -- 172.21.15.167:0/1236855102 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c0b87d0 con 0x7f4174151f60 2023-11-28T20:38:35.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f41717fa640 1 -- 172.21.15.167:0/1236855102 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c0b8b80 con 0x7f4174151f60 2023-11-28T20:38:35.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41740cae80 con 0x7f4174151f60 2023-11-28T20:38:35.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417414fa70 con 0x7f4174151f60 2023-11-28T20:38:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417414fc30 con 0x7f4174151f60 2023-11-28T20:38:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.520+0000 7f41717fa640 1 -- 172.21.15.167:0/1236855102 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f416c0b8ce0 con 0x7f4174151f60 2023-11-28T20:38:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.524+0000 7f41717fa640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4158066470 0x7f4158068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.524+0000 7f41717fa640 1 -- 172.21.15.167:0/1236855102 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f416c11f4e0 con 0x7f4174151f60 2023-11-28T20:38:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.524+0000 7f4178a15640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4158066470 0x7f4158068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.524+0000 7f4178a15640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4158066470 0x7f4158068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f416800c900 tx=0x7f4168008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:35.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.528+0000 7f41717fa640 1 -- 172.21.15.167:0/1236855102 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f416c0ec710 con 0x7f4174151f60 2023-11-28T20:38:35.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.680+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41740682c0 con 0x7f4174151f60 2023-11-28T20:38:35.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.680+0000 7f41717fa640 1 -- 172.21.15.167:0/1236855102 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f416c009510 con 0x7f4174151f60 2023-11-28T20:38:35.685 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:38:35.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4158066470 msgr2=0x7f4158068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4158066470 0x7f4158068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f416800c900 tx=0x7f4168008040 comp rx=0 tx=0).stop 2023-11-28T20:38:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4174151f60 msgr2=0x7f41740ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4174151f60 0x7f41740ca290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f416c0af040 tx=0x7f416c0196e0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 shutdown_connections 2023-11-28T20:38:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4158066470 0x7f4158068930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4174151f60 0x7f41740ca290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41740c5c90 0x7f4174156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 --2- 172.21.15.167:0/1236855102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f417406a580 0x7f4174070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 >> 172.21.15.167:0/1236855102 conn(0x7f41740cb1e0 msgr2=0x7f4174143d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:35.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 shutdown_connections 2023-11-28T20:38:35.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.684+0000 7f417ac79640 1 -- 172.21.15.167:0/1236855102 wait complete. 2023-11-28T20:38:35.706 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:38:35.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.840+0000 7f4fe0557640 1 Processor -- start 2023-11-28T20:38:35.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.840+0000 7f4fe0557640 1 -- start start 2023-11-28T20:38:35.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fe0557640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4fd80c6ff0 0x7f4fd8157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fe0557640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4fd80c4510 0x7f4fd806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fe0557640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80c48f0 con 0x7f4fd8150b40 2023-11-28T20:38:35.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fe0557640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80c62f0 con 0x7f4fd80c4510 2023-11-28T20:38:35.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fe0557640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80c6ac0 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fdeaf4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4fd80c4510 0x7f4fd806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fdeaf4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4fd80c4510 0x7f4fd806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48736/0 (socket says 172.21.15.167:48736) 2023-11-28T20:38:35.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fdeaf4640 1 -- 172.21.15.167:0/1662308565 learned_addr learned my addr 172.21.15.167:0/1662308565 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:35.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fddaf2640 1 --2- 172.21.15.167:0/1662308565 >> v2:172.21.15.178:3300/0 conn(0x7f4fd80c6ff0 0x7f4fd8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fdeaf4640 1 -- 172.21.15.167:0/1662308565 >> v2:172.21.15.178:3300/0 conn(0x7f4fd80c6ff0 msgr2=0x7f4fd8157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:35.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fdeaf4640 1 --2- 172.21.15.167:0/1662308565 >> v2:172.21.15.178:3300/0 conn(0x7f4fd80c6ff0 0x7f4fd8157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fdeaf4640 1 -- 172.21.15.167:0/1662308565 >> v1:172.21.15.178:6789/0 conn(0x7f4fd8150b40 legacy=0x7f4fd80c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.844+0000 7f4fdeaf4640 1 -- 172.21.15.167:0/1662308565 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80c6500 con 0x7f4fd80c4510 2023-11-28T20:38:35.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fdeaf4640 1 --2- 172.21.15.167:0/1662308565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c4510 0x7f4fd806a580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4fd806bba0 tx=0x7f4fd001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f014113faab636b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:35.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fdd2f1640 1 -- 172.21.15.167:0/1662308565 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00a5770 con 0x7f4fd80c4510 2023-11-28T20:38:35.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fdd2f1640 1 -- 172.21.15.167:0/1662308565 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd00a58d0 con 0x7f4fd80c4510 2023-11-28T20:38:35.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fdd2f1640 1 -- 172.21.15.167:0/1662308565 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00a5c60 con 0x7f4fd80c4510 2023-11-28T20:38:35.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 -- 172.21.15.167:0/1662308565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c4510 msgr2=0x7f4fd806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 --2- 172.21.15.167:0/1662308565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c4510 0x7f4fd806a580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4fd806bba0 tx=0x7f4fd001c9a0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 -- 172.21.15.167:0/1662308565 shutdown_connections 2023-11-28T20:38:35.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 --2- 172.21.15.167:0/1662308565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c4510 0x7f4fd806a580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 --2- 172.21.15.167:0/1662308565 >> v2:172.21.15.178:3300/0 conn(0x7f4fd80c6ff0 0x7f4fd8157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 -- 172.21.15.167:0/1662308565 >> 172.21.15.167:0/1662308565 conn(0x7f4fd80cb1e0 msgr2=0x7f4fd80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:35.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 -- 172.21.15.167:0/1662308565 shutdown_connections 2023-11-28T20:38:35.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 -- 172.21.15.167:0/1662308565 wait complete. 2023-11-28T20:38:35.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 Processor -- start 2023-11-28T20:38:35.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.848+0000 7f4fe0557640 1 -- start start 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fe0557640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd80c4510 0x7f4fd8146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fe0557640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c6ff0 0x7f4fd8146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fe0557640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd8150b40 0x7f4fd81439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fe0557640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81f0e20 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fe0557640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81458b0 con 0x7f4fd80c4510 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fe0557640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8145b90 con 0x7f4fd8150b40 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fddaf2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c6ff0 0x7f4fd8146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fddaf2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c6ff0 0x7f4fd8146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48750/0 (socket says 172.21.15.167:48750) 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fddaf2640 1 -- 172.21.15.167:0/619194948 learned_addr learned my addr 172.21.15.167:0/619194948 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:35.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fde2f3640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd80c4510 0x7f4fd8146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fdeaf4640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd8150b40 0x7f4fd81439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fddaf2640 1 -- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd8150b40 msgr2=0x7f4fd81439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fddaf2640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd8150b40 0x7f4fd81439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fddaf2640 1 -- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd80c4510 msgr2=0x7f4fd8146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fddaf2640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd80c4510 0x7f4fd8146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fddaf2640 1 -- 172.21.15.167:0/619194948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd0009b30 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fddaf2640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c6ff0 0x7f4fd8146bb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800e930 tx=0x7f4fc800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fceffd640 1 -- 172.21.15.167:0/619194948 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8009690 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fceffd640 1 -- 172.21.15.167:0/619194948 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc800ca00 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd8145e70 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fceffd640 1 -- 172.21.15.167:0/619194948 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800cd70 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd81f1100 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd80682c0 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.852+0000 7f4fceffd640 1 -- 172.21.15.167:0/619194948 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fc8013470 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.856+0000 7f4fceffd640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fbc0664a0 0x7f4fbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:35.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.856+0000 7f4fceffd640 1 -- 172.21.15.167:0/619194948 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4fc8084400 con 0x7f4fd80c6ff0 2023-11-28T20:38:35.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.856+0000 7f4fde2f3640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fbc0664a0 0x7f4fbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:35.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.856+0000 7f4fde2f3640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fbc0664a0 0x7f4fbc068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4007fd0 tx=0x7f4fd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:35.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:35.860+0000 7f4fceffd640 1 -- 172.21.15.167:0/619194948 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fc8051660 con 0x7f4fd80c6ff0 2023-11-28T20:38:36.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.020+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4fd8075c90 con 0x7f4fd80c6ff0 2023-11-28T20:38:36.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.020+0000 7f4fceffd640 1 -- 172.21.15.167:0/619194948 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4fc8054c80 con 0x7f4fd80c6ff0 2023-11-28T20:38:36.025 INFO:teuthology.orchestra.run.smithi167.stderr:listed 0 entries 2023-11-28T20:38:36.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fbc0664a0 msgr2=0x7f4fbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fbc0664a0 0x7f4fbc068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4007fd0 tx=0x7f4fd4009040 comp rx=0 tx=0).stop 2023-11-28T20:38:36.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c6ff0 msgr2=0x7f4fd8146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c6ff0 0x7f4fd8146bb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800e930 tx=0x7f4fc800edf0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 shutdown_connections 2023-11-28T20:38:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fbc0664a0 0x7f4fbc068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd8150b40 0x7f4fd81439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd80c6ff0 0x7f4fd8146bb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 --2- 172.21.15.167:0/619194948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd80c4510 0x7f4fd8146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 >> 172.21.15.167:0/619194948 conn(0x7f4fd80cb1e0 msgr2=0x7f4fd80705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:36.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 shutdown_connections 2023-11-28T20:38:36.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.024+0000 7f4fe0557640 1 -- 172.21.15.167:0/619194948 wait complete. 2023-11-28T20:38:36.045 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:38:36.046 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:38:36.056 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:36.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79e68d6640 1 Processor -- start 2023-11-28T20:38:36.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79e68d6640 1 -- start start 2023-11-28T20:38:36.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79e68d6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f79e006e030 0x7f79e01500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79e68d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e0070480 0x7f79e01505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79e68d6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e01571d0 con 0x7f79e006e410 2023-11-28T20:38:36.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79e68d6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e0071a90 con 0x7f79e006e030 2023-11-28T20:38:36.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79e68d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00c70d0 con 0x7f79e0070480 2023-11-28T20:38:36.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79dffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f79e006e030 0x7f79e01500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79dffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f79e006e030 0x7f79e01500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48754/0 (socket says 172.21.15.167:48754) 2023-11-28T20:38:36.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79dffff640 1 -- 172.21.15.167:0/136216791 learned_addr learned my addr 172.21.15.167:0/136216791 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:36.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79df7fe640 1 --2- 172.21.15.167:0/136216791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e0070480 0x7f79e01505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79dffff640 1 -- 172.21.15.167:0/136216791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e0070480 msgr2=0x7f79e01505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:36.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79dffff640 1 --2- 172.21.15.167:0/136216791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e0070480 0x7f79e01505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79dffff640 1 -- 172.21.15.167:0/136216791 >> v1:172.21.15.178:6789/0 conn(0x7f79e006e410 legacy=0x7f79e0071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.236+0000 7f79dffff640 1 -- 172.21.15.167:0/136216791 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00c73b0 con 0x7f79e006e030 2023-11-28T20:38:36.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79dffff640 1 --2- 172.21.15.167:0/136216791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e030 0x7f79e01500b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79d000aa10 tx=0x7f79d001e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9172b4e53dbc1b94 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:36.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79deffd640 1 -- 172.21.15.167:0/136216791 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00a7ac0 con 0x7f79e006e030 2023-11-28T20:38:36.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79deffd640 1 -- 172.21.15.167:0/136216791 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00a7c20 con 0x7f79e006e030 2023-11-28T20:38:36.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79deffd640 1 -- 172.21.15.167:0/136216791 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00af440 con 0x7f79e006e030 2023-11-28T20:38:36.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79e68d6640 1 -- 172.21.15.167:0/136216791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e030 msgr2=0x7f79e01500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79e68d6640 1 --2- 172.21.15.167:0/136216791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e030 0x7f79e01500b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79d000aa10 tx=0x7f79d001e9f0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79e68d6640 1 -- 172.21.15.167:0/136216791 shutdown_connections 2023-11-28T20:38:36.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79e68d6640 1 --2- 172.21.15.167:0/136216791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e0070480 0x7f79e01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79e68d6640 1 --2- 172.21.15.167:0/136216791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e030 0x7f79e01500b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79e68d6640 1 -- 172.21.15.167:0/136216791 >> 172.21.15.167:0/136216791 conn(0x7f79e00cb1e0 msgr2=0x7f79e00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:36.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79e68d6640 1 -- 172.21.15.167:0/136216791 shutdown_connections 2023-11-28T20:38:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.240+0000 7f79e68d6640 1 -- 172.21.15.167:0/136216791 wait complete. 2023-11-28T20:38:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 Processor -- start 2023-11-28T20:38:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 -- start start 2023-11-28T20:38:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e006e030 0x7f79e0142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e410 0x7f79e014dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0070480 0x7f79e014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e01e9c70 con 0x7f79e006e410 2023-11-28T20:38:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e0150d10 con 0x7f79e0070480 2023-11-28T20:38:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e01549d0 con 0x7f79e006e030 2023-11-28T20:38:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79df7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e410 0x7f79e014dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79df7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e410 0x7f79e014dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48760/0 (socket says 172.21.15.167:48760) 2023-11-28T20:38:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79df7fe640 1 -- 172.21.15.167:0/783158005 learned_addr learned my addr 172.21.15.167:0/783158005 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:36.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79dffff640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e006e030 0x7f79e0142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e4e73640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0070480 0x7f79e014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79df7fe640 1 -- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e006e030 msgr2=0x7f79e0142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79df7fe640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e006e030 0x7f79e0142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79df7fe640 1 -- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0070480 msgr2=0x7f79e014e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79df7fe640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0070480 0x7f79e014e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79df7fe640 1 -- 172.21.15.167:0/783158005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d000a670 con 0x7f79e006e410 2023-11-28T20:38:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e4e73640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0070480 0x7f79e014e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79df7fe640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e410 0x7f79e014dfa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79d400e930 tx=0x7f79d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79dcff9640 1 -- 172.21.15.167:0/783158005 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4009690 con 0x7f79e006e410 2023-11-28T20:38:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79dcff9640 1 -- 172.21.15.167:0/783158005 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d400ca00 con 0x7f79e006e410 2023-11-28T20:38:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79dcff9640 1 -- 172.21.15.167:0/783158005 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d400cd70 con 0x7f79e006e410 2023-11-28T20:38:36.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e0154cb0 con 0x7f79e006e410 2023-11-28T20:38:36.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.244+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e01f3ff0 con 0x7f79e006e410 2023-11-28T20:38:36.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.248+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e00682c0 con 0x7f79e006e410 2023-11-28T20:38:36.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.248+0000 7f79dcff9640 1 -- 172.21.15.167:0/783158005 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f79d4013470 con 0x7f79e006e410 2023-11-28T20:38:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.248+0000 7f79dcff9640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79cc066470 0x7f79cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.248+0000 7f79dcff9640 1 -- 172.21.15.167:0/783158005 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79d4084320 con 0x7f79e006e410 2023-11-28T20:38:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.248+0000 7f79dffff640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79cc066470 0x7f79cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.248+0000 7f79dffff640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79cc066470 0x7f79cc068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79d00b1000 tx=0x7f79d00a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.252+0000 7f79dcff9640 1 -- 172.21.15.167:0/783158005 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79d4051610 con 0x7f79e006e410 2023-11-28T20:38:36.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.404+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79e0075c90 con 0x7f79e006e410 2023-11-28T20:38:36.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.404+0000 7f79dcff9640 1 -- 172.21.15.167:0/783158005 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7f79d4054c30 con 0x7f79e006e410 2023-11-28T20:38:36.408 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:36.409 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:36.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79cc066470 msgr2=0x7f79cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79cc066470 0x7f79cc068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79d00b1000 tx=0x7f79d00a9070 comp rx=0 tx=0).stop 2023-11-28T20:38:36.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e410 msgr2=0x7f79e014dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e410 0x7f79e014dfa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79d400e930 tx=0x7f79d400edf0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 shutdown_connections 2023-11-28T20:38:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79cc066470 0x7f79cc068930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0070480 0x7f79e014e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79e006e410 0x7f79e014dfa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 --2- 172.21.15.167:0/783158005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e006e030 0x7f79e0142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 >> 172.21.15.167:0/783158005 conn(0x7f79e00cb1e0 msgr2=0x7f79e00cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:36.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 shutdown_connections 2023-11-28T20:38:36.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.408+0000 7f79e68d6640 1 -- 172.21.15.167:0/783158005 wait complete. 2023-11-28T20:38:36.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:38:05.507993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:38:17.477871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:38:17.884061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T20:38:21.578587+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T20:38:36.432 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:38:36.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f6126972640 1 Processor -- start 2023-11-28T20:38:36.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f6126972640 1 -- start start 2023-11-28T20:38:36.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f6126972640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f612006e030 0x7f61201500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f6126972640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61201571d0 con 0x7f6120072630 2023-11-28T20:38:36.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f6126972640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6120071a90 con 0x7f6120070480 2023-11-28T20:38:36.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f6126972640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61200c70d0 con 0x7f612006e030 2023-11-28T20:38:36.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f6124f0f640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6120072630 0x7f6120160b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34676/0 (socket says 172.21.15.167:34676) 2023-11-28T20:38:36.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f6124f0f640 1 -- 172.21.15.167:0/224136651 learned_addr learned my addr 172.21.15.167:0/224136651 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f611ffff640 1 --2- 172.21.15.167:0/224136651 >> v2:172.21.15.178:3300/0 conn(0x7f612006e030 0x7f61201500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f611effd640 1 -- 172.21.15.167:0/224136651 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717816105 0 0) 0x7f61201571d0 con 0x7f6120072630 2023-11-28T20:38:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f611effd640 1 -- 172.21.15.167:0/224136651 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6108003530 con 0x7f6120072630 2023-11-28T20:38:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f611effd640 1 -- 172.21.15.167:0/224136651 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4011343823 0 0) 0x7f6108003530 con 0x7f6120072630 2023-11-28T20:38:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f611ffff640 1 -- 172.21.15.167:0/224136651 >> v1:172.21.15.178:6789/0 conn(0x7f6120070480 legacy=0x7f6120071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f611ffff640 1 -- 172.21.15.167:0/224136651 >> v1:172.21.15.167:6789/0 conn(0x7f6120072630 legacy=0x7f6120160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.572+0000 7f611ffff640 1 -- 172.21.15.167:0/224136651 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61200c73b0 con 0x7f612006e030 2023-11-28T20:38:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f611ffff640 1 --2- 172.21.15.167:0/224136651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612006e030 0x7f61201500b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61100097c0 tx=0x7f611001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a1543fd8bf10e3e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f611effd640 1 -- 172.21.15.167:0/224136651 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118001a00 con 0x7f612006e030 2023-11-28T20:38:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f611effd640 1 -- 172.21.15.167:0/224136651 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61100a7050 con 0x7f612006e030 2023-11-28T20:38:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f611effd640 1 -- 172.21.15.167:0/224136651 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100ab600 con 0x7f612006e030 2023-11-28T20:38:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f6126972640 1 -- 172.21.15.167:0/224136651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612006e030 msgr2=0x7f61201500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f6126972640 1 --2- 172.21.15.167:0/224136651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612006e030 0x7f61201500b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f61100097c0 tx=0x7f611001c370 comp rx=0 tx=0).stop 2023-11-28T20:38:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f6126972640 1 -- 172.21.15.167:0/224136651 shutdown_connections 2023-11-28T20:38:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f6126972640 1 --2- 172.21.15.167:0/224136651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612006e030 0x7f61201500b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f6126972640 1 -- 172.21.15.167:0/224136651 >> 172.21.15.167:0/224136651 conn(0x7f61200cb1e0 msgr2=0x7f61200cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f6126972640 1 -- 172.21.15.167:0/224136651 shutdown_connections 2023-11-28T20:38:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.576+0000 7f6126972640 1 -- 172.21.15.167:0/224136651 wait complete. 2023-11-28T20:38:36.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 Processor -- start 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 -- start start 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612006e030 0x7f612014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6120070480 0x7f61201f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120072630 0x7f6120164510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612014b960 con 0x7f6120072630 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61201f8730 con 0x7f612006e030 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612014ace0 con 0x7f6120070480 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6124f0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120072630 0x7f6120164510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6124f0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120072630 0x7f6120164510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48766/0 (socket says 172.21.15.167:48766) 2023-11-28T20:38:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6124f0f640 1 -- 172.21.15.167:0/1356793031 learned_addr learned my addr 172.21.15.167:0/1356793031 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f611f7fe640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6120070480 0x7f61201f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f611ffff640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612006e030 0x7f612014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6124f0f640 1 -- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6120070480 msgr2=0x7f61201f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6124f0f640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6120070480 0x7f61201f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6124f0f640 1 -- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612006e030 msgr2=0x7f612014bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6124f0f640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612006e030 0x7f612014bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6124f0f640 1 -- 172.21.15.167:0/1356793031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009420 con 0x7f6120072630 2023-11-28T20:38:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6124f0f640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120072630 0x7f6120164510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6118001570 tx=0x7f611800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f611cff9640 1 -- 172.21.15.167:0/1356793031 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800ce90 con 0x7f6120072630 2023-11-28T20:38:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f611cff9640 1 -- 172.21.15.167:0/1356793031 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118012400 con 0x7f6120072630 2023-11-28T20:38:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612014afc0 con 0x7f6120072630 2023-11-28T20:38:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f611cff9640 1 -- 172.21.15.167:0/1356793031 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61180127f0 con 0x7f6120072630 2023-11-28T20:38:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.580+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612014b580 con 0x7f6120072630 2023-11-28T20:38:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.584+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61200682c0 con 0x7f6120072630 2023-11-28T20:38:36.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.584+0000 7f611cff9640 1 -- 172.21.15.167:0/1356793031 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6118012950 con 0x7f6120072630 2023-11-28T20:38:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.584+0000 7f611cff9640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f610c066470 0x7f610c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.584+0000 7f611cff9640 1 -- 172.21.15.167:0/1356793031 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61180849d0 con 0x7f6120072630 2023-11-28T20:38:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.584+0000 7f611ffff640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f610c066470 0x7f610c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.584+0000 7f611ffff640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f610c066470 0x7f610c068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61100ad000 tx=0x7f61100a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.588+0000 7f611cff9640 1 -- 172.21.15.167:0/1356793031 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6118051a30 con 0x7f6120072630 2023-11-28T20:38:36.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6120075c90 con 0x7f6120072630 2023-11-28T20:38:36.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f611cff9640 1 -- 172.21.15.167:0/1356793031 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6118055050 con 0x7f6120072630 2023-11-28T20:38:36.744 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2023-11-28T20:38:36.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f610c066470 msgr2=0x7f610c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f610c066470 0x7f610c068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61100ad000 tx=0x7f61100a6000 comp rx=0 tx=0).stop 2023-11-28T20:38:36.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120072630 msgr2=0x7f6120164510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120072630 0x7f6120164510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6118001570 tx=0x7f611800a430 comp rx=0 tx=0).stop 2023-11-28T20:38:36.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 shutdown_connections 2023-11-28T20:38:36.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f610c066470 0x7f610c068930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120072630 0x7f6120164510 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6120070480 0x7f61201f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 --2- 172.21.15.167:0/1356793031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612006e030 0x7f612014bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 >> 172.21.15.167:0/1356793031 conn(0x7f61200cb1e0 msgr2=0x7f61200c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:36.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 shutdown_connections 2023-11-28T20:38:36.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.740+0000 7f6126972640 1 -- 172.21.15.167:0/1356793031 wait complete. 2023-11-28T20:38:36.764 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:38:36.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.900+0000 7f7608046640 1 Processor -- start 2023-11-28T20:38:36.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.900+0000 7f7608046640 1 -- start start 2023-11-28T20:38:36.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.900+0000 7f7608046640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7600070480 0x7f7600071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.900+0000 7f7608046640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f760006e410 0x7f7600072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.900+0000 7f7608046640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76001571d0 con 0x7f760006e030 2023-11-28T20:38:36.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.900+0000 7f7608046640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7600071a90 con 0x7f760006e410 2023-11-28T20:38:36.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.900+0000 7f7608046640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76000c70d0 con 0x7f7600070480 2023-11-28T20:38:36.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f7605de2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f760006e030 0x7f76001500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34690/0 (socket says 172.21.15.167:34690) 2023-11-28T20:38:36.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f7605de2640 1 -- 172.21.15.167:0/4155152617 learned_addr learned my addr 172.21.15.167:0/4155152617 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f76065e3640 1 --2- 172.21.15.167:0/4155152617 >> v2:172.21.15.167:3300/0 conn(0x7f760006e410 0x7f7600072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f76055e1640 1 --2- 172.21.15.167:0/4155152617 >> v2:172.21.15.178:3300/0 conn(0x7f7600070480 0x7f7600071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f7604de0640 1 -- 172.21.15.167:0/4155152617 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756851008 0 0) 0x7f76001571d0 con 0x7f760006e030 2023-11-28T20:38:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f7604de0640 1 -- 172.21.15.167:0/4155152617 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ec003530 con 0x7f760006e030 2023-11-28T20:38:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f76065e3640 1 -- 172.21.15.167:0/4155152617 >> v2:172.21.15.178:3300/0 conn(0x7f7600070480 msgr2=0x7f7600071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f76065e3640 1 --2- 172.21.15.167:0/4155152617 >> v2:172.21.15.178:3300/0 conn(0x7f7600070480 0x7f7600071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f76065e3640 1 -- 172.21.15.167:0/4155152617 >> v1:172.21.15.167:6789/0 conn(0x7f760006e030 legacy=0x7f76001500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f76065e3640 1 -- 172.21.15.167:0/4155152617 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000c73b0 con 0x7f760006e410 2023-11-28T20:38:36.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f76065e3640 1 --2- 172.21.15.167:0/4155152617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f760006e410 0x7f7600072460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f760006b790 tx=0x7f75f801da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40733aaa18553bd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:36.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f7604de0640 1 -- 172.21.15.167:0/4155152617 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800a2d0 con 0x7f760006e410 2023-11-28T20:38:36.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f7604de0640 1 -- 172.21.15.167:0/4155152617 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f80a68c0 con 0x7f760006e410 2023-11-28T20:38:36.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.904+0000 7f7604de0640 1 -- 172.21.15.167:0/4155152617 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80a6c50 con 0x7f760006e410 2023-11-28T20:38:36.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 -- 172.21.15.167:0/4155152617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f760006e410 msgr2=0x7f7600072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 --2- 172.21.15.167:0/4155152617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f760006e410 0x7f7600072460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f760006b790 tx=0x7f75f801da00 comp rx=0 tx=0).stop 2023-11-28T20:38:36.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 -- 172.21.15.167:0/4155152617 shutdown_connections 2023-11-28T20:38:36.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 --2- 172.21.15.167:0/4155152617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f760006e410 0x7f7600072460 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 --2- 172.21.15.167:0/4155152617 >> v2:172.21.15.178:3300/0 conn(0x7f7600070480 0x7f7600071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 -- 172.21.15.167:0/4155152617 >> 172.21.15.167:0/4155152617 conn(0x7f76000cb1e0 msgr2=0x7f76000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:36.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 -- 172.21.15.167:0/4155152617 shutdown_connections 2023-11-28T20:38:36.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 -- 172.21.15.167:0/4155152617 wait complete. 2023-11-28T20:38:36.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 Processor -- start 2023-11-28T20:38:36.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 -- start start 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f760006e030 0x7f760014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f760006e410 0x7f76001f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7600070480 0x7f76001433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760014dfc0 con 0x7f7600070480 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600155040 con 0x7f760006e030 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7608046640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76001552e0 con 0x7f760006e410 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76065e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7600070480 0x7f76001433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76065e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7600070480 0x7f76001433a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48778/0 (socket says 172.21.15.167:48778) 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76065e3640 1 -- 172.21.15.167:0/3444006867 learned_addr learned my addr 172.21.15.167:0/3444006867 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:36.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f7605de2640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f760006e030 0x7f760014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76055e1640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f760006e410 0x7f76001f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76065e3640 1 -- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f760006e410 msgr2=0x7f76001f0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76065e3640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f760006e410 0x7f76001f0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76065e3640 1 -- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f760006e030 msgr2=0x7f760014d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76065e3640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f760006e030 0x7f760014d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76065e3640 1 -- 172.21.15.167:0/3444006867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f800ab80 con 0x7f7600070480 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.908+0000 7f76055e1640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f760006e410 0x7f76001f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f76065e3640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7600070480 0x7f76001433a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75f80b0040 tx=0x7f75f801a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f75f67fc640 1 -- 172.21.15.167:0/3444006867 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80b7680 con 0x7f7600070480 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f75f67fc640 1 -- 172.21.15.167:0/3444006867 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f80b7800 con 0x7f7600070480 2023-11-28T20:38:36.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f75f67fc640 1 -- 172.21.15.167:0/3444006867 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80b7bb0 con 0x7f7600070480 2023-11-28T20:38:36.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76001555c0 con 0x7f7600070480 2023-11-28T20:38:36.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76001f4500 con 0x7f7600070480 2023-11-28T20:38:36.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76000682c0 con 0x7f7600070480 2023-11-28T20:38:36.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f75f67fc640 1 -- 172.21.15.167:0/3444006867 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75f80b7d10 con 0x7f7600070480 2023-11-28T20:38:36.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f75f67fc640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f75e4066470 0x7f75e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:36.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f75f67fc640 1 -- 172.21.15.167:0/3444006867 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75f811f7a0 con 0x7f7600070480 2023-11-28T20:38:36.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.912+0000 7f7605de2640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f75e4066470 0x7f75e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:36.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.916+0000 7f7605de2640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f75e4066470 0x7f75e4068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0011f0 tx=0x7f75fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:36.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:36.916+0000 7f75f67fc640 1 -- 172.21.15.167:0/3444006867 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75f80eca70 con 0x7f7600070480 2023-11-28T20:38:37.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.064+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7600075c90 con 0x7f7600070480 2023-11-28T20:38:37.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.064+0000 7f75f67fc640 1 -- 172.21.15.167:0/3444006867 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75f80f0090 con 0x7f7600070480 2023-11-28T20:38:37.070 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:38:37.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f75e4066470 msgr2=0x7f75e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f75e4066470 0x7f75e4068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0011f0 tx=0x7f75fc009040 comp rx=0 tx=0).stop 2023-11-28T20:38:37.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7600070480 msgr2=0x7f76001433a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7600070480 0x7f76001433a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75f80b0040 tx=0x7f75f801a7a0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 shutdown_connections 2023-11-28T20:38:37.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f75e4066470 0x7f75e4068930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7600070480 0x7f76001433a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f760006e410 0x7f76001f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 --2- 172.21.15.167:0/3444006867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f760006e030 0x7f760014d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 >> 172.21.15.167:0/3444006867 conn(0x7f76000cb1e0 msgr2=0x7f760014e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:37.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 shutdown_connections 2023-11-28T20:38:37.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.068+0000 7f7608046640 1 -- 172.21.15.167:0/3444006867 wait complete. 2023-11-28T20:38:37.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:38:37.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c486d6640 1 Processor -- start 2023-11-28T20:38:37.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c486d6640 1 -- start start 2023-11-28T20:38:37.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c486d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c400c75c0 0x7f8c400c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c486d6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c4006a580 0x7f8c4006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c486d6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4015b220 con 0x7f8c40151f60 2023-11-28T20:38:37.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c486d6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c400c4da0 con 0x7f8c4006a580 2023-11-28T20:38:37.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c486d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400c2df0 con 0x7f8c400c75c0 2023-11-28T20:38:37.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c45c71640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c400c75c0 0x7f8c400c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c46c73640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c4006a580 0x7f8c4006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c46472640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f8c40151f60 0x7f8c400c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:44596/0 (socket says 172.21.15.167:44596) 2023-11-28T20:38:37.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c46472640 1 -- 172.21.15.167:0/1823451680 learned_addr learned my addr 172.21.15.167:0/1823451680 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:37.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c46c73640 1 -- 172.21.15.167:0/1823451680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c400c75c0 msgr2=0x7f8c400c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:37.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c46c73640 1 --2- 172.21.15.167:0/1823451680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c400c75c0 0x7f8c400c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c46c73640 1 -- 172.21.15.167:0/1823451680 >> v1:172.21.15.178:6789/0 conn(0x7f8c40151f60 legacy=0x7f8c400c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.228+0000 7f8c46c73640 1 -- 172.21.15.167:0/1823451680 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c400c7a20 con 0x7f8c4006a580 2023-11-28T20:38:37.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c46c73640 1 --2- 172.21.15.167:0/1823451680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c4006a580 0x7f8c4006a9b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009dc0 tx=0x7f8c3801c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=767553b6c7c299a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:37.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c45470640 1 -- 172.21.15.167:0/1823451680 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c380a5870 con 0x7f8c4006a580 2023-11-28T20:38:37.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c45470640 1 -- 172.21.15.167:0/1823451680 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c380a59d0 con 0x7f8c4006a580 2023-11-28T20:38:37.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c45470640 1 -- 172.21.15.167:0/1823451680 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c380a5d60 con 0x7f8c4006a580 2023-11-28T20:38:37.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c486d6640 1 -- 172.21.15.167:0/1823451680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c4006a580 msgr2=0x7f8c4006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c486d6640 1 --2- 172.21.15.167:0/1823451680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c4006a580 0x7f8c4006a9b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009dc0 tx=0x7f8c3801c8a0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c486d6640 1 -- 172.21.15.167:0/1823451680 shutdown_connections 2023-11-28T20:38:37.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c486d6640 1 --2- 172.21.15.167:0/1823451680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c4006a580 0x7f8c4006a9b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c486d6640 1 --2- 172.21.15.167:0/1823451680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c400c75c0 0x7f8c400c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c486d6640 1 -- 172.21.15.167:0/1823451680 >> 172.21.15.167:0/1823451680 conn(0x7f8c400cb1e0 msgr2=0x7f8c400cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:37.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c486d6640 1 -- 172.21.15.167:0/1823451680 shutdown_connections 2023-11-28T20:38:37.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.232+0000 7f8c486d6640 1 -- 172.21.15.167:0/1823451680 wait complete. 2023-11-28T20:38:37.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 Processor -- start 2023-11-28T20:38:37.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 -- start start 2023-11-28T20:38:37.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c4006a580 0x7f8c40145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c400c75c0 0x7f8c4015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c40151f60 0x7f8c4015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400cab50 con 0x7f8c400c75c0 2023-11-28T20:38:37.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40156270 con 0x7f8c4006a580 2023-11-28T20:38:37.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40156550 con 0x7f8c40151f60 2023-11-28T20:38:37.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c45c71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c400c75c0 0x7f8c4015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c45c71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c400c75c0 0x7f8c4015a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48780/0 (socket says 172.21.15.167:48780) 2023-11-28T20:38:37.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c45c71640 1 -- 172.21.15.167:0/3998219597 learned_addr learned my addr 172.21.15.167:0/3998219597 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:37.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c46472640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c4006a580 0x7f8c40145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c46c73640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c40151f60 0x7f8c4015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c45c71640 1 -- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c40151f60 msgr2=0x7f8c4015a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c45c71640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c40151f60 0x7f8c4015a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c45c71640 1 -- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c4006a580 msgr2=0x7f8c40145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c45c71640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c4006a580 0x7f8c40145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c45c71640 1 -- 172.21.15.167:0/3998219597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38009a70 con 0x7f8c400c75c0 2023-11-28T20:38:37.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c46c73640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c40151f60 0x7f8c4015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:37.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c45c71640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c400c75c0 0x7f8c4015a2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000e930 tx=0x7f8c3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:37.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c36ffd640 1 -- 172.21.15.167:0/3998219597 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30009690 con 0x7f8c400c75c0 2023-11-28T20:38:37.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c36ffd640 1 -- 172.21.15.167:0/3998219597 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000ca00 con 0x7f8c400c75c0 2023-11-28T20:38:37.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c36ffd640 1 -- 172.21.15.167:0/3998219597 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000cd70 con 0x7f8c400c75c0 2023-11-28T20:38:37.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c40156830 con 0x7f8c400c75c0 2023-11-28T20:38:37.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.236+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c40145fe0 con 0x7f8c400c75c0 2023-11-28T20:38:37.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.240+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c400682c0 con 0x7f8c400c75c0 2023-11-28T20:38:37.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.240+0000 7f8c36ffd640 1 -- 172.21.15.167:0/3998219597 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8c30013470 con 0x7f8c400c75c0 2023-11-28T20:38:37.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.240+0000 7f8c36ffd640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c24066470 0x7f8c24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.240+0000 7f8c36ffd640 1 -- 172.21.15.167:0/3998219597 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c30084320 con 0x7f8c400c75c0 2023-11-28T20:38:37.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.240+0000 7f8c46472640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c24066470 0x7f8c24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.240+0000 7f8c46472640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c24066470 0x7f8c24068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c005890 tx=0x7f8c3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:37.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.244+0000 7f8c36ffd640 1 -- 172.21.15.167:0/3998219597 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c30051610 con 0x7f8c400c75c0 2023-11-28T20:38:37.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.396+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c40075c90 con 0x7f8c400c75c0 2023-11-28T20:38:37.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.396+0000 7f8c36ffd640 1 -- 172.21.15.167:0/3998219597 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c30054c30 con 0x7f8c400c75c0 2023-11-28T20:38:37.401 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2023-11-28T20:38:37.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c24066470 msgr2=0x7f8c24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c24066470 0x7f8c24068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c005890 tx=0x7f8c3c009040 comp rx=0 tx=0).stop 2023-11-28T20:38:37.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c400c75c0 msgr2=0x7f8c4015a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c400c75c0 0x7f8c4015a2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000e930 tx=0x7f8c3000edf0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 shutdown_connections 2023-11-28T20:38:37.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c24066470 0x7f8c24068930 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c40151f60 0x7f8c4015a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c400c75c0 0x7f8c4015a2b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 --2- 172.21.15.167:0/3998219597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c4006a580 0x7f8c40145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 >> 172.21.15.167:0/3998219597 conn(0x7f8c400cb1e0 msgr2=0x7f8c40150a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:37.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 shutdown_connections 2023-11-28T20:38:37.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.400+0000 7f8c486d6640 1 -- 172.21.15.167:0/3998219597 wait complete. 2023-11-28T20:38:37.422 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T20:38:37.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.560+0000 7fef7a679640 1 Processor -- start 2023-11-28T20:38:37.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.560+0000 7fef7a679640 1 -- start start 2023-11-28T20:38:37.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef7a679640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef74150b40 0x7fef74157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef7a679640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef740c4510 0x7fef7406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef7a679640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef740c4920 con 0x7fef740c6ff0 2023-11-28T20:38:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef7a679640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef740c62f0 con 0x7fef74150b40 2023-11-28T20:38:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef7a679640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c6ac0 con 0x7fef740c4510 2023-11-28T20:38:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef6bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fef740c6ff0 0x7fef740c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34694/0 (socket says 172.21.15.167:34694) 2023-11-28T20:38:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef6bfff640 1 -- 172.21.15.167:0/3713021655 learned_addr learned my addr 172.21.15.167:0/3713021655 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef73fff640 1 --2- 172.21.15.167:0/3713021655 >> v2:172.21.15.178:3300/0 conn(0x7fef74150b40 0x7fef74157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef78c16640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef740c4510 0x7fef7406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747917222 0 0) 0x7fef740c4920 con 0x7fef740c6ff0 2023-11-28T20:38:37.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef60005740 con 0x7fef740c6ff0 2023-11-28T20:38:37.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1331314534 0 0) 0x7fef60005740 con 0x7fef740c6ff0 2023-11-28T20:38:37.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef740c4510 msgr2=0x7fef7406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:37.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef740c4510 0x7fef7406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 >> v2:172.21.15.178:3300/0 conn(0x7fef74150b40 msgr2=0x7fef74157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:37.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 --2- 172.21.15.167:0/3713021655 >> v2:172.21.15.178:3300/0 conn(0x7fef74150b40 0x7fef74157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740c6500 con 0x7fef740c6ff0 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fef5c0016a0 con 0x7fef740c6ff0 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 >> v1:172.21.15.167:6789/0 conn(0x7fef740c6ff0 legacy=0x7fef740c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef60005b90 0x7fef60005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef740c4510 0x7fef600069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60006f20 0x7fef600073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c62f0 con 0x7fef60006f20 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c6ac0 con 0x7fef60005b90 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6000dba0 con 0x7fef740c4510 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef78c16640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60006f20 0x7fef600073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef73fff640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef60005b90 0x7fef60005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef6bfff640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef740c4510 0x7fef600069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef78c16640 1 -- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef740c4510 msgr2=0x7fef600069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef78c16640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef740c4510 0x7fef600069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef78c16640 1 -- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef60005b90 msgr2=0x7fef60005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef78c16640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef60005b90 0x7fef60005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.564+0000 7fef78c16640 1 -- 172.21.15.167:0/3713021655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60005740 con 0x7fef60006f20 2023-11-28T20:38:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef78c16640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60006f20 0x7fef600073a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009fc0 tx=0x7fef6c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a494ea03c6ce2585 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0a5c70 con 0x7fef60006f20 2023-11-28T20:38:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c00f040 con 0x7fef60006f20 2023-11-28T20:38:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef737fe640 1 -- 172.21.15.167:0/3713021655 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0ad440 con 0x7fef60006f20 2023-11-28T20:38:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef7a679640 1 -- 172.21.15.167:0/3713021655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60006f20 msgr2=0x7fef600073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef7a679640 1 --2- 172.21.15.167:0/3713021655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60006f20 0x7fef600073a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009fc0 tx=0x7fef6c01cc60 comp rx=0 tx=0).stop 2023-11-28T20:38:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef78c16640 1 -- 172.21.15.167:0/3713021655 reap_dead start 2023-11-28T20:38:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef7a679640 1 -- 172.21.15.167:0/3713021655 shutdown_connections 2023-11-28T20:38:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef7a679640 1 -- 172.21.15.167:0/3713021655 >> 172.21.15.167:0/3713021655 conn(0x7fef740cb1e0 msgr2=0x7fef740cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:37.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef7a679640 1 -- 172.21.15.167:0/3713021655 shutdown_connections 2023-11-28T20:38:37.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.568+0000 7fef7a679640 1 -- 172.21.15.167:0/3713021655 wait complete. 2023-11-28T20:38:37.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 Processor -- start 2023-11-28T20:38:37.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 -- start start 2023-11-28T20:38:37.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef60006f20 0x7fef74155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74154ac0 0x7fef74149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef7414a040 0x7fef741595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef740cbb80 con 0x7fef74154ac0 2023-11-28T20:38:37.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef74155d40 con 0x7fef7414a040 2023-11-28T20:38:37.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef741518c0 con 0x7fef60006f20 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef6bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74154ac0 0x7fef74149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef6bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74154ac0 0x7fef74149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48788/0 (socket says 172.21.15.167:48788) 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef6bfff640 1 -- 172.21.15.167:0/1929659935 learned_addr learned my addr 172.21.15.167:0/1929659935 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef78c16640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef7414a040 0x7fef741595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef73fff640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef60006f20 0x7fef74155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef6bfff640 1 -- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef60006f20 msgr2=0x7fef74155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef6bfff640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef60006f20 0x7fef74155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef6bfff640 1 -- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef7414a040 msgr2=0x7fef741595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef6bfff640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef7414a040 0x7fef741595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef6bfff640 1 -- 172.21.15.167:0/1929659935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74158e30 con 0x7fef74154ac0 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef6bfff640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74154ac0 0x7fef74149b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e8b0 tx=0x7fef5c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:37.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef717fa640 1 -- 172.21.15.167:0/1929659935 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c0016a0 con 0x7fef74154ac0 2023-11-28T20:38:37.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef717fa640 1 -- 172.21.15.167:0/1929659935 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c00c870 con 0x7fef74154ac0 2023-11-28T20:38:37.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef717fa640 1 -- 172.21.15.167:0/1929659935 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00cc20 con 0x7fef74154ac0 2023-11-28T20:38:37.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef74152c50 con 0x7fef74154ac0 2023-11-28T20:38:37.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef74153210 con 0x7fef74154ac0 2023-11-28T20:38:37.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.572+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef740682c0 con 0x7fef74154ac0 2023-11-28T20:38:37.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.576+0000 7fef717fa640 1 -- 172.21.15.167:0/1929659935 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef5c00cd80 con 0x7fef74154ac0 2023-11-28T20:38:37.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.576+0000 7fef717fa640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef540664a0 0x7fef54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.576+0000 7fef717fa640 1 -- 172.21.15.167:0/1929659935 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef5c083d40 con 0x7fef74154ac0 2023-11-28T20:38:37.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.576+0000 7fef73fff640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef540664a0 0x7fef54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.576+0000 7fef73fff640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef540664a0 0x7fef54068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef64009b40 tx=0x7fef64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:37.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.580+0000 7fef717fa640 1 -- 172.21.15.167:0/1929659935 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fef5c050ed0 con 0x7fef74154ac0 2023-11-28T20:38:37.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fef740682c0 con 0x7fef74154ac0 2023-11-28T20:38:37.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef717fa640 1 -- 172.21.15.167:0/1929659935 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fef5c0544f0 con 0x7fef74154ac0 2023-11-28T20:38:37.735 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:38:37.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef540664a0 msgr2=0x7fef54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef540664a0 0x7fef54068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef64009b40 tx=0x7fef64008040 comp rx=0 tx=0).stop 2023-11-28T20:38:37.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74154ac0 msgr2=0x7fef74149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74154ac0 0x7fef74149b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e8b0 tx=0x7fef5c00ed70 comp rx=0 tx=0).stop 2023-11-28T20:38:37.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 shutdown_connections 2023-11-28T20:38:37.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef540664a0 0x7fef54068960 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef7414a040 0x7fef741595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74154ac0 0x7fef74149b00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 --2- 172.21.15.167:0/1929659935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef60006f20 0x7fef74155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 >> 172.21.15.167:0/1929659935 conn(0x7fef740cb1e0 msgr2=0x7fef74156280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:37.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 shutdown_connections 2023-11-28T20:38:37.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.732+0000 7fef7a679640 1 -- 172.21.15.167:0/1929659935 wait complete. 2023-11-28T20:38:37.757 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T20:38:37.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca357d8640 1 Processor -- start 2023-11-28T20:38:37.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca357d8640 1 -- start start 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca357d8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fca300cf860 0x7fca300cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca357d8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cfc40 0x7fca300ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca357d8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3015ac00 con 0x7fca30153ae0 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca357d8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca300cbd60 con 0x7fca300cf860 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca357d8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca30159ff0 con 0x7fca300cfc40 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca2effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fca300cf860 0x7fca300cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca2effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fca300cf860 0x7fca300cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48794/0 (socket says 172.21.15.167:48794) 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca2f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fca30153ae0 0x7fca3015d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34706/0 (socket says 172.21.15.167:34706) 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca2effd640 1 -- 172.21.15.167:0/432081511 learned_addr learned my addr 172.21.15.167:0/432081511 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca267fc640 1 --2- 172.21.15.167:0/432081511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cfc40 0x7fca300ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca2effd640 1 -- 172.21.15.167:0/432081511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cfc40 msgr2=0x7fca300ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:37.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca2effd640 1 --2- 172.21.15.167:0/432081511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cfc40 0x7fca300ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca2effd640 1 -- 172.21.15.167:0/432081511 >> v1:172.21.15.167:6789/0 conn(0x7fca30153ae0 legacy=0x7fca3015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.892+0000 7fca2effd640 1 -- 172.21.15.167:0/432081511 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3015a2d0 con 0x7fca300cf860 2023-11-28T20:38:37.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca2effd640 1 --2- 172.21.15.167:0/432081511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca300cf860 0x7fca300cb770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca20009e50 tx=0x7fca2001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84621a1e77bb7ba7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:37.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca2e7fc640 1 -- 172.21.15.167:0/432081511 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200a58a0 con 0x7fca300cf860 2023-11-28T20:38:37.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca2e7fc640 1 -- 172.21.15.167:0/432081511 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca200a5a00 con 0x7fca300cf860 2023-11-28T20:38:37.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca2e7fc640 1 -- 172.21.15.167:0/432081511 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200a5d90 con 0x7fca300cf860 2023-11-28T20:38:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca357d8640 1 -- 172.21.15.167:0/432081511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca300cf860 msgr2=0x7fca300cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca357d8640 1 --2- 172.21.15.167:0/432081511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca300cf860 0x7fca300cb770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca20009e50 tx=0x7fca2001c9e0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca357d8640 1 -- 172.21.15.167:0/432081511 shutdown_connections 2023-11-28T20:38:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca357d8640 1 --2- 172.21.15.167:0/432081511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cfc40 0x7fca300ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca357d8640 1 --2- 172.21.15.167:0/432081511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca300cf860 0x7fca300cb770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca357d8640 1 -- 172.21.15.167:0/432081511 >> 172.21.15.167:0/432081511 conn(0x7fca3006c1f0 msgr2=0x7fca30071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca357d8640 1 -- 172.21.15.167:0/432081511 shutdown_connections 2023-11-28T20:38:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.896+0000 7fca357d8640 1 -- 172.21.15.167:0/432081511 wait complete. 2023-11-28T20:38:37.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 Processor -- start 2023-11-28T20:38:37.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 -- start start 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cf860 0x7fca300b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca300cfc40 0x7fca300b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30153ae0 0x7fca300c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300c7ab0 con 0x7fca30153ae0 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca300cf420 con 0x7fca300cfc40 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300cde60 con 0x7fca300cf860 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30153ae0 0x7fca300c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30153ae0 0x7fca300c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48800/0 (socket says 172.21.15.167:48800) 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2f7fe640 1 -- 172.21.15.167:0/1145089606 learned_addr learned my addr 172.21.15.167:0/1145089606 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2effd640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cf860 0x7fca300b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca267fc640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca300cfc40 0x7fca300b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2f7fe640 1 -- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cf860 msgr2=0x7fca300b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2f7fe640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cf860 0x7fca300b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2f7fe640 1 -- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca300cfc40 msgr2=0x7fca300b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2f7fe640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca300cfc40 0x7fca300b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2f7fe640 1 -- 172.21.15.167:0/1145089606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009b30 con 0x7fca30153ae0 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2effd640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cf860 0x7fca300b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca267fc640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca300cfc40 0x7fca300b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca2f7fe640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30153ae0 0x7fca300c8350 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c410 tx=0x7fca2800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca27fff640 1 -- 172.21.15.167:0/1145089606 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca280074e0 con 0x7fca30153ae0 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca27fff640 1 -- 172.21.15.167:0/1145089606 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca28007640 con 0x7fca30153ae0 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca27fff640 1 -- 172.21.15.167:0/1145089606 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28004a10 con 0x7fca30153ae0 2023-11-28T20:38:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca300ce100 con 0x7fca30153ae0 2023-11-28T20:38:37.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.900+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca300cf140 con 0x7fca30153ae0 2023-11-28T20:38:37.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.904+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca30075c90 con 0x7fca30153ae0 2023-11-28T20:38:37.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.904+0000 7fca27fff640 1 -- 172.21.15.167:0/1145089606 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca28004b70 con 0x7fca30153ae0 2023-11-28T20:38:37.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.904+0000 7fca27fff640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fca10066470 0x7fca10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:37.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.904+0000 7fca27fff640 1 -- 172.21.15.167:0/1145089606 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca28083c50 con 0x7fca30153ae0 2023-11-28T20:38:37.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.904+0000 7fca2effd640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fca10066470 0x7fca10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:37.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.908+0000 7fca2effd640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fca10066470 0x7fca10068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca200ae000 tx=0x7fca200a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:37.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:37.908+0000 7fca27fff640 1 -- 172.21.15.167:0/1145089606 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca28050d40 con 0x7fca30153ae0 2023-11-28T20:38:38.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fca30146c40 con 0x7fca30153ae0 2023-11-28T20:38:38.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca27fff640 1 -- 172.21.15.167:0/1145089606 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fca28054360 con 0x7fca30153ae0 2023-11-28T20:38:38.075 INFO:teuthology.orchestra.run.smithi167.stderr:listed 0 entries 2023-11-28T20:38:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fca10066470 msgr2=0x7fca10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fca10066470 0x7fca10068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca200ae000 tx=0x7fca200a7070 comp rx=0 tx=0).stop 2023-11-28T20:38:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30153ae0 msgr2=0x7fca300c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30153ae0 0x7fca300c8350 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c410 tx=0x7fca2800c8d0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 shutdown_connections 2023-11-28T20:38:38.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fca10066470 0x7fca10068930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca30153ae0 0x7fca300c8350 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca300cfc40 0x7fca300b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 --2- 172.21.15.167:0/1145089606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca300cf860 0x7fca300b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 >> 172.21.15.167:0/1145089606 conn(0x7fca3006c1f0 msgr2=0x7fca300662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:38.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 shutdown_connections 2023-11-28T20:38:38.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.072+0000 7fca357d8640 1 -- 172.21.15.167:0/1145089606 wait complete. 2023-11-28T20:38:38.096 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi167.front.sepia.ceph.com... 2023-11-28T20:38:38.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:38.097 DEBUG:teuthology.orchestra.run.smithi167:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-28T20:38:38.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi167.stderr:ceph-fuse[44166]: fuse finished with error 0 and tester_r 0 2023-11-28T20:38:38.130 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:38:38.180 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T20:38:38.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:38.181 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-28T20:38:38.200 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:38.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb31b46b640 1 Processor -- start 2023-11-28T20:38:38.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb31b46b640 1 -- start start 2023-11-28T20:38:38.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb31b46b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3140cfc40 0x7fb3140cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb31b46b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 0x7fb314153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb31b46b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31415ac00 con 0x7fb3140cf860 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb31b46b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3140cbd60 con 0x7fb3140cfc40 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb31b46b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb314159ff0 con 0x7fb314153ae0 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb318a06640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3140cfc40 0x7fb3140cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb318a06640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3140cfc40 0x7fb3140cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48814/0 (socket says 172.21.15.167:48814) 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb318a06640 1 -- 172.21.15.167:0/2461500325 learned_addr learned my addr 172.21.15.167:0/2461500325 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb319a08640 1 --2- 172.21.15.167:0/2461500325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 0x7fb314153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb318a06640 1 -- 172.21.15.167:0/2461500325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 msgr2=0x7fb314153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb318a06640 1 --2- 172.21.15.167:0/2461500325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 0x7fb314153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb318a06640 1 -- 172.21.15.167:0/2461500325 >> v1:172.21.15.178:6789/0 conn(0x7fb3140cf860 legacy=0x7fb3140ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.380+0000 7fb318a06640 1 -- 172.21.15.167:0/2461500325 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31415a2d0 con 0x7fb3140cfc40 2023-11-28T20:38:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb318a06640 1 --2- 172.21.15.167:0/2461500325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cfc40 0x7fb3140cb770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb304009870 tx=0x7fb30401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98654bf3e34f74a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb30bfff640 1 -- 172.21.15.167:0/2461500325 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040a9400 con 0x7fb3140cfc40 2023-11-28T20:38:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb30bfff640 1 -- 172.21.15.167:0/2461500325 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3040a9560 con 0x7fb3140cfc40 2023-11-28T20:38:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb30bfff640 1 -- 172.21.15.167:0/2461500325 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040a98f0 con 0x7fb3140cfc40 2023-11-28T20:38:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb31b46b640 1 -- 172.21.15.167:0/2461500325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cfc40 msgr2=0x7fb3140cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb31b46b640 1 --2- 172.21.15.167:0/2461500325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cfc40 0x7fb3140cb770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb304009870 tx=0x7fb30401c540 comp rx=0 tx=0).stop 2023-11-28T20:38:38.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb31b46b640 1 -- 172.21.15.167:0/2461500325 shutdown_connections 2023-11-28T20:38:38.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb31b46b640 1 --2- 172.21.15.167:0/2461500325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 0x7fb314153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb31b46b640 1 --2- 172.21.15.167:0/2461500325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cfc40 0x7fb3140cb770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb31b46b640 1 -- 172.21.15.167:0/2461500325 >> 172.21.15.167:0/2461500325 conn(0x7fb31406c1f0 msgr2=0x7fb314071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:38.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb31b46b640 1 -- 172.21.15.167:0/2461500325 shutdown_connections 2023-11-28T20:38:38.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.384+0000 7fb31b46b640 1 -- 172.21.15.167:0/2461500325 wait complete. 2023-11-28T20:38:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 Processor -- start 2023-11-28T20:38:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 -- start start 2023-11-28T20:38:38.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cf860 0x7fb3141f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3140cfc40 0x7fb314155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 0x7fb3140c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb314157500 con 0x7fb3140cf860 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3141f6630 con 0x7fb3140cfc40 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140c6910 con 0x7fb314153ae0 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319207640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cf860 0x7fb3141f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319207640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cf860 0x7fb3141f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48816/0 (socket says 172.21.15.167:48816) 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319207640 1 -- 172.21.15.167:0/4054423447 learned_addr learned my addr 172.21.15.167:0/4054423447 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb318a06640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3140cfc40 0x7fb314155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319a08640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 0x7fb3140c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319207640 1 -- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 msgr2=0x7fb3140c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319207640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 0x7fb3140c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319207640 1 -- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3140cfc40 msgr2=0x7fb314155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319207640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3140cfc40 0x7fb314155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319207640 1 -- 172.21.15.167:0/4054423447 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3040094d0 con 0x7fb3140cf860 2023-11-28T20:38:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb319207640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cf860 0x7fb3141f6ac0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c3f0 tx=0x7fb31000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb309ffb640 1 -- 172.21.15.167:0/4054423447 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100052d0 con 0x7fb3140cf860 2023-11-28T20:38:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb309ffb640 1 -- 172.21.15.167:0/4054423447 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310005430 con 0x7fb3140cf860 2023-11-28T20:38:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb309ffb640 1 -- 172.21.15.167:0/4054423447 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310003840 con 0x7fb3140cf860 2023-11-28T20:38:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb314154650 con 0x7fb3140cf860 2023-11-28T20:38:38.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.388+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb314154910 con 0x7fb3140cf860 2023-11-28T20:38:38.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.392+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb314075c90 con 0x7fb3140cf860 2023-11-28T20:38:38.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.392+0000 7fb309ffb640 1 -- 172.21.15.167:0/4054423447 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3100039a0 con 0x7fb3140cf860 2023-11-28T20:38:38.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.392+0000 7fb309ffb640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2f80664a0 0x7fb2f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.392+0000 7fb309ffb640 1 -- 172.21.15.167:0/4054423447 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb310083640 con 0x7fb3140cf860 2023-11-28T20:38:38.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.392+0000 7fb318a06640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2f80664a0 0x7fb2f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.392+0000 7fb318a06640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2f80664a0 0x7fb2f8068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3040ae000 tx=0x7fb304008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:38.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.396+0000 7fb309ffb640 1 -- 172.21.15.167:0/4054423447 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb310050870 con 0x7fb3140cf860 2023-11-28T20:38:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.548+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb314146e40 con 0x7fb3140cf860 2023-11-28T20:38:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb309ffb640 1 -- 172.21.15.167:0/4054423447 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7fb310053e90 con 0x7fb3140cf860 2023-11-28T20:38:38.555 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:38.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2f80664a0 msgr2=0x7fb2f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2f80664a0 0x7fb2f8068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3040ae000 tx=0x7fb304008040 comp rx=0 tx=0).stop 2023-11-28T20:38:38.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cf860 msgr2=0x7fb3141f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cf860 0x7fb3141f6ac0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c3f0 tx=0x7fb31000c8b0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 shutdown_connections 2023-11-28T20:38:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2f80664a0 0x7fb2f8068960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb314153ae0 0x7fb3140c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3140cfc40 0x7fb314155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 --2- 172.21.15.167:0/4054423447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3140cf860 0x7fb3141f6ac0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 >> 172.21.15.167:0/4054423447 conn(0x7fb31406c1f0 msgr2=0x7fb3140662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 shutdown_connections 2023-11-28T20:38:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.552+0000 7fb31b46b640 1 -- 172.21.15.167:0/4054423447 wait complete. 2023-11-28T20:38:38.576 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:38.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882be46640 1 Processor -- start 2023-11-28T20:38:38.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882be46640 1 -- start start 2023-11-28T20:38:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882be46640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cfc40 0x7f88240cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882be46640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8824153ae0 0x7f8824153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882be46640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882415ac00 con 0x7f88240cf860 2023-11-28T20:38:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882be46640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8824154470 con 0x7f8824153ae0 2023-11-28T20:38:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882be46640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88240cbd60 con 0x7f88240cfc40 2023-11-28T20:38:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882a3e3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8824153ae0 0x7f8824153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f8829be2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f88240cf860 0x7f88240ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34710/0 (socket says 172.21.15.167:34710) 2023-11-28T20:38:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f8829be2640 1 -- 172.21.15.167:0/1135052593 learned_addr learned my addr 172.21.15.167:0/1135052593 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:38.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f88293e1640 1 --2- 172.21.15.167:0/1135052593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cfc40 0x7f88240cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882a3e3640 1 -- 172.21.15.167:0/1135052593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cfc40 msgr2=0x7f88240cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:38.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882a3e3640 1 --2- 172.21.15.167:0/1135052593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cfc40 0x7f88240cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882a3e3640 1 -- 172.21.15.167:0/1135052593 >> v1:172.21.15.167:6789/0 conn(0x7f88240cf860 legacy=0x7f88240ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f8828be0640 1 -- 172.21.15.167:0/1135052593 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925405572 0 0) 0x7f882415ac00 con 0x7f88240cf860 2023-11-28T20:38:38.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f882a3e3640 1 -- 172.21.15.167:0/1135052593 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824159ff0 con 0x7f8824153ae0 2023-11-28T20:38:38.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.712+0000 7f88293e1640 1 --2- 172.21.15.167:0/1135052593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cfc40 0x7f88240cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:38.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f882a3e3640 1 --2- 172.21.15.167:0/1135052593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 0x7f8824153f30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f881c009d90 tx=0x7f881c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bd89e1dc5b99fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:38.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f8828be0640 1 -- 172.21.15.167:0/1135052593 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0a59e0 con 0x7f8824153ae0 2023-11-28T20:38:38.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f8828be0640 1 -- 172.21.15.167:0/1135052593 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c0a5b40 con 0x7f8824153ae0 2023-11-28T20:38:38.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f8828be0640 1 -- 172.21.15.167:0/1135052593 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0ad440 con 0x7f8824153ae0 2023-11-28T20:38:38.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f882be46640 1 -- 172.21.15.167:0/1135052593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 msgr2=0x7f8824153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f882be46640 1 --2- 172.21.15.167:0/1135052593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 0x7f8824153f30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f881c009d90 tx=0x7f881c01c920 comp rx=0 tx=0).stop 2023-11-28T20:38:38.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f882be46640 1 -- 172.21.15.167:0/1135052593 shutdown_connections 2023-11-28T20:38:38.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f882be46640 1 --2- 172.21.15.167:0/1135052593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 0x7f8824153f30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f882be46640 1 --2- 172.21.15.167:0/1135052593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cfc40 0x7f88240cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f882be46640 1 -- 172.21.15.167:0/1135052593 >> 172.21.15.167:0/1135052593 conn(0x7f882406c1f0 msgr2=0x7f8824071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:38.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f882be46640 1 -- 172.21.15.167:0/1135052593 shutdown_connections 2023-11-28T20:38:38.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.716+0000 7f882be46640 1 -- 172.21.15.167:0/1135052593 wait complete. 2023-11-28T20:38:38.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 Processor -- start 2023-11-28T20:38:38.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 -- start start 2023-11-28T20:38:38.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cf860 0x7f88240c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88240cfc40 0x7f88241f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 0x7f88241f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882414c400 con 0x7f8824153ae0 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88241f2b30 con 0x7f88240cfc40 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88240b5550 con 0x7f88240cf860 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882a3e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 0x7f88241f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882a3e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 0x7f88241f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48836/0 (socket says 172.21.15.167:48836) 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882a3e3640 1 -- 172.21.15.167:0/2094348358 learned_addr learned my addr 172.21.15.167:0/2094348358 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f88293e1640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88240cfc40 0x7f88241f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f8829be2640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cf860 0x7f88240c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882a3e3640 1 -- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cf860 msgr2=0x7f88240c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882a3e3640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cf860 0x7f88240c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882a3e3640 1 -- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88240cfc40 msgr2=0x7f88241f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882a3e3640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88240cfc40 0x7f88241f6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882a3e3640 1 -- 172.21.15.167:0/2094348358 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c009a70 con 0x7f8824153ae0 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882a3e3640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 0x7f88241f3540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f881c0b0040 tx=0x7f881c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f881a7fc640 1 -- 172.21.15.167:0/2094348358 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0ade40 con 0x7f8824153ae0 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f881a7fc640 1 -- 172.21.15.167:0/2094348358 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c009450 con 0x7f8824153ae0 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88241f3a80 con 0x7f8824153ae0 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f881a7fc640 1 -- 172.21.15.167:0/2094348358 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0b9690 con 0x7f8824153ae0 2023-11-28T20:38:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882414be40 con 0x7f8824153ae0 2023-11-28T20:38:38.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.720+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8824075c90 con 0x7f8824153ae0 2023-11-28T20:38:38.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.724+0000 7f881a7fc640 1 -- 172.21.15.167:0/2094348358 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f881c0b97f0 con 0x7f8824153ae0 2023-11-28T20:38:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.724+0000 7f881a7fc640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8808066470 0x7f8808068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.724+0000 7f881a7fc640 1 -- 172.21.15.167:0/2094348358 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f881c11ff40 con 0x7f8824153ae0 2023-11-28T20:38:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.724+0000 7f8829be2640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8808066470 0x7f8808068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.724+0000 7f8829be2640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8808066470 0x7f8808068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8820000f70 tx=0x7f8820007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:38.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.728+0000 7f881a7fc640 1 -- 172.21.15.167:0/2094348358 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f881c0ed150 con 0x7f8824153ae0 2023-11-28T20:38:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.876+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88240670d0 con 0x7f8824153ae0 2023-11-28T20:38:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f881a7fc640 1 -- 172.21.15.167:0/2094348358 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7f881c0f0770 con 0x7f8824153ae0 2023-11-28T20:38:38.883 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:38.883 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8808066470 msgr2=0x7f8808068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8808066470 0x7f8808068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8820000f70 tx=0x7f8820007c10 comp rx=0 tx=0).stop 2023-11-28T20:38:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 msgr2=0x7f88241f3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 0x7f88241f3540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f881c0b0040 tx=0x7f881c0196c0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 shutdown_connections 2023-11-28T20:38:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8808066470 0x7f8808068930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8824153ae0 0x7f88241f3540 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88240cfc40 0x7f88241f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 --2- 172.21.15.167:0/2094348358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240cf860 0x7f88240c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 >> 172.21.15.167:0/2094348358 conn(0x7f882406c1f0 msgr2=0x7f88240cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 shutdown_connections 2023-11-28T20:38:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:38.880+0000 7f882be46640 1 -- 172.21.15.167:0/2094348358 wait complete. 2023-11-28T20:38:38.904 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T20:38:39.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.040+0000 7f5007b1d640 1 Processor -- start 2023-11-28T20:38:39.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.040+0000 7f5007b1d640 1 -- start start 2023-11-28T20:38:39.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.040+0000 7f5007b1d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f50001585d0 0x7f50000c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.040+0000 7f5007b1d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500015e5e0 con 0x7f500015e130 2023-11-28T20:38:39.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.040+0000 7f5007b1d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500015e8c0 con 0x7f50000c7720 2023-11-28T20:38:39.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.040+0000 7f5007b1d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500015f160 con 0x7f50001585d0 2023-11-28T20:38:39.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.040+0000 7f50050b8640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f500015e130 0x7f5000161de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34716/0 (socket says 172.21.15.167:34716) 2023-11-28T20:38:39.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.040+0000 7f50050b8640 1 -- 172.21.15.167:0/3313733486 learned_addr learned my addr 172.21.15.167:0/3313733486 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.040+0000 7f50058b9640 1 --2- 172.21.15.167:0/3313733486 >> v2:172.21.15.178:3300/0 conn(0x7f50001585d0 0x7f50000c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429365145 0 0) 0x7f500015e5e0 con 0x7f500015e130 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fec003530 con 0x7f500015e130 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657585053 0 0) 0x7f4fec003530 con 0x7f500015e130 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 >> v2:172.21.15.178:3300/0 conn(0x7f50001585d0 msgr2=0x7f50000c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 --2- 172.21.15.167:0/3313733486 >> v2:172.21.15.178:3300/0 conn(0x7f50001585d0 0x7f50000c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 >> v1:172.21.15.178:6789/0 conn(0x7f50000c7720 legacy=0x7f500006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500015eba0 con 0x7f500015e130 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f4ff0001680 con 0x7f500015e130 2023-11-28T20:38:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 >> v1:172.21.15.167:6789/0 conn(0x7f500015e130 legacy=0x7f5000161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fec003980 0x7f4fec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fec0047d0 0x7f4fec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fec005190 0x7f4fec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500015f160 con 0x7f4fec0047d0 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec00c030 con 0x7f4fec003980 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec00c1f0 con 0x7f4fec005190 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50050b8640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fec0047d0 0x7f4fec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50058b9640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fec003980 0x7f4fec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50060ba640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fec005190 0x7f4fec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50050b8640 1 -- 172.21.15.167:0/3313733486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fec005190 msgr2=0x7f4fec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50050b8640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fec005190 0x7f4fec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50050b8640 1 -- 172.21.15.167:0/3313733486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fec003980 msgr2=0x7f4fec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:39.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50050b8640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fec003980 0x7f4fec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50050b8640 1 -- 172.21.15.167:0/3313733486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec003530 con 0x7f4fec0047d0 2023-11-28T20:38:39.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.044+0000 7f50060ba640 1 -- 172.21.15.167:0/3313733486 reap_dead start 2023-11-28T20:38:39.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f50050b8640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fec0047d0 0x7f4fec004c50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c240 tx=0x7f4ff001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1eaeabea40b20d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:39.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0005ae0 con 0x7f4fec0047d0 2023-11-28T20:38:39.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff00ab070 con 0x7f4fec0047d0 2023-11-28T20:38:39.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f50048b7640 1 -- 172.21.15.167:0/3313733486 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0007070 con 0x7f4fec0047d0 2023-11-28T20:38:39.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f5007b1d640 1 -- 172.21.15.167:0/3313733486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fec0047d0 msgr2=0x7f4fec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f5007b1d640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fec0047d0 0x7f4fec004c50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000c240 tx=0x7f4ff001f370 comp rx=0 tx=0).stop 2023-11-28T20:38:39.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f5007b1d640 1 -- 172.21.15.167:0/3313733486 shutdown_connections 2023-11-28T20:38:39.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f5007b1d640 1 --2- 172.21.15.167:0/3313733486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fec0047d0 0x7f4fec004c50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f5007b1d640 1 -- 172.21.15.167:0/3313733486 >> 172.21.15.167:0/3313733486 conn(0x7f50000cb1e0 msgr2=0x7f50000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:39.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f5007b1d640 1 -- 172.21.15.167:0/3313733486 shutdown_connections 2023-11-28T20:38:39.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f5007b1d640 1 -- 172.21.15.167:0/3313733486 wait complete. 2023-11-28T20:38:39.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f5007b1d640 1 Processor -- start 2023-11-28T20:38:39.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.048+0000 7f5007b1d640 1 -- start start 2023-11-28T20:38:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f5007b1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fec0047d0 0x7f500015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f5007b1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50001528e0 0x7f50001f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f5007b1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50000c36e0 0x7f500015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f5007b1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50001e82b0 con 0x7f50000c36e0 2023-11-28T20:38:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f5007b1d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50001f71f0 con 0x7f50001528e0 2023-11-28T20:38:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f5007b1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500015f930 con 0x7f4fec0047d0 2023-11-28T20:38:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50060ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50000c36e0 0x7f500015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50060ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50000c36e0 0x7f500015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48858/0 (socket says 172.21.15.167:48858) 2023-11-28T20:38:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50060ba640 1 -- 172.21.15.167:0/3964877554 learned_addr learned my addr 172.21.15.167:0/3964877554 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50058b9640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fec0047d0 0x7f500015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50050b8640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50001528e0 0x7f50001f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50060ba640 1 -- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fec0047d0 msgr2=0x7f500015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50060ba640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fec0047d0 0x7f500015f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50060ba640 1 -- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50001528e0 msgr2=0x7f50001f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50060ba640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50001528e0 0x7f50001f6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50060ba640 1 -- 172.21.15.167:0/3964877554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500015fc10 con 0x7f50000c36e0 2023-11-28T20:38:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50050b8640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50001528e0 0x7f50001f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f50060ba640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50000c36e0 0x7f500015ca70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f500006fe30 tx=0x7f4ff800fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:39.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f4ff67fc640 1 -- 172.21.15.167:0/3964877554 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8003980 con 0x7f50000c36e0 2023-11-28T20:38:39.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f4ff67fc640 1 -- 172.21.15.167:0/3964877554 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8003b00 con 0x7f50000c36e0 2023-11-28T20:38:39.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500015fef0 con 0x7f50000c36e0 2023-11-28T20:38:39.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f4ff67fc640 1 -- 172.21.15.167:0/3964877554 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80050d0 con 0x7f50000c36e0 2023-11-28T20:38:39.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50001e6de0 con 0x7f50000c36e0 2023-11-28T20:38:39.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50000682c0 con 0x7f50000c36e0 2023-11-28T20:38:39.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f4ff67fc640 1 -- 172.21.15.167:0/3964877554 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ff8005230 con 0x7f50000c36e0 2023-11-28T20:38:39.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.052+0000 7f4ff67fc640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fe4066470 0x7f4fe4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.056+0000 7f4ff67fc640 1 -- 172.21.15.167:0/3964877554 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ff8083ff0 con 0x7f50000c36e0 2023-11-28T20:38:39.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.056+0000 7f50058b9640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fe4066470 0x7f4fe4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.056+0000 7f50058b9640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fe4066470 0x7f4fe4068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5000050190 tx=0x7f4ffc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:39.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.060+0000 7f4ff67fc640 1 -- 172.21.15.167:0/3964877554 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ff80b5280 con 0x7f50000c36e0 2023-11-28T20:38:39.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.240+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f50001618a0 con 0x7f50000c36e0 2023-11-28T20:38:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.520+0000 7f4ff67fc640 1 -- 172.21.15.167:0/3964877554 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f50001618a0 con 0x7f50000c36e0 2023-11-28T20:38:39.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fe4066470 msgr2=0x7f4fe4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fe4066470 0x7f4fe4068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5000050190 tx=0x7f4ffc009190 comp rx=0 tx=0).stop 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50000c36e0 msgr2=0x7f500015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50000c36e0 0x7f500015ca70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f500006fe30 tx=0x7f4ff800fbb0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 shutdown_connections 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4fe4066470 0x7f4fe4068930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50000c36e0 0x7f500015ca70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50001528e0 0x7f50001f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 --2- 172.21.15.167:0/3964877554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fec0047d0 0x7f500015f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 >> 172.21.15.167:0/3964877554 conn(0x7f50000cb1e0 msgr2=0x7f5000157930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 shutdown_connections 2023-11-28T20:38:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.524+0000 7f5007b1d640 1 -- 172.21.15.167:0/3964877554 wait complete. 2023-11-28T20:38:39.547 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2023-11-28T20:38:39.547 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-11-28T20:38:39.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.688+0000 7f41adfaa640 1 Processor -- start 2023-11-28T20:38:39.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.688+0000 7f41adfaa640 1 -- start start 2023-11-28T20:38:39.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.688+0000 7f41adfaa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f41a806e030 0x7f41a81500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.688+0000 7f41adfaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8070480 0x7f41a81505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.688+0000 7f41adfaa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a81571d0 con 0x7f41a806e410 2023-11-28T20:38:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.688+0000 7f41adfaa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a8071a90 con 0x7f41a806e030 2023-11-28T20:38:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.688+0000 7f41adfaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80c70d0 con 0x7f41a8070480 2023-11-28T20:38:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.688+0000 7f41a7fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f41a806e410 0x7f41a8071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34728/0 (socket says 172.21.15.167:34728) 2023-11-28T20:38:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.688+0000 7f41a7fff640 1 -- 172.21.15.167:0/3098986372 learned_addr learned my addr 172.21.15.167:0/3098986372 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a77fe640 1 --2- 172.21.15.167:0/3098986372 >> v2:172.21.15.178:3300/0 conn(0x7f41a806e030 0x7f41a81500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f419ffff640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8070480 0x7f41a81505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014796807 0 0) 0x7f41a81571d0 con 0x7f41a806e410 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4194003530 con 0x7f41a806e410 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651466860 0 0) 0x7f4194003530 con 0x7f41a806e410 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8070480 msgr2=0x7f41a81505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8070480 0x7f41a81505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 >> v2:172.21.15.178:3300/0 conn(0x7f41a806e030 msgr2=0x7f41a81500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 --2- 172.21.15.167:0/3098986372 >> v2:172.21.15.178:3300/0 conn(0x7f41a806e030 0x7f41a81500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80c73b0 con 0x7f41a806e410 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f41a0001a00 con 0x7f41a806e410 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 >> v1:172.21.15.167:6789/0 conn(0x7f41a806e410 legacy=0x7f41a8071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8070480 0x7f4194003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194003f00 0x7f41940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4194004d10 0x7f4194005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8071a90 con 0x7f4194003f00 2023-11-28T20:38:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80c70d0 con 0x7f4194004d10 2023-11-28T20:38:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419400b990 con 0x7f41a8070480 2023-11-28T20:38:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f419ffff640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194003f00 0x7f41940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a77fe640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8070480 0x7f4194003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a7fff640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4194004d10 0x7f4194005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f419ffff640 1 -- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8070480 msgr2=0x7f4194003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:39.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f419ffff640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8070480 0x7f4194003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f419ffff640 1 -- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4194004d10 msgr2=0x7f4194005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:39.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f419ffff640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4194004d10 0x7f4194005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f419ffff640 1 -- 172.21.15.167:0/3098986372 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194003530 con 0x7f4194003f00 2023-11-28T20:38:39.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.692+0000 7f41a77fe640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8070480 0x7f4194003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:39.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f419ffff640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194003f00 0x7f41940047d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f419000aa60 tx=0x7f419001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7f49b21f8473a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:39.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900a5b40 con 0x7f4194003f00 2023-11-28T20:38:39.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41900a5ca0 con 0x7f4194003f00 2023-11-28T20:38:39.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41a6ffd640 1 -- 172.21.15.167:0/3098986372 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900ad680 con 0x7f4194003f00 2023-11-28T20:38:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41adfaa640 1 -- 172.21.15.167:0/3098986372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194003f00 msgr2=0x7f41940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41adfaa640 1 --2- 172.21.15.167:0/3098986372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194003f00 0x7f41940047d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f419000aa60 tx=0x7f419001cbb0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41a7fff640 1 -- 172.21.15.167:0/3098986372 reap_dead start 2023-11-28T20:38:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41adfaa640 1 -- 172.21.15.167:0/3098986372 shutdown_connections 2023-11-28T20:38:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41adfaa640 1 -- 172.21.15.167:0/3098986372 >> 172.21.15.167:0/3098986372 conn(0x7f41a80cb1e0 msgr2=0x7f41a80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41adfaa640 1 -- 172.21.15.167:0/3098986372 shutdown_connections 2023-11-28T20:38:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41adfaa640 1 -- 172.21.15.167:0/3098986372 wait complete. 2023-11-28T20:38:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41adfaa640 1 Processor -- start 2023-11-28T20:38:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41adfaa640 1 -- start start 2023-11-28T20:38:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.696+0000 7f41adfaa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4194003f00 0x7f41a8155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41adfaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41a8152ea0 0x7f41a80c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41adfaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8144770 0x7f41a80c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41adfaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8154a70 con 0x7f41a8152ea0 2023-11-28T20:38:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41adfaa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a81432d0 con 0x7f4194003f00 2023-11-28T20:38:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41adfaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8141de0 con 0x7f41a8144770 2023-11-28T20:38:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f419ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41a8152ea0 0x7f41a80c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f419ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41a8152ea0 0x7f41a80c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48864/0 (socket says 172.21.15.167:48864) 2023-11-28T20:38:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f419ffff640 1 -- 172.21.15.167:0/1201399347 learned_addr learned my addr 172.21.15.167:0/1201399347 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41a77fe640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4194003f00 0x7f41a8155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41a7fff640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8144770 0x7f41a80c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f419ffff640 1 -- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8144770 msgr2=0x7f41a80c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f419ffff640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8144770 0x7f41a80c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f419ffff640 1 -- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4194003f00 msgr2=0x7f41a8155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f419ffff640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4194003f00 0x7f41a8155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f419ffff640 1 -- 172.21.15.167:0/1201399347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80ca9a0 con 0x7f41a8152ea0 2023-11-28T20:38:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41a7fff640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8144770 0x7f41a80c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f419ffff640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41a8152ea0 0x7f41a80c9280 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41900b0040 tx=0x7f4194005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41a4ff9640 1 -- 172.21.15.167:0/1201399347 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900add60 con 0x7f41a8152ea0 2023-11-28T20:38:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41a4ff9640 1 -- 172.21.15.167:0/1201399347 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190004020 con 0x7f41a8152ea0 2023-11-28T20:38:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41a4ff9640 1 -- 172.21.15.167:0/1201399347 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900043d0 con 0x7f41a8152ea0 2023-11-28T20:38:39.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a80cac80 con 0x7f41a8152ea0 2023-11-28T20:38:39.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a80caf60 con 0x7f41a8152ea0 2023-11-28T20:38:39.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a80682c0 con 0x7f41a8152ea0 2023-11-28T20:38:39.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.700+0000 7f41a4ff9640 1 -- 172.21.15.167:0/1201399347 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f41900b4040 con 0x7f41a8152ea0 2023-11-28T20:38:39.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.704+0000 7f41a4ff9640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4188066470 0x7f4188068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:39.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.704+0000 7f41a4ff9640 1 -- 172.21.15.167:0/1201399347 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f419011eac0 con 0x7f41a8152ea0 2023-11-28T20:38:39.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.704+0000 7f41a77fe640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4188066470 0x7f4188068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:39.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.704+0000 7f41a77fe640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4188066470 0x7f4188068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4198009be0 tx=0x7f4198008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:39.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.708+0000 7f41a4ff9640 1 -- 172.21.15.167:0/1201399347 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41900ebcf0 con 0x7f41a8152ea0 2023-11-28T20:38:39.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:39.892+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f41a8154a70 con 0x7f41a8152ea0 2023-11-28T20:38:40.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.524+0000 7f41a4ff9640 1 -- 172.21.15.167:0/1201399347 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f419000b040 con 0x7f41a8152ea0 2023-11-28T20:38:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.524+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4188066470 msgr2=0x7f4188068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.524+0000 7f41adfaa640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4188066470 0x7f4188068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4198009be0 tx=0x7f4198008040 comp rx=0 tx=0).stop 2023-11-28T20:38:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.524+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41a8152ea0 msgr2=0x7f41a80c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.524+0000 7f41adfaa640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41a8152ea0 0x7f41a80c9280 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41900b0040 tx=0x7f4194005800 comp rx=0 tx=0).stop 2023-11-28T20:38:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.528+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 shutdown_connections 2023-11-28T20:38:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.528+0000 7f41adfaa640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4188066470 0x7f4188068930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.528+0000 7f41adfaa640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41a8144770 0x7f41a80c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.528+0000 7f41adfaa640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41a8152ea0 0x7f41a80c9280 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.528+0000 7f41adfaa640 1 --2- 172.21.15.167:0/1201399347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4194003f00 0x7f41a8155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.528+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 >> 172.21.15.167:0/1201399347 conn(0x7f41a80cb1e0 msgr2=0x7f41a80c4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.528+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 shutdown_connections 2023-11-28T20:38:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.528+0000 7f41adfaa640 1 -- 172.21.15.167:0/1201399347 wait complete. 2023-11-28T20:38:40.552 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T20:38:40.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.688+0000 7efe773aa640 1 Processor -- start 2023-11-28T20:38:40.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.688+0000 7efe773aa640 1 -- start start 2023-11-28T20:38:40.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.688+0000 7efe773aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe700c6ff0 0x7efe70157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:40.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.688+0000 7efe773aa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe700c4940 con 0x7efe700c4510 2023-11-28T20:38:40.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.688+0000 7efe773aa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe700c6ac0 con 0x7efe70150b40 2023-11-28T20:38:40.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.688+0000 7efe773aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe700c62f0 con 0x7efe700c6ff0 2023-11-28T20:38:40.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.688+0000 7efe75947640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7efe700c4510 0x7efe7006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34734/0 (socket says 172.21.15.167:34734) 2023-11-28T20:38:40.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe75947640 1 -- 172.21.15.167:0/2882963486 learned_addr learned my addr 172.21.15.167:0/2882963486 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:40.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe74945640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe700c6ff0 0x7efe70157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:40.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727334751 0 0) 0x7efe700c4940 con 0x7efe700c4510 2023-11-28T20:38:40.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe5c005740 con 0x7efe700c4510 2023-11-28T20:38:40.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163457187 0 0) 0x7efe700c6ac0 con 0x7efe70150b40 2023-11-28T20:38:40.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe700c4940 con 0x7efe70150b40 2023-11-28T20:38:40.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2087931074 0 0) 0x7efe5c005740 con 0x7efe700c4510 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe700c6ff0 msgr2=0x7efe70157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe700c6ff0 0x7efe70157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 >> v1:172.21.15.178:6789/0 conn(0x7efe70150b40 legacy=0x7efe700c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe700c6500 con 0x7efe700c4510 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7efe68001980 con 0x7efe700c4510 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 >> v1:172.21.15.167:6789/0 conn(0x7efe700c4510 legacy=0x7efe7006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe5c005d50 0x7efe5c006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe700c6ff0 0x7efe5c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe5c006f20 0x7efe5c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe700c62f0 con 0x7efe5c005d50 2023-11-28T20:38:40.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c00dc80 con 0x7efe5c006f20 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c00de40 con 0x7efe700c6ff0 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe75146640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe5c005d50 0x7efe5c006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe74945640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe700c6ff0 0x7efe5c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe75947640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe5c006f20 0x7efe5c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe75146640 1 -- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe700c6ff0 msgr2=0x7efe5c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe75146640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe700c6ff0 0x7efe5c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe75146640 1 -- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe5c006f20 msgr2=0x7efe5c0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe75146640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe5c006f20 0x7efe5c0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe75146640 1 -- 172.21.15.167:0/2882963486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c005740 con 0x7efe5c005d50 2023-11-28T20:38:40.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.692+0000 7efe75947640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe5c006f20 0x7efe5c0073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:40.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe75146640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe5c005d50 0x7efe5c006150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efe700c4ad0 tx=0x7efe6c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c25e5de87a824 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:40.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0052d0 con 0x7efe5c005d50 2023-11-28T20:38:40.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c0a7050 con 0x7efe5c005d50 2023-11-28T20:38:40.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe67fff640 1 -- 172.21.15.167:0/2882963486 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c003600 con 0x7efe5c005d50 2023-11-28T20:38:40.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 -- 172.21.15.167:0/2882963486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe5c005d50 msgr2=0x7efe5c006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:40.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 --2- 172.21.15.167:0/2882963486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe5c005d50 0x7efe5c006150 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efe700c4ad0 tx=0x7efe6c01c510 comp rx=0 tx=0).stop 2023-11-28T20:38:40.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe75947640 1 -- 172.21.15.167:0/2882963486 reap_dead start 2023-11-28T20:38:40.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 -- 172.21.15.167:0/2882963486 shutdown_connections 2023-11-28T20:38:40.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 -- 172.21.15.167:0/2882963486 >> 172.21.15.167:0/2882963486 conn(0x7efe700cb1e0 msgr2=0x7efe700cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:40.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 -- 172.21.15.167:0/2882963486 shutdown_connections 2023-11-28T20:38:40.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 -- 172.21.15.167:0/2882963486 wait complete. 2023-11-28T20:38:40.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 Processor -- start 2023-11-28T20:38:40.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 -- start start 2023-11-28T20:38:40.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe5c005d50 0x7efe700c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:40.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe70157ba0 0x7efe70147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:40.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe7014b3c0 0x7efe70147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:40.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe701487b0 con 0x7efe70157ba0 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe70148a70 con 0x7efe7014b3c0 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.696+0000 7efe773aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe70148d50 con 0x7efe5c005d50 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe74945640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe70157ba0 0x7efe70147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe74945640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe70157ba0 0x7efe70147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48876/0 (socket says 172.21.15.167:48876) 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe74945640 1 -- 172.21.15.167:0/867342066 learned_addr learned my addr 172.21.15.167:0/867342066 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe75146640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe5c005d50 0x7efe700c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe75947640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe7014b3c0 0x7efe70147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe74945640 1 -- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe5c005d50 msgr2=0x7efe700c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe74945640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe5c005d50 0x7efe700c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe74945640 1 -- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe7014b3c0 msgr2=0x7efe70147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe74945640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe7014b3c0 0x7efe70147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:40.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe74945640 1 -- 172.21.15.167:0/867342066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe70149030 con 0x7efe70157ba0 2023-11-28T20:38:40.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe75947640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe7014b3c0 0x7efe70147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:40.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe74945640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe70157ba0 0x7efe70147250 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe600119d0 tx=0x7efe60011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:40.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe65ffb640 1 -- 172.21.15.167:0/867342066 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6000fb50 con 0x7efe70157ba0 2023-11-28T20:38:40.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe65ffb640 1 -- 172.21.15.167:0/867342066 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6000fcb0 con 0x7efe70157ba0 2023-11-28T20:38:40.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe70149310 con 0x7efe70157ba0 2023-11-28T20:38:40.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe65ffb640 1 -- 172.21.15.167:0/867342066 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60014440 con 0x7efe70157ba0 2023-11-28T20:38:40.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe700ca170 con 0x7efe70157ba0 2023-11-28T20:38:40.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe700682c0 con 0x7efe70157ba0 2023-11-28T20:38:40.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.700+0000 7efe65ffb640 1 -- 172.21.15.167:0/867342066 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe600145a0 con 0x7efe70157ba0 2023-11-28T20:38:40.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.704+0000 7efe65ffb640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efe540664a0 0x7efe54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:40.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.704+0000 7efe65ffb640 1 -- 172.21.15.167:0/867342066 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe60084a40 con 0x7efe70157ba0 2023-11-28T20:38:40.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.704+0000 7efe75146640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efe540664a0 0x7efe54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:40.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.704+0000 7efe75146640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efe540664a0 0x7efe54068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0ac000 tx=0x7efe6c001370 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:40.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.708+0000 7efe65ffb640 1 -- 172.21.15.167:0/867342066 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe60086e60 con 0x7efe70157ba0 2023-11-28T20:38:40.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:40.892+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efe70067c40 con 0x7efe70157ba0 2023-11-28T20:38:41.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.540+0000 7efe65ffb640 1 -- 172.21.15.167:0/867342066 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe60022020 con 0x7efe70157ba0 2023-11-28T20:38:41.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efe540664a0 msgr2=0x7efe54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efe540664a0 0x7efe54068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0ac000 tx=0x7efe6c001370 comp rx=0 tx=0).stop 2023-11-28T20:38:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe70157ba0 msgr2=0x7efe70147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe70157ba0 0x7efe70147250 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe600119d0 tx=0x7efe60011e90 comp rx=0 tx=0).stop 2023-11-28T20:38:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 shutdown_connections 2023-11-28T20:38:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efe540664a0 0x7efe54068960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe7014b3c0 0x7efe70147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe70157ba0 0x7efe70147250 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 --2- 172.21.15.167:0/867342066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe5c005d50 0x7efe700c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 >> 172.21.15.167:0/867342066 conn(0x7efe700cb1e0 msgr2=0x7efe700c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:41.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 shutdown_connections 2023-11-28T20:38:41.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.544+0000 7efe773aa640 1 -- 172.21.15.167:0/867342066 wait complete. 2023-11-28T20:38:41.573 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-11-28T20:38:41.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf3c808640 1 Processor -- start 2023-11-28T20:38:41.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf3c808640 1 -- start start 2023-11-28T20:38:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf3c808640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf38071820 0x7fbf38156d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf3c808640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf381572a0 0x7fbf38161160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf3c808640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf38151000 con 0x7fbf38150c20 2023-11-28T20:38:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf3c808640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf38071c60 con 0x7fbf381572a0 2023-11-28T20:38:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf3c808640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380c26e0 con 0x7fbf38071820 2023-11-28T20:38:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf36d9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbf38150c20 0x7fbf380c6cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34744/0 (socket says 172.21.15.167:34744) 2023-11-28T20:38:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf36d9d640 1 -- 172.21.15.167:0/1388391112 learned_addr learned my addr 172.21.15.167:0/1388391112 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf3659c640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf38071820 0x7fbf38156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf3759e640 1 --2- 172.21.15.167:0/1388391112 >> v2:172.21.15.178:3300/0 conn(0x7fbf381572a0 0x7fbf38161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446206494 0 0) 0x7fbf38151000 con 0x7fbf38150c20 2023-11-28T20:38:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf20003530 con 0x7fbf38150c20 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4167470465 0 0) 0x7fbf20003530 con 0x7fbf38150c20 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf38071820 msgr2=0x7fbf38156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf38071820 0x7fbf38156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 >> v2:172.21.15.178:3300/0 conn(0x7fbf381572a0 msgr2=0x7fbf38161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 --2- 172.21.15.167:0/1388391112 >> v2:172.21.15.178:3300/0 conn(0x7fbf381572a0 0x7fbf38161160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf381576f0 con 0x7fbf38150c20 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fbf28001680 con 0x7fbf38150c20 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 >> v1:172.21.15.167:6789/0 conn(0x7fbf38150c20 legacy=0x7fbf380c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.716+0000 7fbf35d9b640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf38071820 0x7fbf20003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf35d9b640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf20003f00 0x7fbf200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf35d9b640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf38071c60 con 0x7fbf20004d10 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380c26e0 con 0x7fbf20003f00 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2000b990 con 0x7fbf38071820 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3759e640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf36d9d640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf38071820 0x7fbf20003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3659c640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf20003f00 0x7fbf200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3759e640 1 -- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf38071820 msgr2=0x7fbf20003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3759e640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf38071820 0x7fbf20003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3759e640 1 -- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf20003f00 msgr2=0x7fbf200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3759e640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf20003f00 0x7fbf200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3759e640 1 -- 172.21.15.167:0/1388391112 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf20003530 con 0x7fbf20004d10 2023-11-28T20:38:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3759e640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf20005190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009fc0 tx=0x7fbf3001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeed4561fb1afb8b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300a5cb0 con 0x7fbf20004d10 2023-11-28T20:38:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3000f040 con 0x7fbf20004d10 2023-11-28T20:38:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf35d9b640 1 -- 172.21.15.167:0/1388391112 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300ad680 con 0x7fbf20004d10 2023-11-28T20:38:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3c808640 1 -- 172.21.15.167:0/1388391112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 msgr2=0x7fbf20005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3c808640 1 --2- 172.21.15.167:0/1388391112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf20005190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009fc0 tx=0x7fbf3001cc40 comp rx=0 tx=0).stop 2023-11-28T20:38:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.720+0000 7fbf3759e640 1 -- 172.21.15.167:0/1388391112 reap_dead start 2023-11-28T20:38:41.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 -- 172.21.15.167:0/1388391112 shutdown_connections 2023-11-28T20:38:41.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 -- 172.21.15.167:0/1388391112 >> 172.21.15.167:0/1388391112 conn(0x7fbf380c7ce0 msgr2=0x7fbf380c80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:41.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 -- 172.21.15.167:0/1388391112 shutdown_connections 2023-11-28T20:38:41.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 -- 172.21.15.167:0/1388391112 wait complete. 2023-11-28T20:38:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 Processor -- start 2023-11-28T20:38:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 -- start start 2023-11-28T20:38:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf3814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf381eba30 0x7fbf381422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3814e430 0x7fbf3814c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381504d0 con 0x7fbf20004d10 2023-11-28T20:38:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381ead40 con 0x7fbf381eba30 2023-11-28T20:38:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3c808640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3814ff10 con 0x7fbf3814e430 2023-11-28T20:38:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf36d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf3814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf36d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf3814f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48884/0 (socket says 172.21.15.167:48884) 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf36d9d640 1 -- 172.21.15.167:0/4207837965 learned_addr learned my addr 172.21.15.167:0/4207837965 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3659c640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf381eba30 0x7fbf381422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf3759e640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3814e430 0x7fbf3814c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf36d9d640 1 -- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3814e430 msgr2=0x7fbf3814c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf36d9d640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3814e430 0x7fbf3814c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf36d9d640 1 -- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf381eba30 msgr2=0x7fbf381422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf36d9d640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf381eba30 0x7fbf381422a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.724+0000 7fbf36d9d640 1 -- 172.21.15.167:0/4207837965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf381501f0 con 0x7fbf20004d10 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf36d9d640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf3814f8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800e8e0 tx=0x7fbf2800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf1f7fe640 1 -- 172.21.15.167:0/4207837965 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28004b80 con 0x7fbf20004d10 2023-11-28T20:38:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf1f7fe640 1 -- 172.21.15.167:0/4207837965 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf28004d00 con 0x7fbf20004d10 2023-11-28T20:38:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf1f7fe640 1 -- 172.21.15.167:0/4207837965 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28005290 con 0x7fbf20004d10 2023-11-28T20:38:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf381eaf50 con 0x7fbf20004d10 2023-11-28T20:38:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf381eb510 con 0x7fbf20004d10 2023-11-28T20:38:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf380682c0 con 0x7fbf20004d10 2023-11-28T20:38:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf1f7fe640 1 -- 172.21.15.167:0/4207837965 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbf280053f0 con 0x7fbf20004d10 2023-11-28T20:38:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf1f7fe640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf24066490 0x7fbf24068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.728+0000 7fbf1f7fe640 1 -- 172.21.15.167:0/4207837965 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbf28083d60 con 0x7fbf20004d10 2023-11-28T20:38:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.732+0000 7fbf3659c640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf24066490 0x7fbf24068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:41.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.732+0000 7fbf3659c640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf24066490 0x7fbf24068950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbf380c5460 tx=0x7fbf2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:41.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.732+0000 7fbf1f7fe640 1 -- 172.21.15.167:0/4207837965 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf28050fa0 con 0x7fbf20004d10 2023-11-28T20:38:41.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:41.920+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fbf380c54b0 con 0x7fbf20004d10 2023-11-28T20:38:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.552+0000 7fbf1f7fe640 1 -- 172.21.15.167:0/4207837965 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) v1 ==== 115+0+0 (secure 0 0 0) 0x7fbf28019070 con 0x7fbf20004d10 2023-11-28T20:38:42.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf24066490 msgr2=0x7fbf24068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf24066490 0x7fbf24068950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbf380c5460 tx=0x7fbf2c008040 comp rx=0 tx=0).stop 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 msgr2=0x7fbf3814f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf3814f8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800e8e0 tx=0x7fbf2800eda0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 shutdown_connections 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf24066490 0x7fbf24068950 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3814e430 0x7fbf3814c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf381eba30 0x7fbf381422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 --2- 172.21.15.167:0/4207837965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf20004d10 0x7fbf3814f8f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 >> 172.21.15.167:0/4207837965 conn(0x7fbf380c7ce0 msgr2=0x7fbf38145930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 shutdown_connections 2023-11-28T20:38:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.556+0000 7fbf3c808640 1 -- 172.21.15.167:0/4207837965 wait complete. 2023-11-28T20:38:42.581 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T20:38:42.581 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:38:42.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b78832640 1 Processor -- start 2023-11-28T20:38:42.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b78832640 1 -- start start 2023-11-28T20:38:42.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b78832640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b740cfc40 0x7f3b740cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:42.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b78832640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7415ac00 con 0x7f3b74153ae0 2023-11-28T20:38:42.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b78832640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b740cbd60 con 0x7f3b740cf860 2023-11-28T20:38:42.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b78832640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b74159ff0 con 0x7f3b740cfc40 2023-11-28T20:38:42.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b69d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b740cfc40 0x7f3b740cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b72d9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3b74153ae0 0x7f3b7415d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34750/0 (socket says 172.21.15.167:34750) 2023-11-28T20:38:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b72d9d640 1 -- 172.21.15.167:0/901702864 learned_addr learned my addr 172.21.15.167:0/901702864 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b69d9b640 1 -- 172.21.15.167:0/901702864 >> v1:172.21.15.178:6789/0 conn(0x7f3b740cf860 legacy=0x7f3b740ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b69d9b640 1 -- 172.21.15.167:0/901702864 >> v1:172.21.15.167:6789/0 conn(0x7f3b74153ae0 legacy=0x7f3b7415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.716+0000 7f3b69d9b640 1 -- 172.21.15.167:0/901702864 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7415a2d0 con 0x7f3b740cfc40 2023-11-28T20:38:42.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b69d9b640 1 --2- 172.21.15.167:0/901702864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b740cfc40 0x7f3b740cb770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3b640097c0 tx=0x7f3b6401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf88cfc0fff5c74 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:42.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b71d9b640 1 -- 172.21.15.167:0/901702864 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640ab650 con 0x7f3b740cfc40 2023-11-28T20:38:42.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b71d9b640 1 -- 172.21.15.167:0/901702864 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b640ab7b0 con 0x7f3b740cfc40 2023-11-28T20:38:42.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b71d9b640 1 -- 172.21.15.167:0/901702864 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640abb40 con 0x7f3b740cfc40 2023-11-28T20:38:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b78832640 1 -- 172.21.15.167:0/901702864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b740cfc40 msgr2=0x7f3b740cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b78832640 1 --2- 172.21.15.167:0/901702864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b740cfc40 0x7f3b740cb770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3b640097c0 tx=0x7f3b6401c450 comp rx=0 tx=0).stop 2023-11-28T20:38:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b78832640 1 -- 172.21.15.167:0/901702864 shutdown_connections 2023-11-28T20:38:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b78832640 1 --2- 172.21.15.167:0/901702864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b740cfc40 0x7f3b740cb770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b78832640 1 -- 172.21.15.167:0/901702864 >> 172.21.15.167:0/901702864 conn(0x7f3b7406c1f0 msgr2=0x7f3b74071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b78832640 1 -- 172.21.15.167:0/901702864 shutdown_connections 2023-11-28T20:38:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.720+0000 7f3b78832640 1 -- 172.21.15.167:0/901702864 wait complete. 2023-11-28T20:38:42.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 Processor -- start 2023-11-28T20:38:42.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 -- start start 2023-11-28T20:38:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b740cf860 0x7f3b740b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b740cfc40 0x7f3b74147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b74153ae0 0x7f3b74158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74146db0 con 0x7f3b74153ae0 2023-11-28T20:38:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74147370 con 0x7f3b740cf860 2023-11-28T20:38:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740b3ea0 con 0x7f3b740cfc40 2023-11-28T20:38:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b72d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b74153ae0 0x7f3b74158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b72d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b74153ae0 0x7f3b74158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48900/0 (socket says 172.21.15.167:48900) 2023-11-28T20:38:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b72d9d640 1 -- 172.21.15.167:0/1118519031 learned_addr learned my addr 172.21.15.167:0/1118519031 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b69d9b640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b740cfc40 0x7f3b74147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b7259c640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b740cf860 0x7f3b740b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b72d9d640 1 -- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b740cfc40 msgr2=0x7f3b74147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b72d9d640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b740cfc40 0x7f3b74147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b72d9d640 1 -- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b740cf860 msgr2=0x7f3b740b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b72d9d640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b740cf860 0x7f3b740b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b72d9d640 1 -- 172.21.15.167:0/1118519031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009420 con 0x7f3b74153ae0 2023-11-28T20:38:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b72d9d640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b74153ae0 0x7f3b74158dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00cbc0 tx=0x7f3b6c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b6b7fe640 1 -- 172.21.15.167:0/1118519031 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00ad40 con 0x7f3b74153ae0 2023-11-28T20:38:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b6b7fe640 1 -- 172.21.15.167:0/1118519031 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c012400 con 0x7f3b74153ae0 2023-11-28T20:38:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b740b4180 con 0x7f3b74153ae0 2023-11-28T20:38:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b6b7fe640 1 -- 172.21.15.167:0/1118519031 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00aea0 con 0x7f3b74153ae0 2023-11-28T20:38:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b74147000 con 0x7f3b74153ae0 2023-11-28T20:38:42.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.724+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b741474e0 con 0x7f3b74153ae0 2023-11-28T20:38:42.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.728+0000 7f3b6b7fe640 1 -- 172.21.15.167:0/1118519031 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b6c007070 con 0x7f3b74153ae0 2023-11-28T20:38:42.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.728+0000 7f3b6b7fe640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b54066470 0x7f3b54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:42.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.728+0000 7f3b6b7fe640 1 -- 172.21.15.167:0/1118519031 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b6c083fd0 con 0x7f3b74153ae0 2023-11-28T20:38:42.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.728+0000 7f3b7259c640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b54066470 0x7f3b54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:42.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.728+0000 7f3b7259c640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b54066470 0x7f3b54068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c000f70 tx=0x7f3b5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:42.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.732+0000 7f3b6b7fe640 1 -- 172.21.15.167:0/1118519031 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b6c051200 con 0x7f3b74153ae0 2023-11-28T20:38:42.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.908+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b74075c90 con 0x7f3b74153ae0 2023-11-28T20:38:42.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b6b7fe640 1 -- 172.21.15.167:0/1118519031 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+6526 (secure 0 0 0) 0x7f3b6c017090 con 0x7f3b74153ae0 2023-11-28T20:38:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:42.915 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T20:38:41.924215+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4279,"mds_1":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.167:6837/1234930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1234930245},{"type":"v1","addr":"172.21.15.167:6837","nonce":1234930245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:38:42.915 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 11 2023-11-28T20:38:42.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b54066470 msgr2=0x7f3b54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b54066470 0x7f3b54068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c000f70 tx=0x7f3b5c009040 comp rx=0 tx=0).stop 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b74153ae0 msgr2=0x7f3b74158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b74153ae0 0x7f3b74158dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00cbc0 tx=0x7f3b6c00a430 comp rx=0 tx=0).stop 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 shutdown_connections 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b54066470 0x7f3b54068930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b74153ae0 0x7f3b74158dc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b740cfc40 0x7f3b74147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 --2- 172.21.15.167:0/1118519031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b740cf860 0x7f3b740b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 >> 172.21.15.167:0/1118519031 conn(0x7f3b7406c1f0 msgr2=0x7f3b740ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 shutdown_connections 2023-11-28T20:38:42.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:42.912+0000 7f3b78832640 1 -- 172.21.15.167:0/1118519031 wait complete. 2023-11-28T20:38:42.936 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:43.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.068+0000 7efcfaa5a640 1 Processor -- start 2023-11-28T20:38:43.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.068+0000 7efcfaa5a640 1 -- start start 2023-11-28T20:38:43.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcfaa5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcf406e030 0x7efcf41500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcfaa5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf41571d0 con 0x7efcf4072630 2023-11-28T20:38:43.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcfaa5a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf4071a90 con 0x7efcf4070480 2023-11-28T20:38:43.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcfaa5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40c70d0 con 0x7efcf406e030 2023-11-28T20:38:43.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf8ff7640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7efcf4072630 0x7efcf4160b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44570/0 (socket says 172.21.15.167:44570) 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf8ff7640 1 -- 172.21.15.167:0/2561494229 learned_addr learned my addr 172.21.15.167:0/2561494229 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf3fff640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcf406e030 0x7efcf41500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316302384 0 0) 0x7efcf41571d0 con 0x7efcf4072630 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcdc003530 con 0x7efcf4072630 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1015506447 0 0) 0x7efcdc003530 con 0x7efcf4072630 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcf406e030 msgr2=0x7efcf41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcf406e030 0x7efcf41500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 >> v1:172.21.15.178:6789/0 conn(0x7efcf4070480 legacy=0x7efcf4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40c73b0 con 0x7efcf4072630 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7efcec001a00 con 0x7efcf4072630 2023-11-28T20:38:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 >> v1:172.21.15.167:6789/0 conn(0x7efcf4072630 legacy=0x7efcf4160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc0039b0 0x7efcdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcf406e030 0x7efcdc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcdc004d10 0x7efcdc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40c70d0 con 0x7efcdc0039b0 2023-11-28T20:38:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc00b990 con 0x7efcdc004d10 2023-11-28T20:38:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc00bb50 con 0x7efcf406e030 2023-11-28T20:38:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf3fff640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc0039b0 0x7efcdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf37fe640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcf406e030 0x7efcdc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf8ff7640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcdc004d10 0x7efcdc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf3fff640 1 -- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcf406e030 msgr2=0x7efcdc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf3fff640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcf406e030 0x7efcdc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf3fff640 1 -- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcdc004d10 msgr2=0x7efcdc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf3fff640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcdc004d10 0x7efcdc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.072+0000 7efcf3fff640 1 -- 172.21.15.167:0/2561494229 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc003530 con 0x7efcdc0039b0 2023-11-28T20:38:43.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcf3fff640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc0039b0 0x7efcdc003d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efce400aa60 tx=0x7efce401cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cefb7e2288e4b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:43.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40a5b90 con 0x7efcdc0039b0 2023-11-28T20:38:43.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce40a5cf0 con 0x7efcdc0039b0 2023-11-28T20:38:43.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcf2ffd640 1 -- 172.21.15.167:0/2561494229 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40ad680 con 0x7efcdc0039b0 2023-11-28T20:38:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcfaa5a640 1 -- 172.21.15.167:0/2561494229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc0039b0 msgr2=0x7efcdc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcfaa5a640 1 --2- 172.21.15.167:0/2561494229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc0039b0 0x7efcdc003d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efce400aa60 tx=0x7efce401cb50 comp rx=0 tx=0).stop 2023-11-28T20:38:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcf8ff7640 1 -- 172.21.15.167:0/2561494229 reap_dead start 2023-11-28T20:38:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcfaa5a640 1 -- 172.21.15.167:0/2561494229 shutdown_connections 2023-11-28T20:38:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcfaa5a640 1 -- 172.21.15.167:0/2561494229 >> 172.21.15.167:0/2561494229 conn(0x7efcf40cb1e0 msgr2=0x7efcf40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcfaa5a640 1 -- 172.21.15.167:0/2561494229 shutdown_connections 2023-11-28T20:38:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcfaa5a640 1 -- 172.21.15.167:0/2561494229 wait complete. 2023-11-28T20:38:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.076+0000 7efcfaa5a640 1 Processor -- start 2023-11-28T20:38:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 -- start start 2023-11-28T20:38:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcdc0039b0 0x7efcf414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf4153f70 0x7efcf41f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcf4148fb0 0x7efcf41f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41efd60 con 0x7efcf4153f70 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4154540 con 0x7efcf4148fb0 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4154820 con 0x7efcdc0039b0 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf4153f70 0x7efcf41f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf4153f70 0x7efcf41f01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46554/0 (socket says 172.21.15.167:46554) 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf37fe640 1 -- 172.21.15.167:0/4112486958 learned_addr learned my addr 172.21.15.167:0/4112486958 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf3fff640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcdc0039b0 0x7efcf414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf8ff7640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcf4148fb0 0x7efcf41f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf37fe640 1 -- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcdc0039b0 msgr2=0x7efcf414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf37fe640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcdc0039b0 0x7efcf414c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf37fe640 1 -- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcf4148fb0 msgr2=0x7efcf41f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf37fe640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcf4148fb0 0x7efcf41f2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf37fe640 1 -- 172.21.15.167:0/4112486958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4154b00 con 0x7efcf4153f70 2023-11-28T20:38:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf37fe640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf4153f70 0x7efcf41f01f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efce8007860 tx=0x7efce800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf0ff9640 1 -- 172.21.15.167:0/4112486958 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce800fcb0 con 0x7efcf4153f70 2023-11-28T20:38:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf0ff9640 1 -- 172.21.15.167:0/4112486958 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce800fe10 con 0x7efcf4153f70 2023-11-28T20:38:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf4154de0 con 0x7efcf4153f70 2023-11-28T20:38:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcf0ff9640 1 -- 172.21.15.167:0/4112486958 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8005310 con 0x7efcf4153f70 2023-11-28T20:38:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf414c820 con 0x7efcf4153f70 2023-11-28T20:38:43.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.080+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf40682c0 con 0x7efcf4153f70 2023-11-28T20:38:43.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.084+0000 7efcf0ff9640 1 -- 172.21.15.167:0/4112486958 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efce8003600 con 0x7efcf4153f70 2023-11-28T20:38:43.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.084+0000 7efcf0ff9640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efce0066470 0x7efce0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.084+0000 7efcf0ff9640 1 -- 172.21.15.167:0/4112486958 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efce8087af0 con 0x7efcf4153f70 2023-11-28T20:38:43.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.084+0000 7efcf3fff640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efce0066470 0x7efce0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.084+0000 7efcf3fff640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efce0066470 0x7efce0068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efce40af000 tx=0x7efce40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:43.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.088+0000 7efcf0ff9640 1 -- 172.21.15.167:0/4112486958 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efce8054bf0 con 0x7efcf4153f70 2023-11-28T20:38:43.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.236+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcf4075c90 con 0x7efcf4153f70 2023-11-28T20:38:43.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcf0ff9640 1 -- 172.21.15.167:0/4112486958 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7efce8019020 con 0x7efcf4153f70 2023-11-28T20:38:43.243 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:43.243 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:43.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efce0066470 msgr2=0x7efce0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efce0066470 0x7efce0068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efce40af000 tx=0x7efce40046d0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf4153f70 msgr2=0x7efcf41f01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf4153f70 0x7efcf41f01f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efce8007860 tx=0x7efce800f5a0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 shutdown_connections 2023-11-28T20:38:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efce0066470 0x7efce0068930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efcf4148fb0 0x7efcf41f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf4153f70 0x7efcf41f01f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 --2- 172.21.15.167:0/4112486958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efcdc0039b0 0x7efcf414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 >> 172.21.15.167:0/4112486958 conn(0x7efcf40cb1e0 msgr2=0x7efcf414d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:43.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 shutdown_connections 2023-11-28T20:38:43.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.240+0000 7efcfaa5a640 1 -- 172.21.15.167:0/4112486958 wait complete. 2023-11-28T20:38:43.266 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T20:38:43.266 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:38:43.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.400+0000 7fcf99874640 1 Processor -- start 2023-11-28T20:38:43.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf99874640 1 -- start start 2023-11-28T20:38:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf99874640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcf94150f30 0x7fcf94070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf99874640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf9406b2a0 0x7fcf940c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf99874640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf94156b10 con 0x7fcf940c4b60 2023-11-28T20:38:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf99874640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf940c3a80 con 0x7fcf94150f30 2023-11-28T20:38:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf99874640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf940c2cc0 con 0x7fcf9406b2a0 2023-11-28T20:38:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf98872640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcf94150f30 0x7fcf94070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf99073640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcf940c4b60 0x7fcf94159f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44574/0 (socket says 172.21.15.167:44574) 2023-11-28T20:38:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf99073640 1 -- 172.21.15.167:0/3126910306 learned_addr learned my addr 172.21.15.167:0/3126910306 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf93fff640 1 --2- 172.21.15.167:0/3126910306 >> v2:172.21.15.178:3300/0 conn(0x7fcf9406b2a0 0x7fcf940c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf98872640 1 -- 172.21.15.167:0/3126910306 >> v2:172.21.15.178:3300/0 conn(0x7fcf9406b2a0 msgr2=0x7fcf940c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf98872640 1 --2- 172.21.15.167:0/3126910306 >> v2:172.21.15.178:3300/0 conn(0x7fcf9406b2a0 0x7fcf940c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf98872640 1 -- 172.21.15.167:0/3126910306 >> v1:172.21.15.167:6789/0 conn(0x7fcf940c4b60 legacy=0x7fcf94159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf98872640 1 -- 172.21.15.167:0/3126910306 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf94156db0 con 0x7fcf94150f30 2023-11-28T20:38:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf937fe640 1 -- 172.21.15.167:0/3126910306 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314149263 0 0) 0x7fcf94156b10 con 0x7fcf940c4b60 2023-11-28T20:38:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.404+0000 7fcf93fff640 1 --2- 172.21.15.167:0/3126910306 >> v2:172.21.15.178:3300/0 conn(0x7fcf9406b2a0 0x7fcf940c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf98872640 1 --2- 172.21.15.167:0/3126910306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 0x7fcf94070460 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf940c3fd0 tx=0x7fcf8801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c48edacbeec604 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf937fe640 1 -- 172.21.15.167:0/3126910306 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880ab600 con 0x7fcf94150f30 2023-11-28T20:38:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf937fe640 1 -- 172.21.15.167:0/3126910306 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf880a7050 con 0x7fcf94150f30 2023-11-28T20:38:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf937fe640 1 -- 172.21.15.167:0/3126910306 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880ab980 con 0x7fcf94150f30 2023-11-28T20:38:43.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 -- 172.21.15.167:0/3126910306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 msgr2=0x7fcf94070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 --2- 172.21.15.167:0/3126910306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 0x7fcf94070460 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf940c3fd0 tx=0x7fcf8801c460 comp rx=0 tx=0).stop 2023-11-28T20:38:43.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 -- 172.21.15.167:0/3126910306 shutdown_connections 2023-11-28T20:38:43.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 --2- 172.21.15.167:0/3126910306 >> v2:172.21.15.178:3300/0 conn(0x7fcf9406b2a0 0x7fcf940c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 --2- 172.21.15.167:0/3126910306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 0x7fcf94070460 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 -- 172.21.15.167:0/3126910306 >> 172.21.15.167:0/3126910306 conn(0x7fcf940cb3f0 msgr2=0x7fcf940cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 -- 172.21.15.167:0/3126910306 shutdown_connections 2023-11-28T20:38:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 -- 172.21.15.167:0/3126910306 wait complete. 2023-11-28T20:38:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 Processor -- start 2023-11-28T20:38:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.408+0000 7fcf99874640 1 -- start start 2023-11-28T20:38:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99874640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf9406b2a0 0x7fcf9413c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99874640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf940c4b60 0x7fcf94143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99874640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 0x7fcf94144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99874640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940ca2d0 con 0x7fcf94150f30 2023-11-28T20:38:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99874640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf94154250 con 0x7fcf9406b2a0 2023-11-28T20:38:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99874640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940cae30 con 0x7fcf940c4b60 2023-11-28T20:38:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99073640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 0x7fcf94144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99073640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 0x7fcf94144190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46580/0 (socket says 172.21.15.167:46580) 2023-11-28T20:38:43.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99073640 1 -- 172.21.15.167:0/2090111423 learned_addr learned my addr 172.21.15.167:0/2090111423 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:43.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf93fff640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf940c4b60 0x7fcf94143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf98872640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf9406b2a0 0x7fcf9413c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99073640 1 -- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf940c4b60 msgr2=0x7fcf94143c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99073640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf940c4b60 0x7fcf94143c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99073640 1 -- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf9406b2a0 msgr2=0x7fcf9413c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99073640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf9406b2a0 0x7fcf9413c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99073640 1 -- 172.21.15.167:0/2090111423 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88009420 con 0x7fcf94150f30 2023-11-28T20:38:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99073640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 0x7fcf94144190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00c7a0 tx=0x7fcf8c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf917fa640 1 -- 172.21.15.167:0/2090111423 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00a640 con 0x7fcf94150f30 2023-11-28T20:38:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf917fa640 1 -- 172.21.15.167:0/2090111423 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c00a7a0 con 0x7fcf94150f30 2023-11-28T20:38:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf917fa640 1 -- 172.21.15.167:0/2090111423 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00ab90 con 0x7fcf94150f30 2023-11-28T20:38:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9413c720 con 0x7fcf94150f30 2023-11-28T20:38:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf94141aa0 con 0x7fcf94150f30 2023-11-28T20:38:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.412+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf94067c40 con 0x7fcf94150f30 2023-11-28T20:38:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.416+0000 7fcf917fa640 1 -- 172.21.15.167:0/2090111423 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf8c00acf0 con 0x7fcf94150f30 2023-11-28T20:38:43.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.416+0000 7fcf917fa640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf78066470 0x7fcf78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.416+0000 7fcf917fa640 1 -- 172.21.15.167:0/2090111423 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf8c0835b0 con 0x7fcf94150f30 2023-11-28T20:38:43.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.416+0000 7fcf98872640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf78066470 0x7fcf78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.416+0000 7fcf98872640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf78066470 0x7fcf78068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf880ad000 tx=0x7fcf880a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:43.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.420+0000 7fcf917fa640 1 -- 172.21.15.167:0/2090111423 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf8c050880 con 0x7fcf94150f30 2023-11-28T20:38:43.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.568+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf940c28f0 con 0x7fcf78066470 2023-11-28T20:38:43.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.684+0000 7fcf917fa640 1 -- 172.21.15.167:0/2090111423 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345182 (secure 0 0 0) 0x7fcf880bb070 con 0x7fcf78066470 2023-11-28T20:38:43.691 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:43.694 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:38:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf78066470 msgr2=0x7fcf78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf78066470 0x7fcf78068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf880ad000 tx=0x7fcf880a6000 comp rx=0 tx=0).stop 2023-11-28T20:38:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 msgr2=0x7fcf94144190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 0x7fcf94144190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00c7a0 tx=0x7fcf8c00cc60 comp rx=0 tx=0).stop 2023-11-28T20:38:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 shutdown_connections 2023-11-28T20:38:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf78066470 0x7fcf78068930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf94150f30 0x7fcf94144190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf940c4b60 0x7fcf94143c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 --2- 172.21.15.167:0/2090111423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf9406b2a0 0x7fcf9413c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 >> 172.21.15.167:0/2090111423 conn(0x7fcf940cb3f0 msgr2=0x7fcf9414f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 shutdown_connections 2023-11-28T20:38:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.688+0000 7fcf99874640 1 -- 172.21.15.167:0/2090111423 wait complete. 2023-11-28T20:38:43.712 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-28T20:38:43.437075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236056,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738664,"statfs":{"total":773094113280,"available":772852391936,"internally_reserved":0,"allocated":3317760,"data_stored":2006214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005302"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528906+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:24.528906+0000","last_peered":"2023-11-28T20:38:24.528906+0000","last_clean":"2023-11-28T20:38:24.528906+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:24.528906+0000","last_undegraded":"2023-11-28T20:38:24.528906+0000","last_fullsized":"2023-11-28T20:38:24.528906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555618+0000","last_change":"2023-11-28T20:38:19.384120+0000","last_active":"2023-11-28T20:38:23.555618+0000","last_peered":"2023-11-28T20:38:23.555618+0000","last_clean":"2023-11-28T20:38:23.555618+0000","last_became_active":"2023-11-28T20:38:19.383899+0000","last_became_peered":"2023-11-28T20:38:19.383899+0000","last_unstale":"2023-11-28T20:38:23.555618+0000","last_undegraded":"2023-11-28T20:38:23.555618+0000","last_fullsized":"2023-11-28T20:38:23.555618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:02:32.168294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523700+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:38:24.523700+0000","last_peered":"2023-11-28T20:38:24.523700+0000","last_clean":"2023-11-28T20:38:24.523700+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:38:24.523700+0000","last_undegraded":"2023-11-28T20:38:24.523700+0000","last_fullsized":"2023-11-28T20:38:24.523700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524795+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:38:24.524795+0000","last_peered":"2023-11-28T20:38:24.524795+0000","last_clean":"2023-11-28T20:38:24.524795+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:38:24.524795+0000","last_undegraded":"2023-11-28T20:38:24.524795+0000","last_fullsized":"2023-11-28T20:38:24.524795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562919+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:23.562919+0000","last_peered":"2023-11-28T20:38:23.562919+0000","last_clean":"2023-11-28T20:38:23.562919+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:23.562919+0000","last_undegraded":"2023-11-28T20:38:23.562919+0000","last_fullsized":"2023-11-28T20:38:23.562919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527387+0000","last_change":"2023-11-28T20:38:23.600077+0000","last_active":"2023-11-28T20:38:24.527387+0000","last_peered":"2023-11-28T20:38:24.527387+0000","last_clean":"2023-11-28T20:38:24.527387+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:24.527387+0000","last_undegraded":"2023-11-28T20:38:24.527387+0000","last_fullsized":"2023-11-28T20:38:24.527387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:39.002909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532607+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:24.532607+0000","last_peered":"2023-11-28T20:38:24.532607+0000","last_clean":"2023-11-28T20:38:24.532607+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:24.532607+0000","last_undegraded":"2023-11-28T20:38:24.532607+0000","last_fullsized":"2023-11-28T20:38:24.532607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560982+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:23.560982+0000","last_peered":"2023-11-28T20:38:23.560982+0000","last_clean":"2023-11-28T20:38:23.560982+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:23.560982+0000","last_undegraded":"2023-11-28T20:38:23.560982+0000","last_fullsized":"2023-11-28T20:38:23.560982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529343+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:24.529343+0000","last_peered":"2023-11-28T20:38:24.529343+0000","last_clean":"2023-11-28T20:38:24.529343+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:24.529343+0000","last_undegraded":"2023-11-28T20:38:24.529343+0000","last_fullsized":"2023-11-28T20:38:24.529343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532210+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532210+0000","last_peered":"2023-11-28T20:38:24.532210+0000","last_clean":"2023-11-28T20:38:24.532210+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532210+0000","last_undegraded":"2023-11-28T20:38:24.532210+0000","last_fullsized":"2023-11-28T20:38:24.532210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562448+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:23.562448+0000","last_peered":"2023-11-28T20:38:23.562448+0000","last_clean":"2023-11-28T20:38:23.562448+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:23.562448+0000","last_undegraded":"2023-11-28T20:38:23.562448+0000","last_fullsized":"2023-11-28T20:38:23.562448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528969+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:24.528969+0000","last_peered":"2023-11-28T20:38:24.528969+0000","last_clean":"2023-11-28T20:38:24.528969+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:24.528969+0000","last_undegraded":"2023-11-28T20:38:24.528969+0000","last_fullsized":"2023-11-28T20:38:24.528969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563714+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:23.563714+0000","last_peered":"2023-11-28T20:38:23.563714+0000","last_clean":"2023-11-28T20:38:23.563714+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:23.563714+0000","last_undegraded":"2023-11-28T20:38:23.563714+0000","last_fullsized":"2023-11-28T20:38:23.563714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528553+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:24.528553+0000","last_peered":"2023-11-28T20:38:24.528553+0000","last_clean":"2023-11-28T20:38:24.528553+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:24.528553+0000","last_undegraded":"2023-11-28T20:38:24.528553+0000","last_fullsized":"2023-11-28T20:38:24.528553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530149+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:24.530149+0000","last_peered":"2023-11-28T20:38:24.530149+0000","last_clean":"2023-11-28T20:38:24.530149+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:24.530149+0000","last_undegraded":"2023-11-28T20:38:24.530149+0000","last_fullsized":"2023-11-28T20:38:24.530149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556220+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:38:23.556220+0000","last_peered":"2023-11-28T20:38:23.556220+0000","last_clean":"2023-11-28T20:38:23.556220+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:38:23.556220+0000","last_undegraded":"2023-11-28T20:38:23.556220+0000","last_fullsized":"2023-11-28T20:38:23.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571843+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:38:23.571843+0000","last_peered":"2023-11-28T20:38:23.571843+0000","last_clean":"2023-11-28T20:38:23.571843+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:38:23.571843+0000","last_undegraded":"2023-11-28T20:38:23.571843+0000","last_fullsized":"2023-11-28T20:38:23.571843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529638+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:24.529638+0000","last_peered":"2023-11-28T20:38:24.529638+0000","last_clean":"2023-11-28T20:38:24.529638+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:24.529638+0000","last_undegraded":"2023-11-28T20:38:24.529638+0000","last_fullsized":"2023-11-28T20:38:24.529638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556959+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:38:23.556959+0000","last_peered":"2023-11-28T20:38:23.556959+0000","last_clean":"2023-11-28T20:38:23.556959+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:38:23.556959+0000","last_undegraded":"2023-11-28T20:38:23.556959+0000","last_fullsized":"2023-11-28T20:38:23.556959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571617+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:38:23.571617+0000","last_peered":"2023-11-28T20:38:23.571617+0000","last_clean":"2023-11-28T20:38:23.571617+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:38:23.571617+0000","last_undegraded":"2023-11-28T20:38:23.571617+0000","last_fullsized":"2023-11-28T20:38:23.571617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535771+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.535771+0000","last_peered":"2023-11-28T20:38:24.535771+0000","last_clean":"2023-11-28T20:38:24.535771+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:38:24.535771+0000","last_undegraded":"2023-11-28T20:38:24.535771+0000","last_fullsized":"2023-11-28T20:38:24.535771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.585068+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:23.585068+0000","last_peered":"2023-11-28T20:38:23.585068+0000","last_clean":"2023-11-28T20:38:23.585068+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:23.585068+0000","last_undegraded":"2023-11-28T20:38:23.585068+0000","last_fullsized":"2023-11-28T20:38:23.585068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770408+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:23.770408+0000","last_peered":"2023-11-28T20:38:23.770408+0000","last_clean":"2023-11-28T20:38:23.770408+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:23.770408+0000","last_undegraded":"2023-11-28T20:38:23.770408+0000","last_fullsized":"2023-11-28T20:38:23.770408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530157+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:24.530157+0000","last_peered":"2023-11-28T20:38:24.530157+0000","last_clean":"2023-11-28T20:38:24.530157+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:24.530157+0000","last_undegraded":"2023-11-28T20:38:24.530157+0000","last_fullsized":"2023-11-28T20:38:24.530157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561892+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:23.561892+0000","last_peered":"2023-11-28T20:38:23.561892+0000","last_clean":"2023-11-28T20:38:23.561892+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:23.561892+0000","last_undegraded":"2023-11-28T20:38:23.561892+0000","last_fullsized":"2023-11-28T20:38:23.561892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531914+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:24.531914+0000","last_peered":"2023-11-28T20:38:24.531914+0000","last_clean":"2023-11-28T20:38:24.531914+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:24.531914+0000","last_undegraded":"2023-11-28T20:38:24.531914+0000","last_fullsized":"2023-11-28T20:38:24.531914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528204+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:24.528204+0000","last_peered":"2023-11-28T20:38:24.528204+0000","last_clean":"2023-11-28T20:38:24.528204+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:24.528204+0000","last_undegraded":"2023-11-28T20:38:24.528204+0000","last_fullsized":"2023-11-28T20:38:24.528204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556394+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:38:23.556394+0000","last_peered":"2023-11-28T20:38:23.556394+0000","last_clean":"2023-11-28T20:38:23.556394+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:38:23.556394+0000","last_undegraded":"2023-11-28T20:38:23.556394+0000","last_fullsized":"2023-11-28T20:38:23.556394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535703+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:38:24.535703+0000","last_peered":"2023-11-28T20:38:24.535703+0000","last_clean":"2023-11-28T20:38:24.535703+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:38:24.535703+0000","last_undegraded":"2023-11-28T20:38:24.535703+0000","last_fullsized":"2023-11-28T20:38:24.535703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523623+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:38:24.523623+0000","last_peered":"2023-11-28T20:38:24.523623+0000","last_clean":"2023-11-28T20:38:24.523623+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:38:24.523623+0000","last_undegraded":"2023-11-28T20:38:24.523623+0000","last_fullsized":"2023-11-28T20:38:24.523623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572645+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:38:23.572645+0000","last_peered":"2023-11-28T20:38:23.572645+0000","last_clean":"2023-11-28T20:38:23.572645+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:38:23.572645+0000","last_undegraded":"2023-11-28T20:38:23.572645+0000","last_fullsized":"2023-11-28T20:38:23.572645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.772221+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:23.772221+0000","last_peered":"2023-11-28T20:38:23.772221+0000","last_clean":"2023-11-28T20:38:23.772221+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:23.772221+0000","last_undegraded":"2023-11-28T20:38:23.772221+0000","last_fullsized":"2023-11-28T20:38:23.772221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344337+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:24.344337+0000","last_peered":"2023-11-28T20:38:24.344337+0000","last_clean":"2023-11-28T20:38:24.344337+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:24.344337+0000","last_undegraded":"2023-11-28T20:38:24.344337+0000","last_fullsized":"2023-11-28T20:38:24.344337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562716+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:23.562716+0000","last_peered":"2023-11-28T20:38:23.562716+0000","last_clean":"2023-11-28T20:38:23.562716+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:23.562716+0000","last_undegraded":"2023-11-28T20:38:23.562716+0000","last_fullsized":"2023-11-28T20:38:23.562716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572746+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:38:23.572746+0000","last_peered":"2023-11-28T20:38:23.572746+0000","last_clean":"2023-11-28T20:38:23.572746+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:38:23.572746+0000","last_undegraded":"2023-11-28T20:38:23.572746+0000","last_fullsized":"2023-11-28T20:38:23.572746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535102+0000","last_change":"2023-11-28T20:38:23.594782+0000","last_active":"2023-11-28T20:38:24.535102+0000","last_peered":"2023-11-28T20:38:24.535102+0000","last_clean":"2023-11-28T20:38:24.535102+0000","last_became_active":"2023-11-28T20:38:23.594034+0000","last_became_peered":"2023-11-28T20:38:23.594034+0000","last_unstale":"2023-11-28T20:38:24.535102+0000","last_undegraded":"2023-11-28T20:38:24.535102+0000","last_fullsized":"2023-11-28T20:38:24.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:29:14.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.581982+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:23.581982+0000","last_peered":"2023-11-28T20:38:23.581982+0000","last_clean":"2023-11-28T20:38:23.581982+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:23.581982+0000","last_undegraded":"2023-11-28T20:38:23.581982+0000","last_fullsized":"2023-11-28T20:38:23.581982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560074+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:23.560074+0000","last_peered":"2023-11-28T20:38:23.560074+0000","last_clean":"2023-11-28T20:38:23.560074+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:23.560074+0000","last_undegraded":"2023-11-28T20:38:23.560074+0000","last_fullsized":"2023-11-28T20:38:23.560074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535460+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:38:24.535460+0000","last_peered":"2023-11-28T20:38:24.535460+0000","last_clean":"2023-11-28T20:38:24.535460+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:38:24.535460+0000","last_undegraded":"2023-11-28T20:38:24.535460+0000","last_fullsized":"2023-11-28T20:38:24.535460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571588+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:38:23.571588+0000","last_peered":"2023-11-28T20:38:23.571588+0000","last_clean":"2023-11-28T20:38:23.571588+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:38:23.571588+0000","last_undegraded":"2023-11-28T20:38:23.571588+0000","last_fullsized":"2023-11-28T20:38:23.571588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579909+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:38:23.579909+0000","last_peered":"2023-11-28T20:38:23.579909+0000","last_clean":"2023-11-28T20:38:23.579909+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:38:23.579909+0000","last_undegraded":"2023-11-28T20:38:23.579909+0000","last_fullsized":"2023-11-28T20:38:23.579909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535820+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:38:24.535820+0000","last_peered":"2023-11-28T20:38:24.535820+0000","last_clean":"2023-11-28T20:38:24.535820+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:38:24.535820+0000","last_undegraded":"2023-11-28T20:38:24.535820+0000","last_fullsized":"2023-11-28T20:38:24.535820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560814+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:23.560814+0000","last_peered":"2023-11-28T20:38:23.560814+0000","last_clean":"2023-11-28T20:38:23.560814+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:23.560814+0000","last_undegraded":"2023-11-28T20:38:23.560814+0000","last_fullsized":"2023-11-28T20:38:23.560814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770415+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:23.770415+0000","last_peered":"2023-11-28T20:38:23.770415+0000","last_clean":"2023-11-28T20:38:23.770415+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:23.770415+0000","last_undegraded":"2023-11-28T20:38:23.770415+0000","last_fullsized":"2023-11-28T20:38:23.770415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344627+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:24.344627+0000","last_peered":"2023-11-28T20:38:24.344627+0000","last_clean":"2023-11-28T20:38:24.344627+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:24.344627+0000","last_undegraded":"2023-11-28T20:38:24.344627+0000","last_fullsized":"2023-11-28T20:38:24.344627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555061+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:38:23.555061+0000","last_peered":"2023-11-28T20:38:23.555061+0000","last_clean":"2023-11-28T20:38:23.555061+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:38:23.555061+0000","last_undegraded":"2023-11-28T20:38:23.555061+0000","last_fullsized":"2023-11-28T20:38:23.555061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.567796+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:23.567796+0000","last_peered":"2023-11-28T20:38:23.567796+0000","last_clean":"2023-11-28T20:38:23.567796+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:23.567796+0000","last_undegraded":"2023-11-28T20:38:23.567796+0000","last_fullsized":"2023-11-28T20:38:23.567796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770661+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:23.770661+0000","last_peered":"2023-11-28T20:38:23.770661+0000","last_clean":"2023-11-28T20:38:23.770661+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:23.770661+0000","last_undegraded":"2023-11-28T20:38:23.770661+0000","last_fullsized":"2023-11-28T20:38:23.770661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351420+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:24.351420+0000","last_peered":"2023-11-28T20:38:24.351420+0000","last_clean":"2023-11-28T20:38:24.351420+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:24.351420+0000","last_undegraded":"2023-11-28T20:38:24.351420+0000","last_fullsized":"2023-11-28T20:38:24.351420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771541+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:23.771541+0000","last_peered":"2023-11-28T20:38:23.771541+0000","last_clean":"2023-11-28T20:38:23.771541+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:23.771541+0000","last_undegraded":"2023-11-28T20:38:23.771541+0000","last_fullsized":"2023-11-28T20:38:23.771541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.582714+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:38:23.582714+0000","last_peered":"2023-11-28T20:38:23.582714+0000","last_clean":"2023-11-28T20:38:23.582714+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:38:23.582714+0000","last_undegraded":"2023-11-28T20:38:23.582714+0000","last_fullsized":"2023-11-28T20:38:23.582714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350832+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:24.350832+0000","last_peered":"2023-11-28T20:38:24.350832+0000","last_clean":"2023-11-28T20:38:24.350832+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:24.350832+0000","last_undegraded":"2023-11-28T20:38:24.350832+0000","last_fullsized":"2023-11-28T20:38:24.350832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561174+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:23.561174+0000","last_peered":"2023-11-28T20:38:23.561174+0000","last_clean":"2023-11-28T20:38:23.561174+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:23.561174+0000","last_undegraded":"2023-11-28T20:38:23.561174+0000","last_fullsized":"2023-11-28T20:38:23.561174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.533486+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:38:24.533486+0000","last_peered":"2023-11-28T20:38:24.533486+0000","last_clean":"2023-11-28T20:38:24.533486+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:38:24.533486+0000","last_undegraded":"2023-11-28T20:38:24.533486+0000","last_fullsized":"2023-11-28T20:38:24.533486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344212+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:24.344212+0000","last_peered":"2023-11-28T20:38:24.344212+0000","last_clean":"2023-11-28T20:38:24.344212+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:24.344212+0000","last_undegraded":"2023-11-28T20:38:24.344212+0000","last_fullsized":"2023-11-28T20:38:24.344212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771932+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:23.771932+0000","last_peered":"2023-11-28T20:38:23.771932+0000","last_clean":"2023-11-28T20:38:23.771932+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:23.771932+0000","last_undegraded":"2023-11-28T20:38:23.771932+0000","last_fullsized":"2023-11-28T20:38:23.771932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532302+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:38:24.532302+0000","last_peered":"2023-11-28T20:38:24.532302+0000","last_clean":"2023-11-28T20:38:24.532302+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:38:24.532302+0000","last_undegraded":"2023-11-28T20:38:24.532302+0000","last_fullsized":"2023-11-28T20:38:24.532302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348053+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:24.348053+0000","last_peered":"2023-11-28T20:38:24.348053+0000","last_clean":"2023-11-28T20:38:24.348053+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:24.348053+0000","last_undegraded":"2023-11-28T20:38:24.348053+0000","last_fullsized":"2023-11-28T20:38:24.348053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771535+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:23.771535+0000","last_peered":"2023-11-28T20:38:23.771535+0000","last_clean":"2023-11-28T20:38:23.771535+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:23.771535+0000","last_undegraded":"2023-11-28T20:38:23.771535+0000","last_fullsized":"2023-11-28T20:38:23.771535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530364+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:24.530364+0000","last_peered":"2023-11-28T20:38:24.530364+0000","last_clean":"2023-11-28T20:38:24.530364+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:24.530364+0000","last_undegraded":"2023-11-28T20:38:24.530364+0000","last_fullsized":"2023-11-28T20:38:24.530364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527514+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:24.527514+0000","last_peered":"2023-11-28T20:38:24.527514+0000","last_clean":"2023-11-28T20:38:24.527514+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:24.527514+0000","last_undegraded":"2023-11-28T20:38:24.527514+0000","last_fullsized":"2023-11-28T20:38:24.527514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770655+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:23.770655+0000","last_peered":"2023-11-28T20:38:23.770655+0000","last_clean":"2023-11-28T20:38:23.770655+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:23.770655+0000","last_undegraded":"2023-11-28T20:38:23.770655+0000","last_fullsized":"2023-11-28T20:38:23.770655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534259+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:38:24.534259+0000","last_peered":"2023-11-28T20:38:24.534259+0000","last_clean":"2023-11-28T20:38:24.534259+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:38:24.534259+0000","last_undegraded":"2023-11-28T20:38:24.534259+0000","last_fullsized":"2023-11-28T20:38:24.534259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344497+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:24.344497+0000","last_peered":"2023-11-28T20:38:24.344497+0000","last_clean":"2023-11-28T20:38:24.344497+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:24.344497+0000","last_undegraded":"2023-11-28T20:38:24.344497+0000","last_fullsized":"2023-11-28T20:38:24.344497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563464+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:23.563464+0000","last_peered":"2023-11-28T20:38:23.563464+0000","last_clean":"2023-11-28T20:38:23.563464+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:23.563464+0000","last_undegraded":"2023-11-28T20:38:23.563464+0000","last_fullsized":"2023-11-28T20:38:23.563464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563470+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:23.563470+0000","last_peered":"2023-11-28T20:38:23.563470+0000","last_clean":"2023-11-28T20:38:23.563470+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:23.563470+0000","last_undegraded":"2023-11-28T20:38:23.563470+0000","last_fullsized":"2023-11-28T20:38:23.563470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.525043+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:38:24.525043+0000","last_peered":"2023-11-28T20:38:24.525043+0000","last_clean":"2023-11-28T20:38:24.525043+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:38:24.525043+0000","last_undegraded":"2023-11-28T20:38:24.525043+0000","last_fullsized":"2023-11-28T20:38:24.525043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771026+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:23.771026+0000","last_peered":"2023-11-28T20:38:23.771026+0000","last_clean":"2023-11-28T20:38:23.771026+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:23.771026+0000","last_undegraded":"2023-11-28T20:38:23.771026+0000","last_fullsized":"2023-11-28T20:38:23.771026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559866+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:23.559866+0000","last_peered":"2023-11-28T20:38:23.559866+0000","last_clean":"2023-11-28T20:38:23.559866+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:23.559866+0000","last_undegraded":"2023-11-28T20:38:23.559866+0000","last_fullsized":"2023-11-28T20:38:23.559866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524484+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.524484+0000","last_peered":"2023-11-28T20:38:24.524484+0000","last_clean":"2023-11-28T20:38:24.524484+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:38:24.524484+0000","last_undegraded":"2023-11-28T20:38:24.524484+0000","last_fullsized":"2023-11-28T20:38:24.524484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560744+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:23.560744+0000","last_peered":"2023-11-28T20:38:23.560744+0000","last_clean":"2023-11-28T20:38:23.560744+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:23.560744+0000","last_undegraded":"2023-11-28T20:38:23.560744+0000","last_fullsized":"2023-11-28T20:38:23.560744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528309+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:24.528309+0000","last_peered":"2023-11-28T20:38:24.528309+0000","last_clean":"2023-11-28T20:38:24.528309+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:24.528309+0000","last_undegraded":"2023-11-28T20:38:24.528309+0000","last_fullsized":"2023-11-28T20:38:24.528309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350690+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:24.350690+0000","last_peered":"2023-11-28T20:38:24.350690+0000","last_clean":"2023-11-28T20:38:24.350690+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:24.350690+0000","last_undegraded":"2023-11-28T20:38:24.350690+0000","last_fullsized":"2023-11-28T20:38:24.350690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771288+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:23.771288+0000","last_peered":"2023-11-28T20:38:23.771288+0000","last_clean":"2023-11-28T20:38:23.771288+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:23.771288+0000","last_undegraded":"2023-11-28T20:38:23.771288+0000","last_fullsized":"2023-11-28T20:38:23.771288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:33.736395+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:33.736395+0000","last_peered":"2023-11-28T20:38:33.736395+0000","last_clean":"2023-11-28T20:38:33.736395+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:33.736395+0000","last_undegraded":"2023-11-28T20:38:33.736395+0000","last_fullsized":"2023-11-28T20:38:33.736395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535078+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:38:24.535078+0000","last_peered":"2023-11-28T20:38:24.535078+0000","last_clean":"2023-11-28T20:38:24.535078+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:38:24.535078+0000","last_undegraded":"2023-11-28T20:38:24.535078+0000","last_fullsized":"2023-11-28T20:38:24.535078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571791+0000","last_change":"2023-11-28T20:38:19.398113+0000","last_active":"2023-11-28T20:38:23.571791+0000","last_peered":"2023-11-28T20:38:23.571791+0000","last_clean":"2023-11-28T20:38:23.571791+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:38:23.571791+0000","last_undegraded":"2023-11-28T20:38:23.571791+0000","last_fullsized":"2023-11-28T20:38:23.571791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:08.187641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532512+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:38:24.532512+0000","last_peered":"2023-11-28T20:38:24.532512+0000","last_clean":"2023-11-28T20:38:24.532512+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:38:24.532512+0000","last_undegraded":"2023-11-28T20:38:24.532512+0000","last_fullsized":"2023-11-28T20:38:24.532512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529696+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:24.529696+0000","last_peered":"2023-11-28T20:38:24.529696+0000","last_clean":"2023-11-28T20:38:24.529696+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:24.529696+0000","last_undegraded":"2023-11-28T20:38:24.529696+0000","last_fullsized":"2023-11-28T20:38:24.529696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562967+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:23.562967+0000","last_peered":"2023-11-28T20:38:23.562967+0000","last_clean":"2023-11-28T20:38:23.562967+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:23.562967+0000","last_undegraded":"2023-11-28T20:38:23.562967+0000","last_fullsized":"2023-11-28T20:38:23.562967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559741+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:23.559741+0000","last_peered":"2023-11-28T20:38:23.559741+0000","last_clean":"2023-11-28T20:38:23.559741+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:23.559741+0000","last_undegraded":"2023-11-28T20:38:23.559741+0000","last_fullsized":"2023-11-28T20:38:23.559741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524020+0000","last_change":"2023-11-28T20:38:23.592734+0000","last_active":"2023-11-28T20:38:24.524020+0000","last_peered":"2023-11-28T20:38:24.524020+0000","last_clean":"2023-11-28T20:38:24.524020+0000","last_became_active":"2023-11-28T20:38:23.592348+0000","last_became_peered":"2023-11-28T20:38:23.592348+0000","last_unstale":"2023-11-28T20:38:24.524020+0000","last_undegraded":"2023-11-28T20:38:24.524020+0000","last_fullsized":"2023-11-28T20:38:24.524020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:11:10.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559511+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:23.559511+0000","last_peered":"2023-11-28T20:38:23.559511+0000","last_clean":"2023-11-28T20:38:23.559511+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:23.559511+0000","last_undegraded":"2023-11-28T20:38:23.559511+0000","last_fullsized":"2023-11-28T20:38:23.559511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.565387+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:23.565387+0000","last_peered":"2023-11-28T20:38:23.565387+0000","last_clean":"2023-11-28T20:38:23.565387+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:23.565387+0000","last_undegraded":"2023-11-28T20:38:23.565387+0000","last_fullsized":"2023-11-28T20:38:23.565387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523851+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:38:24.523851+0000","last_peered":"2023-11-28T20:38:24.523851+0000","last_clean":"2023-11-28T20:38:24.523851+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:38:24.523851+0000","last_undegraded":"2023-11-28T20:38:24.523851+0000","last_fullsized":"2023-11-28T20:38:24.523851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344511+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:24.344511+0000","last_peered":"2023-11-28T20:38:24.344511+0000","last_clean":"2023-11-28T20:38:24.344511+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:24.344511+0000","last_undegraded":"2023-11-28T20:38:24.344511+0000","last_fullsized":"2023-11-28T20:38:24.344511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571440+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:38:23.571440+0000","last_peered":"2023-11-28T20:38:23.571440+0000","last_clean":"2023-11-28T20:38:23.571440+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:38:23.571440+0000","last_undegraded":"2023-11-28T20:38:23.571440+0000","last_fullsized":"2023-11-28T20:38:23.571440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564701+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:23.564701+0000","last_peered":"2023-11-28T20:38:23.564701+0000","last_clean":"2023-11-28T20:38:23.564701+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:23.564701+0000","last_undegraded":"2023-11-28T20:38:23.564701+0000","last_fullsized":"2023-11-28T20:38:23.564701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351748+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:24.351748+0000","last_peered":"2023-11-28T20:38:24.351748+0000","last_clean":"2023-11-28T20:38:24.351748+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:24.351748+0000","last_undegraded":"2023-11-28T20:38:24.351748+0000","last_fullsized":"2023-11-28T20:38:24.351748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556007+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:38:23.556007+0000","last_peered":"2023-11-28T20:38:23.556007+0000","last_clean":"2023-11-28T20:38:23.556007+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:38:23.556007+0000","last_undegraded":"2023-11-28T20:38:23.556007+0000","last_fullsized":"2023-11-28T20:38:23.556007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555641+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:38:23.555641+0000","last_peered":"2023-11-28T20:38:23.555641+0000","last_clean":"2023-11-28T20:38:23.555641+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:38:23.555641+0000","last_undegraded":"2023-11-28T20:38:23.555641+0000","last_fullsized":"2023-11-28T20:38:23.555641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350688+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:24.350688+0000","last_peered":"2023-11-28T20:38:24.350688+0000","last_clean":"2023-11-28T20:38:24.350688+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:24.350688+0000","last_undegraded":"2023-11-28T20:38:24.350688+0000","last_fullsized":"2023-11-28T20:38:24.350688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561439+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:23.561439+0000","last_peered":"2023-11-28T20:38:23.561439+0000","last_clean":"2023-11-28T20:38:23.561439+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:23.561439+0000","last_undegraded":"2023-11-28T20:38:23.561439+0000","last_fullsized":"2023-11-28T20:38:23.561439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534500+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:38:24.534500+0000","last_peered":"2023-11-28T20:38:24.534500+0000","last_clean":"2023-11-28T20:38:24.534500+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:38:24.534500+0000","last_undegraded":"2023-11-28T20:38:24.534500+0000","last_fullsized":"2023-11-28T20:38:24.534500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524333+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:38:24.524333+0000","last_peered":"2023-11-28T20:38:24.524333+0000","last_clean":"2023-11-28T20:38:24.524333+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:38:24.524333+0000","last_undegraded":"2023-11-28T20:38:24.524333+0000","last_fullsized":"2023-11-28T20:38:24.524333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.588393+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:23.588393+0000","last_peered":"2023-11-28T20:38:23.588393+0000","last_clean":"2023-11-28T20:38:23.588393+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:23.588393+0000","last_undegraded":"2023-11-28T20:38:23.588393+0000","last_fullsized":"2023-11-28T20:38:23.588393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524719+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:38:24.524719+0000","last_peered":"2023-11-28T20:38:24.524719+0000","last_clean":"2023-11-28T20:38:24.524719+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:38:24.524719+0000","last_undegraded":"2023-11-28T20:38:24.524719+0000","last_fullsized":"2023-11-28T20:38:24.524719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563172+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:23.563172+0000","last_peered":"2023-11-28T20:38:23.563172+0000","last_clean":"2023-11-28T20:38:23.563172+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:23.563172+0000","last_undegraded":"2023-11-28T20:38:23.563172+0000","last_fullsized":"2023-11-28T20:38:23.563172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579796+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:38:23.579796+0000","last_peered":"2023-11-28T20:38:23.579796+0000","last_clean":"2023-11-28T20:38:23.579796+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:38:23.579796+0000","last_undegraded":"2023-11-28T20:38:23.579796+0000","last_fullsized":"2023-11-28T20:38:23.579796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559655+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:23.559655+0000","last_peered":"2023-11-28T20:38:23.559655+0000","last_clean":"2023-11-28T20:38:23.559655+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:23.559655+0000","last_undegraded":"2023-11-28T20:38:23.559655+0000","last_fullsized":"2023-11-28T20:38:23.559655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561367+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:23.561367+0000","last_peered":"2023-11-28T20:38:23.561367+0000","last_clean":"2023-11-28T20:38:23.561367+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:23.561367+0000","last_undegraded":"2023-11-28T20:38:23.561367+0000","last_fullsized":"2023-11-28T20:38:23.561367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556118+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:38:23.556118+0000","last_peered":"2023-11-28T20:38:23.556118+0000","last_clean":"2023-11-28T20:38:23.556118+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:38:23.556118+0000","last_undegraded":"2023-11-28T20:38:23.556118+0000","last_fullsized":"2023-11-28T20:38:23.556118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579390+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:38:23.579390+0000","last_peered":"2023-11-28T20:38:23.579390+0000","last_clean":"2023-11-28T20:38:23.579390+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:38:23.579390+0000","last_undegraded":"2023-11-28T20:38:23.579390+0000","last_fullsized":"2023-11-28T20:38:23.579390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.567024+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:23.567024+0000","last_peered":"2023-11-28T20:38:23.567024+0000","last_clean":"2023-11-28T20:38:23.567024+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:23.567024+0000","last_undegraded":"2023-11-28T20:38:23.567024+0000","last_fullsized":"2023-11-28T20:38:23.567024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556268+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:38:23.556268+0000","last_peered":"2023-11-28T20:38:23.556268+0000","last_clean":"2023-11-28T20:38:23.556268+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:38:23.556268+0000","last_undegraded":"2023-11-28T20:38:23.556268+0000","last_fullsized":"2023-11-28T20:38:23.556268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564684+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:23.564684+0000","last_peered":"2023-11-28T20:38:23.564684+0000","last_clean":"2023-11-28T20:38:23.564684+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:23.564684+0000","last_undegraded":"2023-11-28T20:38:23.564684+0000","last_fullsized":"2023-11-28T20:38:23.564684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555549+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:38:23.555549+0000","last_peered":"2023-11-28T20:38:23.555549+0000","last_clean":"2023-11-28T20:38:23.555549+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:38:23.555549+0000","last_undegraded":"2023-11-28T20:38:23.555549+0000","last_fullsized":"2023-11-28T20:38:23.555549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559455+0000","last_change":"2023-11-28T20:38:19.391161+0000","last_active":"2023-11-28T20:38:23.559455+0000","last_peered":"2023-11-28T20:38:23.559455+0000","last_clean":"2023-11-28T20:38:23.559455+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:38:23.559455+0000","last_undegraded":"2023-11-28T20:38:23.559455+0000","last_fullsized":"2023-11-28T20:38:23.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:29.088707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561269+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:23.561269+0000","last_peered":"2023-11-28T20:38:23.561269+0000","last_clean":"2023-11-28T20:38:23.561269+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:23.561269+0000","last_undegraded":"2023-11-28T20:38:23.561269+0000","last_fullsized":"2023-11-28T20:38:23.561269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.565066+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:23.565066+0000","last_peered":"2023-11-28T20:38:23.565066+0000","last_clean":"2023-11-28T20:38:23.565066+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:23.565066+0000","last_undegraded":"2023-11-28T20:38:23.565066+0000","last_fullsized":"2023-11-28T20:38:23.565066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.772001+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:23.772001+0000","last_peered":"2023-11-28T20:38:23.772001+0000","last_clean":"2023-11-28T20:38:23.772001+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:23.772001+0000","last_undegraded":"2023-11-28T20:38:23.772001+0000","last_fullsized":"2023-11-28T20:38:23.772001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.583087+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:38:23.583087+0000","last_peered":"2023-11-28T20:38:23.583087+0000","last_clean":"2023-11-28T20:38:23.583087+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:38:23.583087+0000","last_undegraded":"2023-11-28T20:38:23.583087+0000","last_fullsized":"2023-11-28T20:38:23.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560491+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:23.560491+0000","last_peered":"2023-11-28T20:38:23.560491+0000","last_clean":"2023-11-28T20:38:23.560491+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:23.560491+0000","last_undegraded":"2023-11-28T20:38:23.560491+0000","last_fullsized":"2023-11-28T20:38:23.560491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564469+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:23.564469+0000","last_peered":"2023-11-28T20:38:23.564469+0000","last_clean":"2023-11-28T20:38:23.564469+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:23.564469+0000","last_undegraded":"2023-11-28T20:38:23.564469+0000","last_fullsized":"2023-11-28T20:38:23.564469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571449+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:38:23.571449+0000","last_peered":"2023-11-28T20:38:23.571449+0000","last_clean":"2023-11-28T20:38:23.571449+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:38:23.571449+0000","last_undegraded":"2023-11-28T20:38:23.571449+0000","last_fullsized":"2023-11-28T20:38:23.571449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560649+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:23.560649+0000","last_peered":"2023-11-28T20:38:23.560649+0000","last_clean":"2023-11-28T20:38:23.560649+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:23.560649+0000","last_undegraded":"2023-11-28T20:38:23.560649+0000","last_fullsized":"2023-11-28T20:38:23.560649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556123+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:38:23.556123+0000","last_peered":"2023-11-28T20:38:23.556123+0000","last_clean":"2023-11-28T20:38:23.556123+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:38:23.556123+0000","last_undegraded":"2023-11-28T20:38:23.556123+0000","last_fullsized":"2023-11-28T20:38:23.556123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571565+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:23.571565+0000","last_peered":"2023-11-28T20:38:23.571565+0000","last_clean":"2023-11-28T20:38:23.571565+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:23.571565+0000","last_undegraded":"2023-11-28T20:38:23.571565+0000","last_fullsized":"2023-11-28T20:38:23.571565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563921+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:23.563921+0000","last_peered":"2023-11-28T20:38:23.563921+0000","last_clean":"2023-11-28T20:38:23.563921+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:23.563921+0000","last_undegraded":"2023-11-28T20:38:23.563921+0000","last_fullsized":"2023-11-28T20:38:23.563921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.566792+0000","last_change":"2023-11-28T20:38:19.399387+0000","last_active":"2023-11-28T20:38:23.566792+0000","last_peered":"2023-11-28T20:38:23.566792+0000","last_clean":"2023-11-28T20:38:23.566792+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:23.566792+0000","last_undegraded":"2023-11-28T20:38:23.566792+0000","last_fullsized":"2023-11-28T20:38:23.566792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:19:33.795318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771738+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:23.771738+0000","last_peered":"2023-11-28T20:38:23.771738+0000","last_clean":"2023-11-28T20:38:23.771738+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:23.771738+0000","last_undegraded":"2023-11-28T20:38:23.771738+0000","last_fullsized":"2023-11-28T20:38:23.771738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.554837+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:38:23.554837+0000","last_peered":"2023-11-28T20:38:23.554837+0000","last_clean":"2023-11-28T20:38:23.554837+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:38:23.554837+0000","last_undegraded":"2023-11-28T20:38:23.554837+0000","last_fullsized":"2023-11-28T20:38:23.554837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770651+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:23.770651+0000","last_peered":"2023-11-28T20:38:23.770651+0000","last_clean":"2023-11-28T20:38:23.770651+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:23.770651+0000","last_undegraded":"2023-11-28T20:38:23.770651+0000","last_fullsized":"2023-11-28T20:38:23.770651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559229+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:23.559229+0000","last_peered":"2023-11-28T20:38:23.559229+0000","last_clean":"2023-11-28T20:38:23.559229+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:23.559229+0000","last_undegraded":"2023-11-28T20:38:23.559229+0000","last_fullsized":"2023-11-28T20:38:23.559229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771010+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:23.771010+0000","last_peered":"2023-11-28T20:38:23.771010+0000","last_clean":"2023-11-28T20:38:23.771010+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:23.771010+0000","last_undegraded":"2023-11-28T20:38:23.771010+0000","last_fullsized":"2023-11-28T20:38:23.771010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560781+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:23.560781+0000","last_peered":"2023-11-28T20:38:23.560781+0000","last_clean":"2023-11-28T20:38:23.560781+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:23.560781+0000","last_undegraded":"2023-11-28T20:38:23.560781+0000","last_fullsized":"2023-11-28T20:38:23.560781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561319+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:23.561319+0000","last_peered":"2023-11-28T20:38:23.561319+0000","last_clean":"2023-11-28T20:38:23.561319+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:23.561319+0000","last_undegraded":"2023-11-28T20:38:23.561319+0000","last_fullsized":"2023-11-28T20:38:23.561319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.580170+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:38:23.580170+0000","last_peered":"2023-11-28T20:38:23.580170+0000","last_clean":"2023-11-28T20:38:23.580170+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:38:23.580170+0000","last_undegraded":"2023-11-28T20:38:23.580170+0000","last_fullsized":"2023-11-28T20:38:23.580170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771481+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:23.771481+0000","last_peered":"2023-11-28T20:38:23.771481+0000","last_clean":"2023-11-28T20:38:23.771481+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:23.771481+0000","last_undegraded":"2023-11-28T20:38:23.771481+0000","last_fullsized":"2023-11-28T20:38:23.771481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":102025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":102185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":856064,"data_stored":692975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":102115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":102151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:38:43.721 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:38:43.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c83103640 1 Processor -- start 2023-11-28T20:38:43.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c83103640 1 -- start start 2023-11-28T20:38:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c83103640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c7c159900 0x7f7c7c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c83103640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7c7c0c6770 0x7f7c7c0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c83103640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c06d900 con 0x7f7c7c15a1c0 2023-11-28T20:38:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c83103640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c0714b0 con 0x7f7c7c159900 2023-11-28T20:38:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c83103640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c06db50 con 0x7f7c7c0c6770 2023-11-28T20:38:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c82101640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c7c159900 0x7f7c7c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c81900640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7c7c15a1c0 0x7f7c7c06e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44578/0 (socket says 172.21.15.167:44578) 2023-11-28T20:38:43.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c81900640 1 -- 172.21.15.167:0/2718136912 learned_addr learned my addr 172.21.15.167:0/2718136912 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:43.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c82902640 1 --2- 172.21.15.167:0/2718136912 >> v2:172.21.15.178:3300/0 conn(0x7f7c7c0c6770 0x7f7c7c0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c82101640 1 -- 172.21.15.167:0/2718136912 >> v2:172.21.15.178:3300/0 conn(0x7f7c7c0c6770 msgr2=0x7f7c7c0c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:43.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c82101640 1 --2- 172.21.15.167:0/2718136912 >> v2:172.21.15.178:3300/0 conn(0x7f7c7c0c6770 0x7f7c7c0c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c82101640 1 -- 172.21.15.167:0/2718136912 >> v1:172.21.15.167:6789/0 conn(0x7f7c7c15a1c0 legacy=0x7f7c7c06e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c82101640 1 -- 172.21.15.167:0/2718136912 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c06de30 con 0x7f7c7c159900 2023-11-28T20:38:43.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.888+0000 7f7c810ff640 1 -- 172.21.15.167:0/2718136912 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198147880 0 0) 0x7f7c7c06d900 con 0x7f7c7c15a1c0 2023-11-28T20:38:43.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c82101640 1 --2- 172.21.15.167:0/2718136912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 0x7f7c7c070e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0c92a0 tx=0x7f7c7801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee56ca864ebd24fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:43.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c810ff640 1 -- 172.21.15.167:0/2718136912 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78004230 con 0x7f7c7c159900 2023-11-28T20:38:43.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c810ff640 1 -- 172.21.15.167:0/2718136912 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c780a7050 con 0x7f7c7c159900 2023-11-28T20:38:43.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c810ff640 1 -- 172.21.15.167:0/2718136912 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78003620 con 0x7f7c7c159900 2023-11-28T20:38:43.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c83103640 1 -- 172.21.15.167:0/2718136912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 msgr2=0x7f7c7c070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c83103640 1 --2- 172.21.15.167:0/2718136912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 0x7f7c7c070e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0c92a0 tx=0x7f7c7801c460 comp rx=0 tx=0).stop 2023-11-28T20:38:43.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c83103640 1 -- 172.21.15.167:0/2718136912 shutdown_connections 2023-11-28T20:38:43.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c83103640 1 --2- 172.21.15.167:0/2718136912 >> v2:172.21.15.178:3300/0 conn(0x7f7c7c0c6770 0x7f7c7c0c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c83103640 1 --2- 172.21.15.167:0/2718136912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 0x7f7c7c070e70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c83103640 1 -- 172.21.15.167:0/2718136912 >> 172.21.15.167:0/2718136912 conn(0x7f7c7c0cb3f0 msgr2=0x7f7c7c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c83103640 1 -- 172.21.15.167:0/2718136912 shutdown_connections 2023-11-28T20:38:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.892+0000 7f7c83103640 1 -- 172.21.15.167:0/2718136912 wait complete. 2023-11-28T20:38:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 Processor -- start 2023-11-28T20:38:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 -- start start 2023-11-28T20:38:43.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c7c0c6770 0x7f7c7c1f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 0x7f7c7c156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c7c15a1c0 0x7f7c7c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c157990 con 0x7f7c7c159900 2023-11-28T20:38:43.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0c19c0 con 0x7f7c7c15a1c0 2023-11-28T20:38:43.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c154150 con 0x7f7c7c0c6770 2023-11-28T20:38:43.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c81900640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 0x7f7c7c156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c81900640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 0x7f7c7c156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46598/0 (socket says 172.21.15.167:46598) 2023-11-28T20:38:43.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c81900640 1 -- 172.21.15.167:0/3655735722 learned_addr learned my addr 172.21.15.167:0/3655735722 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:43.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c82902640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c7c15a1c0 0x7f7c7c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c82101640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c7c0c6770 0x7f7c7c1f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c81900640 1 -- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c7c0c6770 msgr2=0x7f7c7c1f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c81900640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c7c0c6770 0x7f7c7c1f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c81900640 1 -- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c7c15a1c0 msgr2=0x7f7c7c1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c81900640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c7c15a1c0 0x7f7c7c1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c81900640 1 -- 172.21.15.167:0/3655735722 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78009420 con 0x7f7c7c159900 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c81900640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 0x7f7c7c156260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00c480 tx=0x7f7c6c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c72ffd640 1 -- 172.21.15.167:0/3655735722 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0074e0 con 0x7f7c7c159900 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c72ffd640 1 -- 172.21.15.167:0/3655735722 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c007660 con 0x7f7c7c159900 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c150810 con 0x7f7c7c159900 2023-11-28T20:38:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c72ffd640 1 -- 172.21.15.167:0/3655735722 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c004a30 con 0x7f7c7c159900 2023-11-28T20:38:43.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c1f6980 con 0x7f7c7c159900 2023-11-28T20:38:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.896+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c067c40 con 0x7f7c7c159900 2023-11-28T20:38:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.900+0000 7f7c72ffd640 1 -- 172.21.15.167:0/3655735722 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c6c004b90 con 0x7f7c7c159900 2023-11-28T20:38:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.900+0000 7f7c72ffd640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c60066470 0x7f7c60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.900+0000 7f7c72ffd640 1 -- 172.21.15.167:0/3655735722 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7c6c083700 con 0x7f7c7c159900 2023-11-28T20:38:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.900+0000 7f7c82101640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c60066470 0x7f7c60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.900+0000 7f7c82101640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c60066470 0x7f7c60068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c780ad000 tx=0x7f7c78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:43.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:43.904+0000 7f7c72ffd640 1 -- 172.21.15.167:0/3655735722 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c6c054280 con 0x7f7c7c159900 2023-11-28T20:38:44.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.048+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c7c150690 con 0x7f7c60066470 2023-11-28T20:38:44.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.076+0000 7f7c72ffd640 1 -- 172.21.15.167:0/3655735722 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345182 (secure 0 0 0) 0x7f7c780043f0 con 0x7f7c60066470 2023-11-28T20:38:44.084 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:44.086 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:38:44.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c60066470 msgr2=0x7f7c60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c60066470 0x7f7c60068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c780ad000 tx=0x7f7c78008040 comp rx=0 tx=0).stop 2023-11-28T20:38:44.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 msgr2=0x7f7c7c156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 0x7f7c7c156260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00c480 tx=0x7f7c6c00c940 comp rx=0 tx=0).stop 2023-11-28T20:38:44.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 shutdown_connections 2023-11-28T20:38:44.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c60066470 0x7f7c60068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c7c15a1c0 0x7f7c7c1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c159900 0x7f7c7c156260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 --2- 172.21.15.167:0/3655735722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c7c0c6770 0x7f7c7c1f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 >> 172.21.15.167:0/3655735722 conn(0x7f7c7c0cb3f0 msgr2=0x7f7c7c14f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:44.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 shutdown_connections 2023-11-28T20:38:44.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.080+0000 7f7c83103640 1 -- 172.21.15.167:0/3655735722 wait complete. 2023-11-28T20:38:44.102 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-28T20:38:43.437075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236056,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738664,"statfs":{"total":773094113280,"available":772852391936,"internally_reserved":0,"allocated":3317760,"data_stored":2006214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005302"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528906+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:24.528906+0000","last_peered":"2023-11-28T20:38:24.528906+0000","last_clean":"2023-11-28T20:38:24.528906+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:24.528906+0000","last_undegraded":"2023-11-28T20:38:24.528906+0000","last_fullsized":"2023-11-28T20:38:24.528906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555618+0000","last_change":"2023-11-28T20:38:19.384120+0000","last_active":"2023-11-28T20:38:23.555618+0000","last_peered":"2023-11-28T20:38:23.555618+0000","last_clean":"2023-11-28T20:38:23.555618+0000","last_became_active":"2023-11-28T20:38:19.383899+0000","last_became_peered":"2023-11-28T20:38:19.383899+0000","last_unstale":"2023-11-28T20:38:23.555618+0000","last_undegraded":"2023-11-28T20:38:23.555618+0000","last_fullsized":"2023-11-28T20:38:23.555618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:02:32.168294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523700+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:38:24.523700+0000","last_peered":"2023-11-28T20:38:24.523700+0000","last_clean":"2023-11-28T20:38:24.523700+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:38:24.523700+0000","last_undegraded":"2023-11-28T20:38:24.523700+0000","last_fullsized":"2023-11-28T20:38:24.523700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524795+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:38:24.524795+0000","last_peered":"2023-11-28T20:38:24.524795+0000","last_clean":"2023-11-28T20:38:24.524795+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:38:24.524795+0000","last_undegraded":"2023-11-28T20:38:24.524795+0000","last_fullsized":"2023-11-28T20:38:24.524795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562919+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:23.562919+0000","last_peered":"2023-11-28T20:38:23.562919+0000","last_clean":"2023-11-28T20:38:23.562919+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:23.562919+0000","last_undegraded":"2023-11-28T20:38:23.562919+0000","last_fullsized":"2023-11-28T20:38:23.562919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527387+0000","last_change":"2023-11-28T20:38:23.600077+0000","last_active":"2023-11-28T20:38:24.527387+0000","last_peered":"2023-11-28T20:38:24.527387+0000","last_clean":"2023-11-28T20:38:24.527387+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:24.527387+0000","last_undegraded":"2023-11-28T20:38:24.527387+0000","last_fullsized":"2023-11-28T20:38:24.527387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:39.002909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532607+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:24.532607+0000","last_peered":"2023-11-28T20:38:24.532607+0000","last_clean":"2023-11-28T20:38:24.532607+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:24.532607+0000","last_undegraded":"2023-11-28T20:38:24.532607+0000","last_fullsized":"2023-11-28T20:38:24.532607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560982+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:23.560982+0000","last_peered":"2023-11-28T20:38:23.560982+0000","last_clean":"2023-11-28T20:38:23.560982+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:23.560982+0000","last_undegraded":"2023-11-28T20:38:23.560982+0000","last_fullsized":"2023-11-28T20:38:23.560982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529343+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:24.529343+0000","last_peered":"2023-11-28T20:38:24.529343+0000","last_clean":"2023-11-28T20:38:24.529343+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:24.529343+0000","last_undegraded":"2023-11-28T20:38:24.529343+0000","last_fullsized":"2023-11-28T20:38:24.529343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532210+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532210+0000","last_peered":"2023-11-28T20:38:24.532210+0000","last_clean":"2023-11-28T20:38:24.532210+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532210+0000","last_undegraded":"2023-11-28T20:38:24.532210+0000","last_fullsized":"2023-11-28T20:38:24.532210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562448+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:23.562448+0000","last_peered":"2023-11-28T20:38:23.562448+0000","last_clean":"2023-11-28T20:38:23.562448+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:23.562448+0000","last_undegraded":"2023-11-28T20:38:23.562448+0000","last_fullsized":"2023-11-28T20:38:23.562448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528969+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:24.528969+0000","last_peered":"2023-11-28T20:38:24.528969+0000","last_clean":"2023-11-28T20:38:24.528969+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:24.528969+0000","last_undegraded":"2023-11-28T20:38:24.528969+0000","last_fullsized":"2023-11-28T20:38:24.528969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563714+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:23.563714+0000","last_peered":"2023-11-28T20:38:23.563714+0000","last_clean":"2023-11-28T20:38:23.563714+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:23.563714+0000","last_undegraded":"2023-11-28T20:38:23.563714+0000","last_fullsized":"2023-11-28T20:38:23.563714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528553+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:24.528553+0000","last_peered":"2023-11-28T20:38:24.528553+0000","last_clean":"2023-11-28T20:38:24.528553+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:24.528553+0000","last_undegraded":"2023-11-28T20:38:24.528553+0000","last_fullsized":"2023-11-28T20:38:24.528553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530149+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:24.530149+0000","last_peered":"2023-11-28T20:38:24.530149+0000","last_clean":"2023-11-28T20:38:24.530149+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:24.530149+0000","last_undegraded":"2023-11-28T20:38:24.530149+0000","last_fullsized":"2023-11-28T20:38:24.530149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556220+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:38:23.556220+0000","last_peered":"2023-11-28T20:38:23.556220+0000","last_clean":"2023-11-28T20:38:23.556220+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:38:23.556220+0000","last_undegraded":"2023-11-28T20:38:23.556220+0000","last_fullsized":"2023-11-28T20:38:23.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571843+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:38:23.571843+0000","last_peered":"2023-11-28T20:38:23.571843+0000","last_clean":"2023-11-28T20:38:23.571843+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:38:23.571843+0000","last_undegraded":"2023-11-28T20:38:23.571843+0000","last_fullsized":"2023-11-28T20:38:23.571843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529638+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:24.529638+0000","last_peered":"2023-11-28T20:38:24.529638+0000","last_clean":"2023-11-28T20:38:24.529638+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:24.529638+0000","last_undegraded":"2023-11-28T20:38:24.529638+0000","last_fullsized":"2023-11-28T20:38:24.529638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556959+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:38:23.556959+0000","last_peered":"2023-11-28T20:38:23.556959+0000","last_clean":"2023-11-28T20:38:23.556959+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:38:23.556959+0000","last_undegraded":"2023-11-28T20:38:23.556959+0000","last_fullsized":"2023-11-28T20:38:23.556959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571617+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:38:23.571617+0000","last_peered":"2023-11-28T20:38:23.571617+0000","last_clean":"2023-11-28T20:38:23.571617+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:38:23.571617+0000","last_undegraded":"2023-11-28T20:38:23.571617+0000","last_fullsized":"2023-11-28T20:38:23.571617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535771+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.535771+0000","last_peered":"2023-11-28T20:38:24.535771+0000","last_clean":"2023-11-28T20:38:24.535771+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:38:24.535771+0000","last_undegraded":"2023-11-28T20:38:24.535771+0000","last_fullsized":"2023-11-28T20:38:24.535771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.585068+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:23.585068+0000","last_peered":"2023-11-28T20:38:23.585068+0000","last_clean":"2023-11-28T20:38:23.585068+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:23.585068+0000","last_undegraded":"2023-11-28T20:38:23.585068+0000","last_fullsized":"2023-11-28T20:38:23.585068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770408+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:23.770408+0000","last_peered":"2023-11-28T20:38:23.770408+0000","last_clean":"2023-11-28T20:38:23.770408+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:23.770408+0000","last_undegraded":"2023-11-28T20:38:23.770408+0000","last_fullsized":"2023-11-28T20:38:23.770408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530157+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:24.530157+0000","last_peered":"2023-11-28T20:38:24.530157+0000","last_clean":"2023-11-28T20:38:24.530157+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:24.530157+0000","last_undegraded":"2023-11-28T20:38:24.530157+0000","last_fullsized":"2023-11-28T20:38:24.530157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561892+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:23.561892+0000","last_peered":"2023-11-28T20:38:23.561892+0000","last_clean":"2023-11-28T20:38:23.561892+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:23.561892+0000","last_undegraded":"2023-11-28T20:38:23.561892+0000","last_fullsized":"2023-11-28T20:38:23.561892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531914+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:24.531914+0000","last_peered":"2023-11-28T20:38:24.531914+0000","last_clean":"2023-11-28T20:38:24.531914+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:24.531914+0000","last_undegraded":"2023-11-28T20:38:24.531914+0000","last_fullsized":"2023-11-28T20:38:24.531914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528204+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:24.528204+0000","last_peered":"2023-11-28T20:38:24.528204+0000","last_clean":"2023-11-28T20:38:24.528204+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:24.528204+0000","last_undegraded":"2023-11-28T20:38:24.528204+0000","last_fullsized":"2023-11-28T20:38:24.528204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556394+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:38:23.556394+0000","last_peered":"2023-11-28T20:38:23.556394+0000","last_clean":"2023-11-28T20:38:23.556394+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:38:23.556394+0000","last_undegraded":"2023-11-28T20:38:23.556394+0000","last_fullsized":"2023-11-28T20:38:23.556394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535703+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:38:24.535703+0000","last_peered":"2023-11-28T20:38:24.535703+0000","last_clean":"2023-11-28T20:38:24.535703+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:38:24.535703+0000","last_undegraded":"2023-11-28T20:38:24.535703+0000","last_fullsized":"2023-11-28T20:38:24.535703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523623+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:38:24.523623+0000","last_peered":"2023-11-28T20:38:24.523623+0000","last_clean":"2023-11-28T20:38:24.523623+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:38:24.523623+0000","last_undegraded":"2023-11-28T20:38:24.523623+0000","last_fullsized":"2023-11-28T20:38:24.523623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572645+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:38:23.572645+0000","last_peered":"2023-11-28T20:38:23.572645+0000","last_clean":"2023-11-28T20:38:23.572645+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:38:23.572645+0000","last_undegraded":"2023-11-28T20:38:23.572645+0000","last_fullsized":"2023-11-28T20:38:23.572645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.772221+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:23.772221+0000","last_peered":"2023-11-28T20:38:23.772221+0000","last_clean":"2023-11-28T20:38:23.772221+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:23.772221+0000","last_undegraded":"2023-11-28T20:38:23.772221+0000","last_fullsized":"2023-11-28T20:38:23.772221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344337+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:24.344337+0000","last_peered":"2023-11-28T20:38:24.344337+0000","last_clean":"2023-11-28T20:38:24.344337+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:24.344337+0000","last_undegraded":"2023-11-28T20:38:24.344337+0000","last_fullsized":"2023-11-28T20:38:24.344337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562716+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:23.562716+0000","last_peered":"2023-11-28T20:38:23.562716+0000","last_clean":"2023-11-28T20:38:23.562716+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:23.562716+0000","last_undegraded":"2023-11-28T20:38:23.562716+0000","last_fullsized":"2023-11-28T20:38:23.562716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572746+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:38:23.572746+0000","last_peered":"2023-11-28T20:38:23.572746+0000","last_clean":"2023-11-28T20:38:23.572746+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:38:23.572746+0000","last_undegraded":"2023-11-28T20:38:23.572746+0000","last_fullsized":"2023-11-28T20:38:23.572746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535102+0000","last_change":"2023-11-28T20:38:23.594782+0000","last_active":"2023-11-28T20:38:24.535102+0000","last_peered":"2023-11-28T20:38:24.535102+0000","last_clean":"2023-11-28T20:38:24.535102+0000","last_became_active":"2023-11-28T20:38:23.594034+0000","last_became_peered":"2023-11-28T20:38:23.594034+0000","last_unstale":"2023-11-28T20:38:24.535102+0000","last_undegraded":"2023-11-28T20:38:24.535102+0000","last_fullsized":"2023-11-28T20:38:24.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:29:14.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.581982+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:23.581982+0000","last_peered":"2023-11-28T20:38:23.581982+0000","last_clean":"2023-11-28T20:38:23.581982+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:23.581982+0000","last_undegraded":"2023-11-28T20:38:23.581982+0000","last_fullsized":"2023-11-28T20:38:23.581982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560074+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:23.560074+0000","last_peered":"2023-11-28T20:38:23.560074+0000","last_clean":"2023-11-28T20:38:23.560074+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:23.560074+0000","last_undegraded":"2023-11-28T20:38:23.560074+0000","last_fullsized":"2023-11-28T20:38:23.560074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535460+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:38:24.535460+0000","last_peered":"2023-11-28T20:38:24.535460+0000","last_clean":"2023-11-28T20:38:24.535460+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:38:24.535460+0000","last_undegraded":"2023-11-28T20:38:24.535460+0000","last_fullsized":"2023-11-28T20:38:24.535460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571588+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:38:23.571588+0000","last_peered":"2023-11-28T20:38:23.571588+0000","last_clean":"2023-11-28T20:38:23.571588+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:38:23.571588+0000","last_undegraded":"2023-11-28T20:38:23.571588+0000","last_fullsized":"2023-11-28T20:38:23.571588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579909+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:38:23.579909+0000","last_peered":"2023-11-28T20:38:23.579909+0000","last_clean":"2023-11-28T20:38:23.579909+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:38:23.579909+0000","last_undegraded":"2023-11-28T20:38:23.579909+0000","last_fullsized":"2023-11-28T20:38:23.579909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535820+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:38:24.535820+0000","last_peered":"2023-11-28T20:38:24.535820+0000","last_clean":"2023-11-28T20:38:24.535820+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:38:24.535820+0000","last_undegraded":"2023-11-28T20:38:24.535820+0000","last_fullsized":"2023-11-28T20:38:24.535820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560814+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:23.560814+0000","last_peered":"2023-11-28T20:38:23.560814+0000","last_clean":"2023-11-28T20:38:23.560814+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:23.560814+0000","last_undegraded":"2023-11-28T20:38:23.560814+0000","last_fullsized":"2023-11-28T20:38:23.560814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770415+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:23.770415+0000","last_peered":"2023-11-28T20:38:23.770415+0000","last_clean":"2023-11-28T20:38:23.770415+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:23.770415+0000","last_undegraded":"2023-11-28T20:38:23.770415+0000","last_fullsized":"2023-11-28T20:38:23.770415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344627+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:24.344627+0000","last_peered":"2023-11-28T20:38:24.344627+0000","last_clean":"2023-11-28T20:38:24.344627+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:24.344627+0000","last_undegraded":"2023-11-28T20:38:24.344627+0000","last_fullsized":"2023-11-28T20:38:24.344627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555061+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:38:23.555061+0000","last_peered":"2023-11-28T20:38:23.555061+0000","last_clean":"2023-11-28T20:38:23.555061+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:38:23.555061+0000","last_undegraded":"2023-11-28T20:38:23.555061+0000","last_fullsized":"2023-11-28T20:38:23.555061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.567796+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:23.567796+0000","last_peered":"2023-11-28T20:38:23.567796+0000","last_clean":"2023-11-28T20:38:23.567796+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:23.567796+0000","last_undegraded":"2023-11-28T20:38:23.567796+0000","last_fullsized":"2023-11-28T20:38:23.567796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770661+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:23.770661+0000","last_peered":"2023-11-28T20:38:23.770661+0000","last_clean":"2023-11-28T20:38:23.770661+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:23.770661+0000","last_undegraded":"2023-11-28T20:38:23.770661+0000","last_fullsized":"2023-11-28T20:38:23.770661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351420+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:24.351420+0000","last_peered":"2023-11-28T20:38:24.351420+0000","last_clean":"2023-11-28T20:38:24.351420+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:24.351420+0000","last_undegraded":"2023-11-28T20:38:24.351420+0000","last_fullsized":"2023-11-28T20:38:24.351420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771541+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:23.771541+0000","last_peered":"2023-11-28T20:38:23.771541+0000","last_clean":"2023-11-28T20:38:23.771541+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:23.771541+0000","last_undegraded":"2023-11-28T20:38:23.771541+0000","last_fullsized":"2023-11-28T20:38:23.771541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.582714+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:38:23.582714+0000","last_peered":"2023-11-28T20:38:23.582714+0000","last_clean":"2023-11-28T20:38:23.582714+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:38:23.582714+0000","last_undegraded":"2023-11-28T20:38:23.582714+0000","last_fullsized":"2023-11-28T20:38:23.582714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350832+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:24.350832+0000","last_peered":"2023-11-28T20:38:24.350832+0000","last_clean":"2023-11-28T20:38:24.350832+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:24.350832+0000","last_undegraded":"2023-11-28T20:38:24.350832+0000","last_fullsized":"2023-11-28T20:38:24.350832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561174+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:23.561174+0000","last_peered":"2023-11-28T20:38:23.561174+0000","last_clean":"2023-11-28T20:38:23.561174+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:23.561174+0000","last_undegraded":"2023-11-28T20:38:23.561174+0000","last_fullsized":"2023-11-28T20:38:23.561174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.533486+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:38:24.533486+0000","last_peered":"2023-11-28T20:38:24.533486+0000","last_clean":"2023-11-28T20:38:24.533486+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:38:24.533486+0000","last_undegraded":"2023-11-28T20:38:24.533486+0000","last_fullsized":"2023-11-28T20:38:24.533486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344212+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:24.344212+0000","last_peered":"2023-11-28T20:38:24.344212+0000","last_clean":"2023-11-28T20:38:24.344212+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:24.344212+0000","last_undegraded":"2023-11-28T20:38:24.344212+0000","last_fullsized":"2023-11-28T20:38:24.344212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771932+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:23.771932+0000","last_peered":"2023-11-28T20:38:23.771932+0000","last_clean":"2023-11-28T20:38:23.771932+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:23.771932+0000","last_undegraded":"2023-11-28T20:38:23.771932+0000","last_fullsized":"2023-11-28T20:38:23.771932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532302+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:38:24.532302+0000","last_peered":"2023-11-28T20:38:24.532302+0000","last_clean":"2023-11-28T20:38:24.532302+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:38:24.532302+0000","last_undegraded":"2023-11-28T20:38:24.532302+0000","last_fullsized":"2023-11-28T20:38:24.532302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348053+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:24.348053+0000","last_peered":"2023-11-28T20:38:24.348053+0000","last_clean":"2023-11-28T20:38:24.348053+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:24.348053+0000","last_undegraded":"2023-11-28T20:38:24.348053+0000","last_fullsized":"2023-11-28T20:38:24.348053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771535+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:23.771535+0000","last_peered":"2023-11-28T20:38:23.771535+0000","last_clean":"2023-11-28T20:38:23.771535+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:23.771535+0000","last_undegraded":"2023-11-28T20:38:23.771535+0000","last_fullsized":"2023-11-28T20:38:23.771535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530364+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:24.530364+0000","last_peered":"2023-11-28T20:38:24.530364+0000","last_clean":"2023-11-28T20:38:24.530364+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:24.530364+0000","last_undegraded":"2023-11-28T20:38:24.530364+0000","last_fullsized":"2023-11-28T20:38:24.530364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527514+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:24.527514+0000","last_peered":"2023-11-28T20:38:24.527514+0000","last_clean":"2023-11-28T20:38:24.527514+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:24.527514+0000","last_undegraded":"2023-11-28T20:38:24.527514+0000","last_fullsized":"2023-11-28T20:38:24.527514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770655+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:23.770655+0000","last_peered":"2023-11-28T20:38:23.770655+0000","last_clean":"2023-11-28T20:38:23.770655+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:23.770655+0000","last_undegraded":"2023-11-28T20:38:23.770655+0000","last_fullsized":"2023-11-28T20:38:23.770655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534259+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:38:24.534259+0000","last_peered":"2023-11-28T20:38:24.534259+0000","last_clean":"2023-11-28T20:38:24.534259+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:38:24.534259+0000","last_undegraded":"2023-11-28T20:38:24.534259+0000","last_fullsized":"2023-11-28T20:38:24.534259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344497+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:24.344497+0000","last_peered":"2023-11-28T20:38:24.344497+0000","last_clean":"2023-11-28T20:38:24.344497+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:24.344497+0000","last_undegraded":"2023-11-28T20:38:24.344497+0000","last_fullsized":"2023-11-28T20:38:24.344497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563464+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:23.563464+0000","last_peered":"2023-11-28T20:38:23.563464+0000","last_clean":"2023-11-28T20:38:23.563464+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:23.563464+0000","last_undegraded":"2023-11-28T20:38:23.563464+0000","last_fullsized":"2023-11-28T20:38:23.563464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563470+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:23.563470+0000","last_peered":"2023-11-28T20:38:23.563470+0000","last_clean":"2023-11-28T20:38:23.563470+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:23.563470+0000","last_undegraded":"2023-11-28T20:38:23.563470+0000","last_fullsized":"2023-11-28T20:38:23.563470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.525043+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:38:24.525043+0000","last_peered":"2023-11-28T20:38:24.525043+0000","last_clean":"2023-11-28T20:38:24.525043+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:38:24.525043+0000","last_undegraded":"2023-11-28T20:38:24.525043+0000","last_fullsized":"2023-11-28T20:38:24.525043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771026+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:23.771026+0000","last_peered":"2023-11-28T20:38:23.771026+0000","last_clean":"2023-11-28T20:38:23.771026+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:23.771026+0000","last_undegraded":"2023-11-28T20:38:23.771026+0000","last_fullsized":"2023-11-28T20:38:23.771026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559866+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:23.559866+0000","last_peered":"2023-11-28T20:38:23.559866+0000","last_clean":"2023-11-28T20:38:23.559866+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:23.559866+0000","last_undegraded":"2023-11-28T20:38:23.559866+0000","last_fullsized":"2023-11-28T20:38:23.559866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524484+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.524484+0000","last_peered":"2023-11-28T20:38:24.524484+0000","last_clean":"2023-11-28T20:38:24.524484+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:38:24.524484+0000","last_undegraded":"2023-11-28T20:38:24.524484+0000","last_fullsized":"2023-11-28T20:38:24.524484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560744+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:23.560744+0000","last_peered":"2023-11-28T20:38:23.560744+0000","last_clean":"2023-11-28T20:38:23.560744+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:23.560744+0000","last_undegraded":"2023-11-28T20:38:23.560744+0000","last_fullsized":"2023-11-28T20:38:23.560744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528309+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:24.528309+0000","last_peered":"2023-11-28T20:38:24.528309+0000","last_clean":"2023-11-28T20:38:24.528309+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:24.528309+0000","last_undegraded":"2023-11-28T20:38:24.528309+0000","last_fullsized":"2023-11-28T20:38:24.528309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350690+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:24.350690+0000","last_peered":"2023-11-28T20:38:24.350690+0000","last_clean":"2023-11-28T20:38:24.350690+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:24.350690+0000","last_undegraded":"2023-11-28T20:38:24.350690+0000","last_fullsized":"2023-11-28T20:38:24.350690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771288+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:23.771288+0000","last_peered":"2023-11-28T20:38:23.771288+0000","last_clean":"2023-11-28T20:38:23.771288+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:23.771288+0000","last_undegraded":"2023-11-28T20:38:23.771288+0000","last_fullsized":"2023-11-28T20:38:23.771288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:33.736395+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:33.736395+0000","last_peered":"2023-11-28T20:38:33.736395+0000","last_clean":"2023-11-28T20:38:33.736395+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:33.736395+0000","last_undegraded":"2023-11-28T20:38:33.736395+0000","last_fullsized":"2023-11-28T20:38:33.736395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535078+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:38:24.535078+0000","last_peered":"2023-11-28T20:38:24.535078+0000","last_clean":"2023-11-28T20:38:24.535078+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:38:24.535078+0000","last_undegraded":"2023-11-28T20:38:24.535078+0000","last_fullsized":"2023-11-28T20:38:24.535078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571791+0000","last_change":"2023-11-28T20:38:19.398113+0000","last_active":"2023-11-28T20:38:23.571791+0000","last_peered":"2023-11-28T20:38:23.571791+0000","last_clean":"2023-11-28T20:38:23.571791+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:38:23.571791+0000","last_undegraded":"2023-11-28T20:38:23.571791+0000","last_fullsized":"2023-11-28T20:38:23.571791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:08.187641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532512+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:38:24.532512+0000","last_peered":"2023-11-28T20:38:24.532512+0000","last_clean":"2023-11-28T20:38:24.532512+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:38:24.532512+0000","last_undegraded":"2023-11-28T20:38:24.532512+0000","last_fullsized":"2023-11-28T20:38:24.532512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529696+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:24.529696+0000","last_peered":"2023-11-28T20:38:24.529696+0000","last_clean":"2023-11-28T20:38:24.529696+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:24.529696+0000","last_undegraded":"2023-11-28T20:38:24.529696+0000","last_fullsized":"2023-11-28T20:38:24.529696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562967+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:23.562967+0000","last_peered":"2023-11-28T20:38:23.562967+0000","last_clean":"2023-11-28T20:38:23.562967+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:23.562967+0000","last_undegraded":"2023-11-28T20:38:23.562967+0000","last_fullsized":"2023-11-28T20:38:23.562967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559741+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:23.559741+0000","last_peered":"2023-11-28T20:38:23.559741+0000","last_clean":"2023-11-28T20:38:23.559741+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:23.559741+0000","last_undegraded":"2023-11-28T20:38:23.559741+0000","last_fullsized":"2023-11-28T20:38:23.559741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524020+0000","last_change":"2023-11-28T20:38:23.592734+0000","last_active":"2023-11-28T20:38:24.524020+0000","last_peered":"2023-11-28T20:38:24.524020+0000","last_clean":"2023-11-28T20:38:24.524020+0000","last_became_active":"2023-11-28T20:38:23.592348+0000","last_became_peered":"2023-11-28T20:38:23.592348+0000","last_unstale":"2023-11-28T20:38:24.524020+0000","last_undegraded":"2023-11-28T20:38:24.524020+0000","last_fullsized":"2023-11-28T20:38:24.524020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:11:10.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559511+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:23.559511+0000","last_peered":"2023-11-28T20:38:23.559511+0000","last_clean":"2023-11-28T20:38:23.559511+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:23.559511+0000","last_undegraded":"2023-11-28T20:38:23.559511+0000","last_fullsized":"2023-11-28T20:38:23.559511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.565387+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:23.565387+0000","last_peered":"2023-11-28T20:38:23.565387+0000","last_clean":"2023-11-28T20:38:23.565387+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:23.565387+0000","last_undegraded":"2023-11-28T20:38:23.565387+0000","last_fullsized":"2023-11-28T20:38:23.565387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523851+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:38:24.523851+0000","last_peered":"2023-11-28T20:38:24.523851+0000","last_clean":"2023-11-28T20:38:24.523851+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:38:24.523851+0000","last_undegraded":"2023-11-28T20:38:24.523851+0000","last_fullsized":"2023-11-28T20:38:24.523851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344511+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:24.344511+0000","last_peered":"2023-11-28T20:38:24.344511+0000","last_clean":"2023-11-28T20:38:24.344511+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:24.344511+0000","last_undegraded":"2023-11-28T20:38:24.344511+0000","last_fullsized":"2023-11-28T20:38:24.344511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571440+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:38:23.571440+0000","last_peered":"2023-11-28T20:38:23.571440+0000","last_clean":"2023-11-28T20:38:23.571440+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:38:23.571440+0000","last_undegraded":"2023-11-28T20:38:23.571440+0000","last_fullsized":"2023-11-28T20:38:23.571440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564701+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:23.564701+0000","last_peered":"2023-11-28T20:38:23.564701+0000","last_clean":"2023-11-28T20:38:23.564701+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:23.564701+0000","last_undegraded":"2023-11-28T20:38:23.564701+0000","last_fullsized":"2023-11-28T20:38:23.564701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351748+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:24.351748+0000","last_peered":"2023-11-28T20:38:24.351748+0000","last_clean":"2023-11-28T20:38:24.351748+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:24.351748+0000","last_undegraded":"2023-11-28T20:38:24.351748+0000","last_fullsized":"2023-11-28T20:38:24.351748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556007+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:38:23.556007+0000","last_peered":"2023-11-28T20:38:23.556007+0000","last_clean":"2023-11-28T20:38:23.556007+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:38:23.556007+0000","last_undegraded":"2023-11-28T20:38:23.556007+0000","last_fullsized":"2023-11-28T20:38:23.556007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555641+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:38:23.555641+0000","last_peered":"2023-11-28T20:38:23.555641+0000","last_clean":"2023-11-28T20:38:23.555641+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:38:23.555641+0000","last_undegraded":"2023-11-28T20:38:23.555641+0000","last_fullsized":"2023-11-28T20:38:23.555641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350688+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:24.350688+0000","last_peered":"2023-11-28T20:38:24.350688+0000","last_clean":"2023-11-28T20:38:24.350688+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:24.350688+0000","last_undegraded":"2023-11-28T20:38:24.350688+0000","last_fullsized":"2023-11-28T20:38:24.350688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561439+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:23.561439+0000","last_peered":"2023-11-28T20:38:23.561439+0000","last_clean":"2023-11-28T20:38:23.561439+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:23.561439+0000","last_undegraded":"2023-11-28T20:38:23.561439+0000","last_fullsized":"2023-11-28T20:38:23.561439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534500+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:38:24.534500+0000","last_peered":"2023-11-28T20:38:24.534500+0000","last_clean":"2023-11-28T20:38:24.534500+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:38:24.534500+0000","last_undegraded":"2023-11-28T20:38:24.534500+0000","last_fullsized":"2023-11-28T20:38:24.534500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524333+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:38:24.524333+0000","last_peered":"2023-11-28T20:38:24.524333+0000","last_clean":"2023-11-28T20:38:24.524333+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:38:24.524333+0000","last_undegraded":"2023-11-28T20:38:24.524333+0000","last_fullsized":"2023-11-28T20:38:24.524333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.588393+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:23.588393+0000","last_peered":"2023-11-28T20:38:23.588393+0000","last_clean":"2023-11-28T20:38:23.588393+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:23.588393+0000","last_undegraded":"2023-11-28T20:38:23.588393+0000","last_fullsized":"2023-11-28T20:38:23.588393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524719+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:38:24.524719+0000","last_peered":"2023-11-28T20:38:24.524719+0000","last_clean":"2023-11-28T20:38:24.524719+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:38:24.524719+0000","last_undegraded":"2023-11-28T20:38:24.524719+0000","last_fullsized":"2023-11-28T20:38:24.524719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563172+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:23.563172+0000","last_peered":"2023-11-28T20:38:23.563172+0000","last_clean":"2023-11-28T20:38:23.563172+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:23.563172+0000","last_undegraded":"2023-11-28T20:38:23.563172+0000","last_fullsized":"2023-11-28T20:38:23.563172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579796+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:38:23.579796+0000","last_peered":"2023-11-28T20:38:23.579796+0000","last_clean":"2023-11-28T20:38:23.579796+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:38:23.579796+0000","last_undegraded":"2023-11-28T20:38:23.579796+0000","last_fullsized":"2023-11-28T20:38:23.579796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559655+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:23.559655+0000","last_peered":"2023-11-28T20:38:23.559655+0000","last_clean":"2023-11-28T20:38:23.559655+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:23.559655+0000","last_undegraded":"2023-11-28T20:38:23.559655+0000","last_fullsized":"2023-11-28T20:38:23.559655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561367+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:23.561367+0000","last_peered":"2023-11-28T20:38:23.561367+0000","last_clean":"2023-11-28T20:38:23.561367+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:23.561367+0000","last_undegraded":"2023-11-28T20:38:23.561367+0000","last_fullsized":"2023-11-28T20:38:23.561367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556118+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:38:23.556118+0000","last_peered":"2023-11-28T20:38:23.556118+0000","last_clean":"2023-11-28T20:38:23.556118+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:38:23.556118+0000","last_undegraded":"2023-11-28T20:38:23.556118+0000","last_fullsized":"2023-11-28T20:38:23.556118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579390+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:38:23.579390+0000","last_peered":"2023-11-28T20:38:23.579390+0000","last_clean":"2023-11-28T20:38:23.579390+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:38:23.579390+0000","last_undegraded":"2023-11-28T20:38:23.579390+0000","last_fullsized":"2023-11-28T20:38:23.579390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.567024+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:23.567024+0000","last_peered":"2023-11-28T20:38:23.567024+0000","last_clean":"2023-11-28T20:38:23.567024+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:23.567024+0000","last_undegraded":"2023-11-28T20:38:23.567024+0000","last_fullsized":"2023-11-28T20:38:23.567024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556268+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:38:23.556268+0000","last_peered":"2023-11-28T20:38:23.556268+0000","last_clean":"2023-11-28T20:38:23.556268+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:38:23.556268+0000","last_undegraded":"2023-11-28T20:38:23.556268+0000","last_fullsized":"2023-11-28T20:38:23.556268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564684+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:23.564684+0000","last_peered":"2023-11-28T20:38:23.564684+0000","last_clean":"2023-11-28T20:38:23.564684+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:23.564684+0000","last_undegraded":"2023-11-28T20:38:23.564684+0000","last_fullsized":"2023-11-28T20:38:23.564684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555549+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:38:23.555549+0000","last_peered":"2023-11-28T20:38:23.555549+0000","last_clean":"2023-11-28T20:38:23.555549+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:38:23.555549+0000","last_undegraded":"2023-11-28T20:38:23.555549+0000","last_fullsized":"2023-11-28T20:38:23.555549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559455+0000","last_change":"2023-11-28T20:38:19.391161+0000","last_active":"2023-11-28T20:38:23.559455+0000","last_peered":"2023-11-28T20:38:23.559455+0000","last_clean":"2023-11-28T20:38:23.559455+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:38:23.559455+0000","last_undegraded":"2023-11-28T20:38:23.559455+0000","last_fullsized":"2023-11-28T20:38:23.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:29.088707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561269+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:23.561269+0000","last_peered":"2023-11-28T20:38:23.561269+0000","last_clean":"2023-11-28T20:38:23.561269+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:23.561269+0000","last_undegraded":"2023-11-28T20:38:23.561269+0000","last_fullsized":"2023-11-28T20:38:23.561269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.565066+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:23.565066+0000","last_peered":"2023-11-28T20:38:23.565066+0000","last_clean":"2023-11-28T20:38:23.565066+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:23.565066+0000","last_undegraded":"2023-11-28T20:38:23.565066+0000","last_fullsized":"2023-11-28T20:38:23.565066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.772001+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:23.772001+0000","last_peered":"2023-11-28T20:38:23.772001+0000","last_clean":"2023-11-28T20:38:23.772001+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:23.772001+0000","last_undegraded":"2023-11-28T20:38:23.772001+0000","last_fullsized":"2023-11-28T20:38:23.772001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.583087+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:38:23.583087+0000","last_peered":"2023-11-28T20:38:23.583087+0000","last_clean":"2023-11-28T20:38:23.583087+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:38:23.583087+0000","last_undegraded":"2023-11-28T20:38:23.583087+0000","last_fullsized":"2023-11-28T20:38:23.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560491+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:23.560491+0000","last_peered":"2023-11-28T20:38:23.560491+0000","last_clean":"2023-11-28T20:38:23.560491+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:23.560491+0000","last_undegraded":"2023-11-28T20:38:23.560491+0000","last_fullsized":"2023-11-28T20:38:23.560491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564469+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:23.564469+0000","last_peered":"2023-11-28T20:38:23.564469+0000","last_clean":"2023-11-28T20:38:23.564469+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:23.564469+0000","last_undegraded":"2023-11-28T20:38:23.564469+0000","last_fullsized":"2023-11-28T20:38:23.564469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571449+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:38:23.571449+0000","last_peered":"2023-11-28T20:38:23.571449+0000","last_clean":"2023-11-28T20:38:23.571449+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:38:23.571449+0000","last_undegraded":"2023-11-28T20:38:23.571449+0000","last_fullsized":"2023-11-28T20:38:23.571449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560649+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:23.560649+0000","last_peered":"2023-11-28T20:38:23.560649+0000","last_clean":"2023-11-28T20:38:23.560649+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:23.560649+0000","last_undegraded":"2023-11-28T20:38:23.560649+0000","last_fullsized":"2023-11-28T20:38:23.560649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556123+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:38:23.556123+0000","last_peered":"2023-11-28T20:38:23.556123+0000","last_clean":"2023-11-28T20:38:23.556123+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:38:23.556123+0000","last_undegraded":"2023-11-28T20:38:23.556123+0000","last_fullsized":"2023-11-28T20:38:23.556123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571565+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:23.571565+0000","last_peered":"2023-11-28T20:38:23.571565+0000","last_clean":"2023-11-28T20:38:23.571565+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:23.571565+0000","last_undegraded":"2023-11-28T20:38:23.571565+0000","last_fullsized":"2023-11-28T20:38:23.571565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563921+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:23.563921+0000","last_peered":"2023-11-28T20:38:23.563921+0000","last_clean":"2023-11-28T20:38:23.563921+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:23.563921+0000","last_undegraded":"2023-11-28T20:38:23.563921+0000","last_fullsized":"2023-11-28T20:38:23.563921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.566792+0000","last_change":"2023-11-28T20:38:19.399387+0000","last_active":"2023-11-28T20:38:23.566792+0000","last_peered":"2023-11-28T20:38:23.566792+0000","last_clean":"2023-11-28T20:38:23.566792+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:23.566792+0000","last_undegraded":"2023-11-28T20:38:23.566792+0000","last_fullsized":"2023-11-28T20:38:23.566792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:19:33.795318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771738+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:23.771738+0000","last_peered":"2023-11-28T20:38:23.771738+0000","last_clean":"2023-11-28T20:38:23.771738+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:23.771738+0000","last_undegraded":"2023-11-28T20:38:23.771738+0000","last_fullsized":"2023-11-28T20:38:23.771738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.554837+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:38:23.554837+0000","last_peered":"2023-11-28T20:38:23.554837+0000","last_clean":"2023-11-28T20:38:23.554837+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:38:23.554837+0000","last_undegraded":"2023-11-28T20:38:23.554837+0000","last_fullsized":"2023-11-28T20:38:23.554837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770651+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:23.770651+0000","last_peered":"2023-11-28T20:38:23.770651+0000","last_clean":"2023-11-28T20:38:23.770651+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:23.770651+0000","last_undegraded":"2023-11-28T20:38:23.770651+0000","last_fullsized":"2023-11-28T20:38:23.770651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559229+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:23.559229+0000","last_peered":"2023-11-28T20:38:23.559229+0000","last_clean":"2023-11-28T20:38:23.559229+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:23.559229+0000","last_undegraded":"2023-11-28T20:38:23.559229+0000","last_fullsized":"2023-11-28T20:38:23.559229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771010+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:23.771010+0000","last_peered":"2023-11-28T20:38:23.771010+0000","last_clean":"2023-11-28T20:38:23.771010+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:23.771010+0000","last_undegraded":"2023-11-28T20:38:23.771010+0000","last_fullsized":"2023-11-28T20:38:23.771010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560781+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:23.560781+0000","last_peered":"2023-11-28T20:38:23.560781+0000","last_clean":"2023-11-28T20:38:23.560781+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:23.560781+0000","last_undegraded":"2023-11-28T20:38:23.560781+0000","last_fullsized":"2023-11-28T20:38:23.560781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561319+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:23.561319+0000","last_peered":"2023-11-28T20:38:23.561319+0000","last_clean":"2023-11-28T20:38:23.561319+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:23.561319+0000","last_undegraded":"2023-11-28T20:38:23.561319+0000","last_fullsized":"2023-11-28T20:38:23.561319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.580170+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:38:23.580170+0000","last_peered":"2023-11-28T20:38:23.580170+0000","last_clean":"2023-11-28T20:38:23.580170+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:38:23.580170+0000","last_undegraded":"2023-11-28T20:38:23.580170+0000","last_fullsized":"2023-11-28T20:38:23.580170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771481+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:23.771481+0000","last_peered":"2023-11-28T20:38:23.771481+0000","last_clean":"2023-11-28T20:38:23.771481+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:23.771481+0000","last_undegraded":"2023-11-28T20:38:23.771481+0000","last_fullsized":"2023-11-28T20:38:23.771481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":105866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":102025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":102185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":856064,"data_stored":692975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":102115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":102151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:38:44.108 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T20:38:44.108 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T20:38:44.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T20:38:44.108 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T20:38:44.109 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T20:38:44.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f8672691640 1 Processor -- start 2023-11-28T20:38:44.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f8672691640 1 -- start start 2023-11-28T20:38:44.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f8672691640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cfc40 0x7f866c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f8672691640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c15ac00 con 0x7f866c0cf860 2023-11-28T20:38:44.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f8672691640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c0cbd60 con 0x7f866c153ae0 2023-11-28T20:38:44.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f8672691640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c159ff0 con 0x7f866c0cfc40 2023-11-28T20:38:44.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f866bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f866c0cf860 0x7f866c0ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44590/0 (socket says 172.21.15.167:44590) 2023-11-28T20:38:44.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f866bfff640 1 -- 172.21.15.167:0/458566597 learned_addr learned my addr 172.21.15.167:0/458566597 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:44.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f866b7fe640 1 --2- 172.21.15.167:0/458566597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cfc40 0x7f866c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f866affd640 1 -- 172.21.15.167:0/458566597 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791331462 0 0) 0x7f866c15ac00 con 0x7f866c0cf860 2023-11-28T20:38:44.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f866affd640 1 -- 172.21.15.167:0/458566597 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8654003530 con 0x7f866c0cf860 2023-11-28T20:38:44.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f866affd640 1 -- 172.21.15.167:0/458566597 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678962812 0 0) 0x7f8654003530 con 0x7f866c0cf860 2023-11-28T20:38:44.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f866b7fe640 1 -- 172.21.15.167:0/458566597 >> v1:172.21.15.178:6789/0 conn(0x7f866c153ae0 legacy=0x7f866c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f866b7fe640 1 -- 172.21.15.167:0/458566597 >> v1:172.21.15.167:6789/0 conn(0x7f866c0cf860 legacy=0x7f866c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.280+0000 7f866b7fe640 1 -- 172.21.15.167:0/458566597 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c15a2d0 con 0x7f866c0cfc40 2023-11-28T20:38:44.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f866b7fe640 1 --2- 172.21.15.167:0/458566597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cfc40 0x7f866c0cb770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86600097f0 tx=0x7f866001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d860544a56fdeb79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:44.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f866affd640 1 -- 172.21.15.167:0/458566597 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c001680 con 0x7f866c0cfc40 2023-11-28T20:38:44.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f866affd640 1 -- 172.21.15.167:0/458566597 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600a7050 con 0x7f866c0cfc40 2023-11-28T20:38:44.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f866affd640 1 -- 172.21.15.167:0/458566597 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600ab600 con 0x7f866c0cfc40 2023-11-28T20:38:44.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f8672691640 1 -- 172.21.15.167:0/458566597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cfc40 msgr2=0x7f866c0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f8672691640 1 --2- 172.21.15.167:0/458566597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cfc40 0x7f866c0cb770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86600097f0 tx=0x7f866001c3b0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f8672691640 1 -- 172.21.15.167:0/458566597 shutdown_connections 2023-11-28T20:38:44.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f8672691640 1 --2- 172.21.15.167:0/458566597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cfc40 0x7f866c0cb770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f8672691640 1 -- 172.21.15.167:0/458566597 >> 172.21.15.167:0/458566597 conn(0x7f866c06c1f0 msgr2=0x7f866c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:44.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f8672691640 1 -- 172.21.15.167:0/458566597 shutdown_connections 2023-11-28T20:38:44.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.284+0000 7f8672691640 1 -- 172.21.15.167:0/458566597 wait complete. 2023-11-28T20:38:44.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 Processor -- start 2023-11-28T20:38:44.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 -- start start 2023-11-28T20:38:44.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cf860 0x7f866c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c0cfc40 0x7f866c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f866c153ae0 0x7f866c0c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0c9140 con 0x7f866c153ae0 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1f6cf0 con 0x7f866c0cfc40 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0b55a0 con 0x7f866c0cf860 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8670c2e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f866c153ae0 0x7f866c0c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8670c2e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f866c153ae0 0x7f866c0c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46614/0 (socket says 172.21.15.167:46614) 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8670c2e640 1 -- 172.21.15.167:0/1590067826 learned_addr learned my addr 172.21.15.167:0/1590067826 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f866bfff640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cf860 0x7f866c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f866b7fe640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c0cfc40 0x7f866c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8670c2e640 1 -- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cf860 msgr2=0x7f866c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8670c2e640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cf860 0x7f866c158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8670c2e640 1 -- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c0cfc40 msgr2=0x7f866c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8670c2e640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c0cfc40 0x7f866c0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8670c2e640 1 -- 172.21.15.167:0/1590067826 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660009420 con 0x7f866c153ae0 2023-11-28T20:38:44.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8670c2e640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f866c153ae0 0x7f866c0c84c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f866400c770 tx=0x7f866400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:44.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8668ff9640 1 -- 172.21.15.167:0/1590067826 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664003b80 con 0x7f866c153ae0 2023-11-28T20:38:44.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8668ff9640 1 -- 172.21.15.167:0/1590067826 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8664003ce0 con 0x7f866c153ae0 2023-11-28T20:38:44.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8668ff9640 1 -- 172.21.15.167:0/1590067826 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866400aa30 con 0x7f866c153ae0 2023-11-28T20:38:44.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c1f6f20 con 0x7f866c153ae0 2023-11-28T20:38:44.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.288+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c0c6ef0 con 0x7f866c153ae0 2023-11-28T20:38:44.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.292+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c067c40 con 0x7f866c153ae0 2023-11-28T20:38:44.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.292+0000 7f8668ff9640 1 -- 172.21.15.167:0/1590067826 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f866400ab90 con 0x7f866c153ae0 2023-11-28T20:38:44.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.292+0000 7f8668ff9640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8658066470 0x7f8658068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.292+0000 7f8668ff9640 1 -- 172.21.15.167:0/1590067826 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8664083ea0 con 0x7f866c153ae0 2023-11-28T20:38:44.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.292+0000 7f866bfff640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8658066470 0x7f8658068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.292+0000 7f866bfff640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8658066470 0x7f8658068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f865c005890 tx=0x7f865c001d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:44.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.296+0000 7f8668ff9640 1 -- 172.21.15.167:0/1590067826 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8664051040 con 0x7f866c153ae0 2023-11-28T20:38:44.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.484+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f866c075c90 con 0x7f866c153ae0 2023-11-28T20:38:44.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.484+0000 7f8668ff9640 1 -- 172.21.15.167:0/1590067826 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164434 (secure 0 0 0) 0x7f8664054660 con 0x7f866c153ae0 2023-11-28T20:38:44.492 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:44.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8658066470 msgr2=0x7f8658068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8658066470 0x7f8658068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f865c005890 tx=0x7f865c001d10 comp rx=0 tx=0).stop 2023-11-28T20:38:44.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f866c153ae0 msgr2=0x7f866c0c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f866c153ae0 0x7f866c0c84c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f866400c770 tx=0x7f866400cc30 comp rx=0 tx=0).stop 2023-11-28T20:38:44.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 shutdown_connections 2023-11-28T20:38:44.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8658066470 0x7f8658068930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f866c153ae0 0x7f866c0c84c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c0cfc40 0x7f866c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 --2- 172.21.15.167:0/1590067826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c0cf860 0x7f866c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 >> 172.21.15.167:0/1590067826 conn(0x7f866c06c1f0 msgr2=0x7f866c0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:44.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 shutdown_connections 2023-11-28T20:38:44.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.488+0000 7f8672691640 1 -- 172.21.15.167:0/1590067826 wait complete. 2023-11-28T20:38:44.513 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":824645964},{"type":"v1","addr":"172.21.15.178:6833","nonce":824645964}]},"active_addr":"172.21.15.178:6833/824645964","active_change":"2023-11-28T20:37:59.413537+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":3255861879}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":1821635898}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":739354521}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":559905646}]}]} 2023-11-28T20:38:44.517 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T20:38:44.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T20:38:44.517 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:44.607 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:38:44.611 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:38:44.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.652+0000 7fcc19fe6640 1 Processor -- start 2023-11-28T20:38:44.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.652+0000 7fcc19fe6640 1 -- start start 2023-11-28T20:38:44.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc19fe6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc1415dcb0 0x7fcc141570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc19fe6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc14070cc0 0x7fcc14157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc19fe6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc140c9de0 con 0x7fcc140708e0 2023-11-28T20:38:44.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc19fe6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc140c8850 con 0x7fcc14070cc0 2023-11-28T20:38:44.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc19fe6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc140c2a50 con 0x7fcc1415dcb0 2023-11-28T20:38:44.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc13fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc14070cc0 0x7fcc14157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc13fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc14070cc0 0x7fcc14157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46622/0 (socket says 172.21.15.167:46622) 2023-11-28T20:38:44.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc13fff640 1 -- 172.21.15.167:0/4160427037 learned_addr learned my addr 172.21.15.167:0/4160427037 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:44.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc12ffd640 1 --2- 172.21.15.167:0/4160427037 >> v2:172.21.15.178:3300/0 conn(0x7fcc1415dcb0 0x7fcc141570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc13fff640 1 -- 172.21.15.167:0/4160427037 >> v2:172.21.15.178:3300/0 conn(0x7fcc1415dcb0 msgr2=0x7fcc141570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:44.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc13fff640 1 --2- 172.21.15.167:0/4160427037 >> v2:172.21.15.178:3300/0 conn(0x7fcc1415dcb0 0x7fcc141570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc13fff640 1 -- 172.21.15.167:0/4160427037 >> v1:172.21.15.178:6789/0 conn(0x7fcc140708e0 legacy=0x7fcc1415d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.656+0000 7fcc13fff640 1 -- 172.21.15.167:0/4160427037 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140c85b0 con 0x7fcc14070cc0 2023-11-28T20:38:44.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc13fff640 1 --2- 172.21.15.167:0/4160427037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 0x7fcc14157630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc140b3ae0 tx=0x7fcc0c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f263fb06ba5eefcb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:44.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc127fc640 1 -- 172.21.15.167:0/4160427037 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0a5710 con 0x7fcc14070cc0 2023-11-28T20:38:44.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc127fc640 1 -- 172.21.15.167:0/4160427037 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c0a5870 con 0x7fcc14070cc0 2023-11-28T20:38:44.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc127fc640 1 -- 172.21.15.167:0/4160427037 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0a5c00 con 0x7fcc14070cc0 2023-11-28T20:38:44.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 -- 172.21.15.167:0/4160427037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 msgr2=0x7fcc14157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 --2- 172.21.15.167:0/4160427037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 0x7fcc14157630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcc140b3ae0 tx=0x7fcc0c01c940 comp rx=0 tx=0).stop 2023-11-28T20:38:44.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 -- 172.21.15.167:0/4160427037 shutdown_connections 2023-11-28T20:38:44.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 --2- 172.21.15.167:0/4160427037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 0x7fcc14157630 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 --2- 172.21.15.167:0/4160427037 >> v2:172.21.15.178:3300/0 conn(0x7fcc1415dcb0 0x7fcc141570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 -- 172.21.15.167:0/4160427037 >> 172.21.15.167:0/4160427037 conn(0x7fcc1406a580 msgr2=0x7fcc1406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:44.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 -- 172.21.15.167:0/4160427037 shutdown_connections 2023-11-28T20:38:44.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 -- 172.21.15.167:0/4160427037 wait complete. 2023-11-28T20:38:44.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 Processor -- start 2023-11-28T20:38:44.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.660+0000 7fcc19fe6640 1 -- start start 2023-11-28T20:38:44.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc19fe6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc140708e0 0x7fcc141456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc19fe6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 0x7fcc140ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc19fe6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc1415dcb0 0x7fcc140c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc19fe6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14145c30 con 0x7fcc14070cc0 2023-11-28T20:38:44.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc19fe6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140af940 con 0x7fcc1415dcb0 2023-11-28T20:38:44.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc19fe6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140cb630 con 0x7fcc140708e0 2023-11-28T20:38:44.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc12ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 0x7fcc140ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc12ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 0x7fcc140ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46632/0 (socket says 172.21.15.167:46632) 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc12ffd640 1 -- 172.21.15.167:0/2355676031 learned_addr learned my addr 172.21.15.167:0/2355676031 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc13fff640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc1415dcb0 0x7fcc140c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc137fe640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc140708e0 0x7fcc141456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc12ffd640 1 -- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc140708e0 msgr2=0x7fcc141456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc12ffd640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc140708e0 0x7fcc141456f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc12ffd640 1 -- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc1415dcb0 msgr2=0x7fcc140c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc12ffd640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc1415dcb0 0x7fcc140c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc12ffd640 1 -- 172.21.15.167:0/2355676031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c009b30 con 0x7fcc14070cc0 2023-11-28T20:38:44.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc12ffd640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 0x7fcc140ccb50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800e870 tx=0x7fcc0800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:44.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcbfbfff640 1 -- 172.21.15.167:0/2355676031 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08009510 con 0x7fcc14070cc0 2023-11-28T20:38:44.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcbfbfff640 1 -- 172.21.15.167:0/2355676031 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0800eec0 con 0x7fcc14070cc0 2023-11-28T20:38:44.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc140cb8f0 con 0x7fcc14070cc0 2023-11-28T20:38:44.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcbfbfff640 1 -- 172.21.15.167:0/2355676031 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0800cb40 con 0x7fcc14070cc0 2023-11-28T20:38:44.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc140cbeb0 con 0x7fcc14070cc0 2023-11-28T20:38:44.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc14075c90 con 0x7fcc14070cc0 2023-11-28T20:38:44.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.664+0000 7fcbfbfff640 1 -- 172.21.15.167:0/2355676031 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc0800cca0 con 0x7fcc14070cc0 2023-11-28T20:38:44.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.668+0000 7fcbfbfff640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc00066470 0x7fcc00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:44.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.668+0000 7fcbfbfff640 1 -- 172.21.15.167:0/2355676031 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc080841f0 con 0x7fcc14070cc0 2023-11-28T20:38:44.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.668+0000 7fcc137fe640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc00066470 0x7fcc00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:44.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.668+0000 7fcc137fe640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc00066470 0x7fcc00068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcc04007fd0 tx=0x7fcc04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:44.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.672+0000 7fcbfbfff640 1 -- 172.21.15.167:0/2355676031 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc08051430 con 0x7fcc14070cc0 2023-11-28T20:38:44.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc140ada30 con 0x7fcc14070cc0 2023-11-28T20:38:44.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcbfbfff640 1 -- 172.21.15.167:0/2355676031 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7fcc08054a50 con 0x7fcc14070cc0 2023-11-28T20:38:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:44.828 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:44.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc00066470 msgr2=0x7fcc00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc00066470 0x7fcc00068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcc04007fd0 tx=0x7fcc04009040 comp rx=0 tx=0).stop 2023-11-28T20:38:44.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 msgr2=0x7fcc140ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:44.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 0x7fcc140ccb50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800e870 tx=0x7fcc0800ec70 comp rx=0 tx=0).stop 2023-11-28T20:38:44.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 shutdown_connections 2023-11-28T20:38:44.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc00066470 0x7fcc00068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc1415dcb0 0x7fcc140c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc14070cc0 0x7fcc140ccb50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 --2- 172.21.15.167:0/2355676031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc140708e0 0x7fcc141456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:44.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 >> 172.21.15.167:0/2355676031 conn(0x7fcc1406a580 msgr2=0x7fcc1406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:44.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 shutdown_connections 2023-11-28T20:38:44.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:44.824+0000 7fcc19fe6640 1 -- 172.21.15.167:0/2355676031 wait complete. 2023-11-28T20:38:44.849 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T20:38:44.849 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:45.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.020+0000 7fde571f8640 1 Processor -- start 2023-11-28T20:38:45.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.020+0000 7fde571f8640 1 -- start start 2023-11-28T20:38:45.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde571f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fde50150b40 0x7fde50157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde571f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500c48f0 con 0x7fde500c6ff0 2023-11-28T20:38:45.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde571f8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500c6ac0 con 0x7fde500c4510 2023-11-28T20:38:45.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde571f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde500c62f0 con 0x7fde50150b40 2023-11-28T20:38:45.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde47fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fde500c6ff0 0x7fde500c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44596/0 (socket says 172.21.15.167:44596) 2023-11-28T20:38:45.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde47fff640 1 -- 172.21.15.167:0/1666228124 learned_addr learned my addr 172.21.15.167:0/1666228124 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:45.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde54f94640 1 --2- 172.21.15.167:0/1666228124 >> v2:172.21.15.178:3300/0 conn(0x7fde50150b40 0x7fde50157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193497040 0 0) 0x7fde500c48f0 con 0x7fde500c6ff0 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde38003530 con 0x7fde500c6ff0 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2715501946 0 0) 0x7fde38003530 con 0x7fde500c6ff0 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 >> v2:172.21.15.178:3300/0 conn(0x7fde50150b40 msgr2=0x7fde50157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 --2- 172.21.15.167:0/1666228124 >> v2:172.21.15.178:3300/0 conn(0x7fde50150b40 0x7fde50157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 >> v1:172.21.15.178:6789/0 conn(0x7fde500c4510 legacy=0x7fde5006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500c6500 con 0x7fde500c6ff0 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fde400016a0 con 0x7fde500c6ff0 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 >> v1:172.21.15.167:6789/0 conn(0x7fde500c6ff0 legacy=0x7fde500c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde38003980 0x7fde38003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde380042a0 0x7fde380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde38004f10 0x7fde3800ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500c62f0 con 0x7fde380042a0 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde380104e0 con 0x7fde38003980 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde38010620 con 0x7fde38004f10 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde47fff640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde380042a0 0x7fde380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde54f94640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde38003980 0x7fde38003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde55795640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde38004f10 0x7fde3800ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde47fff640 1 -- 172.21.15.167:0/1666228124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde38004f10 msgr2=0x7fde3800ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde47fff640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde38004f10 0x7fde3800ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde47fff640 1 -- 172.21.15.167:0/1666228124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde38003980 msgr2=0x7fde38003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde47fff640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde38003980 0x7fde38003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde47fff640 1 -- 172.21.15.167:0/1666228124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde38003530 con 0x7fde380042a0 2023-11-28T20:38:45.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.024+0000 7fde55795640 1 -- 172.21.15.167:0/1666228124 reap_dead start 2023-11-28T20:38:45.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde47fff640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde380042a0 0x7fde380047d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fde500c25b0 tx=0x7fde4001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8a879ccd73edb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40005ae0 con 0x7fde380042a0 2023-11-28T20:38:45.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40005c60 con 0x7fde380042a0 2023-11-28T20:38:45.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde477fe640 1 -- 172.21.15.167:0/1666228124 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400a5780 con 0x7fde380042a0 2023-11-28T20:38:45.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde571f8640 1 -- 172.21.15.167:0/1666228124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde380042a0 msgr2=0x7fde380047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde571f8640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde380042a0 0x7fde380047d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fde500c25b0 tx=0x7fde4001cb90 comp rx=0 tx=0).stop 2023-11-28T20:38:45.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde571f8640 1 -- 172.21.15.167:0/1666228124 shutdown_connections 2023-11-28T20:38:45.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde571f8640 1 --2- 172.21.15.167:0/1666228124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde380042a0 0x7fde380047d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde571f8640 1 -- 172.21.15.167:0/1666228124 >> 172.21.15.167:0/1666228124 conn(0x7fde500cb1e0 msgr2=0x7fde500cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde571f8640 1 -- 172.21.15.167:0/1666228124 shutdown_connections 2023-11-28T20:38:45.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.028+0000 7fde571f8640 1 -- 172.21.15.167:0/1666228124 wait complete. 2023-11-28T20:38:45.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 Processor -- start 2023-11-28T20:38:45.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 -- start start 2023-11-28T20:38:45.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde380042a0 0x7fde5014b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde501eeca0 0x7fde50149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde50158270 0x7fde50149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde501ee810 con 0x7fde501eeca0 2023-11-28T20:38:45.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde501edf00 con 0x7fde380042a0 2023-11-28T20:38:45.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5014b770 con 0x7fde50158270 2023-11-28T20:38:45.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde47fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde501eeca0 0x7fde50149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde54f94640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde380042a0 0x7fde5014b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde47fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde501eeca0 0x7fde50149100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46652/0 (socket says 172.21.15.167:46652) 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde47fff640 1 -- 172.21.15.167:0/4130984649 learned_addr learned my addr 172.21.15.167:0/4130984649 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde54f94640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde380042a0 0x7fde5014b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55104/0 (socket says 172.21.15.167:55104) 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde55795640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde50158270 0x7fde50149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde47fff640 1 -- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde50158270 msgr2=0x7fde50149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde47fff640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde50158270 0x7fde50149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde47fff640 1 -- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde380042a0 msgr2=0x7fde5014b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde47fff640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde380042a0 0x7fde5014b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde47fff640 1 -- 172.21.15.167:0/4130984649 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5014ba50 con 0x7fde501eeca0 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde47fff640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde501eeca0 0x7fde50149100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde4001c9c0 tx=0x7fde38005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde457fa640 1 -- 172.21.15.167:0/4130984649 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400b4070 con 0x7fde501eeca0 2023-11-28T20:38:45.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde457fa640 1 -- 172.21.15.167:0/4130984649 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40001520 con 0x7fde501eeca0 2023-11-28T20:38:45.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde501ee1c0 con 0x7fde501eeca0 2023-11-28T20:38:45.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde457fa640 1 -- 172.21.15.167:0/4130984649 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400a59e0 con 0x7fde501eeca0 2023-11-28T20:38:45.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.032+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5014a0d0 con 0x7fde501eeca0 2023-11-28T20:38:45.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.036+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde500682c0 con 0x7fde501eeca0 2023-11-28T20:38:45.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.036+0000 7fde457fa640 1 -- 172.21.15.167:0/4130984649 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fde400a5b40 con 0x7fde501eeca0 2023-11-28T20:38:45.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.036+0000 7fde457fa640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde3c0664a0 0x7fde3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.036+0000 7fde457fa640 1 -- 172.21.15.167:0/4130984649 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde4011dcb0 con 0x7fde501eeca0 2023-11-28T20:38:45.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.036+0000 7fde54f94640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde3c0664a0 0x7fde3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.036+0000 7fde54f94640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde3c0664a0 0x7fde3c068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009be0 tx=0x7fde4c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.040+0000 7fde457fa640 1 -- 172.21.15.167:0/4130984649 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fde400eaf00 con 0x7fde501eeca0 2023-11-28T20:38:45.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde50075c90 con 0x7fde501eeca0 2023-11-28T20:38:45.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde457fa640 1 -- 172.21.15.167:0/4130984649 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7fde400ee520 con 0x7fde501eeca0 2023-11-28T20:38:45.196 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:45.196 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:45.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde3c0664a0 msgr2=0x7fde3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde3c0664a0 0x7fde3c068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009be0 tx=0x7fde4c009190 comp rx=0 tx=0).stop 2023-11-28T20:38:45.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde501eeca0 msgr2=0x7fde50149100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde501eeca0 0x7fde50149100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde4001c9c0 tx=0x7fde38005800 comp rx=0 tx=0).stop 2023-11-28T20:38:45.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 shutdown_connections 2023-11-28T20:38:45.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde3c0664a0 0x7fde3c068960 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde50158270 0x7fde50149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde501eeca0 0x7fde50149100 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 --2- 172.21.15.167:0/4130984649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde380042a0 0x7fde5014b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 >> 172.21.15.167:0/4130984649 conn(0x7fde500cb1e0 msgr2=0x7fde501550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 shutdown_connections 2023-11-28T20:38:45.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.192+0000 7fde571f8640 1 -- 172.21.15.167:0/4130984649 wait complete. 2023-11-28T20:38:45.217 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T20:38:45.218 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T20:38:45.218 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T20:38:45.221 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T20:38:45.222 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T20:38:45.222 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T20:38:45.222 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T20:38:45.223 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T20:38:45.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.464+0000 7fab7e417640 1 Processor -- start 2023-11-28T20:38:45.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7f4b7933e640 1 Processor -- start 2023-11-28T20:38:45.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.464+0000 7fab7e417640 1 -- start start 2023-11-28T20:38:45.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7e417640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d20 0x7fab78159b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7e417640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab780cf440 0x7fab780cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7e417640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7815a1b0 con 0x7fab780ca3c0 2023-11-28T20:38:45.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7e417640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7815a450 con 0x7fab780cf440 2023-11-28T20:38:45.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7e417640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7815a710 con 0x7fab78153d20 2023-11-28T20:38:45.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7f4b7933e640 1 -- start start 2023-11-28T20:38:45.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7dc16640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab780cf440 0x7fab780cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7f4168ebb640 1 Processor -- start 2023-11-28T20:38:45.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4168ebb640 1 -- start start 2023-11-28T20:38:45.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7f4b7933e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4b74153f40 0x7f4b74159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7f4b7933e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740cb5c0 con 0x7f4b740caa90 2023-11-28T20:38:45.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7f4b7933e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740c4f00 con 0x7f4b740ca660 2023-11-28T20:38:45.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7f4b7933e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b740b2c60 con 0x7f4b74153f40 2023-11-28T20:38:45.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7f4b72ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4b74153f40 0x7f4b74159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b727fc640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4b740ca660 0x7f4b740cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46792/0 (socket says 172.21.15.167:46792) 2023-11-28T20:38:45.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b727fc640 1 -- 172.21.15.167:0/439051990 learned_addr learned my addr 172.21.15.167:0/439051990 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:45.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b72ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4b74153f40 0x7f4b74159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46662/0 (socket says 172.21.15.167:46662) 2023-11-28T20:38:45.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913480052 0 0) 0x7f4b740c4f00 con 0x7f4b740ca660 2023-11-28T20:38:45.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b5c003530 con 0x7f4b740ca660 2023-11-28T20:38:45.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7dc16640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab780cf440 0x7fab780cf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55118/0 (socket says 172.21.15.167:55118) 2023-11-28T20:38:45.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7dc16640 1 -- 172.21.15.167:0/4043057280 learned_addr learned my addr 172.21.15.167:0/4043057280 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7d415640 1 --2- 172.21.15.167:0/4043057280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d20 0x7fab78159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7dc16640 1 -- 172.21.15.167:0/4043057280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d20 msgr2=0x7fab78159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7dc16640 1 --2- 172.21.15.167:0/4043057280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d20 0x7fab78159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7dc16640 1 -- 172.21.15.167:0/4043057280 >> v1:172.21.15.178:6789/0 conn(0x7fab780ca3c0 legacy=0x7fab780c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.468+0000 7fab7dc16640 1 -- 172.21.15.167:0/4043057280 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7815a9f0 con 0x7fab780cf440 2023-11-28T20:38:45.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4276600408 0 0) 0x7f4b5c003530 con 0x7f4b740ca660 2023-11-28T20:38:45.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 >> v2:172.21.15.167:3300/0 conn(0x7f4b74153f40 msgr2=0x7f4b74159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 --2- 172.21.15.167:0/439051990 >> v2:172.21.15.167:3300/0 conn(0x7f4b74153f40 0x7f4b74159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 >> v1:172.21.15.167:6789/0 conn(0x7f4b740caa90 legacy=0x7f4b740c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740c54c0 con 0x7f4b740ca660 2023-11-28T20:38:45.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f4b68001680 con 0x7f4b740ca660 2023-11-28T20:38:45.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 >> v1:172.21.15.178:6789/0 conn(0x7f4b740ca660 legacy=0x7f4b740cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b5c003980 0x7f4b5c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0047d0 0x7f4b5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b5c005190 0x7f4b5c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740b2c60 con 0x7f4b5c0047d0 2023-11-28T20:38:45.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c00c0c0 con 0x7f4b5c003980 2023-11-28T20:38:45.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4168ebb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f41640c6330 0x7f4164156730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4168ebb640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f416406a940 0x7f416406ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4168ebb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4164150480 con 0x7f41640cbd00 2023-11-28T20:38:45.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4168ebb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416406b290 con 0x7f41640c6330 2023-11-28T20:38:45.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4168ebb640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416415a010 con 0x7f416406a940 2023-11-28T20:38:45.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c00c280 con 0x7f4b5c005190 2023-11-28T20:38:45.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f492e157640 1 Processor -- start 2023-11-28T20:38:45.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4161d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f41640c6330 0x7f4164156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f416259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f41640cbd00 0x7f416414fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44614/0 (socket says 172.21.15.167:44614) 2023-11-28T20:38:45.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f416259c640 1 -- 172.21.15.167:0/1446440769 learned_addr learned my addr 172.21.15.167:0/1446440769 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:45.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4161d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f41640c6330 0x7f4164156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46676/0 (socket says 172.21.15.167:46676) 2023-11-28T20:38:45.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b72ffd640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b5c003980 0x7f4b5c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b727fc640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0047d0 0x7f4b5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4b737fe640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b5c005190 0x7f4b5c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f4162d9d640 1 --2- 172.21.15.167:0/1446440769 >> v2:172.21.15.178:3300/0 conn(0x7f416406a940 0x7f416406ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4b72ffd640 1 -- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b5c005190 msgr2=0x7f4b5c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4b72ffd640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b5c005190 0x7f4b5c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4b72ffd640 1 -- 172.21.15.167:0/439051990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0047d0 msgr2=0x7f4b5c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4b72ffd640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0047d0 0x7f4b5c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4b72ffd640 1 -- 172.21.15.167:0/439051990 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740c54c0 con 0x7f4b5c003980 2023-11-28T20:38:45.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4b727fc640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c0047d0 0x7f4b5c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:45.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4b737fe640 1 -- 172.21.15.167:0/439051990 reap_dead start 2023-11-28T20:38:45.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7fab7dc16640 1 --2- 172.21.15.167:0/4043057280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab780cf440 0x7fab780cf890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab70009e50 tx=0x7fab7001f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5481ec54e97f2cda server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.472+0000 7f492e157640 1 -- start start 2023-11-28T20:38:45.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129287942 0 0) 0x7f4158001120 con 0x7f41640cbd00 2023-11-28T20:38:45.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f414c003530 con 0x7f41640cbd00 2023-11-28T20:38:45.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3334329460 0 0) 0x7f414c003530 con 0x7f41640cbd00 2023-11-28T20:38:45.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 >> v2:172.21.15.178:3300/0 conn(0x7f416406a940 msgr2=0x7f416406ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 --2- 172.21.15.167:0/1446440769 >> v2:172.21.15.178:3300/0 conn(0x7f416406a940 0x7f416406ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 >> v2:172.21.15.167:3300/0 conn(0x7f41640c6330 msgr2=0x7f4164156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 --2- 172.21.15.167:0/1446440769 >> v2:172.21.15.167:3300/0 conn(0x7f41640c6330 0x7f4164156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41641596e0 con 0x7f41640cbd00 2023-11-28T20:38:45.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f4158001810 con 0x7f41640cbd00 2023-11-28T20:38:45.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 >> v1:172.21.15.167:6789/0 conn(0x7f41640cbd00 legacy=0x7f416414fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f414c003980 0x7f414c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f414c0047d0 0x7f414c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f414c005190 0x7f414c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416406b290 con 0x7f414c0047d0 2023-11-28T20:38:45.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416415a010 con 0x7f414c005190 2023-11-28T20:38:45.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c00bf00 con 0x7f414c003980 2023-11-28T20:38:45.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f492e157640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49280b5100 0x7f49280c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f492e157640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f492815eaf0 0x7f4928157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f492e157640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49280cff30 con 0x7f49280b54e0 2023-11-28T20:38:45.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f492e157640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49280c4b60 con 0x7f492815eaf0 2023-11-28T20:38:45.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f492e157640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49280cf690 con 0x7f49280b5100 2023-11-28T20:38:45.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4cae3f8640 1 Processor -- start 2023-11-28T20:38:45.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4927fff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f492815eaf0 0x7f4928157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4927fff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f492815eaf0 0x7f4928157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55144/0 (socket says 172.21.15.167:55144) 2023-11-28T20:38:45.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4927fff640 1 -- 172.21.15.167:0/1672501876 learned_addr learned my addr 172.21.15.167:0/1672501876 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4cae3f8640 1 -- start start 2023-11-28T20:38:45.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7fab6ffff640 1 -- 172.21.15.167:0/4043057280 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700af400 con 0x7fab780cf440 2023-11-28T20:38:45.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f49277fe640 1 --2- 172.21.15.167:0/1672501876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49280b5100 0x7f49280c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416259c640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f414c003980 0x7f414c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4162d9d640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f414c005190 0x7f414c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4927fff640 1 -- 172.21.15.167:0/1672501876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49280b5100 msgr2=0x7f49280c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4927fff640 1 --2- 172.21.15.167:0/1672501876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49280b5100 0x7f49280c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7fab6ffff640 1 -- 172.21.15.167:0/4043057280 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab700ab050 con 0x7fab780cf440 2023-11-28T20:38:45.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7fab6ffff640 1 -- 172.21.15.167:0/4043057280 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700af780 con 0x7fab780cf440 2023-11-28T20:38:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4161d9b640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f414c0047d0 0x7f414c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4927fff640 1 -- 172.21.15.167:0/1672501876 >> v1:172.21.15.167:6789/0 conn(0x7f49280b54e0 legacy=0x7f49280c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4927fff640 1 -- 172.21.15.167:0/1672501876 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49280cf970 con 0x7f492815eaf0 2023-11-28T20:38:45.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416259c640 1 -- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f414c005190 msgr2=0x7f414c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416259c640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f414c005190 0x7f414c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416259c640 1 -- 172.21.15.167:0/1446440769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f414c0047d0 msgr2=0x7f414c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416259c640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f414c0047d0 0x7f414c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f416259c640 1 -- 172.21.15.167:0/1446440769 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41641596e0 con 0x7f414c003980 2023-11-28T20:38:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7fab7e417640 1 -- 172.21.15.167:0/4043057280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab780cf440 msgr2=0x7fab780cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7fab7e417640 1 --2- 172.21.15.167:0/4043057280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab780cf440 0x7fab780cf890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fab70009e50 tx=0x7fab7001f1e0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fab7e417640 1 -- 172.21.15.167:0/4043057280 shutdown_connections 2023-11-28T20:38:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fab7e417640 1 --2- 172.21.15.167:0/4043057280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab780cf440 0x7fab780cf890 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fab7e417640 1 --2- 172.21.15.167:0/4043057280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d20 0x7fab78159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fab7e417640 1 -- 172.21.15.167:0/4043057280 >> 172.21.15.167:0/4043057280 conn(0x7fab7806b800 msgr2=0x7fab7806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4cae3f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ca81585d0 0x7f4ca80c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4cae3f8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4ca815e130 0x7f4ca8161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4ca7fff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ca81585d0 0x7f4ca80c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4ca7fff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ca81585d0 0x7f4ca80c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55162/0 (socket says 172.21.15.167:55162) 2023-11-28T20:38:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4ca7fff640 1 -- 172.21.15.167:0/3642482773 learned_addr learned my addr 172.21.15.167:0/3642482773 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3642482773 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca815e5e0 con 0x7f4ca80c7720 2023-11-28T20:38:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3642482773 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca815f160 con 0x7f4ca815e130 2023-11-28T20:38:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3642482773 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca815e8c0 con 0x7f4ca81585d0 2023-11-28T20:38:45.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4ca7fff640 1 -- 172.21.15.167:0/3642482773 >> v2:172.21.15.167:3300/0 conn(0x7f4ca815e130 msgr2=0x7f4ca8161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4ca7fff640 1 --2- 172.21.15.167:0/3642482773 >> v2:172.21.15.167:3300/0 conn(0x7f4ca815e130 0x7f4ca8161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4ca7fff640 1 -- 172.21.15.167:0/3642482773 >> v1:172.21.15.178:6789/0 conn(0x7f4ca80c7720 legacy=0x7f4ca806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4ca7fff640 1 -- 172.21.15.167:0/3642482773 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca815eba0 con 0x7f4ca81585d0 2023-11-28T20:38:45.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7f4162d9d640 1 -- 172.21.15.167:0/1446440769 reap_dead start 2023-11-28T20:38:45.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.476+0000 7fda304e3640 1 Processor -- start 2023-11-28T20:38:45.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fab7e417640 1 -- 172.21.15.167:0/4043057280 shutdown_connections 2023-11-28T20:38:45.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fab7e417640 1 -- 172.21.15.167:0/4043057280 wait complete. 2023-11-28T20:38:45.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4b72ffd640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b5c003980 0x7f4b5c003d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400ba00 tx=0x7f4b6401c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f74105e3bed32faa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda304e3640 1 -- start start 2023-11-28T20:38:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640ad410 con 0x7f4b5c003980 2023-11-28T20:38:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda304e3640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fda2815e130 0x7fda28161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda304e3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda280c7720 0x7fda28162320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda304e3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2815e5e0 con 0x7fda281585d0 2023-11-28T20:38:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda304e3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2815f160 con 0x7fda280c7720 2023-11-28T20:38:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda304e3640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2815e8c0 con 0x7fda2815e130 2023-11-28T20:38:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b640a7030 con 0x7f4b5c003980 2023-11-28T20:38:45.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda2e27f640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fda281585d0 0x7fda280c5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44638/0 (socket says 172.21.15.167:44638) 2023-11-28T20:38:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda2ea80640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda280c7720 0x7fda28162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda2e27f640 1 -- 172.21.15.167:0/1713393159 learned_addr learned my addr 172.21.15.167:0/1713393159 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda2da7e640 1 --2- 172.21.15.167:0/1713393159 >> v2:172.21.15.178:3300/0 conn(0x7fda2815e130 0x7fda28161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda2ea80640 1 -- 172.21.15.167:0/1713393159 >> v2:172.21.15.178:3300/0 conn(0x7fda2815e130 msgr2=0x7fda28161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda2ea80640 1 --2- 172.21.15.167:0/1713393159 >> v2:172.21.15.178:3300/0 conn(0x7fda2815e130 0x7fda28161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda2ea80640 1 -- 172.21.15.167:0/1713393159 >> v1:172.21.15.167:6789/0 conn(0x7fda281585d0 legacy=0x7fda280c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda2ea80640 1 -- 172.21.15.167:0/1713393159 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2815eba0 con 0x7fda280c7720 2023-11-28T20:38:45.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f416259c640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f414c003980 0x7f414c003da0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f415800c260 tx=0x7f415801cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2839519ef593269 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4b71ffb640 1 -- 172.21.15.167:0/439051990 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640ad7b0 con 0x7f4b5c003980 2023-11-28T20:38:45.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4b7933e640 1 -- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b5c003980 msgr2=0x7f4b5c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7f4b7933e640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b5c003980 0x7f4b5c003d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400ba00 tx=0x7f4b6401c620 comp rx=0 tx=0).stop 2023-11-28T20:38:45.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.480+0000 7fda2da7e640 1 --2- 172.21.15.167:0/1713393159 >> v2:172.21.15.178:3300/0 conn(0x7fda2815e130 0x7fda28161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:45.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7e417640 1 Processor -- start 2023-11-28T20:38:45.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580058e0 con 0x7f414c003980 2023-11-28T20:38:45.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4158005a40 con 0x7f414c003980 2023-11-28T20:38:45.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f416159a640 1 -- 172.21.15.167:0/1446440769 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4158005e10 con 0x7f414c003980 2023-11-28T20:38:45.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4b7933e640 1 -- 172.21.15.167:0/439051990 shutdown_connections 2023-11-28T20:38:45.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4b7933e640 1 --2- 172.21.15.167:0/439051990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b5c003980 0x7f4b5c003d80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4927fff640 1 --2- 172.21.15.167:0/1672501876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f492815eaf0 0x7f4928157f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f491c009870 tx=0x7f491c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6846147400f21b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4b7933e640 1 -- 172.21.15.167:0/439051990 >> 172.21.15.167:0/439051990 conn(0x7f4b7406b800 msgr2=0x7f4b7406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f0448cbb640 1 Processor -- start 2023-11-28T20:38:45.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f0448cbb640 1 -- start start 2023-11-28T20:38:45.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7e417640 1 -- start start 2023-11-28T20:38:45.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f49267fc640 1 -- 172.21.15.167:0/1672501876 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0ab620 con 0x7f492815eaf0 2023-11-28T20:38:45.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f49267fc640 1 -- 172.21.15.167:0/1672501876 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c0ab780 con 0x7f492815eaf0 2023-11-28T20:38:45.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f49267fc640 1 -- 172.21.15.167:0/1672501876 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0abb10 con 0x7f492815eaf0 2023-11-28T20:38:45.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4b7933e640 1 -- 172.21.15.167:0/439051990 shutdown_connections 2023-11-28T20:38:45.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4b7933e640 1 -- 172.21.15.167:0/439051990 wait complete. 2023-11-28T20:38:45.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4168ebb640 1 -- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f414c003980 msgr2=0x7f414c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4168ebb640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f414c003980 0x7f414c003da0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f415800c260 tx=0x7f415801cbe0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7e417640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab780ca3c0 0x7fab7814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7e417640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780cf440 0x7fab781ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7e417640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab78153d20 0x7fab7815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7e417640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab782006f0 con 0x7fab78153d20 2023-11-28T20:38:45.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7e417640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7814b620 con 0x7fab780ca3c0 2023-11-28T20:38:45.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7e417640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab780c9680 con 0x7fab780cf440 2023-11-28T20:38:45.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f492e157640 1 -- 172.21.15.167:0/1672501876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f492815eaf0 msgr2=0x7f4928157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f492e157640 1 --2- 172.21.15.167:0/1672501876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f492815eaf0 0x7f4928157f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f491c009870 tx=0x7f491c01c510 comp rx=0 tx=0).stop 2023-11-28T20:38:45.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f492e157640 1 -- 172.21.15.167:0/1672501876 shutdown_connections 2023-11-28T20:38:45.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f492e157640 1 --2- 172.21.15.167:0/1672501876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f492815eaf0 0x7f4928157f90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f492e157640 1 --2- 172.21.15.167:0/1672501876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49280b5100 0x7f49280c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f492e157640 1 -- 172.21.15.167:0/1672501876 >> 172.21.15.167:0/1672501876 conn(0x7f49280662a0 msgr2=0x7f49280666b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4168ebb640 1 -- 172.21.15.167:0/1446440769 shutdown_connections 2023-11-28T20:38:45.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4168ebb640 1 --2- 172.21.15.167:0/1446440769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f414c003980 0x7f414c003da0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4168ebb640 1 -- 172.21.15.167:0/1446440769 >> 172.21.15.167:0/1446440769 conn(0x7f41640cb1e0 msgr2=0x7f41640cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f0448cbb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04440cf860 0x7f04440cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f0448cbb640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f04440cfc40 0x7f04440ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f0448cbb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0444153ae0 0x7f0444153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f0448cbb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0444154470 con 0x7f0444153ae0 2023-11-28T20:38:45.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f0448cbb640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044415ac00 con 0x7f04440cfc40 2023-11-28T20:38:45.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f0448cbb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04440cbd60 con 0x7f04440cf860 2023-11-28T20:38:45.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7cc14640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780cf440 0x7fab781ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7cc14640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780cf440 0x7fab781ff9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33554/0 (socket says 172.21.15.167:33554) 2023-11-28T20:38:45.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7cc14640 1 -- 172.21.15.167:0/1422776833 learned_addr learned my addr 172.21.15.167:0/1422776833 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7d415640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab780ca3c0 0x7fab7814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f0442d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0444153ae0 0x7f0444153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4168ebb640 1 -- 172.21.15.167:0/1446440769 shutdown_connections 2023-11-28T20:38:45.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7dc16640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab78153d20 0x7fab7815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f044259c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04440cf860 0x7f04440cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f044259c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04440cf860 0x7f04440cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33562/0 (socket says 172.21.15.167:33562) 2023-11-28T20:38:45.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f044259c640 1 -- 172.21.15.167:0/3897762338 learned_addr learned my addr 172.21.15.167:0/3897762338 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7cc14640 1 -- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab780ca3c0 msgr2=0x7fab7814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7cc14640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab780ca3c0 0x7fab7814bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7cc14640 1 -- 172.21.15.167:0/1422776833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab78153d20 msgr2=0x7fab7815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7cc14640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab78153d20 0x7fab7815cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7fab7cc14640 1 -- 172.21.15.167:0/1422776833 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70009b30 con 0x7fab780cf440 2023-11-28T20:38:45.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.484+0000 7f4168ebb640 1 -- 172.21.15.167:0/1446440769 wait complete. 2023-11-28T20:38:45.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f0441d9b640 1 --2- 172.21.15.167:0/3897762338 >> v2:172.21.15.178:3300/0 conn(0x7f04440cfc40 0x7f04440ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f492e157640 1 -- 172.21.15.167:0/1672501876 shutdown_connections 2023-11-28T20:38:45.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fda2ea80640 1 --2- 172.21.15.167:0/1713393159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda280c7720 0x7fda28162320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fda2806eea0 tx=0x7fda2001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e3759878f0d5f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f044259c640 1 -- 172.21.15.167:0/3897762338 >> v2:172.21.15.178:3300/0 conn(0x7f04440cfc40 msgr2=0x7f04440ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f044259c640 1 --2- 172.21.15.167:0/3897762338 >> v2:172.21.15.178:3300/0 conn(0x7f04440cfc40 0x7f04440ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f044259c640 1 -- 172.21.15.167:0/3897762338 >> v2:172.21.15.167:3300/0 conn(0x7f0444153ae0 msgr2=0x7f0444153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f044259c640 1 --2- 172.21.15.167:0/3897762338 >> v2:172.21.15.167:3300/0 conn(0x7f0444153ae0 0x7f0444153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f044259c640 1 -- 172.21.15.167:0/3897762338 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444159ff0 con 0x7f04440cf860 2023-11-28T20:38:45.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b7933e640 1 Processor -- start 2023-11-28T20:38:45.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4ca7fff640 1 --2- 172.21.15.167:0/3642482773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ca81585d0 0x7f4ca80c5e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80c5e20 tx=0x7f4c9c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efdf985c419d286d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fab7cc14640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780cf440 0x7fab781ff9b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c490 tx=0x7fab68001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b7933e640 1 -- start start 2023-11-28T20:38:45.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fda2d27d640 1 -- 172.21.15.167:0/1713393159 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda200a59a0 con 0x7fda280c7720 2023-11-28T20:38:45.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fda2d27d640 1 -- 172.21.15.167:0/1713393159 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda200a5b00 con 0x7fda280c7720 2023-11-28T20:38:45.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fda2d27d640 1 -- 172.21.15.167:0/1713393159 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda200a59a0 con 0x7fda280c7720 2023-11-28T20:38:45.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4ca6ffd640 1 -- 172.21.15.167:0/3642482773 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c0ac640 con 0x7f4ca81585d0 2023-11-28T20:38:45.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fab6dffb640 1 -- 172.21.15.167:0/1422776833 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68003600 con 0x7fab780cf440 2023-11-28T20:38:45.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4ca6ffd640 1 -- 172.21.15.167:0/3642482773 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c0ac7a0 con 0x7f4ca81585d0 2023-11-28T20:38:45.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fab6dffb640 1 -- 172.21.15.167:0/1422776833 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab68003780 con 0x7fab780cf440 2023-11-28T20:38:45.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fab6dffb640 1 -- 172.21.15.167:0/1422776833 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68003b70 con 0x7fab780cf440 2023-11-28T20:38:45.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4ca6ffd640 1 -- 172.21.15.167:0/3642482773 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c0ac640 con 0x7f4ca81585d0 2023-11-28T20:38:45.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4168ebb640 1 Processor -- start 2023-11-28T20:38:45.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b7933e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c003980 0x7f4b74153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b7933e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b740cd820 0x7f4b74158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b7933e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74143630 0x7f4b740cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b7933e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74152c10 con 0x7f4b5c003980 2023-11-28T20:38:45.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b7933e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74151a20 con 0x7f4b74143630 2023-11-28T20:38:45.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b7933e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74141560 con 0x7f4b740cd820 2023-11-28T20:38:45.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fab7e417640 1 -- 172.21.15.167:0/1422776833 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab78200410 con 0x7fab780cf440 2023-11-28T20:38:45.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b737fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74143630 0x7f4b740cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b737fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74143630 0x7f4b740cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55202/0 (socket says 172.21.15.167:55202) 2023-11-28T20:38:45.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b737fe640 1 -- 172.21.15.167:0/3979523128 learned_addr learned my addr 172.21.15.167:0/3979523128 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fab7e417640 1 -- 172.21.15.167:0/1422776833 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab780c93a0 con 0x7fab780cf440 2023-11-28T20:38:45.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f492e157640 1 -- 172.21.15.167:0/1672501876 wait complete. 2023-11-28T20:38:45.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f492e157640 1 Processor -- start 2023-11-28T20:38:45.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3642482773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ca81585d0 msgr2=0x7f4ca80c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4cae3f8640 1 --2- 172.21.15.167:0/3642482773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ca81585d0 0x7f4ca80c5e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80c5e20 tx=0x7f4c9c01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f1a56b65640 1 Processor -- start 2023-11-28T20:38:45.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4168ebb640 1 -- start start 2023-11-28T20:38:45.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fda304e3640 1 -- 172.21.15.167:0/1713393159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda280c7720 msgr2=0x7fda28162320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7fda304e3640 1 --2- 172.21.15.167:0/1713393159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda280c7720 0x7fda28162320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fda2806eea0 tx=0x7fda2001c8e0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3642482773 shutdown_connections 2023-11-28T20:38:45.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4b737fe640 1 -- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b740cd820 msgr2=0x7f4b74158ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T20:38:45.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b737fe640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b740cd820 0x7f4b74158ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.488+0000 7f4cae3f8640 1 --2- 172.21.15.167:0/3642482773 >> v2:172.21.15.167:3300/0 conn(0x7f4ca815e130 0x7f4ca8161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4cae3f8640 1 --2- 172.21.15.167:0/3642482773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ca81585d0 0x7f4ca80c5e90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b737fe640 1 -- 172.21.15.167:0/3979523128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c003980 msgr2=0x7f4b74153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3642482773 >> 172.21.15.167:0/3642482773 conn(0x7f4ca80cb1e0 msgr2=0x7f4ca80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b737fe640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b5c003980 0x7f4b74153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b737fe640 1 -- 172.21.15.167:0/3979523128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b741eebc0 con 0x7f4b74143630 2023-11-28T20:38:45.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7fda304e3640 1 -- 172.21.15.167:0/1713393159 shutdown_connections 2023-11-28T20:38:45.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7fda304e3640 1 --2- 172.21.15.167:0/1713393159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda280c7720 0x7fda28162320 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7fda304e3640 1 --2- 172.21.15.167:0/1713393159 >> v2:172.21.15.178:3300/0 conn(0x7fda2815e130 0x7fda28161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7fda304e3640 1 -- 172.21.15.167:0/1713393159 >> 172.21.15.167:0/1713393159 conn(0x7fda280cb1e0 msgr2=0x7fda280cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7fab7e417640 1 -- 172.21.15.167:0/1422776833 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab780ca1e0 con 0x7fab780cf440 2023-11-28T20:38:45.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3642482773 shutdown_connections 2023-11-28T20:38:45.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4168ebb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f414c003980 0x7f41641587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4168ebb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4164158cf0 0x7f41640c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4168ebb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4164132000 0x7f4164149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f1a56b65640 1 -- start start 2023-11-28T20:38:45.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3642482773 wait complete. 2023-11-28T20:38:45.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4168ebb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4164134740 con 0x7f414c003980 2023-11-28T20:38:45.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4168ebb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41641558f0 con 0x7f4164132000 2023-11-28T20:38:45.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4168ebb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4164137890 con 0x7f4164158cf0 2023-11-28T20:38:45.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7fda304e3640 1 -- 172.21.15.167:0/1713393159 shutdown_connections 2023-11-28T20:38:45.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f044259c640 1 --2- 172.21.15.167:0/3897762338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04440cf860 0x7f04440cb770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04440cd1c0 tx=0x7f043401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4df39e2d325e1690 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f492e157640 1 -- start start 2023-11-28T20:38:45.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b737fe640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74143630 0x7f4b740cdf60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c007fd0 tx=0x7f4b6c00fc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4162d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4164132000 0x7f4164149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4162d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4164132000 0x7f4164149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55218/0 (socket says 172.21.15.167:55218) 2023-11-28T20:38:45.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4162d9d640 1 -- 172.21.15.167:0/1589617672 learned_addr learned my addr 172.21.15.167:0/1589617672 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4161d9b640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4164158cf0 0x7f41640c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f416259c640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f414c003980 0x7f41641587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7fda304e3640 1 -- 172.21.15.167:0/1713393159 wait complete. 2023-11-28T20:38:45.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f044159a640 1 -- 172.21.15.167:0/3897762338 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340aa5f0 con 0x7f04440cf860 2023-11-28T20:38:45.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f044159a640 1 -- 172.21.15.167:0/3897762338 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04340aa750 con 0x7f04440cf860 2023-11-28T20:38:45.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f044159a640 1 -- 172.21.15.167:0/3897762338 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340aaae0 con 0x7f04440cf860 2023-11-28T20:38:45.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b5b7fe640 1 -- 172.21.15.167:0/3979523128 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00fee0 con 0x7f4b74143630 2023-11-28T20:38:45.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b5b7fe640 1 -- 172.21.15.167:0/3979523128 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c003b90 con 0x7f4b74143630 2023-11-28T20:38:45.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b5b7fe640 1 -- 172.21.15.167:0/3979523128 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0050d0 con 0x7f4b74143630 2023-11-28T20:38:45.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4161d9b640 1 -- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4164132000 msgr2=0x7f4164149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4161d9b640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4164132000 0x7f4164149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4161d9b640 1 -- 172.21.15.167:0/1589617672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f414c003980 msgr2=0x7f41641587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4161d9b640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f414c003980 0x7f41641587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4161d9b640 1 -- 172.21.15.167:0/1589617672 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4164131ae0 con 0x7f4164158cf0 2023-11-28T20:38:45.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f416259c640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f414c003980 0x7f41641587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:45.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4161d9b640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4164158cf0 0x7f41640c3820 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f416402cef0 tx=0x7f4154011920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b741eeea0 con 0x7f4b74143630 2023-11-28T20:38:45.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b74152830 con 0x7f4b74143630 2023-11-28T20:38:45.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4cae3f8640 1 Processor -- start 2023-11-28T20:38:45.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4cae3f8640 1 -- start start 2023-11-28T20:38:45.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7fab6dffb640 1 -- 172.21.15.167:0/1422776833 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab68003cd0 con 0x7fab780cf440 2023-11-28T20:38:45.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f0448cbb640 1 -- 172.21.15.167:0/3897762338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04440cf860 msgr2=0x7f04440cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f0448cbb640 1 --2- 172.21.15.167:0/3897762338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04440cf860 0x7f04440cb770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f04440cd1c0 tx=0x7f043401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4152ffd640 1 -- 172.21.15.167:0/1589617672 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154004500 con 0x7f4164158cf0 2023-11-28T20:38:45.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f492e157640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49280b5100 0x7f4928148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f492e157640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49280b54e0 0x7f4928149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41641342d0 con 0x7f4164158cf0 2023-11-28T20:38:45.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416406ad50 con 0x7f4164158cf0 2023-11-28T20:38:45.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda304e3640 1 Processor -- start 2023-11-28T20:38:45.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f1a56b65640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a5015d770 0x7f1a5015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f1a56b65640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a5006a580 0x7f1a5006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f1a56b65640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5015ada0 con 0x7f1a50153fa0 2023-11-28T20:38:45.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f1a56b65640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5015e120 con 0x7f1a5006a580 2023-11-28T20:38:45.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.492+0000 7f1a56b65640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a50159f40 con 0x7f1a5015d770 2023-11-28T20:38:45.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f492e157640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f492815eaf0 0x7f492814a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f492e157640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492814a4b0 con 0x7f49280b5100 2023-11-28T20:38:45.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f492e157640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492814c1b0 con 0x7f49280b54e0 2023-11-28T20:38:45.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f492e157640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492814c490 con 0x7f492815eaf0 2023-11-28T20:38:45.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b741523d0 con 0x7f4b74143630 2023-11-28T20:38:45.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda304e3640 1 -- start start 2023-11-28T20:38:45.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4152ffd640 1 -- 172.21.15.167:0/1589617672 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4154003620 con 0x7f4164158cf0 2023-11-28T20:38:45.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4152ffd640 1 -- 172.21.15.167:0/1589617672 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41540039f0 con 0x7f4164158cf0 2023-11-28T20:38:45.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f0448cbb640 1 -- 172.21.15.167:0/3897762338 shutdown_connections 2023-11-28T20:38:45.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f0448cbb640 1 --2- 172.21.15.167:0/3897762338 >> v2:172.21.15.167:3300/0 conn(0x7f0444153ae0 0x7f0444153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f0448cbb640 1 --2- 172.21.15.167:0/3897762338 >> v2:172.21.15.178:3300/0 conn(0x7f04440cfc40 0x7f04440ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f0448cbb640 1 --2- 172.21.15.167:0/3897762338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04440cf860 0x7f04440cb770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f0448cbb640 1 -- 172.21.15.167:0/3897762338 >> 172.21.15.167:0/3897762338 conn(0x7f044406c1f0 msgr2=0x7f0444071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f0448cbb640 1 -- 172.21.15.167:0/3897762338 shutdown_connections 2023-11-28T20:38:45.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a54901640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f1a50153fa0 0x7f1a500c5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46822/0 (socket says 172.21.15.167:46822) 2023-11-28T20:38:45.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a54901640 1 -- 172.21.15.167:0/2927496270 learned_addr learned my addr 172.21.15.167:0/2927496270 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:45.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fab6dffb640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab5c066570 0x7fab5c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fab6dffb640 1 -- 172.21.15.167:0/1422776833 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab68083eb0 con 0x7fab780cf440 2023-11-28T20:38:45.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fab6dffb640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7fab5c06fbb0 0x7fab5c071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fab6dffb640 1 -- 172.21.15.167:0/1422776833 --> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab5c0726c0 con 0x7fab5c06fbb0 2023-11-28T20:38:45.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fab6dffb640 1 -- 172.21.15.167:0/1422776833 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab68084260 con 0x7fab780cf440 2023-11-28T20:38:45.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4927fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f492815eaf0 0x7f492814a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4927fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f492815eaf0 0x7f492814a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33594/0 (socket says 172.21.15.167:33594) 2023-11-28T20:38:45.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4927fff640 1 -- 172.21.15.167:0/2284725734 learned_addr learned my addr 172.21.15.167:0/2284725734 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cae3f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca80c7720 0x7f4ca815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cae3f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ca81585d0 0x7f4ca814d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cae3f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ca815e130 0x7f4ca814c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cae3f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca814d7e0 con 0x7f4ca80c7720 2023-11-28T20:38:45.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cae3f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca81597a0 con 0x7f4ca81585d0 2023-11-28T20:38:45.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cae3f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca814cab0 con 0x7f4ca815e130 2023-11-28T20:38:45.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cac995640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ca815e130 0x7f4ca814c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cac995640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ca815e130 0x7f4ca814c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33602/0 (socket says 172.21.15.167:33602) 2023-11-28T20:38:45.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cac995640 1 -- 172.21.15.167:0/3659416432 learned_addr learned my addr 172.21.15.167:0/3659416432 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4ca77fe640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ca81585d0 0x7f4ca814d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cac995640 1 -- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ca81585d0 msgr2=0x7f4ca814d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cac995640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ca81585d0 0x7f4ca814d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cac995640 1 -- 172.21.15.167:0/3659416432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca80c7720 msgr2=0x7f4ca815a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cac995640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca80c7720 0x7f4ca815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cac995640 1 -- 172.21.15.167:0/3659416432 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c0094d0 con 0x7f4ca815e130 2023-11-28T20:38:45.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4ca77fe640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ca81585d0 0x7f4ca814d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:45.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4148000fd0 con 0x7f4164158cf0 2023-11-28T20:38:45.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f0448cbb640 1 -- 172.21.15.167:0/3897762338 wait complete. 2023-11-28T20:38:45.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223889395 0 0) 0x7f1a4c001120 con 0x7f1a50153fa0 2023-11-28T20:38:45.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a55102640 1 --2- 172.21.15.167:0/2927496270 >> v2:172.21.15.167:3300/0 conn(0x7f1a5006a580 0x7f1a5006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a38003530 con 0x7f1a50153fa0 2023-11-28T20:38:45.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4927fff640 1 -- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49280b54e0 msgr2=0x7f4928149260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:38:45.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4927fff640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49280b54e0 0x7f4928149260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4927fff640 1 -- 172.21.15.167:0/2284725734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49280b5100 msgr2=0x7f4928148d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:38:45.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda304e3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280c7720 0x7fda28156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda304e3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda281585d0 0x7fda28155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937766521 0 0) 0x7f1a38003530 con 0x7f1a50153fa0 2023-11-28T20:38:45.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 >> v2:172.21.15.178:3300/0 conn(0x7f1a5015d770 msgr2=0x7f1a5015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 --2- 172.21.15.167:0/2927496270 >> v2:172.21.15.178:3300/0 conn(0x7f1a5015d770 0x7f1a5015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 >> v2:172.21.15.167:3300/0 conn(0x7f1a5006a580 msgr2=0x7f1a5006a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 --2- 172.21.15.167:0/2927496270 >> v2:172.21.15.167:3300/0 conn(0x7f1a5006a580 0x7f1a5006a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5015a220 con 0x7f1a50153fa0 2023-11-28T20:38:45.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda304e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2815e130 0x7fda28202720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda304e3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28157520 con 0x7fda2815e130 2023-11-28T20:38:45.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda304e3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28203060 con 0x7fda281585d0 2023-11-28T20:38:45.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda304e3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda28157a40 con 0x7fda280c7720 2023-11-28T20:38:45.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cac995640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ca815e130 0x7f4ca814c570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000c770 tx=0x7f4ca000cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda2da7e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda281585d0 0x7fda28155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda2da7e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda281585d0 0x7fda28155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55244/0 (socket says 172.21.15.167:55244) 2023-11-28T20:38:45.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda2da7e640 1 -- 172.21.15.167:0/3422374334 learned_addr learned my addr 172.21.15.167:0/3422374334 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f1a4c001810 con 0x7f1a50153fa0 2023-11-28T20:38:45.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 >> v1:172.21.15.178:6789/0 conn(0x7f1a50153fa0 legacy=0x7f1a500c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a38003980 0x7f1a38003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a380047d0 0x7f1a38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a38005190 0x7f1a3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5015e120 con 0x7f1a38003980 2023-11-28T20:38:45.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50159f40 con 0x7f1a38005190 2023-11-28T20:38:45.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda2e27f640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280c7720 0x7fda28156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3800c0b0 con 0x7f1a380047d0 2023-11-28T20:38:45.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a55102640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a38005190 0x7f1a3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fab7d415640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab5c066570 0x7fab5c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4ca4ff9640 1 -- 172.21.15.167:0/3659416432 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0003b80 con 0x7f4ca815e130 2023-11-28T20:38:45.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca82002b0 con 0x7f4ca815e130 2023-11-28T20:38:45.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4b5b7fe640 1 -- 172.21.15.167:0/3979523128 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b6c005230 con 0x7f4b74143630 2023-11-28T20:38:45.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca81599f0 con 0x7f4ca815e130 2023-11-28T20:38:45.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda2e27f640 1 -- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda281585d0 msgr2=0x7fda28155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda2e27f640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda281585d0 0x7fda28155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda2e27f640 1 -- 172.21.15.167:0/3422374334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2815e130 msgr2=0x7fda28202720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda2e27f640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda2815e130 0x7fda28202720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7fda2e27f640 1 -- 172.21.15.167:0/3422374334 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20009a70 con 0x7fda280c7720 2023-11-28T20:38:45.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f1a47fff640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a380047d0 0x7f1a38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.496+0000 7f4927fff640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49280b5100 0x7f4928148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fda2da7e640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda281585d0 0x7fda28155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:45.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4927fff640 1 -- 172.21.15.167:0/2284725734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0094d0 con 0x7f492815eaf0 2023-11-28T20:38:45.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4ca4ff9640 1 -- 172.21.15.167:0/3659416432 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca0003ce0 con 0x7f4ca815e130 2023-11-28T20:38:45.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4ca4ff9640 1 -- 172.21.15.167:0/3659416432 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000aa70 con 0x7f4ca815e130 2023-11-28T20:38:45.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f1a55102640 1 -- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a380047d0 msgr2=0x7f1a38004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f1a55102640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a380047d0 0x7f1a38004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f1a55102640 1 -- 172.21.15.167:0/2927496270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a38003980 msgr2=0x7f1a38003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f1a55102640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a38003980 0x7f1a38003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f1a55102640 1 -- 172.21.15.167:0/2927496270 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5015a220 con 0x7f1a38005190 2023-11-28T20:38:45.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ca8071750 con 0x7f4ca815e130 2023-11-28T20:38:45.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fab7d415640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab5c066570 0x7fab5c068a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fab74009ac0 tx=0x7fab74009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f0448cbb640 1 Processor -- start 2023-11-28T20:38:45.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fda2e27f640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280c7720 0x7fda28156fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c430 tx=0x7fda2400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f0448cbb640 1 -- start start 2023-11-28T20:38:45.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4152ffd640 1 -- 172.21.15.167:0/1589617672 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4154003b50 con 0x7f4164158cf0 2023-11-28T20:38:45.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fda1effd640 1 -- 172.21.15.167:0/3422374334 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24005cf0 con 0x7fda280c7720 2023-11-28T20:38:45.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fda1effd640 1 -- 172.21.15.167:0/3422374334 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24005e50 con 0x7fda280c7720 2023-11-28T20:38:45.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fda1effd640 1 -- 172.21.15.167:0/3422374334 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240072d0 con 0x7fda280c7720 2023-11-28T20:38:45.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda28157d20 con 0x7fda280c7720 2023-11-28T20:38:45.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2815b730 con 0x7fda280c7720 2023-11-28T20:38:45.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4b5b7fe640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4b60066540 0x7f4b60068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4b5b7fe640 1 -- 172.21.15.167:0/3979523128 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b6c084c20 con 0x7f4b74143630 2023-11-28T20:38:45.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4b5b7fe640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7f4b6006fb80 0x7f4b60071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4b5b7fe640 1 -- 172.21.15.167:0/3979523128 --> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b60072690 con 0x7f4b6006fb80 2023-11-28T20:38:45.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4b5b7fe640 1 -- 172.21.15.167:0/3979523128 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b6c084fd0 con 0x7f4b74143630 2023-11-28T20:38:45.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4b72ffd640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4b60066540 0x7f4b60068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fab7dc16640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7fab5c06fbb0 0x7fab5c071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4927fff640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f492815eaf0 0x7f492814a960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f491c0ad040 tx=0x7f491c01ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4152ffd640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4144066470 0x7f4144068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4152ffd640 1 -- 172.21.15.167:0/1589617672 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4154084b90 con 0x7f4164158cf0 2023-11-28T20:38:45.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4152ffd640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f414406fa30 0x7f4144071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4152ffd640 1 -- 172.21.15.167:0/1589617672 --> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4144072540 con 0x7f414406fa30 2023-11-28T20:38:45.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4152ffd640 1 -- 172.21.15.167:0/1589617672 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4154084f00 con 0x7f4164158cf0 2023-11-28T20:38:45.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda28167eb0 con 0x7fda280c7720 2023-11-28T20:38:45.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4b727fc640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7f4b6006fb80 0x7f4b60071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7fab7dc16640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7fab5c06fbb0 0x7fab5c071ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f4162d9d640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f414406fa30 0x7f4144071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f416259c640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4144066470 0x7f4144068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f490ffff640 1 -- 172.21.15.167:0/2284725734 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0be3f0 con 0x7f492815eaf0 2023-11-28T20:38:45.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4ca4ff9640 1 -- 172.21.15.167:0/3659416432 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ca000abd0 con 0x7f4ca815e130 2023-11-28T20:38:45.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f0448cbb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04440cf860 0x7f04440b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f0448cbb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04440cfc40 0x7f0444158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f0448cbb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0444153ae0 0x7f0444154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f0448cbb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0444151930 con 0x7f04440cf860 2023-11-28T20:38:45.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f0448cbb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0444154650 con 0x7f04440cfc40 2023-11-28T20:38:45.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.500+0000 7f0448cbb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0444151bd0 con 0x7f0444153ae0 2023-11-28T20:38:45.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f490ffff640 1 -- 172.21.15.167:0/2284725734 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c0be570 con 0x7f492815eaf0 2023-11-28T20:38:45.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0442d9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0444153ae0 0x7f0444154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0442d9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0444153ae0 0x7f0444154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33614/0 (socket says 172.21.15.167:33614) 2023-11-28T20:38:45.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0442d9d640 1 -- 172.21.15.167:0/4101857353 learned_addr learned my addr 172.21.15.167:0/4101857353 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f490ffff640 1 -- 172.21.15.167:0/2284725734 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0be920 con 0x7f492815eaf0 2023-11-28T20:38:45.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0441d9b640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04440cfc40 0x7f0444158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f044259c640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04440cf860 0x7f04440b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492814c770 con 0x7f492815eaf0 2023-11-28T20:38:45.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492814cd30 con 0x7f492815eaf0 2023-11-28T20:38:45.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0442d9d640 1 -- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04440cfc40 msgr2=0x7f0444158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0442d9d640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04440cfc40 0x7f0444158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0442d9d640 1 -- 172.21.15.167:0/4101857353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04440cf860 msgr2=0x7f04440b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0442d9d640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04440cf860 0x7f04440b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0442d9d640 1 -- 172.21.15.167:0/4101857353 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340094d0 con 0x7f0444153ae0 2023-11-28T20:38:45.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4ca4ff9640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c94066470 0x7f4c94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7fab6dffb640 1 -- 172.21.15.167:0/1422776833 <== osd.1 v2:172.21.15.167:6808/3381685754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fab5c0726c0 con 0x7fab5c06fbb0 2023-11-28T20:38:45.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4162d9d640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f414406fa30 0x7f4144071e70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49280cbe40 con 0x7f492815eaf0 2023-11-28T20:38:45.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0442d9d640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0444153ae0 0x7f0444154e10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f043c00efc0 tx=0x7f043c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4ca4ff9640 1 -- 172.21.15.167:0/3659416432 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ca0084a00 con 0x7f4ca815e130 2023-11-28T20:38:45.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f1a55102640 1 -- 172.21.15.167:0/2927496270 reap_dead start 2023-11-28T20:38:45.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4b72ffd640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4b60066540 0x7f4b60068a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0057b0 tx=0x7f4b64004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4b727fc640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7f4b6006fb80 0x7f4b60071fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4ca4ff9640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f4c9406fa30 0x7f4c94071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4ca4ff9640 1 -- 172.21.15.167:0/3659416432 --> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c94072540 con 0x7f4c9406fa30 2023-11-28T20:38:45.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4ca4ff9640 1 -- 172.21.15.167:0/3659416432 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ca0084e50 con 0x7f4ca815e130 2023-11-28T20:38:45.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4ca7fff640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c94066470 0x7f4c94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f416259c640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4144066470 0x7f4144068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f41580aa000 tx=0x7f4158001ad0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7fda1effd640 1 -- 172.21.15.167:0/3422374334 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fda24007430 con 0x7fda280c7720 2023-11-28T20:38:45.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0432ffd640 1 -- 172.21.15.167:0/4101857353 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c009ba0 con 0x7f0444153ae0 2023-11-28T20:38:45.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4ca77fe640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f4c9406fa30 0x7f4c94071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0432ffd640 1 -- 172.21.15.167:0/4101857353 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c00f040 con 0x7f0444153ae0 2023-11-28T20:38:45.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0432ffd640 1 -- 172.21.15.167:0/4101857353 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0146c0 con 0x7f0444153ae0 2023-11-28T20:38:45.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f1a55102640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a38005190 0x7f1a3800b990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009fc0 tx=0x7f1a4801cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac0da88e393620b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044415cda0 con 0x7f0444153ae0 2023-11-28T20:38:45.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044415d080 con 0x7f0444153ae0 2023-11-28T20:38:45.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4ca7fff640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c94066470 0x7f4c94068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0ae000 tx=0x7f4c9c004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4b5b7fe640 1 -- 172.21.15.167:0/3979523128 <== osd.0 v2:172.21.15.167:6800/1022160227 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4b60072690 con 0x7f4b6006fb80 2023-11-28T20:38:45.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f4152ffd640 1 -- 172.21.15.167:0/1589617672 <== osd.4 v2:172.21.15.178:6800/1470729243 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4144072540 con 0x7f414406fa30 2023-11-28T20:38:45.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a480a5c60 con 0x7f1a38005190 2023-11-28T20:38:45.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4800f040 con 0x7f1a38005190 2023-11-28T20:38:45.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.504+0000 7f1a477fe640 1 -- 172.21.15.167:0/2927496270 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a480039a0 con 0x7f1a38005190 2023-11-28T20:38:45.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f4ca77fe640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f4c9406fa30 0x7f4c94071e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7fda1effd640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda0c066470 0x7fda0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7fda1effd640 1 -- 172.21.15.167:0/3422374334 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda24083e30 con 0x7fda280c7720 2023-11-28T20:38:45.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7fda1effd640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7fda0c06fab0 0x7fda0c071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7fda1effd640 1 -- 172.21.15.167:0/3422374334 --> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda0c0725c0 con 0x7fda0c06fab0 2023-11-28T20:38:45.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7fda1effd640 1 -- 172.21.15.167:0/3422374334 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda240841e0 con 0x7fda280c7720 2023-11-28T20:38:45.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04440caa50 con 0x7f0444153ae0 2023-11-28T20:38:45.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7fda2da7e640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda0c066470 0x7fda0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7fda2ea80640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7fda0c06fab0 0x7fda0c071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f1a56b65640 1 -- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a38005190 msgr2=0x7f1a3800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f1a56b65640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a38005190 0x7f1a3800b990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009fc0 tx=0x7f1a4801cc70 comp rx=0 tx=0).stop 2023-11-28T20:38:45.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f4ca4ff9640 1 -- 172.21.15.167:0/3659416432 <== osd.3 v2:172.21.15.167:6824/1382439964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4c94072540 con 0x7f4c9406fa30 2023-11-28T20:38:45.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f1a56b65640 1 -- 172.21.15.167:0/2927496270 shutdown_connections 2023-11-28T20:38:45.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f1a56b65640 1 --2- 172.21.15.167:0/2927496270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a38005190 0x7f1a3800b990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f1a56b65640 1 -- 172.21.15.167:0/2927496270 >> 172.21.15.167:0/2927496270 conn(0x7f1a500cb1e0 msgr2=0x7f1a500cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f490ffff640 1 -- 172.21.15.167:0/2284725734 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f491c0b43f0 con 0x7f492815eaf0 2023-11-28T20:38:45.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f1a56b65640 1 -- 172.21.15.167:0/2927496270 shutdown_connections 2023-11-28T20:38:45.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7fda2ea80640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7fda0c06fab0 0x7fda0c071ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7fda2da7e640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda0c066470 0x7fda0c068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda28157ff0 tx=0x7fda18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.508+0000 7f1a56b65640 1 -- 172.21.15.167:0/2927496270 wait complete. 2023-11-28T20:38:45.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7fda1effd640 1 -- 172.21.15.167:0/3422374334 <== osd.5 v2:172.21.15.178:6816/929221892 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fda0c0725c0 con 0x7fda0c06fab0 2023-11-28T20:38:45.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f0432ffd640 1 -- 172.21.15.167:0/4101857353 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f043c014820 con 0x7f0444153ae0 2023-11-28T20:38:45.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f0432ffd640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066540 0x7f0424068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f0432ffd640 1 -- 172.21.15.167:0/4101857353 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f043c084fb0 con 0x7f0444153ae0 2023-11-28T20:38:45.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f0432ffd640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7f042406fb00 0x7f0424071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f0432ffd640 1 -- 172.21.15.167:0/4101857353 --> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0424072610 con 0x7f042406fb00 2023-11-28T20:38:45.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f1a56b65640 1 Processor -- start 2023-11-28T20:38:45.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f1a56b65640 1 -- start start 2023-11-28T20:38:45.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f490ffff640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49140664f0 0x7f49140689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f490ffff640 1 -- 172.21.15.167:0/2284725734 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f491c11e880 con 0x7f492815eaf0 2023-11-28T20:38:45.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f490ffff640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f491406fb30 0x7f4914071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f490ffff640 1 -- 172.21.15.167:0/2284725734 --> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4914072640 con 0x7f491406fb30 2023-11-28T20:38:45.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f490ffff640 1 -- 172.21.15.167:0/2284725734 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f491c11eca0 con 0x7f492815eaf0 2023-11-28T20:38:45.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f49277fe640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49140664f0 0x7f49140689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f0441d9b640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7f042406fb00 0x7f0424071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f044259c640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066540 0x7f0424068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.512+0000 7f49277fe640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49140664f0 0x7f49140689b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49200070b0 tx=0x7f4920007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f0441d9b640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7f042406fb00 0x7f0424071f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f0432ffd640 1 -- 172.21.15.167:0/4101857353 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f043c052090 con 0x7f0444153ae0 2023-11-28T20:38:45.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a56b65640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a38005190 0x7f1a50152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a56b65640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5014cba0 0x7f1a501f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a56b65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5014e7d0 0x7f1a500ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a56b65640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50150ca0 con 0x7f1a38005190 2023-11-28T20:38:45.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a56b65640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a501f7c50 con 0x7f1a5014cba0 2023-11-28T20:38:45.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a56b65640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50151d70 con 0x7f1a5014e7d0 2023-11-28T20:38:45.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f044259c640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066540 0x7f0424068a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04340ae000 tx=0x7f04340b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f4926ffd640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f491406fb30 0x7f4914071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a55102640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5014e7d0 0x7f1a500ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a55102640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5014e7d0 0x7f1a500ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33618/0 (socket says 172.21.15.167:33618) 2023-11-28T20:38:45.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a55102640 1 -- 172.21.15.167:0/2113184372 learned_addr learned my addr 172.21.15.167:0/2113184372 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a47fff640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5014cba0 0x7f1a501f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a54901640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a38005190 0x7f1a50152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f0432ffd640 1 -- 172.21.15.167:0/4101857353 <== osd.6 v2:172.21.15.178:6817/1489101033 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0424072610 con 0x7f042406fb00 2023-11-28T20:38:45.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a55102640 1 -- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5014cba0 msgr2=0x7f1a501f7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a55102640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5014cba0 0x7f1a501f7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a55102640 1 -- 172.21.15.167:0/2113184372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a38005190 msgr2=0x7f1a50152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a55102640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a38005190 0x7f1a50152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a55102640 1 -- 172.21.15.167:0/2113184372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a501532a0 con 0x7f1a5014e7d0 2023-11-28T20:38:45.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a54901640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a38005190 0x7f1a50152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:45.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f4926ffd640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f491406fb30 0x7f4914071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a55102640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5014e7d0 0x7f1a500ca300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a4801d510 tx=0x7f1a48009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a457fa640 1 -- 172.21.15.167:0/2113184372 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48003ea0 con 0x7f1a5014e7d0 2023-11-28T20:38:45.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.516+0000 7f1a56b65640 1 -- 172.21.15.167:0/2113184372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5014d000 con 0x7f1a5014e7d0 2023-11-28T20:38:45.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.520+0000 7f1a56b65640 1 -- 172.21.15.167:0/2113184372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a50151720 con 0x7f1a5014e7d0 2023-11-28T20:38:45.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.520+0000 7f490ffff640 1 -- 172.21.15.167:0/2284725734 <== osd.2 v2:172.21.15.167:6816/3946163569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4914072640 con 0x7f491406fb30 2023-11-28T20:38:45.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.520+0000 7f1a457fa640 1 -- 172.21.15.167:0/2113184372 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a480a5c60 con 0x7f1a5014e7d0 2023-11-28T20:38:45.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.520+0000 7f1a457fa640 1 -- 172.21.15.167:0/2113184372 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48004020 con 0x7f1a5014e7d0 2023-11-28T20:38:45.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.520+0000 7f1a36ffd640 1 -- 172.21.15.167:0/2113184372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a30000fd0 con 0x7f1a5014e7d0 2023-11-28T20:38:45.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.524+0000 7f1a457fa640 1 -- 172.21.15.167:0/2113184372 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a48004180 con 0x7f1a5014e7d0 2023-11-28T20:38:45.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.524+0000 7f1a457fa640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a3c0664d0 0x7f1a3c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.528+0000 7f1a457fa640 1 -- 172.21.15.167:0/2113184372 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a480f0b20 con 0x7f1a5014e7d0 2023-11-28T20:38:45.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.528+0000 7f1a54901640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a3c0664d0 0x7f1a3c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.528+0000 7f1a457fa640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f1a3c070730 0x7f1a3c072bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.528+0000 7f1a457fa640 1 -- 172.21.15.167:0/2113184372 --> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a3c0732a0 con 0x7f1a3c070730 2023-11-28T20:38:45.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.528+0000 7f1a457fa640 1 -- 172.21.15.167:0/2113184372 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a48004020 con 0x7f1a5014e7d0 2023-11-28T20:38:45.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.528+0000 7f1a47fff640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f1a3c070730 0x7f1a3c072bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.528+0000 7f1a54901640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a3c0664d0 0x7f1a3c068990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c007b10 tx=0x7f1a4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.528+0000 7f1a47fff640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f1a3c070730 0x7f1a3c072bd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 --> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ca816b2d0 con 0x7f4c9406fa30 2023-11-28T20:38:45.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4ca4ff9640 1 -- 172.21.15.167:0/3659416432 <== osd.3 v2:172.21.15.167:6824/1382439964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4c9800a9a0 con 0x7f4c9406fa30 2023-11-28T20:38:45.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f1a457fa640 1 -- 172.21.15.167:0/2113184372 <== osd.7 v2:172.21.15.178:6808/98078411 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1a3c0732a0 con 0x7f1a3c070730 2023-11-28T20:38:45.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f4c9406fa30 msgr2=0x7f4c94071e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f4c9406fa30 0x7f4c94071e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 --> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4148002cc0 con 0x7f414406fa30 2023-11-28T20:38:45.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c94066470 msgr2=0x7f4c94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c94066470 0x7f4c94068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0ae000 tx=0x7f4c9c004740 comp rx=0 tx=0).stop 2023-11-28T20:38:45.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ca815e130 msgr2=0x7f4ca814c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 --2- 172.21.15.167:0/3659416432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ca815e130 0x7f4ca814c570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000c770 tx=0x7f4ca000cc30 comp rx=0 tx=0).stop 2023-11-28T20:38:45.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cac995640 1 -- 172.21.15.167:0/3659416432 reap_dead start 2023-11-28T20:38:45.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 shutdown_connections 2023-11-28T20:38:45.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 >> 172.21.15.167:0/3659416432 conn(0x7f4ca80cb1e0 msgr2=0x7f4ca8071930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 shutdown_connections 2023-11-28T20:38:45.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4cae3f8640 1 -- 172.21.15.167:0/3659416432 wait complete. 2023-11-28T20:38:45.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7fab7e417640 1 -- 172.21.15.167:0/1422776833 --> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab780b23e0 con 0x7fab5c06fbb0 2023-11-28T20:38:45.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4152ffd640 1 -- 172.21.15.167:0/1589617672 <== osd.4 v2:172.21.15.178:6800/1470729243 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4148002cc0 con 0x7f414406fa30 2023-11-28T20:38:45.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f414406fa30 msgr2=0x7f4144071e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4168ebb640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f414406fa30 0x7f4144071e70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.532+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4144066470 msgr2=0x7f4144068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4168ebb640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4144066470 0x7f4144068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f41580aa000 tx=0x7f4158001ad0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4164158cf0 msgr2=0x7f41640c3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4168ebb640 1 --2- 172.21.15.167:0/1589617672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4164158cf0 0x7f41640c3820 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f416402cef0 tx=0x7f4154011920 comp rx=0 tx=0).stop 2023-11-28T20:38:45.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4162d9d640 1 -- 172.21.15.167:0/1589617672 reap_dead start 2023-11-28T20:38:45.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7fab6dffb640 1 -- 172.21.15.167:0/1422776833 <== osd.1 v2:172.21.15.167:6808/3381685754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fab780b23e0 con 0x7fab5c06fbb0 2023-11-28T20:38:45.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 shutdown_connections 2023-11-28T20:38:45.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 >> 172.21.15.167:0/1589617672 conn(0x7f41640cb1e0 msgr2=0x7f416406ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 --> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b7415a640 con 0x7f4b6006fb80 2023-11-28T20:38:45.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 shutdown_connections 2023-11-28T20:38:45.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4168ebb640 1 -- 172.21.15.167:0/1589617672 wait complete. 2023-11-28T20:38:45.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7f4b5b7fe640 1 -- 172.21.15.167:0/3979523128 <== osd.0 v2:172.21.15.167:6800/1022160227 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b6801a390 con 0x7f4b6006fb80 2023-11-28T20:38:45.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7fab5b7fe640 1 -- 172.21.15.167:0/1422776833 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7fab5c06fbb0 msgr2=0x7fab5c071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7fab5b7fe640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7fab5c06fbb0 0x7fab5c071ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7fab5b7fe640 1 -- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab5c066570 msgr2=0x7fab5c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7fab5b7fe640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fab5c066570 0x7fab5c068a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fab74009ac0 tx=0x7fab74009190 comp rx=0 tx=0).stop 2023-11-28T20:38:45.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7f4b6006fb80 msgr2=0x7f4b60071fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7f4b6006fb80 0x7f4b60071fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4b60066540 msgr2=0x7f4b60068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4b60066540 0x7f4b60068a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0057b0 tx=0x7f4b64004740 comp rx=0 tx=0).stop 2023-11-28T20:38:45.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74143630 msgr2=0x7f4b740cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 --2- 172.21.15.167:0/3979523128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74143630 0x7f4b740cdf60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c007fd0 tx=0x7f4b6c00fc90 comp rx=0 tx=0).stop 2023-11-28T20:38:45.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b737fe640 1 -- 172.21.15.167:0/3979523128 reap_dead start 2023-11-28T20:38:45.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 shutdown_connections 2023-11-28T20:38:45.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 >> 172.21.15.167:0/3979523128 conn(0x7f4b7406b800 msgr2=0x7f4b740b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 shutdown_connections 2023-11-28T20:38:45.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7f4b7933e640 1 -- 172.21.15.167:0/3979523128 wait complete. 2023-11-28T20:38:45.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7fab5b7fe640 1 -- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780cf440 msgr2=0x7fab781ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.536+0000 7fab5b7fe640 1 --2- 172.21.15.167:0/1422776833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780cf440 0x7fab781ff9b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c490 tx=0x7fab68001e80 comp rx=0 tx=0).stop 2023-11-28T20:38:45.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7fab7dc16640 1 -- 172.21.15.167:0/1422776833 reap_dead start 2023-11-28T20:38:45.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7fab5b7fe640 1 -- 172.21.15.167:0/1422776833 shutdown_connections 2023-11-28T20:38:45.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7fab5b7fe640 1 -- 172.21.15.167:0/1422776833 >> 172.21.15.167:0/1422776833 conn(0x7fab7806b800 msgr2=0x7fab78152c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7fab5b7fe640 1 -- 172.21.15.167:0/1422776833 shutdown_connections 2023-11-28T20:38:45.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.540+0000 7fab5b7fe640 1 -- 172.21.15.167:0/1422776833 wait complete. 2023-11-28T20:38:45.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.544+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 --> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0444159cc0 con 0x7f042406fb00 2023-11-28T20:38:45.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.544+0000 7f0432ffd640 1 -- 172.21.15.167:0/4101857353 <== osd.6 v2:172.21.15.178:6817/1489101033 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f04380097a0 con 0x7f042406fb00 2023-11-28T20:38:45.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 --> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda28075c90 con 0x7fda0c06fab0 2023-11-28T20:38:45.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7f042406fb00 msgr2=0x7f0424071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7f0448cbb640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7f042406fb00 0x7f0424071f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066540 msgr2=0x7f0424068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7f0448cbb640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066540 0x7f0424068a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f04340ae000 tx=0x7f04340b5040 comp rx=0 tx=0).stop 2023-11-28T20:38:45.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0444153ae0 msgr2=0x7f0444154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7f0448cbb640 1 --2- 172.21.15.167:0/4101857353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0444153ae0 0x7f0444154e10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f043c00efc0 tx=0x7f043c00c490 comp rx=0 tx=0).stop 2023-11-28T20:38:45.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7f0442d9d640 1 -- 172.21.15.167:0/4101857353 reap_dead start 2023-11-28T20:38:45.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda1effd640 1 -- 172.21.15.167:0/3422374334 <== osd.5 v2:172.21.15.178:6816/929221892 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fda28075c90 con 0x7fda0c06fab0 2023-11-28T20:38:45.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7fda0c06fab0 msgr2=0x7fda0c071ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7fda0c06fab0 0x7fda0c071ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda0c066470 msgr2=0x7fda0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda0c066470 0x7fda0c068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda28157ff0 tx=0x7fda18008040 comp rx=0 tx=0).stop 2023-11-28T20:38:45.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280c7720 msgr2=0x7fda28156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 --2- 172.21.15.167:0/3422374334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280c7720 0x7fda28156fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c430 tx=0x7fda2400c8f0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda2ea80640 1 -- 172.21.15.167:0/3422374334 reap_dead start 2023-11-28T20:38:45.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 shutdown_connections 2023-11-28T20:38:45.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 >> 172.21.15.167:0/3422374334 conn(0x7fda280cb1e0 msgr2=0x7fda28070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 shutdown_connections 2023-11-28T20:38:45.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.548+0000 7fda304e3640 1 -- 172.21.15.167:0/3422374334 wait complete. 2023-11-28T20:38:45.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.556+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 shutdown_connections 2023-11-28T20:38:45.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.556+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 >> 172.21.15.167:0/4101857353 conn(0x7f044406c1f0 msgr2=0x7f0444152b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.556+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 shutdown_connections 2023-11-28T20:38:45.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.556+0000 7f0448cbb640 1 -- 172.21.15.167:0/4101857353 wait complete. 2023-11-28T20:38:45.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.564+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 --> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f492814a680 con 0x7f491406fb30 2023-11-28T20:38:45.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.568+0000 7f490ffff640 1 -- 172.21.15.167:0/2284725734 <== osd.2 v2:172.21.15.167:6816/3946163569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f492814a680 con 0x7f491406fb30 2023-11-28T20:38:45.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.564+0000 7f1a36ffd640 1 -- 172.21.15.167:0/2113184372 --> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a30002cc0 con 0x7f1a3c070730 2023-11-28T20:38:45.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.572+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f491406fb30 msgr2=0x7f4914071f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.572+0000 7f492e157640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f491406fb30 0x7f4914071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.572+0000 7f1a457fa640 1 -- 172.21.15.167:0/2113184372 <== osd.7 v2:172.21.15.178:6808/98078411 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a30002cc0 con 0x7f1a3c070730 2023-11-28T20:38:45.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49140664f0 msgr2=0x7f49140689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f492e157640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49140664f0 0x7f49140689b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f49200070b0 tx=0x7f4920007040 comp rx=0 tx=0).stop 2023-11-28T20:38:45.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f492815eaf0 msgr2=0x7f492814a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f492e157640 1 --2- 172.21.15.167:0/2284725734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f492815eaf0 0x7f492814a960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f491c0ad040 tx=0x7f491c01ad50 comp rx=0 tx=0).stop 2023-11-28T20:38:45.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 -- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f1a3c070730 msgr2=0x7f1a3c072bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f1a3c070730 0x7f1a3c072bd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 -- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a3c0664d0 msgr2=0x7f1a3c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a3c0664d0 0x7f1a3c068990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c007b10 tx=0x7f1a4c009040 comp rx=0 tx=0).stop 2023-11-28T20:38:45.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 -- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5014e7d0 msgr2=0x7f1a500ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 --2- 172.21.15.167:0/2113184372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5014e7d0 0x7f1a500ca300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a4801d510 tx=0x7f1a48009750 comp rx=0 tx=0).stop 2023-11-28T20:38:45.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a55102640 1 -- 172.21.15.167:0/2113184372 reap_dead start 2023-11-28T20:38:45.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 -- 172.21.15.167:0/2113184372 shutdown_connections 2023-11-28T20:38:45.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 -- 172.21.15.167:0/2113184372 >> 172.21.15.167:0/2113184372 conn(0x7f1a500cb1e0 msgr2=0x7f1a500cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.626 INFO:teuthology.orchestra.run.smithi167.stdout:64424509451 2023-11-28T20:38:45.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 -- 172.21.15.167:0/2113184372 shutdown_connections 2023-11-28T20:38:45.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f1a36ffd640 1 -- 172.21.15.167:0/2113184372 wait complete. 2023-11-28T20:38:45.627 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T20:38:45.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f4927fff640 1 -- 172.21.15.167:0/2284725734 reap_dead start 2023-11-28T20:38:45.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 shutdown_connections 2023-11-28T20:38:45.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.580+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 >> 172.21.15.167:0/2284725734 conn(0x7f49280662a0 msgr2=0x7f4928156300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.584+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 shutdown_connections 2023-11-28T20:38:45.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.584+0000 7f492e157640 1 -- 172.21.15.167:0/2284725734 wait complete. 2023-11-28T20:38:45.629 INFO:teuthology.orchestra.run.smithi167.stdout:60129542155 2023-11-28T20:38:45.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T20:38:45.630 INFO:teuthology.orchestra.run.smithi167.stdout:60129542155 2023-11-28T20:38:45.631 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T20:38:45.632 INFO:teuthology.orchestra.run.smithi167.stdout:64424509451 2023-11-28T20:38:45.632 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T20:38:45.633 INFO:teuthology.orchestra.run.smithi167.stdout:60129542156 2023-11-28T20:38:45.633 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T20:38:45.634 INFO:teuthology.orchestra.run.smithi167.stdout:60129542156 2023-11-28T20:38:45.634 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T20:38:45.635 INFO:teuthology.orchestra.run.smithi167.stdout:60129542155 2023-11-28T20:38:45.635 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T20:38:45.636 INFO:teuthology.orchestra.run.smithi167.stdout:64424509451 2023-11-28T20:38:45.637 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T20:38:45.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.908+0000 7f1b724fd640 1 Processor -- start 2023-11-28T20:38:45.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.908+0000 7f1b724fd640 1 -- start start 2023-11-28T20:38:45.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.908+0000 7f1b724fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b6c153d50 0x7f1b6c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.908+0000 7f1b724fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b6c0c5b50 0x7f1b6c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.908+0000 7f1b724fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1b6c159f60 0x7f1b6c070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.908+0000 7f1b724fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6c15a3f0 con 0x7f1b6c159f60 2023-11-28T20:38:45.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.908+0000 7f1b724fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6c06e900 con 0x7f1b6c153d50 2023-11-28T20:38:45.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.908+0000 7f1b724fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c154130 con 0x7f1b6c0c5b50 2023-11-28T20:38:45.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b70a9a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1b6c159f60 0x7f1b6c070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b70a9a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1b6c159f60 0x7f1b6c070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46808/0 (socket says 172.21.15.167:46808) 2023-11-28T20:38:45.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b70a9a640 1 -- 172.21.15.167:0/2355398931 learned_addr learned my addr 172.21.15.167:0/2355398931 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b70a9a640 1 -- 172.21.15.167:0/2355398931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b6c0c5b50 msgr2=0x7f1b6c159a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T20:38:45.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b70a9a640 1 --2- 172.21.15.167:0/2355398931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b6c0c5b50 0x7f1b6c159a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b70a9a640 1 -- 172.21.15.167:0/2355398931 >> v2:172.21.15.178:3300/0 conn(0x7f1b6c153d50 msgr2=0x7f1b6c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b6bfff640 1 --2- 172.21.15.167:0/2355398931 >> v2:172.21.15.178:3300/0 conn(0x7f1b6c153d50 0x7f1b6c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b70a9a640 1 --2- 172.21.15.167:0/2355398931 >> v2:172.21.15.178:3300/0 conn(0x7f1b6c153d50 0x7f1b6c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b70a9a640 1 -- 172.21.15.167:0/2355398931 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c15a600 con 0x7f1b6c159f60 2023-11-28T20:38:45.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.912+0000 7f1b6bfff640 1 --2- 172.21.15.167:0/2355398931 >> v2:172.21.15.178:3300/0 conn(0x7f1b6c153d50 0x7f1b6c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:45.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fb71a1f5640 1 Processor -- start 2023-11-28T20:38:45.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc543d1640 1 Processor -- start 2023-11-28T20:38:45.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc543d1640 1 -- start start 2023-11-28T20:38:45.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7f1b70a9a640 1 --2- 172.21.15.167:0/2355398931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c159f60 0x7f1b6c070db0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c074300 tx=0x7f1b6401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae3e9b7067df6f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fb71a1f5640 1 -- start start 2023-11-28T20:38:45.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fb71a1f5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb71406ec00 0x7fb714156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fb71a1f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7140c73e0 con 0x7fb71414fc60 2023-11-28T20:38:45.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fb71a1f5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7140c7630 con 0x7fb71414f880 2023-11-28T20:38:45.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fb71a1f5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7140c7910 con 0x7fb71406ec00 2023-11-28T20:38:45.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc543d1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc4c0c5b50 0x7fcc4c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc543d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7f1b6affd640 1 -- 172.21.15.167:0/2355398931 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640af400 con 0x7f1b6c159f60 2023-11-28T20:38:45.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7f1b6affd640 1 -- 172.21.15.167:0/2355398931 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b640ab050 con 0x7f1b6c159f60 2023-11-28T20:38:45.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7f1b6affd640 1 -- 172.21.15.167:0/2355398931 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640af780 con 0x7f1b6c159f60 2023-11-28T20:38:45.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc543d1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c154130 con 0x7fcc4c153d50 2023-11-28T20:38:45.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc543d1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c15a3f0 con 0x7fcc4c0c5b50 2023-11-28T20:38:45.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc543d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c15a600 con 0x7fcc4c159f60 2023-11-28T20:38:45.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fb713fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb71414fc60 0x7fb714160370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44646/0 (socket says 172.21.15.167:44646) 2023-11-28T20:38:45.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc5196c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc4c0c5b50 0x7fcc4c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fb7137fe640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb71414f880 0x7fb71406d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46828/0 (socket says 172.21.15.167:46828) 2023-11-28T20:38:45.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fb7137fe640 1 -- 172.21.15.167:0/1847609098 learned_addr learned my addr 172.21.15.167:0/1847609098 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:45.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc5196c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc4c0c5b50 0x7fcc4c159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55280/0 (socket says 172.21.15.167:55280) 2023-11-28T20:38:45.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.916+0000 7fcc5196c640 1 -- 172.21.15.167:0/3714847444 learned_addr learned my addr 172.21.15.167:0/3714847444 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fcc5296e640 1 --2- 172.21.15.167:0/3714847444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 -- 172.21.15.167:0/2355398931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c159f60 msgr2=0x7f1b6c070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 --2- 172.21.15.167:0/2355398931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c159f60 0x7f1b6c070db0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c074300 tx=0x7f1b6401f1e0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240695025 0 0) 0x7fb7140c7630 con 0x7fb71414f880 2023-11-28T20:38:45.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 -- 172.21.15.167:0/2355398931 shutdown_connections 2023-11-28T20:38:45.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 --2- 172.21.15.167:0/2355398931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c159f60 0x7f1b6c070db0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 --2- 172.21.15.167:0/2355398931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b6c0c5b50 0x7f1b6c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 --2- 172.21.15.167:0/2355398931 >> v2:172.21.15.178:3300/0 conn(0x7f1b6c153d50 0x7f1b6c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 -- 172.21.15.167:0/2355398931 >> 172.21.15.167:0/2355398931 conn(0x7f1b6c0c7c50 msgr2=0x7f1b6c0c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb700003530 con 0x7fb71414f880 2023-11-28T20:38:45.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306035759 0 0) 0x7fb7140c73e0 con 0x7fb71414fc60 2023-11-28T20:38:45.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7140c7630 con 0x7fb71414fc60 2023-11-28T20:38:45.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb712ffd640 1 --2- 172.21.15.167:0/1847609098 >> v2:172.21.15.178:3300/0 conn(0x7fb71406ec00 0x7fb714156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2676383437 0 0) 0x7fb700003530 con 0x7fb71414f880 2023-11-28T20:38:45.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 >> v2:172.21.15.178:3300/0 conn(0x7fb71406ec00 msgr2=0x7fb714156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 --2- 172.21.15.167:0/1847609098 >> v2:172.21.15.178:3300/0 conn(0x7fb71406ec00 0x7fb714156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 >> v1:172.21.15.167:6789/0 conn(0x7fb71414fc60 legacy=0x7fb714160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7140c5b50 con 0x7fb71414f880 2023-11-28T20:38:45.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fb70c001a00 con 0x7fb71414f880 2023-11-28T20:38:45.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fcc5296e640 1 -- 172.21.15.167:0/3714847444 >> v2:172.21.15.178:3300/0 conn(0x7fcc4c0c5b50 msgr2=0x7fcc4c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fcc5296e640 1 --2- 172.21.15.167:0/3714847444 >> v2:172.21.15.178:3300/0 conn(0x7fcc4c0c5b50 0x7fcc4c159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fcc5296e640 1 -- 172.21.15.167:0/3714847444 >> v1:172.21.15.178:6789/0 conn(0x7fcc4c153d50 legacy=0x7fcc4c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fcc5296e640 1 -- 172.21.15.167:0/3714847444 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c15a8e0 con 0x7fcc4c159f60 2023-11-28T20:38:45.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fcc5196c640 1 --2- 172.21.15.167:0/3714847444 >> v2:172.21.15.178:3300/0 conn(0x7fcc4c0c5b50 0x7fcc4c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:45.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 -- 172.21.15.167:0/2355398931 shutdown_connections 2023-11-28T20:38:45.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 -- 172.21.15.167:0/2355398931 wait complete. 2023-11-28T20:38:45.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 >> v1:172.21.15.178:6789/0 conn(0x7fb71414f880 legacy=0x7fb71406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb700004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700003770 0x7fb700003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb700004250 0x7fb70000fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140c7910 con 0x7fb700003770 2023-11-28T20:38:45.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb700010690 con 0x7fb700004250 2023-11-28T20:38:45.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb700009a00 con 0x7fb700004bc0 2023-11-28T20:38:45.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7137fe640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb700004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb713fff640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb700004250 0x7fb70000fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb712ffd640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700003770 0x7fb700003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7137fe640 1 -- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb700004250 msgr2=0x7fb70000fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7137fe640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb700004250 0x7fb70000fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7f1b724fd640 1 Processor -- start 2023-11-28T20:38:45.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7137fe640 1 -- 172.21.15.167:0/1847609098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700003770 msgr2=0x7fb700003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7137fe640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700003770 0x7fb700003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.920+0000 7fb7137fe640 1 -- 172.21.15.167:0/1847609098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7140c5b50 con 0x7fb700004bc0 2023-11-28T20:38:45.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7fb713fff640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb700004250 0x7fb70000fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:45.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7fb713fff640 1 -- 172.21.15.167:0/1847609098 reap_dead start 2023-11-28T20:38:45.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7fb712ffd640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb700003770 0x7fb700003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:45.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7f1b724fd640 1 -- start start 2023-11-28T20:38:45.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7fcc5296e640 1 --2- 172.21.15.167:0/3714847444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c070db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009d90 tx=0x7fcc4401f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8f47dd373135aba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7f1b724fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b6c0c5b50 0x7f1b6c1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7f1b724fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c153d50 0x7f1b6c146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7f1b724fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b6c159f60 0x7f1b6c144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7f1b724fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c143b20 con 0x7f1b6c153d50 2023-11-28T20:38:45.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7f1b724fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c157860 con 0x7f1b6c0c5b50 2023-11-28T20:38:45.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7f1b724fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c158b70 con 0x7f1b6c159f60 2023-11-28T20:38:45.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7fcc5116b640 1 -- 172.21.15.167:0/3714847444 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440af600 con 0x7fcc4c159f60 2023-11-28T20:38:45.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7fcc5116b640 1 -- 172.21.15.167:0/3714847444 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc440ab050 con 0x7fcc4c159f60 2023-11-28T20:38:45.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7fcc5116b640 1 -- 172.21.15.167:0/3714847444 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440af980 con 0x7fcc4c159f60 2023-11-28T20:38:45.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c153d50 0x7f1b6c146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b6c0c5b50 0x7f1b6c1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c153d50 0x7f1b6c146420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46834/0 (socket says 172.21.15.167:46834) 2023-11-28T20:38:45.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6b7fe640 1 -- 172.21.15.167:0/3532355473 learned_addr learned my addr 172.21.15.167:0/3532355473 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b70a9a640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b6c159f60 0x7f1b6c144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fcc543d1640 1 -- 172.21.15.167:0/3714847444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 msgr2=0x7fcc4c070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fcc543d1640 1 --2- 172.21.15.167:0/3714847444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c070db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009d90 tx=0x7fcc4401f130 comp rx=0 tx=0).stop 2023-11-28T20:38:45.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f8f68291640 1 Processor -- start 2023-11-28T20:38:45.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7f49d8e91640 1 Processor -- start 2023-11-28T20:38:45.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.924+0000 7f49d8e91640 1 -- start start 2023-11-28T20:38:45.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d8e91640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f49d41582b0 0x7f49d40c7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6b7fe640 1 -- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b6c159f60 msgr2=0x7f1b6c144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6b7fe640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b6c159f60 0x7f1b6c144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6b7fe640 1 -- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b6c0c5b50 msgr2=0x7f1b6c1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6b7fe640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b6c0c5b50 0x7f1b6c1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6b7fe640 1 -- 172.21.15.167:0/3532355473 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64009b30 con 0x7f1b6c153d50 2023-11-28T20:38:45.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fb7137fe640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb700004fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00a860 tx=0x7fb70c01d2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=903b57620ee0c7d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6bfff640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b6c0c5b50 0x7f1b6c1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:45.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f8f68291640 1 -- start start 2023-11-28T20:38:45.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d8e91640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d4161740 con 0x7f49d40c5e90 2023-11-28T20:38:45.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d8e91640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d415e3e0 con 0x7f49d4161c20 2023-11-28T20:38:45.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d8e91640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d415e6c0 con 0x7f49d41582b0 2023-11-28T20:38:45.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d2d9d640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f49d4161c20 0x7f49d4168a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46858/0 (socket says 172.21.15.167:46858) 2023-11-28T20:38:45.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d2d9d640 1 -- 172.21.15.167:0/2340476749 learned_addr learned my addr 172.21.15.167:0/2340476749 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:45.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d259c640 1 --2- 172.21.15.167:0/2340476749 >> v2:172.21.15.178:3300/0 conn(0x7f49d41582b0 0x7f49d40c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b6b7fe640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c153d50 0x7f1b6c146420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00b480 tx=0x7f1b5c00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0072d0 con 0x7fb700004bc0 2023-11-28T20:38:45.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c0a8070 con 0x7fb700004bc0 2023-11-28T20:38:45.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fb7127fc640 1 -- 172.21.15.167:0/1847609098 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0072d0 con 0x7fb700004bc0 2023-11-28T20:38:45.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fcc543d1640 1 -- 172.21.15.167:0/3714847444 shutdown_connections 2023-11-28T20:38:45.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fcc543d1640 1 --2- 172.21.15.167:0/3714847444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c070db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fcc543d1640 1 --2- 172.21.15.167:0/3714847444 >> v2:172.21.15.178:3300/0 conn(0x7fcc4c0c5b50 0x7fcc4c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fcc543d1640 1 -- 172.21.15.167:0/3714847444 >> 172.21.15.167:0/3714847444 conn(0x7fcc4c0c7c50 msgr2=0x7fcc4c0c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fcc543d1640 1 -- 172.21.15.167:0/3714847444 shutdown_connections 2023-11-28T20:38:45.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d259c640 1 -- 172.21.15.167:0/2340476749 >> v1:172.21.15.178:6789/0 conn(0x7f49d4161c20 legacy=0x7f49d4168a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d259c640 1 -- 172.21.15.167:0/2340476749 >> v1:172.21.15.167:6789/0 conn(0x7f49d40c5e90 legacy=0x7f49d406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f49d259c640 1 -- 172.21.15.167:0/2340476749 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d415e9a0 con 0x7f49d41582b0 2023-11-28T20:38:45.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b68ff9640 1 -- 172.21.15.167:0/3532355473 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c010870 con 0x7f1b6c153d50 2023-11-28T20:38:45.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 msgr2=0x7fb700004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fb71a1f5640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb700004fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00a860 tx=0x7fb70c01d2c0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b724fd640 1 -- 172.21.15.167:0/3532355473 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c1583b0 con 0x7f1b6c153d50 2023-11-28T20:38:45.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1847609098 shutdown_connections 2023-11-28T20:38:45.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fb71a1f5640 1 --2- 172.21.15.167:0/1847609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb700004fc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1847609098 >> 172.21.15.167:0/1847609098 conn(0x7fb7140c7c50 msgr2=0x7fb7140c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1847609098 shutdown_connections 2023-11-28T20:38:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f8f68291640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6014ffd0 0x7f8f60156730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f8f68291640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f600c6330 0x7f8f6006a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f8f68291640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8f6006ae80 0x7f8f60070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f8f68291640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6015a010 con 0x7f8f6006ae80 2023-11-28T20:38:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f8f68291640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f60159420 con 0x7f8f600c6330 2023-11-28T20:38:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f8f68291640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f601596e0 con 0x7f8f6014ffd0 2023-11-28T20:38:45.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b68ff9640 1 -- 172.21.15.167:0/3532355473 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c0109d0 con 0x7f1b6c153d50 2023-11-28T20:38:45.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b68ff9640 1 -- 172.21.15.167:0/3532355473 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c010da0 con 0x7f1b6c153d50 2023-11-28T20:38:45.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7f1b724fd640 1 -- 172.21.15.167:0/3532355473 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c158670 con 0x7f1b6c153d50 2023-11-28T20:38:45.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1847609098 wait complete. 2023-11-28T20:38:45.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f8f6582c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f600c6330 0x7f8f6006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f8f6582c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f600c6330 0x7f8f6006a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55334/0 (socket says 172.21.15.167:55334) 2023-11-28T20:38:45.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f8f6582c640 1 -- 172.21.15.167:0/1793647443 learned_addr learned my addr 172.21.15.167:0/1793647443 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.928+0000 7fcc543d1640 1 -- 172.21.15.167:0/3714847444 wait complete. 2023-11-28T20:38:45.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fcc543d1640 1 Processor -- start 2023-11-28T20:38:45.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f8f6602d640 1 --2- 172.21.15.167:0/1793647443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6014ffd0 0x7f8f60156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fcc543d1640 1 -- start start 2023-11-28T20:38:45.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f8f6582c640 1 -- 172.21.15.167:0/1793647443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6014ffd0 msgr2=0x7f8f60156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f1b527fc640 1 -- 172.21.15.167:0/3532355473 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c158890 con 0x7f1b6c153d50 2023-11-28T20:38:45.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f8f6582c640 1 --2- 172.21.15.167:0/1793647443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6014ffd0 0x7f8f60156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f8f6582c640 1 -- 172.21.15.167:0/1793647443 >> v2:172.21.15.167:3300/0 conn(0x7f8f6006ae80 msgr2=0x7f8f60070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f8f6582c640 1 --2- 172.21.15.167:0/1793647443 >> v2:172.21.15.167:3300/0 conn(0x7f8f6006ae80 0x7f8f60070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f8f6582c640 1 -- 172.21.15.167:0/1793647443 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f601599c0 con 0x7f8f600c6330 2023-11-28T20:38:45.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fccb359e640 1 Processor -- start 2023-11-28T20:38:45.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fccb359e640 1 -- start start 2023-11-28T20:38:45.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fccb359e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb406ebb0 0x7fccb40c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fccb359e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb40c8030 con 0x7fccb40c22c0 2023-11-28T20:38:45.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fccb359e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb4150270 con 0x7fccb414fe90 2023-11-28T20:38:45.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fccb359e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb40c6f00 con 0x7fccb406ebb0 2023-11-28T20:38:45.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fccabfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb406ebb0 0x7fccb40c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fcc543d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c0c5b50 0x7fcc4c145980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fccabfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb406ebb0 0x7fccb40c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33694/0 (socket says 172.21.15.167:33694) 2023-11-28T20:38:45.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fccabfff640 1 -- 172.21.15.167:0/3116687334 learned_addr learned my addr 172.21.15.167:0/3116687334 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fcc543d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc4c153d50 0x7fcc4c146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7f49d259c640 1 --2- 172.21.15.167:0/2340476749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 0x7f49d40c7600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0097c0 tx=0x7f49bc01ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3514b4a5706da216 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fb71a1f5640 1 Processor -- start 2023-11-28T20:38:45.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.932+0000 7fb71a1f5640 1 -- start start 2023-11-28T20:38:45.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc543d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c1f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5216d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c0c5b50 0x7fcc4c145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5216d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c0c5b50 0x7fcc4c145980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55344/0 (socket says 172.21.15.167:55344) 2023-11-28T20:38:45.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fccabfff640 1 -- 172.21.15.167:0/3116687334 >> v1:172.21.15.178:6789/0 conn(0x7fccb414fe90 legacy=0x7fccb406e4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T20:38:45.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fccabfff640 1 -- 172.21.15.167:0/3116687334 >> v1:172.21.15.167:6789/0 conn(0x7fccb40c22c0 legacy=0x7fccb4160450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fccabfff640 1 -- 172.21.15.167:0/3116687334 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4070c00 con 0x7fccb406ebb0 2023-11-28T20:38:45.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d159a640 1 -- 172.21.15.167:0/2340476749 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0a8930 con 0x7f49d41582b0 2023-11-28T20:38:45.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc543d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c156090 con 0x7fcc4c153d50 2023-11-28T20:38:45.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc543d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c1460d0 con 0x7fcc4c0c5b50 2023-11-28T20:38:45.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc543d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c144800 con 0x7fcc4c159f60 2023-11-28T20:38:45.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d159a640 1 -- 172.21.15.167:0/2340476749 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc0a8a90 con 0x7f49d41582b0 2023-11-28T20:38:45.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d159a640 1 -- 172.21.15.167:0/2340476749 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0a8e20 con 0x7f49d41582b0 2023-11-28T20:38:45.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb71a1f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb71414aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb71a1f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb714155090 0x7fb7141eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb71a1f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7141449b0 0x7fb714144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb71a1f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7141eee00 con 0x7fb714155090 2023-11-28T20:38:45.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb71a1f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb714145370 con 0x7fb7141449b0 2023-11-28T20:38:45.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb71a1f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7141ee4a0 con 0x7fb700004bc0 2023-11-28T20:38:45.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5216d640 1 -- 172.21.15.167:0/35367029 learned_addr learned my addr 172.21.15.167:0/35367029 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5296e640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c1f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb7137fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb71414aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb7137fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb71414aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33714/0 (socket says 172.21.15.167:33714) 2023-11-28T20:38:45.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb7137fe640 1 -- 172.21.15.167:0/1064137138 learned_addr learned my addr 172.21.15.167:0/1064137138 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb713fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7141449b0 0x7fb714144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5296e640 1 -- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c0c5b50 msgr2=0x7fcc4c145980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5296e640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c0c5b50 0x7fcc4c145980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5296e640 1 -- 172.21.15.167:0/35367029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc4c153d50 msgr2=0x7fcc4c146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5296e640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc4c153d50 0x7fcc4c146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5296e640 1 -- 172.21.15.167:0/35367029 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc44009a70 con 0x7fcc4c159f60 2023-11-28T20:38:45.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d8e91640 1 -- 172.21.15.167:0/2340476749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 msgr2=0x7f49d40c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d8e91640 1 --2- 172.21.15.167:0/2340476749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 0x7f49d40c7600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0097c0 tx=0x7f49bc01ec30 comp rx=0 tx=0).stop 2023-11-28T20:38:45.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f1b68ff9640 1 -- 172.21.15.167:0/3532355473 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b5c00f3c0 con 0x7f1b6c153d50 2023-11-28T20:38:45.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5216d640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c0c5b50 0x7fcc4c145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:45.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f5daa0d6640 1 Processor -- start 2023-11-28T20:38:45.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc5296e640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c1f28a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c15a530 tx=0x7fcc4401bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d8e91640 1 -- 172.21.15.167:0/2340476749 shutdown_connections 2023-11-28T20:38:45.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d8e91640 1 --2- 172.21.15.167:0/2340476749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 0x7f49d40c7600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d8e91640 1 -- 172.21.15.167:0/2340476749 >> 172.21.15.167:0/2340476749 conn(0x7f49d40cb1e0 msgr2=0x7f49d40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f5daa0d6640 1 -- start start 2023-11-28T20:38:45.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f8f6582c640 1 --2- 172.21.15.167:0/1793647443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f600c6330 0x7f8f6006a940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f6006ba20 tx=0x7f8f5801f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbc8b2819b5f3f74 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d8e91640 1 -- 172.21.15.167:0/2340476749 shutdown_connections 2023-11-28T20:38:45.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f49d8e91640 1 -- 172.21.15.167:0/2340476749 wait complete. 2023-11-28T20:38:45.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc42ffd640 1 -- 172.21.15.167:0/35367029 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440ba420 con 0x7fcc4c159f60 2023-11-28T20:38:45.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc42ffd640 1 -- 172.21.15.167:0/35367029 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc440ba580 con 0x7fcc4c159f60 2023-11-28T20:38:45.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f8f6502b640 1 -- 172.21.15.167:0/1793647443 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580af400 con 0x7f8f600c6330 2023-11-28T20:38:45.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fcc42ffd640 1 -- 172.21.15.167:0/35367029 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440ba8f0 con 0x7fcc4c159f60 2023-11-28T20:38:45.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb712ffd640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb714155090 0x7fb7141eaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb7137fe640 1 -- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7141449b0 msgr2=0x7fb714144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb7137fe640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7141449b0 0x7fb714144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb7137fe640 1 -- 172.21.15.167:0/1064137138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb714155090 msgr2=0x7fb7141eaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb7137fe640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb714155090 0x7fb7141eaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb7137fe640 1 -- 172.21.15.167:0/1064137138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714149ea0 con 0x7fb700004bc0 2023-11-28T20:38:45.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f8f6502b640 1 -- 172.21.15.167:0/1793647443 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f580ab050 con 0x7f8f600c6330 2023-11-28T20:38:45.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb713fff640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7141449b0 0x7fb714144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:45.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7f8f6502b640 1 -- 172.21.15.167:0/1793647443 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580af780 con 0x7f8f600c6330 2023-11-28T20:38:45.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.936+0000 7fb7137fe640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb71414aed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb70c01d0f0 tx=0x7fb700005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fb712ffd640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb714155090 0x7fb7141eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:45.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c144aa0 con 0x7fcc4c159f60 2023-11-28T20:38:45.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fb70bfff640 1 -- 172.21.15.167:0/1064137138 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0019c0 con 0x7fb700004bc0 2023-11-28T20:38:45.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5daa0d6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5da406e030 0x7f5da41500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5daa0d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da4070480 0x7f5da41505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c155db0 con 0x7fcc4c159f60 2023-11-28T20:38:45.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5daa0d6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da41571d0 con 0x7f5da406e410 2023-11-28T20:38:45.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5daa0d6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da4071a90 con 0x7f5da406e030 2023-11-28T20:38:45.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5daa0d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40c70d0 con 0x7f5da4070480 2023-11-28T20:38:45.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f8f68291640 1 -- 172.21.15.167:0/1793647443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f600c6330 msgr2=0x7f8f6006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f8f68291640 1 --2- 172.21.15.167:0/1793647443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f600c6330 0x7f8f6006a940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f6006ba20 tx=0x7f8f5801f1e0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fb70bfff640 1 -- 172.21.15.167:0/1064137138 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c004b70 con 0x7fb700004bc0 2023-11-28T20:38:45.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fb70bfff640 1 -- 172.21.15.167:0/1064137138 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0070d0 con 0x7fb700004bc0 2023-11-28T20:38:45.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71414a180 con 0x7fb700004bc0 2023-11-28T20:38:45.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f1b68ff9640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b58066470 0x7f1b58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f1b68ff9640 1 -- 172.21.15.167:0/3532355473 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b5c084100 con 0x7f1b6c153d50 2023-11-28T20:38:45.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f1b6bfff640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b58066470 0x7f1b58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5d9affd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da4070480 0x7f5da41505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5d9affd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da4070480 0x7f5da41505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33728/0 (socket says 172.21.15.167:33728) 2023-11-28T20:38:45.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5d9affd640 1 -- 172.21.15.167:0/3716341719 learned_addr learned my addr 172.21.15.167:0/3716341719 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7141eea20 con 0x7fb700004bc0 2023-11-28T20:38:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5da37fe640 1 --2- 172.21.15.167:0/3716341719 >> v2:172.21.15.178:3300/0 conn(0x7f5da406e030 0x7f5da41500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f8f68291640 1 -- 172.21.15.167:0/1793647443 shutdown_connections 2023-11-28T20:38:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f8f68291640 1 --2- 172.21.15.167:0/1793647443 >> v2:172.21.15.167:3300/0 conn(0x7f8f6006ae80 0x7f8f60070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f8f68291640 1 --2- 172.21.15.167:0/1793647443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f600c6330 0x7f8f6006a940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f8f68291640 1 --2- 172.21.15.167:0/1793647443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6014ffd0 0x7f8f60156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f8f68291640 1 -- 172.21.15.167:0/1793647443 >> 172.21.15.167:0/1793647443 conn(0x7f8f600cb1e0 msgr2=0x7f8f600cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f8f68291640 1 -- 172.21.15.167:0/1793647443 shutdown_connections 2023-11-28T20:38:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f49d8e91640 1 Processor -- start 2023-11-28T20:38:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5d9affd640 1 -- 172.21.15.167:0/3716341719 >> v2:172.21.15.178:3300/0 conn(0x7f5da406e030 msgr2=0x7f5da41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5d9affd640 1 --2- 172.21.15.167:0/3716341719 >> v2:172.21.15.178:3300/0 conn(0x7f5da406e030 0x7f5da41500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5d9affd640 1 -- 172.21.15.167:0/3716341719 >> v1:172.21.15.167:6789/0 conn(0x7f5da406e410 legacy=0x7f5da4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f5d9affd640 1 -- 172.21.15.167:0/3716341719 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da40c73b0 con 0x7f5da4070480 2023-11-28T20:38:45.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71404e850 con 0x7fb700004bc0 2023-11-28T20:38:45.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7f8f68291640 1 -- 172.21.15.167:0/1793647443 wait complete. 2023-11-28T20:38:45.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f1b6bfff640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b58066470 0x7f1b58068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b60006fd0 tx=0x7f1b60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fccabfff640 1 --2- 172.21.15.167:0/3116687334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb406ebb0 0x7fccb40c6220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0090e0 tx=0x7fcc9c020f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d62e9fa3c52e7d98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.940+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c04e850 con 0x7fcc4c159f60 2023-11-28T20:38:45.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fcc42ffd640 1 -- 172.21.15.167:0/35367029 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc440baa50 con 0x7fcc4c159f60 2023-11-28T20:38:45.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d8e91640 1 -- start start 2023-11-28T20:38:45.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fccb1d9b640 1 -- 172.21.15.167:0/3116687334 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0aac40 con 0x7fccb406ebb0 2023-11-28T20:38:45.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fccb1d9b640 1 -- 172.21.15.167:0/3116687334 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c0aada0 con 0x7fccb406ebb0 2023-11-28T20:38:45.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fccb1d9b640 1 -- 172.21.15.167:0/3116687334 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0b2660 con 0x7fccb406ebb0 2023-11-28T20:38:45.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f8f68291640 1 Processor -- start 2023-11-28T20:38:45.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fcc42ffd640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc300664c0 0x7fcc30068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fcc42ffd640 1 -- 172.21.15.167:0/35367029 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc44122be0 con 0x7fcc4c159f60 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d8e91640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49d40c5e90 0x7f49d40c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d8e91640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 0x7f49d415f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d8e91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d4161c20 0x7f49d4160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d8e91640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d41f3b10 con 0x7f49d4161c20 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d8e91640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c9820 con 0x7f49d41582b0 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d8e91640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40c9b00 con 0x7f49d40c5e90 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d1d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 0x7f49d415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d2d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d4161c20 0x7f49d4160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d259c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49d40c5e90 0x7f49d40c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d1d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 0x7f49d415f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55378/0 (socket says 172.21.15.167:55378) 2023-11-28T20:38:45.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f49d1d9b640 1 -- 172.21.15.167:0/1524635940 learned_addr learned my addr 172.21.15.167:0/1524635940 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fccb359e640 1 -- 172.21.15.167:0/3116687334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb406ebb0 msgr2=0x7fccb40c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fccb359e640 1 --2- 172.21.15.167:0/3116687334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb406ebb0 0x7fccb40c6220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0090e0 tx=0x7fcc9c020f40 comp rx=0 tx=0).stop 2023-11-28T20:38:45.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f8f68291640 1 -- start start 2023-11-28T20:38:45.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f1b68ff9640 1 -- 172.21.15.167:0/3532355473 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b5c051330 con 0x7f1b6c153d50 2023-11-28T20:38:45.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fb70bfff640 1 -- 172.21.15.167:0/1064137138 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb70c0aa030 con 0x7fb700004bc0 2023-11-28T20:38:45.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fcc5216d640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc300664c0 0x7fcc30068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f8f68291640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6006ae80 0x7f8f601eb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f8f68291640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f600c6330 0x7f8f600ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f8f68291640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6014ffd0 0x7f8f601ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f8f68291640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60154240 con 0x7f8f600c6330 2023-11-28T20:38:45.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f8f68291640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60154520 con 0x7f8f6006ae80 2023-11-28T20:38:45.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7f8f68291640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f601549b0 con 0x7f8f6014ffd0 2023-11-28T20:38:45.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fccb359e640 1 -- 172.21.15.167:0/3116687334 shutdown_connections 2023-11-28T20:38:45.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fccb359e640 1 --2- 172.21.15.167:0/3116687334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb406ebb0 0x7fccb40c6220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.944+0000 7fccb359e640 1 -- 172.21.15.167:0/3116687334 >> 172.21.15.167:0/3116687334 conn(0x7fccb40cb820 msgr2=0x7fccb40cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:45.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6602d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6006ae80 0x7f8f601eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6582c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f600c6330 0x7f8f600ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6602d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6006ae80 0x7f8f601eb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55384/0 (socket says 172.21.15.167:55384) 2023-11-28T20:38:45.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6602d640 1 -- 172.21.15.167:0/3780975570 learned_addr learned my addr 172.21.15.167:0/3780975570 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f49d259c640 1 -- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 msgr2=0x7f49d415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f49d259c640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 0x7f49d415f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f49d259c640 1 -- 172.21.15.167:0/1524635940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d4161c20 msgr2=0x7f49d4160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f49d259c640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d4161c20 0x7f49d4160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f49d259c640 1 -- 172.21.15.167:0/1524635940 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc009420 con 0x7f49d40c5e90 2023-11-28T20:38:45.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fccb359e640 1 -- 172.21.15.167:0/3116687334 shutdown_connections 2023-11-28T20:38:45.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fccb359e640 1 -- 172.21.15.167:0/3116687334 wait complete. 2023-11-28T20:38:45.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f49d259c640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49d40c5e90 0x7f49d40c8fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0af000 tx=0x7f49bc01b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6602d640 1 -- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6014ffd0 msgr2=0x7f8f601ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6602d640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6014ffd0 0x7f8f601ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6602d640 1 -- 172.21.15.167:0/3780975570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f600c6330 msgr2=0x7f8f600ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6602d640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f600c6330 0x7f8f600ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6602d640 1 -- 172.21.15.167:0/3780975570 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58009b30 con 0x7f8f6006ae80 2023-11-28T20:38:45.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fb70bfff640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6f4066470 0x7fb6f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fb70bfff640 1 -- 172.21.15.167:0/1064137138 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb70c11df80 con 0x7fb700004bc0 2023-11-28T20:38:45.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f6602d640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6006ae80 0x7f8f601eb790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000e910 tx=0x7f8f5000edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fb712ffd640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6f4066470 0x7fb6f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f5d9affd640 1 --2- 172.21.15.167:0/3716341719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da4070480 0x7f5da41505f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009870 tx=0x7f5d8c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e90ab335d6e3efc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fcc5216d640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc300664c0 0x7fcc30068980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc48007fd0 tx=0x7fcc48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f56ffd640 1 -- 172.21.15.167:0/3780975570 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5000cb40 con 0x7f8f6006ae80 2023-11-28T20:38:45.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f56ffd640 1 -- 172.21.15.167:0/3780975570 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5000cca0 con 0x7f8f6006ae80 2023-11-28T20:38:45.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f56ffd640 1 -- 172.21.15.167:0/3780975570 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f500115f0 con 0x7f8f6006ae80 2023-11-28T20:38:45.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fccb359e640 1 Processor -- start 2023-11-28T20:38:45.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fccb359e640 1 -- start start 2023-11-28T20:38:45.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fb712ffd640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6f4066470 0x7fb6f4068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb704006fd0 tx=0x7fb704008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f601ebcd0 con 0x7f8f6006ae80 2023-11-28T20:38:45.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f60154e30 con 0x7f8f6006ae80 2023-11-28T20:38:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.948+0000 7fccb359e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccb406ebb0 0x7fccb4141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb40c22c0 0x7fccb414baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccabfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb40c22c0 0x7fccb414baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb259c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccb406ebb0 0x7fccb4141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccabfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb40c22c0 0x7fccb414baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46876/0 (socket says 172.21.15.167:46876) 2023-11-28T20:38:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb259c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccb406ebb0 0x7fccb4141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55394/0 (socket says 172.21.15.167:55394) 2023-11-28T20:38:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb359e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb414fe90 0x7fccb41efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:45.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccabfff640 1 -- 172.21.15.167:0/1882463969 learned_addr learned my addr 172.21.15.167:0/1882463969 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:45.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb414b680 con 0x7fccb40c22c0 2023-11-28T20:38:45.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb414a3f0 con 0x7fccb406ebb0 2023-11-28T20:38:45.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb40c1f90 con 0x7fccb414fe90 2023-11-28T20:38:45.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f600682c0 con 0x7f8f6006ae80 2023-11-28T20:38:45.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb2d9d640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb414fe90 0x7fccb41efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:45.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccabfff640 1 -- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb414fe90 msgr2=0x7fccb41efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccabfff640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb414fe90 0x7fccb41efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccabfff640 1 -- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccb406ebb0 msgr2=0x7fccb4141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:45.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccabfff640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccb406ebb0 0x7fccb4141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:45.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccabfff640 1 -- 172.21.15.167:0/1882463969 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c009d60 con 0x7fccb40c22c0 2023-11-28T20:38:45.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccabfff640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb40c22c0 0x7fccb414baa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0b5040 tx=0x7fcc9c01dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:45.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccaaffd640 1 -- 172.21.15.167:0/1882463969 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0aac40 con 0x7fccb40c22c0 2023-11-28T20:38:46.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7f8f56ffd640 1 -- 172.21.15.167:0/3780975570 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f50011750 con 0x7f8f6006ae80 2023-11-28T20:38:46.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccaaffd640 1 -- 172.21.15.167:0/1882463969 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c0bd460 con 0x7fccb40c22c0 2023-11-28T20:38:46.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccaaffd640 1 -- 172.21.15.167:0/1882463969 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0bd830 con 0x7fccb40c22c0 2023-11-28T20:38:46.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb414a660 con 0x7fccb40c22c0 2023-11-28T20:38:46.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb414ac20 con 0x7fccb40c22c0 2023-11-28T20:38:46.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7f043e7f5640 1 Processor -- start 2023-11-28T20:38:46.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7f043e7f5640 1 -- start start 2023-11-28T20:38:46.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7f8f56ffd640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8f440664a0 0x7f8f44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7f8f56ffd640 1 -- 172.21.15.167:0/3780975570 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f500847a0 con 0x7f8f6006ae80 2023-11-28T20:38:46.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.952+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb414b7c0 con 0x7fccb40c22c0 2023-11-28T20:38:46.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f8f6582c640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8f440664a0 0x7f8f44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f043e7f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f043815e130 0x7f0438161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f043e7f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 0x7f0438162320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f043e7f5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043815e5e0 con 0x7f04381585d0 2023-11-28T20:38:46.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f043e7f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043815f160 con 0x7f043815e130 2023-11-28T20:38:46.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f043e7f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043815e8c0 con 0x7f04380c7720 2023-11-28T20:38:46.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f8f6582c640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8f440664a0 0x7f8f44068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f580b1000 tx=0x7f8f580aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:46.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f0437fff640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f04381585d0 0x7f04380c5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46868/0 (socket says 172.21.15.167:46868) 2023-11-28T20:38:46.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f0437fff640 1 -- 172.21.15.167:0/1419691555 learned_addr learned my addr 172.21.15.167:0/1419691555 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:46.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f04377fe640 1 --2- 172.21.15.167:0/1419691555 >> v2:172.21.15.167:3300/0 conn(0x7f043815e130 0x7f0438161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f043cd92640 1 --2- 172.21.15.167:0/1419691555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 0x7f0438162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f04377fe640 1 -- 172.21.15.167:0/1419691555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 msgr2=0x7f0438162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:46.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f04377fe640 1 --2- 172.21.15.167:0/1419691555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 0x7f0438162320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f04377fe640 1 -- 172.21.15.167:0/1419691555 >> v1:172.21.15.178:6789/0 conn(0x7f04381585d0 legacy=0x7f04380c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7f04377fe640 1 -- 172.21.15.167:0/1419691555 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043815eba0 con 0x7f043815e130 2023-11-28T20:38:46.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7fccaaffd640 1 -- 172.21.15.167:0/1882463969 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc9c0c5360 con 0x7fccb40c22c0 2023-11-28T20:38:46.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7fccaaffd640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc94066470 0x7fcc94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7fccaaffd640 1 -- 172.21.15.167:0/1882463969 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc9c121a20 con 0x7fccb40c22c0 2023-11-28T20:38:46.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.956+0000 7fccb259c640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc94066470 0x7fcc94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.960+0000 7f04377fe640 1 --2- 172.21.15.167:0/1419691555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043815e130 0x7f0438161de0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f042c0097c0 tx=0x7f042c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6243b3f70cab1770 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:46.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.960+0000 7fccb259c640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc94066470 0x7fcc94068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009980 tx=0x7fcca40090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:46.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.960+0000 7fcc42ffd640 1 -- 172.21.15.167:0/35367029 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcc440efd60 con 0x7fcc4c159f60 2023-11-28T20:38:46.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.964+0000 7f0436ffd640 1 -- 172.21.15.167:0/1419691555 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c0ab650 con 0x7f043815e130 2023-11-28T20:38:46.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.964+0000 7f0436ffd640 1 -- 172.21.15.167:0/1419691555 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c0ab7b0 con 0x7f043815e130 2023-11-28T20:38:46.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.964+0000 7f0436ffd640 1 -- 172.21.15.167:0/1419691555 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c0abb40 con 0x7f043815e130 2023-11-28T20:38:46.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f8f56ffd640 1 -- 172.21.15.167:0/3780975570 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f50051930 con 0x7f8f6006ae80 2023-11-28T20:38:46.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7fccaaffd640 1 -- 172.21.15.167:0/1882463969 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fccb414b7c0 con 0x7fccb40c22c0 2023-11-28T20:38:46.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 -- 172.21.15.167:0/1419691555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043815e130 msgr2=0x7f0438161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 --2- 172.21.15.167:0/1419691555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043815e130 0x7f0438161de0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f042c0097c0 tx=0x7f042c01c470 comp rx=0 tx=0).stop 2023-11-28T20:38:46.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 -- 172.21.15.167:0/1419691555 shutdown_connections 2023-11-28T20:38:46.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 --2- 172.21.15.167:0/1419691555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 0x7f0438162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 --2- 172.21.15.167:0/1419691555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f043815e130 0x7f0438161de0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 -- 172.21.15.167:0/1419691555 >> 172.21.15.167:0/1419691555 conn(0x7f04380cb1e0 msgr2=0x7f04380cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 -- 172.21.15.167:0/1419691555 shutdown_connections 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 -- 172.21.15.167:0/1419691555 wait complete. 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 Processor -- start 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 -- start start 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 0x7f04381f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381585d0 0x7f04381f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.968+0000 7f043e7f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f043815e130 0x7f043815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f043e7f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04381f77b0 con 0x7f04381585d0 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f043e7f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04381efe60 con 0x7f043815e130 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f043e7f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04381f0420 con 0x7f04380c7720 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f04377fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381585d0 0x7f04381f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f04377fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381585d0 0x7f04381f08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46894/0 (socket says 172.21.15.167:46894) 2023-11-28T20:38:46.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f04377fe640 1 -- 172.21.15.167:0/3584584486 learned_addr learned my addr 172.21.15.167:0/3584584486 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:46.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f5da2ffd640 1 -- 172.21.15.167:0/3716341719 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0aa5f0 con 0x7f5da4070480 2023-11-28T20:38:46.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f49caffd640 1 -- 172.21.15.167:0/1524635940 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0b9610 con 0x7f49d40c5e90 2023-11-28T20:38:46.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f0437fff640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 0x7f04381f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f49caffd640 1 -- 172.21.15.167:0/1524635940 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc0b9770 con 0x7f49d40c5e90 2023-11-28T20:38:46.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d41f3dd0 con 0x7f49d40c5e90 2023-11-28T20:38:46.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f5da2ffd640 1 -- 172.21.15.167:0/3716341719 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c0aa750 con 0x7f5da4070480 2023-11-28T20:38:46.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f5da2ffd640 1 -- 172.21.15.167:0/3716341719 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0aaae0 con 0x7f5da4070480 2023-11-28T20:38:46.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f04377fe640 1 -- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 msgr2=0x7f04381f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f04377fe640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 0x7f04381f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f04377fe640 1 -- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f043815e130 msgr2=0x7f043815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f04377fe640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f043815e130 0x7f043815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f04377fe640 1 -- 172.21.15.167:0/3584584486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c009420 con 0x7f04381585d0 2023-11-28T20:38:46.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f04377fe640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381585d0 0x7f04381f08b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f042c01ab20 tx=0x7f042c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:46.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f5daa0d6640 1 -- 172.21.15.167:0/3716341719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da4070480 msgr2=0x7f5da41505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f5daa0d6640 1 --2- 172.21.15.167:0/3716341719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da4070480 0x7f5da41505f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009870 tx=0x7f5d8c01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f0434ff9640 1 -- 172.21.15.167:0/3584584486 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c0abdf0 con 0x7f04381585d0 2023-11-28T20:38:46.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f0434ff9640 1 -- 172.21.15.167:0/3584584486 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c0bf450 con 0x7f04381585d0 2023-11-28T20:38:46.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f0434ff9640 1 -- 172.21.15.167:0/3584584486 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c0bf800 con 0x7f04381585d0 2023-11-28T20:38:46.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f49caffd640 1 -- 172.21.15.167:0/1524635940 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0b9610 con 0x7f49d40c5e90 2023-11-28T20:38:46.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7fb70bfff640 1 -- 172.21.15.167:0/1064137138 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb70c0eb0f0 con 0x7fb700004bc0 2023-11-28T20:38:46.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f5daa0d6640 1 -- 172.21.15.167:0/3716341719 shutdown_connections 2023-11-28T20:38:46.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f5daa0d6640 1 --2- 172.21.15.167:0/3716341719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da4070480 0x7f5da41505f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f5daa0d6640 1 --2- 172.21.15.167:0/3716341719 >> v2:172.21.15.178:3300/0 conn(0x7f5da406e030 0x7f5da41500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f5daa0d6640 1 -- 172.21.15.167:0/3716341719 >> 172.21.15.167:0/3716341719 conn(0x7f5da40cb1e0 msgr2=0x7f5da40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7f5daa0d6640 1 -- 172.21.15.167:0/3716341719 shutdown_connections 2023-11-28T20:38:46.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d41f4390 con 0x7f49d40c5e90 2023-11-28T20:38:46.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04381537d0 con 0x7f04381585d0 2023-11-28T20:38:46.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.972+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0438153d90 con 0x7f04381585d0 2023-11-28T20:38:46.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7f49caffd640 1 -- 172.21.15.167:0/1524635940 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f49bc0b7040 con 0x7f49d40c5e90 2023-11-28T20:38:46.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04380682c0 con 0x7f04381585d0 2023-11-28T20:38:46.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7f5daa0d6640 1 -- 172.21.15.167:0/3716341719 wait complete. 2023-11-28T20:38:46.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7f5daa0d6640 1 Processor -- start 2023-11-28T20:38:46.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d40682c0 con 0x7f49d40c5e90 2023-11-28T20:38:46.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7f49caffd640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49b4066490 0x7f49b4068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7f49caffd640 1 -- 172.21.15.167:0/1524635940 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f49bc121df0 con 0x7f49d40c5e90 2023-11-28T20:38:46.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.976+0000 7f0434ff9640 1 -- 172.21.15.167:0/3584584486 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f042c0bf960 con 0x7f04381585d0 2023-11-28T20:38:46.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f0434ff9640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066470 0x7f0424068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f0434ff9640 1 -- 172.21.15.167:0/3584584486 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f042c11e7d0 con 0x7f04381585d0 2023-11-28T20:38:46.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5daa0d6640 1 -- start start 2023-11-28T20:38:46.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5daa0d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5da406e030 0x7f5da41f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5daa0d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da406e410 0x7f5da415a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f49d1d9b640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49b4066490 0x7f49b4068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f0437fff640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066470 0x7f0424068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5daa0d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da4070480 0x7f5da415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5daa0d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da415f1f0 con 0x7f5da406e030 2023-11-28T20:38:46.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5daa0d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4155840 con 0x7f5da4070480 2023-11-28T20:38:46.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5daa0d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4155aa0 con 0x7f5da406e410 2023-11-28T20:38:46.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5da3fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da4070480 0x7f5da415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5da3fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da4070480 0x7f5da415ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55412/0 (socket says 172.21.15.167:55412) 2023-11-28T20:38:46.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5da3fff640 1 -- 172.21.15.167:0/4122553380 learned_addr learned my addr 172.21.15.167:0/4122553380 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:46.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f5d9affd640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da406e410 0x7f5da415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.980+0000 7f0437fff640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066470 0x7f0424068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0430005c10 tx=0x7f0430009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:46.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da37fe640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5da406e030 0x7f5da41f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da3fff640 1 -- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da406e410 msgr2=0x7f5da415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da3fff640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da406e410 0x7f5da415a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da3fff640 1 -- 172.21.15.167:0/4122553380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5da406e030 msgr2=0x7f5da41f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da3fff640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5da406e030 0x7f5da41f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da3fff640 1 -- 172.21.15.167:0/4122553380 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c0094d0 con 0x7f5da4070480 2023-11-28T20:38:46.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da3fff640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da4070480 0x7f5da415ecb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00b9e0 tx=0x7f5d9c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:46.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da0ff9640 1 -- 172.21.15.167:0/4122553380 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00cb20 con 0x7f5da4070480 2023-11-28T20:38:46.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da4155d40 con 0x7f5da4070480 2023-11-28T20:38:46.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da41f7020 con 0x7f5da4070480 2023-11-28T20:38:46.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da0ff9640 1 -- 172.21.15.167:0/4122553380 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00cc80 con 0x7f5da4070480 2023-11-28T20:38:46.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f5da0ff9640 1 -- 172.21.15.167:0/4122553380 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00cb20 con 0x7f5da4070480 2023-11-28T20:38:46.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f0434ff9640 1 -- 172.21.15.167:0/3584584486 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f042c0eb830 con 0x7f04381585d0 2023-11-28T20:38:46.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.988+0000 7f5da0ff9640 1 -- 172.21.15.167:0/4122553380 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d9c01d3b0 con 0x7f5da4070480 2023-11-28T20:38:46.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.988+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d88005260 con 0x7f5da4070480 2023-11-28T20:38:46.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.984+0000 7f49d1d9b640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49b4066490 0x7f49b4068950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f49d4071130 tx=0x7f49cc0090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:46.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.988+0000 7f5da0ff9640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d840664d0 0x7f5d84068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:46.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.988+0000 7f5da0ff9640 1 -- 172.21.15.167:0/4122553380 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d9c083cc0 con 0x7f5da4070480 2023-11-28T20:38:46.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.992+0000 7f49caffd640 1 -- 172.21.15.167:0/1524635940 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49bc0eef00 con 0x7f49d40c5e90 2023-11-28T20:38:46.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.988+0000 7f5da37fe640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d840664d0 0x7f5d84068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:46.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:45.992+0000 7f5da37fe640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d840664d0 0x7f5d84068990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400b930 tx=0x7f5d94008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:46.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.000+0000 7f5da0ff9640 1 -- 172.21.15.167:0/4122553380 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5d9c08a080 con 0x7f5da4070480 2023-11-28T20:38:46.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.268+0000 7f1b527fc640 1 -- 172.21.15.167:0/3532355473 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b6c04e850 con 0x7f1b6c153d50 2023-11-28T20:38:46.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.268+0000 7f1b68ff9640 1 -- 172.21.15.167:0/3532355473 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b5c054950 con 0x7f1b6c153d50 2023-11-28T20:38:46.274 INFO:teuthology.orchestra.run.smithi167.stdout:64424509450 2023-11-28T20:38:46.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 -- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b58066470 msgr2=0x7f1b58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b58066470 0x7f1b58068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b60006fd0 tx=0x7f1b60008040 comp rx=0 tx=0).stop 2023-11-28T20:38:46.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 -- 172.21.15.167:0/3532355473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c153d50 msgr2=0x7f1b6c146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c153d50 0x7f1b6c146420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00b480 tx=0x7f1b5c00b940 comp rx=0 tx=0).stop 2023-11-28T20:38:46.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 -- 172.21.15.167:0/3532355473 shutdown_connections 2023-11-28T20:38:46.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b58066470 0x7f1b58068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b6c159f60 0x7f1b6c144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b6c153d50 0x7f1b6c146420 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00b480 tx=0x7f1b5c00b940 comp rx=0 tx=0).stop 2023-11-28T20:38:46.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 --2- 172.21.15.167:0/3532355473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b6c0c5b50 0x7f1b6c1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 -- 172.21.15.167:0/3532355473 >> 172.21.15.167:0/3532355473 conn(0x7f1b6c0c7c50 msgr2=0x7f1b6c142e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 -- 172.21.15.167:0/3532355473 shutdown_connections 2023-11-28T20:38:46.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.272+0000 7f1b527fc640 1 -- 172.21.15.167:0/3532355473 wait complete. 2023-11-28T20:38:46.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.280+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcc4c06eaf0 con 0x7fcc4c159f60 2023-11-28T20:38:46.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.284+0000 7fcc42ffd640 1 -- 172.21.15.167:0/35367029 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc440b4020 con 0x7fcc4c159f60 2023-11-28T20:38:46.287 INFO:teuthology.orchestra.run.smithi167.stdout:60129542153 2023-11-28T20:38:46.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.284+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8f60075c90 con 0x7f8f6006ae80 2023-11-28T20:38:46.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.284+0000 7f8f56ffd640 1 -- 172.21.15.167:0/3780975570 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f50021020 con 0x7f8f6006ae80 2023-11-28T20:38:46.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.284+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc300664c0 msgr2=0x7fcc30068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.284+0000 7fcc543d1640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc300664c0 0x7fcc30068980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc48007fd0 tx=0x7fcc48009040 comp rx=0 tx=0).stop 2023-11-28T20:38:46.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.284+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 msgr2=0x7fcc4c1f28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.284+0000 7fcc543d1640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c1f28a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c15a530 tx=0x7fcc4401bed0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.291 INFO:teuthology.orchestra.run.smithi167.stdout:64424509450 2023-11-28T20:38:46.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 shutdown_connections 2023-11-28T20:38:46.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7fcc543d1640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc300664c0 0x7fcc30068980 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7fcc543d1640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c159f60 0x7fcc4c1f28a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7fcc543d1640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc4c153d50 0x7fcc4c146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7fcc543d1640 1 --2- 172.21.15.167:0/35367029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c0c5b50 0x7fcc4c145980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 >> 172.21.15.167:0/35367029 conn(0x7fcc4c0c7c50 msgr2=0x7fcc4c158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 shutdown_connections 2023-11-28T20:38:46.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7fcc543d1640 1 -- 172.21.15.167:0/35367029 wait complete. 2023-11-28T20:38:46.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8f440664a0 msgr2=0x7f8f44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7f8f68291640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8f440664a0 0x7f8f44068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f580b1000 tx=0x7f8f580aa000 comp rx=0 tx=0).stop 2023-11-28T20:38:46.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6006ae80 msgr2=0x7f8f601eb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.288+0000 7f8f68291640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6006ae80 0x7f8f601eb790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000e910 tx=0x7f8f5000edd0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 shutdown_connections 2023-11-28T20:38:46.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7f8f68291640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8f440664a0 0x7f8f44068960 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7f8f68291640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6014ffd0 0x7f8f601ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7f8f68291640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f600c6330 0x7f8f600ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7f8f68291640 1 --2- 172.21.15.167:0/3780975570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6006ae80 0x7f8f601eb790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 >> 172.21.15.167:0/3780975570 conn(0x7f8f600cb1e0 msgr2=0x7f8f600c2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 shutdown_connections 2023-11-28T20:38:46.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7f8f68291640 1 -- 172.21.15.167:0/3780975570 wait complete. 2023-11-28T20:38:46.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fccb414b7c0 con 0x7fccb40c22c0 2023-11-28T20:38:46.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.292+0000 7fccaaffd640 1 -- 172.21.15.167:0/1882463969 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccb414b7c0 con 0x7fccb40c22c0 2023-11-28T20:38:46.297 INFO:teuthology.orchestra.run.smithi167.stdout:60129542153 2023-11-28T20:38:46.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.296+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc94066470 msgr2=0x7fcc94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.296+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb71406dbf0 con 0x7fb700004bc0 2023-11-28T20:38:46.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.296+0000 7fccb359e640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc94066470 0x7fcc94068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009980 tx=0x7fcca40090e0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.296+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb40c22c0 msgr2=0x7fccb414baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.296+0000 7fccb359e640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb40c22c0 0x7fccb414baa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0b5040 tx=0x7fcc9c01dce0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 shutdown_connections 2023-11-28T20:38:46.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7fccb359e640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc94066470 0x7fcc94068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7fb70bfff640 1 -- 172.21.15.167:0/1064137138 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb70c0ee710 con 0x7fb700004bc0 2023-11-28T20:38:46.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7fccb359e640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccb414fe90 0x7fccb41efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7fccb359e640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb40c22c0 0x7fccb414baa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7fccb359e640 1 --2- 172.21.15.167:0/1882463969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccb406ebb0 0x7fccb4141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 >> 172.21.15.167:0/1882463969 conn(0x7fccb40cb820 msgr2=0x7fccb41456d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 shutdown_connections 2023-11-28T20:38:46.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f04381f05d0 con 0x7f04381585d0 2023-11-28T20:38:46.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7fccb359e640 1 -- 172.21.15.167:0/1882463969 wait complete. 2023-11-28T20:38:46.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.300+0000 7f0434ff9640 1 -- 172.21.15.167:0/3584584486 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f04381f05d0 con 0x7f04381585d0 2023-11-28T20:38:46.305 INFO:teuthology.orchestra.run.smithi167.stdout:60129542154 2023-11-28T20:38:46.305 INFO:teuthology.orchestra.run.smithi167.stdout:60129542153 2023-11-28T20:38:46.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6f4066470 msgr2=0x7fb6f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6f4066470 0x7fb6f4068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb704006fd0 tx=0x7fb704008040 comp rx=0 tx=0).stop 2023-11-28T20:38:46.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 msgr2=0x7fb71414aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb71414aed0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb70c01d0f0 tx=0x7fb700005800 comp rx=0 tx=0).stop 2023-11-28T20:38:46.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 shutdown_connections 2023-11-28T20:38:46.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6f4066470 0x7fb6f4068930 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7141449b0 0x7fb714144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb714155090 0x7fb7141eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 --2- 172.21.15.167:0/1064137138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb700004bc0 0x7fb71414aed0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 >> 172.21.15.167:0/1064137138 conn(0x7fb7140c7c50 msgr2=0x7fb714071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066470 msgr2=0x7f0424068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066470 0x7f0424068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0430005c10 tx=0x7f0430009040 comp rx=0 tx=0).stop 2023-11-28T20:38:46.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381585d0 msgr2=0x7f04381f08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381585d0 0x7f04381f08b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f042c01ab20 tx=0x7f042c019210 comp rx=0 tx=0).stop 2023-11-28T20:38:46.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 shutdown_connections 2023-11-28T20:38:46.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0424066470 0x7f0424068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f043815e130 0x7f043815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04381585d0 0x7f04381f08b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 --2- 172.21.15.167:0/3584584486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04380c7720 0x7f04381f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 >> 172.21.15.167:0/3584584486 conn(0x7f04380cb1e0 msgr2=0x7f043815d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 shutdown_connections 2023-11-28T20:38:46.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 shutdown_connections 2023-11-28T20:38:46.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7fb71a1f5640 1 -- 172.21.15.167:0/1064137138 wait complete. 2023-11-28T20:38:46.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.304+0000 7f043e7f5640 1 -- 172.21.15.167:0/3584584486 wait complete. 2023-11-28T20:38:46.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.2 2023-11-28T20:38:46.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.312+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f49d40682c0 con 0x7f49d40c5e90 2023-11-28T20:38:46.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.312+0000 7f49caffd640 1 -- 172.21.15.167:0/1524635940 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49bc006e20 con 0x7f49d40c5e90 2023-11-28T20:38:46.317 INFO:teuthology.orchestra.run.smithi167.stdout:60129542154 2023-11-28T20:38:46.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49b4066490 msgr2=0x7f49b4068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49b4066490 0x7f49b4068950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f49d4071130 tx=0x7f49cc0090e0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49d40c5e90 msgr2=0x7f49d40c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49d40c5e90 0x7f49d40c8fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0af000 tx=0x7f49bc01b9d0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 shutdown_connections 2023-11-28T20:38:46.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f49b4066490 0x7f49b4068950 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d4161c20 0x7f49d4160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49d41582b0 0x7f49d415f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 --2- 172.21.15.167:0/1524635940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49d40c5e90 0x7f49d40c8fe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 >> 172.21.15.167:0/1524635940 conn(0x7f49d40cb1e0 msgr2=0x7f49d4071440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 shutdown_connections 2023-11-28T20:38:46.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.316+0000 7f49d8e91640 1 -- 172.21.15.167:0/1524635940 wait complete. 2023-11-28T20:38:46.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.4 2023-11-28T20:38:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.328+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5d88005510 con 0x7f5da4070480 2023-11-28T20:38:46.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.328+0000 7f5da0ff9640 1 -- 172.21.15.167:0/4122553380 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d9c019090 con 0x7f5da4070480 2023-11-28T20:38:46.333 INFO:teuthology.orchestra.run.smithi167.stdout:64424509450 2023-11-28T20:38:46.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.1 2023-11-28T20:38:46.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d840664d0 msgr2=0x7f5d84068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d840664d0 0x7f5d84068990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400b930 tx=0x7f5d94008040 comp rx=0 tx=0).stop 2023-11-28T20:38:46.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da4070480 msgr2=0x7f5da415ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:46.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da4070480 0x7f5da415ecb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00b9e0 tx=0x7f5d9c00bea0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 shutdown_connections 2023-11-28T20:38:46.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d840664d0 0x7f5d84068990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da4070480 0x7f5da415ecb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da406e410 0x7f5da415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 --2- 172.21.15.167:0/4122553380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5da406e030 0x7f5da41f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:46.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 >> 172.21.15.167:0/4122553380 conn(0x7f5da40cb1e0 msgr2=0x7f5da40ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:46.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 shutdown_connections 2023-11-28T20:38:46.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:46.332+0000 7f5daa0d6640 1 -- 172.21.15.167:0/4122553380 wait complete. 2023-11-28T20:38:46.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.7 2023-11-28T20:38:46.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.6 2023-11-28T20:38:46.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.0 2023-11-28T20:38:46.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.5 2023-11-28T20:38:46.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2023-11-28T20:38:47.313 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T20:38:47.333 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T20:38:47.339 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T20:38:47.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T20:38:47.349 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T20:38:47.352 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T20:38:47.355 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T20:38:47.361 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T20:38:47.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.528+0000 7fda02a9e640 1 Processor -- start 2023-11-28T20:38:47.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.528+0000 7fda02a9e640 1 -- start start 2023-11-28T20:38:47.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda02a9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd9fc14f880 0x7fd9fc156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda02a9e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd9fc06ec00 0x7fd9fc0c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda02a9e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc14fc60 0x7fd9fc06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda0083a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd9fc14f880 0x7fd9fc156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda0083a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd9fc14f880 0x7fd9fc156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46912/0 (socket says 172.21.15.167:46912) 2023-11-28T20:38:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda0083a640 1 -- 172.21.15.167:0/3062274362 learned_addr learned my addr 172.21.15.167:0/3062274362 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda02a9e640 1 -- 172.21.15.167:0/3062274362 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc0c6b70 con 0x7fd9fc14f880 2023-11-28T20:38:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda02a9e640 1 -- 172.21.15.167:0/3062274362 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc0c73e0 con 0x7fd9fc06ec00 2023-11-28T20:38:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda02a9e640 1 -- 172.21.15.167:0/3062274362 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0c7630 con 0x7fd9fc14fc60 2023-11-28T20:38:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fd9fbfff640 1 --2- 172.21.15.167:0/3062274362 >> v2:172.21.15.178:3300/0 conn(0x7fd9fc06ec00 0x7fd9fc0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fda0103b640 1 --2- 172.21.15.167:0/3062274362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc14fc60 0x7fd9fc06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fd9fbfff640 1 -- 172.21.15.167:0/3062274362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc14fc60 msgr2=0x7fd9fc06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fd9fbfff640 1 --2- 172.21.15.167:0/3062274362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc14fc60 0x7fd9fc06d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.532+0000 7fd9fbfff640 1 -- 172.21.15.167:0/3062274362 >> v2:172.21.15.167:3300/0 conn(0x7fd9fc14f880 msgr2=0x7fd9fc156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.536+0000 7fd9fbfff640 1 --2- 172.21.15.167:0/3062274362 >> v2:172.21.15.167:3300/0 conn(0x7fd9fc14f880 0x7fd9fc156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.536+0000 7fd9fbfff640 1 -- 172.21.15.167:0/3062274362 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc0c7910 con 0x7fd9fc06ec00 2023-11-28T20:38:47.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.536+0000 7fda0103b640 1 --2- 172.21.15.167:0/3062274362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc14fc60 0x7fd9fc06d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:47.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.536+0000 7fda0083a640 1 --2- 172.21.15.167:0/3062274362 >> v2:172.21.15.167:3300/0 conn(0x7fd9fc14f880 0x7fd9fc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:47.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fd9fbfff640 1 --2- 172.21.15.167:0/3062274362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9fc06ec00 0x7fd9fc0c6630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0c7c20 tx=0x7fd9f401eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb653e02da28ebd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fd9fb7fe640 1 -- 172.21.15.167:0/3062274362 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40a7c30 con 0x7fd9fc06ec00 2023-11-28T20:38:47.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fd9fb7fe640 1 -- 172.21.15.167:0/3062274362 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f40a7d90 con 0x7fd9fc06ec00 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fd9fb7fe640 1 -- 172.21.15.167:0/3062274362 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40af660 con 0x7fd9fc06ec00 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fda02a9e640 1 -- 172.21.15.167:0/3062274362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9fc06ec00 msgr2=0x7fd9fc0c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fda02a9e640 1 --2- 172.21.15.167:0/3062274362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9fc06ec00 0x7fd9fc0c6630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0c7c20 tx=0x7fd9f401eda0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fda02a9e640 1 -- 172.21.15.167:0/3062274362 shutdown_connections 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fda02a9e640 1 --2- 172.21.15.167:0/3062274362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc14fc60 0x7fd9fc06d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fda02a9e640 1 --2- 172.21.15.167:0/3062274362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9fc06ec00 0x7fd9fc0c6630 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0c7c20 tx=0x7fd9f401eda0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fda02a9e640 1 --2- 172.21.15.167:0/3062274362 >> v2:172.21.15.167:3300/0 conn(0x7fd9fc14f880 0x7fd9fc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.540+0000 7fda02a9e640 1 -- 172.21.15.167:0/3062274362 >> 172.21.15.167:0/3062274362 conn(0x7fd9fc0c7c50 msgr2=0x7fd9fc0c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.544+0000 7fda02a9e640 1 -- 172.21.15.167:0/3062274362 shutdown_connections 2023-11-28T20:38:47.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.544+0000 7fda02a9e640 1 -- 172.21.15.167:0/3062274362 wait complete. 2023-11-28T20:38:47.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.544+0000 7fda02a9e640 1 Processor -- start 2023-11-28T20:38:47.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.544+0000 7fda02a9e640 1 -- start start 2023-11-28T20:38:47.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda02a9e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9fc14f880 0x7fd9fc0c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda02a9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9fc14fc60 0x7fd9fc1f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda02a9e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc1fa6f0 0x7fd9fc14a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda02a9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1fb6e0 con 0x7fd9fc14fc60 2023-11-28T20:38:47.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda02a9e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1f8120 con 0x7fd9fc14f880 2023-11-28T20:38:47.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda02a9e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0ca840 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0083a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9fc14f880 0x7fd9fc0c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0103b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc1fa6f0 0x7fd9fc14a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0103b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc1fa6f0 0x7fd9fc14a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33790/0 (socket says 172.21.15.167:33790) 2023-11-28T20:38:47.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0103b640 1 -- 172.21.15.167:0/687074858 learned_addr learned my addr 172.21.15.167:0/687074858 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0103b640 1 -- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9fc14f880 msgr2=0x7fd9fc0c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0103b640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9fc14f880 0x7fd9fc0c3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0103b640 1 -- 172.21.15.167:0/687074858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9fc14fc60 msgr2=0x7fd9fc1f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0103b640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9fc14fc60 0x7fd9fc1f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0103b640 1 -- 172.21.15.167:0/687074858 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00094d0 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.548+0000 7fda0103b640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc1fa6f0 0x7fd9fc14a2e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00dba0 tx=0x7fd9ec00b3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.552+0000 7fd9f97fa640 1 -- 172.21.15.167:0/687074858 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec012070 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.552+0000 7fd9f97fa640 1 -- 172.21.15.167:0/687074858 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec00bd80 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.552+0000 7fd9f97fa640 1 -- 172.21.15.167:0/687074858 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec004270 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.552+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec007cd0 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.552+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f4009a70 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.556+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc005260 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.556+0000 7fd9f97fa640 1 -- 172.21.15.167:0/687074858 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd9ec0043d0 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.556+0000 7fd9f97fa640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd9e8066570 0x7fd9e8068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.556+0000 7fd9f97fa640 1 -- 172.21.15.167:0/687074858 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9ec084540 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.556+0000 7fda0083a640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd9e8066570 0x7fd9e8068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.560+0000 7fda0083a640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd9e8066570 0x7fd9e8068a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009c70 tx=0x7fd9f0009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.568+0000 7fd9f97fa640 1 -- 172.21.15.167:0/687074858 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9ec051620 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.612+0000 7faa2e5c4640 1 Processor -- start 2023-11-28T20:38:47.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.612+0000 7f008cfc4640 1 Processor -- start 2023-11-28T20:38:47.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.612+0000 7faa2e5c4640 1 -- start start 2023-11-28T20:38:47.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa2e5c4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faa2806a580 0x7faa2806a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa2e5c4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa28161740 con 0x7faa2815e150 2023-11-28T20:38:47.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa2e5c4640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa28161a20 con 0x7faa28158540 2023-11-28T20:38:47.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa2e5c4640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa280c2b30 con 0x7faa2806a580 2023-11-28T20:38:47.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.612+0000 7f008cfc4640 1 -- start start 2023-11-28T20:38:47.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f008cfc4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0088153f40 0x7f00880cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f008cfc4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00880c4800 0x7f00880c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f008cfc4640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00880c4d00 con 0x7f00880c43e0 2023-11-28T20:38:47.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f008cfc4640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00880b2c30 con 0x7f0088153f40 2023-11-28T20:38:47.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f008cfc4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0088159b90 con 0x7f00880c4800 2023-11-28T20:38:47.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa27fff640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7faa28158540 0x7faa28161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46878/0 (socket says 172.21.15.167:46878) 2023-11-28T20:38:47.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa2cb61640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faa2806a580 0x7faa2806a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa277fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7faa2815e150 0x7faa280c6c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44680/0 (socket says 172.21.15.167:44680) 2023-11-28T20:38:47.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa277fe640 1 -- 172.21.15.167:0/3707668581 learned_addr learned my addr 172.21.15.167:0/3707668581 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:47.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa26ffd640 1 -- 172.21.15.167:0/3707668581 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680090030 0 0) 0x7faa28161a20 con 0x7faa28158540 2023-11-28T20:38:47.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa2cb61640 1 -- 172.21.15.167:0/3707668581 >> v1:172.21.15.178:6789/0 conn(0x7faa28158540 legacy=0x7faa28161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa2cb61640 1 -- 172.21.15.167:0/3707668581 >> v1:172.21.15.167:6789/0 conn(0x7faa2815e150 legacy=0x7faa280c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f0085d9b640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f00880c43e0 0x7f008806b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46882/0 (socket says 172.21.15.167:46882) 2023-11-28T20:38:47.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f0085d9b640 1 -- 172.21.15.167:0/1440913013 learned_addr learned my addr 172.21.15.167:0/1440913013 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:47.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f0086d9d640 1 --2- 172.21.15.167:0/1440913013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00880c4800 0x7f00880c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f008659c640 1 --2- 172.21.15.167:0/1440913013 >> v2:172.21.15.178:3300/0 conn(0x7f0088153f40 0x7f00880cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7faa2cb61640 1 -- 172.21.15.167:0/3707668581 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28070940 con 0x7faa2806a580 2023-11-28T20:38:47.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f0086d9d640 1 -- 172.21.15.167:0/1440913013 >> v2:172.21.15.178:3300/0 conn(0x7f0088153f40 msgr2=0x7f00880cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f0086d9d640 1 --2- 172.21.15.167:0/1440913013 >> v2:172.21.15.178:3300/0 conn(0x7f0088153f40 0x7f00880cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f0086d9d640 1 -- 172.21.15.167:0/1440913013 >> v1:172.21.15.178:6789/0 conn(0x7f00880c43e0 legacy=0x7f008806b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.616+0000 7f0086d9d640 1 -- 172.21.15.167:0/1440913013 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0088159e70 con 0x7f00880c4800 2023-11-28T20:38:47.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.620+0000 7fe1b5491640 1 Processor -- start 2023-11-28T20:38:47.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.620+0000 7fe1b5491640 1 -- start start 2023-11-28T20:38:47.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.620+0000 7f3b76365640 1 Processor -- start 2023-11-28T20:38:47.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.620+0000 7f3b76365640 1 -- start start 2023-11-28T20:38:47.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.620+0000 7f9d1d6e3640 1 Processor -- start 2023-11-28T20:38:47.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f9d1d6e3640 1 -- start start 2023-11-28T20:38:47.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f6f55996640 1 Processor -- start 2023-11-28T20:38:47.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7faa2cb61640 1 --2- 172.21.15.167:0/3707668581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2806a580 0x7faa2806a9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa20009d90 tx=0x7faa2001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a65431232989a0c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b76365640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 0x7f3b7006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7fe1b5491640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1b014ffd0 0x7fe1b0156730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7faa26ffd640 1 -- 172.21.15.167:0/3707668581 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa200a5920 con 0x7faa2806a580 2023-11-28T20:38:47.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f6f55996640 1 -- start start 2023-11-28T20:38:47.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7faa26ffd640 1 -- 172.21.15.167:0/3707668581 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa200a5a80 con 0x7faa2806a580 2023-11-28T20:38:47.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7faa26ffd640 1 -- 172.21.15.167:0/3707668581 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa200a5e10 con 0x7faa2806a580 2023-11-28T20:38:47.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f9d16ffd640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9d1814fef0 0x7f9d1806e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46912/0 (socket says 172.21.15.167:46912) 2023-11-28T20:38:47.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7faa2e5c4640 1 -- 172.21.15.167:0/3707668581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2806a580 msgr2=0x7faa2806a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7faa2e5c4640 1 --2- 172.21.15.167:0/3707668581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2806a580 0x7faa2806a9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa20009d90 tx=0x7faa2001c970 comp rx=0 tx=0).stop 2023-11-28T20:38:47.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7fe1b5491640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b015a010 con 0x7fe1b00cbd00 2023-11-28T20:38:47.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7fe1b5491640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b0159420 con 0x7fe1b00c6330 2023-11-28T20:38:47.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7fe1b5491640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b01596e0 con 0x7fe1b014ffd0 2023-11-28T20:38:47.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f9d16ffd640 1 -- 172.21.15.167:0/400411900 learned_addr learned my addr 172.21.15.167:0/400411900 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:47.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7faa2e5c4640 1 -- 172.21.15.167:0/3707668581 shutdown_connections 2023-11-28T20:38:47.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7faa2e5c4640 1 --2- 172.21.15.167:0/3707668581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2806a580 0x7faa2806a9d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f0086d9d640 1 --2- 172.21.15.167:0/1440913013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00880c4800 0x7f00880c9ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0080009d90 tx=0x7f008001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20634e7aadde036e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f008559a640 1 -- 172.21.15.167:0/1440913013 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800a59e0 con 0x7f00880c4800 2023-11-28T20:38:47.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f008559a640 1 -- 172.21.15.167:0/1440913013 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00800a5b40 con 0x7f00880c4800 2023-11-28T20:38:47.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f008559a640 1 -- 172.21.15.167:0/1440913013 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800a59e0 con 0x7f00880c4800 2023-11-28T20:38:47.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f008cfc4640 1 -- 172.21.15.167:0/1440913013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00880c4800 msgr2=0x7f00880c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f008cfc4640 1 --2- 172.21.15.167:0/1440913013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00880c4800 0x7f00880c9ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0080009d90 tx=0x7f008001c920 comp rx=0 tx=0).stop 2023-11-28T20:38:47.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f008cfc4640 1 -- 172.21.15.167:0/1440913013 shutdown_connections 2023-11-28T20:38:47.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f008cfc4640 1 --2- 172.21.15.167:0/1440913013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00880c4800 0x7f00880c9ec0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f008cfc4640 1 --2- 172.21.15.167:0/1440913013 >> v2:172.21.15.178:3300/0 conn(0x7f0088153f40 0x7f00880cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f008cfc4640 1 -- 172.21.15.167:0/1440913013 >> 172.21.15.167:0/1440913013 conn(0x7f00880668a0 msgr2=0x7f00880cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7faa2e5c4640 1 -- 172.21.15.167:0/3707668581 >> 172.21.15.167:0/3707668581 conn(0x7faa280cb1e0 msgr2=0x7faa280cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7faa2e5c4640 1 -- 172.21.15.167:0/3707668581 shutdown_connections 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b76365640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b70166a40 con 0x7f3b700c7780 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b76365640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7016a150 con 0x7f3b70166f40 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b76365640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7006aea0 con 0x7f3b7006a580 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 0x7f3b7006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b74902640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3b70166f40 0x7f3b701712e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46896/0 (socket says 172.21.15.167:46896) 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b74902640 1 -- 172.21.15.167:0/620235496 learned_addr learned my addr 172.21.15.167:0/620235496 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230360006 0 0) 0x7f3b7016a150 con 0x7f3b70166f40 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b5800bd40 con 0x7f3b70166f40 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613640288 0 0) 0x7f3b70166a40 con 0x7f3b700c7780 2023-11-28T20:38:47.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b7016a150 con 0x7f3b700c7780 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1149441925 0 0) 0x7f3b5800bd40 con 0x7f3b70166f40 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 msgr2=0x7f3b7006a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 0x7f3b7006a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 >> v1:172.21.15.167:6789/0 conn(0x7f3b700c7780 legacy=0x7f3b700c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7016a430 con 0x7f3b70166f40 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f3b60001680 con 0x7f3b70166f40 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6ffff640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 0x7f3b7006a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 >> v1:172.21.15.178:6789/0 conn(0x7f3b70166f40 legacy=0x7f3b701712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f3b6effd640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5800c320 0x7f3b5800c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b6effd640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b5800cfe0 0x7f3b5800d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b6effd640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 0x7f3b5800d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7006aea0 con 0x7f3b5800c320 2023-11-28T20:38:47.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580141a0 con 0x7f3b5800cfe0 2023-11-28T20:38:47.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58014360 con 0x7f3b7006a580 2023-11-28T20:38:47.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f6f55996640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6f501585d0 0x7f6f500c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f6f55996640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6f5015e130 0x7f6f50161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f6f55996640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5015e5e0 con 0x7f6f500c7720 2023-11-28T20:38:47.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f6f55996640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5015f160 con 0x7f6f501585d0 2023-11-28T20:38:47.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f6f55996640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5015e8c0 con 0x7f6f5015e130 2023-11-28T20:38:47.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7fe1aeffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1b014ffd0 0x7fe1b0156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7fe1ae7fc640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe1b00c6330 0x7fe1b006a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46920/0 (socket says 172.21.15.167:46920) 2023-11-28T20:38:47.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7fe1ae7fc640 1 -- 172.21.15.167:0/3065003463 learned_addr learned my addr 172.21.15.167:0/3065003463 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:47.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7fe1adffb640 1 -- 172.21.15.167:0/3065003463 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232111934 0 0) 0x7fe1b0159420 con 0x7fe1b00c6330 2023-11-28T20:38:47.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7fe1adffb640 1 -- 172.21.15.167:0/3065003463 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe198003530 con 0x7fe1b00c6330 2023-11-28T20:38:47.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f9d1d6e3640 1 --2- 172.21.15.167:0/400411900 >> v2:172.21.15.167:3300/0 conn(0x7f9d18070c90 0x7f9d18159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/400411900 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d181502d0 con 0x7f9d18070870 2023-11-28T20:38:47.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/400411900 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d18071390 con 0x7f9d1814fef0 2023-11-28T20:38:47.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.624+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/400411900 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1806e990 con 0x7f9d18070c90 2023-11-28T20:38:47.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b74902640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 0x7f3b5800d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f6f467fc640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6f5015e130 0x7f6f50161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f6f4effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6f501585d0 0x7f6f500c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7fe1aeffd640 1 -- 172.21.15.167:0/3065003463 >> v1:172.21.15.178:6789/0 conn(0x7fe1b00c6330 legacy=0x7fe1b006a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7fe1aeffd640 1 -- 172.21.15.167:0/3065003463 >> v1:172.21.15.167:6789/0 conn(0x7fe1b00cbd00 legacy=0x7fe1b0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7fe1aeffd640 1 -- 172.21.15.167:0/3065003463 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b01599c0 con 0x7fe1b014ffd0 2023-11-28T20:38:47.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d177fe640 1 --2- 172.21.15.167:0/400411900 >> v2:172.21.15.167:3300/0 conn(0x7f9d18070c90 0x7f9d18159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684043049 0 0) 0x7f9d18071390 con 0x7f9d1814fef0 2023-11-28T20:38:47.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d00003530 con 0x7f9d1814fef0 2023-11-28T20:38:47.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679058901 0 0) 0x7f9d181502d0 con 0x7f9d18070870 2023-11-28T20:38:47.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f6f4effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6f501585d0 0x7f6f500c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46942/0 (socket says 172.21.15.167:46942) 2023-11-28T20:38:47.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f6f4effd640 1 -- 172.21.15.167:0/72856818 learned_addr learned my addr 172.21.15.167:0/72856818 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b6ffff640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5800c320 0x7f3b5800c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d18071390 con 0x7f9d18070870 2023-11-28T20:38:47.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b6f7fe640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b5800cfe0 0x7f3b5800d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b74902640 1 -- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b5800cfe0 msgr2=0x7f3b5800d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b74902640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b5800cfe0 0x7f3b5800d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b74902640 1 -- 172.21.15.167:0/620235496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5800c320 msgr2=0x7f3b5800c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1434528212 0 0) 0x7f9d00003530 con 0x7f9d1814fef0 2023-11-28T20:38:47.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 >> v2:172.21.15.167:3300/0 conn(0x7f9d18070c90 msgr2=0x7f9d18159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 --2- 172.21.15.167:0/400411900 >> v2:172.21.15.167:3300/0 conn(0x7f9d18070c90 0x7f9d18159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b74902640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5800c320 0x7f3b5800c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b74902640 1 -- 172.21.15.167:0/620235496 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6800bbd0 con 0x7f3b7006a580 2023-11-28T20:38:47.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f3b6ffff640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5800c320 0x7f3b5800c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:47.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f6f4effd640 1 -- 172.21.15.167:0/72856818 >> v2:172.21.15.178:3300/0 conn(0x7f6f5015e130 msgr2=0x7f6f50161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f6f4effd640 1 --2- 172.21.15.167:0/72856818 >> v2:172.21.15.178:3300/0 conn(0x7f6f5015e130 0x7f6f50161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f6f4effd640 1 -- 172.21.15.167:0/72856818 >> v1:172.21.15.167:6789/0 conn(0x7f6f500c7720 legacy=0x7f6f5006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f6f4effd640 1 -- 172.21.15.167:0/72856818 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5015eba0 con 0x7f6f501585d0 2023-11-28T20:38:47.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f008cfc4640 1 -- 172.21.15.167:0/1440913013 shutdown_connections 2023-11-28T20:38:47.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f008cfc4640 1 -- 172.21.15.167:0/1440913013 wait complete. 2023-11-28T20:38:47.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7faa2e5c4640 1 -- 172.21.15.167:0/3707668581 wait complete. 2023-11-28T20:38:47.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7faa2e5c4640 1 Processor -- start 2023-11-28T20:38:47.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2e5c4640 1 -- start start 2023-11-28T20:38:47.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 >> v1:172.21.15.167:6789/0 conn(0x7f9d18070870 legacy=0x7f9d18159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18071670 con 0x7f9d1814fef0 2023-11-28T20:38:47.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9d08001680 con 0x7f9d1814fef0 2023-11-28T20:38:47.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 >> v1:172.21.15.178:6789/0 conn(0x7f9d1814fef0 legacy=0x7f9d1806e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00003b60 0x7f9d00003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d00007aa0 0x7f9d000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 0x7f9d000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1806e990 con 0x7f9d00007aa0 2023-11-28T20:38:47.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000147f0 con 0x7f9d00004d10 2023-11-28T20:38:47.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000149b0 con 0x7f9d00003b60 2023-11-28T20:38:47.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d177fe640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 0x7f9d000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d16ffd640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00003b60 0x7f9d00003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.628+0000 7f9d167fc640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d00007aa0 0x7f9d000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f3f188d6640 1 Processor -- start 2023-11-28T20:38:47.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f3f188d6640 1 -- start start 2023-11-28T20:38:47.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f9d177fe640 1 -- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00003b60 msgr2=0x7f9d00003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f9d177fe640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00003b60 0x7f9d00003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f9d177fe640 1 -- 172.21.15.167:0/400411900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d00007aa0 msgr2=0x7f9d000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f9d177fe640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d00007aa0 0x7f9d000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f9d177fe640 1 -- 172.21.15.167:0/400411900 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18071670 con 0x7f9d00004d10 2023-11-28T20:38:47.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f9d167fc640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d00007aa0 0x7f9d000047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:47.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f9d16ffd640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00003b60 0x7f9d00003f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:47.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7fe1aeffd640 1 --2- 172.21.15.167:0/3065003463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b014ffd0 0x7fe1b0156730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40097c0 tx=0x7fe1a401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88ca2470fb4ac23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2e5c4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2806a580 0x7faa28157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2e5c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa28158540 0x7faa28158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2e5c4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2815e150 0x7faa28149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2e5c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa28161570 con 0x7faa28158540 2023-11-28T20:38:47.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2e5c4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa281610e0 con 0x7faa2815e150 2023-11-28T20:38:47.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2e5c4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa28160210 con 0x7faa2806a580 2023-11-28T20:38:47.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f008cfc4640 1 Processor -- start 2023-11-28T20:38:47.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7fe1adffb640 1 -- 172.21.15.167:0/3065003463 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40a8930 con 0x7fe1b014ffd0 2023-11-28T20:38:47.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa27fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2806a580 0x7faa28157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2cb61640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2815e150 0x7faa28149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2cb61640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2815e150 0x7faa28149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55500/0 (socket says 172.21.15.167:55500) 2023-11-28T20:38:47.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2cb61640 1 -- 172.21.15.167:0/2292001659 learned_addr learned my addr 172.21.15.167:0/2292001659 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7fe1adffb640 1 -- 172.21.15.167:0/3065003463 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a40a8a90 con 0x7fe1b014ffd0 2023-11-28T20:38:47.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7fe1adffb640 1 -- 172.21.15.167:0/3065003463 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40a8e20 con 0x7fe1b014ffd0 2023-11-28T20:38:47.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa277fe640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa28158540 0x7faa28158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f008cfc4640 1 -- start start 2023-11-28T20:38:47.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f3f1259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3f140cf860 0x7f3f140ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44718/0 (socket says 172.21.15.167:44718) 2023-11-28T20:38:47.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f3f1259c640 1 -- 172.21.15.167:0/2060580918 learned_addr learned my addr 172.21.15.167:0/2060580918 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:47.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7f3f188d6640 1 --2- 172.21.15.167:0/2060580918 >> v2:172.21.15.167:3300/0 conn(0x7f3f140cfc40 0x7f3f140cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2cb61640 1 -- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2806a580 msgr2=0x7faa28157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2cb61640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2806a580 0x7faa28157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.632+0000 7faa2cb61640 1 -- 172.21.15.167:0/2292001659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa28158540 msgr2=0x7faa28158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f188d6640 1 --2- 172.21.15.167:0/2060580918 >> v2:172.21.15.178:3300/0 conn(0x7f3f14153ae0 0x7f3f14153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f6f4effd640 1 --2- 172.21.15.167:0/72856818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f501585d0 0x7f6f500c5e90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f5006eea0 tx=0x7f6f4001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c593af41af7eff9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa2cb61640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa28158540 0x7faa28158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f188d6640 1 -- 172.21.15.167:0/2060580918 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1415ac00 con 0x7f3f140cf860 2023-11-28T20:38:47.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f188d6640 1 -- 172.21.15.167:0/2060580918 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f140cbd60 con 0x7f3f140cfc40 2023-11-28T20:38:47.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa2cb61640 1 -- 172.21.15.167:0/2292001659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20009a70 con 0x7faa2815e150 2023-11-28T20:38:47.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7fe1b5491640 1 -- 172.21.15.167:0/3065003463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b014ffd0 msgr2=0x7fe1b0156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7fe1b5491640 1 --2- 172.21.15.167:0/3065003463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b014ffd0 0x7fe1b0156730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40097c0 tx=0x7fe1a401ec30 comp rx=0 tx=0).stop 2023-11-28T20:38:47.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa277fe640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa28158540 0x7faa28158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:47.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f188d6640 1 -- 172.21.15.167:0/2060580918 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f14159ff0 con 0x7f3f14153ae0 2023-11-28T20:38:47.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3b74902640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 0x7f3b5800d9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000c240 tx=0x7f3b6001cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e348eec605518f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f11d9b640 1 --2- 172.21.15.167:0/2060580918 >> v2:172.21.15.167:3300/0 conn(0x7f3f140cfc40 0x7f3f140cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f12d9d640 1 --2- 172.21.15.167:0/2060580918 >> v2:172.21.15.178:3300/0 conn(0x7f3f14153ae0 0x7f3f14153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7fe1b5491640 1 -- 172.21.15.167:0/3065003463 shutdown_connections 2023-11-28T20:38:47.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7fe1b5491640 1 --2- 172.21.15.167:0/3065003463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b014ffd0 0x7fe1b0156730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7fe1b5491640 1 -- 172.21.15.167:0/3065003463 >> 172.21.15.167:0/3065003463 conn(0x7fe1b00cb1e0 msgr2=0x7fe1b00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa2cb61640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2815e150 0x7faa28149a90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa20019580 tx=0x7faa20019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d177fe640 1 -- 172.21.15.167:0/400411900 reap_dead start 2023-11-28T20:38:47.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60005ae0 con 0x7f3b7006a580 2023-11-28T20:38:47.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b60005c40 con 0x7f3b7006a580 2023-11-28T20:38:47.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3b6effd640 1 -- 172.21.15.167:0/620235496 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b600a58c0 con 0x7f3b7006a580 2023-11-28T20:38:47.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7fe1b5491640 1 -- 172.21.15.167:0/3065003463 shutdown_connections 2023-11-28T20:38:47.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7fe1b5491640 1 -- 172.21.15.167:0/3065003463 wait complete. 2023-11-28T20:38:47.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f1159a640 1 -- 172.21.15.167:0/2060580918 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132717752 0 0) 0x7f3f1415ac00 con 0x7f3f140cf860 2023-11-28T20:38:47.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f1159a640 1 -- 172.21.15.167:0/2060580918 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f00003530 con 0x7f3f140cf860 2023-11-28T20:38:47.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f008cfc4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880c43e0 0x7f0088146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa24ff9640 1 -- 172.21.15.167:0/2292001659 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa200adb80 con 0x7faa2815e150 2023-11-28T20:38:47.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa24ff9640 1 -- 172.21.15.167:0/2292001659 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa200adce0 con 0x7faa2815e150 2023-11-28T20:38:47.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa24ff9640 1 -- 172.21.15.167:0/2292001659 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa200b8660 con 0x7faa2815e150 2023-11-28T20:38:47.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d177fe640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 0x7f9d000051c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000a170 tx=0x7f9d1001d010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef6ca01ecb59edb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f008cfc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00880c4800 0x7f008815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f008cfc4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088153f40 0x7f008815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa280c22d0 con 0x7faa2815e150 2023-11-28T20:38:47.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa281607b0 con 0x7faa2815e150 2023-11-28T20:38:47.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d100a5e10 con 0x7f9d00004d10 2023-11-28T20:38:47.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d10007af0 con 0x7f9d00004d10 2023-11-28T20:38:47.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d15ffb640 1 -- 172.21.15.167:0/400411900 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d10007ea0 con 0x7f9d00004d10 2023-11-28T20:38:47.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3b76365640 1 -- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 msgr2=0x7f3b5800d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3b76365640 1 --2- 172.21.15.167:0/620235496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7006a580 0x7f3b5800d9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000c240 tx=0x7f3b6001cbc0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3b74902640 1 -- 172.21.15.167:0/620235496 reap_dead start 2023-11-28T20:38:47.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f11d9b640 1 -- 172.21.15.167:0/2060580918 >> v2:172.21.15.178:3300/0 conn(0x7f3f14153ae0 msgr2=0x7f3f14153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:47.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f11d9b640 1 --2- 172.21.15.167:0/2060580918 >> v2:172.21.15.178:3300/0 conn(0x7f3f14153ae0 0x7f3f14153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f11d9b640 1 -- 172.21.15.167:0/2060580918 >> v1:172.21.15.167:6789/0 conn(0x7f3f140cf860 legacy=0x7f3f140ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3f11d9b640 1 -- 172.21.15.167:0/2060580918 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1415a2d0 con 0x7f3f140cfc40 2023-11-28T20:38:47.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f0085d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00880c4800 0x7f008815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f008659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880c43e0 0x7f0088146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f0085d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00880c4800 0x7f008815be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47008/0 (socket says 172.21.15.167:47008) 2023-11-28T20:38:47.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f008659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880c43e0 0x7f0088146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55526/0 (socket says 172.21.15.167:55526) 2023-11-28T20:38:47.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 msgr2=0x7f9d000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa280682c0 con 0x7faa2815e150 2023-11-28T20:38:47.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d1d6e3640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 0x7f9d000051c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000a170 tx=0x7f9d1001d010 comp rx=0 tx=0).stop 2023-11-28T20:38:47.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3b76365640 1 -- 172.21.15.167:0/620235496 shutdown_connections 2023-11-28T20:38:47.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f3b76365640 1 -- 172.21.15.167:0/620235496 >> 172.21.15.167:0/620235496 conn(0x7f3b700cb1e0 msgr2=0x7f3b700cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f6f4e7fc640 1 -- 172.21.15.167:0/72856818 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400a5770 con 0x7f6f501585d0 2023-11-28T20:38:47.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f6f4e7fc640 1 -- 172.21.15.167:0/72856818 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f400a58d0 con 0x7f6f501585d0 2023-11-28T20:38:47.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f6f4e7fc640 1 -- 172.21.15.167:0/72856818 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400a5c60 con 0x7f6f501585d0 2023-11-28T20:38:47.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/400411900 shutdown_connections 2023-11-28T20:38:47.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d1d6e3640 1 --2- 172.21.15.167:0/400411900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 0x7f9d000051c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.636+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/400411900 >> 172.21.15.167:0/400411900 conn(0x7f9d180c7c50 msgr2=0x7f9d180c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/400411900 shutdown_connections 2023-11-28T20:38:47.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f3b76365640 1 -- 172.21.15.167:0/620235496 shutdown_connections 2023-11-28T20:38:47.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1b5491640 1 Processor -- start 2023-11-28T20:38:47.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0085d9b640 1 -- 172.21.15.167:0/329947656 learned_addr learned my addr 172.21.15.167:0/329947656 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f008cfc4640 1 -- 172.21.15.167:0/329947656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008815b6e0 con 0x7f00880c4800 2023-11-28T20:38:47.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f008cfc4640 1 -- 172.21.15.167:0/329947656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00880ce370 con 0x7f00880c43e0 2023-11-28T20:38:47.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f008cfc4640 1 -- 172.21.15.167:0/329947656 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00880cf190 con 0x7f0088153f40 2023-11-28T20:38:47.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f6f55996640 1 -- 172.21.15.167:0/72856818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f501585d0 msgr2=0x7f6f500c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f6f55996640 1 --2- 172.21.15.167:0/72856818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f501585d0 0x7f6f500c5e90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6f5006eea0 tx=0x7f6f4001c9a0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0086d9d640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088153f40 0x7f008815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/400411900 wait complete. 2023-11-28T20:38:47.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f3b76365640 1 -- 172.21.15.167:0/620235496 wait complete. 2023-11-28T20:38:47.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1b5491640 1 -- start start 2023-11-28T20:38:47.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0086d9d640 1 -- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880c43e0 msgr2=0x7f0088146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0086d9d640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880c43e0 0x7f0088146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0086d9d640 1 -- 172.21.15.167:0/329947656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00880c4800 msgr2=0x7f008815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0086d9d640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00880c4800 0x7f008815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0086d9d640 1 -- 172.21.15.167:0/329947656 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080009a70 con 0x7f0088153f40 2023-11-28T20:38:47.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0085d9b640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00880c4800 0x7f008815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:47.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f6f55996640 1 -- 172.21.15.167:0/72856818 shutdown_connections 2023-11-28T20:38:47.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f6f55996640 1 --2- 172.21.15.167:0/72856818 >> v2:172.21.15.178:3300/0 conn(0x7f6f5015e130 0x7f6f50161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f6f55996640 1 --2- 172.21.15.167:0/72856818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f501585d0 0x7f6f500c5e90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f6f55996640 1 -- 172.21.15.167:0/72856818 >> 172.21.15.167:0/72856818 conn(0x7f6f500cb1e0 msgr2=0x7f6f500cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0086d9d640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088153f40 0x7f008815c3d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0088159cd0 tx=0x7f00800196c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7faa24ff9640 1 -- 172.21.15.167:0/2292001659 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa200b87c0 con 0x7faa2815e150 2023-11-28T20:38:47.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f6f55996640 1 -- 172.21.15.167:0/72856818 shutdown_connections 2023-11-28T20:38:47.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0076ffd640 1 -- 172.21.15.167:0/329947656 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800be070 con 0x7f0088153f40 2023-11-28T20:38:47.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f9d1d6e3640 1 Processor -- start 2023-11-28T20:38:47.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f6f55996640 1 -- 172.21.15.167:0/72856818 wait complete. 2023-11-28T20:38:47.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1b5491640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1b00c6330 0x7fe1b013b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1b5491640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b00cbd00 0x7fe1b01512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1b5491640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b014ffd0 0x7fe1b01517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1b5491640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0153360 con 0x7fe1b00cbd00 2023-11-28T20:38:47.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1b5491640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b014cb70 con 0x7fe1b00c6330 2023-11-28T20:38:47.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1b5491640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b014ce10 con 0x7fe1b014ffd0 2023-11-28T20:38:47.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7faa24ff9640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa14066470 0x7faa14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1aeffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1b00c6330 0x7fe1b013b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1aeffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1b00c6330 0x7fe1b013b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55536/0 (socket says 172.21.15.167:55536) 2023-11-28T20:38:47.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7fe1aeffd640 1 -- 172.21.15.167:0/3160606472 learned_addr learned my addr 172.21.15.167:0/3160606472 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7faa24ff9640 1 -- 172.21.15.167:0/2292001659 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa2011fb20 con 0x7faa2815e150 2023-11-28T20:38:47.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1af7fe640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b014ffd0 0x7fe1b01517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1ae7fc640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b00cbd00 0x7fe1b01512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f3f11d9b640 1 --2- 172.21.15.167:0/2060580918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 0x7f3f140cb770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f140b2240 tx=0x7f3f0401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f287ad59891209a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f9d1d6e3640 1 -- start start 2023-11-28T20:38:47.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0076ffd640 1 -- 172.21.15.167:0/329947656 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00800a57e0 con 0x7f0088153f40 2023-11-28T20:38:47.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.640+0000 7f0076ffd640 1 -- 172.21.15.167:0/329947656 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080004280 con 0x7f0088153f40 2023-11-28T20:38:47.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d1d6e3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 0x7f9d1814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d1d6e3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d181eaaa0 0x7f9d1813f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d1d6e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d18140040 0x7f9d18149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f6f55996640 1 Processor -- start 2023-11-28T20:38:47.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1ae7fc640 1 -- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b014ffd0 msgr2=0x7fe1b01517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1ae7fc640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b014ffd0 0x7fe1b01517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1ae7fc640 1 -- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1b00c6330 msgr2=0x7fe1b013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1ae7fc640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1b00c6330 0x7fe1b013b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f3f1159a640 1 -- 172.21.15.167:0/2060580918 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f040a59b0 con 0x7f3f140cfc40 2023-11-28T20:38:47.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f3f1159a640 1 -- 172.21.15.167:0/2060580918 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f040a5b10 con 0x7f3f140cfc40 2023-11-28T20:38:47.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f3f1159a640 1 -- 172.21.15.167:0/2060580918 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f040a5ea0 con 0x7f3f140cfc40 2023-11-28T20:38:47.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1ae7fc640 1 -- 172.21.15.167:0/3160606472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009420 con 0x7fe1b00cbd00 2023-11-28T20:38:47.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d1d6e3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1814ca00 con 0x7f9d18140040 2023-11-28T20:38:47.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d1d6e3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d18159f70 con 0x7f9d00004d10 2023-11-28T20:38:47.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d1d6e3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1814e370 con 0x7f9d181eaaa0 2023-11-28T20:38:47.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1aeffd640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1b00c6330 0x7fe1b013b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:47.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d167fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d181eaaa0 0x7f9d1813f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d167fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d181eaaa0 0x7f9d1813f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33886/0 (socket says 172.21.15.167:33886) 2023-11-28T20:38:47.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d167fc640 1 -- 172.21.15.167:0/1905583014 learned_addr learned my addr 172.21.15.167:0/1905583014 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d16ffd640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 0x7f9d1814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d177fe640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d18140040 0x7f9d18149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1ae7fc640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b00cbd00 0x7fe1b01512a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c400 tx=0x7fe1a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1977fe640 1 -- 172.21.15.167:0/3160606472 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0005cf0 con 0x7fe1b00cbd00 2023-11-28T20:38:47.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1977fe640 1 -- 172.21.15.167:0/3160606472 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0005e50 con 0x7fe1b00cbd00 2023-11-28T20:38:47.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1977fe640 1 -- 172.21.15.167:0/3160606472 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00072d0 con 0x7fe1b00cbd00 2023-11-28T20:38:47.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b01507c0 con 0x7fe1b00cbd00 2023-11-28T20:38:47.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f008cfc4640 1 -- 172.21.15.167:0/329947656 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00880ce950 con 0x7f0088153f40 2023-11-28T20:38:47.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f008cfc4640 1 -- 172.21.15.167:0/329947656 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00880cebf0 con 0x7f0088153f40 2023-11-28T20:38:47.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d177fe640 1 -- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d181eaaa0 msgr2=0x7f9d1813f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d177fe640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d181eaaa0 0x7f9d1813f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d177fe640 1 -- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 msgr2=0x7f9d1814de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d177fe640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 0x7f9d1814de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d177fe640 1 -- 172.21.15.167:0/1905583014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d181eaf50 con 0x7f9d18140040 2023-11-28T20:38:47.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f3b76365640 1 Processor -- start 2023-11-28T20:38:47.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b0150d80 con 0x7fe1b00cbd00 2023-11-28T20:38:47.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f6f55996640 1 -- start start 2023-11-28T20:38:47.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7faa27fff640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa14066470 0x7faa14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f9d177fe640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d18140040 0x7f9d18149370 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d18066fa0 tx=0x7f9d10007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f0074ff9640 1 -- 172.21.15.167:0/329947656 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008804e850 con 0x7f0088153f40 2023-11-28T20:38:47.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7f3b76365640 1 -- start start 2023-11-28T20:38:47.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.644+0000 7faa27fff640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa14066470 0x7faa14068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa18000f70 tx=0x7faa18007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3f188d6640 1 -- 172.21.15.167:0/2060580918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 msgr2=0x7f3f140cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3f188d6640 1 --2- 172.21.15.167:0/2060580918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 0x7f3f140cb770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f140b2240 tx=0x7f3f0401c910 comp rx=0 tx=0).stop 2023-11-28T20:38:47.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f55996640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f500c7720 0x7f6f500cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b00682c0 con 0x7fe1b00cbd00 2023-11-28T20:38:47.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f55996640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f501585d0 0x7f6f5015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f55996640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f5015e130 0x7f6f5015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f4effd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f500c7720 0x7f6f500cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f4effd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f500c7720 0x7f6f500cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33888/0 (socket says 172.21.15.167:33888) 2023-11-28T20:38:47.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b76365640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7006a580 0x7f3b700708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b76365640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b700b7f00 0x7f3b70165ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b76365640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b701fedf0 0x7f3b70166410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f0076ffd640 1 -- 172.21.15.167:0/329947656 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00800043e0 con 0x7f0088153f40 2023-11-28T20:38:47.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f4effd640 1 -- 172.21.15.167:0/2404610389 learned_addr learned my addr 172.21.15.167:0/2404610389 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3f188d6640 1 -- 172.21.15.167:0/2060580918 shutdown_connections 2023-11-28T20:38:47.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3f188d6640 1 --2- 172.21.15.167:0/2060580918 >> v2:172.21.15.178:3300/0 conn(0x7f3f14153ae0 0x7f3f14153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3f188d6640 1 --2- 172.21.15.167:0/2060580918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 0x7f3f140cb770 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3f188d6640 1 -- 172.21.15.167:0/2060580918 >> 172.21.15.167:0/2060580918 conn(0x7f3f1406c1f0 msgr2=0x7f3f14071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f9cff7fe640 1 -- 172.21.15.167:0/1905583014 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d10003ea0 con 0x7f9d18140040 2023-11-28T20:38:47.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f9cff7fe640 1 -- 172.21.15.167:0/1905583014 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d10004430 con 0x7f9d18140040 2023-11-28T20:38:47.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f9cff7fe640 1 -- 172.21.15.167:0/1905583014 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d100047e0 con 0x7f9d18140040 2023-11-28T20:38:47.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d181eb230 con 0x7f9d18140040 2023-11-28T20:38:47.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b76365640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b701fc830 con 0x7f3b701fedf0 2023-11-28T20:38:47.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7006a580 0x7f3b700708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7006a580 0x7f3b700708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55552/0 (socket says 172.21.15.167:55552) 2023-11-28T20:38:47.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6ffff640 1 -- 172.21.15.167:0/29741870 learned_addr learned my addr 172.21.15.167:0/29741870 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3f188d6640 1 -- 172.21.15.167:0/2060580918 shutdown_connections 2023-11-28T20:38:47.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b70071b30 con 0x7f3b7006a580 2023-11-28T20:38:47.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d181eb7f0 con 0x7f9d18140040 2023-11-28T20:38:47.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b701fbbb0 con 0x7f3b700b7f00 2023-11-28T20:38:47.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5015f770 con 0x7f6f501585d0 2023-11-28T20:38:47.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6f7fe640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b700b7f00 0x7f3b70165ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f0076ffd640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0068066470 0x7f0068068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f0076ffd640 1 -- 172.21.15.167:0/329947656 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f008011f6c0 con 0x7f0088153f40 2023-11-28T20:38:47.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5015a3e0 con 0x7f6f5015e130 2023-11-28T20:38:47.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f4f7fe640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f5015e130 0x7f6f5015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5015f490 con 0x7f6f500c7720 2023-11-28T20:38:47.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f008659c640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0068066470 0x7f0068068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f6f467fc640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f501585d0 0x7f6f5015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1814cb40 con 0x7f9d18140040 2023-11-28T20:38:47.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3f188d6640 1 -- 172.21.15.167:0/2060580918 wait complete. 2023-11-28T20:38:47.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b74902640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b701fedf0 0x7f3b70166410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6ffff640 1 -- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b700b7f00 msgr2=0x7f3b70165ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6ffff640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b700b7f00 0x7f3b70165ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6ffff640 1 -- 172.21.15.167:0/29741870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b701fedf0 msgr2=0x7f3b70166410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6ffff640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b701fedf0 0x7f3b70166410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6ffff640 1 -- 172.21.15.167:0/29741870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b701fbe90 con 0x7f3b7006a580 2023-11-28T20:38:47.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f008659c640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0068066470 0x7f0068068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0078009ac0 tx=0x7f0078009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.648+0000 7f3b6ffff640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7006a580 0x7f3b700708e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b68010580 tx=0x7f3b68010a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7fe1977fe640 1 -- 172.21.15.167:0/3160606472 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1a0007430 con 0x7fe1b00cbd00 2023-11-28T20:38:47.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f6f4effd640 1 -- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f5015e130 msgr2=0x7f6f5015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f6f4effd640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f5015e130 0x7f6f5015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f6f4effd640 1 -- 172.21.15.167:0/2404610389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f501585d0 msgr2=0x7f6f5015c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f6f4effd640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f501585d0 0x7f6f5015c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f9cff7fe640 1 -- 172.21.15.167:0/1905583014 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d10009020 con 0x7f9d18140040 2023-11-28T20:38:47.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f6f4effd640 1 -- 172.21.15.167:0/2404610389 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40009b30 con 0x7f6f500c7720 2023-11-28T20:38:47.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f6f4effd640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f500c7720 0x7f6f500cb5c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f400af040 tx=0x7f6f40019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f9cff7fe640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d04066570 0x7f9d04068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7fe1977fe640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe19c066470 0x7fe19c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f9cff7fe640 1 -- 172.21.15.167:0/1905583014 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d1011f1a0 con 0x7f9d18140040 2023-11-28T20:38:47.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7fe1977fe640 1 -- 172.21.15.167:0/3160606472 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1a0083960 con 0x7fe1b00cbd00 2023-11-28T20:38:47.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f3f188d6640 1 Processor -- start 2023-11-28T20:38:47.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f9d16ffd640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d04066570 0x7f9d04068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7fe1aeffd640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe19c066470 0x7fe19c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f3f188d6640 1 -- start start 2023-11-28T20:38:47.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f9d16ffd640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d04066570 0x7f9d04068a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9d08004880 tx=0x7f9d08001d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7fe1aeffd640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe19c066470 0x7fe19c068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1a401ec70 tx=0x7fe1a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f3f188d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f140cf860 0x7f3f1415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f3f188d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 0x7f3f14156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f3f188d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f14153ae0 0x7f3f141578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f3f188d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1415bf60 con 0x7f3f140cfc40 2023-11-28T20:38:47.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f3f188d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f14145de0 con 0x7f3f14153ae0 2023-11-28T20:38:47.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.652+0000 7f3f188d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f14155510 con 0x7f3f140cf860 2023-11-28T20:38:47.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f1259c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f140cf860 0x7f3f1415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f1259c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f140cf860 0x7f3f1415ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33918/0 (socket says 172.21.15.167:33918) 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f1259c640 1 -- 172.21.15.167:0/2502011924 learned_addr learned my addr 172.21.15.167:0/2502011924 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f11d9b640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 0x7f3f14156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f12d9d640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f14153ae0 0x7f3f141578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f11d9b640 1 -- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f140cf860 msgr2=0x7f3f1415ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f11d9b640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f140cf860 0x7f3f1415ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f11d9b640 1 -- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f14153ae0 msgr2=0x7f3f141578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f11d9b640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f14153ae0 0x7f3f141578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f11d9b640 1 -- 172.21.15.167:0/2502011924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f04009a70 con 0x7f3f140cfc40 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7f3f11d9b640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 0x7f3f14156eb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f040ac000 tx=0x7f3f040196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.656+0000 7fe1977fe640 1 -- 172.21.15.167:0/3160606472 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1a0050af0 con 0x7fe1b00cbd00 2023-11-28T20:38:47.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3b6cff9640 1 -- 172.21.15.167:0/29741870 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68012880 con 0x7f3b7006a580 2023-11-28T20:38:47.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3b6cff9640 1 -- 172.21.15.167:0/29741870 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b680129e0 con 0x7f3b7006a580 2023-11-28T20:38:47.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3b6cff9640 1 -- 172.21.15.167:0/29741870 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68012d70 con 0x7f3b7006a580 2023-11-28T20:38:47.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b701fc170 con 0x7f3b7006a580 2023-11-28T20:38:47.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b701fb880 con 0x7f3b7006a580 2023-11-28T20:38:47.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7faa24ff9640 1 -- 172.21.15.167:0/2292001659 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa200ecd40 con 0x7faa2815e150 2023-11-28T20:38:47.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f9cff7fe640 1 -- 172.21.15.167:0/1905583014 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d100ec450 con 0x7f9d18140040 2023-11-28T20:38:47.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3f0affd640 1 -- 172.21.15.167:0/2502011924 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f040bf070 con 0x7f3f140cfc40 2023-11-28T20:38:47.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3f0affd640 1 -- 172.21.15.167:0/2502011924 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f040aea90 con 0x7f3f140cfc40 2023-11-28T20:38:47.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3f0affd640 1 -- 172.21.15.167:0/2502011924 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f040aee60 con 0x7f3f140cfc40 2023-11-28T20:38:47.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b700682c0 con 0x7f3b7006a580 2023-11-28T20:38:47.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3f188d6640 1 -- 172.21.15.167:0/2502011924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f14158d80 con 0x7f3f140cfc40 2023-11-28T20:38:47.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3f188d6640 1 -- 172.21.15.167:0/2502011924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f14158fd0 con 0x7f3f140cfc40 2023-11-28T20:38:47.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.660+0000 7f3f08ff9640 1 -- 172.21.15.167:0/2502011924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec005260 con 0x7f3f140cfc40 2023-11-28T20:38:47.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.664+0000 7f3b6cff9640 1 -- 172.21.15.167:0/29741870 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b6801c450 con 0x7f3b7006a580 2023-11-28T20:38:47.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.664+0000 7f3f0affd640 1 -- 172.21.15.167:0/2502011924 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f040b4050 con 0x7f3f140cfc40 2023-11-28T20:38:47.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.664+0000 7f3b6cff9640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b5c0664a0 0x7f3b5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.664+0000 7f3b6cff9640 1 -- 172.21.15.167:0/29741870 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b680855f0 con 0x7f3b7006a580 2023-11-28T20:38:47.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.664+0000 7f3b6f7fe640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b5c0664a0 0x7f3b5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.668+0000 7f3f0affd640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ef4066570 0x7f3ef4068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.668+0000 7f3b6f7fe640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b5c0664a0 0x7f3b5c068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b701f94b0 tx=0x7f3b64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.668+0000 7f3f1259c640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ef4066570 0x7f3ef4068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.668+0000 7f3f0affd640 1 -- 172.21.15.167:0/2502011924 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f0411f6a0 con 0x7f3f140cfc40 2023-11-28T20:38:47.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.668+0000 7f3f1259c640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ef4066570 0x7f3ef4068a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0011f0 tx=0x7f3efc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.668+0000 7f3f0affd640 1 -- 172.21.15.167:0/2502011924 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f040ec950 con 0x7f3f140cfc40 2023-11-28T20:38:47.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.668+0000 7f0076ffd640 1 -- 172.21.15.167:0/329947656 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00800ec950 con 0x7f0088153f40 2023-11-28T20:38:47.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.668+0000 7f6f4cff9640 1 -- 172.21.15.167:0/2404610389 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400b8670 con 0x7f6f500c7720 2023-11-28T20:38:47.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.668+0000 7f6f4cff9640 1 -- 172.21.15.167:0/2404610389 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f400b87f0 con 0x7f6f500c7720 2023-11-28T20:38:47.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.672+0000 7f6f4cff9640 1 -- 172.21.15.167:0/2404610389 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400b8ba0 con 0x7f6f500c7720 2023-11-28T20:38:47.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.672+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f501f71d0 con 0x7f6f500c7720 2023-11-28T20:38:47.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.672+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5015a070 con 0x7f6f500c7720 2023-11-28T20:38:47.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.672+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f500682c0 con 0x7f6f500c7720 2023-11-28T20:38:47.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.676+0000 7f6f4cff9640 1 -- 172.21.15.167:0/2404610389 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f400b8d00 con 0x7f6f500c7720 2023-11-28T20:38:47.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.676+0000 7f6f4cff9640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6f30066570 0x7f6f30068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:47.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.676+0000 7f6f4cff9640 1 -- 172.21.15.167:0/2404610389 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f4011f8e0 con 0x7f6f500c7720 2023-11-28T20:38:47.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.676+0000 7f6f467fc640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6f30066570 0x7f6f30068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:47.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.680+0000 7f6f467fc640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6f30066570 0x7f6f30068a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f500c6040 tx=0x7f6f38009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:47.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.684+0000 7f3b6cff9640 1 -- 172.21.15.167:0/29741870 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3b68052770 con 0x7f3b7006a580 2023-11-28T20:38:47.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.692+0000 7f6f4cff9640 1 -- 172.21.15.167:0/2404610389 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f400ecb00 con 0x7f6f500c7720 2023-11-28T20:38:47.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.904+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9dc005510 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.904+0000 7fd9f97fa640 1 -- 172.21.15.167:0/687074858 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9ec054c40 con 0x7fd9fc1fa6f0 2023-11-28T20:38:47.913 INFO:teuthology.orchestra.run.smithi167.stdout:64424509452 2023-11-28T20:38:47.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd9e8066570 msgr2=0x7fd9e8068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd9e8066570 0x7fd9e8068a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009c70 tx=0x7fd9f0009240 comp rx=0 tx=0).stop 2023-11-28T20:38:47.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc1fa6f0 msgr2=0x7fd9fc14a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc1fa6f0 0x7fd9fc14a2e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00dba0 tx=0x7fd9ec00b3c0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 shutdown_connections 2023-11-28T20:38:47.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd9e8066570 0x7fd9e8068a30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9fc1fa6f0 0x7fd9fc14a2e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9fc14fc60 0x7fd9fc1f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 --2- 172.21.15.167:0/687074858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9fc14f880 0x7fd9fc0c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 >> 172.21.15.167:0/687074858 conn(0x7fd9fc0c7c50 msgr2=0x7fd9fc0709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 shutdown_connections 2023-11-28T20:38:47.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.912+0000 7fda02a9e640 1 -- 172.21.15.167:0/687074858 wait complete. 2023-11-28T20:38:47.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.2 2023-11-28T20:38:47.948 DEBUG:teuthology.parallel:result is None 2023-11-28T20:38:47.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.964+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe1b0150620 con 0x7fe1b00cbd00 2023-11-28T20:38:47.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.964+0000 7fe1977fe640 1 -- 172.21.15.167:0/3160606472 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1b0150620 con 0x7fe1b00cbd00 2023-11-28T20:38:47.967 INFO:teuthology.orchestra.run.smithi167.stdout:60129542156 2023-11-28T20:38:47.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.964+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe19c066470 msgr2=0x7fe19c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.964+0000 7fe1b5491640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe19c066470 0x7fe19c068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1a401ec70 tx=0x7fe1a4008040 comp rx=0 tx=0).stop 2023-11-28T20:38:47.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.964+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b00cbd00 msgr2=0x7fe1b01512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.964+0000 7fe1b5491640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b00cbd00 0x7fe1b01512a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c400 tx=0x7fe1a000c8c0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.968+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 shutdown_connections 2023-11-28T20:38:47.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.968+0000 7fe1b5491640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe19c066470 0x7fe19c068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.968+0000 7fe1b5491640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b014ffd0 0x7fe1b01517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.968+0000 7fe1b5491640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b00cbd00 0x7fe1b01512a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.968+0000 7fe1b5491640 1 --2- 172.21.15.167:0/3160606472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1b00c6330 0x7fe1b013b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.968+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 >> 172.21.15.167:0/3160606472 conn(0x7fe1b00cb1e0 msgr2=0x7fe1b00c4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.968+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 shutdown_connections 2023-11-28T20:38:47.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.968+0000 7fe1b5491640 1 -- 172.21.15.167:0/3160606472 wait complete. 2023-11-28T20:38:47.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.976+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa28067c40 con 0x7faa2815e150 2023-11-28T20:38:47.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.976+0000 7faa24ff9640 1 -- 172.21.15.167:0/2292001659 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa200c6020 con 0x7faa2815e150 2023-11-28T20:38:47.981 INFO:teuthology.orchestra.run.smithi167.stdout:64424509452 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa14066470 msgr2=0x7faa14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa14066470 0x7faa14068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa18000f70 tx=0x7faa18007240 comp rx=0 tx=0).stop 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2815e150 msgr2=0x7faa28149a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2815e150 0x7faa28149a90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa20019580 tx=0x7faa20019710 comp rx=0 tx=0).stop 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 shutdown_connections 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa14066470 0x7faa14068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2815e150 0x7faa28149a90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa28158540 0x7faa28158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 --2- 172.21.15.167:0/2292001659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2806a580 0x7faa28157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:47.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 >> 172.21.15.167:0/2292001659 conn(0x7faa280cb1e0 msgr2=0x7faa280c6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:47.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 shutdown_connections 2023-11-28T20:38:47.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.980+0000 7faa2e5c4640 1 -- 172.21.15.167:0/2292001659 wait complete. 2023-11-28T20:38:47.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.5 2023-11-28T20:38:47.992 DEBUG:teuthology.parallel:result is None 2023-11-28T20:38:48.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.996+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3b70075c90 con 0x7f3b7006a580 2023-11-28T20:38:48.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.996+0000 7f3f08ff9640 1 -- 172.21.15.167:0/2502011924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3eec0057e0 con 0x7f3f140cfc40 2023-11-28T20:38:48.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:47.996+0000 7f3b6cff9640 1 -- 172.21.15.167:0/29741870 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b68017090 con 0x7f3b7006a580 2023-11-28T20:38:48.002 INFO:teuthology.orchestra.run.smithi167.stdout:60129542156 2023-11-28T20:38:48.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3f0affd640 1 -- 172.21.15.167:0/2502011924 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f040b2020 con 0x7f3f140cfc40 2023-11-28T20:38:48.003 INFO:teuthology.orchestra.run.smithi167.stdout:64424509452 2023-11-28T20:38:48.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f0074ff9640 1 -- 172.21.15.167:0/329947656 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f00881640d0 con 0x7f0088153f40 2023-11-28T20:38:48.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f0076ffd640 1 -- 172.21.15.167:0/329947656 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00800b2020 con 0x7f0088153f40 2023-11-28T20:38:48.004 INFO:teuthology.orchestra.run.smithi167.stdout:60129542155 2023-11-28T20:38:48.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b5c0664a0 msgr2=0x7f3b5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b5c0664a0 0x7f3b5c068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b701f94b0 tx=0x7f3b64009040 comp rx=0 tx=0).stop 2023-11-28T20:38:48.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7006a580 msgr2=0x7f3b700708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7006a580 0x7f3b700708e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b68010580 tx=0x7f3b68010a40 comp rx=0 tx=0).stop 2023-11-28T20:38:48.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 shutdown_connections 2023-11-28T20:38:48.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b5c0664a0 0x7f3b5c068960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b701fedf0 0x7f3b70166410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b700b7f00 0x7f3b70165ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 --2- 172.21.15.167:0/29741870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7006a580 0x7f3b700708e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 >> 172.21.15.167:0/29741870 conn(0x7f3b700cb1e0 msgr2=0x7f3b700c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:48.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9d1814cb40 con 0x7f9d18140040 2023-11-28T20:38:48.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 shutdown_connections 2023-11-28T20:38:48.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3b76365640 1 -- 172.21.15.167:0/29741870 wait complete. 2023-11-28T20:38:48.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f9cff7fe640 1 -- 172.21.15.167:0/1905583014 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d1814cb40 con 0x7f9d18140040 2023-11-28T20:38:48.007 INFO:teuthology.orchestra.run.smithi167.stdout:60129542155 2023-11-28T20:38:48.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3f08ff9640 1 -- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ef4066570 msgr2=0x7f3ef4068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3f08ff9640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ef4066570 0x7f3ef4068a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0011f0 tx=0x7f3efc009040 comp rx=0 tx=0).stop 2023-11-28T20:38:48.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3f08ff9640 1 -- 172.21.15.167:0/2502011924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 msgr2=0x7f3f14156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.000+0000 7f3f08ff9640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 0x7f3f14156eb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f040ac000 tx=0x7f3f040196b0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f3f08ff9640 1 -- 172.21.15.167:0/2502011924 shutdown_connections 2023-11-28T20:38:48.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f3f08ff9640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ef4066570 0x7f3ef4068a30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f3f08ff9640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f14153ae0 0x7f3f141578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f3f08ff9640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f140cfc40 0x7f3f14156eb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f3f08ff9640 1 --2- 172.21.15.167:0/2502011924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f140cf860 0x7f3f1415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f3f08ff9640 1 -- 172.21.15.167:0/2502011924 >> 172.21.15.167:0/2502011924 conn(0x7f3f1406c1f0 msgr2=0x7f3f140c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:48.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f3f08ff9640 1 -- 172.21.15.167:0/2502011924 shutdown_connections 2023-11-28T20:38:48.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 -- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0068066470 msgr2=0x7f0068068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0068066470 0x7f0068068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0078009ac0 tx=0x7f0078009190 comp rx=0 tx=0).stop 2023-11-28T20:38:48.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f3f08ff9640 1 -- 172.21.15.167:0/2502011924 wait complete. 2023-11-28T20:38:48.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 -- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088153f40 msgr2=0x7f008815c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088153f40 0x7f008815c3d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0088159cd0 tx=0x7f00800196c0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 -- 172.21.15.167:0/329947656 shutdown_connections 2023-11-28T20:38:48.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0068066470 0x7f0068068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088153f40 0x7f008815c3d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00880c4800 0x7f008815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 --2- 172.21.15.167:0/329947656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880c43e0 0x7f0088146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 -- 172.21.15.167:0/329947656 >> 172.21.15.167:0/329947656 conn(0x7f00880668a0 msgr2=0x7f0088146d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:48.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d04066570 msgr2=0x7f9d04068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d04066570 0x7f9d04068a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9d08004880 tx=0x7f9d08001d30 comp rx=0 tx=0).stop 2023-11-28T20:38:48.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d18140040 msgr2=0x7f9d18149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d18140040 0x7f9d18149370 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9d18066fa0 tx=0x7f9d10007730 comp rx=0 tx=0).stop 2023-11-28T20:38:48.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 -- 172.21.15.167:0/329947656 shutdown_connections 2023-11-28T20:38:48.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f0074ff9640 1 -- 172.21.15.167:0/329947656 wait complete. 2023-11-28T20:38:48.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 shutdown_connections 2023-11-28T20:38:48.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d04066570 0x7f9d04068a30 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9d08004880 tx=0x7f9d08001d30 comp rx=0 tx=0).stop 2023-11-28T20:38:48.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d18140040 0x7f9d18149370 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d181eaaa0 0x7f9d1813f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 --2- 172.21.15.167:0/1905583014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d00004d10 0x7f9d1814de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 >> 172.21.15.167:0/1905583014 conn(0x7f9d180c7c50 msgr2=0x7f9d1814bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:48.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 shutdown_connections 2023-11-28T20:38:48.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.004+0000 7f9d1d6e3640 1 -- 172.21.15.167:0/1905583014 wait complete. 2023-11-28T20:38:48.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.012+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f50075c90 con 0x7f6f500c7720 2023-11-28T20:38:48.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.012+0000 7f6f4cff9640 1 -- 172.21.15.167:0/2404610389 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f400f0120 con 0x7f6f500c7720 2023-11-28T20:38:48.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.1 2023-11-28T20:38:48.019 INFO:teuthology.orchestra.run.smithi167.stdout:60129542155 2023-11-28T20:38:48.019 DEBUG:teuthology.parallel:result is None 2023-11-28T20:38:48.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6f30066570 msgr2=0x7f6f30068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6f30066570 0x7f6f30068a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f500c6040 tx=0x7f6f38009190 comp rx=0 tx=0).stop 2023-11-28T20:38:48.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f500c7720 msgr2=0x7f6f500cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f500c7720 0x7f6f500cb5c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f400af040 tx=0x7f6f40019740 comp rx=0 tx=0).stop 2023-11-28T20:38:48.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 shutdown_connections 2023-11-28T20:38:48.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6f30066570 0x7f6f30068a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f5015e130 0x7f6f5015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f501585d0 0x7f6f5015c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 --2- 172.21.15.167:0/2404610389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f500c7720 0x7f6f500cb5c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 >> 172.21.15.167:0/2404610389 conn(0x7f6f500cb1e0 msgr2=0x7f6f500c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:48.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 shutdown_connections 2023-11-28T20:38:48.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.016+0000 7f6f55996640 1 -- 172.21.15.167:0/2404610389 wait complete. 2023-11-28T20:38:48.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.3 2023-11-28T20:38:48.041 DEBUG:teuthology.parallel:result is None 2023-11-28T20:38:48.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.4 2023-11-28T20:38:48.042 DEBUG:teuthology.parallel:result is None 2023-11-28T20:38:48.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.6 2023-11-28T20:38:48.048 DEBUG:teuthology.parallel:result is None 2023-11-28T20:38:48.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.0 2023-11-28T20:38:48.049 DEBUG:teuthology.parallel:result is None 2023-11-28T20:38:48.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.7 2023-11-28T20:38:48.049 DEBUG:teuthology.parallel:result is None 2023-11-28T20:38:48.049 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T20:38:48.049 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:38:48.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.220+0000 7f9f167df640 1 Processor -- start 2023-11-28T20:38:48.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.220+0000 7f9f167df640 1 -- start start 2023-11-28T20:38:48.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f167df640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f10150b40 0x7f9f10157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f167df640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f100c4940 con 0x7f9f100c4510 2023-11-28T20:38:48.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f167df640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f100c6ac0 con 0x7f9f100c6ff0 2023-11-28T20:38:48.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f167df640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c62f0 con 0x7f9f10150b40 2023-11-28T20:38:48.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f14d7c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9f100c4510 0x7f9f1006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44720/0 (socket says 172.21.15.167:44720) 2023-11-28T20:38:48.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f14d7c640 1 -- 172.21.15.167:0/3014465555 learned_addr learned my addr 172.21.15.167:0/3014465555 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:48.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0ffff640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f10150b40 0x7f9f10157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874676474 0 0) 0x7f9f100c4940 con 0x7f9f100c4510 2023-11-28T20:38:48.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef8005740 con 0x7f9f100c4510 2023-11-28T20:38:48.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2802460722 0 0) 0x7f9ef8005740 con 0x7f9f100c4510 2023-11-28T20:38:48.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f10150b40 msgr2=0x7f9f10157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:48.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f10150b40 0x7f9f10157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 >> v1:172.21.15.178:6789/0 conn(0x7f9f100c6ff0 legacy=0x7f9f100c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f100c6500 con 0x7f9f100c4510 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9f08001a00 con 0x7f9f100c4510 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 >> v1:172.21.15.167:6789/0 conn(0x7f9f100c4510 legacy=0x7f9f1006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef8005bc0 0x7f9ef8005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f10150b40 0x7f9ef80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ef8006f20 0x7f9ef80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c62f0 con 0x7f9ef8006f20 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef800dba0 con 0x7f9ef8005bc0 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef800dd60 con 0x7f9f10150b40 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f14d7c640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ef8006f20 0x7f9ef80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0ffff640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef8005bc0 0x7f9ef8005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f0f7fe640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f10150b40 0x7f9ef80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f14d7c640 1 -- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f10150b40 msgr2=0x7f9ef80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:48.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f14d7c640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f10150b40 0x7f9ef80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f14d7c640 1 -- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef8005bc0 msgr2=0x7f9ef8005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:48.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f14d7c640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef8005bc0 0x7f9ef8005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.224+0000 7f9f14d7c640 1 -- 172.21.15.167:0/3014465555 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8005740 con 0x7f9ef8006f20 2023-11-28T20:38:48.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f14d7c640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ef8006f20 0x7f9ef80073a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800a7d0 tx=0x7f9f0801fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d9c38b4a05b193 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:48.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f080aa650 con 0x7f9ef8006f20 2023-11-28T20:38:48.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f080aa7d0 con 0x7f9ef8006f20 2023-11-28T20:38:48.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f0effd640 1 -- 172.21.15.167:0/3014465555 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f080aab80 con 0x7f9ef8006f20 2023-11-28T20:38:48.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f167df640 1 -- 172.21.15.167:0/3014465555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ef8006f20 msgr2=0x7f9ef80073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f167df640 1 --2- 172.21.15.167:0/3014465555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ef8006f20 0x7f9ef80073a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800a7d0 tx=0x7f9f0801fa20 comp rx=0 tx=0).stop 2023-11-28T20:38:48.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f14d7c640 1 -- 172.21.15.167:0/3014465555 reap_dead start 2023-11-28T20:38:48.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f167df640 1 -- 172.21.15.167:0/3014465555 shutdown_connections 2023-11-28T20:38:48.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f167df640 1 -- 172.21.15.167:0/3014465555 >> 172.21.15.167:0/3014465555 conn(0x7f9f100cb1e0 msgr2=0x7f9f100cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:48.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f167df640 1 -- 172.21.15.167:0/3014465555 shutdown_connections 2023-11-28T20:38:48.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.228+0000 7f9f167df640 1 -- 172.21.15.167:0/3014465555 wait complete. 2023-11-28T20:38:48.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 Processor -- start 2023-11-28T20:38:48.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 -- start start 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef8006f20 0x7f9f101f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f1014def0 0x7f9f101584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f101f1a90 0x7f9f101f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100c7a40 con 0x7f9f1014def0 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f101599e0 con 0x7f9ef8006f20 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f10159c10 con 0x7f9f101f1a90 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f1014def0 0x7f9f101584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f1014def0 0x7f9f101584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47058/0 (socket says 172.21.15.167:47058) 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0f7fe640 1 -- 172.21.15.167:0/1283174795 learned_addr learned my addr 172.21.15.167:0/1283174795 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:48.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f14d7c640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f101f1a90 0x7f9f101f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0ffff640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef8006f20 0x7f9f101f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0f7fe640 1 -- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f101f1a90 msgr2=0x7f9f101f1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0f7fe640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f101f1a90 0x7f9f101f1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0f7fe640 1 -- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef8006f20 msgr2=0x7f9f101f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0f7fe640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef8006f20 0x7f9f101f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0f7fe640 1 -- 172.21.15.167:0/1283174795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f10159ef0 con 0x7f9f1014def0 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0f7fe640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f1014def0 0x7f9f101584b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400e530 tx=0x7f9f0400e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0cff9640 1 -- 172.21.15.167:0/1283174795 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04005320 con 0x7f9f1014def0 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0cff9640 1 -- 172.21.15.167:0/1283174795 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f04005480 con 0x7f9f1014def0 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f0cff9640 1 -- 172.21.15.167:0/1283174795 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04007270 con 0x7f9f1014def0 2023-11-28T20:38:48.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f10157cb0 con 0x7f9f1014def0 2023-11-28T20:38:48.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1015a330 con 0x7f9f1014def0 2023-11-28T20:38:48.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.232+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f100682c0 con 0x7f9f1014def0 2023-11-28T20:38:48.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.236+0000 7f9f0cff9640 1 -- 172.21.15.167:0/1283174795 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f040073d0 con 0x7f9f1014def0 2023-11-28T20:38:48.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.236+0000 7f9f0cff9640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9efc066470 0x7f9efc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.236+0000 7f9f0cff9640 1 -- 172.21.15.167:0/1283174795 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f04083af0 con 0x7f9f1014def0 2023-11-28T20:38:48.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.236+0000 7f9f0ffff640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9efc066470 0x7f9efc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.236+0000 7f9f0ffff640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9efc066470 0x7f9efc068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009a30 tx=0x7f9f00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:48.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.240+0000 7f9f0cff9640 1 -- 172.21.15.167:0/1283174795 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f04050be0 con 0x7f9f1014def0 2023-11-28T20:38:48.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.384+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f10157b30 con 0x7f9efc066470 2023-11-28T20:38:48.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.412+0000 7f9f0cff9640 1 -- 172.21.15.167:0/1283174795 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345266 (secure 0 0 0) 0x7f9f00013a20 con 0x7f9efc066470 2023-11-28T20:38:48.419 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:48.421 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:38:48.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9efc066470 msgr2=0x7f9efc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9efc066470 0x7f9efc068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009a30 tx=0x7f9f00008040 comp rx=0 tx=0).stop 2023-11-28T20:38:48.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f1014def0 msgr2=0x7f9f101584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f1014def0 0x7f9f101584b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400e530 tx=0x7f9f0400e9f0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 shutdown_connections 2023-11-28T20:38:48.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9efc066470 0x7f9efc068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f101f1a90 0x7f9f101f1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f1014def0 0x7f9f101584b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 --2- 172.21.15.167:0/1283174795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef8006f20 0x7f9f101f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 >> 172.21.15.167:0/1283174795 conn(0x7f9f100cb1e0 msgr2=0x7f9f1006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:48.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 shutdown_connections 2023-11-28T20:38:48.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.416+0000 7f9f167df640 1 -- 172.21.15.167:0/1283174795 wait complete. 2023-11-28T20:38:48.438 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-11-28T20:38:47.438542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596323,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":224,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236056,"kb_used_data":3248,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738664,"statfs":{"total":773094113280,"available":772852391936,"internally_reserved":0,"allocated":3325952,"data_stored":2006836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3545,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004906"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528906+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:24.528906+0000","last_peered":"2023-11-28T20:38:24.528906+0000","last_clean":"2023-11-28T20:38:24.528906+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:24.528906+0000","last_undegraded":"2023-11-28T20:38:24.528906+0000","last_fullsized":"2023-11-28T20:38:24.528906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555618+0000","last_change":"2023-11-28T20:38:19.384120+0000","last_active":"2023-11-28T20:38:23.555618+0000","last_peered":"2023-11-28T20:38:23.555618+0000","last_clean":"2023-11-28T20:38:23.555618+0000","last_became_active":"2023-11-28T20:38:19.383899+0000","last_became_peered":"2023-11-28T20:38:19.383899+0000","last_unstale":"2023-11-28T20:38:23.555618+0000","last_undegraded":"2023-11-28T20:38:23.555618+0000","last_fullsized":"2023-11-28T20:38:23.555618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:02:32.168294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523700+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:38:24.523700+0000","last_peered":"2023-11-28T20:38:24.523700+0000","last_clean":"2023-11-28T20:38:24.523700+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:38:24.523700+0000","last_undegraded":"2023-11-28T20:38:24.523700+0000","last_fullsized":"2023-11-28T20:38:24.523700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524795+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:38:24.524795+0000","last_peered":"2023-11-28T20:38:24.524795+0000","last_clean":"2023-11-28T20:38:24.524795+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:38:24.524795+0000","last_undegraded":"2023-11-28T20:38:24.524795+0000","last_fullsized":"2023-11-28T20:38:24.524795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562919+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:23.562919+0000","last_peered":"2023-11-28T20:38:23.562919+0000","last_clean":"2023-11-28T20:38:23.562919+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:23.562919+0000","last_undegraded":"2023-11-28T20:38:23.562919+0000","last_fullsized":"2023-11-28T20:38:23.562919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527387+0000","last_change":"2023-11-28T20:38:23.600077+0000","last_active":"2023-11-28T20:38:24.527387+0000","last_peered":"2023-11-28T20:38:24.527387+0000","last_clean":"2023-11-28T20:38:24.527387+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:24.527387+0000","last_undegraded":"2023-11-28T20:38:24.527387+0000","last_fullsized":"2023-11-28T20:38:24.527387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:39.002909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532607+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:24.532607+0000","last_peered":"2023-11-28T20:38:24.532607+0000","last_clean":"2023-11-28T20:38:24.532607+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:24.532607+0000","last_undegraded":"2023-11-28T20:38:24.532607+0000","last_fullsized":"2023-11-28T20:38:24.532607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560982+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:23.560982+0000","last_peered":"2023-11-28T20:38:23.560982+0000","last_clean":"2023-11-28T20:38:23.560982+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:23.560982+0000","last_undegraded":"2023-11-28T20:38:23.560982+0000","last_fullsized":"2023-11-28T20:38:23.560982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529343+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:24.529343+0000","last_peered":"2023-11-28T20:38:24.529343+0000","last_clean":"2023-11-28T20:38:24.529343+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:24.529343+0000","last_undegraded":"2023-11-28T20:38:24.529343+0000","last_fullsized":"2023-11-28T20:38:24.529343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532210+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532210+0000","last_peered":"2023-11-28T20:38:24.532210+0000","last_clean":"2023-11-28T20:38:24.532210+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532210+0000","last_undegraded":"2023-11-28T20:38:24.532210+0000","last_fullsized":"2023-11-28T20:38:24.532210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562448+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:23.562448+0000","last_peered":"2023-11-28T20:38:23.562448+0000","last_clean":"2023-11-28T20:38:23.562448+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:23.562448+0000","last_undegraded":"2023-11-28T20:38:23.562448+0000","last_fullsized":"2023-11-28T20:38:23.562448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528969+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:24.528969+0000","last_peered":"2023-11-28T20:38:24.528969+0000","last_clean":"2023-11-28T20:38:24.528969+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:24.528969+0000","last_undegraded":"2023-11-28T20:38:24.528969+0000","last_fullsized":"2023-11-28T20:38:24.528969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563714+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:23.563714+0000","last_peered":"2023-11-28T20:38:23.563714+0000","last_clean":"2023-11-28T20:38:23.563714+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:23.563714+0000","last_undegraded":"2023-11-28T20:38:23.563714+0000","last_fullsized":"2023-11-28T20:38:23.563714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574248+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:45.574248+0000","last_peered":"2023-11-28T20:38:45.574248+0000","last_clean":"2023-11-28T20:38:45.574248+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:45.574248+0000","last_undegraded":"2023-11-28T20:38:45.574248+0000","last_fullsized":"2023-11-28T20:38:45.574248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530149+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:24.530149+0000","last_peered":"2023-11-28T20:38:24.530149+0000","last_clean":"2023-11-28T20:38:24.530149+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:24.530149+0000","last_undegraded":"2023-11-28T20:38:24.530149+0000","last_fullsized":"2023-11-28T20:38:24.530149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556220+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:38:23.556220+0000","last_peered":"2023-11-28T20:38:23.556220+0000","last_clean":"2023-11-28T20:38:23.556220+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:38:23.556220+0000","last_undegraded":"2023-11-28T20:38:23.556220+0000","last_fullsized":"2023-11-28T20:38:23.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571843+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:38:23.571843+0000","last_peered":"2023-11-28T20:38:23.571843+0000","last_clean":"2023-11-28T20:38:23.571843+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:38:23.571843+0000","last_undegraded":"2023-11-28T20:38:23.571843+0000","last_fullsized":"2023-11-28T20:38:23.571843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529638+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:24.529638+0000","last_peered":"2023-11-28T20:38:24.529638+0000","last_clean":"2023-11-28T20:38:24.529638+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:24.529638+0000","last_undegraded":"2023-11-28T20:38:24.529638+0000","last_fullsized":"2023-11-28T20:38:24.529638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556959+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:38:23.556959+0000","last_peered":"2023-11-28T20:38:23.556959+0000","last_clean":"2023-11-28T20:38:23.556959+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:38:23.556959+0000","last_undegraded":"2023-11-28T20:38:23.556959+0000","last_fullsized":"2023-11-28T20:38:23.556959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.554096+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:38:45.554096+0000","last_peered":"2023-11-28T20:38:45.554096+0000","last_clean":"2023-11-28T20:38:45.554096+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:38:45.554096+0000","last_undegraded":"2023-11-28T20:38:45.554096+0000","last_fullsized":"2023-11-28T20:38:45.554096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535771+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.535771+0000","last_peered":"2023-11-28T20:38:24.535771+0000","last_clean":"2023-11-28T20:38:24.535771+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:38:24.535771+0000","last_undegraded":"2023-11-28T20:38:24.535771+0000","last_fullsized":"2023-11-28T20:38:24.535771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.585068+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:23.585068+0000","last_peered":"2023-11-28T20:38:23.585068+0000","last_clean":"2023-11-28T20:38:23.585068+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:23.585068+0000","last_undegraded":"2023-11-28T20:38:23.585068+0000","last_fullsized":"2023-11-28T20:38:23.585068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574872+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:45.574872+0000","last_peered":"2023-11-28T20:38:45.574872+0000","last_clean":"2023-11-28T20:38:45.574872+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:45.574872+0000","last_undegraded":"2023-11-28T20:38:45.574872+0000","last_fullsized":"2023-11-28T20:38:45.574872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530157+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:24.530157+0000","last_peered":"2023-11-28T20:38:24.530157+0000","last_clean":"2023-11-28T20:38:24.530157+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:24.530157+0000","last_undegraded":"2023-11-28T20:38:24.530157+0000","last_fullsized":"2023-11-28T20:38:24.530157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561892+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:23.561892+0000","last_peered":"2023-11-28T20:38:23.561892+0000","last_clean":"2023-11-28T20:38:23.561892+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:23.561892+0000","last_undegraded":"2023-11-28T20:38:23.561892+0000","last_fullsized":"2023-11-28T20:38:23.561892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531914+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:24.531914+0000","last_peered":"2023-11-28T20:38:24.531914+0000","last_clean":"2023-11-28T20:38:24.531914+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:24.531914+0000","last_undegraded":"2023-11-28T20:38:24.531914+0000","last_fullsized":"2023-11-28T20:38:24.531914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528204+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:24.528204+0000","last_peered":"2023-11-28T20:38:24.528204+0000","last_clean":"2023-11-28T20:38:24.528204+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:24.528204+0000","last_undegraded":"2023-11-28T20:38:24.528204+0000","last_fullsized":"2023-11-28T20:38:24.528204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556394+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:38:23.556394+0000","last_peered":"2023-11-28T20:38:23.556394+0000","last_clean":"2023-11-28T20:38:23.556394+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:38:23.556394+0000","last_undegraded":"2023-11-28T20:38:23.556394+0000","last_fullsized":"2023-11-28T20:38:23.556394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535703+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:38:24.535703+0000","last_peered":"2023-11-28T20:38:24.535703+0000","last_clean":"2023-11-28T20:38:24.535703+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:38:24.535703+0000","last_undegraded":"2023-11-28T20:38:24.535703+0000","last_fullsized":"2023-11-28T20:38:24.535703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523623+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:38:24.523623+0000","last_peered":"2023-11-28T20:38:24.523623+0000","last_clean":"2023-11-28T20:38:24.523623+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:38:24.523623+0000","last_undegraded":"2023-11-28T20:38:24.523623+0000","last_fullsized":"2023-11-28T20:38:24.523623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572645+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:38:23.572645+0000","last_peered":"2023-11-28T20:38:23.572645+0000","last_clean":"2023-11-28T20:38:23.572645+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:38:23.572645+0000","last_undegraded":"2023-11-28T20:38:23.572645+0000","last_fullsized":"2023-11-28T20:38:23.572645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528499+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:24.528499+0000","last_peered":"2023-11-28T20:38:24.528499+0000","last_clean":"2023-11-28T20:38:24.528499+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:24.528499+0000","last_undegraded":"2023-11-28T20:38:24.528499+0000","last_fullsized":"2023-11-28T20:38:24.528499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344337+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:24.344337+0000","last_peered":"2023-11-28T20:38:24.344337+0000","last_clean":"2023-11-28T20:38:24.344337+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:24.344337+0000","last_undegraded":"2023-11-28T20:38:24.344337+0000","last_fullsized":"2023-11-28T20:38:24.344337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562716+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:23.562716+0000","last_peered":"2023-11-28T20:38:23.562716+0000","last_clean":"2023-11-28T20:38:23.562716+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:23.562716+0000","last_undegraded":"2023-11-28T20:38:23.562716+0000","last_fullsized":"2023-11-28T20:38:23.562716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572746+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:38:23.572746+0000","last_peered":"2023-11-28T20:38:23.572746+0000","last_clean":"2023-11-28T20:38:23.572746+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:38:23.572746+0000","last_undegraded":"2023-11-28T20:38:23.572746+0000","last_fullsized":"2023-11-28T20:38:23.572746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535102+0000","last_change":"2023-11-28T20:38:23.594782+0000","last_active":"2023-11-28T20:38:24.535102+0000","last_peered":"2023-11-28T20:38:24.535102+0000","last_clean":"2023-11-28T20:38:24.535102+0000","last_became_active":"2023-11-28T20:38:23.594034+0000","last_became_peered":"2023-11-28T20:38:23.594034+0000","last_unstale":"2023-11-28T20:38:24.535102+0000","last_undegraded":"2023-11-28T20:38:24.535102+0000","last_fullsized":"2023-11-28T20:38:24.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:29:14.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.581982+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:23.581982+0000","last_peered":"2023-11-28T20:38:23.581982+0000","last_clean":"2023-11-28T20:38:23.581982+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:23.581982+0000","last_undegraded":"2023-11-28T20:38:23.581982+0000","last_fullsized":"2023-11-28T20:38:23.581982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560074+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:23.560074+0000","last_peered":"2023-11-28T20:38:23.560074+0000","last_clean":"2023-11-28T20:38:23.560074+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:23.560074+0000","last_undegraded":"2023-11-28T20:38:23.560074+0000","last_fullsized":"2023-11-28T20:38:23.560074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535460+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:38:24.535460+0000","last_peered":"2023-11-28T20:38:24.535460+0000","last_clean":"2023-11-28T20:38:24.535460+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:38:24.535460+0000","last_undegraded":"2023-11-28T20:38:24.535460+0000","last_fullsized":"2023-11-28T20:38:24.535460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571588+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:38:23.571588+0000","last_peered":"2023-11-28T20:38:23.571588+0000","last_clean":"2023-11-28T20:38:23.571588+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:38:23.571588+0000","last_undegraded":"2023-11-28T20:38:23.571588+0000","last_fullsized":"2023-11-28T20:38:23.571588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534096+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:38:24.534096+0000","last_peered":"2023-11-28T20:38:24.534096+0000","last_clean":"2023-11-28T20:38:24.534096+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:38:24.534096+0000","last_undegraded":"2023-11-28T20:38:24.534096+0000","last_fullsized":"2023-11-28T20:38:24.534096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535820+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:38:24.535820+0000","last_peered":"2023-11-28T20:38:24.535820+0000","last_clean":"2023-11-28T20:38:24.535820+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:38:24.535820+0000","last_undegraded":"2023-11-28T20:38:24.535820+0000","last_fullsized":"2023-11-28T20:38:24.535820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560814+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:23.560814+0000","last_peered":"2023-11-28T20:38:23.560814+0000","last_clean":"2023-11-28T20:38:23.560814+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:23.560814+0000","last_undegraded":"2023-11-28T20:38:23.560814+0000","last_fullsized":"2023-11-28T20:38:23.560814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770415+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:23.770415+0000","last_peered":"2023-11-28T20:38:23.770415+0000","last_clean":"2023-11-28T20:38:23.770415+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:23.770415+0000","last_undegraded":"2023-11-28T20:38:23.770415+0000","last_fullsized":"2023-11-28T20:38:23.770415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344627+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:24.344627+0000","last_peered":"2023-11-28T20:38:24.344627+0000","last_clean":"2023-11-28T20:38:24.344627+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:24.344627+0000","last_undegraded":"2023-11-28T20:38:24.344627+0000","last_fullsized":"2023-11-28T20:38:24.344627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555061+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:38:23.555061+0000","last_peered":"2023-11-28T20:38:23.555061+0000","last_clean":"2023-11-28T20:38:23.555061+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:38:23.555061+0000","last_undegraded":"2023-11-28T20:38:23.555061+0000","last_fullsized":"2023-11-28T20:38:23.555061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.567796+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:23.567796+0000","last_peered":"2023-11-28T20:38:23.567796+0000","last_clean":"2023-11-28T20:38:23.567796+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:23.567796+0000","last_undegraded":"2023-11-28T20:38:23.567796+0000","last_fullsized":"2023-11-28T20:38:23.567796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770661+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:23.770661+0000","last_peered":"2023-11-28T20:38:23.770661+0000","last_clean":"2023-11-28T20:38:23.770661+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:23.770661+0000","last_undegraded":"2023-11-28T20:38:23.770661+0000","last_fullsized":"2023-11-28T20:38:23.770661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351420+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:24.351420+0000","last_peered":"2023-11-28T20:38:24.351420+0000","last_clean":"2023-11-28T20:38:24.351420+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:24.351420+0000","last_undegraded":"2023-11-28T20:38:24.351420+0000","last_fullsized":"2023-11-28T20:38:24.351420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771541+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:23.771541+0000","last_peered":"2023-11-28T20:38:23.771541+0000","last_clean":"2023-11-28T20:38:23.771541+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:23.771541+0000","last_undegraded":"2023-11-28T20:38:23.771541+0000","last_fullsized":"2023-11-28T20:38:23.771541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.582714+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:38:23.582714+0000","last_peered":"2023-11-28T20:38:23.582714+0000","last_clean":"2023-11-28T20:38:23.582714+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:38:23.582714+0000","last_undegraded":"2023-11-28T20:38:23.582714+0000","last_fullsized":"2023-11-28T20:38:23.582714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350832+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:24.350832+0000","last_peered":"2023-11-28T20:38:24.350832+0000","last_clean":"2023-11-28T20:38:24.350832+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:24.350832+0000","last_undegraded":"2023-11-28T20:38:24.350832+0000","last_fullsized":"2023-11-28T20:38:24.350832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561174+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:23.561174+0000","last_peered":"2023-11-28T20:38:23.561174+0000","last_clean":"2023-11-28T20:38:23.561174+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:23.561174+0000","last_undegraded":"2023-11-28T20:38:23.561174+0000","last_fullsized":"2023-11-28T20:38:23.561174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.533486+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:38:24.533486+0000","last_peered":"2023-11-28T20:38:24.533486+0000","last_clean":"2023-11-28T20:38:24.533486+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:38:24.533486+0000","last_undegraded":"2023-11-28T20:38:24.533486+0000","last_fullsized":"2023-11-28T20:38:24.533486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344212+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:24.344212+0000","last_peered":"2023-11-28T20:38:24.344212+0000","last_clean":"2023-11-28T20:38:24.344212+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:24.344212+0000","last_undegraded":"2023-11-28T20:38:24.344212+0000","last_fullsized":"2023-11-28T20:38:24.344212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771932+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:23.771932+0000","last_peered":"2023-11-28T20:38:23.771932+0000","last_clean":"2023-11-28T20:38:23.771932+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:23.771932+0000","last_undegraded":"2023-11-28T20:38:23.771932+0000","last_fullsized":"2023-11-28T20:38:23.771932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532302+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:38:24.532302+0000","last_peered":"2023-11-28T20:38:24.532302+0000","last_clean":"2023-11-28T20:38:24.532302+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:38:24.532302+0000","last_undegraded":"2023-11-28T20:38:24.532302+0000","last_fullsized":"2023-11-28T20:38:24.532302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348053+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:24.348053+0000","last_peered":"2023-11-28T20:38:24.348053+0000","last_clean":"2023-11-28T20:38:24.348053+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:24.348053+0000","last_undegraded":"2023-11-28T20:38:24.348053+0000","last_fullsized":"2023-11-28T20:38:24.348053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771535+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:23.771535+0000","last_peered":"2023-11-28T20:38:23.771535+0000","last_clean":"2023-11-28T20:38:23.771535+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:23.771535+0000","last_undegraded":"2023-11-28T20:38:23.771535+0000","last_fullsized":"2023-11-28T20:38:23.771535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530364+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:24.530364+0000","last_peered":"2023-11-28T20:38:24.530364+0000","last_clean":"2023-11-28T20:38:24.530364+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:24.530364+0000","last_undegraded":"2023-11-28T20:38:24.530364+0000","last_fullsized":"2023-11-28T20:38:24.530364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527514+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:24.527514+0000","last_peered":"2023-11-28T20:38:24.527514+0000","last_clean":"2023-11-28T20:38:24.527514+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:24.527514+0000","last_undegraded":"2023-11-28T20:38:24.527514+0000","last_fullsized":"2023-11-28T20:38:24.527514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770655+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:23.770655+0000","last_peered":"2023-11-28T20:38:23.770655+0000","last_clean":"2023-11-28T20:38:23.770655+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:23.770655+0000","last_undegraded":"2023-11-28T20:38:23.770655+0000","last_fullsized":"2023-11-28T20:38:23.770655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.572183+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:38:45.572183+0000","last_peered":"2023-11-28T20:38:45.572183+0000","last_clean":"2023-11-28T20:38:45.572183+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:38:45.572183+0000","last_undegraded":"2023-11-28T20:38:45.572183+0000","last_fullsized":"2023-11-28T20:38:45.572183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344497+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:24.344497+0000","last_peered":"2023-11-28T20:38:24.344497+0000","last_clean":"2023-11-28T20:38:24.344497+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:24.344497+0000","last_undegraded":"2023-11-28T20:38:24.344497+0000","last_fullsized":"2023-11-28T20:38:24.344497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563464+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:23.563464+0000","last_peered":"2023-11-28T20:38:23.563464+0000","last_clean":"2023-11-28T20:38:23.563464+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:23.563464+0000","last_undegraded":"2023-11-28T20:38:23.563464+0000","last_fullsized":"2023-11-28T20:38:23.563464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563470+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:23.563470+0000","last_peered":"2023-11-28T20:38:23.563470+0000","last_clean":"2023-11-28T20:38:23.563470+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:23.563470+0000","last_undegraded":"2023-11-28T20:38:23.563470+0000","last_fullsized":"2023-11-28T20:38:23.563470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.525043+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:38:24.525043+0000","last_peered":"2023-11-28T20:38:24.525043+0000","last_clean":"2023-11-28T20:38:24.525043+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:38:24.525043+0000","last_undegraded":"2023-11-28T20:38:24.525043+0000","last_fullsized":"2023-11-28T20:38:24.525043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771026+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:23.771026+0000","last_peered":"2023-11-28T20:38:23.771026+0000","last_clean":"2023-11-28T20:38:23.771026+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:23.771026+0000","last_undegraded":"2023-11-28T20:38:23.771026+0000","last_fullsized":"2023-11-28T20:38:23.771026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559866+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:23.559866+0000","last_peered":"2023-11-28T20:38:23.559866+0000","last_clean":"2023-11-28T20:38:23.559866+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:23.559866+0000","last_undegraded":"2023-11-28T20:38:23.559866+0000","last_fullsized":"2023-11-28T20:38:23.559866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524484+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.524484+0000","last_peered":"2023-11-28T20:38:24.524484+0000","last_clean":"2023-11-28T20:38:24.524484+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:38:24.524484+0000","last_undegraded":"2023-11-28T20:38:24.524484+0000","last_fullsized":"2023-11-28T20:38:24.524484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560744+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:23.560744+0000","last_peered":"2023-11-28T20:38:23.560744+0000","last_clean":"2023-11-28T20:38:23.560744+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:23.560744+0000","last_undegraded":"2023-11-28T20:38:23.560744+0000","last_fullsized":"2023-11-28T20:38:23.560744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528309+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:24.528309+0000","last_peered":"2023-11-28T20:38:24.528309+0000","last_clean":"2023-11-28T20:38:24.528309+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:24.528309+0000","last_undegraded":"2023-11-28T20:38:24.528309+0000","last_fullsized":"2023-11-28T20:38:24.528309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350690+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:24.350690+0000","last_peered":"2023-11-28T20:38:24.350690+0000","last_clean":"2023-11-28T20:38:24.350690+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:24.350690+0000","last_undegraded":"2023-11-28T20:38:24.350690+0000","last_fullsized":"2023-11-28T20:38:24.350690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771288+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:23.771288+0000","last_peered":"2023-11-28T20:38:23.771288+0000","last_clean":"2023-11-28T20:38:23.771288+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:23.771288+0000","last_undegraded":"2023-11-28T20:38:23.771288+0000","last_fullsized":"2023-11-28T20:38:23.771288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:33.736395+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:33.736395+0000","last_peered":"2023-11-28T20:38:33.736395+0000","last_clean":"2023-11-28T20:38:33.736395+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:33.736395+0000","last_undegraded":"2023-11-28T20:38:33.736395+0000","last_fullsized":"2023-11-28T20:38:33.736395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535078+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:38:24.535078+0000","last_peered":"2023-11-28T20:38:24.535078+0000","last_clean":"2023-11-28T20:38:24.535078+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:38:24.535078+0000","last_undegraded":"2023-11-28T20:38:24.535078+0000","last_fullsized":"2023-11-28T20:38:24.535078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571791+0000","last_change":"2023-11-28T20:38:19.398113+0000","last_active":"2023-11-28T20:38:23.571791+0000","last_peered":"2023-11-28T20:38:23.571791+0000","last_clean":"2023-11-28T20:38:23.571791+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:38:23.571791+0000","last_undegraded":"2023-11-28T20:38:23.571791+0000","last_fullsized":"2023-11-28T20:38:23.571791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:08.187641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535609+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:38:24.535609+0000","last_peered":"2023-11-28T20:38:24.535609+0000","last_clean":"2023-11-28T20:38:24.535609+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:38:24.535609+0000","last_undegraded":"2023-11-28T20:38:24.535609+0000","last_fullsized":"2023-11-28T20:38:24.535609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529696+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:24.529696+0000","last_peered":"2023-11-28T20:38:24.529696+0000","last_clean":"2023-11-28T20:38:24.529696+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:24.529696+0000","last_undegraded":"2023-11-28T20:38:24.529696+0000","last_fullsized":"2023-11-28T20:38:24.529696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562967+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:23.562967+0000","last_peered":"2023-11-28T20:38:23.562967+0000","last_clean":"2023-11-28T20:38:23.562967+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:23.562967+0000","last_undegraded":"2023-11-28T20:38:23.562967+0000","last_fullsized":"2023-11-28T20:38:23.562967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559741+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:23.559741+0000","last_peered":"2023-11-28T20:38:23.559741+0000","last_clean":"2023-11-28T20:38:23.559741+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:23.559741+0000","last_undegraded":"2023-11-28T20:38:23.559741+0000","last_fullsized":"2023-11-28T20:38:23.559741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524020+0000","last_change":"2023-11-28T20:38:23.592734+0000","last_active":"2023-11-28T20:38:24.524020+0000","last_peered":"2023-11-28T20:38:24.524020+0000","last_clean":"2023-11-28T20:38:24.524020+0000","last_became_active":"2023-11-28T20:38:23.592348+0000","last_became_peered":"2023-11-28T20:38:23.592348+0000","last_unstale":"2023-11-28T20:38:24.524020+0000","last_undegraded":"2023-11-28T20:38:24.524020+0000","last_fullsized":"2023-11-28T20:38:24.524020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:11:10.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559511+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:23.559511+0000","last_peered":"2023-11-28T20:38:23.559511+0000","last_clean":"2023-11-28T20:38:23.559511+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:23.559511+0000","last_undegraded":"2023-11-28T20:38:23.559511+0000","last_fullsized":"2023-11-28T20:38:23.559511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.565387+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:23.565387+0000","last_peered":"2023-11-28T20:38:23.565387+0000","last_clean":"2023-11-28T20:38:23.565387+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:23.565387+0000","last_undegraded":"2023-11-28T20:38:23.565387+0000","last_fullsized":"2023-11-28T20:38:23.565387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523851+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:38:24.523851+0000","last_peered":"2023-11-28T20:38:24.523851+0000","last_clean":"2023-11-28T20:38:24.523851+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:38:24.523851+0000","last_undegraded":"2023-11-28T20:38:24.523851+0000","last_fullsized":"2023-11-28T20:38:24.523851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344511+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:24.344511+0000","last_peered":"2023-11-28T20:38:24.344511+0000","last_clean":"2023-11-28T20:38:24.344511+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:24.344511+0000","last_undegraded":"2023-11-28T20:38:24.344511+0000","last_fullsized":"2023-11-28T20:38:24.344511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571440+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:38:23.571440+0000","last_peered":"2023-11-28T20:38:23.571440+0000","last_clean":"2023-11-28T20:38:23.571440+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:38:23.571440+0000","last_undegraded":"2023-11-28T20:38:23.571440+0000","last_fullsized":"2023-11-28T20:38:23.571440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564701+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:23.564701+0000","last_peered":"2023-11-28T20:38:23.564701+0000","last_clean":"2023-11-28T20:38:23.564701+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:23.564701+0000","last_undegraded":"2023-11-28T20:38:23.564701+0000","last_fullsized":"2023-11-28T20:38:23.564701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351748+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:24.351748+0000","last_peered":"2023-11-28T20:38:24.351748+0000","last_clean":"2023-11-28T20:38:24.351748+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:24.351748+0000","last_undegraded":"2023-11-28T20:38:24.351748+0000","last_fullsized":"2023-11-28T20:38:24.351748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556007+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:38:23.556007+0000","last_peered":"2023-11-28T20:38:23.556007+0000","last_clean":"2023-11-28T20:38:23.556007+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:38:23.556007+0000","last_undegraded":"2023-11-28T20:38:23.556007+0000","last_fullsized":"2023-11-28T20:38:23.556007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555641+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:38:23.555641+0000","last_peered":"2023-11-28T20:38:23.555641+0000","last_clean":"2023-11-28T20:38:23.555641+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:38:23.555641+0000","last_undegraded":"2023-11-28T20:38:23.555641+0000","last_fullsized":"2023-11-28T20:38:23.555641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350688+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:24.350688+0000","last_peered":"2023-11-28T20:38:24.350688+0000","last_clean":"2023-11-28T20:38:24.350688+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:24.350688+0000","last_undegraded":"2023-11-28T20:38:24.350688+0000","last_fullsized":"2023-11-28T20:38:24.350688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561439+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:23.561439+0000","last_peered":"2023-11-28T20:38:23.561439+0000","last_clean":"2023-11-28T20:38:23.561439+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:23.561439+0000","last_undegraded":"2023-11-28T20:38:23.561439+0000","last_fullsized":"2023-11-28T20:38:23.561439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534500+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:38:24.534500+0000","last_peered":"2023-11-28T20:38:24.534500+0000","last_clean":"2023-11-28T20:38:24.534500+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:38:24.534500+0000","last_undegraded":"2023-11-28T20:38:24.534500+0000","last_fullsized":"2023-11-28T20:38:24.534500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.579080+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:38:45.579080+0000","last_peered":"2023-11-28T20:38:45.579080+0000","last_clean":"2023-11-28T20:38:45.579080+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:38:45.579080+0000","last_undegraded":"2023-11-28T20:38:45.579080+0000","last_fullsized":"2023-11-28T20:38:45.579080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.588393+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:23.588393+0000","last_peered":"2023-11-28T20:38:23.588393+0000","last_clean":"2023-11-28T20:38:23.588393+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:23.588393+0000","last_undegraded":"2023-11-28T20:38:23.588393+0000","last_fullsized":"2023-11-28T20:38:23.588393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524719+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:38:24.524719+0000","last_peered":"2023-11-28T20:38:24.524719+0000","last_clean":"2023-11-28T20:38:24.524719+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:38:24.524719+0000","last_undegraded":"2023-11-28T20:38:24.524719+0000","last_fullsized":"2023-11-28T20:38:24.524719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563172+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:23.563172+0000","last_peered":"2023-11-28T20:38:23.563172+0000","last_clean":"2023-11-28T20:38:23.563172+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:23.563172+0000","last_undegraded":"2023-11-28T20:38:23.563172+0000","last_fullsized":"2023-11-28T20:38:23.563172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579796+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:38:23.579796+0000","last_peered":"2023-11-28T20:38:23.579796+0000","last_clean":"2023-11-28T20:38:23.579796+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:38:23.579796+0000","last_undegraded":"2023-11-28T20:38:23.579796+0000","last_fullsized":"2023-11-28T20:38:23.579796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559655+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:23.559655+0000","last_peered":"2023-11-28T20:38:23.559655+0000","last_clean":"2023-11-28T20:38:23.559655+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:23.559655+0000","last_undegraded":"2023-11-28T20:38:23.559655+0000","last_fullsized":"2023-11-28T20:38:23.559655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561367+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:23.561367+0000","last_peered":"2023-11-28T20:38:23.561367+0000","last_clean":"2023-11-28T20:38:23.561367+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:23.561367+0000","last_undegraded":"2023-11-28T20:38:23.561367+0000","last_fullsized":"2023-11-28T20:38:23.561367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556118+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:38:23.556118+0000","last_peered":"2023-11-28T20:38:23.556118+0000","last_clean":"2023-11-28T20:38:23.556118+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:38:23.556118+0000","last_undegraded":"2023-11-28T20:38:23.556118+0000","last_fullsized":"2023-11-28T20:38:23.556118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579390+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:38:23.579390+0000","last_peered":"2023-11-28T20:38:23.579390+0000","last_clean":"2023-11-28T20:38:23.579390+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:38:23.579390+0000","last_undegraded":"2023-11-28T20:38:23.579390+0000","last_fullsized":"2023-11-28T20:38:23.579390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.567024+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:23.567024+0000","last_peered":"2023-11-28T20:38:23.567024+0000","last_clean":"2023-11-28T20:38:23.567024+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:23.567024+0000","last_undegraded":"2023-11-28T20:38:23.567024+0000","last_fullsized":"2023-11-28T20:38:23.567024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556268+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:38:23.556268+0000","last_peered":"2023-11-28T20:38:23.556268+0000","last_clean":"2023-11-28T20:38:23.556268+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:38:23.556268+0000","last_undegraded":"2023-11-28T20:38:23.556268+0000","last_fullsized":"2023-11-28T20:38:23.556268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564684+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:23.564684+0000","last_peered":"2023-11-28T20:38:23.564684+0000","last_clean":"2023-11-28T20:38:23.564684+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:23.564684+0000","last_undegraded":"2023-11-28T20:38:23.564684+0000","last_fullsized":"2023-11-28T20:38:23.564684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555549+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:38:23.555549+0000","last_peered":"2023-11-28T20:38:23.555549+0000","last_clean":"2023-11-28T20:38:23.555549+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:38:23.555549+0000","last_undegraded":"2023-11-28T20:38:23.555549+0000","last_fullsized":"2023-11-28T20:38:23.555549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559455+0000","last_change":"2023-11-28T20:38:19.391161+0000","last_active":"2023-11-28T20:38:23.559455+0000","last_peered":"2023-11-28T20:38:23.559455+0000","last_clean":"2023-11-28T20:38:23.559455+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:38:23.559455+0000","last_undegraded":"2023-11-28T20:38:23.559455+0000","last_fullsized":"2023-11-28T20:38:23.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:29.088707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561269+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:23.561269+0000","last_peered":"2023-11-28T20:38:23.561269+0000","last_clean":"2023-11-28T20:38:23.561269+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:23.561269+0000","last_undegraded":"2023-11-28T20:38:23.561269+0000","last_fullsized":"2023-11-28T20:38:23.561269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.565066+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:23.565066+0000","last_peered":"2023-11-28T20:38:23.565066+0000","last_clean":"2023-11-28T20:38:23.565066+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:23.565066+0000","last_undegraded":"2023-11-28T20:38:23.565066+0000","last_fullsized":"2023-11-28T20:38:23.565066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.772001+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:23.772001+0000","last_peered":"2023-11-28T20:38:23.772001+0000","last_clean":"2023-11-28T20:38:23.772001+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:23.772001+0000","last_undegraded":"2023-11-28T20:38:23.772001+0000","last_fullsized":"2023-11-28T20:38:23.772001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.583087+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:38:23.583087+0000","last_peered":"2023-11-28T20:38:23.583087+0000","last_clean":"2023-11-28T20:38:23.583087+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:38:23.583087+0000","last_undegraded":"2023-11-28T20:38:23.583087+0000","last_fullsized":"2023-11-28T20:38:23.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560491+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:23.560491+0000","last_peered":"2023-11-28T20:38:23.560491+0000","last_clean":"2023-11-28T20:38:23.560491+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:23.560491+0000","last_undegraded":"2023-11-28T20:38:23.560491+0000","last_fullsized":"2023-11-28T20:38:23.560491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564469+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:23.564469+0000","last_peered":"2023-11-28T20:38:23.564469+0000","last_clean":"2023-11-28T20:38:23.564469+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:23.564469+0000","last_undegraded":"2023-11-28T20:38:23.564469+0000","last_fullsized":"2023-11-28T20:38:23.564469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571449+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:38:23.571449+0000","last_peered":"2023-11-28T20:38:23.571449+0000","last_clean":"2023-11-28T20:38:23.571449+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:38:23.571449+0000","last_undegraded":"2023-11-28T20:38:23.571449+0000","last_fullsized":"2023-11-28T20:38:23.571449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560649+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:23.560649+0000","last_peered":"2023-11-28T20:38:23.560649+0000","last_clean":"2023-11-28T20:38:23.560649+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:23.560649+0000","last_undegraded":"2023-11-28T20:38:23.560649+0000","last_fullsized":"2023-11-28T20:38:23.560649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556123+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:38:23.556123+0000","last_peered":"2023-11-28T20:38:23.556123+0000","last_clean":"2023-11-28T20:38:23.556123+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:38:23.556123+0000","last_undegraded":"2023-11-28T20:38:23.556123+0000","last_fullsized":"2023-11-28T20:38:23.556123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571565+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:23.571565+0000","last_peered":"2023-11-28T20:38:23.571565+0000","last_clean":"2023-11-28T20:38:23.571565+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:23.571565+0000","last_undegraded":"2023-11-28T20:38:23.571565+0000","last_fullsized":"2023-11-28T20:38:23.571565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563921+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:23.563921+0000","last_peered":"2023-11-28T20:38:23.563921+0000","last_clean":"2023-11-28T20:38:23.563921+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:23.563921+0000","last_undegraded":"2023-11-28T20:38:23.563921+0000","last_fullsized":"2023-11-28T20:38:23.563921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.566792+0000","last_change":"2023-11-28T20:38:19.399387+0000","last_active":"2023-11-28T20:38:23.566792+0000","last_peered":"2023-11-28T20:38:23.566792+0000","last_clean":"2023-11-28T20:38:23.566792+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:23.566792+0000","last_undegraded":"2023-11-28T20:38:23.566792+0000","last_fullsized":"2023-11-28T20:38:23.566792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:19:33.795318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771738+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:23.771738+0000","last_peered":"2023-11-28T20:38:23.771738+0000","last_clean":"2023-11-28T20:38:23.771738+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:23.771738+0000","last_undegraded":"2023-11-28T20:38:23.771738+0000","last_fullsized":"2023-11-28T20:38:23.771738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.554837+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:38:23.554837+0000","last_peered":"2023-11-28T20:38:23.554837+0000","last_clean":"2023-11-28T20:38:23.554837+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:38:23.554837+0000","last_undegraded":"2023-11-28T20:38:23.554837+0000","last_fullsized":"2023-11-28T20:38:23.554837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770651+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:23.770651+0000","last_peered":"2023-11-28T20:38:23.770651+0000","last_clean":"2023-11-28T20:38:23.770651+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:23.770651+0000","last_undegraded":"2023-11-28T20:38:23.770651+0000","last_fullsized":"2023-11-28T20:38:23.770651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559229+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:23.559229+0000","last_peered":"2023-11-28T20:38:23.559229+0000","last_clean":"2023-11-28T20:38:23.559229+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:23.559229+0000","last_undegraded":"2023-11-28T20:38:23.559229+0000","last_fullsized":"2023-11-28T20:38:23.559229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771010+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:23.771010+0000","last_peered":"2023-11-28T20:38:23.771010+0000","last_clean":"2023-11-28T20:38:23.771010+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:23.771010+0000","last_undegraded":"2023-11-28T20:38:23.771010+0000","last_fullsized":"2023-11-28T20:38:23.771010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560781+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:23.560781+0000","last_peered":"2023-11-28T20:38:23.560781+0000","last_clean":"2023-11-28T20:38:23.560781+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:23.560781+0000","last_undegraded":"2023-11-28T20:38:23.560781+0000","last_fullsized":"2023-11-28T20:38:23.560781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561319+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:23.561319+0000","last_peered":"2023-11-28T20:38:23.561319+0000","last_clean":"2023-11-28T20:38:23.561319+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:23.561319+0000","last_undegraded":"2023-11-28T20:38:23.561319+0000","last_fullsized":"2023-11-28T20:38:23.561319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.580170+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:38:23.580170+0000","last_peered":"2023-11-28T20:38:23.580170+0000","last_clean":"2023-11-28T20:38:23.580170+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:38:23.580170+0000","last_undegraded":"2023-11-28T20:38:23.580170+0000","last_fullsized":"2023-11-28T20:38:23.580170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771481+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:23.771481+0000","last_peered":"2023-11-28T20:38:23.771481+0000","last_clean":"2023-11-28T20:38:23.771481+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:23.771481+0000","last_undegraded":"2023-11-28T20:38:23.771481+0000","last_fullsized":"2023-11-28T20:38:23.771481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5955,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":11300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":58,"ondisk_log_size":58,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":102025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":102185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":856064,"data_stored":692975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":102115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":102151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:38:48.447 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:38:48.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0d06157640 1 Processor -- start 2023-11-28T20:38:48.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0d06157640 1 -- start start 2023-11-28T20:38:48.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0d06157640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d000cfc40 0x7f0d000cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0d06157640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0015ac00 con 0x7f0d000cf860 2023-11-28T20:38:48.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0d06157640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d000cbd60 con 0x7f0d00153ae0 2023-11-28T20:38:48.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0d06157640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d00159ff0 con 0x7f0d000cfc40 2023-11-28T20:38:48.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0cfeffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d000cfc40 0x7f0d000cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0cff7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0d000cf860 0x7f0d000ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44732/0 (socket says 172.21.15.167:44732) 2023-11-28T20:38:48.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0cff7fe640 1 -- 172.21.15.167:0/2953992547 learned_addr learned my addr 172.21.15.167:0/2953992547 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:48.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0cfeffd640 1 -- 172.21.15.167:0/2953992547 >> v1:172.21.15.178:6789/0 conn(0x7f0d00153ae0 legacy=0x7f0d0015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0cfeffd640 1 -- 172.21.15.167:0/2953992547 >> v1:172.21.15.167:6789/0 conn(0x7f0d000cf860 legacy=0x7f0d000ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0cfeffd640 1 -- 172.21.15.167:0/2953992547 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0015a2d0 con 0x7f0d000cfc40 2023-11-28T20:38:48.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.616+0000 7f0cfe7fc640 1 -- 172.21.15.167:0/2953992547 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739555586 0 0) 0x7f0d0015ac00 con 0x7f0d000cf860 2023-11-28T20:38:48.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0cfeffd640 1 --2- 172.21.15.167:0/2953992547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d000cfc40 0x7f0d000cb770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40097c0 tx=0x7f0cf401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909167b5b21c3acc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:48.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0cfe7fc640 1 -- 172.21.15.167:0/2953992547 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40ab650 con 0x7f0d000cfc40 2023-11-28T20:38:48.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0cfe7fc640 1 -- 172.21.15.167:0/2953992547 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf40ab7b0 con 0x7f0d000cfc40 2023-11-28T20:38:48.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0cfe7fc640 1 -- 172.21.15.167:0/2953992547 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40abb40 con 0x7f0d000cfc40 2023-11-28T20:38:48.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0d06157640 1 -- 172.21.15.167:0/2953992547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d000cfc40 msgr2=0x7f0d000cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0d06157640 1 --2- 172.21.15.167:0/2953992547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d000cfc40 0x7f0d000cb770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40097c0 tx=0x7f0cf401c450 comp rx=0 tx=0).stop 2023-11-28T20:38:48.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0d06157640 1 -- 172.21.15.167:0/2953992547 shutdown_connections 2023-11-28T20:38:48.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0d06157640 1 --2- 172.21.15.167:0/2953992547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d000cfc40 0x7f0d000cb770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0d06157640 1 -- 172.21.15.167:0/2953992547 >> 172.21.15.167:0/2953992547 conn(0x7f0d0006c1f0 msgr2=0x7f0d00071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:48.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0d06157640 1 -- 172.21.15.167:0/2953992547 shutdown_connections 2023-11-28T20:38:48.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.620+0000 7f0d06157640 1 -- 172.21.15.167:0/2953992547 wait complete. 2023-11-28T20:38:48.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 Processor -- start 2023-11-28T20:38:48.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 -- start start 2023-11-28T20:38:48.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000cf860 0x7f0d00139fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000cfc40 0x7f0d0013a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d00153ae0 0x7f0d00157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000b5110 con 0x7f0d00153ae0 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001f4120 con 0x7f0d000cfc40 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0015d9b0 con 0x7f0d000cf860 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d00153ae0 0x7f0d00157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d00153ae0 0x7f0d00157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47080/0 (socket says 172.21.15.167:47080) 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfffff640 1 -- 172.21.15.167:0/1988576932 learned_addr learned my addr 172.21.15.167:0/1988576932 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfeffd640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000cfc40 0x7f0d0013a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cff7fe640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000cf860 0x7f0d00139fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfffff640 1 -- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000cf860 msgr2=0x7f0d00139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfffff640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000cf860 0x7f0d00139fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfffff640 1 -- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000cfc40 msgr2=0x7f0d0013a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfffff640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000cfc40 0x7f0d0013a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfffff640 1 -- 172.21.15.167:0/1988576932 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4009420 con 0x7f0d00153ae0 2023-11-28T20:38:48.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cff7fe640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000cf860 0x7f0d00139fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:48.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0cfffff640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d00153ae0 0x7f0d00157b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c770 tx=0x7f0cf800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:48.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0ce7fff640 1 -- 172.21.15.167:0/1988576932 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8003b80 con 0x7f0d00153ae0 2023-11-28T20:38:48.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0ce7fff640 1 -- 172.21.15.167:0/1988576932 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf8003ce0 con 0x7f0d00153ae0 2023-11-28T20:38:48.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d00150db0 con 0x7f0d00153ae0 2023-11-28T20:38:48.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0ce7fff640 1 -- 172.21.15.167:0/1988576932 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800aa90 con 0x7f0d00153ae0 2023-11-28T20:38:48.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d00151050 con 0x7f0d00153ae0 2023-11-28T20:38:48.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.624+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d00075c90 con 0x7f0d00153ae0 2023-11-28T20:38:48.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.628+0000 7f0ce7fff640 1 -- 172.21.15.167:0/1988576932 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0cf800abf0 con 0x7f0d00153ae0 2023-11-28T20:38:48.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.628+0000 7f0ce7fff640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cec066470 0x7f0cec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:48.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.628+0000 7f0ce7fff640 1 -- 172.21.15.167:0/1988576932 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cf8083fe0 con 0x7f0d00153ae0 2023-11-28T20:38:48.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.628+0000 7f0cff7fe640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cec066470 0x7f0cec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:48.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.628+0000 7f0cff7fe640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cec066470 0x7f0cec068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0000f70 tx=0x7f0cf0007dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:48.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.632+0000 7f0ce7fff640 1 -- 172.21.15.167:0/1988576932 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0cf80510a0 con 0x7f0d00153ae0 2023-11-28T20:38:48.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.780+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d00154300 con 0x7f0cec066470 2023-11-28T20:38:48.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.804+0000 7f0ce7fff640 1 -- 172.21.15.167:0/1988576932 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345266 (secure 0 0 0) 0x7f0cf00075a0 con 0x7f0cec066470 2023-11-28T20:38:48.811 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:48.813 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:38:48.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cec066470 msgr2=0x7f0cec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cec066470 0x7f0cec068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0000f70 tx=0x7f0cf0007dd0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d00153ae0 msgr2=0x7f0d00157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d00153ae0 0x7f0d00157b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c770 tx=0x7f0cf800cc30 comp rx=0 tx=0).stop 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 shutdown_connections 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cec066470 0x7f0cec068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d00153ae0 0x7f0d00157b70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000cfc40 0x7f0d0013a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 --2- 172.21.15.167:0/1988576932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000cf860 0x7f0d00139fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 >> 172.21.15.167:0/1988576932 conn(0x7f0d0006c1f0 msgr2=0x7f0d000cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 shutdown_connections 2023-11-28T20:38:48.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:48.808+0000 7f0d06157640 1 -- 172.21.15.167:0/1988576932 wait complete. 2023-11-28T20:38:48.831 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-11-28T20:38:47.438542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596323,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":224,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236056,"kb_used_data":3248,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738664,"statfs":{"total":773094113280,"available":772852391936,"internally_reserved":0,"allocated":3325952,"data_stored":2006836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3545,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004906"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528906+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:24.528906+0000","last_peered":"2023-11-28T20:38:24.528906+0000","last_clean":"2023-11-28T20:38:24.528906+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:24.528906+0000","last_undegraded":"2023-11-28T20:38:24.528906+0000","last_fullsized":"2023-11-28T20:38:24.528906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555618+0000","last_change":"2023-11-28T20:38:19.384120+0000","last_active":"2023-11-28T20:38:23.555618+0000","last_peered":"2023-11-28T20:38:23.555618+0000","last_clean":"2023-11-28T20:38:23.555618+0000","last_became_active":"2023-11-28T20:38:19.383899+0000","last_became_peered":"2023-11-28T20:38:19.383899+0000","last_unstale":"2023-11-28T20:38:23.555618+0000","last_undegraded":"2023-11-28T20:38:23.555618+0000","last_fullsized":"2023-11-28T20:38:23.555618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:02:32.168294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523700+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:38:24.523700+0000","last_peered":"2023-11-28T20:38:24.523700+0000","last_clean":"2023-11-28T20:38:24.523700+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:38:24.523700+0000","last_undegraded":"2023-11-28T20:38:24.523700+0000","last_fullsized":"2023-11-28T20:38:24.523700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524795+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:38:24.524795+0000","last_peered":"2023-11-28T20:38:24.524795+0000","last_clean":"2023-11-28T20:38:24.524795+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:38:24.524795+0000","last_undegraded":"2023-11-28T20:38:24.524795+0000","last_fullsized":"2023-11-28T20:38:24.524795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562919+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:23.562919+0000","last_peered":"2023-11-28T20:38:23.562919+0000","last_clean":"2023-11-28T20:38:23.562919+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:23.562919+0000","last_undegraded":"2023-11-28T20:38:23.562919+0000","last_fullsized":"2023-11-28T20:38:23.562919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527387+0000","last_change":"2023-11-28T20:38:23.600077+0000","last_active":"2023-11-28T20:38:24.527387+0000","last_peered":"2023-11-28T20:38:24.527387+0000","last_clean":"2023-11-28T20:38:24.527387+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:24.527387+0000","last_undegraded":"2023-11-28T20:38:24.527387+0000","last_fullsized":"2023-11-28T20:38:24.527387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:39.002909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532607+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:24.532607+0000","last_peered":"2023-11-28T20:38:24.532607+0000","last_clean":"2023-11-28T20:38:24.532607+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:24.532607+0000","last_undegraded":"2023-11-28T20:38:24.532607+0000","last_fullsized":"2023-11-28T20:38:24.532607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560982+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:23.560982+0000","last_peered":"2023-11-28T20:38:23.560982+0000","last_clean":"2023-11-28T20:38:23.560982+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:23.560982+0000","last_undegraded":"2023-11-28T20:38:23.560982+0000","last_fullsized":"2023-11-28T20:38:23.560982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529343+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:24.529343+0000","last_peered":"2023-11-28T20:38:24.529343+0000","last_clean":"2023-11-28T20:38:24.529343+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:24.529343+0000","last_undegraded":"2023-11-28T20:38:24.529343+0000","last_fullsized":"2023-11-28T20:38:24.529343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532210+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532210+0000","last_peered":"2023-11-28T20:38:24.532210+0000","last_clean":"2023-11-28T20:38:24.532210+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532210+0000","last_undegraded":"2023-11-28T20:38:24.532210+0000","last_fullsized":"2023-11-28T20:38:24.532210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562448+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:23.562448+0000","last_peered":"2023-11-28T20:38:23.562448+0000","last_clean":"2023-11-28T20:38:23.562448+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:23.562448+0000","last_undegraded":"2023-11-28T20:38:23.562448+0000","last_fullsized":"2023-11-28T20:38:23.562448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528969+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:24.528969+0000","last_peered":"2023-11-28T20:38:24.528969+0000","last_clean":"2023-11-28T20:38:24.528969+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:24.528969+0000","last_undegraded":"2023-11-28T20:38:24.528969+0000","last_fullsized":"2023-11-28T20:38:24.528969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563714+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:23.563714+0000","last_peered":"2023-11-28T20:38:23.563714+0000","last_clean":"2023-11-28T20:38:23.563714+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:23.563714+0000","last_undegraded":"2023-11-28T20:38:23.563714+0000","last_fullsized":"2023-11-28T20:38:23.563714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574248+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:45.574248+0000","last_peered":"2023-11-28T20:38:45.574248+0000","last_clean":"2023-11-28T20:38:45.574248+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:45.574248+0000","last_undegraded":"2023-11-28T20:38:45.574248+0000","last_fullsized":"2023-11-28T20:38:45.574248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530149+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:24.530149+0000","last_peered":"2023-11-28T20:38:24.530149+0000","last_clean":"2023-11-28T20:38:24.530149+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:24.530149+0000","last_undegraded":"2023-11-28T20:38:24.530149+0000","last_fullsized":"2023-11-28T20:38:24.530149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556220+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:38:23.556220+0000","last_peered":"2023-11-28T20:38:23.556220+0000","last_clean":"2023-11-28T20:38:23.556220+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:38:23.556220+0000","last_undegraded":"2023-11-28T20:38:23.556220+0000","last_fullsized":"2023-11-28T20:38:23.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571843+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:38:23.571843+0000","last_peered":"2023-11-28T20:38:23.571843+0000","last_clean":"2023-11-28T20:38:23.571843+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:38:23.571843+0000","last_undegraded":"2023-11-28T20:38:23.571843+0000","last_fullsized":"2023-11-28T20:38:23.571843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529638+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:24.529638+0000","last_peered":"2023-11-28T20:38:24.529638+0000","last_clean":"2023-11-28T20:38:24.529638+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:24.529638+0000","last_undegraded":"2023-11-28T20:38:24.529638+0000","last_fullsized":"2023-11-28T20:38:24.529638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556959+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:38:23.556959+0000","last_peered":"2023-11-28T20:38:23.556959+0000","last_clean":"2023-11-28T20:38:23.556959+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:38:23.556959+0000","last_undegraded":"2023-11-28T20:38:23.556959+0000","last_fullsized":"2023-11-28T20:38:23.556959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.554096+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:38:45.554096+0000","last_peered":"2023-11-28T20:38:45.554096+0000","last_clean":"2023-11-28T20:38:45.554096+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:38:45.554096+0000","last_undegraded":"2023-11-28T20:38:45.554096+0000","last_fullsized":"2023-11-28T20:38:45.554096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535771+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.535771+0000","last_peered":"2023-11-28T20:38:24.535771+0000","last_clean":"2023-11-28T20:38:24.535771+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:38:24.535771+0000","last_undegraded":"2023-11-28T20:38:24.535771+0000","last_fullsized":"2023-11-28T20:38:24.535771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.585068+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:23.585068+0000","last_peered":"2023-11-28T20:38:23.585068+0000","last_clean":"2023-11-28T20:38:23.585068+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:23.585068+0000","last_undegraded":"2023-11-28T20:38:23.585068+0000","last_fullsized":"2023-11-28T20:38:23.585068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574872+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:45.574872+0000","last_peered":"2023-11-28T20:38:45.574872+0000","last_clean":"2023-11-28T20:38:45.574872+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:45.574872+0000","last_undegraded":"2023-11-28T20:38:45.574872+0000","last_fullsized":"2023-11-28T20:38:45.574872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530157+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:24.530157+0000","last_peered":"2023-11-28T20:38:24.530157+0000","last_clean":"2023-11-28T20:38:24.530157+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:24.530157+0000","last_undegraded":"2023-11-28T20:38:24.530157+0000","last_fullsized":"2023-11-28T20:38:24.530157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561892+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:23.561892+0000","last_peered":"2023-11-28T20:38:23.561892+0000","last_clean":"2023-11-28T20:38:23.561892+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:23.561892+0000","last_undegraded":"2023-11-28T20:38:23.561892+0000","last_fullsized":"2023-11-28T20:38:23.561892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531914+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:24.531914+0000","last_peered":"2023-11-28T20:38:24.531914+0000","last_clean":"2023-11-28T20:38:24.531914+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:24.531914+0000","last_undegraded":"2023-11-28T20:38:24.531914+0000","last_fullsized":"2023-11-28T20:38:24.531914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528204+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:24.528204+0000","last_peered":"2023-11-28T20:38:24.528204+0000","last_clean":"2023-11-28T20:38:24.528204+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:24.528204+0000","last_undegraded":"2023-11-28T20:38:24.528204+0000","last_fullsized":"2023-11-28T20:38:24.528204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556394+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:38:23.556394+0000","last_peered":"2023-11-28T20:38:23.556394+0000","last_clean":"2023-11-28T20:38:23.556394+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:38:23.556394+0000","last_undegraded":"2023-11-28T20:38:23.556394+0000","last_fullsized":"2023-11-28T20:38:23.556394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535703+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:38:24.535703+0000","last_peered":"2023-11-28T20:38:24.535703+0000","last_clean":"2023-11-28T20:38:24.535703+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:38:24.535703+0000","last_undegraded":"2023-11-28T20:38:24.535703+0000","last_fullsized":"2023-11-28T20:38:24.535703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523623+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:38:24.523623+0000","last_peered":"2023-11-28T20:38:24.523623+0000","last_clean":"2023-11-28T20:38:24.523623+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:38:24.523623+0000","last_undegraded":"2023-11-28T20:38:24.523623+0000","last_fullsized":"2023-11-28T20:38:24.523623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572645+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:38:23.572645+0000","last_peered":"2023-11-28T20:38:23.572645+0000","last_clean":"2023-11-28T20:38:23.572645+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:38:23.572645+0000","last_undegraded":"2023-11-28T20:38:23.572645+0000","last_fullsized":"2023-11-28T20:38:23.572645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528499+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:24.528499+0000","last_peered":"2023-11-28T20:38:24.528499+0000","last_clean":"2023-11-28T20:38:24.528499+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:24.528499+0000","last_undegraded":"2023-11-28T20:38:24.528499+0000","last_fullsized":"2023-11-28T20:38:24.528499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344337+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:24.344337+0000","last_peered":"2023-11-28T20:38:24.344337+0000","last_clean":"2023-11-28T20:38:24.344337+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:24.344337+0000","last_undegraded":"2023-11-28T20:38:24.344337+0000","last_fullsized":"2023-11-28T20:38:24.344337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562716+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:23.562716+0000","last_peered":"2023-11-28T20:38:23.562716+0000","last_clean":"2023-11-28T20:38:23.562716+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:23.562716+0000","last_undegraded":"2023-11-28T20:38:23.562716+0000","last_fullsized":"2023-11-28T20:38:23.562716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572746+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:38:23.572746+0000","last_peered":"2023-11-28T20:38:23.572746+0000","last_clean":"2023-11-28T20:38:23.572746+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:38:23.572746+0000","last_undegraded":"2023-11-28T20:38:23.572746+0000","last_fullsized":"2023-11-28T20:38:23.572746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535102+0000","last_change":"2023-11-28T20:38:23.594782+0000","last_active":"2023-11-28T20:38:24.535102+0000","last_peered":"2023-11-28T20:38:24.535102+0000","last_clean":"2023-11-28T20:38:24.535102+0000","last_became_active":"2023-11-28T20:38:23.594034+0000","last_became_peered":"2023-11-28T20:38:23.594034+0000","last_unstale":"2023-11-28T20:38:24.535102+0000","last_undegraded":"2023-11-28T20:38:24.535102+0000","last_fullsized":"2023-11-28T20:38:24.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:29:14.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.581982+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:23.581982+0000","last_peered":"2023-11-28T20:38:23.581982+0000","last_clean":"2023-11-28T20:38:23.581982+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:23.581982+0000","last_undegraded":"2023-11-28T20:38:23.581982+0000","last_fullsized":"2023-11-28T20:38:23.581982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560074+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:23.560074+0000","last_peered":"2023-11-28T20:38:23.560074+0000","last_clean":"2023-11-28T20:38:23.560074+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:23.560074+0000","last_undegraded":"2023-11-28T20:38:23.560074+0000","last_fullsized":"2023-11-28T20:38:23.560074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535460+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:38:24.535460+0000","last_peered":"2023-11-28T20:38:24.535460+0000","last_clean":"2023-11-28T20:38:24.535460+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:38:24.535460+0000","last_undegraded":"2023-11-28T20:38:24.535460+0000","last_fullsized":"2023-11-28T20:38:24.535460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571588+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:38:23.571588+0000","last_peered":"2023-11-28T20:38:23.571588+0000","last_clean":"2023-11-28T20:38:23.571588+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:38:23.571588+0000","last_undegraded":"2023-11-28T20:38:23.571588+0000","last_fullsized":"2023-11-28T20:38:23.571588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534096+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:38:24.534096+0000","last_peered":"2023-11-28T20:38:24.534096+0000","last_clean":"2023-11-28T20:38:24.534096+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:38:24.534096+0000","last_undegraded":"2023-11-28T20:38:24.534096+0000","last_fullsized":"2023-11-28T20:38:24.534096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535820+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:38:24.535820+0000","last_peered":"2023-11-28T20:38:24.535820+0000","last_clean":"2023-11-28T20:38:24.535820+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:38:24.535820+0000","last_undegraded":"2023-11-28T20:38:24.535820+0000","last_fullsized":"2023-11-28T20:38:24.535820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560814+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:23.560814+0000","last_peered":"2023-11-28T20:38:23.560814+0000","last_clean":"2023-11-28T20:38:23.560814+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:23.560814+0000","last_undegraded":"2023-11-28T20:38:23.560814+0000","last_fullsized":"2023-11-28T20:38:23.560814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770415+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:23.770415+0000","last_peered":"2023-11-28T20:38:23.770415+0000","last_clean":"2023-11-28T20:38:23.770415+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:23.770415+0000","last_undegraded":"2023-11-28T20:38:23.770415+0000","last_fullsized":"2023-11-28T20:38:23.770415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344627+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:24.344627+0000","last_peered":"2023-11-28T20:38:24.344627+0000","last_clean":"2023-11-28T20:38:24.344627+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:24.344627+0000","last_undegraded":"2023-11-28T20:38:24.344627+0000","last_fullsized":"2023-11-28T20:38:24.344627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555061+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:38:23.555061+0000","last_peered":"2023-11-28T20:38:23.555061+0000","last_clean":"2023-11-28T20:38:23.555061+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:38:23.555061+0000","last_undegraded":"2023-11-28T20:38:23.555061+0000","last_fullsized":"2023-11-28T20:38:23.555061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.567796+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:23.567796+0000","last_peered":"2023-11-28T20:38:23.567796+0000","last_clean":"2023-11-28T20:38:23.567796+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:23.567796+0000","last_undegraded":"2023-11-28T20:38:23.567796+0000","last_fullsized":"2023-11-28T20:38:23.567796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770661+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:23.770661+0000","last_peered":"2023-11-28T20:38:23.770661+0000","last_clean":"2023-11-28T20:38:23.770661+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:23.770661+0000","last_undegraded":"2023-11-28T20:38:23.770661+0000","last_fullsized":"2023-11-28T20:38:23.770661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351420+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:24.351420+0000","last_peered":"2023-11-28T20:38:24.351420+0000","last_clean":"2023-11-28T20:38:24.351420+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:24.351420+0000","last_undegraded":"2023-11-28T20:38:24.351420+0000","last_fullsized":"2023-11-28T20:38:24.351420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771541+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:23.771541+0000","last_peered":"2023-11-28T20:38:23.771541+0000","last_clean":"2023-11-28T20:38:23.771541+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:23.771541+0000","last_undegraded":"2023-11-28T20:38:23.771541+0000","last_fullsized":"2023-11-28T20:38:23.771541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.582714+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:38:23.582714+0000","last_peered":"2023-11-28T20:38:23.582714+0000","last_clean":"2023-11-28T20:38:23.582714+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:38:23.582714+0000","last_undegraded":"2023-11-28T20:38:23.582714+0000","last_fullsized":"2023-11-28T20:38:23.582714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350832+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:24.350832+0000","last_peered":"2023-11-28T20:38:24.350832+0000","last_clean":"2023-11-28T20:38:24.350832+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:24.350832+0000","last_undegraded":"2023-11-28T20:38:24.350832+0000","last_fullsized":"2023-11-28T20:38:24.350832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561174+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:23.561174+0000","last_peered":"2023-11-28T20:38:23.561174+0000","last_clean":"2023-11-28T20:38:23.561174+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:23.561174+0000","last_undegraded":"2023-11-28T20:38:23.561174+0000","last_fullsized":"2023-11-28T20:38:23.561174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.533486+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:38:24.533486+0000","last_peered":"2023-11-28T20:38:24.533486+0000","last_clean":"2023-11-28T20:38:24.533486+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:38:24.533486+0000","last_undegraded":"2023-11-28T20:38:24.533486+0000","last_fullsized":"2023-11-28T20:38:24.533486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344212+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:24.344212+0000","last_peered":"2023-11-28T20:38:24.344212+0000","last_clean":"2023-11-28T20:38:24.344212+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:24.344212+0000","last_undegraded":"2023-11-28T20:38:24.344212+0000","last_fullsized":"2023-11-28T20:38:24.344212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771932+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:23.771932+0000","last_peered":"2023-11-28T20:38:23.771932+0000","last_clean":"2023-11-28T20:38:23.771932+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:23.771932+0000","last_undegraded":"2023-11-28T20:38:23.771932+0000","last_fullsized":"2023-11-28T20:38:23.771932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532302+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:38:24.532302+0000","last_peered":"2023-11-28T20:38:24.532302+0000","last_clean":"2023-11-28T20:38:24.532302+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:38:24.532302+0000","last_undegraded":"2023-11-28T20:38:24.532302+0000","last_fullsized":"2023-11-28T20:38:24.532302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348053+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:24.348053+0000","last_peered":"2023-11-28T20:38:24.348053+0000","last_clean":"2023-11-28T20:38:24.348053+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:24.348053+0000","last_undegraded":"2023-11-28T20:38:24.348053+0000","last_fullsized":"2023-11-28T20:38:24.348053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771535+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:23.771535+0000","last_peered":"2023-11-28T20:38:23.771535+0000","last_clean":"2023-11-28T20:38:23.771535+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:23.771535+0000","last_undegraded":"2023-11-28T20:38:23.771535+0000","last_fullsized":"2023-11-28T20:38:23.771535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530364+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:24.530364+0000","last_peered":"2023-11-28T20:38:24.530364+0000","last_clean":"2023-11-28T20:38:24.530364+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:24.530364+0000","last_undegraded":"2023-11-28T20:38:24.530364+0000","last_fullsized":"2023-11-28T20:38:24.530364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527514+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:24.527514+0000","last_peered":"2023-11-28T20:38:24.527514+0000","last_clean":"2023-11-28T20:38:24.527514+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:24.527514+0000","last_undegraded":"2023-11-28T20:38:24.527514+0000","last_fullsized":"2023-11-28T20:38:24.527514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770655+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:23.770655+0000","last_peered":"2023-11-28T20:38:23.770655+0000","last_clean":"2023-11-28T20:38:23.770655+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:23.770655+0000","last_undegraded":"2023-11-28T20:38:23.770655+0000","last_fullsized":"2023-11-28T20:38:23.770655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.572183+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:38:45.572183+0000","last_peered":"2023-11-28T20:38:45.572183+0000","last_clean":"2023-11-28T20:38:45.572183+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:38:45.572183+0000","last_undegraded":"2023-11-28T20:38:45.572183+0000","last_fullsized":"2023-11-28T20:38:45.572183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344497+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:24.344497+0000","last_peered":"2023-11-28T20:38:24.344497+0000","last_clean":"2023-11-28T20:38:24.344497+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:24.344497+0000","last_undegraded":"2023-11-28T20:38:24.344497+0000","last_fullsized":"2023-11-28T20:38:24.344497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563464+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:23.563464+0000","last_peered":"2023-11-28T20:38:23.563464+0000","last_clean":"2023-11-28T20:38:23.563464+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:23.563464+0000","last_undegraded":"2023-11-28T20:38:23.563464+0000","last_fullsized":"2023-11-28T20:38:23.563464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563470+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:23.563470+0000","last_peered":"2023-11-28T20:38:23.563470+0000","last_clean":"2023-11-28T20:38:23.563470+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:23.563470+0000","last_undegraded":"2023-11-28T20:38:23.563470+0000","last_fullsized":"2023-11-28T20:38:23.563470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.525043+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:38:24.525043+0000","last_peered":"2023-11-28T20:38:24.525043+0000","last_clean":"2023-11-28T20:38:24.525043+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:38:24.525043+0000","last_undegraded":"2023-11-28T20:38:24.525043+0000","last_fullsized":"2023-11-28T20:38:24.525043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771026+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:23.771026+0000","last_peered":"2023-11-28T20:38:23.771026+0000","last_clean":"2023-11-28T20:38:23.771026+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:23.771026+0000","last_undegraded":"2023-11-28T20:38:23.771026+0000","last_fullsized":"2023-11-28T20:38:23.771026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559866+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:23.559866+0000","last_peered":"2023-11-28T20:38:23.559866+0000","last_clean":"2023-11-28T20:38:23.559866+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:23.559866+0000","last_undegraded":"2023-11-28T20:38:23.559866+0000","last_fullsized":"2023-11-28T20:38:23.559866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524484+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.524484+0000","last_peered":"2023-11-28T20:38:24.524484+0000","last_clean":"2023-11-28T20:38:24.524484+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:38:24.524484+0000","last_undegraded":"2023-11-28T20:38:24.524484+0000","last_fullsized":"2023-11-28T20:38:24.524484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560744+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:23.560744+0000","last_peered":"2023-11-28T20:38:23.560744+0000","last_clean":"2023-11-28T20:38:23.560744+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:23.560744+0000","last_undegraded":"2023-11-28T20:38:23.560744+0000","last_fullsized":"2023-11-28T20:38:23.560744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528309+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:24.528309+0000","last_peered":"2023-11-28T20:38:24.528309+0000","last_clean":"2023-11-28T20:38:24.528309+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:24.528309+0000","last_undegraded":"2023-11-28T20:38:24.528309+0000","last_fullsized":"2023-11-28T20:38:24.528309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350690+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:24.350690+0000","last_peered":"2023-11-28T20:38:24.350690+0000","last_clean":"2023-11-28T20:38:24.350690+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:24.350690+0000","last_undegraded":"2023-11-28T20:38:24.350690+0000","last_fullsized":"2023-11-28T20:38:24.350690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771288+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:23.771288+0000","last_peered":"2023-11-28T20:38:23.771288+0000","last_clean":"2023-11-28T20:38:23.771288+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:23.771288+0000","last_undegraded":"2023-11-28T20:38:23.771288+0000","last_fullsized":"2023-11-28T20:38:23.771288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:33.736395+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:33.736395+0000","last_peered":"2023-11-28T20:38:33.736395+0000","last_clean":"2023-11-28T20:38:33.736395+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:33.736395+0000","last_undegraded":"2023-11-28T20:38:33.736395+0000","last_fullsized":"2023-11-28T20:38:33.736395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535078+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:38:24.535078+0000","last_peered":"2023-11-28T20:38:24.535078+0000","last_clean":"2023-11-28T20:38:24.535078+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:38:24.535078+0000","last_undegraded":"2023-11-28T20:38:24.535078+0000","last_fullsized":"2023-11-28T20:38:24.535078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571791+0000","last_change":"2023-11-28T20:38:19.398113+0000","last_active":"2023-11-28T20:38:23.571791+0000","last_peered":"2023-11-28T20:38:23.571791+0000","last_clean":"2023-11-28T20:38:23.571791+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:38:23.571791+0000","last_undegraded":"2023-11-28T20:38:23.571791+0000","last_fullsized":"2023-11-28T20:38:23.571791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:08.187641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535609+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:38:24.535609+0000","last_peered":"2023-11-28T20:38:24.535609+0000","last_clean":"2023-11-28T20:38:24.535609+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:38:24.535609+0000","last_undegraded":"2023-11-28T20:38:24.535609+0000","last_fullsized":"2023-11-28T20:38:24.535609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529696+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:24.529696+0000","last_peered":"2023-11-28T20:38:24.529696+0000","last_clean":"2023-11-28T20:38:24.529696+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:24.529696+0000","last_undegraded":"2023-11-28T20:38:24.529696+0000","last_fullsized":"2023-11-28T20:38:24.529696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562967+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:23.562967+0000","last_peered":"2023-11-28T20:38:23.562967+0000","last_clean":"2023-11-28T20:38:23.562967+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:23.562967+0000","last_undegraded":"2023-11-28T20:38:23.562967+0000","last_fullsized":"2023-11-28T20:38:23.562967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559741+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:23.559741+0000","last_peered":"2023-11-28T20:38:23.559741+0000","last_clean":"2023-11-28T20:38:23.559741+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:23.559741+0000","last_undegraded":"2023-11-28T20:38:23.559741+0000","last_fullsized":"2023-11-28T20:38:23.559741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524020+0000","last_change":"2023-11-28T20:38:23.592734+0000","last_active":"2023-11-28T20:38:24.524020+0000","last_peered":"2023-11-28T20:38:24.524020+0000","last_clean":"2023-11-28T20:38:24.524020+0000","last_became_active":"2023-11-28T20:38:23.592348+0000","last_became_peered":"2023-11-28T20:38:23.592348+0000","last_unstale":"2023-11-28T20:38:24.524020+0000","last_undegraded":"2023-11-28T20:38:24.524020+0000","last_fullsized":"2023-11-28T20:38:24.524020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:11:10.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559511+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:23.559511+0000","last_peered":"2023-11-28T20:38:23.559511+0000","last_clean":"2023-11-28T20:38:23.559511+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:23.559511+0000","last_undegraded":"2023-11-28T20:38:23.559511+0000","last_fullsized":"2023-11-28T20:38:23.559511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.565387+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:23.565387+0000","last_peered":"2023-11-28T20:38:23.565387+0000","last_clean":"2023-11-28T20:38:23.565387+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:23.565387+0000","last_undegraded":"2023-11-28T20:38:23.565387+0000","last_fullsized":"2023-11-28T20:38:23.565387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523851+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:38:24.523851+0000","last_peered":"2023-11-28T20:38:24.523851+0000","last_clean":"2023-11-28T20:38:24.523851+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:38:24.523851+0000","last_undegraded":"2023-11-28T20:38:24.523851+0000","last_fullsized":"2023-11-28T20:38:24.523851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344511+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:24.344511+0000","last_peered":"2023-11-28T20:38:24.344511+0000","last_clean":"2023-11-28T20:38:24.344511+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:24.344511+0000","last_undegraded":"2023-11-28T20:38:24.344511+0000","last_fullsized":"2023-11-28T20:38:24.344511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571440+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:38:23.571440+0000","last_peered":"2023-11-28T20:38:23.571440+0000","last_clean":"2023-11-28T20:38:23.571440+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:38:23.571440+0000","last_undegraded":"2023-11-28T20:38:23.571440+0000","last_fullsized":"2023-11-28T20:38:23.571440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564701+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:23.564701+0000","last_peered":"2023-11-28T20:38:23.564701+0000","last_clean":"2023-11-28T20:38:23.564701+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:23.564701+0000","last_undegraded":"2023-11-28T20:38:23.564701+0000","last_fullsized":"2023-11-28T20:38:23.564701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351748+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:24.351748+0000","last_peered":"2023-11-28T20:38:24.351748+0000","last_clean":"2023-11-28T20:38:24.351748+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:24.351748+0000","last_undegraded":"2023-11-28T20:38:24.351748+0000","last_fullsized":"2023-11-28T20:38:24.351748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556007+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:38:23.556007+0000","last_peered":"2023-11-28T20:38:23.556007+0000","last_clean":"2023-11-28T20:38:23.556007+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:38:23.556007+0000","last_undegraded":"2023-11-28T20:38:23.556007+0000","last_fullsized":"2023-11-28T20:38:23.556007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555641+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:38:23.555641+0000","last_peered":"2023-11-28T20:38:23.555641+0000","last_clean":"2023-11-28T20:38:23.555641+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:38:23.555641+0000","last_undegraded":"2023-11-28T20:38:23.555641+0000","last_fullsized":"2023-11-28T20:38:23.555641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350688+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:24.350688+0000","last_peered":"2023-11-28T20:38:24.350688+0000","last_clean":"2023-11-28T20:38:24.350688+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:24.350688+0000","last_undegraded":"2023-11-28T20:38:24.350688+0000","last_fullsized":"2023-11-28T20:38:24.350688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561439+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:23.561439+0000","last_peered":"2023-11-28T20:38:23.561439+0000","last_clean":"2023-11-28T20:38:23.561439+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:23.561439+0000","last_undegraded":"2023-11-28T20:38:23.561439+0000","last_fullsized":"2023-11-28T20:38:23.561439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534500+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:38:24.534500+0000","last_peered":"2023-11-28T20:38:24.534500+0000","last_clean":"2023-11-28T20:38:24.534500+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:38:24.534500+0000","last_undegraded":"2023-11-28T20:38:24.534500+0000","last_fullsized":"2023-11-28T20:38:24.534500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.579080+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:38:45.579080+0000","last_peered":"2023-11-28T20:38:45.579080+0000","last_clean":"2023-11-28T20:38:45.579080+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:38:45.579080+0000","last_undegraded":"2023-11-28T20:38:45.579080+0000","last_fullsized":"2023-11-28T20:38:45.579080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.588393+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:23.588393+0000","last_peered":"2023-11-28T20:38:23.588393+0000","last_clean":"2023-11-28T20:38:23.588393+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:23.588393+0000","last_undegraded":"2023-11-28T20:38:23.588393+0000","last_fullsized":"2023-11-28T20:38:23.588393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524719+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:38:24.524719+0000","last_peered":"2023-11-28T20:38:24.524719+0000","last_clean":"2023-11-28T20:38:24.524719+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:38:24.524719+0000","last_undegraded":"2023-11-28T20:38:24.524719+0000","last_fullsized":"2023-11-28T20:38:24.524719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563172+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:23.563172+0000","last_peered":"2023-11-28T20:38:23.563172+0000","last_clean":"2023-11-28T20:38:23.563172+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:23.563172+0000","last_undegraded":"2023-11-28T20:38:23.563172+0000","last_fullsized":"2023-11-28T20:38:23.563172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579796+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:38:23.579796+0000","last_peered":"2023-11-28T20:38:23.579796+0000","last_clean":"2023-11-28T20:38:23.579796+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:38:23.579796+0000","last_undegraded":"2023-11-28T20:38:23.579796+0000","last_fullsized":"2023-11-28T20:38:23.579796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559655+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:23.559655+0000","last_peered":"2023-11-28T20:38:23.559655+0000","last_clean":"2023-11-28T20:38:23.559655+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:23.559655+0000","last_undegraded":"2023-11-28T20:38:23.559655+0000","last_fullsized":"2023-11-28T20:38:23.559655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561367+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:23.561367+0000","last_peered":"2023-11-28T20:38:23.561367+0000","last_clean":"2023-11-28T20:38:23.561367+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:23.561367+0000","last_undegraded":"2023-11-28T20:38:23.561367+0000","last_fullsized":"2023-11-28T20:38:23.561367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556118+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:38:23.556118+0000","last_peered":"2023-11-28T20:38:23.556118+0000","last_clean":"2023-11-28T20:38:23.556118+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:38:23.556118+0000","last_undegraded":"2023-11-28T20:38:23.556118+0000","last_fullsized":"2023-11-28T20:38:23.556118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579390+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:38:23.579390+0000","last_peered":"2023-11-28T20:38:23.579390+0000","last_clean":"2023-11-28T20:38:23.579390+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:38:23.579390+0000","last_undegraded":"2023-11-28T20:38:23.579390+0000","last_fullsized":"2023-11-28T20:38:23.579390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.567024+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:23.567024+0000","last_peered":"2023-11-28T20:38:23.567024+0000","last_clean":"2023-11-28T20:38:23.567024+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:23.567024+0000","last_undegraded":"2023-11-28T20:38:23.567024+0000","last_fullsized":"2023-11-28T20:38:23.567024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556268+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:38:23.556268+0000","last_peered":"2023-11-28T20:38:23.556268+0000","last_clean":"2023-11-28T20:38:23.556268+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:38:23.556268+0000","last_undegraded":"2023-11-28T20:38:23.556268+0000","last_fullsized":"2023-11-28T20:38:23.556268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564684+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:23.564684+0000","last_peered":"2023-11-28T20:38:23.564684+0000","last_clean":"2023-11-28T20:38:23.564684+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:23.564684+0000","last_undegraded":"2023-11-28T20:38:23.564684+0000","last_fullsized":"2023-11-28T20:38:23.564684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555549+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:38:23.555549+0000","last_peered":"2023-11-28T20:38:23.555549+0000","last_clean":"2023-11-28T20:38:23.555549+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:38:23.555549+0000","last_undegraded":"2023-11-28T20:38:23.555549+0000","last_fullsized":"2023-11-28T20:38:23.555549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559455+0000","last_change":"2023-11-28T20:38:19.391161+0000","last_active":"2023-11-28T20:38:23.559455+0000","last_peered":"2023-11-28T20:38:23.559455+0000","last_clean":"2023-11-28T20:38:23.559455+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:38:23.559455+0000","last_undegraded":"2023-11-28T20:38:23.559455+0000","last_fullsized":"2023-11-28T20:38:23.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:29.088707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561269+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:23.561269+0000","last_peered":"2023-11-28T20:38:23.561269+0000","last_clean":"2023-11-28T20:38:23.561269+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:23.561269+0000","last_undegraded":"2023-11-28T20:38:23.561269+0000","last_fullsized":"2023-11-28T20:38:23.561269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.565066+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:23.565066+0000","last_peered":"2023-11-28T20:38:23.565066+0000","last_clean":"2023-11-28T20:38:23.565066+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:23.565066+0000","last_undegraded":"2023-11-28T20:38:23.565066+0000","last_fullsized":"2023-11-28T20:38:23.565066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.772001+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:23.772001+0000","last_peered":"2023-11-28T20:38:23.772001+0000","last_clean":"2023-11-28T20:38:23.772001+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:23.772001+0000","last_undegraded":"2023-11-28T20:38:23.772001+0000","last_fullsized":"2023-11-28T20:38:23.772001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.583087+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:38:23.583087+0000","last_peered":"2023-11-28T20:38:23.583087+0000","last_clean":"2023-11-28T20:38:23.583087+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:38:23.583087+0000","last_undegraded":"2023-11-28T20:38:23.583087+0000","last_fullsized":"2023-11-28T20:38:23.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560491+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:23.560491+0000","last_peered":"2023-11-28T20:38:23.560491+0000","last_clean":"2023-11-28T20:38:23.560491+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:23.560491+0000","last_undegraded":"2023-11-28T20:38:23.560491+0000","last_fullsized":"2023-11-28T20:38:23.560491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564469+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:23.564469+0000","last_peered":"2023-11-28T20:38:23.564469+0000","last_clean":"2023-11-28T20:38:23.564469+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:23.564469+0000","last_undegraded":"2023-11-28T20:38:23.564469+0000","last_fullsized":"2023-11-28T20:38:23.564469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571449+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:38:23.571449+0000","last_peered":"2023-11-28T20:38:23.571449+0000","last_clean":"2023-11-28T20:38:23.571449+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:38:23.571449+0000","last_undegraded":"2023-11-28T20:38:23.571449+0000","last_fullsized":"2023-11-28T20:38:23.571449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560649+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:23.560649+0000","last_peered":"2023-11-28T20:38:23.560649+0000","last_clean":"2023-11-28T20:38:23.560649+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:23.560649+0000","last_undegraded":"2023-11-28T20:38:23.560649+0000","last_fullsized":"2023-11-28T20:38:23.560649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556123+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:38:23.556123+0000","last_peered":"2023-11-28T20:38:23.556123+0000","last_clean":"2023-11-28T20:38:23.556123+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:38:23.556123+0000","last_undegraded":"2023-11-28T20:38:23.556123+0000","last_fullsized":"2023-11-28T20:38:23.556123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571565+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:23.571565+0000","last_peered":"2023-11-28T20:38:23.571565+0000","last_clean":"2023-11-28T20:38:23.571565+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:23.571565+0000","last_undegraded":"2023-11-28T20:38:23.571565+0000","last_fullsized":"2023-11-28T20:38:23.571565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563921+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:23.563921+0000","last_peered":"2023-11-28T20:38:23.563921+0000","last_clean":"2023-11-28T20:38:23.563921+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:23.563921+0000","last_undegraded":"2023-11-28T20:38:23.563921+0000","last_fullsized":"2023-11-28T20:38:23.563921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.566792+0000","last_change":"2023-11-28T20:38:19.399387+0000","last_active":"2023-11-28T20:38:23.566792+0000","last_peered":"2023-11-28T20:38:23.566792+0000","last_clean":"2023-11-28T20:38:23.566792+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:23.566792+0000","last_undegraded":"2023-11-28T20:38:23.566792+0000","last_fullsized":"2023-11-28T20:38:23.566792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:19:33.795318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771738+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:23.771738+0000","last_peered":"2023-11-28T20:38:23.771738+0000","last_clean":"2023-11-28T20:38:23.771738+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:23.771738+0000","last_undegraded":"2023-11-28T20:38:23.771738+0000","last_fullsized":"2023-11-28T20:38:23.771738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.554837+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:38:23.554837+0000","last_peered":"2023-11-28T20:38:23.554837+0000","last_clean":"2023-11-28T20:38:23.554837+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:38:23.554837+0000","last_undegraded":"2023-11-28T20:38:23.554837+0000","last_fullsized":"2023-11-28T20:38:23.554837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770651+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:23.770651+0000","last_peered":"2023-11-28T20:38:23.770651+0000","last_clean":"2023-11-28T20:38:23.770651+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:23.770651+0000","last_undegraded":"2023-11-28T20:38:23.770651+0000","last_fullsized":"2023-11-28T20:38:23.770651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559229+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:23.559229+0000","last_peered":"2023-11-28T20:38:23.559229+0000","last_clean":"2023-11-28T20:38:23.559229+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:23.559229+0000","last_undegraded":"2023-11-28T20:38:23.559229+0000","last_fullsized":"2023-11-28T20:38:23.559229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771010+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:23.771010+0000","last_peered":"2023-11-28T20:38:23.771010+0000","last_clean":"2023-11-28T20:38:23.771010+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:23.771010+0000","last_undegraded":"2023-11-28T20:38:23.771010+0000","last_fullsized":"2023-11-28T20:38:23.771010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560781+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:23.560781+0000","last_peered":"2023-11-28T20:38:23.560781+0000","last_clean":"2023-11-28T20:38:23.560781+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:23.560781+0000","last_undegraded":"2023-11-28T20:38:23.560781+0000","last_fullsized":"2023-11-28T20:38:23.560781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561319+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:23.561319+0000","last_peered":"2023-11-28T20:38:23.561319+0000","last_clean":"2023-11-28T20:38:23.561319+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:23.561319+0000","last_undegraded":"2023-11-28T20:38:23.561319+0000","last_fullsized":"2023-11-28T20:38:23.561319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.580170+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:38:23.580170+0000","last_peered":"2023-11-28T20:38:23.580170+0000","last_clean":"2023-11-28T20:38:23.580170+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:38:23.580170+0000","last_undegraded":"2023-11-28T20:38:23.580170+0000","last_fullsized":"2023-11-28T20:38:23.580170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771481+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:23.771481+0000","last_peered":"2023-11-28T20:38:23.771481+0000","last_clean":"2023-11-28T20:38:23.771481+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:23.771481+0000","last_undegraded":"2023-11-28T20:38:23.771481+0000","last_fullsized":"2023-11-28T20:38:23.771481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5955,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":11300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":58,"ondisk_log_size":58,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":102025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":102185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":856064,"data_stored":692975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":102115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":270336,"data_stored":102151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:38:48.837 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T20:38:48.837 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T20:38:48.837 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T20:38:48.837 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T20:38:48.838 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-11-28T20:38:48.833+0000 7fa6aa4cf640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-28T20:38:49.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.004+0000 7f62b8ad6640 1 Processor -- start 2023-11-28T20:38:49.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.004+0000 7f62b8ad6640 1 -- start start 2023-11-28T20:38:49.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b8ad6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62b40c6ff0 0x7f62b4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b8ad6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b40c4510 0x7f62b406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b8ad6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b40c4920 con 0x7f62b4150b40 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b8ad6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b40c62f0 con 0x7f62b40c6ff0 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b8ad6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40c6ac0 con 0x7f62b40c4510 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f62b4150b40 0x7f62b40c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44738/0 (socket says 172.21.15.167:44738) 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b259c640 1 -- 172.21.15.167:0/4215700164 learned_addr learned my addr 172.21.15.167:0/4215700164 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62a9d9b640 1 --2- 172.21.15.167:0/4215700164 >> v2:172.21.15.178:3300/0 conn(0x7f62b40c6ff0 0x7f62b4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b2d9d640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b40c4510 0x7f62b406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910411205 0 0) 0x7f62b40c4920 con 0x7f62b4150b40 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a0003530 con 0x7f62b4150b40 2023-11-28T20:38:49.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1369303802 0 0) 0x7f62a0003530 con 0x7f62b4150b40 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b40c4510 msgr2=0x7f62b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b40c4510 0x7f62b406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 >> v2:172.21.15.178:3300/0 conn(0x7f62b40c6ff0 msgr2=0x7f62b4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 --2- 172.21.15.167:0/4215700164 >> v2:172.21.15.178:3300/0 conn(0x7f62b40c6ff0 0x7f62b4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40c6500 con 0x7f62b4150b40 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f62a4001a20 con 0x7f62b4150b40 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 >> v1:172.21.15.167:6789/0 conn(0x7f62b4150b40 legacy=0x7f62b40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b40c4510 0x7f62a0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62a0003f00 0x7f62a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40c62f0 con 0x7f62a0004d10 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40c6ac0 con 0x7f62a0003f00 2023-11-28T20:38:49.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a000dba0 con 0x7f62b40c4510 2023-11-28T20:38:49.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b2d9d640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62a9d9b640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62a0003f00 0x7f62a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b259c640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b40c4510 0x7f62a0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b2d9d640 1 -- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b40c4510 msgr2=0x7f62a0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:49.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b2d9d640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b40c4510 0x7f62a0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b2d9d640 1 -- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62a0003f00 msgr2=0x7f62a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:49.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b2d9d640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62a0003f00 0x7f62a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.008+0000 7f62b2d9d640 1 -- 172.21.15.167:0/4215700164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0003530 con 0x7f62a0004d10 2023-11-28T20:38:49.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b2d9d640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62a0005190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009ae0 tx=0x7f62ac01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10eff43daf85877 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:49.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0a5640 con 0x7f62a0004d10 2023-11-28T20:38:49.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0a57a0 con 0x7f62a0004d10 2023-11-28T20:38:49.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b1d9b640 1 -- 172.21.15.167:0/4215700164 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0a5b50 con 0x7f62a0004d10 2023-11-28T20:38:49.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b8ad6640 1 -- 172.21.15.167:0/4215700164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 msgr2=0x7f62a0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b8ad6640 1 --2- 172.21.15.167:0/4215700164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62a0005190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009ae0 tx=0x7f62ac01c9f0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b2d9d640 1 -- 172.21.15.167:0/4215700164 reap_dead start 2023-11-28T20:38:49.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b8ad6640 1 -- 172.21.15.167:0/4215700164 shutdown_connections 2023-11-28T20:38:49.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b8ad6640 1 -- 172.21.15.167:0/4215700164 >> 172.21.15.167:0/4215700164 conn(0x7f62b40cb1e0 msgr2=0x7f62b40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:49.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b8ad6640 1 -- 172.21.15.167:0/4215700164 shutdown_connections 2023-11-28T20:38:49.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b8ad6640 1 -- 172.21.15.167:0/4215700164 wait complete. 2023-11-28T20:38:49.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b8ad6640 1 Processor -- start 2023-11-28T20:38:49.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.012+0000 7f62b8ad6640 1 -- start start 2023-11-28T20:38:49.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b8ad6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62b41f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b8ad6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b41f29c0 0x7f62b4152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b8ad6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62b41534e0 0x7f62b414cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b8ad6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4153970 con 0x7f62a0004d10 2023-11-28T20:38:49.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b8ad6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4152aa0 con 0x7f62b41534e0 2023-11-28T20:38:49.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b8ad6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b41f2f00 con 0x7f62b41f29c0 2023-11-28T20:38:49.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62b41f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62b41f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47104/0 (socket says 172.21.15.167:47104) 2023-11-28T20:38:49.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b259c640 1 -- 172.21.15.167:0/1303929022 learned_addr learned my addr 172.21.15.167:0/1303929022 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:49.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62a9d9b640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b41f29c0 0x7f62b4152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b2d9d640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62b41534e0 0x7f62b414cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b259c640 1 -- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b41f29c0 msgr2=0x7f62b4152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b259c640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b41f29c0 0x7f62b4152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b259c640 1 -- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62b41534e0 msgr2=0x7f62b414cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b259c640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62b41534e0 0x7f62b414cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b259c640 1 -- 172.21.15.167:0/1303929022 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40c1fa0 con 0x7f62a0004d10 2023-11-28T20:38:49.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b259c640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62b41f2480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62a4002070 tx=0x7f62a400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:49.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62ab7fe640 1 -- 172.21.15.167:0/1303929022 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4004b70 con 0x7f62a0004d10 2023-11-28T20:38:49.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62ab7fe640 1 -- 172.21.15.167:0/1303929022 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4004cd0 con 0x7f62a0004d10 2023-11-28T20:38:49.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62ab7fe640 1 -- 172.21.15.167:0/1303929022 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40146c0 con 0x7f62a0004d10 2023-11-28T20:38:49.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b40c2280 con 0x7f62a0004d10 2023-11-28T20:38:49.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b41549e0 con 0x7f62a0004d10 2023-11-28T20:38:49.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.016+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b40682c0 con 0x7f62a0004d10 2023-11-28T20:38:49.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.020+0000 7f62ab7fe640 1 -- 172.21.15.167:0/1303929022 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62a4005050 con 0x7f62a0004d10 2023-11-28T20:38:49.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.020+0000 7f62ab7fe640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62940664a0 0x7f6294068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.020+0000 7f62ab7fe640 1 -- 172.21.15.167:0/1303929022 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62a4084500 con 0x7f62a0004d10 2023-11-28T20:38:49.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.020+0000 7f62a9d9b640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62940664a0 0x7f6294068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.020+0000 7f62a9d9b640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62940664a0 0x7f6294068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f629c009ae0 tx=0x7f629c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:49.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.024+0000 7f62ab7fe640 1 -- 172.21.15.167:0/1303929022 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62a4051730 con 0x7f62a0004d10 2023-11-28T20:38:49.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.204+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f62b4152c10 con 0x7f62a0004d10 2023-11-28T20:38:49.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.204+0000 7f62ab7fe640 1 -- 172.21.15.167:0/1303929022 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f62a4019040 con 0x7f62a0004d10 2023-11-28T20:38:49.209 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:49.209 INFO:teuthology.orchestra.run.smithi167.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T20:38:49.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62940664a0 msgr2=0x7f6294068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62940664a0 0x7f6294068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f629c009ae0 tx=0x7f629c008040 comp rx=0 tx=0).stop 2023-11-28T20:38:49.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 msgr2=0x7f62b41f2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62b41f2480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62a4002070 tx=0x7f62a400e530 comp rx=0 tx=0).stop 2023-11-28T20:38:49.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 shutdown_connections 2023-11-28T20:38:49.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62940664a0 0x7f6294068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62b41534e0 0x7f62b414cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62b41f29c0 0x7f62b4152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 --2- 172.21.15.167:0/1303929022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62a0004d10 0x7f62b41f2480 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 >> 172.21.15.167:0/1303929022 conn(0x7f62b40cb1e0 msgr2=0x7f62b4155050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:49.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 shutdown_connections 2023-11-28T20:38:49.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.208+0000 7f62b8ad6640 1 -- 172.21.15.167:0/1303929022 wait complete. 2023-11-28T20:38:49.230 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T20:38:49.230 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:49.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.364+0000 7fd5f445a640 1 Processor -- start 2023-11-28T20:38:49.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.364+0000 7fd5f445a640 1 -- start start 2023-11-28T20:38:49.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f445a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd5ec070480 0x7fd5ec071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f445a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd5ec06e410 0x7fd5ec072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f445a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ec1571d0 con 0x7fd5ec06e030 2023-11-28T20:38:49.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f445a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ec071a90 con 0x7fd5ec070480 2023-11-28T20:38:49.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f445a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ec0c70d0 con 0x7fd5ec06e410 2023-11-28T20:38:49.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f21f6640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd5ec06e030 0x7fd5ec1500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44754/0 (socket says 172.21.15.167:44754) 2023-11-28T20:38:49.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f21f6640 1 -- 172.21.15.167:0/1951148709 learned_addr learned my addr 172.21.15.167:0/1951148709 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:49.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f19f5640 1 --2- 172.21.15.167:0/1951148709 >> v2:172.21.15.167:3300/0 conn(0x7fd5ec070480 0x7fd5ec071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f29f7640 1 --2- 172.21.15.167:0/1951148709 >> v2:172.21.15.178:3300/0 conn(0x7fd5ec06e410 0x7fd5ec072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f11f4640 1 -- 172.21.15.167:0/1951148709 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241915896 0 0) 0x7fd5ec1571d0 con 0x7fd5ec06e030 2023-11-28T20:38:49.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f11f4640 1 -- 172.21.15.167:0/1951148709 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d8003530 con 0x7fd5ec06e030 2023-11-28T20:38:49.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f19f5640 1 -- 172.21.15.167:0/1951148709 >> v2:172.21.15.178:3300/0 conn(0x7fd5ec06e410 msgr2=0x7fd5ec072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:49.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f19f5640 1 --2- 172.21.15.167:0/1951148709 >> v2:172.21.15.178:3300/0 conn(0x7fd5ec06e410 0x7fd5ec072460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f19f5640 1 -- 172.21.15.167:0/1951148709 >> v1:172.21.15.167:6789/0 conn(0x7fd5ec06e030 legacy=0x7fd5ec1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f19f5640 1 -- 172.21.15.167:0/1951148709 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec0c73b0 con 0x7fd5ec070480 2023-11-28T20:38:49.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f29f7640 1 --2- 172.21.15.167:0/1951148709 >> v2:172.21.15.178:3300/0 conn(0x7fd5ec06e410 0x7fd5ec072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:49.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.368+0000 7fd5f19f5640 1 --2- 172.21.15.167:0/1951148709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 0x7fd5ec071f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec06c280 tx=0x7fd5dc01d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d101e4ae63d61f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:49.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f11f4640 1 -- 172.21.15.167:0/1951148709 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0a6710 con 0x7fd5ec070480 2023-11-28T20:38:49.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f11f4640 1 -- 172.21.15.167:0/1951148709 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc0a6870 con 0x7fd5ec070480 2023-11-28T20:38:49.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f11f4640 1 -- 172.21.15.167:0/1951148709 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0a6be0 con 0x7fd5ec070480 2023-11-28T20:38:49.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 -- 172.21.15.167:0/1951148709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 msgr2=0x7fd5ec071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 --2- 172.21.15.167:0/1951148709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 0x7fd5ec071f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec06c280 tx=0x7fd5dc01d660 comp rx=0 tx=0).stop 2023-11-28T20:38:49.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 -- 172.21.15.167:0/1951148709 shutdown_connections 2023-11-28T20:38:49.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 --2- 172.21.15.167:0/1951148709 >> v2:172.21.15.178:3300/0 conn(0x7fd5ec06e410 0x7fd5ec072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 --2- 172.21.15.167:0/1951148709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 0x7fd5ec071f20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 -- 172.21.15.167:0/1951148709 >> 172.21.15.167:0/1951148709 conn(0x7fd5ec0cb1e0 msgr2=0x7fd5ec0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:49.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 -- 172.21.15.167:0/1951148709 shutdown_connections 2023-11-28T20:38:49.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 -- 172.21.15.167:0/1951148709 wait complete. 2023-11-28T20:38:49.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 Processor -- start 2023-11-28T20:38:49.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 -- start start 2023-11-28T20:38:49.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5ec06e030 0x7fd5ec0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5ec06e410 0x7fd5ec1f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 0x7fd5ec148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec1f3800 con 0x7fd5ec070480 2023-11-28T20:38:49.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec1f3240 con 0x7fd5ec06e030 2023-11-28T20:38:49.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f445a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec1f3520 con 0x7fd5ec06e410 2023-11-28T20:38:49.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f29f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 0x7fd5ec148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f29f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 0x7fd5ec148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47130/0 (socket says 172.21.15.167:47130) 2023-11-28T20:38:49.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f29f7640 1 -- 172.21.15.167:0/2392125481 learned_addr learned my addr 172.21.15.167:0/2392125481 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:49.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f19f5640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5ec06e410 0x7fd5ec1f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.372+0000 7fd5f21f6640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5ec06e030 0x7fd5ec0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f29f7640 1 -- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5ec06e410 msgr2=0x7fd5ec1f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f29f7640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5ec06e410 0x7fd5ec1f3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f29f7640 1 -- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5ec06e030 msgr2=0x7fd5ec0c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f29f7640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5ec06e030 0x7fd5ec0c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f29f7640 1 -- 172.21.15.167:0/2392125481 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc009420 con 0x7fd5ec070480 2023-11-28T20:38:49.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f19f5640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5ec06e410 0x7fd5ec1f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:49.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f29f7640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 0x7fd5ec148cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007df0 tx=0x7fd5e400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:49.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5e2ffd640 1 -- 172.21.15.167:0/2392125481 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40039a0 con 0x7fd5ec070480 2023-11-28T20:38:49.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5e2ffd640 1 -- 172.21.15.167:0/2392125481 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e400f040 con 0x7fd5ec070480 2023-11-28T20:38:49.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5e2ffd640 1 -- 172.21.15.167:0/2392125481 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4003d40 con 0x7fd5ec070480 2023-11-28T20:38:49.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec0c9110 con 0x7fd5ec070480 2023-11-28T20:38:49.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ec0c96d0 con 0x7fd5ec070480 2023-11-28T20:38:49.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec0682c0 con 0x7fd5ec070480 2023-11-28T20:38:49.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5e2ffd640 1 -- 172.21.15.167:0/2392125481 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5e4004030 con 0x7fd5ec070480 2023-11-28T20:38:49.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5e2ffd640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd5d0066470 0x7fd5d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.376+0000 7fd5e2ffd640 1 -- 172.21.15.167:0/2392125481 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd5e4084450 con 0x7fd5ec070480 2023-11-28T20:38:49.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.380+0000 7fd5f21f6640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd5d0066470 0x7fd5d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.380+0000 7fd5f21f6640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd5d0066470 0x7fd5d0068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8005890 tx=0x7fd5e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:49.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.384+0000 7fd5e2ffd640 1 -- 172.21.15.167:0/2392125481 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5e40515e0 con 0x7fd5ec070480 2023-11-28T20:38:49.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.532+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5ec0c98c0 con 0x7fd5ec070480 2023-11-28T20:38:49.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.532+0000 7fd5e2ffd640 1 -- 172.21.15.167:0/2392125481 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7fd5e4054c00 con 0x7fd5ec070480 2023-11-28T20:38:49.537 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:49.537 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:49.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd5d0066470 msgr2=0x7fd5d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd5d0066470 0x7fd5d0068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8005890 tx=0x7fd5e8009040 comp rx=0 tx=0).stop 2023-11-28T20:38:49.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 msgr2=0x7fd5ec148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 0x7fd5ec148cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007df0 tx=0x7fd5e400d4a0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 shutdown_connections 2023-11-28T20:38:49.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd5d0066470 0x7fd5d0068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5ec070480 0x7fd5ec148cf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5ec06e410 0x7fd5ec1f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 --2- 172.21.15.167:0/2392125481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5ec06e030 0x7fd5ec0c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 >> 172.21.15.167:0/2392125481 conn(0x7fd5ec0cb1e0 msgr2=0x7fd5ec0c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:49.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 shutdown_connections 2023-11-28T20:38:49.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.536+0000 7fd5f445a640 1 -- 172.21.15.167:0/2392125481 wait complete. 2023-11-28T20:38:49.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:38:05.507993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:38:17.477871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:38:17.884061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T20:38:21.578587+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T20:38:49.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:38:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.696+0000 7f242ce46640 1 Processor -- start 2023-11-28T20:38:49.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.696+0000 7f242ce46640 1 -- start start 2023-11-28T20:38:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242ce46640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2428150b40 0x7f2428157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242ce46640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 0x7f242806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242ce46640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24280c4920 con 0x7f24280c6ff0 2023-11-28T20:38:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242ce46640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24280c62f0 con 0x7f2428150b40 2023-11-28T20:38:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242ce46640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24280c6ac0 con 0x7f24280c4510 2023-11-28T20:38:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f241ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f24280c6ff0 0x7f24280c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44766/0 (socket says 172.21.15.167:44766) 2023-11-28T20:38:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242659c640 1 --2- 172.21.15.167:0/1935655425 >> v2:172.21.15.167:3300/0 conn(0x7f2428150b40 0x7f2428157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f241ffff640 1 -- 172.21.15.167:0/1935655425 learned_addr learned my addr 172.21.15.167:0/1935655425 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:49.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f2426d9d640 1 --2- 172.21.15.167:0/1935655425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 0x7f242806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242659c640 1 -- 172.21.15.167:0/1935655425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 msgr2=0x7f242806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:49.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242659c640 1 --2- 172.21.15.167:0/1935655425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 0x7f242806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f2425d9b640 1 -- 172.21.15.167:0/1935655425 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956981301 0 0) 0x7f24280c4920 con 0x7f24280c6ff0 2023-11-28T20:38:49.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242659c640 1 -- 172.21.15.167:0/1935655425 >> v1:172.21.15.167:6789/0 conn(0x7f24280c6ff0 legacy=0x7f24280c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.700+0000 7f242659c640 1 -- 172.21.15.167:0/1935655425 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24280c6500 con 0x7f2428150b40 2023-11-28T20:38:49.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242659c640 1 --2- 172.21.15.167:0/1935655425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2428150b40 0x7f2428157560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f24180097c0 tx=0x7f241801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eea62155ff1bc14 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:49.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f2425d9b640 1 -- 172.21.15.167:0/1935655425 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24180ad660 con 0x7f2428150b40 2023-11-28T20:38:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f2425d9b640 1 -- 172.21.15.167:0/1935655425 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24180ad7c0 con 0x7f2428150b40 2023-11-28T20:38:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f2425d9b640 1 -- 172.21.15.167:0/1935655425 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24180adb50 con 0x7f2428150b40 2023-11-28T20:38:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 -- 172.21.15.167:0/1935655425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2428150b40 msgr2=0x7f2428157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 --2- 172.21.15.167:0/1935655425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2428150b40 0x7f2428157560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f24180097c0 tx=0x7f241801c450 comp rx=0 tx=0).stop 2023-11-28T20:38:49.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 -- 172.21.15.167:0/1935655425 shutdown_connections 2023-11-28T20:38:49.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 --2- 172.21.15.167:0/1935655425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 0x7f242806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 --2- 172.21.15.167:0/1935655425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2428150b40 0x7f2428157560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 -- 172.21.15.167:0/1935655425 >> 172.21.15.167:0/1935655425 conn(0x7f24280cb1e0 msgr2=0x7f24280cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:49.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 -- 172.21.15.167:0/1935655425 shutdown_connections 2023-11-28T20:38:49.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 -- 172.21.15.167:0/1935655425 wait complete. 2023-11-28T20:38:49.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 Processor -- start 2023-11-28T20:38:49.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 -- start start 2023-11-28T20:38:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.704+0000 7f242ce46640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 0x7f24281f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242ce46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24280c6ff0 0x7f2428141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242ce46640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2428150b40 0x7f2428162b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242ce46640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24281f3530 con 0x7f24280c6ff0 2023-11-28T20:38:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242ce46640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242806b310 con 0x7f2428150b40 2023-11-28T20:38:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242ce46640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24281f6ca0 con 0x7f24280c4510 2023-11-28T20:38:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24280c6ff0 0x7f2428141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24280c6ff0 0x7f2428141300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47142/0 (socket says 172.21.15.167:47142) 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241ffff640 1 -- 172.21.15.167:0/3863050374 learned_addr learned my addr 172.21.15.167:0/3863050374 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242659c640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 0x7f24281f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f2426d9d640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2428150b40 0x7f2428162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241ffff640 1 -- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 msgr2=0x7f24281f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241ffff640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 0x7f24281f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241ffff640 1 -- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2428150b40 msgr2=0x7f2428162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241ffff640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2428150b40 0x7f2428162b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241ffff640 1 -- 172.21.15.167:0/3863050374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2418009420 con 0x7f24280c6ff0 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242659c640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 0x7f24281f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241ffff640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24280c6ff0 0x7f2428141300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f241000c580 tx=0x7f241000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241effd640 1 -- 172.21.15.167:0/3863050374 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410005cf0 con 0x7f24280c6ff0 2023-11-28T20:38:49.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241effd640 1 -- 172.21.15.167:0/3863050374 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2410005e70 con 0x7f24280c6ff0 2023-11-28T20:38:49.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24281f28f0 con 0x7f24280c6ff0 2023-11-28T20:38:49.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241effd640 1 -- 172.21.15.167:0/3863050374 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410007310 con 0x7f24280c6ff0 2023-11-28T20:38:49.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24281f2e70 con 0x7f24280c6ff0 2023-11-28T20:38:49.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24280682c0 con 0x7f24280c6ff0 2023-11-28T20:38:49.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.708+0000 7f241effd640 1 -- 172.21.15.167:0/3863050374 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2410007470 con 0x7f24280c6ff0 2023-11-28T20:38:49.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.712+0000 7f241effd640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24080664a0 0x7f2408068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:49.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.712+0000 7f241effd640 1 -- 172.21.15.167:0/3863050374 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f24100837d0 con 0x7f24280c6ff0 2023-11-28T20:38:49.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.712+0000 7f242659c640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24080664a0 0x7f2408068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:49.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.712+0000 7f242659c640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24080664a0 0x7f2408068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24180af000 tx=0x7f2418008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:49.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.716+0000 7f241effd640 1 -- 172.21.15.167:0/3863050374 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2410050950 con 0x7f24280c6ff0 2023-11-28T20:38:49.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24281f3670 con 0x7f24280c6ff0 2023-11-28T20:38:49.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f241effd640 1 -- 172.21.15.167:0/3863050374 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24281f3670 con 0x7f24280c6ff0 2023-11-28T20:38:49.868 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2023-11-28T20:38:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24080664a0 msgr2=0x7f2408068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24080664a0 0x7f2408068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24180af000 tx=0x7f2418008040 comp rx=0 tx=0).stop 2023-11-28T20:38:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24280c6ff0 msgr2=0x7f2428141300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24280c6ff0 0x7f2428141300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f241000c580 tx=0x7f241000ca40 comp rx=0 tx=0).stop 2023-11-28T20:38:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 shutdown_connections 2023-11-28T20:38:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24080664a0 0x7f2408068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2428150b40 0x7f2428162b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24280c6ff0 0x7f2428141300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 --2- 172.21.15.167:0/3863050374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24280c4510 0x7f24281f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 >> 172.21.15.167:0/3863050374 conn(0x7f24280cb1e0 msgr2=0x7f24280c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 shutdown_connections 2023-11-28T20:38:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:49.864+0000 7f242ce46640 1 -- 172.21.15.167:0/3863050374 wait complete. 2023-11-28T20:38:49.889 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:38:50.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.024+0000 7f92a6f80640 1 Processor -- start 2023-11-28T20:38:50.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.024+0000 7f92a6f80640 1 -- start start 2023-11-28T20:38:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a6f80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a00cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a6f80640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f92a00cfc40 0x7f92a00ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a6f80640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a015ac00 con 0x7f92a0153ae0 2023-11-28T20:38:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a6f80640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a00cbd60 con 0x7f92a00cfc40 2023-11-28T20:38:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a6f80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a0159ff0 con 0x7f92a00cf860 2023-11-28T20:38:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a4d1c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f929ffff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f92a00cfc40 0x7f92a00ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a4d1c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a00cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:34008/0 (socket says 172.21.15.167:34008) 2023-11-28T20:38:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a4d1c640 1 -- 172.21.15.167:0/2039688964 learned_addr learned my addr 172.21.15.167:0/2039688964 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a4d1c640 1 -- 172.21.15.167:0/2039688964 >> v2:172.21.15.178:3300/0 conn(0x7f92a00cfc40 msgr2=0x7f92a00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a4d1c640 1 --2- 172.21.15.167:0/2039688964 >> v2:172.21.15.178:3300/0 conn(0x7f92a00cfc40 0x7f92a00ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a4d1c640 1 -- 172.21.15.167:0/2039688964 >> v1:172.21.15.178:6789/0 conn(0x7f92a0153ae0 legacy=0x7f92a015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.028+0000 7f92a4d1c640 1 -- 172.21.15.167:0/2039688964 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a015a2d0 con 0x7f92a00cf860 2023-11-28T20:38:50.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a4d1c640 1 --2- 172.21.15.167:0/2039688964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a00cb770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9294009870 tx=0x7f929401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c8769c70a45c770 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:50.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f929f7fe640 1 -- 172.21.15.167:0/2039688964 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92940aa670 con 0x7f92a00cf860 2023-11-28T20:38:50.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f929f7fe640 1 -- 172.21.15.167:0/2039688964 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92940aa7d0 con 0x7f92a00cf860 2023-11-28T20:38:50.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f929f7fe640 1 -- 172.21.15.167:0/2039688964 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92940aab60 con 0x7f92a00cf860 2023-11-28T20:38:50.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 -- 172.21.15.167:0/2039688964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 msgr2=0x7f92a00cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 --2- 172.21.15.167:0/2039688964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a00cb770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9294009870 tx=0x7f929401c510 comp rx=0 tx=0).stop 2023-11-28T20:38:50.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 -- 172.21.15.167:0/2039688964 shutdown_connections 2023-11-28T20:38:50.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 --2- 172.21.15.167:0/2039688964 >> v2:172.21.15.178:3300/0 conn(0x7f92a00cfc40 0x7f92a00ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 --2- 172.21.15.167:0/2039688964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a00cb770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 -- 172.21.15.167:0/2039688964 >> 172.21.15.167:0/2039688964 conn(0x7f92a006c1f0 msgr2=0x7f92a0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:50.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 -- 172.21.15.167:0/2039688964 shutdown_connections 2023-11-28T20:38:50.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 -- 172.21.15.167:0/2039688964 wait complete. 2023-11-28T20:38:50.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 Processor -- start 2023-11-28T20:38:50.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.032+0000 7f92a6f80640 1 -- start start 2023-11-28T20:38:50.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a6f80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a6f80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a00cfc40 0x7f92a00c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a6f80640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92a0153ae0 0x7f92a00c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a6f80640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00c88f0 con 0x7f92a00cfc40 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a6f80640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a015b480 con 0x7f92a0153ae0 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a6f80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a015be50 con 0x7f92a00cf860 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a00cfc40 0x7f92a00c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a00cfc40 0x7f92a00c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47146/0 (socket says 172.21.15.167:47146) 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929ffff640 1 -- 172.21.15.167:0/3867615523 learned_addr learned my addr 172.21.15.167:0/3867615523 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a4d1c640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a551d640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92a0153ae0 0x7f92a00c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929ffff640 1 -- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 msgr2=0x7f92a015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929ffff640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a015b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929ffff640 1 -- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92a0153ae0 msgr2=0x7f92a00c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929ffff640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92a0153ae0 0x7f92a00c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929ffff640 1 -- 172.21.15.167:0/3867615523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92940094d0 con 0x7f92a00cfc40 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a4d1c640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929ffff640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a00cfc40 0x7f92a00c7cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f928c00e930 tx=0x7f928c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929d7fa640 1 -- 172.21.15.167:0/3867615523 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c009690 con 0x7f92a00cfc40 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929d7fa640 1 -- 172.21.15.167:0/3867615523 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928c00ca00 con 0x7f92a00cfc40 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a00c8200 con 0x7f92a00cfc40 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f929d7fa640 1 -- 172.21.15.167:0/3867615523 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c00cd70 con 0x7f92a00cfc40 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a00c8b20 con 0x7f92a00cfc40 2023-11-28T20:38:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.036+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a015b610 con 0x7f92a00cfc40 2023-11-28T20:38:50.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.040+0000 7f929d7fa640 1 -- 172.21.15.167:0/3867615523 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f928c013470 con 0x7f92a00cfc40 2023-11-28T20:38:50.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.040+0000 7f929d7fa640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9284066470 0x7f9284068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.040+0000 7f929d7fa640 1 -- 172.21.15.167:0/3867615523 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f928c084370 con 0x7f92a00cfc40 2023-11-28T20:38:50.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.040+0000 7f92a4d1c640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9284066470 0x7f9284068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.040+0000 7f92a4d1c640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9284066470 0x7f9284068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f92940ae000 tx=0x7f92940a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:50.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.044+0000 7f929d7fa640 1 -- 172.21.15.167:0/3867615523 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f928c051650 con 0x7f92a00cfc40 2023-11-28T20:38:50.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.196+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92a0075c90 con 0x7f92a00cfc40 2023-11-28T20:38:50.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.196+0000 7f929d7fa640 1 -- 172.21.15.167:0/3867615523 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f928c054c70 con 0x7f92a00cfc40 2023-11-28T20:38:50.201 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:38:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9284066470 msgr2=0x7f9284068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9284066470 0x7f9284068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f92940ae000 tx=0x7f92940a7000 comp rx=0 tx=0).stop 2023-11-28T20:38:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a00cfc40 msgr2=0x7f92a00c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a00cfc40 0x7f92a00c7cc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f928c00e930 tx=0x7f928c00edf0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 shutdown_connections 2023-11-28T20:38:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9284066470 0x7f9284068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92a0153ae0 0x7f92a00c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a00cfc40 0x7f92a00c7cc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 --2- 172.21.15.167:0/3867615523 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92a00cf860 0x7f92a015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 >> 172.21.15.167:0/3867615523 conn(0x7f92a006c1f0 msgr2=0x7f92a0151920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:50.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 shutdown_connections 2023-11-28T20:38:50.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.200+0000 7f92a6f80640 1 -- 172.21.15.167:0/3867615523 wait complete. 2023-11-28T20:38:50.222 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:38:50.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.360+0000 7f8e093f5640 1 Processor -- start 2023-11-28T20:38:50.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.360+0000 7f8e093f5640 1 -- start start 2023-11-28T20:38:50.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e093f5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e04153f90 0x7f8e0406f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e093f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e040c8750 0x7f8e0406f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e093f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c6e90 0x7f8e040c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e093f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e040c7860 con 0x7f8e040c8750 2023-11-28T20:38:50.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e093f5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0415ad20 con 0x7f8e04153f90 2023-11-28T20:38:50.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e093f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04159e70 con 0x7f8e040c6e90 2023-11-28T20:38:50.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e027fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e040c8750 0x7f8e0406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e027fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e040c8750 0x7f8e0406f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47162/0 (socket says 172.21.15.167:47162) 2023-11-28T20:38:50.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e027fc640 1 -- 172.21.15.167:0/3718180857 learned_addr learned my addr 172.21.15.167:0/3718180857 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:50.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e02ffd640 1 --2- 172.21.15.167:0/3718180857 >> v2:172.21.15.178:3300/0 conn(0x7f8e04153f90 0x7f8e0406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e037fe640 1 --2- 172.21.15.167:0/3718180857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c6e90 0x7f8e040c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e027fc640 1 -- 172.21.15.167:0/3718180857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c6e90 msgr2=0x7f8e040c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:50.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e027fc640 1 --2- 172.21.15.167:0/3718180857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c6e90 0x7f8e040c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e027fc640 1 -- 172.21.15.167:0/3718180857 >> v2:172.21.15.178:3300/0 conn(0x7f8e04153f90 msgr2=0x7f8e0406f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:50.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e027fc640 1 --2- 172.21.15.167:0/3718180857 >> v2:172.21.15.178:3300/0 conn(0x7f8e04153f90 0x7f8e0406f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.364+0000 7f8e027fc640 1 -- 172.21.15.167:0/3718180857 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0415a110 con 0x7f8e040c8750 2023-11-28T20:38:50.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e027fc640 1 --2- 172.21.15.167:0/3718180857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e040c8750 0x7f8e0406f550 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e040c36d0 tx=0x7f8df801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41da3011afac23b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:50.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e01ffb640 1 -- 172.21.15.167:0/3718180857 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df80a89b0 con 0x7f8e040c8750 2023-11-28T20:38:50.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e01ffb640 1 -- 172.21.15.167:0/3718180857 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df80a8b10 con 0x7f8e040c8750 2023-11-28T20:38:50.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e01ffb640 1 -- 172.21.15.167:0/3718180857 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df80a8ea0 con 0x7f8e040c8750 2023-11-28T20:38:50.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e093f5640 1 -- 172.21.15.167:0/3718180857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e040c8750 msgr2=0x7f8e0406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e093f5640 1 --2- 172.21.15.167:0/3718180857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e040c8750 0x7f8e0406f550 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e040c36d0 tx=0x7f8df801ecf0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e093f5640 1 -- 172.21.15.167:0/3718180857 shutdown_connections 2023-11-28T20:38:50.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e093f5640 1 --2- 172.21.15.167:0/3718180857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c6e90 0x7f8e040c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e093f5640 1 --2- 172.21.15.167:0/3718180857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e040c8750 0x7f8e0406f550 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e093f5640 1 --2- 172.21.15.167:0/3718180857 >> v2:172.21.15.178:3300/0 conn(0x7f8e04153f90 0x7f8e0406f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e093f5640 1 -- 172.21.15.167:0/3718180857 >> 172.21.15.167:0/3718180857 conn(0x7f8e040cc300 msgr2=0x7f8e040cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:50.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e093f5640 1 -- 172.21.15.167:0/3718180857 shutdown_connections 2023-11-28T20:38:50.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.368+0000 7f8e093f5640 1 -- 172.21.15.167:0/3718180857 wait complete. 2023-11-28T20:38:50.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 Processor -- start 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 -- start start 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e040c6e90 0x7f8e041efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c8750 0x7f8e04157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e04153f90 0x7f8e0415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041f0280 con 0x7f8e04153f90 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0415c190 con 0x7f8e040c6e90 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041f0d00 con 0x7f8e040c8750 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e037fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e04153f90 0x7f8e0415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e037fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e04153f90 0x7f8e0415cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47172/0 (socket says 172.21.15.167:47172) 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e037fe640 1 -- 172.21.15.167:0/2359676365 learned_addr learned my addr 172.21.15.167:0/2359676365 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e02ffd640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e040c6e90 0x7f8e041efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e027fc640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c8750 0x7f8e04157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e037fe640 1 -- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c8750 msgr2=0x7f8e04157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e037fe640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c8750 0x7f8e04157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e037fe640 1 -- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e040c6e90 msgr2=0x7f8e041efd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e037fe640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e040c6e90 0x7f8e041efd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e037fe640 1 -- 172.21.15.167:0/2359676365 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df80094d0 con 0x7f8e04153f90 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e037fe640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e04153f90 0x7f8e0415cba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc007e60 tx=0x7f8dfc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8deb7fe640 1 -- 172.21.15.167:0/2359676365 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc014620 con 0x7f8e04153f90 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8deb7fe640 1 -- 172.21.15.167:0/2359676365 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc0147a0 con 0x7f8e04153f90 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e041f0460 con 0x7f8e04153f90 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8deb7fe640 1 -- 172.21.15.167:0/2359676365 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc014b50 con 0x7f8e04153f90 2023-11-28T20:38:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.372+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e041f0a20 con 0x7f8e04153f90 2023-11-28T20:38:50.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.376+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e040682c0 con 0x7f8e04153f90 2023-11-28T20:38:50.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.376+0000 7f8deb7fe640 1 -- 172.21.15.167:0/2359676365 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8dfc014cb0 con 0x7f8e04153f90 2023-11-28T20:38:50.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.376+0000 7f8deb7fe640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8df0066470 0x7f8df0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.376+0000 7f8deb7fe640 1 -- 172.21.15.167:0/2359676365 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8dfc0849d0 con 0x7f8e04153f90 2023-11-28T20:38:50.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.376+0000 7f8e02ffd640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8df0066470 0x7f8df0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.380+0000 7f8e02ffd640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8df0066470 0x7f8df0068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8df40079c0 tx=0x7f8df4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:50.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.380+0000 7f8deb7fe640 1 -- 172.21.15.167:0/2359676365 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8dfc051ae0 con 0x7f8e04153f90 2023-11-28T20:38:50.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.532+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e04075c90 con 0x7f8e04153f90 2023-11-28T20:38:50.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.532+0000 7f8deb7fe640 1 -- 172.21.15.167:0/2359676365 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8dfc055100 con 0x7f8e04153f90 2023-11-28T20:38:50.537 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2023-11-28T20:38:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8df0066470 msgr2=0x7f8df0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8df0066470 0x7f8df0068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8df40079c0 tx=0x7f8df4008040 comp rx=0 tx=0).stop 2023-11-28T20:38:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e04153f90 msgr2=0x7f8e0415cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e04153f90 0x7f8e0415cba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc007e60 tx=0x7f8dfc00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 shutdown_connections 2023-11-28T20:38:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8df0066470 0x7f8df0068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e04153f90 0x7f8e0415cba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e040c8750 0x7f8e04157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 --2- 172.21.15.167:0/2359676365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e040c6e90 0x7f8e041efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 >> 172.21.15.167:0/2359676365 conn(0x7f8e040cc300 msgr2=0x7f8e0406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:50.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 shutdown_connections 2023-11-28T20:38:50.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.536+0000 7f8e093f5640 1 -- 172.21.15.167:0/2359676365 wait complete. 2023-11-28T20:38:50.559 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T20:38:50.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.696+0000 7f8515df5640 1 Processor -- start 2023-11-28T20:38:50.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f8515df5640 1 -- start start 2023-11-28T20:38:50.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f8515df5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510157560 0x7f85100c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f8515df5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8510157970 con 0x7f85100c6ff0 2023-11-28T20:38:50.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f8515df5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85100c6ac0 con 0x7f8510150b40 2023-11-28T20:38:50.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f8515df5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85100c62f0 con 0x7f8510157560 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850effd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f85100c6ff0 0x7f851006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44780/0 (socket says 172.21.15.167:44780) 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850effd640 1 -- 172.21.15.167:0/852178809 learned_addr learned my addr 172.21.15.167:0/852178809 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850ffff640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510157560 0x7f85100c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100033295 0 0) 0x7f8510157970 con 0x7f85100c6ff0 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f8003530 con 0x7f85100c6ff0 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523846403 0 0) 0x7f85100c6ac0 con 0x7f8510150b40 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8510157970 con 0x7f8510150b40 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1933933571 0 0) 0x7f84f8003530 con 0x7f85100c6ff0 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510157560 msgr2=0x7f85100c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510157560 0x7f85100c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 >> v1:172.21.15.178:6789/0 conn(0x7f8510150b40 legacy=0x7f85100c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100c6500 con 0x7f85100c6ff0 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f85040016a0 con 0x7f85100c6ff0 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 >> v1:172.21.15.167:6789/0 conn(0x7f85100c6ff0 legacy=0x7f851006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8003b40 0x7f84f8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510157560 0x7f84f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84f8004d10 0x7f84f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85100c62f0 con 0x7f84f8004d10 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f800dc50 con 0x7f84f8003b40 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f800ddc0 con 0x7f8510157560 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850f7fe640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8003b40 0x7f84f8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850ffff640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84f8004d10 0x7f84f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850effd640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510157560 0x7f84f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850ffff640 1 -- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510157560 msgr2=0x7f84f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:50.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850ffff640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510157560 0x7f84f80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850ffff640 1 -- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8003b40 msgr2=0x7f84f8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:50.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850ffff640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8003b40 0x7f84f8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.700+0000 7f850ffff640 1 -- 172.21.15.167:0/852178809 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f8003530 con 0x7f84f8004d10 2023-11-28T20:38:50.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f850ffff640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84f8004d10 0x7f84f8005190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8508009fc0 tx=0x7f850801ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fca082152a3c04 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:50.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85080a5d00 con 0x7f84f8004d10 2023-11-28T20:38:50.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850800f040 con 0x7f84f8004d10 2023-11-28T20:38:50.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f850e7fc640 1 -- 172.21.15.167:0/852178809 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85080ad680 con 0x7f84f8004d10 2023-11-28T20:38:50.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f8515df5640 1 -- 172.21.15.167:0/852178809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84f8004d10 msgr2=0x7f84f8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f8515df5640 1 --2- 172.21.15.167:0/852178809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84f8004d10 0x7f84f8005190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8508009fc0 tx=0x7f850801ccf0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f850ffff640 1 -- 172.21.15.167:0/852178809 reap_dead start 2023-11-28T20:38:50.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f8515df5640 1 -- 172.21.15.167:0/852178809 shutdown_connections 2023-11-28T20:38:50.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f8515df5640 1 -- 172.21.15.167:0/852178809 >> 172.21.15.167:0/852178809 conn(0x7f85100cb1e0 msgr2=0x7f85100cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:50.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f8515df5640 1 -- 172.21.15.167:0/852178809 shutdown_connections 2023-11-28T20:38:50.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.704+0000 7f8515df5640 1 -- 172.21.15.167:0/852178809 wait complete. 2023-11-28T20:38:50.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 Processor -- start 2023-11-28T20:38:50.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 -- start start 2023-11-28T20:38:50.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8004d10 0x7f8510147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85101ee8a0 0x7f851014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510148730 0x7f8510148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85101eb540 con 0x7f85101ee8a0 2023-11-28T20:38:50.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85101ea950 con 0x7f84f8004d10 2023-11-28T20:38:50.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85101482e0 con 0x7f8510148730 2023-11-28T20:38:50.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85101ee8a0 0x7f851014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85101ee8a0 0x7f851014e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47192/0 (socket says 172.21.15.167:47192) 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850effd640 1 -- 172.21.15.167:0/2117787092 learned_addr learned my addr 172.21.15.167:0/2117787092 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850ffff640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510148730 0x7f8510148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850f7fe640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8004d10 0x7f8510147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850effd640 1 -- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510148730 msgr2=0x7f8510148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850effd640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510148730 0x7f8510148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850effd640 1 -- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8004d10 msgr2=0x7f8510147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850effd640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8004d10 0x7f8510147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850effd640 1 -- 172.21.15.167:0/2117787092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85101eac10 con 0x7f85101ee8a0 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850f7fe640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8004d10 0x7f8510147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f850effd640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85101ee8a0 0x7f851014e900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8504001060 tx=0x7f85040077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:50.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f84f7fff640 1 -- 172.21.15.167:0/2117787092 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400f990 con 0x7f85101ee8a0 2023-11-28T20:38:50.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f84f7fff640 1 -- 172.21.15.167:0/2117787092 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850400faf0 con 0x7f85101ee8a0 2023-11-28T20:38:50.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f84f7fff640 1 -- 172.21.15.167:0/2117787092 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400fea0 con 0x7f85101ee8a0 2023-11-28T20:38:50.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85101eaef0 con 0x7f85101ee8a0 2023-11-28T20:38:50.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.708+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85101eed00 con 0x7f85101ee8a0 2023-11-28T20:38:50.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.712+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85100682c0 con 0x7f85101ee8a0 2023-11-28T20:38:50.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.712+0000 7f84f7fff640 1 -- 172.21.15.167:0/2117787092 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f850401d460 con 0x7f85101ee8a0 2023-11-28T20:38:50.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.712+0000 7f84f7fff640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f84fc066470 0x7f84fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:50.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.712+0000 7f84f7fff640 1 -- 172.21.15.167:0/2117787092 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f85040844e0 con 0x7f85101ee8a0 2023-11-28T20:38:50.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.712+0000 7f850f7fe640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f84fc066470 0x7f84fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:50.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.712+0000 7f850f7fe640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f84fc066470 0x7f84fc068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8500007fd0 tx=0x7f8500009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:50.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.716+0000 7f84f7fff640 1 -- 172.21.15.167:0/2117787092 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8504051540 con 0x7f85101ee8a0 2023-11-28T20:38:50.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.864+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8510075c90 con 0x7f85101ee8a0 2023-11-28T20:38:50.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.864+0000 7f84f7fff640 1 -- 172.21.15.167:0/2117787092 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8504054b60 con 0x7f85101ee8a0 2023-11-28T20:38:50.869 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:38:50.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f84fc066470 msgr2=0x7f84fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f84fc066470 0x7f84fc068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8500007fd0 tx=0x7f8500009040 comp rx=0 tx=0).stop 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85101ee8a0 msgr2=0x7f851014e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85101ee8a0 0x7f851014e900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8504001060 tx=0x7f85040077a0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 shutdown_connections 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f84fc066470 0x7f84fc068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8510148730 0x7f8510148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85101ee8a0 0x7f851014e900 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 --2- 172.21.15.167:0/2117787092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84f8004d10 0x7f8510147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 >> 172.21.15.167:0/2117787092 conn(0x7f85100cb1e0 msgr2=0x7f8510155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 shutdown_connections 2023-11-28T20:38:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:50.868+0000 7f8515df5640 1 -- 172.21.15.167:0/2117787092 wait complete. 2023-11-28T20:38:50.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:38:51.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.024+0000 7f915b017640 1 Processor -- start 2023-11-28T20:38:51.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.024+0000 7f915b017640 1 -- start start 2023-11-28T20:38:51.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f915b017640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c5c90 0x7f91541635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f915b017640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91540c7a50 con 0x7f91540c75c0 2023-11-28T20:38:51.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f915b017640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915415b220 con 0x7f9154151f60 2023-11-28T20:38:51.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f915b017640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91540c4da0 con 0x7f91540c5c90 2023-11-28T20:38:51.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f914bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f91540c75c0 0x7f915406a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44796/0 (socket says 172.21.15.167:44796) 2023-11-28T20:38:51.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f914bfff640 1 -- 172.21.15.167:0/1672997347 learned_addr learned my addr 172.21.15.167:0/1672997347 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:51.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f91595b4640 1 --2- 172.21.15.167:0/1672997347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c5c90 0x7f91541635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f914b7fe640 1 -- 172.21.15.167:0/1672997347 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133959597 0 0) 0x7f9144001120 con 0x7f91540c75c0 2023-11-28T20:38:51.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f914b7fe640 1 -- 172.21.15.167:0/1672997347 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f913c003530 con 0x7f91540c75c0 2023-11-28T20:38:51.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f914b7fe640 1 -- 172.21.15.167:0/1672997347 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607451398 0 0) 0x7f915415b220 con 0x7f9154151f60 2023-11-28T20:38:51.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f914b7fe640 1 -- 172.21.15.167:0/1672997347 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9144001120 con 0x7f9154151f60 2023-11-28T20:38:51.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f91595b4640 1 -- 172.21.15.167:0/1672997347 >> v1:172.21.15.178:6789/0 conn(0x7f9154151f60 legacy=0x7f91540c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f91595b4640 1 -- 172.21.15.167:0/1672997347 >> v1:172.21.15.167:6789/0 conn(0x7f91540c75c0 legacy=0x7f915406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.028+0000 7f91595b4640 1 -- 172.21.15.167:0/1672997347 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9154152340 con 0x7f91540c5c90 2023-11-28T20:38:51.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f91595b4640 1 --2- 172.21.15.167:0/1672997347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c5c90 0x7f91541635c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f914c009dc0 tx=0x7f914c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c88a4c333cfb7def server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:51.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f914b7fe640 1 -- 172.21.15.167:0/1672997347 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c0a57a0 con 0x7f91540c5c90 2023-11-28T20:38:51.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f914b7fe640 1 -- 172.21.15.167:0/1672997347 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c0a5900 con 0x7f91540c5c90 2023-11-28T20:38:51.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f914b7fe640 1 -- 172.21.15.167:0/1672997347 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c0a5c70 con 0x7f91540c5c90 2023-11-28T20:38:51.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f915b017640 1 -- 172.21.15.167:0/1672997347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c5c90 msgr2=0x7f91541635c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f915b017640 1 --2- 172.21.15.167:0/1672997347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c5c90 0x7f91541635c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f914c009dc0 tx=0x7f914c01c8e0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f915b017640 1 -- 172.21.15.167:0/1672997347 shutdown_connections 2023-11-28T20:38:51.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f915b017640 1 --2- 172.21.15.167:0/1672997347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c5c90 0x7f91541635c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f915b017640 1 -- 172.21.15.167:0/1672997347 >> 172.21.15.167:0/1672997347 conn(0x7f91540cb1e0 msgr2=0x7f91540cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:51.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f915b017640 1 -- 172.21.15.167:0/1672997347 shutdown_connections 2023-11-28T20:38:51.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f915b017640 1 -- 172.21.15.167:0/1672997347 wait complete. 2023-11-28T20:38:51.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f915b017640 1 Processor -- start 2023-11-28T20:38:51.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.032+0000 7f915b017640 1 -- start start 2023-11-28T20:38:51.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f915b017640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91540c5c90 0x7f91540c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f915b017640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c75c0 0x7f91541481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f915b017640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154151f60 0x7f915414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f915b017640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91541f78a0 con 0x7f9154151f60 2023-11-28T20:38:51.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f915b017640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91541f6f90 con 0x7f91540c5c90 2023-11-28T20:38:51.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f915b017640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91540c11c0 con 0x7f91540c75c0 2023-11-28T20:38:51.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91595b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154151f60 0x7f915414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91595b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154151f60 0x7f915414d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47206/0 (socket says 172.21.15.167:47206) 2023-11-28T20:38:51.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91595b4640 1 -- 172.21.15.167:0/262279812 learned_addr learned my addr 172.21.15.167:0/262279812 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:51.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f914bfff640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c75c0 0x7f91541481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f9158db3640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91540c5c90 0x7f91540c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91595b4640 1 -- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c75c0 msgr2=0x7f91541481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91595b4640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c75c0 0x7f91541481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91595b4640 1 -- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91540c5c90 msgr2=0x7f91540c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91595b4640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91540c5c90 0x7f91540c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91595b4640 1 -- 172.21.15.167:0/262279812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c009a70 con 0x7f9154151f60 2023-11-28T20:38:51.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f914bfff640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c75c0 0x7f91541481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:51.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91595b4640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154151f60 0x7f915414d9a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f914c0194f0 tx=0x7f914c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:51.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91497fa640 1 -- 172.21.15.167:0/262279812 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c003db0 con 0x7f9154151f60 2023-11-28T20:38:51.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91497fa640 1 -- 172.21.15.167:0/262279812 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c004040 con 0x7f9154151f60 2023-11-28T20:38:51.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91497fa640 1 -- 172.21.15.167:0/262279812 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c0043b0 con 0x7f9154151f60 2023-11-28T20:38:51.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91540c14a0 con 0x7f9154151f60 2023-11-28T20:38:51.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91541f7530 con 0x7f9154151f60 2023-11-28T20:38:51.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91540682c0 con 0x7f9154151f60 2023-11-28T20:38:51.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.036+0000 7f91497fa640 1 -- 172.21.15.167:0/262279812 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f914c0b4070 con 0x7f9154151f60 2023-11-28T20:38:51.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.040+0000 7f91497fa640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9140066470 0x7f9140068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.040+0000 7f91497fa640 1 -- 172.21.15.167:0/262279812 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f914c11eee0 con 0x7f9154151f60 2023-11-28T20:38:51.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.040+0000 7f9158db3640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9140066470 0x7f9140068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.040+0000 7f9158db3640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9140066470 0x7f9140068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f91500011f0 tx=0x7f9150009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:51.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.044+0000 7f91497fa640 1 -- 172.21.15.167:0/262279812 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f914c0ec100 con 0x7f9154151f60 2023-11-28T20:38:51.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9154075c90 con 0x7f9154151f60 2023-11-28T20:38:51.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f91497fa640 1 -- 172.21.15.167:0/262279812 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6542 (secure 0 0 0) 0x7f914c0b2070 con 0x7f9154151f60 2023-11-28T20:38:51.227 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:51.227 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T20:38:46.585104+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4278,"mds_2":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"f","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4278":{"gid":4278,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.167:6837/1234930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1234930245},{"type":"v1","addr":"172.21.15.167:6837","nonce":1234930245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:38:51.227 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 13 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9140066470 msgr2=0x7f9140068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9140066470 0x7f9140068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f91500011f0 tx=0x7f9150009040 comp rx=0 tx=0).stop 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154151f60 msgr2=0x7f915414d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154151f60 0x7f915414d9a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f914c0194f0 tx=0x7f914c019680 comp rx=0 tx=0).stop 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 shutdown_connections 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9140066470 0x7f9140068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9154151f60 0x7f915414d9a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91540c75c0 0x7f91541481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 --2- 172.21.15.167:0/262279812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91540c5c90 0x7f91540c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 >> 172.21.15.167:0/262279812 conn(0x7f91540cb1e0 msgr2=0x7f915414f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 shutdown_connections 2023-11-28T20:38:51.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.224+0000 7f915b017640 1 -- 172.21.15.167:0/262279812 wait complete. 2023-11-28T20:38:51.248 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:51.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feef1510640 1 Processor -- start 2023-11-28T20:38:51.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feef1510640 1 -- start start 2023-11-28T20:38:51.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feef1510640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feeec0cb500 0x7feeec0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feef1510640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec06b450 con 0x7feeec0cb940 2023-11-28T20:38:51.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feef1510640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec06b6a0 con 0x7feeec153d00 2023-11-28T20:38:51.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feef1510640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec06c320 con 0x7feeec0cb500 2023-11-28T20:38:51.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feeeb7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feeec0cb500 0x7feeec0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feeeb7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feeec0cb500 0x7feeec0c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47216/0 (socket says 172.21.15.167:47216) 2023-11-28T20:38:51.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feef0d0f640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7feeec0cb940 0x7feeec0c9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44804/0 (socket says 172.21.15.167:44804) 2023-11-28T20:38:51.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feeeb7fe640 1 -- 172.21.15.167:0/2379266050 learned_addr learned my addr 172.21.15.167:0/2379266050 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:51.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feeeb7fe640 1 -- 172.21.15.167:0/2379266050 >> v1:172.21.15.178:6789/0 conn(0x7feeec153d00 legacy=0x7feeec15da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:51.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feeeb7fe640 1 -- 172.21.15.167:0/2379266050 >> v1:172.21.15.167:6789/0 conn(0x7feeec0cb940 legacy=0x7feeec0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.384+0000 7feeeb7fe640 1 -- 172.21.15.167:0/2379266050 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec06b980 con 0x7feeec0cb500 2023-11-28T20:38:51.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feeeb7fe640 1 --2- 172.21.15.167:0/2379266050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec0cb500 0x7feeec0c43c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feee0009870 tx=0x7feee001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ca221827e28613 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:51.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feeeaffd640 1 -- 172.21.15.167:0/2379266050 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00a89f0 con 0x7feeec0cb500 2023-11-28T20:38:51.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feeeaffd640 1 -- 172.21.15.167:0/2379266050 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee00a8b50 con 0x7feeec0cb500 2023-11-28T20:38:51.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feeeaffd640 1 -- 172.21.15.167:0/2379266050 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00b0440 con 0x7feeec0cb500 2023-11-28T20:38:51.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feef1510640 1 -- 172.21.15.167:0/2379266050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec0cb500 msgr2=0x7feeec0c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feef1510640 1 --2- 172.21.15.167:0/2379266050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec0cb500 0x7feeec0c43c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feee0009870 tx=0x7feee001ecf0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feef1510640 1 -- 172.21.15.167:0/2379266050 shutdown_connections 2023-11-28T20:38:51.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feef1510640 1 --2- 172.21.15.167:0/2379266050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec0cb500 0x7feeec0c43c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feef1510640 1 -- 172.21.15.167:0/2379266050 >> 172.21.15.167:0/2379266050 conn(0x7feeec0668a0 msgr2=0x7feeec0cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:51.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feef1510640 1 -- 172.21.15.167:0/2379266050 shutdown_connections 2023-11-28T20:38:51.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.388+0000 7feef1510640 1 -- 172.21.15.167:0/2379266050 wait complete. 2023-11-28T20:38:51.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef1510640 1 Processor -- start 2023-11-28T20:38:51.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef1510640 1 -- start start 2023-11-28T20:38:51.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef1510640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeec0cb500 0x7feeec1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef1510640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeec0cb940 0x7feeec1f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef1510640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec153d00 0x7feeec145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef1510640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec14ca70 con 0x7feeec153d00 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef1510640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec1f3120 con 0x7feeec0cb500 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef1510640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec14d560 con 0x7feeec0cb940 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feeebfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeec0cb500 0x7feeec1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef0d0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec153d00 0x7feeec145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feeebfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeec0cb500 0x7feeec1526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55762/0 (socket says 172.21.15.167:55762) 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feeebfff640 1 -- 172.21.15.167:0/1593219871 learned_addr learned my addr 172.21.15.167:0/1593219871 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef0d0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec153d00 0x7feeec145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47218/0 (socket says 172.21.15.167:47218) 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feeeb7fe640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeec0cb940 0x7feeec1f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef0d0f640 1 -- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeec0cb940 msgr2=0x7feeec1f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef0d0f640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeec0cb940 0x7feeec1f35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef0d0f640 1 -- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeec0cb500 msgr2=0x7feeec1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef0d0f640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeec0cb500 0x7feeec1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.392+0000 7feef0d0f640 1 -- 172.21.15.167:0/1593219871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00094d0 con 0x7feeec153d00 2023-11-28T20:38:51.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.396+0000 7feef0d0f640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec153d00 0x7feeec145d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feeec072c60 tx=0x7feee400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:51.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.396+0000 7feee8ff9640 1 -- 172.21.15.167:0/1593219871 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4004d70 con 0x7feeec153d00 2023-11-28T20:38:51.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.396+0000 7feee8ff9640 1 -- 172.21.15.167:0/1593219871 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee400a5e0 con 0x7feeec153d00 2023-11-28T20:38:51.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.396+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec1f2df0 con 0x7feeec153d00 2023-11-28T20:38:51.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.396+0000 7feee8ff9640 1 -- 172.21.15.167:0/1593219871 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400a9b0 con 0x7feeec153d00 2023-11-28T20:38:51.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.396+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec14cfa0 con 0x7feeec153d00 2023-11-28T20:38:51.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.396+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec04e850 con 0x7feeec153d00 2023-11-28T20:38:51.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.396+0000 7feee8ff9640 1 -- 172.21.15.167:0/1593219871 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feee400ad20 con 0x7feeec153d00 2023-11-28T20:38:51.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.400+0000 7feee8ff9640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feed8066470 0x7feed8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.400+0000 7feee8ff9640 1 -- 172.21.15.167:0/1593219871 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feee4083760 con 0x7feeec153d00 2023-11-28T20:38:51.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.400+0000 7feeebfff640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feed8066470 0x7feed8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.400+0000 7feeebfff640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feed8066470 0x7feed8068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feedc0050b0 tx=0x7feedc003700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:51.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.404+0000 7feee8ff9640 1 -- 172.21.15.167:0/1593219871 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feee4050990 con 0x7feeec153d00 2023-11-28T20:38:51.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.552+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feeec1f3260 con 0x7feeec153d00 2023-11-28T20:38:51.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feee8ff9640 1 -- 172.21.15.167:0/1593219871 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7feee4053fb0 con 0x7feeec153d00 2023-11-28T20:38:51.559 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:51.560 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:51.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feed8066470 msgr2=0x7feed8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feed8066470 0x7feed8068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feedc0050b0 tx=0x7feedc003700 comp rx=0 tx=0).stop 2023-11-28T20:38:51.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec153d00 msgr2=0x7feeec145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec153d00 0x7feeec145d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feeec072c60 tx=0x7feee400cb90 comp rx=0 tx=0).stop 2023-11-28T20:38:51.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 shutdown_connections 2023-11-28T20:38:51.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feed8066470 0x7feed8068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeec153d00 0x7feeec145d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeec0cb940 0x7feeec1f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 --2- 172.21.15.167:0/1593219871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeec0cb500 0x7feeec1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 >> 172.21.15.167:0/1593219871 conn(0x7feeec0668a0 msgr2=0x7feeec149300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:51.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 shutdown_connections 2023-11-28T20:38:51.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.556+0000 7feef1510640 1 -- 172.21.15.167:0/1593219871 wait complete. 2023-11-28T20:38:51.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:38:05.507993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:38:17.477871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:38:17.884061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T20:38:21.578587+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T20:38:51.580 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:38:51.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd7180640 1 Processor -- start 2023-11-28T20:38:51.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd7180640 1 -- start start 2023-11-28T20:38:51.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd7180640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0cd00cb770 0x7f0cd015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd7180640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd015ac00 con 0x7f0cd00cfc40 2023-11-28T20:38:51.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd7180640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd00cbd60 con 0x7f0cd00cf860 2023-11-28T20:38:51.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd7180640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd0159ff0 con 0x7f0cd00cb770 2023-11-28T20:38:51.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd571d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0cd00cb770 0x7f0cd015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cc7fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0cd00cfc40 0x7f0cd0153ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44806/0 (socket says 172.21.15.167:44806) 2023-11-28T20:38:51.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cc7fff640 1 -- 172.21.15.167:0/264115669 learned_addr learned my addr 172.21.15.167:0/264115669 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:51.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd571d640 1 -- 172.21.15.167:0/264115669 >> v1:172.21.15.178:6789/0 conn(0x7f0cd00cf860 legacy=0x7f0cd00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd571d640 1 -- 172.21.15.167:0/264115669 >> v1:172.21.15.167:6789/0 conn(0x7f0cd00cfc40 legacy=0x7f0cd0153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cd571d640 1 -- 172.21.15.167:0/264115669 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd015a2d0 con 0x7f0cd00cb770 2023-11-28T20:38:51.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.724+0000 7f0cc77fe640 1 -- 172.21.15.167:0/264115669 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204309376 0 0) 0x7f0cd015ac00 con 0x7f0cd00cfc40 2023-11-28T20:38:51.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cd571d640 1 --2- 172.21.15.167:0/264115669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cb770 0x7f0cd015d4d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009d90 tx=0x7f0cc801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556e5bde2aeac80c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:51.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cc77fe640 1 -- 172.21.15.167:0/264115669 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80a59e0 con 0x7f0cd00cb770 2023-11-28T20:38:51.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cc77fe640 1 -- 172.21.15.167:0/264115669 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc80a5b40 con 0x7f0cd00cb770 2023-11-28T20:38:51.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cc77fe640 1 -- 172.21.15.167:0/264115669 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80ad440 con 0x7f0cd00cb770 2023-11-28T20:38:51.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cd7180640 1 -- 172.21.15.167:0/264115669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cb770 msgr2=0x7f0cd015d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cd7180640 1 --2- 172.21.15.167:0/264115669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cb770 0x7f0cd015d4d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009d90 tx=0x7f0cc801c920 comp rx=0 tx=0).stop 2023-11-28T20:38:51.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cd7180640 1 -- 172.21.15.167:0/264115669 shutdown_connections 2023-11-28T20:38:51.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cd7180640 1 --2- 172.21.15.167:0/264115669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cb770 0x7f0cd015d4d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cd7180640 1 -- 172.21.15.167:0/264115669 >> 172.21.15.167:0/264115669 conn(0x7f0cd006c1f0 msgr2=0x7f0cd0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:51.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cd7180640 1 -- 172.21.15.167:0/264115669 shutdown_connections 2023-11-28T20:38:51.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.728+0000 7f0cd7180640 1 -- 172.21.15.167:0/264115669 wait complete. 2023-11-28T20:38:51.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 Processor -- start 2023-11-28T20:38:51.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 -- start start 2023-11-28T20:38:51.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00cb770 0x7f0cd014a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cf860 0x7f0cd014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd00cfc40 0x7f0cd014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0149b50 con 0x7f0cd00cf860 2023-11-28T20:38:51.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd00c89f0 con 0x7f0cd00cfc40 2023-11-28T20:38:51.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd014d830 con 0x7f0cd00cb770 2023-11-28T20:38:51.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cf860 0x7f0cd014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cf860 0x7f0cd014c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47236/0 (socket says 172.21.15.167:47236) 2023-11-28T20:38:51.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc7fff640 1 -- 172.21.15.167:0/1417964353 learned_addr learned my addr 172.21.15.167:0/1417964353 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:51.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd4f1c640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00cb770 0x7f0cd014a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd571d640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd00cfc40 0x7f0cd014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc7fff640 1 -- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00cb770 msgr2=0x7f0cd014a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc7fff640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00cb770 0x7f0cd014a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc7fff640 1 -- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd00cfc40 msgr2=0x7f0cd014cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc7fff640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd00cfc40 0x7f0cd014cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc7fff640 1 -- 172.21.15.167:0/1417964353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8009a70 con 0x7f0cd00cf860 2023-11-28T20:38:51.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd571d640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd00cfc40 0x7f0cd014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:51.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc7fff640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cf860 0x7f0cd014c760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c4a0 tx=0x7f0cc000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:51.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc57fa640 1 -- 172.21.15.167:0/1417964353 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00074e0 con 0x7f0cd00cf860 2023-11-28T20:38:51.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc57fa640 1 -- 172.21.15.167:0/1417964353 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc0007640 con 0x7f0cd00cf860 2023-11-28T20:38:51.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cc57fa640 1 -- 172.21.15.167:0/1417964353 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0004a30 con 0x7f0cd00cf860 2023-11-28T20:38:51.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd014b170 con 0x7f0cd00cf860 2023-11-28T20:38:51.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.732+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd014db10 con 0x7f0cd00cf860 2023-11-28T20:38:51.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.736+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd0067c40 con 0x7f0cd00cf860 2023-11-28T20:38:51.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.736+0000 7f0cc57fa640 1 -- 172.21.15.167:0/1417964353 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0cc0004b90 con 0x7f0cd00cf860 2023-11-28T20:38:51.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.736+0000 7f0cc57fa640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cbc0664a0 0x7f0cbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:51.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.736+0000 7f0cc57fa640 1 -- 172.21.15.167:0/1417964353 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cc00831e0 con 0x7f0cd00cf860 2023-11-28T20:38:51.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.736+0000 7f0cd4f1c640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cbc0664a0 0x7f0cbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:51.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.736+0000 7f0cd4f1c640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cbc0664a0 0x7f0cbc068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc007fd0 tx=0x7f0ccc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:51.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.740+0000 7f0cc57fa640 1 -- 172.21.15.167:0/1417964353 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0cc0050410 con 0x7f0cd00cf860 2023-11-28T20:38:51.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.892+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cd0159ca0 con 0x7f0cd00cf860 2023-11-28T20:38:51.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.892+0000 7f0cc57fa640 1 -- 172.21.15.167:0/1417964353 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cd0159ca0 con 0x7f0cd00cf860 2023-11-28T20:38:51.898 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2023-11-28T20:38:51.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cbc0664a0 msgr2=0x7f0cbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cbc0664a0 0x7f0cbc068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc007fd0 tx=0x7f0ccc009040 comp rx=0 tx=0).stop 2023-11-28T20:38:51.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cf860 msgr2=0x7f0cd014c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:51.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cf860 0x7f0cd014c760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c4a0 tx=0x7f0cc000c960 comp rx=0 tx=0).stop 2023-11-28T20:38:51.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 shutdown_connections 2023-11-28T20:38:51.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cbc0664a0 0x7f0cbc068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd00cfc40 0x7f0cd014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cd00cf860 0x7f0cd014c760 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 --2- 172.21.15.167:0/1417964353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00cb770 0x7f0cd014a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:51.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 >> 172.21.15.167:0/1417964353 conn(0x7f0cd006c1f0 msgr2=0x7f0cd00662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:51.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 shutdown_connections 2023-11-28T20:38:51.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:51.896+0000 7f0cd7180640 1 -- 172.21.15.167:0/1417964353 wait complete. 2023-11-28T20:38:51.918 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:38:52.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.052+0000 7fd1cc86b640 1 Processor -- start 2023-11-28T20:38:52.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.052+0000 7fd1cc86b640 1 -- start start 2023-11-28T20:38:52.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1cc86b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1c8150cd0 0x7fd1c8157490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1cc86b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6820 0x7fd1c80c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1cc86b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd1c80c6ff0 0x7fd1c806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1cc86b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c80c49c0 con 0x7fd1c8150cd0 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1cc86b640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c80c26e0 con 0x7fd1c80c6ff0 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1cc86b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80c5d80 con 0x7fd1c80c6820 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1c659c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1c8150cd0 0x7fd1c8157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1c659c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1c8150cd0 0x7fd1c8157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47238/0 (socket says 172.21.15.167:47238) 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1c659c640 1 -- 172.21.15.167:0/3960882958 learned_addr learned my addr 172.21.15.167:0/3960882958 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1bdd9b640 1 --2- 172.21.15.167:0/3960882958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6820 0x7fd1c80c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1c6d9d640 1 --2- 172.21.15.167:0/3960882958 >> v2:172.21.15.178:3300/0 conn(0x7fd1c80c6ff0 0x7fd1c806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1c659c640 1 -- 172.21.15.167:0/3960882958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6820 msgr2=0x7fd1c80c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:52.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1c659c640 1 --2- 172.21.15.167:0/3960882958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6820 0x7fd1c80c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1c659c640 1 -- 172.21.15.167:0/3960882958 >> v2:172.21.15.178:3300/0 conn(0x7fd1c80c6ff0 msgr2=0x7fd1c806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1c659c640 1 --2- 172.21.15.167:0/3960882958 >> v2:172.21.15.178:3300/0 conn(0x7fd1c80c6ff0 0x7fd1c806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1c659c640 1 -- 172.21.15.167:0/3960882958 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80c2f40 con 0x7fd1c8150cd0 2023-11-28T20:38:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.056+0000 7fd1bdd9b640 1 --2- 172.21.15.167:0/3960882958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6820 0x7fd1c80c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:52.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1c659c640 1 --2- 172.21.15.167:0/3960882958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c8150cd0 0x7fd1c8157490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd1c806bba0 tx=0x7fd1b801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77d5e4c31813105 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:52.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1c5d9b640 1 -- 172.21.15.167:0/3960882958 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80a7b70 con 0x7fd1c8150cd0 2023-11-28T20:38:52.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1c5d9b640 1 -- 172.21.15.167:0/3960882958 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b80a7cd0 con 0x7fd1c8150cd0 2023-11-28T20:38:52.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1c5d9b640 1 -- 172.21.15.167:0/3960882958 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80af660 con 0x7fd1c8150cd0 2023-11-28T20:38:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 -- 172.21.15.167:0/3960882958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c8150cd0 msgr2=0x7fd1c8157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/3960882958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c8150cd0 0x7fd1c8157490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd1c806bba0 tx=0x7fd1b801ebd0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 -- 172.21.15.167:0/3960882958 shutdown_connections 2023-11-28T20:38:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/3960882958 >> v2:172.21.15.178:3300/0 conn(0x7fd1c80c6ff0 0x7fd1c806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/3960882958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6820 0x7fd1c80c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/3960882958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c8150cd0 0x7fd1c8157490 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 -- 172.21.15.167:0/3960882958 >> 172.21.15.167:0/3960882958 conn(0x7fd1c80cb1e0 msgr2=0x7fd1c80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 -- 172.21.15.167:0/3960882958 shutdown_connections 2023-11-28T20:38:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 -- 172.21.15.167:0/3960882958 wait complete. 2023-11-28T20:38:52.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 Processor -- start 2023-11-28T20:38:52.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.060+0000 7fd1cc86b640 1 -- start start 2023-11-28T20:38:52.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1cc86b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c80c6820 0x7fd1c81f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1cc86b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6ff0 0x7fd1c81f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1cc86b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1c8150cd0 0x7fd1c814bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1cc86b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81f27c0 con 0x7fd1c80c6820 2023-11-28T20:38:52.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1cc86b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81f6c80 con 0x7fd1c8150cd0 2023-11-28T20:38:52.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1cc86b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c81f2d40 con 0x7fd1c80c6ff0 2023-11-28T20:38:52.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c80c6820 0x7fd1c81f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c80c6820 0x7fd1c81f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47254/0 (socket says 172.21.15.167:47254) 2023-11-28T20:38:52.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c659c640 1 -- 172.21.15.167:0/2984122437 learned_addr learned my addr 172.21.15.167:0/2984122437 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:52.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1bdd9b640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6ff0 0x7fd1c81f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c6d9d640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1c8150cd0 0x7fd1c814bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c659c640 1 -- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6ff0 msgr2=0x7fd1c81f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c659c640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6ff0 0x7fd1c81f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c659c640 1 -- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1c8150cd0 msgr2=0x7fd1c814bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c659c640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1c8150cd0 0x7fd1c814bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c659c640 1 -- 172.21.15.167:0/2984122437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b800b770 con 0x7fd1c80c6820 2023-11-28T20:38:52.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1c659c640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c80c6820 0x7fd1c81f6740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800b2c0 tx=0x7fd1b801d410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:52.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1bf7fe640 1 -- 172.21.15.167:0/2984122437 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80afea0 con 0x7fd1c80c6820 2023-11-28T20:38:52.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1bf7fe640 1 -- 172.21.15.167:0/2984122437 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b80ba480 con 0x7fd1c80c6820 2023-11-28T20:38:52.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1bf7fe640 1 -- 172.21.15.167:0/2984122437 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80ba830 con 0x7fd1c80c6820 2023-11-28T20:38:52.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c81f3710 con 0x7fd1c80c6820 2023-11-28T20:38:52.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c8155700 con 0x7fd1c80c6820 2023-11-28T20:38:52.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c80682c0 con 0x7fd1c80c6820 2023-11-28T20:38:52.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.064+0000 7fd1bf7fe640 1 -- 172.21.15.167:0/2984122437 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1b80ba990 con 0x7fd1c80c6820 2023-11-28T20:38:52.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.068+0000 7fd1bf7fe640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd1a80664a0 0x7fd1a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.068+0000 7fd1bf7fe640 1 -- 172.21.15.167:0/2984122437 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1b80a7e40 con 0x7fd1c80c6820 2023-11-28T20:38:52.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.068+0000 7fd1bdd9b640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd1a80664a0 0x7fd1a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.068+0000 7fd1bdd9b640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd1a80664a0 0x7fd1a8068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80c5170 tx=0x7fd1b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:52.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.072+0000 7fd1bf7fe640 1 -- 172.21.15.167:0/2984122437 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1b80ec980 con 0x7fd1c80c6820 2023-11-28T20:38:52.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1c8075c90 con 0x7fd1c80c6820 2023-11-28T20:38:52.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1bf7fe640 1 -- 172.21.15.167:0/2984122437 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1b80effa0 con 0x7fd1c80c6820 2023-11-28T20:38:52.223 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:38:52.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd1a80664a0 msgr2=0x7fd1a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd1a80664a0 0x7fd1a8068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80c5170 tx=0x7fd1b0008040 comp rx=0 tx=0).stop 2023-11-28T20:38:52.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c80c6820 msgr2=0x7fd1c81f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c80c6820 0x7fd1c81f6740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800b2c0 tx=0x7fd1b801d410 comp rx=0 tx=0).stop 2023-11-28T20:38:52.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 shutdown_connections 2023-11-28T20:38:52.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd1a80664a0 0x7fd1a8068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1c8150cd0 0x7fd1c814bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1c80c6ff0 0x7fd1c81f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 --2- 172.21.15.167:0/2984122437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1c80c6820 0x7fd1c81f6740 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 >> 172.21.15.167:0/2984122437 conn(0x7fd1c80cb1e0 msgr2=0x7fd1c8160980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 shutdown_connections 2023-11-28T20:38:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.220+0000 7fd1cc86b640 1 -- 172.21.15.167:0/2984122437 wait complete. 2023-11-28T20:38:52.244 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:38:52.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.380+0000 7f44f209e640 1 Processor -- start 2023-11-28T20:38:52.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.380+0000 7f44f209e640 1 -- start start 2023-11-28T20:38:52.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.380+0000 7f44f209e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f44ec0cb770 0x7f44ec15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.380+0000 7f44f209e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec15ac00 con 0x7f44ec0cf860 2023-11-28T20:38:52.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.380+0000 7f44f209e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec0cbd60 con 0x7f44ec0cfc40 2023-11-28T20:38:52.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.380+0000 7f44f209e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec159ff0 con 0x7f44ec0cb770 2023-11-28T20:38:52.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.380+0000 7f44ebfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f44ec0cb770 0x7f44ec15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.384+0000 7f44eb7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f44ec0cf860 0x7f44ec0ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44816/0 (socket says 172.21.15.167:44816) 2023-11-28T20:38:52.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.384+0000 7f44eb7fe640 1 -- 172.21.15.167:0/1851857439 learned_addr learned my addr 172.21.15.167:0/1851857439 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:52.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.384+0000 7f44ebfff640 1 -- 172.21.15.167:0/1851857439 >> v1:172.21.15.178:6789/0 conn(0x7f44ec0cfc40 legacy=0x7f44ec153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.384+0000 7f44ebfff640 1 -- 172.21.15.167:0/1851857439 >> v1:172.21.15.167:6789/0 conn(0x7f44ec0cf860 legacy=0x7f44ec0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.384+0000 7f44ebfff640 1 -- 172.21.15.167:0/1851857439 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec15a2d0 con 0x7f44ec0cb770 2023-11-28T20:38:52.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.384+0000 7f44ebfff640 1 --2- 172.21.15.167:0/1851857439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 0x7f44ec15d4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009d90 tx=0x7f44e401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c2f021b53bdd5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:52.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.384+0000 7f44ea7fc640 1 -- 172.21.15.167:0/1851857439 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40a59e0 con 0x7f44ec0cb770 2023-11-28T20:38:52.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.384+0000 7f44ea7fc640 1 -- 172.21.15.167:0/1851857439 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e40a5b40 con 0x7f44ec0cb770 2023-11-28T20:38:52.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.384+0000 7f44ea7fc640 1 -- 172.21.15.167:0/1851857439 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40ad440 con 0x7f44ec0cb770 2023-11-28T20:38:52.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 -- 172.21.15.167:0/1851857439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 msgr2=0x7f44ec15d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 --2- 172.21.15.167:0/1851857439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 0x7f44ec15d4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009d90 tx=0x7f44e401c920 comp rx=0 tx=0).stop 2023-11-28T20:38:52.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 -- 172.21.15.167:0/1851857439 shutdown_connections 2023-11-28T20:38:52.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 --2- 172.21.15.167:0/1851857439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 0x7f44ec15d4d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 -- 172.21.15.167:0/1851857439 >> 172.21.15.167:0/1851857439 conn(0x7f44ec06c1f0 msgr2=0x7f44ec071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:52.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 -- 172.21.15.167:0/1851857439 shutdown_connections 2023-11-28T20:38:52.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 -- 172.21.15.167:0/1851857439 wait complete. 2023-11-28T20:38:52.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 Processor -- start 2023-11-28T20:38:52.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 -- start start 2023-11-28T20:38:52.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 0x7f44ec1f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ec0cf860 0x7f44ec152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44ec0cfc40 0x7f44ec0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0c73a0 con 0x7f44ec0cb770 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec1f61e0 con 0x7f44ec0cf860 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44f209e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0c6860 con 0x7f44ec0cfc40 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 0x7f44ec1f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 0x7f44ec1f6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47272/0 (socket says 172.21.15.167:47272) 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eb7fe640 1 -- 172.21.15.167:0/1118375684 learned_addr learned my addr 172.21.15.167:0/1118375684 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eaffd640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ec0cf860 0x7f44ec152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44ebfff640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44ec0cfc40 0x7f44ec0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eb7fe640 1 -- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44ec0cfc40 msgr2=0x7f44ec0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eb7fe640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44ec0cfc40 0x7f44ec0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eb7fe640 1 -- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ec0cf860 msgr2=0x7f44ec152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eb7fe640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ec0cf860 0x7f44ec152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eb7fe640 1 -- 172.21.15.167:0/1118375684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4009a70 con 0x7f44ec0cb770 2023-11-28T20:38:52.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.388+0000 7f44eb7fe640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 0x7f44ec1f6670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00c400 tx=0x7f44dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:52.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44d3fff640 1 -- 172.21.15.167:0/1118375684 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc005cf0 con 0x7f44ec0cb770 2023-11-28T20:38:52.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44d3fff640 1 -- 172.21.15.167:0/1118375684 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc005e50 con 0x7f44ec0cb770 2023-11-28T20:38:52.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44d3fff640 1 -- 172.21.15.167:0/1118375684 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc0072d0 con 0x7f44ec0cb770 2023-11-28T20:38:52.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec1f6bb0 con 0x7f44ec0cb770 2023-11-28T20:38:52.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec0c6de0 con 0x7f44ec0cb770 2023-11-28T20:38:52.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ec067c40 con 0x7f44ec0cb770 2023-11-28T20:38:52.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44d3fff640 1 -- 172.21.15.167:0/1118375684 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44dc007430 con 0x7f44ec0cb770 2023-11-28T20:38:52.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44d3fff640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f44d8066470 0x7f44d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44d3fff640 1 -- 172.21.15.167:0/1118375684 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44dc0837f0 con 0x7f44ec0cb770 2023-11-28T20:38:52.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.392+0000 7f44eaffd640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f44d8066470 0x7f44d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.396+0000 7f44eaffd640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f44d8066470 0x7f44d8068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0cb740 tx=0x7f44e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:52.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.396+0000 7f44d3fff640 1 -- 172.21.15.167:0/1118375684 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44dc050900 con 0x7f44ec0cb770 2023-11-28T20:38:52.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.548+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44ec075c90 con 0x7f44ec0cb770 2023-11-28T20:38:52.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.548+0000 7f44d3fff640 1 -- 172.21.15.167:0/1118375684 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44dc017020 con 0x7f44ec0cb770 2023-11-28T20:38:52.553 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2023-11-28T20:38:52.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f44d8066470 msgr2=0x7f44d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f44d8066470 0x7f44d8068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0cb740 tx=0x7f44e0009040 comp rx=0 tx=0).stop 2023-11-28T20:38:52.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 msgr2=0x7f44ec1f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 0x7f44ec1f6670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00c400 tx=0x7f44dc00c8c0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 shutdown_connections 2023-11-28T20:38:52.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f44d8066470 0x7f44d8068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44ec0cfc40 0x7f44ec0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ec0cf860 0x7f44ec152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 --2- 172.21.15.167:0/1118375684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44ec0cb770 0x7f44ec1f6670 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 >> 172.21.15.167:0/1118375684 conn(0x7f44ec06c1f0 msgr2=0x7f44ec0662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:52.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 shutdown_connections 2023-11-28T20:38:52.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.552+0000 7f44f209e640 1 -- 172.21.15.167:0/1118375684 wait complete. 2023-11-28T20:38:52.575 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T20:38:52.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f87051f5640 1 Processor -- start 2023-11-28T20:38:52.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f87051f5640 1 -- start start 2023-11-28T20:38:52.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f87051f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8700150b40 0x7f8700157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f87051f5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f87000c6ff0 0x7f87000c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f87051f5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87000c6ac0 con 0x7f87000c5be0 2023-11-28T20:38:52.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f87051f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87000c6500 con 0x7f8700150b40 2023-11-28T20:38:52.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f87051f5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87000c67e0 con 0x7f87000c6ff0 2023-11-28T20:38:52.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f86fed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8700150b40 0x7f8700157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f86fed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8700150b40 0x7f8700157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47274/0 (socket says 172.21.15.167:47274) 2023-11-28T20:38:52.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.712+0000 7f86fed9d640 1 -- 172.21.15.167:0/3057471060 learned_addr learned my addr 172.21.15.167:0/3057471060 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:52.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.716+0000 7f86f659c640 1 --2- 172.21.15.167:0/3057471060 >> v2:172.21.15.178:3300/0 conn(0x7f87000c6ff0 0x7f87000c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.716+0000 7f86fed9d640 1 -- 172.21.15.167:0/3057471060 >> v2:172.21.15.178:3300/0 conn(0x7f87000c6ff0 msgr2=0x7f87000c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:52.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.716+0000 7f86fed9d640 1 --2- 172.21.15.167:0/3057471060 >> v2:172.21.15.178:3300/0 conn(0x7f87000c6ff0 0x7f87000c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.716+0000 7f86fed9d640 1 -- 172.21.15.167:0/3057471060 >> v1:172.21.15.178:6789/0 conn(0x7f87000c5be0 legacy=0x7f870006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:52.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.716+0000 7f86fed9d640 1 -- 172.21.15.167:0/3057471060 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8700156a80 con 0x7f8700150b40 2023-11-28T20:38:52.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.716+0000 7f86fed9d640 1 --2- 172.21.15.167:0/3057471060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 0x7f8700157560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f87000cc090 tx=0x7f86f001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d5aa804605804b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:52.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.716+0000 7f86fe59c640 1 -- 172.21.15.167:0/3057471060 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f00ab670 con 0x7f8700150b40 2023-11-28T20:38:52.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.716+0000 7f86fe59c640 1 -- 172.21.15.167:0/3057471060 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f00ab7d0 con 0x7f8700150b40 2023-11-28T20:38:52.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.716+0000 7f86fe59c640 1 -- 172.21.15.167:0/3057471060 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f00abb60 con 0x7f8700150b40 2023-11-28T20:38:52.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 -- 172.21.15.167:0/3057471060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 msgr2=0x7f8700157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 --2- 172.21.15.167:0/3057471060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 0x7f8700157560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f87000cc090 tx=0x7f86f001c470 comp rx=0 tx=0).stop 2023-11-28T20:38:52.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 -- 172.21.15.167:0/3057471060 shutdown_connections 2023-11-28T20:38:52.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 --2- 172.21.15.167:0/3057471060 >> v2:172.21.15.178:3300/0 conn(0x7f87000c6ff0 0x7f87000c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 --2- 172.21.15.167:0/3057471060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 0x7f8700157560 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 -- 172.21.15.167:0/3057471060 >> 172.21.15.167:0/3057471060 conn(0x7f87000cb1e0 msgr2=0x7f87000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:52.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 -- 172.21.15.167:0/3057471060 shutdown_connections 2023-11-28T20:38:52.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 -- 172.21.15.167:0/3057471060 wait complete. 2023-11-28T20:38:52.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 Processor -- start 2023-11-28T20:38:52.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 -- start start 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87000c5be0 0x7f8700158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87000c6ff0 0x7f8700160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 0x7f87000705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8700158a80 con 0x7f8700150b40 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87001f30c0 con 0x7f87000c5be0 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f87051f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87001f24d0 con 0x7f87000c6ff0 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f86ff59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 0x7f87000705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f86ff59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 0x7f87000705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47280/0 (socket says 172.21.15.167:47280) 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f86ff59e640 1 -- 172.21.15.167:0/1749802451 learned_addr learned my addr 172.21.15.167:0/1749802451 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:52.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f86fed9d640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87000c5be0 0x7f8700158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.720+0000 7f86f659c640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87000c6ff0 0x7f8700160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86ff59e640 1 -- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87000c6ff0 msgr2=0x7f8700160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86ff59e640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87000c6ff0 0x7f8700160880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86ff59e640 1 -- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87000c5be0 msgr2=0x7f8700158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86ff59e640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87000c5be0 0x7f8700158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86ff59e640 1 -- 172.21.15.167:0/1749802451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f00094d0 con 0x7f8700150b40 2023-11-28T20:38:52.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86f659c640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87000c6ff0 0x7f8700160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:52.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86ff59e640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 0x7f87000705a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86f800b970 tx=0x7f86f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:52.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86f7fff640 1 -- 172.21.15.167:0/1749802451 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800cb40 con 0x7f8700150b40 2023-11-28T20:38:52.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86f7fff640 1 -- 172.21.15.167:0/1749802451 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f800cca0 con 0x7f8700150b40 2023-11-28T20:38:52.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86f7fff640 1 -- 172.21.15.167:0/1749802451 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8014680 con 0x7f8700150b40 2023-11-28T20:38:52.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8700070f70 con 0x7f8700150b40 2023-11-28T20:38:52.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87001f2a70 con 0x7f8700150b40 2023-11-28T20:38:52.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87000682c0 con 0x7f8700150b40 2023-11-28T20:38:52.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86f7fff640 1 -- 172.21.15.167:0/1749802451 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f86f801d3b0 con 0x7f8700150b40 2023-11-28T20:38:52.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86f7fff640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86e0066470 0x7f86e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:52.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.724+0000 7f86f7fff640 1 -- 172.21.15.167:0/1749802451 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86f8084060 con 0x7f8700150b40 2023-11-28T20:38:52.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.728+0000 7f86fed9d640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86e0066470 0x7f86e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:52.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.728+0000 7f86fed9d640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86e0066470 0x7f86e0068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f86f00af000 tx=0x7f86f00b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:52.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.728+0000 7f86f7fff640 1 -- 172.21.15.167:0/1749802451 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f86f80b5280 con 0x7f8700150b40 2023-11-28T20:38:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.880+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8700075c90 con 0x7f8700150b40 2023-11-28T20:38:52.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.880+0000 7f86f7fff640 1 -- 172.21.15.167:0/1749802451 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f86f80190a0 con 0x7f8700150b40 2023-11-28T20:38:52.885 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:38:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86e0066470 msgr2=0x7f86e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86e0066470 0x7f86e0068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f86f00af000 tx=0x7f86f00b6040 comp rx=0 tx=0).stop 2023-11-28T20:38:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 msgr2=0x7f87000705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 0x7f87000705a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86f800b970 tx=0x7f86f800be30 comp rx=0 tx=0).stop 2023-11-28T20:38:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 shutdown_connections 2023-11-28T20:38:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86e0066470 0x7f86e0068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8700150b40 0x7f87000705a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87000c6ff0 0x7f8700160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 --2- 172.21.15.167:0/1749802451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87000c5be0 0x7f8700158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:52.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 >> 172.21.15.167:0/1749802451 conn(0x7f87000cb1e0 msgr2=0x7f870014fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:52.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 shutdown_connections 2023-11-28T20:38:52.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:52.884+0000 7f87051f5640 1 -- 172.21.15.167:0/1749802451 wait complete. 2023-11-28T20:38:52.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:38:53.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.040+0000 7f940b45a640 1 Processor -- start 2023-11-28T20:38:53.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.040+0000 7f940b45a640 1 -- start start 2023-11-28T20:38:53.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.040+0000 7f940b45a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f94041585d0 0x7f94040c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.040+0000 7f940b45a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94040c7720 0x7f940406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.040+0000 7f940b45a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940415e5e0 con 0x7f940415e130 2023-11-28T20:38:53.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.040+0000 7f940b45a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940415f160 con 0x7f94040c7720 2023-11-28T20:38:53.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.040+0000 7f940b45a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940415e8c0 con 0x7f94041585d0 2023-11-28T20:38:53.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f94099f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94040c7720 0x7f940406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f94091f6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f94041585d0 0x7f94040c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f94099f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94040c7720 0x7f940406a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45630/0 (socket says 172.21.15.167:45630) 2023-11-28T20:38:53.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f94099f7640 1 -- 172.21.15.167:0/3204813188 learned_addr learned my addr 172.21.15.167:0/3204813188 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:53.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f94099f7640 1 -- 172.21.15.167:0/3204813188 >> v2:172.21.15.178:3300/0 conn(0x7f94041585d0 msgr2=0x7f94040c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:53.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f94099f7640 1 --2- 172.21.15.167:0/3204813188 >> v2:172.21.15.178:3300/0 conn(0x7f94041585d0 0x7f94040c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f94099f7640 1 -- 172.21.15.167:0/3204813188 >> v1:172.21.15.178:6789/0 conn(0x7f940415e130 legacy=0x7f9404161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f94099f7640 1 -- 172.21.15.167:0/3204813188 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940415eba0 con 0x7f94040c7720 2023-11-28T20:38:53.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f94099f7640 1 --2- 172.21.15.167:0/3204813188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 0x7f940406a580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f94040c5e20 tx=0x7f93fc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fdc24edfc9a59b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:53.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f93fbfff640 1 -- 172.21.15.167:0/3204813188 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0a5770 con 0x7f94040c7720 2023-11-28T20:38:53.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f93fbfff640 1 -- 172.21.15.167:0/3204813188 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc0a58d0 con 0x7f94040c7720 2023-11-28T20:38:53.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.044+0000 7f93fbfff640 1 -- 172.21.15.167:0/3204813188 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0a5c60 con 0x7f94040c7720 2023-11-28T20:38:53.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 -- 172.21.15.167:0/3204813188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 msgr2=0x7f940406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 --2- 172.21.15.167:0/3204813188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 0x7f940406a580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f94040c5e20 tx=0x7f93fc01c9a0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 -- 172.21.15.167:0/3204813188 shutdown_connections 2023-11-28T20:38:53.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 --2- 172.21.15.167:0/3204813188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 0x7f940406a580 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 --2- 172.21.15.167:0/3204813188 >> v2:172.21.15.178:3300/0 conn(0x7f94041585d0 0x7f94040c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 -- 172.21.15.167:0/3204813188 >> 172.21.15.167:0/3204813188 conn(0x7f94040cb1e0 msgr2=0x7f94040cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:53.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 -- 172.21.15.167:0/3204813188 shutdown_connections 2023-11-28T20:38:53.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 -- 172.21.15.167:0/3204813188 wait complete. 2023-11-28T20:38:53.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 Processor -- start 2023-11-28T20:38:53.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 -- start start 2023-11-28T20:38:53.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 0x7f940415c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94041585d0 0x7f9404159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940415e130 0x7f94041fa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940415af00 con 0x7f94040c7720 2023-11-28T20:38:53.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94041f85d0 con 0x7f940415e130 2023-11-28T20:38:53.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f940b45a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940415b6d0 con 0x7f94041585d0 2023-11-28T20:38:53.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94091f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 0x7f940415c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94091f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 0x7f940415c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45638/0 (socket says 172.21.15.167:45638) 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94091f6640 1 -- 172.21.15.167:0/2135769550 learned_addr learned my addr 172.21.15.167:0/2135769550 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94089f5640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94041585d0 0x7f9404159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94099f7640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940415e130 0x7f94041fa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94091f6640 1 -- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94041585d0 msgr2=0x7f9404159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94091f6640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94041585d0 0x7f9404159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94091f6640 1 -- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940415e130 msgr2=0x7f94041fa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94091f6640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940415e130 0x7f94041fa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94091f6640 1 -- 172.21.15.167:0/2135769550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc009b30 con 0x7f94040c7720 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.048+0000 7f94099f7640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940415e130 0x7f94041fa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f94091f6640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 0x7f940415c950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f940000e8a0 tx=0x7f940000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:53.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f93f9ffb640 1 -- 172.21.15.167:0/2135769550 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400009510 con 0x7f94040c7720 2023-11-28T20:38:53.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f93f9ffb640 1 -- 172.21.15.167:0/2135769550 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940000c940 con 0x7f94040c7720 2023-11-28T20:38:53.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f93f9ffb640 1 -- 172.21.15.167:0/2135769550 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940000ccb0 con 0x7f94040c7720 2023-11-28T20:38:53.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9404158ee0 con 0x7f94040c7720 2023-11-28T20:38:53.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940415b110 con 0x7f94040c7720 2023-11-28T20:38:53.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94040682c0 con 0x7f94040c7720 2023-11-28T20:38:53.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f93f9ffb640 1 -- 172.21.15.167:0/2135769550 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9400013470 con 0x7f94040c7720 2023-11-28T20:38:53.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f93f9ffb640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93e8066470 0x7f93e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.052+0000 7f93f9ffb640 1 -- 172.21.15.167:0/2135769550 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9400084330 con 0x7f94040c7720 2023-11-28T20:38:53.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.056+0000 7f94089f5640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93e8066470 0x7f93e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.056+0000 7f94089f5640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93e8066470 0x7f93e8068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f940415a6f0 tx=0x7f93f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:53.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.056+0000 7f93f9ffb640 1 -- 172.21.15.167:0/2135769550 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9400051420 con 0x7f94040c7720 2023-11-28T20:38:53.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.236+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9404075c90 con 0x7f94040c7720 2023-11-28T20:38:53.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.236+0000 7f93f9ffb640 1 -- 172.21.15.167:0/2135769550 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6541 (secure 0 0 0) 0x7f9400054a40 con 0x7f94040c7720 2023-11-28T20:38:53.242 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:53.242 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T20:38:51.614518+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4278,"mds_2":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4278":{"gid":4278,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.167:6837/1234930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1234930245},{"type":"v1","addr":"172.21.15.167:6837","nonce":1234930245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:38:53.242 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 14 2023-11-28T20:38:53.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93e8066470 msgr2=0x7f93e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93e8066470 0x7f93e8068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f940415a6f0 tx=0x7f93f4009040 comp rx=0 tx=0).stop 2023-11-28T20:38:53.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 msgr2=0x7f940415c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 0x7f940415c950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f940000e8a0 tx=0x7f940000eca0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 shutdown_connections 2023-11-28T20:38:53.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93e8066470 0x7f93e8068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940415e130 0x7f94041fa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94041585d0 0x7f9404159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 --2- 172.21.15.167:0/2135769550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94040c7720 0x7f940415c950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 >> 172.21.15.167:0/2135769550 conn(0x7f94040cb1e0 msgr2=0x7f94040cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:53.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 shutdown_connections 2023-11-28T20:38:53.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.240+0000 7f940b45a640 1 -- 172.21.15.167:0/2135769550 wait complete. 2023-11-28T20:38:53.263 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:53.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.396+0000 7f6fcf1e6640 1 Processor -- start 2023-11-28T20:38:53.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.396+0000 7f6fcf1e6640 1 -- start start 2023-11-28T20:38:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fcf1e6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fc80c6ff0 0x7f6fc8157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fcf1e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c4510 0x7f6fc806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fcf1e6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc80c4920 con 0x7f6fc8150b40 2023-11-28T20:38:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fcf1e6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc80c62f0 con 0x7f6fc80c6ff0 2023-11-28T20:38:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fcf1e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80c6ac0 con 0x7f6fc80c4510 2023-11-28T20:38:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fcd783640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c4510 0x7f6fc806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fbffff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fc80c6ff0 0x7f6fc8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fcd783640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c4510 0x7f6fc806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:37888/0 (socket says 172.21.15.167:37888) 2023-11-28T20:38:53.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fcd783640 1 -- 172.21.15.167:0/3442930886 learned_addr learned my addr 172.21.15.167:0/3442930886 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:53.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fbffff640 1 -- 172.21.15.167:0/3442930886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c4510 msgr2=0x7f6fc806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:53.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fbffff640 1 --2- 172.21.15.167:0/3442930886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c4510 0x7f6fc806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fbffff640 1 -- 172.21.15.167:0/3442930886 >> v1:172.21.15.178:6789/0 conn(0x7f6fc8150b40 legacy=0x7f6fc80c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fbffff640 1 -- 172.21.15.167:0/3442930886 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80c6500 con 0x7f6fc80c6ff0 2023-11-28T20:38:53.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.400+0000 7f6fcd783640 1 --2- 172.21.15.167:0/3442930886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c4510 0x7f6fc806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:53.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fbffff640 1 --2- 172.21.15.167:0/3442930886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c6ff0 0x7f6fc8157560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80097c0 tx=0x7f6fb801e660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc5b1de092a49b08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:53.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fbf7fe640 1 -- 172.21.15.167:0/3442930886 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb80ad680 con 0x7f6fc80c6ff0 2023-11-28T20:38:53.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fbf7fe640 1 -- 172.21.15.167:0/3442930886 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb80ad7e0 con 0x7f6fc80c6ff0 2023-11-28T20:38:53.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fbf7fe640 1 -- 172.21.15.167:0/3442930886 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb80adb70 con 0x7f6fc80c6ff0 2023-11-28T20:38:53.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/3442930886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c6ff0 msgr2=0x7f6fc8157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 --2- 172.21.15.167:0/3442930886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c6ff0 0x7f6fc8157560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80097c0 tx=0x7f6fb801e660 comp rx=0 tx=0).stop 2023-11-28T20:38:53.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/3442930886 shutdown_connections 2023-11-28T20:38:53.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 --2- 172.21.15.167:0/3442930886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c4510 0x7f6fc806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 --2- 172.21.15.167:0/3442930886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c6ff0 0x7f6fc8157560 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/3442930886 >> 172.21.15.167:0/3442930886 conn(0x7f6fc80cb1e0 msgr2=0x7f6fc80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:53.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/3442930886 shutdown_connections 2023-11-28T20:38:53.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/3442930886 wait complete. 2023-11-28T20:38:53.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 Processor -- start 2023-11-28T20:38:53.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.404+0000 7f6fcf1e6640 1 -- start start 2023-11-28T20:38:53.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcf1e6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c4510 0x7f6fc81f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcf1e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c6ff0 0x7f6fc8148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcf1e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc8150b40 0x7f6fc8145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcf1e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc81545c0 con 0x7f6fc8150b40 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcf1e6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc815ade0 con 0x7f6fc80c4510 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcf1e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc814f650 con 0x7f6fc80c6ff0 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcd783640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc8150b40 0x7f6fc8145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcd783640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc8150b40 0x7f6fc8145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45650/0 (socket says 172.21.15.167:45650) 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcd783640 1 -- 172.21.15.167:0/738728691 learned_addr learned my addr 172.21.15.167:0/738728691 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fbffff640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c6ff0 0x7f6fc8148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fccf82640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c4510 0x7f6fc81f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcd783640 1 -- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c6ff0 msgr2=0x7f6fc8148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcd783640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c6ff0 0x7f6fc8148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcd783640 1 -- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c4510 msgr2=0x7f6fc81f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcd783640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c4510 0x7f6fc81f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcd783640 1 -- 172.21.15.167:0/738728691 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0009b30 con 0x7f6fc8150b40 2023-11-28T20:38:53.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fccf82640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c4510 0x7f6fc81f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:53.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcd783640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc8150b40 0x7f6fc8145a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000efc0 tx=0x7f6fc000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:53.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fbd7fa640 1 -- 172.21.15.167:0/738728691 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0018070 con 0x7f6fc8150b40 2023-11-28T20:38:53.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fbd7fa640 1 -- 172.21.15.167:0/738728691 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc000f040 con 0x7f6fc8150b40 2023-11-28T20:38:53.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb8009420 con 0x7f6fc8150b40 2023-11-28T20:38:53.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fbd7fa640 1 -- 172.21.15.167:0/738728691 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000ce00 con 0x7f6fc8150b40 2023-11-28T20:38:53.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc814fc10 con 0x7f6fc8150b40 2023-11-28T20:38:53.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.408+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc80682c0 con 0x7f6fc8150b40 2023-11-28T20:38:53.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.412+0000 7f6fbd7fa640 1 -- 172.21.15.167:0/738728691 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6fc0014480 con 0x7f6fc8150b40 2023-11-28T20:38:53.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.412+0000 7f6fbd7fa640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb4066470 0x7f6fb4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.412+0000 7f6fbd7fa640 1 -- 172.21.15.167:0/738728691 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6fc0084340 con 0x7f6fc8150b40 2023-11-28T20:38:53.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.412+0000 7f6fccf82640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb4066470 0x7f6fb4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.412+0000 7f6fccf82640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb4066470 0x7f6fb4068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4000f70 tx=0x7f6fc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:53.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.416+0000 7f6fbd7fa640 1 -- 172.21.15.167:0/738728691 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6fc0051430 con 0x7f6fc8150b40 2023-11-28T20:38:53.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.568+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fc8075c90 con 0x7f6fc8150b40 2023-11-28T20:38:53.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.568+0000 7f6fbd7fa640 1 -- 172.21.15.167:0/738728691 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7f6fc0054a50 con 0x7f6fc8150b40 2023-11-28T20:38:53.573 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:53.573 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:53.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb4066470 msgr2=0x7f6fb4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb4066470 0x7f6fb4068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4000f70 tx=0x7f6fc4009040 comp rx=0 tx=0).stop 2023-11-28T20:38:53.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc8150b40 msgr2=0x7f6fc8145a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc8150b40 0x7f6fc8145a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000efc0 tx=0x7f6fc000c490 comp rx=0 tx=0).stop 2023-11-28T20:38:53.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 shutdown_connections 2023-11-28T20:38:53.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb4066470 0x7f6fb4068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc8150b40 0x7f6fc8145a50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc80c6ff0 0x7f6fc8148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 --2- 172.21.15.167:0/738728691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc80c4510 0x7f6fc81f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 >> 172.21.15.167:0/738728691 conn(0x7f6fc80cb1e0 msgr2=0x7f6fc80cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:53.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 shutdown_connections 2023-11-28T20:38:53.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.572+0000 7f6fcf1e6640 1 -- 172.21.15.167:0/738728691 wait complete. 2023-11-28T20:38:53.595 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:38:53.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.728+0000 7fba16654640 1 Processor -- start 2023-11-28T20:38:53.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.728+0000 7fba16654640 1 -- start start 2023-11-28T20:38:53.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba16654640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fba100c6ff0 0x7fba10157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba16654640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba100c4510 0x7fba1006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba16654640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100c48f0 con 0x7fba10150b40 2023-11-28T20:38:53.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba16654640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100c62f0 con 0x7fba100c4510 2023-11-28T20:38:53.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba16654640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100c6ac0 con 0x7fba100c6ff0 2023-11-28T20:38:53.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba14bf1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba100c4510 0x7fba1006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba14bf1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba100c4510 0x7fba1006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45664/0 (socket says 172.21.15.167:45664) 2023-11-28T20:38:53.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba14bf1640 1 -- 172.21.15.167:0/1048349850 learned_addr learned my addr 172.21.15.167:0/1048349850 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:53.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba0f7fe640 1 --2- 172.21.15.167:0/1048349850 >> v2:172.21.15.178:3300/0 conn(0x7fba100c6ff0 0x7fba10157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba14bf1640 1 -- 172.21.15.167:0/1048349850 >> v2:172.21.15.178:3300/0 conn(0x7fba100c6ff0 msgr2=0x7fba10157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:53.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba14bf1640 1 --2- 172.21.15.167:0/1048349850 >> v2:172.21.15.178:3300/0 conn(0x7fba100c6ff0 0x7fba10157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba14bf1640 1 -- 172.21.15.167:0/1048349850 >> v1:172.21.15.178:6789/0 conn(0x7fba10150b40 legacy=0x7fba100c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:53.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.732+0000 7fba14bf1640 1 -- 172.21.15.167:0/1048349850 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100c6500 con 0x7fba100c4510 2023-11-28T20:38:53.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba14bf1640 1 --2- 172.21.15.167:0/1048349850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 0x7fba1006a580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fba100cc270 tx=0x7fba0801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d07b60796627ecf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:53.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba0effd640 1 -- 172.21.15.167:0/1048349850 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080a5710 con 0x7fba100c4510 2023-11-28T20:38:53.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba0effd640 1 -- 172.21.15.167:0/1048349850 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba080a5870 con 0x7fba100c4510 2023-11-28T20:38:53.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba0effd640 1 -- 172.21.15.167:0/1048349850 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080a5c00 con 0x7fba100c4510 2023-11-28T20:38:53.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 -- 172.21.15.167:0/1048349850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 msgr2=0x7fba1006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 --2- 172.21.15.167:0/1048349850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 0x7fba1006a580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fba100cc270 tx=0x7fba0801c940 comp rx=0 tx=0).stop 2023-11-28T20:38:53.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 -- 172.21.15.167:0/1048349850 shutdown_connections 2023-11-28T20:38:53.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 --2- 172.21.15.167:0/1048349850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 0x7fba1006a580 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 --2- 172.21.15.167:0/1048349850 >> v2:172.21.15.178:3300/0 conn(0x7fba100c6ff0 0x7fba10157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 -- 172.21.15.167:0/1048349850 >> 172.21.15.167:0/1048349850 conn(0x7fba100cb1e0 msgr2=0x7fba100cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:53.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 -- 172.21.15.167:0/1048349850 shutdown_connections 2023-11-28T20:38:53.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 -- 172.21.15.167:0/1048349850 wait complete. 2023-11-28T20:38:53.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 Processor -- start 2023-11-28T20:38:53.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 -- start start 2023-11-28T20:38:53.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 0x7fba100c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba100c6ff0 0x7fba101f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba10150b40 0x7fba100ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101f3310 con 0x7fba100c4510 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100c96d0 con 0x7fba10150b40 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.736+0000 7fba16654640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba100709e0 con 0x7fba100c6ff0 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 0x7fba100c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 0x7fba100c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45680/0 (socket says 172.21.15.167:45680) 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0ffff640 1 -- 172.21.15.167:0/1344993781 learned_addr learned my addr 172.21.15.167:0/1344993781 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0f7fe640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba100c6ff0 0x7fba101f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba14bf1640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba10150b40 0x7fba100ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0ffff640 1 -- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba100c6ff0 msgr2=0x7fba101f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0ffff640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba100c6ff0 0x7fba101f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0ffff640 1 -- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba10150b40 msgr2=0x7fba100ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0ffff640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba10150b40 0x7fba100ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0ffff640 1 -- 172.21.15.167:0/1344993781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08009b30 con 0x7fba100c4510 2023-11-28T20:38:53.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0ffff640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 0x7fba100c9b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c450 tx=0x7fba0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:53.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0cff9640 1 -- 172.21.15.167:0/1344993781 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00012830 con 0x7fba100c4510 2023-11-28T20:38:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0cff9640 1 -- 172.21.15.167:0/1344993781 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba000129b0 con 0x7fba100c4510 2023-11-28T20:38:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba10070cc0 con 0x7fba100c4510 2023-11-28T20:38:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0cff9640 1 -- 172.21.15.167:0/1344993781 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00012d60 con 0x7fba100c4510 2023-11-28T20:38:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba100c9360 con 0x7fba100c4510 2023-11-28T20:38:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba100682c0 con 0x7fba100c4510 2023-11-28T20:38:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.740+0000 7fba0cff9640 1 -- 172.21.15.167:0/1344993781 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba0001c460 con 0x7fba100c4510 2023-11-28T20:38:53.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.744+0000 7fba0cff9640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb9fc0664a0 0x7fb9fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:53.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.744+0000 7fba0cff9640 1 -- 172.21.15.167:0/1344993781 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba00083fc0 con 0x7fba100c4510 2023-11-28T20:38:53.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.744+0000 7fba0f7fe640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb9fc0664a0 0x7fb9fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:53.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.744+0000 7fba0f7fe640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb9fc0664a0 0x7fb9fc068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba101ecc00 tx=0x7fba04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:53.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.748+0000 7fba0cff9640 1 -- 172.21.15.167:0/1344993781 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba000b5280 con 0x7fba100c4510 2023-11-28T20:38:53.836 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-11-28T20:38:53.833+0000 7fa6aa4cf640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-11-28T20:38:53.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.924+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba10075c90 con 0x7fba100c4510 2023-11-28T20:38:53.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.924+0000 7fba0cff9640 1 -- 172.21.15.167:0/1344993781 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6541 (secure 0 0 0) 0x7fba000510d0 con 0x7fba100c4510 2023-11-28T20:38:53.931 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:53.931 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T20:38:51.614518+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4278,"mds_2":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4278":{"gid":4278,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.167:6837/1234930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1234930245},{"type":"v1","addr":"172.21.15.167:6837","nonce":1234930245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:38:53.932 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 14 2023-11-28T20:38:53.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb9fc0664a0 msgr2=0x7fb9fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb9fc0664a0 0x7fb9fc068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba101ecc00 tx=0x7fba04008040 comp rx=0 tx=0).stop 2023-11-28T20:38:53.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 msgr2=0x7fba100c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:53.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 0x7fba100c9b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c450 tx=0x7fba0000c910 comp rx=0 tx=0).stop 2023-11-28T20:38:53.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 shutdown_connections 2023-11-28T20:38:53.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb9fc0664a0 0x7fb9fc068960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba10150b40 0x7fba100ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba100c6ff0 0x7fba101f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 --2- 172.21.15.167:0/1344993781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c4510 0x7fba100c9b60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:53.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 >> 172.21.15.167:0/1344993781 conn(0x7fba100cb1e0 msgr2=0x7fba100cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:53.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 shutdown_connections 2023-11-28T20:38:53.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:53.928+0000 7fba16654640 1 -- 172.21.15.167:0/1344993781 wait complete. 2023-11-28T20:38:54.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T20:38:18.895715+0000', 'modified': '2023-11-28T20:38:51.614518+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4279, 'mds_1': 4278, 'mds_2': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'f', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.178:6838/3161530579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 3161530579}, {'type': 'v1', 'addr': '172.21.15.178:6838', 'nonce': 3161530579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4278': {'gid': 4278, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.167:6837/1234930245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 1234930245}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1234930245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.178:6839/4165916206', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6837', 'nonce': 4165916206}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 4165916206}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T20:38:54.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-11-28T20:38:54.554 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-11-28T20:38:54.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.692+0000 7f2cf4832640 1 Processor -- start 2023-11-28T20:38:54.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.692+0000 7f2cf4832640 1 -- start start 2023-11-28T20:38:54.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.692+0000 7f2cf4832640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2cf0150b40 0x7f2cf0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.692+0000 7f2cf4832640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.692+0000 7f2cf4832640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00c6ac0 con 0x7f2cf00c5be0 2023-11-28T20:38:54.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.692+0000 7f2cf4832640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00c6500 con 0x7f2cf0150b40 2023-11-28T20:38:54.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.692+0000 7f2cf4832640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00c67e0 con 0x7f2cf00c6ff0 2023-11-28T20:38:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.696+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.696+0000 7f2cee59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2cf0150b40 0x7f2cf0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.696+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf00c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:37912/0 (socket says 172.21.15.167:37912) 2023-11-28T20:38:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.696+0000 7f2ce7fff640 1 -- 172.21.15.167:0/665281545 learned_addr learned my addr 172.21.15.167:0/665281545 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.696+0000 7f2cee59c640 1 -- 172.21.15.167:0/665281545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 msgr2=0x7f2cf00c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.696+0000 7f2cee59c640 1 --2- 172.21.15.167:0/665281545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf00c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.696+0000 7f2cee59c640 1 -- 172.21.15.167:0/665281545 >> v1:172.21.15.178:6789/0 conn(0x7f2cf00c5be0 legacy=0x7f2cf006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:54.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.696+0000 7f2cee59c640 1 -- 172.21.15.167:0/665281545 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0156a80 con 0x7f2cf0150b40 2023-11-28T20:38:54.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.696+0000 7f2ce7fff640 1 --2- 172.21.15.167:0/665281545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf00c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:38:54.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cee59c640 1 --2- 172.21.15.167:0/665281545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cf0150b40 0x7f2cf0157560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00097c0 tx=0x7f2ce001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc468eb5a76f82fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:54.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cedd9b640 1 -- 172.21.15.167:0/665281545 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00ab650 con 0x7f2cf0150b40 2023-11-28T20:38:54.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cedd9b640 1 -- 172.21.15.167:0/665281545 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce00ab7b0 con 0x7f2cf0150b40 2023-11-28T20:38:54.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cedd9b640 1 -- 172.21.15.167:0/665281545 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00abb40 con 0x7f2cf0150b40 2023-11-28T20:38:54.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 -- 172.21.15.167:0/665281545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cf0150b40 msgr2=0x7f2cf0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:54.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 --2- 172.21.15.167:0/665281545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cf0150b40 0x7f2cf0157560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00097c0 tx=0x7f2ce001c450 comp rx=0 tx=0).stop 2023-11-28T20:38:54.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 -- 172.21.15.167:0/665281545 shutdown_connections 2023-11-28T20:38:54.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 --2- 172.21.15.167:0/665281545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf00c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 --2- 172.21.15.167:0/665281545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cf0150b40 0x7f2cf0157560 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 -- 172.21.15.167:0/665281545 >> 172.21.15.167:0/665281545 conn(0x7f2cf00cb1e0 msgr2=0x7f2cf00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:54.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 -- 172.21.15.167:0/665281545 shutdown_connections 2023-11-28T20:38:54.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 -- 172.21.15.167:0/665281545 wait complete. 2023-11-28T20:38:54.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 Processor -- start 2023-11-28T20:38:54.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 -- start start 2023-11-28T20:38:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cf00c5be0 0x7f2cf0137e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf01f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cf0150b40 0x7f2cf013f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf013e730 con 0x7f2cf0150b40 2023-11-28T20:38:54.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf013c460 con 0x7f2cf00c5be0 2023-11-28T20:38:54.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.700+0000 7f2cf4832640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf013ccb0 con 0x7f2cf00c6ff0 2023-11-28T20:38:54.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cf0150b40 0x7f2cf013f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2cee59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cf00c5be0 0x7f2cf0137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cf0150b40 0x7f2cf013f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45690/0 (socket says 172.21.15.167:45690) 2023-11-28T20:38:54.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ceed9d640 1 -- 172.21.15.167:0/3492887660 learned_addr learned my addr 172.21.15.167:0/3492887660 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:54.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ce7fff640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf01f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ceed9d640 1 -- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 msgr2=0x7f2cf01f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf01f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ceed9d640 1 -- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cf00c5be0 msgr2=0x7f2cf0137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cf00c5be0 0x7f2cf0137e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ceed9d640 1 -- 172.21.15.167:0/3492887660 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd80094d0 con 0x7f2cf0150b40 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cf0150b40 0x7f2cf013f130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800c760 tx=0x7f2ce800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ce6ffd640 1 -- 172.21.15.167:0/3492887660 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8003b80 con 0x7f2cf0150b40 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ce6ffd640 1 -- 172.21.15.167:0/3492887660 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce8003ce0 con 0x7f2cf0150b40 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2cf4832640 1 -- 172.21.15.167:0/3492887660 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce0009420 con 0x7f2cf0150b40 2023-11-28T20:38:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ce6ffd640 1 -- 172.21.15.167:0/3492887660 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800aa30 con 0x7f2cf0150b40 2023-11-28T20:38:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2cf4832640 1 -- 172.21.15.167:0/3492887660 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf013c070 con 0x7f2cf0150b40 2023-11-28T20:38:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.704+0000 7f2ce6ffd640 1 -- 172.21.15.167:0/3492887660 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ce800ab90 con 0x7f2cf0150b40 2023-11-28T20:38:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ce6ffd640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2cd0066470 0x7f2cd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ce6ffd640 1 -- 172.21.15.167:0/3492887660 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ce8083f10 con 0x7f2cf0150b40 2023-11-28T20:38:54.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cee59c640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2cd0066470 0x7f2cd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cf7ba9000 1 Processor -- start 2023-11-28T20:38:54.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cf7ba9000 1 -- start start 2023-11-28T20:38:54.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cee59c640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2cd0066470 0x7f2cd0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00af000 tx=0x7f2ce00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:54.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b319d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b31edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401b148130 con 0x56401b31f310 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401b1359a0 con 0x56401b319930 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56401b132ed0 con 0x56401b31e9f0 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45696/0 (socket says 172.21.15.167:45696) 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ceed9d640 1 -- 172.21.15.167:0/1487678115 learned_addr learned my addr 172.21.15.167:0/1487678115 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2cee59c640 1 --2- 172.21.15.167:0/1487678115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b319d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ce7fff640 1 --2- 172.21.15.167:0/1487678115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b31edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ceed9d640 1 -- 172.21.15.167:0/1487678115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 msgr2=0x56401b31edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/1487678115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b31edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ceed9d640 1 -- 172.21.15.167:0/1487678115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 msgr2=0x56401b319d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/1487678115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b319d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ceed9d640 1 -- 172.21.15.167:0/1487678115 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56401ae26890 con 0x56401b31f310 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/1487678115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31f6f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8054c70 tx=0x7f2ce8054740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e9e619465f5e41 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ccffff640 1 -- 172.21.15.167:0/1487678115 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce805cfc0 con 0x56401b31f310 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ccffff640 1 -- 172.21.15.167:0/1487678115 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce8053080 con 0x56401b31f310 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.708+0000 7f2ccffff640 1 -- 172.21.15.167:0/1487678115 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce805cb30 con 0x56401b31f310 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/1487678115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 msgr2=0x56401b31f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/1487678115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31f6f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8054c70 tx=0x7f2ce8054740 comp rx=0 tx=0).stop 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/1487678115 shutdown_connections 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/1487678115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31f6f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/1487678115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b31edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/1487678115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b319d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/1487678115 >> 172.21.15.167:0/1487678115 conn(0x56401b31a7a0 msgr2=0x56401b31cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/1487678115 shutdown_connections 2023-11-28T20:38:54.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/1487678115 wait complete. 2023-11-28T20:38:54.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- start start 2023-11-28T20:38:54.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 Processor -- start 2023-11-28T20:38:54.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b319930 0x56401b318d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31e9f0 0x56401b319250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b31f310 0x56401b328990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401b12e7c0 con 0x56401b31e9f0 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401b0e6bf0 con 0x56401b31f310 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56401b0eca90 con 0x56401b319930 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 10 client.0 _ll_register_callbacks cb 0x56401b2c93c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31e9f0 0x56401b319250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ce7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31e9f0 0x56401b319250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45712/0 (socket says 172.21.15.167:45712) 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ce7fff640 1 -- 172.21.15.167:0/3926889002 learned_addr learned my addr 172.21.15.167:0/3926889002 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cee59c640 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b319930 0x56401b318d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b31f310 0x56401b328990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ce7fff640 1 -- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b319930 msgr2=0x56401b318d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ce7fff640 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b319930 0x56401b318d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ce7fff640 1 -- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b31f310 msgr2=0x56401b328990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:54.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ce7fff640 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b31f310 0x56401b328990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ce7fff640 1 -- 172.21.15.167:0/3926889002 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf013c070 con 0x56401b31e9f0 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b31f310 0x56401b328990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ce7fff640 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31e9f0 0x56401b319250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8014710 tx=0x7f2cd8014bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4069b84137d9ce75 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/3926889002 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8004020 con 0x56401b31e9f0 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3926889002 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56401b0f0470 con 0x56401b31e9f0 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/3926889002 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2cd801a070 con 0x56401b31e9f0 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/3926889002 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cd8004180 con 0x56401b31e9f0 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 10 client.4836 fetch_fsmap learned FSMap version 14 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.712+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3926889002 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x56401b0ef190 con 0x56401b31e9f0 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/3926889002 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56401b0f0470 con 0x56401b31e9f0 2023-11-28T20:38:54.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/3926889002 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f2cd8011030 con 0x56401b31e9f0 2023-11-28T20:38:54.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2cf7ba9000 10 client.4836 fetch_fsmap finished waiting for FSMap version 14 2023-11-28T20:38:54.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2cf7ba9000 10 client.4836 resolve_mds: resolved name 'f' to daemon mds.f 2023-11-28T20:38:54.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2cf7ba9000 20 client.4836 populate_metadata read hostname 'smithi167' 2023-11-28T20:38:54.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] conn(0x56401b3296d0 0x56401b329ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:54.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2cf7ba9000 4 client.4836 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:38:54.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3926889002 --> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56401b0f3b50 con 0x56401b3296d0 2023-11-28T20:38:54.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2cee59c640 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] conn(0x56401b3296d0 0x56401b329ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:54.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2cee59c640 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] conn(0x56401b3296d0 0x56401b329ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3818cffae9d4c44 server_cookie=8c87d834a2e9b85e in_seq=0 out_seq=0 2023-11-28T20:38:54.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:54.716+0000 7f2ccd7fa640 10 client.4836 ms_handle_connect on v2:172.21.15.178:6836/3161530579 2023-11-28T20:38:56.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/3926889002 <== mds.2 v2:172.21.15.178:6836/3161530579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56401b0f3b50 con 0x56401b3296d0 2023-11-28T20:38:56.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2ccd7fa640 10 client.4836 handle_command_reply: tid=0 2023-11-28T20:38:56.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 client.4836 shutdown 2023-11-28T20:38:56.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3926889002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31e9f0 msgr2=0x56401b319250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31e9f0 0x56401b319250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8014710 tx=0x7f2cd8014bd0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3926889002 shutdown_connections 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] conn(0x56401b3296d0 0x56401b329ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b31f310 0x56401b328990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31e9f0 0x56401b319250 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3926889002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b319930 0x56401b318d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2ccd7fa640 0 client.4836 ms_handle_reset on v2:172.21.15.178:6836/3161530579 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3926889002 >> 172.21.15.167:0/3926889002 conn(0x56401b31a7a0 msgr2=0x56401b2e3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3926889002 shutdown_connections 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3926889002 wait complete. 2023-11-28T20:38:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.628+0000 7f2cf7ba9000 20 client.4836 trim_cache size 0 max 16384 2023-11-28T20:38:56.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cf7ba9000 1 Processor -- start 2023-11-28T20:38:56.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cf7ba9000 1 -- start start 2023-11-28T20:38:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b31cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b31d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401ade7940 con 0x56401b31f310 2023-11-28T20:38:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401b1360c0 con 0x56401b319930 2023-11-28T20:38:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56401b12a5c0 con 0x56401b31e9f0 2023-11-28T20:38:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45714/0 (socket says 172.21.15.167:45714) 2023-11-28T20:38:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ceed9d640 1 -- 172.21.15.167:0/3249311592 learned_addr learned my addr 172.21.15.167:0/3249311592 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cee59c640 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b31cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ce7fff640 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b31d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ceed9d640 1 -- 172.21.15.167:0/3249311592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 msgr2=0x56401b31d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b31d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ceed9d640 1 -- 172.21.15.167:0/3249311592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 msgr2=0x56401b31cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b31cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ceed9d640 1 -- 172.21.15.167:0/3249311592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56401b0d5490 con 0x56401b31f310 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2cee59c640 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b31cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31d610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800c730 tx=0x7f2ce8058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4483d45145f1ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ce4ff9640 1 -- 172.21.15.167:0/3249311592 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce805cfc0 con 0x56401b31f310 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ce4ff9640 1 -- 172.21.15.167:0/3249311592 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce8072e90 con 0x56401b31f310 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.644+0000 7f2ce4ff9640 1 -- 172.21.15.167:0/3249311592 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80513f0 con 0x56401b31f310 2023-11-28T20:38:56.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3249311592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 msgr2=0x56401b31d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31d610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800c730 tx=0x7f2ce8058000 comp rx=0 tx=0).stop 2023-11-28T20:38:56.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3249311592 shutdown_connections 2023-11-28T20:38:56.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b31d610 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b31d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/3249311592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b31cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3249311592 >> 172.21.15.167:0/3249311592 conn(0x56401b31a7a0 msgr2=0x56401b328640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:56.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3249311592 shutdown_connections 2023-11-28T20:38:56.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/3249311592 wait complete. 2023-11-28T20:38:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 -- start start 2023-11-28T20:38:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 Processor -- start 2023-11-28T20:38:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b37dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b37e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b37e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401b12bbc0 con 0x56401b31f310 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401b318d60 con 0x56401b319930 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56401b108e30 con 0x56401b31e9f0 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cf7ba9000 10 client.0 _ll_register_callbacks cb 0x56401b2a9bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b37e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2ceed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b37e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45726/0 (socket says 172.21.15.167:45726) 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2ceed9d640 1 -- 172.21.15.167:0/2257298495 learned_addr learned my addr 172.21.15.167:0/2257298495 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2ce7fff640 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b37e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2cee59c640 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b37dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2ceed9d640 1 -- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 msgr2=0x56401b37e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:56.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b37e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2ceed9d640 1 -- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 msgr2=0x56401b37dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b37dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.648+0000 7f2ceed9d640 1 -- 172.21.15.167:0/2257298495 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56401ae26890 con 0x56401b31f310 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ceed9d640 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b37e6a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80549e0 tx=0x7f2ce8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ee1f5338dfe69c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/2257298495 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce805cfc0 con 0x56401b31f310 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/2257298495 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ce805cb30 con 0x56401b31f310 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/2257298495 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56401b12d110 con 0x56401b31f310 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/2257298495 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ce805cd10 con 0x56401b31f310 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 10 client.4842 fetch_fsmap learned FSMap version 14 2023-11-28T20:38:56.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/2257298495 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x56401ae26cc0 con 0x56401b31f310 2023-11-28T20:38:56.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/2257298495 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56401b12d110 con 0x56401b31f310 2023-11-28T20:38:56.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/2257298495 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f2ce8019020 con 0x56401b31f310 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 10 client.4842 fetch_fsmap finished waiting for FSMap version 14 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 10 client.4842 resolve_mds: resolved name 'f' to daemon mds.f 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 20 client.4842 populate_metadata read hostname 'smithi167' 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] conn(0x56401b2e1220 0x56401b2e1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 4 client.4842 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/2257298495 --> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56401b15c9a0 con 0x56401b2e1220 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cee59c640 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] conn(0x56401b2e1220 0x56401b2e1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 10 client.4842 ms_handle_connect on v2:172.21.15.178:6836/3161530579 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cee59c640 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] conn(0x56401b2e1220 0x56401b2e1600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ebbcf067d3b9326 server_cookie=9ea37199fe6312c8 in_seq=0 out_seq=0 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 1 -- 172.21.15.167:0/2257298495 <== mds.2 v2:172.21.15.178:6836/3161530579 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56401b15c9a0 con 0x56401b2e1220 2023-11-28T20:38:56.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 10 client.4842 handle_command_reply: tid=0 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 client.4842 shutdown 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/2257298495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 msgr2=0x56401b37e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b37e6a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80549e0 tx=0x7f2ce8001260 comp rx=0 tx=0).stop 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/2257298495 shutdown_connections 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:6836/3161530579,v1:172.21.15.178:6838/3161530579] conn(0x56401b2e1220 0x56401b2e1600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56401b31f310 0x56401b37e6a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56401b31e9f0 0x56401b37e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 --2- 172.21.15.167:0/2257298495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56401b319930 0x56401b37dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2ccd7fa640 0 client.4842 ms_handle_reset on v2:172.21.15.178:6836/3161530579 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/2257298495 >> 172.21.15.167:0/2257298495 conn(0x56401b31a7a0 msgr2=0x56401b31e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/2257298495 shutdown_connections 2023-11-28T20:38:56.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 1 -- 172.21.15.167:0/2257298495 wait complete. 2023-11-28T20:38:56.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.652+0000 7f2cf7ba9000 20 client.4842 trim_cache size 0 max 16384 2023-11-28T20:38:56.661 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:38:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "cluster_fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:38:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "whoami": 2, 2023-11-28T20:38:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4276, 2023-11-28T20:38:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "want_state": "up:active", 2023-11-28T20:38:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "up:active", 2023-11-28T20:38:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs", 2023-11-28T20:38:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "rank_uptime": 10.065152799, 2023-11-28T20:38:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsmap_epoch": 14, 2023-11-28T20:38:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch": 25, 2023-11-28T20:38:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch_barrier": 25, 2023-11-28T20:38:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: "uptime": 43.857148119000001 2023-11-28T20:38:56.662 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:38:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 -- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2cd0066470 msgr2=0x7f2cd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2cd0066470 0x7f2cd0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00af000 tx=0x7f2ce00a7000 comp rx=0 tx=0).stop 2023-11-28T20:38:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 -- 172.21.15.167:0/3492887660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cf0150b40 msgr2=0x7f2cf013f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cf0150b40 0x7f2cf013f130 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800c760 tx=0x7f2ce800cc20 comp rx=0 tx=0).stop 2023-11-28T20:38:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 -- 172.21.15.167:0/3492887660 shutdown_connections 2023-11-28T20:38:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2cd0066470 0x7f2cd0068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cf0150b40 0x7f2cf013f130 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cf00c6ff0 0x7f2cf01f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 --2- 172.21.15.167:0/3492887660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cf00c5be0 0x7f2cf0137e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 -- 172.21.15.167:0/3492887660 >> 172.21.15.167:0/3492887660 conn(0x7f2cf00cb1e0 msgr2=0x7f2cf00717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:56.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 -- 172.21.15.167:0/3492887660 shutdown_connections 2023-11-28T20:38:56.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.656+0000 7f2cf4832640 1 -- 172.21.15.167:0/3492887660 wait complete. 2023-11-28T20:38:56.681 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T20:38:56.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f398b4fd640 1 Processor -- start 2023-11-28T20:38:56.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f398b4fd640 1 -- start start 2023-11-28T20:38:56.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f398b4fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3984150b40 0x7f3984157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f398b4fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39840c4510 0x7f398406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f398b4fd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39840c4920 con 0x7f39840c6ff0 2023-11-28T20:38:56.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f398b4fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840c62f0 con 0x7f3984150b40 2023-11-28T20:38:56.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f398b4fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39840c6ac0 con 0x7f39840c4510 2023-11-28T20:38:56.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f3989299640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3984150b40 0x7f3984157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f3989299640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3984150b40 0x7f3984157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:37198/0 (socket says 172.21.15.167:37198) 2023-11-28T20:38:56.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f3989a9a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39840c4510 0x7f398406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f3989299640 1 -- 172.21.15.167:0/3686316700 learned_addr learned my addr 172.21.15.167:0/3686316700 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:56.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f3989a9a640 1 -- 172.21.15.167:0/3686316700 >> v2:172.21.15.178:3300/0 conn(0x7f3984150b40 msgr2=0x7f3984157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:56.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f3989a9a640 1 --2- 172.21.15.167:0/3686316700 >> v2:172.21.15.178:3300/0 conn(0x7f3984150b40 0x7f3984157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f3989a9a640 1 -- 172.21.15.167:0/3686316700 >> v1:172.21.15.178:6789/0 conn(0x7f39840c6ff0 legacy=0x7f39840c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.820+0000 7f3989a9a640 1 -- 172.21.15.167:0/3686316700 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840c6500 con 0x7f39840c4510 2023-11-28T20:38:56.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.824+0000 7f3989a9a640 1 --2- 172.21.15.167:0/3686316700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39840c4510 0x7f398406a580 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f397c009d90 tx=0x7f397c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2503941887d201d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:56.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.824+0000 7f397bfff640 1 -- 172.21.15.167:0/3686316700 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c0a58f0 con 0x7f39840c4510 2023-11-28T20:38:56.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.824+0000 7f397bfff640 1 -- 172.21.15.167:0/3686316700 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c0a5a50 con 0x7f39840c4510 2023-11-28T20:38:56.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.824+0000 7f397bfff640 1 -- 172.21.15.167:0/3686316700 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c0a5de0 con 0x7f39840c4510 2023-11-28T20:38:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 -- 172.21.15.167:0/3686316700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39840c4510 msgr2=0x7f398406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 --2- 172.21.15.167:0/3686316700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39840c4510 0x7f398406a580 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f397c009d90 tx=0x7f397c01c920 comp rx=0 tx=0).stop 2023-11-28T20:38:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 -- 172.21.15.167:0/3686316700 shutdown_connections 2023-11-28T20:38:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 --2- 172.21.15.167:0/3686316700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39840c4510 0x7f398406a580 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 --2- 172.21.15.167:0/3686316700 >> v2:172.21.15.178:3300/0 conn(0x7f3984150b40 0x7f3984157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 -- 172.21.15.167:0/3686316700 >> 172.21.15.167:0/3686316700 conn(0x7f39840cb1e0 msgr2=0x7f39840cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 -- 172.21.15.167:0/3686316700 shutdown_connections 2023-11-28T20:38:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 -- 172.21.15.167:0/3686316700 wait complete. 2023-11-28T20:38:56.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 Processor -- start 2023-11-28T20:38:56.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 -- start start 2023-11-28T20:38:56.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39840c4510 0x7f398414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39840c6ff0 0x7f3984148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3984150b40 0x7f3984071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39841f2460 con 0x7f39840c4510 2023-11-28T20:38:56.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39841f2730 con 0x7f39840c6ff0 2023-11-28T20:38:56.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f398b4fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39841f2a10 con 0x7f3984150b40 2023-11-28T20:38:56.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3989299640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39840c4510 0x7f398414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3989299640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39840c4510 0x7f398414b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45728/0 (socket says 172.21.15.167:45728) 2023-11-28T20:38:56.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3989299640 1 -- 172.21.15.167:0/1904909203 learned_addr learned my addr 172.21.15.167:0/1904909203 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:56.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3988a98640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39840c6ff0 0x7f3984148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3989a9a640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3984150b40 0x7f3984071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3989299640 1 -- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3984150b40 msgr2=0x7f3984071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3989299640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3984150b40 0x7f3984071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3989299640 1 -- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39840c6ff0 msgr2=0x7f3984148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3989299640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39840c6ff0 0x7f3984148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.828+0000 7f3989299640 1 -- 172.21.15.167:0/1904909203 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c009a70 con 0x7f39840c4510 2023-11-28T20:38:56.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f3989299640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39840c4510 0x7f398414b4d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f398000e7f0 tx=0x7f398000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:56.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f3979ffb640 1 -- 172.21.15.167:0/1904909203 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980009580 con 0x7f39840c4510 2023-11-28T20:38:56.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f3979ffb640 1 -- 172.21.15.167:0/1904909203 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398000c940 con 0x7f39840c4510 2023-11-28T20:38:56.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f3979ffb640 1 -- 172.21.15.167:0/1904909203 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000ccf0 con 0x7f39840c4510 2023-11-28T20:38:56.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f398b4fd640 1 -- 172.21.15.167:0/1904909203 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39841f2cf0 con 0x7f39840c4510 2023-11-28T20:38:56.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f398b4fd640 1 -- 172.21.15.167:0/1904909203 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39841f32b0 con 0x7f39840c4510 2023-11-28T20:38:56.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f3979ffb640 1 -- 172.21.15.167:0/1904909203 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3980013470 con 0x7f39840c4510 2023-11-28T20:38:56.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f3979ffb640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f39680664a0 0x7f3968068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f3979ffb640 1 -- 172.21.15.167:0/1904909203 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3980084250 con 0x7f39840c4510 2023-11-28T20:38:56.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.832+0000 7f398e85f000 1 Processor -- start 2023-11-28T20:38:56.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f39680664a0 0x7f3968068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- start start 2023-11-28T20:38:56.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f39680664a0 0x7f3968068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3984067a50 tx=0x7f3974009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:56.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 0x55b179d51d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d56dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 0x55b179d576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179b80130 con 0x55b179d569f0 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179b6d9a0 con 0x55b179d57310 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b179b6aed0 con 0x55b179d51930 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d56dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d56dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45734/0 (socket says 172.21.15.167:45734) 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 -- 172.21.15.167:0/1181092943 learned_addr learned my addr 172.21.15.167:0/1181092943 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3989a9a640 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 0x55b179d576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3989299640 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 0x55b179d51d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 -- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 msgr2=0x55b179d51d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 0x55b179d51d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 -- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 msgr2=0x55b179d576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 0x55b179d576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 -- 172.21.15.167:0/1181092943 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b17985e890 con 0x55b179d569f0 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3989299640 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 0x55b179d51d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3989a9a640 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 0x55b179d576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3988a98640 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d56dd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f397400f820 tx=0x7f3974012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64463e24ee1cd68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3966ffd640 1 -- 172.21.15.167:0/1181092943 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740149d0 con 0x55b179d569f0 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3966ffd640 1 -- 172.21.15.167:0/1181092943 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974014b30 con 0x55b179d569f0 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f3966ffd640 1 -- 172.21.15.167:0/1181092943 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974014ea0 con 0x55b179d569f0 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- 172.21.15.167:0/1181092943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 msgr2=0x55b179d56dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d56dd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f397400f820 tx=0x7f3974012000 comp rx=0 tx=0).stop 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- 172.21.15.167:0/1181092943 shutdown_connections 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 0x55b179d576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d56dd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 --2- 172.21.15.167:0/1181092943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 0x55b179d51d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- 172.21.15.167:0/1181092943 >> 172.21.15.167:0/1181092943 conn(0x55b179d527a0 msgr2=0x55b179d54b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:56.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- 172.21.15.167:0/1181092943 shutdown_connections 2023-11-28T20:38:56.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- 172.21.15.167:0/1181092943 wait complete. 2023-11-28T20:38:56.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.836+0000 7f398e85f000 1 -- start start 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 Processor -- start 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d51930 0x55b179d50d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d569f0 0x55b179d51250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 0x55b179d60990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179b667c0 con 0x55b179d51930 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179b1ebf0 con 0x55b179d57310 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b179b24a90 con 0x55b179d569f0 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 10 client.0 _ll_register_callbacks cb 0x55b179d013c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989299640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d51930 0x55b179d50d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989299640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d51930 0x55b179d50d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45738/0 (socket says 172.21.15.167:45738) 2023-11-28T20:38:56.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989299640 1 -- 172.21.15.167:0/2537771185 learned_addr learned my addr 172.21.15.167:0/2537771185 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989a9a640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 0x55b179d60990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3988a98640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d569f0 0x55b179d51250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989299640 1 -- 172.21.15.167:0/2537771185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d569f0 msgr2=0x55b179d51250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989299640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d569f0 0x55b179d51250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989299640 1 -- 172.21.15.167:0/2537771185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 msgr2=0x55b179d60990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989299640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 0x55b179d60990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989299640 1 -- 172.21.15.167:0/2537771185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39840c4920 con 0x55b179d51930 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3989299640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d51930 0x55b179d50d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3980082360 tx=0x7f3980054b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db61771e4a2cf24 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f395ffff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f395ffff640 1 -- 172.21.15.167:0/2537771185 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980084070 con 0x55b179d51930 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f395ffff640 1 -- 172.21.15.167:0/2537771185 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f398000ce50 con 0x55b179d51930 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 -- 172.21.15.167:0/2537771185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b179b28470 con 0x55b179d51930 2023-11-28T20:38:56.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f395ffff640 1 -- 172.21.15.167:0/2537771185 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3980082080 con 0x55b179d51930 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 10 client.4851 fetch_fsmap learned FSMap version 14 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 -- 172.21.15.167:0/2537771185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55b179b27190 con 0x55b179d51930 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f395ffff640 1 -- 172.21.15.167:0/2537771185 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b179b28470 con 0x55b179d51930 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f395ffff640 1 -- 172.21.15.167:0/2537771185 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f3980011070 con 0x55b179d51930 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 10 client.4851 fetch_fsmap finished waiting for FSMap version 14 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 10 client.4851 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 20 client.4851 populate_metadata read hostname 'smithi167' 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179d616d0 0x55b179d61ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 4 client.4851 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f398e85f000 1 -- 172.21.15.167:0/2537771185 --> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b179b2bb50 con 0x55b179d616d0 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3988a98640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179d616d0 0x55b179d61ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:56.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3988a98640 1 -- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179d616d0 msgr2=0x55b179d61ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send send error: (32) Broken pipe 2023-11-28T20:38:56.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3988a98640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179d616d0 0x55b179d61ab0 crc :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).write compression request write failed r=-32 ((32) Broken pipe) 2023-11-28T20:38:56.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:56.840+0000 7f3988a98640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179d616d0 0x55b179d61ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:38:57.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f3988a98640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179d616d0 0x55b179d61ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f3988a98640 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179d616d0 0x55b179d61ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ebaa222e2ec2ee2 server_cookie=518bddc524eb4430 in_seq=0 out_seq=0 2023-11-28T20:38:57.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f395ffff640 10 client.4851 ms_handle_connect on v2:172.21.15.167:6836/1234930245 2023-11-28T20:38:57.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f395ffff640 1 -- 172.21.15.167:0/2537771185 <== mds.1 v2:172.21.15.167:6836/1234930245 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b179b2bb50 con 0x55b179d616d0 2023-11-28T20:38:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f395ffff640 10 client.4851 handle_command_reply: tid=0 2023-11-28T20:38:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 client.4851 shutdown 2023-11-28T20:38:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 -- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d51930 msgr2=0x55b179d50d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d51930 0x55b179d50d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3980082360 tx=0x7f3980054b10 comp rx=0 tx=0).stop 2023-11-28T20:38:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 -- 172.21.15.167:0/2537771185 shutdown_connections 2023-11-28T20:38:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179d616d0 0x55b179d61ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d57310 0x55b179d60990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d569f0 0x55b179d51250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 --2- 172.21.15.167:0/2537771185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d51930 0x55b179d50d10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f395ffff640 0 client.4851 ms_handle_reset on v2:172.21.15.167:6836/1234930245 2023-11-28T20:38:57.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 -- 172.21.15.167:0/2537771185 >> 172.21.15.167:0/2537771185 conn(0x55b179d527a0 msgr2=0x55b179d1bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 -- 172.21.15.167:0/2537771185 shutdown_connections 2023-11-28T20:38:57.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 1 -- 172.21.15.167:0/2537771185 wait complete. 2023-11-28T20:38:57.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.044+0000 7f398e85f000 20 client.4851 trim_cache size 0 max 16384 2023-11-28T20:38:57.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f398e85f000 1 Processor -- start 2023-11-28T20:38:57.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f398e85f000 1 -- start start 2023-11-28T20:38:57.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f398e85f000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d51930 0x55b179d61ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f398e85f000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d61ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f398e85f000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d57310 0x55b179d62530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f398e85f000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b17981f940 con 0x55b179d569f0 2023-11-28T20:38:57.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f398e85f000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179b625c0 con 0x55b179d51930 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f398e85f000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b179bd97a0 con 0x55b179d57310 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3988a98640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d61ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3988a98640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d61ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45748/0 (socket says 172.21.15.167:45748) 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3988a98640 1 -- 172.21.15.167:0/3409211321 learned_addr learned my addr 172.21.15.167:0/3409211321 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3989299640 1 --2- 172.21.15.167:0/3409211321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d51930 0x55b179d61ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3989a9a640 1 --2- 172.21.15.167:0/3409211321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d57310 0x55b179d62530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3988a98640 1 -- 172.21.15.167:0/3409211321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d57310 msgr2=0x55b179d62530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3988a98640 1 --2- 172.21.15.167:0/3409211321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d57310 0x55b179d62530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3988a98640 1 -- 172.21.15.167:0/3409211321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d51930 msgr2=0x55b179d61ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3988a98640 1 --2- 172.21.15.167:0/3409211321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d51930 0x55b179d61ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3988a98640 1 -- 172.21.15.167:0/3409211321 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b179b0d490 con 0x55b179d569f0 2023-11-28T20:38:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f3988a98640 1 --2- 172.21.15.167:0/3409211321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d61ff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3974023040 tx=0x7f3974015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7e15068b360f86 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f39677fe640 1 -- 172.21.15.167:0/3409211321 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740149d0 con 0x55b179d569f0 2023-11-28T20:38:57.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f39677fe640 1 -- 172.21.15.167:0/3409211321 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974034b70 con 0x55b179d569f0 2023-11-28T20:38:57.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.060+0000 7f39677fe640 1 -- 172.21.15.167:0/3409211321 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974034390 con 0x55b179d569f0 2023-11-28T20:38:57.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- 172.21.15.167:0/3409211321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 msgr2=0x55b179d61ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 --2- 172.21.15.167:0/3409211321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d61ff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3974023040 tx=0x7f3974015000 comp rx=0 tx=0).stop 2023-11-28T20:38:57.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- 172.21.15.167:0/3409211321 shutdown_connections 2023-11-28T20:38:57.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 --2- 172.21.15.167:0/3409211321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d57310 0x55b179d62530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 --2- 172.21.15.167:0/3409211321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d569f0 0x55b179d61ff0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 --2- 172.21.15.167:0/3409211321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d51930 0x55b179d61ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- 172.21.15.167:0/3409211321 >> 172.21.15.167:0/3409211321 conn(0x55b179d527a0 msgr2=0x55b179d5ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- 172.21.15.167:0/3409211321 shutdown_connections 2023-11-28T20:38:57.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- 172.21.15.167:0/3409211321 wait complete. 2023-11-28T20:38:57.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- start start 2023-11-28T20:38:57.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 Processor -- start 2023-11-28T20:38:57.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 0x55b179d187a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d569f0 0x55b179d18ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d57310 0x55b179d85ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179b018a0 con 0x55b179d57310 2023-11-28T20:38:57.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b179d1b220 con 0x55b179d569f0 2023-11-28T20:38:57.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b179b63fd0 con 0x55b179d51930 2023-11-28T20:38:57.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 10 client.0 _ll_register_callbacks cb 0x55b179ce1bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989a9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d57310 0x55b179d85ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989a9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d57310 0x55b179d85ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45764/0 (socket says 172.21.15.167:45764) 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989a9a640 1 -- 172.21.15.167:0/1849442884 learned_addr learned my addr 172.21.15.167:0/1849442884 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989299640 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 0x55b179d187a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3988a98640 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d569f0 0x55b179d18ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989a9a640 1 -- 172.21.15.167:0/1849442884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 msgr2=0x55b179d187a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989a9a640 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 0x55b179d187a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989a9a640 1 -- 172.21.15.167:0/1849442884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d569f0 msgr2=0x55b179d18ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989a9a640 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d569f0 0x55b179d18ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989a9a640 1 -- 172.21.15.167:0/1849442884 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b17985e890 con 0x55b179d57310 2023-11-28T20:38:57.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f3989a9a640 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d57310 0x55b179d85ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f397c009d90 tx=0x7f397c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419d2ebe665c06d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f395ffff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-28T20:38:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f395ffff640 1 -- 172.21.15.167:0/1849442884 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c0c6070 con 0x55b179d57310 2023-11-28T20:38:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- 172.21.15.167:0/1849442884 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b179b65110 con 0x55b179d57310 2023-11-28T20:38:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f395ffff640 1 -- 172.21.15.167:0/1849442884 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f397c0b7440 con 0x55b179d57310 2023-11-28T20:38:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f395ffff640 1 -- 172.21.15.167:0/1849442884 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f397c0bc040 con 0x55b179d57310 2023-11-28T20:38:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 10 client.4857 fetch_fsmap learned FSMap version 14 2023-11-28T20:38:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.064+0000 7f398e85f000 1 -- 172.21.15.167:0/1849442884 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55b17985ecc0 con 0x55b179d57310 2023-11-28T20:38:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f395ffff640 1 -- 172.21.15.167:0/1849442884 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b179b65110 con 0x55b179d57310 2023-11-28T20:38:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f395ffff640 1 -- 172.21.15.167:0/1849442884 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f397c0c9020 con 0x55b179d57310 2023-11-28T20:38:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 10 client.4857 fetch_fsmap finished waiting for FSMap version 14 2023-11-28T20:38:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 10 client.4857 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T20:38:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 20 client.4857 populate_metadata read hostname 'smithi167' 2023-11-28T20:38:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179dcb2c0 0x55b179dcd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 4 client.4857 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:38:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 -- 172.21.15.167:0/1849442884 --> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b179b949a0 con 0x55b179dcb2c0 2023-11-28T20:38:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f3989299640 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179dcb2c0 0x55b179dcd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f3989299640 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179dcb2c0 0x55b179dcd6b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30ee87a2b45c11f6 server_cookie=7f6f9c1673246cf7 in_seq=0 out_seq=0 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f395ffff640 10 client.4857 ms_handle_connect on v2:172.21.15.167:6836/1234930245 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f395ffff640 1 -- 172.21.15.167:0/1849442884 <== mds.1 v2:172.21.15.167:6836/1234930245 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b179b949a0 con 0x55b179dcb2c0 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f395ffff640 10 client.4857 handle_command_reply: tid=0 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 client.4857 shutdown 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 -- 172.21.15.167:0/1849442884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d57310 msgr2=0x55b179d85ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d57310 0x55b179d85ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f397c009d90 tx=0x7f397c004a50 comp rx=0 tx=0).stop 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 -- 172.21.15.167:0/1849442884 shutdown_connections 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.167:6836/1234930245,v1:172.21.15.167:6837/1234930245] conn(0x55b179dcb2c0 0x55b179dcd6b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b179d57310 0x55b179d85ea0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b179d569f0 0x55b179d18ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 --2- 172.21.15.167:0/1849442884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b179d51930 0x55b179d187a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f395ffff640 0 client.4857 ms_handle_reset on v2:172.21.15.167:6836/1234930245 2023-11-28T20:38:57.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 -- 172.21.15.167:0/1849442884 >> 172.21.15.167:0/1849442884 conn(0x55b179d527a0 msgr2=0x55b179d62ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 -- 172.21.15.167:0/1849442884 shutdown_connections 2023-11-28T20:38:57.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 1 -- 172.21.15.167:0/1849442884 wait complete. 2023-11-28T20:38:57.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398e85f000 20 client.4857 trim_cache size 0 max 16384 2023-11-28T20:38:57.078 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:38:57.078 INFO:teuthology.orchestra.run.smithi167.stdout: "cluster_fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:38:57.078 INFO:teuthology.orchestra.run.smithi167.stdout: "whoami": 1, 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4278, 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout: "want_state": "up:active", 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "up:active", 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs", 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout: "rank_uptime": 16.534466495, 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsmap_epoch": 14, 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch": 25, 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch_barrier": 25, 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout: "uptime": 44.254603025000002 2023-11-28T20:38:57.079 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:38:57.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 -- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f39680664a0 msgr2=0x7f3968068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f39680664a0 0x7f3968068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3984067a50 tx=0x7f3974009040 comp rx=0 tx=0).stop 2023-11-28T20:38:57.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 -- 172.21.15.167:0/1904909203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39840c4510 msgr2=0x7f398414b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39840c4510 0x7f398414b4d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f398000e7f0 tx=0x7f398000ecb0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 -- 172.21.15.167:0/1904909203 shutdown_connections 2023-11-28T20:38:57.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f39680664a0 0x7f3968068960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3984150b40 0x7f3984071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39840c6ff0 0x7f3984148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 --2- 172.21.15.167:0/1904909203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39840c4510 0x7f398414b4d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 -- 172.21.15.167:0/1904909203 >> 172.21.15.167:0/1904909203 conn(0x7f39840cb1e0 msgr2=0x7f398414fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 -- 172.21.15.167:0/1904909203 shutdown_connections 2023-11-28T20:38:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.068+0000 7f398b4fd640 1 -- 172.21.15.167:0/1904909203 wait complete. 2023-11-28T20:38:57.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-28T20:38:57.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.224+0000 7f370e479640 1 Processor -- start 2023-11-28T20:38:57.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.224+0000 7f370e479640 1 -- start start 2023-11-28T20:38:57.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370e479640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37080c75c0 0x7f37080c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370e479640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f370806a580 0x7f370806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370e479640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37080c7a50 con 0x7f3708151f60 2023-11-28T20:38:57.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370e479640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370806aed0 con 0x7f370806a580 2023-11-28T20:38:57.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370e479640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37080c4da0 con 0x7f37080c75c0 2023-11-28T20:38:57.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370ca16640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f370806a580 0x7f370806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f3707fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3708151f60 0x7f37080c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50150/0 (socket says 172.21.15.167:50150) 2023-11-28T20:38:57.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f3707fff640 1 -- 172.21.15.167:0/1261968977 learned_addr learned my addr 172.21.15.167:0/1261968977 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:57.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f37077fe640 1 --2- 172.21.15.167:0/1261968977 >> v2:172.21.15.178:3300/0 conn(0x7f37080c75c0 0x7f37080c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370ca16640 1 -- 172.21.15.167:0/1261968977 >> v2:172.21.15.178:3300/0 conn(0x7f37080c75c0 msgr2=0x7f37080c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370ca16640 1 --2- 172.21.15.167:0/1261968977 >> v2:172.21.15.178:3300/0 conn(0x7f37080c75c0 0x7f37080c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370ca16640 1 -- 172.21.15.167:0/1261968977 >> v1:172.21.15.167:6789/0 conn(0x7f3708151f60 legacy=0x7f37080c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.228+0000 7f370ca16640 1 -- 172.21.15.167:0/1261968977 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370815b220 con 0x7f370806a580 2023-11-28T20:38:57.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370ca16640 1 --2- 172.21.15.167:0/1261968977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f370806a580 0x7f370806a990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f37080c8d80 tx=0x7f370001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e626dc9a6a381ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f3706ffd640 1 -- 172.21.15.167:0/1261968977 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000a5740 con 0x7f370806a580 2023-11-28T20:38:57.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f3706ffd640 1 -- 172.21.15.167:0/1261968977 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37000a58a0 con 0x7f370806a580 2023-11-28T20:38:57.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f3706ffd640 1 -- 172.21.15.167:0/1261968977 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000a5c30 con 0x7f370806a580 2023-11-28T20:38:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 -- 172.21.15.167:0/1261968977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f370806a580 msgr2=0x7f370806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 --2- 172.21.15.167:0/1261968977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f370806a580 0x7f370806a990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f37080c8d80 tx=0x7f370001c880 comp rx=0 tx=0).stop 2023-11-28T20:38:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 -- 172.21.15.167:0/1261968977 shutdown_connections 2023-11-28T20:38:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 --2- 172.21.15.167:0/1261968977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f370806a580 0x7f370806a990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 --2- 172.21.15.167:0/1261968977 >> v2:172.21.15.178:3300/0 conn(0x7f37080c75c0 0x7f37080c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 -- 172.21.15.167:0/1261968977 >> 172.21.15.167:0/1261968977 conn(0x7f37080cb1e0 msgr2=0x7f37080cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 -- 172.21.15.167:0/1261968977 shutdown_connections 2023-11-28T20:38:57.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 -- 172.21.15.167:0/1261968977 wait complete. 2023-11-28T20:38:57.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 Processor -- start 2023-11-28T20:38:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 -- start start 2023-11-28T20:38:57.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370806a580 0x7f3708158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37080c75c0 0x7f3708156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3708151f60 0x7f37081f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370814f100 con 0x7f37080c75c0 2023-11-28T20:38:57.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3708159330 con 0x7f370806a580 2023-11-28T20:38:57.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.232+0000 7f370e479640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3708155f90 con 0x7f3708151f60 2023-11-28T20:38:57.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f37077fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37080c75c0 0x7f3708156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f37077fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37080c75c0 0x7f3708156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45790/0 (socket says 172.21.15.167:45790) 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f37077fe640 1 -- 172.21.15.167:0/3965931264 learned_addr learned my addr 172.21.15.167:0/3965931264 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f3707fff640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370806a580 0x7f3708158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f370ca16640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3708151f60 0x7f37081f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f37077fe640 1 -- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3708151f60 msgr2=0x7f37081f3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f37077fe640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3708151f60 0x7f37081f3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f37077fe640 1 -- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370806a580 msgr2=0x7f3708158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f37077fe640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370806a580 0x7f3708158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f37077fe640 1 -- 172.21.15.167:0/3965931264 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700009a70 con 0x7f37080c75c0 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f37077fe640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37080c75c0 0x7f3708156420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00d800 tx=0x7f36fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f3704ff9640 1 -- 172.21.15.167:0/3965931264 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00b6c0 con 0x7f37080c75c0 2023-11-28T20:38:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f3704ff9640 1 -- 172.21.15.167:0/3965931264 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc00b820 con 0x7f37080c75c0 2023-11-28T20:38:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f370e479640 1 -- 172.21.15.167:0/3965931264 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3708155cb0 con 0x7f37080c75c0 2023-11-28T20:38:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f3704ff9640 1 -- 172.21.15.167:0/3965931264 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00bb90 con 0x7f37080c75c0 2023-11-28T20:38:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f370e479640 1 -- 172.21.15.167:0/3965931264 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370815acd0 con 0x7f37080c75c0 2023-11-28T20:38:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f3704ff9640 1 -- 172.21.15.167:0/3965931264 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f36fc00bcf0 con 0x7f37080c75c0 2023-11-28T20:38:57.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.236+0000 7f3704ff9640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36f4066470 0x7f36f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f3704ff9640 1 -- 172.21.15.167:0/3965931264 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36fc084720 con 0x7f37080c75c0 2023-11-28T20:38:57.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f3707fff640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36f4066470 0x7f36f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 Processor -- start 2023-11-28T20:38:57.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 -- start start 2023-11-28T20:38:57.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f3707fff640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36f4066470 0x7f36f4068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36f8005890 tx=0x7f36f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af755b40 0x55a9af755f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75a9f0 0x55a9af75add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75b310 0x55a9af75b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9af584130 con 0x55a9af75b310 2023-11-28T20:38:57.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9af5719a0 con 0x55a9af755b40 2023-11-28T20:38:57.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9af56eed0 con 0x55a9af75a9f0 2023-11-28T20:38:57.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f370ca16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75b310 0x55a9af75b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f370ca16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75b310 0x55a9af75b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45798/0 (socket says 172.21.15.167:45798) 2023-11-28T20:38:57.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f370ca16640 1 -- 172.21.15.167:0/4222243461 learned_addr learned my addr 172.21.15.167:0/4222243461 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f3707fff640 1 --2- 172.21.15.167:0/4222243461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af755b40 0x55a9af755f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37077fe640 1 --2- 172.21.15.167:0/4222243461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75a9f0 0x55a9af75add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f370ca16640 1 -- 172.21.15.167:0/4222243461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75a9f0 msgr2=0x55a9af75add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f370ca16640 1 --2- 172.21.15.167:0/4222243461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75a9f0 0x55a9af75add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f370ca16640 1 -- 172.21.15.167:0/4222243461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af755b40 msgr2=0x55a9af755f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f370ca16640 1 --2- 172.21.15.167:0/4222243461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af755b40 0x55a9af755f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f370ca16640 1 -- 172.21.15.167:0/4222243461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9af262890 con 0x55a9af75b310 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f370ca16640 1 --2- 172.21.15.167:0/4222243461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75b310 0x55a9af75b6f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3700019490 tx=0x7f3700004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db14219d2108c13d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f36edffb640 1 -- 172.21.15.167:0/4222243461 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000a5c10 con 0x55a9af75b310 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f36edffb640 1 -- 172.21.15.167:0/4222243461 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37000a5d70 con 0x55a9af75b310 2023-11-28T20:38:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f36edffb640 1 -- 172.21.15.167:0/4222243461 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000b86c0 con 0x55a9af75b310 2023-11-28T20:38:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 -- 172.21.15.167:0/4222243461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75b310 msgr2=0x55a9af75b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 --2- 172.21.15.167:0/4222243461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75b310 0x55a9af75b6f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3700019490 tx=0x7f3700004ac0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 -- 172.21.15.167:0/4222243461 shutdown_connections 2023-11-28T20:38:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 --2- 172.21.15.167:0/4222243461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75b310 0x55a9af75b6f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 --2- 172.21.15.167:0/4222243461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75a9f0 0x55a9af75add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 --2- 172.21.15.167:0/4222243461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af755b40 0x55a9af755f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 -- 172.21.15.167:0/4222243461 >> 172.21.15.167:0/4222243461 conn(0x55a9af7567a0 msgr2=0x55a9af758b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 -- 172.21.15.167:0/4222243461 shutdown_connections 2023-11-28T20:38:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.240+0000 7f37117ea000 1 -- 172.21.15.167:0/4222243461 wait complete. 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 -- start start 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 Processor -- start 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af755b40 0x55a9af754d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af755250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75b310 0x55a9af765dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9af56a7c0 con 0x55a9af75a9f0 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9af522bf0 con 0x55a9af75b310 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9af528a90 con 0x55a9af755b40 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 10 client.0 _ll_register_callbacks cb 0x55a9af7053c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37077fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af755250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37077fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af755250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45814/0 (socket says 172.21.15.167:45814) 2023-11-28T20:38:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37077fe640 1 -- 172.21.15.167:0/860491075 learned_addr learned my addr 172.21.15.167:0/860491075 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f3707fff640 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af755b40 0x55a9af754d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f370ca16640 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75b310 0x55a9af765dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37077fe640 1 -- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af755b40 msgr2=0x55a9af754d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37077fe640 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af755b40 0x55a9af754d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37077fe640 1 -- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75b310 msgr2=0x55a9af765dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37077fe640 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75b310 0x55a9af765dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37077fe640 1 -- 172.21.15.167:0/860491075 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370815b220 con 0x55a9af75a9f0 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37077fe640 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af755250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f36fc055140 tx=0x7f36fc055c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62de8488725fcb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f36e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f36e6ffd640 1 -- 172.21.15.167:0/860491075 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc059150 con 0x55a9af75a9f0 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f36e6ffd640 1 -- 172.21.15.167:0/860491075 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36fc0592b0 con 0x55a9af75a9f0 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 -- 172.21.15.167:0/860491075 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9af52c470 con 0x55a9af75a9f0 2023-11-28T20:38:57.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f36e6ffd640 1 -- 172.21.15.167:0/860491075 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36fc073170 con 0x55a9af75a9f0 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 10 client.4872 fetch_fsmap learned FSMap version 14 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 -- 172.21.15.167:0/860491075 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55a9af52b190 con 0x55a9af75a9f0 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f36e6ffd640 1 -- 172.21.15.167:0/860491075 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9af52c470 con 0x55a9af75a9f0 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f36e6ffd640 1 -- 172.21.15.167:0/860491075 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f36fc082d20 con 0x55a9af75a9f0 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 10 client.4872 fetch_fsmap finished waiting for FSMap version 14 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 10 client.4872 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 20 client.4872 populate_metadata read hostname 'smithi167' 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x55a9af766a70 0x55a9af766e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 4 client.4872 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f37117ea000 1 -- 172.21.15.167:0/860491075 --> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9af52fb50 con 0x55a9af766a70 2023-11-28T20:38:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.244+0000 7f3707fff640 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x55a9af766a70 0x55a9af766e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f36e6ffd640 10 client.4872 ms_handle_connect on v2:172.21.15.178:6837/4165916206 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f3707fff640 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x55a9af766a70 0x55a9af766e50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c98fceeada8e014 server_cookie=18aa4bcd46046cdb in_seq=0 out_seq=0 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f36e6ffd640 1 -- 172.21.15.167:0/860491075 <== mds.0 v2:172.21.15.178:6837/4165916206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a9af52fb50 con 0x55a9af766a70 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f36e6ffd640 10 client.4872 handle_command_reply: tid=0 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 client.4872 shutdown 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 -- 172.21.15.167:0/860491075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 msgr2=0x55a9af755250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af755250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f36fc055140 tx=0x7f36fc055c80 comp rx=0 tx=0).stop 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 -- 172.21.15.167:0/860491075 shutdown_connections 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x55a9af766a70 0x55a9af766e50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75b310 0x55a9af765dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af755250 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 --2- 172.21.15.167:0/860491075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af755b40 0x55a9af754d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f36e6ffd640 0 client.4872 ms_handle_reset on v2:172.21.15.178:6837/4165916206 2023-11-28T20:38:57.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 -- 172.21.15.167:0/860491075 >> 172.21.15.167:0/860491075 conn(0x55a9af7567a0 msgr2=0x55a9af75a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 -- 172.21.15.167:0/860491075 shutdown_connections 2023-11-28T20:38:57.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 1 -- 172.21.15.167:0/860491075 wait complete. 2023-11-28T20:38:57.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.248+0000 7f37117ea000 20 client.4872 trim_cache size 0 max 16384 2023-11-28T20:38:57.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f37117ea000 1 Processor -- start 2023-11-28T20:38:57.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f37117ea000 1 -- start start 2023-11-28T20:38:57.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f37117ea000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af755b40 0x55a9af770dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f37117ea000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75a9f0 0x55a9af771310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f37117ea000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 0x55a9af771850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f37117ea000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9af223940 con 0x55a9af755b40 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f37117ea000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9af604600 con 0x55a9af75a9f0 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f37117ea000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9af7559f0 con 0x55a9af75b310 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f3707fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af755b40 0x55a9af770dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f3707fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af755b40 0x55a9af770dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45826/0 (socket says 172.21.15.167:45826) 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f3707fff640 1 -- 172.21.15.167:0/891790434 learned_addr learned my addr 172.21.15.167:0/891790434 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f370ca16640 1 --2- 172.21.15.167:0/891790434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 0x55a9af771850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f37077fe640 1 --2- 172.21.15.167:0/891790434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75a9f0 0x55a9af771310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f3707fff640 1 -- 172.21.15.167:0/891790434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 msgr2=0x55a9af771850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f3707fff640 1 --2- 172.21.15.167:0/891790434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 0x55a9af771850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f3707fff640 1 -- 172.21.15.167:0/891790434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75a9f0 msgr2=0x55a9af771310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f3707fff640 1 --2- 172.21.15.167:0/891790434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75a9f0 0x55a9af771310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f3707fff640 1 -- 172.21.15.167:0/891790434 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9af511490 con 0x55a9af755b40 2023-11-28T20:38:57.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.264+0000 7f3707fff640 1 --2- 172.21.15.167:0/891790434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af755b40 0x55a9af770dd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f36f8001690 tx=0x7f36f8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fd8c3c260eec27 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f36ee7fc640 1 -- 172.21.15.167:0/891790434 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8028070 con 0x55a9af755b40 2023-11-28T20:38:57.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f36ee7fc640 1 -- 172.21.15.167:0/891790434 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8016110 con 0x55a9af755b40 2023-11-28T20:38:57.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f36ee7fc640 1 -- 172.21.15.167:0/891790434 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8016c10 con 0x55a9af755b40 2023-11-28T20:38:57.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- 172.21.15.167:0/891790434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af755b40 msgr2=0x55a9af770dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 --2- 172.21.15.167:0/891790434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af755b40 0x55a9af770dd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f36f8001690 tx=0x7f36f8012000 comp rx=0 tx=0).stop 2023-11-28T20:38:57.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- 172.21.15.167:0/891790434 shutdown_connections 2023-11-28T20:38:57.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 --2- 172.21.15.167:0/891790434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 0x55a9af771850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 --2- 172.21.15.167:0/891790434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af75a9f0 0x55a9af771310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 --2- 172.21.15.167:0/891790434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af755b40 0x55a9af770dd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- 172.21.15.167:0/891790434 >> 172.21.15.167:0/891790434 conn(0x55a9af7567a0 msgr2=0x55a9af75a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- 172.21.15.167:0/891790434 shutdown_connections 2023-11-28T20:38:57.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- 172.21.15.167:0/891790434 wait complete. 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- start start 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 Processor -- start 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af768120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 0x55a9af768660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af7777e0 0x55a9af777bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9af56e0a0 con 0x55a9af75a9f0 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9af544e30 con 0x55a9af7777e0 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9af758ff0 con 0x55a9af75b310 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 10 client.0 _ll_register_callbacks cb 0x55a9af6e5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f3707fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af768120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f3707fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af768120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45832/0 (socket says 172.21.15.167:45832) 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f3707fff640 1 -- 172.21.15.167:0/2596185838 learned_addr learned my addr 172.21.15.167:0/2596185838 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f370ca16640 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af7777e0 0x55a9af777bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37077fe640 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 0x55a9af768660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f3707fff640 1 -- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 msgr2=0x55a9af768660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f3707fff640 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 0x55a9af768660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f3707fff640 1 -- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af7777e0 msgr2=0x55a9af777bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f3707fff640 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af7777e0 0x55a9af777bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f3707fff640 1 -- 172.21.15.167:0/2596185838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f8019040 con 0x55a9af75a9f0 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f3707fff640 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af768120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36f8016040 tx=0x7f36f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcde9b4501d10676 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f36e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f36e6ffd640 1 -- 172.21.15.167:0/2596185838 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8038070 con 0x55a9af75a9f0 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f36e6ffd640 1 -- 172.21.15.167:0/2596185838 <== mon.0 v2:172.21.15.167:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36f801c040 con 0x55a9af75a9f0 2023-11-28T20:38:57.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.268+0000 7f37117ea000 1 -- 172.21.15.167:0/2596185838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9af569110 con 0x55a9af75a9f0 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f36e6ffd640 1 -- 172.21.15.167:0/2596185838 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f8016280 con 0x55a9af75a9f0 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 10 client.4878 fetch_fsmap learned FSMap version 14 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 -- 172.21.15.167:0/2596185838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55a9af262cc0 con 0x55a9af75a9f0 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f36e6ffd640 1 -- 172.21.15.167:0/2596185838 <== mon.0 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9af569110 con 0x55a9af75a9f0 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f36e6ffd640 1 -- 172.21.15.167:0/2596185838 <== mon.0 v2:172.21.15.167:3300/0 5 ==== fsmap(e 14) v1 ==== 4476+0+0 (secure 0 0 0) 0x7f36f803b020 con 0x55a9af75a9f0 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 10 client.4878 fetch_fsmap finished waiting for FSMap version 14 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 10 client.4878 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 20 client.4878 populate_metadata read hostname 'smithi167' 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x55a9af778100 0x55a9af7cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 4 client.4878 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T20:38:57.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 -- 172.21.15.167:0/2596185838 --> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9af5989a0 con 0x55a9af778100 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37077fe640 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x55a9af778100 0x55a9af7cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f36e6ffd640 10 client.4878 ms_handle_connect on v2:172.21.15.178:6837/4165916206 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37077fe640 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x55a9af778100 0x55a9af7cd120 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ad0cceb3941678 server_cookie=562dc73cd6312da1 in_seq=0 out_seq=0 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f36e6ffd640 1 -- 172.21.15.167:0/2596185838 <== mds.0 v2:172.21.15.178:6837/4165916206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a9af5989a0 con 0x55a9af778100 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f36e6ffd640 10 client.4878 handle_command_reply: tid=0 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 client.4878 shutdown 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 -- 172.21.15.167:0/2596185838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 msgr2=0x55a9af768120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af768120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36f8016040 tx=0x7f36f8005800 comp rx=0 tx=0).stop 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 -- 172.21.15.167:0/2596185838 shutdown_connections 2023-11-28T20:38:57.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:6837/4165916206,v1:172.21.15.178:6839/4165916206] conn(0x55a9af778100 0x55a9af7cd120 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a9af7777e0 0x55a9af777bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a9af75b310 0x55a9af768660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 --2- 172.21.15.167:0/2596185838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9af75a9f0 0x55a9af768120 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f36e6ffd640 0 client.4878 ms_handle_reset on v2:172.21.15.178:6837/4165916206 2023-11-28T20:38:57.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 -- 172.21.15.167:0/2596185838 >> 172.21.15.167:0/2596185838 conn(0x55a9af7567a0 msgr2=0x55a9af75a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 -- 172.21.15.167:0/2596185838 shutdown_connections 2023-11-28T20:38:57.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 1 -- 172.21.15.167:0/2596185838 wait complete. 2023-11-28T20:38:57.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f37117ea000 20 client.4878 trim_cache size 0 max 16384 2023-11-28T20:38:57.281 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "cluster_fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "whoami": 0, 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 4279, 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "want_state": "up:active", 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "up:active", 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs", 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "rank_uptime": 37.761972751999998, 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "mdsmap_epoch": 14, 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch": 25, 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_epoch_barrier": 25, 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout: "uptime": 44.475968735999999 2023-11-28T20:38:57.282 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:38:57.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 -- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36f4066470 msgr2=0x7f36f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36f4066470 0x7f36f4068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36f8005890 tx=0x7f36f8009040 comp rx=0 tx=0).stop 2023-11-28T20:38:57.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 -- 172.21.15.167:0/3965931264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37080c75c0 msgr2=0x7f3708156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37080c75c0 0x7f3708156420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00d800 tx=0x7f36fc00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 -- 172.21.15.167:0/3965931264 shutdown_connections 2023-11-28T20:38:57.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36f4066470 0x7f36f4068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3708151f60 0x7f37081f3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37080c75c0 0x7f3708156420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 --2- 172.21.15.167:0/3965931264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370806a580 0x7f3708158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 -- 172.21.15.167:0/3965931264 >> 172.21.15.167:0/3965931264 conn(0x7f37080cb1e0 msgr2=0x7f3708147e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 -- 172.21.15.167:0/3965931264 shutdown_connections 2023-11-28T20:38:57.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.272+0000 7f370e479640 1 -- 172.21.15.167:0/3965931264 wait complete. 2023-11-28T20:38:57.296 INFO:teuthology.run_tasks:Running task kclient... 2023-11-28T20:38:57.321 INFO:tasks.kclient:Mounting kernel clients... 2023-11-28T20:38:57.322 INFO:tasks.kclient:config is {'client.0': {}} 2023-11-28T20:38:57.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:57.322 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-11-28T20:38:57.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-28T20:38:57.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:57.332 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-28T20:38:57.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:57.399 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2023-11-28T20:38:57.608 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-28T20:38:57.609 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T20:38:57.609 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:38:57.609 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T20:38:57.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f20330e3640 1 Processor -- start 2023-11-28T20:38:57.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f20330e3640 1 -- start start 2023-11-28T20:38:57.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f20330e3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f202c0c75c0 0x7f202c0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f20330e3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c06a580 0x7f202c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f20330e3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0c7a50 con 0x7f202c151f60 2023-11-28T20:38:57.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f20330e3640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c06aed0 con 0x7f202c0c75c0 2023-11-28T20:38:57.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f20330e3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0c4da0 con 0x7f202c06a580 2023-11-28T20:38:57.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f2030e7f640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f202c151f60 0x7f202c0c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50152/0 (socket says 172.21.15.167:50152) 2023-11-28T20:38:57.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f202bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f202c0c75c0 0x7f202c0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f2030e7f640 1 -- 172.21.15.167:0/3712481101 learned_addr learned my addr 172.21.15.167:0/3712481101 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:57.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f2031680640 1 --2- 172.21.15.167:0/3712481101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c06a580 0x7f202c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f202bfff640 1 -- 172.21.15.167:0/3712481101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c06a580 msgr2=0x7f202c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:57.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f202bfff640 1 --2- 172.21.15.167:0/3712481101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c06a580 0x7f202c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f202bfff640 1 -- 172.21.15.167:0/3712481101 >> v1:172.21.15.167:6789/0 conn(0x7f202c151f60 legacy=0x7f202c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f202bfff640 1 -- 172.21.15.167:0/3712481101 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c15b220 con 0x7f202c0c75c0 2023-11-28T20:38:57.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.744+0000 7f202b7fe640 1 -- 172.21.15.167:0/3712481101 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608094683 0 0) 0x7f2020001120 con 0x7f202c151f60 2023-11-28T20:38:57.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f202bfff640 1 --2- 172.21.15.167:0/3712481101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c0c75c0 0x7f202c0c5c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f20180097c0 tx=0x7f201801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7d051933c30c04 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f202b7fe640 1 -- 172.21.15.167:0/3712481101 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180ab600 con 0x7f202c0c75c0 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f202b7fe640 1 -- 172.21.15.167:0/3712481101 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20180a7050 con 0x7f202c0c75c0 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f202b7fe640 1 -- 172.21.15.167:0/3712481101 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180ab980 con 0x7f202c0c75c0 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f20330e3640 1 -- 172.21.15.167:0/3712481101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c0c75c0 msgr2=0x7f202c0c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f20330e3640 1 --2- 172.21.15.167:0/3712481101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c0c75c0 0x7f202c0c5c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f20180097c0 tx=0x7f201801c3f0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f20330e3640 1 -- 172.21.15.167:0/3712481101 shutdown_connections 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f20330e3640 1 --2- 172.21.15.167:0/3712481101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c0c75c0 0x7f202c0c5c90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f20330e3640 1 --2- 172.21.15.167:0/3712481101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c06a580 0x7f202c06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f20330e3640 1 -- 172.21.15.167:0/3712481101 >> 172.21.15.167:0/3712481101 conn(0x7f202c0cb1e0 msgr2=0x7f202c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f20330e3640 1 -- 172.21.15.167:0/3712481101 shutdown_connections 2023-11-28T20:38:57.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.748+0000 7f20330e3640 1 -- 172.21.15.167:0/3712481101 wait complete. 2023-11-28T20:38:57.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 Processor -- start 2023-11-28T20:38:57.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 -- start start 2023-11-28T20:38:57.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f202c06a580 0x7f202c071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c0c75c0 0x7f202c1f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c151f60 0x7f202c1f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c1f60e0 con 0x7f202c151f60 2023-11-28T20:38:57.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c15a1c0 con 0x7f202c06a580 2023-11-28T20:38:57.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c15a580 con 0x7f202c0c75c0 2023-11-28T20:38:57.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2031680640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c151f60 0x7f202c1f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2031680640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c151f60 0x7f202c1f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45858/0 (socket says 172.21.15.167:45858) 2023-11-28T20:38:57.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2031680640 1 -- 172.21.15.167:0/3577529641 learned_addr learned my addr 172.21.15.167:0/3577529641 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:57.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2030e7f640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f202c06a580 0x7f202c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f202bfff640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c0c75c0 0x7f202c1f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2031680640 1 -- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c0c75c0 msgr2=0x7f202c1f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2031680640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c0c75c0 0x7f202c1f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2031680640 1 -- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f202c06a580 msgr2=0x7f202c071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2031680640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f202c06a580 0x7f202c071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2031680640 1 -- 172.21.15.167:0/3577529641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018009420 con 0x7f202c151f60 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f2031680640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c151f60 0x7f202c1f6b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2024007e60 tx=0x7f202400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20297fa640 1 -- 172.21.15.167:0/3577529641 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024014420 con 0x7f202c151f60 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20297fa640 1 -- 172.21.15.167:0/3577529641 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20240145a0 con 0x7f202c151f60 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20297fa640 1 -- 172.21.15.167:0/3577529641 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024014950 con 0x7f202c151f60 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c15a860 con 0x7f202c151f60 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c15ae20 con 0x7f202c151f60 2023-11-28T20:38:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.752+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c0682c0 con 0x7f202c151f60 2023-11-28T20:38:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.756+0000 7f20297fa640 1 -- 172.21.15.167:0/3577529641 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2024014ab0 con 0x7f202c151f60 2023-11-28T20:38:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.756+0000 7f20297fa640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2010066470 0x7f2010068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.756+0000 7f20297fa640 1 -- 172.21.15.167:0/3577529641 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2024084b30 con 0x7f202c151f60 2023-11-28T20:38:57.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.756+0000 7f2030e7f640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2010066470 0x7f2010068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:57.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.756+0000 7f2030e7f640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2010066470 0x7f2010068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2020007fd0 tx=0x7f20200079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:57.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.760+0000 7f20297fa640 1 -- 172.21.15.167:0/3577529641 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2024051c20 con 0x7f202c151f60 2023-11-28T20:38:57.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f202c075c90 con 0x7f202c151f60 2023-11-28T20:38:57.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20297fa640 1 -- 172.21.15.167:0/3577529641 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2024055240 con 0x7f202c151f60 2023-11-28T20:38:57.947 INFO:teuthology.orchestra.run.smithi167.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-28T20:38:57.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2010066470 msgr2=0x7f2010068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2010066470 0x7f2010068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2020007fd0 tx=0x7f20200079c0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c151f60 msgr2=0x7f202c1f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c151f60 0x7f202c1f6b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2024007e60 tx=0x7f202400e4b0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 shutdown_connections 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2010066470 0x7f2010068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f202c151f60 0x7f202c1f6b00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f202c0c75c0 0x7f202c1f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 --2- 172.21.15.167:0/3577529641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f202c06a580 0x7f202c071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 >> 172.21.15.167:0/3577529641 conn(0x7f202c0cb1e0 msgr2=0x7f202c0c3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 shutdown_connections 2023-11-28T20:38:57.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:57.944+0000 7f20330e3640 1 -- 172.21.15.167:0/3577529641 wait complete. 2023-11-28T20:38:57.967 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T20:38:57.968 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T20:38:57.968 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2023-11-28T20:38:57.968 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T20:38:57.968 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T20:38:57.968 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T20:38:57.968 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T20:38:57.968 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T20:38:57.968 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:38:57.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:57.969 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2023-11-28T20:38:57.978 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:57.979 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42371sec preferred_lft 42371sec 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 02:42:1a:f0:da:9c brd ff:ff:ff:ff:ff:ff 2023-11-28T20:38:57.980 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T20:38:57.981 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2023-11-28T20:38:57.981 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T20:38:57.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:57.981 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:57.981 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:57.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2023-11-28T20:38:57.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2023-11-28T20:38:57.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2023-11-28T20:38:57.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T20:38:57.982 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:58.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.095 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T20:38:58.115 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-11-28T20:38:58.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.117 DEBUG:teuthology.orchestra.run.smithi167:> route 2023-11-28T20:38:58.168 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2023-11-28T20:38:58.168 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T20:38:58.169 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T20:38:58.169 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T20:38:58.169 INFO:teuthology.orchestra.run.smithi167.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T20:38:58.169 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T20:38:58.169 INFO:teuthology.orchestra.run.smithi167.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:38:58.169 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:38:58.169 INFO:teuthology.orchestra.run.smithi167.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T20:38:58.169 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T20:38:58.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.170 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:58.170 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:58.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T20:38:58.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T20:38:58.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T20:38:58.170 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:58.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.264 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-11-28T20:38:58.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.274 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2023-11-28T20:38:58.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.331 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:58.331 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:58.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T20:38:58.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T20:38:58.331 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:58.413 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T20:38:58.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.413 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:58.413 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:58.413 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T20:38:58.413 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T20:38:58.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T20:38:58.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T20:38:58.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T20:38:58.414 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:58.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.553 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2023-11-28T20:38:58.553 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2023-11-28T20:38:58.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2023-11-28T20:38:58.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T20:38:58.553 DEBUG:teuthology.orchestra.run.smithi167:> ') 2023-11-28T20:38:58.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:38:58.596 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T20:38:58.650 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T20:38:58.651 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T20:38:58.651 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:38:58.701 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T20:38:58.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.702 DEBUG:teuthology.orchestra.run.smithi167:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T20:38:58.795 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T20:38:58.795 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T20:38:58.796 INFO:teuthology.orchestra.run.smithi167.stdout:invalid new device string format 2023-11-28T20:38:58.906 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T20:38:58.906 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T20:38:58.906 INFO:teuthology.orchestra.run.smithi167.stdout:invalid new device string format 2023-11-28T20:38:58.906 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.167:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-28T20:38:58.906 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T20:38:58.920 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T20:38:58.920 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T20:38:58.920 INFO:teuthology.orchestra.run.smithi167.stdout:invalid new device string format 2023-11-28T20:38:58.920 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.167:3300,172.21.15.178:3300,172.21.15.178:3301" 2023-11-28T20:38:58.921 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T20:38:58.921 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.167:6789,172.21.15.178:6789,172.21.15.178:6790" 2023-11-28T20:38:58.921 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.167:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2023-11-28T20:38:58.921 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4f385093-4252-4ae9-94ab-503723a001fd" will pass to kernel 2023-11-28T20:38:58.924 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T20:38:58.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T20:38:58.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:58.945 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:38:59.002 INFO:teuthology.orchestra.run.smithi167.stdout:client4709 2023-11-28T20:38:59.003 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:38:59.003 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T20:38:59.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:59.054 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:38:59.114 INFO:teuthology.orchestra.run.smithi167.stdout:client4709 2023-11-28T20:38:59.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:59.114 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T20:38:59.174 INFO:teuthology.orchestra.run.smithi167.stdout:client4709 2023-11-28T20:38:59.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T20:38:59.174 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f385093-4252-4ae9-94ab-503723a001fd.client4709/status') 2023-11-28T20:38:59.242 INFO:teuthology.orchestra.run.smithi167.stdout:instance: client.4709 (3)172.21.15.167:0/981365435 2023-11-28T20:38:59.242 INFO:teuthology.orchestra.run.smithi167.stdout:blocklisted: false 2023-11-28T20:38:59.242 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records in 2023-11-28T20:38:59.243 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records out 2023-11-28T20:38:59.243 INFO:teuthology.orchestra.run.smithi167.stderr:70 bytes copied, 7.3287e-05 s, 955 kB/s 2023-11-28T20:38:59.244 INFO:teuthology.run_tasks:Running task mon_thrash... 2023-11-28T20:38:59.257 INFO:tasks.mon_thrash:Beginning mon_thrash... 2023-11-28T20:38:59.257 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:38:59.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eb0df8640 1 Processor -- start 2023-11-28T20:38:59.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eb0df8640 1 -- start start 2023-11-28T20:38:59.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eb0df8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7eac151cf0 0x7f7eac0c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eb0df8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac0c7d80 0x7f7eac06f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eb0df8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0c63a0 con 0x7f7eac06a8f0 2023-11-28T20:38:59.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eb0df8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0724f0 con 0x7f7eac151cf0 2023-11-28T20:38:59.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eb0df8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c60c0 con 0x7f7eac0c7d80 2023-11-28T20:38:59.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea1d9b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7eac06a8f0 0x7f7eac06f010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50166/0 (socket says 172.21.15.167:50166) 2023-11-28T20:38:59.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea1d9b640 1 -- 172.21.15.167:0/4137051076 learned_addr learned my addr 172.21.15.167:0/4137051076 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:38:59.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eaa59c640 1 --2- 172.21.15.167:0/4137051076 >> v2:172.21.15.178:3300/0 conn(0x7f7eac151cf0 0x7f7eac0c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eaad9d640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac0c7d80 0x7f7eac06f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484880535 0 0) 0x7f7eac0c63a0 con 0x7f7eac06a8f0 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e98003530 con 0x7f7eac06a8f0 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1511600907 0 0) 0x7f7e98003530 con 0x7f7eac06a8f0 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac0c7d80 msgr2=0x7f7eac06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac0c7d80 0x7f7eac06f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 >> v2:172.21.15.178:3300/0 conn(0x7f7eac151cf0 msgr2=0x7f7eac0c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 --2- 172.21.15.167:0/4137051076 >> v2:172.21.15.178:3300/0 conn(0x7f7eac151cf0 0x7f7eac0c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac071c50 con 0x7f7eac06a8f0 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f7e94001a00 con 0x7f7eac06a8f0 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 >> v1:172.21.15.167:6789/0 conn(0x7f7eac06a8f0 legacy=0x7f7eac06f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e98003980 0x7f7e98003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac0c7d80 0x7f7e980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7e98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0724f0 con 0x7f7e98004d10 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c60c0 con 0x7f7e98003980 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9800b990 con 0x7f7eac0c7d80 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eaad9d640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7e98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7ea1d9b640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac0c7d80 0x7f7e980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eaa59c640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e98003980 0x7f7e98003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eaad9d640 1 -- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac0c7d80 msgr2=0x7f7e980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eaad9d640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac0c7d80 0x7f7e980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.428+0000 7f7eaad9d640 1 -- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e98003980 msgr2=0x7f7e98003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:59.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eaad9d640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e98003980 0x7f7e98003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eaad9d640 1 -- 172.21.15.167:0/4137051076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98003530 con 0x7f7e98004d10 2023-11-28T20:38:59.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eaad9d640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7e98005190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009ab0 tx=0x7f7ea401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b3dc2f5bad6e49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:59.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40a5620 con 0x7f7e98004d10 2023-11-28T20:38:59.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea40a5780 con 0x7f7e98004d10 2023-11-28T20:38:59.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7ea9d9b640 1 -- 172.21.15.167:0/4137051076 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40a5af0 con 0x7f7e98004d10 2023-11-28T20:38:59.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eb0df8640 1 -- 172.21.15.167:0/4137051076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 msgr2=0x7f7e98005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eb0df8640 1 --2- 172.21.15.167:0/4137051076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7e98005190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009ab0 tx=0x7f7ea401ca30 comp rx=0 tx=0).stop 2023-11-28T20:38:59.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eaad9d640 1 -- 172.21.15.167:0/4137051076 reap_dead start 2023-11-28T20:38:59.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eb0df8640 1 -- 172.21.15.167:0/4137051076 shutdown_connections 2023-11-28T20:38:59.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eb0df8640 1 -- 172.21.15.167:0/4137051076 >> 172.21.15.167:0/4137051076 conn(0x7f7eac0cc300 msgr2=0x7f7eac0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:59.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eb0df8640 1 -- 172.21.15.167:0/4137051076 shutdown_connections 2023-11-28T20:38:59.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.432+0000 7f7eb0df8640 1 -- 172.21.15.167:0/4137051076 wait complete. 2023-11-28T20:38:59.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eb0df8640 1 Processor -- start 2023-11-28T20:38:59.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eb0df8640 1 -- start start 2023-11-28T20:38:59.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eb0df8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7eac0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eb0df8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eac15bb20 0x7f7eac1f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eb0df8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac1f30c0 0x7f7eac0c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eb0df8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c4bc0 con 0x7f7e98004d10 2023-11-28T20:38:59.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eb0df8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac1f2410 con 0x7f7eac15bb20 2023-11-28T20:38:59.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eb0df8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c4950 con 0x7f7eac1f30c0 2023-11-28T20:38:59.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaa59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7eac0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaa59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7eac0c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45868/0 (socket says 172.21.15.167:45868) 2023-11-28T20:38:59.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaa59c640 1 -- 172.21.15.167:0/2568106137 learned_addr learned my addr 172.21.15.167:0/2568106137 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:59.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaad9d640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac1f30c0 0x7f7eac0c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7ea1d9b640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eac15bb20 0x7f7eac1f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaa59c640 1 -- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac1f30c0 msgr2=0x7f7eac0c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaa59c640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac1f30c0 0x7f7eac0c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaa59c640 1 -- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eac15bb20 msgr2=0x7f7eac1f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaa59c640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eac15bb20 0x7f7eac1f2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaa59c640 1 -- 172.21.15.167:0/2568106137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0c37b0 con 0x7f7e98004d10 2023-11-28T20:38:59.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7ea1d9b640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eac15bb20 0x7f7eac1f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:38:59.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.436+0000 7f7eaa59c640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7eac0c8480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0119d0 tx=0x7f7e9c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:59.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7ea37fe640 1 -- 172.21.15.167:0/2568106137 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00fb50 con 0x7f7e98004d10 2023-11-28T20:38:59.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7ea37fe640 1 -- 172.21.15.167:0/2568106137 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c00fcb0 con 0x7f7e98004d10 2023-11-28T20:38:59.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7ea37fe640 1 -- 172.21.15.167:0/2568106137 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c014440 con 0x7f7e98004d10 2023-11-28T20:38:59.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac0c4dd0 con 0x7f7e98004d10 2023-11-28T20:38:59.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac0c5390 con 0x7f7e98004d10 2023-11-28T20:38:59.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac0682c0 con 0x7f7e98004d10 2023-11-28T20:38:59.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7ea37fe640 1 -- 172.21.15.167:0/2568106137 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e9c0145a0 con 0x7f7e98004d10 2023-11-28T20:38:59.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7ea37fe640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e8c066470 0x7f7e8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7ea37fe640 1 -- 172.21.15.167:0/2568106137 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e9c084a70 con 0x7f7e98004d10 2023-11-28T20:38:59.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.440+0000 7f7ea1d9b640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e8c066470 0x7f7e8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.444+0000 7f7ea1d9b640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e8c066470 0x7f7e8c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7eac155f90 tx=0x7f7e9400a060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:59.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.444+0000 7f7ea37fe640 1 -- 172.21.15.167:0/2568106137 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e9c051c20 con 0x7f7e98004d10 2023-11-28T20:38:59.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.596+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eac075c90 con 0x7f7e98004d10 2023-11-28T20:38:59.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.596+0000 7f7ea37fe640 1 -- 172.21.15.167:0/2568106137 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18370 (secure 0 0 0) 0x7f7e9c022020 con 0x7f7e98004d10 2023-11-28T20:38:59.602 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:38:59.602 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":25,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:38:23.954903+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:38:59.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e8c066470 msgr2=0x7f7e8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e8c066470 0x7f7e8c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7eac155f90 tx=0x7f7e9400a060 comp rx=0 tx=0).stop 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 msgr2=0x7f7eac0c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7eac0c8480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0119d0 tx=0x7f7e9c011e90 comp rx=0 tx=0).stop 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 shutdown_connections 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e8c066470 0x7f7e8c068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eac1f30c0 0x7f7eac0c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eac15bb20 0x7f7eac1f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 --2- 172.21.15.167:0/2568106137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e98004d10 0x7f7eac0c8480 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 >> 172.21.15.167:0/2568106137 conn(0x7f7eac0cc300 msgr2=0x7f7eac150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 shutdown_connections 2023-11-28T20:38:59.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.600+0000 7f7eb0df8640 1 -- 172.21.15.167:0/2568106137 wait complete. 2023-11-28T20:38:59.623 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:38:05.507993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:38:17.477871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:38:17.884061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T20:38:21.578587+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T20:38:59.623 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:38:59.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf770f640 1 Processor -- start 2023-11-28T20:38:59.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf770f640 1 -- start start 2023-11-28T20:38:59.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf770f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf015e130 0x7fcbf0161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf770f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbf00c7720 0x7fcbf0162320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf770f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf015e5e0 con 0x7fcbf01585d0 2023-11-28T20:38:59.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf770f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf015f160 con 0x7fcbf00c7720 2023-11-28T20:38:59.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf770f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf015e8c0 con 0x7fcbf015e130 2023-11-28T20:38:59.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf4caa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf015e130 0x7fcbf0161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf5cac640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbf00c7720 0x7fcbf0162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf4caa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf015e130 0x7fcbf0161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:38106/0 (socket says 172.21.15.167:38106) 2023-11-28T20:38:59.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf4caa640 1 -- 172.21.15.167:0/4256971654 learned_addr learned my addr 172.21.15.167:0/4256971654 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:59.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf5cac640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbf00c7720 0x7fcbf0162320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:37360/0 (socket says 172.21.15.167:37360) 2023-11-28T20:38:59.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf54ab640 1 --1- 172.21.15.167:0/4256971654 >> v1:172.21.15.178:6789/0 conn(0x7fcbf01585d0 0x7fcbf00c5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:35380/0 (socket says 172.21.15.167:35380) 2023-11-28T20:38:59.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf4caa640 1 -- 172.21.15.167:0/4256971654 >> v2:172.21.15.178:3300/0 conn(0x7fcbf00c7720 msgr2=0x7fcbf0162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:38:59.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf4caa640 1 --2- 172.21.15.167:0/4256971654 >> v2:172.21.15.178:3300/0 conn(0x7fcbf00c7720 0x7fcbf0162320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf4caa640 1 -- 172.21.15.167:0/4256971654 >> v1:172.21.15.178:6789/0 conn(0x7fcbf01585d0 legacy=0x7fcbf00c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.764+0000 7fcbf4caa640 1 -- 172.21.15.167:0/4256971654 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf015eba0 con 0x7fcbf015e130 2023-11-28T20:38:59.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbf4caa640 1 --2- 172.21.15.167:0/4256971654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf015e130 0x7fcbf0161de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009870 tx=0x7fcbe001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb24d13fefbb09a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:59.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbe7fff640 1 -- 172.21.15.167:0/4256971654 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00aa670 con 0x7fcbf015e130 2023-11-28T20:38:59.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbe7fff640 1 -- 172.21.15.167:0/4256971654 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe00aa7d0 con 0x7fcbf015e130 2023-11-28T20:38:59.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbe7fff640 1 -- 172.21.15.167:0/4256971654 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00aab60 con 0x7fcbf015e130 2023-11-28T20:38:59.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbf770f640 1 -- 172.21.15.167:0/4256971654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf015e130 msgr2=0x7fcbf0161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbf770f640 1 --2- 172.21.15.167:0/4256971654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf015e130 0x7fcbf0161de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009870 tx=0x7fcbe001c510 comp rx=0 tx=0).stop 2023-11-28T20:38:59.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbf770f640 1 -- 172.21.15.167:0/4256971654 shutdown_connections 2023-11-28T20:38:59.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbf770f640 1 --2- 172.21.15.167:0/4256971654 >> v2:172.21.15.178:3300/0 conn(0x7fcbf00c7720 0x7fcbf0162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbf770f640 1 --2- 172.21.15.167:0/4256971654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf015e130 0x7fcbf0161de0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbf770f640 1 -- 172.21.15.167:0/4256971654 >> 172.21.15.167:0/4256971654 conn(0x7fcbf00cb1e0 msgr2=0x7fcbf00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:59.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbf770f640 1 -- 172.21.15.167:0/4256971654 shutdown_connections 2023-11-28T20:38:59.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.768+0000 7fcbf770f640 1 -- 172.21.15.167:0/4256971654 wait complete. 2023-11-28T20:38:59.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 Processor -- start 2023-11-28T20:38:59.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 -- start start 2023-11-28T20:38:59.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf00c7720 0x7fcbf0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf01585d0 0x7fcbf00c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbf015e130 0x7fcbf00ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf00c94a0 con 0x7fcbf00c7720 2023-11-28T20:38:59.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf015aa50 con 0x7fcbf015e130 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf015ad30 con 0x7fcbf01585d0 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf54ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf00c7720 0x7fcbf0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf54ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf00c7720 0x7fcbf0159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45878/0 (socket says 172.21.15.167:45878) 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf54ab640 1 -- 172.21.15.167:0/2375349602 learned_addr learned my addr 172.21.15.167:0/2375349602 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf5cac640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbf015e130 0x7fcbf00ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf4caa640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf01585d0 0x7fcbf00c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf54ab640 1 -- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf01585d0 msgr2=0x7fcbf00c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf54ab640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf01585d0 0x7fcbf00c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf54ab640 1 -- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbf015e130 msgr2=0x7fcbf00ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf54ab640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbf015e130 0x7fcbf00ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf54ab640 1 -- 172.21.15.167:0/2375349602 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00094d0 con 0x7fcbf00c7720 2023-11-28T20:38:59.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf54ab640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf00c7720 0x7fcbf0159aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00c420 tx=0x7fcbec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:59.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbe5ffb640 1 -- 172.21.15.167:0/2375349602 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0074e0 con 0x7fcbf00c7720 2023-11-28T20:38:59.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbe5ffb640 1 -- 172.21.15.167:0/2375349602 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec007640 con 0x7fcbf00c7720 2023-11-28T20:38:59.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbe5ffb640 1 -- 172.21.15.167:0/2375349602 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec004a30 con 0x7fcbf00c7720 2023-11-28T20:38:59.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf00c96f0 con 0x7fcbf00c7720 2023-11-28T20:38:59.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.772+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf00c9cb0 con 0x7fcbf00c7720 2023-11-28T20:38:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.776+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf00682c0 con 0x7fcbf00c7720 2023-11-28T20:38:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.776+0000 7fcbe5ffb640 1 -- 172.21.15.167:0/2375349602 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbec004b90 con 0x7fcbf00c7720 2023-11-28T20:38:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.776+0000 7fcbe5ffb640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbd4066470 0x7fcbd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:38:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.776+0000 7fcbe5ffb640 1 -- 172.21.15.167:0/2375349602 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbec083b10 con 0x7fcbf00c7720 2023-11-28T20:38:59.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.776+0000 7fcbf4caa640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbd4066470 0x7fcbd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:38:59.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.776+0000 7fcbf4caa640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbd4066470 0x7fcbd4068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00ae000 tx=0x7fcbe00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:38:59.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.780+0000 7fcbe5ffb640 1 -- 172.21.15.167:0/2375349602 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbec050cb0 con 0x7fcbf00c7720 2023-11-28T20:38:59.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbf0075c90 con 0x7fcbf00c7720 2023-11-28T20:38:59.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbe5ffb640 1 -- 172.21.15.167:0/2375349602 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbec0542d0 con 0x7fcbf00c7720 2023-11-28T20:38:59.935 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2023-11-28T20:38:59.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbd4066470 msgr2=0x7fcbd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbd4066470 0x7fcbd4068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00ae000 tx=0x7fcbe00b5040 comp rx=0 tx=0).stop 2023-11-28T20:38:59.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf00c7720 msgr2=0x7fcbf0159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:38:59.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf00c7720 0x7fcbf0159aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00c420 tx=0x7fcbec00c8e0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 shutdown_connections 2023-11-28T20:38:59.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbd4066470 0x7fcbd4068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbf015e130 0x7fcbf00ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf01585d0 0x7fcbf00c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 --2- 172.21.15.167:0/2375349602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf00c7720 0x7fcbf0159aa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:38:59.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 >> 172.21.15.167:0/2375349602 conn(0x7fcbf00cb1e0 msgr2=0x7fcbf015be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:38:59.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 shutdown_connections 2023-11-28T20:38:59.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:38:59.932+0000 7fcbf770f640 1 -- 172.21.15.167:0/2375349602 wait complete. 2023-11-28T20:38:59.956 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:39:00.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f544165a640 1 Processor -- start 2023-11-28T20:39:00.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f544165a640 1 -- start start 2023-11-28T20:39:00.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f544165a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f543c1582c0 0x7f543c0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f544165a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f543c0c8010 0x7f543c0c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f544165a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c06a8c0 con 0x7f543c0c2630 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f544165a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0c2f50 con 0x7f543c1582c0 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f544165a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0c84c0 con 0x7f543c0c8010 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f543affd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f543c0c2630 0x7f543c157bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50180/0 (socket says 172.21.15.167:50180) 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f543affd640 1 -- 172.21.15.167:0/2447740441 learned_addr learned my addr 172.21.15.167:0/2447740441 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.092+0000 7f54327fc640 1 --2- 172.21.15.167:0/2447740441 >> v2:172.21.15.167:3300/0 conn(0x7f543c1582c0 0x7f543c0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f543b7fe640 1 --2- 172.21.15.167:0/2447740441 >> v2:172.21.15.178:3300/0 conn(0x7f543c0c8010 0x7f543c0c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f543a7fc640 1 -- 172.21.15.167:0/2447740441 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314285245 0 0) 0x7f543c06a8c0 con 0x7f543c0c2630 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f543a7fc640 1 -- 172.21.15.167:0/2447740441 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5428003530 con 0x7f543c0c2630 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f54327fc640 1 -- 172.21.15.167:0/2447740441 >> v2:172.21.15.178:3300/0 conn(0x7f543c0c8010 msgr2=0x7f543c0c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f54327fc640 1 --2- 172.21.15.167:0/2447740441 >> v2:172.21.15.178:3300/0 conn(0x7f543c0c8010 0x7f543c0c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f54327fc640 1 -- 172.21.15.167:0/2447740441 >> v1:172.21.15.167:6789/0 conn(0x7f543c0c2630 legacy=0x7f543c157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f54327fc640 1 -- 172.21.15.167:0/2447740441 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c0c94d0 con 0x7f543c1582c0 2023-11-28T20:39:00.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f543b7fe640 1 --2- 172.21.15.167:0/2447740441 >> v2:172.21.15.178:3300/0 conn(0x7f543c0c8010 0x7f543c0c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:00.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f54327fc640 1 --2- 172.21.15.167:0/2447740441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 0x7f543c0c44d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f543c0c43f0 tx=0x7f542c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481204040d4485ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:00.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f543a7fc640 1 -- 172.21.15.167:0/2447740441 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c0ab660 con 0x7f543c1582c0 2023-11-28T20:39:00.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f543a7fc640 1 -- 172.21.15.167:0/2447740441 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c0ab7c0 con 0x7f543c1582c0 2023-11-28T20:39:00.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.096+0000 7f543a7fc640 1 -- 172.21.15.167:0/2447740441 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c0abb50 con 0x7f543c1582c0 2023-11-28T20:39:00.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 -- 172.21.15.167:0/2447740441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 msgr2=0x7f543c0c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 --2- 172.21.15.167:0/2447740441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 0x7f543c0c44d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f543c0c43f0 tx=0x7f542c01c460 comp rx=0 tx=0).stop 2023-11-28T20:39:00.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 -- 172.21.15.167:0/2447740441 shutdown_connections 2023-11-28T20:39:00.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 --2- 172.21.15.167:0/2447740441 >> v2:172.21.15.178:3300/0 conn(0x7f543c0c8010 0x7f543c0c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 --2- 172.21.15.167:0/2447740441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 0x7f543c0c44d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 -- 172.21.15.167:0/2447740441 >> 172.21.15.167:0/2447740441 conn(0x7f543c06ee00 msgr2=0x7f543c06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:00.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 -- 172.21.15.167:0/2447740441 shutdown_connections 2023-11-28T20:39:00.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 -- 172.21.15.167:0/2447740441 wait complete. 2023-11-28T20:39:00.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 Processor -- start 2023-11-28T20:39:00.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 -- start start 2023-11-28T20:39:00.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543c0c2630 0x7f543c1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543c0c8010 0x7f543c1f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 0x7f543c1f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c154120 con 0x7f543c1582c0 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c148840 con 0x7f543c0c8010 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f544165a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0c71e0 con 0x7f543c0c2630 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f543b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 0x7f543c1f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f543affd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543c0c2630 0x7f543c1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f543b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 0x7f543c1f21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45894/0 (socket says 172.21.15.167:45894) 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f543b7fe640 1 -- 172.21.15.167:0/262060108 learned_addr learned my addr 172.21.15.167:0/262060108 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f54327fc640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543c0c8010 0x7f543c1f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f543b7fe640 1 -- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543c0c2630 msgr2=0x7f543c1f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f543b7fe640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543c0c2630 0x7f543c1f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f543b7fe640 1 -- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543c0c8010 msgr2=0x7f543c1f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f543b7fe640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543c0c8010 0x7f543c1f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f543b7fe640 1 -- 172.21.15.167:0/262060108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c009420 con 0x7f543c1582c0 2023-11-28T20:39:00.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.100+0000 7f54327fc640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543c0c8010 0x7f543c1f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:00.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f543b7fe640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 0x7f543c1f21c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5434007e60 tx=0x7f543400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:00.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f5433fff640 1 -- 172.21.15.167:0/262060108 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434003ba0 con 0x7f543c1582c0 2023-11-28T20:39:00.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f5433fff640 1 -- 172.21.15.167:0/262060108 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543400f040 con 0x7f543c1582c0 2023-11-28T20:39:00.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c06cb00 con 0x7f543c1582c0 2023-11-28T20:39:00.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f5433fff640 1 -- 172.21.15.167:0/262060108 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400de80 con 0x7f543c1582c0 2023-11-28T20:39:00.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c06c1d0 con 0x7f543c1582c0 2023-11-28T20:39:00.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c06cc90 con 0x7f543c1582c0 2023-11-28T20:39:00.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f5433fff640 1 -- 172.21.15.167:0/262060108 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5434004030 con 0x7f543c1582c0 2023-11-28T20:39:00.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f5433fff640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f541c066470 0x7f541c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f5433fff640 1 -- 172.21.15.167:0/262060108 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5434084380 con 0x7f543c1582c0 2023-11-28T20:39:00.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.104+0000 7f543affd640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f541c066470 0x7f541c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.108+0000 7f543affd640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f541c066470 0x7f541c068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5424005890 tx=0x7f5424009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:00.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.108+0000 7f5433fff640 1 -- 172.21.15.167:0/262060108 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54340515b0 con 0x7f543c1582c0 2023-11-28T20:39:00.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f543c075c90 con 0x7f543c1582c0 2023-11-28T20:39:00.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f5433fff640 1 -- 172.21.15.167:0/262060108 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5434054bd0 con 0x7f543c1582c0 2023-11-28T20:39:00.262 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f541c066470 msgr2=0x7f541c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f541c066470 0x7f541c068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5424005890 tx=0x7f5424009040 comp rx=0 tx=0).stop 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 msgr2=0x7f543c1f21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 0x7f543c1f21c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5434007e60 tx=0x7f543400d4a0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 shutdown_connections 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f541c066470 0x7f541c068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c1582c0 0x7f543c1f21c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543c0c8010 0x7f543c1f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 --2- 172.21.15.167:0/262060108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543c0c2630 0x7f543c1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 >> 172.21.15.167:0/262060108 conn(0x7f543c06ee00 msgr2=0x7f543c06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:00.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 shutdown_connections 2023-11-28T20:39:00.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.260+0000 7f544165a640 1 -- 172.21.15.167:0/262060108 wait complete. 2023-11-28T20:39:00.283 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:39:00.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd78226b640 1 Processor -- start 2023-11-28T20:39:00.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd78226b640 1 -- start start 2023-11-28T20:39:00.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd78226b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 0x7fd77c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd78226b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd77c06a580 0x7fd77c06aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd78226b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c15ada0 con 0x7fd77c153fa0 2023-11-28T20:39:00.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd78226b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c15e0f0 con 0x7fd77c06a580 2023-11-28T20:39:00.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd78226b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c159f40 con 0x7fd77c15d770 2023-11-28T20:39:00.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd780808640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd77c06a580 0x7fd77c06aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd77bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd77c153fa0 0x7fd77c0c5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50184/0 (socket says 172.21.15.167:50184) 2023-11-28T20:39:00.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd77bfff640 1 -- 172.21.15.167:0/2287529218 learned_addr learned my addr 172.21.15.167:0/2287529218 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:00.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.428+0000 7fd77b7fe640 1 --2- 172.21.15.167:0/2287529218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 0x7fd77c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd780808640 1 -- 172.21.15.167:0/2287529218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 msgr2=0x7fd77c15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:00.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd780808640 1 --2- 172.21.15.167:0/2287529218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 0x7fd77c15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd780808640 1 -- 172.21.15.167:0/2287529218 >> v1:172.21.15.167:6789/0 conn(0x7fd77c153fa0 legacy=0x7fd77c0c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd780808640 1 -- 172.21.15.167:0/2287529218 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c15a220 con 0x7fd77c06a580 2023-11-28T20:39:00.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd780808640 1 --2- 172.21.15.167:0/2287529218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 0x7fd77c06aa10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd774009d90 tx=0x7fd77401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10c93b27d3ac214 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:00.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd77affd640 1 -- 172.21.15.167:0/2287529218 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740a5800 con 0x7fd77c06a580 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd77affd640 1 -- 172.21.15.167:0/2287529218 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7740a5960 con 0x7fd77c06a580 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd77affd640 1 -- 172.21.15.167:0/2287529218 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740a5cf0 con 0x7fd77c06a580 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd78226b640 1 -- 172.21.15.167:0/2287529218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 msgr2=0x7fd77c06aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd78226b640 1 --2- 172.21.15.167:0/2287529218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 0x7fd77c06aa10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd774009d90 tx=0x7fd77401c7e0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd78226b640 1 -- 172.21.15.167:0/2287529218 shutdown_connections 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd78226b640 1 --2- 172.21.15.167:0/2287529218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 0x7fd77c06aa10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd78226b640 1 --2- 172.21.15.167:0/2287529218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 0x7fd77c15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd78226b640 1 -- 172.21.15.167:0/2287529218 >> 172.21.15.167:0/2287529218 conn(0x7fd77c0cb1e0 msgr2=0x7fd77c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd78226b640 1 -- 172.21.15.167:0/2287529218 shutdown_connections 2023-11-28T20:39:00.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.432+0000 7fd78226b640 1 -- 172.21.15.167:0/2287529218 wait complete. 2023-11-28T20:39:00.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd78226b640 1 Processor -- start 2023-11-28T20:39:00.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd78226b640 1 -- start start 2023-11-28T20:39:00.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd78226b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 0x7fd77c1f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd78226b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd77c153fa0 0x7fd77c146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd78226b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 0x7fd77c1efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd78226b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c158df0 con 0x7fd77c06a580 2023-11-28T20:39:00.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd78226b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c1f0900 con 0x7fd77c153fa0 2023-11-28T20:39:00.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd78226b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c1ef490 con 0x7fd77c15d770 2023-11-28T20:39:00.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 0x7fd77c1f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 0x7fd77c1f3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45916/0 (socket says 172.21.15.167:45916) 2023-11-28T20:39:00.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77bfff640 1 -- 172.21.15.167:0/3238845900 learned_addr learned my addr 172.21.15.167:0/3238845900 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:00.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77b7fe640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd77c153fa0 0x7fd77c146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd780808640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 0x7fd77c1efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77bfff640 1 -- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 msgr2=0x7fd77c1efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77bfff640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 0x7fd77c1efbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77bfff640 1 -- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd77c153fa0 msgr2=0x7fd77c146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77bfff640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd77c153fa0 0x7fd77c146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77bfff640 1 -- 172.21.15.167:0/3238845900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774009a70 con 0x7fd77c06a580 2023-11-28T20:39:00.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd77bfff640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 0x7fd77c1f3410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00fae0 tx=0x7fd76c00d060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:00.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.436+0000 7fd778ff9640 1 -- 172.21.15.167:0/3238845900 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c007d00 con 0x7fd77c06a580 2023-11-28T20:39:00.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.440+0000 7fd778ff9640 1 -- 172.21.15.167:0/3238845900 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c007e60 con 0x7fd77c06a580 2023-11-28T20:39:00.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.440+0000 7fd778ff9640 1 -- 172.21.15.167:0/3238845900 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00d9f0 con 0x7fd77c06a580 2023-11-28T20:39:00.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.440+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77c1f3950 con 0x7fd77c06a580 2023-11-28T20:39:00.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.440+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c159200 con 0x7fd77c06a580 2023-11-28T20:39:00.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.440+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c0682a0 con 0x7fd77c06a580 2023-11-28T20:39:00.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.440+0000 7fd778ff9640 1 -- 172.21.15.167:0/3238845900 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd76c00db50 con 0x7fd77c06a580 2023-11-28T20:39:00.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.440+0000 7fd778ff9640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd768066470 0x7fd768068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.440+0000 7fd778ff9640 1 -- 172.21.15.167:0/3238845900 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd76c086700 con 0x7fd77c06a580 2023-11-28T20:39:00.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.440+0000 7fd77b7fe640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd768066470 0x7fd768068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.444+0000 7fd77b7fe640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd768066470 0x7fd768068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd77c147420 tx=0x7fd770008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:00.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.444+0000 7fd778ff9640 1 -- 172.21.15.167:0/3238845900 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd76c0537e0 con 0x7fd77c06a580 2023-11-28T20:39:00.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.596+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd77c15ada0 con 0x7fd77c06a580 2023-11-28T20:39:00.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.596+0000 7fd778ff9640 1 -- 172.21.15.167:0/3238845900 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd77c15ada0 con 0x7fd77c06a580 2023-11-28T20:39:00.601 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2023-11-28T20:39:00.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd768066470 msgr2=0x7fd768068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd768066470 0x7fd768068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd77c147420 tx=0x7fd770008040 comp rx=0 tx=0).stop 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 msgr2=0x7fd77c1f3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 0x7fd77c1f3410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00fae0 tx=0x7fd76c00d060 comp rx=0 tx=0).stop 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 shutdown_connections 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd768066470 0x7fd768068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd77c15d770 0x7fd77c1efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd77c153fa0 0x7fd77c146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 --2- 172.21.15.167:0/3238845900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77c06a580 0x7fd77c1f3410 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 >> 172.21.15.167:0/3238845900 conn(0x7fd77c0cb1e0 msgr2=0x7fd77c071450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 shutdown_connections 2023-11-28T20:39:00.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.600+0000 7fd78226b640 1 -- 172.21.15.167:0/3238845900 wait complete. 2023-11-28T20:39:00.623 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T20:39:00.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f833ba5a640 1 Processor -- start 2023-11-28T20:39:00.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f833ba5a640 1 -- start start 2023-11-28T20:39:00.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f833ba5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f83341585d0 0x7f83340c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f833ba5a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f833415e130 0x7f8334161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f833ba5a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833415e5e0 con 0x7f83340c7720 2023-11-28T20:39:00.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f833ba5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833415f160 con 0x7f83341585d0 2023-11-28T20:39:00.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f833ba5a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833415e8c0 con 0x7f833415e130 2023-11-28T20:39:00.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f83397f6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f83341585d0 0x7f83340c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f83397f6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f83341585d0 0x7f83340c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45932/0 (socket says 172.21.15.167:45932) 2023-11-28T20:39:00.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f83397f6640 1 -- 172.21.15.167:0/692210877 learned_addr learned my addr 172.21.15.167:0/692210877 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:00.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f8338ff5640 1 --2- 172.21.15.167:0/692210877 >> v2:172.21.15.178:3300/0 conn(0x7f833415e130 0x7f8334161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f83397f6640 1 -- 172.21.15.167:0/692210877 >> v2:172.21.15.178:3300/0 conn(0x7f833415e130 msgr2=0x7f8334161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:00.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f83397f6640 1 --2- 172.21.15.167:0/692210877 >> v2:172.21.15.178:3300/0 conn(0x7f833415e130 0x7f8334161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f83397f6640 1 -- 172.21.15.167:0/692210877 >> v1:172.21.15.178:6789/0 conn(0x7f83340c7720 legacy=0x7f833406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:00.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.760+0000 7f83397f6640 1 -- 172.21.15.167:0/692210877 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833415eba0 con 0x7f83341585d0 2023-11-28T20:39:00.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f83397f6640 1 --2- 172.21.15.167:0/692210877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83341585d0 0x7f83340c5e90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f833406eea0 tx=0x7f833001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b4069b9b6ddf86 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:00.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f832bfff640 1 -- 172.21.15.167:0/692210877 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300ac600 con 0x7f83341585d0 2023-11-28T20:39:00.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f832bfff640 1 -- 172.21.15.167:0/692210877 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83300a8050 con 0x7f83341585d0 2023-11-28T20:39:00.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f832bfff640 1 -- 172.21.15.167:0/692210877 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300ac980 con 0x7f83341585d0 2023-11-28T20:39:00.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f833ba5a640 1 -- 172.21.15.167:0/692210877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83341585d0 msgr2=0x7f83340c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f833ba5a640 1 --2- 172.21.15.167:0/692210877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83341585d0 0x7f83340c5e90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f833406eea0 tx=0x7f833001c490 comp rx=0 tx=0).stop 2023-11-28T20:39:00.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f833ba5a640 1 -- 172.21.15.167:0/692210877 shutdown_connections 2023-11-28T20:39:00.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f833ba5a640 1 --2- 172.21.15.167:0/692210877 >> v2:172.21.15.178:3300/0 conn(0x7f833415e130 0x7f8334161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f833ba5a640 1 --2- 172.21.15.167:0/692210877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83341585d0 0x7f83340c5e90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f833ba5a640 1 -- 172.21.15.167:0/692210877 >> 172.21.15.167:0/692210877 conn(0x7f83340cb1e0 msgr2=0x7f83340cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:00.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f833ba5a640 1 -- 172.21.15.167:0/692210877 shutdown_connections 2023-11-28T20:39:00.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.764+0000 7f833ba5a640 1 -- 172.21.15.167:0/692210877 wait complete. 2023-11-28T20:39:00.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 Processor -- start 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 -- start start 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83340c7720 0x7f83340c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83341585d0 0x7f83341f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833415e130 0x7f833414d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83340cabc0 con 0x7f833415e130 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83340ca900 con 0x7f83341585d0 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83341f6af0 con 0x7f83340c7720 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8339ff7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833415e130 0x7f833414d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8339ff7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833415e130 0x7f833414d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45938/0 (socket says 172.21.15.167:45938) 2023-11-28T20:39:00.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8339ff7640 1 -- 172.21.15.167:0/3168989125 learned_addr learned my addr 172.21.15.167:0/3168989125 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:00.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8338ff5640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83341585d0 0x7f83341f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f83397f6640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83340c7720 0x7f83340c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8339ff7640 1 -- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83340c7720 msgr2=0x7f83340c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8339ff7640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83340c7720 0x7f83340c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8339ff7640 1 -- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83341585d0 msgr2=0x7f83341f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8339ff7640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83341585d0 0x7f83341f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8339ff7640 1 -- 172.21.15.167:0/3168989125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83300094d0 con 0x7f833415e130 2023-11-28T20:39:00.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8339ff7640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833415e130 0x7f833414d5e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f832c00b970 tx=0x7f832c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:00.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8329ffb640 1 -- 172.21.15.167:0/3168989125 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c00cb40 con 0x7f833415e130 2023-11-28T20:39:00.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8329ffb640 1 -- 172.21.15.167:0/3168989125 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c00cca0 con 0x7f833415e130 2023-11-28T20:39:00.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f8329ffb640 1 -- 172.21.15.167:0/3168989125 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c014680 con 0x7f833415e130 2023-11-28T20:39:00.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833414fe20 con 0x7f833415e130 2023-11-28T20:39:00.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.768+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83341f7090 con 0x7f833415e130 2023-11-28T20:39:00.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.772+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83340682c0 con 0x7f833415e130 2023-11-28T20:39:00.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.772+0000 7f8329ffb640 1 -- 172.21.15.167:0/3168989125 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f832c01d3b0 con 0x7f833415e130 2023-11-28T20:39:00.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.772+0000 7f8329ffb640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8318066470 0x7f8318068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:00.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.772+0000 7f8329ffb640 1 -- 172.21.15.167:0/3168989125 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f832c084130 con 0x7f833415e130 2023-11-28T20:39:00.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.772+0000 7f83397f6640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8318066470 0x7f8318068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:00.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.772+0000 7f83397f6640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8318066470 0x7f8318068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83300ae000 tx=0x7f83300a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:00.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.776+0000 7f8329ffb640 1 -- 172.21.15.167:0/3168989125 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f832c051150 con 0x7f833415e130 2023-11-28T20:39:00.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.924+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8334150010 con 0x7f833415e130 2023-11-28T20:39:00.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.924+0000 7f8329ffb640 1 -- 172.21.15.167:0/3168989125 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f832c054770 con 0x7f833415e130 2023-11-28T20:39:00.930 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:39:00.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8318066470 msgr2=0x7f8318068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8318066470 0x7f8318068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83300ae000 tx=0x7f83300a7000 comp rx=0 tx=0).stop 2023-11-28T20:39:00.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833415e130 msgr2=0x7f833414d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:00.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833415e130 0x7f833414d5e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f832c00b970 tx=0x7f832c00be30 comp rx=0 tx=0).stop 2023-11-28T20:39:00.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 shutdown_connections 2023-11-28T20:39:00.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8318066470 0x7f8318068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f833415e130 0x7f833414d5e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83341585d0 0x7f83341f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 --2- 172.21.15.167:0/3168989125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83340c7720 0x7f83340c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:00.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 >> 172.21.15.167:0/3168989125 conn(0x7f83340cb1e0 msgr2=0x7f83340c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:00.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 shutdown_connections 2023-11-28T20:39:00.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:00.928+0000 7f833ba5a640 1 -- 172.21.15.167:0/3168989125 wait complete. 2023-11-28T20:39:00.950 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2023-11-28T20:39:00.950 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:39:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde41abb640 1 Processor -- start 2023-11-28T20:39:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde41abb640 1 -- start start 2023-11-28T20:39:01.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde41abb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fde3c150b40 0x7fde3c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde41abb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c0c6ff0 0x7fde3c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde41abb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c0c6ac0 con 0x7fde3c0c5be0 2023-11-28T20:39:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde41abb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3c0c6500 con 0x7fde3c150b40 2023-11-28T20:39:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde41abb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0c67e0 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde3b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fde3c150b40 0x7fde3c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde3bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fde3c0c5be0 0x7fde3c06a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50194/0 (socket says 172.21.15.167:50194) 2023-11-28T20:39:01.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde3bfff640 1 -- 172.21.15.167:0/239915921 learned_addr learned my addr 172.21.15.167:0/239915921 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:01.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde3affd640 1 --2- 172.21.15.167:0/239915921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c0c6ff0 0x7fde3c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde3b7fe640 1 -- 172.21.15.167:0/239915921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c0c6ff0 msgr2=0x7fde3c0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:01.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.084+0000 7fde3b7fe640 1 --2- 172.21.15.167:0/239915921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c0c6ff0 0x7fde3c0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde3b7fe640 1 -- 172.21.15.167:0/239915921 >> v1:172.21.15.167:6789/0 conn(0x7fde3c0c5be0 legacy=0x7fde3c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde3a7fc640 1 -- 172.21.15.167:0/239915921 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914866505 0 0) 0x7fde3c0c6ac0 con 0x7fde3c0c5be0 2023-11-28T20:39:01.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde3b7fe640 1 -- 172.21.15.167:0/239915921 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c156a80 con 0x7fde3c150b40 2023-11-28T20:39:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde3b7fe640 1 --2- 172.21.15.167:0/239915921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c150b40 0x7fde3c157560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0097c0 tx=0x7fde2c01e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27935c9558f9adf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde3a7fc640 1 -- 172.21.15.167:0/239915921 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0ab630 con 0x7fde3c150b40 2023-11-28T20:39:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde3a7fc640 1 -- 172.21.15.167:0/239915921 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c0ab790 con 0x7fde3c150b40 2023-11-28T20:39:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde3a7fc640 1 -- 172.21.15.167:0/239915921 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0abb20 con 0x7fde3c150b40 2023-11-28T20:39:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde41abb640 1 -- 172.21.15.167:0/239915921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c150b40 msgr2=0x7fde3c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde41abb640 1 --2- 172.21.15.167:0/239915921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c150b40 0x7fde3c157560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0097c0 tx=0x7fde2c01e660 comp rx=0 tx=0).stop 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde41abb640 1 -- 172.21.15.167:0/239915921 shutdown_connections 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde41abb640 1 --2- 172.21.15.167:0/239915921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c0c6ff0 0x7fde3c0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde41abb640 1 --2- 172.21.15.167:0/239915921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c150b40 0x7fde3c157560 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde41abb640 1 -- 172.21.15.167:0/239915921 >> 172.21.15.167:0/239915921 conn(0x7fde3c0cb1e0 msgr2=0x7fde3c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde41abb640 1 -- 172.21.15.167:0/239915921 shutdown_connections 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.088+0000 7fde41abb640 1 -- 172.21.15.167:0/239915921 wait complete. 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde41abb640 1 Processor -- start 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde41abb640 1 -- start start 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde41abb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde3c0c5be0 0x7fde3c1f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde41abb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c0c6ff0 0x7fde3c14bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde41abb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c150b40 0x7fde3c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde41abb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0ca960 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde41abb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0c9b80 con 0x7fde3c0c5be0 2023-11-28T20:39:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde41abb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0c9e60 con 0x7fde3c150b40 2023-11-28T20:39:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c0c6ff0 0x7fde3c14bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c0c6ff0 0x7fde3c14bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45950/0 (socket says 172.21.15.167:45950) 2023-11-28T20:39:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3affd640 1 -- 172.21.15.167:0/2643273020 learned_addr learned my addr 172.21.15.167:0/2643273020 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3bfff640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c150b40 0x7fde3c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3b7fe640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde3c0c5be0 0x7fde3c1f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3affd640 1 -- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c150b40 msgr2=0x7fde3c0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3affd640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c150b40 0x7fde3c0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3affd640 1 -- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde3c0c5be0 msgr2=0x7fde3c1f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3affd640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde3c0c5be0 0x7fde3c1f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3affd640 1 -- 172.21.15.167:0/2643273020 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c009420 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.092+0000 7fde3affd640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c0c6ff0 0x7fde3c14bcd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde3000d800 tx=0x7fde3000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde23fff640 1 -- 172.21.15.167:0/2643273020 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3000b6c0 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde23fff640 1 -- 172.21.15.167:0/2643273020 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3000b820 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde23fff640 1 -- 172.21.15.167:0/2643273020 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3000bb90 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c0ca140 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c145b40 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c0682c0 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde23fff640 1 -- 172.21.15.167:0/2643273020 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fde3000bcf0 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde23fff640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde28066470 0x7fde28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde23fff640 1 -- 172.21.15.167:0/2643273020 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fde30084740 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.096+0000 7fde3b7fe640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde28066470 0x7fde28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.100+0000 7fde3b7fe640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde28066470 0x7fde28068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0b0000 tx=0x7fde2c0a9000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:01.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.100+0000 7fde23fff640 1 -- 172.21.15.167:0/2643273020 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fde30051780 con 0x7fde3c0c6ff0 2023-11-28T20:39:01.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.248+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde3c06ac90 con 0x7fde28066470 2023-11-28T20:39:01.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde23fff640 1 -- 172.21.15.167:0/2643273020 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345500 (secure 0 0 0) 0x7fde2c0ab610 con 0x7fde28066470 2023-11-28T20:39:01.280 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:01.282 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:39:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde28066470 msgr2=0x7fde28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde28066470 0x7fde28068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0b0000 tx=0x7fde2c0a9000 comp rx=0 tx=0).stop 2023-11-28T20:39:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c0c6ff0 msgr2=0x7fde3c14bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c0c6ff0 0x7fde3c14bcd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde3000d800 tx=0x7fde3000dcc0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 shutdown_connections 2023-11-28T20:39:01.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fde28066470 0x7fde28068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3c150b40 0x7fde3c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde3c0c6ff0 0x7fde3c14bcd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 --2- 172.21.15.167:0/2643273020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde3c0c5be0 0x7fde3c1f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 >> 172.21.15.167:0/2643273020 conn(0x7fde3c0cb1e0 msgr2=0x7fde3c0c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:01.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 shutdown_connections 2023-11-28T20:39:01.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.276+0000 7fde41abb640 1 -- 172.21.15.167:0/2643273020 wait complete. 2023-11-28T20:39:01.300 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2023-11-28T20:39:00.365398+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597819,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":286,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236104,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738616,"statfs":{"total":773094113280,"available":772852342784,"internally_reserved":0,"allocated":3416064,"data_stored":2011838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1496,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.925559"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.609081+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:51.609081+0000","last_peered":"2023-11-28T20:38:51.609081+0000","last_clean":"2023-11-28T20:38:51.609081+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:51.609081+0000","last_undegraded":"2023-11-28T20:38:51.609081+0000","last_fullsized":"2023-11-28T20:38:51.609081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555618+0000","last_change":"2023-11-28T20:38:19.384120+0000","last_active":"2023-11-28T20:38:23.555618+0000","last_peered":"2023-11-28T20:38:23.555618+0000","last_clean":"2023-11-28T20:38:23.555618+0000","last_became_active":"2023-11-28T20:38:19.383899+0000","last_became_peered":"2023-11-28T20:38:19.383899+0000","last_unstale":"2023-11-28T20:38:23.555618+0000","last_undegraded":"2023-11-28T20:38:23.555618+0000","last_fullsized":"2023-11-28T20:38:23.555618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:02:32.168294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523700+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:38:24.523700+0000","last_peered":"2023-11-28T20:38:24.523700+0000","last_clean":"2023-11-28T20:38:24.523700+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:38:24.523700+0000","last_undegraded":"2023-11-28T20:38:24.523700+0000","last_fullsized":"2023-11-28T20:38:24.523700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530236+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:38:24.530236+0000","last_peered":"2023-11-28T20:38:24.530236+0000","last_clean":"2023-11-28T20:38:24.530236+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:38:24.530236+0000","last_undegraded":"2023-11-28T20:38:24.530236+0000","last_fullsized":"2023-11-28T20:38:24.530236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562919+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:23.562919+0000","last_peered":"2023-11-28T20:38:23.562919+0000","last_clean":"2023-11-28T20:38:23.562919+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:23.562919+0000","last_undegraded":"2023-11-28T20:38:23.562919+0000","last_fullsized":"2023-11-28T20:38:23.562919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527387+0000","last_change":"2023-11-28T20:38:23.600077+0000","last_active":"2023-11-28T20:38:24.527387+0000","last_peered":"2023-11-28T20:38:24.527387+0000","last_clean":"2023-11-28T20:38:24.527387+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:24.527387+0000","last_undegraded":"2023-11-28T20:38:24.527387+0000","last_fullsized":"2023-11-28T20:38:24.527387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:52:39.002909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606241+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:51.606241+0000","last_peered":"2023-11-28T20:38:51.606241+0000","last_clean":"2023-11-28T20:38:51.606241+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:51.606241+0000","last_undegraded":"2023-11-28T20:38:51.606241+0000","last_fullsized":"2023-11-28T20:38:51.606241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560982+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:23.560982+0000","last_peered":"2023-11-28T20:38:23.560982+0000","last_clean":"2023-11-28T20:38:23.560982+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:23.560982+0000","last_undegraded":"2023-11-28T20:38:23.560982+0000","last_fullsized":"2023-11-28T20:38:23.560982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529343+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:24.529343+0000","last_peered":"2023-11-28T20:38:24.529343+0000","last_clean":"2023-11-28T20:38:24.529343+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:24.529343+0000","last_undegraded":"2023-11-28T20:38:24.529343+0000","last_fullsized":"2023-11-28T20:38:24.529343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532210+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532210+0000","last_peered":"2023-11-28T20:38:24.532210+0000","last_clean":"2023-11-28T20:38:24.532210+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532210+0000","last_undegraded":"2023-11-28T20:38:24.532210+0000","last_fullsized":"2023-11-28T20:38:24.532210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562448+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:23.562448+0000","last_peered":"2023-11-28T20:38:23.562448+0000","last_clean":"2023-11-28T20:38:23.562448+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:23.562448+0000","last_undegraded":"2023-11-28T20:38:23.562448+0000","last_fullsized":"2023-11-28T20:38:23.562448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528969+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:24.528969+0000","last_peered":"2023-11-28T20:38:24.528969+0000","last_clean":"2023-11-28T20:38:24.528969+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:24.528969+0000","last_undegraded":"2023-11-28T20:38:24.528969+0000","last_fullsized":"2023-11-28T20:38:24.528969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563714+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:23.563714+0000","last_peered":"2023-11-28T20:38:23.563714+0000","last_clean":"2023-11-28T20:38:23.563714+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:23.563714+0000","last_undegraded":"2023-11-28T20:38:23.563714+0000","last_fullsized":"2023-11-28T20:38:23.563714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574248+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:45.574248+0000","last_peered":"2023-11-28T20:38:45.574248+0000","last_clean":"2023-11-28T20:38:45.574248+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:45.574248+0000","last_undegraded":"2023-11-28T20:38:45.574248+0000","last_fullsized":"2023-11-28T20:38:45.574248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530149+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:24.530149+0000","last_peered":"2023-11-28T20:38:24.530149+0000","last_clean":"2023-11-28T20:38:24.530149+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:24.530149+0000","last_undegraded":"2023-11-28T20:38:24.530149+0000","last_fullsized":"2023-11-28T20:38:24.530149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556220+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:38:23.556220+0000","last_peered":"2023-11-28T20:38:23.556220+0000","last_clean":"2023-11-28T20:38:23.556220+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:38:23.556220+0000","last_undegraded":"2023-11-28T20:38:23.556220+0000","last_fullsized":"2023-11-28T20:38:23.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535282+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:38:24.535282+0000","last_peered":"2023-11-28T20:38:24.535282+0000","last_clean":"2023-11-28T20:38:24.535282+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:38:24.535282+0000","last_undegraded":"2023-11-28T20:38:24.535282+0000","last_fullsized":"2023-11-28T20:38:24.535282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529638+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:24.529638+0000","last_peered":"2023-11-28T20:38:24.529638+0000","last_clean":"2023-11-28T20:38:24.529638+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:24.529638+0000","last_undegraded":"2023-11-28T20:38:24.529638+0000","last_fullsized":"2023-11-28T20:38:24.529638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556959+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:38:23.556959+0000","last_peered":"2023-11-28T20:38:23.556959+0000","last_clean":"2023-11-28T20:38:23.556959+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:38:23.556959+0000","last_undegraded":"2023-11-28T20:38:23.556959+0000","last_fullsized":"2023-11-28T20:38:23.556959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.554096+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:38:45.554096+0000","last_peered":"2023-11-28T20:38:45.554096+0000","last_clean":"2023-11-28T20:38:45.554096+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:38:45.554096+0000","last_undegraded":"2023-11-28T20:38:45.554096+0000","last_fullsized":"2023-11-28T20:38:45.554096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535771+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.535771+0000","last_peered":"2023-11-28T20:38:24.535771+0000","last_clean":"2023-11-28T20:38:24.535771+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:38:24.535771+0000","last_undegraded":"2023-11-28T20:38:24.535771+0000","last_fullsized":"2023-11-28T20:38:24.535771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.585068+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:23.585068+0000","last_peered":"2023-11-28T20:38:23.585068+0000","last_clean":"2023-11-28T20:38:23.585068+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:23.585068+0000","last_undegraded":"2023-11-28T20:38:23.585068+0000","last_fullsized":"2023-11-28T20:38:23.585068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574872+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:45.574872+0000","last_peered":"2023-11-28T20:38:45.574872+0000","last_clean":"2023-11-28T20:38:45.574872+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:45.574872+0000","last_undegraded":"2023-11-28T20:38:45.574872+0000","last_fullsized":"2023-11-28T20:38:45.574872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530157+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:24.530157+0000","last_peered":"2023-11-28T20:38:24.530157+0000","last_clean":"2023-11-28T20:38:24.530157+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:24.530157+0000","last_undegraded":"2023-11-28T20:38:24.530157+0000","last_fullsized":"2023-11-28T20:38:24.530157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561892+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:23.561892+0000","last_peered":"2023-11-28T20:38:23.561892+0000","last_clean":"2023-11-28T20:38:23.561892+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:23.561892+0000","last_undegraded":"2023-11-28T20:38:23.561892+0000","last_fullsized":"2023-11-28T20:38:23.561892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.570305+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:45.570305+0000","last_peered":"2023-11-28T20:38:45.570305+0000","last_clean":"2023-11-28T20:38:45.570305+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:45.570305+0000","last_undegraded":"2023-11-28T20:38:45.570305+0000","last_fullsized":"2023-11-28T20:38:45.570305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528204+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:24.528204+0000","last_peered":"2023-11-28T20:38:24.528204+0000","last_clean":"2023-11-28T20:38:24.528204+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:24.528204+0000","last_undegraded":"2023-11-28T20:38:24.528204+0000","last_fullsized":"2023-11-28T20:38:24.528204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556394+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:38:23.556394+0000","last_peered":"2023-11-28T20:38:23.556394+0000","last_clean":"2023-11-28T20:38:23.556394+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:38:23.556394+0000","last_undegraded":"2023-11-28T20:38:23.556394+0000","last_fullsized":"2023-11-28T20:38:23.556394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607464+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:38:51.607464+0000","last_peered":"2023-11-28T20:38:51.607464+0000","last_clean":"2023-11-28T20:38:51.607464+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:38:51.607464+0000","last_undegraded":"2023-11-28T20:38:51.607464+0000","last_fullsized":"2023-11-28T20:38:51.607464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523623+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:38:24.523623+0000","last_peered":"2023-11-28T20:38:24.523623+0000","last_clean":"2023-11-28T20:38:24.523623+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:38:24.523623+0000","last_undegraded":"2023-11-28T20:38:24.523623+0000","last_fullsized":"2023-11-28T20:38:24.523623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572645+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:38:23.572645+0000","last_peered":"2023-11-28T20:38:23.572645+0000","last_clean":"2023-11-28T20:38:23.572645+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:38:23.572645+0000","last_undegraded":"2023-11-28T20:38:23.572645+0000","last_fullsized":"2023-11-28T20:38:23.572645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528499+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:24.528499+0000","last_peered":"2023-11-28T20:38:24.528499+0000","last_clean":"2023-11-28T20:38:24.528499+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:24.528499+0000","last_undegraded":"2023-11-28T20:38:24.528499+0000","last_fullsized":"2023-11-28T20:38:24.528499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344337+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:24.344337+0000","last_peered":"2023-11-28T20:38:24.344337+0000","last_clean":"2023-11-28T20:38:24.344337+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:24.344337+0000","last_undegraded":"2023-11-28T20:38:24.344337+0000","last_fullsized":"2023-11-28T20:38:24.344337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562716+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:23.562716+0000","last_peered":"2023-11-28T20:38:23.562716+0000","last_clean":"2023-11-28T20:38:23.562716+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:23.562716+0000","last_undegraded":"2023-11-28T20:38:23.562716+0000","last_fullsized":"2023-11-28T20:38:23.562716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.572746+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:38:23.572746+0000","last_peered":"2023-11-28T20:38:23.572746+0000","last_clean":"2023-11-28T20:38:23.572746+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:38:23.572746+0000","last_undegraded":"2023-11-28T20:38:23.572746+0000","last_fullsized":"2023-11-28T20:38:23.572746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535102+0000","last_change":"2023-11-28T20:38:23.594782+0000","last_active":"2023-11-28T20:38:24.535102+0000","last_peered":"2023-11-28T20:38:24.535102+0000","last_clean":"2023-11-28T20:38:24.535102+0000","last_became_active":"2023-11-28T20:38:23.594034+0000","last_became_peered":"2023-11-28T20:38:23.594034+0000","last_unstale":"2023-11-28T20:38:24.535102+0000","last_undegraded":"2023-11-28T20:38:24.535102+0000","last_fullsized":"2023-11-28T20:38:24.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:29:14.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.581982+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:23.581982+0000","last_peered":"2023-11-28T20:38:23.581982+0000","last_clean":"2023-11-28T20:38:23.581982+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:23.581982+0000","last_undegraded":"2023-11-28T20:38:23.581982+0000","last_fullsized":"2023-11-28T20:38:23.581982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349413+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:24.349413+0000","last_peered":"2023-11-28T20:38:24.349413+0000","last_clean":"2023-11-28T20:38:24.349413+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:24.349413+0000","last_undegraded":"2023-11-28T20:38:24.349413+0000","last_fullsized":"2023-11-28T20:38:24.349413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535460+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:38:24.535460+0000","last_peered":"2023-11-28T20:38:24.535460+0000","last_clean":"2023-11-28T20:38:24.535460+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:38:24.535460+0000","last_undegraded":"2023-11-28T20:38:24.535460+0000","last_fullsized":"2023-11-28T20:38:24.535460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571588+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:38:23.571588+0000","last_peered":"2023-11-28T20:38:23.571588+0000","last_clean":"2023-11-28T20:38:23.571588+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:38:23.571588+0000","last_undegraded":"2023-11-28T20:38:23.571588+0000","last_fullsized":"2023-11-28T20:38:23.571588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607572+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:38:51.607572+0000","last_peered":"2023-11-28T20:38:51.607572+0000","last_clean":"2023-11-28T20:38:51.607572+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:38:51.607572+0000","last_undegraded":"2023-11-28T20:38:51.607572+0000","last_fullsized":"2023-11-28T20:38:51.607572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535820+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:38:24.535820+0000","last_peered":"2023-11-28T20:38:24.535820+0000","last_clean":"2023-11-28T20:38:24.535820+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:38:24.535820+0000","last_undegraded":"2023-11-28T20:38:24.535820+0000","last_fullsized":"2023-11-28T20:38:24.535820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560814+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:23.560814+0000","last_peered":"2023-11-28T20:38:23.560814+0000","last_clean":"2023-11-28T20:38:23.560814+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:23.560814+0000","last_undegraded":"2023-11-28T20:38:23.560814+0000","last_fullsized":"2023-11-28T20:38:23.560814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607282+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:51.607282+0000","last_peered":"2023-11-28T20:38:51.607282+0000","last_clean":"2023-11-28T20:38:51.607282+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:51.607282+0000","last_undegraded":"2023-11-28T20:38:51.607282+0000","last_fullsized":"2023-11-28T20:38:51.607282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344627+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:24.344627+0000","last_peered":"2023-11-28T20:38:24.344627+0000","last_clean":"2023-11-28T20:38:24.344627+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:24.344627+0000","last_undegraded":"2023-11-28T20:38:24.344627+0000","last_fullsized":"2023-11-28T20:38:24.344627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555061+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:38:23.555061+0000","last_peered":"2023-11-28T20:38:23.555061+0000","last_clean":"2023-11-28T20:38:23.555061+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:38:23.555061+0000","last_undegraded":"2023-11-28T20:38:23.555061+0000","last_fullsized":"2023-11-28T20:38:23.555061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.585571+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:45.585571+0000","last_peered":"2023-11-28T20:38:45.585571+0000","last_clean":"2023-11-28T20:38:45.585571+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:45.585571+0000","last_undegraded":"2023-11-28T20:38:45.585571+0000","last_fullsized":"2023-11-28T20:38:45.585571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770661+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:23.770661+0000","last_peered":"2023-11-28T20:38:23.770661+0000","last_clean":"2023-11-28T20:38:23.770661+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:23.770661+0000","last_undegraded":"2023-11-28T20:38:23.770661+0000","last_fullsized":"2023-11-28T20:38:23.770661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351420+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:24.351420+0000","last_peered":"2023-11-28T20:38:24.351420+0000","last_clean":"2023-11-28T20:38:24.351420+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:24.351420+0000","last_undegraded":"2023-11-28T20:38:24.351420+0000","last_fullsized":"2023-11-28T20:38:24.351420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771541+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:23.771541+0000","last_peered":"2023-11-28T20:38:23.771541+0000","last_clean":"2023-11-28T20:38:23.771541+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:23.771541+0000","last_undegraded":"2023-11-28T20:38:23.771541+0000","last_fullsized":"2023-11-28T20:38:23.771541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607747+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:38:51.607747+0000","last_peered":"2023-11-28T20:38:51.607747+0000","last_clean":"2023-11-28T20:38:51.607747+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:38:51.607747+0000","last_undegraded":"2023-11-28T20:38:51.607747+0000","last_fullsized":"2023-11-28T20:38:51.607747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350832+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:24.350832+0000","last_peered":"2023-11-28T20:38:24.350832+0000","last_clean":"2023-11-28T20:38:24.350832+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:24.350832+0000","last_undegraded":"2023-11-28T20:38:24.350832+0000","last_fullsized":"2023-11-28T20:38:24.350832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561174+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:23.561174+0000","last_peered":"2023-11-28T20:38:23.561174+0000","last_clean":"2023-11-28T20:38:23.561174+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:23.561174+0000","last_undegraded":"2023-11-28T20:38:23.561174+0000","last_fullsized":"2023-11-28T20:38:23.561174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.533486+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:38:24.533486+0000","last_peered":"2023-11-28T20:38:24.533486+0000","last_clean":"2023-11-28T20:38:24.533486+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:38:24.533486+0000","last_undegraded":"2023-11-28T20:38:24.533486+0000","last_fullsized":"2023-11-28T20:38:24.533486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344212+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:24.344212+0000","last_peered":"2023-11-28T20:38:24.344212+0000","last_clean":"2023-11-28T20:38:24.344212+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:24.344212+0000","last_undegraded":"2023-11-28T20:38:24.344212+0000","last_fullsized":"2023-11-28T20:38:24.344212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771932+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:23.771932+0000","last_peered":"2023-11-28T20:38:23.771932+0000","last_clean":"2023-11-28T20:38:23.771932+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:23.771932+0000","last_undegraded":"2023-11-28T20:38:23.771932+0000","last_fullsized":"2023-11-28T20:38:23.771932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532302+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:38:24.532302+0000","last_peered":"2023-11-28T20:38:24.532302+0000","last_clean":"2023-11-28T20:38:24.532302+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:38:24.532302+0000","last_undegraded":"2023-11-28T20:38:24.532302+0000","last_fullsized":"2023-11-28T20:38:24.532302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348053+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:24.348053+0000","last_peered":"2023-11-28T20:38:24.348053+0000","last_clean":"2023-11-28T20:38:24.348053+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:24.348053+0000","last_undegraded":"2023-11-28T20:38:24.348053+0000","last_fullsized":"2023-11-28T20:38:24.348053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771535+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:23.771535+0000","last_peered":"2023-11-28T20:38:23.771535+0000","last_clean":"2023-11-28T20:38:23.771535+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:23.771535+0000","last_undegraded":"2023-11-28T20:38:23.771535+0000","last_fullsized":"2023-11-28T20:38:23.771535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530364+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:24.530364+0000","last_peered":"2023-11-28T20:38:24.530364+0000","last_clean":"2023-11-28T20:38:24.530364+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:24.530364+0000","last_undegraded":"2023-11-28T20:38:24.530364+0000","last_fullsized":"2023-11-28T20:38:24.530364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527514+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:24.527514+0000","last_peered":"2023-11-28T20:38:24.527514+0000","last_clean":"2023-11-28T20:38:24.527514+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:24.527514+0000","last_undegraded":"2023-11-28T20:38:24.527514+0000","last_fullsized":"2023-11-28T20:38:24.527514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770655+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:23.770655+0000","last_peered":"2023-11-28T20:38:23.770655+0000","last_clean":"2023-11-28T20:38:23.770655+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:23.770655+0000","last_undegraded":"2023-11-28T20:38:23.770655+0000","last_fullsized":"2023-11-28T20:38:23.770655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607963+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:38:51.607963+0000","last_peered":"2023-11-28T20:38:51.607963+0000","last_clean":"2023-11-28T20:38:51.607963+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:38:51.607963+0000","last_undegraded":"2023-11-28T20:38:51.607963+0000","last_fullsized":"2023-11-28T20:38:51.607963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344497+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:24.344497+0000","last_peered":"2023-11-28T20:38:24.344497+0000","last_clean":"2023-11-28T20:38:24.344497+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:24.344497+0000","last_undegraded":"2023-11-28T20:38:24.344497+0000","last_fullsized":"2023-11-28T20:38:24.344497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563464+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:23.563464+0000","last_peered":"2023-11-28T20:38:23.563464+0000","last_clean":"2023-11-28T20:38:23.563464+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:23.563464+0000","last_undegraded":"2023-11-28T20:38:23.563464+0000","last_fullsized":"2023-11-28T20:38:23.563464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.610930+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:51.610930+0000","last_peered":"2023-11-28T20:38:51.610930+0000","last_clean":"2023-11-28T20:38:51.610930+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:51.610930+0000","last_undegraded":"2023-11-28T20:38:51.610930+0000","last_fullsized":"2023-11-28T20:38:51.610930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.525043+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:38:24.525043+0000","last_peered":"2023-11-28T20:38:24.525043+0000","last_clean":"2023-11-28T20:38:24.525043+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:38:24.525043+0000","last_undegraded":"2023-11-28T20:38:24.525043+0000","last_fullsized":"2023-11-28T20:38:24.525043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771026+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:23.771026+0000","last_peered":"2023-11-28T20:38:23.771026+0000","last_clean":"2023-11-28T20:38:23.771026+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:23.771026+0000","last_undegraded":"2023-11-28T20:38:23.771026+0000","last_fullsized":"2023-11-28T20:38:23.771026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.576826+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:45.576826+0000","last_peered":"2023-11-28T20:38:45.576826+0000","last_clean":"2023-11-28T20:38:45.576826+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:45.576826+0000","last_undegraded":"2023-11-28T20:38:45.576826+0000","last_fullsized":"2023-11-28T20:38:45.576826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524484+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.524484+0000","last_peered":"2023-11-28T20:38:24.524484+0000","last_clean":"2023-11-28T20:38:24.524484+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:38:24.524484+0000","last_undegraded":"2023-11-28T20:38:24.524484+0000","last_fullsized":"2023-11-28T20:38:24.524484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560744+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:23.560744+0000","last_peered":"2023-11-28T20:38:23.560744+0000","last_clean":"2023-11-28T20:38:23.560744+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:23.560744+0000","last_undegraded":"2023-11-28T20:38:23.560744+0000","last_fullsized":"2023-11-28T20:38:23.560744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.605086+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:51.605086+0000","last_peered":"2023-11-28T20:38:51.605086+0000","last_clean":"2023-11-28T20:38:51.605086+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:51.605086+0000","last_undegraded":"2023-11-28T20:38:51.605086+0000","last_fullsized":"2023-11-28T20:38:51.605086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350690+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:24.350690+0000","last_peered":"2023-11-28T20:38:24.350690+0000","last_clean":"2023-11-28T20:38:24.350690+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:24.350690+0000","last_undegraded":"2023-11-28T20:38:24.350690+0000","last_fullsized":"2023-11-28T20:38:24.350690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771288+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:23.771288+0000","last_peered":"2023-11-28T20:38:23.771288+0000","last_clean":"2023-11-28T20:38:23.771288+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:23.771288+0000","last_undegraded":"2023-11-28T20:38:23.771288+0000","last_fullsized":"2023-11-28T20:38:23.771288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.580418+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:45.580418+0000","last_peered":"2023-11-28T20:38:45.580418+0000","last_clean":"2023-11-28T20:38:45.580418+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:45.580418+0000","last_undegraded":"2023-11-28T20:38:45.580418+0000","last_fullsized":"2023-11-28T20:38:45.580418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535078+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:38:24.535078+0000","last_peered":"2023-11-28T20:38:24.535078+0000","last_clean":"2023-11-28T20:38:24.535078+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:38:24.535078+0000","last_undegraded":"2023-11-28T20:38:24.535078+0000","last_fullsized":"2023-11-28T20:38:24.535078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571791+0000","last_change":"2023-11-28T20:38:19.398113+0000","last_active":"2023-11-28T20:38:23.571791+0000","last_peered":"2023-11-28T20:38:23.571791+0000","last_clean":"2023-11-28T20:38:23.571791+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:38:23.571791+0000","last_undegraded":"2023-11-28T20:38:23.571791+0000","last_fullsized":"2023-11-28T20:38:23.571791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:08.187641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535609+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:38:24.535609+0000","last_peered":"2023-11-28T20:38:24.535609+0000","last_clean":"2023-11-28T20:38:24.535609+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:38:24.535609+0000","last_undegraded":"2023-11-28T20:38:24.535609+0000","last_fullsized":"2023-11-28T20:38:24.535609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529696+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:24.529696+0000","last_peered":"2023-11-28T20:38:24.529696+0000","last_clean":"2023-11-28T20:38:24.529696+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:24.529696+0000","last_undegraded":"2023-11-28T20:38:24.529696+0000","last_fullsized":"2023-11-28T20:38:24.529696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.562967+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:23.562967+0000","last_peered":"2023-11-28T20:38:23.562967+0000","last_clean":"2023-11-28T20:38:23.562967+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:23.562967+0000","last_undegraded":"2023-11-28T20:38:23.562967+0000","last_fullsized":"2023-11-28T20:38:23.562967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.572723+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:45.572723+0000","last_peered":"2023-11-28T20:38:45.572723+0000","last_clean":"2023-11-28T20:38:45.572723+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:45.572723+0000","last_undegraded":"2023-11-28T20:38:45.572723+0000","last_fullsized":"2023-11-28T20:38:45.572723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524020+0000","last_change":"2023-11-28T20:38:23.592734+0000","last_active":"2023-11-28T20:38:24.524020+0000","last_peered":"2023-11-28T20:38:24.524020+0000","last_clean":"2023-11-28T20:38:24.524020+0000","last_became_active":"2023-11-28T20:38:23.592348+0000","last_became_peered":"2023-11-28T20:38:23.592348+0000","last_unstale":"2023-11-28T20:38:24.524020+0000","last_undegraded":"2023-11-28T20:38:24.524020+0000","last_fullsized":"2023-11-28T20:38:24.524020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:11:10.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559511+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:23.559511+0000","last_peered":"2023-11-28T20:38:23.559511+0000","last_clean":"2023-11-28T20:38:23.559511+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:23.559511+0000","last_undegraded":"2023-11-28T20:38:23.559511+0000","last_fullsized":"2023-11-28T20:38:23.559511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573495+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:45.573495+0000","last_peered":"2023-11-28T20:38:45.573495+0000","last_clean":"2023-11-28T20:38:45.573495+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:45.573495+0000","last_undegraded":"2023-11-28T20:38:45.573495+0000","last_fullsized":"2023-11-28T20:38:45.573495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523851+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:38:24.523851+0000","last_peered":"2023-11-28T20:38:24.523851+0000","last_clean":"2023-11-28T20:38:24.523851+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:38:24.523851+0000","last_undegraded":"2023-11-28T20:38:24.523851+0000","last_fullsized":"2023-11-28T20:38:24.523851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344511+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:24.344511+0000","last_peered":"2023-11-28T20:38:24.344511+0000","last_clean":"2023-11-28T20:38:24.344511+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:24.344511+0000","last_undegraded":"2023-11-28T20:38:24.344511+0000","last_fullsized":"2023-11-28T20:38:24.344511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571440+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:38:23.571440+0000","last_peered":"2023-11-28T20:38:23.571440+0000","last_clean":"2023-11-28T20:38:23.571440+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:38:23.571440+0000","last_undegraded":"2023-11-28T20:38:23.571440+0000","last_fullsized":"2023-11-28T20:38:23.571440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348854+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:24.348854+0000","last_peered":"2023-11-28T20:38:24.348854+0000","last_clean":"2023-11-28T20:38:24.348854+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:24.348854+0000","last_undegraded":"2023-11-28T20:38:24.348854+0000","last_fullsized":"2023-11-28T20:38:24.348854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351748+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:24.351748+0000","last_peered":"2023-11-28T20:38:24.351748+0000","last_clean":"2023-11-28T20:38:24.351748+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:24.351748+0000","last_undegraded":"2023-11-28T20:38:24.351748+0000","last_fullsized":"2023-11-28T20:38:24.351748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556007+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:38:23.556007+0000","last_peered":"2023-11-28T20:38:23.556007+0000","last_clean":"2023-11-28T20:38:23.556007+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:38:23.556007+0000","last_undegraded":"2023-11-28T20:38:23.556007+0000","last_fullsized":"2023-11-28T20:38:23.556007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606505+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:38:51.606505+0000","last_peered":"2023-11-28T20:38:51.606505+0000","last_clean":"2023-11-28T20:38:51.606505+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:38:51.606505+0000","last_undegraded":"2023-11-28T20:38:51.606505+0000","last_fullsized":"2023-11-28T20:38:51.606505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.609457+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:51.609457+0000","last_peered":"2023-11-28T20:38:51.609457+0000","last_clean":"2023-11-28T20:38:51.609457+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:51.609457+0000","last_undegraded":"2023-11-28T20:38:51.609457+0000","last_fullsized":"2023-11-28T20:38:51.609457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561439+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:23.561439+0000","last_peered":"2023-11-28T20:38:23.561439+0000","last_clean":"2023-11-28T20:38:23.561439+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:23.561439+0000","last_undegraded":"2023-11-28T20:38:23.561439+0000","last_fullsized":"2023-11-28T20:38:23.561439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534500+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:38:24.534500+0000","last_peered":"2023-11-28T20:38:24.534500+0000","last_clean":"2023-11-28T20:38:24.534500+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:38:24.534500+0000","last_undegraded":"2023-11-28T20:38:24.534500+0000","last_fullsized":"2023-11-28T20:38:24.534500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.579080+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:38:45.579080+0000","last_peered":"2023-11-28T20:38:45.579080+0000","last_clean":"2023-11-28T20:38:45.579080+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:38:45.579080+0000","last_undegraded":"2023-11-28T20:38:45.579080+0000","last_fullsized":"2023-11-28T20:38:45.579080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.588393+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:23.588393+0000","last_peered":"2023-11-28T20:38:23.588393+0000","last_clean":"2023-11-28T20:38:23.588393+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:23.588393+0000","last_undegraded":"2023-11-28T20:38:23.588393+0000","last_fullsized":"2023-11-28T20:38:23.588393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524719+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:38:24.524719+0000","last_peered":"2023-11-28T20:38:24.524719+0000","last_clean":"2023-11-28T20:38:24.524719+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:38:24.524719+0000","last_undegraded":"2023-11-28T20:38:24.524719+0000","last_fullsized":"2023-11-28T20:38:24.524719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563172+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:23.563172+0000","last_peered":"2023-11-28T20:38:23.563172+0000","last_clean":"2023-11-28T20:38:23.563172+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:23.563172+0000","last_undegraded":"2023-11-28T20:38:23.563172+0000","last_fullsized":"2023-11-28T20:38:23.563172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579796+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:38:23.579796+0000","last_peered":"2023-11-28T20:38:23.579796+0000","last_clean":"2023-11-28T20:38:23.579796+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:38:23.579796+0000","last_undegraded":"2023-11-28T20:38:23.579796+0000","last_fullsized":"2023-11-28T20:38:23.579796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559655+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:23.559655+0000","last_peered":"2023-11-28T20:38:23.559655+0000","last_clean":"2023-11-28T20:38:23.559655+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:23.559655+0000","last_undegraded":"2023-11-28T20:38:23.559655+0000","last_fullsized":"2023-11-28T20:38:23.559655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561367+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:23.561367+0000","last_peered":"2023-11-28T20:38:23.561367+0000","last_clean":"2023-11-28T20:38:23.561367+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:23.561367+0000","last_undegraded":"2023-11-28T20:38:23.561367+0000","last_fullsized":"2023-11-28T20:38:23.561367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556118+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:38:23.556118+0000","last_peered":"2023-11-28T20:38:23.556118+0000","last_clean":"2023-11-28T20:38:23.556118+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:38:23.556118+0000","last_undegraded":"2023-11-28T20:38:23.556118+0000","last_fullsized":"2023-11-28T20:38:23.556118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579390+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:38:23.579390+0000","last_peered":"2023-11-28T20:38:23.579390+0000","last_clean":"2023-11-28T20:38:23.579390+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:38:23.579390+0000","last_undegraded":"2023-11-28T20:38:23.579390+0000","last_fullsized":"2023-11-28T20:38:23.579390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.567024+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:23.567024+0000","last_peered":"2023-11-28T20:38:23.567024+0000","last_clean":"2023-11-28T20:38:23.567024+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:23.567024+0000","last_undegraded":"2023-11-28T20:38:23.567024+0000","last_fullsized":"2023-11-28T20:38:23.567024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556268+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:38:23.556268+0000","last_peered":"2023-11-28T20:38:23.556268+0000","last_clean":"2023-11-28T20:38:23.556268+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:38:23.556268+0000","last_undegraded":"2023-11-28T20:38:23.556268+0000","last_fullsized":"2023-11-28T20:38:23.556268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564684+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:23.564684+0000","last_peered":"2023-11-28T20:38:23.564684+0000","last_clean":"2023-11-28T20:38:23.564684+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:23.564684+0000","last_undegraded":"2023-11-28T20:38:23.564684+0000","last_fullsized":"2023-11-28T20:38:23.564684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555549+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:38:23.555549+0000","last_peered":"2023-11-28T20:38:23.555549+0000","last_clean":"2023-11-28T20:38:23.555549+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:38:23.555549+0000","last_undegraded":"2023-11-28T20:38:23.555549+0000","last_fullsized":"2023-11-28T20:38:23.555549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559455+0000","last_change":"2023-11-28T20:38:19.391161+0000","last_active":"2023-11-28T20:38:23.559455+0000","last_peered":"2023-11-28T20:38:23.559455+0000","last_clean":"2023-11-28T20:38:23.559455+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:38:23.559455+0000","last_undegraded":"2023-11-28T20:38:23.559455+0000","last_fullsized":"2023-11-28T20:38:23.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:29.088707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561269+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:23.561269+0000","last_peered":"2023-11-28T20:38:23.561269+0000","last_clean":"2023-11-28T20:38:23.561269+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:23.561269+0000","last_undegraded":"2023-11-28T20:38:23.561269+0000","last_fullsized":"2023-11-28T20:38:23.561269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.565066+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:23.565066+0000","last_peered":"2023-11-28T20:38:23.565066+0000","last_clean":"2023-11-28T20:38:23.565066+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:23.565066+0000","last_undegraded":"2023-11-28T20:38:23.565066+0000","last_fullsized":"2023-11-28T20:38:23.565066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.772001+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:23.772001+0000","last_peered":"2023-11-28T20:38:23.772001+0000","last_clean":"2023-11-28T20:38:23.772001+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:23.772001+0000","last_undegraded":"2023-11-28T20:38:23.772001+0000","last_fullsized":"2023-11-28T20:38:23.772001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.583087+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:38:23.583087+0000","last_peered":"2023-11-28T20:38:23.583087+0000","last_clean":"2023-11-28T20:38:23.583087+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:38:23.583087+0000","last_undegraded":"2023-11-28T20:38:23.583087+0000","last_fullsized":"2023-11-28T20:38:23.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560491+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:23.560491+0000","last_peered":"2023-11-28T20:38:23.560491+0000","last_clean":"2023-11-28T20:38:23.560491+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:23.560491+0000","last_undegraded":"2023-11-28T20:38:23.560491+0000","last_fullsized":"2023-11-28T20:38:23.560491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.564469+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:23.564469+0000","last_peered":"2023-11-28T20:38:23.564469+0000","last_clean":"2023-11-28T20:38:23.564469+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:23.564469+0000","last_undegraded":"2023-11-28T20:38:23.564469+0000","last_fullsized":"2023-11-28T20:38:23.564469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571449+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:38:23.571449+0000","last_peered":"2023-11-28T20:38:23.571449+0000","last_clean":"2023-11-28T20:38:23.571449+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:38:23.571449+0000","last_undegraded":"2023-11-28T20:38:23.571449+0000","last_fullsized":"2023-11-28T20:38:23.571449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560649+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:23.560649+0000","last_peered":"2023-11-28T20:38:23.560649+0000","last_clean":"2023-11-28T20:38:23.560649+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:23.560649+0000","last_undegraded":"2023-11-28T20:38:23.560649+0000","last_fullsized":"2023-11-28T20:38:23.560649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556123+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:38:23.556123+0000","last_peered":"2023-11-28T20:38:23.556123+0000","last_clean":"2023-11-28T20:38:23.556123+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:38:23.556123+0000","last_undegraded":"2023-11-28T20:38:23.556123+0000","last_fullsized":"2023-11-28T20:38:23.556123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571565+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:23.571565+0000","last_peered":"2023-11-28T20:38:23.571565+0000","last_clean":"2023-11-28T20:38:23.571565+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:23.571565+0000","last_undegraded":"2023-11-28T20:38:23.571565+0000","last_fullsized":"2023-11-28T20:38:23.571565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.563921+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:23.563921+0000","last_peered":"2023-11-28T20:38:23.563921+0000","last_clean":"2023-11-28T20:38:23.563921+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:23.563921+0000","last_undegraded":"2023-11-28T20:38:23.563921+0000","last_fullsized":"2023-11-28T20:38:23.563921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.566792+0000","last_change":"2023-11-28T20:38:19.399387+0000","last_active":"2023-11-28T20:38:23.566792+0000","last_peered":"2023-11-28T20:38:23.566792+0000","last_clean":"2023-11-28T20:38:23.566792+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:23.566792+0000","last_undegraded":"2023-11-28T20:38:23.566792+0000","last_fullsized":"2023-11-28T20:38:23.566792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:19:33.795318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771738+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:23.771738+0000","last_peered":"2023-11-28T20:38:23.771738+0000","last_clean":"2023-11-28T20:38:23.771738+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:23.771738+0000","last_undegraded":"2023-11-28T20:38:23.771738+0000","last_fullsized":"2023-11-28T20:38:23.771738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.554837+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:38:23.554837+0000","last_peered":"2023-11-28T20:38:23.554837+0000","last_clean":"2023-11-28T20:38:23.554837+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:38:23.554837+0000","last_undegraded":"2023-11-28T20:38:23.554837+0000","last_fullsized":"2023-11-28T20:38:23.554837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.770651+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:23.770651+0000","last_peered":"2023-11-28T20:38:23.770651+0000","last_clean":"2023-11-28T20:38:23.770651+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:23.770651+0000","last_undegraded":"2023-11-28T20:38:23.770651+0000","last_fullsized":"2023-11-28T20:38:23.770651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559229+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:23.559229+0000","last_peered":"2023-11-28T20:38:23.559229+0000","last_clean":"2023-11-28T20:38:23.559229+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:23.559229+0000","last_undegraded":"2023-11-28T20:38:23.559229+0000","last_fullsized":"2023-11-28T20:38:23.559229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771010+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:23.771010+0000","last_peered":"2023-11-28T20:38:23.771010+0000","last_clean":"2023-11-28T20:38:23.771010+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:23.771010+0000","last_undegraded":"2023-11-28T20:38:23.771010+0000","last_fullsized":"2023-11-28T20:38:23.771010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.560781+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:23.560781+0000","last_peered":"2023-11-28T20:38:23.560781+0000","last_clean":"2023-11-28T20:38:23.560781+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:23.560781+0000","last_undegraded":"2023-11-28T20:38:23.560781+0000","last_fullsized":"2023-11-28T20:38:23.560781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.561319+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:23.561319+0000","last_peered":"2023-11-28T20:38:23.561319+0000","last_clean":"2023-11-28T20:38:23.561319+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:23.561319+0000","last_undegraded":"2023-11-28T20:38:23.561319+0000","last_fullsized":"2023-11-28T20:38:23.561319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.580170+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:38:23.580170+0000","last_peered":"2023-11-28T20:38:23.580170+0000","last_clean":"2023-11-28T20:38:23.580170+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:38:23.580170+0000","last_undegraded":"2023-11-28T20:38:23.580170+0000","last_fullsized":"2023-11-28T20:38:23.580170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.771481+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:23.771481+0000","last_peered":"2023-11-28T20:38:23.771481+0000","last_clean":"2023-11-28T20:38:23.771481+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:23.771481+0000","last_undegraded":"2023-11-28T20:38:23.771481+0000","last_fullsized":"2023-11-28T20:38:23.771481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7451,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":102843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":102969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":693709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":693053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:39:01.306 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:39:01.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f679b632640 1 Processor -- start 2023-11-28T20:39:01.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f679b632640 1 -- start start 2023-11-28T20:39:01.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f679b632640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e030 0x7f67941500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f679b632640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6794070480 0x7f67941505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f679b632640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f679406e410 0x7f6794071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f679b632640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67941571d0 con 0x7f6794070480 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f679b632640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6794071a90 con 0x7f679406e410 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f679b632640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940c70d0 con 0x7f679406e030 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f6798bcd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6794070480 0x7f67941505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f6798bcd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6794070480 0x7f67941505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45958/0 (socket says 172.21.15.167:45958) 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f6798bcd640 1 -- 172.21.15.167:0/3108545881 learned_addr learned my addr 172.21.15.167:0/3108545881 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f67993ce640 1 --2- 172.21.15.167:0/3108545881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e030 0x7f67941500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f6799bcf640 1 --2- 172.21.15.167:0/3108545881 >> v2:172.21.15.178:3300/0 conn(0x7f679406e410 0x7f6794071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f6798bcd640 1 -- 172.21.15.167:0/3108545881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e030 msgr2=0x7f67941500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f6798bcd640 1 --2- 172.21.15.167:0/3108545881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e030 0x7f67941500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f6798bcd640 1 -- 172.21.15.167:0/3108545881 >> v2:172.21.15.178:3300/0 conn(0x7f679406e410 msgr2=0x7f6794071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:01.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f6798bcd640 1 --2- 172.21.15.167:0/3108545881 >> v2:172.21.15.178:3300/0 conn(0x7f679406e410 0x7f6794071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.484+0000 7f6798bcd640 1 -- 172.21.15.167:0/3108545881 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67940c73b0 con 0x7f6794070480 2023-11-28T20:39:01.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f6798bcd640 1 --2- 172.21.15.167:0/3108545881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 0x7f67941505f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f67940c7c90 tx=0x7f678401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8017d15937055da9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f678bfff640 1 -- 172.21.15.167:0/3108545881 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67840a7c30 con 0x7f6794070480 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f678bfff640 1 -- 172.21.15.167:0/3108545881 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67840a7d90 con 0x7f6794070480 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f678bfff640 1 -- 172.21.15.167:0/3108545881 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67840af660 con 0x7f6794070480 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f679b632640 1 -- 172.21.15.167:0/3108545881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 msgr2=0x7f67941505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f679b632640 1 --2- 172.21.15.167:0/3108545881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 0x7f67941505f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f67940c7c90 tx=0x7f678401eba0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f679b632640 1 -- 172.21.15.167:0/3108545881 shutdown_connections 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f679b632640 1 --2- 172.21.15.167:0/3108545881 >> v2:172.21.15.178:3300/0 conn(0x7f679406e410 0x7f6794071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f679b632640 1 --2- 172.21.15.167:0/3108545881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 0x7f67941505f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f679b632640 1 --2- 172.21.15.167:0/3108545881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e030 0x7f67941500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f679b632640 1 -- 172.21.15.167:0/3108545881 >> 172.21.15.167:0/3108545881 conn(0x7f67940cb1e0 msgr2=0x7f67940cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:01.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f679b632640 1 -- 172.21.15.167:0/3108545881 shutdown_connections 2023-11-28T20:39:01.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.488+0000 7f679b632640 1 -- 172.21.15.167:0/3108545881 wait complete. 2023-11-28T20:39:01.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 Processor -- start 2023-11-28T20:39:01.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 -- start start 2023-11-28T20:39:01.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406e030 0x7f6794154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e410 0x7f6794150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 0x7f6794155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6794155580 con 0x7f6794070480 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67941590c0 con 0x7f679406e030 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6794151410 con 0x7f679406e410 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6799bcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 0x7f6794155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6799bcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 0x7f6794155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45962/0 (socket says 172.21.15.167:45962) 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6799bcf640 1 -- 172.21.15.167:0/2990529705 learned_addr learned my addr 172.21.15.167:0/2990529705 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f67993ce640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406e030 0x7f6794154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6798bcd640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e410 0x7f6794150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6799bcf640 1 -- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e410 msgr2=0x7f6794150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6799bcf640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e410 0x7f6794150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6799bcf640 1 -- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406e030 msgr2=0x7f6794154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6799bcf640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406e030 0x7f6794154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6799bcf640 1 -- 172.21.15.167:0/2990529705 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678400b770 con 0x7f6794070480 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6798bcd640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e410 0x7f6794150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f67993ce640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406e030 0x7f6794154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6799bcf640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 0x7f6794155ac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f678c009fd0 tx=0x7f678c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6789ffb640 1 -- 172.21.15.167:0/2990529705 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c014420 con 0x7f6794070480 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6789ffb640 1 -- 172.21.15.167:0/2990529705 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c014580 con 0x7f6794070480 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6794159360 con 0x7f6794070480 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f6789ffb640 1 -- 172.21.15.167:0/2990529705 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c014930 con 0x7f6794070480 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6794159920 con 0x7f6794070480 2023-11-28T20:39:01.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.492+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67940682c0 con 0x7f6794070480 2023-11-28T20:39:01.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.496+0000 7f6789ffb640 1 -- 172.21.15.167:0/2990529705 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f678c014a90 con 0x7f6794070480 2023-11-28T20:39:01.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.496+0000 7f6789ffb640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6778066470 0x7f6778068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.496+0000 7f6789ffb640 1 -- 172.21.15.167:0/2990529705 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f678c084b50 con 0x7f6794070480 2023-11-28T20:39:01.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.496+0000 7f67993ce640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6778066470 0x7f6778068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.496+0000 7f67993ce640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6778066470 0x7f6778068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f679000ba50 tx=0x7f6790008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:01.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.500+0000 7f6789ffb640 1 -- 172.21.15.167:0/2990529705 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f678c051c00 con 0x7f6794070480 2023-11-28T20:39:01.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.648+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6794159b10 con 0x7f6778066470 2023-11-28T20:39:01.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.676+0000 7f6789ffb640 1 -- 172.21.15.167:0/2990529705 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345313 (secure 0 0 0) 0x7f6794159b10 con 0x7f6778066470 2023-11-28T20:39:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:01.684 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:39:01.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6778066470 msgr2=0x7f6778068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6778066470 0x7f6778068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f679000ba50 tx=0x7f6790008040 comp rx=0 tx=0).stop 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 msgr2=0x7f6794155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 0x7f6794155ac0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f678c009fd0 tx=0x7f678c00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 shutdown_connections 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6778066470 0x7f6778068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6794070480 0x7f6794155ac0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679406e410 0x7f6794150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 --2- 172.21.15.167:0/2990529705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f679406e030 0x7f6794154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 >> 172.21.15.167:0/2990529705 conn(0x7f67940cb1e0 msgr2=0x7f679414fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:01.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 shutdown_connections 2023-11-28T20:39:01.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.680+0000 7f679b632640 1 -- 172.21.15.167:0/2990529705 wait complete. 2023-11-28T20:39:01.702 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2023-11-28T20:39:01.444532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598073,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":289,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236120,"kb_used_data":3348,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738600,"statfs":{"total":773094113280,"available":772852326400,"internally_reserved":0,"allocated":3428352,"data_stored":2019158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1660,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003135"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.609165+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:51.609165+0000","last_peered":"2023-11-28T20:38:51.609165+0000","last_clean":"2023-11-28T20:38:51.609165+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:51.609165+0000","last_undegraded":"2023-11-28T20:38:51.609165+0000","last_fullsized":"2023-11-28T20:38:51.609165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.390144+0000","last_change":"2023-11-28T20:39:01.387644+0000","last_active":"2023-11-28T20:39:01.390144+0000","last_peered":"2023-11-28T20:39:01.390144+0000","last_clean":"2023-11-28T20:39:01.390144+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T20:39:01.390144+0000","last_undegraded":"2023-11-28T20:39:01.390144+0000","last_fullsized":"2023-11-28T20:39:01.390144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:52.977080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523700+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:38:24.523700+0000","last_peered":"2023-11-28T20:38:24.523700+0000","last_clean":"2023-11-28T20:38:24.523700+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:38:24.523700+0000","last_undegraded":"2023-11-28T20:38:24.523700+0000","last_fullsized":"2023-11-28T20:38:24.523700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530236+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:38:24.530236+0000","last_peered":"2023-11-28T20:38:24.530236+0000","last_clean":"2023-11-28T20:38:24.530236+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:38:24.530236+0000","last_undegraded":"2023-11-28T20:38:24.530236+0000","last_fullsized":"2023-11-28T20:38:24.530236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344550+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:24.344550+0000","last_peered":"2023-11-28T20:38:24.344550+0000","last_clean":"2023-11-28T20:38:24.344550+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:24.344550+0000","last_undegraded":"2023-11-28T20:38:24.344550+0000","last_fullsized":"2023-11-28T20:38:24.344550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:25.445649+0000","last_change":"2023-11-28T20:39:00.368426+0000","last_active":"2023-11-28T20:39:00.368426+0000","last_peered":"2023-11-28T20:38:25.445649+0000","last_clean":"2023-11-28T20:38:25.445649+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:25.445649+0000","last_undegraded":"2023-11-28T20:38:25.445649+0000","last_fullsized":"2023-11-28T20:38:25.445649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606601+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:51.606601+0000","last_peered":"2023-11-28T20:38:51.606601+0000","last_clean":"2023-11-28T20:38:51.606601+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:51.606601+0000","last_undegraded":"2023-11-28T20:38:51.606601+0000","last_fullsized":"2023-11-28T20:38:51.606601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350728+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:24.350728+0000","last_peered":"2023-11-28T20:38:24.350728+0000","last_clean":"2023-11-28T20:38:24.350728+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:24.350728+0000","last_undegraded":"2023-11-28T20:38:24.350728+0000","last_fullsized":"2023-11-28T20:38:24.350728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445936+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:25.445936+0000","last_peered":"2023-11-28T20:38:25.445936+0000","last_clean":"2023-11-28T20:38:25.445936+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:25.445936+0000","last_undegraded":"2023-11-28T20:38:25.445936+0000","last_fullsized":"2023-11-28T20:38:25.445936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532409+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532409+0000","last_peered":"2023-11-28T20:38:24.532409+0000","last_clean":"2023-11-28T20:38:24.532409+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532409+0000","last_undegraded":"2023-11-28T20:38:24.532409+0000","last_fullsized":"2023-11-28T20:38:24.532409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350514+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:24.350514+0000","last_peered":"2023-11-28T20:38:24.350514+0000","last_clean":"2023-11-28T20:38:24.350514+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:24.350514+0000","last_undegraded":"2023-11-28T20:38:24.350514+0000","last_fullsized":"2023-11-28T20:38:24.350514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445855+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:25.445855+0000","last_peered":"2023-11-28T20:38:25.445855+0000","last_clean":"2023-11-28T20:38:25.445855+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:25.445855+0000","last_undegraded":"2023-11-28T20:38:25.445855+0000","last_fullsized":"2023-11-28T20:38:25.445855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350262+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:24.350262+0000","last_peered":"2023-11-28T20:38:24.350262+0000","last_clean":"2023-11-28T20:38:24.350262+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:24.350262+0000","last_undegraded":"2023-11-28T20:38:24.350262+0000","last_fullsized":"2023-11-28T20:38:24.350262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575295+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:45.575295+0000","last_peered":"2023-11-28T20:38:45.575295+0000","last_clean":"2023-11-28T20:38:45.575295+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:45.575295+0000","last_undegraded":"2023-11-28T20:38:45.575295+0000","last_fullsized":"2023-11-28T20:38:45.575295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446173+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:25.446173+0000","last_peered":"2023-11-28T20:38:25.446173+0000","last_clean":"2023-11-28T20:38:25.446173+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:25.446173+0000","last_undegraded":"2023-11-28T20:38:25.446173+0000","last_fullsized":"2023-11-28T20:38:25.446173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556220+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:38:23.556220+0000","last_peered":"2023-11-28T20:38:23.556220+0000","last_clean":"2023-11-28T20:38:23.556220+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:38:23.556220+0000","last_undegraded":"2023-11-28T20:38:23.556220+0000","last_fullsized":"2023-11-28T20:38:23.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372769+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:39:00.372769+0000","last_peered":"2023-11-28T20:39:00.372769+0000","last_clean":"2023-11-28T20:39:00.372769+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:39:00.372769+0000","last_undegraded":"2023-11-28T20:39:00.372769+0000","last_fullsized":"2023-11-28T20:39:00.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446061+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:25.446061+0000","last_peered":"2023-11-28T20:38:25.446061+0000","last_clean":"2023-11-28T20:38:25.446061+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:25.446061+0000","last_undegraded":"2023-11-28T20:38:25.446061+0000","last_fullsized":"2023-11-28T20:38:25.446061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556959+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:38:23.556959+0000","last_peered":"2023-11-28T20:38:23.556959+0000","last_clean":"2023-11-28T20:38:23.556959+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:38:23.556959+0000","last_undegraded":"2023-11-28T20:38:23.556959+0000","last_fullsized":"2023-11-28T20:38:23.556959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372086+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:39:00.372086+0000","last_peered":"2023-11-28T20:39:00.372086+0000","last_clean":"2023-11-28T20:39:00.372086+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:39:00.372086+0000","last_undegraded":"2023-11-28T20:39:00.372086+0000","last_fullsized":"2023-11-28T20:39:00.372086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373087+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.373087+0000","last_peered":"2023-11-28T20:39:00.373087+0000","last_clean":"2023-11-28T20:39:00.373087+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:39:00.373087+0000","last_undegraded":"2023-11-28T20:39:00.373087+0000","last_fullsized":"2023-11-28T20:39:00.373087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528774+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:24.528774+0000","last_peered":"2023-11-28T20:38:24.528774+0000","last_clean":"2023-11-28T20:38:24.528774+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:24.528774+0000","last_undegraded":"2023-11-28T20:38:24.528774+0000","last_fullsized":"2023-11-28T20:38:24.528774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575123+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:45.575123+0000","last_peered":"2023-11-28T20:38:45.575123+0000","last_clean":"2023-11-28T20:38:45.575123+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:45.575123+0000","last_undegraded":"2023-11-28T20:38:45.575123+0000","last_fullsized":"2023-11-28T20:38:45.575123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446227+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:25.446227+0000","last_peered":"2023-11-28T20:38:25.446227+0000","last_clean":"2023-11-28T20:38:25.446227+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:25.446227+0000","last_undegraded":"2023-11-28T20:38:25.446227+0000","last_fullsized":"2023-11-28T20:38:25.446227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344675+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:24.344675+0000","last_peered":"2023-11-28T20:38:24.344675+0000","last_clean":"2023-11-28T20:38:24.344675+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:24.344675+0000","last_undegraded":"2023-11-28T20:38:24.344675+0000","last_fullsized":"2023-11-28T20:38:24.344675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573711+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:45.573711+0000","last_peered":"2023-11-28T20:38:45.573711+0000","last_clean":"2023-11-28T20:38:45.573711+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:45.573711+0000","last_undegraded":"2023-11-28T20:38:45.573711+0000","last_fullsized":"2023-11-28T20:38:45.573711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445762+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:25.445762+0000","last_peered":"2023-11-28T20:38:25.445762+0000","last_clean":"2023-11-28T20:38:25.445762+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:25.445762+0000","last_undegraded":"2023-11-28T20:38:25.445762+0000","last_fullsized":"2023-11-28T20:38:25.445762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556394+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:38:23.556394+0000","last_peered":"2023-11-28T20:38:23.556394+0000","last_clean":"2023-11-28T20:38:23.556394+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:38:23.556394+0000","last_undegraded":"2023-11-28T20:38:23.556394+0000","last_fullsized":"2023-11-28T20:38:23.556394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373110+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:39:00.373110+0000","last_peered":"2023-11-28T20:39:00.373110+0000","last_clean":"2023-11-28T20:39:00.373110+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:39:00.373110+0000","last_undegraded":"2023-11-28T20:39:00.373110+0000","last_fullsized":"2023-11-28T20:39:00.373110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523623+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:38:24.523623+0000","last_peered":"2023-11-28T20:38:24.523623+0000","last_clean":"2023-11-28T20:38:24.523623+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:38:24.523623+0000","last_undegraded":"2023-11-28T20:38:24.523623+0000","last_fullsized":"2023-11-28T20:38:24.523623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372844+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:39:00.372844+0000","last_peered":"2023-11-28T20:39:00.372844+0000","last_clean":"2023-11-28T20:39:00.372844+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:39:00.372844+0000","last_undegraded":"2023-11-28T20:39:00.372844+0000","last_fullsized":"2023-11-28T20:39:00.372844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574343+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:45.574343+0000","last_peered":"2023-11-28T20:38:45.574343+0000","last_clean":"2023-11-28T20:38:45.574343+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:45.574343+0000","last_undegraded":"2023-11-28T20:38:45.574343+0000","last_fullsized":"2023-11-28T20:38:45.574343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439058+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:25.439058+0000","last_peered":"2023-11-28T20:38:25.439058+0000","last_clean":"2023-11-28T20:38:25.439058+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:25.439058+0000","last_undegraded":"2023-11-28T20:38:25.439058+0000","last_fullsized":"2023-11-28T20:38:25.439058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350784+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:24.350784+0000","last_peered":"2023-11-28T20:38:24.350784+0000","last_clean":"2023-11-28T20:38:24.350784+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:24.350784+0000","last_undegraded":"2023-11-28T20:38:24.350784+0000","last_fullsized":"2023-11-28T20:38:24.350784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372929+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:39:00.372929+0000","last_peered":"2023-11-28T20:39:00.372929+0000","last_clean":"2023-11-28T20:39:00.372929+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:39:00.372929+0000","last_undegraded":"2023-11-28T20:39:00.372929+0000","last_fullsized":"2023-11-28T20:39:00.372929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535102+0000","last_change":"2023-11-28T20:38:23.594782+0000","last_active":"2023-11-28T20:38:24.535102+0000","last_peered":"2023-11-28T20:38:24.535102+0000","last_clean":"2023-11-28T20:38:24.535102+0000","last_became_active":"2023-11-28T20:38:23.594034+0000","last_became_peered":"2023-11-28T20:38:23.594034+0000","last_unstale":"2023-11-28T20:38:24.535102+0000","last_undegraded":"2023-11-28T20:38:24.535102+0000","last_fullsized":"2023-11-28T20:38:24.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:29:14.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529967+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:24.529967+0000","last_peered":"2023-11-28T20:38:24.529967+0000","last_clean":"2023-11-28T20:38:24.529967+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:24.529967+0000","last_undegraded":"2023-11-28T20:38:24.529967+0000","last_fullsized":"2023-11-28T20:38:24.529967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608154+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:51.608154+0000","last_peered":"2023-11-28T20:38:51.608154+0000","last_clean":"2023-11-28T20:38:51.608154+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:51.608154+0000","last_undegraded":"2023-11-28T20:38:51.608154+0000","last_fullsized":"2023-11-28T20:38:51.608154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372765+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:39:00.372765+0000","last_peered":"2023-11-28T20:39:00.372765+0000","last_clean":"2023-11-28T20:39:00.372765+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:39:00.372765+0000","last_undegraded":"2023-11-28T20:39:00.372765+0000","last_fullsized":"2023-11-28T20:39:00.372765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373168+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:39:00.373168+0000","last_peered":"2023-11-28T20:39:00.373168+0000","last_clean":"2023-11-28T20:39:00.373168+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:39:00.373168+0000","last_undegraded":"2023-11-28T20:39:00.373168+0000","last_fullsized":"2023-11-28T20:39:00.373168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607572+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:38:51.607572+0000","last_peered":"2023-11-28T20:38:51.607572+0000","last_clean":"2023-11-28T20:38:51.607572+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:38:51.607572+0000","last_undegraded":"2023-11-28T20:38:51.607572+0000","last_fullsized":"2023-11-28T20:38:51.607572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373409+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:39:00.373409+0000","last_peered":"2023-11-28T20:39:00.373409+0000","last_clean":"2023-11-28T20:39:00.373409+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:39:00.373409+0000","last_undegraded":"2023-11-28T20:39:00.373409+0000","last_fullsized":"2023-11-28T20:39:00.373409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.343810+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:24.343810+0000","last_peered":"2023-11-28T20:38:24.343810+0000","last_clean":"2023-11-28T20:38:24.343810+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:24.343810+0000","last_undegraded":"2023-11-28T20:38:24.343810+0000","last_fullsized":"2023-11-28T20:38:24.343810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608237+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:51.608237+0000","last_peered":"2023-11-28T20:38:51.608237+0000","last_clean":"2023-11-28T20:38:51.608237+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:51.608237+0000","last_undegraded":"2023-11-28T20:38:51.608237+0000","last_fullsized":"2023-11-28T20:38:51.608237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439136+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:25.439136+0000","last_peered":"2023-11-28T20:38:25.439136+0000","last_clean":"2023-11-28T20:38:25.439136+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:25.439136+0000","last_undegraded":"2023-11-28T20:38:25.439136+0000","last_fullsized":"2023-11-28T20:38:25.439136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555061+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:38:23.555061+0000","last_peered":"2023-11-28T20:38:23.555061+0000","last_clean":"2023-11-28T20:38:23.555061+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:38:23.555061+0000","last_undegraded":"2023-11-28T20:38:23.555061+0000","last_fullsized":"2023-11-28T20:38:23.555061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608459+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:51.608459+0000","last_peered":"2023-11-28T20:38:51.608459+0000","last_clean":"2023-11-28T20:38:51.608459+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:51.608459+0000","last_undegraded":"2023-11-28T20:38:51.608459+0000","last_fullsized":"2023-11-28T20:38:51.608459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528002+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:24.528002+0000","last_peered":"2023-11-28T20:38:24.528002+0000","last_clean":"2023-11-28T20:38:24.528002+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:24.528002+0000","last_undegraded":"2023-11-28T20:38:24.528002+0000","last_fullsized":"2023-11-28T20:38:24.528002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441545+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:25.441545+0000","last_peered":"2023-11-28T20:38:25.441545+0000","last_clean":"2023-11-28T20:38:25.441545+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:25.441545+0000","last_undegraded":"2023-11-28T20:38:25.441545+0000","last_fullsized":"2023-11-28T20:38:25.441545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528152+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:24.528152+0000","last_peered":"2023-11-28T20:38:24.528152+0000","last_clean":"2023-11-28T20:38:24.528152+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:24.528152+0000","last_undegraded":"2023-11-28T20:38:24.528152+0000","last_fullsized":"2023-11-28T20:38:24.528152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607747+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:38:51.607747+0000","last_peered":"2023-11-28T20:38:51.607747+0000","last_clean":"2023-11-28T20:38:51.607747+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:38:51.607747+0000","last_undegraded":"2023-11-28T20:38:51.607747+0000","last_fullsized":"2023-11-28T20:38:51.607747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441453+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:25.441453+0000","last_peered":"2023-11-28T20:38:25.441453+0000","last_clean":"2023-11-28T20:38:25.441453+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:25.441453+0000","last_undegraded":"2023-11-28T20:38:25.441453+0000","last_fullsized":"2023-11-28T20:38:25.441453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350421+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:24.350421+0000","last_peered":"2023-11-28T20:38:24.350421+0000","last_clean":"2023-11-28T20:38:24.350421+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:24.350421+0000","last_undegraded":"2023-11-28T20:38:24.350421+0000","last_fullsized":"2023-11-28T20:38:24.350421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372659+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:39:00.372659+0000","last_peered":"2023-11-28T20:39:00.372659+0000","last_clean":"2023-11-28T20:39:00.372659+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:39:00.372659+0000","last_undegraded":"2023-11-28T20:39:00.372659+0000","last_fullsized":"2023-11-28T20:39:00.372659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439079+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:25.439079+0000","last_peered":"2023-11-28T20:38:25.439079+0000","last_clean":"2023-11-28T20:38:25.439079+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:25.439079+0000","last_undegraded":"2023-11-28T20:38:25.439079+0000","last_fullsized":"2023-11-28T20:38:25.439079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531147+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:24.531147+0000","last_peered":"2023-11-28T20:38:24.531147+0000","last_clean":"2023-11-28T20:38:24.531147+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:24.531147+0000","last_undegraded":"2023-11-28T20:38:24.531147+0000","last_fullsized":"2023-11-28T20:38:24.531147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532302+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:38:24.532302+0000","last_peered":"2023-11-28T20:38:24.532302+0000","last_clean":"2023-11-28T20:38:24.532302+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:38:24.532302+0000","last_undegraded":"2023-11-28T20:38:24.532302+0000","last_fullsized":"2023-11-28T20:38:24.532302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446714+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:25.446714+0000","last_peered":"2023-11-28T20:38:25.446714+0000","last_clean":"2023-11-28T20:38:25.446714+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:25.446714+0000","last_undegraded":"2023-11-28T20:38:25.446714+0000","last_fullsized":"2023-11-28T20:38:25.446714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529633+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:24.529633+0000","last_peered":"2023-11-28T20:38:24.529633+0000","last_clean":"2023-11-28T20:38:24.529633+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:24.529633+0000","last_undegraded":"2023-11-28T20:38:24.529633+0000","last_fullsized":"2023-11-28T20:38:24.529633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:56.834824+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:56.834824+0000","last_peered":"2023-11-28T20:38:56.834824+0000","last_clean":"2023-11-28T20:38:56.834824+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:56.834824+0000","last_undegraded":"2023-11-28T20:38:56.834824+0000","last_fullsized":"2023-11-28T20:38:56.834824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445709+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:25.445709+0000","last_peered":"2023-11-28T20:38:25.445709+0000","last_clean":"2023-11-28T20:38:25.445709+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:25.445709+0000","last_undegraded":"2023-11-28T20:38:25.445709+0000","last_fullsized":"2023-11-28T20:38:25.445709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527830+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:24.527830+0000","last_peered":"2023-11-28T20:38:24.527830+0000","last_clean":"2023-11-28T20:38:24.527830+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:24.527830+0000","last_undegraded":"2023-11-28T20:38:24.527830+0000","last_fullsized":"2023-11-28T20:38:24.527830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607963+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:38:51.607963+0000","last_peered":"2023-11-28T20:38:51.607963+0000","last_clean":"2023-11-28T20:38:51.607963+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:38:51.607963+0000","last_undegraded":"2023-11-28T20:38:51.607963+0000","last_fullsized":"2023-11-28T20:38:51.607963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439127+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:25.439127+0000","last_peered":"2023-11-28T20:38:25.439127+0000","last_clean":"2023-11-28T20:38:25.439127+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:25.439127+0000","last_undegraded":"2023-11-28T20:38:25.439127+0000","last_fullsized":"2023-11-28T20:38:25.439127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349743+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:24.349743+0000","last_peered":"2023-11-28T20:38:24.349743+0000","last_clean":"2023-11-28T20:38:24.349743+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:24.349743+0000","last_undegraded":"2023-11-28T20:38:24.349743+0000","last_fullsized":"2023-11-28T20:38:24.349743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.613830+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:51.613830+0000","last_peered":"2023-11-28T20:38:51.613830+0000","last_clean":"2023-11-28T20:38:51.613830+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:51.613830+0000","last_undegraded":"2023-11-28T20:38:51.613830+0000","last_fullsized":"2023-11-28T20:38:51.613830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.525043+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:38:24.525043+0000","last_peered":"2023-11-28T20:38:24.525043+0000","last_clean":"2023-11-28T20:38:24.525043+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:38:24.525043+0000","last_undegraded":"2023-11-28T20:38:24.525043+0000","last_fullsized":"2023-11-28T20:38:24.525043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528018+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:24.528018+0000","last_peered":"2023-11-28T20:38:24.528018+0000","last_clean":"2023-11-28T20:38:24.528018+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:24.528018+0000","last_undegraded":"2023-11-28T20:38:24.528018+0000","last_fullsized":"2023-11-28T20:38:24.528018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.577200+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:45.577200+0000","last_peered":"2023-11-28T20:38:45.577200+0000","last_clean":"2023-11-28T20:38:45.577200+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:45.577200+0000","last_undegraded":"2023-11-28T20:38:45.577200+0000","last_fullsized":"2023-11-28T20:38:45.577200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524484+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.524484+0000","last_peered":"2023-11-28T20:38:24.524484+0000","last_clean":"2023-11-28T20:38:24.524484+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:38:24.524484+0000","last_undegraded":"2023-11-28T20:38:24.524484+0000","last_fullsized":"2023-11-28T20:38:24.524484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344100+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:24.344100+0000","last_peered":"2023-11-28T20:38:24.344100+0000","last_clean":"2023-11-28T20:38:24.344100+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:24.344100+0000","last_undegraded":"2023-11-28T20:38:24.344100+0000","last_fullsized":"2023-11-28T20:38:24.344100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607879+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:51.607879+0000","last_peered":"2023-11-28T20:38:51.607879+0000","last_clean":"2023-11-28T20:38:51.607879+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:51.607879+0000","last_undegraded":"2023-11-28T20:38:51.607879+0000","last_fullsized":"2023-11-28T20:38:51.607879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446949+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:25.446949+0000","last_peered":"2023-11-28T20:38:25.446949+0000","last_clean":"2023-11-28T20:38:25.446949+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:25.446949+0000","last_undegraded":"2023-11-28T20:38:25.446949+0000","last_fullsized":"2023-11-28T20:38:25.446949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527948+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:24.527948+0000","last_peered":"2023-11-28T20:38:24.527948+0000","last_clean":"2023-11-28T20:38:24.527948+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:24.527948+0000","last_undegraded":"2023-11-28T20:38:24.527948+0000","last_fullsized":"2023-11-28T20:38:24.527948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:58.919852+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:58.919852+0000","last_peered":"2023-11-28T20:38:58.919852+0000","last_clean":"2023-11-28T20:38:58.919852+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:58.919852+0000","last_undegraded":"2023-11-28T20:38:58.919852+0000","last_fullsized":"2023-11-28T20:38:58.919852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372497+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:39:00.372497+0000","last_peered":"2023-11-28T20:39:00.372497+0000","last_clean":"2023-11-28T20:39:00.372497+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:39:00.372497+0000","last_undegraded":"2023-11-28T20:39:00.372497+0000","last_fullsized":"2023-11-28T20:39:00.372497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571791+0000","last_change":"2023-11-28T20:38:19.398113+0000","last_active":"2023-11-28T20:38:23.571791+0000","last_peered":"2023-11-28T20:38:23.571791+0000","last_clean":"2023-11-28T20:38:23.571791+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:38:23.571791+0000","last_undegraded":"2023-11-28T20:38:23.571791+0000","last_fullsized":"2023-11-28T20:38:23.571791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:08.187641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372562+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:39:00.372562+0000","last_peered":"2023-11-28T20:39:00.372562+0000","last_clean":"2023-11-28T20:39:00.372562+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:39:00.372562+0000","last_undegraded":"2023-11-28T20:39:00.372562+0000","last_fullsized":"2023-11-28T20:39:00.372562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445985+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:25.445985+0000","last_peered":"2023-11-28T20:38:25.445985+0000","last_clean":"2023-11-28T20:38:25.445985+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:25.445985+0000","last_undegraded":"2023-11-28T20:38:25.445985+0000","last_fullsized":"2023-11-28T20:38:25.445985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344646+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:24.344646+0000","last_peered":"2023-11-28T20:38:24.344646+0000","last_clean":"2023-11-28T20:38:24.344646+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:24.344646+0000","last_undegraded":"2023-11-28T20:38:24.344646+0000","last_fullsized":"2023-11-28T20:38:24.344646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573108+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:45.573108+0000","last_peered":"2023-11-28T20:38:45.573108+0000","last_clean":"2023-11-28T20:38:45.573108+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:45.573108+0000","last_undegraded":"2023-11-28T20:38:45.573108+0000","last_fullsized":"2023-11-28T20:38:45.573108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524020+0000","last_change":"2023-11-28T20:38:23.592734+0000","last_active":"2023-11-28T20:38:24.524020+0000","last_peered":"2023-11-28T20:38:24.524020+0000","last_clean":"2023-11-28T20:38:24.524020+0000","last_became_active":"2023-11-28T20:38:23.592348+0000","last_became_peered":"2023-11-28T20:38:23.592348+0000","last_unstale":"2023-11-28T20:38:24.524020+0000","last_undegraded":"2023-11-28T20:38:24.524020+0000","last_fullsized":"2023-11-28T20:38:24.524020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:11:10.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350686+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:24.350686+0000","last_peered":"2023-11-28T20:38:24.350686+0000","last_clean":"2023-11-28T20:38:24.350686+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:24.350686+0000","last_undegraded":"2023-11-28T20:38:24.350686+0000","last_fullsized":"2023-11-28T20:38:24.350686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574006+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:45.574006+0000","last_peered":"2023-11-28T20:38:45.574006+0000","last_clean":"2023-11-28T20:38:45.574006+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:45.574006+0000","last_undegraded":"2023-11-28T20:38:45.574006+0000","last_fullsized":"2023-11-28T20:38:45.574006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523851+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:38:24.523851+0000","last_peered":"2023-11-28T20:38:24.523851+0000","last_clean":"2023-11-28T20:38:24.523851+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:38:24.523851+0000","last_undegraded":"2023-11-28T20:38:24.523851+0000","last_fullsized":"2023-11-28T20:38:24.523851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439118+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:25.439118+0000","last_peered":"2023-11-28T20:38:25.439118+0000","last_clean":"2023-11-28T20:38:25.439118+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:25.439118+0000","last_undegraded":"2023-11-28T20:38:25.439118+0000","last_fullsized":"2023-11-28T20:38:25.439118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372002+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:39:00.372002+0000","last_peered":"2023-11-28T20:39:00.372002+0000","last_clean":"2023-11-28T20:39:00.372002+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:39:00.372002+0000","last_undegraded":"2023-11-28T20:39:00.372002+0000","last_fullsized":"2023-11-28T20:39:00.372002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.570975+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:45.570975+0000","last_peered":"2023-11-28T20:38:45.570975+0000","last_clean":"2023-11-28T20:38:45.570975+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:45.570975+0000","last_undegraded":"2023-11-28T20:38:45.570975+0000","last_fullsized":"2023-11-28T20:38:45.570975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441612+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:25.441612+0000","last_peered":"2023-11-28T20:38:25.441612+0000","last_clean":"2023-11-28T20:38:25.441612+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:25.441612+0000","last_undegraded":"2023-11-28T20:38:25.441612+0000","last_fullsized":"2023-11-28T20:38:25.441612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556007+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:38:23.556007+0000","last_peered":"2023-11-28T20:38:23.556007+0000","last_clean":"2023-11-28T20:38:23.556007+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:38:23.556007+0000","last_undegraded":"2023-11-28T20:38:23.556007+0000","last_fullsized":"2023-11-28T20:38:23.556007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606505+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:38:51.606505+0000","last_peered":"2023-11-28T20:38:51.606505+0000","last_clean":"2023-11-28T20:38:51.606505+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:38:51.606505+0000","last_undegraded":"2023-11-28T20:38:51.606505+0000","last_fullsized":"2023-11-28T20:38:51.606505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.610690+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:51.610690+0000","last_peered":"2023-11-28T20:38:51.610690+0000","last_clean":"2023-11-28T20:38:51.610690+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:51.610690+0000","last_undegraded":"2023-11-28T20:38:51.610690+0000","last_fullsized":"2023-11-28T20:38:51.610690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344364+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:24.344364+0000","last_peered":"2023-11-28T20:38:24.344364+0000","last_clean":"2023-11-28T20:38:24.344364+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:24.344364+0000","last_undegraded":"2023-11-28T20:38:24.344364+0000","last_fullsized":"2023-11-28T20:38:24.344364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534500+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:38:24.534500+0000","last_peered":"2023-11-28T20:38:24.534500+0000","last_clean":"2023-11-28T20:38:24.534500+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:38:24.534500+0000","last_undegraded":"2023-11-28T20:38:24.534500+0000","last_fullsized":"2023-11-28T20:38:24.534500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.579080+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:38:45.579080+0000","last_peered":"2023-11-28T20:38:45.579080+0000","last_clean":"2023-11-28T20:38:45.579080+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:38:45.579080+0000","last_undegraded":"2023-11-28T20:38:45.579080+0000","last_fullsized":"2023-11-28T20:38:45.579080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529110+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:24.529110+0000","last_peered":"2023-11-28T20:38:24.529110+0000","last_clean":"2023-11-28T20:38:24.529110+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:24.529110+0000","last_undegraded":"2023-11-28T20:38:24.529110+0000","last_fullsized":"2023-11-28T20:38:24.529110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524719+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:38:24.524719+0000","last_peered":"2023-11-28T20:38:24.524719+0000","last_clean":"2023-11-28T20:38:24.524719+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:38:24.524719+0000","last_undegraded":"2023-11-28T20:38:24.524719+0000","last_fullsized":"2023-11-28T20:38:24.524719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349566+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:24.349566+0000","last_peered":"2023-11-28T20:38:24.349566+0000","last_clean":"2023-11-28T20:38:24.349566+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:24.349566+0000","last_undegraded":"2023-11-28T20:38:24.349566+0000","last_fullsized":"2023-11-28T20:38:24.349566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579796+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:38:23.579796+0000","last_peered":"2023-11-28T20:38:23.579796+0000","last_clean":"2023-11-28T20:38:23.579796+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:38:23.579796+0000","last_undegraded":"2023-11-28T20:38:23.579796+0000","last_fullsized":"2023-11-28T20:38:23.579796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349192+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:24.349192+0000","last_peered":"2023-11-28T20:38:24.349192+0000","last_clean":"2023-11-28T20:38:24.349192+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:24.349192+0000","last_undegraded":"2023-11-28T20:38:24.349192+0000","last_fullsized":"2023-11-28T20:38:24.349192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344288+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:24.344288+0000","last_peered":"2023-11-28T20:38:24.344288+0000","last_clean":"2023-11-28T20:38:24.344288+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:24.344288+0000","last_undegraded":"2023-11-28T20:38:24.344288+0000","last_fullsized":"2023-11-28T20:38:24.344288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556118+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:38:23.556118+0000","last_peered":"2023-11-28T20:38:23.556118+0000","last_clean":"2023-11-28T20:38:23.556118+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:38:23.556118+0000","last_undegraded":"2023-11-28T20:38:23.556118+0000","last_fullsized":"2023-11-28T20:38:23.556118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372406+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:39:00.372406+0000","last_peered":"2023-11-28T20:39:00.372406+0000","last_clean":"2023-11-28T20:39:00.372406+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:39:00.372406+0000","last_undegraded":"2023-11-28T20:39:00.372406+0000","last_fullsized":"2023-11-28T20:39:00.372406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351931+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:24.351931+0000","last_peered":"2023-11-28T20:38:24.351931+0000","last_clean":"2023-11-28T20:38:24.351931+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:24.351931+0000","last_undegraded":"2023-11-28T20:38:24.351931+0000","last_fullsized":"2023-11-28T20:38:24.351931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556268+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:38:23.556268+0000","last_peered":"2023-11-28T20:38:23.556268+0000","last_clean":"2023-11-28T20:38:23.556268+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:38:23.556268+0000","last_undegraded":"2023-11-28T20:38:23.556268+0000","last_fullsized":"2023-11-28T20:38:23.556268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348638+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:24.348638+0000","last_peered":"2023-11-28T20:38:24.348638+0000","last_clean":"2023-11-28T20:38:24.348638+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:24.348638+0000","last_undegraded":"2023-11-28T20:38:24.348638+0000","last_fullsized":"2023-11-28T20:38:24.348638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555549+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:38:23.555549+0000","last_peered":"2023-11-28T20:38:23.555549+0000","last_clean":"2023-11-28T20:38:23.555549+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:38:23.555549+0000","last_undegraded":"2023-11-28T20:38:23.555549+0000","last_fullsized":"2023-11-28T20:38:23.555549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559455+0000","last_change":"2023-11-28T20:38:19.391161+0000","last_active":"2023-11-28T20:38:23.559455+0000","last_peered":"2023-11-28T20:38:23.559455+0000","last_clean":"2023-11-28T20:38:23.559455+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:38:23.559455+0000","last_undegraded":"2023-11-28T20:38:23.559455+0000","last_fullsized":"2023-11-28T20:38:23.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:29.088707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344051+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:24.344051+0000","last_peered":"2023-11-28T20:38:24.344051+0000","last_clean":"2023-11-28T20:38:24.344051+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:24.344051+0000","last_undegraded":"2023-11-28T20:38:24.344051+0000","last_fullsized":"2023-11-28T20:38:24.344051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351494+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:24.351494+0000","last_peered":"2023-11-28T20:38:24.351494+0000","last_clean":"2023-11-28T20:38:24.351494+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:24.351494+0000","last_undegraded":"2023-11-28T20:38:24.351494+0000","last_fullsized":"2023-11-28T20:38:24.351494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528399+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:24.528399+0000","last_peered":"2023-11-28T20:38:24.528399+0000","last_clean":"2023-11-28T20:38:24.528399+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:24.528399+0000","last_undegraded":"2023-11-28T20:38:24.528399+0000","last_fullsized":"2023-11-28T20:38:24.528399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.583087+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:38:23.583087+0000","last_peered":"2023-11-28T20:38:23.583087+0000","last_clean":"2023-11-28T20:38:23.583087+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:38:23.583087+0000","last_undegraded":"2023-11-28T20:38:23.583087+0000","last_fullsized":"2023-11-28T20:38:23.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351592+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:24.351592+0000","last_peered":"2023-11-28T20:38:24.351592+0000","last_clean":"2023-11-28T20:38:24.351592+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:24.351592+0000","last_undegraded":"2023-11-28T20:38:24.351592+0000","last_fullsized":"2023-11-28T20:38:24.351592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348427+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:24.348427+0000","last_peered":"2023-11-28T20:38:24.348427+0000","last_clean":"2023-11-28T20:38:24.348427+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:24.348427+0000","last_undegraded":"2023-11-28T20:38:24.348427+0000","last_fullsized":"2023-11-28T20:38:24.348427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371998+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:39:00.371998+0000","last_peered":"2023-11-28T20:39:00.371998+0000","last_clean":"2023-11-28T20:39:00.371998+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:39:00.371998+0000","last_undegraded":"2023-11-28T20:39:00.371998+0000","last_fullsized":"2023-11-28T20:39:00.371998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344015+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:24.344015+0000","last_peered":"2023-11-28T20:38:24.344015+0000","last_clean":"2023-11-28T20:38:24.344015+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:24.344015+0000","last_undegraded":"2023-11-28T20:38:24.344015+0000","last_fullsized":"2023-11-28T20:38:24.344015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556123+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:38:23.556123+0000","last_peered":"2023-11-28T20:38:23.556123+0000","last_clean":"2023-11-28T20:38:23.556123+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:38:23.556123+0000","last_undegraded":"2023-11-28T20:38:23.556123+0000","last_fullsized":"2023-11-28T20:38:23.556123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529932+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:24.529932+0000","last_peered":"2023-11-28T20:38:24.529932+0000","last_clean":"2023-11-28T20:38:24.529932+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:24.529932+0000","last_undegraded":"2023-11-28T20:38:24.529932+0000","last_fullsized":"2023-11-28T20:38:24.529932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351455+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:24.351455+0000","last_peered":"2023-11-28T20:38:24.351455+0000","last_clean":"2023-11-28T20:38:24.351455+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:24.351455+0000","last_undegraded":"2023-11-28T20:38:24.351455+0000","last_fullsized":"2023-11-28T20:38:24.351455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:24.351828+0000","last_change":"2023-11-28T20:39:00.374712+0000","last_active":"2023-11-28T20:39:00.374712+0000","last_peered":"2023-11-28T20:38:24.351828+0000","last_clean":"2023-11-28T20:38:24.351828+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:24.351828+0000","last_undegraded":"2023-11-28T20:38:24.351828+0000","last_fullsized":"2023-11-28T20:38:24.351828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530905+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:24.530905+0000","last_peered":"2023-11-28T20:38:24.530905+0000","last_clean":"2023-11-28T20:38:24.530905+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:24.530905+0000","last_undegraded":"2023-11-28T20:38:24.530905+0000","last_fullsized":"2023-11-28T20:38:24.530905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.554837+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:38:23.554837+0000","last_peered":"2023-11-28T20:38:23.554837+0000","last_clean":"2023-11-28T20:38:23.554837+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:38:23.554837+0000","last_undegraded":"2023-11-28T20:38:23.554837+0000","last_fullsized":"2023-11-28T20:38:23.554837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527751+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:24.527751+0000","last_peered":"2023-11-28T20:38:24.527751+0000","last_clean":"2023-11-28T20:38:24.527751+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:24.527751+0000","last_undegraded":"2023-11-28T20:38:24.527751+0000","last_fullsized":"2023-11-28T20:38:24.527751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348972+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:24.348972+0000","last_peered":"2023-11-28T20:38:24.348972+0000","last_clean":"2023-11-28T20:38:24.348972+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:24.348972+0000","last_undegraded":"2023-11-28T20:38:24.348972+0000","last_fullsized":"2023-11-28T20:38:24.348972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527847+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:24.527847+0000","last_peered":"2023-11-28T20:38:24.527847+0000","last_clean":"2023-11-28T20:38:24.527847+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:24.527847+0000","last_undegraded":"2023-11-28T20:38:24.527847+0000","last_fullsized":"2023-11-28T20:38:24.527847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350257+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:24.350257+0000","last_peered":"2023-11-28T20:38:24.350257+0000","last_clean":"2023-11-28T20:38:24.350257+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:24.350257+0000","last_undegraded":"2023-11-28T20:38:24.350257+0000","last_fullsized":"2023-11-28T20:38:24.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344441+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:24.344441+0000","last_peered":"2023-11-28T20:38:24.344441+0000","last_clean":"2023-11-28T20:38:24.344441+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:24.344441+0000","last_undegraded":"2023-11-28T20:38:24.344441+0000","last_fullsized":"2023-11-28T20:38:24.344441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373007+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:39:00.373007+0000","last_peered":"2023-11-28T20:39:00.373007+0000","last_clean":"2023-11-28T20:39:00.373007+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:39:00.373007+0000","last_undegraded":"2023-11-28T20:39:00.373007+0000","last_fullsized":"2023-11-28T20:39:00.373007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530439+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:24.530439+0000","last_peered":"2023-11-28T20:38:24.530439+0000","last_clean":"2023-11-28T20:38:24.530439+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:24.530439+0000","last_undegraded":"2023-11-28T20:38:24.530439+0000","last_fullsized":"2023-11-28T20:38:24.530439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7705,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":102843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":693709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":693053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:39:01.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:39:01.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.880+0000 7f3ec1772640 1 Processor -- start 2023-11-28T20:39:01.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.880+0000 7f3ec1772640 1 -- start start 2023-11-28T20:39:01.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.880+0000 7f3ec1772640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3ebc06e030 0x7f3ebc1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.880+0000 7f3ec1772640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc072630 0x7f3ebc1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.880+0000 7f3ec1772640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc1571d0 con 0x7f3ebc070480 2023-11-28T20:39:01.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.880+0000 7f3ec1772640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ebc071a90 con 0x7f3ebc06e030 2023-11-28T20:39:01.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.880+0000 7f3ec1772640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0c70d0 con 0x7f3ebc072630 2023-11-28T20:39:01.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eb3fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3ebc070480 0x7f3ebc071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50206/0 (socket says 172.21.15.167:50206) 2023-11-28T20:39:01.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eb3fff640 1 -- 172.21.15.167:0/2852419701 learned_addr learned my addr 172.21.15.167:0/2852419701 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:01.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3ebaffd640 1 --2- 172.21.15.167:0/2852419701 >> v2:172.21.15.178:3300/0 conn(0x7f3ebc06e030 0x7f3ebc1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3ebb7fe640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc072630 0x7f3ebc1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423015211 0 0) 0x7f3ebc1571d0 con 0x7f3ebc070480 2023-11-28T20:39:01.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea8003530 con 0x7f3ebc070480 2023-11-28T20:39:01.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1417013089 0 0) 0x7f3ea8003530 con 0x7f3ebc070480 2023-11-28T20:39:01.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc072630 msgr2=0x7f3ebc1505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:01.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc072630 0x7f3ebc1505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 >> v2:172.21.15.178:3300/0 conn(0x7f3ebc06e030 msgr2=0x7f3ebc1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:01.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 --2- 172.21.15.167:0/2852419701 >> v2:172.21.15.178:3300/0 conn(0x7f3ebc06e030 0x7f3ebc1500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0c73b0 con 0x7f3ebc070480 2023-11-28T20:39:01.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f3ea4001680 con 0x7f3ebc070480 2023-11-28T20:39:01.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 >> v1:172.21.15.167:6789/0 conn(0x7f3ebc070480 legacy=0x7f3ebc071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ea8003980 0x7f3ea8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea80047d0 0x7f3ea8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc072630 0x7f3ea8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc071a90 con 0x7f3ea8003980 2023-11-28T20:39:01.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0c70d0 con 0x7f3ea80047d0 2023-11-28T20:39:01.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea800b990 con 0x7f3ebc072630 2023-11-28T20:39:01.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3ebaffd640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ea8003980 0x7f3ea8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3ebb7fe640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc072630 0x7f3ea8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3eb3fff640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea80047d0 0x7f3ea8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3ebaffd640 1 -- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc072630 msgr2=0x7f3ea8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:01.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3ebaffd640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc072630 0x7f3ea8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3ebaffd640 1 -- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea80047d0 msgr2=0x7f3ea8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:01.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3ebaffd640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea80047d0 0x7f3ea8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.884+0000 7f3ebaffd640 1 -- 172.21.15.167:0/2852419701 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8003530 con 0x7f3ea8003980 2023-11-28T20:39:01.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ebaffd640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ea8003980 0x7f3ea8003da0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009ae0 tx=0x7f3eac01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a630aadef184391f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:01.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0a5550 con 0x7f3ea8003980 2023-11-28T20:39:01.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac0a56b0 con 0x7f3ea8003980 2023-11-28T20:39:01.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3eba7fc640 1 -- 172.21.15.167:0/2852419701 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0a5a60 con 0x7f3ea8003980 2023-11-28T20:39:01.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ec1772640 1 -- 172.21.15.167:0/2852419701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ea8003980 msgr2=0x7f3ea8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ec1772640 1 --2- 172.21.15.167:0/2852419701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ea8003980 0x7f3ea8003da0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009ae0 tx=0x7f3eac01ca60 comp rx=0 tx=0).stop 2023-11-28T20:39:01.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ebb7fe640 1 -- 172.21.15.167:0/2852419701 reap_dead start 2023-11-28T20:39:01.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ec1772640 1 -- 172.21.15.167:0/2852419701 shutdown_connections 2023-11-28T20:39:01.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ec1772640 1 -- 172.21.15.167:0/2852419701 >> 172.21.15.167:0/2852419701 conn(0x7f3ebc0cb1e0 msgr2=0x7f3ebc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:01.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ec1772640 1 -- 172.21.15.167:0/2852419701 shutdown_connections 2023-11-28T20:39:01.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ec1772640 1 -- 172.21.15.167:0/2852419701 wait complete. 2023-11-28T20:39:01.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ec1772640 1 Processor -- start 2023-11-28T20:39:01.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.888+0000 7f3ec1772640 1 -- start start 2023-11-28T20:39:01.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ec1772640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea8003980 0x7f3ebc159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ec1772640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc0cab20 0x7f3ebc144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ec1772640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ebc1550d0 0x7f3ebc145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ec1772640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc1573b0 con 0x7f3ebc1550d0 2023-11-28T20:39:01.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ec1772640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc155730 con 0x7f3ea8003980 2023-11-28T20:39:01.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ec1772640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc1559f0 con 0x7f3ebc0cab20 2023-11-28T20:39:01.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ebc1550d0 0x7f3ebc145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ebc1550d0 0x7f3ebc145440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45970/0 (socket says 172.21.15.167:45970) 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebb7fe640 1 -- 172.21.15.167:0/4075723814 learned_addr learned my addr 172.21.15.167:0/4075723814 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebaffd640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea8003980 0x7f3ebc159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3eb3fff640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc0cab20 0x7f3ebc144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebb7fe640 1 -- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc0cab20 msgr2=0x7f3ebc144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebb7fe640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc0cab20 0x7f3ebc144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebb7fe640 1 -- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea8003980 msgr2=0x7f3ebc159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebb7fe640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea8003980 0x7f3ebc159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebb7fe640 1 -- 172.21.15.167:0/4075723814 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc155cd0 con 0x7f3ebc1550d0 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ebb7fe640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ebc1550d0 0x7f3ebc145440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0c9090 tx=0x7f3eb40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:01.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3eb37fe640 1 -- 172.21.15.167:0/4075723814 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400e070 con 0x7f3ebc1550d0 2023-11-28T20:39:01.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3eb37fe640 1 -- 172.21.15.167:0/4075723814 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb4011e50 con 0x7f3ebc1550d0 2023-11-28T20:39:01.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3eb37fe640 1 -- 172.21.15.167:0/4075723814 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40039a0 con 0x7f3ebc1550d0 2023-11-28T20:39:01.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc157600 con 0x7f3ebc1550d0 2023-11-28T20:39:01.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc14f8f0 con 0x7f3ebc1550d0 2023-11-28T20:39:01.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc0682c0 con 0x7f3ebc1550d0 2023-11-28T20:39:01.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.892+0000 7f3eb37fe640 1 -- 172.21.15.167:0/4075723814 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3eb4003b00 con 0x7f3ebc1550d0 2023-11-28T20:39:01.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.896+0000 7f3eb37fe640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e9c0664a0 0x7f3e9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:01.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.896+0000 7f3eb37fe640 1 -- 172.21.15.167:0/4075723814 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3eb4084810 con 0x7f3ebc1550d0 2023-11-28T20:39:01.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.896+0000 7f3ebaffd640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e9c0664a0 0x7f3e9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:01.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.896+0000 7f3ebaffd640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e9c0664a0 0x7f3e9c068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0af000 tx=0x7f3eac0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:01.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:01.900+0000 7f3eb37fe640 1 -- 172.21.15.167:0/4075723814 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3eb40518c0 con 0x7f3ebc1550d0 2023-11-28T20:39:02.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.044+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ebc074750 con 0x7f3e9c0664a0 2023-11-28T20:39:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.072+0000 7f3eb37fe640 1 -- 172.21.15.167:0/4075723814 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345313 (secure 0 0 0) 0x7f3ebc074750 con 0x7f3e9c0664a0 2023-11-28T20:39:02.078 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:02.080 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:39:02.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e9c0664a0 msgr2=0x7f3e9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e9c0664a0 0x7f3e9c068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0af000 tx=0x7f3eac0046d0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ebc1550d0 msgr2=0x7f3ebc145440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ebc1550d0 0x7f3ebc145440 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0c9090 tx=0x7f3eb40115a0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 shutdown_connections 2023-11-28T20:39:02.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e9c0664a0 0x7f3e9c068960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ebc1550d0 0x7f3ebc145440 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ebc0cab20 0x7f3ebc144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 --2- 172.21.15.167:0/4075723814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea8003980 0x7f3ebc159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 >> 172.21.15.167:0/4075723814 conn(0x7f3ebc0cb1e0 msgr2=0x7f3ebc0c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:02.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 shutdown_connections 2023-11-28T20:39:02.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.076+0000 7f3ec1772640 1 -- 172.21.15.167:0/4075723814 wait complete. 2023-11-28T20:39:02.097 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2023-11-28T20:39:01.444532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598073,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":289,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236120,"kb_used_data":3348,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738600,"statfs":{"total":773094113280,"available":772852326400,"internally_reserved":0,"allocated":3428352,"data_stored":2019158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1660,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003135"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.609165+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:51.609165+0000","last_peered":"2023-11-28T20:38:51.609165+0000","last_clean":"2023-11-28T20:38:51.609165+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:51.609165+0000","last_undegraded":"2023-11-28T20:38:51.609165+0000","last_fullsized":"2023-11-28T20:38:51.609165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.390144+0000","last_change":"2023-11-28T20:39:01.387644+0000","last_active":"2023-11-28T20:39:01.390144+0000","last_peered":"2023-11-28T20:39:01.390144+0000","last_clean":"2023-11-28T20:39:01.390144+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T20:39:01.390144+0000","last_undegraded":"2023-11-28T20:39:01.390144+0000","last_fullsized":"2023-11-28T20:39:01.390144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:52.977080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523700+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:38:24.523700+0000","last_peered":"2023-11-28T20:38:24.523700+0000","last_clean":"2023-11-28T20:38:24.523700+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:38:24.523700+0000","last_undegraded":"2023-11-28T20:38:24.523700+0000","last_fullsized":"2023-11-28T20:38:24.523700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530236+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:38:24.530236+0000","last_peered":"2023-11-28T20:38:24.530236+0000","last_clean":"2023-11-28T20:38:24.530236+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:38:24.530236+0000","last_undegraded":"2023-11-28T20:38:24.530236+0000","last_fullsized":"2023-11-28T20:38:24.530236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344550+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:24.344550+0000","last_peered":"2023-11-28T20:38:24.344550+0000","last_clean":"2023-11-28T20:38:24.344550+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:24.344550+0000","last_undegraded":"2023-11-28T20:38:24.344550+0000","last_fullsized":"2023-11-28T20:38:24.344550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:25.445649+0000","last_change":"2023-11-28T20:39:00.368426+0000","last_active":"2023-11-28T20:39:00.368426+0000","last_peered":"2023-11-28T20:38:25.445649+0000","last_clean":"2023-11-28T20:38:25.445649+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:25.445649+0000","last_undegraded":"2023-11-28T20:38:25.445649+0000","last_fullsized":"2023-11-28T20:38:25.445649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606601+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:51.606601+0000","last_peered":"2023-11-28T20:38:51.606601+0000","last_clean":"2023-11-28T20:38:51.606601+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:51.606601+0000","last_undegraded":"2023-11-28T20:38:51.606601+0000","last_fullsized":"2023-11-28T20:38:51.606601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350728+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:24.350728+0000","last_peered":"2023-11-28T20:38:24.350728+0000","last_clean":"2023-11-28T20:38:24.350728+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:24.350728+0000","last_undegraded":"2023-11-28T20:38:24.350728+0000","last_fullsized":"2023-11-28T20:38:24.350728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445936+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:25.445936+0000","last_peered":"2023-11-28T20:38:25.445936+0000","last_clean":"2023-11-28T20:38:25.445936+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:25.445936+0000","last_undegraded":"2023-11-28T20:38:25.445936+0000","last_fullsized":"2023-11-28T20:38:25.445936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532409+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532409+0000","last_peered":"2023-11-28T20:38:24.532409+0000","last_clean":"2023-11-28T20:38:24.532409+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532409+0000","last_undegraded":"2023-11-28T20:38:24.532409+0000","last_fullsized":"2023-11-28T20:38:24.532409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350514+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:24.350514+0000","last_peered":"2023-11-28T20:38:24.350514+0000","last_clean":"2023-11-28T20:38:24.350514+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:24.350514+0000","last_undegraded":"2023-11-28T20:38:24.350514+0000","last_fullsized":"2023-11-28T20:38:24.350514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445855+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:25.445855+0000","last_peered":"2023-11-28T20:38:25.445855+0000","last_clean":"2023-11-28T20:38:25.445855+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:25.445855+0000","last_undegraded":"2023-11-28T20:38:25.445855+0000","last_fullsized":"2023-11-28T20:38:25.445855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350262+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:24.350262+0000","last_peered":"2023-11-28T20:38:24.350262+0000","last_clean":"2023-11-28T20:38:24.350262+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:24.350262+0000","last_undegraded":"2023-11-28T20:38:24.350262+0000","last_fullsized":"2023-11-28T20:38:24.350262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575295+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:45.575295+0000","last_peered":"2023-11-28T20:38:45.575295+0000","last_clean":"2023-11-28T20:38:45.575295+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:45.575295+0000","last_undegraded":"2023-11-28T20:38:45.575295+0000","last_fullsized":"2023-11-28T20:38:45.575295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446173+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:25.446173+0000","last_peered":"2023-11-28T20:38:25.446173+0000","last_clean":"2023-11-28T20:38:25.446173+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:25.446173+0000","last_undegraded":"2023-11-28T20:38:25.446173+0000","last_fullsized":"2023-11-28T20:38:25.446173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556220+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:38:23.556220+0000","last_peered":"2023-11-28T20:38:23.556220+0000","last_clean":"2023-11-28T20:38:23.556220+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:38:23.556220+0000","last_undegraded":"2023-11-28T20:38:23.556220+0000","last_fullsized":"2023-11-28T20:38:23.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372769+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:39:00.372769+0000","last_peered":"2023-11-28T20:39:00.372769+0000","last_clean":"2023-11-28T20:39:00.372769+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:39:00.372769+0000","last_undegraded":"2023-11-28T20:39:00.372769+0000","last_fullsized":"2023-11-28T20:39:00.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446061+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:25.446061+0000","last_peered":"2023-11-28T20:38:25.446061+0000","last_clean":"2023-11-28T20:38:25.446061+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:25.446061+0000","last_undegraded":"2023-11-28T20:38:25.446061+0000","last_fullsized":"2023-11-28T20:38:25.446061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556959+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:38:23.556959+0000","last_peered":"2023-11-28T20:38:23.556959+0000","last_clean":"2023-11-28T20:38:23.556959+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:38:23.556959+0000","last_undegraded":"2023-11-28T20:38:23.556959+0000","last_fullsized":"2023-11-28T20:38:23.556959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372086+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:39:00.372086+0000","last_peered":"2023-11-28T20:39:00.372086+0000","last_clean":"2023-11-28T20:39:00.372086+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:39:00.372086+0000","last_undegraded":"2023-11-28T20:39:00.372086+0000","last_fullsized":"2023-11-28T20:39:00.372086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373087+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.373087+0000","last_peered":"2023-11-28T20:39:00.373087+0000","last_clean":"2023-11-28T20:39:00.373087+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:39:00.373087+0000","last_undegraded":"2023-11-28T20:39:00.373087+0000","last_fullsized":"2023-11-28T20:39:00.373087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528774+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:24.528774+0000","last_peered":"2023-11-28T20:38:24.528774+0000","last_clean":"2023-11-28T20:38:24.528774+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:24.528774+0000","last_undegraded":"2023-11-28T20:38:24.528774+0000","last_fullsized":"2023-11-28T20:38:24.528774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575123+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:45.575123+0000","last_peered":"2023-11-28T20:38:45.575123+0000","last_clean":"2023-11-28T20:38:45.575123+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:45.575123+0000","last_undegraded":"2023-11-28T20:38:45.575123+0000","last_fullsized":"2023-11-28T20:38:45.575123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446227+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:25.446227+0000","last_peered":"2023-11-28T20:38:25.446227+0000","last_clean":"2023-11-28T20:38:25.446227+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:25.446227+0000","last_undegraded":"2023-11-28T20:38:25.446227+0000","last_fullsized":"2023-11-28T20:38:25.446227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344675+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:24.344675+0000","last_peered":"2023-11-28T20:38:24.344675+0000","last_clean":"2023-11-28T20:38:24.344675+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:24.344675+0000","last_undegraded":"2023-11-28T20:38:24.344675+0000","last_fullsized":"2023-11-28T20:38:24.344675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573711+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:45.573711+0000","last_peered":"2023-11-28T20:38:45.573711+0000","last_clean":"2023-11-28T20:38:45.573711+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:45.573711+0000","last_undegraded":"2023-11-28T20:38:45.573711+0000","last_fullsized":"2023-11-28T20:38:45.573711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445762+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:25.445762+0000","last_peered":"2023-11-28T20:38:25.445762+0000","last_clean":"2023-11-28T20:38:25.445762+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:25.445762+0000","last_undegraded":"2023-11-28T20:38:25.445762+0000","last_fullsized":"2023-11-28T20:38:25.445762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556394+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:38:23.556394+0000","last_peered":"2023-11-28T20:38:23.556394+0000","last_clean":"2023-11-28T20:38:23.556394+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:38:23.556394+0000","last_undegraded":"2023-11-28T20:38:23.556394+0000","last_fullsized":"2023-11-28T20:38:23.556394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373110+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:39:00.373110+0000","last_peered":"2023-11-28T20:39:00.373110+0000","last_clean":"2023-11-28T20:39:00.373110+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:39:00.373110+0000","last_undegraded":"2023-11-28T20:39:00.373110+0000","last_fullsized":"2023-11-28T20:39:00.373110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523623+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:38:24.523623+0000","last_peered":"2023-11-28T20:38:24.523623+0000","last_clean":"2023-11-28T20:38:24.523623+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:38:24.523623+0000","last_undegraded":"2023-11-28T20:38:24.523623+0000","last_fullsized":"2023-11-28T20:38:24.523623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372844+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:39:00.372844+0000","last_peered":"2023-11-28T20:39:00.372844+0000","last_clean":"2023-11-28T20:39:00.372844+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:39:00.372844+0000","last_undegraded":"2023-11-28T20:39:00.372844+0000","last_fullsized":"2023-11-28T20:39:00.372844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574343+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:45.574343+0000","last_peered":"2023-11-28T20:38:45.574343+0000","last_clean":"2023-11-28T20:38:45.574343+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:45.574343+0000","last_undegraded":"2023-11-28T20:38:45.574343+0000","last_fullsized":"2023-11-28T20:38:45.574343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439058+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:25.439058+0000","last_peered":"2023-11-28T20:38:25.439058+0000","last_clean":"2023-11-28T20:38:25.439058+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:25.439058+0000","last_undegraded":"2023-11-28T20:38:25.439058+0000","last_fullsized":"2023-11-28T20:38:25.439058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350784+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:24.350784+0000","last_peered":"2023-11-28T20:38:24.350784+0000","last_clean":"2023-11-28T20:38:24.350784+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:24.350784+0000","last_undegraded":"2023-11-28T20:38:24.350784+0000","last_fullsized":"2023-11-28T20:38:24.350784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372929+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:39:00.372929+0000","last_peered":"2023-11-28T20:39:00.372929+0000","last_clean":"2023-11-28T20:39:00.372929+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:39:00.372929+0000","last_undegraded":"2023-11-28T20:39:00.372929+0000","last_fullsized":"2023-11-28T20:39:00.372929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535102+0000","last_change":"2023-11-28T20:38:23.594782+0000","last_active":"2023-11-28T20:38:24.535102+0000","last_peered":"2023-11-28T20:38:24.535102+0000","last_clean":"2023-11-28T20:38:24.535102+0000","last_became_active":"2023-11-28T20:38:23.594034+0000","last_became_peered":"2023-11-28T20:38:23.594034+0000","last_unstale":"2023-11-28T20:38:24.535102+0000","last_undegraded":"2023-11-28T20:38:24.535102+0000","last_fullsized":"2023-11-28T20:38:24.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:29:14.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529967+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:24.529967+0000","last_peered":"2023-11-28T20:38:24.529967+0000","last_clean":"2023-11-28T20:38:24.529967+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:24.529967+0000","last_undegraded":"2023-11-28T20:38:24.529967+0000","last_fullsized":"2023-11-28T20:38:24.529967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608154+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:51.608154+0000","last_peered":"2023-11-28T20:38:51.608154+0000","last_clean":"2023-11-28T20:38:51.608154+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:51.608154+0000","last_undegraded":"2023-11-28T20:38:51.608154+0000","last_fullsized":"2023-11-28T20:38:51.608154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372765+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:39:00.372765+0000","last_peered":"2023-11-28T20:39:00.372765+0000","last_clean":"2023-11-28T20:39:00.372765+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:39:00.372765+0000","last_undegraded":"2023-11-28T20:39:00.372765+0000","last_fullsized":"2023-11-28T20:39:00.372765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373168+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:39:00.373168+0000","last_peered":"2023-11-28T20:39:00.373168+0000","last_clean":"2023-11-28T20:39:00.373168+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:39:00.373168+0000","last_undegraded":"2023-11-28T20:39:00.373168+0000","last_fullsized":"2023-11-28T20:39:00.373168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607572+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:38:51.607572+0000","last_peered":"2023-11-28T20:38:51.607572+0000","last_clean":"2023-11-28T20:38:51.607572+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:38:51.607572+0000","last_undegraded":"2023-11-28T20:38:51.607572+0000","last_fullsized":"2023-11-28T20:38:51.607572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373409+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:39:00.373409+0000","last_peered":"2023-11-28T20:39:00.373409+0000","last_clean":"2023-11-28T20:39:00.373409+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:39:00.373409+0000","last_undegraded":"2023-11-28T20:39:00.373409+0000","last_fullsized":"2023-11-28T20:39:00.373409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.343810+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:24.343810+0000","last_peered":"2023-11-28T20:38:24.343810+0000","last_clean":"2023-11-28T20:38:24.343810+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:24.343810+0000","last_undegraded":"2023-11-28T20:38:24.343810+0000","last_fullsized":"2023-11-28T20:38:24.343810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608237+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:51.608237+0000","last_peered":"2023-11-28T20:38:51.608237+0000","last_clean":"2023-11-28T20:38:51.608237+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:51.608237+0000","last_undegraded":"2023-11-28T20:38:51.608237+0000","last_fullsized":"2023-11-28T20:38:51.608237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439136+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:25.439136+0000","last_peered":"2023-11-28T20:38:25.439136+0000","last_clean":"2023-11-28T20:38:25.439136+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:25.439136+0000","last_undegraded":"2023-11-28T20:38:25.439136+0000","last_fullsized":"2023-11-28T20:38:25.439136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555061+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:38:23.555061+0000","last_peered":"2023-11-28T20:38:23.555061+0000","last_clean":"2023-11-28T20:38:23.555061+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:38:23.555061+0000","last_undegraded":"2023-11-28T20:38:23.555061+0000","last_fullsized":"2023-11-28T20:38:23.555061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608459+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:51.608459+0000","last_peered":"2023-11-28T20:38:51.608459+0000","last_clean":"2023-11-28T20:38:51.608459+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:51.608459+0000","last_undegraded":"2023-11-28T20:38:51.608459+0000","last_fullsized":"2023-11-28T20:38:51.608459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528002+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:24.528002+0000","last_peered":"2023-11-28T20:38:24.528002+0000","last_clean":"2023-11-28T20:38:24.528002+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:24.528002+0000","last_undegraded":"2023-11-28T20:38:24.528002+0000","last_fullsized":"2023-11-28T20:38:24.528002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441545+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:25.441545+0000","last_peered":"2023-11-28T20:38:25.441545+0000","last_clean":"2023-11-28T20:38:25.441545+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:25.441545+0000","last_undegraded":"2023-11-28T20:38:25.441545+0000","last_fullsized":"2023-11-28T20:38:25.441545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528152+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:24.528152+0000","last_peered":"2023-11-28T20:38:24.528152+0000","last_clean":"2023-11-28T20:38:24.528152+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:24.528152+0000","last_undegraded":"2023-11-28T20:38:24.528152+0000","last_fullsized":"2023-11-28T20:38:24.528152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607747+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:38:51.607747+0000","last_peered":"2023-11-28T20:38:51.607747+0000","last_clean":"2023-11-28T20:38:51.607747+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:38:51.607747+0000","last_undegraded":"2023-11-28T20:38:51.607747+0000","last_fullsized":"2023-11-28T20:38:51.607747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441453+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:25.441453+0000","last_peered":"2023-11-28T20:38:25.441453+0000","last_clean":"2023-11-28T20:38:25.441453+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:25.441453+0000","last_undegraded":"2023-11-28T20:38:25.441453+0000","last_fullsized":"2023-11-28T20:38:25.441453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350421+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:24.350421+0000","last_peered":"2023-11-28T20:38:24.350421+0000","last_clean":"2023-11-28T20:38:24.350421+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:24.350421+0000","last_undegraded":"2023-11-28T20:38:24.350421+0000","last_fullsized":"2023-11-28T20:38:24.350421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372659+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:39:00.372659+0000","last_peered":"2023-11-28T20:39:00.372659+0000","last_clean":"2023-11-28T20:39:00.372659+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:39:00.372659+0000","last_undegraded":"2023-11-28T20:39:00.372659+0000","last_fullsized":"2023-11-28T20:39:00.372659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439079+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:25.439079+0000","last_peered":"2023-11-28T20:38:25.439079+0000","last_clean":"2023-11-28T20:38:25.439079+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:25.439079+0000","last_undegraded":"2023-11-28T20:38:25.439079+0000","last_fullsized":"2023-11-28T20:38:25.439079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531147+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:24.531147+0000","last_peered":"2023-11-28T20:38:24.531147+0000","last_clean":"2023-11-28T20:38:24.531147+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:24.531147+0000","last_undegraded":"2023-11-28T20:38:24.531147+0000","last_fullsized":"2023-11-28T20:38:24.531147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532302+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:38:24.532302+0000","last_peered":"2023-11-28T20:38:24.532302+0000","last_clean":"2023-11-28T20:38:24.532302+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:38:24.532302+0000","last_undegraded":"2023-11-28T20:38:24.532302+0000","last_fullsized":"2023-11-28T20:38:24.532302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446714+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:25.446714+0000","last_peered":"2023-11-28T20:38:25.446714+0000","last_clean":"2023-11-28T20:38:25.446714+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:25.446714+0000","last_undegraded":"2023-11-28T20:38:25.446714+0000","last_fullsized":"2023-11-28T20:38:25.446714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529633+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:24.529633+0000","last_peered":"2023-11-28T20:38:24.529633+0000","last_clean":"2023-11-28T20:38:24.529633+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:24.529633+0000","last_undegraded":"2023-11-28T20:38:24.529633+0000","last_fullsized":"2023-11-28T20:38:24.529633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:56.834824+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:56.834824+0000","last_peered":"2023-11-28T20:38:56.834824+0000","last_clean":"2023-11-28T20:38:56.834824+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:56.834824+0000","last_undegraded":"2023-11-28T20:38:56.834824+0000","last_fullsized":"2023-11-28T20:38:56.834824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445709+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:25.445709+0000","last_peered":"2023-11-28T20:38:25.445709+0000","last_clean":"2023-11-28T20:38:25.445709+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:25.445709+0000","last_undegraded":"2023-11-28T20:38:25.445709+0000","last_fullsized":"2023-11-28T20:38:25.445709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527830+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:24.527830+0000","last_peered":"2023-11-28T20:38:24.527830+0000","last_clean":"2023-11-28T20:38:24.527830+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:24.527830+0000","last_undegraded":"2023-11-28T20:38:24.527830+0000","last_fullsized":"2023-11-28T20:38:24.527830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607963+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:38:51.607963+0000","last_peered":"2023-11-28T20:38:51.607963+0000","last_clean":"2023-11-28T20:38:51.607963+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:38:51.607963+0000","last_undegraded":"2023-11-28T20:38:51.607963+0000","last_fullsized":"2023-11-28T20:38:51.607963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439127+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:25.439127+0000","last_peered":"2023-11-28T20:38:25.439127+0000","last_clean":"2023-11-28T20:38:25.439127+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:25.439127+0000","last_undegraded":"2023-11-28T20:38:25.439127+0000","last_fullsized":"2023-11-28T20:38:25.439127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349743+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:24.349743+0000","last_peered":"2023-11-28T20:38:24.349743+0000","last_clean":"2023-11-28T20:38:24.349743+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:24.349743+0000","last_undegraded":"2023-11-28T20:38:24.349743+0000","last_fullsized":"2023-11-28T20:38:24.349743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.613830+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:51.613830+0000","last_peered":"2023-11-28T20:38:51.613830+0000","last_clean":"2023-11-28T20:38:51.613830+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:51.613830+0000","last_undegraded":"2023-11-28T20:38:51.613830+0000","last_fullsized":"2023-11-28T20:38:51.613830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.525043+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:38:24.525043+0000","last_peered":"2023-11-28T20:38:24.525043+0000","last_clean":"2023-11-28T20:38:24.525043+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:38:24.525043+0000","last_undegraded":"2023-11-28T20:38:24.525043+0000","last_fullsized":"2023-11-28T20:38:24.525043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528018+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:24.528018+0000","last_peered":"2023-11-28T20:38:24.528018+0000","last_clean":"2023-11-28T20:38:24.528018+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:24.528018+0000","last_undegraded":"2023-11-28T20:38:24.528018+0000","last_fullsized":"2023-11-28T20:38:24.528018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.577200+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:45.577200+0000","last_peered":"2023-11-28T20:38:45.577200+0000","last_clean":"2023-11-28T20:38:45.577200+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:45.577200+0000","last_undegraded":"2023-11-28T20:38:45.577200+0000","last_fullsized":"2023-11-28T20:38:45.577200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524484+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.524484+0000","last_peered":"2023-11-28T20:38:24.524484+0000","last_clean":"2023-11-28T20:38:24.524484+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:38:24.524484+0000","last_undegraded":"2023-11-28T20:38:24.524484+0000","last_fullsized":"2023-11-28T20:38:24.524484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344100+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:24.344100+0000","last_peered":"2023-11-28T20:38:24.344100+0000","last_clean":"2023-11-28T20:38:24.344100+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:24.344100+0000","last_undegraded":"2023-11-28T20:38:24.344100+0000","last_fullsized":"2023-11-28T20:38:24.344100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607879+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:51.607879+0000","last_peered":"2023-11-28T20:38:51.607879+0000","last_clean":"2023-11-28T20:38:51.607879+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:51.607879+0000","last_undegraded":"2023-11-28T20:38:51.607879+0000","last_fullsized":"2023-11-28T20:38:51.607879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446949+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:25.446949+0000","last_peered":"2023-11-28T20:38:25.446949+0000","last_clean":"2023-11-28T20:38:25.446949+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:25.446949+0000","last_undegraded":"2023-11-28T20:38:25.446949+0000","last_fullsized":"2023-11-28T20:38:25.446949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527948+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:24.527948+0000","last_peered":"2023-11-28T20:38:24.527948+0000","last_clean":"2023-11-28T20:38:24.527948+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:24.527948+0000","last_undegraded":"2023-11-28T20:38:24.527948+0000","last_fullsized":"2023-11-28T20:38:24.527948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:58.919852+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:58.919852+0000","last_peered":"2023-11-28T20:38:58.919852+0000","last_clean":"2023-11-28T20:38:58.919852+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:58.919852+0000","last_undegraded":"2023-11-28T20:38:58.919852+0000","last_fullsized":"2023-11-28T20:38:58.919852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372497+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:39:00.372497+0000","last_peered":"2023-11-28T20:39:00.372497+0000","last_clean":"2023-11-28T20:39:00.372497+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:39:00.372497+0000","last_undegraded":"2023-11-28T20:39:00.372497+0000","last_fullsized":"2023-11-28T20:39:00.372497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571791+0000","last_change":"2023-11-28T20:38:19.398113+0000","last_active":"2023-11-28T20:38:23.571791+0000","last_peered":"2023-11-28T20:38:23.571791+0000","last_clean":"2023-11-28T20:38:23.571791+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:38:23.571791+0000","last_undegraded":"2023-11-28T20:38:23.571791+0000","last_fullsized":"2023-11-28T20:38:23.571791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:08.187641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372562+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:39:00.372562+0000","last_peered":"2023-11-28T20:39:00.372562+0000","last_clean":"2023-11-28T20:39:00.372562+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:39:00.372562+0000","last_undegraded":"2023-11-28T20:39:00.372562+0000","last_fullsized":"2023-11-28T20:39:00.372562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445985+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:25.445985+0000","last_peered":"2023-11-28T20:38:25.445985+0000","last_clean":"2023-11-28T20:38:25.445985+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:25.445985+0000","last_undegraded":"2023-11-28T20:38:25.445985+0000","last_fullsized":"2023-11-28T20:38:25.445985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344646+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:24.344646+0000","last_peered":"2023-11-28T20:38:24.344646+0000","last_clean":"2023-11-28T20:38:24.344646+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:24.344646+0000","last_undegraded":"2023-11-28T20:38:24.344646+0000","last_fullsized":"2023-11-28T20:38:24.344646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573108+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:45.573108+0000","last_peered":"2023-11-28T20:38:45.573108+0000","last_clean":"2023-11-28T20:38:45.573108+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:45.573108+0000","last_undegraded":"2023-11-28T20:38:45.573108+0000","last_fullsized":"2023-11-28T20:38:45.573108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524020+0000","last_change":"2023-11-28T20:38:23.592734+0000","last_active":"2023-11-28T20:38:24.524020+0000","last_peered":"2023-11-28T20:38:24.524020+0000","last_clean":"2023-11-28T20:38:24.524020+0000","last_became_active":"2023-11-28T20:38:23.592348+0000","last_became_peered":"2023-11-28T20:38:23.592348+0000","last_unstale":"2023-11-28T20:38:24.524020+0000","last_undegraded":"2023-11-28T20:38:24.524020+0000","last_fullsized":"2023-11-28T20:38:24.524020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:11:10.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350686+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:24.350686+0000","last_peered":"2023-11-28T20:38:24.350686+0000","last_clean":"2023-11-28T20:38:24.350686+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:24.350686+0000","last_undegraded":"2023-11-28T20:38:24.350686+0000","last_fullsized":"2023-11-28T20:38:24.350686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574006+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:45.574006+0000","last_peered":"2023-11-28T20:38:45.574006+0000","last_clean":"2023-11-28T20:38:45.574006+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:45.574006+0000","last_undegraded":"2023-11-28T20:38:45.574006+0000","last_fullsized":"2023-11-28T20:38:45.574006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523851+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:38:24.523851+0000","last_peered":"2023-11-28T20:38:24.523851+0000","last_clean":"2023-11-28T20:38:24.523851+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:38:24.523851+0000","last_undegraded":"2023-11-28T20:38:24.523851+0000","last_fullsized":"2023-11-28T20:38:24.523851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439118+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:25.439118+0000","last_peered":"2023-11-28T20:38:25.439118+0000","last_clean":"2023-11-28T20:38:25.439118+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:25.439118+0000","last_undegraded":"2023-11-28T20:38:25.439118+0000","last_fullsized":"2023-11-28T20:38:25.439118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372002+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:39:00.372002+0000","last_peered":"2023-11-28T20:39:00.372002+0000","last_clean":"2023-11-28T20:39:00.372002+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:39:00.372002+0000","last_undegraded":"2023-11-28T20:39:00.372002+0000","last_fullsized":"2023-11-28T20:39:00.372002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.570975+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:45.570975+0000","last_peered":"2023-11-28T20:38:45.570975+0000","last_clean":"2023-11-28T20:38:45.570975+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:45.570975+0000","last_undegraded":"2023-11-28T20:38:45.570975+0000","last_fullsized":"2023-11-28T20:38:45.570975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441612+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:25.441612+0000","last_peered":"2023-11-28T20:38:25.441612+0000","last_clean":"2023-11-28T20:38:25.441612+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:25.441612+0000","last_undegraded":"2023-11-28T20:38:25.441612+0000","last_fullsized":"2023-11-28T20:38:25.441612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556007+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:38:23.556007+0000","last_peered":"2023-11-28T20:38:23.556007+0000","last_clean":"2023-11-28T20:38:23.556007+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:38:23.556007+0000","last_undegraded":"2023-11-28T20:38:23.556007+0000","last_fullsized":"2023-11-28T20:38:23.556007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606505+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:38:51.606505+0000","last_peered":"2023-11-28T20:38:51.606505+0000","last_clean":"2023-11-28T20:38:51.606505+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:38:51.606505+0000","last_undegraded":"2023-11-28T20:38:51.606505+0000","last_fullsized":"2023-11-28T20:38:51.606505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.610690+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:51.610690+0000","last_peered":"2023-11-28T20:38:51.610690+0000","last_clean":"2023-11-28T20:38:51.610690+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:51.610690+0000","last_undegraded":"2023-11-28T20:38:51.610690+0000","last_fullsized":"2023-11-28T20:38:51.610690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344364+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:24.344364+0000","last_peered":"2023-11-28T20:38:24.344364+0000","last_clean":"2023-11-28T20:38:24.344364+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:24.344364+0000","last_undegraded":"2023-11-28T20:38:24.344364+0000","last_fullsized":"2023-11-28T20:38:24.344364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534500+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:38:24.534500+0000","last_peered":"2023-11-28T20:38:24.534500+0000","last_clean":"2023-11-28T20:38:24.534500+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:38:24.534500+0000","last_undegraded":"2023-11-28T20:38:24.534500+0000","last_fullsized":"2023-11-28T20:38:24.534500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.579080+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:38:45.579080+0000","last_peered":"2023-11-28T20:38:45.579080+0000","last_clean":"2023-11-28T20:38:45.579080+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:38:45.579080+0000","last_undegraded":"2023-11-28T20:38:45.579080+0000","last_fullsized":"2023-11-28T20:38:45.579080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529110+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:24.529110+0000","last_peered":"2023-11-28T20:38:24.529110+0000","last_clean":"2023-11-28T20:38:24.529110+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:24.529110+0000","last_undegraded":"2023-11-28T20:38:24.529110+0000","last_fullsized":"2023-11-28T20:38:24.529110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524719+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:38:24.524719+0000","last_peered":"2023-11-28T20:38:24.524719+0000","last_clean":"2023-11-28T20:38:24.524719+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:38:24.524719+0000","last_undegraded":"2023-11-28T20:38:24.524719+0000","last_fullsized":"2023-11-28T20:38:24.524719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349566+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:24.349566+0000","last_peered":"2023-11-28T20:38:24.349566+0000","last_clean":"2023-11-28T20:38:24.349566+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:24.349566+0000","last_undegraded":"2023-11-28T20:38:24.349566+0000","last_fullsized":"2023-11-28T20:38:24.349566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579796+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:38:23.579796+0000","last_peered":"2023-11-28T20:38:23.579796+0000","last_clean":"2023-11-28T20:38:23.579796+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:38:23.579796+0000","last_undegraded":"2023-11-28T20:38:23.579796+0000","last_fullsized":"2023-11-28T20:38:23.579796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349192+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:24.349192+0000","last_peered":"2023-11-28T20:38:24.349192+0000","last_clean":"2023-11-28T20:38:24.349192+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:24.349192+0000","last_undegraded":"2023-11-28T20:38:24.349192+0000","last_fullsized":"2023-11-28T20:38:24.349192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344288+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:24.344288+0000","last_peered":"2023-11-28T20:38:24.344288+0000","last_clean":"2023-11-28T20:38:24.344288+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:24.344288+0000","last_undegraded":"2023-11-28T20:38:24.344288+0000","last_fullsized":"2023-11-28T20:38:24.344288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556118+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:38:23.556118+0000","last_peered":"2023-11-28T20:38:23.556118+0000","last_clean":"2023-11-28T20:38:23.556118+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:38:23.556118+0000","last_undegraded":"2023-11-28T20:38:23.556118+0000","last_fullsized":"2023-11-28T20:38:23.556118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372406+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:39:00.372406+0000","last_peered":"2023-11-28T20:39:00.372406+0000","last_clean":"2023-11-28T20:39:00.372406+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:39:00.372406+0000","last_undegraded":"2023-11-28T20:39:00.372406+0000","last_fullsized":"2023-11-28T20:39:00.372406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351931+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:24.351931+0000","last_peered":"2023-11-28T20:38:24.351931+0000","last_clean":"2023-11-28T20:38:24.351931+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:24.351931+0000","last_undegraded":"2023-11-28T20:38:24.351931+0000","last_fullsized":"2023-11-28T20:38:24.351931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556268+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:38:23.556268+0000","last_peered":"2023-11-28T20:38:23.556268+0000","last_clean":"2023-11-28T20:38:23.556268+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:38:23.556268+0000","last_undegraded":"2023-11-28T20:38:23.556268+0000","last_fullsized":"2023-11-28T20:38:23.556268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348638+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:24.348638+0000","last_peered":"2023-11-28T20:38:24.348638+0000","last_clean":"2023-11-28T20:38:24.348638+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:24.348638+0000","last_undegraded":"2023-11-28T20:38:24.348638+0000","last_fullsized":"2023-11-28T20:38:24.348638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555549+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:38:23.555549+0000","last_peered":"2023-11-28T20:38:23.555549+0000","last_clean":"2023-11-28T20:38:23.555549+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:38:23.555549+0000","last_undegraded":"2023-11-28T20:38:23.555549+0000","last_fullsized":"2023-11-28T20:38:23.555549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559455+0000","last_change":"2023-11-28T20:38:19.391161+0000","last_active":"2023-11-28T20:38:23.559455+0000","last_peered":"2023-11-28T20:38:23.559455+0000","last_clean":"2023-11-28T20:38:23.559455+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:38:23.559455+0000","last_undegraded":"2023-11-28T20:38:23.559455+0000","last_fullsized":"2023-11-28T20:38:23.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:29.088707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344051+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:24.344051+0000","last_peered":"2023-11-28T20:38:24.344051+0000","last_clean":"2023-11-28T20:38:24.344051+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:24.344051+0000","last_undegraded":"2023-11-28T20:38:24.344051+0000","last_fullsized":"2023-11-28T20:38:24.344051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351494+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:24.351494+0000","last_peered":"2023-11-28T20:38:24.351494+0000","last_clean":"2023-11-28T20:38:24.351494+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:24.351494+0000","last_undegraded":"2023-11-28T20:38:24.351494+0000","last_fullsized":"2023-11-28T20:38:24.351494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528399+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:24.528399+0000","last_peered":"2023-11-28T20:38:24.528399+0000","last_clean":"2023-11-28T20:38:24.528399+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:24.528399+0000","last_undegraded":"2023-11-28T20:38:24.528399+0000","last_fullsized":"2023-11-28T20:38:24.528399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.583087+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:38:23.583087+0000","last_peered":"2023-11-28T20:38:23.583087+0000","last_clean":"2023-11-28T20:38:23.583087+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:38:23.583087+0000","last_undegraded":"2023-11-28T20:38:23.583087+0000","last_fullsized":"2023-11-28T20:38:23.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351592+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:24.351592+0000","last_peered":"2023-11-28T20:38:24.351592+0000","last_clean":"2023-11-28T20:38:24.351592+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:24.351592+0000","last_undegraded":"2023-11-28T20:38:24.351592+0000","last_fullsized":"2023-11-28T20:38:24.351592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348427+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:24.348427+0000","last_peered":"2023-11-28T20:38:24.348427+0000","last_clean":"2023-11-28T20:38:24.348427+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:24.348427+0000","last_undegraded":"2023-11-28T20:38:24.348427+0000","last_fullsized":"2023-11-28T20:38:24.348427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371998+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:39:00.371998+0000","last_peered":"2023-11-28T20:39:00.371998+0000","last_clean":"2023-11-28T20:39:00.371998+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:39:00.371998+0000","last_undegraded":"2023-11-28T20:39:00.371998+0000","last_fullsized":"2023-11-28T20:39:00.371998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344015+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:24.344015+0000","last_peered":"2023-11-28T20:38:24.344015+0000","last_clean":"2023-11-28T20:38:24.344015+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:24.344015+0000","last_undegraded":"2023-11-28T20:38:24.344015+0000","last_fullsized":"2023-11-28T20:38:24.344015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556123+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:38:23.556123+0000","last_peered":"2023-11-28T20:38:23.556123+0000","last_clean":"2023-11-28T20:38:23.556123+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:38:23.556123+0000","last_undegraded":"2023-11-28T20:38:23.556123+0000","last_fullsized":"2023-11-28T20:38:23.556123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529932+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:24.529932+0000","last_peered":"2023-11-28T20:38:24.529932+0000","last_clean":"2023-11-28T20:38:24.529932+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:24.529932+0000","last_undegraded":"2023-11-28T20:38:24.529932+0000","last_fullsized":"2023-11-28T20:38:24.529932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351455+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:24.351455+0000","last_peered":"2023-11-28T20:38:24.351455+0000","last_clean":"2023-11-28T20:38:24.351455+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:24.351455+0000","last_undegraded":"2023-11-28T20:38:24.351455+0000","last_fullsized":"2023-11-28T20:38:24.351455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:24.351828+0000","last_change":"2023-11-28T20:39:00.374712+0000","last_active":"2023-11-28T20:39:00.374712+0000","last_peered":"2023-11-28T20:38:24.351828+0000","last_clean":"2023-11-28T20:38:24.351828+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:24.351828+0000","last_undegraded":"2023-11-28T20:38:24.351828+0000","last_fullsized":"2023-11-28T20:38:24.351828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530905+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:24.530905+0000","last_peered":"2023-11-28T20:38:24.530905+0000","last_clean":"2023-11-28T20:38:24.530905+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:24.530905+0000","last_undegraded":"2023-11-28T20:38:24.530905+0000","last_fullsized":"2023-11-28T20:38:24.530905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.554837+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:38:23.554837+0000","last_peered":"2023-11-28T20:38:23.554837+0000","last_clean":"2023-11-28T20:38:23.554837+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:38:23.554837+0000","last_undegraded":"2023-11-28T20:38:23.554837+0000","last_fullsized":"2023-11-28T20:38:23.554837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527751+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:24.527751+0000","last_peered":"2023-11-28T20:38:24.527751+0000","last_clean":"2023-11-28T20:38:24.527751+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:24.527751+0000","last_undegraded":"2023-11-28T20:38:24.527751+0000","last_fullsized":"2023-11-28T20:38:24.527751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348972+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:24.348972+0000","last_peered":"2023-11-28T20:38:24.348972+0000","last_clean":"2023-11-28T20:38:24.348972+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:24.348972+0000","last_undegraded":"2023-11-28T20:38:24.348972+0000","last_fullsized":"2023-11-28T20:38:24.348972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527847+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:24.527847+0000","last_peered":"2023-11-28T20:38:24.527847+0000","last_clean":"2023-11-28T20:38:24.527847+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:24.527847+0000","last_undegraded":"2023-11-28T20:38:24.527847+0000","last_fullsized":"2023-11-28T20:38:24.527847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350257+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:24.350257+0000","last_peered":"2023-11-28T20:38:24.350257+0000","last_clean":"2023-11-28T20:38:24.350257+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:24.350257+0000","last_undegraded":"2023-11-28T20:38:24.350257+0000","last_fullsized":"2023-11-28T20:38:24.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344441+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:24.344441+0000","last_peered":"2023-11-28T20:38:24.344441+0000","last_clean":"2023-11-28T20:38:24.344441+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:24.344441+0000","last_undegraded":"2023-11-28T20:38:24.344441+0000","last_fullsized":"2023-11-28T20:38:24.344441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373007+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:39:00.373007+0000","last_peered":"2023-11-28T20:39:00.373007+0000","last_clean":"2023-11-28T20:39:00.373007+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:39:00.373007+0000","last_undegraded":"2023-11-28T20:39:00.373007+0000","last_fullsized":"2023-11-28T20:39:00.373007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530439+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:24.530439+0000","last_peered":"2023-11-28T20:38:24.530439+0000","last_clean":"2023-11-28T20:38:24.530439+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:24.530439+0000","last_undegraded":"2023-11-28T20:38:24.530439+0000","last_fullsized":"2023-11-28T20:38:24.530439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7705,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":102843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":693709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":693053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:39:02.103 INFO:tasks.mon_thrash.ceph_manager:PG 4.18 is not active+clean 2023-11-28T20:39:02.103 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2023-11-28T20:38:25.445649+0000', 'last_change': '2023-11-28T20:39:00.368426+0000', 'last_active': '2023-11-28T20:39:00.368426+0000', 'last_peered': '2023-11-28T20:38:25.445649+0000', 'last_clean': '2023-11-28T20:38:25.445649+0000', 'last_became_active': '2023-11-28T20:38:23.593047+0000', 'last_became_peered': '2023-11-28T20:38:23.593047+0000', 'last_unstale': '2023-11-28T20:38:25.445649+0000', 'last_undegraded': '2023-11-28T20:38:25.445649+0000', 'last_fullsized': '2023-11-28T20:38:25.445649+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 24, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:38:22.532017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:38:22.532017+0000', 'last_clean_scrub_stamp': '2023-11-28T20:38:22.532017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6, 2, 3], 'acting': [4, 6, 2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 2, 3, 6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:39:02.103 INFO:tasks.mon_thrash.ceph_manager:PG 3.36 is not active+clean 2023-11-28T20:39:02.103 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 16, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2023-11-28T20:38:24.351828+0000', 'last_change': '2023-11-28T20:39:00.374712+0000', 'last_active': '2023-11-28T20:39:00.374712+0000', 'last_peered': '2023-11-28T20:38:24.351828+0000', 'last_clean': '2023-11-28T20:38:24.351828+0000', 'last_became_active': '2023-11-28T20:38:19.398797+0000', 'last_became_peered': '2023-11-28T20:38:19.398797+0000', 'last_unstale': '2023-11-28T20:38:24.351828+0000', 'last_undegraded': '2023-11-28T20:38:24.351828+0000', 'last_fullsized': '2023-11-28T20:38:24.351828+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'last_clean_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:39:02.104 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T20:39:02.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.272+0000 7f68fd0c9640 1 Processor -- start 2023-11-28T20:39:02.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.272+0000 7f68fd0c9640 1 -- start start 2023-11-28T20:39:02.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68fd0c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 0x7f68f80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68fd0c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68f80cfc40 0x7f68f80ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68fd0c9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f815ac00 con 0x7f68f8153ae0 2023-11-28T20:39:02.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68fd0c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f80cbd60 con 0x7f68f80cfc40 2023-11-28T20:39:02.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68fd0c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8159ff0 con 0x7f68f80cf860 2023-11-28T20:39:02.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68effff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68f80cfc40 0x7f68f80ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68effff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68f80cfc40 0x7f68f80ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45976/0 (socket says 172.21.15.167:45976) 2023-11-28T20:39:02.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68effff640 1 -- 172.21.15.167:0/16596035 learned_addr learned my addr 172.21.15.167:0/16596035 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:02.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68f6d9d640 1 --2- 172.21.15.167:0/16596035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 0x7f68f80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68effff640 1 -- 172.21.15.167:0/16596035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 msgr2=0x7f68f80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:02.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68effff640 1 --2- 172.21.15.167:0/16596035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 0x7f68f80cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68effff640 1 -- 172.21.15.167:0/16596035 >> v1:172.21.15.178:6789/0 conn(0x7f68f8153ae0 legacy=0x7f68f815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68effff640 1 -- 172.21.15.167:0/16596035 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f815a2d0 con 0x7f68f80cfc40 2023-11-28T20:39:02.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.276+0000 7f68effff640 1 --2- 172.21.15.167:0/16596035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f80cfc40 0x7f68f80ca510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009870 tx=0x7f68e001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5563e2b8cc10245 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:02.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68f659c640 1 -- 172.21.15.167:0/16596035 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00aa670 con 0x7f68f80cfc40 2023-11-28T20:39:02.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68f659c640 1 -- 172.21.15.167:0/16596035 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e00aa7d0 con 0x7f68f80cfc40 2023-11-28T20:39:02.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68f659c640 1 -- 172.21.15.167:0/16596035 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00aab60 con 0x7f68f80cfc40 2023-11-28T20:39:02.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 -- 172.21.15.167:0/16596035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f80cfc40 msgr2=0x7f68f80ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 --2- 172.21.15.167:0/16596035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f80cfc40 0x7f68f80ca510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009870 tx=0x7f68e001c510 comp rx=0 tx=0).stop 2023-11-28T20:39:02.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 -- 172.21.15.167:0/16596035 shutdown_connections 2023-11-28T20:39:02.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 --2- 172.21.15.167:0/16596035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f80cfc40 0x7f68f80ca510 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 --2- 172.21.15.167:0/16596035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 0x7f68f80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 -- 172.21.15.167:0/16596035 >> 172.21.15.167:0/16596035 conn(0x7f68f806c1f0 msgr2=0x7f68f8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:02.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 -- 172.21.15.167:0/16596035 shutdown_connections 2023-11-28T20:39:02.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 -- 172.21.15.167:0/16596035 wait complete. 2023-11-28T20:39:02.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 Processor -- start 2023-11-28T20:39:02.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 -- start start 2023-11-28T20:39:02.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 0x7f68f8152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f80cfc40 0x7f68f8140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f8153ae0 0x7f68f81f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f813d970 con 0x7f68f8153ae0 2023-11-28T20:39:02.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f813e320 con 0x7f68f80cfc40 2023-11-28T20:39:02.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.280+0000 7f68fd0c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8153640 con 0x7f68f80cf860 2023-11-28T20:39:02.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f8153ae0 0x7f68f81f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f8153ae0 0x7f68f81f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45980/0 (socket says 172.21.15.167:45980) 2023-11-28T20:39:02.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f759e640 1 -- 172.21.15.167:0/1755099360 learned_addr learned my addr 172.21.15.167:0/1755099360 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:02.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f6d9d640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 0x7f68f8152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68effff640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f80cfc40 0x7f68f8140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f759e640 1 -- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 msgr2=0x7f68f8152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f759e640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 0x7f68f8152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f759e640 1 -- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f80cfc40 msgr2=0x7f68f8140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f759e640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f80cfc40 0x7f68f8140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f759e640 1 -- 172.21.15.167:0/1755099360 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e00094d0 con 0x7f68f8153ae0 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68f759e640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f8153ae0 0x7f68f81f62b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68f000c770 tx=0x7f68f000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68ef7fe640 1 -- 172.21.15.167:0/1755099360 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0003b80 con 0x7f68f8153ae0 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68ef7fe640 1 -- 172.21.15.167:0/1755099360 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0003ce0 con 0x7f68f8153ae0 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68ef7fe640 1 -- 172.21.15.167:0/1755099360 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000aa90 con 0x7f68f8153ae0 2023-11-28T20:39:02.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f813e6f0 con 0x7f68f8153ae0 2023-11-28T20:39:02.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f8153360 con 0x7f68f8153ae0 2023-11-28T20:39:02.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f813d6d0 con 0x7f68f8153ae0 2023-11-28T20:39:02.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.284+0000 7f68ef7fe640 1 -- 172.21.15.167:0/1755099360 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68f000abf0 con 0x7f68f8153ae0 2023-11-28T20:39:02.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.288+0000 7f68ef7fe640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68d8066470 0x7f68d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.288+0000 7f68ef7fe640 1 -- 172.21.15.167:0/1755099360 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f68f0083ec0 con 0x7f68f8153ae0 2023-11-28T20:39:02.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.288+0000 7f68f6d9d640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68d8066470 0x7f68d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.288+0000 7f68f6d9d640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68d8066470 0x7f68d8068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f68e80079c0 tx=0x7f68e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:02.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.292+0000 7f68ef7fe640 1 -- 172.21.15.167:0/1755099360 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68f813d6d0 con 0x7f68f8153ae0 2023-11-28T20:39:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.496+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f68f813d6d0 con 0x7f68f8153ae0 2023-11-28T20:39:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.496+0000 7f68ef7fe640 1 -- 172.21.15.167:0/1755099360 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3105 (secure 0 0 0) 0x7f68f813d6d0 con 0x7f68f8153ae0 2023-11-28T20:39:02.501 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:02.501 INFO:teuthology.orchestra.run.smithi167.stdout:{"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":67,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":27,"num_osds":8,"num_up_osds":8,"osd_up_since":1701203885,"num_in_osds":8,"osd_in_since":1701203876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":127},{"state_name":"peering","count":2}],"num_pgs":129,"num_pools":4,"num_objects":62,"data_bytes":598073,"bytes_used":241786880,"bytes_avail":772852326400,"bytes_total":773094113280,"inactive_pgs_ratio":0.015503875911235809,"write_bytes_sec":1791,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":14,"id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"f","status":"up:active","gid":4276},{"filesystem_id":1,"rank":1,"name":"c","status":"up:active","gid":4278},{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4279}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-11-28T20:39:01.444752+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T20:39:02.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68d8066470 msgr2=0x7f68d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68d8066470 0x7f68d8068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f68e80079c0 tx=0x7f68e8008040 comp rx=0 tx=0).stop 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f8153ae0 msgr2=0x7f68f81f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f8153ae0 0x7f68f81f62b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68f000c770 tx=0x7f68f000cc30 comp rx=0 tx=0).stop 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 shutdown_connections 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68d8066470 0x7f68d8068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68f8153ae0 0x7f68f81f62b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68f80cfc40 0x7f68f8140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 --2- 172.21.15.167:0/1755099360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68f80cf860 0x7f68f8152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 >> 172.21.15.167:0/1755099360 conn(0x7f68f806c1f0 msgr2=0x7f68f80cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 shutdown_connections 2023-11-28T20:39:02.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.500+0000 7f68fd0c9640 1 -- 172.21.15.167:0/1755099360 wait complete. 2023-11-28T20:39:02.522 INFO:tasks.mon_thrash.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T20:39:02.522 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:39:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f958752a640 1 Processor -- start 2023-11-28T20:39:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f958752a640 1 -- start start 2023-11-28T20:39:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f958752a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 0x7f95800cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f958752a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f95800cfc40 0x7f95800ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f958752a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9580153ae0 0x7f9580153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f958752a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9580154470 con 0x7f9580153ae0 2023-11-28T20:39:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f958752a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958015ac00 con 0x7f95800cfc40 2023-11-28T20:39:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f958752a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95800cbd60 con 0x7f95800cf860 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9585ac7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9580153ae0 0x7f9580153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9585ac7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9580153ae0 0x7f9580153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45986/0 (socket says 172.21.15.167:45986) 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9585ac7640 1 -- 172.21.15.167:0/1839231185 learned_addr learned my addr 172.21.15.167:0/1839231185 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9584ac5640 1 --2- 172.21.15.167:0/1839231185 >> v2:172.21.15.178:3300/0 conn(0x7f95800cfc40 0x7f95800ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f95852c6640 1 --2- 172.21.15.167:0/1839231185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 0x7f95800cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9585ac7640 1 -- 172.21.15.167:0/1839231185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 msgr2=0x7f95800cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9585ac7640 1 --2- 172.21.15.167:0/1839231185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 0x7f95800cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9585ac7640 1 -- 172.21.15.167:0/1839231185 >> v2:172.21.15.178:3300/0 conn(0x7f95800cfc40 msgr2=0x7f95800ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9585ac7640 1 --2- 172.21.15.167:0/1839231185 >> v2:172.21.15.178:3300/0 conn(0x7f95800cfc40 0x7f95800ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9585ac7640 1 -- 172.21.15.167:0/1839231185 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580159ff0 con 0x7f9580153ae0 2023-11-28T20:39:02.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.660+0000 7f9584ac5640 1 --2- 172.21.15.167:0/1839231185 >> v2:172.21.15.178:3300/0 conn(0x7f95800cfc40 0x7f95800ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:02.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f9585ac7640 1 --2- 172.21.15.167:0/1839231185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9580153ae0 0x7f9580153f30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f95800cd1c0 tx=0x7f957801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c935ee5dc2941e68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:02.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f9577fff640 1 -- 172.21.15.167:0/1839231185 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95780a5820 con 0x7f9580153ae0 2023-11-28T20:39:02.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f9577fff640 1 -- 172.21.15.167:0/1839231185 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95780a5980 con 0x7f9580153ae0 2023-11-28T20:39:02.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f9577fff640 1 -- 172.21.15.167:0/1839231185 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95780a5d10 con 0x7f9580153ae0 2023-11-28T20:39:02.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f958752a640 1 -- 172.21.15.167:0/1839231185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9580153ae0 msgr2=0x7f9580153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f958752a640 1 --2- 172.21.15.167:0/1839231185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9580153ae0 0x7f9580153f30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f95800cd1c0 tx=0x7f957801c9a0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f958752a640 1 -- 172.21.15.167:0/1839231185 shutdown_connections 2023-11-28T20:39:02.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f958752a640 1 --2- 172.21.15.167:0/1839231185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9580153ae0 0x7f9580153f30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f958752a640 1 --2- 172.21.15.167:0/1839231185 >> v2:172.21.15.178:3300/0 conn(0x7f95800cfc40 0x7f95800ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f958752a640 1 --2- 172.21.15.167:0/1839231185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 0x7f95800cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f958752a640 1 -- 172.21.15.167:0/1839231185 >> 172.21.15.167:0/1839231185 conn(0x7f958006c1f0 msgr2=0x7f9580071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:02.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f958752a640 1 -- 172.21.15.167:0/1839231185 shutdown_connections 2023-11-28T20:39:02.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.664+0000 7f958752a640 1 -- 172.21.15.167:0/1839231185 wait complete. 2023-11-28T20:39:02.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 Processor -- start 2023-11-28T20:39:02.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 -- start start 2023-11-28T20:39:02.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 0x7f95800c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95800cfc40 0x7f95800b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9580153ae0 0x7f95801486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800c8d20 con 0x7f95800cfc40 2023-11-28T20:39:02.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9580148250 con 0x7f9580153ae0 2023-11-28T20:39:02.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95800cec60 con 0x7f95800cf860 2023-11-28T20:39:02.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9584ac5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95800cfc40 0x7f95800b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9584ac5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95800cfc40 0x7f95800b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45988/0 (socket says 172.21.15.167:45988) 2023-11-28T20:39:02.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9584ac5640 1 -- 172.21.15.167:0/3863318652 learned_addr learned my addr 172.21.15.167:0/3863318652 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:02.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f95852c6640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 0x7f95800c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9585ac7640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9580153ae0 0x7f95801486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9584ac5640 1 -- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 msgr2=0x7f95800c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9584ac5640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 0x7f95800c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9584ac5640 1 -- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9580153ae0 msgr2=0x7f95801486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9584ac5640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9580153ae0 0x7f95801486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9584ac5640 1 -- 172.21.15.167:0/3863318652 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578009b30 con 0x7f95800cfc40 2023-11-28T20:39:02.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9584ac5640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95800cfc40 0x7f95800b4910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f957000e810 tx=0x7f957000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:02.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9575ffb640 1 -- 172.21.15.167:0/3863318652 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000c8d0 con 0x7f95800cfc40 2023-11-28T20:39:02.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9575ffb640 1 -- 172.21.15.167:0/3863318652 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957000ca30 con 0x7f95800cfc40 2023-11-28T20:39:02.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95800cef40 con 0x7f95800cfc40 2023-11-28T20:39:02.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f9575ffb640 1 -- 172.21.15.167:0/3863318652 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000cdc0 con 0x7f95800cfc40 2023-11-28T20:39:02.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.668+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95800c7810 con 0x7f95800cfc40 2023-11-28T20:39:02.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.672+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95800cf460 con 0x7f95800cfc40 2023-11-28T20:39:02.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.672+0000 7f9575ffb640 1 -- 172.21.15.167:0/3863318652 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9570013410 con 0x7f95800cfc40 2023-11-28T20:39:02.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.672+0000 7f9575ffb640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9564066470 0x7f9564068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:02.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.672+0000 7f9575ffb640 1 -- 172.21.15.167:0/3863318652 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9570084090 con 0x7f95800cfc40 2023-11-28T20:39:02.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.672+0000 7f95852c6640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9564066470 0x7f9564068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:02.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.672+0000 7f95852c6640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9564066470 0x7f9564068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f957c00ba30 tx=0x7f957c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:02.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.676+0000 7f9575ffb640 1 -- 172.21.15.167:0/3863318652 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95800cf460 con 0x7f95800cfc40 2023-11-28T20:39:02.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.824+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95800caa50 con 0x7f9564066470 2023-11-28T20:39:02.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.848+0000 7f9575ffb640 1 -- 172.21.15.167:0/3863318652 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345313 (secure 0 0 0) 0x7f957c00b620 con 0x7f9564066470 2023-11-28T20:39:02.855 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:02.857 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:39:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9564066470 msgr2=0x7f9564068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9564066470 0x7f9564068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f957c00ba30 tx=0x7f957c008040 comp rx=0 tx=0).stop 2023-11-28T20:39:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95800cfc40 msgr2=0x7f95800b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95800cfc40 0x7f95800b4910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f957000e810 tx=0x7f957000ecd0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 shutdown_connections 2023-11-28T20:39:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9564066470 0x7f9564068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9580153ae0 0x7f95801486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95800cfc40 0x7f95800b4910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 --2- 172.21.15.167:0/3863318652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95800cf860 0x7f95800c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 >> 172.21.15.167:0/3863318652 conn(0x7f958006c1f0 msgr2=0x7f95800b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 shutdown_connections 2023-11-28T20:39:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:02.852+0000 7f958752a640 1 -- 172.21.15.167:0/3863318652 wait complete. 2023-11-28T20:39:02.875 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2023-11-28T20:39:01.444532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598073,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":289,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236120,"kb_used_data":3348,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738600,"statfs":{"total":773094113280,"available":772852326400,"internally_reserved":0,"allocated":3428352,"data_stored":2019158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1660,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003135"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.609165+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:51.609165+0000","last_peered":"2023-11-28T20:38:51.609165+0000","last_clean":"2023-11-28T20:38:51.609165+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:51.609165+0000","last_undegraded":"2023-11-28T20:38:51.609165+0000","last_fullsized":"2023-11-28T20:38:51.609165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.390144+0000","last_change":"2023-11-28T20:39:01.387644+0000","last_active":"2023-11-28T20:39:01.390144+0000","last_peered":"2023-11-28T20:39:01.390144+0000","last_clean":"2023-11-28T20:39:01.390144+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T20:39:01.390144+0000","last_undegraded":"2023-11-28T20:39:01.390144+0000","last_fullsized":"2023-11-28T20:39:01.390144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:52.977080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523700+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:38:24.523700+0000","last_peered":"2023-11-28T20:38:24.523700+0000","last_clean":"2023-11-28T20:38:24.523700+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:38:24.523700+0000","last_undegraded":"2023-11-28T20:38:24.523700+0000","last_fullsized":"2023-11-28T20:38:24.523700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530236+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:38:24.530236+0000","last_peered":"2023-11-28T20:38:24.530236+0000","last_clean":"2023-11-28T20:38:24.530236+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:38:24.530236+0000","last_undegraded":"2023-11-28T20:38:24.530236+0000","last_fullsized":"2023-11-28T20:38:24.530236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344550+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:24.344550+0000","last_peered":"2023-11-28T20:38:24.344550+0000","last_clean":"2023-11-28T20:38:24.344550+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:24.344550+0000","last_undegraded":"2023-11-28T20:38:24.344550+0000","last_fullsized":"2023-11-28T20:38:24.344550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:25.445649+0000","last_change":"2023-11-28T20:39:00.368426+0000","last_active":"2023-11-28T20:39:00.368426+0000","last_peered":"2023-11-28T20:38:25.445649+0000","last_clean":"2023-11-28T20:38:25.445649+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:25.445649+0000","last_undegraded":"2023-11-28T20:38:25.445649+0000","last_fullsized":"2023-11-28T20:38:25.445649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606601+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:51.606601+0000","last_peered":"2023-11-28T20:38:51.606601+0000","last_clean":"2023-11-28T20:38:51.606601+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:51.606601+0000","last_undegraded":"2023-11-28T20:38:51.606601+0000","last_fullsized":"2023-11-28T20:38:51.606601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350728+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:24.350728+0000","last_peered":"2023-11-28T20:38:24.350728+0000","last_clean":"2023-11-28T20:38:24.350728+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:24.350728+0000","last_undegraded":"2023-11-28T20:38:24.350728+0000","last_fullsized":"2023-11-28T20:38:24.350728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445936+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:25.445936+0000","last_peered":"2023-11-28T20:38:25.445936+0000","last_clean":"2023-11-28T20:38:25.445936+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:25.445936+0000","last_undegraded":"2023-11-28T20:38:25.445936+0000","last_fullsized":"2023-11-28T20:38:25.445936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532409+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532409+0000","last_peered":"2023-11-28T20:38:24.532409+0000","last_clean":"2023-11-28T20:38:24.532409+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532409+0000","last_undegraded":"2023-11-28T20:38:24.532409+0000","last_fullsized":"2023-11-28T20:38:24.532409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350514+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:24.350514+0000","last_peered":"2023-11-28T20:38:24.350514+0000","last_clean":"2023-11-28T20:38:24.350514+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:24.350514+0000","last_undegraded":"2023-11-28T20:38:24.350514+0000","last_fullsized":"2023-11-28T20:38:24.350514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445855+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:25.445855+0000","last_peered":"2023-11-28T20:38:25.445855+0000","last_clean":"2023-11-28T20:38:25.445855+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:25.445855+0000","last_undegraded":"2023-11-28T20:38:25.445855+0000","last_fullsized":"2023-11-28T20:38:25.445855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350262+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:24.350262+0000","last_peered":"2023-11-28T20:38:24.350262+0000","last_clean":"2023-11-28T20:38:24.350262+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:24.350262+0000","last_undegraded":"2023-11-28T20:38:24.350262+0000","last_fullsized":"2023-11-28T20:38:24.350262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575295+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:45.575295+0000","last_peered":"2023-11-28T20:38:45.575295+0000","last_clean":"2023-11-28T20:38:45.575295+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:45.575295+0000","last_undegraded":"2023-11-28T20:38:45.575295+0000","last_fullsized":"2023-11-28T20:38:45.575295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446173+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:25.446173+0000","last_peered":"2023-11-28T20:38:25.446173+0000","last_clean":"2023-11-28T20:38:25.446173+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:25.446173+0000","last_undegraded":"2023-11-28T20:38:25.446173+0000","last_fullsized":"2023-11-28T20:38:25.446173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556220+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:38:23.556220+0000","last_peered":"2023-11-28T20:38:23.556220+0000","last_clean":"2023-11-28T20:38:23.556220+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:38:23.556220+0000","last_undegraded":"2023-11-28T20:38:23.556220+0000","last_fullsized":"2023-11-28T20:38:23.556220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372769+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:39:00.372769+0000","last_peered":"2023-11-28T20:39:00.372769+0000","last_clean":"2023-11-28T20:39:00.372769+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:39:00.372769+0000","last_undegraded":"2023-11-28T20:39:00.372769+0000","last_fullsized":"2023-11-28T20:39:00.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446061+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:25.446061+0000","last_peered":"2023-11-28T20:38:25.446061+0000","last_clean":"2023-11-28T20:38:25.446061+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:25.446061+0000","last_undegraded":"2023-11-28T20:38:25.446061+0000","last_fullsized":"2023-11-28T20:38:25.446061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556959+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:38:23.556959+0000","last_peered":"2023-11-28T20:38:23.556959+0000","last_clean":"2023-11-28T20:38:23.556959+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:38:23.556959+0000","last_undegraded":"2023-11-28T20:38:23.556959+0000","last_fullsized":"2023-11-28T20:38:23.556959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372086+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:39:00.372086+0000","last_peered":"2023-11-28T20:39:00.372086+0000","last_clean":"2023-11-28T20:39:00.372086+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:39:00.372086+0000","last_undegraded":"2023-11-28T20:39:00.372086+0000","last_fullsized":"2023-11-28T20:39:00.372086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373087+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.373087+0000","last_peered":"2023-11-28T20:39:00.373087+0000","last_clean":"2023-11-28T20:39:00.373087+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:39:00.373087+0000","last_undegraded":"2023-11-28T20:39:00.373087+0000","last_fullsized":"2023-11-28T20:39:00.373087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528774+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:24.528774+0000","last_peered":"2023-11-28T20:38:24.528774+0000","last_clean":"2023-11-28T20:38:24.528774+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:24.528774+0000","last_undegraded":"2023-11-28T20:38:24.528774+0000","last_fullsized":"2023-11-28T20:38:24.528774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575123+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:45.575123+0000","last_peered":"2023-11-28T20:38:45.575123+0000","last_clean":"2023-11-28T20:38:45.575123+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:45.575123+0000","last_undegraded":"2023-11-28T20:38:45.575123+0000","last_fullsized":"2023-11-28T20:38:45.575123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446227+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:25.446227+0000","last_peered":"2023-11-28T20:38:25.446227+0000","last_clean":"2023-11-28T20:38:25.446227+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:25.446227+0000","last_undegraded":"2023-11-28T20:38:25.446227+0000","last_fullsized":"2023-11-28T20:38:25.446227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344675+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:24.344675+0000","last_peered":"2023-11-28T20:38:24.344675+0000","last_clean":"2023-11-28T20:38:24.344675+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:24.344675+0000","last_undegraded":"2023-11-28T20:38:24.344675+0000","last_fullsized":"2023-11-28T20:38:24.344675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573711+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:45.573711+0000","last_peered":"2023-11-28T20:38:45.573711+0000","last_clean":"2023-11-28T20:38:45.573711+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:45.573711+0000","last_undegraded":"2023-11-28T20:38:45.573711+0000","last_fullsized":"2023-11-28T20:38:45.573711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445762+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:25.445762+0000","last_peered":"2023-11-28T20:38:25.445762+0000","last_clean":"2023-11-28T20:38:25.445762+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:25.445762+0000","last_undegraded":"2023-11-28T20:38:25.445762+0000","last_fullsized":"2023-11-28T20:38:25.445762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556394+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:38:23.556394+0000","last_peered":"2023-11-28T20:38:23.556394+0000","last_clean":"2023-11-28T20:38:23.556394+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:38:23.556394+0000","last_undegraded":"2023-11-28T20:38:23.556394+0000","last_fullsized":"2023-11-28T20:38:23.556394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373110+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:39:00.373110+0000","last_peered":"2023-11-28T20:39:00.373110+0000","last_clean":"2023-11-28T20:39:00.373110+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:39:00.373110+0000","last_undegraded":"2023-11-28T20:39:00.373110+0000","last_fullsized":"2023-11-28T20:39:00.373110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523623+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:38:24.523623+0000","last_peered":"2023-11-28T20:38:24.523623+0000","last_clean":"2023-11-28T20:38:24.523623+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:38:24.523623+0000","last_undegraded":"2023-11-28T20:38:24.523623+0000","last_fullsized":"2023-11-28T20:38:24.523623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372844+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:39:00.372844+0000","last_peered":"2023-11-28T20:39:00.372844+0000","last_clean":"2023-11-28T20:39:00.372844+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:39:00.372844+0000","last_undegraded":"2023-11-28T20:39:00.372844+0000","last_fullsized":"2023-11-28T20:39:00.372844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574343+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:45.574343+0000","last_peered":"2023-11-28T20:38:45.574343+0000","last_clean":"2023-11-28T20:38:45.574343+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:45.574343+0000","last_undegraded":"2023-11-28T20:38:45.574343+0000","last_fullsized":"2023-11-28T20:38:45.574343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439058+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:25.439058+0000","last_peered":"2023-11-28T20:38:25.439058+0000","last_clean":"2023-11-28T20:38:25.439058+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:25.439058+0000","last_undegraded":"2023-11-28T20:38:25.439058+0000","last_fullsized":"2023-11-28T20:38:25.439058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350784+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:24.350784+0000","last_peered":"2023-11-28T20:38:24.350784+0000","last_clean":"2023-11-28T20:38:24.350784+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:24.350784+0000","last_undegraded":"2023-11-28T20:38:24.350784+0000","last_fullsized":"2023-11-28T20:38:24.350784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372929+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:39:00.372929+0000","last_peered":"2023-11-28T20:39:00.372929+0000","last_clean":"2023-11-28T20:39:00.372929+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:39:00.372929+0000","last_undegraded":"2023-11-28T20:39:00.372929+0000","last_fullsized":"2023-11-28T20:39:00.372929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.535102+0000","last_change":"2023-11-28T20:38:23.594782+0000","last_active":"2023-11-28T20:38:24.535102+0000","last_peered":"2023-11-28T20:38:24.535102+0000","last_clean":"2023-11-28T20:38:24.535102+0000","last_became_active":"2023-11-28T20:38:23.594034+0000","last_became_peered":"2023-11-28T20:38:23.594034+0000","last_unstale":"2023-11-28T20:38:24.535102+0000","last_undegraded":"2023-11-28T20:38:24.535102+0000","last_fullsized":"2023-11-28T20:38:24.535102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:29:14.721489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529967+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:24.529967+0000","last_peered":"2023-11-28T20:38:24.529967+0000","last_clean":"2023-11-28T20:38:24.529967+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:24.529967+0000","last_undegraded":"2023-11-28T20:38:24.529967+0000","last_fullsized":"2023-11-28T20:38:24.529967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608154+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:51.608154+0000","last_peered":"2023-11-28T20:38:51.608154+0000","last_clean":"2023-11-28T20:38:51.608154+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:51.608154+0000","last_undegraded":"2023-11-28T20:38:51.608154+0000","last_fullsized":"2023-11-28T20:38:51.608154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372765+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:39:00.372765+0000","last_peered":"2023-11-28T20:39:00.372765+0000","last_clean":"2023-11-28T20:39:00.372765+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:39:00.372765+0000","last_undegraded":"2023-11-28T20:39:00.372765+0000","last_fullsized":"2023-11-28T20:39:00.372765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373168+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:39:00.373168+0000","last_peered":"2023-11-28T20:39:00.373168+0000","last_clean":"2023-11-28T20:39:00.373168+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:39:00.373168+0000","last_undegraded":"2023-11-28T20:39:00.373168+0000","last_fullsized":"2023-11-28T20:39:00.373168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607572+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:38:51.607572+0000","last_peered":"2023-11-28T20:38:51.607572+0000","last_clean":"2023-11-28T20:38:51.607572+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:38:51.607572+0000","last_undegraded":"2023-11-28T20:38:51.607572+0000","last_fullsized":"2023-11-28T20:38:51.607572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373409+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:39:00.373409+0000","last_peered":"2023-11-28T20:39:00.373409+0000","last_clean":"2023-11-28T20:39:00.373409+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:39:00.373409+0000","last_undegraded":"2023-11-28T20:39:00.373409+0000","last_fullsized":"2023-11-28T20:39:00.373409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.343810+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:24.343810+0000","last_peered":"2023-11-28T20:38:24.343810+0000","last_clean":"2023-11-28T20:38:24.343810+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:24.343810+0000","last_undegraded":"2023-11-28T20:38:24.343810+0000","last_fullsized":"2023-11-28T20:38:24.343810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608237+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:51.608237+0000","last_peered":"2023-11-28T20:38:51.608237+0000","last_clean":"2023-11-28T20:38:51.608237+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:51.608237+0000","last_undegraded":"2023-11-28T20:38:51.608237+0000","last_fullsized":"2023-11-28T20:38:51.608237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439136+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:25.439136+0000","last_peered":"2023-11-28T20:38:25.439136+0000","last_clean":"2023-11-28T20:38:25.439136+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:25.439136+0000","last_undegraded":"2023-11-28T20:38:25.439136+0000","last_fullsized":"2023-11-28T20:38:25.439136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555061+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:38:23.555061+0000","last_peered":"2023-11-28T20:38:23.555061+0000","last_clean":"2023-11-28T20:38:23.555061+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:38:23.555061+0000","last_undegraded":"2023-11-28T20:38:23.555061+0000","last_fullsized":"2023-11-28T20:38:23.555061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608459+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:51.608459+0000","last_peered":"2023-11-28T20:38:51.608459+0000","last_clean":"2023-11-28T20:38:51.608459+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:51.608459+0000","last_undegraded":"2023-11-28T20:38:51.608459+0000","last_fullsized":"2023-11-28T20:38:51.608459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528002+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:24.528002+0000","last_peered":"2023-11-28T20:38:24.528002+0000","last_clean":"2023-11-28T20:38:24.528002+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:24.528002+0000","last_undegraded":"2023-11-28T20:38:24.528002+0000","last_fullsized":"2023-11-28T20:38:24.528002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441545+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:25.441545+0000","last_peered":"2023-11-28T20:38:25.441545+0000","last_clean":"2023-11-28T20:38:25.441545+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:25.441545+0000","last_undegraded":"2023-11-28T20:38:25.441545+0000","last_fullsized":"2023-11-28T20:38:25.441545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528152+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:24.528152+0000","last_peered":"2023-11-28T20:38:24.528152+0000","last_clean":"2023-11-28T20:38:24.528152+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:24.528152+0000","last_undegraded":"2023-11-28T20:38:24.528152+0000","last_fullsized":"2023-11-28T20:38:24.528152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607747+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:38:51.607747+0000","last_peered":"2023-11-28T20:38:51.607747+0000","last_clean":"2023-11-28T20:38:51.607747+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:38:51.607747+0000","last_undegraded":"2023-11-28T20:38:51.607747+0000","last_fullsized":"2023-11-28T20:38:51.607747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441453+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:25.441453+0000","last_peered":"2023-11-28T20:38:25.441453+0000","last_clean":"2023-11-28T20:38:25.441453+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:25.441453+0000","last_undegraded":"2023-11-28T20:38:25.441453+0000","last_fullsized":"2023-11-28T20:38:25.441453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350421+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:24.350421+0000","last_peered":"2023-11-28T20:38:24.350421+0000","last_clean":"2023-11-28T20:38:24.350421+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:24.350421+0000","last_undegraded":"2023-11-28T20:38:24.350421+0000","last_fullsized":"2023-11-28T20:38:24.350421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372659+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:39:00.372659+0000","last_peered":"2023-11-28T20:39:00.372659+0000","last_clean":"2023-11-28T20:39:00.372659+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:39:00.372659+0000","last_undegraded":"2023-11-28T20:39:00.372659+0000","last_fullsized":"2023-11-28T20:39:00.372659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439079+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:25.439079+0000","last_peered":"2023-11-28T20:38:25.439079+0000","last_clean":"2023-11-28T20:38:25.439079+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:25.439079+0000","last_undegraded":"2023-11-28T20:38:25.439079+0000","last_fullsized":"2023-11-28T20:38:25.439079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531147+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:24.531147+0000","last_peered":"2023-11-28T20:38:24.531147+0000","last_clean":"2023-11-28T20:38:24.531147+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:24.531147+0000","last_undegraded":"2023-11-28T20:38:24.531147+0000","last_fullsized":"2023-11-28T20:38:24.531147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532302+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:38:24.532302+0000","last_peered":"2023-11-28T20:38:24.532302+0000","last_clean":"2023-11-28T20:38:24.532302+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:38:24.532302+0000","last_undegraded":"2023-11-28T20:38:24.532302+0000","last_fullsized":"2023-11-28T20:38:24.532302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446714+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:25.446714+0000","last_peered":"2023-11-28T20:38:25.446714+0000","last_clean":"2023-11-28T20:38:25.446714+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:25.446714+0000","last_undegraded":"2023-11-28T20:38:25.446714+0000","last_fullsized":"2023-11-28T20:38:25.446714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529633+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:24.529633+0000","last_peered":"2023-11-28T20:38:24.529633+0000","last_clean":"2023-11-28T20:38:24.529633+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:24.529633+0000","last_undegraded":"2023-11-28T20:38:24.529633+0000","last_fullsized":"2023-11-28T20:38:24.529633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:56.834824+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:56.834824+0000","last_peered":"2023-11-28T20:38:56.834824+0000","last_clean":"2023-11-28T20:38:56.834824+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:56.834824+0000","last_undegraded":"2023-11-28T20:38:56.834824+0000","last_fullsized":"2023-11-28T20:38:56.834824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445709+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:25.445709+0000","last_peered":"2023-11-28T20:38:25.445709+0000","last_clean":"2023-11-28T20:38:25.445709+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:25.445709+0000","last_undegraded":"2023-11-28T20:38:25.445709+0000","last_fullsized":"2023-11-28T20:38:25.445709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527830+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:24.527830+0000","last_peered":"2023-11-28T20:38:24.527830+0000","last_clean":"2023-11-28T20:38:24.527830+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:24.527830+0000","last_undegraded":"2023-11-28T20:38:24.527830+0000","last_fullsized":"2023-11-28T20:38:24.527830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607963+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:38:51.607963+0000","last_peered":"2023-11-28T20:38:51.607963+0000","last_clean":"2023-11-28T20:38:51.607963+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:38:51.607963+0000","last_undegraded":"2023-11-28T20:38:51.607963+0000","last_fullsized":"2023-11-28T20:38:51.607963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439127+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:25.439127+0000","last_peered":"2023-11-28T20:38:25.439127+0000","last_clean":"2023-11-28T20:38:25.439127+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:25.439127+0000","last_undegraded":"2023-11-28T20:38:25.439127+0000","last_fullsized":"2023-11-28T20:38:25.439127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349743+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:24.349743+0000","last_peered":"2023-11-28T20:38:24.349743+0000","last_clean":"2023-11-28T20:38:24.349743+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:24.349743+0000","last_undegraded":"2023-11-28T20:38:24.349743+0000","last_fullsized":"2023-11-28T20:38:24.349743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.613830+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:51.613830+0000","last_peered":"2023-11-28T20:38:51.613830+0000","last_clean":"2023-11-28T20:38:51.613830+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:51.613830+0000","last_undegraded":"2023-11-28T20:38:51.613830+0000","last_fullsized":"2023-11-28T20:38:51.613830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.525043+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:38:24.525043+0000","last_peered":"2023-11-28T20:38:24.525043+0000","last_clean":"2023-11-28T20:38:24.525043+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:38:24.525043+0000","last_undegraded":"2023-11-28T20:38:24.525043+0000","last_fullsized":"2023-11-28T20:38:24.525043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528018+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:24.528018+0000","last_peered":"2023-11-28T20:38:24.528018+0000","last_clean":"2023-11-28T20:38:24.528018+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:24.528018+0000","last_undegraded":"2023-11-28T20:38:24.528018+0000","last_fullsized":"2023-11-28T20:38:24.528018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.577200+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:45.577200+0000","last_peered":"2023-11-28T20:38:45.577200+0000","last_clean":"2023-11-28T20:38:45.577200+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:45.577200+0000","last_undegraded":"2023-11-28T20:38:45.577200+0000","last_fullsized":"2023-11-28T20:38:45.577200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524484+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:38:24.524484+0000","last_peered":"2023-11-28T20:38:24.524484+0000","last_clean":"2023-11-28T20:38:24.524484+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:38:24.524484+0000","last_undegraded":"2023-11-28T20:38:24.524484+0000","last_fullsized":"2023-11-28T20:38:24.524484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344100+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:24.344100+0000","last_peered":"2023-11-28T20:38:24.344100+0000","last_clean":"2023-11-28T20:38:24.344100+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:24.344100+0000","last_undegraded":"2023-11-28T20:38:24.344100+0000","last_fullsized":"2023-11-28T20:38:24.344100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607879+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:51.607879+0000","last_peered":"2023-11-28T20:38:51.607879+0000","last_clean":"2023-11-28T20:38:51.607879+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:51.607879+0000","last_undegraded":"2023-11-28T20:38:51.607879+0000","last_fullsized":"2023-11-28T20:38:51.607879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446949+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:25.446949+0000","last_peered":"2023-11-28T20:38:25.446949+0000","last_clean":"2023-11-28T20:38:25.446949+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:25.446949+0000","last_undegraded":"2023-11-28T20:38:25.446949+0000","last_fullsized":"2023-11-28T20:38:25.446949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527948+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:24.527948+0000","last_peered":"2023-11-28T20:38:24.527948+0000","last_clean":"2023-11-28T20:38:24.527948+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:24.527948+0000","last_undegraded":"2023-11-28T20:38:24.527948+0000","last_fullsized":"2023-11-28T20:38:24.527948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:58.919852+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:58.919852+0000","last_peered":"2023-11-28T20:38:58.919852+0000","last_clean":"2023-11-28T20:38:58.919852+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:58.919852+0000","last_undegraded":"2023-11-28T20:38:58.919852+0000","last_fullsized":"2023-11-28T20:38:58.919852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372497+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:39:00.372497+0000","last_peered":"2023-11-28T20:39:00.372497+0000","last_clean":"2023-11-28T20:39:00.372497+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:39:00.372497+0000","last_undegraded":"2023-11-28T20:39:00.372497+0000","last_fullsized":"2023-11-28T20:39:00.372497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.571791+0000","last_change":"2023-11-28T20:38:19.398113+0000","last_active":"2023-11-28T20:38:23.571791+0000","last_peered":"2023-11-28T20:38:23.571791+0000","last_clean":"2023-11-28T20:38:23.571791+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:38:23.571791+0000","last_undegraded":"2023-11-28T20:38:23.571791+0000","last_fullsized":"2023-11-28T20:38:23.571791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:08.187641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372562+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:39:00.372562+0000","last_peered":"2023-11-28T20:39:00.372562+0000","last_clean":"2023-11-28T20:39:00.372562+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:39:00.372562+0000","last_undegraded":"2023-11-28T20:39:00.372562+0000","last_fullsized":"2023-11-28T20:39:00.372562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445985+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:25.445985+0000","last_peered":"2023-11-28T20:38:25.445985+0000","last_clean":"2023-11-28T20:38:25.445985+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:25.445985+0000","last_undegraded":"2023-11-28T20:38:25.445985+0000","last_fullsized":"2023-11-28T20:38:25.445985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344646+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:24.344646+0000","last_peered":"2023-11-28T20:38:24.344646+0000","last_clean":"2023-11-28T20:38:24.344646+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:24.344646+0000","last_undegraded":"2023-11-28T20:38:24.344646+0000","last_fullsized":"2023-11-28T20:38:24.344646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573108+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:45.573108+0000","last_peered":"2023-11-28T20:38:45.573108+0000","last_clean":"2023-11-28T20:38:45.573108+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:45.573108+0000","last_undegraded":"2023-11-28T20:38:45.573108+0000","last_fullsized":"2023-11-28T20:38:45.573108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524020+0000","last_change":"2023-11-28T20:38:23.592734+0000","last_active":"2023-11-28T20:38:24.524020+0000","last_peered":"2023-11-28T20:38:24.524020+0000","last_clean":"2023-11-28T20:38:24.524020+0000","last_became_active":"2023-11-28T20:38:23.592348+0000","last_became_peered":"2023-11-28T20:38:23.592348+0000","last_unstale":"2023-11-28T20:38:24.524020+0000","last_undegraded":"2023-11-28T20:38:24.524020+0000","last_fullsized":"2023-11-28T20:38:24.524020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:11:10.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350686+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:24.350686+0000","last_peered":"2023-11-28T20:38:24.350686+0000","last_clean":"2023-11-28T20:38:24.350686+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:24.350686+0000","last_undegraded":"2023-11-28T20:38:24.350686+0000","last_fullsized":"2023-11-28T20:38:24.350686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574006+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:45.574006+0000","last_peered":"2023-11-28T20:38:45.574006+0000","last_clean":"2023-11-28T20:38:45.574006+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:45.574006+0000","last_undegraded":"2023-11-28T20:38:45.574006+0000","last_fullsized":"2023-11-28T20:38:45.574006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.523851+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:38:24.523851+0000","last_peered":"2023-11-28T20:38:24.523851+0000","last_clean":"2023-11-28T20:38:24.523851+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:38:24.523851+0000","last_undegraded":"2023-11-28T20:38:24.523851+0000","last_fullsized":"2023-11-28T20:38:24.523851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439118+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:25.439118+0000","last_peered":"2023-11-28T20:38:25.439118+0000","last_clean":"2023-11-28T20:38:25.439118+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:25.439118+0000","last_undegraded":"2023-11-28T20:38:25.439118+0000","last_fullsized":"2023-11-28T20:38:25.439118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372002+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:39:00.372002+0000","last_peered":"2023-11-28T20:39:00.372002+0000","last_clean":"2023-11-28T20:39:00.372002+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:39:00.372002+0000","last_undegraded":"2023-11-28T20:39:00.372002+0000","last_fullsized":"2023-11-28T20:39:00.372002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.570975+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:45.570975+0000","last_peered":"2023-11-28T20:38:45.570975+0000","last_clean":"2023-11-28T20:38:45.570975+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:45.570975+0000","last_undegraded":"2023-11-28T20:38:45.570975+0000","last_fullsized":"2023-11-28T20:38:45.570975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441612+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:25.441612+0000","last_peered":"2023-11-28T20:38:25.441612+0000","last_clean":"2023-11-28T20:38:25.441612+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:25.441612+0000","last_undegraded":"2023-11-28T20:38:25.441612+0000","last_fullsized":"2023-11-28T20:38:25.441612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556007+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:38:23.556007+0000","last_peered":"2023-11-28T20:38:23.556007+0000","last_clean":"2023-11-28T20:38:23.556007+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:38:23.556007+0000","last_undegraded":"2023-11-28T20:38:23.556007+0000","last_fullsized":"2023-11-28T20:38:23.556007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606505+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:38:51.606505+0000","last_peered":"2023-11-28T20:38:51.606505+0000","last_clean":"2023-11-28T20:38:51.606505+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:38:51.606505+0000","last_undegraded":"2023-11-28T20:38:51.606505+0000","last_fullsized":"2023-11-28T20:38:51.606505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.610690+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:51.610690+0000","last_peered":"2023-11-28T20:38:51.610690+0000","last_clean":"2023-11-28T20:38:51.610690+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:51.610690+0000","last_undegraded":"2023-11-28T20:38:51.610690+0000","last_fullsized":"2023-11-28T20:38:51.610690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344364+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:24.344364+0000","last_peered":"2023-11-28T20:38:24.344364+0000","last_clean":"2023-11-28T20:38:24.344364+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:24.344364+0000","last_undegraded":"2023-11-28T20:38:24.344364+0000","last_fullsized":"2023-11-28T20:38:24.344364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.534500+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:38:24.534500+0000","last_peered":"2023-11-28T20:38:24.534500+0000","last_clean":"2023-11-28T20:38:24.534500+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:38:24.534500+0000","last_undegraded":"2023-11-28T20:38:24.534500+0000","last_fullsized":"2023-11-28T20:38:24.534500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.579080+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:38:45.579080+0000","last_peered":"2023-11-28T20:38:45.579080+0000","last_clean":"2023-11-28T20:38:45.579080+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:38:45.579080+0000","last_undegraded":"2023-11-28T20:38:45.579080+0000","last_fullsized":"2023-11-28T20:38:45.579080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529110+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:24.529110+0000","last_peered":"2023-11-28T20:38:24.529110+0000","last_clean":"2023-11-28T20:38:24.529110+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:24.529110+0000","last_undegraded":"2023-11-28T20:38:24.529110+0000","last_fullsized":"2023-11-28T20:38:24.529110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.524719+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:38:24.524719+0000","last_peered":"2023-11-28T20:38:24.524719+0000","last_clean":"2023-11-28T20:38:24.524719+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:38:24.524719+0000","last_undegraded":"2023-11-28T20:38:24.524719+0000","last_fullsized":"2023-11-28T20:38:24.524719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349566+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:24.349566+0000","last_peered":"2023-11-28T20:38:24.349566+0000","last_clean":"2023-11-28T20:38:24.349566+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:24.349566+0000","last_undegraded":"2023-11-28T20:38:24.349566+0000","last_fullsized":"2023-11-28T20:38:24.349566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.579796+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:38:23.579796+0000","last_peered":"2023-11-28T20:38:23.579796+0000","last_clean":"2023-11-28T20:38:23.579796+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:38:23.579796+0000","last_undegraded":"2023-11-28T20:38:23.579796+0000","last_fullsized":"2023-11-28T20:38:23.579796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349192+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:24.349192+0000","last_peered":"2023-11-28T20:38:24.349192+0000","last_clean":"2023-11-28T20:38:24.349192+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:24.349192+0000","last_undegraded":"2023-11-28T20:38:24.349192+0000","last_fullsized":"2023-11-28T20:38:24.349192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344288+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:24.344288+0000","last_peered":"2023-11-28T20:38:24.344288+0000","last_clean":"2023-11-28T20:38:24.344288+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:24.344288+0000","last_undegraded":"2023-11-28T20:38:24.344288+0000","last_fullsized":"2023-11-28T20:38:24.344288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556118+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:38:23.556118+0000","last_peered":"2023-11-28T20:38:23.556118+0000","last_clean":"2023-11-28T20:38:23.556118+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:38:23.556118+0000","last_undegraded":"2023-11-28T20:38:23.556118+0000","last_fullsized":"2023-11-28T20:38:23.556118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372406+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:39:00.372406+0000","last_peered":"2023-11-28T20:39:00.372406+0000","last_clean":"2023-11-28T20:39:00.372406+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:39:00.372406+0000","last_undegraded":"2023-11-28T20:39:00.372406+0000","last_fullsized":"2023-11-28T20:39:00.372406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351931+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:24.351931+0000","last_peered":"2023-11-28T20:38:24.351931+0000","last_clean":"2023-11-28T20:38:24.351931+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:24.351931+0000","last_undegraded":"2023-11-28T20:38:24.351931+0000","last_fullsized":"2023-11-28T20:38:24.351931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556268+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:38:23.556268+0000","last_peered":"2023-11-28T20:38:23.556268+0000","last_clean":"2023-11-28T20:38:23.556268+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:38:23.556268+0000","last_undegraded":"2023-11-28T20:38:23.556268+0000","last_fullsized":"2023-11-28T20:38:23.556268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348638+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:24.348638+0000","last_peered":"2023-11-28T20:38:24.348638+0000","last_clean":"2023-11-28T20:38:24.348638+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:24.348638+0000","last_undegraded":"2023-11-28T20:38:24.348638+0000","last_fullsized":"2023-11-28T20:38:24.348638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.555549+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:38:23.555549+0000","last_peered":"2023-11-28T20:38:23.555549+0000","last_clean":"2023-11-28T20:38:23.555549+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:38:23.555549+0000","last_undegraded":"2023-11-28T20:38:23.555549+0000","last_fullsized":"2023-11-28T20:38:23.555549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.559455+0000","last_change":"2023-11-28T20:38:19.391161+0000","last_active":"2023-11-28T20:38:23.559455+0000","last_peered":"2023-11-28T20:38:23.559455+0000","last_clean":"2023-11-28T20:38:23.559455+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:38:23.559455+0000","last_undegraded":"2023-11-28T20:38:23.559455+0000","last_fullsized":"2023-11-28T20:38:23.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:29.088707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344051+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:24.344051+0000","last_peered":"2023-11-28T20:38:24.344051+0000","last_clean":"2023-11-28T20:38:24.344051+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:24.344051+0000","last_undegraded":"2023-11-28T20:38:24.344051+0000","last_fullsized":"2023-11-28T20:38:24.344051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351494+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:24.351494+0000","last_peered":"2023-11-28T20:38:24.351494+0000","last_clean":"2023-11-28T20:38:24.351494+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:24.351494+0000","last_undegraded":"2023-11-28T20:38:24.351494+0000","last_fullsized":"2023-11-28T20:38:24.351494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528399+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:24.528399+0000","last_peered":"2023-11-28T20:38:24.528399+0000","last_clean":"2023-11-28T20:38:24.528399+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:24.528399+0000","last_undegraded":"2023-11-28T20:38:24.528399+0000","last_fullsized":"2023-11-28T20:38:24.528399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.583087+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:38:23.583087+0000","last_peered":"2023-11-28T20:38:23.583087+0000","last_clean":"2023-11-28T20:38:23.583087+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:38:23.583087+0000","last_undegraded":"2023-11-28T20:38:23.583087+0000","last_fullsized":"2023-11-28T20:38:23.583087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351592+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:24.351592+0000","last_peered":"2023-11-28T20:38:24.351592+0000","last_clean":"2023-11-28T20:38:24.351592+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:24.351592+0000","last_undegraded":"2023-11-28T20:38:24.351592+0000","last_fullsized":"2023-11-28T20:38:24.351592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348427+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:24.348427+0000","last_peered":"2023-11-28T20:38:24.348427+0000","last_clean":"2023-11-28T20:38:24.348427+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:24.348427+0000","last_undegraded":"2023-11-28T20:38:24.348427+0000","last_fullsized":"2023-11-28T20:38:24.348427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371998+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:39:00.371998+0000","last_peered":"2023-11-28T20:39:00.371998+0000","last_clean":"2023-11-28T20:39:00.371998+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:39:00.371998+0000","last_undegraded":"2023-11-28T20:39:00.371998+0000","last_fullsized":"2023-11-28T20:39:00.371998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344015+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:24.344015+0000","last_peered":"2023-11-28T20:38:24.344015+0000","last_clean":"2023-11-28T20:38:24.344015+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:24.344015+0000","last_undegraded":"2023-11-28T20:38:24.344015+0000","last_fullsized":"2023-11-28T20:38:24.344015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.556123+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:38:23.556123+0000","last_peered":"2023-11-28T20:38:23.556123+0000","last_clean":"2023-11-28T20:38:23.556123+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:38:23.556123+0000","last_undegraded":"2023-11-28T20:38:23.556123+0000","last_fullsized":"2023-11-28T20:38:23.556123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529932+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:24.529932+0000","last_peered":"2023-11-28T20:38:24.529932+0000","last_clean":"2023-11-28T20:38:24.529932+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:24.529932+0000","last_undegraded":"2023-11-28T20:38:24.529932+0000","last_fullsized":"2023-11-28T20:38:24.529932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351455+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:24.351455+0000","last_peered":"2023-11-28T20:38:24.351455+0000","last_clean":"2023-11-28T20:38:24.351455+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:24.351455+0000","last_undegraded":"2023-11-28T20:38:24.351455+0000","last_fullsized":"2023-11-28T20:38:24.351455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:24.351828+0000","last_change":"2023-11-28T20:39:00.374712+0000","last_active":"2023-11-28T20:39:00.374712+0000","last_peered":"2023-11-28T20:38:24.351828+0000","last_clean":"2023-11-28T20:38:24.351828+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:24.351828+0000","last_undegraded":"2023-11-28T20:38:24.351828+0000","last_fullsized":"2023-11-28T20:38:24.351828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530905+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:24.530905+0000","last_peered":"2023-11-28T20:38:24.530905+0000","last_clean":"2023-11-28T20:38:24.530905+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:24.530905+0000","last_undegraded":"2023-11-28T20:38:24.530905+0000","last_fullsized":"2023-11-28T20:38:24.530905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-28T20:38:23.554837+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:38:23.554837+0000","last_peered":"2023-11-28T20:38:23.554837+0000","last_clean":"2023-11-28T20:38:23.554837+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:38:23.554837+0000","last_undegraded":"2023-11-28T20:38:23.554837+0000","last_fullsized":"2023-11-28T20:38:23.554837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527751+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:24.527751+0000","last_peered":"2023-11-28T20:38:24.527751+0000","last_clean":"2023-11-28T20:38:24.527751+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:24.527751+0000","last_undegraded":"2023-11-28T20:38:24.527751+0000","last_fullsized":"2023-11-28T20:38:24.527751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348972+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:24.348972+0000","last_peered":"2023-11-28T20:38:24.348972+0000","last_clean":"2023-11-28T20:38:24.348972+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:24.348972+0000","last_undegraded":"2023-11-28T20:38:24.348972+0000","last_fullsized":"2023-11-28T20:38:24.348972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527847+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:24.527847+0000","last_peered":"2023-11-28T20:38:24.527847+0000","last_clean":"2023-11-28T20:38:24.527847+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:24.527847+0000","last_undegraded":"2023-11-28T20:38:24.527847+0000","last_fullsized":"2023-11-28T20:38:24.527847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350257+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:24.350257+0000","last_peered":"2023-11-28T20:38:24.350257+0000","last_clean":"2023-11-28T20:38:24.350257+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:24.350257+0000","last_undegraded":"2023-11-28T20:38:24.350257+0000","last_fullsized":"2023-11-28T20:38:24.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344441+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:24.344441+0000","last_peered":"2023-11-28T20:38:24.344441+0000","last_clean":"2023-11-28T20:38:24.344441+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:24.344441+0000","last_undegraded":"2023-11-28T20:38:24.344441+0000","last_fullsized":"2023-11-28T20:38:24.344441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373007+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:39:00.373007+0000","last_peered":"2023-11-28T20:39:00.373007+0000","last_clean":"2023-11-28T20:39:00.373007+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:39:00.373007+0000","last_undegraded":"2023-11-28T20:39:00.373007+0000","last_fullsized":"2023-11-28T20:39:00.373007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530439+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:24.530439+0000","last_peered":"2023-11-28T20:38:24.530439+0000","last_clean":"2023-11-28T20:38:24.530439+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:24.530439+0000","last_undegraded":"2023-11-28T20:38:24.530439+0000","last_fullsized":"2023-11-28T20:38:24.530439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7705,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":106578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":102843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":693709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":693053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:39:05.881 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:39:06.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.024+0000 7f60b069e640 1 Processor -- start 2023-11-28T20:39:06.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.024+0000 7f60b069e640 1 -- start start 2023-11-28T20:39:06.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60b069e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f60a806e030 0x7f60a81500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60b069e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60a8072630 0x7f60a81505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60b069e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a81571d0 con 0x7f60a8070480 2023-11-28T20:39:06.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60b069e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a8071a90 con 0x7f60a8072630 2023-11-28T20:39:06.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60b069e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a80c70d0 con 0x7f60a806e030 2023-11-28T20:39:06.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60aec3b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60a8072630 0x7f60a81505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60aec3b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60a8072630 0x7f60a81505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33428/0 (socket says 172.21.15.167:33428) 2023-11-28T20:39:06.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60aec3b640 1 -- 172.21.15.167:0/549969800 learned_addr learned my addr 172.21.15.167:0/549969800 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:06.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60ae43a640 1 --2- 172.21.15.167:0/549969800 >> v2:172.21.15.178:3300/0 conn(0x7f60a806e030 0x7f60a81500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60aec3b640 1 -- 172.21.15.167:0/549969800 >> v2:172.21.15.178:3300/0 conn(0x7f60a806e030 msgr2=0x7f60a81500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:06.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60aec3b640 1 --2- 172.21.15.167:0/549969800 >> v2:172.21.15.178:3300/0 conn(0x7f60a806e030 0x7f60a81500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60aec3b640 1 -- 172.21.15.167:0/549969800 >> v1:172.21.15.178:6789/0 conn(0x7f60a8070480 legacy=0x7f60a8071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60aec3b640 1 -- 172.21.15.167:0/549969800 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a80c73b0 con 0x7f60a8072630 2023-11-28T20:39:06.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.028+0000 7f60aec3b640 1 --2- 172.21.15.167:0/549969800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a8072630 0x7f60a81505f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f60a80cbff0 tx=0x7f60a001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe23f39fdc4295 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:06.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60ad438640 1 -- 172.21.15.167:0/549969800 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a00a5710 con 0x7f60a8072630 2023-11-28T20:39:06.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60ad438640 1 -- 172.21.15.167:0/549969800 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a00a5870 con 0x7f60a8072630 2023-11-28T20:39:06.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60ad438640 1 -- 172.21.15.167:0/549969800 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a00a5c00 con 0x7f60a8072630 2023-11-28T20:39:06.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 -- 172.21.15.167:0/549969800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a8072630 msgr2=0x7f60a81505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 --2- 172.21.15.167:0/549969800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a8072630 0x7f60a81505f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f60a80cbff0 tx=0x7f60a001c960 comp rx=0 tx=0).stop 2023-11-28T20:39:06.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 -- 172.21.15.167:0/549969800 shutdown_connections 2023-11-28T20:39:06.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 --2- 172.21.15.167:0/549969800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a8072630 0x7f60a81505f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 --2- 172.21.15.167:0/549969800 >> v2:172.21.15.178:3300/0 conn(0x7f60a806e030 0x7f60a81500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 -- 172.21.15.167:0/549969800 >> 172.21.15.167:0/549969800 conn(0x7f60a80cb1e0 msgr2=0x7f60a80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:06.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 -- 172.21.15.167:0/549969800 shutdown_connections 2023-11-28T20:39:06.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 -- 172.21.15.167:0/549969800 wait complete. 2023-11-28T20:39:06.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 Processor -- start 2023-11-28T20:39:06.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 -- start start 2023-11-28T20:39:06.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a806e030 0x7f60a80c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60a8070480 0x7f60a8149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60a8072630 0x7f60a81f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a8155980 con 0x7f60a806e030 2023-11-28T20:39:06.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80c95e0 con 0x7f60a8070480 2023-11-28T20:39:06.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60b069e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a81553e0 con 0x7f60a8072630 2023-11-28T20:39:06.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.032+0000 7f60ae43a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a806e030 0x7f60a80c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60ae43a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a806e030 0x7f60a80c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33434/0 (socket says 172.21.15.167:33434) 2023-11-28T20:39:06.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60ae43a640 1 -- 172.21.15.167:0/843759327 learned_addr learned my addr 172.21.15.167:0/843759327 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:06.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60aec3b640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60a8072630 0x7f60a81f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60adc39640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60a8070480 0x7f60a8149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60ae43a640 1 -- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60a8072630 msgr2=0x7f60a81f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60ae43a640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60a8072630 0x7f60a81f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60ae43a640 1 -- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60a8070480 msgr2=0x7f60a8149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60ae43a640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60a8070480 0x7f60a8149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60ae43a640 1 -- 172.21.15.167:0/843759327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0009b30 con 0x7f60a806e030 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60ae43a640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a806e030 0x7f60a80c90a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f60a400d620 tx=0x7f60a400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f609effd640 1 -- 172.21.15.167:0/843759327 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400b620 con 0x7f60a806e030 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f609effd640 1 -- 172.21.15.167:0/843759327 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a400b780 con 0x7f60a806e030 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a81556a0 con 0x7f60a806e030 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f609effd640 1 -- 172.21.15.167:0/843759327 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400bb10 con 0x7f60a806e030 2023-11-28T20:39:06.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a8147120 con 0x7f60a806e030 2023-11-28T20:39:06.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a80682c0 con 0x7f60a806e030 2023-11-28T20:39:06.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.036+0000 7f609effd640 1 -- 172.21.15.167:0/843759327 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f60a400bc70 con 0x7f60a806e030 2023-11-28T20:39:06.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.040+0000 7f609effd640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f608c0664a0 0x7f608c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.040+0000 7f609effd640 1 -- 172.21.15.167:0/843759327 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f60a40847d0 con 0x7f60a806e030 2023-11-28T20:39:06.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.040+0000 7f60adc39640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f608c0664a0 0x7f608c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.040+0000 7f60adc39640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f608c0664a0 0x7f608c068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f60a8144f90 tx=0x7f6098009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:06.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.044+0000 7f609effd640 1 -- 172.21.15.167:0/843759327 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60a4051760 con 0x7f60a806e030 2023-11-28T20:39:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.188+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60a8146ca0 con 0x7f608c0664a0 2023-11-28T20:39:06.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.216+0000 7f609effd640 1 -- 172.21.15.167:0/843759327 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345280 (secure 0 0 0) 0x7f60a8146ca0 con 0x7f608c0664a0 2023-11-28T20:39:06.224 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:06.226 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:39:06.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f608c0664a0 msgr2=0x7f608c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f608c0664a0 0x7f608c068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f60a8144f90 tx=0x7f6098009040 comp rx=0 tx=0).stop 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a806e030 msgr2=0x7f60a80c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a806e030 0x7f60a80c90a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f60a400d620 tx=0x7f60a400dae0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 shutdown_connections 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f608c0664a0 0x7f608c068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60a8072630 0x7f60a81f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60a8070480 0x7f60a8149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 --2- 172.21.15.167:0/843759327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60a806e030 0x7f60a80c90a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 >> 172.21.15.167:0/843759327 conn(0x7f60a80cb1e0 msgr2=0x7f60a815f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 shutdown_connections 2023-11-28T20:39:06.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.220+0000 7f60b069e640 1 -- 172.21.15.167:0/843759327 wait complete. 2023-11-28T20:39:06.242 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-11-28T20:39:05.446176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598073,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":289,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3384,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3465216,"data_stored":2040447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":254,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003359"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.609165+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:51.609165+0000","last_peered":"2023-11-28T20:38:51.609165+0000","last_clean":"2023-11-28T20:38:51.609165+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:51.609165+0000","last_undegraded":"2023-11-28T20:38:51.609165+0000","last_fullsized":"2023-11-28T20:38:51.609165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.390144+0000","last_change":"2023-11-28T20:39:01.387644+0000","last_active":"2023-11-28T20:39:01.390144+0000","last_peered":"2023-11-28T20:39:01.390144+0000","last_clean":"2023-11-28T20:39:01.390144+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T20:39:01.390144+0000","last_undegraded":"2023-11-28T20:39:01.390144+0000","last_fullsized":"2023-11-28T20:39:01.390144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:52.977080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376803+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:39:00.376803+0000","last_peered":"2023-11-28T20:39:00.376803+0000","last_clean":"2023-11-28T20:39:00.376803+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:39:00.376803+0000","last_undegraded":"2023-11-28T20:39:00.376803+0000","last_fullsized":"2023-11-28T20:39:00.376803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378262+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:39:00.378262+0000","last_peered":"2023-11-28T20:39:00.378262+0000","last_clean":"2023-11-28T20:39:00.378262+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:39:00.378262+0000","last_undegraded":"2023-11-28T20:39:00.378262+0000","last_fullsized":"2023-11-28T20:39:00.378262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344550+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:24.344550+0000","last_peered":"2023-11-28T20:38:24.344550+0000","last_clean":"2023-11-28T20:38:24.344550+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:24.344550+0000","last_undegraded":"2023-11-28T20:38:24.344550+0000","last_fullsized":"2023-11-28T20:38:24.344550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:25.445649+0000","last_change":"2023-11-28T20:39:00.368426+0000","last_active":"2023-11-28T20:39:00.368426+0000","last_peered":"2023-11-28T20:38:25.445649+0000","last_clean":"2023-11-28T20:38:25.445649+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:25.445649+0000","last_undegraded":"2023-11-28T20:38:25.445649+0000","last_fullsized":"2023-11-28T20:38:25.445649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606601+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:51.606601+0000","last_peered":"2023-11-28T20:38:51.606601+0000","last_clean":"2023-11-28T20:38:51.606601+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:51.606601+0000","last_undegraded":"2023-11-28T20:38:51.606601+0000","last_fullsized":"2023-11-28T20:38:51.606601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350728+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:24.350728+0000","last_peered":"2023-11-28T20:38:24.350728+0000","last_clean":"2023-11-28T20:38:24.350728+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:24.350728+0000","last_undegraded":"2023-11-28T20:38:24.350728+0000","last_fullsized":"2023-11-28T20:38:24.350728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445936+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:25.445936+0000","last_peered":"2023-11-28T20:38:25.445936+0000","last_clean":"2023-11-28T20:38:25.445936+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:25.445936+0000","last_undegraded":"2023-11-28T20:38:25.445936+0000","last_fullsized":"2023-11-28T20:38:25.445936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532409+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532409+0000","last_peered":"2023-11-28T20:38:24.532409+0000","last_clean":"2023-11-28T20:38:24.532409+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532409+0000","last_undegraded":"2023-11-28T20:38:24.532409+0000","last_fullsized":"2023-11-28T20:38:24.532409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350514+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:24.350514+0000","last_peered":"2023-11-28T20:38:24.350514+0000","last_clean":"2023-11-28T20:38:24.350514+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:24.350514+0000","last_undegraded":"2023-11-28T20:38:24.350514+0000","last_fullsized":"2023-11-28T20:38:24.350514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445855+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:25.445855+0000","last_peered":"2023-11-28T20:38:25.445855+0000","last_clean":"2023-11-28T20:38:25.445855+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:25.445855+0000","last_undegraded":"2023-11-28T20:38:25.445855+0000","last_fullsized":"2023-11-28T20:38:25.445855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350262+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:24.350262+0000","last_peered":"2023-11-28T20:38:24.350262+0000","last_clean":"2023-11-28T20:38:24.350262+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:24.350262+0000","last_undegraded":"2023-11-28T20:38:24.350262+0000","last_fullsized":"2023-11-28T20:38:24.350262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575295+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:45.575295+0000","last_peered":"2023-11-28T20:38:45.575295+0000","last_clean":"2023-11-28T20:38:45.575295+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:45.575295+0000","last_undegraded":"2023-11-28T20:38:45.575295+0000","last_fullsized":"2023-11-28T20:38:45.575295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446173+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:25.446173+0000","last_peered":"2023-11-28T20:38:25.446173+0000","last_clean":"2023-11-28T20:38:25.446173+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:25.446173+0000","last_undegraded":"2023-11-28T20:38:25.446173+0000","last_fullsized":"2023-11-28T20:38:25.446173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377543+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:39:00.377543+0000","last_peered":"2023-11-28T20:39:00.377543+0000","last_clean":"2023-11-28T20:39:00.377543+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:39:00.377543+0000","last_undegraded":"2023-11-28T20:39:00.377543+0000","last_fullsized":"2023-11-28T20:39:00.377543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372769+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:39:00.372769+0000","last_peered":"2023-11-28T20:39:00.372769+0000","last_clean":"2023-11-28T20:39:00.372769+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:39:00.372769+0000","last_undegraded":"2023-11-28T20:39:00.372769+0000","last_fullsized":"2023-11-28T20:39:00.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446061+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:25.446061+0000","last_peered":"2023-11-28T20:38:25.446061+0000","last_clean":"2023-11-28T20:38:25.446061+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:25.446061+0000","last_undegraded":"2023-11-28T20:38:25.446061+0000","last_fullsized":"2023-11-28T20:38:25.446061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377798+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:39:00.377798+0000","last_peered":"2023-11-28T20:39:00.377798+0000","last_clean":"2023-11-28T20:39:00.377798+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:39:00.377798+0000","last_undegraded":"2023-11-28T20:39:00.377798+0000","last_fullsized":"2023-11-28T20:39:00.377798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372086+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:39:00.372086+0000","last_peered":"2023-11-28T20:39:00.372086+0000","last_clean":"2023-11-28T20:39:00.372086+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:39:00.372086+0000","last_undegraded":"2023-11-28T20:39:00.372086+0000","last_fullsized":"2023-11-28T20:39:00.372086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373087+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.373087+0000","last_peered":"2023-11-28T20:39:00.373087+0000","last_clean":"2023-11-28T20:39:00.373087+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:39:00.373087+0000","last_undegraded":"2023-11-28T20:39:00.373087+0000","last_fullsized":"2023-11-28T20:39:00.373087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528774+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:24.528774+0000","last_peered":"2023-11-28T20:38:24.528774+0000","last_clean":"2023-11-28T20:38:24.528774+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:24.528774+0000","last_undegraded":"2023-11-28T20:38:24.528774+0000","last_fullsized":"2023-11-28T20:38:24.528774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575123+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:45.575123+0000","last_peered":"2023-11-28T20:38:45.575123+0000","last_clean":"2023-11-28T20:38:45.575123+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:45.575123+0000","last_undegraded":"2023-11-28T20:38:45.575123+0000","last_fullsized":"2023-11-28T20:38:45.575123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446227+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:25.446227+0000","last_peered":"2023-11-28T20:38:25.446227+0000","last_clean":"2023-11-28T20:38:25.446227+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:25.446227+0000","last_undegraded":"2023-11-28T20:38:25.446227+0000","last_fullsized":"2023-11-28T20:38:25.446227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344675+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:24.344675+0000","last_peered":"2023-11-28T20:38:24.344675+0000","last_clean":"2023-11-28T20:38:24.344675+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:24.344675+0000","last_undegraded":"2023-11-28T20:38:24.344675+0000","last_fullsized":"2023-11-28T20:38:24.344675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573711+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:45.573711+0000","last_peered":"2023-11-28T20:38:45.573711+0000","last_clean":"2023-11-28T20:38:45.573711+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:45.573711+0000","last_undegraded":"2023-11-28T20:38:45.573711+0000","last_fullsized":"2023-11-28T20:38:45.573711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445762+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:25.445762+0000","last_peered":"2023-11-28T20:38:25.445762+0000","last_clean":"2023-11-28T20:38:25.445762+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:25.445762+0000","last_undegraded":"2023-11-28T20:38:25.445762+0000","last_fullsized":"2023-11-28T20:38:25.445762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378189+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:39:00.378189+0000","last_peered":"2023-11-28T20:39:00.378189+0000","last_clean":"2023-11-28T20:39:00.378189+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:39:00.378189+0000","last_undegraded":"2023-11-28T20:39:00.378189+0000","last_fullsized":"2023-11-28T20:39:00.378189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373110+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:39:00.373110+0000","last_peered":"2023-11-28T20:39:00.373110+0000","last_clean":"2023-11-28T20:39:00.373110+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:39:00.373110+0000","last_undegraded":"2023-11-28T20:39:00.373110+0000","last_fullsized":"2023-11-28T20:39:00.373110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377445+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:39:00.377445+0000","last_peered":"2023-11-28T20:39:00.377445+0000","last_clean":"2023-11-28T20:39:00.377445+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:39:00.377445+0000","last_undegraded":"2023-11-28T20:39:00.377445+0000","last_fullsized":"2023-11-28T20:39:00.377445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372844+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:39:00.372844+0000","last_peered":"2023-11-28T20:39:00.372844+0000","last_clean":"2023-11-28T20:39:00.372844+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:39:00.372844+0000","last_undegraded":"2023-11-28T20:39:00.372844+0000","last_fullsized":"2023-11-28T20:39:00.372844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574343+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:45.574343+0000","last_peered":"2023-11-28T20:38:45.574343+0000","last_clean":"2023-11-28T20:38:45.574343+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:45.574343+0000","last_undegraded":"2023-11-28T20:38:45.574343+0000","last_fullsized":"2023-11-28T20:38:45.574343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439058+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:25.439058+0000","last_peered":"2023-11-28T20:38:25.439058+0000","last_clean":"2023-11-28T20:38:25.439058+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:25.439058+0000","last_undegraded":"2023-11-28T20:38:25.439058+0000","last_fullsized":"2023-11-28T20:38:25.439058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350784+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:24.350784+0000","last_peered":"2023-11-28T20:38:24.350784+0000","last_clean":"2023-11-28T20:38:24.350784+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:24.350784+0000","last_undegraded":"2023-11-28T20:38:24.350784+0000","last_fullsized":"2023-11-28T20:38:24.350784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372929+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:39:00.372929+0000","last_peered":"2023-11-28T20:39:00.372929+0000","last_clean":"2023-11-28T20:39:00.372929+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:39:00.372929+0000","last_undegraded":"2023-11-28T20:39:00.372929+0000","last_fullsized":"2023-11-28T20:39:00.372929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":6,"reported_epoch":27,"state":"activating","last_fresh":"2023-11-28T20:39:01.389091+0000","last_change":"2023-11-28T20:39:01.378051+0000","last_active":"2023-11-28T20:38:22.532017+0000","last_peered":"2023-11-28T20:38:22.532017+0000","last_clean":"2023-11-28T20:38:22.532017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:39:01.389091+0000","last_undegraded":"2023-11-28T20:39:01.389091+0000","last_fullsized":"2023-11-28T20:39:01.389091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:50:13.565586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":["2(0)","0(3)","1(0)","4(2)","5(1)"],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529967+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:24.529967+0000","last_peered":"2023-11-28T20:38:24.529967+0000","last_clean":"2023-11-28T20:38:24.529967+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:24.529967+0000","last_undegraded":"2023-11-28T20:38:24.529967+0000","last_fullsized":"2023-11-28T20:38:24.529967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608154+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:51.608154+0000","last_peered":"2023-11-28T20:38:51.608154+0000","last_clean":"2023-11-28T20:38:51.608154+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:51.608154+0000","last_undegraded":"2023-11-28T20:38:51.608154+0000","last_fullsized":"2023-11-28T20:38:51.608154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372765+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:39:00.372765+0000","last_peered":"2023-11-28T20:39:00.372765+0000","last_clean":"2023-11-28T20:39:00.372765+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:39:00.372765+0000","last_undegraded":"2023-11-28T20:39:00.372765+0000","last_fullsized":"2023-11-28T20:39:00.372765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373168+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:39:00.373168+0000","last_peered":"2023-11-28T20:39:00.373168+0000","last_clean":"2023-11-28T20:39:00.373168+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:39:00.373168+0000","last_undegraded":"2023-11-28T20:39:00.373168+0000","last_fullsized":"2023-11-28T20:39:00.373168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370832+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:39:00.370832+0000","last_peered":"2023-11-28T20:39:00.370832+0000","last_clean":"2023-11-28T20:39:00.370832+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:39:00.370832+0000","last_undegraded":"2023-11-28T20:39:00.370832+0000","last_fullsized":"2023-11-28T20:39:00.370832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373409+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:39:00.373409+0000","last_peered":"2023-11-28T20:39:00.373409+0000","last_clean":"2023-11-28T20:39:00.373409+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:39:00.373409+0000","last_undegraded":"2023-11-28T20:39:00.373409+0000","last_fullsized":"2023-11-28T20:39:00.373409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.343810+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:24.343810+0000","last_peered":"2023-11-28T20:38:24.343810+0000","last_clean":"2023-11-28T20:38:24.343810+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:24.343810+0000","last_undegraded":"2023-11-28T20:38:24.343810+0000","last_fullsized":"2023-11-28T20:38:24.343810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608237+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:51.608237+0000","last_peered":"2023-11-28T20:38:51.608237+0000","last_clean":"2023-11-28T20:38:51.608237+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:51.608237+0000","last_undegraded":"2023-11-28T20:38:51.608237+0000","last_fullsized":"2023-11-28T20:38:51.608237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439136+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:25.439136+0000","last_peered":"2023-11-28T20:38:25.439136+0000","last_clean":"2023-11-28T20:38:25.439136+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:25.439136+0000","last_undegraded":"2023-11-28T20:38:25.439136+0000","last_fullsized":"2023-11-28T20:38:25.439136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376856+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:39:00.376856+0000","last_peered":"2023-11-28T20:39:00.376856+0000","last_clean":"2023-11-28T20:39:00.376856+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:39:00.376856+0000","last_undegraded":"2023-11-28T20:39:00.376856+0000","last_fullsized":"2023-11-28T20:39:00.376856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608459+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:51.608459+0000","last_peered":"2023-11-28T20:38:51.608459+0000","last_clean":"2023-11-28T20:38:51.608459+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:51.608459+0000","last_undegraded":"2023-11-28T20:38:51.608459+0000","last_fullsized":"2023-11-28T20:38:51.608459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528002+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:24.528002+0000","last_peered":"2023-11-28T20:38:24.528002+0000","last_clean":"2023-11-28T20:38:24.528002+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:24.528002+0000","last_undegraded":"2023-11-28T20:38:24.528002+0000","last_fullsized":"2023-11-28T20:38:24.528002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441545+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:25.441545+0000","last_peered":"2023-11-28T20:38:25.441545+0000","last_clean":"2023-11-28T20:38:25.441545+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:25.441545+0000","last_undegraded":"2023-11-28T20:38:25.441545+0000","last_fullsized":"2023-11-28T20:38:25.441545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528152+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:24.528152+0000","last_peered":"2023-11-28T20:38:24.528152+0000","last_clean":"2023-11-28T20:38:24.528152+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:24.528152+0000","last_undegraded":"2023-11-28T20:38:24.528152+0000","last_fullsized":"2023-11-28T20:38:24.528152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371241+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:39:00.371241+0000","last_peered":"2023-11-28T20:39:00.371241+0000","last_clean":"2023-11-28T20:39:00.371241+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:39:00.371241+0000","last_undegraded":"2023-11-28T20:39:00.371241+0000","last_fullsized":"2023-11-28T20:39:00.371241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441453+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:25.441453+0000","last_peered":"2023-11-28T20:38:25.441453+0000","last_clean":"2023-11-28T20:38:25.441453+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:25.441453+0000","last_undegraded":"2023-11-28T20:38:25.441453+0000","last_fullsized":"2023-11-28T20:38:25.441453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350421+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:24.350421+0000","last_peered":"2023-11-28T20:38:24.350421+0000","last_clean":"2023-11-28T20:38:24.350421+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:24.350421+0000","last_undegraded":"2023-11-28T20:38:24.350421+0000","last_fullsized":"2023-11-28T20:38:24.350421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372659+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:39:00.372659+0000","last_peered":"2023-11-28T20:39:00.372659+0000","last_clean":"2023-11-28T20:39:00.372659+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:39:00.372659+0000","last_undegraded":"2023-11-28T20:39:00.372659+0000","last_fullsized":"2023-11-28T20:39:00.372659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439079+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:25.439079+0000","last_peered":"2023-11-28T20:38:25.439079+0000","last_clean":"2023-11-28T20:38:25.439079+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:25.439079+0000","last_undegraded":"2023-11-28T20:38:25.439079+0000","last_fullsized":"2023-11-28T20:38:25.439079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531147+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:24.531147+0000","last_peered":"2023-11-28T20:38:24.531147+0000","last_clean":"2023-11-28T20:38:24.531147+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:24.531147+0000","last_undegraded":"2023-11-28T20:38:24.531147+0000","last_fullsized":"2023-11-28T20:38:24.531147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371475+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:39:00.371475+0000","last_peered":"2023-11-28T20:39:00.371475+0000","last_clean":"2023-11-28T20:39:00.371475+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:39:00.371475+0000","last_undegraded":"2023-11-28T20:39:00.371475+0000","last_fullsized":"2023-11-28T20:39:00.371475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446714+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:25.446714+0000","last_peered":"2023-11-28T20:38:25.446714+0000","last_clean":"2023-11-28T20:38:25.446714+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:25.446714+0000","last_undegraded":"2023-11-28T20:38:25.446714+0000","last_fullsized":"2023-11-28T20:38:25.446714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529633+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:24.529633+0000","last_peered":"2023-11-28T20:38:24.529633+0000","last_clean":"2023-11-28T20:38:24.529633+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:24.529633+0000","last_undegraded":"2023-11-28T20:38:24.529633+0000","last_fullsized":"2023-11-28T20:38:24.529633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:56.834824+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:56.834824+0000","last_peered":"2023-11-28T20:38:56.834824+0000","last_clean":"2023-11-28T20:38:56.834824+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:56.834824+0000","last_undegraded":"2023-11-28T20:38:56.834824+0000","last_fullsized":"2023-11-28T20:38:56.834824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445709+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:25.445709+0000","last_peered":"2023-11-28T20:38:25.445709+0000","last_clean":"2023-11-28T20:38:25.445709+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:25.445709+0000","last_undegraded":"2023-11-28T20:38:25.445709+0000","last_fullsized":"2023-11-28T20:38:25.445709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527830+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:24.527830+0000","last_peered":"2023-11-28T20:38:24.527830+0000","last_clean":"2023-11-28T20:38:24.527830+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:24.527830+0000","last_undegraded":"2023-11-28T20:38:24.527830+0000","last_fullsized":"2023-11-28T20:38:24.527830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370725+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:39:00.370725+0000","last_peered":"2023-11-28T20:39:00.370725+0000","last_clean":"2023-11-28T20:39:00.370725+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:39:00.370725+0000","last_undegraded":"2023-11-28T20:39:00.370725+0000","last_fullsized":"2023-11-28T20:39:00.370725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439127+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:25.439127+0000","last_peered":"2023-11-28T20:38:25.439127+0000","last_clean":"2023-11-28T20:38:25.439127+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:25.439127+0000","last_undegraded":"2023-11-28T20:38:25.439127+0000","last_fullsized":"2023-11-28T20:38:25.439127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349743+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:24.349743+0000","last_peered":"2023-11-28T20:38:24.349743+0000","last_clean":"2023-11-28T20:38:24.349743+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:24.349743+0000","last_undegraded":"2023-11-28T20:38:24.349743+0000","last_fullsized":"2023-11-28T20:38:24.349743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.613830+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:51.613830+0000","last_peered":"2023-11-28T20:38:51.613830+0000","last_clean":"2023-11-28T20:38:51.613830+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:51.613830+0000","last_undegraded":"2023-11-28T20:38:51.613830+0000","last_fullsized":"2023-11-28T20:38:51.613830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378106+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:39:00.378106+0000","last_peered":"2023-11-28T20:39:00.378106+0000","last_clean":"2023-11-28T20:39:00.378106+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:39:00.378106+0000","last_undegraded":"2023-11-28T20:39:00.378106+0000","last_fullsized":"2023-11-28T20:39:00.378106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528018+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:24.528018+0000","last_peered":"2023-11-28T20:38:24.528018+0000","last_clean":"2023-11-28T20:38:24.528018+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:24.528018+0000","last_undegraded":"2023-11-28T20:38:24.528018+0000","last_fullsized":"2023-11-28T20:38:24.528018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.577200+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:45.577200+0000","last_peered":"2023-11-28T20:38:45.577200+0000","last_clean":"2023-11-28T20:38:45.577200+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:45.577200+0000","last_undegraded":"2023-11-28T20:38:45.577200+0000","last_fullsized":"2023-11-28T20:38:45.577200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377546+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.377546+0000","last_peered":"2023-11-28T20:39:00.377546+0000","last_clean":"2023-11-28T20:39:00.377546+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:39:00.377546+0000","last_undegraded":"2023-11-28T20:39:00.377546+0000","last_fullsized":"2023-11-28T20:39:00.377546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344100+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:24.344100+0000","last_peered":"2023-11-28T20:38:24.344100+0000","last_clean":"2023-11-28T20:38:24.344100+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:24.344100+0000","last_undegraded":"2023-11-28T20:38:24.344100+0000","last_fullsized":"2023-11-28T20:38:24.344100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607879+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:51.607879+0000","last_peered":"2023-11-28T20:38:51.607879+0000","last_clean":"2023-11-28T20:38:51.607879+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:51.607879+0000","last_undegraded":"2023-11-28T20:38:51.607879+0000","last_fullsized":"2023-11-28T20:38:51.607879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446949+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:25.446949+0000","last_peered":"2023-11-28T20:38:25.446949+0000","last_clean":"2023-11-28T20:38:25.446949+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:25.446949+0000","last_undegraded":"2023-11-28T20:38:25.446949+0000","last_fullsized":"2023-11-28T20:38:25.446949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527948+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:24.527948+0000","last_peered":"2023-11-28T20:38:24.527948+0000","last_clean":"2023-11-28T20:38:24.527948+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:24.527948+0000","last_undegraded":"2023-11-28T20:38:24.527948+0000","last_fullsized":"2023-11-28T20:38:24.527948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:58.919852+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:58.919852+0000","last_peered":"2023-11-28T20:38:58.919852+0000","last_clean":"2023-11-28T20:38:58.919852+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:58.919852+0000","last_undegraded":"2023-11-28T20:38:58.919852+0000","last_fullsized":"2023-11-28T20:38:58.919852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372497+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:39:00.372497+0000","last_peered":"2023-11-28T20:39:00.372497+0000","last_clean":"2023-11-28T20:39:00.372497+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:39:00.372497+0000","last_undegraded":"2023-11-28T20:39:00.372497+0000","last_fullsized":"2023-11-28T20:39:00.372497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":4,"reported_epoch":27,"state":"activating","last_fresh":"2023-11-28T20:39:01.378933+0000","last_change":"2023-11-28T20:39:01.378933+0000","last_active":"2023-11-28T20:39:01.378787+0000","last_peered":"2023-11-28T20:38:24.529908+0000","last_clean":"2023-11-28T20:38:24.529908+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:39:01.378933+0000","last_undegraded":"2023-11-28T20:39:01.378933+0000","last_fullsized":"2023-11-28T20:39:01.378933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:55:18.203913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372562+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:39:00.372562+0000","last_peered":"2023-11-28T20:39:00.372562+0000","last_clean":"2023-11-28T20:39:00.372562+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:39:00.372562+0000","last_undegraded":"2023-11-28T20:39:00.372562+0000","last_fullsized":"2023-11-28T20:39:00.372562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445985+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:25.445985+0000","last_peered":"2023-11-28T20:38:25.445985+0000","last_clean":"2023-11-28T20:38:25.445985+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:25.445985+0000","last_undegraded":"2023-11-28T20:38:25.445985+0000","last_fullsized":"2023-11-28T20:38:25.445985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344646+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:24.344646+0000","last_peered":"2023-11-28T20:38:24.344646+0000","last_clean":"2023-11-28T20:38:24.344646+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:24.344646+0000","last_undegraded":"2023-11-28T20:38:24.344646+0000","last_fullsized":"2023-11-28T20:38:24.344646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573108+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:45.573108+0000","last_peered":"2023-11-28T20:38:45.573108+0000","last_clean":"2023-11-28T20:38:45.573108+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:45.573108+0000","last_undegraded":"2023-11-28T20:38:45.573108+0000","last_fullsized":"2023-11-28T20:38:45.573108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.386759+0000","last_change":"2023-11-28T20:39:01.386759+0000","last_active":"2023-11-28T20:39:01.386759+0000","last_peered":"2023-11-28T20:39:01.386759+0000","last_clean":"2023-11-28T20:39:01.386759+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T20:39:01.386759+0000","last_undegraded":"2023-11-28T20:39:01.386759+0000","last_fullsized":"2023-11-28T20:39:01.386759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:57:45.861105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350686+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:24.350686+0000","last_peered":"2023-11-28T20:38:24.350686+0000","last_clean":"2023-11-28T20:38:24.350686+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:24.350686+0000","last_undegraded":"2023-11-28T20:38:24.350686+0000","last_fullsized":"2023-11-28T20:38:24.350686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574006+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:45.574006+0000","last_peered":"2023-11-28T20:38:45.574006+0000","last_clean":"2023-11-28T20:38:45.574006+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:45.574006+0000","last_undegraded":"2023-11-28T20:38:45.574006+0000","last_fullsized":"2023-11-28T20:38:45.574006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376894+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:39:00.376894+0000","last_peered":"2023-11-28T20:39:00.376894+0000","last_clean":"2023-11-28T20:39:00.376894+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:39:00.376894+0000","last_undegraded":"2023-11-28T20:39:00.376894+0000","last_fullsized":"2023-11-28T20:39:00.376894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439118+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:25.439118+0000","last_peered":"2023-11-28T20:38:25.439118+0000","last_clean":"2023-11-28T20:38:25.439118+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:25.439118+0000","last_undegraded":"2023-11-28T20:38:25.439118+0000","last_fullsized":"2023-11-28T20:38:25.439118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372002+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:39:00.372002+0000","last_peered":"2023-11-28T20:39:00.372002+0000","last_clean":"2023-11-28T20:39:00.372002+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:39:00.372002+0000","last_undegraded":"2023-11-28T20:39:00.372002+0000","last_fullsized":"2023-11-28T20:39:00.372002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.570975+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:45.570975+0000","last_peered":"2023-11-28T20:38:45.570975+0000","last_clean":"2023-11-28T20:38:45.570975+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:45.570975+0000","last_undegraded":"2023-11-28T20:38:45.570975+0000","last_fullsized":"2023-11-28T20:38:45.570975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441612+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:25.441612+0000","last_peered":"2023-11-28T20:38:25.441612+0000","last_clean":"2023-11-28T20:38:25.441612+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:25.441612+0000","last_undegraded":"2023-11-28T20:38:25.441612+0000","last_fullsized":"2023-11-28T20:38:25.441612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377725+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:39:00.377725+0000","last_peered":"2023-11-28T20:39:00.377725+0000","last_clean":"2023-11-28T20:39:00.377725+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:39:00.377725+0000","last_undegraded":"2023-11-28T20:39:00.377725+0000","last_fullsized":"2023-11-28T20:39:00.377725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377196+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:39:00.377196+0000","last_peered":"2023-11-28T20:39:00.377196+0000","last_clean":"2023-11-28T20:39:00.377196+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:39:00.377196+0000","last_undegraded":"2023-11-28T20:39:00.377196+0000","last_fullsized":"2023-11-28T20:39:00.377196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.610690+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:51.610690+0000","last_peered":"2023-11-28T20:38:51.610690+0000","last_clean":"2023-11-28T20:38:51.610690+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:51.610690+0000","last_undegraded":"2023-11-28T20:38:51.610690+0000","last_fullsized":"2023-11-28T20:38:51.610690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344364+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:24.344364+0000","last_peered":"2023-11-28T20:38:24.344364+0000","last_clean":"2023-11-28T20:38:24.344364+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:24.344364+0000","last_undegraded":"2023-11-28T20:38:24.344364+0000","last_fullsized":"2023-11-28T20:38:24.344364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371112+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:39:00.371112+0000","last_peered":"2023-11-28T20:39:00.371112+0000","last_clean":"2023-11-28T20:39:00.371112+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:39:00.371112+0000","last_undegraded":"2023-11-28T20:39:00.371112+0000","last_fullsized":"2023-11-28T20:39:00.371112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377615+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:39:00.377615+0000","last_peered":"2023-11-28T20:39:00.377615+0000","last_clean":"2023-11-28T20:39:00.377615+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:39:00.377615+0000","last_undegraded":"2023-11-28T20:39:00.377615+0000","last_fullsized":"2023-11-28T20:39:00.377615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529110+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:24.529110+0000","last_peered":"2023-11-28T20:38:24.529110+0000","last_clean":"2023-11-28T20:38:24.529110+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:24.529110+0000","last_undegraded":"2023-11-28T20:38:24.529110+0000","last_fullsized":"2023-11-28T20:38:24.529110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377999+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:39:00.377999+0000","last_peered":"2023-11-28T20:39:00.377999+0000","last_clean":"2023-11-28T20:39:00.377999+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:39:00.377999+0000","last_undegraded":"2023-11-28T20:39:00.377999+0000","last_fullsized":"2023-11-28T20:39:00.377999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349566+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:24.349566+0000","last_peered":"2023-11-28T20:38:24.349566+0000","last_clean":"2023-11-28T20:38:24.349566+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:24.349566+0000","last_undegraded":"2023-11-28T20:38:24.349566+0000","last_fullsized":"2023-11-28T20:38:24.349566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370843+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:39:00.370843+0000","last_peered":"2023-11-28T20:39:00.370843+0000","last_clean":"2023-11-28T20:39:00.370843+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:39:00.370843+0000","last_undegraded":"2023-11-28T20:39:00.370843+0000","last_fullsized":"2023-11-28T20:39:00.370843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349192+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:24.349192+0000","last_peered":"2023-11-28T20:38:24.349192+0000","last_clean":"2023-11-28T20:38:24.349192+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:24.349192+0000","last_undegraded":"2023-11-28T20:38:24.349192+0000","last_fullsized":"2023-11-28T20:38:24.349192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344288+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:24.344288+0000","last_peered":"2023-11-28T20:38:24.344288+0000","last_clean":"2023-11-28T20:38:24.344288+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:24.344288+0000","last_undegraded":"2023-11-28T20:38:24.344288+0000","last_fullsized":"2023-11-28T20:38:24.344288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377858+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:39:00.377858+0000","last_peered":"2023-11-28T20:39:00.377858+0000","last_clean":"2023-11-28T20:39:00.377858+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:39:00.377858+0000","last_undegraded":"2023-11-28T20:39:00.377858+0000","last_fullsized":"2023-11-28T20:39:00.377858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372406+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:39:00.372406+0000","last_peered":"2023-11-28T20:39:00.372406+0000","last_clean":"2023-11-28T20:39:00.372406+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:39:00.372406+0000","last_undegraded":"2023-11-28T20:39:00.372406+0000","last_fullsized":"2023-11-28T20:39:00.372406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351931+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:24.351931+0000","last_peered":"2023-11-28T20:38:24.351931+0000","last_clean":"2023-11-28T20:38:24.351931+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:24.351931+0000","last_undegraded":"2023-11-28T20:38:24.351931+0000","last_fullsized":"2023-11-28T20:38:24.351931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378113+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:39:00.378113+0000","last_peered":"2023-11-28T20:39:00.378113+0000","last_clean":"2023-11-28T20:39:00.378113+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:39:00.378113+0000","last_undegraded":"2023-11-28T20:39:00.378113+0000","last_fullsized":"2023-11-28T20:39:00.378113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348638+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:24.348638+0000","last_peered":"2023-11-28T20:38:24.348638+0000","last_clean":"2023-11-28T20:38:24.348638+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:24.348638+0000","last_undegraded":"2023-11-28T20:38:24.348638+0000","last_fullsized":"2023-11-28T20:38:24.348638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377083+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:39:00.377083+0000","last_peered":"2023-11-28T20:39:00.377083+0000","last_clean":"2023-11-28T20:39:00.377083+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:39:00.377083+0000","last_undegraded":"2023-11-28T20:39:00.377083+0000","last_fullsized":"2023-11-28T20:39:00.377083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":4,"reported_epoch":27,"state":"activating","last_fresh":"2023-11-28T20:39:01.378773+0000","last_change":"2023-11-28T20:39:01.378773+0000","last_active":"2023-11-28T20:39:01.378606+0000","last_peered":"2023-11-28T20:38:24.349072+0000","last_clean":"2023-11-28T20:38:24.349072+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:39:01.378773+0000","last_undegraded":"2023-11-28T20:39:01.378773+0000","last_fullsized":"2023-11-28T20:39:01.378773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:49.057388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344051+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:24.344051+0000","last_peered":"2023-11-28T20:38:24.344051+0000","last_clean":"2023-11-28T20:38:24.344051+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:24.344051+0000","last_undegraded":"2023-11-28T20:38:24.344051+0000","last_fullsized":"2023-11-28T20:38:24.344051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351494+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:24.351494+0000","last_peered":"2023-11-28T20:38:24.351494+0000","last_clean":"2023-11-28T20:38:24.351494+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:24.351494+0000","last_undegraded":"2023-11-28T20:38:24.351494+0000","last_fullsized":"2023-11-28T20:38:24.351494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528399+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:24.528399+0000","last_peered":"2023-11-28T20:38:24.528399+0000","last_clean":"2023-11-28T20:38:24.528399+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:24.528399+0000","last_undegraded":"2023-11-28T20:38:24.528399+0000","last_fullsized":"2023-11-28T20:38:24.528399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371437+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:39:00.371437+0000","last_peered":"2023-11-28T20:39:00.371437+0000","last_clean":"2023-11-28T20:39:00.371437+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:39:00.371437+0000","last_undegraded":"2023-11-28T20:39:00.371437+0000","last_fullsized":"2023-11-28T20:39:00.371437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351592+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:24.351592+0000","last_peered":"2023-11-28T20:38:24.351592+0000","last_clean":"2023-11-28T20:38:24.351592+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:24.351592+0000","last_undegraded":"2023-11-28T20:38:24.351592+0000","last_fullsized":"2023-11-28T20:38:24.351592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348427+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:24.348427+0000","last_peered":"2023-11-28T20:38:24.348427+0000","last_clean":"2023-11-28T20:38:24.348427+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:24.348427+0000","last_undegraded":"2023-11-28T20:38:24.348427+0000","last_fullsized":"2023-11-28T20:38:24.348427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371998+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:39:00.371998+0000","last_peered":"2023-11-28T20:39:00.371998+0000","last_clean":"2023-11-28T20:39:00.371998+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:39:00.371998+0000","last_undegraded":"2023-11-28T20:39:00.371998+0000","last_fullsized":"2023-11-28T20:39:00.371998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344015+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:24.344015+0000","last_peered":"2023-11-28T20:38:24.344015+0000","last_clean":"2023-11-28T20:38:24.344015+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:24.344015+0000","last_undegraded":"2023-11-28T20:38:24.344015+0000","last_fullsized":"2023-11-28T20:38:24.344015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377458+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:39:00.377458+0000","last_peered":"2023-11-28T20:39:00.377458+0000","last_clean":"2023-11-28T20:39:00.377458+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:39:00.377458+0000","last_undegraded":"2023-11-28T20:39:00.377458+0000","last_fullsized":"2023-11-28T20:39:00.377458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529932+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:24.529932+0000","last_peered":"2023-11-28T20:38:24.529932+0000","last_clean":"2023-11-28T20:38:24.529932+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:24.529932+0000","last_undegraded":"2023-11-28T20:38:24.529932+0000","last_fullsized":"2023-11-28T20:38:24.529932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351455+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:24.351455+0000","last_peered":"2023-11-28T20:38:24.351455+0000","last_clean":"2023-11-28T20:38:24.351455+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:24.351455+0000","last_undegraded":"2023-11-28T20:38:24.351455+0000","last_fullsized":"2023-11-28T20:38:24.351455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:24.351828+0000","last_change":"2023-11-28T20:39:00.374712+0000","last_active":"2023-11-28T20:39:00.374712+0000","last_peered":"2023-11-28T20:38:24.351828+0000","last_clean":"2023-11-28T20:38:24.351828+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:24.351828+0000","last_undegraded":"2023-11-28T20:38:24.351828+0000","last_fullsized":"2023-11-28T20:38:24.351828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530905+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:24.530905+0000","last_peered":"2023-11-28T20:38:24.530905+0000","last_clean":"2023-11-28T20:38:24.530905+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:24.530905+0000","last_undegraded":"2023-11-28T20:38:24.530905+0000","last_fullsized":"2023-11-28T20:38:24.530905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377589+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:39:00.377589+0000","last_peered":"2023-11-28T20:39:00.377589+0000","last_clean":"2023-11-28T20:39:00.377589+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:39:00.377589+0000","last_undegraded":"2023-11-28T20:39:00.377589+0000","last_fullsized":"2023-11-28T20:39:00.377589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527751+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:24.527751+0000","last_peered":"2023-11-28T20:38:24.527751+0000","last_clean":"2023-11-28T20:38:24.527751+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:24.527751+0000","last_undegraded":"2023-11-28T20:38:24.527751+0000","last_fullsized":"2023-11-28T20:38:24.527751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348972+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:24.348972+0000","last_peered":"2023-11-28T20:38:24.348972+0000","last_clean":"2023-11-28T20:38:24.348972+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:24.348972+0000","last_undegraded":"2023-11-28T20:38:24.348972+0000","last_fullsized":"2023-11-28T20:38:24.348972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527847+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:24.527847+0000","last_peered":"2023-11-28T20:38:24.527847+0000","last_clean":"2023-11-28T20:38:24.527847+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:24.527847+0000","last_undegraded":"2023-11-28T20:38:24.527847+0000","last_fullsized":"2023-11-28T20:38:24.527847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350257+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:24.350257+0000","last_peered":"2023-11-28T20:38:24.350257+0000","last_clean":"2023-11-28T20:38:24.350257+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:24.350257+0000","last_undegraded":"2023-11-28T20:38:24.350257+0000","last_fullsized":"2023-11-28T20:38:24.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344441+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:24.344441+0000","last_peered":"2023-11-28T20:38:24.344441+0000","last_clean":"2023-11-28T20:38:24.344441+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:24.344441+0000","last_undegraded":"2023-11-28T20:38:24.344441+0000","last_fullsized":"2023-11-28T20:38:24.344441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373007+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:39:00.373007+0000","last_peered":"2023-11-28T20:39:00.373007+0000","last_clean":"2023-11-28T20:39:00.373007+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:39:00.373007+0000","last_undegraded":"2023-11-28T20:39:00.373007+0000","last_fullsized":"2023-11-28T20:39:00.373007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530439+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:24.530439+0000","last_peered":"2023-11-28T20:38:24.530439+0000","last_clean":"2023-11-28T20:38:24.530439+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:24.530439+0000","last_undegraded":"2023-11-28T20:38:24.530439+0000","last_fullsized":"2023-11-28T20:38:24.530439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7705,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":120801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":109909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":693709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":693053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:39:06.247 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:39:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f878b365640 1 Processor -- start 2023-11-28T20:39:06.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f878b365640 1 -- start start 2023-11-28T20:39:06.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f878b365640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87840cf860 0x7f87840cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f878b365640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8784153ae0 0x7f8784153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f878b365640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878415ac00 con 0x7f87840cfc40 2023-11-28T20:39:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f878b365640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87840cbd60 con 0x7f87840cf860 2023-11-28T20:39:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f878b365640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8784159ff0 con 0x7f8784153ae0 2023-11-28T20:39:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f8789101640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87840cf860 0x7f87840cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f8788900640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f87840cfc40 0x7f87840ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51692/0 (socket says 172.21.15.167:51692) 2023-11-28T20:39:06.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f8789101640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87840cf860 0x7f87840cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33438/0 (socket says 172.21.15.167:33438) 2023-11-28T20:39:06.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f8788900640 1 -- 172.21.15.167:0/2802549007 learned_addr learned my addr 172.21.15.167:0/2802549007 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f8789902640 1 --2- 172.21.15.167:0/2802549007 >> v2:172.21.15.178:3300/0 conn(0x7f8784153ae0 0x7f8784153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f8789101640 1 -- 172.21.15.167:0/2802549007 >> v2:172.21.15.178:3300/0 conn(0x7f8784153ae0 msgr2=0x7f8784153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f8789101640 1 --2- 172.21.15.167:0/2802549007 >> v2:172.21.15.178:3300/0 conn(0x7f8784153ae0 0x7f8784153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f8789101640 1 -- 172.21.15.167:0/2802549007 >> v1:172.21.15.167:6789/0 conn(0x7f87840cfc40 legacy=0x7f87840ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f8789101640 1 -- 172.21.15.167:0/2802549007 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878415a2d0 con 0x7f87840cf860 2023-11-28T20:39:06.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.420+0000 7f877bfff640 1 -- 172.21.15.167:0/2802549007 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931893488 0 0) 0x7f878415ac00 con 0x7f87840cfc40 2023-11-28T20:39:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f8789101640 1 --2- 172.21.15.167:0/2802549007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 0x7f87840cb770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f87840b2240 tx=0x7f878001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545c6bab2dd0fd8f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f877bfff640 1 -- 172.21.15.167:0/2802549007 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87800ab660 con 0x7f87840cf860 2023-11-28T20:39:06.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f877bfff640 1 -- 172.21.15.167:0/2802549007 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87800ab7c0 con 0x7f87840cf860 2023-11-28T20:39:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f877bfff640 1 -- 172.21.15.167:0/2802549007 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87800abb50 con 0x7f87840cf860 2023-11-28T20:39:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f878b365640 1 -- 172.21.15.167:0/2802549007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 msgr2=0x7f87840cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f878b365640 1 --2- 172.21.15.167:0/2802549007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 0x7f87840cb770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f87840b2240 tx=0x7f878001c460 comp rx=0 tx=0).stop 2023-11-28T20:39:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f878b365640 1 -- 172.21.15.167:0/2802549007 shutdown_connections 2023-11-28T20:39:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f878b365640 1 --2- 172.21.15.167:0/2802549007 >> v2:172.21.15.178:3300/0 conn(0x7f8784153ae0 0x7f8784153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f878b365640 1 --2- 172.21.15.167:0/2802549007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 0x7f87840cb770 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f878b365640 1 -- 172.21.15.167:0/2802549007 >> 172.21.15.167:0/2802549007 conn(0x7f878406c1f0 msgr2=0x7f8784071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f878b365640 1 -- 172.21.15.167:0/2802549007 shutdown_connections 2023-11-28T20:39:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.424+0000 7f878b365640 1 -- 172.21.15.167:0/2802549007 wait complete. 2023-11-28T20:39:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 Processor -- start 2023-11-28T20:39:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 -- start start 2023-11-28T20:39:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 0x7f87841f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840cfc40 0x7f87840b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784153ae0 0x7f87841f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87841f3380 con 0x7f87840cf860 2023-11-28T20:39:06.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8784154850 con 0x7f8784153ae0 2023-11-28T20:39:06.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87841f7020 con 0x7f87840cfc40 2023-11-28T20:39:06.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789101640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 0x7f87841f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789101640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 0x7f87841f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33440/0 (socket says 172.21.15.167:33440) 2023-11-28T20:39:06.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789101640 1 -- 172.21.15.167:0/2292493768 learned_addr learned my addr 172.21.15.167:0/2292493768 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:06.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789902640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784153ae0 0x7f87841f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8788900640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840cfc40 0x7f87840b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789101640 1 -- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840cfc40 msgr2=0x7f87840b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789101640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840cfc40 0x7f87840b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789101640 1 -- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784153ae0 msgr2=0x7f87841f6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789101640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784153ae0 0x7f87841f6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789101640 1 -- 172.21.15.167:0/2292493768 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8780009420 con 0x7f87840cf860 2023-11-28T20:39:06.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8789101640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 0x7f87841f37a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8780019070 tx=0x7f878001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:06.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8779ffb640 1 -- 172.21.15.167:0/2292493768 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87800b5810 con 0x7f87840cf860 2023-11-28T20:39:06.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8779ffb640 1 -- 172.21.15.167:0/2292493768 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87800b5970 con 0x7f87840cf860 2023-11-28T20:39:06.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f8779ffb640 1 -- 172.21.15.167:0/2292493768 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87800b5ce0 con 0x7f87840cf860 2023-11-28T20:39:06.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8784159730 con 0x7f87840cf860 2023-11-28T20:39:06.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8784159450 con 0x7f87840cf860 2023-11-28T20:39:06.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.428+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8784075c90 con 0x7f87840cf860 2023-11-28T20:39:06.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.432+0000 7f8779ffb640 1 -- 172.21.15.167:0/2292493768 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87800a9070 con 0x7f87840cf860 2023-11-28T20:39:06.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.432+0000 7f8779ffb640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8768066470 0x7f8768068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.432+0000 7f8779ffb640 1 -- 172.21.15.167:0/2292493768 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f878011e710 con 0x7f87840cf860 2023-11-28T20:39:06.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.432+0000 7f8788900640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8768066470 0x7f8768068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.432+0000 7f8788900640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8768066470 0x7f8768068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8784159a30 tx=0x7f8774007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:06.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.436+0000 7f8779ffb640 1 -- 172.21.15.167:0/2292493768 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87800eb7c0 con 0x7f87840cf860 2023-11-28T20:39:06.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.596+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87840b1ea0 con 0x7f8768066470 2023-11-28T20:39:06.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.620+0000 7f8779ffb640 1 -- 172.21.15.167:0/2292493768 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345280 (secure 0 0 0) 0x7f87840b1ea0 con 0x7f8768066470 2023-11-28T20:39:06.629 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:06.631 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:39:06.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8768066470 msgr2=0x7f8768068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8768066470 0x7f8768068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8784159a30 tx=0x7f8774007c10 comp rx=0 tx=0).stop 2023-11-28T20:39:06.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 msgr2=0x7f87841f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 0x7f87841f37a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8780019070 tx=0x7f878001aca0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 shutdown_connections 2023-11-28T20:39:06.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8768066470 0x7f8768068930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784153ae0 0x7f87841f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840cfc40 0x7f87840b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 --2- 172.21.15.167:0/2292493768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87840cf860 0x7f87841f37a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 >> 172.21.15.167:0/2292493768 conn(0x7f878406c1f0 msgr2=0x7f87841514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:06.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.624+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 shutdown_connections 2023-11-28T20:39:06.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.628+0000 7f878b365640 1 -- 172.21.15.167:0/2292493768 wait complete. 2023-11-28T20:39:06.649 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-11-28T20:39:05.446176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598073,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":289,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3384,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3465216,"data_stored":2040447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":254,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003359"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.609165+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:51.609165+0000","last_peered":"2023-11-28T20:38:51.609165+0000","last_clean":"2023-11-28T20:38:51.609165+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:51.609165+0000","last_undegraded":"2023-11-28T20:38:51.609165+0000","last_fullsized":"2023-11-28T20:38:51.609165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.390144+0000","last_change":"2023-11-28T20:39:01.387644+0000","last_active":"2023-11-28T20:39:01.390144+0000","last_peered":"2023-11-28T20:39:01.390144+0000","last_clean":"2023-11-28T20:39:01.390144+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T20:39:01.390144+0000","last_undegraded":"2023-11-28T20:39:01.390144+0000","last_fullsized":"2023-11-28T20:39:01.390144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:52.977080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376803+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:39:00.376803+0000","last_peered":"2023-11-28T20:39:00.376803+0000","last_clean":"2023-11-28T20:39:00.376803+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:39:00.376803+0000","last_undegraded":"2023-11-28T20:39:00.376803+0000","last_fullsized":"2023-11-28T20:39:00.376803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378262+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:39:00.378262+0000","last_peered":"2023-11-28T20:39:00.378262+0000","last_clean":"2023-11-28T20:39:00.378262+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:39:00.378262+0000","last_undegraded":"2023-11-28T20:39:00.378262+0000","last_fullsized":"2023-11-28T20:39:00.378262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344550+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:24.344550+0000","last_peered":"2023-11-28T20:38:24.344550+0000","last_clean":"2023-11-28T20:38:24.344550+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:24.344550+0000","last_undegraded":"2023-11-28T20:38:24.344550+0000","last_fullsized":"2023-11-28T20:38:24.344550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:25.445649+0000","last_change":"2023-11-28T20:39:00.368426+0000","last_active":"2023-11-28T20:39:00.368426+0000","last_peered":"2023-11-28T20:38:25.445649+0000","last_clean":"2023-11-28T20:38:25.445649+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:25.445649+0000","last_undegraded":"2023-11-28T20:38:25.445649+0000","last_fullsized":"2023-11-28T20:38:25.445649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606601+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:51.606601+0000","last_peered":"2023-11-28T20:38:51.606601+0000","last_clean":"2023-11-28T20:38:51.606601+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:51.606601+0000","last_undegraded":"2023-11-28T20:38:51.606601+0000","last_fullsized":"2023-11-28T20:38:51.606601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350728+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:24.350728+0000","last_peered":"2023-11-28T20:38:24.350728+0000","last_clean":"2023-11-28T20:38:24.350728+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:24.350728+0000","last_undegraded":"2023-11-28T20:38:24.350728+0000","last_fullsized":"2023-11-28T20:38:24.350728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445936+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:25.445936+0000","last_peered":"2023-11-28T20:38:25.445936+0000","last_clean":"2023-11-28T20:38:25.445936+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:25.445936+0000","last_undegraded":"2023-11-28T20:38:25.445936+0000","last_fullsized":"2023-11-28T20:38:25.445936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532409+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532409+0000","last_peered":"2023-11-28T20:38:24.532409+0000","last_clean":"2023-11-28T20:38:24.532409+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532409+0000","last_undegraded":"2023-11-28T20:38:24.532409+0000","last_fullsized":"2023-11-28T20:38:24.532409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350514+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:24.350514+0000","last_peered":"2023-11-28T20:38:24.350514+0000","last_clean":"2023-11-28T20:38:24.350514+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:24.350514+0000","last_undegraded":"2023-11-28T20:38:24.350514+0000","last_fullsized":"2023-11-28T20:38:24.350514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445855+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:25.445855+0000","last_peered":"2023-11-28T20:38:25.445855+0000","last_clean":"2023-11-28T20:38:25.445855+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:25.445855+0000","last_undegraded":"2023-11-28T20:38:25.445855+0000","last_fullsized":"2023-11-28T20:38:25.445855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350262+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:24.350262+0000","last_peered":"2023-11-28T20:38:24.350262+0000","last_clean":"2023-11-28T20:38:24.350262+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:24.350262+0000","last_undegraded":"2023-11-28T20:38:24.350262+0000","last_fullsized":"2023-11-28T20:38:24.350262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575295+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:45.575295+0000","last_peered":"2023-11-28T20:38:45.575295+0000","last_clean":"2023-11-28T20:38:45.575295+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:45.575295+0000","last_undegraded":"2023-11-28T20:38:45.575295+0000","last_fullsized":"2023-11-28T20:38:45.575295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446173+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:25.446173+0000","last_peered":"2023-11-28T20:38:25.446173+0000","last_clean":"2023-11-28T20:38:25.446173+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:25.446173+0000","last_undegraded":"2023-11-28T20:38:25.446173+0000","last_fullsized":"2023-11-28T20:38:25.446173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377543+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:39:00.377543+0000","last_peered":"2023-11-28T20:39:00.377543+0000","last_clean":"2023-11-28T20:39:00.377543+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:39:00.377543+0000","last_undegraded":"2023-11-28T20:39:00.377543+0000","last_fullsized":"2023-11-28T20:39:00.377543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372769+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:39:00.372769+0000","last_peered":"2023-11-28T20:39:00.372769+0000","last_clean":"2023-11-28T20:39:00.372769+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:39:00.372769+0000","last_undegraded":"2023-11-28T20:39:00.372769+0000","last_fullsized":"2023-11-28T20:39:00.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446061+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:25.446061+0000","last_peered":"2023-11-28T20:38:25.446061+0000","last_clean":"2023-11-28T20:38:25.446061+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:25.446061+0000","last_undegraded":"2023-11-28T20:38:25.446061+0000","last_fullsized":"2023-11-28T20:38:25.446061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377798+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:39:00.377798+0000","last_peered":"2023-11-28T20:39:00.377798+0000","last_clean":"2023-11-28T20:39:00.377798+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:39:00.377798+0000","last_undegraded":"2023-11-28T20:39:00.377798+0000","last_fullsized":"2023-11-28T20:39:00.377798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372086+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:39:00.372086+0000","last_peered":"2023-11-28T20:39:00.372086+0000","last_clean":"2023-11-28T20:39:00.372086+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:39:00.372086+0000","last_undegraded":"2023-11-28T20:39:00.372086+0000","last_fullsized":"2023-11-28T20:39:00.372086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373087+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.373087+0000","last_peered":"2023-11-28T20:39:00.373087+0000","last_clean":"2023-11-28T20:39:00.373087+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:39:00.373087+0000","last_undegraded":"2023-11-28T20:39:00.373087+0000","last_fullsized":"2023-11-28T20:39:00.373087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528774+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:24.528774+0000","last_peered":"2023-11-28T20:38:24.528774+0000","last_clean":"2023-11-28T20:38:24.528774+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:24.528774+0000","last_undegraded":"2023-11-28T20:38:24.528774+0000","last_fullsized":"2023-11-28T20:38:24.528774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575123+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:45.575123+0000","last_peered":"2023-11-28T20:38:45.575123+0000","last_clean":"2023-11-28T20:38:45.575123+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:45.575123+0000","last_undegraded":"2023-11-28T20:38:45.575123+0000","last_fullsized":"2023-11-28T20:38:45.575123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446227+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:25.446227+0000","last_peered":"2023-11-28T20:38:25.446227+0000","last_clean":"2023-11-28T20:38:25.446227+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:25.446227+0000","last_undegraded":"2023-11-28T20:38:25.446227+0000","last_fullsized":"2023-11-28T20:38:25.446227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344675+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:24.344675+0000","last_peered":"2023-11-28T20:38:24.344675+0000","last_clean":"2023-11-28T20:38:24.344675+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:24.344675+0000","last_undegraded":"2023-11-28T20:38:24.344675+0000","last_fullsized":"2023-11-28T20:38:24.344675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573711+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:45.573711+0000","last_peered":"2023-11-28T20:38:45.573711+0000","last_clean":"2023-11-28T20:38:45.573711+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:45.573711+0000","last_undegraded":"2023-11-28T20:38:45.573711+0000","last_fullsized":"2023-11-28T20:38:45.573711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445762+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:25.445762+0000","last_peered":"2023-11-28T20:38:25.445762+0000","last_clean":"2023-11-28T20:38:25.445762+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:25.445762+0000","last_undegraded":"2023-11-28T20:38:25.445762+0000","last_fullsized":"2023-11-28T20:38:25.445762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378189+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:39:00.378189+0000","last_peered":"2023-11-28T20:39:00.378189+0000","last_clean":"2023-11-28T20:39:00.378189+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:39:00.378189+0000","last_undegraded":"2023-11-28T20:39:00.378189+0000","last_fullsized":"2023-11-28T20:39:00.378189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373110+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:39:00.373110+0000","last_peered":"2023-11-28T20:39:00.373110+0000","last_clean":"2023-11-28T20:39:00.373110+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:39:00.373110+0000","last_undegraded":"2023-11-28T20:39:00.373110+0000","last_fullsized":"2023-11-28T20:39:00.373110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377445+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:39:00.377445+0000","last_peered":"2023-11-28T20:39:00.377445+0000","last_clean":"2023-11-28T20:39:00.377445+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:39:00.377445+0000","last_undegraded":"2023-11-28T20:39:00.377445+0000","last_fullsized":"2023-11-28T20:39:00.377445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372844+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:39:00.372844+0000","last_peered":"2023-11-28T20:39:00.372844+0000","last_clean":"2023-11-28T20:39:00.372844+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:39:00.372844+0000","last_undegraded":"2023-11-28T20:39:00.372844+0000","last_fullsized":"2023-11-28T20:39:00.372844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574343+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:45.574343+0000","last_peered":"2023-11-28T20:38:45.574343+0000","last_clean":"2023-11-28T20:38:45.574343+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:45.574343+0000","last_undegraded":"2023-11-28T20:38:45.574343+0000","last_fullsized":"2023-11-28T20:38:45.574343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439058+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:25.439058+0000","last_peered":"2023-11-28T20:38:25.439058+0000","last_clean":"2023-11-28T20:38:25.439058+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:25.439058+0000","last_undegraded":"2023-11-28T20:38:25.439058+0000","last_fullsized":"2023-11-28T20:38:25.439058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350784+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:24.350784+0000","last_peered":"2023-11-28T20:38:24.350784+0000","last_clean":"2023-11-28T20:38:24.350784+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:24.350784+0000","last_undegraded":"2023-11-28T20:38:24.350784+0000","last_fullsized":"2023-11-28T20:38:24.350784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372929+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:39:00.372929+0000","last_peered":"2023-11-28T20:39:00.372929+0000","last_clean":"2023-11-28T20:39:00.372929+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:39:00.372929+0000","last_undegraded":"2023-11-28T20:39:00.372929+0000","last_fullsized":"2023-11-28T20:39:00.372929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":6,"reported_epoch":27,"state":"activating","last_fresh":"2023-11-28T20:39:01.389091+0000","last_change":"2023-11-28T20:39:01.378051+0000","last_active":"2023-11-28T20:38:22.532017+0000","last_peered":"2023-11-28T20:38:22.532017+0000","last_clean":"2023-11-28T20:38:22.532017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:39:01.389091+0000","last_undegraded":"2023-11-28T20:39:01.389091+0000","last_fullsized":"2023-11-28T20:39:01.389091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:50:13.565586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":["2(0)","0(3)","1(0)","4(2)","5(1)"],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529967+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:24.529967+0000","last_peered":"2023-11-28T20:38:24.529967+0000","last_clean":"2023-11-28T20:38:24.529967+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:24.529967+0000","last_undegraded":"2023-11-28T20:38:24.529967+0000","last_fullsized":"2023-11-28T20:38:24.529967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608154+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:51.608154+0000","last_peered":"2023-11-28T20:38:51.608154+0000","last_clean":"2023-11-28T20:38:51.608154+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:51.608154+0000","last_undegraded":"2023-11-28T20:38:51.608154+0000","last_fullsized":"2023-11-28T20:38:51.608154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372765+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:39:00.372765+0000","last_peered":"2023-11-28T20:39:00.372765+0000","last_clean":"2023-11-28T20:39:00.372765+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:39:00.372765+0000","last_undegraded":"2023-11-28T20:39:00.372765+0000","last_fullsized":"2023-11-28T20:39:00.372765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373168+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:39:00.373168+0000","last_peered":"2023-11-28T20:39:00.373168+0000","last_clean":"2023-11-28T20:39:00.373168+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:39:00.373168+0000","last_undegraded":"2023-11-28T20:39:00.373168+0000","last_fullsized":"2023-11-28T20:39:00.373168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370832+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:39:00.370832+0000","last_peered":"2023-11-28T20:39:00.370832+0000","last_clean":"2023-11-28T20:39:00.370832+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:39:00.370832+0000","last_undegraded":"2023-11-28T20:39:00.370832+0000","last_fullsized":"2023-11-28T20:39:00.370832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373409+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:39:00.373409+0000","last_peered":"2023-11-28T20:39:00.373409+0000","last_clean":"2023-11-28T20:39:00.373409+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:39:00.373409+0000","last_undegraded":"2023-11-28T20:39:00.373409+0000","last_fullsized":"2023-11-28T20:39:00.373409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.343810+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:24.343810+0000","last_peered":"2023-11-28T20:38:24.343810+0000","last_clean":"2023-11-28T20:38:24.343810+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:24.343810+0000","last_undegraded":"2023-11-28T20:38:24.343810+0000","last_fullsized":"2023-11-28T20:38:24.343810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608237+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:51.608237+0000","last_peered":"2023-11-28T20:38:51.608237+0000","last_clean":"2023-11-28T20:38:51.608237+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:51.608237+0000","last_undegraded":"2023-11-28T20:38:51.608237+0000","last_fullsized":"2023-11-28T20:38:51.608237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439136+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:25.439136+0000","last_peered":"2023-11-28T20:38:25.439136+0000","last_clean":"2023-11-28T20:38:25.439136+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:25.439136+0000","last_undegraded":"2023-11-28T20:38:25.439136+0000","last_fullsized":"2023-11-28T20:38:25.439136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376856+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:39:00.376856+0000","last_peered":"2023-11-28T20:39:00.376856+0000","last_clean":"2023-11-28T20:39:00.376856+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:39:00.376856+0000","last_undegraded":"2023-11-28T20:39:00.376856+0000","last_fullsized":"2023-11-28T20:39:00.376856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608459+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:51.608459+0000","last_peered":"2023-11-28T20:38:51.608459+0000","last_clean":"2023-11-28T20:38:51.608459+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:51.608459+0000","last_undegraded":"2023-11-28T20:38:51.608459+0000","last_fullsized":"2023-11-28T20:38:51.608459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528002+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:24.528002+0000","last_peered":"2023-11-28T20:38:24.528002+0000","last_clean":"2023-11-28T20:38:24.528002+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:24.528002+0000","last_undegraded":"2023-11-28T20:38:24.528002+0000","last_fullsized":"2023-11-28T20:38:24.528002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441545+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:25.441545+0000","last_peered":"2023-11-28T20:38:25.441545+0000","last_clean":"2023-11-28T20:38:25.441545+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:25.441545+0000","last_undegraded":"2023-11-28T20:38:25.441545+0000","last_fullsized":"2023-11-28T20:38:25.441545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528152+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:24.528152+0000","last_peered":"2023-11-28T20:38:24.528152+0000","last_clean":"2023-11-28T20:38:24.528152+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:24.528152+0000","last_undegraded":"2023-11-28T20:38:24.528152+0000","last_fullsized":"2023-11-28T20:38:24.528152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371241+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:39:00.371241+0000","last_peered":"2023-11-28T20:39:00.371241+0000","last_clean":"2023-11-28T20:39:00.371241+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:39:00.371241+0000","last_undegraded":"2023-11-28T20:39:00.371241+0000","last_fullsized":"2023-11-28T20:39:00.371241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441453+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:25.441453+0000","last_peered":"2023-11-28T20:38:25.441453+0000","last_clean":"2023-11-28T20:38:25.441453+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:25.441453+0000","last_undegraded":"2023-11-28T20:38:25.441453+0000","last_fullsized":"2023-11-28T20:38:25.441453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350421+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:24.350421+0000","last_peered":"2023-11-28T20:38:24.350421+0000","last_clean":"2023-11-28T20:38:24.350421+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:24.350421+0000","last_undegraded":"2023-11-28T20:38:24.350421+0000","last_fullsized":"2023-11-28T20:38:24.350421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372659+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:39:00.372659+0000","last_peered":"2023-11-28T20:39:00.372659+0000","last_clean":"2023-11-28T20:39:00.372659+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:39:00.372659+0000","last_undegraded":"2023-11-28T20:39:00.372659+0000","last_fullsized":"2023-11-28T20:39:00.372659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439079+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:25.439079+0000","last_peered":"2023-11-28T20:38:25.439079+0000","last_clean":"2023-11-28T20:38:25.439079+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:25.439079+0000","last_undegraded":"2023-11-28T20:38:25.439079+0000","last_fullsized":"2023-11-28T20:38:25.439079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531147+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:24.531147+0000","last_peered":"2023-11-28T20:38:24.531147+0000","last_clean":"2023-11-28T20:38:24.531147+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:24.531147+0000","last_undegraded":"2023-11-28T20:38:24.531147+0000","last_fullsized":"2023-11-28T20:38:24.531147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371475+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:39:00.371475+0000","last_peered":"2023-11-28T20:39:00.371475+0000","last_clean":"2023-11-28T20:39:00.371475+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:39:00.371475+0000","last_undegraded":"2023-11-28T20:39:00.371475+0000","last_fullsized":"2023-11-28T20:39:00.371475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446714+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:25.446714+0000","last_peered":"2023-11-28T20:38:25.446714+0000","last_clean":"2023-11-28T20:38:25.446714+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:25.446714+0000","last_undegraded":"2023-11-28T20:38:25.446714+0000","last_fullsized":"2023-11-28T20:38:25.446714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529633+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:24.529633+0000","last_peered":"2023-11-28T20:38:24.529633+0000","last_clean":"2023-11-28T20:38:24.529633+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:24.529633+0000","last_undegraded":"2023-11-28T20:38:24.529633+0000","last_fullsized":"2023-11-28T20:38:24.529633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:56.834824+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:56.834824+0000","last_peered":"2023-11-28T20:38:56.834824+0000","last_clean":"2023-11-28T20:38:56.834824+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:56.834824+0000","last_undegraded":"2023-11-28T20:38:56.834824+0000","last_fullsized":"2023-11-28T20:38:56.834824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445709+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:25.445709+0000","last_peered":"2023-11-28T20:38:25.445709+0000","last_clean":"2023-11-28T20:38:25.445709+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:25.445709+0000","last_undegraded":"2023-11-28T20:38:25.445709+0000","last_fullsized":"2023-11-28T20:38:25.445709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527830+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:24.527830+0000","last_peered":"2023-11-28T20:38:24.527830+0000","last_clean":"2023-11-28T20:38:24.527830+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:24.527830+0000","last_undegraded":"2023-11-28T20:38:24.527830+0000","last_fullsized":"2023-11-28T20:38:24.527830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370725+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:39:00.370725+0000","last_peered":"2023-11-28T20:39:00.370725+0000","last_clean":"2023-11-28T20:39:00.370725+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:39:00.370725+0000","last_undegraded":"2023-11-28T20:39:00.370725+0000","last_fullsized":"2023-11-28T20:39:00.370725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439127+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:25.439127+0000","last_peered":"2023-11-28T20:38:25.439127+0000","last_clean":"2023-11-28T20:38:25.439127+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:25.439127+0000","last_undegraded":"2023-11-28T20:38:25.439127+0000","last_fullsized":"2023-11-28T20:38:25.439127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349743+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:24.349743+0000","last_peered":"2023-11-28T20:38:24.349743+0000","last_clean":"2023-11-28T20:38:24.349743+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:24.349743+0000","last_undegraded":"2023-11-28T20:38:24.349743+0000","last_fullsized":"2023-11-28T20:38:24.349743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.613830+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:51.613830+0000","last_peered":"2023-11-28T20:38:51.613830+0000","last_clean":"2023-11-28T20:38:51.613830+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:51.613830+0000","last_undegraded":"2023-11-28T20:38:51.613830+0000","last_fullsized":"2023-11-28T20:38:51.613830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378106+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:39:00.378106+0000","last_peered":"2023-11-28T20:39:00.378106+0000","last_clean":"2023-11-28T20:39:00.378106+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:39:00.378106+0000","last_undegraded":"2023-11-28T20:39:00.378106+0000","last_fullsized":"2023-11-28T20:39:00.378106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528018+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:24.528018+0000","last_peered":"2023-11-28T20:38:24.528018+0000","last_clean":"2023-11-28T20:38:24.528018+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:24.528018+0000","last_undegraded":"2023-11-28T20:38:24.528018+0000","last_fullsized":"2023-11-28T20:38:24.528018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.577200+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:45.577200+0000","last_peered":"2023-11-28T20:38:45.577200+0000","last_clean":"2023-11-28T20:38:45.577200+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:45.577200+0000","last_undegraded":"2023-11-28T20:38:45.577200+0000","last_fullsized":"2023-11-28T20:38:45.577200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377546+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.377546+0000","last_peered":"2023-11-28T20:39:00.377546+0000","last_clean":"2023-11-28T20:39:00.377546+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:39:00.377546+0000","last_undegraded":"2023-11-28T20:39:00.377546+0000","last_fullsized":"2023-11-28T20:39:00.377546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344100+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:24.344100+0000","last_peered":"2023-11-28T20:38:24.344100+0000","last_clean":"2023-11-28T20:38:24.344100+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:24.344100+0000","last_undegraded":"2023-11-28T20:38:24.344100+0000","last_fullsized":"2023-11-28T20:38:24.344100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607879+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:51.607879+0000","last_peered":"2023-11-28T20:38:51.607879+0000","last_clean":"2023-11-28T20:38:51.607879+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:51.607879+0000","last_undegraded":"2023-11-28T20:38:51.607879+0000","last_fullsized":"2023-11-28T20:38:51.607879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446949+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:25.446949+0000","last_peered":"2023-11-28T20:38:25.446949+0000","last_clean":"2023-11-28T20:38:25.446949+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:25.446949+0000","last_undegraded":"2023-11-28T20:38:25.446949+0000","last_fullsized":"2023-11-28T20:38:25.446949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527948+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:24.527948+0000","last_peered":"2023-11-28T20:38:24.527948+0000","last_clean":"2023-11-28T20:38:24.527948+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:24.527948+0000","last_undegraded":"2023-11-28T20:38:24.527948+0000","last_fullsized":"2023-11-28T20:38:24.527948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:58.919852+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:58.919852+0000","last_peered":"2023-11-28T20:38:58.919852+0000","last_clean":"2023-11-28T20:38:58.919852+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:58.919852+0000","last_undegraded":"2023-11-28T20:38:58.919852+0000","last_fullsized":"2023-11-28T20:38:58.919852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372497+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:39:00.372497+0000","last_peered":"2023-11-28T20:39:00.372497+0000","last_clean":"2023-11-28T20:39:00.372497+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:39:00.372497+0000","last_undegraded":"2023-11-28T20:39:00.372497+0000","last_fullsized":"2023-11-28T20:39:00.372497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":4,"reported_epoch":27,"state":"activating","last_fresh":"2023-11-28T20:39:01.378933+0000","last_change":"2023-11-28T20:39:01.378933+0000","last_active":"2023-11-28T20:39:01.378787+0000","last_peered":"2023-11-28T20:38:24.529908+0000","last_clean":"2023-11-28T20:38:24.529908+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:39:01.378933+0000","last_undegraded":"2023-11-28T20:39:01.378933+0000","last_fullsized":"2023-11-28T20:39:01.378933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:55:18.203913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372562+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:39:00.372562+0000","last_peered":"2023-11-28T20:39:00.372562+0000","last_clean":"2023-11-28T20:39:00.372562+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:39:00.372562+0000","last_undegraded":"2023-11-28T20:39:00.372562+0000","last_fullsized":"2023-11-28T20:39:00.372562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445985+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:25.445985+0000","last_peered":"2023-11-28T20:38:25.445985+0000","last_clean":"2023-11-28T20:38:25.445985+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:25.445985+0000","last_undegraded":"2023-11-28T20:38:25.445985+0000","last_fullsized":"2023-11-28T20:38:25.445985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344646+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:24.344646+0000","last_peered":"2023-11-28T20:38:24.344646+0000","last_clean":"2023-11-28T20:38:24.344646+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:24.344646+0000","last_undegraded":"2023-11-28T20:38:24.344646+0000","last_fullsized":"2023-11-28T20:38:24.344646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573108+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:45.573108+0000","last_peered":"2023-11-28T20:38:45.573108+0000","last_clean":"2023-11-28T20:38:45.573108+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:45.573108+0000","last_undegraded":"2023-11-28T20:38:45.573108+0000","last_fullsized":"2023-11-28T20:38:45.573108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.386759+0000","last_change":"2023-11-28T20:39:01.386759+0000","last_active":"2023-11-28T20:39:01.386759+0000","last_peered":"2023-11-28T20:39:01.386759+0000","last_clean":"2023-11-28T20:39:01.386759+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T20:39:01.386759+0000","last_undegraded":"2023-11-28T20:39:01.386759+0000","last_fullsized":"2023-11-28T20:39:01.386759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:57:45.861105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350686+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:24.350686+0000","last_peered":"2023-11-28T20:38:24.350686+0000","last_clean":"2023-11-28T20:38:24.350686+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:24.350686+0000","last_undegraded":"2023-11-28T20:38:24.350686+0000","last_fullsized":"2023-11-28T20:38:24.350686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574006+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:45.574006+0000","last_peered":"2023-11-28T20:38:45.574006+0000","last_clean":"2023-11-28T20:38:45.574006+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:45.574006+0000","last_undegraded":"2023-11-28T20:38:45.574006+0000","last_fullsized":"2023-11-28T20:38:45.574006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376894+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:39:00.376894+0000","last_peered":"2023-11-28T20:39:00.376894+0000","last_clean":"2023-11-28T20:39:00.376894+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:39:00.376894+0000","last_undegraded":"2023-11-28T20:39:00.376894+0000","last_fullsized":"2023-11-28T20:39:00.376894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439118+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:25.439118+0000","last_peered":"2023-11-28T20:38:25.439118+0000","last_clean":"2023-11-28T20:38:25.439118+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:25.439118+0000","last_undegraded":"2023-11-28T20:38:25.439118+0000","last_fullsized":"2023-11-28T20:38:25.439118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372002+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:39:00.372002+0000","last_peered":"2023-11-28T20:39:00.372002+0000","last_clean":"2023-11-28T20:39:00.372002+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:39:00.372002+0000","last_undegraded":"2023-11-28T20:39:00.372002+0000","last_fullsized":"2023-11-28T20:39:00.372002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.570975+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:45.570975+0000","last_peered":"2023-11-28T20:38:45.570975+0000","last_clean":"2023-11-28T20:38:45.570975+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:45.570975+0000","last_undegraded":"2023-11-28T20:38:45.570975+0000","last_fullsized":"2023-11-28T20:38:45.570975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441612+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:25.441612+0000","last_peered":"2023-11-28T20:38:25.441612+0000","last_clean":"2023-11-28T20:38:25.441612+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:25.441612+0000","last_undegraded":"2023-11-28T20:38:25.441612+0000","last_fullsized":"2023-11-28T20:38:25.441612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377725+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:39:00.377725+0000","last_peered":"2023-11-28T20:39:00.377725+0000","last_clean":"2023-11-28T20:39:00.377725+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:39:00.377725+0000","last_undegraded":"2023-11-28T20:39:00.377725+0000","last_fullsized":"2023-11-28T20:39:00.377725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377196+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:39:00.377196+0000","last_peered":"2023-11-28T20:39:00.377196+0000","last_clean":"2023-11-28T20:39:00.377196+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:39:00.377196+0000","last_undegraded":"2023-11-28T20:39:00.377196+0000","last_fullsized":"2023-11-28T20:39:00.377196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.610690+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:51.610690+0000","last_peered":"2023-11-28T20:38:51.610690+0000","last_clean":"2023-11-28T20:38:51.610690+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:51.610690+0000","last_undegraded":"2023-11-28T20:38:51.610690+0000","last_fullsized":"2023-11-28T20:38:51.610690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344364+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:24.344364+0000","last_peered":"2023-11-28T20:38:24.344364+0000","last_clean":"2023-11-28T20:38:24.344364+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:24.344364+0000","last_undegraded":"2023-11-28T20:38:24.344364+0000","last_fullsized":"2023-11-28T20:38:24.344364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371112+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:39:00.371112+0000","last_peered":"2023-11-28T20:39:00.371112+0000","last_clean":"2023-11-28T20:39:00.371112+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:39:00.371112+0000","last_undegraded":"2023-11-28T20:39:00.371112+0000","last_fullsized":"2023-11-28T20:39:00.371112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377615+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:39:00.377615+0000","last_peered":"2023-11-28T20:39:00.377615+0000","last_clean":"2023-11-28T20:39:00.377615+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:39:00.377615+0000","last_undegraded":"2023-11-28T20:39:00.377615+0000","last_fullsized":"2023-11-28T20:39:00.377615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529110+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:24.529110+0000","last_peered":"2023-11-28T20:38:24.529110+0000","last_clean":"2023-11-28T20:38:24.529110+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:24.529110+0000","last_undegraded":"2023-11-28T20:38:24.529110+0000","last_fullsized":"2023-11-28T20:38:24.529110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377999+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:39:00.377999+0000","last_peered":"2023-11-28T20:39:00.377999+0000","last_clean":"2023-11-28T20:39:00.377999+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:39:00.377999+0000","last_undegraded":"2023-11-28T20:39:00.377999+0000","last_fullsized":"2023-11-28T20:39:00.377999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349566+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:24.349566+0000","last_peered":"2023-11-28T20:38:24.349566+0000","last_clean":"2023-11-28T20:38:24.349566+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:24.349566+0000","last_undegraded":"2023-11-28T20:38:24.349566+0000","last_fullsized":"2023-11-28T20:38:24.349566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370843+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:39:00.370843+0000","last_peered":"2023-11-28T20:39:00.370843+0000","last_clean":"2023-11-28T20:39:00.370843+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:39:00.370843+0000","last_undegraded":"2023-11-28T20:39:00.370843+0000","last_fullsized":"2023-11-28T20:39:00.370843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349192+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:24.349192+0000","last_peered":"2023-11-28T20:38:24.349192+0000","last_clean":"2023-11-28T20:38:24.349192+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:24.349192+0000","last_undegraded":"2023-11-28T20:38:24.349192+0000","last_fullsized":"2023-11-28T20:38:24.349192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344288+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:24.344288+0000","last_peered":"2023-11-28T20:38:24.344288+0000","last_clean":"2023-11-28T20:38:24.344288+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:24.344288+0000","last_undegraded":"2023-11-28T20:38:24.344288+0000","last_fullsized":"2023-11-28T20:38:24.344288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377858+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:39:00.377858+0000","last_peered":"2023-11-28T20:39:00.377858+0000","last_clean":"2023-11-28T20:39:00.377858+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:39:00.377858+0000","last_undegraded":"2023-11-28T20:39:00.377858+0000","last_fullsized":"2023-11-28T20:39:00.377858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372406+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:39:00.372406+0000","last_peered":"2023-11-28T20:39:00.372406+0000","last_clean":"2023-11-28T20:39:00.372406+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:39:00.372406+0000","last_undegraded":"2023-11-28T20:39:00.372406+0000","last_fullsized":"2023-11-28T20:39:00.372406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351931+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:24.351931+0000","last_peered":"2023-11-28T20:38:24.351931+0000","last_clean":"2023-11-28T20:38:24.351931+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:24.351931+0000","last_undegraded":"2023-11-28T20:38:24.351931+0000","last_fullsized":"2023-11-28T20:38:24.351931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378113+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:39:00.378113+0000","last_peered":"2023-11-28T20:39:00.378113+0000","last_clean":"2023-11-28T20:39:00.378113+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:39:00.378113+0000","last_undegraded":"2023-11-28T20:39:00.378113+0000","last_fullsized":"2023-11-28T20:39:00.378113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348638+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:24.348638+0000","last_peered":"2023-11-28T20:38:24.348638+0000","last_clean":"2023-11-28T20:38:24.348638+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:24.348638+0000","last_undegraded":"2023-11-28T20:38:24.348638+0000","last_fullsized":"2023-11-28T20:38:24.348638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377083+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:39:00.377083+0000","last_peered":"2023-11-28T20:39:00.377083+0000","last_clean":"2023-11-28T20:39:00.377083+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:39:00.377083+0000","last_undegraded":"2023-11-28T20:39:00.377083+0000","last_fullsized":"2023-11-28T20:39:00.377083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":4,"reported_epoch":27,"state":"activating","last_fresh":"2023-11-28T20:39:01.378773+0000","last_change":"2023-11-28T20:39:01.378773+0000","last_active":"2023-11-28T20:39:01.378606+0000","last_peered":"2023-11-28T20:38:24.349072+0000","last_clean":"2023-11-28T20:38:24.349072+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:39:01.378773+0000","last_undegraded":"2023-11-28T20:39:01.378773+0000","last_fullsized":"2023-11-28T20:39:01.378773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:49.057388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344051+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:24.344051+0000","last_peered":"2023-11-28T20:38:24.344051+0000","last_clean":"2023-11-28T20:38:24.344051+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:24.344051+0000","last_undegraded":"2023-11-28T20:38:24.344051+0000","last_fullsized":"2023-11-28T20:38:24.344051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351494+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:24.351494+0000","last_peered":"2023-11-28T20:38:24.351494+0000","last_clean":"2023-11-28T20:38:24.351494+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:24.351494+0000","last_undegraded":"2023-11-28T20:38:24.351494+0000","last_fullsized":"2023-11-28T20:38:24.351494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528399+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:24.528399+0000","last_peered":"2023-11-28T20:38:24.528399+0000","last_clean":"2023-11-28T20:38:24.528399+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:24.528399+0000","last_undegraded":"2023-11-28T20:38:24.528399+0000","last_fullsized":"2023-11-28T20:38:24.528399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371437+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:39:00.371437+0000","last_peered":"2023-11-28T20:39:00.371437+0000","last_clean":"2023-11-28T20:39:00.371437+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:39:00.371437+0000","last_undegraded":"2023-11-28T20:39:00.371437+0000","last_fullsized":"2023-11-28T20:39:00.371437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351592+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:24.351592+0000","last_peered":"2023-11-28T20:38:24.351592+0000","last_clean":"2023-11-28T20:38:24.351592+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:24.351592+0000","last_undegraded":"2023-11-28T20:38:24.351592+0000","last_fullsized":"2023-11-28T20:38:24.351592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348427+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:24.348427+0000","last_peered":"2023-11-28T20:38:24.348427+0000","last_clean":"2023-11-28T20:38:24.348427+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:24.348427+0000","last_undegraded":"2023-11-28T20:38:24.348427+0000","last_fullsized":"2023-11-28T20:38:24.348427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371998+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:39:00.371998+0000","last_peered":"2023-11-28T20:39:00.371998+0000","last_clean":"2023-11-28T20:39:00.371998+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:39:00.371998+0000","last_undegraded":"2023-11-28T20:39:00.371998+0000","last_fullsized":"2023-11-28T20:39:00.371998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344015+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:24.344015+0000","last_peered":"2023-11-28T20:38:24.344015+0000","last_clean":"2023-11-28T20:38:24.344015+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:24.344015+0000","last_undegraded":"2023-11-28T20:38:24.344015+0000","last_fullsized":"2023-11-28T20:38:24.344015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377458+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:39:00.377458+0000","last_peered":"2023-11-28T20:39:00.377458+0000","last_clean":"2023-11-28T20:39:00.377458+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:39:00.377458+0000","last_undegraded":"2023-11-28T20:39:00.377458+0000","last_fullsized":"2023-11-28T20:39:00.377458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529932+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:24.529932+0000","last_peered":"2023-11-28T20:38:24.529932+0000","last_clean":"2023-11-28T20:38:24.529932+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:24.529932+0000","last_undegraded":"2023-11-28T20:38:24.529932+0000","last_fullsized":"2023-11-28T20:38:24.529932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351455+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:24.351455+0000","last_peered":"2023-11-28T20:38:24.351455+0000","last_clean":"2023-11-28T20:38:24.351455+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:24.351455+0000","last_undegraded":"2023-11-28T20:38:24.351455+0000","last_fullsized":"2023-11-28T20:38:24.351455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:24.351828+0000","last_change":"2023-11-28T20:39:00.374712+0000","last_active":"2023-11-28T20:39:00.374712+0000","last_peered":"2023-11-28T20:38:24.351828+0000","last_clean":"2023-11-28T20:38:24.351828+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:24.351828+0000","last_undegraded":"2023-11-28T20:38:24.351828+0000","last_fullsized":"2023-11-28T20:38:24.351828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530905+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:24.530905+0000","last_peered":"2023-11-28T20:38:24.530905+0000","last_clean":"2023-11-28T20:38:24.530905+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:24.530905+0000","last_undegraded":"2023-11-28T20:38:24.530905+0000","last_fullsized":"2023-11-28T20:38:24.530905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377589+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:39:00.377589+0000","last_peered":"2023-11-28T20:39:00.377589+0000","last_clean":"2023-11-28T20:39:00.377589+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:39:00.377589+0000","last_undegraded":"2023-11-28T20:39:00.377589+0000","last_fullsized":"2023-11-28T20:39:00.377589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527751+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:24.527751+0000","last_peered":"2023-11-28T20:38:24.527751+0000","last_clean":"2023-11-28T20:38:24.527751+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:24.527751+0000","last_undegraded":"2023-11-28T20:38:24.527751+0000","last_fullsized":"2023-11-28T20:38:24.527751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348972+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:24.348972+0000","last_peered":"2023-11-28T20:38:24.348972+0000","last_clean":"2023-11-28T20:38:24.348972+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:24.348972+0000","last_undegraded":"2023-11-28T20:38:24.348972+0000","last_fullsized":"2023-11-28T20:38:24.348972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527847+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:24.527847+0000","last_peered":"2023-11-28T20:38:24.527847+0000","last_clean":"2023-11-28T20:38:24.527847+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:24.527847+0000","last_undegraded":"2023-11-28T20:38:24.527847+0000","last_fullsized":"2023-11-28T20:38:24.527847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350257+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:24.350257+0000","last_peered":"2023-11-28T20:38:24.350257+0000","last_clean":"2023-11-28T20:38:24.350257+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:24.350257+0000","last_undegraded":"2023-11-28T20:38:24.350257+0000","last_fullsized":"2023-11-28T20:38:24.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344441+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:24.344441+0000","last_peered":"2023-11-28T20:38:24.344441+0000","last_clean":"2023-11-28T20:38:24.344441+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:24.344441+0000","last_undegraded":"2023-11-28T20:38:24.344441+0000","last_fullsized":"2023-11-28T20:38:24.344441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373007+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:39:00.373007+0000","last_peered":"2023-11-28T20:39:00.373007+0000","last_clean":"2023-11-28T20:39:00.373007+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:39:00.373007+0000","last_undegraded":"2023-11-28T20:39:00.373007+0000","last_fullsized":"2023-11-28T20:39:00.373007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530439+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:24.530439+0000","last_peered":"2023-11-28T20:38:24.530439+0000","last_clean":"2023-11-28T20:38:24.530439+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:24.530439+0000","last_undegraded":"2023-11-28T20:38:24.530439+0000","last_fullsized":"2023-11-28T20:38:24.530439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7705,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":120801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":109909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":693709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":693053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:39:06.654 INFO:tasks.mon_thrash.ceph_manager:PG 4.18 is not active+clean 2023-11-28T20:39:06.655 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2023-11-28T20:38:25.445649+0000', 'last_change': '2023-11-28T20:39:00.368426+0000', 'last_active': '2023-11-28T20:39:00.368426+0000', 'last_peered': '2023-11-28T20:38:25.445649+0000', 'last_clean': '2023-11-28T20:38:25.445649+0000', 'last_became_active': '2023-11-28T20:38:23.593047+0000', 'last_became_peered': '2023-11-28T20:38:23.593047+0000', 'last_unstale': '2023-11-28T20:38:25.445649+0000', 'last_undegraded': '2023-11-28T20:38:25.445649+0000', 'last_fullsized': '2023-11-28T20:38:25.445649+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 24, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:38:22.532017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:38:22.532017+0000', 'last_clean_scrub_stamp': '2023-11-28T20:38:22.532017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6, 2, 3], 'acting': [4, 6, 2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 2, 3, 6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T20:39:06.655 INFO:tasks.mon_thrash.ceph_manager:PG 4.2 is not active+clean 2023-11-28T20:39:06.655 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 27, 'state': 'activating', 'last_fresh': '2023-11-28T20:39:01.389091+0000', 'last_change': '2023-11-28T20:39:01.378051+0000', 'last_active': '2023-11-28T20:38:22.532017+0000', 'last_peered': '2023-11-28T20:38:22.532017+0000', 'last_clean': '2023-11-28T20:38:22.532017+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T20:39:01.389091+0000', 'last_undegraded': '2023-11-28T20:39:01.389091+0000', 'last_fullsized': '2023-11-28T20:39:01.389091+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 23, 'last_epoch_clean': 24, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:38:22.532017+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:38:22.532017+0000', 'last_clean_scrub_stamp': '2023-11-28T20:38:22.532017+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:50:13.565586+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5, 4, 0], 'acting': [2, 5, 4, 0], 'avail_no_missing': ['2(0)', '0(3)', '1(0)', '4(2)', '5(1)'], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:39:06.655 INFO:tasks.mon_thrash.ceph_manager:PG 3.14 is not active+clean 2023-11-28T20:39:06.655 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 27, 'state': 'activating', 'last_fresh': '2023-11-28T20:39:01.378933+0000', 'last_change': '2023-11-28T20:39:01.378933+0000', 'last_active': '2023-11-28T20:39:01.378787+0000', 'last_peered': '2023-11-28T20:38:24.529908+0000', 'last_clean': '2023-11-28T20:38:24.529908+0000', 'last_became_active': '2023-11-28T20:38:19.397231+0000', 'last_became_peered': '2023-11-28T20:38:19.397231+0000', 'last_unstale': '2023-11-28T20:39:01.378933+0000', 'last_undegraded': '2023-11-28T20:39:01.378933+0000', 'last_fullsized': '2023-11-28T20:39:01.378933+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'last_clean_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T07:55:18.203913+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:39:06.655 INFO:tasks.mon_thrash.ceph_manager:PG 3.2a is not active+clean 2023-11-28T20:39:06.655 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 27, 'state': 'activating', 'last_fresh': '2023-11-28T20:39:01.378773+0000', 'last_change': '2023-11-28T20:39:01.378773+0000', 'last_active': '2023-11-28T20:39:01.378606+0000', 'last_peered': '2023-11-28T20:38:24.349072+0000', 'last_clean': '2023-11-28T20:38:24.349072+0000', 'last_became_active': '2023-11-28T20:38:19.390107+0000', 'last_became_peered': '2023-11-28T20:38:19.390107+0000', 'last_unstale': '2023-11-28T20:39:01.378773+0000', 'last_undegraded': '2023-11-28T20:39:01.378773+0000', 'last_fullsized': '2023-11-28T20:39:01.378773+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'last_clean_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-30T04:45:49.057388+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T20:39:06.656 INFO:tasks.mon_thrash.ceph_manager:PG 3.36 is not active+clean 2023-11-28T20:39:06.656 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 16, 'reported_epoch': 25, 'state': 'peering', 'last_fresh': '2023-11-28T20:38:24.351828+0000', 'last_change': '2023-11-28T20:39:00.374712+0000', 'last_active': '2023-11-28T20:39:00.374712+0000', 'last_peered': '2023-11-28T20:38:24.351828+0000', 'last_clean': '2023-11-28T20:38:24.351828+0000', 'last_became_active': '2023-11-28T20:38:19.398797+0000', 'last_became_peered': '2023-11-28T20:38:19.398797+0000', 'last_unstale': '2023-11-28T20:38:24.351828+0000', 'last_undegraded': '2023-11-28T20:38:24.351828+0000', 'last_fullsized': '2023-11-28T20:38:24.351828+0000', 'mapping_epoch': 26, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 20, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'last_clean_scrub_stamp': '2023-11-28T20:38:18.500380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T20:39:06.656 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T20:39:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.824+0000 7f9ad67b5640 1 Processor -- start 2023-11-28T20:39:06.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.824+0000 7f9ad67b5640 1 -- start start 2023-11-28T20:39:06.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.824+0000 7f9ad67b5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0151bc0 0x7f9ad00ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.824+0000 7f9ad67b5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad0157dd0 con 0x7f9ad0157920 2023-11-28T20:39:06.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.824+0000 7f9ad67b5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad01580b0 con 0x7f9ad006f760 2023-11-28T20:39:06.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.824+0000 7f9ad67b5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00c41a0 con 0x7f9ad0151bc0 2023-11-28T20:39:06.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad4fb2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9ad0157920 0x7f9ad00c82e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51700/0 (socket says 172.21.15.167:51700) 2023-11-28T20:39:06.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad4fb2640 1 -- 172.21.15.167:0/3366767100 learned_addr learned my addr 172.21.15.167:0/3366767100 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:06.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad57b3640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0151bc0 0x7f9ad00ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723118489 0 0) 0x7f9ad0157dd0 con 0x7f9ad0157920 2023-11-28T20:39:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9abc003530 con 0x7f9ad0157920 2023-11-28T20:39:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 217002941 0 0) 0x7f9abc003530 con 0x7f9ad0157920 2023-11-28T20:39:06.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0151bc0 msgr2=0x7f9ad00ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0151bc0 0x7f9ad00ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 >> v1:172.21.15.178:6789/0 conn(0x7f9ad006f760 legacy=0x7f9ad006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0158390 con 0x7f9ad0157920 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9ac0001680 con 0x7f9ad0157920 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 >> v1:172.21.15.167:6789/0 conn(0x7f9ad0157920 legacy=0x7f9ad00c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9abc0039b0 0x7f9abc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0151bc0 0x7f9abc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9abc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc00ba40 con 0x7f9abc004d10 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc00bbb0 con 0x7f9abc0039b0 2023-11-28T20:39:06.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc00bd70 con 0x7f9ad0151bc0 2023-11-28T20:39:06.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad5fb4640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9abc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad57b3640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9abc0039b0 0x7f9abc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad4fb2640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0151bc0 0x7f9abc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad5fb4640 1 -- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0151bc0 msgr2=0x7f9abc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:06.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad5fb4640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0151bc0 0x7f9abc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad5fb4640 1 -- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9abc0039b0 msgr2=0x7f9abc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:06.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad5fb4640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9abc0039b0 0x7f9abc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad5fb4640 1 -- 172.21.15.167:0/3366767100 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc003530 con 0x7f9abc004d10 2023-11-28T20:39:06.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.828+0000 7f9ad57b3640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9abc0039b0 0x7f9abc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:06.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad5fb4640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9abc005190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8001e40 tx=0x7f9ac801c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedfa77aff5e21b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:06.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8003b80 con 0x7f9abc004d10 2023-11-28T20:39:06.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac8003ce0 con 0x7f9abc004d10 2023-11-28T20:39:06.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ac7fff640 1 -- 172.21.15.167:0/3366767100 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80052c0 con 0x7f9abc004d10 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3366767100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 msgr2=0x7f9abc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad67b5640 1 --2- 172.21.15.167:0/3366767100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9abc005190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8001e40 tx=0x7f9ac801c740 comp rx=0 tx=0).stop 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad5fb4640 1 -- 172.21.15.167:0/3366767100 reap_dead start 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3366767100 shutdown_connections 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3366767100 >> 172.21.15.167:0/3366767100 conn(0x7f9ad00700e0 msgr2=0x7f9ad00704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3366767100 shutdown_connections 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3366767100 wait complete. 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad67b5640 1 Processor -- start 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.832+0000 7f9ad67b5640 1 -- start start 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad67b5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9ad015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad67b5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad014f160 0x7f9ad01f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad67b5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad01f2f20 0x7f9ad014b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad67b5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad01f36e0 con 0x7f9abc004d10 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad67b5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad01f3400 con 0x7f9ad01f2f20 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad67b5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad014d390 con 0x7f9ad014f160 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad57b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9ad015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad57b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9ad015b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33450/0 (socket says 172.21.15.167:33450) 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad57b3640 1 -- 172.21.15.167:0/3809090790 learned_addr learned my addr 172.21.15.167:0/3809090790 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad4fb2640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad014f160 0x7f9ad01f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad5fb4640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad01f2f20 0x7f9ad014b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad57b3640 1 -- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad014f160 msgr2=0x7f9ad01f29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad57b3640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad014f160 0x7f9ad01f29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad57b3640 1 -- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad01f2f20 msgr2=0x7f9ad014b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:06.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad57b3640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad01f2f20 0x7f9ad014b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad57b3640 1 -- 172.21.15.167:0/3809090790 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad014d670 con 0x7f9abc004d10 2023-11-28T20:39:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad57b3640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9ad015b980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0115f0 tx=0x7f9acc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ac5ffb640 1 -- 172.21.15.167:0/3809090790 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc004220 con 0x7f9abc004d10 2023-11-28T20:39:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ac5ffb640 1 -- 172.21.15.167:0/3809090790 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc004380 con 0x7f9abc004d10 2023-11-28T20:39:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ac5ffb640 1 -- 172.21.15.167:0/3809090790 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00f8f0 con 0x7f9abc004d10 2023-11-28T20:39:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad014d950 con 0x7f9abc004d10 2023-11-28T20:39:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad014bd80 con 0x7f9abc004d10 2023-11-28T20:39:06.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad00c80e0 con 0x7f9abc004d10 2023-11-28T20:39:06.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.836+0000 7f9ac5ffb640 1 -- 172.21.15.167:0/3809090790 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9acc00fa50 con 0x7f9abc004d10 2023-11-28T20:39:06.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.840+0000 7f9ac5ffb640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ab40664a0 0x7f9ab4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:06.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.840+0000 7f9ac5ffb640 1 -- 172.21.15.167:0/3809090790 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9acc084430 con 0x7f9abc004d10 2023-11-28T20:39:06.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.840+0000 7f9ad4fb2640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ab40664a0 0x7f9ab4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:06.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.840+0000 7f9ad4fb2640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ab40664a0 0x7f9ab4068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0001060 tx=0x7f9ac0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:06.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:06.844+0000 7f9ac5ffb640 1 -- 172.21.15.167:0/3809090790 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9acc0514f0 con 0x7f9abc004d10 2023-11-28T20:39:07.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.044+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9ad004e850 con 0x7f9abc004d10 2023-11-28T20:39:07.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.044+0000 7f9ac5ffb640 1 -- 172.21.15.167:0/3809090790 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2626 (secure 0 0 0) 0x7f9acc054b10 con 0x7f9abc004d10 2023-11-28T20:39:07.049 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:07.050 INFO:teuthology.orchestra.run.smithi167.stdout:{"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":72,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":27,"num_osds":8,"num_up_osds":8,"osd_up_since":1701203885,"num_in_osds":8,"osd_in_since":1701203876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":124},{"state_name":"activating","count":3},{"state_name":"peering","count":2}],"num_pgs":129,"num_pools":4,"num_objects":62,"data_bytes":598073,"bytes_used":241836032,"bytes_avail":772852277248,"bytes_total":773094113280,"inactive_pgs_ratio":0.038759689778089523,"write_bytes_sec":255,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":14,"id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"f","status":"up:active","gid":4276},{"filesystem_id":1,"rank":1,"name":"c","status":"up:active","gid":4278},{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4279}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-11-28T20:39:05.446252+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T20:39:07.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ab40664a0 msgr2=0x7f9ab4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:07.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ab40664a0 0x7f9ab4068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0001060 tx=0x7f9ac0009040 comp rx=0 tx=0).stop 2023-11-28T20:39:07.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 msgr2=0x7f9ad015b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:07.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9ad015b980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0115f0 tx=0x7f9acc011ab0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 shutdown_connections 2023-11-28T20:39:07.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ab40664a0 0x7f9ab4068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad01f2f20 0x7f9ad014b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad014f160 0x7f9ad01f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 --2- 172.21.15.167:0/3809090790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9abc004d10 0x7f9ad015b980 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 >> 172.21.15.167:0/3809090790 conn(0x7f9ad00700e0 msgr2=0x7f9ad00ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:07.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 shutdown_connections 2023-11-28T20:39:07.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.048+0000 7f9ad67b5640 1 -- 172.21.15.167:0/3809090790 wait complete. 2023-11-28T20:39:07.071 INFO:tasks.mon_thrash.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T20:39:07.071 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:39:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.204+0000 7f4e1f079640 1 Processor -- start 2023-11-28T20:39:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.204+0000 7f4e1f079640 1 -- start start 2023-11-28T20:39:07.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e1f079640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4e18157560 0x7f4e180c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:07.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e1f079640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e18157940 con 0x7f4e180c6ff0 2023-11-28T20:39:07.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e1f079640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e180c6ac0 con 0x7f4e18150b40 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e1f079640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e180c62f0 con 0x7f4e18157560 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e0ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4e180c6ff0 0x7f4e1806a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51704/0 (socket says 172.21.15.167:51704) 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e0ffff640 1 -- 172.21.15.167:0/636403738 learned_addr learned my addr 172.21.15.167:0/636403738 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e1d616640 1 --2- 172.21.15.167:0/636403738 >> v2:172.21.15.178:3300/0 conn(0x7f4e18157560 0x7f4e180c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e0f7fe640 1 -- 172.21.15.167:0/636403738 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156522520 0 0) 0x7f4e18157940 con 0x7f4e180c6ff0 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e0f7fe640 1 -- 172.21.15.167:0/636403738 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e00003530 con 0x7f4e180c6ff0 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e1d616640 1 -- 172.21.15.167:0/636403738 >> v1:172.21.15.178:6789/0 conn(0x7f4e18150b40 legacy=0x7f4e180c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e0f7fe640 1 -- 172.21.15.167:0/636403738 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4150790225 0 0) 0x7f4e00003530 con 0x7f4e180c6ff0 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e1d616640 1 -- 172.21.15.167:0/636403738 >> v1:172.21.15.167:6789/0 conn(0x7f4e180c6ff0 legacy=0x7f4e1806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.208+0000 7f4e1d616640 1 -- 172.21.15.167:0/636403738 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180c6500 con 0x7f4e18157560 2023-11-28T20:39:07.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1d616640 1 --2- 172.21.15.167:0/636403738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18157560 0x7f4e180c4510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009d90 tx=0x7f4e10021270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a800a3af63f4d8c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:07.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e0f7fe640 1 -- 172.21.15.167:0/636403738 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080016a0 con 0x7f4e18157560 2023-11-28T20:39:07.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e0f7fe640 1 -- 172.21.15.167:0/636403738 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e100ad050 con 0x7f4e18157560 2023-11-28T20:39:07.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e0f7fe640 1 -- 172.21.15.167:0/636403738 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e100b1600 con 0x7f4e18157560 2023-11-28T20:39:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1f079640 1 -- 172.21.15.167:0/636403738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18157560 msgr2=0x7f4e180c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1f079640 1 --2- 172.21.15.167:0/636403738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18157560 0x7f4e180c4510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009d90 tx=0x7f4e10021270 comp rx=0 tx=0).stop 2023-11-28T20:39:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1f079640 1 -- 172.21.15.167:0/636403738 shutdown_connections 2023-11-28T20:39:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1f079640 1 --2- 172.21.15.167:0/636403738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18157560 0x7f4e180c4510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1f079640 1 -- 172.21.15.167:0/636403738 >> 172.21.15.167:0/636403738 conn(0x7f4e180cb1e0 msgr2=0x7f4e180cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1f079640 1 -- 172.21.15.167:0/636403738 shutdown_connections 2023-11-28T20:39:07.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1f079640 1 -- 172.21.15.167:0/636403738 wait complete. 2023-11-28T20:39:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1f079640 1 Processor -- start 2023-11-28T20:39:07.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.212+0000 7f4e1f079640 1 -- start start 2023-11-28T20:39:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1f079640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e180c6ff0 0x7f4e181eb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1f079640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18150b40 0x7f4e180ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1f079640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e18157560 0x7f4e1806a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1f079640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e181ebc90 con 0x7f4e180c6ff0 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1f079640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e180caee0 con 0x7f4e18150b40 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1f079640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e180c8fe0 con 0x7f4e18157560 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1ce15640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e180c6ff0 0x7f4e181eb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1ce15640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e180c6ff0 0x7f4e181eb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33452/0 (socket says 172.21.15.167:33452) 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1ce15640 1 -- 172.21.15.167:0/4217618337 learned_addr learned my addr 172.21.15.167:0/4217618337 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1d616640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e18157560 0x7f4e1806a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e0ffff640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18150b40 0x7f4e180ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1ce15640 1 -- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e18157560 msgr2=0x7f4e1806a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1ce15640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e18157560 0x7f4e1806a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1ce15640 1 -- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18150b40 msgr2=0x7f4e180ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1ce15640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18150b40 0x7f4e180ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1ce15640 1 -- 172.21.15.167:0/4217618337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e10009a70 con 0x7f4e180c6ff0 2023-11-28T20:39:07.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e0ffff640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18150b40 0x7f4e180ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:07.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1ce15640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e180c6ff0 0x7f4e181eb750 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400c500 tx=0x7f4e1400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:07.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e0d7fa640 1 -- 172.21.15.167:0/4217618337 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14005220 con 0x7f4e180c6ff0 2023-11-28T20:39:07.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e0d7fa640 1 -- 172.21.15.167:0/4217618337 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14005380 con 0x7f4e180c6ff0 2023-11-28T20:39:07.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e0d7fa640 1 -- 172.21.15.167:0/4217618337 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14007270 con 0x7f4e180c6ff0 2023-11-28T20:39:07.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e180c9280 con 0x7f4e180c6ff0 2023-11-28T20:39:07.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e180c9840 con 0x7f4e180c6ff0 2023-11-28T20:39:07.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.216+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e180682c0 con 0x7f4e180c6ff0 2023-11-28T20:39:07.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.220+0000 7f4e0d7fa640 1 -- 172.21.15.167:0/4217618337 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e140073d0 con 0x7f4e180c6ff0 2023-11-28T20:39:07.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.220+0000 7f4e0d7fa640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e04066470 0x7f4e04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:07.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.220+0000 7f4e0d7fa640 1 -- 172.21.15.167:0/4217618337 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e14083c40 con 0x7f4e180c6ff0 2023-11-28T20:39:07.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.220+0000 7f4e0ffff640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e04066470 0x7f4e04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:07.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.220+0000 7f4e0ffff640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e04066470 0x7f4e04068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4e080017d0 tx=0x7f4e08001700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:07.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.224+0000 7f4e0d7fa640 1 -- 172.21.15.167:0/4217618337 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e14050c70 con 0x7f4e180c6ff0 2023-11-28T20:39:07.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.372+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e18156d60 con 0x7f4e04066470 2023-11-28T20:39:07.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.400+0000 7f4e0d7fa640 1 -- 172.21.15.167:0/4217618337 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345280 (secure 0 0 0) 0x7f4e080019e0 con 0x7f4e04066470 2023-11-28T20:39:07.409 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:07.411 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:39:07.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e04066470 msgr2=0x7f4e04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:07.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e04066470 0x7f4e04068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4e080017d0 tx=0x7f4e08001700 comp rx=0 tx=0).stop 2023-11-28T20:39:07.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e180c6ff0 msgr2=0x7f4e181eb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:07.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e180c6ff0 0x7f4e181eb750 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400c500 tx=0x7f4e1400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 shutdown_connections 2023-11-28T20:39:07.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e04066470 0x7f4e04068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e18157560 0x7f4e1806a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e18150b40 0x7f4e180ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 --2- 172.21.15.167:0/4217618337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e180c6ff0 0x7f4e181eb750 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:07.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 >> 172.21.15.167:0/4217618337 conn(0x7f4e180cb1e0 msgr2=0x7f4e181558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:07.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 shutdown_connections 2023-11-28T20:39:07.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:07.404+0000 7f4e1f079640 1 -- 172.21.15.167:0/4217618337 wait complete. 2023-11-28T20:39:07.428 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-11-28T20:39:05.446176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598073,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":289,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236168,"kb_used_data":3384,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738552,"statfs":{"total":773094113280,"available":772852277248,"internally_reserved":0,"allocated":3465216,"data_stored":2040447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":254,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003359"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.609165+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:38:51.609165+0000","last_peered":"2023-11-28T20:38:51.609165+0000","last_clean":"2023-11-28T20:38:51.609165+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:38:51.609165+0000","last_undegraded":"2023-11-28T20:38:51.609165+0000","last_fullsized":"2023-11-28T20:38:51.609165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.390144+0000","last_change":"2023-11-28T20:39:01.387644+0000","last_active":"2023-11-28T20:39:01.390144+0000","last_peered":"2023-11-28T20:39:01.390144+0000","last_clean":"2023-11-28T20:39:01.390144+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T20:39:01.390144+0000","last_undegraded":"2023-11-28T20:39:01.390144+0000","last_fullsized":"2023-11-28T20:39:01.390144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:52.977080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376803+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:39:00.376803+0000","last_peered":"2023-11-28T20:39:00.376803+0000","last_clean":"2023-11-28T20:39:00.376803+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:39:00.376803+0000","last_undegraded":"2023-11-28T20:39:00.376803+0000","last_fullsized":"2023-11-28T20:39:00.376803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378262+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:39:00.378262+0000","last_peered":"2023-11-28T20:39:00.378262+0000","last_clean":"2023-11-28T20:39:00.378262+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:39:00.378262+0000","last_undegraded":"2023-11-28T20:39:00.378262+0000","last_fullsized":"2023-11-28T20:39:00.378262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344550+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:38:24.344550+0000","last_peered":"2023-11-28T20:38:24.344550+0000","last_clean":"2023-11-28T20:38:24.344550+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:38:24.344550+0000","last_undegraded":"2023-11-28T20:38:24.344550+0000","last_fullsized":"2023-11-28T20:38:24.344550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:25.445649+0000","last_change":"2023-11-28T20:39:00.368426+0000","last_active":"2023-11-28T20:39:00.368426+0000","last_peered":"2023-11-28T20:38:25.445649+0000","last_clean":"2023-11-28T20:38:25.445649+0000","last_became_active":"2023-11-28T20:38:23.593047+0000","last_became_peered":"2023-11-28T20:38:23.593047+0000","last_unstale":"2023-11-28T20:38:25.445649+0000","last_undegraded":"2023-11-28T20:38:25.445649+0000","last_fullsized":"2023-11-28T20:38:25.445649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.606601+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:38:51.606601+0000","last_peered":"2023-11-28T20:38:51.606601+0000","last_clean":"2023-11-28T20:38:51.606601+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:38:51.606601+0000","last_undegraded":"2023-11-28T20:38:51.606601+0000","last_fullsized":"2023-11-28T20:38:51.606601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350728+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:38:24.350728+0000","last_peered":"2023-11-28T20:38:24.350728+0000","last_clean":"2023-11-28T20:38:24.350728+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:38:24.350728+0000","last_undegraded":"2023-11-28T20:38:24.350728+0000","last_fullsized":"2023-11-28T20:38:24.350728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445936+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:38:25.445936+0000","last_peered":"2023-11-28T20:38:25.445936+0000","last_clean":"2023-11-28T20:38:25.445936+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:38:25.445936+0000","last_undegraded":"2023-11-28T20:38:25.445936+0000","last_fullsized":"2023-11-28T20:38:25.445936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.532409+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:38:24.532409+0000","last_peered":"2023-11-28T20:38:24.532409+0000","last_clean":"2023-11-28T20:38:24.532409+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:38:24.532409+0000","last_undegraded":"2023-11-28T20:38:24.532409+0000","last_fullsized":"2023-11-28T20:38:24.532409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350514+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:38:24.350514+0000","last_peered":"2023-11-28T20:38:24.350514+0000","last_clean":"2023-11-28T20:38:24.350514+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:38:24.350514+0000","last_undegraded":"2023-11-28T20:38:24.350514+0000","last_fullsized":"2023-11-28T20:38:24.350514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445855+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:38:25.445855+0000","last_peered":"2023-11-28T20:38:25.445855+0000","last_clean":"2023-11-28T20:38:25.445855+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:38:25.445855+0000","last_undegraded":"2023-11-28T20:38:25.445855+0000","last_fullsized":"2023-11-28T20:38:25.445855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350262+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:38:24.350262+0000","last_peered":"2023-11-28T20:38:24.350262+0000","last_clean":"2023-11-28T20:38:24.350262+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:38:24.350262+0000","last_undegraded":"2023-11-28T20:38:24.350262+0000","last_fullsized":"2023-11-28T20:38:24.350262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575295+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:38:45.575295+0000","last_peered":"2023-11-28T20:38:45.575295+0000","last_clean":"2023-11-28T20:38:45.575295+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:38:45.575295+0000","last_undegraded":"2023-11-28T20:38:45.575295+0000","last_fullsized":"2023-11-28T20:38:45.575295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446173+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:38:25.446173+0000","last_peered":"2023-11-28T20:38:25.446173+0000","last_clean":"2023-11-28T20:38:25.446173+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:38:25.446173+0000","last_undegraded":"2023-11-28T20:38:25.446173+0000","last_fullsized":"2023-11-28T20:38:25.446173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377543+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:39:00.377543+0000","last_peered":"2023-11-28T20:39:00.377543+0000","last_clean":"2023-11-28T20:39:00.377543+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:39:00.377543+0000","last_undegraded":"2023-11-28T20:39:00.377543+0000","last_fullsized":"2023-11-28T20:39:00.377543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372769+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:39:00.372769+0000","last_peered":"2023-11-28T20:39:00.372769+0000","last_clean":"2023-11-28T20:39:00.372769+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:39:00.372769+0000","last_undegraded":"2023-11-28T20:39:00.372769+0000","last_fullsized":"2023-11-28T20:39:00.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446061+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:38:25.446061+0000","last_peered":"2023-11-28T20:38:25.446061+0000","last_clean":"2023-11-28T20:38:25.446061+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:38:25.446061+0000","last_undegraded":"2023-11-28T20:38:25.446061+0000","last_fullsized":"2023-11-28T20:38:25.446061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377798+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:39:00.377798+0000","last_peered":"2023-11-28T20:39:00.377798+0000","last_clean":"2023-11-28T20:39:00.377798+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:39:00.377798+0000","last_undegraded":"2023-11-28T20:39:00.377798+0000","last_fullsized":"2023-11-28T20:39:00.377798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372086+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:39:00.372086+0000","last_peered":"2023-11-28T20:39:00.372086+0000","last_clean":"2023-11-28T20:39:00.372086+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:39:00.372086+0000","last_undegraded":"2023-11-28T20:39:00.372086+0000","last_fullsized":"2023-11-28T20:39:00.372086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373087+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.373087+0000","last_peered":"2023-11-28T20:39:00.373087+0000","last_clean":"2023-11-28T20:39:00.373087+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:39:00.373087+0000","last_undegraded":"2023-11-28T20:39:00.373087+0000","last_fullsized":"2023-11-28T20:39:00.373087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528774+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:38:24.528774+0000","last_peered":"2023-11-28T20:38:24.528774+0000","last_clean":"2023-11-28T20:38:24.528774+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:38:24.528774+0000","last_undegraded":"2023-11-28T20:38:24.528774+0000","last_fullsized":"2023-11-28T20:38:24.528774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.575123+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:38:45.575123+0000","last_peered":"2023-11-28T20:38:45.575123+0000","last_clean":"2023-11-28T20:38:45.575123+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:38:45.575123+0000","last_undegraded":"2023-11-28T20:38:45.575123+0000","last_fullsized":"2023-11-28T20:38:45.575123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446227+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:38:25.446227+0000","last_peered":"2023-11-28T20:38:25.446227+0000","last_clean":"2023-11-28T20:38:25.446227+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:38:25.446227+0000","last_undegraded":"2023-11-28T20:38:25.446227+0000","last_fullsized":"2023-11-28T20:38:25.446227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344675+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:38:24.344675+0000","last_peered":"2023-11-28T20:38:24.344675+0000","last_clean":"2023-11-28T20:38:24.344675+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:38:24.344675+0000","last_undegraded":"2023-11-28T20:38:24.344675+0000","last_fullsized":"2023-11-28T20:38:24.344675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573711+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:38:45.573711+0000","last_peered":"2023-11-28T20:38:45.573711+0000","last_clean":"2023-11-28T20:38:45.573711+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:38:45.573711+0000","last_undegraded":"2023-11-28T20:38:45.573711+0000","last_fullsized":"2023-11-28T20:38:45.573711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445762+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:38:25.445762+0000","last_peered":"2023-11-28T20:38:25.445762+0000","last_clean":"2023-11-28T20:38:25.445762+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:38:25.445762+0000","last_undegraded":"2023-11-28T20:38:25.445762+0000","last_fullsized":"2023-11-28T20:38:25.445762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378189+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:39:00.378189+0000","last_peered":"2023-11-28T20:39:00.378189+0000","last_clean":"2023-11-28T20:39:00.378189+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:39:00.378189+0000","last_undegraded":"2023-11-28T20:39:00.378189+0000","last_fullsized":"2023-11-28T20:39:00.378189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373110+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:39:00.373110+0000","last_peered":"2023-11-28T20:39:00.373110+0000","last_clean":"2023-11-28T20:39:00.373110+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:39:00.373110+0000","last_undegraded":"2023-11-28T20:39:00.373110+0000","last_fullsized":"2023-11-28T20:39:00.373110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377445+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:39:00.377445+0000","last_peered":"2023-11-28T20:39:00.377445+0000","last_clean":"2023-11-28T20:39:00.377445+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:39:00.377445+0000","last_undegraded":"2023-11-28T20:39:00.377445+0000","last_fullsized":"2023-11-28T20:39:00.377445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372844+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:39:00.372844+0000","last_peered":"2023-11-28T20:39:00.372844+0000","last_clean":"2023-11-28T20:39:00.372844+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:39:00.372844+0000","last_undegraded":"2023-11-28T20:39:00.372844+0000","last_fullsized":"2023-11-28T20:39:00.372844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574343+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:38:45.574343+0000","last_peered":"2023-11-28T20:38:45.574343+0000","last_clean":"2023-11-28T20:38:45.574343+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:38:45.574343+0000","last_undegraded":"2023-11-28T20:38:45.574343+0000","last_fullsized":"2023-11-28T20:38:45.574343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439058+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:38:25.439058+0000","last_peered":"2023-11-28T20:38:25.439058+0000","last_clean":"2023-11-28T20:38:25.439058+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:38:25.439058+0000","last_undegraded":"2023-11-28T20:38:25.439058+0000","last_fullsized":"2023-11-28T20:38:25.439058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350784+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:38:24.350784+0000","last_peered":"2023-11-28T20:38:24.350784+0000","last_clean":"2023-11-28T20:38:24.350784+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:38:24.350784+0000","last_undegraded":"2023-11-28T20:38:24.350784+0000","last_fullsized":"2023-11-28T20:38:24.350784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372929+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:39:00.372929+0000","last_peered":"2023-11-28T20:39:00.372929+0000","last_clean":"2023-11-28T20:39:00.372929+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:39:00.372929+0000","last_undegraded":"2023-11-28T20:39:00.372929+0000","last_fullsized":"2023-11-28T20:39:00.372929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":6,"reported_epoch":27,"state":"activating","last_fresh":"2023-11-28T20:39:01.389091+0000","last_change":"2023-11-28T20:39:01.378051+0000","last_active":"2023-11-28T20:38:22.532017+0000","last_peered":"2023-11-28T20:38:22.532017+0000","last_clean":"2023-11-28T20:38:22.532017+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T20:39:01.389091+0000","last_undegraded":"2023-11-28T20:39:01.389091+0000","last_fullsized":"2023-11-28T20:39:01.389091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:50:13.565586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":["2(0)","0(3)","1(0)","4(2)","5(1)"],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529967+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:38:24.529967+0000","last_peered":"2023-11-28T20:38:24.529967+0000","last_clean":"2023-11-28T20:38:24.529967+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:38:24.529967+0000","last_undegraded":"2023-11-28T20:38:24.529967+0000","last_fullsized":"2023-11-28T20:38:24.529967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608154+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:38:51.608154+0000","last_peered":"2023-11-28T20:38:51.608154+0000","last_clean":"2023-11-28T20:38:51.608154+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:38:51.608154+0000","last_undegraded":"2023-11-28T20:38:51.608154+0000","last_fullsized":"2023-11-28T20:38:51.608154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372765+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:39:00.372765+0000","last_peered":"2023-11-28T20:39:00.372765+0000","last_clean":"2023-11-28T20:39:00.372765+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:39:00.372765+0000","last_undegraded":"2023-11-28T20:39:00.372765+0000","last_fullsized":"2023-11-28T20:39:00.372765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373168+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:39:00.373168+0000","last_peered":"2023-11-28T20:39:00.373168+0000","last_clean":"2023-11-28T20:39:00.373168+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:39:00.373168+0000","last_undegraded":"2023-11-28T20:39:00.373168+0000","last_fullsized":"2023-11-28T20:39:00.373168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370832+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:39:00.370832+0000","last_peered":"2023-11-28T20:39:00.370832+0000","last_clean":"2023-11-28T20:39:00.370832+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:39:00.370832+0000","last_undegraded":"2023-11-28T20:39:00.370832+0000","last_fullsized":"2023-11-28T20:39:00.370832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373409+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:39:00.373409+0000","last_peered":"2023-11-28T20:39:00.373409+0000","last_clean":"2023-11-28T20:39:00.373409+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:39:00.373409+0000","last_undegraded":"2023-11-28T20:39:00.373409+0000","last_fullsized":"2023-11-28T20:39:00.373409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.343810+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:38:24.343810+0000","last_peered":"2023-11-28T20:38:24.343810+0000","last_clean":"2023-11-28T20:38:24.343810+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:38:24.343810+0000","last_undegraded":"2023-11-28T20:38:24.343810+0000","last_fullsized":"2023-11-28T20:38:24.343810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608237+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:38:51.608237+0000","last_peered":"2023-11-28T20:38:51.608237+0000","last_clean":"2023-11-28T20:38:51.608237+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:38:51.608237+0000","last_undegraded":"2023-11-28T20:38:51.608237+0000","last_fullsized":"2023-11-28T20:38:51.608237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439136+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:38:25.439136+0000","last_peered":"2023-11-28T20:38:25.439136+0000","last_clean":"2023-11-28T20:38:25.439136+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:38:25.439136+0000","last_undegraded":"2023-11-28T20:38:25.439136+0000","last_fullsized":"2023-11-28T20:38:25.439136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376856+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:39:00.376856+0000","last_peered":"2023-11-28T20:39:00.376856+0000","last_clean":"2023-11-28T20:39:00.376856+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:39:00.376856+0000","last_undegraded":"2023-11-28T20:39:00.376856+0000","last_fullsized":"2023-11-28T20:39:00.376856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.608459+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:38:51.608459+0000","last_peered":"2023-11-28T20:38:51.608459+0000","last_clean":"2023-11-28T20:38:51.608459+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:38:51.608459+0000","last_undegraded":"2023-11-28T20:38:51.608459+0000","last_fullsized":"2023-11-28T20:38:51.608459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528002+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:38:24.528002+0000","last_peered":"2023-11-28T20:38:24.528002+0000","last_clean":"2023-11-28T20:38:24.528002+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:38:24.528002+0000","last_undegraded":"2023-11-28T20:38:24.528002+0000","last_fullsized":"2023-11-28T20:38:24.528002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441545+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:38:25.441545+0000","last_peered":"2023-11-28T20:38:25.441545+0000","last_clean":"2023-11-28T20:38:25.441545+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:38:25.441545+0000","last_undegraded":"2023-11-28T20:38:25.441545+0000","last_fullsized":"2023-11-28T20:38:25.441545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528152+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:38:24.528152+0000","last_peered":"2023-11-28T20:38:24.528152+0000","last_clean":"2023-11-28T20:38:24.528152+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:38:24.528152+0000","last_undegraded":"2023-11-28T20:38:24.528152+0000","last_fullsized":"2023-11-28T20:38:24.528152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371241+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:39:00.371241+0000","last_peered":"2023-11-28T20:39:00.371241+0000","last_clean":"2023-11-28T20:39:00.371241+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:39:00.371241+0000","last_undegraded":"2023-11-28T20:39:00.371241+0000","last_fullsized":"2023-11-28T20:39:00.371241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441453+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:38:25.441453+0000","last_peered":"2023-11-28T20:38:25.441453+0000","last_clean":"2023-11-28T20:38:25.441453+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:38:25.441453+0000","last_undegraded":"2023-11-28T20:38:25.441453+0000","last_fullsized":"2023-11-28T20:38:25.441453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350421+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:38:24.350421+0000","last_peered":"2023-11-28T20:38:24.350421+0000","last_clean":"2023-11-28T20:38:24.350421+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:38:24.350421+0000","last_undegraded":"2023-11-28T20:38:24.350421+0000","last_fullsized":"2023-11-28T20:38:24.350421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372659+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:39:00.372659+0000","last_peered":"2023-11-28T20:39:00.372659+0000","last_clean":"2023-11-28T20:39:00.372659+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:39:00.372659+0000","last_undegraded":"2023-11-28T20:39:00.372659+0000","last_fullsized":"2023-11-28T20:39:00.372659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439079+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:38:25.439079+0000","last_peered":"2023-11-28T20:38:25.439079+0000","last_clean":"2023-11-28T20:38:25.439079+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:38:25.439079+0000","last_undegraded":"2023-11-28T20:38:25.439079+0000","last_fullsized":"2023-11-28T20:38:25.439079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.531147+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:38:24.531147+0000","last_peered":"2023-11-28T20:38:24.531147+0000","last_clean":"2023-11-28T20:38:24.531147+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:38:24.531147+0000","last_undegraded":"2023-11-28T20:38:24.531147+0000","last_fullsized":"2023-11-28T20:38:24.531147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371475+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:39:00.371475+0000","last_peered":"2023-11-28T20:39:00.371475+0000","last_clean":"2023-11-28T20:39:00.371475+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:39:00.371475+0000","last_undegraded":"2023-11-28T20:39:00.371475+0000","last_fullsized":"2023-11-28T20:39:00.371475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446714+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:38:25.446714+0000","last_peered":"2023-11-28T20:38:25.446714+0000","last_clean":"2023-11-28T20:38:25.446714+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:38:25.446714+0000","last_undegraded":"2023-11-28T20:38:25.446714+0000","last_fullsized":"2023-11-28T20:38:25.446714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529633+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:38:24.529633+0000","last_peered":"2023-11-28T20:38:24.529633+0000","last_clean":"2023-11-28T20:38:24.529633+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:38:24.529633+0000","last_undegraded":"2023-11-28T20:38:24.529633+0000","last_fullsized":"2023-11-28T20:38:24.529633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:56.834824+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:38:56.834824+0000","last_peered":"2023-11-28T20:38:56.834824+0000","last_clean":"2023-11-28T20:38:56.834824+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:38:56.834824+0000","last_undegraded":"2023-11-28T20:38:56.834824+0000","last_fullsized":"2023-11-28T20:38:56.834824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445709+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:38:25.445709+0000","last_peered":"2023-11-28T20:38:25.445709+0000","last_clean":"2023-11-28T20:38:25.445709+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:38:25.445709+0000","last_undegraded":"2023-11-28T20:38:25.445709+0000","last_fullsized":"2023-11-28T20:38:25.445709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527830+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:38:24.527830+0000","last_peered":"2023-11-28T20:38:24.527830+0000","last_clean":"2023-11-28T20:38:24.527830+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:38:24.527830+0000","last_undegraded":"2023-11-28T20:38:24.527830+0000","last_fullsized":"2023-11-28T20:38:24.527830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370725+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:39:00.370725+0000","last_peered":"2023-11-28T20:39:00.370725+0000","last_clean":"2023-11-28T20:39:00.370725+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:39:00.370725+0000","last_undegraded":"2023-11-28T20:39:00.370725+0000","last_fullsized":"2023-11-28T20:39:00.370725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439127+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:38:25.439127+0000","last_peered":"2023-11-28T20:38:25.439127+0000","last_clean":"2023-11-28T20:38:25.439127+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:38:25.439127+0000","last_undegraded":"2023-11-28T20:38:25.439127+0000","last_fullsized":"2023-11-28T20:38:25.439127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349743+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:38:24.349743+0000","last_peered":"2023-11-28T20:38:24.349743+0000","last_clean":"2023-11-28T20:38:24.349743+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:38:24.349743+0000","last_undegraded":"2023-11-28T20:38:24.349743+0000","last_fullsized":"2023-11-28T20:38:24.349743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.613830+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:38:51.613830+0000","last_peered":"2023-11-28T20:38:51.613830+0000","last_clean":"2023-11-28T20:38:51.613830+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:38:51.613830+0000","last_undegraded":"2023-11-28T20:38:51.613830+0000","last_fullsized":"2023-11-28T20:38:51.613830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378106+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:39:00.378106+0000","last_peered":"2023-11-28T20:39:00.378106+0000","last_clean":"2023-11-28T20:39:00.378106+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:39:00.378106+0000","last_undegraded":"2023-11-28T20:39:00.378106+0000","last_fullsized":"2023-11-28T20:39:00.378106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528018+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:38:24.528018+0000","last_peered":"2023-11-28T20:38:24.528018+0000","last_clean":"2023-11-28T20:38:24.528018+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:38:24.528018+0000","last_undegraded":"2023-11-28T20:38:24.528018+0000","last_fullsized":"2023-11-28T20:38:24.528018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.577200+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:38:45.577200+0000","last_peered":"2023-11-28T20:38:45.577200+0000","last_clean":"2023-11-28T20:38:45.577200+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:38:45.577200+0000","last_undegraded":"2023-11-28T20:38:45.577200+0000","last_fullsized":"2023-11-28T20:38:45.577200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377546+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.377546+0000","last_peered":"2023-11-28T20:39:00.377546+0000","last_clean":"2023-11-28T20:39:00.377546+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:39:00.377546+0000","last_undegraded":"2023-11-28T20:39:00.377546+0000","last_fullsized":"2023-11-28T20:39:00.377546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344100+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:38:24.344100+0000","last_peered":"2023-11-28T20:38:24.344100+0000","last_clean":"2023-11-28T20:38:24.344100+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:38:24.344100+0000","last_undegraded":"2023-11-28T20:38:24.344100+0000","last_fullsized":"2023-11-28T20:38:24.344100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.607879+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:38:51.607879+0000","last_peered":"2023-11-28T20:38:51.607879+0000","last_clean":"2023-11-28T20:38:51.607879+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:38:51.607879+0000","last_undegraded":"2023-11-28T20:38:51.607879+0000","last_fullsized":"2023-11-28T20:38:51.607879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.446949+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:38:25.446949+0000","last_peered":"2023-11-28T20:38:25.446949+0000","last_clean":"2023-11-28T20:38:25.446949+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:38:25.446949+0000","last_undegraded":"2023-11-28T20:38:25.446949+0000","last_fullsized":"2023-11-28T20:38:25.446949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527948+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:38:24.527948+0000","last_peered":"2023-11-28T20:38:24.527948+0000","last_clean":"2023-11-28T20:38:24.527948+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:38:24.527948+0000","last_undegraded":"2023-11-28T20:38:24.527948+0000","last_fullsized":"2023-11-28T20:38:24.527948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:58.919852+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:38:58.919852+0000","last_peered":"2023-11-28T20:38:58.919852+0000","last_clean":"2023-11-28T20:38:58.919852+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:38:58.919852+0000","last_undegraded":"2023-11-28T20:38:58.919852+0000","last_fullsized":"2023-11-28T20:38:58.919852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372497+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:39:00.372497+0000","last_peered":"2023-11-28T20:39:00.372497+0000","last_clean":"2023-11-28T20:39:00.372497+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:39:00.372497+0000","last_undegraded":"2023-11-28T20:39:00.372497+0000","last_fullsized":"2023-11-28T20:39:00.372497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":4,"reported_epoch":27,"state":"activating","last_fresh":"2023-11-28T20:39:01.378933+0000","last_change":"2023-11-28T20:39:01.378933+0000","last_active":"2023-11-28T20:39:01.378787+0000","last_peered":"2023-11-28T20:38:24.529908+0000","last_clean":"2023-11-28T20:38:24.529908+0000","last_became_active":"2023-11-28T20:38:19.397231+0000","last_became_peered":"2023-11-28T20:38:19.397231+0000","last_unstale":"2023-11-28T20:39:01.378933+0000","last_undegraded":"2023-11-28T20:39:01.378933+0000","last_fullsized":"2023-11-28T20:39:01.378933+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:55:18.203913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372562+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:39:00.372562+0000","last_peered":"2023-11-28T20:39:00.372562+0000","last_clean":"2023-11-28T20:39:00.372562+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:39:00.372562+0000","last_undegraded":"2023-11-28T20:39:00.372562+0000","last_fullsized":"2023-11-28T20:39:00.372562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.445985+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:38:25.445985+0000","last_peered":"2023-11-28T20:38:25.445985+0000","last_clean":"2023-11-28T20:38:25.445985+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:38:25.445985+0000","last_undegraded":"2023-11-28T20:38:25.445985+0000","last_fullsized":"2023-11-28T20:38:25.445985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344646+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:38:24.344646+0000","last_peered":"2023-11-28T20:38:24.344646+0000","last_clean":"2023-11-28T20:38:24.344646+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:38:24.344646+0000","last_undegraded":"2023-11-28T20:38:24.344646+0000","last_fullsized":"2023-11-28T20:38:24.344646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.573108+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:38:45.573108+0000","last_peered":"2023-11-28T20:38:45.573108+0000","last_clean":"2023-11-28T20:38:45.573108+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:38:45.573108+0000","last_undegraded":"2023-11-28T20:38:45.573108+0000","last_fullsized":"2023-11-28T20:38:45.573108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.386759+0000","last_change":"2023-11-28T20:39:01.386759+0000","last_active":"2023-11-28T20:39:01.386759+0000","last_peered":"2023-11-28T20:39:01.386759+0000","last_clean":"2023-11-28T20:39:01.386759+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T20:39:01.386759+0000","last_undegraded":"2023-11-28T20:39:01.386759+0000","last_fullsized":"2023-11-28T20:39:01.386759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:57:45.861105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350686+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:38:24.350686+0000","last_peered":"2023-11-28T20:38:24.350686+0000","last_clean":"2023-11-28T20:38:24.350686+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:38:24.350686+0000","last_undegraded":"2023-11-28T20:38:24.350686+0000","last_fullsized":"2023-11-28T20:38:24.350686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.574006+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:38:45.574006+0000","last_peered":"2023-11-28T20:38:45.574006+0000","last_clean":"2023-11-28T20:38:45.574006+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:38:45.574006+0000","last_undegraded":"2023-11-28T20:38:45.574006+0000","last_fullsized":"2023-11-28T20:38:45.574006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376894+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:39:00.376894+0000","last_peered":"2023-11-28T20:39:00.376894+0000","last_clean":"2023-11-28T20:39:00.376894+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:39:00.376894+0000","last_undegraded":"2023-11-28T20:39:00.376894+0000","last_fullsized":"2023-11-28T20:39:00.376894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.439118+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:38:25.439118+0000","last_peered":"2023-11-28T20:38:25.439118+0000","last_clean":"2023-11-28T20:38:25.439118+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:38:25.439118+0000","last_undegraded":"2023-11-28T20:38:25.439118+0000","last_fullsized":"2023-11-28T20:38:25.439118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372002+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:39:00.372002+0000","last_peered":"2023-11-28T20:39:00.372002+0000","last_clean":"2023-11-28T20:39:00.372002+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:39:00.372002+0000","last_undegraded":"2023-11-28T20:39:00.372002+0000","last_fullsized":"2023-11-28T20:39:00.372002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:45.570975+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:38:45.570975+0000","last_peered":"2023-11-28T20:38:45.570975+0000","last_clean":"2023-11-28T20:38:45.570975+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:38:45.570975+0000","last_undegraded":"2023-11-28T20:38:45.570975+0000","last_fullsized":"2023-11-28T20:38:45.570975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:25.441612+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:38:25.441612+0000","last_peered":"2023-11-28T20:38:25.441612+0000","last_clean":"2023-11-28T20:38:25.441612+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:38:25.441612+0000","last_undegraded":"2023-11-28T20:38:25.441612+0000","last_fullsized":"2023-11-28T20:38:25.441612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377725+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:39:00.377725+0000","last_peered":"2023-11-28T20:39:00.377725+0000","last_clean":"2023-11-28T20:39:00.377725+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:39:00.377725+0000","last_undegraded":"2023-11-28T20:39:00.377725+0000","last_fullsized":"2023-11-28T20:39:00.377725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377196+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:39:00.377196+0000","last_peered":"2023-11-28T20:39:00.377196+0000","last_clean":"2023-11-28T20:39:00.377196+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:39:00.377196+0000","last_undegraded":"2023-11-28T20:39:00.377196+0000","last_fullsized":"2023-11-28T20:39:00.377196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:51.610690+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:38:51.610690+0000","last_peered":"2023-11-28T20:38:51.610690+0000","last_clean":"2023-11-28T20:38:51.610690+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:38:51.610690+0000","last_undegraded":"2023-11-28T20:38:51.610690+0000","last_fullsized":"2023-11-28T20:38:51.610690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344364+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:38:24.344364+0000","last_peered":"2023-11-28T20:38:24.344364+0000","last_clean":"2023-11-28T20:38:24.344364+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:38:24.344364+0000","last_undegraded":"2023-11-28T20:38:24.344364+0000","last_fullsized":"2023-11-28T20:38:24.344364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371112+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:39:00.371112+0000","last_peered":"2023-11-28T20:39:00.371112+0000","last_clean":"2023-11-28T20:39:00.371112+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:39:00.371112+0000","last_undegraded":"2023-11-28T20:39:00.371112+0000","last_fullsized":"2023-11-28T20:39:00.371112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377615+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:39:00.377615+0000","last_peered":"2023-11-28T20:39:00.377615+0000","last_clean":"2023-11-28T20:39:00.377615+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:39:00.377615+0000","last_undegraded":"2023-11-28T20:39:00.377615+0000","last_fullsized":"2023-11-28T20:39:00.377615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529110+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:38:24.529110+0000","last_peered":"2023-11-28T20:38:24.529110+0000","last_clean":"2023-11-28T20:38:24.529110+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:38:24.529110+0000","last_undegraded":"2023-11-28T20:38:24.529110+0000","last_fullsized":"2023-11-28T20:38:24.529110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377999+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:39:00.377999+0000","last_peered":"2023-11-28T20:39:00.377999+0000","last_clean":"2023-11-28T20:39:00.377999+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:39:00.377999+0000","last_undegraded":"2023-11-28T20:39:00.377999+0000","last_fullsized":"2023-11-28T20:39:00.377999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349566+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:38:24.349566+0000","last_peered":"2023-11-28T20:38:24.349566+0000","last_clean":"2023-11-28T20:38:24.349566+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:38:24.349566+0000","last_undegraded":"2023-11-28T20:38:24.349566+0000","last_fullsized":"2023-11-28T20:38:24.349566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370843+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:39:00.370843+0000","last_peered":"2023-11-28T20:39:00.370843+0000","last_clean":"2023-11-28T20:39:00.370843+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:39:00.370843+0000","last_undegraded":"2023-11-28T20:39:00.370843+0000","last_fullsized":"2023-11-28T20:39:00.370843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.349192+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:38:24.349192+0000","last_peered":"2023-11-28T20:38:24.349192+0000","last_clean":"2023-11-28T20:38:24.349192+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:38:24.349192+0000","last_undegraded":"2023-11-28T20:38:24.349192+0000","last_fullsized":"2023-11-28T20:38:24.349192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344288+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:38:24.344288+0000","last_peered":"2023-11-28T20:38:24.344288+0000","last_clean":"2023-11-28T20:38:24.344288+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:38:24.344288+0000","last_undegraded":"2023-11-28T20:38:24.344288+0000","last_fullsized":"2023-11-28T20:38:24.344288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377858+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:39:00.377858+0000","last_peered":"2023-11-28T20:39:00.377858+0000","last_clean":"2023-11-28T20:39:00.377858+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:39:00.377858+0000","last_undegraded":"2023-11-28T20:39:00.377858+0000","last_fullsized":"2023-11-28T20:39:00.377858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372406+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:39:00.372406+0000","last_peered":"2023-11-28T20:39:00.372406+0000","last_clean":"2023-11-28T20:39:00.372406+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:39:00.372406+0000","last_undegraded":"2023-11-28T20:39:00.372406+0000","last_fullsized":"2023-11-28T20:39:00.372406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351931+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:38:24.351931+0000","last_peered":"2023-11-28T20:38:24.351931+0000","last_clean":"2023-11-28T20:38:24.351931+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:38:24.351931+0000","last_undegraded":"2023-11-28T20:38:24.351931+0000","last_fullsized":"2023-11-28T20:38:24.351931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378113+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:39:00.378113+0000","last_peered":"2023-11-28T20:39:00.378113+0000","last_clean":"2023-11-28T20:39:00.378113+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:39:00.378113+0000","last_undegraded":"2023-11-28T20:39:00.378113+0000","last_fullsized":"2023-11-28T20:39:00.378113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348638+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:38:24.348638+0000","last_peered":"2023-11-28T20:38:24.348638+0000","last_clean":"2023-11-28T20:38:24.348638+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:38:24.348638+0000","last_undegraded":"2023-11-28T20:38:24.348638+0000","last_fullsized":"2023-11-28T20:38:24.348638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377083+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:39:00.377083+0000","last_peered":"2023-11-28T20:39:00.377083+0000","last_clean":"2023-11-28T20:39:00.377083+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:39:00.377083+0000","last_undegraded":"2023-11-28T20:39:00.377083+0000","last_fullsized":"2023-11-28T20:39:00.377083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":4,"reported_epoch":27,"state":"activating","last_fresh":"2023-11-28T20:39:01.378773+0000","last_change":"2023-11-28T20:39:01.378773+0000","last_active":"2023-11-28T20:39:01.378606+0000","last_peered":"2023-11-28T20:38:24.349072+0000","last_clean":"2023-11-28T20:38:24.349072+0000","last_became_active":"2023-11-28T20:38:19.390107+0000","last_became_peered":"2023-11-28T20:38:19.390107+0000","last_unstale":"2023-11-28T20:39:01.378773+0000","last_undegraded":"2023-11-28T20:39:01.378773+0000","last_fullsized":"2023-11-28T20:39:01.378773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:49.057388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344051+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:38:24.344051+0000","last_peered":"2023-11-28T20:38:24.344051+0000","last_clean":"2023-11-28T20:38:24.344051+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:38:24.344051+0000","last_undegraded":"2023-11-28T20:38:24.344051+0000","last_fullsized":"2023-11-28T20:38:24.344051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351494+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:38:24.351494+0000","last_peered":"2023-11-28T20:38:24.351494+0000","last_clean":"2023-11-28T20:38:24.351494+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:38:24.351494+0000","last_undegraded":"2023-11-28T20:38:24.351494+0000","last_fullsized":"2023-11-28T20:38:24.351494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.528399+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:38:24.528399+0000","last_peered":"2023-11-28T20:38:24.528399+0000","last_clean":"2023-11-28T20:38:24.528399+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:38:24.528399+0000","last_undegraded":"2023-11-28T20:38:24.528399+0000","last_fullsized":"2023-11-28T20:38:24.528399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371437+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:39:00.371437+0000","last_peered":"2023-11-28T20:39:00.371437+0000","last_clean":"2023-11-28T20:39:00.371437+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:39:00.371437+0000","last_undegraded":"2023-11-28T20:39:00.371437+0000","last_fullsized":"2023-11-28T20:39:00.371437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351592+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:38:24.351592+0000","last_peered":"2023-11-28T20:38:24.351592+0000","last_clean":"2023-11-28T20:38:24.351592+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:38:24.351592+0000","last_undegraded":"2023-11-28T20:38:24.351592+0000","last_fullsized":"2023-11-28T20:38:24.351592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348427+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:38:24.348427+0000","last_peered":"2023-11-28T20:38:24.348427+0000","last_clean":"2023-11-28T20:38:24.348427+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:38:24.348427+0000","last_undegraded":"2023-11-28T20:38:24.348427+0000","last_fullsized":"2023-11-28T20:38:24.348427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371998+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:39:00.371998+0000","last_peered":"2023-11-28T20:39:00.371998+0000","last_clean":"2023-11-28T20:39:00.371998+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:39:00.371998+0000","last_undegraded":"2023-11-28T20:39:00.371998+0000","last_fullsized":"2023-11-28T20:39:00.371998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344015+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:38:24.344015+0000","last_peered":"2023-11-28T20:38:24.344015+0000","last_clean":"2023-11-28T20:38:24.344015+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:38:24.344015+0000","last_undegraded":"2023-11-28T20:38:24.344015+0000","last_fullsized":"2023-11-28T20:38:24.344015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377458+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:39:00.377458+0000","last_peered":"2023-11-28T20:39:00.377458+0000","last_clean":"2023-11-28T20:39:00.377458+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:39:00.377458+0000","last_undegraded":"2023-11-28T20:39:00.377458+0000","last_fullsized":"2023-11-28T20:39:00.377458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.529932+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:38:24.529932+0000","last_peered":"2023-11-28T20:38:24.529932+0000","last_clean":"2023-11-28T20:38:24.529932+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:38:24.529932+0000","last_undegraded":"2023-11-28T20:38:24.529932+0000","last_fullsized":"2023-11-28T20:38:24.529932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.351455+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:38:24.351455+0000","last_peered":"2023-11-28T20:38:24.351455+0000","last_clean":"2023-11-28T20:38:24.351455+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:38:24.351455+0000","last_undegraded":"2023-11-28T20:38:24.351455+0000","last_fullsized":"2023-11-28T20:38:24.351455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"peering","last_fresh":"2023-11-28T20:38:24.351828+0000","last_change":"2023-11-28T20:39:00.374712+0000","last_active":"2023-11-28T20:39:00.374712+0000","last_peered":"2023-11-28T20:38:24.351828+0000","last_clean":"2023-11-28T20:38:24.351828+0000","last_became_active":"2023-11-28T20:38:19.398797+0000","last_became_peered":"2023-11-28T20:38:19.398797+0000","last_unstale":"2023-11-28T20:38:24.351828+0000","last_undegraded":"2023-11-28T20:38:24.351828+0000","last_fullsized":"2023-11-28T20:38:24.351828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530905+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:38:24.530905+0000","last_peered":"2023-11-28T20:38:24.530905+0000","last_clean":"2023-11-28T20:38:24.530905+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:38:24.530905+0000","last_undegraded":"2023-11-28T20:38:24.530905+0000","last_fullsized":"2023-11-28T20:38:24.530905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377589+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:39:00.377589+0000","last_peered":"2023-11-28T20:39:00.377589+0000","last_clean":"2023-11-28T20:39:00.377589+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:39:00.377589+0000","last_undegraded":"2023-11-28T20:39:00.377589+0000","last_fullsized":"2023-11-28T20:39:00.377589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527751+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:38:24.527751+0000","last_peered":"2023-11-28T20:38:24.527751+0000","last_clean":"2023-11-28T20:38:24.527751+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:38:24.527751+0000","last_undegraded":"2023-11-28T20:38:24.527751+0000","last_fullsized":"2023-11-28T20:38:24.527751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.348972+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:38:24.348972+0000","last_peered":"2023-11-28T20:38:24.348972+0000","last_clean":"2023-11-28T20:38:24.348972+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:38:24.348972+0000","last_undegraded":"2023-11-28T20:38:24.348972+0000","last_fullsized":"2023-11-28T20:38:24.348972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.527847+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:38:24.527847+0000","last_peered":"2023-11-28T20:38:24.527847+0000","last_clean":"2023-11-28T20:38:24.527847+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:38:24.527847+0000","last_undegraded":"2023-11-28T20:38:24.527847+0000","last_fullsized":"2023-11-28T20:38:24.527847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.350257+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:38:24.350257+0000","last_peered":"2023-11-28T20:38:24.350257+0000","last_clean":"2023-11-28T20:38:24.350257+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:38:24.350257+0000","last_undegraded":"2023-11-28T20:38:24.350257+0000","last_fullsized":"2023-11-28T20:38:24.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.344441+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:38:24.344441+0000","last_peered":"2023-11-28T20:38:24.344441+0000","last_clean":"2023-11-28T20:38:24.344441+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:38:24.344441+0000","last_undegraded":"2023-11-28T20:38:24.344441+0000","last_fullsized":"2023-11-28T20:38:24.344441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373007+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:39:00.373007+0000","last_peered":"2023-11-28T20:39:00.373007+0000","last_clean":"2023-11-28T20:39:00.373007+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:39:00.373007+0000","last_undegraded":"2023-11-28T20:39:00.373007+0000","last_fullsized":"2023-11-28T20:39:00.373007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-11-28T20:38:24.530439+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:38:24.530439+0000","last_peered":"2023-11-28T20:38:24.530439+0000","last_clean":"2023-11-28T20:38:24.530439+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:38:24.530439+0000","last_undegraded":"2023-11-28T20:38:24.530439+0000","last_fullsized":"2023-11-28T20:38:24.530439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7705,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":120801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":109909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":693709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":106798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":103403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":693053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:39:10.434 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T20:39:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5eaebf5640 1 Processor -- start 2023-11-28T20:39:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5eaebf5640 1 -- start start 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5eaebf5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ea80cfc40 0x7f5ea80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5eaebf5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5ea8153ae0 0x7f5ea8153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5eaebf5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea815ac00 con 0x7f5ea80cf860 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5eaebf5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea80cbd60 con 0x7f5ea80cfc40 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5eaebf5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea8159ff0 con 0x7f5ea8153ae0 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5e9ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ea80cfc40 0x7f5ea80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5eac991640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f5ea80cf860 0x7f5ea80ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51716/0 (socket says 172.21.15.167:51716) 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5eac991640 1 -- 172.21.15.167:0/3261560341 learned_addr learned my addr 172.21.15.167:0/3261560341 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5ead192640 1 --2- 172.21.15.167:0/3261560341 >> v2:172.21.15.178:3300/0 conn(0x7f5ea8153ae0 0x7f5ea8153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5e9ffff640 1 -- 172.21.15.167:0/3261560341 >> v2:172.21.15.178:3300/0 conn(0x7f5ea8153ae0 msgr2=0x7f5ea8153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5e9ffff640 1 --2- 172.21.15.167:0/3261560341 >> v2:172.21.15.178:3300/0 conn(0x7f5ea8153ae0 0x7f5ea8153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5e9ffff640 1 -- 172.21.15.167:0/3261560341 >> v1:172.21.15.167:6789/0 conn(0x7f5ea80cf860 legacy=0x7f5ea80ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.580+0000 7f5e9ffff640 1 -- 172.21.15.167:0/3261560341 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea815a2d0 con 0x7f5ea80cfc40 2023-11-28T20:39:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5e9ffff640 1 --2- 172.21.15.167:0/3261560341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cfc40 0x7f5ea80cb770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80b2240 tx=0x7f5e9801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1f52077e0b4ffb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5e9f7fe640 1 -- 172.21.15.167:0/3261560341 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980ab660 con 0x7f5ea80cfc40 2023-11-28T20:39:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5e9f7fe640 1 -- 172.21.15.167:0/3261560341 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e980ab7c0 con 0x7f5ea80cfc40 2023-11-28T20:39:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5e9f7fe640 1 -- 172.21.15.167:0/3261560341 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980abb50 con 0x7f5ea80cfc40 2023-11-28T20:39:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5eaebf5640 1 -- 172.21.15.167:0/3261560341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cfc40 msgr2=0x7f5ea80cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5eaebf5640 1 --2- 172.21.15.167:0/3261560341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cfc40 0x7f5ea80cb770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80b2240 tx=0x7f5e9801c460 comp rx=0 tx=0).stop 2023-11-28T20:39:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5eaebf5640 1 -- 172.21.15.167:0/3261560341 shutdown_connections 2023-11-28T20:39:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5eaebf5640 1 --2- 172.21.15.167:0/3261560341 >> v2:172.21.15.178:3300/0 conn(0x7f5ea8153ae0 0x7f5ea8153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5eaebf5640 1 --2- 172.21.15.167:0/3261560341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cfc40 0x7f5ea80cb770 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5eaebf5640 1 -- 172.21.15.167:0/3261560341 >> 172.21.15.167:0/3261560341 conn(0x7f5ea806c1f0 msgr2=0x7f5ea8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5eaebf5640 1 -- 172.21.15.167:0/3261560341 shutdown_connections 2023-11-28T20:39:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.584+0000 7f5eaebf5640 1 -- 172.21.15.167:0/3261560341 wait complete. 2023-11-28T20:39:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 Processor -- start 2023-11-28T20:39:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 -- start start 2023-11-28T20:39:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cf860 0x7f5ea8154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80cfc40 0x7f5ea81557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8153ae0 0x7f5ea80b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea81f2830 con 0x7f5ea80cf860 2023-11-28T20:39:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea81f37e0 con 0x7f5ea8153ae0 2023-11-28T20:39:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80b37e0 con 0x7f5ea80cfc40 2023-11-28T20:39:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eac991640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cf860 0x7f5ea8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eac991640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cf860 0x7f5ea8154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33472/0 (socket says 172.21.15.167:33472) 2023-11-28T20:39:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eac991640 1 -- 172.21.15.167:0/65734882 learned_addr learned my addr 172.21.15.167:0/65734882 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5e9ffff640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80cfc40 0x7f5ea81557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5ead192640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8153ae0 0x7f5ea80b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eac991640 1 -- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80cfc40 msgr2=0x7f5ea81557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eac991640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80cfc40 0x7f5ea81557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eac991640 1 -- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8153ae0 msgr2=0x7f5ea80b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eac991640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8153ae0 0x7f5ea80b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eac991640 1 -- 172.21.15.167:0/65734882 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98009420 con 0x7f5ea80cf860 2023-11-28T20:39:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eac991640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cf860 0x7f5ea8154810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400c430 tx=0x7f5ea400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5e9d7fa640 1 -- 172.21.15.167:0/65734882 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4005cf0 con 0x7f5ea80cf860 2023-11-28T20:39:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5e9d7fa640 1 -- 172.21.15.167:0/65734882 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea4005e50 con 0x7f5ea80cf860 2023-11-28T20:39:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea81f2a20 con 0x7f5ea80cf860 2023-11-28T20:39:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5e9d7fa640 1 -- 172.21.15.167:0/65734882 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40072d0 con 0x7f5ea80cf860 2023-11-28T20:39:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.588+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea81f2fe0 con 0x7f5ea80cf860 2023-11-28T20:39:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.592+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea8075c90 con 0x7f5ea80cf860 2023-11-28T20:39:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.592+0000 7f5e9d7fa640 1 -- 172.21.15.167:0/65734882 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ea4007430 con 0x7f5ea80cf860 2023-11-28T20:39:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.592+0000 7f5e9d7fa640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e94066470 0x7f5e94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.592+0000 7f5e9d7fa640 1 -- 172.21.15.167:0/65734882 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ea4083760 con 0x7f5ea80cf860 2023-11-28T20:39:10.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.592+0000 7f5e9ffff640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e94066470 0x7f5e94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.592+0000 7f5e9ffff640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e94066470 0x7f5e94068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e980af000 tx=0x7f5e980a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:10.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.596+0000 7f5e9d7fa640 1 -- 172.21.15.167:0/65734882 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ea4050830 con 0x7f5ea80cf860 2023-11-28T20:39:10.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.744+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ea80c9fd0 con 0x7f5e94066470 2023-11-28T20:39:10.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.768+0000 7f5e9d7fa640 1 -- 172.21.15.167:0/65734882 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353282 (secure 0 0 0) 0x7f5ea80c9fd0 con 0x7f5e94066470 2023-11-28T20:39:10.776 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:10.778 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T20:39:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e94066470 msgr2=0x7f5e94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e94066470 0x7f5e94068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e980af000 tx=0x7f5e980a7000 comp rx=0 tx=0).stop 2023-11-28T20:39:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cf860 msgr2=0x7f5ea8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cf860 0x7f5ea8154810 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400c430 tx=0x7f5ea400c8f0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 shutdown_connections 2023-11-28T20:39:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e94066470 0x7f5e94068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8153ae0 0x7f5ea80b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80cfc40 0x7f5ea81557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 --2- 172.21.15.167:0/65734882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80cf860 0x7f5ea8154810 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 >> 172.21.15.167:0/65734882 conn(0x7f5ea806c1f0 msgr2=0x7f5ea80cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:10.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 shutdown_connections 2023-11-28T20:39:10.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.772+0000 7f5eaebf5640 1 -- 172.21.15.167:0/65734882 wait complete. 2023-11-28T20:39:10.796 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-11-28T20:39:09.448047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598073,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":289,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236340,"kb_used_data":3528,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738380,"statfs":{"total":773094113280,"available":772852101120,"internally_reserved":0,"allocated":3612672,"data_stored":2124098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":254,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.082649"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374282+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T20:39:00.374282+0000","last_peered":"2023-11-28T20:39:00.374282+0000","last_clean":"2023-11-28T20:39:00.374282+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T20:39:00.374282+0000","last_undegraded":"2023-11-28T20:39:00.374282+0000","last_fullsized":"2023-11-28T20:39:00.374282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.390144+0000","last_change":"2023-11-28T20:39:01.387644+0000","last_active":"2023-11-28T20:39:01.390144+0000","last_peered":"2023-11-28T20:39:01.390144+0000","last_clean":"2023-11-28T20:39:01.390144+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T20:39:01.390144+0000","last_undegraded":"2023-11-28T20:39:01.390144+0000","last_fullsized":"2023-11-28T20:39:01.390144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:52.977080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376803+0000","last_change":"2023-11-28T20:38:23.779378+0000","last_active":"2023-11-28T20:39:00.376803+0000","last_peered":"2023-11-28T20:39:00.376803+0000","last_clean":"2023-11-28T20:39:00.376803+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T20:39:00.376803+0000","last_undegraded":"2023-11-28T20:39:00.376803+0000","last_fullsized":"2023-11-28T20:39:00.376803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:31:21.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378262+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T20:39:00.378262+0000","last_peered":"2023-11-28T20:39:00.378262+0000","last_clean":"2023-11-28T20:39:00.378262+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T20:39:00.378262+0000","last_undegraded":"2023-11-28T20:39:00.378262+0000","last_fullsized":"2023-11-28T20:39:00.378262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374018+0000","last_change":"2023-11-28T20:38:19.385808+0000","last_active":"2023-11-28T20:39:00.374018+0000","last_peered":"2023-11-28T20:39:00.374018+0000","last_clean":"2023-11-28T20:39:00.374018+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T20:39:00.374018+0000","last_undegraded":"2023-11-28T20:39:00.374018+0000","last_fullsized":"2023-11-28T20:39:00.374018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:12.040002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.391569+0000","last_change":"2023-11-28T20:39:01.391569+0000","last_active":"2023-11-28T20:39:01.391569+0000","last_peered":"2023-11-28T20:39:01.391569+0000","last_clean":"2023-11-28T20:39:01.391569+0000","last_became_active":"2023-11-28T20:39:01.389891+0000","last_became_peered":"2023-11-28T20:39:01.389891+0000","last_unstale":"2023-11-28T20:39:01.391569+0000","last_undegraded":"2023-11-28T20:39:01.391569+0000","last_fullsized":"2023-11-28T20:39:01.391569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:15:55.147293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.384019+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T20:39:00.384019+0000","last_peered":"2023-11-28T20:39:00.384019+0000","last_clean":"2023-11-28T20:39:00.384019+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T20:39:00.384019+0000","last_undegraded":"2023-11-28T20:39:00.384019+0000","last_fullsized":"2023-11-28T20:39:00.384019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378137+0000","last_change":"2023-11-28T20:38:19.404234+0000","last_active":"2023-11-28T20:39:00.378137+0000","last_peered":"2023-11-28T20:39:00.378137+0000","last_clean":"2023-11-28T20:39:00.378137+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T20:39:00.378137+0000","last_undegraded":"2023-11-28T20:39:00.378137+0000","last_fullsized":"2023-11-28T20:39:00.378137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:06.035952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371802+0000","last_change":"2023-11-28T20:38:23.599714+0000","last_active":"2023-11-28T20:39:00.371802+0000","last_peered":"2023-11-28T20:39:00.371802+0000","last_clean":"2023-11-28T20:39:00.371802+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T20:39:00.371802+0000","last_undegraded":"2023-11-28T20:39:00.371802+0000","last_fullsized":"2023-11-28T20:39:00.371802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:43.787397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.383204+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T20:39:00.383204+0000","last_peered":"2023-11-28T20:39:00.383204+0000","last_clean":"2023-11-28T20:39:00.383204+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T20:39:00.383204+0000","last_undegraded":"2023-11-28T20:39:00.383204+0000","last_fullsized":"2023-11-28T20:39:00.383204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378169+0000","last_change":"2023-11-28T20:38:19.380155+0000","last_active":"2023-11-28T20:39:00.378169+0000","last_peered":"2023-11-28T20:39:00.378169+0000","last_clean":"2023-11-28T20:39:00.378169+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T20:39:00.378169+0000","last_undegraded":"2023-11-28T20:39:00.378169+0000","last_fullsized":"2023-11-28T20:39:00.378169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:28:20.523594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.368997+0000","last_change":"2023-11-28T20:38:23.602940+0000","last_active":"2023-11-28T20:39:00.368997+0000","last_peered":"2023-11-28T20:39:00.368997+0000","last_clean":"2023-11-28T20:39:00.368997+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T20:39:00.368997+0000","last_undegraded":"2023-11-28T20:39:00.368997+0000","last_fullsized":"2023-11-28T20:39:00.368997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:54.787239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371963+0000","last_change":"2023-11-28T20:38:19.400265+0000","last_active":"2023-11-28T20:39:00.371963+0000","last_peered":"2023-11-28T20:39:00.371963+0000","last_clean":"2023-11-28T20:39:00.371963+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T20:39:00.371963+0000","last_undegraded":"2023-11-28T20:39:00.371963+0000","last_fullsized":"2023-11-28T20:39:00.371963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:47.409716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.382723+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T20:39:00.382723+0000","last_peered":"2023-11-28T20:39:00.382723+0000","last_clean":"2023-11-28T20:39:00.382723+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T20:39:00.382723+0000","last_undegraded":"2023-11-28T20:39:00.382723+0000","last_fullsized":"2023-11-28T20:39:00.382723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.367133+0000","last_change":"2023-11-28T20:38:23.602858+0000","last_active":"2023-11-28T20:39:00.367133+0000","last_peered":"2023-11-28T20:39:00.367133+0000","last_clean":"2023-11-28T20:39:00.367133+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T20:39:00.367133+0000","last_undegraded":"2023-11-28T20:39:00.367133+0000","last_fullsized":"2023-11-28T20:39:00.367133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:50:34.096607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377543+0000","last_change":"2023-11-28T20:38:19.355528+0000","last_active":"2023-11-28T20:39:00.377543+0000","last_peered":"2023-11-28T20:39:00.377543+0000","last_clean":"2023-11-28T20:39:00.377543+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T20:39:00.377543+0000","last_undegraded":"2023-11-28T20:39:00.377543+0000","last_fullsized":"2023-11-28T20:39:00.377543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:04:12.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372769+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T20:39:00.372769+0000","last_peered":"2023-11-28T20:39:00.372769+0000","last_clean":"2023-11-28T20:39:00.372769+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T20:39:00.372769+0000","last_undegraded":"2023-11-28T20:39:00.372769+0000","last_fullsized":"2023-11-28T20:39:00.372769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.366328+0000","last_change":"2023-11-28T20:38:23.599381+0000","last_active":"2023-11-28T20:39:00.366328+0000","last_peered":"2023-11-28T20:39:00.366328+0000","last_clean":"2023-11-28T20:39:00.366328+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T20:39:00.366328+0000","last_undegraded":"2023-11-28T20:39:00.366328+0000","last_fullsized":"2023-11-28T20:39:00.366328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:05.504313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377798+0000","last_change":"2023-11-28T20:38:19.353590+0000","last_active":"2023-11-28T20:39:00.377798+0000","last_peered":"2023-11-28T20:39:00.377798+0000","last_clean":"2023-11-28T20:39:00.377798+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T20:39:00.377798+0000","last_undegraded":"2023-11-28T20:39:00.377798+0000","last_fullsized":"2023-11-28T20:39:00.377798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:43:20.115228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372086+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T20:39:00.372086+0000","last_peered":"2023-11-28T20:39:00.372086+0000","last_clean":"2023-11-28T20:39:00.372086+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T20:39:00.372086+0000","last_undegraded":"2023-11-28T20:39:00.372086+0000","last_fullsized":"2023-11-28T20:39:00.372086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373087+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.373087+0000","last_peered":"2023-11-28T20:39:00.373087+0000","last_clean":"2023-11-28T20:39:00.373087+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T20:39:00.373087+0000","last_undegraded":"2023-11-28T20:39:00.373087+0000","last_fullsized":"2023-11-28T20:39:00.373087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:13.760532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370496+0000","last_change":"2023-11-28T20:38:19.398548+0000","last_active":"2023-11-28T20:39:00.370496+0000","last_peered":"2023-11-28T20:39:00.370496+0000","last_clean":"2023-11-28T20:39:00.370496+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T20:39:00.370496+0000","last_undegraded":"2023-11-28T20:39:00.370496+0000","last_fullsized":"2023-11-28T20:39:00.370496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:52.540901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.381155+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T20:39:00.381155+0000","last_peered":"2023-11-28T20:39:00.381155+0000","last_clean":"2023-11-28T20:39:00.381155+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T20:39:00.381155+0000","last_undegraded":"2023-11-28T20:39:00.381155+0000","last_fullsized":"2023-11-28T20:39:00.381155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.367766+0000","last_change":"2023-11-28T20:38:23.600661+0000","last_active":"2023-11-28T20:39:00.367766+0000","last_peered":"2023-11-28T20:39:00.367766+0000","last_clean":"2023-11-28T20:39:00.367766+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T20:39:00.367766+0000","last_undegraded":"2023-11-28T20:39:00.367766+0000","last_fullsized":"2023-11-28T20:39:00.367766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:40.952987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374485+0000","last_change":"2023-11-28T20:38:19.363357+0000","last_active":"2023-11-28T20:39:00.374485+0000","last_peered":"2023-11-28T20:39:00.374485+0000","last_clean":"2023-11-28T20:39:00.374485+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T20:39:00.374485+0000","last_undegraded":"2023-11-28T20:39:00.374485+0000","last_fullsized":"2023-11-28T20:39:00.374485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:51.434359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374118+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T20:39:00.374118+0000","last_peered":"2023-11-28T20:39:00.374118+0000","last_clean":"2023-11-28T20:39:00.374118+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T20:39:00.374118+0000","last_undegraded":"2023-11-28T20:39:00.374118+0000","last_fullsized":"2023-11-28T20:39:00.374118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370062+0000","last_change":"2023-11-28T20:38:23.779995+0000","last_active":"2023-11-28T20:39:00.370062+0000","last_peered":"2023-11-28T20:39:00.370062+0000","last_clean":"2023-11-28T20:39:00.370062+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T20:39:00.370062+0000","last_undegraded":"2023-11-28T20:39:00.370062+0000","last_fullsized":"2023-11-28T20:39:00.370062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:45.434126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378189+0000","last_change":"2023-11-28T20:38:19.389745+0000","last_active":"2023-11-28T20:39:00.378189+0000","last_peered":"2023-11-28T20:39:00.378189+0000","last_clean":"2023-11-28T20:39:00.378189+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T20:39:00.378189+0000","last_undegraded":"2023-11-28T20:39:00.378189+0000","last_fullsized":"2023-11-28T20:39:00.378189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:59.995805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373110+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T20:39:00.373110+0000","last_peered":"2023-11-28T20:39:00.373110+0000","last_clean":"2023-11-28T20:39:00.373110+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T20:39:00.373110+0000","last_undegraded":"2023-11-28T20:39:00.373110+0000","last_fullsized":"2023-11-28T20:39:00.373110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377445+0000","last_change":"2023-11-28T20:38:23.778204+0000","last_active":"2023-11-28T20:39:00.377445+0000","last_peered":"2023-11-28T20:39:00.377445+0000","last_clean":"2023-11-28T20:39:00.377445+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T20:39:00.377445+0000","last_undegraded":"2023-11-28T20:39:00.377445+0000","last_fullsized":"2023-11-28T20:39:00.377445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:19:03.215743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372844+0000","last_change":"2023-11-28T20:38:19.354070+0000","last_active":"2023-11-28T20:39:00.372844+0000","last_peered":"2023-11-28T20:39:00.372844+0000","last_clean":"2023-11-28T20:39:00.372844+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T20:39:00.372844+0000","last_undegraded":"2023-11-28T20:39:00.372844+0000","last_fullsized":"2023-11-28T20:39:00.372844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:30.089318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.384254+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T20:39:00.384254+0000","last_peered":"2023-11-28T20:39:00.384254+0000","last_clean":"2023-11-28T20:39:00.384254+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T20:39:00.384254+0000","last_undegraded":"2023-11-28T20:39:00.384254+0000","last_fullsized":"2023-11-28T20:39:00.384254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374191+0000","last_change":"2023-11-28T20:38:23.774255+0000","last_active":"2023-11-28T20:39:00.374191+0000","last_peered":"2023-11-28T20:39:00.374191+0000","last_clean":"2023-11-28T20:39:00.374191+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T20:39:00.374191+0000","last_undegraded":"2023-11-28T20:39:00.374191+0000","last_fullsized":"2023-11-28T20:39:00.374191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:35:07.519989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378355+0000","last_change":"2023-11-28T20:38:19.365306+0000","last_active":"2023-11-28T20:39:00.378355+0000","last_peered":"2023-11-28T20:39:00.378355+0000","last_clean":"2023-11-28T20:39:00.378355+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T20:39:00.378355+0000","last_undegraded":"2023-11-28T20:39:00.378355+0000","last_fullsized":"2023-11-28T20:39:00.378355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:56.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372929+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T20:39:00.372929+0000","last_peered":"2023-11-28T20:39:00.372929+0000","last_clean":"2023-11-28T20:39:00.372929+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T20:39:00.372929+0000","last_undegraded":"2023-11-28T20:39:00.372929+0000","last_fullsized":"2023-11-28T20:39:00.372929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.571444+0000","last_change":"2023-11-28T20:39:01.571444+0000","last_active":"2023-11-28T20:39:01.571444+0000","last_peered":"2023-11-28T20:39:01.571444+0000","last_clean":"2023-11-28T20:39:01.571444+0000","last_became_active":"2023-11-28T20:39:01.570987+0000","last_became_peered":"2023-11-28T20:39:01.570987+0000","last_unstale":"2023-11-28T20:39:01.571444+0000","last_undegraded":"2023-11-28T20:39:01.571444+0000","last_fullsized":"2023-11-28T20:39:01.571444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:50:13.565586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.367307+0000","last_change":"2023-11-28T20:38:19.398085+0000","last_active":"2023-11-28T20:39:00.367307+0000","last_peered":"2023-11-28T20:39:00.367307+0000","last_clean":"2023-11-28T20:39:00.367307+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T20:39:00.367307+0000","last_undegraded":"2023-11-28T20:39:00.367307+0000","last_fullsized":"2023-11-28T20:39:00.367307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:00.706907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.375563+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T20:39:00.375563+0000","last_peered":"2023-11-28T20:39:00.375563+0000","last_clean":"2023-11-28T20:39:00.375563+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T20:39:00.375563+0000","last_undegraded":"2023-11-28T20:39:00.375563+0000","last_fullsized":"2023-11-28T20:39:00.375563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372765+0000","last_change":"2023-11-28T20:38:23.584554+0000","last_active":"2023-11-28T20:39:00.372765+0000","last_peered":"2023-11-28T20:39:00.372765+0000","last_clean":"2023-11-28T20:39:00.372765+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T20:39:00.372765+0000","last_undegraded":"2023-11-28T20:39:00.372765+0000","last_fullsized":"2023-11-28T20:39:00.372765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:33.288056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373168+0000","last_change":"2023-11-28T20:38:19.354028+0000","last_active":"2023-11-28T20:39:00.373168+0000","last_peered":"2023-11-28T20:39:00.373168+0000","last_clean":"2023-11-28T20:39:00.373168+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T20:39:00.373168+0000","last_undegraded":"2023-11-28T20:39:00.373168+0000","last_fullsized":"2023-11-28T20:39:00.373168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:26.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370832+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T20:39:00.370832+0000","last_peered":"2023-11-28T20:39:00.370832+0000","last_clean":"2023-11-28T20:39:00.370832+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T20:39:00.370832+0000","last_undegraded":"2023-11-28T20:39:00.370832+0000","last_fullsized":"2023-11-28T20:39:00.370832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373409+0000","last_change":"2023-11-28T20:38:23.588346+0000","last_active":"2023-11-28T20:39:00.373409+0000","last_peered":"2023-11-28T20:39:00.373409+0000","last_clean":"2023-11-28T20:39:00.373409+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T20:39:00.373409+0000","last_undegraded":"2023-11-28T20:39:00.373409+0000","last_fullsized":"2023-11-28T20:39:00.373409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:18.060574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373864+0000","last_change":"2023-11-28T20:38:19.398584+0000","last_active":"2023-11-28T20:39:00.373864+0000","last_peered":"2023-11-28T20:39:00.373864+0000","last_clean":"2023-11-28T20:39:00.373864+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T20:39:00.373864+0000","last_undegraded":"2023-11-28T20:39:00.373864+0000","last_fullsized":"2023-11-28T20:39:00.373864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:41:57.301840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.381403+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T20:39:00.381403+0000","last_peered":"2023-11-28T20:39:00.381403+0000","last_clean":"2023-11-28T20:39:00.381403+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T20:39:00.381403+0000","last_undegraded":"2023-11-28T20:39:00.381403+0000","last_fullsized":"2023-11-28T20:39:00.381403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374306+0000","last_change":"2023-11-28T20:38:23.774035+0000","last_active":"2023-11-28T20:39:00.374306+0000","last_peered":"2023-11-28T20:39:00.374306+0000","last_clean":"2023-11-28T20:39:00.374306+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T20:39:00.374306+0000","last_undegraded":"2023-11-28T20:39:00.374306+0000","last_fullsized":"2023-11-28T20:39:00.374306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:47.941783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376856+0000","last_change":"2023-11-28T20:38:19.379281+0000","last_active":"2023-11-28T20:39:00.376856+0000","last_peered":"2023-11-28T20:39:00.376856+0000","last_clean":"2023-11-28T20:39:00.376856+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T20:39:00.376856+0000","last_undegraded":"2023-11-28T20:39:00.376856+0000","last_fullsized":"2023-11-28T20:39:00.376856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:14:18.159142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377157+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T20:39:00.377157+0000","last_peered":"2023-11-28T20:39:00.377157+0000","last_clean":"2023-11-28T20:39:00.377157+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T20:39:00.377157+0000","last_undegraded":"2023-11-28T20:39:00.377157+0000","last_fullsized":"2023-11-28T20:39:00.377157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.381649+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T20:39:00.381649+0000","last_peered":"2023-11-28T20:39:00.381649+0000","last_clean":"2023-11-28T20:39:00.381649+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T20:39:00.381649+0000","last_undegraded":"2023-11-28T20:39:00.381649+0000","last_fullsized":"2023-11-28T20:39:00.381649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372728+0000","last_change":"2023-11-28T20:38:23.781134+0000","last_active":"2023-11-28T20:39:00.372728+0000","last_peered":"2023-11-28T20:39:00.372728+0000","last_clean":"2023-11-28T20:39:00.372728+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T20:39:00.372728+0000","last_undegraded":"2023-11-28T20:39:00.372728+0000","last_fullsized":"2023-11-28T20:39:00.372728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:29.069735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.383612+0000","last_change":"2023-11-28T20:38:19.400036+0000","last_active":"2023-11-28T20:39:00.383612+0000","last_peered":"2023-11-28T20:39:00.383612+0000","last_clean":"2023-11-28T20:39:00.383612+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T20:39:00.383612+0000","last_undegraded":"2023-11-28T20:39:00.383612+0000","last_fullsized":"2023-11-28T20:39:00.383612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:01:57.310763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371241+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T20:39:00.371241+0000","last_peered":"2023-11-28T20:39:00.371241+0000","last_clean":"2023-11-28T20:39:00.371241+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T20:39:00.371241+0000","last_undegraded":"2023-11-28T20:39:00.371241+0000","last_fullsized":"2023-11-28T20:39:00.371241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371738+0000","last_change":"2023-11-28T20:38:23.775724+0000","last_active":"2023-11-28T20:39:00.371738+0000","last_peered":"2023-11-28T20:39:00.371738+0000","last_clean":"2023-11-28T20:39:00.371738+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T20:39:00.371738+0000","last_undegraded":"2023-11-28T20:39:00.371738+0000","last_fullsized":"2023-11-28T20:39:00.371738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:26.703457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378331+0000","last_change":"2023-11-28T20:38:19.365293+0000","last_active":"2023-11-28T20:39:00.378331+0000","last_peered":"2023-11-28T20:39:00.378331+0000","last_clean":"2023-11-28T20:39:00.378331+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T20:39:00.378331+0000","last_undegraded":"2023-11-28T20:39:00.378331+0000","last_fullsized":"2023-11-28T20:39:00.378331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:14.283962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372659+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T20:39:00.372659+0000","last_peered":"2023-11-28T20:39:00.372659+0000","last_clean":"2023-11-28T20:39:00.372659+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T20:39:00.372659+0000","last_undegraded":"2023-11-28T20:39:00.372659+0000","last_fullsized":"2023-11-28T20:39:00.372659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374358+0000","last_change":"2023-11-28T20:38:23.591795+0000","last_active":"2023-11-28T20:39:00.374358+0000","last_peered":"2023-11-28T20:39:00.374358+0000","last_clean":"2023-11-28T20:39:00.374358+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T20:39:00.374358+0000","last_undegraded":"2023-11-28T20:39:00.374358+0000","last_fullsized":"2023-11-28T20:39:00.374358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:32:43.089198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.384166+0000","last_change":"2023-11-28T20:38:19.407472+0000","last_active":"2023-11-28T20:39:00.384166+0000","last_peered":"2023-11-28T20:39:00.384166+0000","last_clean":"2023-11-28T20:39:00.384166+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T20:39:00.384166+0000","last_undegraded":"2023-11-28T20:39:00.384166+0000","last_fullsized":"2023-11-28T20:39:00.384166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:00:33.834643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371475+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T20:39:00.371475+0000","last_peered":"2023-11-28T20:39:00.371475+0000","last_clean":"2023-11-28T20:39:00.371475+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T20:39:00.371475+0000","last_undegraded":"2023-11-28T20:39:00.371475+0000","last_fullsized":"2023-11-28T20:39:00.371475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.369934+0000","last_change":"2023-11-28T20:38:23.780181+0000","last_active":"2023-11-28T20:39:00.369934+0000","last_peered":"2023-11-28T20:39:00.369934+0000","last_clean":"2023-11-28T20:39:00.369934+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T20:39:00.369934+0000","last_undegraded":"2023-11-28T20:39:00.369934+0000","last_fullsized":"2023-11-28T20:39:00.369934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:09.493489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.383851+0000","last_change":"2023-11-28T20:38:19.407920+0000","last_active":"2023-11-28T20:39:00.383851+0000","last_peered":"2023-11-28T20:39:00.383851+0000","last_clean":"2023-11-28T20:39:00.383851+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T20:39:00.383851+0000","last_undegraded":"2023-11-28T20:39:00.383851+0000","last_fullsized":"2023-11-28T20:39:00.383851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.742095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.368613+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T20:39:00.368613+0000","last_peered":"2023-11-28T20:39:00.368613+0000","last_clean":"2023-11-28T20:39:00.368613+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T20:39:00.368613+0000","last_undegraded":"2023-11-28T20:39:00.368613+0000","last_fullsized":"2023-11-28T20:39:00.368613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.369793+0000","last_change":"2023-11-28T20:38:23.598926+0000","last_active":"2023-11-28T20:39:00.369793+0000","last_peered":"2023-11-28T20:39:00.369793+0000","last_clean":"2023-11-28T20:39:00.369793+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T20:39:00.369793+0000","last_undegraded":"2023-11-28T20:39:00.369793+0000","last_fullsized":"2023-11-28T20:39:00.369793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:31:54.238520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.382367+0000","last_change":"2023-11-28T20:38:19.407399+0000","last_active":"2023-11-28T20:39:00.382367+0000","last_peered":"2023-11-28T20:39:00.382367+0000","last_clean":"2023-11-28T20:39:00.382367+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T20:39:00.382367+0000","last_undegraded":"2023-11-28T20:39:00.382367+0000","last_fullsized":"2023-11-28T20:39:00.382367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:16:19.466066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370725+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T20:39:00.370725+0000","last_peered":"2023-11-28T20:39:00.370725+0000","last_clean":"2023-11-28T20:39:00.370725+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T20:39:00.370725+0000","last_undegraded":"2023-11-28T20:39:00.370725+0000","last_fullsized":"2023-11-28T20:39:00.370725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374219+0000","last_change":"2023-11-28T20:38:23.585173+0000","last_active":"2023-11-28T20:39:00.374219+0000","last_peered":"2023-11-28T20:39:00.374219+0000","last_clean":"2023-11-28T20:39:00.374219+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T20:39:00.374219+0000","last_undegraded":"2023-11-28T20:39:00.374219+0000","last_fullsized":"2023-11-28T20:39:00.374219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:02:57.707689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374947+0000","last_change":"2023-11-28T20:38:19.377025+0000","last_active":"2023-11-28T20:39:00.374947+0000","last_peered":"2023-11-28T20:39:00.374947+0000","last_clean":"2023-11-28T20:39:00.374947+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T20:39:00.374947+0000","last_undegraded":"2023-11-28T20:39:00.374947+0000","last_fullsized":"2023-11-28T20:39:00.374947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:07.107243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371882+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T20:39:00.371882+0000","last_peered":"2023-11-28T20:39:00.371882+0000","last_clean":"2023-11-28T20:39:00.371882+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T20:39:00.371882+0000","last_undegraded":"2023-11-28T20:39:00.371882+0000","last_fullsized":"2023-11-28T20:39:00.371882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378106+0000","last_change":"2023-11-28T20:38:23.774452+0000","last_active":"2023-11-28T20:39:00.378106+0000","last_peered":"2023-11-28T20:39:00.378106+0000","last_clean":"2023-11-28T20:39:00.378106+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T20:39:00.378106+0000","last_undegraded":"2023-11-28T20:39:00.378106+0000","last_fullsized":"2023-11-28T20:39:00.378106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:02.880642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.382314+0000","last_change":"2023-11-28T20:38:19.402446+0000","last_active":"2023-11-28T20:39:00.382314+0000","last_peered":"2023-11-28T20:39:00.382314+0000","last_clean":"2023-11-28T20:39:00.382314+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T20:39:00.382314+0000","last_undegraded":"2023-11-28T20:39:00.382314+0000","last_fullsized":"2023-11-28T20:39:00.382314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:14.428795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.375295+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T20:39:00.375295+0000","last_peered":"2023-11-28T20:39:00.375295+0000","last_clean":"2023-11-28T20:39:00.375295+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T20:39:00.375295+0000","last_undegraded":"2023-11-28T20:39:00.375295+0000","last_fullsized":"2023-11-28T20:39:00.375295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377546+0000","last_change":"2023-11-28T20:38:23.779386+0000","last_active":"2023-11-28T20:39:00.377546+0000","last_peered":"2023-11-28T20:39:00.377546+0000","last_clean":"2023-11-28T20:39:00.377546+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T20:39:00.377546+0000","last_undegraded":"2023-11-28T20:39:00.377546+0000","last_fullsized":"2023-11-28T20:39:00.377546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:12:03.887294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374396+0000","last_change":"2023-11-28T20:38:19.389604+0000","last_active":"2023-11-28T20:39:00.374396+0000","last_peered":"2023-11-28T20:39:00.374396+0000","last_clean":"2023-11-28T20:39:00.374396+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T20:39:00.374396+0000","last_undegraded":"2023-11-28T20:39:00.374396+0000","last_fullsized":"2023-11-28T20:39:00.374396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:40.599871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374589+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T20:39:00.374589+0000","last_peered":"2023-11-28T20:39:00.374589+0000","last_clean":"2023-11-28T20:39:00.374589+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T20:39:00.374589+0000","last_undegraded":"2023-11-28T20:39:00.374589+0000","last_fullsized":"2023-11-28T20:39:00.374589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377982+0000","last_change":"2023-11-28T20:38:23.780911+0000","last_active":"2023-11-28T20:39:00.377982+0000","last_peered":"2023-11-28T20:39:00.377982+0000","last_clean":"2023-11-28T20:39:00.377982+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T20:39:00.377982+0000","last_undegraded":"2023-11-28T20:39:00.377982+0000","last_fullsized":"2023-11-28T20:39:00.377982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:41.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.383898+0000","last_change":"2023-11-28T20:38:19.395611+0000","last_active":"2023-11-28T20:39:00.383898+0000","last_peered":"2023-11-28T20:39:00.383898+0000","last_clean":"2023-11-28T20:39:00.383898+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T20:39:00.383898+0000","last_undegraded":"2023-11-28T20:39:00.383898+0000","last_fullsized":"2023-11-28T20:39:00.383898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:11.363336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'13","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373250+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T20:39:00.373250+0000","last_peered":"2023-11-28T20:39:00.373250+0000","last_clean":"2023-11-28T20:39:00.373250+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T20:39:00.373250+0000","last_undegraded":"2023-11-28T20:39:00.373250+0000","last_fullsized":"2023-11-28T20:39:00.373250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4095,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372497+0000","last_change":"2023-11-28T20:38:23.595035+0000","last_active":"2023-11-28T20:39:00.372497+0000","last_peered":"2023-11-28T20:39:00.372497+0000","last_clean":"2023-11-28T20:39:00.372497+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T20:39:00.372497+0000","last_undegraded":"2023-11-28T20:39:00.372497+0000","last_fullsized":"2023-11-28T20:39:00.372497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:20.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.848525+0000","last_change":"2023-11-28T20:39:01.848525+0000","last_active":"2023-11-28T20:39:01.848525+0000","last_peered":"2023-11-28T20:39:01.848525+0000","last_clean":"2023-11-28T20:39:01.848525+0000","last_became_active":"2023-11-28T20:39:01.848225+0000","last_became_peered":"2023-11-28T20:39:01.848225+0000","last_unstale":"2023-11-28T20:39:01.848525+0000","last_undegraded":"2023-11-28T20:39:01.848525+0000","last_fullsized":"2023-11-28T20:39:01.848525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:55:18.203913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372562+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T20:39:00.372562+0000","last_peered":"2023-11-28T20:39:00.372562+0000","last_clean":"2023-11-28T20:39:00.372562+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T20:39:00.372562+0000","last_undegraded":"2023-11-28T20:39:00.372562+0000","last_fullsized":"2023-11-28T20:39:00.372562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.366832+0000","last_change":"2023-11-28T20:38:23.599354+0000","last_active":"2023-11-28T20:39:00.366832+0000","last_peered":"2023-11-28T20:39:00.366832+0000","last_clean":"2023-11-28T20:39:00.366832+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T20:39:00.366832+0000","last_undegraded":"2023-11-28T20:39:00.366832+0000","last_fullsized":"2023-11-28T20:39:00.366832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:39.145764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374185+0000","last_change":"2023-11-28T20:38:19.385622+0000","last_active":"2023-11-28T20:39:00.374185+0000","last_peered":"2023-11-28T20:39:00.374185+0000","last_clean":"2023-11-28T20:39:00.374185+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T20:39:00.374185+0000","last_undegraded":"2023-11-28T20:39:00.374185+0000","last_fullsized":"2023-11-28T20:39:00.374185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:18:03.134187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377060+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T20:39:00.377060+0000","last_peered":"2023-11-28T20:39:00.377060+0000","last_clean":"2023-11-28T20:39:00.377060+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T20:39:00.377060+0000","last_undegraded":"2023-11-28T20:39:00.377060+0000","last_fullsized":"2023-11-28T20:39:00.377060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.386759+0000","last_change":"2023-11-28T20:39:01.386759+0000","last_active":"2023-11-28T20:39:01.386759+0000","last_peered":"2023-11-28T20:39:01.386759+0000","last_clean":"2023-11-28T20:39:01.386759+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T20:39:01.386759+0000","last_undegraded":"2023-11-28T20:39:01.386759+0000","last_fullsized":"2023-11-28T20:39:01.386759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:57:45.861105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376822+0000","last_change":"2023-11-28T20:38:19.392902+0000","last_active":"2023-11-28T20:39:00.376822+0000","last_peered":"2023-11-28T20:39:00.376822+0000","last_clean":"2023-11-28T20:39:00.376822+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T20:39:00.376822+0000","last_undegraded":"2023-11-28T20:39:00.376822+0000","last_fullsized":"2023-11-28T20:39:00.376822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:54:48.837124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373894+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T20:39:00.373894+0000","last_peered":"2023-11-28T20:39:00.373894+0000","last_clean":"2023-11-28T20:39:00.373894+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T20:39:00.373894+0000","last_undegraded":"2023-11-28T20:39:00.373894+0000","last_fullsized":"2023-11-28T20:39:00.373894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.376894+0000","last_change":"2023-11-28T20:38:23.778333+0000","last_active":"2023-11-28T20:39:00.376894+0000","last_peered":"2023-11-28T20:39:00.376894+0000","last_clean":"2023-11-28T20:39:00.376894+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T20:39:00.376894+0000","last_undegraded":"2023-11-28T20:39:00.376894+0000","last_fullsized":"2023-11-28T20:39:00.376894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:33.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374117+0000","last_change":"2023-11-28T20:38:23.778302+0000","last_active":"2023-11-28T20:39:00.374117+0000","last_peered":"2023-11-28T20:39:00.374117+0000","last_clean":"2023-11-28T20:39:00.374117+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T20:39:00.374117+0000","last_undegraded":"2023-11-28T20:39:00.374117+0000","last_fullsized":"2023-11-28T20:39:00.374117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:33.957009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372002+0000","last_change":"2023-11-28T20:38:19.362282+0000","last_active":"2023-11-28T20:39:00.372002+0000","last_peered":"2023-11-28T20:39:00.372002+0000","last_clean":"2023-11-28T20:39:00.372002+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T20:39:00.372002+0000","last_undegraded":"2023-11-28T20:39:00.372002+0000","last_fullsized":"2023-11-28T20:39:00.372002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:10:04.556549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370786+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T20:39:00.370786+0000","last_peered":"2023-11-28T20:39:00.370786+0000","last_clean":"2023-11-28T20:39:00.370786+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T20:39:00.370786+0000","last_undegraded":"2023-11-28T20:39:00.370786+0000","last_fullsized":"2023-11-28T20:39:00.370786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374254+0000","last_change":"2023-11-28T20:38:23.584746+0000","last_active":"2023-11-28T20:39:00.374254+0000","last_peered":"2023-11-28T20:39:00.374254+0000","last_clean":"2023-11-28T20:39:00.374254+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T20:39:00.374254+0000","last_undegraded":"2023-11-28T20:39:00.374254+0000","last_fullsized":"2023-11-28T20:39:00.374254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:26.165297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377725+0000","last_change":"2023-11-28T20:38:19.354478+0000","last_active":"2023-11-28T20:39:00.377725+0000","last_peered":"2023-11-28T20:39:00.377725+0000","last_clean":"2023-11-28T20:39:00.377725+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T20:39:00.377725+0000","last_undegraded":"2023-11-28T20:39:00.377725+0000","last_fullsized":"2023-11-28T20:39:00.377725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:02.345655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377196+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T20:39:00.377196+0000","last_peered":"2023-11-28T20:39:00.377196+0000","last_clean":"2023-11-28T20:39:00.377196+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T20:39:00.377196+0000","last_undegraded":"2023-11-28T20:39:00.377196+0000","last_fullsized":"2023-11-28T20:39:00.377196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372376+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T20:39:00.372376+0000","last_peered":"2023-11-28T20:39:00.372376+0000","last_clean":"2023-11-28T20:39:00.372376+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T20:39:00.372376+0000","last_undegraded":"2023-11-28T20:39:00.372376+0000","last_fullsized":"2023-11-28T20:39:00.372376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374510+0000","last_change":"2023-11-28T20:38:19.377972+0000","last_active":"2023-11-28T20:39:00.374510+0000","last_peered":"2023-11-28T20:39:00.374510+0000","last_clean":"2023-11-28T20:39:00.374510+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T20:39:00.374510+0000","last_undegraded":"2023-11-28T20:39:00.374510+0000","last_fullsized":"2023-11-28T20:39:00.374510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:31.606472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371112+0000","last_change":"2023-11-28T20:38:23.589906+0000","last_active":"2023-11-28T20:39:00.371112+0000","last_peered":"2023-11-28T20:39:00.371112+0000","last_clean":"2023-11-28T20:39:00.371112+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T20:39:00.371112+0000","last_undegraded":"2023-11-28T20:39:00.371112+0000","last_fullsized":"2023-11-28T20:39:00.371112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:45.521780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377615+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T20:39:00.377615+0000","last_peered":"2023-11-28T20:39:00.377615+0000","last_clean":"2023-11-28T20:39:00.377615+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T20:39:00.377615+0000","last_undegraded":"2023-11-28T20:39:00.377615+0000","last_fullsized":"2023-11-28T20:39:00.377615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.369356+0000","last_change":"2023-11-28T20:38:19.398670+0000","last_active":"2023-11-28T20:39:00.369356+0000","last_peered":"2023-11-28T20:39:00.369356+0000","last_clean":"2023-11-28T20:39:00.369356+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T20:39:00.369356+0000","last_undegraded":"2023-11-28T20:39:00.369356+0000","last_fullsized":"2023-11-28T20:39:00.369356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:48.982498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377999+0000","last_change":"2023-11-28T20:38:23.591204+0000","last_active":"2023-11-28T20:39:00.377999+0000","last_peered":"2023-11-28T20:39:00.377999+0000","last_clean":"2023-11-28T20:39:00.377999+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T20:39:00.377999+0000","last_undegraded":"2023-11-28T20:39:00.377999+0000","last_fullsized":"2023-11-28T20:39:00.377999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:12:04.969793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374560+0000","last_change":"2023-11-28T20:38:19.377166+0000","last_active":"2023-11-28T20:39:00.374560+0000","last_peered":"2023-11-28T20:39:00.374560+0000","last_clean":"2023-11-28T20:39:00.374560+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T20:39:00.374560+0000","last_undegraded":"2023-11-28T20:39:00.374560+0000","last_fullsized":"2023-11-28T20:39:00.374560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:12.655834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370843+0000","last_change":"2023-11-28T20:38:19.385093+0000","last_active":"2023-11-28T20:39:00.370843+0000","last_peered":"2023-11-28T20:39:00.370843+0000","last_clean":"2023-11-28T20:39:00.370843+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T20:39:00.370843+0000","last_undegraded":"2023-11-28T20:39:00.370843+0000","last_fullsized":"2023-11-28T20:39:00.370843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:04:23.216459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.375038+0000","last_change":"2023-11-28T20:38:19.378483+0000","last_active":"2023-11-28T20:39:00.375038+0000","last_peered":"2023-11-28T20:39:00.375038+0000","last_clean":"2023-11-28T20:39:00.375038+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T20:39:00.375038+0000","last_undegraded":"2023-11-28T20:39:00.375038+0000","last_fullsized":"2023-11-28T20:39:00.375038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:16:09.430612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374438+0000","last_change":"2023-11-28T20:38:19.358362+0000","last_active":"2023-11-28T20:39:00.374438+0000","last_peered":"2023-11-28T20:39:00.374438+0000","last_clean":"2023-11-28T20:39:00.374438+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T20:39:00.374438+0000","last_undegraded":"2023-11-28T20:39:00.374438+0000","last_fullsized":"2023-11-28T20:39:00.374438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:28:35.985318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377858+0000","last_change":"2023-11-28T20:38:19.406503+0000","last_active":"2023-11-28T20:39:00.377858+0000","last_peered":"2023-11-28T20:39:00.377858+0000","last_clean":"2023-11-28T20:39:00.377858+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T20:39:00.377858+0000","last_undegraded":"2023-11-28T20:39:00.377858+0000","last_fullsized":"2023-11-28T20:39:00.377858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:14.680597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372406+0000","last_change":"2023-11-28T20:38:19.362475+0000","last_active":"2023-11-28T20:39:00.372406+0000","last_peered":"2023-11-28T20:39:00.372406+0000","last_clean":"2023-11-28T20:39:00.372406+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T20:39:00.372406+0000","last_undegraded":"2023-11-28T20:39:00.372406+0000","last_fullsized":"2023-11-28T20:39:00.372406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:19:14.070930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.375206+0000","last_change":"2023-11-28T20:38:19.392158+0000","last_active":"2023-11-28T20:39:00.375206+0000","last_peered":"2023-11-28T20:39:00.375206+0000","last_clean":"2023-11-28T20:39:00.375206+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T20:39:00.375206+0000","last_undegraded":"2023-11-28T20:39:00.375206+0000","last_fullsized":"2023-11-28T20:39:00.375206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:10.125963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.378113+0000","last_change":"2023-11-28T20:38:19.378246+0000","last_active":"2023-11-28T20:39:00.378113+0000","last_peered":"2023-11-28T20:39:00.378113+0000","last_clean":"2023-11-28T20:39:00.378113+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T20:39:00.378113+0000","last_undegraded":"2023-11-28T20:39:00.378113+0000","last_fullsized":"2023-11-28T20:39:00.378113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:36.038030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370557+0000","last_change":"2023-11-28T20:38:19.365616+0000","last_active":"2023-11-28T20:39:00.370557+0000","last_peered":"2023-11-28T20:39:00.370557+0000","last_clean":"2023-11-28T20:39:00.370557+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T20:39:00.370557+0000","last_undegraded":"2023-11-28T20:39:00.370557+0000","last_fullsized":"2023-11-28T20:39:00.370557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:40.966486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377083+0000","last_change":"2023-11-28T20:38:19.398471+0000","last_active":"2023-11-28T20:39:00.377083+0000","last_peered":"2023-11-28T20:39:00.377083+0000","last_clean":"2023-11-28T20:39:00.377083+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T20:39:00.377083+0000","last_undegraded":"2023-11-28T20:39:00.377083+0000","last_fullsized":"2023-11-28T20:39:00.377083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:44:25.847893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.848487+0000","last_change":"2023-11-28T20:39:01.848487+0000","last_active":"2023-11-28T20:39:01.848487+0000","last_peered":"2023-11-28T20:39:01.848487+0000","last_clean":"2023-11-28T20:39:01.848487+0000","last_became_active":"2023-11-28T20:39:01.848167+0000","last_became_peered":"2023-11-28T20:39:01.848167+0000","last_unstale":"2023-11-28T20:39:01.848487+0000","last_undegraded":"2023-11-28T20:39:01.848487+0000","last_fullsized":"2023-11-28T20:39:01.848487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:49.057388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374278+0000","last_change":"2023-11-28T20:38:19.390992+0000","last_active":"2023-11-28T20:39:00.374278+0000","last_peered":"2023-11-28T20:39:00.374278+0000","last_clean":"2023-11-28T20:39:00.374278+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T20:39:00.374278+0000","last_undegraded":"2023-11-28T20:39:00.374278+0000","last_fullsized":"2023-11-28T20:39:00.374278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:56:18.760193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373022+0000","last_change":"2023-11-28T20:38:19.407580+0000","last_active":"2023-11-28T20:39:00.373022+0000","last_peered":"2023-11-28T20:39:00.373022+0000","last_clean":"2023-11-28T20:39:00.373022+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T20:39:00.373022+0000","last_undegraded":"2023-11-28T20:39:00.373022+0000","last_fullsized":"2023-11-28T20:39:00.373022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:57.345090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.384098+0000","last_change":"2023-11-28T20:38:19.397203+0000","last_active":"2023-11-28T20:39:00.384098+0000","last_peered":"2023-11-28T20:39:00.384098+0000","last_clean":"2023-11-28T20:39:00.384098+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T20:39:00.384098+0000","last_undegraded":"2023-11-28T20:39:00.384098+0000","last_fullsized":"2023-11-28T20:39:00.384098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:05:48.717648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371437+0000","last_change":"2023-11-28T20:38:19.383506+0000","last_active":"2023-11-28T20:39:00.371437+0000","last_peered":"2023-11-28T20:39:00.371437+0000","last_clean":"2023-11-28T20:39:00.371437+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T20:39:00.371437+0000","last_undegraded":"2023-11-28T20:39:00.371437+0000","last_fullsized":"2023-11-28T20:39:00.371437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:16:49.517176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.379430+0000","last_change":"2023-11-28T20:38:19.390897+0000","last_active":"2023-11-28T20:39:00.379430+0000","last_peered":"2023-11-28T20:39:00.379430+0000","last_clean":"2023-11-28T20:39:00.379430+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T20:39:00.379430+0000","last_undegraded":"2023-11-28T20:39:00.379430+0000","last_fullsized":"2023-11-28T20:39:00.379430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:31:58.392076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.370305+0000","last_change":"2023-11-28T20:38:19.365976+0000","last_active":"2023-11-28T20:39:00.370305+0000","last_peered":"2023-11-28T20:39:00.370305+0000","last_clean":"2023-11-28T20:39:00.370305+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T20:39:00.370305+0000","last_undegraded":"2023-11-28T20:39:00.370305+0000","last_fullsized":"2023-11-28T20:39:00.370305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:35.431346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.371998+0000","last_change":"2023-11-28T20:38:19.378277+0000","last_active":"2023-11-28T20:39:00.371998+0000","last_peered":"2023-11-28T20:39:00.371998+0000","last_clean":"2023-11-28T20:39:00.371998+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T20:39:00.371998+0000","last_undegraded":"2023-11-28T20:39:00.371998+0000","last_fullsized":"2023-11-28T20:39:00.371998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:07.890906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.374323+0000","last_change":"2023-11-28T20:38:19.362998+0000","last_active":"2023-11-28T20:39:00.374323+0000","last_peered":"2023-11-28T20:39:00.374323+0000","last_clean":"2023-11-28T20:39:00.374323+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T20:39:00.374323+0000","last_undegraded":"2023-11-28T20:39:00.374323+0000","last_fullsized":"2023-11-28T20:39:00.374323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:05.217338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377458+0000","last_change":"2023-11-28T20:38:19.383669+0000","last_active":"2023-11-28T20:39:00.377458+0000","last_peered":"2023-11-28T20:39:00.377458+0000","last_clean":"2023-11-28T20:39:00.377458+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T20:39:00.377458+0000","last_undegraded":"2023-11-28T20:39:00.377458+0000","last_fullsized":"2023-11-28T20:39:00.377458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:59.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.366729+0000","last_change":"2023-11-28T20:38:19.400911+0000","last_active":"2023-11-28T20:39:00.366729+0000","last_peered":"2023-11-28T20:39:00.366729+0000","last_clean":"2023-11-28T20:39:00.366729+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T20:39:00.366729+0000","last_undegraded":"2023-11-28T20:39:00.366729+0000","last_fullsized":"2023-11-28T20:39:00.366729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:53.948328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.372969+0000","last_change":"2023-11-28T20:38:19.386669+0000","last_active":"2023-11-28T20:39:00.372969+0000","last_peered":"2023-11-28T20:39:00.372969+0000","last_clean":"2023-11-28T20:39:00.372969+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T20:39:00.372969+0000","last_undegraded":"2023-11-28T20:39:00.372969+0000","last_fullsized":"2023-11-28T20:39:00.372969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:13:39.245327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-11-28T20:39:01.392330+0000","last_change":"2023-11-28T20:39:01.392330+0000","last_active":"2023-11-28T20:39:01.392330+0000","last_peered":"2023-11-28T20:39:01.392330+0000","last_clean":"2023-11-28T20:39:01.392330+0000","last_became_active":"2023-11-28T20:39:01.391291+0000","last_became_peered":"2023-11-28T20:39:01.391291+0000","last_unstale":"2023-11-28T20:39:01.392330+0000","last_undegraded":"2023-11-28T20:39:01.392330+0000","last_fullsized":"2023-11-28T20:39:01.392330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:53.193592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.384160+0000","last_change":"2023-11-28T20:38:19.402788+0000","last_active":"2023-11-28T20:39:00.384160+0000","last_peered":"2023-11-28T20:39:00.384160+0000","last_clean":"2023-11-28T20:39:00.384160+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T20:39:00.384160+0000","last_undegraded":"2023-11-28T20:39:00.384160+0000","last_fullsized":"2023-11-28T20:39:00.384160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:43:12.948400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377589+0000","last_change":"2023-11-28T20:38:19.366566+0000","last_active":"2023-11-28T20:39:00.377589+0000","last_peered":"2023-11-28T20:39:00.377589+0000","last_clean":"2023-11-28T20:39:00.377589+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T20:39:00.377589+0000","last_undegraded":"2023-11-28T20:39:00.377589+0000","last_fullsized":"2023-11-28T20:39:00.377589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:11:08.819729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.382139+0000","last_change":"2023-11-28T20:38:19.394273+0000","last_active":"2023-11-28T20:39:00.382139+0000","last_peered":"2023-11-28T20:39:00.382139+0000","last_clean":"2023-11-28T20:39:00.382139+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T20:39:00.382139+0000","last_undegraded":"2023-11-28T20:39:00.382139+0000","last_fullsized":"2023-11-28T20:39:00.382139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:14:13.142803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373471+0000","last_change":"2023-11-28T20:38:19.379037+0000","last_active":"2023-11-28T20:39:00.373471+0000","last_peered":"2023-11-28T20:39:00.373471+0000","last_clean":"2023-11-28T20:39:00.373471+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T20:39:00.373471+0000","last_undegraded":"2023-11-28T20:39:00.373471+0000","last_fullsized":"2023-11-28T20:39:00.373471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:24:39.765475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.381922+0000","last_change":"2023-11-28T20:38:19.391122+0000","last_active":"2023-11-28T20:39:00.381922+0000","last_peered":"2023-11-28T20:39:00.381922+0000","last_clean":"2023-11-28T20:39:00.381922+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T20:39:00.381922+0000","last_undegraded":"2023-11-28T20:39:00.381922+0000","last_fullsized":"2023-11-28T20:39:00.381922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:31.372537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.377946+0000","last_change":"2023-11-28T20:38:19.366790+0000","last_active":"2023-11-28T20:39:00.377946+0000","last_peered":"2023-11-28T20:39:00.377946+0000","last_clean":"2023-11-28T20:39:00.377946+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T20:39:00.377946+0000","last_undegraded":"2023-11-28T20:39:00.377946+0000","last_fullsized":"2023-11-28T20:39:00.377946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:44.047340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373966+0000","last_change":"2023-11-28T20:38:19.359779+0000","last_active":"2023-11-28T20:39:00.373966+0000","last_peered":"2023-11-28T20:39:00.373966+0000","last_clean":"2023-11-28T20:39:00.373966+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T20:39:00.373966+0000","last_undegraded":"2023-11-28T20:39:00.373966+0000","last_fullsized":"2023-11-28T20:39:00.373966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:30.906114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.373007+0000","last_change":"2023-11-28T20:38:19.357603+0000","last_active":"2023-11-28T20:39:00.373007+0000","last_peered":"2023-11-28T20:39:00.373007+0000","last_clean":"2023-11-28T20:39:00.373007+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T20:39:00.373007+0000","last_undegraded":"2023-11-28T20:39:00.373007+0000","last_fullsized":"2023-11-28T20:39:00.373007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:59.881429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-28T20:39:00.383531+0000","last_change":"2023-11-28T20:38:19.390722+0000","last_active":"2023-11-28T20:39:00.383531+0000","last_peered":"2023-11-28T20:39:00.383531+0000","last_clean":"2023-11-28T20:39:00.383531+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T20:39:00.383531+0000","last_undegraded":"2023-11-28T20:39:00.383531+0000","last_fullsized":"2023-11-28T20:39:00.383531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:41.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7705,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":120801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.47199999999999998}]},{"osd":1,"last update":"Tue Nov 28 20:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.442},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Nov 28 20:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.45700000000000002}]},{"osd":4,"last update":"Tue Nov 28 20:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Tue Nov 28 20:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.77300000000000002}]},{"osd":6,"last update":"Tue Nov 28 20:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.87}]},{"osd":7,"last update":"Tue Nov 28 20:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.84399999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":116938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":897024,"data_stored":707678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":303104,"data_stored":120767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":4,"last update":"Tue Nov 28 20:39:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.153}]},{"osd":5,"last update":"Tue Nov 28 20:39:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.80900000000000005}]},{"osd":7,"last update":"Tue Nov 28 20:39:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.2}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":303104,"data_stored":117372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":299008,"data_stored":116708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 20:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":1.036}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Nov 28 20:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.745},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Tue Nov 28 20:39:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.006}]},{"osd":7,"last update":"Tue Nov 28 20:39:04 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.147},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.1779999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":707022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":4,"last update":"Tue Nov 28 20:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.048},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.88}]},{"osd":5,"last update":"Tue Nov 28 20:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.94199999999999995}]},{"osd":6,"last update":"Tue Nov 28 20:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.91500000000000004}]},{"osd":7,"last update":"Tue Nov 28 20:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.92800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T20:39:10.802 INFO:tasks.mon_thrash.ceph_manager:clean! 2023-11-28T20:39:10.803 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T20:39:10.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a5df65640 1 Processor -- start 2023-11-28T20:39:10.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a5df65640 1 -- start start 2023-11-28T20:39:10.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a5df65640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a580cf860 0x7f4a580cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a5df65640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4a580cfc40 0x7f4a580ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a5df65640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5815ac00 con 0x7f4a58153ae0 2023-11-28T20:39:10.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a5df65640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580cbd60 con 0x7f4a580cf860 2023-11-28T20:39:10.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a5df65640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a58159ff0 con 0x7f4a580cfc40 2023-11-28T20:39:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a57fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4a58153ae0 0x7f4a5815d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51724/0 (socket says 172.21.15.167:51724) 2023-11-28T20:39:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a57fff640 1 -- 172.21.15.167:0/352860880 learned_addr learned my addr 172.21.15.167:0/352860880 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a577fe640 1 --2- 172.21.15.167:0/352860880 >> v2:172.21.15.167:3300/0 conn(0x7f4a580cf860 0x7f4a580cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a4ffff640 1 --2- 172.21.15.167:0/352860880 >> v2:172.21.15.178:3300/0 conn(0x7f4a580cfc40 0x7f4a580ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a577fe640 1 -- 172.21.15.167:0/352860880 >> v2:172.21.15.178:3300/0 conn(0x7f4a580cfc40 msgr2=0x7f4a580ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:10.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a577fe640 1 --2- 172.21.15.167:0/352860880 >> v2:172.21.15.178:3300/0 conn(0x7f4a580cfc40 0x7f4a580ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a577fe640 1 -- 172.21.15.167:0/352860880 >> v1:172.21.15.167:6789/0 conn(0x7f4a58153ae0 legacy=0x7f4a5815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a56ffd640 1 -- 172.21.15.167:0/352860880 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711182739 0 0) 0x7f4a5815ac00 con 0x7f4a58153ae0 2023-11-28T20:39:10.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.972+0000 7f4a577fe640 1 -- 172.21.15.167:0/352860880 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5815a2d0 con 0x7f4a580cf860 2023-11-28T20:39:10.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a577fe640 1 --2- 172.21.15.167:0/352860880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a580cf860 0x7f4a580cb770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4a580c9c50 tx=0x7f4a4801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432e86da3a75d486 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:10.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a56ffd640 1 -- 172.21.15.167:0/352860880 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480a7070 con 0x7f4a580cf860 2023-11-28T20:39:10.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a56ffd640 1 -- 172.21.15.167:0/352860880 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a480ab430 con 0x7f4a580cf860 2023-11-28T20:39:10.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a56ffd640 1 -- 172.21.15.167:0/352860880 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480ab7c0 con 0x7f4a580cf860 2023-11-28T20:39:10.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a5df65640 1 -- 172.21.15.167:0/352860880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a580cf860 msgr2=0x7f4a580cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a5df65640 1 --2- 172.21.15.167:0/352860880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a580cf860 0x7f4a580cb770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4a580c9c50 tx=0x7f4a4801c430 comp rx=0 tx=0).stop 2023-11-28T20:39:10.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a5df65640 1 -- 172.21.15.167:0/352860880 shutdown_connections 2023-11-28T20:39:10.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a5df65640 1 --2- 172.21.15.167:0/352860880 >> v2:172.21.15.178:3300/0 conn(0x7f4a580cfc40 0x7f4a580ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a5df65640 1 --2- 172.21.15.167:0/352860880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a580cf860 0x7f4a580cb770 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a5df65640 1 -- 172.21.15.167:0/352860880 >> 172.21.15.167:0/352860880 conn(0x7f4a5806c1f0 msgr2=0x7f4a58071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:10.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a5df65640 1 -- 172.21.15.167:0/352860880 shutdown_connections 2023-11-28T20:39:10.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.976+0000 7f4a5df65640 1 -- 172.21.15.167:0/352860880 wait complete. 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 Processor -- start 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 -- start start 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a580cf860 0x7f4a58140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a580cfc40 0x7f4a580cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a58153ae0 0x7f4a5813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581412e0 con 0x7f4a58153ae0 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5815c880 con 0x7f4a580cfc40 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58140910 con 0x7f4a580cf860 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a58153ae0 0x7f4a5813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a58153ae0 0x7f4a5813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33498/0 (socket says 172.21.15.167:33498) 2023-11-28T20:39:10.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a57fff640 1 -- 172.21.15.167:0/2934256671 learned_addr learned my addr 172.21.15.167:0/2934256671 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:10.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a4ffff640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a580cfc40 0x7f4a580cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a577fe640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a580cf860 0x7f4a58140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a57fff640 1 -- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a580cf860 msgr2=0x7f4a58140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a57fff640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a580cf860 0x7f4a58140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a57fff640 1 -- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a580cfc40 msgr2=0x7f4a580cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:10.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a57fff640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a580cfc40 0x7f4a580cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a57fff640 1 -- 172.21.15.167:0/2934256671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48009420 con 0x7f4a58153ae0 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a57fff640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a58153ae0 0x7f4a5813ed10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000c7d0 tx=0x7f4a5000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a54ff9640 1 -- 172.21.15.167:0/2934256671 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000a640 con 0x7f4a58153ae0 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a54ff9640 1 -- 172.21.15.167:0/2934256671 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5000a7a0 con 0x7f4a58153ae0 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5815d070 con 0x7f4a58153ae0 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a54ff9640 1 -- 172.21.15.167:0/2934256671 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000ab50 con 0x7f4a58153ae0 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5815cd90 con 0x7f4a58153ae0 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.980+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a58075c90 con 0x7f4a58153ae0 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.984+0000 7f4a54ff9640 1 -- 172.21.15.167:0/2934256671 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4a5000acb0 con 0x7f4a58153ae0 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.984+0000 7f4a54ff9640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a38066470 0x7f4a38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:10.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.984+0000 7f4a54ff9640 1 -- 172.21.15.167:0/2934256671 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4a50083a60 con 0x7f4a58153ae0 2023-11-28T20:39:10.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.984+0000 7f4a577fe640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a38066470 0x7f4a38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:10.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.984+0000 7f4a577fe640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a38066470 0x7f4a38068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a480af000 tx=0x7f4a480a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:10.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:10.988+0000 7f4a54ff9640 1 -- 172.21.15.167:0/2934256671 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a50050b30 con 0x7f4a58153ae0 2023-11-28T20:39:11.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.136+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a58140a50 con 0x7f4a58153ae0 2023-11-28T20:39:11.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a54ff9640 1 -- 172.21.15.167:0/2934256671 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18760 (secure 0 0 0) 0x7f4a50018090 con 0x7f4a58153ae0 2023-11-28T20:39:11.142 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:11.142 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":27,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:39:01.361279+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T20:39:11.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a38066470 msgr2=0x7f4a38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a38066470 0x7f4a38068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a480af000 tx=0x7f4a480a7000 comp rx=0 tx=0).stop 2023-11-28T20:39:11.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a58153ae0 msgr2=0x7f4a5813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a58153ae0 0x7f4a5813ed10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000c7d0 tx=0x7f4a5000cc90 comp rx=0 tx=0).stop 2023-11-28T20:39:11.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 shutdown_connections 2023-11-28T20:39:11.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a38066470 0x7f4a38068930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a58153ae0 0x7f4a5813ed10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a580cfc40 0x7f4a580cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 --2- 172.21.15.167:0/2934256671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a580cf860 0x7f4a58140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 >> 172.21.15.167:0/2934256671 conn(0x7f4a5806c1f0 msgr2=0x7f4a580c5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:11.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 shutdown_connections 2023-11-28T20:39:11.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.140+0000 7f4a5df65640 1 -- 172.21.15.167:0/2934256671 wait complete. 2023-11-28T20:39:11.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:38:05.507993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:38:17.477871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:38:17.884061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T20:38:21.578587+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T20:39:11.164 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T20:39:11.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.300+0000 7fe1855e6640 1 Processor -- start 2023-11-28T20:39:11.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.300+0000 7fe1855e6640 1 -- start start 2023-11-28T20:39:11.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe1855e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18006b0d0 0x7fe180070930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe1855e6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1800c7100 0x7fe180160810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe1855e6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1800c5be0 con 0x7fe18006b4b0 2023-11-28T20:39:11.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe1855e6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1800c6760 con 0x7fe1800c7100 2023-11-28T20:39:11.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe1855e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe180070e70 con 0x7fe18006b0d0 2023-11-28T20:39:11.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe1767fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe18006b4b0 0x7fe18014f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51730/0 (socket says 172.21.15.167:51730) 2023-11-28T20:39:11.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe1767fc640 1 -- 172.21.15.167:0/3886497654 learned_addr learned my addr 172.21.15.167:0/3886497654 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:11.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe17f7fe640 1 --2- 172.21.15.167:0/3886497654 >> v2:172.21.15.178:3300/0 conn(0x7fe1800c7100 0x7fe180160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe17effd640 1 --2- 172.21.15.167:0/3886497654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18006b0d0 0x7fe180070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe17e7fc640 1 -- 172.21.15.167:0/3886497654 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713521971 0 0) 0x7fe1800c5be0 con 0x7fe18006b4b0 2023-11-28T20:39:11.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe17e7fc640 1 -- 172.21.15.167:0/3886497654 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe16c003530 con 0x7fe18006b4b0 2023-11-28T20:39:11.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe17f7fe640 1 -- 172.21.15.167:0/3886497654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18006b0d0 msgr2=0x7fe180070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:11.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe17f7fe640 1 --2- 172.21.15.167:0/3886497654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18006b0d0 0x7fe180070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe17f7fe640 1 -- 172.21.15.167:0/3886497654 >> v1:172.21.15.167:6789/0 conn(0x7fe18006b4b0 legacy=0x7fe18014f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.304+0000 7fe17f7fe640 1 -- 172.21.15.167:0/3886497654 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180156ce0 con 0x7fe1800c7100 2023-11-28T20:39:11.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe17f7fe640 1 --2- 172.21.15.167:0/3886497654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800c7100 0x7fe180160810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe1780097f0 tx=0x7fe17801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=192a72d7ff0deeb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:11.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe17e7fc640 1 -- 172.21.15.167:0/3886497654 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780a8970 con 0x7fe1800c7100 2023-11-28T20:39:11.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe17e7fc640 1 -- 172.21.15.167:0/3886497654 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1780a8ad0 con 0x7fe1800c7100 2023-11-28T20:39:11.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe17e7fc640 1 -- 172.21.15.167:0/3886497654 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780a8e40 con 0x7fe1800c7100 2023-11-28T20:39:11.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 -- 172.21.15.167:0/3886497654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800c7100 msgr2=0x7fe180160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 --2- 172.21.15.167:0/3886497654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800c7100 0x7fe180160810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe1780097f0 tx=0x7fe17801ec70 comp rx=0 tx=0).stop 2023-11-28T20:39:11.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 -- 172.21.15.167:0/3886497654 shutdown_connections 2023-11-28T20:39:11.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 --2- 172.21.15.167:0/3886497654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800c7100 0x7fe180160810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 --2- 172.21.15.167:0/3886497654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18006b0d0 0x7fe180070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 -- 172.21.15.167:0/3886497654 >> 172.21.15.167:0/3886497654 conn(0x7fe1800c7ce0 msgr2=0x7fe1800c80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:11.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 -- 172.21.15.167:0/3886497654 shutdown_connections 2023-11-28T20:39:11.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 -- 172.21.15.167:0/3886497654 wait complete. 2023-11-28T20:39:11.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 Processor -- start 2023-11-28T20:39:11.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 -- start start 2023-11-28T20:39:11.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18006b0d0 0x7fe18014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1800c7100 0x7fe180155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180156430 0x7fe1801f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.308+0000 7fe1855e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801ef4c0 con 0x7fe1800c7100 2023-11-28T20:39:11.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1855e6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe180145a10 con 0x7fe18006b0d0 2023-11-28T20:39:11.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1855e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe180153da0 con 0x7fe180156430 2023-11-28T20:39:11.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1767fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1800c7100 0x7fe180155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1767fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1800c7100 0x7fe180155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33502/0 (socket says 172.21.15.167:33502) 2023-11-28T20:39:11.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1767fc640 1 -- 172.21.15.167:0/3756490556 learned_addr learned my addr 172.21.15.167:0/3756490556 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:11.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe17effd640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18006b0d0 0x7fe18014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe17f7fe640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180156430 0x7fe1801f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1767fc640 1 -- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180156430 msgr2=0x7fe1801f3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1767fc640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180156430 0x7fe1801f3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1767fc640 1 -- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18006b0d0 msgr2=0x7fe18014e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1767fc640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18006b0d0 0x7fe18014e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1767fc640 1 -- 172.21.15.167:0/3756490556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178009420 con 0x7fe1800c7100 2023-11-28T20:39:11.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1767fc640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1800c7100 0x7fe180155ef0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe16800cbf0 tx=0x7fe16800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:11.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe177fff640 1 -- 172.21.15.167:0/3756490556 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16800ad50 con 0x7fe1800c7100 2023-11-28T20:39:11.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe177fff640 1 -- 172.21.15.167:0/3756490556 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe168012400 con 0x7fe1800c7100 2023-11-28T20:39:11.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe180154040 con 0x7fe1800c7100 2023-11-28T20:39:11.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe177fff640 1 -- 172.21.15.167:0/3756490556 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168012790 con 0x7fe1800c7100 2023-11-28T20:39:11.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe180154600 con 0x7fe1800c7100 2023-11-28T20:39:11.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1800682c0 con 0x7fe1800c7100 2023-11-28T20:39:11.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.312+0000 7fe177fff640 1 -- 172.21.15.167:0/3756490556 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe168007070 con 0x7fe1800c7100 2023-11-28T20:39:11.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.316+0000 7fe177fff640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe160066470 0x7fe160068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.316+0000 7fe177fff640 1 -- 172.21.15.167:0/3756490556 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe168084260 con 0x7fe1800c7100 2023-11-28T20:39:11.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.316+0000 7fe17effd640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe160066470 0x7fe160068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.316+0000 7fe17effd640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe160066470 0x7fe160068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe170009b60 tx=0x7fe170009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:11.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.320+0000 7fe177fff640 1 -- 172.21.15.167:0/3756490556 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1680513d0 con 0x7fe1800c7100 2023-11-28T20:39:11.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1800c6f70 con 0x7fe1800c7100 2023-11-28T20:39:11.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe177fff640 1 -- 172.21.15.167:0/3756490556 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1680549f0 con 0x7fe1800c7100 2023-11-28T20:39:11.480 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2023-11-28T20:39:11.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe160066470 msgr2=0x7fe160068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe160066470 0x7fe160068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe170009b60 tx=0x7fe170009190 comp rx=0 tx=0).stop 2023-11-28T20:39:11.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1800c7100 msgr2=0x7fe180155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1800c7100 0x7fe180155ef0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe16800cbf0 tx=0x7fe16800a430 comp rx=0 tx=0).stop 2023-11-28T20:39:11.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 shutdown_connections 2023-11-28T20:39:11.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe160066470 0x7fe160068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180156430 0x7fe1801f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1800c7100 0x7fe180155ef0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 --2- 172.21.15.167:0/3756490556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18006b0d0 0x7fe18014e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.476+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 >> 172.21.15.167:0/3756490556 conn(0x7fe1800c7ce0 msgr2=0x7fe1800c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:11.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.480+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 shutdown_connections 2023-11-28T20:39:11.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.480+0000 7fe1855e6640 1 -- 172.21.15.167:0/3756490556 wait complete. 2023-11-28T20:39:11.501 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T20:39:11.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.640+0000 7fc65e30f640 1 Processor -- start 2023-11-28T20:39:11.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.640+0000 7fc65e30f640 1 -- start start 2023-11-28T20:39:11.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc65e30f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc65806e030 0x7fc6581500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc65e30f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc658072630 0x7fc6581505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc65e30f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6581571d0 con 0x7fc658070480 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc65e30f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc658071a90 con 0x7fc65806e030 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc65e30f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6580c70d0 con 0x7fc658072630 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc657fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc65806e030 0x7fc6581500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc6577fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc658070480 0x7fc658071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51740/0 (socket says 172.21.15.167:51740) 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc657fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc65806e030 0x7fc6581500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33504/0 (socket says 172.21.15.167:33504) 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc6577fe640 1 -- 172.21.15.167:0/2507284268 learned_addr learned my addr 172.21.15.167:0/2507284268 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc65c8ac640 1 --2- 172.21.15.167:0/2507284268 >> v2:172.21.15.178:3300/0 conn(0x7fc658072630 0x7fc6581505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc657fff640 1 -- 172.21.15.167:0/2507284268 >> v2:172.21.15.178:3300/0 conn(0x7fc658072630 msgr2=0x7fc6581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc657fff640 1 --2- 172.21.15.167:0/2507284268 >> v2:172.21.15.178:3300/0 conn(0x7fc658072630 0x7fc6581505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc657fff640 1 -- 172.21.15.167:0/2507284268 >> v1:172.21.15.167:6789/0 conn(0x7fc658070480 legacy=0x7fc658071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.644+0000 7fc657fff640 1 -- 172.21.15.167:0/2507284268 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6580c73b0 con 0x7fc65806e030 2023-11-28T20:39:11.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc657fff640 1 --2- 172.21.15.167:0/2507284268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 0x7fc6581500b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc65806c280 tx=0x7fc64801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfad883f351944a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:11.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc656ffd640 1 -- 172.21.15.167:0/2507284268 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6480ab600 con 0x7fc65806e030 2023-11-28T20:39:11.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc656ffd640 1 -- 172.21.15.167:0/2507284268 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6480a7050 con 0x7fc65806e030 2023-11-28T20:39:11.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc656ffd640 1 -- 172.21.15.167:0/2507284268 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6480ab980 con 0x7fc65806e030 2023-11-28T20:39:11.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 -- 172.21.15.167:0/2507284268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 msgr2=0x7fc6581500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 --2- 172.21.15.167:0/2507284268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 0x7fc6581500b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc65806c280 tx=0x7fc64801c430 comp rx=0 tx=0).stop 2023-11-28T20:39:11.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 -- 172.21.15.167:0/2507284268 shutdown_connections 2023-11-28T20:39:11.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 --2- 172.21.15.167:0/2507284268 >> v2:172.21.15.178:3300/0 conn(0x7fc658072630 0x7fc6581505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 --2- 172.21.15.167:0/2507284268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 0x7fc6581500b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 -- 172.21.15.167:0/2507284268 >> 172.21.15.167:0/2507284268 conn(0x7fc6580cb1e0 msgr2=0x7fc6580cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:11.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 -- 172.21.15.167:0/2507284268 shutdown_connections 2023-11-28T20:39:11.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 -- 172.21.15.167:0/2507284268 wait complete. 2023-11-28T20:39:11.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 Processor -- start 2023-11-28T20:39:11.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.648+0000 7fc65e30f640 1 -- start start 2023-11-28T20:39:11.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65e30f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 0x7fc65814c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65e30f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc658070480 0x7fc65814c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65e30f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc658072630 0x7fc658155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65e30f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580ca1c0 con 0x7fc65806e030 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65e30f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65814abc0 con 0x7fc658070480 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65e30f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65814ae60 con 0x7fc658072630 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc657fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 0x7fc65814c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc657fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 0x7fc65814c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33514/0 (socket says 172.21.15.167:33514) 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc657fff640 1 -- 172.21.15.167:0/3533614327 learned_addr learned my addr 172.21.15.167:0/3533614327 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc6577fe640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc658070480 0x7fc65814c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65c8ac640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc658072630 0x7fc658155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc657fff640 1 -- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc658072630 msgr2=0x7fc658155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc657fff640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc658072630 0x7fc658155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc657fff640 1 -- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc658070480 msgr2=0x7fc65814c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc657fff640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc658070480 0x7fc65814c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc657fff640 1 -- 172.21.15.167:0/3533614327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648009420 con 0x7fc65806e030 2023-11-28T20:39:11.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc657fff640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 0x7fc65814c470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc64801aae0 tx=0x7fc6480191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:11.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc654ff9640 1 -- 172.21.15.167:0/3533614327 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6480ba070 con 0x7fc65806e030 2023-11-28T20:39:11.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc654ff9640 1 -- 172.21.15.167:0/3533614327 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6480abe50 con 0x7fc65806e030 2023-11-28T20:39:11.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc654ff9640 1 -- 172.21.15.167:0/3533614327 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6480b4650 con 0x7fc65806e030 2023-11-28T20:39:11.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6581493f0 con 0x7fc65806e030 2023-11-28T20:39:11.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6581499b0 con 0x7fc65806e030 2023-11-28T20:39:11.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6580682c0 con 0x7fc65806e030 2023-11-28T20:39:11.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.652+0000 7fc654ff9640 1 -- 172.21.15.167:0/3533614327 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc6480b2040 con 0x7fc65806e030 2023-11-28T20:39:11.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.656+0000 7fc654ff9640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc644066470 0x7fc644068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.656+0000 7fc654ff9640 1 -- 172.21.15.167:0/3533614327 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc64811d900 con 0x7fc65806e030 2023-11-28T20:39:11.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.656+0000 7fc6577fe640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc644066470 0x7fc644068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.656+0000 7fc6577fe640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc644066470 0x7fc644068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc658144a60 tx=0x7fc64c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:11.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.660+0000 7fc654ff9640 1 -- 172.21.15.167:0/3533614327 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6480ea930 con 0x7fc65806e030 2023-11-28T20:39:11.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc658075c90 con 0x7fc65806e030 2023-11-28T20:39:11.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc654ff9640 1 -- 172.21.15.167:0/3533614327 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6480edf50 con 0x7fc65806e030 2023-11-28T20:39:11.815 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:39:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc644066470 msgr2=0x7fc644068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc644066470 0x7fc644068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc658144a60 tx=0x7fc64c009040 comp rx=0 tx=0).stop 2023-11-28T20:39:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 msgr2=0x7fc65814c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 0x7fc65814c470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc64801aae0 tx=0x7fc6480191d0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 shutdown_connections 2023-11-28T20:39:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc644066470 0x7fc644068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc658072630 0x7fc658155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc658070480 0x7fc65814c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 --2- 172.21.15.167:0/3533614327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc65806e030 0x7fc65814c470 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 >> 172.21.15.167:0/3533614327 conn(0x7fc6580cb1e0 msgr2=0x7fc65814e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 shutdown_connections 2023-11-28T20:39:11.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.812+0000 7fc65e30f640 1 -- 172.21.15.167:0/3533614327 wait complete. 2023-11-28T20:39:11.836 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T20:39:11.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7ec5f640 1 Processor -- start 2023-11-28T20:39:11.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7ec5f640 1 -- start start 2023-11-28T20:39:11.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7ec5f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 0x7fbf780c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7ec5f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbf7806a580 0x7fbf7806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7ec5f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7815b220 con 0x7fbf78151f60 2023-11-28T20:39:11.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7ec5f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780c4da0 con 0x7fbf7806a580 2023-11-28T20:39:11.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7ec5f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf780c2df0 con 0x7fbf780c75c0 2023-11-28T20:39:11.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7c9fb640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbf78151f60 0x7fbf780c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51748/0 (socket says 172.21.15.167:51748) 2023-11-28T20:39:11.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7c9fb640 1 -- 172.21.15.167:0/4077177367 learned_addr learned my addr 172.21.15.167:0/4077177367 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:11.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.972+0000 7fbf7d1fc640 1 --2- 172.21.15.167:0/4077177367 >> v2:172.21.15.167:3300/0 conn(0x7fbf7806a580 0x7fbf7806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf6ffff640 1 --2- 172.21.15.167:0/4077177367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 0x7fbf780c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf7d1fc640 1 -- 172.21.15.167:0/4077177367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 msgr2=0x7fbf780c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:11.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf7d1fc640 1 --2- 172.21.15.167:0/4077177367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 0x7fbf780c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf7d1fc640 1 -- 172.21.15.167:0/4077177367 >> v1:172.21.15.167:6789/0 conn(0x7fbf78151f60 legacy=0x7fbf780c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf7d1fc640 1 -- 172.21.15.167:0/4077177367 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780c7a20 con 0x7fbf7806a580 2023-11-28T20:39:11.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf6ffff640 1 --2- 172.21.15.167:0/4077177367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 0x7fbf780c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:11.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf6f7fe640 1 -- 172.21.15.167:0/4077177367 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554340203 0 0) 0x7fbf7815b220 con 0x7fbf78151f60 2023-11-28T20:39:11.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf7d1fc640 1 --2- 172.21.15.167:0/4077177367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 0x7fbf7806a9b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009dc0 tx=0x7fbf7001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50455c22b2356e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:11.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf6f7fe640 1 -- 172.21.15.167:0/4077177367 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf700a5870 con 0x7fbf7806a580 2023-11-28T20:39:11.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf6f7fe640 1 -- 172.21.15.167:0/4077177367 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf700a59d0 con 0x7fbf7806a580 2023-11-28T20:39:11.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.976+0000 7fbf6f7fe640 1 -- 172.21.15.167:0/4077177367 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf700a5d60 con 0x7fbf7806a580 2023-11-28T20:39:11.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/4077177367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 msgr2=0x7fbf7806a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 --2- 172.21.15.167:0/4077177367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 0x7fbf7806a9b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009dc0 tx=0x7fbf7001c8a0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/4077177367 shutdown_connections 2023-11-28T20:39:11.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 --2- 172.21.15.167:0/4077177367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 0x7fbf7806a9b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 --2- 172.21.15.167:0/4077177367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 0x7fbf780c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/4077177367 >> 172.21.15.167:0/4077177367 conn(0x7fbf780cb1e0 msgr2=0x7fbf780cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:11.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/4077177367 shutdown_connections 2023-11-28T20:39:11.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/4077177367 wait complete. 2023-11-28T20:39:11.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 Processor -- start 2023-11-28T20:39:11.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 -- start start 2023-11-28T20:39:11.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 0x7fbf781f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 0x7fbf781573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf78151f60 0x7fbf78140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf78151830 con 0x7fbf7806a580 2023-11-28T20:39:11.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf781f6250 con 0x7fbf78151f60 2023-11-28T20:39:11.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7ec5f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf781f5f20 con 0x7fbf780c75c0 2023-11-28T20:39:11.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7c9fb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 0x7fbf781f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7c9fb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 0x7fbf781f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33538/0 (socket says 172.21.15.167:33538) 2023-11-28T20:39:11.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7c9fb640 1 -- 172.21.15.167:0/1852859948 learned_addr learned my addr 172.21.15.167:0/1852859948 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:11.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf6ffff640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 0x7fbf781573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7d1fc640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf78151f60 0x7fbf78140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7c9fb640 1 -- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 msgr2=0x7fbf781573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7c9fb640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 0x7fbf781573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7c9fb640 1 -- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf78151f60 msgr2=0x7fbf78140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:11.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7c9fb640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf78151f60 0x7fbf78140600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:11.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7c9fb640 1 -- 172.21.15.167:0/1852859948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70009a70 con 0x7fbf7806a580 2023-11-28T20:39:11.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7d1fc640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf78151f60 0x7fbf78140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:39:11.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.980+0000 7fbf7c9fb640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 0x7fbf781f66e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400c480 tx=0x7fbf7400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:11.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf6d7fa640 1 -- 172.21.15.167:0/1852859948 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740074e0 con 0x7fbf7806a580 2023-11-28T20:39:11.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf6d7fa640 1 -- 172.21.15.167:0/1852859948 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf74007660 con 0x7fbf7806a580 2023-11-28T20:39:11.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf6d7fa640 1 -- 172.21.15.167:0/1852859948 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74004a30 con 0x7fbf7806a580 2023-11-28T20:39:11.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf78150f90 con 0x7fbf7806a580 2023-11-28T20:39:11.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf78151550 con 0x7fbf7806a580 2023-11-28T20:39:11.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf780682c0 con 0x7fbf7806a580 2023-11-28T20:39:11.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf6d7fa640 1 -- 172.21.15.167:0/1852859948 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbf74004b90 con 0x7fbf7806a580 2023-11-28T20:39:11.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf6d7fa640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf64066470 0x7fbf64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:11.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf6d7fa640 1 -- 172.21.15.167:0/1852859948 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbf740834a0 con 0x7fbf7806a580 2023-11-28T20:39:11.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.984+0000 7fbf6ffff640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf64066470 0x7fbf64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:11.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.988+0000 7fbf6ffff640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf64066470 0x7fbf64068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbf78154a40 tx=0x7fbf68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:11.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:11.988+0000 7fbf6d7fa640 1 -- 172.21.15.167:0/1852859948 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf74053f50 con 0x7fbf7806a580 2023-11-28T20:39:12.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.136+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf781f5d80 con 0x7fbf7806a580 2023-11-28T20:39:12.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.136+0000 7fbf6d7fa640 1 -- 172.21.15.167:0/1852859948 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf781f5d80 con 0x7fbf7806a580 2023-11-28T20:39:12.141 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2023-11-28T20:39:12.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf64066470 msgr2=0x7fbf64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf64066470 0x7fbf64068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbf78154a40 tx=0x7fbf68008040 comp rx=0 tx=0).stop 2023-11-28T20:39:12.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 msgr2=0x7fbf781f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 0x7fbf781f66e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400c480 tx=0x7fbf7400c940 comp rx=0 tx=0).stop 2023-11-28T20:39:12.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 shutdown_connections 2023-11-28T20:39:12.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf64066470 0x7fbf64068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf78151f60 0x7fbf78140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf780c75c0 0x7fbf781573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 --2- 172.21.15.167:0/1852859948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf7806a580 0x7fbf781f66e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 >> 172.21.15.167:0/1852859948 conn(0x7fbf780cb1e0 msgr2=0x7fbf780c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:12.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 shutdown_connections 2023-11-28T20:39:12.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.140+0000 7fbf7ec5f640 1 -- 172.21.15.167:0/1852859948 wait complete. 2023-11-28T20:39:12.162 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T20:39:12.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264fd96640 1 Processor -- start 2023-11-28T20:39:12.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264fd96640 1 -- start start 2023-11-28T20:39:12.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264fd96640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2648150b40 0x7f2648157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264fd96640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f26480c6ff0 0x7f26480c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264fd96640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26480c6ac0 con 0x7f26480c5be0 2023-11-28T20:39:12.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264fd96640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480c6500 con 0x7f2648150b40 2023-11-28T20:39:12.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264fd96640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480c67e0 con 0x7f26480c6ff0 2023-11-28T20:39:12.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264db32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2648150b40 0x7f2648157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264db32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2648150b40 0x7f2648157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33546/0 (socket says 172.21.15.167:33546) 2023-11-28T20:39:12.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264db32640 1 -- 172.21.15.167:0/4259242793 learned_addr learned my addr 172.21.15.167:0/4259242793 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:12.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264d331640 1 --2- 172.21.15.167:0/4259242793 >> v2:172.21.15.178:3300/0 conn(0x7f26480c6ff0 0x7f26480c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264db32640 1 -- 172.21.15.167:0/4259242793 >> v2:172.21.15.178:3300/0 conn(0x7f26480c6ff0 msgr2=0x7f26480c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:12.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264db32640 1 --2- 172.21.15.167:0/4259242793 >> v2:172.21.15.178:3300/0 conn(0x7f26480c6ff0 0x7f26480c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264db32640 1 -- 172.21.15.167:0/4259242793 >> v1:172.21.15.178:6789/0 conn(0x7f26480c5be0 legacy=0x7f264806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.300+0000 7f264db32640 1 -- 172.21.15.167:0/4259242793 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2648156a80 con 0x7f2648150b40 2023-11-28T20:39:12.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264db32640 1 --2- 172.21.15.167:0/4259242793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2648150b40 0x7f2648157560 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f264806bba0 tx=0x7f264401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980e9afb6d8a6a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:12.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264cb30640 1 -- 172.21.15.167:0/4259242793 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440a7b70 con 0x7f2648150b40 2023-11-28T20:39:12.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264cb30640 1 -- 172.21.15.167:0/4259242793 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26440a7cd0 con 0x7f2648150b40 2023-11-28T20:39:12.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264cb30640 1 -- 172.21.15.167:0/4259242793 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440af660 con 0x7f2648150b40 2023-11-28T20:39:12.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264fd96640 1 -- 172.21.15.167:0/4259242793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2648150b40 msgr2=0x7f2648157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264fd96640 1 --2- 172.21.15.167:0/4259242793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2648150b40 0x7f2648157560 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f264806bba0 tx=0x7f264401eba0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264fd96640 1 -- 172.21.15.167:0/4259242793 shutdown_connections 2023-11-28T20:39:12.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264fd96640 1 --2- 172.21.15.167:0/4259242793 >> v2:172.21.15.178:3300/0 conn(0x7f26480c6ff0 0x7f26480c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264fd96640 1 --2- 172.21.15.167:0/4259242793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2648150b40 0x7f2648157560 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264fd96640 1 -- 172.21.15.167:0/4259242793 >> 172.21.15.167:0/4259242793 conn(0x7f26480cb1e0 msgr2=0x7f26480cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:12.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264fd96640 1 -- 172.21.15.167:0/4259242793 shutdown_connections 2023-11-28T20:39:12.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.304+0000 7f264fd96640 1 -- 172.21.15.167:0/4259242793 wait complete. 2023-11-28T20:39:12.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 Processor -- start 2023-11-28T20:39:12.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 -- start start 2023-11-28T20:39:12.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26480c5be0 0x7f26481f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26480c6ff0 0x7f2648154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2648150b40 0x7f264814b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26481f3750 con 0x7f26480c5be0 2023-11-28T20:39:12.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26481543f0 con 0x7f26480c6ff0 2023-11-28T20:39:12.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264814b110 con 0x7f2648150b40 2023-11-28T20:39:12.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264db32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26480c5be0 0x7f26481f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264db32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26480c5be0 0x7f26481f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33554/0 (socket says 172.21.15.167:33554) 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264db32640 1 -- 172.21.15.167:0/1909578819 learned_addr learned my addr 172.21.15.167:0/1909578819 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264d331640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26480c6ff0 0x7f2648154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264e333640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2648150b40 0x7f264814b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264db32640 1 -- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2648150b40 msgr2=0x7f264814b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264db32640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2648150b40 0x7f264814b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264db32640 1 -- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26480c6ff0 msgr2=0x7f2648154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264db32640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26480c6ff0 0x7f2648154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264db32640 1 -- 172.21.15.167:0/1909578819 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264400b770 con 0x7f26480c5be0 2023-11-28T20:39:12.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264db32640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26480c5be0 0x7f26481f3210 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f264401b7b0 tx=0x7f264401b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:12.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f263e7fc640 1 -- 172.21.15.167:0/1909578819 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440ba660 con 0x7f26480c5be0 2023-11-28T20:39:12.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f263e7fc640 1 -- 172.21.15.167:0/1909578819 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26440ba7c0 con 0x7f26480c5be0 2023-11-28T20:39:12.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264814b3d0 con 0x7f26480c5be0 2023-11-28T20:39:12.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f263e7fc640 1 -- 172.21.15.167:0/1909578819 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440bab70 con 0x7f26480c5be0 2023-11-28T20:39:12.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.308+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2648149bf0 con 0x7f26480c5be0 2023-11-28T20:39:12.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.312+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26480682c0 con 0x7f26480c5be0 2023-11-28T20:39:12.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.312+0000 7f263e7fc640 1 -- 172.21.15.167:0/1909578819 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26440c33b0 con 0x7f26480c5be0 2023-11-28T20:39:12.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.312+0000 7f263e7fc640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f262c066470 0x7f262c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.312+0000 7f263e7fc640 1 -- 172.21.15.167:0/1909578819 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f26440a7e40 con 0x7f26480c5be0 2023-11-28T20:39:12.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.312+0000 7f264d331640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f262c066470 0x7f262c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.312+0000 7f264d331640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f262c066470 0x7f262c068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f26480cae20 tx=0x7f2638008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:12.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.316+0000 7f263e7fc640 1 -- 172.21.15.167:0/1909578819 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26440ec320 con 0x7f26480c5be0 2023-11-28T20:39:12.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2648075c90 con 0x7f26480c5be0 2023-11-28T20:39:12.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f263e7fc640 1 -- 172.21.15.167:0/1909578819 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f26440b40a0 con 0x7f26480c5be0 2023-11-28T20:39:12.472 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T20:39:12.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f262c066470 msgr2=0x7f262c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f262c066470 0x7f262c068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f26480cae20 tx=0x7f2638008040 comp rx=0 tx=0).stop 2023-11-28T20:39:12.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26480c5be0 msgr2=0x7f26481f3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26480c5be0 0x7f26481f3210 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f264401b7b0 tx=0x7f264401b940 comp rx=0 tx=0).stop 2023-11-28T20:39:12.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 shutdown_connections 2023-11-28T20:39:12.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f262c066470 0x7f262c068930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2648150b40 0x7f264814b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26480c6ff0 0x7f2648154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 --2- 172.21.15.167:0/1909578819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26480c5be0 0x7f26481f3210 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 >> 172.21.15.167:0/1909578819 conn(0x7f26480cb1e0 msgr2=0x7f26480ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:12.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 shutdown_connections 2023-11-28T20:39:12.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.468+0000 7f264fd96640 1 -- 172.21.15.167:0/1909578819 wait complete. 2023-11-28T20:39:12.492 DEBUG:tasks.mon_thrash:Yielding 2023-11-28T20:39:12.493 INFO:teuthology.run_tasks:Running task workunit... 2023-11-28T20:39:12.507 INFO:tasks.workunit:Pulling workunits from ref 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:39:12.508 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-28T20:39:12.508 INFO:tasks.workunit:timeout=6h 2023-11-28T20:39:12.508 INFO:tasks.workunit:cleanup=True 2023-11-28T20:39:12.508 DEBUG:teuthology.orchestra.run.smithi167:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-28T20:39:12.509 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T20:39:12.518 INFO:teuthology.orchestra.run.smithi167.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-28T20:39:12.518 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-11-28T20:39:12.518 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 2bh/43d Inode: 1 Links: 2 2023-11-28T20:39:12.518 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T20:39:12.518 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-28T20:39:12.519 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-11-28 20:38:24.516417233 +0000 2023-11-28T20:39:12.519 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-11-28 20:38:33.732227276 +0000 2023-11-28T20:39:12.519 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-11-28 20:38:24.516417233 +0000 2023-11-28T20:39:12.519 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-28T20:39:12.519 DEBUG:teuthology.orchestra.run.smithi167:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-28T20:39:12.595 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:39:12.652 INFO:tasks.workunit.client.0.smithi167.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-28T20:39:12.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.648+0000 7f2f2d479640 1 Processor -- start 2023-11-28T20:39:12.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.648+0000 7f2f2d479640 1 -- start start 2023-11-28T20:39:12.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f2d479640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f280b0110 0x7f2f2815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f2d479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 0x7f2f28066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f2d479640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f2806d530 0x7f2f2806b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f2d479640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2806a8d0 con 0x7f2f280b0110 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f2d479640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f280ca230 con 0x7f2f2806d530 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f2d479640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280c8990 con 0x7f2f280c8010 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f26ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f280b0110 0x7f2f2815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f26ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f280b0110 0x7f2f2815d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33564/0 (socket says 172.21.15.167:33564) 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f26ffd640 1 -- 172.21.15.167:0/3754852949 learned_addr learned my addr 172.21.15.167:0/3754852949 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f277fe640 1 --2- 172.21.15.167:0/3754852949 >> v2:172.21.15.178:3300/0 conn(0x7f2f2806d530 0x7f2f2806b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f267fc640 1 --2- 172.21.15.167:0/3754852949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 0x7f2f28066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f26ffd640 1 -- 172.21.15.167:0/3754852949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 msgr2=0x7f2f28066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f26ffd640 1 --2- 172.21.15.167:0/3754852949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 0x7f2f28066730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f26ffd640 1 -- 172.21.15.167:0/3754852949 >> v2:172.21.15.178:3300/0 conn(0x7f2f2806d530 msgr2=0x7f2f2806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:12.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f26ffd640 1 --2- 172.21.15.167:0/3754852949 >> v2:172.21.15.178:3300/0 conn(0x7f2f2806d530 0x7f2f2806b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.652+0000 7f2f26ffd640 1 -- 172.21.15.167:0/3754852949 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280ca480 con 0x7f2f280b0110 2023-11-28T20:39:12.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f26ffd640 1 --2- 172.21.15.167:0/3754852949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f280b0110 0x7f2f2815d3b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2f280cad20 tx=0x7f2f1801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7098545d7f35f744 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:12.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f25ffb640 1 -- 172.21.15.167:0/3754852949 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180a89b0 con 0x7f2f280b0110 2023-11-28T20:39:12.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f25ffb640 1 -- 172.21.15.167:0/3754852949 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f180a8b10 con 0x7f2f280b0110 2023-11-28T20:39:12.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f25ffb640 1 -- 172.21.15.167:0/3754852949 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180a8ea0 con 0x7f2f280b0110 2023-11-28T20:39:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 -- 172.21.15.167:0/3754852949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f280b0110 msgr2=0x7f2f2815d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 --2- 172.21.15.167:0/3754852949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f280b0110 0x7f2f2815d3b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2f280cad20 tx=0x7f2f1801ecf0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 -- 172.21.15.167:0/3754852949 shutdown_connections 2023-11-28T20:39:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 --2- 172.21.15.167:0/3754852949 >> v2:172.21.15.178:3300/0 conn(0x7f2f2806d530 0x7f2f2806b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 --2- 172.21.15.167:0/3754852949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 0x7f2f28066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 --2- 172.21.15.167:0/3754852949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f280b0110 0x7f2f2815d3b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 -- 172.21.15.167:0/3754852949 >> 172.21.15.167:0/3754852949 conn(0x7f2f2806ee30 msgr2=0x7f2f2806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 -- 172.21.15.167:0/3754852949 shutdown_connections 2023-11-28T20:39:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 -- 172.21.15.167:0/3754852949 wait complete. 2023-11-28T20:39:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 Processor -- start 2023-11-28T20:39:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.656+0000 7f2f2d479640 1 -- start start 2023-11-28T20:39:12.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f2d479640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2806d530 0x7f2f28070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f2d479640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f280b0110 0x7f2f281efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f2d479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 0x7f2f281f0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f2d479640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f281ef7a0 con 0x7f2f2806d530 2023-11-28T20:39:12.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f2d479640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f281f2b70 con 0x7f2f280b0110 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f2d479640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f281f2e10 con 0x7f2f280c8010 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f26ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2806d530 0x7f2f28070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f26ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2806d530 0x7f2f28070870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33574/0 (socket says 172.21.15.167:33574) 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f26ffd640 1 -- 172.21.15.167:0/2747218044 learned_addr learned my addr 172.21.15.167:0/2747218044 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f277fe640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 0x7f2f281f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f267fc640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f280b0110 0x7f2f281efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f26ffd640 1 -- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 msgr2=0x7f2f281f0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f26ffd640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 0x7f2f281f0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f26ffd640 1 -- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f280b0110 msgr2=0x7f2f281efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f26ffd640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f280b0110 0x7f2f281efc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f26ffd640 1 -- 172.21.15.167:0/2747218044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180094d0 con 0x7f2f2806d530 2023-11-28T20:39:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f267fc640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f280b0110 0x7f2f281efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f26ffd640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2806d530 0x7f2f28070870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f1801d3a0 tx=0x7f2f1801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f0f7fe640 1 -- 172.21.15.167:0/2747218044 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180ba600 con 0x7f2f2806d530 2023-11-28T20:39:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f0f7fe640 1 -- 172.21.15.167:0/2747218044 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f180ba760 con 0x7f2f2806d530 2023-11-28T20:39:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f0f7fe640 1 -- 172.21.15.167:0/2747218044 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180bab10 con 0x7f2f2806d530 2023-11-28T20:39:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f281f30f0 con 0x7f2f2806d530 2023-11-28T20:39:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f281f36b0 con 0x7f2f2806d530 2023-11-28T20:39:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f28075c90 con 0x7f2f2806d530 2023-11-28T20:39:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.660+0000 7f2f0f7fe640 1 -- 172.21.15.167:0/2747218044 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f180bac70 con 0x7f2f2806d530 2023-11-28T20:39:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.664+0000 7f2f0f7fe640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f140664a0 0x7f2f14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:12.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.664+0000 7f2f0f7fe640 1 -- 172.21.15.167:0/2747218044 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f18122810 con 0x7f2f2806d530 2023-11-28T20:39:12.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.664+0000 7f2f267fc640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f140664a0 0x7f2f14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:12.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.664+0000 7f2f267fc640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f140664a0 0x7f2f14068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f28153430 tx=0x7f2f1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:12.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.668+0000 7f2f0f7fe640 1 -- 172.21.15.167:0/2747218044 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f180ef8d0 con 0x7f2f2806d530 2023-11-28T20:39:12.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.868+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f280cafb0 con 0x7f2f2806d530 2023-11-28T20:39:12.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f0f7fe640 1 -- 172.21.15.167:0/2747218044 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+6541 (secure 0 0 0) 0x7f2f180b5090 con 0x7f2f2806d530 2023-11-28T20:39:12.874 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T20:39:12.874 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T20:38:51.614518+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4278,"mds_2":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4278":{"gid":4278,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.167:6837/1234930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1234930245},{"type":"v1","addr":"172.21.15.167:6837","nonce":1234930245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T20:39:12.874 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 14 2023-11-28T20:39:12.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f140664a0 msgr2=0x7f2f14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f140664a0 0x7f2f14068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2f28153430 tx=0x7f2f1c008040 comp rx=0 tx=0).stop 2023-11-28T20:39:12.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2806d530 msgr2=0x7f2f28070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:12.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2806d530 0x7f2f28070870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f1801d3a0 tx=0x7f2f1801ba90 comp rx=0 tx=0).stop 2023-11-28T20:39:12.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 shutdown_connections 2023-11-28T20:39:12.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2f140664a0 0x7f2f14068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f280c8010 0x7f2f281f0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f280b0110 0x7f2f281efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 --2- 172.21.15.167:0/2747218044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f2806d530 0x7f2f28070870 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:12.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 >> 172.21.15.167:0/2747218044 conn(0x7f2f2806ee30 msgr2=0x7f2f280c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:12.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 shutdown_connections 2023-11-28T20:39:12.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:12.872+0000 7f2f2d479640 1 -- 172.21.15.167:0/2747218044 wait complete. 2023-11-28T20:39:12.896 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2023-11-28T20:39:12.896 INFO:tasks.mon_thrash.mon_thrasher:seed: 1701203950, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2023-11-28T20:39:12.896 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:39:12.897 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:39:13.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.076+0000 7f430d101640 1 Processor -- start 2023-11-28T20:39:13.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.076+0000 7f430d101640 1 -- start start 2023-11-28T20:39:13.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430d101640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43080cf860 0x7f43080cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430d101640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430815ac00 con 0x7f4308153ae0 2023-11-28T20:39:13.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430d101640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43080cbd60 con 0x7f43080cfc40 2023-11-28T20:39:13.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430d101640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4308159ff0 con 0x7f43080cf860 2023-11-28T20:39:13.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430759e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4308153ae0 0x7f430815d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48666/0 (socket says 172.21.15.167:48666) 2023-11-28T20:39:13.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430759e640 1 -- 172.21.15.167:0/2662055000 learned_addr learned my addr 172.21.15.167:0/2662055000 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:13.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4306d9d640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43080cf860 0x7f43080cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060796797 0 0) 0x7f430815ac00 con 0x7f4308153ae0 2023-11-28T20:39:13.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f0003530 con 0x7f4308153ae0 2023-11-28T20:39:13.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2104783602 0 0) 0x7f42f0003530 con 0x7f4308153ae0 2023-11-28T20:39:13.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43080cf860 msgr2=0x7f43080cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:13.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43080cf860 0x7f43080cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 >> v1:172.21.15.178:6789/0 conn(0x7f43080cfc40 legacy=0x7f43080ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430815a2d0 con 0x7f4308153ae0 2023-11-28T20:39:13.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f4300001a00 con 0x7f4308153ae0 2023-11-28T20:39:13.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 >> v1:172.21.15.167:6789/0 conn(0x7f4308153ae0 legacy=0x7f430815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42f00039b0 0x7f42f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00047d0 0x7f42f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43080cf860 0x7f42f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4308159ff0 con 0x7f42f00047d0 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f000ba70 con 0x7f42f00039b0 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f000bc30 con 0x7f43080cf860 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430659c640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00047d0 0x7f42f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f4306d9d640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42f00039b0 0x7f42f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430759e640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43080cf860 0x7f42f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430659c640 1 -- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43080cf860 msgr2=0x7f42f0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:13.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430659c640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43080cf860 0x7f42f0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430659c640 1 -- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42f00039b0 msgr2=0x7f42f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:13.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430659c640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42f00039b0 0x7f42f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.080+0000 7f430659c640 1 -- 172.21.15.167:0/2662055000 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0003530 con 0x7f42f00047d0 2023-11-28T20:39:13.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f430659c640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00047d0 0x7f42f0004c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f42fc001750 tx=0x7f42fc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9c50085624e39a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc0052d0 con 0x7f42f00047d0 2023-11-28T20:39:13.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc0a7050 con 0x7f42f00047d0 2023-11-28T20:39:13.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f4305d9b640 1 -- 172.21.15.167:0/2662055000 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc003600 con 0x7f42f00047d0 2023-11-28T20:39:13.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f430d101640 1 -- 172.21.15.167:0/2662055000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00047d0 msgr2=0x7f42f0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f430d101640 1 --2- 172.21.15.167:0/2662055000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00047d0 0x7f42f0004c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f42fc001750 tx=0x7f42fc01c3a0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f430759e640 1 -- 172.21.15.167:0/2662055000 reap_dead start 2023-11-28T20:39:13.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f430d101640 1 -- 172.21.15.167:0/2662055000 shutdown_connections 2023-11-28T20:39:13.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f430d101640 1 -- 172.21.15.167:0/2662055000 >> 172.21.15.167:0/2662055000 conn(0x7f430806c1f0 msgr2=0x7f4308071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:13.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f430d101640 1 -- 172.21.15.167:0/2662055000 shutdown_connections 2023-11-28T20:39:13.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.084+0000 7f430d101640 1 -- 172.21.15.167:0/2662055000 wait complete. 2023-11-28T20:39:13.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 Processor -- start 2023-11-28T20:39:13.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 -- start start 2023-11-28T20:39:13.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42f00047d0 0x7f43080c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43080c7760 0x7f43081e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43081f3610 0x7f43081f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4308151020 con 0x7f43081f3610 2023-11-28T20:39:13.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080c8ef0 con 0x7f43080c7760 2023-11-28T20:39:13.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43081f3fb0 con 0x7f42f00047d0 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43081f3610 0x7f43081f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43081f3610 0x7f43081f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44106/0 (socket says 172.21.15.167:44106) 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430759e640 1 -- 172.21.15.167:0/901612338 learned_addr learned my addr 172.21.15.167:0/901612338 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f4306d9d640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42f00047d0 0x7f43080c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430659c640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43080c7760 0x7f43081e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430759e640 1 -- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42f00047d0 msgr2=0x7f43080c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430759e640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42f00047d0 0x7f43080c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430759e640 1 -- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43080c7760 msgr2=0x7f43081e6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430759e640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43080c7760 0x7f43081e6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430759e640 1 -- 172.21.15.167:0/901612338 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43080c82e0 con 0x7f43081f3610 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430759e640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43081f3610 0x7f43081f3a70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4308153ec0 tx=0x7f4300011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f42ef7fe640 1 -- 172.21.15.167:0/901612338 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300014780 con 0x7f43081f3610 2023-11-28T20:39:13.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f42ef7fe640 1 -- 172.21.15.167:0/901612338 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43000148e0 con 0x7f43081f3610 2023-11-28T20:39:13.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f42ef7fe640 1 -- 172.21.15.167:0/901612338 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300014c90 con 0x7f43081f3610 2023-11-28T20:39:13.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43080c85c0 con 0x7f43081f3610 2023-11-28T20:39:13.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.088+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43080c8b80 con 0x7f43081f3610 2023-11-28T20:39:13.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.092+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4308075c90 con 0x7f43081f3610 2023-11-28T20:39:13.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.092+0000 7f42ef7fe640 1 -- 172.21.15.167:0/901612338 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f430001f460 con 0x7f43081f3610 2023-11-28T20:39:13.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.092+0000 7f42ef7fe640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42f40664a0 0x7f42f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.092+0000 7f42ef7fe640 1 -- 172.21.15.167:0/901612338 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f43000870b0 con 0x7f43081f3610 2023-11-28T20:39:13.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.092+0000 7f4306d9d640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42f40664a0 0x7f42f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.092+0000 7f4306d9d640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42f40664a0 0x7f42f4068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009be0 tx=0x7f42f8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.096+0000 7f42ef7fe640 1 -- 172.21.15.167:0/901612338 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4300054160 con 0x7f43081f3610 2023-11-28T20:39:13.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.296+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f43080b2490 con 0x7f43081f3610 2023-11-28T20:39:13.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.296+0000 7f42ef7fe640 1 -- 172.21.15.167:0/901612338 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7f4300057780 con 0x7f43081f3610 2023-11-28T20:39:13.301 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":78,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:39:13.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42f40664a0 msgr2=0x7f42f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42f40664a0 0x7f42f4068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009be0 tx=0x7f42f8009190 comp rx=0 tx=0).stop 2023-11-28T20:39:13.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43081f3610 msgr2=0x7f43081f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43081f3610 0x7f43081f3a70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4308153ec0 tx=0x7f4300011b60 comp rx=0 tx=0).stop 2023-11-28T20:39:13.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 shutdown_connections 2023-11-28T20:39:13.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42f40664a0 0x7f42f4068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43081f3610 0x7f43081f3a70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43080c7760 0x7f43081e6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 --2- 172.21.15.167:0/901612338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42f00047d0 0x7f43080c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 >> 172.21.15.167:0/901612338 conn(0x7f430806c1f0 msgr2=0x7f43080c58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:13.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 shutdown_connections 2023-11-28T20:39:13.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.300+0000 7f430d101640 1 -- 172.21.15.167:0/901612338 wait complete. 2023-11-28T20:39:13.322 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:39:13.323 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:39:13.323 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:39:13.323 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:39:13.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.456+0000 7fa9af217640 1 Processor -- start 2023-11-28T20:39:13.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.456+0000 7fa9af217640 1 -- start start 2023-11-28T20:39:13.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa9af217640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a8153fa0 0x7fa9a80c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa9af217640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a815ada0 con 0x7fa9a80c63d0 2023-11-28T20:39:13.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa9af217640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a8159f40 con 0x7fa9a815de80 2023-11-28T20:39:13.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa9af217640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a815a220 con 0x7fa9a8153fa0 2023-11-28T20:39:13.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa9a80c63d0 0x7fa9a815d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48670/0 (socket says 172.21.15.167:48670) 2023-11-28T20:39:13.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99ffff640 1 -- 172.21.15.167:0/3760199913 learned_addr learned my addr 172.21.15.167:0/3760199913 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:13.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa9acfb3640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a8153fa0 0x7fa9a80c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961347430 0 0) 0x7fa998001120 con 0x7fa9a80c63d0 2023-11-28T20:39:13.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa990003530 con 0x7fa9a80c63d0 2023-11-28T20:39:13.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1460703142 0 0) 0x7fa990003530 con 0x7fa9a80c63d0 2023-11-28T20:39:13.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a8153fa0 msgr2=0x7fa9a80c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:13.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a8153fa0 0x7fa9a80c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 >> v1:172.21.15.178:6789/0 conn(0x7fa9a815de80 legacy=0x7fa9a806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a815a500 con 0x7fa9a80c63d0 2023-11-28T20:39:13.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fa998001810 con 0x7fa9a80c63d0 2023-11-28T20:39:13.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 >> v1:172.21.15.167:6789/0 conn(0x7fa9a80c63d0 legacy=0x7fa9a815d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a8153fa0 0x7fa9900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa990003ef0 0x7fa9900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa990004d10 0x7fa990005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a815a220 con 0x7fa990003ef0 2023-11-28T20:39:13.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99000b9f0 con 0x7fa990004d10 2023-11-28T20:39:13.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99000bbb0 con 0x7fa9a8153fa0 2023-11-28T20:39:13.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99ffff640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa990003ef0 0x7fa9900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa9acfb3640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a8153fa0 0x7fa9900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa9ad7b4640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa990004d10 0x7fa990005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99ffff640 1 -- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a8153fa0 msgr2=0x7fa9900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:13.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99ffff640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a8153fa0 0x7fa9900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99ffff640 1 -- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa990004d10 msgr2=0x7fa990005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:13.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99ffff640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa990004d10 0x7fa990005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa99ffff640 1 -- 172.21.15.167:0/3760199913 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990003530 con 0x7fa990003ef0 2023-11-28T20:39:13.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.460+0000 7fa9ad7b4640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa990004d10 0x7fa990005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:13.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa99ffff640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa990003ef0 0x7fa9900047d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c1c0 tx=0x7fa99801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62542323fa4f4183 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998005ae0 con 0x7fa990003ef0 2023-11-28T20:39:13.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa998005c60 con 0x7fa990003ef0 2023-11-28T20:39:13.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa99f7fe640 1 -- 172.21.15.167:0/3760199913 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980a5aa0 con 0x7fa990003ef0 2023-11-28T20:39:13.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa9af217640 1 -- 172.21.15.167:0/3760199913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa990003ef0 msgr2=0x7fa9900047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa9af217640 1 --2- 172.21.15.167:0/3760199913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa990003ef0 0x7fa9900047d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c1c0 tx=0x7fa99801cb60 comp rx=0 tx=0).stop 2023-11-28T20:39:13.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa9ad7b4640 1 -- 172.21.15.167:0/3760199913 reap_dead start 2023-11-28T20:39:13.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa9af217640 1 -- 172.21.15.167:0/3760199913 shutdown_connections 2023-11-28T20:39:13.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa9af217640 1 -- 172.21.15.167:0/3760199913 >> 172.21.15.167:0/3760199913 conn(0x7fa9a80cb1e0 msgr2=0x7fa9a80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:13.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa9af217640 1 -- 172.21.15.167:0/3760199913 shutdown_connections 2023-11-28T20:39:13.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.464+0000 7fa9af217640 1 -- 172.21.15.167:0/3760199913 wait complete. 2023-11-28T20:39:13.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 Processor -- start 2023-11-28T20:39:13.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 -- start start 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa990003ef0 0x7fa9a8156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a80c44d0 0x7fa9a80c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8157de0 0x7fa9a8158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a8150460 con 0x7fa9a8157de0 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a81587a0 con 0x7fa9a80c44d0 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a814fc00 con 0x7fa990003ef0 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9ad7b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8157de0 0x7fa9a8158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9ad7b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8157de0 0x7fa9a8158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44120/0 (socket says 172.21.15.167:44120) 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9ad7b4640 1 -- 172.21.15.167:0/1530805901 learned_addr learned my addr 172.21.15.167:0/1530805901 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9acfb3640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa990003ef0 0x7fa9a8156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa99ffff640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a80c44d0 0x7fa9a80c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9ad7b4640 1 -- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa990003ef0 msgr2=0x7fa9a8156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9ad7b4640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa990003ef0 0x7fa9a8156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9ad7b4640 1 -- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a80c44d0 msgr2=0x7fa9a80c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9ad7b4640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a80c44d0 0x7fa9a80c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9ad7b4640 1 -- 172.21.15.167:0/1530805901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a8156980 con 0x7fa9a8157de0 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9acfb3640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa990003ef0 0x7fa9a8156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9ad7b4640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8157de0 0x7fa9a8158260 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa9a815e260 tx=0x7fa9a0010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0003d90 con 0x7fa9a8157de0 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a000d070 con 0x7fa9a8157de0 2023-11-28T20:39:13.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000ea90 con 0x7fa9a8157de0 2023-11-28T20:39:13.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a80c4e30 con 0x7fa9a8157de0 2023-11-28T20:39:13.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a8150180 con 0x7fa9a8157de0 2023-11-28T20:39:13.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8154690 0x7fa9a8154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.468+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a8074770 con 0x7fa9a8154690 2023-11-28T20:39:13.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa9acfb3640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8154690 0x7fa9a8154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa9acfb3640 1 -- 172.21.15.167:0/1530805901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9a80c7920 con 0x7fa9a8154690 2023-11-28T20:39:13.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa9acfb3640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8154690 0x7fa9a8154a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4014990 tx=0x7fa9a4014e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa9a000ebf0 con 0x7fa9a8157de0 2023-11-28T20:39:13.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99d7fa640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa994066470 0x7fa994068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa9a0087390 con 0x7fa9a8157de0 2023-11-28T20:39:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4012b70 con 0x7fa9a8154690 2023-11-28T20:39:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa9a4012cd0 con 0x7fa9a8154690 2023-11-28T20:39:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8154690 msgr2=0x7fa9a8154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99d7fa640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8154690 0x7fa9a8154a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4014990 tx=0x7fa9a4014e50 comp rx=0 tx=0).stop 2023-11-28T20:39:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8154690 msgr2=0x7fa9a8154a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99d7fa640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8154690 0x7fa9a8154a70 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4014990 tx=0x7fa9a4014e50 comp rx=0 tx=0).stop 2023-11-28T20:39:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99ffff640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa994066470 0x7fa994068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.472+0000 7fa99ffff640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa994066470 0x7fa994068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa9980ab000 tx=0x7fa9980a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a81468d0 0x7fa9a8146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80c5e90 con 0x7fa9a81468d0 2023-11-28T20:39:13.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9acfb3640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a81468d0 0x7fa9a8146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9acfb3640 1 -- 172.21.15.167:0/1530805901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa9a80682c0 con 0x7fa9a81468d0 2023-11-28T20:39:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9acfb3640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a81468d0 0x7fa9a8146cb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4014990 tx=0x7fa9a4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4025ab0 con 0x7fa9a81468d0 2023-11-28T20:39:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4981 (secure 0 0 0) 0x7fa9a4025c10 con 0x7fa9a81468d0 2023-11-28T20:39:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a81468d0 msgr2=0x7fa9a8146cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa99d7fa640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a81468d0 0x7fa9a8146cb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4014990 tx=0x7fa9a4004740 comp rx=0 tx=0).stop 2023-11-28T20:39:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa99d7fa640 1 -- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a81468d0 msgr2=0x7fa9a8146cb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa99d7fa640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a81468d0 0x7fa9a8146cb0 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4014990 tx=0x7fa9a4004740 comp rx=0 tx=0).stop 2023-11-28T20:39:13.484 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 8, 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 78, 2023-11-28T20:39:13.485 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:13.486 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:13.487 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:13.487 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:39:13.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:39:13.487 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:13.488 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:13.488 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:13.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:13.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:13.488 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:13.489 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:13.489 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:13.489 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:13.489 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:13.490 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.490 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:39:13.490 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:39:13.490 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:39:13.490 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:39:13.490 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:39:13.491 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:13.492 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:13.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:13.495 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:13.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.496 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:13.496 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:39:13.496 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.496 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:13.496 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:39:13.496 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:13.498 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:13.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.500 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:39:13.501 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.502 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.502 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:39:13.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.502 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.502 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.502 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:13.502 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.502 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:39:13.503 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:39:13.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa994066470 msgr2=0x7fa994068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa994066470 0x7fa994068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa9980ab000 tx=0x7fa9980a7070 comp rx=0 tx=0).stop 2023-11-28T20:39:13.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8157de0 msgr2=0x7fa9a8158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 --2- 172.21.15.167:0/1530805901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a8157de0 0x7fa9a8158260 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa9a815e260 tx=0x7fa9a0010f40 comp rx=0 tx=0).stop 2023-11-28T20:39:13.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9ad7b4640 1 -- 172.21.15.167:0/1530805901 reap_dead start 2023-11-28T20:39:13.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9ad7b4640 1 -- 172.21.15.167:0/1530805901 reap_dead start 2023-11-28T20:39:13.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 shutdown_connections 2023-11-28T20:39:13.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 >> 172.21.15.167:0/1530805901 conn(0x7fa9a80cb1e0 msgr2=0x7fa9a8070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:13.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 shutdown_connections 2023-11-28T20:39:13.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.480+0000 7fa9af217640 1 -- 172.21.15.167:0/1530805901 wait complete. 2023-11-28T20:39:13.506 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:39:13.506 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:39:13.506 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:39:13.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02c5df5640 1 Processor -- start 2023-11-28T20:39:13.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02c5df5640 1 -- start start 2023-11-28T20:39:13.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02c5df5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f02c0151f60 0x7f02c00c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02c5df5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c00c6120 con 0x7f02c006a580 2023-11-28T20:39:13.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02c5df5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c015b220 con 0x7f02c00c5c90 2023-11-28T20:39:13.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02c5df5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c00c4da0 con 0x7f02c0151f60 2023-11-28T20:39:13.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02bf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f02c0151f60 0x7f02c00c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02bffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f02c006a580 0x7f02c01625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48684/0 (socket says 172.21.15.167:48684) 2023-11-28T20:39:13.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02bffff640 1 -- 172.21.15.167:0/3788032 learned_addr learned my addr 172.21.15.167:0/3788032 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:13.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02bf7fe640 1 -- 172.21.15.167:0/3788032 >> v1:172.21.15.178:6789/0 conn(0x7f02c00c5c90 legacy=0x7f02c00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:13.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02bf7fe640 1 -- 172.21.15.167:0/3788032 >> v1:172.21.15.167:6789/0 conn(0x7f02c006a580 legacy=0x7f02c01625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02bf7fe640 1 -- 172.21.15.167:0/3788032 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0152340 con 0x7f02c0151f60 2023-11-28T20:39:13.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.644+0000 7f02be7fc640 1 -- 172.21.15.167:0/3788032 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268004633 0 0) 0x7f02b80014a0 con 0x7f02c006a580 2023-11-28T20:39:13.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02bf7fe640 1 --2- 172.21.15.167:0/3788032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 0x7f02c00c75c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f02b00097c0 tx=0x7f02b001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80db73178b8b6ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02be7fc640 1 -- 172.21.15.167:0/3788032 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b00ab600 con 0x7f02c0151f60 2023-11-28T20:39:13.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02be7fc640 1 -- 172.21.15.167:0/3788032 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b00a7050 con 0x7f02c0151f60 2023-11-28T20:39:13.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02be7fc640 1 -- 172.21.15.167:0/3788032 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b00ab980 con 0x7f02c0151f60 2023-11-28T20:39:13.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02c5df5640 1 -- 172.21.15.167:0/3788032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 msgr2=0x7f02c00c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02c5df5640 1 --2- 172.21.15.167:0/3788032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 0x7f02c00c75c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f02b00097c0 tx=0x7f02b001c3b0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02c5df5640 1 -- 172.21.15.167:0/3788032 shutdown_connections 2023-11-28T20:39:13.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02c5df5640 1 --2- 172.21.15.167:0/3788032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 0x7f02c00c75c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02c5df5640 1 -- 172.21.15.167:0/3788032 >> 172.21.15.167:0/3788032 conn(0x7f02c00cb1e0 msgr2=0x7f02c00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:13.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02c5df5640 1 -- 172.21.15.167:0/3788032 shutdown_connections 2023-11-28T20:39:13.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.648+0000 7f02c5df5640 1 -- 172.21.15.167:0/3788032 wait complete. 2023-11-28T20:39:13.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 Processor -- start 2023-11-28T20:39:13.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 -- start start 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c006a580 0x7f02c0070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02c00c5c90 0x7f02c0150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 0x7f02c01f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01f6d70 con 0x7f02c0151f60 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c014d3f0 con 0x7f02c006a580 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01f28b0 con 0x7f02c00c5c90 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 0x7f02c01f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 0x7f02c01f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44172/0 (socket says 172.21.15.167:44172) 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bffff640 1 -- 172.21.15.167:0/2972632293 learned_addr learned my addr 172.21.15.167:0/2972632293 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bf7fe640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c006a580 0x7f02c0070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02beffd640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02c00c5c90 0x7f02c0150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bffff640 1 -- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02c00c5c90 msgr2=0x7f02c0150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bffff640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02c00c5c90 0x7f02c0150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bffff640 1 -- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c006a580 msgr2=0x7f02c0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bffff640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c006a580 0x7f02c0070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bffff640 1 -- 172.21.15.167:0/2972632293 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0009420 con 0x7f02c0151f60 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02beffd640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02c00c5c90 0x7f02c0150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02bffff640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 0x7f02c01f2fe0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c780 tx=0x7f02b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b800ce90 con 0x7f02c0151f60 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b800a5e0 con 0x7f02c0151f60 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b800a970 con 0x7f02c0151f60 2023-11-28T20:39:13.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c015afd0 con 0x7f02c0151f60 2023-11-28T20:39:13.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c01f64d0 con 0x7f02c0151f60 2023-11-28T20:39:13.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c01f2a20 0x7f02c0140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.652+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0074770 con 0x7f02c01f2a20 2023-11-28T20:39:13.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02bf7fe640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c01f2a20 0x7f02c0140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02bf7fe640 1 -- 172.21.15.167:0/2972632293 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02c0163b60 con 0x7f02c01f2a20 2023-11-28T20:39:13.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02b800aad0 con 0x7f02c0151f60 2023-11-28T20:39:13.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02bf7fe640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c01f2a20 0x7f02c0140400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f02c00c5580 tx=0x7f02b001abf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02a7fff640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02ac066470 0x7f02ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02b8083590 con 0x7f02c0151f60 2023-11-28T20:39:13.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b00b6680 con 0x7f02c01f2a20 2023-11-28T20:39:13.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02beffd640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02ac066470 0x7f02ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f02b00b67e0 con 0x7f02c01f2a20 2023-11-28T20:39:13.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c01f2a20 msgr2=0x7f02c0140400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02a7fff640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c01f2a20 0x7f02c0140400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f02c00c5580 tx=0x7f02b001abf0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c01f2a20 msgr2=0x7f02c0140400 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:13.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02a7fff640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c01f2a20 0x7f02c0140400 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f02c00c5580 tx=0x7f02b001abf0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.656+0000 7f02beffd640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02ac066470 0x7f02ac068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f02c0155760 tx=0x7f02b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c014eff0 0x7f02c0140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c006ada0 con 0x7f02c014eff0 2023-11-28T20:39:13.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02bf7fe640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c014eff0 0x7f02c0140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02bf7fe640 1 -- 172.21.15.167:0/2972632293 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f02c015ba30 con 0x7f02c014eff0 2023-11-28T20:39:13.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02bf7fe640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c014eff0 0x7f02c0140940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f02b0019fe0 tx=0x7f02b0019150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b00c1c00 con 0x7f02c014eff0 2023-11-28T20:39:13.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4809 (secure 0 0 0) 0x7f02b00c1d60 con 0x7f02c014eff0 2023-11-28T20:39:13.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c014eff0 msgr2=0x7f02c0140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02a7fff640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c014eff0 0x7f02c0140940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f02b0019fe0 tx=0x7f02b0019150 comp rx=0 tx=0).stop 2023-11-28T20:39:13.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02a7fff640 1 -- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c014eff0 msgr2=0x7f02c0140940 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:13.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02a7fff640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02c014eff0 0x7f02c0140940 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f02b0019fe0 tx=0x7f02b0019150 comp rx=0 tx=0).stop 2023-11-28T20:39:13.670 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:39:13.670 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:13.670 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:13.670 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:39:13.670 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 8, 2023-11-28T20:39:13.670 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:39:13.670 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:39:13.670 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:39:13.670 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 79, 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:13.671 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:13.672 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:39:13.673 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:39:13.674 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:39:13.674 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:39:13.674 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:39:13.674 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:13.675 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.676 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:39:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:39:13.678 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.679 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:39:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:39:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:13.681 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.683 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.684 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.685 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:39:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.686 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:39:13.686 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02ac066470 msgr2=0x7f02ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f02ac066470 0x7f02ac068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f02c0155760 tx=0x7f02b4009040 comp rx=0 tx=0).stop 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 msgr2=0x7f02c01f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 --2- 172.21.15.167:0/2972632293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c0151f60 0x7f02c01f2fe0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f02b800c780 tx=0x7f02b800cc40 comp rx=0 tx=0).stop 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02bffff640 1 -- 172.21.15.167:0/2972632293 reap_dead start 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02bffff640 1 -- 172.21.15.167:0/2972632293 reap_dead start 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 shutdown_connections 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 >> 172.21.15.167:0/2972632293 conn(0x7f02c00cb1e0 msgr2=0x7f02c0147d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 shutdown_connections 2023-11-28T20:39:13.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.664+0000 7f02c5df5640 1 -- 172.21.15.167:0/2972632293 wait complete. 2023-11-28T20:39:13.689 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:39:13.689 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:39:13.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:39:13.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed32757640 1 Processor -- start 2023-11-28T20:39:13.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed32757640 1 -- start start 2023-11-28T20:39:13.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed32757640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cf860 0x7fed2c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed32757640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed2c0cfc40 0x7fed2c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed32757640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2c15ac00 con 0x7fed2c153ae0 2023-11-28T20:39:13.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed32757640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2c0cbd60 con 0x7fed2c0cfc40 2023-11-28T20:39:13.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed32757640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c159ff0 con 0x7fed2c0cf860 2023-11-28T20:39:13.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed2b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed2c0cfc40 0x7fed2c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed30cf4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fed2c153ae0 0x7fed2c15d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48700/0 (socket says 172.21.15.167:48700) 2023-11-28T20:39:13.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.824+0000 7fed30cf4640 1 -- 172.21.15.167:0/4290699575 learned_addr learned my addr 172.21.15.167:0/4290699575 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:13.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.828+0000 7fed2bfff640 1 --2- 172.21.15.167:0/4290699575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cf860 0x7fed2c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.828+0000 7fed2b7fe640 1 -- 172.21.15.167:0/4290699575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cf860 msgr2=0x7fed2c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:13.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.828+0000 7fed2b7fe640 1 --2- 172.21.15.167:0/4290699575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cf860 0x7fed2c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.828+0000 7fed2b7fe640 1 -- 172.21.15.167:0/4290699575 >> v1:172.21.15.167:6789/0 conn(0x7fed2c153ae0 legacy=0x7fed2c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.828+0000 7fed2b7fe640 1 -- 172.21.15.167:0/4290699575 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c15a2d0 con 0x7fed2c0cfc40 2023-11-28T20:39:13.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.828+0000 7fed2b7fe640 1 --2- 172.21.15.167:0/4290699575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c0cfc40 0x7fed2c0ca510 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed200097c0 tx=0x7fed2001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee983a4ade1544f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.828+0000 7fed2affd640 1 -- 172.21.15.167:0/4290699575 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed200ab650 con 0x7fed2c0cfc40 2023-11-28T20:39:13.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.828+0000 7fed2affd640 1 -- 172.21.15.167:0/4290699575 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed200ab7b0 con 0x7fed2c0cfc40 2023-11-28T20:39:13.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.828+0000 7fed2affd640 1 -- 172.21.15.167:0/4290699575 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed200abb40 con 0x7fed2c0cfc40 2023-11-28T20:39:13.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 -- 172.21.15.167:0/4290699575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c0cfc40 msgr2=0x7fed2c0ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 --2- 172.21.15.167:0/4290699575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c0cfc40 0x7fed2c0ca510 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed200097c0 tx=0x7fed2001c450 comp rx=0 tx=0).stop 2023-11-28T20:39:13.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 -- 172.21.15.167:0/4290699575 shutdown_connections 2023-11-28T20:39:13.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 --2- 172.21.15.167:0/4290699575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c0cfc40 0x7fed2c0ca510 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 --2- 172.21.15.167:0/4290699575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cf860 0x7fed2c0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 -- 172.21.15.167:0/4290699575 >> 172.21.15.167:0/4290699575 conn(0x7fed2c06c1f0 msgr2=0x7fed2c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:13.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 -- 172.21.15.167:0/4290699575 shutdown_connections 2023-11-28T20:39:13.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 -- 172.21.15.167:0/4290699575 wait complete. 2023-11-28T20:39:13.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 Processor -- start 2023-11-28T20:39:13.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 -- start start 2023-11-28T20:39:13.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cf860 0x7fed2c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed2c0cfc40 0x7fed2c1463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c153ae0 0x7fed2c1f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c150d90 con 0x7fed2c153ae0 2023-11-28T20:39:13.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c14dff0 con 0x7fed2c0cfc40 2023-11-28T20:39:13.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed32757640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c145bc0 con 0x7fed2c0cf860 2023-11-28T20:39:13.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed30cf4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c153ae0 0x7fed2c1f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed30cf4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c153ae0 0x7fed2c1f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44190/0 (socket says 172.21.15.167:44190) 2023-11-28T20:39:13.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed30cf4640 1 -- 172.21.15.167:0/3265742552 learned_addr learned my addr 172.21.15.167:0/3265742552 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:13.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed2bfff640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cf860 0x7fed2c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed2b7fe640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed2c0cfc40 0x7fed2c1463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed30cf4640 1 -- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cf860 msgr2=0x7fed2c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed30cf4640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c0cf860 0x7fed2c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed30cf4640 1 -- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed2c0cfc40 msgr2=0x7fed2c1463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed30cf4640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed2c0cfc40 0x7fed2c1463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed30cf4640 1 -- 172.21.15.167:0/3265742552 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20009420 con 0x7fed2c153ae0 2023-11-28T20:39:13.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.832+0000 7fed30cf4640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c153ae0 0x7fed2c1f2d40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fed2400cbc0 tx=0x7fed2400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2400ad40 con 0x7fed2c153ae0 2023-11-28T20:39:13.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24012400 con 0x7fed2c153ae0 2023-11-28T20:39:13.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2400aea0 con 0x7fed2c153ae0 2023-11-28T20:39:13.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c0b5580 con 0x7fed2c153ae0 2023-11-28T20:39:13.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c145e10 con 0x7fed2c153ae0 2023-11-28T20:39:13.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed32757640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1f3280 0x7fed2c143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c072860 con 0x7fed2c1f3280 2023-11-28T20:39:13.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed2bfff640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1f3280 0x7fed2c143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed24007070 con 0x7fed2c153ae0 2023-11-28T20:39:13.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed2bfff640 1 -- 172.21.15.167:0/3265742552 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed2c151340 con 0x7fed2c1f3280 2023-11-28T20:39:13.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed2bfff640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1f3280 0x7fed2c143d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed1c011510 tx=0x7fed1c0119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed28ff9640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed18066470 0x7fed18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fed24084240 con 0x7fed2c153ae0 2023-11-28T20:39:13.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c004230 con 0x7fed2c1f3280 2023-11-28T20:39:13.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed2b7fe640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed18066470 0x7fed18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.836+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fed1c004390 con 0x7fed2c1f3280 2023-11-28T20:39:13.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.840+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1f3280 msgr2=0x7fed2c143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.840+0000 7fed28ff9640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1f3280 0x7fed2c143d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed1c011510 tx=0x7fed1c0119d0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.840+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1f3280 msgr2=0x7fed2c143d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:13.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.840+0000 7fed28ff9640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1f3280 0x7fed2c143d50 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed1c011510 tx=0x7fed1c0119d0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.840+0000 7fed2b7fe640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed18066470 0x7fed18068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed200af000 tx=0x7fed200a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.844+0000 7fed32757640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1454d0 0x7fed2c144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:13.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.844+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c146000 con 0x7fed2c1454d0 2023-11-28T20:39:13.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.844+0000 7fed2bfff640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1454d0 0x7fed2c144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:13.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.844+0000 7fed2bfff640 1 -- 172.21.15.167:0/3265742552 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fed2c154300 con 0x7fed2c1454d0 2023-11-28T20:39:13.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.844+0000 7fed2bfff640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1454d0 0x7fed2c144290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed1c011510 tx=0x7fed1c0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:13.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.844+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c024070 con 0x7fed2c1454d0 2023-11-28T20:39:13.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5122 (secure 0 0 0) 0x7fed1c003620 con 0x7fed2c1454d0 2023-11-28T20:39:13.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1454d0 msgr2=0x7fed2c144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed28ff9640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1454d0 0x7fed2c144290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed1c011510 tx=0x7fed1c0046d0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed28ff9640 1 -- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1454d0 msgr2=0x7fed2c144290 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:13.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed28ff9640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed2c1454d0 0x7fed2c144290 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed1c011510 tx=0x7fed1c0046d0 comp rx=0 tx=0).stop 2023-11-28T20:39:13.853 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:39:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:39:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 8, 2023-11-28T20:39:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:39:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:39:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:39:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:39:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 79, 2023-11-28T20:39:13.855 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:13.855 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:39:13.855 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:39:13.855 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:13.855 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:13.855 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:13.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:13.855 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:13.856 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:13.856 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:13.856 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:13.856 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:13.856 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:13.856 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.856 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:39:13.856 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:13.857 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:39:13.858 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:39:13.859 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:39:13.859 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:39:13.859 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:39:13.859 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:39:13.859 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:39:13.859 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:13.859 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:39:13.859 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:39:13.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:13.862 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:13.863 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:39:13.864 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.864 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:13.864 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:39:13.864 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.864 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.864 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.865 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:39:13.865 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:39:13.865 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:13.865 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:13.865 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:13.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.866 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:13.866 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:13.866 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:13.866 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:13.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.866 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:13.867 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:39:13.867 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.867 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:13.867 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:39:13.868 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:13.868 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.868 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.868 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:39:13.868 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:39:13.869 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:13.869 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:13.869 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:13.869 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.869 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.869 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:39:13.870 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:39:13.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.870 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.870 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.870 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:13.871 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.871 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.871 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:39:13.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.871 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.872 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.872 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:13.872 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.872 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.872 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:39:13.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.873 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.873 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.873 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:13.873 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.873 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.873 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:39:13.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.873 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:39:13.874 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.874 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:13.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.874 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.874 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.875 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:39:13.875 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.875 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:13.875 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:39:13.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:13.875 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:13.876 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:13.876 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:13.876 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:13.876 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:13.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:13.876 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:39:13.876 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:39:13.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed18066470 msgr2=0x7fed18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed32757640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed18066470 0x7fed18068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fed200af000 tx=0x7fed200a7000 comp rx=0 tx=0).stop 2023-11-28T20:39:13.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c153ae0 msgr2=0x7fed2c1f2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:13.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed32757640 1 --2- 172.21.15.167:0/3265742552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2c153ae0 0x7fed2c1f2d40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fed2400cbc0 tx=0x7fed2400a430 comp rx=0 tx=0).stop 2023-11-28T20:39:13.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed30cf4640 1 -- 172.21.15.167:0/3265742552 reap_dead start 2023-11-28T20:39:13.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed30cf4640 1 -- 172.21.15.167:0/3265742552 reap_dead start 2023-11-28T20:39:13.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 shutdown_connections 2023-11-28T20:39:13.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 >> 172.21.15.167:0/3265742552 conn(0x7fed2c06c1f0 msgr2=0x7fed2c0c54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:13.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 shutdown_connections 2023-11-28T20:39:13.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:13.848+0000 7fed32757640 1 -- 172.21.15.167:0/3265742552 wait complete. 2023-11-28T20:39:13.881 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:39:13.882 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2023-11-28T20:39:13.882 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:39:13.882 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2023-11-28T20:39:13.882 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:39:13.883 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:39:13.883 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:39:13.904 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:39:13.904 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:39:13.904 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:39:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.036+0000 7f51741aa640 1 Processor -- start 2023-11-28T20:39:14.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f51741aa640 1 -- start start 2023-11-28T20:39:14.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f51741aa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f516c0c6ff0 0x7f516c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:14.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f51741aa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f516c0c4510 0x7f516c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:14.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f51741aa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516c0c48f0 con 0x7f516c150b40 2023-11-28T20:39:14.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f51741aa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c0c62f0 con 0x7f516c0c6ff0 2023-11-28T20:39:14.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f51741aa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c0c6ac0 con 0x7f516c0c4510 2023-11-28T20:39:14.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f5171745640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f516c0c6ff0 0x7f516c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:14.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f5171745640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f516c0c6ff0 0x7f516c157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44206/0 (socket says 172.21.15.167:44206) 2023-11-28T20:39:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f5171745640 1 -- 172.21.15.167:0/2626239906 learned_addr learned my addr 172.21.15.167:0/2626239906 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f5172747640 1 --2- 172.21.15.167:0/2626239906 >> v2:172.21.15.178:3300/0 conn(0x7f516c0c4510 0x7f516c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f5171745640 1 -- 172.21.15.167:0/2626239906 >> v2:172.21.15.178:3300/0 conn(0x7f516c0c4510 msgr2=0x7f516c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f5171745640 1 --2- 172.21.15.167:0/2626239906 >> v2:172.21.15.178:3300/0 conn(0x7f516c0c4510 0x7f516c06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f5171745640 1 -- 172.21.15.167:0/2626239906 >> v1:172.21.15.178:6789/0 conn(0x7f516c150b40 legacy=0x7f516c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.040+0000 7f5171745640 1 -- 172.21.15.167:0/2626239906 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0c6500 con 0x7f516c0c6ff0 2023-11-28T20:39:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f5171745640 1 --2- 172.21.15.167:0/2626239906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 0x7f516c157560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f516c0cc270 tx=0x7f515c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f00f00dd123cba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:14.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f5170f44640 1 -- 172.21.15.167:0/2626239906 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0a7a80 con 0x7f516c0c6ff0 2023-11-28T20:39:14.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f5170f44640 1 -- 172.21.15.167:0/2626239906 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c0a7be0 con 0x7f516c0c6ff0 2023-11-28T20:39:14.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f5170f44640 1 -- 172.21.15.167:0/2626239906 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0af440 con 0x7f516c0c6ff0 2023-11-28T20:39:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 -- 172.21.15.167:0/2626239906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 msgr2=0x7f516c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 --2- 172.21.15.167:0/2626239906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 0x7f516c157560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f516c0cc270 tx=0x7f515c01eba0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 -- 172.21.15.167:0/2626239906 shutdown_connections 2023-11-28T20:39:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 --2- 172.21.15.167:0/2626239906 >> v2:172.21.15.178:3300/0 conn(0x7f516c0c4510 0x7f516c06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 --2- 172.21.15.167:0/2626239906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 0x7f516c157560 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 -- 172.21.15.167:0/2626239906 >> 172.21.15.167:0/2626239906 conn(0x7f516c0cb1e0 msgr2=0x7f516c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 -- 172.21.15.167:0/2626239906 shutdown_connections 2023-11-28T20:39:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 -- 172.21.15.167:0/2626239906 wait complete. 2023-11-28T20:39:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 Processor -- start 2023-11-28T20:39:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.044+0000 7f51741aa640 1 -- start start 2023-11-28T20:39:14.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51741aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f516c0c4510 0x7f516c1f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51741aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 0x7f516c14a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51741aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f516c150b40 0x7f516c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51741aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c14c030 con 0x7f516c0c6ff0 2023-11-28T20:39:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51741aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c14f9d0 con 0x7f516c0c4510 2023-11-28T20:39:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51741aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c14bc90 con 0x7f516c150b40 2023-11-28T20:39:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5172747640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f516c150b40 msgr2=0x7f516c0ca720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171745640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 0x7f516c14a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5172747640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f516c150b40 0x7f516c0ca720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:14.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171745640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 0x7f516c14a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44218/0 (socket says 172.21.15.167:44218) 2023-11-28T20:39:14.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171745640 1 -- 172.21.15.167:0/654148343 learned_addr learned my addr 172.21.15.167:0/654148343 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:14.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171f46640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f516c0c4510 0x7f516c1f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:14.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171745640 1 -- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f516c150b40 msgr2=0x7f516c0ca720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:14.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171745640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f516c150b40 0x7f516c0ca720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171745640 1 -- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f516c0c4510 msgr2=0x7f516c1f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:14.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171745640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f516c0c4510 0x7f516c1f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171745640 1 -- 172.21.15.167:0/654148343 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c00b770 con 0x7f516c0c6ff0 2023-11-28T20:39:14.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171f46640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f516c0c4510 0x7f516c1f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:14.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f5171745640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 0x7f516c14a020 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f515c01b7b0 tx=0x7f515c01b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:14.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51627fc640 1 -- 172.21.15.167:0/654148343 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0ba660 con 0x7f516c0c6ff0 2023-11-28T20:39:14.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51627fc640 1 -- 172.21.15.167:0/654148343 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c0ba7c0 con 0x7f516c0c6ff0 2023-11-28T20:39:14.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c1f6780 con 0x7f516c0c6ff0 2023-11-28T20:39:14.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51627fc640 1 -- 172.21.15.167:0/654148343 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0bab70 con 0x7f516c0c6ff0 2023-11-28T20:39:14.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c14fc70 con 0x7f516c0c6ff0 2023-11-28T20:39:14.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.048+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c0682c0 con 0x7f516c0c6ff0 2023-11-28T20:39:14.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.052+0000 7f51627fc640 1 -- 172.21.15.167:0/654148343 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f515c0a7d50 con 0x7f516c0c6ff0 2023-11-28T20:39:14.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.052+0000 7f51627fc640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5150066420 0x7f51500688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:14.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.052+0000 7f51627fc640 1 -- 172.21.15.167:0/654148343 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f515c11eed0 con 0x7f516c0c6ff0 2023-11-28T20:39:14.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.052+0000 7f5171f46640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5150066420 0x7f51500688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:14.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.052+0000 7f5171f46640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5150066420 0x7f51500688e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5168000f70 tx=0x7f5168009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:14.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.056+0000 7f51627fc640 1 -- 172.21.15.167:0/654148343 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f515c0ebf00 con 0x7f516c0c6ff0 2023-11-28T20:39:14.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.256+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f516c14c170 con 0x7f516c0c6ff0 2023-11-28T20:39:14.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.256+0000 7f51627fc640 1 -- 172.21.15.167:0/654148343 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7f516c14c170 con 0x7f516c0c6ff0 2023-11-28T20:39:14.262 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":79,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:39:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5150066420 msgr2=0x7f51500688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5150066420 0x7f51500688e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5168000f70 tx=0x7f5168009040 comp rx=0 tx=0).stop 2023-11-28T20:39:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 msgr2=0x7f516c14a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 0x7f516c14a020 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f515c01b7b0 tx=0x7f515c01b940 comp rx=0 tx=0).stop 2023-11-28T20:39:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 shutdown_connections 2023-11-28T20:39:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5150066420 0x7f51500688e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f516c150b40 0x7f516c0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f516c0c6ff0 0x7f516c14a020 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 --2- 172.21.15.167:0/654148343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f516c0c4510 0x7f516c1f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 >> 172.21.15.167:0/654148343 conn(0x7f516c0cb1e0 msgr2=0x7f516c160240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 shutdown_connections 2023-11-28T20:39:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:14.260+0000 7f51741aa640 1 -- 172.21.15.167:0/654148343 wait complete. 2023-11-28T20:39:14.655 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:14.658 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:17.284 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:39:17.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.424+0000 7f94fa232640 1 Processor -- start 2023-11-28T20:39:17.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.424+0000 7f94fa232640 1 -- start start 2023-11-28T20:39:17.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.424+0000 7f94fa232640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 0x7f94f4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:17.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.424+0000 7f94fa232640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f41571d0 con 0x7f94f406e030 2023-11-28T20:39:17.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.424+0000 7f94fa232640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f4071a90 con 0x7f94f406e410 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.424+0000 7f94fa232640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40c70d0 con 0x7f94f4070480 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f37fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f94f406e030 0x7f94f41500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48708/0 (socket says 172.21.15.167:48708) 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f37fe640 1 -- 172.21.15.167:0/3989406358 learned_addr learned my addr 172.21.15.167:0/3989406358 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f2ffd640 1 -- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 msgr2=0x7f94f4071f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f2ffd640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 0x7f94f4071f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848055820 0 0) 0x7f94f41571d0 con 0x7f94f406e030 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94dc003450 con 0x7f94f406e030 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1458738459 0 0) 0x7f94dc003450 con 0x7f94f406e030 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 msgr2=0x7f94f4071f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 0x7f94f4071f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 >> v1:172.21.15.178:6789/0 conn(0x7f94f406e410 legacy=0x7f94f4160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40c73b0 con 0x7f94f406e030 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f94e4001680 con 0x7f94f406e030 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 >> v1:172.21.15.167:6789/0 conn(0x7f94f406e030 legacy=0x7f94f41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc003aa0 0x7f94dc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 0x7f94dc00a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94dc00d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40c70d0 con 0x7f94dc00b110 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc00dd80 con 0x7f94dc003aa0 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc00df40 con 0x7f94f4070480 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f2ffd640 1 -- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 msgr2=0x7f94dc00a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f2ffd640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 0x7f94dc00a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:17.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f3fff640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94dc00d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:17.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f37fe640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc003aa0 0x7f94dc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:17.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f3fff640 1 -- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 msgr2=0x7f94dc00a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:39:17.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f3fff640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4070480 0x7f94dc00a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f3fff640 1 -- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc003aa0 msgr2=0x7f94dc003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:17.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f3fff640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc003aa0 0x7f94dc003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.428+0000 7f94f3fff640 1 -- 172.21.15.167:0/3989406358 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc003450 con 0x7f94dc00b110 2023-11-28T20:39:17.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94f3fff640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94dc00d5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f94f40c9090 tx=0x7f94ec01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64330e501716c226 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:17.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec003b80 con 0x7f94dc00b110 2023-11-28T20:39:17.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec003ce0 con 0x7f94dc00b110 2023-11-28T20:39:17.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94f27fc640 1 -- 172.21.15.167:0/3989406358 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec005310 con 0x7f94dc00b110 2023-11-28T20:39:17.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94fa232640 1 -- 172.21.15.167:0/3989406358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 msgr2=0x7f94dc00d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:17.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94fa232640 1 --2- 172.21.15.167:0/3989406358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94dc00d5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f94f40c9090 tx=0x7f94ec01c700 comp rx=0 tx=0).stop 2023-11-28T20:39:17.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94f3fff640 1 -- 172.21.15.167:0/3989406358 reap_dead start 2023-11-28T20:39:17.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94fa232640 1 -- 172.21.15.167:0/3989406358 shutdown_connections 2023-11-28T20:39:17.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94fa232640 1 -- 172.21.15.167:0/3989406358 >> 172.21.15.167:0/3989406358 conn(0x7f94f40cb1e0 msgr2=0x7f94f40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:17.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94fa232640 1 -- 172.21.15.167:0/3989406358 shutdown_connections 2023-11-28T20:39:17.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94fa232640 1 -- 172.21.15.167:0/3989406358 wait complete. 2023-11-28T20:39:17.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94fa232640 1 Processor -- start 2023-11-28T20:39:17.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.432+0000 7f94fa232640 1 -- start start 2023-11-28T20:39:17.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94fa232640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94f4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94fa232640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f41f0340 0x7f94f41e17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94fa232640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f41e1d30 0x7f94f4157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94fa232640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41e5240 con 0x7f94dc00b110 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94fa232640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41573b0 con 0x7f94f41e1d30 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94fa232640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4157970 con 0x7f94f41f0340 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f2ffd640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f41f0340 msgr2=0x7f94f41e17f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f2ffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f41f0340 0x7f94f41e17f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94f4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94f4158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44238/0 (socket says 172.21.15.167:44238) 2023-11-28T20:39:17.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f37fe640 1 -- 172.21.15.167:0/411985145 learned_addr learned my addr 172.21.15.167:0/411985145 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:17.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f3fff640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f41e1d30 0x7f94f4157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:17.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f37fe640 1 -- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f41f0340 msgr2=0x7f94f41e17f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:17.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f37fe640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f41f0340 0x7f94f41e17f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f37fe640 1 -- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f41e1d30 msgr2=0x7f94f4157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:17.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f37fe640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f41e1d30 0x7f94f4157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f37fe640 1 -- 172.21.15.167:0/411985145 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f41590d0 con 0x7f94dc00b110 2023-11-28T20:39:17.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94f37fe640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94f4158a00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f94e40073a0 tx=0x7f94e4007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:17.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94dbfff640 1 -- 172.21.15.167:0/411985145 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4000ee0 con 0x7f94dc00b110 2023-11-28T20:39:17.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94dbfff640 1 -- 172.21.15.167:0/411985145 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e400f990 con 0x7f94dc00b110 2023-11-28T20:39:17.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94dbfff640 1 -- 172.21.15.167:0/411985145 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e400fd40 con 0x7f94dc00b110 2023-11-28T20:39:17.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f4159e70 con 0x7f94dc00b110 2023-11-28T20:39:17.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f415a430 con 0x7f94dc00b110 2023-11-28T20:39:17.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f40682c0 con 0x7f94dc00b110 2023-11-28T20:39:17.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.436+0000 7f94dbfff640 1 -- 172.21.15.167:0/411985145 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f94e401d360 con 0x7f94dc00b110 2023-11-28T20:39:17.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.440+0000 7f94dbfff640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f94e0066420 0x7f94e00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:17.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.440+0000 7f94dbfff640 1 -- 172.21.15.167:0/411985145 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f94e4083b80 con 0x7f94dc00b110 2023-11-28T20:39:17.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.440+0000 7f94f2ffd640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f94e0066420 0x7f94e00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:17.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.440+0000 7f94f2ffd640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f94e0066420 0x7f94e00688e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f94f40c4f60 tx=0x7f94e8006df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:17.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.444+0000 7f94dbfff640 1 -- 172.21.15.167:0/411985145 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94e4050bb0 con 0x7f94dc00b110 2023-11-28T20:39:17.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f94f415a650 con 0x7f94dc00b110 2023-11-28T20:39:17.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94dbfff640 1 -- 172.21.15.167:0/411985145 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7f94e401a070 con 0x7f94dc00b110 2023-11-28T20:39:17.651 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":83,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:39:17.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f94e0066420 msgr2=0x7f94e00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:17.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f94e0066420 0x7f94e00688e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f94f40c4f60 tx=0x7f94e8006df0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 msgr2=0x7f94f4158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:17.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94f4158a00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f94e40073a0 tx=0x7f94e4007860 comp rx=0 tx=0).stop 2023-11-28T20:39:17.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 shutdown_connections 2023-11-28T20:39:17.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f94e0066420 0x7f94e00688e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f41e1d30 0x7f94f4157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f41f0340 0x7f94f41e17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 --2- 172.21.15.167:0/411985145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94dc00b110 0x7f94f4158a00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:17.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 >> 172.21.15.167:0/411985145 conn(0x7f94f40cb1e0 msgr2=0x7f94f4071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:17.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 shutdown_connections 2023-11-28T20:39:17.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:17.648+0000 7f94fa232640 1 -- 172.21.15.167:0/411985145 wait complete. 2023-11-28T20:39:20.673 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:39:20.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.816+0000 7f498685a640 1 Processor -- start 2023-11-28T20:39:20.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.816+0000 7f498685a640 1 -- start start 2023-11-28T20:39:20.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f498685a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f49800cb770 0x7f498015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:20.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f498685a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498015ac00 con 0x7f49800cfc40 2023-11-28T20:39:20.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f498685a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49800cbd60 con 0x7f49800cf860 2023-11-28T20:39:20.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f498685a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4980159ff0 con 0x7f49800cb770 2023-11-28T20:39:20.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f4984df7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f49800cb770 0x7f498015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:20.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f497f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f49800cfc40 0x7f4980153ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48716/0 (socket says 172.21.15.167:48716) 2023-11-28T20:39:20.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f497f7fe640 1 -- 172.21.15.167:0/2232720589 learned_addr learned my addr 172.21.15.167:0/2232720589 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:20.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f4984df7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f49800cb770 0x7f498015d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44246/0 (socket says 172.21.15.167:44246) 2023-11-28T20:39:20.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f4984df7640 1 -- 172.21.15.167:0/2232720589 >> v1:172.21.15.178:6789/0 conn(0x7f49800cf860 legacy=0x7f49800ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:20.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f4984df7640 1 -- 172.21.15.167:0/2232720589 >> v1:172.21.15.167:6789/0 conn(0x7f49800cfc40 legacy=0x7f4980153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:20.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.820+0000 7f4984df7640 1 -- 172.21.15.167:0/2232720589 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498015a2d0 con 0x7f49800cb770 2023-11-28T20:39:20.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f4984df7640 1 --2- 172.21.15.167:0/2232720589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 0x7f498015d4d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4978009d90 tx=0x7f497801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8676e241b7ca21 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:20.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f497effd640 1 -- 172.21.15.167:0/2232720589 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49780a59e0 con 0x7f49800cb770 2023-11-28T20:39:20.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f497effd640 1 -- 172.21.15.167:0/2232720589 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49780a5b40 con 0x7f49800cb770 2023-11-28T20:39:20.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f497effd640 1 -- 172.21.15.167:0/2232720589 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49780ad440 con 0x7f49800cb770 2023-11-28T20:39:20.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f498685a640 1 -- 172.21.15.167:0/2232720589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 msgr2=0x7f498015d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:20.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f498685a640 1 --2- 172.21.15.167:0/2232720589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 0x7f498015d4d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4978009d90 tx=0x7f497801c920 comp rx=0 tx=0).stop 2023-11-28T20:39:20.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f498685a640 1 -- 172.21.15.167:0/2232720589 shutdown_connections 2023-11-28T20:39:20.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f498685a640 1 --2- 172.21.15.167:0/2232720589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 0x7f498015d4d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:20.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f498685a640 1 -- 172.21.15.167:0/2232720589 >> 172.21.15.167:0/2232720589 conn(0x7f498006c1f0 msgr2=0x7f4980071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:20.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f498685a640 1 -- 172.21.15.167:0/2232720589 shutdown_connections 2023-11-28T20:39:20.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f498685a640 1 -- 172.21.15.167:0/2232720589 wait complete. 2023-11-28T20:39:20.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f498685a640 1 Processor -- start 2023-11-28T20:39:20.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.824+0000 7f498685a640 1 -- start start 2023-11-28T20:39:20.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f498685a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 0x7f4980148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:20.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f498685a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49800cf860 0x7f4980154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f498685a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49800cfc40 0x7f4980155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f498685a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4980146f90 con 0x7f49800cb770 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f498685a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4980148950 con 0x7f49800cf860 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f498685a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4980154970 con 0x7f49800cfc40 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f4984df7640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49800cfc40 msgr2=0x7f4980155b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f4984df7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49800cfc40 0x7f4980155b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 0x7f4980148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 0x7f4980148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44250/0 (socket says 172.21.15.167:44250) 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497ffff640 1 -- 172.21.15.167:0/3198027123 learned_addr learned my addr 172.21.15.167:0/3198027123 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497f7fe640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49800cf860 0x7f4980154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497ffff640 1 -- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49800cfc40 msgr2=0x7f4980155b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497ffff640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49800cfc40 0x7f4980155b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497ffff640 1 -- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49800cf860 msgr2=0x7f4980154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497ffff640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49800cf860 0x7f4980154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497ffff640 1 -- 172.21.15.167:0/3198027123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978009a70 con 0x7f49800cb770 2023-11-28T20:39:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497f7fe640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49800cf860 0x7f4980154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497ffff640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 0x7f4980148410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f497000c3c0 tx=0x7f497000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497cff9640 1 -- 172.21.15.167:0/3198027123 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700052d0 con 0x7f49800cb770 2023-11-28T20:39:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497cff9640 1 -- 172.21.15.167:0/3198027123 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970005430 con 0x7f49800cb770 2023-11-28T20:39:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497cff9640 1 -- 172.21.15.167:0/3198027123 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970003840 con 0x7f49800cb770 2023-11-28T20:39:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4980154c10 con 0x7f49800cb770 2023-11-28T20:39:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4980157400 con 0x7f49800cb770 2023-11-28T20:39:20.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4980156f80 con 0x7f49800cb770 2023-11-28T20:39:20.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.828+0000 7f497cff9640 1 -- 172.21.15.167:0/3198027123 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f49700039a0 con 0x7f49800cb770 2023-11-28T20:39:20.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.832+0000 7f497cff9640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f496c066420 0x7f496c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:20.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.832+0000 7f497cff9640 1 -- 172.21.15.167:0/3198027123 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f49700836a0 con 0x7f49800cb770 2023-11-28T20:39:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.832+0000 7f497f7fe640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f496c066420 0x7f496c0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.832+0000 7f497f7fe640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f496c066420 0x7f496c0688e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f49800c5fe0 tx=0x7f4974009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:20.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:20.836+0000 7f497cff9640 1 -- 172.21.15.167:0/3198027123 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4980156f80 con 0x7f49800cb770 2023-11-28T20:39:21.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.036+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4980156f80 con 0x7f49800cb770 2023-11-28T20:39:21.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.036+0000 7f497cff9640 1 -- 172.21.15.167:0/3198027123 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7f4970017620 con 0x7f49800cb770 2023-11-28T20:39:21.041 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":86,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:39:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f496c066420 msgr2=0x7f496c0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f496c066420 0x7f496c0688e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f49800c5fe0 tx=0x7f4974009040 comp rx=0 tx=0).stop 2023-11-28T20:39:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 msgr2=0x7f4980148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:21.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 0x7f4980148410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f497000c3c0 tx=0x7f497000c880 comp rx=0 tx=0).stop 2023-11-28T20:39:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 shutdown_connections 2023-11-28T20:39:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f496c066420 0x7f496c0688e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49800cfc40 0x7f4980155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49800cf860 0x7f4980154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 --2- 172.21.15.167:0/3198027123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49800cb770 0x7f4980148410 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 >> 172.21.15.167:0/3198027123 conn(0x7f498006c1f0 msgr2=0x7f49800c4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 shutdown_connections 2023-11-28T20:39:21.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:21.040+0000 7f498685a640 1 -- 172.21.15.167:0/3198027123 wait complete. 2023-11-28T20:39:24.063 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:39:24.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36f2c8640 1 Processor -- start 2023-11-28T20:39:24.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36f2c8640 1 -- start start 2023-11-28T20:39:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36f2c8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36f2c8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc368071cc0 con 0x7fc3680c2750 2023-11-28T20:39:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36f2c8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc368071fa0 con 0x7fc368150b20 2023-11-28T20:39:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36f2c8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc368072840 con 0x7fc36806ac90 2023-11-28T20:39:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36dac5640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc3680c2750 0x7fc36806a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:42140/0 (socket says 172.21.15.167:42140) 2023-11-28T20:39:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36dac5640 1 -- 172.21.15.167:0/3579219397 learned_addr learned my addr 172.21.15.167:0/3579219397 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:24.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36eac7640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 msgr2=0x7fc36815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:39:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36eac7640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 msgr2=0x7fc36815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:39:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:24.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.208+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:24.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.412+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:24.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.412+0000 7fc36eac7640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 msgr2=0x7fc36815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:39:24.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.412+0000 7fc36eac7640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 msgr2=0x7fc36815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:39:24.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.412+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:24.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.412+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:39:24.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.816+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:24.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.816+0000 7fc36eac7640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 msgr2=0x7fc36815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:39:24.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.816+0000 7fc36eac7640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 msgr2=0x7fc36815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:39:24.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.816+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:24.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:24.816+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:39:25.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:25.620+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:25.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:25.620+0000 7fc36eac7640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 msgr2=0x7fc36815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:39:25.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:25.620+0000 7fc36eac7640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 msgr2=0x7fc36815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:39:25.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:25.620+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:25.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:25.620+0000 7fc36eac7640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:39:27.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc35ffff640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 msgr2=0x7fc36815a290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:39:27.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc35ffff640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.167:3300/0 conn(0x7fc36806ac90 0x7fc36815a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:27.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc35ffff640 1 -- 172.21.15.167:0/3579219397 >> v1:172.21.15.178:6789/0 conn(0x7fc368150b20 legacy=0x7fc368070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:27.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc35ffff640 1 -- 172.21.15.167:0/3579219397 >> v1:172.21.15.167:6789/0 conn(0x7fc3680c2750 legacy=0x7fc36806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:27.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc35ffff640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:27.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc35ffff640 1 --2- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 0x7fc34c0086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:27.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc35ffff640 1 -- 172.21.15.167:0/3579219397 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc368072840 con 0x7fc34c0036f0 2023-11-28T20:39:27.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc35ffff640 1 -- 172.21.15.167:0/3579219397 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c008e00 con 0x7fc34c006220 2023-11-28T20:39:27.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc36dac5640 1 -- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 msgr2=0x7fc34c0086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:27.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc36dac5640 1 --2- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 0x7fc34c0086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:27.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:27.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc36e2c6640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 msgr2=0x7fc34c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:39:27.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc36e2c6640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 msgr2=0x7fc34c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:39:27.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:27.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.212+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.416+0000 7fc36dac5640 1 -- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 msgr2=0x7fc34c0086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.416+0000 7fc36dac5640 1 --2- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 0x7fc34c0086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:39:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.416+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:27.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.416+0000 7fc36e2c6640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 msgr2=0x7fc34c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:39:27.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.416+0000 7fc36e2c6640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 msgr2=0x7fc34c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:39:27.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.416+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:27.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.416+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:39:27.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.820+0000 7fc36dac5640 1 -- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 msgr2=0x7fc34c0086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:27.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.820+0000 7fc36dac5640 1 --2- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 0x7fc34c0086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:39:27.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.820+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:27.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.820+0000 7fc36e2c6640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 msgr2=0x7fc34c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:39:27.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.820+0000 7fc36e2c6640 1 -- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 msgr2=0x7fc34c005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:39:27.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.820+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:27.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:27.820+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:39:28.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.624+0000 7fc36dac5640 1 -- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 msgr2=0x7fc34c0086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:28.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.624+0000 7fc36dac5640 1 --2- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 0x7fc34c0086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:39:28.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.624+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> v2:172.21.15.178:3300/0 conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:28.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.624+0000 7fc36e2c6640 1 -- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 msgr2=0x7fc34c0086e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:39:28.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.624+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c006220 0x7fc34c0086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.624+0000 7fc36e2c6640 1 -- 172.21.15.167:0/3579219397 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc368072280 con 0x7fc34c0036f0 2023-11-28T20:39:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc34c0036f0 0x7fc34c005b70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc364007fd0 tx=0x7fc36401c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1cded3245eb325 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36d2c4640 1 -- 172.21.15.167:0/3579219397 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640050d0 con 0x7fc34c0036f0 2023-11-28T20:39:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36d2c4640 1 -- 172.21.15.167:0/3579219397 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc364005230 con 0x7fc34c0036f0 2023-11-28T20:39:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36d2c4640 1 -- 172.21.15.167:0/3579219397 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640a5790 con 0x7fc34c0036f0 2023-11-28T20:39:28.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36f2c8640 1 -- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc34c0036f0 msgr2=0x7fc34c005b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:28.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36f2c8640 1 --2- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc34c0036f0 0x7fc34c005b70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc364007fd0 tx=0x7fc36401c9c0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36eac7640 1 -- 172.21.15.167:0/3579219397 reap_dead start 2023-11-28T20:39:28.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36f2c8640 1 -- 172.21.15.167:0/3579219397 shutdown_connections 2023-11-28T20:39:28.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36f2c8640 1 --2- 172.21.15.167:0/3579219397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc34c0036f0 0x7fc34c005b70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36f2c8640 1 -- 172.21.15.167:0/3579219397 >> 172.21.15.167:0/3579219397 conn(0x7fc3680cb1e0 msgr2=0x7fc3680cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:28.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36f2c8640 1 -- 172.21.15.167:0/3579219397 shutdown_connections 2023-11-28T20:39:28.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.628+0000 7fc36f2c8640 1 -- 172.21.15.167:0/3579219397 wait complete. 2023-11-28T20:39:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 Processor -- start 2023-11-28T20:39:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 -- start start 2023-11-28T20:39:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c0036f0 0x7fc36814bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3681ef890 0x7fc3680ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3680bd5c0 0x7fc368144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680ca2a0 con 0x7fc3681ef890 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36814f600 con 0x7fc3680bd5c0 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36814b640 con 0x7fc34c0036f0 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36e2c6640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c0036f0 msgr2=0x7fc36814bad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36e2c6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c0036f0 0x7fc36814bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36dac5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3681ef890 0x7fc3680ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36dac5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3681ef890 0x7fc3680ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60060/0 (socket says 172.21.15.167:60060) 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36dac5640 1 -- 172.21.15.167:0/2931828429 learned_addr learned my addr 172.21.15.167:0/2931828429 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36eac7640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3680bd5c0 0x7fc368144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:28.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36dac5640 1 -- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c0036f0 msgr2=0x7fc36814bad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:28.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36dac5640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c0036f0 0x7fc36814bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36dac5640 1 -- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3680bd5c0 msgr2=0x7fc368144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:28.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36dac5640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3680bd5c0 0x7fc368144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36dac5640 1 -- 172.21.15.167:0/2931828429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36400f040 con 0x7fc3681ef890 2023-11-28T20:39:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36dac5640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3681ef890 0x7fc3680ca770 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c700 tx=0x7fc35800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc35effd640 1 -- 172.21.15.167:0/2931828429 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358005aa0 con 0x7fc3681ef890 2023-11-28T20:39:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc35effd640 1 -- 172.21.15.167:0/2931828429 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358005c00 con 0x7fc3681ef890 2023-11-28T20:39:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc35effd640 1 -- 172.21.15.167:0/2931828429 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358007070 con 0x7fc3681ef890 2023-11-28T20:39:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36814c010 con 0x7fc3681ef890 2023-11-28T20:39:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3680ca490 con 0x7fc3681ef890 2023-11-28T20:39:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.632+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36804e850 con 0x7fc3681ef890 2023-11-28T20:39:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.636+0000 7fc35effd640 1 -- 172.21.15.167:0/2931828429 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc3580071d0 con 0x7fc3681ef890 2023-11-28T20:39:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.636+0000 7fc35effd640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc34c069a40 0x7fc34c06bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.636+0000 7fc35effd640 1 -- 172.21.15.167:0/2931828429 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc358083780 con 0x7fc3681ef890 2023-11-28T20:39:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.636+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc34c069a40 0x7fc34c06bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:28.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.636+0000 7fc36e2c6640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc34c069a40 0x7fc34c06bf00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc3640ae000 tx=0x7fc364011040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:28.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.640+0000 7fc35effd640 1 -- 172.21.15.167:0/2931828429 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc3580508e0 con 0x7fc3681ef890 2023-11-28T20:39:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc3680c79a0 con 0x7fc3681ef890 2023-11-28T20:39:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc35effd640 1 -- 172.21.15.167:0/2931828429 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7fc358017620 con 0x7fc3681ef890 2023-11-28T20:39:28.852 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":12,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:39:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc34c069a40 msgr2=0x7fc34c06bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc34c069a40 0x7fc34c06bf00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc3640ae000 tx=0x7fc364011040 comp rx=0 tx=0).stop 2023-11-28T20:39:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3681ef890 msgr2=0x7fc3680ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3681ef890 0x7fc3680ca770 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c700 tx=0x7fc35800cbc0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 shutdown_connections 2023-11-28T20:39:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc34c069a40 0x7fc34c06bf00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3680bd5c0 0x7fc368144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3681ef890 0x7fc3680ca770 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 --2- 172.21.15.167:0/2931828429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc34c0036f0 0x7fc36814bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:28.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.848+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 >> 172.21.15.167:0/2931828429 conn(0x7fc3680cb1e0 msgr2=0x7fc3680c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:28.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.852+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 shutdown_connections 2023-11-28T20:39:28.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:28.852+0000 7fc36f2c8640 1 -- 172.21.15.167:0/2931828429 wait complete. 2023-11-28T20:39:28.873 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:39:28.873 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:39:28.873 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:39:29.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f3488a67640 1 Processor -- start 2023-11-28T20:39:29.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f3488a67640 1 -- start start 2023-11-28T20:39:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f3488a67640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3484153d70 0x7f348415daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f3488a67640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f34840c2f00 0x7f34840c3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f3488a67640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34840c46f0 con 0x7f34840c7e90 2023-11-28T20:39:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f3488a67640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348415dfe0 con 0x7f3484153d70 2023-11-28T20:39:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f3488a67640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348406f700 con 0x7f34840c2f00 2023-11-28T20:39:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f34837fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3484153d70 0x7f348415daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f34837fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3484153d70 0x7f348415daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60076/0 (socket says 172.21.15.167:60076) 2023-11-28T20:39:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f34837fe640 1 -- 172.21.15.167:0/2592387548 learned_addr learned my addr 172.21.15.167:0/2592387548 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f3483fff640 1 --2- 172.21.15.167:0/2592387548 >> v2:172.21.15.178:3300/0 conn(0x7f34840c2f00 0x7f34840c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f34837fe640 1 -- 172.21.15.167:0/2592387548 >> v2:172.21.15.178:3300/0 conn(0x7f34840c2f00 msgr2=0x7f34840c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f34837fe640 1 --2- 172.21.15.167:0/2592387548 >> v2:172.21.15.178:3300/0 conn(0x7f34840c2f00 0x7f34840c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f34837fe640 1 -- 172.21.15.167:0/2592387548 >> v1:172.21.15.178:6789/0 conn(0x7f34840c7e90 legacy=0x7f348406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f34837fe640 1 -- 172.21.15.167:0/2592387548 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840c3870 con 0x7f3484153d70 2023-11-28T20:39:29.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.008+0000 7f3483fff640 1 --2- 172.21.15.167:0/2592387548 >> v2:172.21.15.178:3300/0 conn(0x7f34840c2f00 0x7f34840c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f34837fe640 1 --2- 172.21.15.167:0/2592387548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 0x7f348415daa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f34840c2b20 tx=0x7f347401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe46e649c8807c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3482ffd640 1 -- 172.21.15.167:0/2592387548 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740a89f0 con 0x7f3484153d70 2023-11-28T20:39:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3482ffd640 1 -- 172.21.15.167:0/2592387548 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34740a8b50 con 0x7f3484153d70 2023-11-28T20:39:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3482ffd640 1 -- 172.21.15.167:0/2592387548 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740b0440 con 0x7f3484153d70 2023-11-28T20:39:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3488a67640 1 -- 172.21.15.167:0/2592387548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 msgr2=0x7f348415daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3488a67640 1 --2- 172.21.15.167:0/2592387548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 0x7f348415daa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f34840c2b20 tx=0x7f347401ecf0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3488a67640 1 -- 172.21.15.167:0/2592387548 shutdown_connections 2023-11-28T20:39:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3488a67640 1 --2- 172.21.15.167:0/2592387548 >> v2:172.21.15.178:3300/0 conn(0x7f34840c2f00 0x7f34840c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3488a67640 1 --2- 172.21.15.167:0/2592387548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 0x7f348415daa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3488a67640 1 -- 172.21.15.167:0/2592387548 >> 172.21.15.167:0/2592387548 conn(0x7f34840701a0 msgr2=0x7f34840705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3488a67640 1 -- 172.21.15.167:0/2592387548 shutdown_connections 2023-11-28T20:39:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.012+0000 7f3488a67640 1 -- 172.21.15.167:0/2592387548 wait complete. 2023-11-28T20:39:29.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 Processor -- start 2023-11-28T20:39:29.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 -- start start 2023-11-28T20:39:29.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34840c2f00 0x7f3484154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34840c7e90 0x7f3484159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 0x7f34840cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484154440 con 0x7f3484153d70 2023-11-28T20:39:29.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34841f2420 con 0x7f34840c7e90 2023-11-28T20:39:29.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34840cb410 con 0x7f34840c2f00 2023-11-28T20:39:29.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f34837fe640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34840c2f00 msgr2=0x7f3484154670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f34837fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34840c2f00 0x7f3484154670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3483fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 0x7f34840cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3483fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 0x7f34840cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60090/0 (socket says 172.21.15.167:60090) 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3483fff640 1 -- 172.21.15.167:0/893545587 learned_addr learned my addr 172.21.15.167:0/893545587 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f347bfff640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34840c7e90 0x7f3484159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3483fff640 1 -- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34840c2f00 msgr2=0x7f3484154670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3483fff640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34840c2f00 0x7f3484154670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3483fff640 1 -- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34840c7e90 msgr2=0x7f3484159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3483fff640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34840c7e90 0x7f3484159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3483fff640 1 -- 172.21.15.167:0/893545587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740094d0 con 0x7f3484153d70 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f347bfff640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34840c7e90 0x7f3484159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3483fff640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 0x7f34840cc2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f347c009fd0 tx=0x7f347c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c003ba0 con 0x7f3484153d70 2023-11-28T20:39:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c00f040 con 0x7f3484153d70 2023-11-28T20:39:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34841f2670 con 0x7f3484153d70 2023-11-28T20:39:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c004030 con 0x7f3484153d70 2023-11-28T20:39:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.016+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34841f2c30 con 0x7f3484153d70 2023-11-28T20:39:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3488a67640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34841f2e50 0x7f34840cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348406b0c0 con 0x7f34841f2e50 2023-11-28T20:39:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f34837fe640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34841f2e50 0x7f34840cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f34837fe640 1 -- 172.21.15.167:0/893545587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f348406edd0 con 0x7f34841f2e50 2023-11-28T20:39:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f34837fe640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34841f2e50 0x7f34840cc830 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f34840681e0 tx=0x7f347401d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740b0440 con 0x7f34841f2e50 2023-11-28T20:39:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f347c004190 con 0x7f3484153d70 2023-11-28T20:39:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3480ff9640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3464066510 0x7f34640689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f347c084510 con 0x7f3484153d70 2023-11-28T20:39:29.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f34740a87f0 con 0x7f34841f2e50 2023-11-28T20:39:29.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34841f2e50 msgr2=0x7f34840cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3480ff9640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34841f2e50 0x7f34840cc830 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f34840681e0 tx=0x7f347401d530 comp rx=0 tx=0).stop 2023-11-28T20:39:29.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34841f2e50 msgr2=0x7f34840cc830 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:29.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f3480ff9640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34841f2e50 0x7f34840cc830 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f34840681e0 tx=0x7f347401d530 comp rx=0 tx=0).stop 2023-11-28T20:39:29.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f347bfff640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3464066510 0x7f34640689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.020+0000 7f347bfff640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3464066510 0x7f34640689d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f348406fad0 tx=0x7f346c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34840c7660 0x7f34840c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34840ce040 con 0x7f34840c7660 2023-11-28T20:39:29.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f34837fe640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34840c7660 0x7f34840c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f34837fe640 1 -- 172.21.15.167:0/893545587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f348406eaf0 con 0x7f34840c7660 2023-11-28T20:39:29.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f34837fe640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34840c7660 0x7f34840c58e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f347401c920 tx=0x7f347401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740c3b80 con 0x7f34840c7660 2023-11-28T20:39:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4970 (secure 0 0 0) 0x7f34740a8960 con 0x7f34840c7660 2023-11-28T20:39:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34840c7660 msgr2=0x7f34840c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3480ff9640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34840c7660 0x7f34840c58e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f347401c920 tx=0x7f347401ba90 comp rx=0 tx=0).stop 2023-11-28T20:39:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3480ff9640 1 -- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34840c7660 msgr2=0x7f34840c58e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3480ff9640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34840c7660 0x7f34840c58e0 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f347401c920 tx=0x7f347401ba90 comp rx=0 tx=0).stop 2023-11-28T20:39:29.033 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:39:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:39:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 12, 2023-11-28T20:39:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:39:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:39:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:39:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:39:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:39:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:39:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:39:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:39:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:39:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:39:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:39:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:29.046 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.047 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:39:29.048 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:29.049 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.050 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:29.050 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.050 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.050 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:39:29.050 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:39:29.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3464066510 msgr2=0x7f34640689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3464066510 0x7f34640689d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f348406fad0 tx=0x7f346c009040 comp rx=0 tx=0).stop 2023-11-28T20:39:29.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 msgr2=0x7f34840cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 --2- 172.21.15.167:0/893545587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484153d70 0x7f34840cc2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f347c009fd0 tx=0x7f347c00d560 comp rx=0 tx=0).stop 2023-11-28T20:39:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3483fff640 1 -- 172.21.15.167:0/893545587 reap_dead start 2023-11-28T20:39:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3483fff640 1 -- 172.21.15.167:0/893545587 reap_dead start 2023-11-28T20:39:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 shutdown_connections 2023-11-28T20:39:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 >> 172.21.15.167:0/893545587 conn(0x7f34840701a0 msgr2=0x7f3484152800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 shutdown_connections 2023-11-28T20:39:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.028+0000 7f3488a67640 1 -- 172.21.15.167:0/893545587 wait complete. 2023-11-28T20:39:29.053 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:39:29.053 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:39:29.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:39:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc8cc9640 1 Processor -- start 2023-11-28T20:39:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc8cc9640 1 -- start start 2023-11-28T20:39:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc8cc9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fc4072630 0x7f6fc4161b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc8cc9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc41571d0 con 0x7f6fc406e030 2023-11-28T20:39:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc8cc9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc4071a90 con 0x7f6fc4070480 2023-11-28T20:39:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc8cc9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc40c70d0 con 0x7f6fc4072630 2023-11-28T20:39:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6fc406e030 0x7f6fc41500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:42154/0 (socket says 172.21.15.167:42154) 2023-11-28T20:39:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc259c640 1 -- 172.21.15.167:0/1457663080 learned_addr learned my addr 172.21.15.167:0/1457663080 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc2d9d640 1 --2- 172.21.15.167:0/1457663080 >> v2:172.21.15.178:3300/0 conn(0x7f6fc4072630 0x7f6fc4161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc1d9b640 1 -- 172.21.15.167:0/1457663080 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289195816 0 0) 0x7f6fc41571d0 con 0x7f6fc406e030 2023-11-28T20:39:29.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.188+0000 7f6fc1d9b640 1 -- 172.21.15.167:0/1457663080 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb0003530 con 0x7f6fc406e030 2023-11-28T20:39:29.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc2d9d640 1 -- 172.21.15.167:0/1457663080 >> v1:172.21.15.178:6789/0 conn(0x7f6fc4070480 legacy=0x7f6fc4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc2d9d640 1 -- 172.21.15.167:0/1457663080 >> v1:172.21.15.167:6789/0 conn(0x7f6fc406e030 legacy=0x7f6fc41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc1d9b640 1 -- 172.21.15.167:0/1457663080 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1200472897 0 0) 0x7f6fb0003530 con 0x7f6fc406e030 2023-11-28T20:39:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc2d9d640 1 -- 172.21.15.167:0/1457663080 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc40c73b0 con 0x7f6fc4072630 2023-11-28T20:39:29.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc2d9d640 1 --2- 172.21.15.167:0/1457663080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4072630 0x7f6fc4161b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097c0 tx=0x7f6fbc01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6d8f95b225b39c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc1d9b640 1 -- 172.21.15.167:0/1457663080 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4001680 con 0x7f6fc4072630 2023-11-28T20:39:29.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc1d9b640 1 -- 172.21.15.167:0/1457663080 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc0a7050 con 0x7f6fc4072630 2023-11-28T20:39:29.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc1d9b640 1 -- 172.21.15.167:0/1457663080 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0ab600 con 0x7f6fc4072630 2023-11-28T20:39:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/1457663080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4072630 msgr2=0x7f6fc4161b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.192+0000 7f6fc8cc9640 1 --2- 172.21.15.167:0/1457663080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4072630 0x7f6fc4161b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097c0 tx=0x7f6fbc01c370 comp rx=0 tx=0).stop 2023-11-28T20:39:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/1457663080 shutdown_connections 2023-11-28T20:39:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 --2- 172.21.15.167:0/1457663080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4072630 0x7f6fc4161b80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/1457663080 >> 172.21.15.167:0/1457663080 conn(0x7f6fc40cb1e0 msgr2=0x7f6fc40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/1457663080 shutdown_connections 2023-11-28T20:39:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/1457663080 wait complete. 2023-11-28T20:39:29.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 Processor -- start 2023-11-28T20:39:29.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 -- start start 2023-11-28T20:39:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc406e030 0x7f6fc4141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc4070480 0x7f6fc40c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4072630 0x7f6fc40c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc41401e0 con 0x7f6fc4070480 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4166ee0 con 0x7f6fc4072630 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc8cc9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4141230 con 0x7f6fc406e030 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc259c640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc406e030 msgr2=0x7f6fc4141930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc259c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc406e030 0x7f6fc4141930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fb9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc4070480 0x7f6fc40c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fb9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc4070480 0x7f6fc40c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60124/0 (socket says 172.21.15.167:60124) 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fb9d9b640 1 -- 172.21.15.167:0/3514850881 learned_addr learned my addr 172.21.15.167:0/3514850881 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fc2d9d640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4072630 0x7f6fc40c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fb9d9b640 1 -- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc406e030 msgr2=0x7f6fc4141930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:29.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fb9d9b640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fc406e030 0x7f6fc4141930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fb9d9b640 1 -- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4072630 msgr2=0x7f6fc40c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fb9d9b640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4072630 0x7f6fc40c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.196+0000 7f6fb9d9b640 1 -- 172.21.15.167:0/3514850881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc009420 con 0x7f6fc4070480 2023-11-28T20:39:29.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fb9d9b640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc4070480 0x7f6fc40c9700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00c7c0 tx=0x7f6fac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac003b80 con 0x7f6fc4070480 2023-11-28T20:39:29.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac003ce0 con 0x7f6fc4070480 2023-11-28T20:39:29.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc41403d0 con 0x7f6fc4070480 2023-11-28T20:39:29.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00aa90 con 0x7f6fc4070480 2023-11-28T20:39:29.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc4140990 con 0x7f6fc4070480 2023-11-28T20:39:29.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fc8cc9640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4140b20 0x7f6fc41651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4074770 con 0x7f6fc4140b20 2023-11-28T20:39:29.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fc259c640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4140b20 0x7f6fc41651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fc259c640 1 -- 172.21.15.167:0/3514850881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fc4156c40 con 0x7f6fc4140b20 2023-11-28T20:39:29.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6fac00abf0 con 0x7f6fc4070480 2023-11-28T20:39:29.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fc259c640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4140b20 0x7f6fc41651f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4004880 tx=0x7f6fb400ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fa4066450 0x7f6fa4068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6fac083ff0 con 0x7f6fc4070480 2023-11-28T20:39:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4005cf0 con 0x7f6fc4140b20 2023-11-28T20:39:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6fb4005e50 con 0x7f6fc4140b20 2023-11-28T20:39:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4140b20 msgr2=0x7f6fc41651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4140b20 0x7f6fc41651f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4004880 tx=0x7f6fb400ce80 comp rx=0 tx=0).stop 2023-11-28T20:39:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fc2d9d640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fa4066450 0x7f6fa4068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4140b20 msgr2=0x7f6fc41651f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.200+0000 7f6fbb7fe640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4140b20 0x7f6fc41651f0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4004880 tx=0x7f6fb400ce80 comp rx=0 tx=0).stop 2023-11-28T20:39:29.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.204+0000 7f6fc2d9d640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fa4066450 0x7f6fa4068910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0ad000 tx=0x7f6fbc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.208+0000 7f6fc8cc9640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4165730 0x7f6fc40ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.208+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40682c0 con 0x7f6fc4165730 2023-11-28T20:39:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.208+0000 7f6fc259c640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4165730 0x7f6fc40ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc259c640 1 -- 172.21.15.167:0/3514850881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6fc4075c90 con 0x7f6fc4165730 2023-11-28T20:39:29.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc259c640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4165730 0x7f6fc40ca4d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4015000 tx=0x7f6fb400f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:29.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4021070 con 0x7f6fc4165730 2023-11-28T20:39:29.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4941 (secure 0 0 0) 0x7f6fb40074e0 con 0x7f6fc4165730 2023-11-28T20:39:29.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4165730 msgr2=0x7f6fc40ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fbb7fe640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4165730 0x7f6fc40ca4d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4015000 tx=0x7f6fb400f000 comp rx=0 tx=0).stop 2023-11-28T20:39:29.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fbb7fe640 1 -- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4165730 msgr2=0x7f6fc40ca4d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:29.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fbb7fe640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4165730 0x7f6fc40ca4d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:29.219 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:39:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:39:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 12, 2023-11-28T20:39:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:39:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:39:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:39:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:39:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:39:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:39:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:39:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:39:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:39:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:39:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:39:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:39:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:39:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:39:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:39:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:29.230 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:29.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.230 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:29.230 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:39:29.230 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.230 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:29.231 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:39:29.231 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.231 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.231 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.231 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:39:29.232 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:39:29.232 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:29.232 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:29.232 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:29.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.232 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:29.232 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:29.233 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:29.233 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:29.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.233 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:29.233 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:39:29.233 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.234 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:29.234 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:39:29.234 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:29.234 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.234 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.235 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:39:29.235 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:39:29.235 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:29.235 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:29.235 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:29.236 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.236 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.236 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:39:29.236 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:39:29.236 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.236 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:29.237 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.237 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:29.237 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.237 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.237 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:39:29.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.237 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:29.237 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.238 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:29.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.238 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.238 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:39:29.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.239 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:29.239 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.239 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:29.239 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.239 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:29.239 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:39:29.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:29.240 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:39:29.241 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:39:29.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fa4066450 msgr2=0x7f6fa4068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc8cc9640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fa4066450 0x7f6fa4068910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0ad000 tx=0x7f6fbc0a6000 comp rx=0 tx=0).stop 2023-11-28T20:39:29.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc4070480 msgr2=0x7f6fc40c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:29.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc8cc9640 1 --2- 172.21.15.167:0/3514850881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fc4070480 0x7f6fc40c9700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00c7c0 tx=0x7f6fac00cc80 comp rx=0 tx=0).stop 2023-11-28T20:39:29.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc2d9d640 1 -- 172.21.15.167:0/3514850881 reap_dead start 2023-11-28T20:39:29.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc2d9d640 1 -- 172.21.15.167:0/3514850881 reap_dead start 2023-11-28T20:39:29.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 shutdown_connections 2023-11-28T20:39:29.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 >> 172.21.15.167:0/3514850881 conn(0x7f6fc40cb1e0 msgr2=0x7f6fc4071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:29.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 shutdown_connections 2023-11-28T20:39:29.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:29.212+0000 7f6fc8cc9640 1 -- 172.21.15.167:0/3514850881 wait complete. 2023-11-28T20:39:29.243 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:39:29.243 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:39:44.701 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:44.705 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:49.245 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:39:49.245 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2023-11-28T20:39:49.245 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:39:49.245 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:39:49.248 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:39:49.248 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:39:49.248 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:39:49.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f23658c9640 1 Processor -- start 2023-11-28T20:39:49.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f23658c9640 1 -- start start 2023-11-28T20:39:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f23658c9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2360153f90 0x7f236015a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f23658c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f236015ab90 con 0x7f23600cbee0 2023-11-28T20:39:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f23658c9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2360154370 con 0x7f236006a580 2023-11-28T20:39:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f23658c9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600cd610 con 0x7f2360153f90 2023-11-28T20:39:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f235effd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2360153f90 0x7f236015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f235e7fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f23600cbee0 0x7f236006a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52154/0 (socket says 172.21.15.167:52154) 2023-11-28T20:39:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f235e7fc640 1 -- 172.21.15.167:0/1801722149 learned_addr learned my addr 172.21.15.167:0/1801722149 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:39:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f235effd640 1 -- 172.21.15.167:0/1801722149 >> v1:172.21.15.178:6789/0 conn(0x7f236006a580 legacy=0x7f236006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f235effd640 1 -- 172.21.15.167:0/1801722149 >> v1:172.21.15.167:6789/0 conn(0x7f23600cbee0 legacy=0x7f236006a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f235effd640 1 -- 172.21.15.167:0/1801722149 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600cc630 con 0x7f2360153f90 2023-11-28T20:39:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.392+0000 7f235dffb640 1 -- 172.21.15.167:0/1801722149 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443759822 0 0) 0x7f2354001120 con 0x7f23600cbee0 2023-11-28T20:39:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.396+0000 7f235effd640 1 --2- 172.21.15.167:0/1801722149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2360153f90 0x7f236015a650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f23500097c0 tx=0x7f235001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2925da0943844f1b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:49.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.396+0000 7f235dffb640 1 -- 172.21.15.167:0/1801722149 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500a8970 con 0x7f2360153f90 2023-11-28T20:39:49.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.396+0000 7f235dffb640 1 -- 172.21.15.167:0/1801722149 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23500a8ad0 con 0x7f2360153f90 2023-11-28T20:39:49.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.396+0000 7f235dffb640 1 -- 172.21.15.167:0/1801722149 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500a8e60 con 0x7f2360153f90 2023-11-28T20:39:49.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 -- 172.21.15.167:0/1801722149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2360153f90 msgr2=0x7f236015a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 --2- 172.21.15.167:0/1801722149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2360153f90 0x7f236015a650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f23500097c0 tx=0x7f235001ec70 comp rx=0 tx=0).stop 2023-11-28T20:39:49.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 -- 172.21.15.167:0/1801722149 shutdown_connections 2023-11-28T20:39:49.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 --2- 172.21.15.167:0/1801722149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2360153f90 0x7f236015a650 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 -- 172.21.15.167:0/1801722149 >> 172.21.15.167:0/1801722149 conn(0x7f23600d0d50 msgr2=0x7f23600d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:49.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 -- 172.21.15.167:0/1801722149 shutdown_connections 2023-11-28T20:39:49.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 -- 172.21.15.167:0/1801722149 wait complete. 2023-11-28T20:39:49.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 Processor -- start 2023-11-28T20:39:49.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 -- start start 2023-11-28T20:39:49.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f236006a580 0x7f23601f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2360153f90 0x7f23600c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2360159870 0x7f23601e5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601eff70 con 0x7f2360153f90 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601e3da0 con 0x7f236006a580 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f23658c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600c8e90 con 0x7f2360159870 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2360153f90 0x7f23600c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2360153f90 0x7f23600c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57916/0 (socket says 172.21.15.167:57916) 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235e7fc640 1 -- 172.21.15.167:0/3954617455 learned_addr learned my addr 172.21.15.167:0/3954617455 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235ffff640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2360159870 0x7f23601e5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235effd640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f236006a580 0x7f23601f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235ffff640 1 -- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2360159870 msgr2=0x7f23601e5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235ffff640 1 -- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2360159870 msgr2=0x7f23601e5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:49.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235ffff640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2360159870 0x7f23601e5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235ffff640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2360159870 0x7f23601e5520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235effd640 1 -- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2360159870 msgr2=0x7f23601e5520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235effd640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2360159870 0x7f23601e5520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235effd640 1 -- 172.21.15.167:0/3954617455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2360153f90 msgr2=0x7f23600c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235effd640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2360153f90 0x7f23600c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.400+0000 7f235effd640 1 -- 172.21.15.167:0/3954617455 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350009420 con 0x7f236006a580 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.404+0000 7f235effd640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f236006a580 0x7f23601f0390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f23500af000 tx=0x7f235001ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.404+0000 7f2347fff640 1 -- 172.21.15.167:0/3954617455 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500a8970 con 0x7f236006a580 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.404+0000 7f2347fff640 1 -- 172.21.15.167:0/3954617455 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23500b9410 con 0x7f236006a580 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.404+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23600c9150 con 0x7f236006a580 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.404+0000 7f2347fff640 1 -- 172.21.15.167:0/3954617455 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500b97e0 con 0x7f236006a580 2023-11-28T20:39:49.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.404+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23601ef840 con 0x7f236006a580 2023-11-28T20:39:49.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.404+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2360075c90 con 0x7f236006a580 2023-11-28T20:39:49.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.404+0000 7f2347fff640 1 -- 172.21.15.167:0/3954617455 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f23500b7040 con 0x7f236006a580 2023-11-28T20:39:49.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.404+0000 7f2347fff640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f234c066470 0x7f234c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.408+0000 7f2347fff640 1 -- 172.21.15.167:0/3954617455 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2350121e20 con 0x7f236006a580 2023-11-28T20:39:49.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.408+0000 7f235e7fc640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f234c066470 0x7f234c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.408+0000 7f235e7fc640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f234c066470 0x7f234c068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2354007fd0 tx=0x7f23540078e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:49.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.416+0000 7f2347fff640 1 -- 172.21.15.167:0/3954617455 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f23500eee50 con 0x7f236006a580 2023-11-28T20:39:49.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.648+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f23600d1130 con 0x7f236006a580 2023-11-28T20:39:49.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.652+0000 7f2347fff640 1 -- 172.21.15.167:0/3954617455 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7f23500b5020 con 0x7f236006a580 2023-11-28T20:39:49.657 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:39:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f234c066470 msgr2=0x7f234c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f234c066470 0x7f234c068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2354007fd0 tx=0x7f23540078e0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f236006a580 msgr2=0x7f23601f0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f236006a580 0x7f23601f0390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f23500af000 tx=0x7f235001ba10 comp rx=0 tx=0).stop 2023-11-28T20:39:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 shutdown_connections 2023-11-28T20:39:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f234c066470 0x7f234c068930 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2360159870 0x7f23601e5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2360153f90 0x7f23600c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 --2- 172.21.15.167:0/3954617455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f236006a580 0x7f23601f0390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 >> 172.21.15.167:0/3954617455 conn(0x7f23600d0d50 msgr2=0x7f23601531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:49.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 shutdown_connections 2023-11-28T20:39:49.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.656+0000 7f23658c9640 1 -- 172.21.15.167:0/3954617455 wait complete. 2023-11-28T20:39:49.688 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:39:49.688 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:39:49.688 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:39:49.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f159143c640 1 Processor -- start 2023-11-28T20:39:49.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f159143c640 1 -- start start 2023-11-28T20:39:49.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f159143c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f158c153f10 0x7f158c0cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f159143c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c15d150 con 0x7f158c0ca200 2023-11-28T20:39:49.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f159143c640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c0c4a30 con 0x7f158c159bc0 2023-11-28T20:39:49.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f159143c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c1542f0 con 0x7f158c153f10 2023-11-28T20:39:49.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f158bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f158c153f10 0x7f158c0cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f158bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f158c153f10 0x7f158c0cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57918/0 (socket says 172.21.15.167:57918) 2023-11-28T20:39:49.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f1590c3b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f158c0ca200 0x7f158c1644e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52168/0 (socket says 172.21.15.167:52168) 2023-11-28T20:39:49.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f158bfff640 1 -- 172.21.15.167:0/1334885386 learned_addr learned my addr 172.21.15.167:0/1334885386 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:49.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f158bfff640 1 -- 172.21.15.167:0/1334885386 >> v1:172.21.15.178:6789/0 conn(0x7f158c159bc0 legacy=0x7f158c15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f158bfff640 1 -- 172.21.15.167:0/1334885386 >> v1:172.21.15.167:6789/0 conn(0x7f158c0ca200 legacy=0x7f158c1644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.836+0000 7f158bfff640 1 -- 172.21.15.167:0/1334885386 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c15a100 con 0x7f158c153f10 2023-11-28T20:39:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.840+0000 7f158bfff640 1 --2- 172.21.15.167:0/1334885386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c153f10 0x7f158c0cb4d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f157c009870 tx=0x7f157c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed83bf1792e2090f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:49.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f158affd640 1 -- 172.21.15.167:0/1334885386 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0a8a30 con 0x7f158c153f10 2023-11-28T20:39:49.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f158affd640 1 -- 172.21.15.167:0/1334885386 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c0a8b90 con 0x7f158c153f10 2023-11-28T20:39:49.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f158affd640 1 -- 172.21.15.167:0/1334885386 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0b0440 con 0x7f158c153f10 2023-11-28T20:39:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f159143c640 1 -- 172.21.15.167:0/1334885386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c153f10 msgr2=0x7f158c0cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f159143c640 1 --2- 172.21.15.167:0/1334885386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c153f10 0x7f158c0cb4d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f157c009870 tx=0x7f157c01ed30 comp rx=0 tx=0).stop 2023-11-28T20:39:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f159143c640 1 -- 172.21.15.167:0/1334885386 shutdown_connections 2023-11-28T20:39:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f159143c640 1 --2- 172.21.15.167:0/1334885386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c153f10 0x7f158c0cb4d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f159143c640 1 -- 172.21.15.167:0/1334885386 >> 172.21.15.167:0/1334885386 conn(0x7f158c071cb0 msgr2=0x7f158c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f159143c640 1 -- 172.21.15.167:0/1334885386 shutdown_connections 2023-11-28T20:39:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f159143c640 1 -- 172.21.15.167:0/1334885386 wait complete. 2023-11-28T20:39:49.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f159143c640 1 Processor -- start 2023-11-28T20:39:49.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.844+0000 7f159143c640 1 -- start start 2023-11-28T20:39:49.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0ca200 0x7f158c148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f158c153f10 0x7f158c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158c159bc0 0x7f158c157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c152210 con 0x7f158c0ca200 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c1f04a0 con 0x7f158c159bc0 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c151600 con 0x7f158c153f10 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0ca200 0x7f158c148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0ca200 0x7f158c148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57920/0 (socket says 172.21.15.167:57920) 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158bfff640 1 -- 172.21.15.167:0/2966798917 learned_addr learned my addr 172.21.15.167:0/2966798917 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158b7fe640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f158c153f10 0x7f158c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f1590c3b640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158c159bc0 0x7f158c157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158b7fe640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f158c153f10 msgr2=0x7f158c157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158b7fe640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f158c153f10 msgr2=0x7f158c157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158b7fe640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f158c153f10 0x7f158c157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158b7fe640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f158c153f10 0x7f158c157a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158bfff640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f158c153f10 msgr2=0x7f158c157a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158bfff640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f158c153f10 0x7f158c157a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158bfff640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158c159bc0 msgr2=0x7f158c157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158bfff640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158c159bc0 0x7f158c157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158bfff640 1 -- 172.21.15.167:0/2966798917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0094d0 con 0x7f158c0ca200 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f1590c3b640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158c159bc0 0x7f158c157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158bfff640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0ca200 0x7f158c148e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f157c0b3040 tx=0x7f157c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0be070 con 0x7f158c0ca200 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c0ba400 con 0x7f158c0ca200 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c1518e0 con 0x7f158c0ca200 2023-11-28T20:39:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c0ba7b0 con 0x7f158c0ca200 2023-11-28T20:39:49.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c151ea0 con 0x7f158c0ca200 2023-11-28T20:39:49.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c1efff0 0x7f158c144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c072740 con 0x7f158c1efff0 2023-11-28T20:39:49.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158b7fe640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c1efff0 0x7f158c144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158b7fe640 1 -- 172.21.15.167:0/2966798917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f158c15a9a0 con 0x7f158c1efff0 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.848+0000 7f158b7fe640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c1efff0 0x7f158c144c90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f158c1513d0 tx=0x7f158000e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15800052e0 con 0x7f158c1efff0 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f157c0ba910 con 0x7f158c0ca200 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1588ff9640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1578066510 0x7f15780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f157c122040 con 0x7f158c0ca200 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1580005440 con 0x7f158c1efff0 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c1efff0 msgr2=0x7f158c144c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1588ff9640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c1efff0 0x7f158c144c90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f158c1513d0 tx=0x7f158000e960 comp rx=0 tx=0).stop 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c1efff0 msgr2=0x7f158c144c90 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1588ff9640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c1efff0 0x7f158c144c90 secure :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f158c1513d0 tx=0x7f158000e960 comp rx=0 tx=0).stop 2023-11-28T20:39:49.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1590c3b640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1578066510 0x7f15780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.852+0000 7f1590c3b640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1578066510 0x7f15780689d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15840012f0 tx=0x7f1584005be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.856+0000 7f159143c640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0b33b0 0x7f158c1451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.856+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c152090 con 0x7f158c0b33b0 2023-11-28T20:39:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f158b7fe640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0b33b0 0x7f158c1451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f158b7fe640 1 -- 172.21.15.167:0/2966798917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f158c15a6c0 con 0x7f158c0b33b0 2023-11-28T20:39:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f158b7fe640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0b33b0 0x7f158c1451d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f158c1ed210 tx=0x7f1580001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580021070 con 0x7f158c0b33b0 2023-11-28T20:39:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4981 (secure 0 0 0) 0x7f15800069f0 con 0x7f158c0b33b0 2023-11-28T20:39:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0b33b0 msgr2=0x7f158c1451d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f1588ff9640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0b33b0 0x7f158c1451d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f158c1ed210 tx=0x7f1580001130 comp rx=0 tx=0).stop 2023-11-28T20:39:49.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f1588ff9640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0b33b0 msgr2=0x7f158c1451d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:49.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f1588ff9640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0b33b0 0x7f158c1451d0 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f158c1ed210 tx=0x7f1580001130 comp rx=0 tx=0).stop 2023-11-28T20:39:49.865 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:39:49.866 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:49.867 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:49.867 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:39:49.867 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 14, 2023-11-28T20:39:49.867 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:39:49.867 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:39:49.867 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:49.868 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:49.869 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:49.869 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:49.869 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:49.869 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:49.869 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:49.869 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:39:49.869 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:39:49.869 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:49.870 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:39:49.871 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:39:49.872 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:39:49.872 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:39:49.872 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:39:49.872 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:39:49.872 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:49.872 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:39:49.872 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:49.872 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:49.873 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:49.873 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:49.873 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:49.873 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:49.873 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:49.874 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:49.874 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:49.874 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:49.874 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:49.874 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:39:49.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.875 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:39:49.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.875 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:49.875 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:49.875 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:49.876 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:49.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.876 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:49.876 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:39:49.876 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:49.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.877 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:49.877 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:39:49.877 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:49.877 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:49.877 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:49.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.877 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:39:49.877 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:39:49.877 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:49.878 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:49.878 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:49.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.878 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:49.878 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:49.878 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:49.878 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:49.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:49.879 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:49.880 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:49.881 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:49.881 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:49.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.881 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:49.881 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:39:49.881 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:49.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.882 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:49.882 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:39:49.882 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:49.882 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:49.882 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:49.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.882 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:39:49.882 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.883 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:39:49.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:49.885 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:49.886 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:39:49.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:49.886 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:49.886 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:49.886 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:49.886 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:49.886 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:49.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:49.886 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:39:49.887 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:39:49.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1578066510 msgr2=0x7f15780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f159143c640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1578066510 0x7f15780689d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15840012f0 tx=0x7f1584005be0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0ca200 msgr2=0x7f158c148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f159143c640 1 --2- 172.21.15.167:0/2966798917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158c0ca200 0x7f158c148e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f157c0b3040 tx=0x7f157c01bad0 comp rx=0 tx=0).stop 2023-11-28T20:39:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f1590c3b640 1 -- 172.21.15.167:0/2966798917 reap_dead start 2023-11-28T20:39:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f1590c3b640 1 -- 172.21.15.167:0/2966798917 reap_dead start 2023-11-28T20:39:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 shutdown_connections 2023-11-28T20:39:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 >> 172.21.15.167:0/2966798917 conn(0x7f158c071cb0 msgr2=0x7f158c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 shutdown_connections 2023-11-28T20:39:49.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:49.860+0000 7f159143c640 1 -- 172.21.15.167:0/2966798917 wait complete. 2023-11-28T20:39:49.890 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:39:49.890 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:39:49.890 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:39:50.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e759e640 1 Processor -- start 2023-11-28T20:39:50.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e759e640 1 -- start start 2023-11-28T20:39:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e759e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66e8159b20 0x7f66e80c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e759e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e759e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e8159f70 con 0x7f66e8153d20 2023-11-28T20:39:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e759e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e815a1b0 con 0x7f66e8159b20 2023-11-28T20:39:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e759e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e815a450 con 0x7f66e80c5fb0 2023-11-28T20:39:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e6d9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66dffff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66e8159b20 0x7f66e80c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e6d9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e80cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:55266/0 (socket says 172.21.15.167:55266) 2023-11-28T20:39:50.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66dffff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66e8159b20 0x7f66e80c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:43436/0 (socket says 172.21.15.167:43436) 2023-11-28T20:39:50.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e6d9d640 1 -- 172.21.15.167:0/2229105844 learned_addr learned my addr 172.21.15.167:0/2229105844 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:50.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e659c640 1 --1- 172.21.15.167:0/2229105844 >> v1:172.21.15.178:6789/0 conn(0x7f66e8153d20 0x7f66e80ca3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:33200/0 (socket says 172.21.15.167:33200) 2023-11-28T20:39:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e6d9d640 1 -- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 msgr2=0x7f66e80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:39:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e6d9d640 1 -- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 msgr2=0x7f66e80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:39:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e6d9d640 1 --2- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e80cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66e6d9d640 1 --2- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e80cf440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66dffff640 1 -- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 msgr2=0x7f66e80cf440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:39:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66dffff640 1 --2- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e80cf440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66dffff640 1 -- 172.21.15.167:0/2229105844 >> v1:172.21.15.178:6789/0 conn(0x7f66e8153d20 legacy=0x7f66e80ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.052+0000 7f66dffff640 1 -- 172.21.15.167:0/2229105844 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e815a710 con 0x7f66e8159b20 2023-11-28T20:39:50.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66dffff640 1 --2- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e8159b20 0x7f66e80c5a70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f66d00097c0 tx=0x7f66d001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7da2edeeb0e34e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:50.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e5d9b640 1 -- 172.21.15.167:0/2229105844 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00a8970 con 0x7f66e8159b20 2023-11-28T20:39:50.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e5d9b640 1 -- 172.21.15.167:0/2229105844 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d00a8ad0 con 0x7f66e8159b20 2023-11-28T20:39:50.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e5d9b640 1 -- 172.21.15.167:0/2229105844 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00a8e60 con 0x7f66e8159b20 2023-11-28T20:39:50.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 -- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e8159b20 msgr2=0x7f66e80c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 --2- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e8159b20 0x7f66e80c5a70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f66d00097c0 tx=0x7f66d001ec70 comp rx=0 tx=0).stop 2023-11-28T20:39:50.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 -- 172.21.15.167:0/2229105844 shutdown_connections 2023-11-28T20:39:50.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 --2- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e80cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 --2- 172.21.15.167:0/2229105844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e8159b20 0x7f66e80c5a70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 -- 172.21.15.167:0/2229105844 >> 172.21.15.167:0/2229105844 conn(0x7f66e806b800 msgr2=0x7f66e806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:50.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 -- 172.21.15.167:0/2229105844 shutdown_connections 2023-11-28T20:39:50.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 -- 172.21.15.167:0/2229105844 wait complete. 2023-11-28T20:39:50.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 Processor -- start 2023-11-28T20:39:50.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.060+0000 7f66e759e640 1 -- start start 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e81498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e8153d20 0x7f66e80cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e8159b20 0x7f66e80ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e81574f0 con 0x7f66e8159b20 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e814ebf0 con 0x7f66e8153d20 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e80cd6f0 con 0x7f66e80c5fb0 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e8159b20 0x7f66e80ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e659c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e81498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66dffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e8153d20 0x7f66e80cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e8159b20 0x7f66e80ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57950/0 (socket says 172.21.15.167:57950) 2023-11-28T20:39:50.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e6d9d640 1 -- 172.21.15.167:0/4045809732 learned_addr learned my addr 172.21.15.167:0/4045809732 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:50.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e659c640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 msgr2=0x7f66e81498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:39:50.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e659c640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 msgr2=0x7f66e81498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:50.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e659c640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e81498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:50.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e659c640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e81498a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e6d9d640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 msgr2=0x7f66e81498a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e6d9d640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e80c5fb0 0x7f66e81498a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e6d9d640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e8153d20 msgr2=0x7f66e80cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e6d9d640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e8153d20 0x7f66e80cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e6d9d640 1 -- 172.21.15.167:0/4045809732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0009420 con 0x7f66e8159b20 2023-11-28T20:39:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66dffff640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e8153d20 0x7f66e80cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:39:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e6d9d640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e8159b20 0x7f66e80ce0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f66e0007aa0 tx=0x7f66e0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e0017070 con 0x7f66e8159b20 2023-11-28T20:39:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e000f040 con 0x7f66e8159b20 2023-11-28T20:39:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e000dcb0 con 0x7f66e8159b20 2023-11-28T20:39:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e80cd3f0 con 0x7f66e8159b20 2023-11-28T20:39:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e814ee40 con 0x7f66e8159b20 2023-11-28T20:39:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e80cef40 0x7f66e814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.064+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8072740 con 0x7f66e80cef40 2023-11-28T20:39:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66e659c640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e80cef40 0x7f66e814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66e659c640 1 -- 172.21.15.167:0/4045809732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66e80ca1e0 con 0x7f66e80cef40 2023-11-28T20:39:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66e001c410 con 0x7f66e8159b20 2023-11-28T20:39:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66e659c640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e80cef40 0x7f66e814f120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f66d8000f70 tx=0x7f66d80017f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66deffd640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66c80664a0 0x7f66c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f66e0083b70 con 0x7f66e8159b20 2023-11-28T20:39:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8010510 con 0x7f66e80cef40 2023-11-28T20:39:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f66d8010670 con 0x7f66e80cef40 2023-11-28T20:39:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e80cef40 msgr2=0x7f66e814f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66dffff640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66c80664a0 0x7f66c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66deffd640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e80cef40 0x7f66e814f120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f66d8000f70 tx=0x7f66d80017f0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e80cef40 msgr2=0x7f66e814f120 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66deffd640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e80cef40 0x7f66e814f120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.068+0000 7f66dffff640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66c80664a0 0x7f66c8068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66d00b2000 tx=0x7f66d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:50.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e81f2b50 0x7f66e81f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e81546d0 con 0x7f66e81f2b50 2023-11-28T20:39:50.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e659c640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e81f2b50 0x7f66e81f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e659c640 1 -- 172.21.15.167:0/4045809732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f66e80c5270 con 0x7f66e81f2b50 2023-11-28T20:39:50.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e659c640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e81f2b50 0x7f66e81f2f60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f66d8001ec0 tx=0x7f66d8000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:50.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8021070 con 0x7f66e81f2b50 2023-11-28T20:39:50.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4952 (secure 0 0 0) 0x7f66d8014480 con 0x7f66e81f2b50 2023-11-28T20:39:50.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e81f2b50 msgr2=0x7f66e81f2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66deffd640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e81f2b50 0x7f66e81f2f60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f66d8001ec0 tx=0x7f66d8000ee0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66deffd640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e81f2b50 msgr2=0x7f66e81f2f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:50.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66deffd640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e81f2b50 0x7f66e81f2f60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.080 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 14, 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:50.081 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:50.082 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:50.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:39:50.084 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:50.085 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.086 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:39:50.087 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:50.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:50.089 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.090 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:50.091 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:50.092 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.093 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:39:50.094 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:39:50.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66c80664a0 msgr2=0x7f66c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66c80664a0 0x7f66c8068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66d00b2000 tx=0x7f66d0008040 comp rx=0 tx=0).stop 2023-11-28T20:39:50.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e8159b20 msgr2=0x7f66e80ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 --2- 172.21.15.167:0/4045809732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66e8159b20 0x7f66e80ce0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f66e0007aa0 tx=0x7f66e0007f60 comp rx=0 tx=0).stop 2023-11-28T20:39:50.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e6d9d640 1 -- 172.21.15.167:0/4045809732 reap_dead start 2023-11-28T20:39:50.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e6d9d640 1 -- 172.21.15.167:0/4045809732 reap_dead start 2023-11-28T20:39:50.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 shutdown_connections 2023-11-28T20:39:50.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 >> 172.21.15.167:0/4045809732 conn(0x7f66e806b800 msgr2=0x7f66e8151890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:50.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 shutdown_connections 2023-11-28T20:39:50.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.076+0000 7f66e759e640 1 -- 172.21.15.167:0/4045809732 wait complete. 2023-11-28T20:39:50.100 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:39:50.101 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:39:50.101 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:39:50.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe9627aa640 1 Processor -- start 2023-11-28T20:39:50.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe9627aa640 1 -- start start 2023-11-28T20:39:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe9627aa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe95c0cfc40 0x7fe95c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe9627aa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe95c153ae0 0x7fe95c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe9627aa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c15ac00 con 0x7fe95c0cf860 2023-11-28T20:39:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe9627aa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c0cbd60 con 0x7fe95c153ae0 2023-11-28T20:39:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe9627aa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c159ff0 con 0x7fe95c0cfc40 2023-11-28T20:39:50.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe960d47640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe95c153ae0 0x7fe95c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe960d47640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe95c153ae0 0x7fe95c153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57958/0 (socket says 172.21.15.167:57958) 2023-11-28T20:39:50.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe960d47640 1 -- 172.21.15.167:0/374041758 learned_addr learned my addr 172.21.15.167:0/374041758 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:50.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe95b7fe640 1 --2- 172.21.15.167:0/374041758 >> v2:172.21.15.178:3300/0 conn(0x7fe95c0cfc40 0x7fe95c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe960d47640 1 -- 172.21.15.167:0/374041758 >> v2:172.21.15.178:3300/0 conn(0x7fe95c0cfc40 msgr2=0x7fe95c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:50.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe960d47640 1 --2- 172.21.15.167:0/374041758 >> v2:172.21.15.178:3300/0 conn(0x7fe95c0cfc40 0x7fe95c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe960d47640 1 -- 172.21.15.167:0/374041758 >> v1:172.21.15.178:6789/0 conn(0x7fe95c0cf860 legacy=0x7fe95c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.244+0000 7fe960d47640 1 -- 172.21.15.167:0/374041758 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c15a2d0 con 0x7fe95c153ae0 2023-11-28T20:39:50.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe960d47640 1 --2- 172.21.15.167:0/374041758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c153ae0 0x7fe95c153f50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0c9c50 tx=0x7fe95401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af1cdc64632cea4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe95affd640 1 -- 172.21.15.167:0/374041758 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9540a5890 con 0x7fe95c153ae0 2023-11-28T20:39:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe95affd640 1 -- 172.21.15.167:0/374041758 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9540a59f0 con 0x7fe95c153ae0 2023-11-28T20:39:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe95affd640 1 -- 172.21.15.167:0/374041758 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9540a5d80 con 0x7fe95c153ae0 2023-11-28T20:39:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 -- 172.21.15.167:0/374041758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c153ae0 msgr2=0x7fe95c153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 --2- 172.21.15.167:0/374041758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c153ae0 0x7fe95c153f50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0c9c50 tx=0x7fe95401c9d0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 -- 172.21.15.167:0/374041758 shutdown_connections 2023-11-28T20:39:50.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 --2- 172.21.15.167:0/374041758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c153ae0 0x7fe95c153f50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 --2- 172.21.15.167:0/374041758 >> v2:172.21.15.178:3300/0 conn(0x7fe95c0cfc40 0x7fe95c0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 -- 172.21.15.167:0/374041758 >> 172.21.15.167:0/374041758 conn(0x7fe95c06c1f0 msgr2=0x7fe95c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:50.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 -- 172.21.15.167:0/374041758 shutdown_connections 2023-11-28T20:39:50.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 -- 172.21.15.167:0/374041758 wait complete. 2023-11-28T20:39:50.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 Processor -- start 2023-11-28T20:39:50.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.252+0000 7fe9627aa640 1 -- start start 2023-11-28T20:39:50.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe95c0cf860 0x7fe95c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c0cfc40 0x7fe95c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c153ae0 0x7fe95c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0c9a30 con 0x7fe95c0cfc40 2023-11-28T20:39:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0c8c20 con 0x7fe95c0cf860 2023-11-28T20:39:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1f70e0 con 0x7fe95c153ae0 2023-11-28T20:39:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c0cfc40 0x7fe95c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c0cfc40 0x7fe95c0c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57968/0 (socket says 172.21.15.167:57968) 2023-11-28T20:39:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95b7fe640 1 -- 172.21.15.167:0/1051219318 learned_addr learned my addr 172.21.15.167:0/1051219318 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe960d47640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c153ae0 0x7fe95c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe95c0cf860 0x7fe95c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe960d47640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c153ae0 msgr2=0x7fe95c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:39:50.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe960d47640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c153ae0 msgr2=0x7fe95c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:50.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe960d47640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c153ae0 0x7fe95c0c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:50.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe960d47640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c153ae0 0x7fe95c0c7190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:50.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95b7fe640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c153ae0 msgr2=0x7fe95c0c7190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:50.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95b7fe640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c153ae0 0x7fe95c0c7190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95b7fe640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe95c0cf860 msgr2=0x7fe95c152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:50.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95b7fe640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe95c0cf860 0x7fe95c152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:50.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95b7fe640 1 -- 172.21.15.167:0/1051219318 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954009b30 con 0x7fe95c0cfc40 2023-11-28T20:39:50.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe95c0cf860 0x7fe95c152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:50.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95b7fe640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c0cfc40 0x7fe95c0c6c50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe95000e960 tx=0x7fe95000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:50.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950009690 con 0x7fe95c0cfc40 2023-11-28T20:39:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95000c9a0 con 0x7fe95c0cfc40 2023-11-28T20:39:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c1f6230 con 0x7fe95c0cfc40 2023-11-28T20:39:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95000cd10 con 0x7fe95c0cfc40 2023-11-28T20:39:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c1f67b0 con 0x7fe95c0cfc40 2023-11-28T20:39:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c072860 con 0x7fe95c166630 2023-11-28T20:39:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2023-11-28T20:39:50.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:50.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:50.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.256+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:50.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.260+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe950013470 con 0x7fe95c0cfc40 2023-11-28T20:39:50.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.260+0000 7fe958ff9640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe948066470 0x7fe948068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:50.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.260+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe950084860 con 0x7fe95c0cfc40 2023-11-28T20:39:50.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.260+0000 7fe960d47640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe948066470 0x7fe948068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.260+0000 7fe960d47640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe948066470 0x7fe948068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe9540ae000 tx=0x7fe9540a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.460+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.460+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:39:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.460+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:50.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.460+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:50.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.460+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:39:50.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.864+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:50.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.864+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:39:50.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.864+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:50.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.864+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:50.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:50.864+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:39:51.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:51.668+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:51.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:51.668+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:39:51.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:51.668+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:51.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:51.668+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:51.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:51.668+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:39:53.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:53.272+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:53.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:53.272+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:39:53.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:53.272+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:53.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:53.272+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:53.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:53.272+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-11-28T20:39:54.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe9437fe640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:39:54.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe9437fe640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe9437fe640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 0x7fe9340059e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:54.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe9437fe640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 msgr2=0x7fe95c1f69d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:54.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe9437fe640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c166630 0x7fe95c1f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe9437fe640 1 -- 172.21.15.167:0/1051219318 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe934006090 con 0x7fe934003550 2023-11-28T20:39:54.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 0x7fe9340059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:54.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 msgr2=0x7fe9340059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:39:54.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 msgr2=0x7fe9340059e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:39:54.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 0x7fe9340059e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:39:54.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.256+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 0x7fe9340059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:39:54.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.460+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 0x7fe9340059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:54.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.460+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe934006200 con 0x7fe934003550 2023-11-28T20:39:54.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.460+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 0x7fe9340059e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe94c017920 tx=0x7fe94c017de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:54.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.460+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0052e0 con 0x7fe934003550 2023-11-28T20:39:54.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.460+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fe94c005440 con 0x7fe934003550 2023-11-28T20:39:54.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.460+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 msgr2=0x7fe9340059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.460+0000 7fe958ff9640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 0x7fe9340059e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe94c017920 tx=0x7fe94c017de0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.460+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 msgr2=0x7fe9340059e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:54.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.460+0000 7fe958ff9640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934003550 0x7fe9340059e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe9627aa640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c159810 0x7fe95c147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:54.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1f6f10 con 0x7fe95c159810 2023-11-28T20:39:54.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c159810 0x7fe95c147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:54.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe95bfff640 1 -- 172.21.15.167:0/1051219318 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe95c075c90 con 0x7fe95c159810 2023-11-28T20:39:54.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe95bfff640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c159810 0x7fe95c147f00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe94c017920 tx=0x7fe94c001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:54.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c007220 con 0x7fe95c159810 2023-11-28T20:39:54.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7fe94c003e40 con 0x7fe95c159810 2023-11-28T20:39:54.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c159810 msgr2=0x7fe95c147f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe958ff9640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c159810 0x7fe95c147f00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe94c017920 tx=0x7fe94c001090 comp rx=0 tx=0).stop 2023-11-28T20:39:54.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe958ff9640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c159810 msgr2=0x7fe95c147f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:39:54.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe958ff9640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe95c159810 0x7fe95c147f00 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe94c017920 tx=0x7fe94c001090 comp rx=0 tx=0).stop 2023-11-28T20:39:54.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.468+0000 7fe960d47640 1 -- 172.21.15.167:0/1051219318 reap_dead start 2023-11-28T20:39:54.475 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:39:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:54.475 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:39:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 14, 2023-11-28T20:39:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:39:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:39:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:39:54.476 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:39:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 4, 2023-11-28T20:39:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:39:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:39:54.477 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:54.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:54.479 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:54.480 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:39:54.481 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:39:54.482 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:54.484 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.485 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:39:54.486 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:39:54.487 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:54.488 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:39:54.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:39:54.490 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:39:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:39:54.491 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:39:54.491 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe948066470 msgr2=0x7fe948068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe948066470 0x7fe948068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe9540ae000 tx=0x7fe9540a7070 comp rx=0 tx=0).stop 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c0cfc40 msgr2=0x7fe95c0c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c0cfc40 0x7fe95c0c6c50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe95000e960 tx=0x7fe95000ee20 comp rx=0 tx=0).stop 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 shutdown_connections 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe948066470 0x7fe948068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 --2- 172.21.15.167:0/1051219318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe95c0cfc40 0x7fe95c0c6c50 secure :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe95000e960 tx=0x7fe95000ee20 comp rx=0 tx=0).stop 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 >> 172.21.15.167:0/1051219318 conn(0x7fe95c06c1f0 msgr2=0x7fe95c0cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 shutdown_connections 2023-11-28T20:39:54.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.472+0000 7fe9627aa640 1 -- 172.21.15.167:0/1051219318 wait complete. 2023-11-28T20:39:54.500 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:39:54.501 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:39:54.501 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:39:54.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.692+0000 7f7e54993640 1 Processor -- start 2023-11-28T20:39:54.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.692+0000 7f7e54993640 1 -- start start 2023-11-28T20:39:54.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e54993640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 0x7f7e5015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:54.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e54993640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7e500c8620 0x7f7e500c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:54.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e54993640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e50159b70 con 0x7f7e500c6440 2023-11-28T20:39:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e54993640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e50159de0 con 0x7f7e500c8620 2023-11-28T20:39:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e54993640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5015a0c0 con 0x7f7e500c8240 2023-11-28T20:39:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e4effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7e500c8620 0x7f7e500c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e4effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7e500c8620 0x7f7e500c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:39772/0 (socket says 172.21.15.167:39772) 2023-11-28T20:39:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e4effd640 1 -- 172.21.15.167:0/1598315100 learned_addr learned my addr 172.21.15.167:0/1598315100 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e4f7fe640 1 --2- 172.21.15.167:0/1598315100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 0x7f7e5015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e4effd640 1 -- 172.21.15.167:0/1598315100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 msgr2=0x7f7e5015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:39:54.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e4effd640 1 --2- 172.21.15.167:0/1598315100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 0x7f7e5015daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e4effd640 1 -- 172.21.15.167:0/1598315100 >> v1:172.21.15.178:6789/0 conn(0x7f7e500c6440 legacy=0x7f7e5006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.696+0000 7f7e4effd640 1 -- 172.21.15.167:0/1598315100 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5015a3a0 con 0x7f7e500c8620 2023-11-28T20:39:54.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e4effd640 1 --2- 172.21.15.167:0/1598315100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c8620 0x7f7e500c5f00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009870 tx=0x7f7e4401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad58cb4f0bb6f0d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:54.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e4e7fc640 1 -- 172.21.15.167:0/1598315100 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e440a8a30 con 0x7f7e500c8620 2023-11-28T20:39:54.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e4e7fc640 1 -- 172.21.15.167:0/1598315100 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e440a8b90 con 0x7f7e500c8620 2023-11-28T20:39:54.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e4e7fc640 1 -- 172.21.15.167:0/1598315100 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e440b0440 con 0x7f7e500c8620 2023-11-28T20:39:54.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e54993640 1 -- 172.21.15.167:0/1598315100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c8620 msgr2=0x7f7e500c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e54993640 1 --2- 172.21.15.167:0/1598315100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c8620 0x7f7e500c5f00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009870 tx=0x7f7e4401ed30 comp rx=0 tx=0).stop 2023-11-28T20:39:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e54993640 1 -- 172.21.15.167:0/1598315100 shutdown_connections 2023-11-28T20:39:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e54993640 1 --2- 172.21.15.167:0/1598315100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c8620 0x7f7e500c5f00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e54993640 1 --2- 172.21.15.167:0/1598315100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 0x7f7e5015daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e54993640 1 -- 172.21.15.167:0/1598315100 >> 172.21.15.167:0/1598315100 conn(0x7f7e500c8e70 msgr2=0x7f7e500c9280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e54993640 1 -- 172.21.15.167:0/1598315100 shutdown_connections 2023-11-28T20:39:54.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.700+0000 7f7e54993640 1 -- 172.21.15.167:0/1598315100 wait complete. 2023-11-28T20:39:54.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.704+0000 7f7e54993640 1 Processor -- start 2023-11-28T20:39:54.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.704+0000 7f7e54993640 1 -- start start 2023-11-28T20:39:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.704+0000 7f7e54993640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c6440 0x7f7e500caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.704+0000 7f7e54993640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 0x7f7e5014f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e54993640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e500c8620 0x7f7e50147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:54.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e54993640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5014e220 con 0x7f7e500c6440 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e54993640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5014ce30 con 0x7f7e500c8620 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e54993640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5014d8d0 con 0x7f7e500c8240 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c6440 0x7f7e500caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c6440 0x7f7e500caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:39782/0 (socket says 172.21.15.167:39782) 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4f7fe640 1 -- 172.21.15.167:0/1226330894 learned_addr learned my addr 172.21.15.167:0/1226330894 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4effd640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 0x7f7e5014f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4ffff640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e500c8620 0x7f7e50147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4f7fe640 1 -- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 msgr2=0x7f7e5014f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4f7fe640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 0x7f7e5014f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4f7fe640 1 -- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e500c8620 msgr2=0x7f7e50147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4f7fe640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e500c8620 0x7f7e50147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4f7fe640 1 -- 172.21.15.167:0/1226330894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e440094d0 con 0x7f7e500c6440 2023-11-28T20:39:54.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4ffff640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e500c8620 0x7f7e50147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:39:54.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e4f7fe640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c6440 0x7f7e500caec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000e930 tx=0x7f7e4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:54.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e37fff640 1 -- 172.21.15.167:0/1226330894 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e40009690 con 0x7f7e500c6440 2023-11-28T20:39:54.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e37fff640 1 -- 172.21.15.167:0/1226330894 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000ca00 con 0x7f7e500c6440 2023-11-28T20:39:54.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5014df40 con 0x7f7e500c6440 2023-11-28T20:39:54.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e37fff640 1 -- 172.21.15.167:0/1226330894 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000cd70 con 0x7f7e500c6440 2023-11-28T20:39:54.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5014d3b0 con 0x7f7e500c6440 2023-11-28T20:39:54.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.708+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5014cc90 con 0x7f7e500c6440 2023-11-28T20:39:54.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.712+0000 7f7e37fff640 1 -- 172.21.15.167:0/1226330894 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e40013470 con 0x7f7e500c6440 2023-11-28T20:39:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.712+0000 7f7e37fff640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e3c0664a0 0x7f7e3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:39:54.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.712+0000 7f7e37fff640 1 -- 172.21.15.167:0/1226330894 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e40084460 con 0x7f7e500c6440 2023-11-28T20:39:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.712+0000 7f7e4effd640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e3c0664a0 0x7f7e3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:39:54.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.712+0000 7f7e4effd640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e3c0664a0 0x7f7e3c068960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7e440b2000 tx=0x7f7e44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:39:54.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.716+0000 7f7e37fff640 1 -- 172.21.15.167:0/1226330894 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e5014cc90 con 0x7f7e500c6440 2023-11-28T20:39:54.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.944+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f7e5014cc90 con 0x7f7e500c6440 2023-11-28T20:39:54.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.944+0000 7f7e37fff640 1 -- 172.21.15.167:0/1226330894 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f7e5014cc90 con 0x7f7e500c6440 2023-11-28T20:39:54.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e3c0664a0 msgr2=0x7f7e3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e3c0664a0 0x7f7e3c068960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7e440b2000 tx=0x7f7e44009040 comp rx=0 tx=0).stop 2023-11-28T20:39:54.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c6440 msgr2=0x7f7e500caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:39:54.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c6440 0x7f7e500caec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000e930 tx=0x7f7e4000edf0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 shutdown_connections 2023-11-28T20:39:54.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7e3c0664a0 0x7f7e3c068960 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e500c8620 0x7f7e50147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e500c8240 0x7f7e5014f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 --2- 172.21.15.167:0/1226330894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e500c6440 0x7f7e500caec0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:39:54.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 >> 172.21.15.167:0/1226330894 conn(0x7f7e500c8e70 msgr2=0x7f7e5006e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:39:54.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 shutdown_connections 2023-11-28T20:39:54.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:39:54.948+0000 7f7e54993640 1 -- 172.21.15.167:0/1226330894 wait complete. 2023-11-28T20:39:54.971 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:40:04.972 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:40:04.973 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:40:05.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.203+0000 7f756d1d1640 1 Processor -- start 2023-11-28T20:40:05.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.203+0000 7f756d1d1640 1 -- start start 2023-11-28T20:40:05.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f756d1d1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f75680c2630 0x7f75680c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f756d1d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75681582c0 0x7f75680c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f756d1d1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756806a8c0 con 0x7f75680c8010 2023-11-28T20:40:05.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f756d1d1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75680c2f50 con 0x7f75680c2630 2023-11-28T20:40:05.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f756d1d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75680c94d0 con 0x7f75681582c0 2023-11-28T20:40:05.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f756759e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75681582c0 0x7f75680c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f756759e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75681582c0 0x7f75680c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:40868/0 (socket says 172.21.15.167:40868) 2023-11-28T20:40:05.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f7566d9d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f75680c2630 0x7f75680c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f756759e640 1 -- 172.21.15.167:0/1023130011 learned_addr learned my addr 172.21.15.167:0/1023130011 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:05.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f7566d9d640 1 -- 172.21.15.167:0/1023130011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75681582c0 msgr2=0x7f75680c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:05.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f7566d9d640 1 --2- 172.21.15.167:0/1023130011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75681582c0 0x7f75680c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f7566d9d640 1 -- 172.21.15.167:0/1023130011 >> v1:172.21.15.178:6789/0 conn(0x7f75680c8010 legacy=0x7f7568157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.207+0000 7f7566d9d640 1 -- 172.21.15.167:0/1023130011 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75680ca850 con 0x7f75680c2630 2023-11-28T20:40:05.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.211+0000 7f7566d9d640 1 --2- 172.21.15.167:0/1023130011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75680c2630 0x7f75680c44d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f755800dbe0 tx=0x7f7558020780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65f08e5e1064f1fb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:05.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.211+0000 7f7565d9b640 1 -- 172.21.15.167:0/1023130011 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755800d0d0 con 0x7f75680c2630 2023-11-28T20:40:05.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.211+0000 7f7565d9b640 1 -- 172.21.15.167:0/1023130011 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755800d230 con 0x7f75680c2630 2023-11-28T20:40:05.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.211+0000 7f7565d9b640 1 -- 172.21.15.167:0/1023130011 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75580a9850 con 0x7f75680c2630 2023-11-28T20:40:05.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.215+0000 7f756d1d1640 1 -- 172.21.15.167:0/1023130011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75680c2630 msgr2=0x7f75680c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.215+0000 7f756d1d1640 1 --2- 172.21.15.167:0/1023130011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75680c2630 0x7f75680c44d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f755800dbe0 tx=0x7f7558020780 comp rx=0 tx=0).stop 2023-11-28T20:40:05.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.215+0000 7f756d1d1640 1 -- 172.21.15.167:0/1023130011 shutdown_connections 2023-11-28T20:40:05.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.215+0000 7f756d1d1640 1 --2- 172.21.15.167:0/1023130011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75681582c0 0x7f75680c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.215+0000 7f756d1d1640 1 --2- 172.21.15.167:0/1023130011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75680c2630 0x7f75680c44d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.215+0000 7f756d1d1640 1 -- 172.21.15.167:0/1023130011 >> 172.21.15.167:0/1023130011 conn(0x7f756806ee00 msgr2=0x7f756806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:05.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.215+0000 7f756d1d1640 1 -- 172.21.15.167:0/1023130011 shutdown_connections 2023-11-28T20:40:05.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.215+0000 7f756d1d1640 1 -- 172.21.15.167:0/1023130011 wait complete. 2023-11-28T20:40:05.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f756d1d1640 1 Processor -- start 2023-11-28T20:40:05.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f756d1d1640 1 -- start start 2023-11-28T20:40:05.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f756d1d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75680c2630 0x7f756814b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f756d1d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75680c8010 0x7f756814f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f756d1d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75681582c0 0x7f756815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f7566d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75680c2630 0x7f756814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f7566d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75680c2630 0x7f756814b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36752/0 (socket says 172.21.15.167:36752) 2023-11-28T20:40:05.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f7566d9d640 1 -- 172.21.15.167:0/1736487475 learned_addr learned my addr 172.21.15.167:0/1736487475 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:05.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f756659c640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75680c8010 0x7f756814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f756759e640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75681582c0 0x7f756815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.219+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756815a090 con 0x7f75680c2630 2023-11-28T20:40:05.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75681ef2d0 con 0x7f75681582c0 2023-11-28T20:40:05.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75681ee770 con 0x7f75680c8010 2023-11-28T20:40:05.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756759e640 1 -- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75680c8010 msgr2=0x7f756814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756759e640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75680c8010 0x7f756814f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756759e640 1 -- 172.21.15.167:0/1736487475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75680c2630 msgr2=0x7f756814b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756759e640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75680c2630 0x7f756814b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756759e640 1 -- 172.21.15.167:0/1736487475 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755800d8c0 con 0x7f75681582c0 2023-11-28T20:40:05.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f7566d9d640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75680c2630 0x7f756814b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:40:05.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756759e640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75681582c0 0x7f756815a520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f756000eb80 tx=0x7f756000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:05.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f754f7fe640 1 -- 172.21.15.167:0/1736487475 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756000cb20 con 0x7f75681582c0 2023-11-28T20:40:05.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75681eea30 con 0x7f75681582c0 2023-11-28T20:40:05.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75681eeff0 con 0x7f75681582c0 2023-11-28T20:40:05.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f754f7fe640 1 -- 172.21.15.167:0/1736487475 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756000f040 con 0x7f75681582c0 2023-11-28T20:40:05.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.223+0000 7f754f7fe640 1 -- 172.21.15.167:0/1736487475 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756000cea0 con 0x7f75681582c0 2023-11-28T20:40:05.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.227+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7548005260 con 0x7f75681582c0 2023-11-28T20:40:05.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.227+0000 7f754f7fe640 1 -- 172.21.15.167:0/1736487475 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75600039a0 con 0x7f75681582c0 2023-11-28T20:40:05.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.231+0000 7f754f7fe640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7554066470 0x7f7554068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.231+0000 7f754f7fe640 1 -- 172.21.15.167:0/1736487475 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7560084430 con 0x7f75681582c0 2023-11-28T20:40:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.231+0000 7f7566d9d640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7554066470 0x7f7554068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.231+0000 7f7566d9d640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7554066470 0x7f7554068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7558000c10 tx=0x7f75580ab070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:05.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.243+0000 7f754f7fe640 1 -- 172.21.15.167:0/1736487475 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7560051630 con 0x7f75681582c0 2023-11-28T20:40:05.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.667+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7548005510 con 0x7f75681582c0 2023-11-28T20:40:05.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.667+0000 7f754f7fe640 1 -- 172.21.15.167:0/1736487475 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f7560054c50 con 0x7f75681582c0 2023-11-28T20:40:05.672 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:40:05.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7554066470 msgr2=0x7f7554068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7554066470 0x7f7554068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7558000c10 tx=0x7f75580ab070 comp rx=0 tx=0).stop 2023-11-28T20:40:05.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75681582c0 msgr2=0x7f756815a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75681582c0 0x7f756815a520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f756000eb80 tx=0x7f756000c490 comp rx=0 tx=0).stop 2023-11-28T20:40:05.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 shutdown_connections 2023-11-28T20:40:05.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7554066470 0x7f7554068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75681582c0 0x7f756815a520 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75680c8010 0x7f756814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 --2- 172.21.15.167:0/1736487475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75680c2630 0x7f756814b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 >> 172.21.15.167:0/1736487475 conn(0x7f756806ee00 msgr2=0x7f756806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:05.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 shutdown_connections 2023-11-28T20:40:05.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.671+0000 7f756d1d1640 1 -- 172.21.15.167:0/1736487475 wait complete. 2023-11-28T20:40:05.707 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:40:05.707 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:40:05.707 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:40:05.708 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:40:05.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.939+0000 7f3b39bfd640 1 Processor -- start 2023-11-28T20:40:05.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.939+0000 7f3b39bfd640 1 -- start start 2023-11-28T20:40:05.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b39bfd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b340cf440 0x7f3b340cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b39bfd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b34159f70 con 0x7f3b34159b20 2023-11-28T20:40:05.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b39bfd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3415a1b0 con 0x7f3b34153d20 2023-11-28T20:40:05.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b39bfd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b340cfd90 con 0x7f3b340cf440 2023-11-28T20:40:05.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b38bfb640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3b34153d20 0x7f3b340ca3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:58234/0 (socket says 172.21.15.167:58234) 2023-11-28T20:40:05.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b38bfb640 1 -- 172.21.15.167:0/2687853786 learned_addr learned my addr 172.21.15.167:0/2687853786 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:40:05.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b393fc640 1 --2- 172.21.15.167:0/2687853786 >> v2:172.21.15.167:3300/0 conn(0x7f3b340cf440 0x7f3b340cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b393fc640 1 -- 172.21.15.167:0/2687853786 >> v1:172.21.15.178:6789/0 conn(0x7f3b34153d20 legacy=0x7f3b340ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b337fe640 1 -- 172.21.15.167:0/2687853786 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220527139 0 0) 0x7f3b3415a1b0 con 0x7f3b34153d20 2023-11-28T20:40:05.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b393fc640 1 -- 172.21.15.167:0/2687853786 >> v1:172.21.15.167:6789/0 conn(0x7f3b34159b20 legacy=0x7f3b340c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.943+0000 7f3b393fc640 1 -- 172.21.15.167:0/2687853786 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3415a450 con 0x7f3b340cf440 2023-11-28T20:40:05.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.947+0000 7f3b393fc640 1 --2- 172.21.15.167:0/2687853786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b340cf440 0x7f3b340cf850 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3b3415a640 tx=0x7f3b2c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d45b144e009b2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:05.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.947+0000 7f3b337fe640 1 -- 172.21.15.167:0/2687853786 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0af600 con 0x7f3b340cf440 2023-11-28T20:40:05.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.947+0000 7f3b337fe640 1 -- 172.21.15.167:0/2687853786 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c0ab050 con 0x7f3b340cf440 2023-11-28T20:40:05.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.947+0000 7f3b337fe640 1 -- 172.21.15.167:0/2687853786 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0af980 con 0x7f3b340cf440 2023-11-28T20:40:05.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.947+0000 7f3b39bfd640 1 -- 172.21.15.167:0/2687853786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b340cf440 msgr2=0x7f3b340cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.947+0000 7f3b39bfd640 1 --2- 172.21.15.167:0/2687853786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b340cf440 0x7f3b340cf850 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3b3415a640 tx=0x7f3b2c01f110 comp rx=0 tx=0).stop 2023-11-28T20:40:05.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.947+0000 7f3b39bfd640 1 -- 172.21.15.167:0/2687853786 shutdown_connections 2023-11-28T20:40:05.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.947+0000 7f3b39bfd640 1 --2- 172.21.15.167:0/2687853786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b340cf440 0x7f3b340cf850 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.947+0000 7f3b39bfd640 1 -- 172.21.15.167:0/2687853786 >> 172.21.15.167:0/2687853786 conn(0x7f3b3406b800 msgr2=0x7f3b3406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:05.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.951+0000 7f3b39bfd640 1 -- 172.21.15.167:0/2687853786 shutdown_connections 2023-11-28T20:40:05.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.951+0000 7f3b39bfd640 1 -- 172.21.15.167:0/2687853786 wait complete. 2023-11-28T20:40:05.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.951+0000 7f3b39bfd640 1 Processor -- start 2023-11-28T20:40:05.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.951+0000 7f3b39bfd640 1 -- start start 2023-11-28T20:40:05.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b340cf440 0x7f3b34152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34153d20 0x7f3b34158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b34159b20 0x7f3b34158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b341f0250 con 0x7f3b34153d20 2023-11-28T20:40:05.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34157670 con 0x7f3b340cf440 2023-11-28T20:40:05.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34157950 con 0x7f3b34159b20 2023-11-28T20:40:05.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b33fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34153d20 0x7f3b34158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b38bfb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b340cf440 0x7f3b34152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b33fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34153d20 0x7f3b34158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36764/0 (socket says 172.21.15.167:36764) 2023-11-28T20:40:05.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b33fff640 1 -- 172.21.15.167:0/3542467676 learned_addr learned my addr 172.21.15.167:0/3542467676 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:05.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b38bfb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b340cf440 0x7f3b34152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:52976/0 (socket says 172.21.15.167:52976) 2023-11-28T20:40:05.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b393fc640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b34159b20 0x7f3b34158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b33fff640 1 -- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b34159b20 msgr2=0x7f3b34158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b33fff640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b34159b20 0x7f3b34158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b33fff640 1 -- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b340cf440 msgr2=0x7f3b34152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b33fff640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b340cf440 0x7f3b34152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b33fff640 1 -- 172.21.15.167:0/3542467676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c009a70 con 0x7f3b34153d20 2023-11-28T20:40:05.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b33fff640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34153d20 0x7f3b34158710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c3c0 tx=0x7f3b2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:05.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b200052d0 con 0x7f3b34153d20 2023-11-28T20:40:05.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b20005430 con 0x7f3b34153d20 2023-11-28T20:40:05.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20003840 con 0x7f3b34153d20 2023-11-28T20:40:05.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b34157c30 con 0x7f3b34153d20 2023-11-28T20:40:05.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b341581f0 con 0x7f3b34153d20 2023-11-28T20:40:05.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34159570 0x7f3b341f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.955+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34072740 con 0x7f3b34159570 2023-11-28T20:40:05.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.959+0000 7f3b38bfb640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34159570 0x7f3b341f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.959+0000 7f3b38bfb640 1 -- 172.21.15.167:0/3542467676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b340c4f90 con 0x7f3b34159570 2023-11-28T20:40:05.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.959+0000 7f3b38bfb640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34159570 0x7f3b341f2900 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3b28007fd0 tx=0x7f3b280018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:05.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.959+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2800f5e0 con 0x7f3b34159570 2023-11-28T20:40:05.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.959+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3b200039a0 con 0x7f3b34153d20 2023-11-28T20:40:05.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.959+0000 7f3b317fa640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b18066560 0x7f3b18068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.959+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b20083580 con 0x7f3b34153d20 2023-11-28T20:40:05.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.959+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3b2800f740 con 0x7f3b34159570 2023-11-28T20:40:05.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.959+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34159570 msgr2=0x7f3b341f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.963+0000 7f3b317fa640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34159570 0x7f3b341f2900 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3b28007fd0 tx=0x7f3b280018c0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.963+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34159570 msgr2=0x7f3b341f2900 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:05.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.963+0000 7f3b317fa640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34159570 0x7f3b341f2900 secure :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3b28007fd0 tx=0x7f3b280018c0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.963+0000 7f3b393fc640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b18066560 0x7f3b18068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.963+0000 7f3b393fc640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b18066560 0x7f3b18068a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0b1000 tx=0x7f3b2c0aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:05.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.971+0000 7f3b39bfd640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b341f2e40 0x7f3b341f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:05.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.971+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34157dc0 con 0x7f3b341f2e40 2023-11-28T20:40:05.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b38bfb640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b341f2e40 0x7f3b341f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:05.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b38bfb640 1 -- 172.21.15.167:0/3542467676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3b3415a9f0 con 0x7f3b341f2e40 2023-11-28T20:40:05.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b38bfb640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b341f2e40 0x7f3b341f3250 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3b28007fd0 tx=0x7f3b28000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:05.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28023070 con 0x7f3b341f2e40 2023-11-28T20:40:05.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4982 (secure 0 0 0) 0x7f3b28013600 con 0x7f3b341f2e40 2023-11-28T20:40:05.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b341f2e40 msgr2=0x7f3b341f3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b317fa640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b341f2e40 0x7f3b341f3250 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3b28007fd0 tx=0x7f3b28000ee0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b317fa640 1 -- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b341f2e40 msgr2=0x7f3b341f3250 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:05.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b317fa640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b341f2e40 0x7f3b341f3250 secure :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3b28007fd0 tx=0x7f3b28000ee0 comp rx=0 tx=0).stop 2023-11-28T20:40:05.980 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:40:05.980 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:05.980 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:05.980 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 14, 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 16, 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:05.981 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:40:05.982 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.983 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:40:05.984 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:05.985 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:05.986 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:05.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.987 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:05.987 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:40:05.987 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:05.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:05.988 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:40:05.989 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:40:05.990 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:05.991 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:40:05.992 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:05.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.992 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:05.992 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:40:05.992 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:05.992 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.993 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:05.994 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:40:05.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:05.996 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:05.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:05.997 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:40:05.997 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b18066560 msgr2=0x7f3b18068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b39bfd640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b18066560 0x7f3b18068a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0b1000 tx=0x7f3b2c0aa000 comp rx=0 tx=0).stop 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34153d20 msgr2=0x7f3b34158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b39bfd640 1 --2- 172.21.15.167:0/3542467676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b34153d20 0x7f3b34158710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c3c0 tx=0x7f3b2000c880 comp rx=0 tx=0).stop 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b393fc640 1 -- 172.21.15.167:0/3542467676 reap_dead start 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b393fc640 1 -- 172.21.15.167:0/3542467676 reap_dead start 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 shutdown_connections 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 >> 172.21.15.167:0/3542467676 conn(0x7f3b3406b800 msgr2=0x7f3b340cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 shutdown_connections 2023-11-28T20:40:05.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:05.975+0000 7f3b39bfd640 1 -- 172.21.15.167:0/3542467676 wait complete. 2023-11-28T20:40:06.008 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:40:06.009 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:40:06.009 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:40:06.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6ef03640 1 Processor -- start 2023-11-28T20:40:06.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6ef03640 1 -- start start 2023-11-28T20:40:06.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6ef03640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 0x7fdc68159b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6ef03640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6815a1b0 con 0x7fdc680cf440 2023-11-28T20:40:06.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6ef03640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6815a450 con 0x7fdc680ca3c0 2023-11-28T20:40:06.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6ef03640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6815a710 con 0x7fdc68153d20 2023-11-28T20:40:06.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6e702640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fdc680cf440 0x7fdc681644a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35358/0 (socket says 172.21.15.167:35358) 2023-11-28T20:40:06.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6e702640 1 -- 172.21.15.167:0/182567455 learned_addr learned my addr 172.21.15.167:0/182567455 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:40:06.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6df01640 1 --2- 172.21.15.167:0/182567455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 0x7fdc68159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.243+0000 7fdc6d700640 1 --1- 172.21.15.167:0/182567455 >> v1:172.21.15.178:6789/0 conn(0x7fdc680ca3c0 0x7fdc680c5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:58248/0 (socket says 172.21.15.167:58248) 2023-11-28T20:40:06.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.247+0000 7fdc6ceff640 1 -- 172.21.15.167:0/182567455 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205023125 0 0) 0x7fdc6815a1b0 con 0x7fdc680cf440 2023-11-28T20:40:06.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.247+0000 7fdc6ceff640 1 -- 172.21.15.167:0/182567455 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc54003530 con 0x7fdc680cf440 2023-11-28T20:40:06.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.247+0000 7fdc6ceff640 1 -- 172.21.15.167:0/182567455 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766352321 0 0) 0x7fdc6815a450 con 0x7fdc680ca3c0 2023-11-28T20:40:06.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.247+0000 7fdc6ceff640 1 -- 172.21.15.167:0/182567455 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc6815a1b0 con 0x7fdc680ca3c0 2023-11-28T20:40:06.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.247+0000 7fdc6df01640 1 -- 172.21.15.167:0/182567455 >> v1:172.21.15.178:6789/0 conn(0x7fdc680ca3c0 legacy=0x7fdc680c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.247+0000 7fdc6df01640 1 -- 172.21.15.167:0/182567455 >> v1:172.21.15.167:6789/0 conn(0x7fdc680cf440 legacy=0x7fdc681644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.247+0000 7fdc6df01640 1 -- 172.21.15.167:0/182567455 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6815a9f0 con 0x7fdc68153d20 2023-11-28T20:40:06.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6df01640 1 --2- 172.21.15.167:0/182567455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 0x7fdc68159b20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdc640097f0 tx=0x7fdc6401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64bd8e051e794c06 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ceff640 1 -- 172.21.15.167:0/182567455 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640a8970 con 0x7fdc68153d20 2023-11-28T20:40:06.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ceff640 1 -- 172.21.15.167:0/182567455 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc640a8ad0 con 0x7fdc68153d20 2023-11-28T20:40:06.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ceff640 1 -- 172.21.15.167:0/182567455 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640a8e60 con 0x7fdc68153d20 2023-11-28T20:40:06.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ef03640 1 -- 172.21.15.167:0/182567455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 msgr2=0x7fdc68159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ef03640 1 --2- 172.21.15.167:0/182567455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 0x7fdc68159b20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdc640097f0 tx=0x7fdc6401ec70 comp rx=0 tx=0).stop 2023-11-28T20:40:06.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ef03640 1 -- 172.21.15.167:0/182567455 shutdown_connections 2023-11-28T20:40:06.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ef03640 1 --2- 172.21.15.167:0/182567455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 0x7fdc68159b20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ef03640 1 -- 172.21.15.167:0/182567455 >> 172.21.15.167:0/182567455 conn(0x7fdc6806b800 msgr2=0x7fdc6806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:06.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ef03640 1 -- 172.21.15.167:0/182567455 shutdown_connections 2023-11-28T20:40:06.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.251+0000 7fdc6ef03640 1 -- 172.21.15.167:0/182567455 wait complete. 2023-11-28T20:40:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.255+0000 7fdc6ef03640 1 Processor -- start 2023-11-28T20:40:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.255+0000 7fdc6ef03640 1 -- start start 2023-11-28T20:40:06.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.255+0000 7fdc6ef03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc680ca3c0 0x7fdc681f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.255+0000 7fdc6ef03640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc680cf440 0x7fdc68156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.255+0000 7fdc6ef03640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 0x7fdc68149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.255+0000 7fdc6ef03640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6814f010 con 0x7fdc680ca3c0 2023-11-28T20:40:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.255+0000 7fdc6ef03640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6814e630 con 0x7fdc680cf440 2023-11-28T20:40:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.255+0000 7fdc6ef03640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68150b70 con 0x7fdc68153d20 2023-11-28T20:40:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6df01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc680ca3c0 0x7fdc681f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6df01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc680ca3c0 0x7fdc681f0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36780/0 (socket says 172.21.15.167:36780) 2023-11-28T20:40:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6df01640 1 -- 172.21.15.167:0/4084507263 learned_addr learned my addr 172.21.15.167:0/4084507263 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:06.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6d700640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc680cf440 0x7fdc68156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6e702640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 0x7fdc68149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6df01640 1 -- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 msgr2=0x7fdc68149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6df01640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc68153d20 0x7fdc68149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6df01640 1 -- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc680cf440 msgr2=0x7fdc68156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6df01640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc680cf440 0x7fdc68156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6df01640 1 -- 172.21.15.167:0/4084507263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc64009420 con 0x7fdc680ca3c0 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6df01640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc680ca3c0 0x7fdc681f0020 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009740 tx=0x7fdc6401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640b0d60 con 0x7fdc680ca3c0 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc640bb440 con 0x7fdc680ca3c0 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640bb7f0 con 0x7fdc680ca3c0 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc681efb90 con 0x7fdc680ca3c0 2023-11-28T20:40:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6814e350 con 0x7fdc680ca3c0 2023-11-28T20:40:06.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6ef03640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc681549a0 0x7fdc6814a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6814a7e0 con 0x7fdc681549a0 2023-11-28T20:40:06.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.259+0000 7fdc6d700640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc681549a0 0x7fdc6814a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc6d700640 1 -- 172.21.15.167:0/4084507263 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc680c5550 con 0x7fdc681549a0 2023-11-28T20:40:06.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc6d700640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc681549a0 0x7fdc6814a2a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc680c9a60 tx=0x7fdc58001900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800f5e0 con 0x7fdc681549a0 2023-11-28T20:40:06.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdc640b7040 con 0x7fdc680ca3c0 2023-11-28T20:40:06.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc5e7fc640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc4c066540 0x7fdc4c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdc64121b20 con 0x7fdc680ca3c0 2023-11-28T20:40:06.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fdc5800f740 con 0x7fdc681549a0 2023-11-28T20:40:06.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc681549a0 msgr2=0x7fdc6814a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc5e7fc640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc681549a0 0x7fdc6814a2a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc680c9a60 tx=0x7fdc58001900 comp rx=0 tx=0).stop 2023-11-28T20:40:06.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc681549a0 msgr2=0x7fdc6814a2a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:06.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc5e7fc640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc681549a0 0x7fdc6814a2a0 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc680c9a60 tx=0x7fdc58001900 comp rx=0 tx=0).stop 2023-11-28T20:40:06.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.263+0000 7fdc6e702640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc4c066540 0x7fdc4c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.267+0000 7fdc6e702640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc4c066540 0x7fdc4c068a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdc60001570 tx=0x7fdc60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.275+0000 7fdc6ef03640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc68154410 0x7fdc681f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.275+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68072740 con 0x7fdc68154410 2023-11-28T20:40:06.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.275+0000 7fdc6d700640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc68154410 0x7fdc681f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6d700640 1 -- 172.21.15.167:0/4084507263 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdc680c5270 con 0x7fdc68154410 2023-11-28T20:40:06.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6d700640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc68154410 0x7fdc681f2bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc58017000 tx=0x7fdc58001090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58022070 con 0x7fdc68154410 2023-11-28T20:40:06.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4953 (secure 0 0 0) 0x7fdc580133f0 con 0x7fdc68154410 2023-11-28T20:40:06.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc68154410 msgr2=0x7fdc681f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc5e7fc640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc68154410 0x7fdc681f2bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc58017000 tx=0x7fdc58001090 comp rx=0 tx=0).stop 2023-11-28T20:40:06.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc5e7fc640 1 -- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc68154410 msgr2=0x7fdc681f2bf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:06.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc5e7fc640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc68154410 0x7fdc681f2bf0 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc58017000 tx=0x7fdc58001090 comp rx=0 tx=0).stop 2023-11-28T20:40:06.285 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:40:06.285 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:06.285 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:06.285 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:40:06.285 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 14, 2023-11-28T20:40:06.285 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:40:06.286 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:40:06.286 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:40:06.286 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 16, 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:06.287 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:06.288 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:06.289 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:06.289 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:06.289 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:06.289 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.289 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:40:06.289 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:40:06.289 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:40:06.290 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:40:06.290 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:40:06.290 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:40:06.290 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:06.290 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:06.290 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:40:06.290 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:40:06.290 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:40:06.290 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:40:06.291 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:40:06.291 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:40:06.291 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:40:06.291 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:06.291 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:40:06.291 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:06.291 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:06.292 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:06.292 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:06.292 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:06.292 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:06.292 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:06.292 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:06.292 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:06.292 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:06.292 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:06.293 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:40:06.294 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:06.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.297 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.298 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:06.299 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:40:06.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.301 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:06.302 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:06.302 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:06.302 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.302 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.302 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:40:06.302 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:40:06.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc4c066540 msgr2=0x7fdc4c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6ef03640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc4c066540 0x7fdc4c068a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdc60001570 tx=0x7fdc60009040 comp rx=0 tx=0).stop 2023-11-28T20:40:06.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc680ca3c0 msgr2=0x7fdc681f0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6ef03640 1 --2- 172.21.15.167:0/4084507263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc680ca3c0 0x7fdc681f0020 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009740 tx=0x7fdc6401ba10 comp rx=0 tx=0).stop 2023-11-28T20:40:06.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6e702640 1 -- 172.21.15.167:0/4084507263 reap_dead start 2023-11-28T20:40:06.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6e702640 1 -- 172.21.15.167:0/4084507263 reap_dead start 2023-11-28T20:40:06.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 shutdown_connections 2023-11-28T20:40:06.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 >> 172.21.15.167:0/4084507263 conn(0x7fdc6806b800 msgr2=0x7fdc680ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:06.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 shutdown_connections 2023-11-28T20:40:06.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.279+0000 7fdc6ef03640 1 -- 172.21.15.167:0/4084507263 wait complete. 2023-11-28T20:40:06.311 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:40:06.311 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:40:06.311 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:40:06.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.539+0000 7f8dfb832640 1 Processor -- start 2023-11-28T20:40:06.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.539+0000 7f8dfb832640 1 -- start start 2023-11-28T20:40:06.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8dfb832640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8df4151f60 0x7f8df40c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8dfb832640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df40c5c90 0x7f8df40c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8dfb832640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df415b220 con 0x7f8df406a580 2023-11-28T20:40:06.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8dfb832640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df40c4da0 con 0x7f8df4151f60 2023-11-28T20:40:06.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8dfb832640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40c60f0 con 0x7f8df40c5c90 2023-11-28T20:40:06.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8df95ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8df4151f60 0x7f8df40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8df95ce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8df4151f60 0x7f8df40c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36786/0 (socket says 172.21.15.167:36786) 2023-11-28T20:40:06.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8df95ce640 1 -- 172.21.15.167:0/3993155529 learned_addr learned my addr 172.21.15.167:0/3993155529 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:06.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8df8dcd640 1 --2- 172.21.15.167:0/3993155529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df40c5c90 0x7f8df40c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8df8dcd640 1 -- 172.21.15.167:0/3993155529 >> v2:172.21.15.167:3300/0 conn(0x7f8df4151f60 msgr2=0x7f8df40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:06.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8df8dcd640 1 --2- 172.21.15.167:0/3993155529 >> v2:172.21.15.167:3300/0 conn(0x7f8df4151f60 0x7f8df40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8df8dcd640 1 -- 172.21.15.167:0/3993155529 >> v1:172.21.15.178:6789/0 conn(0x7f8df406a580 legacy=0x7f8df406ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8df8dcd640 1 -- 172.21.15.167:0/3993155529 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4152340 con 0x7f8df40c5c90 2023-11-28T20:40:06.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.543+0000 7f8df95ce640 1 --2- 172.21.15.167:0/3993155529 >> v2:172.21.15.167:3300/0 conn(0x7f8df4151f60 0x7f8df40c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:40:06.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.547+0000 7f8df8dcd640 1 --2- 172.21.15.167:0/3993155529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df40c5c90 0x7f8df40c26e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8de40097c0 tx=0x7f8de401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ef27e96a8e1550d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.547+0000 7f8debfff640 1 -- 172.21.15.167:0/3993155529 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40ab600 con 0x7f8df40c5c90 2023-11-28T20:40:06.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.547+0000 7f8debfff640 1 -- 172.21.15.167:0/3993155529 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de40a7050 con 0x7f8df40c5c90 2023-11-28T20:40:06.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.547+0000 7f8debfff640 1 -- 172.21.15.167:0/3993155529 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40ab980 con 0x7f8df40c5c90 2023-11-28T20:40:06.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.551+0000 7f8dfb832640 1 -- 172.21.15.167:0/3993155529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df40c5c90 msgr2=0x7f8df40c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.551+0000 7f8dfb832640 1 --2- 172.21.15.167:0/3993155529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df40c5c90 0x7f8df40c26e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8de40097c0 tx=0x7f8de401c3f0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.551+0000 7f8dfb832640 1 -- 172.21.15.167:0/3993155529 shutdown_connections 2023-11-28T20:40:06.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.551+0000 7f8dfb832640 1 --2- 172.21.15.167:0/3993155529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df40c5c90 0x7f8df40c26e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.551+0000 7f8dfb832640 1 --2- 172.21.15.167:0/3993155529 >> v2:172.21.15.167:3300/0 conn(0x7f8df4151f60 0x7f8df40c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.551+0000 7f8dfb832640 1 -- 172.21.15.167:0/3993155529 >> 172.21.15.167:0/3993155529 conn(0x7f8df40cb1e0 msgr2=0x7f8df40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:06.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.551+0000 7f8dfb832640 1 -- 172.21.15.167:0/3993155529 shutdown_connections 2023-11-28T20:40:06.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.551+0000 7f8dfb832640 1 -- 172.21.15.167:0/3993155529 wait complete. 2023-11-28T20:40:06.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8dfb832640 1 Processor -- start 2023-11-28T20:40:06.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8dfb832640 1 -- start start 2023-11-28T20:40:06.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8dfb832640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df406a580 0x7f8df41f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8dfb832640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df40c5c90 0x7f8df4147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8dfb832640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df4151f60 0x7f8df40ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8dfb832640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df41f3a70 con 0x7f8df4151f60 2023-11-28T20:40:06.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8dfb832640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40ca490 con 0x7f8df40c5c90 2023-11-28T20:40:06.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8dfb832640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df4146e00 con 0x7f8df406a580 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df8dcd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df40c5c90 0x7f8df4147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df95ce640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df406a580 0x7f8df41f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df8dcd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df40c5c90 0x7f8df4147cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:53016/0 (socket says 172.21.15.167:53016) 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df8dcd640 1 -- 172.21.15.167:0/1617623862 learned_addr learned my addr 172.21.15.167:0/1617623862 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df9dcf640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df4151f60 0x7f8df40ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df8dcd640 1 -- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df406a580 msgr2=0x7f8df41f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df8dcd640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8df406a580 0x7f8df41f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df8dcd640 1 -- 172.21.15.167:0/1617623862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df4151f60 msgr2=0x7f8df40ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df8dcd640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df4151f60 0x7f8df40ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df8dcd640 1 -- 172.21.15.167:0/1617623862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df00094d0 con 0x7f8df40c5c90 2023-11-28T20:40:06.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8df8dcd640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df40c5c90 0x7f8df4147cb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8de40ae040 tx=0x7f8de4019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.555+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40b4430 con 0x7f8df40c5c90 2023-11-28T20:40:06.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de4009420 con 0x7f8df40c5c90 2023-11-28T20:40:06.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df41473c0 con 0x7f8df40c5c90 2023-11-28T20:40:06.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de40b4590 con 0x7f8df40c5c90 2023-11-28T20:40:06.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40b4960 con 0x7f8df40c5c90 2023-11-28T20:40:06.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8dfb832640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4002a40 0x7f8dd4004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4007e90 con 0x7f8dd4002a40 2023-11-28T20:40:06.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8df95ce640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4002a40 0x7f8dd4004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8df95ce640 1 -- 172.21.15.167:0/1617623862 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8dd4008050 con 0x7f8dd4002a40 2023-11-28T20:40:06.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8df95ce640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4002a40 0x7f8dd4004f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8df0011bd0 tx=0x7f8df000f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.559+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0011cc0 con 0x7f8dd4002a40 2023-11-28T20:40:06.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8df0011e20 con 0x7f8dd4002a40 2023-11-28T20:40:06.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4002a40 msgr2=0x7f8dd4004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8de9ffb640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4002a40 0x7f8dd4004f00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8df0011bd0 tx=0x7f8df000f610 comp rx=0 tx=0).stop 2023-11-28T20:40:06.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4002a40 msgr2=0x7f8dd4004f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:06.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8de9ffb640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4002a40 0x7f8dd4004f00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8de40b2040 con 0x7f8df40c5c90 2023-11-28T20:40:06.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8de9ffb640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8dd8066180 0x7f8dd8068640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8de411e0a0 con 0x7f8df40c5c90 2023-11-28T20:40:06.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8df95ce640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8dd8066180 0x7f8dd8068640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.563+0000 7f8df95ce640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8dd8066180 0x7f8dd8068640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8df000fbb0 tx=0x7f8df0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8dfb832640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4006f70 0x7f8dd40073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd400a350 con 0x7f8dd4006f70 2023-11-28T20:40:06.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8df9dcf640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4006f70 0x7f8dd40073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8df9dcf640 1 -- 172.21.15.167:0/1617623862 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8dd400a510 con 0x7f8dd4006f70 2023-11-28T20:40:06.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8df9dcf640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4006f70 0x7f8dd40073c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00f890 tx=0x7f8dec00fd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec017070 con 0x7f8dd4006f70 2023-11-28T20:40:06.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f8dec003b90 con 0x7f8dd4006f70 2023-11-28T20:40:06.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4006f70 msgr2=0x7f8dd40073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8de9ffb640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4006f70 0x7f8dd40073c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00f890 tx=0x7f8dec00fd50 comp rx=0 tx=0).stop 2023-11-28T20:40:06.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8de9ffb640 1 -- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4006f70 msgr2=0x7f8dd40073c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:06.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8de9ffb640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dd4006f70 0x7f8dd40073c0 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00f890 tx=0x7f8dec00fd50 comp rx=0 tx=0).stop 2023-11-28T20:40:06.581 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:40:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:40:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 14, 2023-11-28T20:40:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:40:06.581 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 16, 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:06.582 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:06.583 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:40:06.584 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:40:06.585 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:06.586 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:06.587 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:06.588 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:06.590 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.591 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.592 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:06.593 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:06.594 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:40:06.594 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8dd8066180 msgr2=0x7f8dd8068640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8dfb832640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8dd8066180 0x7f8dd8068640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8df000fbb0 tx=0x7f8df0008030 comp rx=0 tx=0).stop 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df40c5c90 msgr2=0x7f8df4147cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8dfb832640 1 --2- 172.21.15.167:0/1617623862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df40c5c90 0x7f8df4147cb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8de40ae040 tx=0x7f8de4019190 comp rx=0 tx=0).stop 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8df9dcf640 1 -- 172.21.15.167:0/1617623862 reap_dead start 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8df9dcf640 1 -- 172.21.15.167:0/1617623862 reap_dead start 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.575+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 shutdown_connections 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.579+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 >> 172.21.15.167:0/1617623862 conn(0x7f8df40cb1e0 msgr2=0x7f8df40cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.579+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 shutdown_connections 2023-11-28T20:40:06.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.579+0000 7f8dfb832640 1 -- 172.21.15.167:0/1617623862 wait complete. 2023-11-28T20:40:06.608 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:40:06.608 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2023-11-28T20:40:06.608 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:40:06.608 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2023-11-28T20:40:06.608 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:40:06.609 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:40:06.609 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:40:06.624 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:40:06.624 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:40:06.624 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:40:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.847+0000 7f207089b640 1 Processor -- start 2023-11-28T20:40:06.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.847+0000 7f207089b640 1 -- start start 2023-11-28T20:40:06.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f207089b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f206c153db0 0x7f206c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f207089b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c0cfef0 con 0x7f206c0ccb70 2023-11-28T20:40:06.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f207089b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c0cc6e0 con 0x7f206c0cf440 2023-11-28T20:40:06.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f207089b640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c154190 con 0x7f206c153db0 2023-11-28T20:40:06.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206affd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f206c0ccb70 0x7f206c0c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35370/0 (socket says 172.21.15.167:35370) 2023-11-28T20:40:06.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206bfff640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f206c0cf440 0x7f206c0ca350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:58262/0 (socket says 172.21.15.167:58262) 2023-11-28T20:40:06.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206bfff640 1 -- 172.21.15.167:0/3419998391 learned_addr learned my addr 172.21.15.167:0/3419998391 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:40:06.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206b7fe640 1 --2- 172.21.15.167:0/3419998391 >> v2:172.21.15.178:3300/0 conn(0x7f206c153db0 0x7f206c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206a7fc640 1 -- 172.21.15.167:0/3419998391 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108941617 0 0) 0x7f206c0cfef0 con 0x7f206c0ccb70 2023-11-28T20:40:06.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206a7fc640 1 -- 172.21.15.167:0/3419998391 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2054003530 con 0x7f206c0ccb70 2023-11-28T20:40:06.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206a7fc640 1 -- 172.21.15.167:0/3419998391 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072916092 0 0) 0x7f206c0cc6e0 con 0x7f206c0cf440 2023-11-28T20:40:06.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206a7fc640 1 -- 172.21.15.167:0/3419998391 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f206c0cfef0 con 0x7f206c0cf440 2023-11-28T20:40:06.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206b7fe640 1 -- 172.21.15.167:0/3419998391 >> v1:172.21.15.178:6789/0 conn(0x7f206c0cf440 legacy=0x7f206c0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206b7fe640 1 -- 172.21.15.167:0/3419998391 >> v1:172.21.15.167:6789/0 conn(0x7f206c0ccb70 legacy=0x7f206c0c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.851+0000 7f206b7fe640 1 -- 172.21.15.167:0/3419998391 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c0cbad0 con 0x7f206c153db0 2023-11-28T20:40:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f206b7fe640 1 --2- 172.21.15.167:0/3419998391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c153db0 0x7f206c15a540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f205c0097c0 tx=0x7f205c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d3f4aa2577e20b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f206a7fc640 1 -- 172.21.15.167:0/3419998391 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c0ab600 con 0x7f206c153db0 2023-11-28T20:40:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f206a7fc640 1 -- 172.21.15.167:0/3419998391 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c0a7050 con 0x7f206c153db0 2023-11-28T20:40:06.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f206a7fc640 1 -- 172.21.15.167:0/3419998391 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c0ab960 con 0x7f206c153db0 2023-11-28T20:40:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f207089b640 1 -- 172.21.15.167:0/3419998391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c153db0 msgr2=0x7f206c15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f207089b640 1 --2- 172.21.15.167:0/3419998391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c153db0 0x7f206c15a540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f205c0097c0 tx=0x7f205c01c480 comp rx=0 tx=0).stop 2023-11-28T20:40:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f207089b640 1 -- 172.21.15.167:0/3419998391 shutdown_connections 2023-11-28T20:40:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f207089b640 1 --2- 172.21.15.167:0/3419998391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c153db0 0x7f206c15a540 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f207089b640 1 -- 172.21.15.167:0/3419998391 >> 172.21.15.167:0/3419998391 conn(0x7f206c06b800 msgr2=0x7f206c06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f207089b640 1 -- 172.21.15.167:0/3419998391 shutdown_connections 2023-11-28T20:40:06.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.859+0000 7f207089b640 1 -- 172.21.15.167:0/3419998391 wait complete. 2023-11-28T20:40:06.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f207089b640 1 Processor -- start 2023-11-28T20:40:06.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f207089b640 1 -- start start 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f207089b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c0ccb70 0x7f206c15c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f207089b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206c0cf440 0x7f206c146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f207089b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f206c153db0 0x7f206c0b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f207089b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0b52d0 con 0x7f206c153db0 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f207089b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15c8e0 con 0x7f206c0ccb70 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f207089b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15d600 con 0x7f206c0cf440 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f206affd640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206c0cf440 msgr2=0x7f206c146410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f206affd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206c0cf440 0x7f206c146410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f206bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f206c153db0 0x7f206c0b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f206bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f206c153db0 0x7f206c0b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36810/0 (socket says 172.21.15.167:36810) 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f206bfff640 1 -- 172.21.15.167:0/276664682 learned_addr learned my addr 172.21.15.167:0/276664682 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:06.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.863+0000 7f206b7fe640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c0ccb70 0x7f206c15c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f206bfff640 1 -- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206c0cf440 msgr2=0x7f206c146410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f206bfff640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206c0cf440 0x7f206c146410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f206bfff640 1 -- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c0ccb70 msgr2=0x7f206c15c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f206bfff640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c0ccb70 0x7f206c15c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f206bfff640 1 -- 172.21.15.167:0/276664682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c009420 con 0x7f206c153db0 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f206bfff640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f206c153db0 0x7f206c0b3b60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f206400ca80 tx=0x7f206400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f2053fff640 1 -- 172.21.15.167:0/276664682 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400abd0 con 0x7f206c153db0 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f2053fff640 1 -- 172.21.15.167:0/276664682 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206400ad30 con 0x7f206c153db0 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f2053fff640 1 -- 172.21.15.167:0/276664682 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400aea0 con 0x7f206c153db0 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c157830 con 0x7f206c153db0 2023-11-28T20:40:06.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c15d040 con 0x7f206c153db0 2023-11-28T20:40:06.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.867+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c04e850 con 0x7f206c153db0 2023-11-28T20:40:06.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.871+0000 7f2053fff640 1 -- 172.21.15.167:0/276664682 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2064007070 con 0x7f206c153db0 2023-11-28T20:40:06.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.871+0000 7f2053fff640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2058066470 0x7f2058068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:06.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.871+0000 7f2053fff640 1 -- 172.21.15.167:0/276664682 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20640843d0 con 0x7f206c153db0 2023-11-28T20:40:06.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.871+0000 7f206b7fe640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2058066470 0x7f2058068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:06.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.875+0000 7f206b7fe640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2058066470 0x7f2058068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f205c0ad000 tx=0x7f205c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:06.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:06.879+0000 7f2053fff640 1 -- 172.21.15.167:0/276664682 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20640550b0 con 0x7f206c153db0 2023-11-28T20:40:07.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.299+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f206c152940 con 0x7f206c153db0 2023-11-28T20:40:07.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f2053fff640 1 -- 172.21.15.167:0/276664682 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f2064017020 con 0x7f206c153db0 2023-11-28T20:40:07.306 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:40:07.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2058066470 msgr2=0x7f2058068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:07.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2058066470 0x7f2058068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f205c0ad000 tx=0x7f205c008040 comp rx=0 tx=0).stop 2023-11-28T20:40:07.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f206c153db0 msgr2=0x7f206c0b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:07.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f206c153db0 0x7f206c0b3b60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f206400ca80 tx=0x7f206400cf40 comp rx=0 tx=0).stop 2023-11-28T20:40:07.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 shutdown_connections 2023-11-28T20:40:07.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2058066470 0x7f2058068930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:07.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f206c153db0 0x7f206c0b3b60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:07.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206c0cf440 0x7f206c146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:07.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 --2- 172.21.15.167:0/276664682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c0ccb70 0x7f206c15c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:07.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 >> 172.21.15.167:0/276664682 conn(0x7f206c06b800 msgr2=0x7f206c14f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:07.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 shutdown_connections 2023-11-28T20:40:07.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:07.303+0000 7f207089b640 1 -- 172.21.15.167:0/276664682 wait complete. 2023-11-28T20:40:10.340 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:40:10.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.567+0000 7f35c9679640 1 Processor -- start 2023-11-28T20:40:10.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.567+0000 7f35c9679640 1 -- start start 2023-11-28T20:40:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c9679640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f35c40cf860 0x7f35c40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c9679640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35c40cfc40 0x7f35c40ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c9679640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c415ac00 con 0x7f35c4153ae0 2023-11-28T20:40:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c9679640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c40cbd60 con 0x7f35c40cfc40 2023-11-28T20:40:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c9679640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c4159ff0 con 0x7f35c40cf860 2023-11-28T20:40:10.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35c40cfc40 0x7f35c40ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c2ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f35c40cf860 0x7f35c40cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35c40cfc40 0x7f35c40ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36812/0 (socket says 172.21.15.167:36812) 2023-11-28T20:40:10.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c27fc640 1 -- 172.21.15.167:0/1422973267 learned_addr learned my addr 172.21.15.167:0/1422973267 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c2ffd640 1 -- 172.21.15.167:0/1422973267 >> v2:172.21.15.167:3300/0 conn(0x7f35c40cfc40 msgr2=0x7f35c40ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c2ffd640 1 --2- 172.21.15.167:0/1422973267 >> v2:172.21.15.167:3300/0 conn(0x7f35c40cfc40 0x7f35c40ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:10.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c2ffd640 1 -- 172.21.15.167:0/1422973267 >> v1:172.21.15.178:6789/0 conn(0x7f35c4153ae0 legacy=0x7f35c415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:10.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.571+0000 7f35c2ffd640 1 -- 172.21.15.167:0/1422973267 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c415a2d0 con 0x7f35c40cf860 2023-11-28T20:40:10.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.575+0000 7f35c2ffd640 1 --2- 172.21.15.167:0/1422973267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c40cf860 0x7f35c40cb770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f35c40d03b0 tx=0x7f35b401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d9ae967346d984 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:10.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.575+0000 7f35c1ffb640 1 -- 172.21.15.167:0/1422973267 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40a7070 con 0x7f35c40cf860 2023-11-28T20:40:10.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.575+0000 7f35c1ffb640 1 -- 172.21.15.167:0/1422973267 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b40ab430 con 0x7f35c40cf860 2023-11-28T20:40:10.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.575+0000 7f35c1ffb640 1 -- 172.21.15.167:0/1422973267 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40ab7c0 con 0x7f35c40cf860 2023-11-28T20:40:10.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 -- 172.21.15.167:0/1422973267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c40cf860 msgr2=0x7f35c40cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:10.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 --2- 172.21.15.167:0/1422973267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c40cf860 0x7f35c40cb770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f35c40d03b0 tx=0x7f35b401c430 comp rx=0 tx=0).stop 2023-11-28T20:40:10.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 -- 172.21.15.167:0/1422973267 shutdown_connections 2023-11-28T20:40:10.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 --2- 172.21.15.167:0/1422973267 >> v2:172.21.15.167:3300/0 conn(0x7f35c40cfc40 0x7f35c40ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:10.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 --2- 172.21.15.167:0/1422973267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c40cf860 0x7f35c40cb770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 -- 172.21.15.167:0/1422973267 >> 172.21.15.167:0/1422973267 conn(0x7f35c406c1f0 msgr2=0x7f35c4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 -- 172.21.15.167:0/1422973267 shutdown_connections 2023-11-28T20:40:10.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 -- 172.21.15.167:0/1422973267 wait complete. 2023-11-28T20:40:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 Processor -- start 2023-11-28T20:40:10.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.579+0000 7f35c9679640 1 -- start start 2023-11-28T20:40:10.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c9679640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c40cf860 0x7f35c41592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:10.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c9679640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35c40cfc40 0x7f35c40b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:10.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c9679640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35c4153ae0 0x7f35c41f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:10.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c9679640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c414a350 con 0x7f35c40cfc40 2023-11-28T20:40:10.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c9679640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c414a070 con 0x7f35c40cf860 2023-11-28T20:40:10.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c9679640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c4149d70 con 0x7f35c4153ae0 2023-11-28T20:40:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c37fe640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35c4153ae0 msgr2=0x7f35c41f6320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c37fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35c4153ae0 0x7f35c41f6320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35c40cfc40 0x7f35c40b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35c40cfc40 0x7f35c40b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36816/0 (socket says 172.21.15.167:36816) 2023-11-28T20:40:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c27fc640 1 -- 172.21.15.167:0/1234363944 learned_addr learned my addr 172.21.15.167:0/1234363944 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:10.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c2ffd640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c40cf860 0x7f35c41592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c27fc640 1 -- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35c4153ae0 msgr2=0x7f35c41f6320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:40:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c27fc640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35c4153ae0 0x7f35c41f6320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c27fc640 1 -- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c40cf860 msgr2=0x7f35c41592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c27fc640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c40cf860 0x7f35c41592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c27fc640 1 -- 172.21.15.167:0/1234363944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009420 con 0x7f35c40cfc40 2023-11-28T20:40:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c27fc640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35c40cfc40 0x7f35c40b4f40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00e8c0 tx=0x7f35ac00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:10.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35bb7fe640 1 -- 172.21.15.167:0/1234363944 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac009620 con 0x7f35c40cfc40 2023-11-28T20:40:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35bb7fe640 1 -- 172.21.15.167:0/1234363944 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac00c940 con 0x7f35c40cfc40 2023-11-28T20:40:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35bb7fe640 1 -- 172.21.15.167:0/1234363944 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac00ccf0 con 0x7f35c40cfc40 2023-11-28T20:40:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c41587f0 con 0x7f35c40cfc40 2023-11-28T20:40:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.583+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c40cf240 con 0x7f35c40cfc40 2023-11-28T20:40:10.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.587+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c40cf460 con 0x7f35c40cfc40 2023-11-28T20:40:10.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.587+0000 7f35bb7fe640 1 -- 172.21.15.167:0/1234363944 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f35ac013470 con 0x7f35c40cfc40 2023-11-28T20:40:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.591+0000 7f35bb7fe640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35a4066450 0x7f35a4068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.591+0000 7f35bb7fe640 1 -- 172.21.15.167:0/1234363944 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f35ac084600 con 0x7f35c40cfc40 2023-11-28T20:40:10.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.591+0000 7f35c2ffd640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35a4066450 0x7f35a4068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:10.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.591+0000 7f35c2ffd640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35a4066450 0x7f35a4068910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f35b40af000 tx=0x7f35b40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:10.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:10.599+0000 7f35bb7fe640 1 -- 172.21.15.167:0/1234363944 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35c40cf460 con 0x7f35c40cfc40 2023-11-28T20:40:11.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.023+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f35c40cf460 con 0x7f35c40cfc40 2023-11-28T20:40:11.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.023+0000 7f35bb7fe640 1 -- 172.21.15.167:0/1234363944 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f35ac017620 con 0x7f35c40cfc40 2023-11-28T20:40:11.028 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:40:11.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35a4066450 msgr2=0x7f35a4068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:11.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35a4066450 0x7f35a4068910 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f35b40af000 tx=0x7f35b40a7000 comp rx=0 tx=0).stop 2023-11-28T20:40:11.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35c40cfc40 msgr2=0x7f35c40b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:11.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35c40cfc40 0x7f35c40b4f40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00e8c0 tx=0x7f35ac00ed80 comp rx=0 tx=0).stop 2023-11-28T20:40:11.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 shutdown_connections 2023-11-28T20:40:11.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35a4066450 0x7f35a4068910 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:11.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35c4153ae0 0x7f35c41f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:11.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35c40cfc40 0x7f35c40b4f40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:11.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 --2- 172.21.15.167:0/1234363944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c40cf860 0x7f35c41592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:11.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 >> 172.21.15.167:0/1234363944 conn(0x7f35c406c1f0 msgr2=0x7f35c40662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:11.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 shutdown_connections 2023-11-28T20:40:11.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:11.027+0000 7f35c9679640 1 -- 172.21.15.167:0/1234363944 wait complete. 2023-11-28T20:40:14.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:40:14.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.287+0000 7fb7699f8640 1 Processor -- start 2023-11-28T20:40:14.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.287+0000 7fb7699f8640 1 -- start start 2023-11-28T20:40:14.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7699f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb764153db0 0x7fb76415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:14.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7699f8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb7640cf440 0x7fb7640cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7699f8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7640cfef0 con 0x7fb7640ccb70 2023-11-28T20:40:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7699f8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7640cc6e0 con 0x7fb7640cf440 2023-11-28T20:40:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7699f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb764154190 con 0x7fb764153db0 2023-11-28T20:40:14.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7691f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb7640cf440 0x7fb7640cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:14.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7691f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb7640cf440 0x7fb7640cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37200/0 (socket says 172.21.15.167:37200) 2023-11-28T20:40:14.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7691f7640 1 -- 172.21.15.167:0/1071222939 learned_addr learned my addr 172.21.15.167:0/1071222939 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:14.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7689f6640 1 --2- 172.21.15.167:0/1071222939 >> v2:172.21.15.178:3300/0 conn(0x7fb764153db0 0x7fb76415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:14.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7691f7640 1 -- 172.21.15.167:0/1071222939 >> v2:172.21.15.178:3300/0 conn(0x7fb764153db0 msgr2=0x7fb76415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:14.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7691f7640 1 --2- 172.21.15.167:0/1071222939 >> v2:172.21.15.178:3300/0 conn(0x7fb764153db0 0x7fb76415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:14.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7691f7640 1 -- 172.21.15.167:0/1071222939 >> v1:172.21.15.178:6789/0 conn(0x7fb7640ccb70 legacy=0x7fb7640c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:14.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.291+0000 7fb7691f7640 1 -- 172.21.15.167:0/1071222939 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640cbad0 con 0x7fb7640cf440 2023-11-28T20:40:14.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.295+0000 7fb7691f7640 1 --2- 172.21.15.167:0/1071222939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640cf440 0x7fb7640cf8d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb7640ccfb0 tx=0x7fb75c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162c43250f27b017 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:14.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.295+0000 7fb7637fe640 1 -- 172.21.15.167:0/1071222939 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0ab5f0 con 0x7fb7640cf440 2023-11-28T20:40:14.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.295+0000 7fb7637fe640 1 -- 172.21.15.167:0/1071222939 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c0ab750 con 0x7fb7640cf440 2023-11-28T20:40:14.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.295+0000 7fb7637fe640 1 -- 172.21.15.167:0/1071222939 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0abae0 con 0x7fb7640cf440 2023-11-28T20:40:14.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 -- 172.21.15.167:0/1071222939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640cf440 msgr2=0x7fb7640cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:14.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 --2- 172.21.15.167:0/1071222939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640cf440 0x7fb7640cf8d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb7640ccfb0 tx=0x7fb75c01c500 comp rx=0 tx=0).stop 2023-11-28T20:40:14.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 -- 172.21.15.167:0/1071222939 shutdown_connections 2023-11-28T20:40:14.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 --2- 172.21.15.167:0/1071222939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640cf440 0x7fb7640cf8d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:14.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 --2- 172.21.15.167:0/1071222939 >> v2:172.21.15.178:3300/0 conn(0x7fb764153db0 0x7fb76415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:14.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 -- 172.21.15.167:0/1071222939 >> 172.21.15.167:0/1071222939 conn(0x7fb76406b800 msgr2=0x7fb76406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:14.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 -- 172.21.15.167:0/1071222939 shutdown_connections 2023-11-28T20:40:14.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 -- 172.21.15.167:0/1071222939 wait complete. 2023-11-28T20:40:14.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 Processor -- start 2023-11-28T20:40:14.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.299+0000 7fb7699f8640 1 -- start start 2023-11-28T20:40:14.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7699f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640ccb70 0x7fb7640b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:14.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7699f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7640cf440 0x7fb7640c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:14.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7699f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb764153db0 0x7fb7640b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:14.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7699f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7641580f0 con 0x7fb7640ccb70 2023-11-28T20:40:14.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7699f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb764159360 con 0x7fb764153db0 2023-11-28T20:40:14.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7699f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb764158470 con 0x7fb7640cf440 2023-11-28T20:40:14.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb763fff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7640cf440 msgr2=0x7fb7640c5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:14.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb763fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7640cf440 0x7fb7640c5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:14.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7689f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640ccb70 0x7fb7640b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:14.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7689f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640ccb70 0x7fb7640b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37216/0 (socket says 172.21.15.167:37216) 2023-11-28T20:40:14.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7689f6640 1 -- 172.21.15.167:0/976234862 learned_addr learned my addr 172.21.15.167:0/976234862 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:14.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7691f7640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb764153db0 0x7fb7640b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:14.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7689f6640 1 -- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7640cf440 msgr2=0x7fb7640c5080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:40:14.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7689f6640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7640cf440 0x7fb7640c5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:14.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7689f6640 1 -- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb764153db0 msgr2=0x7fb7640b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:14.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7689f6640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb764153db0 0x7fb7640b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:14.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7689f6640 1 -- 172.21.15.167:0/976234862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0094d0 con 0x7fb7640ccb70 2023-11-28T20:40:14.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7689f6640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640ccb70 0x7fb7640b4930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb75800efc0 tx=0x7fb75800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:14.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7617fa640 1 -- 172.21.15.167:0/976234862 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758014480 con 0x7fb7640ccb70 2023-11-28T20:40:14.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7617fa640 1 -- 172.21.15.167:0/976234862 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75800f040 con 0x7fb7640ccb70 2023-11-28T20:40:14.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7617fa640 1 -- 172.21.15.167:0/976234862 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758014800 con 0x7fb7640ccb70 2023-11-28T20:40:14.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb764158750 con 0x7fb7640ccb70 2023-11-28T20:40:14.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.303+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb764158d10 con 0x7fb7640ccb70 2023-11-28T20:40:14.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.307+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76404e850 con 0x7fb7640ccb70 2023-11-28T20:40:14.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.307+0000 7fb7617fa640 1 -- 172.21.15.167:0/976234862 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb758014960 con 0x7fb7640ccb70 2023-11-28T20:40:14.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.307+0000 7fb7617fa640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb748066420 0x7fb7480688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:14.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.307+0000 7fb7617fa640 1 -- 172.21.15.167:0/976234862 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb758085200 con 0x7fb7640ccb70 2023-11-28T20:40:14.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.311+0000 7fb763fff640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb748066420 0x7fb7480688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:14.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.311+0000 7fb763fff640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb748066420 0x7fb7480688e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb750001040 tx=0x7fb750007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:14.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.315+0000 7fb7617fa640 1 -- 172.21.15.167:0/976234862 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb758052190 con 0x7fb7640ccb70 2023-11-28T20:40:14.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.743+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb76414de40 con 0x7fb7640ccb70 2023-11-28T20:40:14.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.743+0000 7fb7617fa640 1 -- 172.21.15.167:0/976234862 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fb7580557b0 con 0x7fb7640ccb70 2023-11-28T20:40:14.747 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:40:14.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.743+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb748066420 msgr2=0x7fb7480688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:14.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.743+0000 7fb7699f8640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb748066420 0x7fb7480688e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb750001040 tx=0x7fb750007a40 comp rx=0 tx=0).stop 2023-11-28T20:40:14.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.743+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640ccb70 msgr2=0x7fb7640b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:14.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.743+0000 7fb7699f8640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640ccb70 0x7fb7640b4930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb75800efc0 tx=0x7fb75800c490 comp rx=0 tx=0).stop 2023-11-28T20:40:14.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.747+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 shutdown_connections 2023-11-28T20:40:14.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.747+0000 7fb7699f8640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb748066420 0x7fb7480688e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:14.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.747+0000 7fb7699f8640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb764153db0 0x7fb7640b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:14.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.747+0000 7fb7699f8640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7640cf440 0x7fb7640c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:14.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.747+0000 7fb7699f8640 1 --2- 172.21.15.167:0/976234862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7640ccb70 0x7fb7640b4930 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:14.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.747+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 >> 172.21.15.167:0/976234862 conn(0x7fb76406b800 msgr2=0x7fb76406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:14.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.747+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 shutdown_connections 2023-11-28T20:40:14.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:14.747+0000 7fb7699f8640 1 -- 172.21.15.167:0/976234862 wait complete. 2023-11-28T20:40:14.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:14.836 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:17.781 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:40:17.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.915+0000 7f9cb629e640 1 Processor -- start 2023-11-28T20:40:17.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.915+0000 7f9cb629e640 1 -- start start 2023-11-28T20:40:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9cb629e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9cb629e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb00c7a50 con 0x7f9cb006a580 2023-11-28T20:40:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9cb629e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb015b220 con 0x7f9cb0151f60 2023-11-28T20:40:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9cb629e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb00c4da0 con 0x7f9cb00c75c0 2023-11-28T20:40:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9caf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9caf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37230/0 (socket says 172.21.15.167:37230) 2023-11-28T20:40:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 learned_addr learned my addr 172.21.15.167:0/1837340745 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 msgr2=0x7f9cb00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:40:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 msgr2=0x7f9cb00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:40:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:17.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:17.919+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.123+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.123+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 msgr2=0x7f9cb00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:40:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.123+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 msgr2=0x7f9cb00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:40:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.123+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:18.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.123+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:40:18.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.527+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:18.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.527+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 msgr2=0x7f9cb00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:40:18.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.527+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 msgr2=0x7f9cb00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:40:18.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.527+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:18.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:18.527+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:40:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:19.331+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:19.331+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 msgr2=0x7f9cb00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:40:19.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:19.331+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 msgr2=0x7f9cb00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:40:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:19.331+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:19.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:19.331+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:40:20.197 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 68% (8317/12117) Updating files: 69% (8361/12117) Updating files: 70% (8482/12117) Updating files: 71% (8604/12117) Updating files: 72% (8725/12117) Updating files: 73% (8846/12117) Updating files: 74% (8967/12117) Updating files: 75% (9088/12117) Updating files: 76% (9209/12117) Updating files: 77% (9331/12117) Updating files: 78% (9452/12117) Updating files: 79% (9573/12117) Updating files: 80% (9694/12117) Updating files: 81% (9815/12117) Updating files: 82% (9936/12117) Updating files: 83% (10058/12117) Updating files: 84% (10179/12117) Updating files: 85% (10300/12117) Updating files: 86% (10421/12117) Updating files: 87% (10542/12117) Updating files: 88% (10663/12117) Updating files: 89% (10785/12117) Updating files: 90% (10906/12117) Updating files: 91% (11027/12117) Updating files: 92% (11148/12117) Updating files: 93% (11269/12117) Updating files: 94% (11390/12117) Updating files: 95% (11512/12117) Updating files: 96% (11633/12117) Updating files: 97% (11754/12117) Updating files: 98% (11875/12117) Updating files: 99% (11996/12117) Updating files: 100% (12117/12117) Updating files: 100% (12117/12117), done. 2023-11-28T20:40:21.909 INFO:tasks.workunit.client.0.smithi167.stderr:Note: switching to '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'. 2023-11-28T20:40:21.909 INFO:tasks.workunit.client.0.smithi167.stderr: 2023-11-28T20:40:21.909 INFO:tasks.workunit.client.0.smithi167.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-28T20:40:21.909 INFO:tasks.workunit.client.0.smithi167.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-28T20:40:21.909 INFO:tasks.workunit.client.0.smithi167.stderr:state without impacting any branches by switching back to a branch. 2023-11-28T20:40:21.909 INFO:tasks.workunit.client.0.smithi167.stderr: 2023-11-28T20:40:21.909 INFO:tasks.workunit.client.0.smithi167.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr: 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr: git switch -c 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr: 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr:Or undo this operation with: 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr: 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr: git switch - 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr: 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-28T20:40:21.921 INFO:tasks.workunit.client.0.smithi167.stderr: 2023-11-28T20:40:21.922 INFO:tasks.workunit.client.0.smithi167.stderr:HEAD is now at 43dd94c1900 Merge PR #52623 into wip-vshankar-testing-20231127.102914 2023-11-28T20:40:21.922 DEBUG:teuthology.orchestra.run.smithi167:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-28T20:40:21.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9cadffb640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 msgr2=0x7f9cb00c5c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:40:21.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9cadffb640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.167:3300/0 conn(0x7f9cb00c75c0 0x7f9cb00c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:21.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9cadffb640 1 -- 172.21.15.167:0/1837340745 >> v1:172.21.15.178:6789/0 conn(0x7f9cb0151f60 legacy=0x7f9cb00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9cadffb640 1 -- 172.21.15.167:0/1837340745 >> v1:172.21.15.167:6789/0 conn(0x7f9cb006a580 legacy=0x7f9cb01625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9cadffb640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9cadffb640 1 --2- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 0x7f9c9c008630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9cadffb640 1 -- 172.21.15.167:0/1837340745 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c008d10 con 0x7f9c9c0036d0 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9cadffb640 1 -- 172.21.15.167:0/1837340745 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c008e80 con 0x7f9c9c006190 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 msgr2=0x7f9c9c008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 0x7f9c9c008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9caffff640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 msgr2=0x7f9c9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9caffff640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 msgr2=0x7f9c9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:20.923+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.127+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 msgr2=0x7f9c9c008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:21.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.127+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 0x7f9c9c008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:40:21.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.127+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:21.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.127+0000 7f9caffff640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 msgr2=0x7f9c9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.127+0000 7f9caffff640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 msgr2=0x7f9c9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.127+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.127+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.531+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 msgr2=0x7f9c9c008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.531+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 0x7f9c9c008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.531+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.531+0000 7f9caffff640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 msgr2=0x7f9c9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.531+0000 7f9caffff640 1 -- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 msgr2=0x7f9c9c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.531+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:21.531+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:40:21.957 INFO:tasks.workunit.client.0.smithi167.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-28T20:40:21.961 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-28T20:40:21.961 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-28T20:40:22.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.335+0000 7f9caf7fe640 1 -- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 msgr2=0x7f9c9c008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:22.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.335+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 0x7f9c9c008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:40:22.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.335+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.335+0000 7f9caffff640 1 -- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 msgr2=0x7f9c9c008630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:40:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.335+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c006190 0x7f9c9c008630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.335+0000 7f9caffff640 1 -- 172.21.15.167:0/1837340745 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0152340 con 0x7f9c9c0036d0 2023-11-28T20:40:22.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9caffff640 1 --2- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0036d0 0x7f9c9c005b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0007fd0 tx=0x7f9ca001c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbdf43420df704fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9caeffd640 1 -- 172.21.15.167:0/1837340745 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00050d0 con 0x7f9c9c0036d0 2023-11-28T20:40:22.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9caeffd640 1 -- 172.21.15.167:0/1837340745 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0005230 con 0x7f9c9c0036d0 2023-11-28T20:40:22.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9caeffd640 1 -- 172.21.15.167:0/1837340745 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0003600 con 0x7f9c9c0036d0 2023-11-28T20:40:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9cb629e640 1 -- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0036d0 msgr2=0x7f9c9c005b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9cb629e640 1 --2- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0036d0 0x7f9c9c005b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0007fd0 tx=0x7f9ca001c9c0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9cb483b640 1 -- 172.21.15.167:0/1837340745 reap_dead start 2023-11-28T20:40:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9cb629e640 1 -- 172.21.15.167:0/1837340745 shutdown_connections 2023-11-28T20:40:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9cb629e640 1 --2- 172.21.15.167:0/1837340745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0036d0 0x7f9c9c005b50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9cb629e640 1 -- 172.21.15.167:0/1837340745 >> 172.21.15.167:0/1837340745 conn(0x7f9cb00cb1e0 msgr2=0x7f9cb00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:22.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9cb629e640 1 -- 172.21.15.167:0/1837340745 shutdown_connections 2023-11-28T20:40:22.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.339+0000 7f9cb629e640 1 -- 172.21.15.167:0/1837340745 wait complete. 2023-11-28T20:40:22.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 Processor -- start 2023-11-28T20:40:22.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 -- start start 2023-11-28T20:40:22.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0036d0 0x7f9cb00c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cb014fdc0 0x7f9cb00c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb0143bb0 0x7f9cb00c1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00ca5d0 con 0x7f9cb014fdc0 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00c07a0 con 0x7f9cb0143bb0 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb013a6a0 con 0x7f9c9c0036d0 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caffff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0036d0 msgr2=0x7f9cb00c1b10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0036d0 0x7f9cb00c1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cb014fdc0 0x7f9cb00c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cb014fdc0 0x7f9cb00c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37270/0 (socket says 172.21.15.167:37270) 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caf7fe640 1 -- 172.21.15.167:0/3654723925 learned_addr learned my addr 172.21.15.167:0/3654723925 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb483b640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb0143bb0 0x7f9cb00c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caf7fe640 1 -- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0036d0 msgr2=0x7f9cb00c1b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0036d0 0x7f9cb00c1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caf7fe640 1 -- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb0143bb0 msgr2=0x7f9cb00c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb0143bb0 0x7f9cb00c1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caf7fe640 1 -- 172.21.15.167:0/3654723925 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca000f040 con 0x7f9cb014fdc0 2023-11-28T20:40:22.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9caf7fe640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cb014fdc0 0x7f9cb00c0bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4010690 tx=0x7f9ca4010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cacff9640 1 -- 172.21.15.167:0/3654723925 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40148d0 con 0x7f9cb014fdc0 2023-11-28T20:40:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cacff9640 1 -- 172.21.15.167:0/3654723925 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca400c040 con 0x7f9cb014fdc0 2023-11-28T20:40:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cacff9640 1 -- 172.21.15.167:0/3654723925 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4014c50 con 0x7f9cb014fdc0 2023-11-28T20:40:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb01f6d50 con 0x7f9cb014fdc0 2023-11-28T20:40:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.343+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb01f72f0 con 0x7f9cb014fdc0 2023-11-28T20:40:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.347+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb00682c0 con 0x7f9cb014fdc0 2023-11-28T20:40:22.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.347+0000 7f9cacff9640 1 -- 172.21.15.167:0/3654723925 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ca4017470 con 0x7f9cb014fdc0 2023-11-28T20:40:22.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.347+0000 7f9cacff9640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9c9c067370 0x7f9c9c069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.347+0000 7f9cacff9640 1 -- 172.21.15.167:0/3654723925 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ca4084620 con 0x7f9cb014fdc0 2023-11-28T20:40:22.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.347+0000 7f9caffff640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9c9c067370 0x7f9c9c069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.351+0000 7f9caffff640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9c9c067370 0x7f9c9c069830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00ae000 tx=0x7f9ca0011040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.351+0000 7f9cacff9640 1 -- 172.21.15.167:0/3654723925 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ca4051820 con 0x7f9cb014fdc0 2023-11-28T20:40:22.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9cb0075c90 con 0x7f9cb014fdc0 2023-11-28T20:40:22.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cacff9640 1 -- 172.21.15.167:0/3654723925 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f9ca4025620 con 0x7f9cb014fdc0 2023-11-28T20:40:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":18,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:40:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9c9c067370 msgr2=0x7f9c9c069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9c9c067370 0x7f9c9c069830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00ae000 tx=0x7f9ca0011040 comp rx=0 tx=0).stop 2023-11-28T20:40:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cb014fdc0 msgr2=0x7f9cb00c0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cb014fdc0 0x7f9cb00c0bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4010690 tx=0x7f9ca4010b50 comp rx=0 tx=0).stop 2023-11-28T20:40:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 shutdown_connections 2023-11-28T20:40:22.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9c9c067370 0x7f9c9c069830 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb0143bb0 0x7f9cb00c1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cb014fdc0 0x7f9cb00c0bf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 --2- 172.21.15.167:0/3654723925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0036d0 0x7f9cb00c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 >> 172.21.15.167:0/3654723925 conn(0x7f9cb00cb1e0 msgr2=0x7f9cb00c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 shutdown_connections 2023-11-28T20:40:22.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.563+0000 7f9cb629e640 1 -- 172.21.15.167:0/3654723925 wait complete. 2023-11-28T20:40:22.588 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:40:22.588 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:40:22.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:40:22.721 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-28T20:40:22.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91cbc46640 1 Processor -- start 2023-11-28T20:40:22.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91cbc46640 1 -- start start 2023-11-28T20:40:22.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91cbc46640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cf860 0x7f91c40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91cbc46640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91c40cfc40 0x7f91c40ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91cbc46640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c415ac00 con 0x7f91c4153ae0 2023-11-28T20:40:22.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91cbc46640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c40cbd60 con 0x7f91c40cfc40 2023-11-28T20:40:22.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91cbc46640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4159ff0 con 0x7f91c40cf860 2023-11-28T20:40:22.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91c99e2640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cf860 msgr2=0x7f91c40cb770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:22.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91c99e2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cf860 0x7f91c40cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:22.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91c91e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91c40cfc40 0x7f91c40ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91c91e1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91c40cfc40 0x7f91c40ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37286/0 (socket says 172.21.15.167:37286) 2023-11-28T20:40:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91c91e1640 1 -- 172.21.15.167:0/3913605012 learned_addr learned my addr 172.21.15.167:0/3913605012 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91c91e1640 1 -- 172.21.15.167:0/3913605012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cf860 msgr2=0x7f91c40cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:40:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91c91e1640 1 --2- 172.21.15.167:0/3913605012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cf860 0x7f91c40cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91c91e1640 1 -- 172.21.15.167:0/3913605012 >> v1:172.21.15.167:6789/0 conn(0x7f91c4153ae0 legacy=0x7f91c415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.771+0000 7f91c91e1640 1 -- 172.21.15.167:0/3913605012 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c415a2d0 con 0x7f91c40cfc40 2023-11-28T20:40:22.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91c91e1640 1 --2- 172.21.15.167:0/3913605012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c40cfc40 0x7f91c40ca510 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009870 tx=0x7f91b401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cd49618fe67edc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91c89e0640 1 -- 172.21.15.167:0/3913605012 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40a95f0 con 0x7f91c40cfc40 2023-11-28T20:40:22.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91c89e0640 1 -- 172.21.15.167:0/3913605012 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b40a9750 con 0x7f91c40cfc40 2023-11-28T20:40:22.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91c89e0640 1 -- 172.21.15.167:0/3913605012 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40a9ae0 con 0x7f91c40cfc40 2023-11-28T20:40:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91cbc46640 1 -- 172.21.15.167:0/3913605012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c40cfc40 msgr2=0x7f91c40ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91cbc46640 1 --2- 172.21.15.167:0/3913605012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c40cfc40 0x7f91c40ca510 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009870 tx=0x7f91b401c530 comp rx=0 tx=0).stop 2023-11-28T20:40:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91cbc46640 1 -- 172.21.15.167:0/3913605012 shutdown_connections 2023-11-28T20:40:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91cbc46640 1 --2- 172.21.15.167:0/3913605012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c40cfc40 0x7f91c40ca510 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91cbc46640 1 --2- 172.21.15.167:0/3913605012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cf860 0x7f91c40cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91cbc46640 1 -- 172.21.15.167:0/3913605012 >> 172.21.15.167:0/3913605012 conn(0x7f91c406c1f0 msgr2=0x7f91c4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:22.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91cbc46640 1 -- 172.21.15.167:0/3913605012 shutdown_connections 2023-11-28T20:40:22.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.775+0000 7f91cbc46640 1 -- 172.21.15.167:0/3913605012 wait complete. 2023-11-28T20:40:22.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 Processor -- start 2023-11-28T20:40:22.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 -- start start 2023-11-28T20:40:22.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91c40cf860 0x7f91c4155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cfc40 0x7f91c41f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4153ae0 0x7f91c4158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4155e60 con 0x7f91c4153ae0 2023-11-28T20:40:22.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c41569c0 con 0x7f91c40cf860 2023-11-28T20:40:22.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c41f6530 con 0x7f91c40cfc40 2023-11-28T20:40:22.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91c91e1640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cfc40 msgr2=0x7f91c41f5ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:22.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91c91e1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cfc40 0x7f91c41f5ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:22.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ca1e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4153ae0 0x7f91c4158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ca1e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4153ae0 0x7f91c4158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37300/0 (socket says 172.21.15.167:37300) 2023-11-28T20:40:22.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ca1e3640 1 -- 172.21.15.167:0/1604427186 learned_addr learned my addr 172.21.15.167:0/1604427186 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:22.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91c99e2640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91c40cf860 0x7f91c4155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ca1e3640 1 -- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cfc40 msgr2=0x7f91c41f5ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:40:22.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ca1e3640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91c40cfc40 0x7f91c41f5ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ca1e3640 1 -- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91c40cf860 msgr2=0x7f91c4155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ca1e3640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91c40cf860 0x7f91c4155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ca1e3640 1 -- 172.21.15.167:0/1604427186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40094d0 con 0x7f91c4153ae0 2023-11-28T20:40:22.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ca1e3640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4153ae0 0x7f91c4158dc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c770 tx=0x7f91bc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc003b80 con 0x7f91c4153ae0 2023-11-28T20:40:22.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc003ce0 con 0x7f91c4153ae0 2023-11-28T20:40:22.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c4154650 con 0x7f91c4153ae0 2023-11-28T20:40:22.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00aa90 con 0x7f91c4153ae0 2023-11-28T20:40:22.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.779+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c4154c10 con 0x7f91c4153ae0 2023-11-28T20:40:22.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91cbc46640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156590 0x7f91c40b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4072860 con 0x7f91c4156590 2023-11-28T20:40:22.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91c99e2640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156590 0x7f91c40b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91c99e2640 1 -- 172.21.15.167:0/1604427186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91c4154300 con 0x7f91c4156590 2023-11-28T20:40:22.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91c99e2640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156590 0x7f91c40b3660 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f91c0003fd0 tx=0x7f91c0009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000e680 con 0x7f91c4156590 2023-11-28T20:40:22.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f91c000e7e0 con 0x7f91c4156590 2023-11-28T20:40:22.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156590 msgr2=0x7f91c40b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91ba7fc640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156590 0x7f91c40b3660 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f91c0003fd0 tx=0x7f91c0009a40 comp rx=0 tx=0).stop 2023-11-28T20:40:22.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156590 msgr2=0x7f91c40b3660 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:22.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91ba7fc640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156590 0x7f91c40b3660 secure :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f91c0003fd0 tx=0x7f91c0009a40 comp rx=0 tx=0).stop 2023-11-28T20:40:22.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91bc00abf0 con 0x7f91c4153ae0 2023-11-28T20:40:22.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91ba7fc640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f91a8066220 0x7f91a80686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f91bc083ef0 con 0x7f91c4153ae0 2023-11-28T20:40:22.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.783+0000 7f91c99e2640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f91a8066220 0x7f91a80686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.787+0000 7f91c99e2640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f91a8066220 0x7f91a80686e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009a80 tx=0x7f91c0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156e30 0x7f91c40b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40caa50 con 0x7f91c4156e30 2023-11-28T20:40:22.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91c91e1640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156e30 0x7f91c40b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91c91e1640 1 -- 172.21.15.167:0/1604427186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f91c4166e40 con 0x7f91c4156e30 2023-11-28T20:40:22.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91c91e1640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156e30 0x7f91c40b3ba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91c40c9c50 tx=0x7f91b40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40a93f0 con 0x7f91c4156e30 2023-11-28T20:40:22.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4970 (secure 0 0 0) 0x7f91b40a9550 con 0x7f91c4156e30 2023-11-28T20:40:22.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156e30 msgr2=0x7f91c40b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91ba7fc640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156e30 0x7f91c40b3ba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91c40c9c50 tx=0x7f91b40046d0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91ba7fc640 1 -- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156e30 msgr2=0x7f91c40b3ba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:22.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91ba7fc640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4156e30 0x7f91c40b3ba0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.796 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:40:22.797 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:22.797 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:22.797 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:40:22.797 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 18, 2023-11-28T20:40:22.797 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:40:22.797 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:40:22.797 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:40:22.798 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.798 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:40:22.798 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:22.798 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:40:22.798 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:40:22.798 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:22.798 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:22.799 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:22.799 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:22.799 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:22.799 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:22.799 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:22.799 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:22.799 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:22.799 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:22.800 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.800 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:40:22.800 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:40:22.800 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:22.800 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:22.800 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:22.800 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:22.800 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:22.801 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:22.801 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:22.801 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:22.801 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:22.801 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:22.801 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:22.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.801 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:40:22.802 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:40:22.802 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:40:22.802 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:40:22.802 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:40:22.802 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:40:22.802 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:22.802 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:22.802 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:40:22.803 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:40:22.803 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:40:22.803 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:40:22.803 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:40:22.803 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:40:22.803 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:40:22.803 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:22.804 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:40:22.804 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:22.804 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:22.804 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:22.804 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:22.805 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:22.805 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:22.805 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:22.805 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:22.805 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:22.805 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:22.805 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.805 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:40:22.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.806 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:40:22.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.806 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:22.806 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:22.806 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:22.806 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:22.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.807 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:22.807 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:40:22.807 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:22.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.807 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:22.807 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:40:22.807 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:22.808 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:22.808 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:22.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.808 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:40:22.808 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:40:22.808 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:22.808 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:22.808 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:22.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.809 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:22.809 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:22.809 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:22.809 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:22.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.809 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:22.810 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:40:22.810 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:22.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.810 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:22.810 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:40:22.810 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:22.811 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:22.811 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:22.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.811 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:40:22.811 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:40:22.811 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:22.811 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:22.811 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:22.812 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.812 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:22.812 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:22.812 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:22.812 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:22.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.812 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:22.813 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:40:22.813 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:22.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.813 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:22.813 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:40:22.813 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:22.813 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:22.814 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:22.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.814 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:40:22.814 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:40:22.814 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:22.814 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:22.814 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:22.814 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:22.815 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:22.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.815 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:40:22.815 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:40:22.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.815 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:22.815 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:22.815 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:22.816 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:22.816 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.816 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:40:22.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.816 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:22.816 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:22.816 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:40:22.817 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:22.817 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.817 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:40:22.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.817 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:22.817 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:22.817 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:40:22.817 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:22.818 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.818 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:40:22.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.818 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:22.818 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:22.818 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:40:22.818 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:40:22.819 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:40:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f91a8066220 msgr2=0x7f91a80686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f91a8066220 0x7f91a80686e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009a80 tx=0x7f91c0008030 comp rx=0 tx=0).stop 2023-11-28T20:40:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4153ae0 msgr2=0x7f91c4158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 --2- 172.21.15.167:0/1604427186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91c4153ae0 0x7f91c4158dc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00c770 tx=0x7f91bc00cc30 comp rx=0 tx=0).stop 2023-11-28T20:40:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91ca1e3640 1 -- 172.21.15.167:0/1604427186 reap_dead start 2023-11-28T20:40:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91ca1e3640 1 -- 172.21.15.167:0/1604427186 reap_dead start 2023-11-28T20:40:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 shutdown_connections 2023-11-28T20:40:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 >> 172.21.15.167:0/1604427186 conn(0x7f91c406c1f0 msgr2=0x7f91c4147030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 shutdown_connections 2023-11-28T20:40:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.791+0000 7f91cbc46640 1 -- 172.21.15.167:0/1604427186 wait complete. 2023-11-28T20:40:22.823 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:40:22.824 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:40:22.824 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:40:22.824 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-28T20:40:22.881 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-28T20:40:22.883 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-28T20:40:22.883 INFO:tasks.workunit.client.0.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-28T20:40:22.938 INFO:tasks.workunit.client.0.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-28T20:40:22.943 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T20:40:22.943 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-28T20:40:22.953 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2023-11-28T20:40:22.954 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2023-11-28T20:40:22.954 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2023-11-28T20:40:22.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d63357640 1 Processor -- start 2023-11-28T20:40:22.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d63357640 1 -- start start 2023-11-28T20:40:22.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d63357640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d5c151f60 0x7f4d5c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d63357640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 0x7f4d5c0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d63357640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5c15b220 con 0x7f4d5c06a580 2023-11-28T20:40:22.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d63357640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c0c4da0 con 0x7f4d5c151f60 2023-11-28T20:40:22.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d63357640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c0c60f0 con 0x7f4d5c0c5c90 2023-11-28T20:40:22.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d608f2640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 msgr2=0x7f4d5c0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:22.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d608f2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 0x7f4d5c0c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:22.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d618f4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4d5c06a580 0x7f4d5c06ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45300/0 (socket says 172.21.15.167:45300) 2023-11-28T20:40:22.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d618f4640 1 -- 172.21.15.167:0/974389228 learned_addr learned my addr 172.21.15.167:0/974389228 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:40:22.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d610f3640 1 --2- 172.21.15.167:0/974389228 >> v2:172.21.15.178:3300/0 conn(0x7f4d5c151f60 0x7f4d5c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d53fff640 1 -- 172.21.15.167:0/974389228 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239988145 0 0) 0x7f4d5c15b220 con 0x7f4d5c06a580 2023-11-28T20:40:22.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d53fff640 1 -- 172.21.15.167:0/974389228 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d48003530 con 0x7f4d5c06a580 2023-11-28T20:40:22.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d610f3640 1 -- 172.21.15.167:0/974389228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 msgr2=0x7f4d5c0c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:40:22.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d610f3640 1 --2- 172.21.15.167:0/974389228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 0x7f4d5c0c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d610f3640 1 -- 172.21.15.167:0/974389228 >> v1:172.21.15.167:6789/0 conn(0x7f4d5c06a580 legacy=0x7f4d5c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.963+0000 7f4d610f3640 1 -- 172.21.15.167:0/974389228 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c152340 con 0x7f4d5c151f60 2023-11-28T20:40:22.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d610f3640 1 --2- 172.21.15.167:0/974389228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c151f60 0x7f4d5c0c75c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d580097c0 tx=0x7f4d5801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381a455929159538 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d53fff640 1 -- 172.21.15.167:0/974389228 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580ab600 con 0x7f4d5c151f60 2023-11-28T20:40:22.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d53fff640 1 -- 172.21.15.167:0/974389228 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d580a7050 con 0x7f4d5c151f60 2023-11-28T20:40:22.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d53fff640 1 -- 172.21.15.167:0/974389228 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580ab960 con 0x7f4d5c151f60 2023-11-28T20:40:22.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d63357640 1 -- 172.21.15.167:0/974389228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c151f60 msgr2=0x7f4d5c0c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d63357640 1 --2- 172.21.15.167:0/974389228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c151f60 0x7f4d5c0c75c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d580097c0 tx=0x7f4d5801c410 comp rx=0 tx=0).stop 2023-11-28T20:40:22.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d63357640 1 -- 172.21.15.167:0/974389228 shutdown_connections 2023-11-28T20:40:22.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d63357640 1 --2- 172.21.15.167:0/974389228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 0x7f4d5c0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d63357640 1 --2- 172.21.15.167:0/974389228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c151f60 0x7f4d5c0c75c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d63357640 1 -- 172.21.15.167:0/974389228 >> 172.21.15.167:0/974389228 conn(0x7f4d5c0cb1e0 msgr2=0x7f4d5c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:22.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d63357640 1 -- 172.21.15.167:0/974389228 shutdown_connections 2023-11-28T20:40:22.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.967+0000 7f4d63357640 1 -- 172.21.15.167:0/974389228 wait complete. 2023-11-28T20:40:22.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d63357640 1 Processor -- start 2023-11-28T20:40:22.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d63357640 1 -- start start 2023-11-28T20:40:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d63357640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c06a580 0x7f4d5c0ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d63357640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 0x7f4d5c147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d63357640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d5c151f60 0x7f4d5c148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d63357640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c1574f0 con 0x7f4d5c151f60 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d63357640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c071260 con 0x7f4d5c06a580 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d63357640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c1558f0 con 0x7f4d5c0c5c90 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d608f2640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 msgr2=0x7f4d5c147d30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d608f2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 0x7f4d5c147d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d618f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d5c151f60 0x7f4d5c148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d610f3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c06a580 0x7f4d5c0ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d618f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d5c151f60 0x7f4d5c148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52786/0 (socket says 172.21.15.167:52786) 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d618f4640 1 -- 172.21.15.167:0/2742492175 learned_addr learned my addr 172.21.15.167:0/2742492175 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d618f4640 1 -- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 msgr2=0x7f4d5c147d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d618f4640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d5c0c5c90 0x7f4d5c147d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d618f4640 1 -- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c06a580 msgr2=0x7f4d5c0ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d618f4640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c06a580 0x7f4d5c0ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d618f4640 1 -- 172.21.15.167:0/2742492175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58009420 con 0x7f4d5c151f60 2023-11-28T20:40:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d618f4640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d5c151f60 0x7f4d5c148270 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400cb70 tx=0x7f4d5400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400ad40 con 0x7f4d5c151f60 2023-11-28T20:40:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d54012400 con 0x7f4d5c151f60 2023-11-28T20:40:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c157740 con 0x7f4d5c151f60 2023-11-28T20:40:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.971+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400aea0 con 0x7f4d5c151f60 2023-11-28T20:40:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c155e50 con 0x7f4d5c151f60 2023-11-28T20:40:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d63357640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c156df0 0x7f4d5c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c074770 con 0x7f4d5c156df0 2023-11-28T20:40:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d610f3640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c156df0 0x7f4d5c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d54007070 con 0x7f4d5c151f60 2023-11-28T20:40:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d610f3640 1 -- 172.21.15.167:0/2742492175 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d5c06ada0 con 0x7f4d5c156df0 2023-11-28T20:40:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d610f3640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c156df0 0x7f4d5c070b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c158660 tx=0x7f4d580191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d51ffb640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d40066450 0x7f4d40068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d54084260 con 0x7f4d5c151f60 2023-11-28T20:40:22.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58003af0 con 0x7f4d5c156df0 2023-11-28T20:40:22.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d608f2640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d40066450 0x7f4d40068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f4d58003c50 con 0x7f4d5c156df0 2023-11-28T20:40:22.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c156df0 msgr2=0x7f4d5c070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d51ffb640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c156df0 0x7f4d5c070b70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c158660 tx=0x7f4d580191b0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c156df0 msgr2=0x7f4d5c070b70 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:22.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.975+0000 7f4d51ffb640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c156df0 0x7f4d5c070b70 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c158660 tx=0x7f4d580191b0 comp rx=0 tx=0).stop 2023-11-28T20:40:22.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.979+0000 7f4d608f2640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d40066450 0x7f4d40068910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0ca110 tx=0x7f4d4c006d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d63357640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c0c97a0 0x7f4d5c142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:22.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c15ba30 con 0x7f4d5c0c97a0 2023-11-28T20:40:22.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d610f3640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c0c97a0 0x7f4d5c142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:22.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d610f3640 1 -- 172.21.15.167:0/2742492175 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4d5c15bf50 con 0x7f4d5c0c97a0 2023-11-28T20:40:22.988 INFO:tasks.workunit.client.0.smithi167.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2023-11-28T20:40:22.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d610f3640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c0c97a0 0x7f4d5c142060 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4d5801aac0 tx=0x7f4d580a6000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:22.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580c4310 con 0x7f4d5c0c97a0 2023-11-28T20:40:22.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4941 (secure 0 0 0) 0x7f4d580b6450 con 0x7f4d5c0c97a0 2023-11-28T20:40:22.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c0c97a0 msgr2=0x7f4d5c142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:22.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d51ffb640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c0c97a0 0x7f4d5c142060 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4d5801aac0 tx=0x7f4d580a6000 comp rx=0 tx=0).stop 2023-11-28T20:40:22.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d51ffb640 1 -- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c0c97a0 msgr2=0x7f4d5c142060 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:22.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.983+0000 7f4d51ffb640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d5c0c97a0 0x7f4d5c142060 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4d5801aac0 tx=0x7f4d580a6000 comp rx=0 tx=0).stop 2023-11-28T20:40:22.990 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:40:22.990 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:22.990 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:22.991 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:40:22.991 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 18, 2023-11-28T20:40:22.991 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:40:22.991 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:40:22.991 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:40:22.991 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.991 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:40:22.992 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:22.992 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:40:22.992 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:40:22.992 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:22.992 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:22.992 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:22.992 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:22.992 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:22.993 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:22.993 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:22.993 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:22.993 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:22.993 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:22.993 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.993 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:40:22.993 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:40:22.994 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:22.994 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:22.994 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:22.994 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:22.994 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:22.994 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:22.995 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:22.995 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:22.995 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:22.995 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:22.995 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:22.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.995 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:40:22.996 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:40:22.996 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:40:22.996 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:40:22.996 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:40:22.996 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:40:22.996 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:22.996 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:22.996 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:40:22.997 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:40:22.997 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:40:22.997 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:40:22.997 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:40:22.997 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:40:22.997 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:40:22.997 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:22.997 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:40:22.998 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:22.998 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:22.998 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:22.998 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:22.998 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:22.998 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:22.998 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:22.999 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:22.999 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:22.999 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:22.999 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:22.999 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:40:22.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:22.999 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:40:22.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.000 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:23.000 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:23.000 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:23.000 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:23.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.000 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:23.000 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:40:23.000 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:23.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.001 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:23.001 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:40:23.001 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:23.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:23.001 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:23.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.002 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:40:23.002 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:40:23.002 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:23.002 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:23.002 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:23.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.003 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:23.003 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:23.003 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:23.003 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:23.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.003 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:23.003 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:40:23.004 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:23.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.004 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:23.004 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:40:23.004 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:23.004 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:23.004 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:23.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.005 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:40:23.005 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:40:23.005 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:23.005 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:23.005 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:23.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.006 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:23.006 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:23.006 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:23.006 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:23.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.006 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:23.006 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:40:23.006 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:23.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.007 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:23.007 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:40:23.007 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:23.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:23.007 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:23.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.008 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:40:23.008 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:40:23.008 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:23.008 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:23.008 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:23.008 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:23.008 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:23.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.009 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:40:23.009 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:40:23.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.009 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:23.009 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:23.009 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:23.010 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:23.010 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:23.010 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:40:23.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.010 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:23.010 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:23.010 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:23.010 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:23.011 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:23.011 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:40:23.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.011 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:23.011 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:23.011 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:23.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:23.011 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:23.012 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:40:23.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.012 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:40:23.012 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:23.012 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:23.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:23.012 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:23.013 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:23.013 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:23.013 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:23.013 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:23.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:23.013 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:40:23.013 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:40:23.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d40066450 msgr2=0x7f4d40068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:23.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d63357640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d40066450 0x7f4d40068910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0ca110 tx=0x7f4d4c006d90 comp rx=0 tx=0).stop 2023-11-28T20:40:23.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d5c151f60 msgr2=0x7f4d5c148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:23.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d63357640 1 --2- 172.21.15.167:0/2742492175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d5c151f60 0x7f4d5c148270 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400cb70 tx=0x7f4d5400a430 comp rx=0 tx=0).stop 2023-11-28T20:40:23.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d618f4640 1 -- 172.21.15.167:0/2742492175 reap_dead start 2023-11-28T20:40:23.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d618f4640 1 -- 172.21.15.167:0/2742492175 reap_dead start 2023-11-28T20:40:23.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 shutdown_connections 2023-11-28T20:40:23.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 >> 172.21.15.167:0/2742492175 conn(0x7f4d5c0cb1e0 msgr2=0x7f4d5c14c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:23.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 shutdown_connections 2023-11-28T20:40:23.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:22.987+0000 7f4d63357640 1 -- 172.21.15.167:0/2742492175 wait complete. 2023-11-28T20:40:23.016 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:40:23.016 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:40:25.539 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir foo 2023-11-28T20:40:26.029 INFO:tasks.workunit.client.0.smithi167.stderr:+ cp linux-2.6.33.tar.bz2 foo 2023-11-28T20:40:26.117 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir foo/.snap/barsnap 2023-11-28T20:40:26.132 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm foo/linux-2.6.33.tar.bz2 2023-11-28T20:40:26.145 INFO:tasks.workunit.client.0.smithi167.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2023-11-28T20:40:26.832 INFO:tasks.workunit.client.0.smithi167.stdout:passed: files are identical 2023-11-28T20:40:26.832 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo passed: files are identical 2023-11-28T20:40:26.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir foo/.snap/barsnap 2023-11-28T20:40:26.856 INFO:tasks.workunit.client.0.smithi167.stdout:OK 2023-11-28T20:40:26.857 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo OK 2023-11-28T20:40:26.857 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T20:40:26.857 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T20:40:27.391 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2023-11-28T20:40:27.391 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2023-11-28T20:40:29.584 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 1 2023-11-28T20:40:29.586 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 2 2023-11-28T20:40:29.587 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2023-11-28T20:40:29.587 INFO:tasks.workunit.client.0.smithi167.stderr:+ '[' -e file4 ']' 2023-11-28T20:40:29.587 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/snap1 2023-11-28T20:40:29.608 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 4 2023-11-28T20:40:29.611 INFO:tasks.workunit.client.0.smithi167.stderr:++ ls 2023-11-28T20:40:29.619 INFO:tasks.workunit.client.0.smithi167.stderr:+ now='file1 2023-11-28T20:40:29.619 INFO:tasks.workunit.client.0.smithi167.stderr:file2 2023-11-28T20:40:29.619 INFO:tasks.workunit.client.0.smithi167.stderr:file3 2023-11-28T20:40:29.620 INFO:tasks.workunit.client.0.smithi167.stderr:file4' 2023-11-28T20:40:29.620 INFO:tasks.workunit.client.0.smithi167.stderr:++ ls .snap/snap1 2023-11-28T20:40:29.633 INFO:tasks.workunit.client.0.smithi167.stderr:+ then='file1 2023-11-28T20:40:29.633 INFO:tasks.workunit.client.0.smithi167.stderr:file2 2023-11-28T20:40:29.634 INFO:tasks.workunit.client.0.smithi167.stderr:file3' 2023-11-28T20:40:29.634 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir .snap/snap1 2023-11-28T20:40:29.646 INFO:tasks.workunit.client.0.smithi167.stderr:+ '[' 'file1 2023-11-28T20:40:29.646 INFO:tasks.workunit.client.0.smithi167.stderr:file2 2023-11-28T20:40:29.646 INFO:tasks.workunit.client.0.smithi167.stderr:file3 2023-11-28T20:40:29.646 INFO:tasks.workunit.client.0.smithi167.stderr:file4' = 'file1 2023-11-28T20:40:29.646 INFO:tasks.workunit.client.0.smithi167.stderr:file2 2023-11-28T20:40:29.646 INFO:tasks.workunit.client.0.smithi167.stderr:file3' ']' 2023-11-28T20:40:29.647 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 1 2023-11-28T20:40:29.660 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 2 2023-11-28T20:40:29.672 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 3 2023-11-28T20:40:29.687 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/snap1 2023-11-28T20:40:29.701 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo 4 2023-11-28T20:40:29.714 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir .snap/snap1 2023-11-28T20:40:29.729 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm file1 file2 file3 file4 2023-11-28T20:40:29.754 INFO:tasks.workunit.client.0.smithi167.stdout:OK 2023-11-28T20:40:29.755 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo OK 2023-11-28T20:40:29.755 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T20:40:29.755 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T20:40:29.792 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2023-11-28T20:40:29.793 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2023-11-28T20:40:34.588 INFO:tasks.workunit.client.0.smithi167.stdout:Create dir 100 to 199 ... 2023-11-28T20:40:34.590 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 100 2023-11-28T20:40:34.602 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 101 2023-11-28T20:40:34.622 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 102 2023-11-28T20:40:34.765 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 103 2023-11-28T20:40:35.021 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 104 2023-11-28T20:40:35.042 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 105 2023-11-28T20:40:35.553 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 106 2023-11-28T20:40:35.574 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 107 2023-11-28T20:40:35.597 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 108 2023-11-28T20:40:35.619 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 109 2023-11-28T20:40:35.639 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 110 2023-11-28T20:40:35.658 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 111 2023-11-28T20:40:35.676 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 112 2023-11-28T20:40:35.693 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 113 2023-11-28T20:40:35.709 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 114 2023-11-28T20:40:35.724 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 115 2023-11-28T20:40:35.752 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 116 2023-11-28T20:40:36.593 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 117 2023-11-28T20:40:36.613 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 118 2023-11-28T20:40:36.650 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 119 2023-11-28T20:40:36.672 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 120 2023-11-28T20:40:36.695 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 121 2023-11-28T20:40:36.716 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 122 2023-11-28T20:40:36.736 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 123 2023-11-28T20:40:36.753 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 124 2023-11-28T20:40:37.017 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 125 2023-11-28T20:40:37.039 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 126 2023-11-28T20:40:37.061 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 127 2023-11-28T20:40:37.084 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 128 2023-11-28T20:40:37.105 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 129 2023-11-28T20:40:37.124 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 130 2023-11-28T20:40:37.141 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 131 2023-11-28T20:40:37.158 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 132 2023-11-28T20:40:37.175 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 133 2023-11-28T20:40:37.191 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 134 2023-11-28T20:40:37.205 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 135 2023-11-28T20:40:37.219 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 136 2023-11-28T20:40:37.232 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 137 2023-11-28T20:40:37.247 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 138 2023-11-28T20:40:37.258 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 139 2023-11-28T20:40:37.270 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 140 2023-11-28T20:40:37.282 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 141 2023-11-28T20:40:37.294 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 142 2023-11-28T20:40:37.305 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 143 2023-11-28T20:40:37.317 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 144 2023-11-28T20:40:37.328 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 145 2023-11-28T20:40:37.339 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 146 2023-11-28T20:40:37.350 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 147 2023-11-28T20:40:37.360 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 148 2023-11-28T20:40:37.371 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 149 2023-11-28T20:40:37.382 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 150 2023-11-28T20:40:37.392 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 151 2023-11-28T20:40:37.768 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 152 2023-11-28T20:40:37.854 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 153 2023-11-28T20:40:37.876 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 154 2023-11-28T20:40:37.898 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 155 2023-11-28T20:40:37.919 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 156 2023-11-28T20:40:37.940 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 157 2023-11-28T20:40:37.958 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 158 2023-11-28T20:40:37.974 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 159 2023-11-28T20:40:37.991 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 160 2023-11-28T20:40:38.007 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 161 2023-11-28T20:40:38.022 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 162 2023-11-28T20:40:38.037 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 163 2023-11-28T20:40:38.248 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 164 2023-11-28T20:40:38.263 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 165 2023-11-28T20:40:38.282 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 166 2023-11-28T20:40:38.302 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 167 2023-11-28T20:40:38.322 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 168 2023-11-28T20:40:38.340 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 169 2023-11-28T20:40:38.357 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 170 2023-11-28T20:40:38.373 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 171 2023-11-28T20:40:38.389 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 172 2023-11-28T20:40:38.403 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 173 2023-11-28T20:40:38.663 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 174 2023-11-28T20:40:38.685 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 175 2023-11-28T20:40:38.707 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 176 2023-11-28T20:40:38.973 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 177 2023-11-28T20:40:39.237 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 178 2023-11-28T20:40:39.510 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 179 2023-11-28T20:40:39.753 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 180 2023-11-28T20:40:39.786 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 181 2023-11-28T20:40:39.815 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 182 2023-11-28T20:40:39.844 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 183 2023-11-28T20:40:39.882 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 184 2023-11-28T20:40:40.745 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 185 2023-11-28T20:40:41.272 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 186 2023-11-28T20:40:41.294 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 187 2023-11-28T20:40:41.316 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 188 2023-11-28T20:40:41.339 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 189 2023-11-28T20:40:41.359 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 190 2023-11-28T20:40:41.377 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 191 2023-11-28T20:40:41.398 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 192 2023-11-28T20:40:41.431 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 193 2023-11-28T20:40:41.467 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 194 2023-11-28T20:40:41.505 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 195 2023-11-28T20:40:41.543 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 196 2023-11-28T20:40:41.578 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 197 2023-11-28T20:40:41.612 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 198 2023-11-28T20:40:41.644 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 199 2023-11-28T20:40:41.679 INFO:tasks.workunit.client.0.smithi167.stdout:Take first snapshot .snap/test1 2023-11-28T20:40:41.910 INFO:tasks.workunit.client.0.smithi167.stdout:Create dir 200 to 299 ... 2023-11-28T20:40:41.912 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 200 2023-11-28T20:40:42.220 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 201 2023-11-28T20:40:42.241 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 202 2023-11-28T20:40:42.261 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 203 2023-11-28T20:40:42.281 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 204 2023-11-28T20:40:42.767 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 205 2023-11-28T20:40:42.787 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 206 2023-11-28T20:40:42.808 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 207 2023-11-28T20:40:42.828 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 208 2023-11-28T20:40:43.017 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:40:43.017 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2023-11-28T20:40:43.017 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:40:43.018 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:40:43.021 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:40:43.021 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:40:43.021 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:40:43.058 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 209 2023-11-28T20:40:43.095 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 210 2023-11-28T20:40:43.106 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 211 2023-11-28T20:40:43.117 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 212 2023-11-28T20:40:43.127 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 213 2023-11-28T20:40:43.137 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 214 2023-11-28T20:40:43.147 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 215 2023-11-28T20:40:43.157 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 216 2023-11-28T20:40:43.166 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 217 2023-11-28T20:40:43.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e449aa640 1 Processor -- start 2023-11-28T20:40:43.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e449aa640 1 -- start start 2023-11-28T20:40:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e449aa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5e40151f60 0x7f5e400c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e449aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e4006a580 0x7f5e4006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e449aa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400c6120 con 0x7f5e400c5c90 2023-11-28T20:40:43.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e449aa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4006aed0 con 0x7f5e40151f60 2023-11-28T20:40:43.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e449aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400c4da0 con 0x7f5e4006a580 2023-11-28T20:40:43.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3e59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5e40151f60 0x7f5e400c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:43.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3dd9b640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f5e400c5c90 0x7f5e400c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:42810/0 (socket says 172.21.15.167:42810) 2023-11-28T20:40:43.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3dd9b640 1 -- 172.21.15.167:0/1945251909 learned_addr learned my addr 172.21.15.167:0/1945251909 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:40:43.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3ed9d640 1 --2- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e4006a580 0x7f5e4006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:43.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3ed9d640 1 -- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e4006a580 msgr2=0x7f5e4006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:40:43.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3ed9d640 1 -- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e4006a580 msgr2=0x7f5e4006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:40:43.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3ed9d640 1 --2- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e4006a580 0x7f5e4006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:43.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3ed9d640 1 --2- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e4006a580 0x7f5e4006a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3e59c640 1 -- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e4006a580 msgr2=0x7f5e4006a990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:40:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3e59c640 1 --2- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e4006a580 0x7f5e4006a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3e59c640 1 -- 172.21.15.167:0/1945251909 >> v1:172.21.15.178:6789/0 conn(0x7f5e400c5c90 legacy=0x7f5e400c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.175+0000 7f5e3e59c640 1 -- 172.21.15.167:0/1945251909 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4015b220 con 0x7f5e40151f60 2023-11-28T20:40:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e3e59c640 1 --2- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e40151f60 0x7f5e400c75c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5e300097c0 tx=0x7f5e3001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48e3fe473d0726e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e3d59a640 1 -- 172.21.15.167:0/1945251909 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300ab600 con 0x7f5e40151f60 2023-11-28T20:40:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e3d59a640 1 -- 172.21.15.167:0/1945251909 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e300a7050 con 0x7f5e40151f60 2023-11-28T20:40:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e3d59a640 1 -- 172.21.15.167:0/1945251909 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300ab980 con 0x7f5e40151f60 2023-11-28T20:40:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e449aa640 1 -- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e40151f60 msgr2=0x7f5e400c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e449aa640 1 --2- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e40151f60 0x7f5e400c75c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5e300097c0 tx=0x7f5e3001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:40:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e449aa640 1 -- 172.21.15.167:0/1945251909 shutdown_connections 2023-11-28T20:40:43.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e449aa640 1 --2- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e4006a580 0x7f5e4006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e449aa640 1 --2- 172.21.15.167:0/1945251909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e40151f60 0x7f5e400c75c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e449aa640 1 -- 172.21.15.167:0/1945251909 >> 172.21.15.167:0/1945251909 conn(0x7f5e400cb1e0 msgr2=0x7f5e400cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e449aa640 1 -- 172.21.15.167:0/1945251909 shutdown_connections 2023-11-28T20:40:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.179+0000 7f5e449aa640 1 -- 172.21.15.167:0/1945251909 wait complete. 2023-11-28T20:40:43.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 Processor -- start 2023-11-28T20:40:43.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 -- start start 2023-11-28T20:40:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4006a580 0x7f5e401ea770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e400c5c90 0x7f5e4015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e40151f60 0x7f5e40144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40153480 con 0x7f5e40151f60 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401562c0 con 0x7f5e4006a580 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401e9ae0 con 0x7f5e400c5c90 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e40151f60 0x7f5e40144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e40151f60 0x7f5e40144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58826/0 (socket says 172.21.15.167:58826) 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3ed9d640 1 -- 172.21.15.167:0/3075357598 learned_addr learned my addr 172.21.15.167:0/3075357598 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3dd9b640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e400c5c90 0x7f5e4015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3e59c640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4006a580 0x7f5e401ea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3dd9b640 1 -- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e400c5c90 msgr2=0x7f5e4015a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3dd9b640 1 -- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e400c5c90 msgr2=0x7f5e4015a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3dd9b640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e400c5c90 0x7f5e4015a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3dd9b640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e400c5c90 0x7f5e4015a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3ed9d640 1 -- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e400c5c90 msgr2=0x7f5e4015a850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3ed9d640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e400c5c90 0x7f5e4015a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3ed9d640 1 -- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4006a580 msgr2=0x7f5e401ea770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3ed9d640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4006a580 0x7f5e401ea770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3ed9d640 1 -- 172.21.15.167:0/3075357598 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009420 con 0x7f5e40151f60 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e3ed9d640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e40151f60 0x7f5e40144f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5e38007e30 tx=0x7f5e3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e2effd640 1 -- 172.21.15.167:0/3075357598 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38014420 con 0x7f5e40151f60 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e2effd640 1 -- 172.21.15.167:0/3075357598 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e380145a0 con 0x7f5e40151f60 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e2effd640 1 -- 172.21.15.167:0/3075357598 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38014950 con 0x7f5e40151f60 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e401558c0 con 0x7f5e40151f60 2023-11-28T20:40:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e40155e80 con 0x7f5e40151f60 2023-11-28T20:40:43.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.183+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e400682c0 con 0x7f5e40151f60 2023-11-28T20:40:43.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.187+0000 7f5e2effd640 1 -- 172.21.15.167:0/3075357598 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e38014ab0 con 0x7f5e40151f60 2023-11-28T20:40:43.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.187+0000 7f5e2effd640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e200664a0 0x7f5e20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:43.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.187+0000 7f5e2effd640 1 -- 172.21.15.167:0/3075357598 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5e38084b90 con 0x7f5e40151f60 2023-11-28T20:40:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.187+0000 7f5e3e59c640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e200664a0 0x7f5e20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.187+0000 7f5e3e59c640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e200664a0 0x7f5e20068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5e300ad000 tx=0x7f5e30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:43.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.191+0000 7f5e2effd640 1 -- 172.21.15.167:0/3075357598 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e38051b90 con 0x7f5e40151f60 2023-11-28T20:40:43.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:43.399+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5e40075c90 con 0x7f5e40151f60 2023-11-28T20:40:43.752 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 218 2023-11-28T20:40:44.032 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 219 2023-11-28T20:40:44.052 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 220 2023-11-28T20:40:44.074 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 221 2023-11-28T20:40:44.096 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 222 2023-11-28T20:40:44.117 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 223 2023-11-28T20:40:44.135 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 224 2023-11-28T20:40:44.151 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 225 2023-11-28T20:40:44.177 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 226 2023-11-28T20:40:44.194 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 227 2023-11-28T20:40:44.209 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 228 2023-11-28T20:40:44.225 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 229 2023-11-28T20:40:44.239 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 230 2023-11-28T20:40:44.254 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 231 2023-11-28T20:40:44.267 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 232 2023-11-28T20:40:44.280 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 233 2023-11-28T20:40:44.293 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 234 2023-11-28T20:40:44.305 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 235 2023-11-28T20:40:44.317 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 236 2023-11-28T20:40:44.330 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 237 2023-11-28T20:40:44.341 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 238 2023-11-28T20:40:44.352 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 239 2023-11-28T20:40:44.363 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 240 2023-11-28T20:40:44.374 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 241 2023-11-28T20:40:44.385 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 242 2023-11-28T20:40:44.395 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 243 2023-11-28T20:40:44.405 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 244 2023-11-28T20:40:44.416 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 245 2023-11-28T20:40:44.426 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 246 2023-11-28T20:40:44.436 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 247 2023-11-28T20:40:44.447 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 248 2023-11-28T20:40:44.456 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 249 2023-11-28T20:40:44.466 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 250 2023-11-28T20:40:44.767 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 251 2023-11-28T20:40:44.937 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:44.941 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:48.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.347+0000 7f5e2effd640 1 -- 172.21.15.167:0/3075357598 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f5e380551b0 con 0x7f5e40151f60 2023-11-28T20:40:48.352 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":22,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:40:48.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e200664a0 msgr2=0x7f5e20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:48.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e200664a0 0x7f5e20068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5e300ad000 tx=0x7f5e30008040 comp rx=0 tx=0).stop 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e40151f60 msgr2=0x7f5e40144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e40151f60 0x7f5e40144f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5e38007e30 tx=0x7f5e3800e4b0 comp rx=0 tx=0).stop 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 shutdown_connections 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e200664a0 0x7f5e20068960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e40151f60 0x7f5e40144f20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e400c5c90 0x7f5e4015a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 --2- 172.21.15.167:0/3075357598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e4006a580 0x7f5e401ea770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 >> 172.21.15.167:0/3075357598 conn(0x7f5e400cb1e0 msgr2=0x7f5e40150510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 shutdown_connections 2023-11-28T20:40:48.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:48.351+0000 7f5e449aa640 1 -- 172.21.15.167:0/3075357598 wait complete. 2023-11-28T20:40:49.606 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 252 2023-11-28T20:40:49.874 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 253 2023-11-28T20:40:50.140 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 254 2023-11-28T20:40:50.160 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 255 2023-11-28T20:40:50.179 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 256 2023-11-28T20:40:50.199 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 257 2023-11-28T20:40:50.218 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 258 2023-11-28T20:40:50.235 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 259 2023-11-28T20:40:50.251 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 260 2023-11-28T20:40:50.266 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 261 2023-11-28T20:40:50.280 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 262 2023-11-28T20:40:50.294 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 263 2023-11-28T20:40:50.307 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 264 2023-11-28T20:40:50.319 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 265 2023-11-28T20:40:50.332 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 266 2023-11-28T20:40:50.344 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 267 2023-11-28T20:40:50.356 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 268 2023-11-28T20:40:50.693 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 269 2023-11-28T20:40:50.710 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 270 2023-11-28T20:40:50.732 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 271 2023-11-28T20:40:50.753 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 272 2023-11-28T20:40:50.774 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 273 2023-11-28T20:40:50.792 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 274 2023-11-28T20:40:50.809 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 275 2023-11-28T20:40:50.826 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 276 2023-11-28T20:40:50.841 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 277 2023-11-28T20:40:50.855 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 278 2023-11-28T20:40:50.868 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 279 2023-11-28T20:40:50.882 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 280 2023-11-28T20:40:51.144 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 281 2023-11-28T20:40:51.164 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 282 2023-11-28T20:40:51.184 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 283 2023-11-28T20:40:51.204 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 284 2023-11-28T20:40:51.223 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 285 2023-11-28T20:40:51.240 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 286 2023-11-28T20:40:51.257 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 287 2023-11-28T20:40:51.273 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 288 2023-11-28T20:40:51.288 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 289 2023-11-28T20:40:51.378 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:40:51.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba7cac9640 1 Processor -- start 2023-11-28T20:40:51.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba7cac9640 1 -- start start 2023-11-28T20:40:51.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba7cac9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba78150b40 0x7fba78157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba7cac9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba780c6ff0 0x7fba780c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba7cac9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba780c6ac0 con 0x7fba780c5be0 2023-11-28T20:40:51.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba7cac9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba780c6500 con 0x7fba780c6ff0 2023-11-28T20:40:51.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba7cac9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba780c67e0 con 0x7fba78150b40 2023-11-28T20:40:51.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba6dd9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba780c6ff0 0x7fba780c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba6dd9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba780c6ff0 0x7fba780c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58832/0 (socket says 172.21.15.167:58832) 2023-11-28T20:40:51.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba6dd9b640 1 -- 172.21.15.167:0/2709990678 learned_addr learned my addr 172.21.15.167:0/2709990678 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:51.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba7659c640 1 --2- 172.21.15.167:0/2709990678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba78150b40 0x7fba78157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba6dd9b640 1 -- 172.21.15.167:0/2709990678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba78150b40 msgr2=0x7fba78157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:51.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba6dd9b640 1 --2- 172.21.15.167:0/2709990678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba78150b40 0x7fba78157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba6dd9b640 1 -- 172.21.15.167:0/2709990678 >> v1:172.21.15.167:6789/0 conn(0x7fba780c5be0 legacy=0x7fba7806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba6dd9b640 1 -- 172.21.15.167:0/2709990678 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78156a80 con 0x7fba780c6ff0 2023-11-28T20:40:51.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.515+0000 7fba75d9b640 1 -- 172.21.15.167:0/2709990678 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762487472 0 0) 0x7fba780c6ac0 con 0x7fba780c5be0 2023-11-28T20:40:51.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba6dd9b640 1 --2- 172.21.15.167:0/2709990678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 0x7fba780c4510 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fba6000d150 tx=0x7fba6001ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70da845270e2335a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:51.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba75d9b640 1 -- 172.21.15.167:0/2709990678 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6000b2d0 con 0x7fba780c6ff0 2023-11-28T20:40:51.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba75d9b640 1 -- 172.21.15.167:0/2709990678 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6000b430 con 0x7fba780c6ff0 2023-11-28T20:40:51.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba75d9b640 1 -- 172.21.15.167:0/2709990678 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600a7bd0 con 0x7fba780c6ff0 2023-11-28T20:40:51.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba7cac9640 1 -- 172.21.15.167:0/2709990678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 msgr2=0x7fba780c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba7cac9640 1 --2- 172.21.15.167:0/2709990678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 0x7fba780c4510 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fba6000d150 tx=0x7fba6001ebe0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba7cac9640 1 -- 172.21.15.167:0/2709990678 shutdown_connections 2023-11-28T20:40:51.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba7cac9640 1 --2- 172.21.15.167:0/2709990678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 0x7fba780c4510 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba7cac9640 1 --2- 172.21.15.167:0/2709990678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba78150b40 0x7fba78157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba7cac9640 1 -- 172.21.15.167:0/2709990678 >> 172.21.15.167:0/2709990678 conn(0x7fba780cb1e0 msgr2=0x7fba780cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:51.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba7cac9640 1 -- 172.21.15.167:0/2709990678 shutdown_connections 2023-11-28T20:40:51.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.519+0000 7fba7cac9640 1 -- 172.21.15.167:0/2709990678 wait complete. 2023-11-28T20:40:51.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 Processor -- start 2023-11-28T20:40:51.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 -- start start 2023-11-28T20:40:51.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba780c5be0 0x7fba780c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 0x7fba781f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba78150b40 0x7fba781470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780c8fe0 con 0x7fba780c6ff0 2023-11-28T20:40:51.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba781f20b0 con 0x7fba78150b40 2023-11-28T20:40:51.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba78142860 con 0x7fba780c5be0 2023-11-28T20:40:51.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 0x7fba781f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 0x7fba781f27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58842/0 (socket says 172.21.15.167:58842) 2023-11-28T20:40:51.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6dd9b640 1 -- 172.21.15.167:0/2376167655 learned_addr learned my addr 172.21.15.167:0/2376167655 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:51.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba76d9d640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba78150b40 0x7fba781470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7659c640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba780c5be0 0x7fba780c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6dd9b640 1 -- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba780c5be0 msgr2=0x7fba780c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6dd9b640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba780c5be0 0x7fba780c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6dd9b640 1 -- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba78150b40 msgr2=0x7fba781470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6dd9b640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba78150b40 0x7fba781470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6dd9b640 1 -- 172.21.15.167:0/2376167655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6000bd40 con 0x7fba780c6ff0 2023-11-28T20:40:51.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6dd9b640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 0x7fba781f27e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fba6001c810 tx=0x7fba6001b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:51.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6f7fe640 1 -- 172.21.15.167:0/2376167655 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60009800 con 0x7fba780c6ff0 2023-11-28T20:40:51.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6f7fe640 1 -- 172.21.15.167:0/2376167655 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba600099a0 con 0x7fba780c6ff0 2023-11-28T20:40:51.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba6f7fe640 1 -- 172.21.15.167:0/2376167655 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60009d50 con 0x7fba780c6ff0 2023-11-28T20:40:51.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba781f5a60 con 0x7fba780c6ff0 2023-11-28T20:40:51.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.523+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba781f6020 con 0x7fba780c6ff0 2023-11-28T20:40:51.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.527+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba780682c0 con 0x7fba780c6ff0 2023-11-28T20:40:51.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.527+0000 7fba6f7fe640 1 -- 172.21.15.167:0/2376167655 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba600af3f0 con 0x7fba780c6ff0 2023-11-28T20:40:51.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.527+0000 7fba6f7fe640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba58066470 0x7fba58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.527+0000 7fba6f7fe640 1 -- 172.21.15.167:0/2376167655 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fba6011f120 con 0x7fba780c6ff0 2023-11-28T20:40:51.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.527+0000 7fba7659c640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba58066470 0x7fba58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.527+0000 7fba7659c640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba58066470 0x7fba58068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba6800b930 tx=0x7fba68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:51.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.531+0000 7fba6f7fe640 1 -- 172.21.15.167:0/2376167655 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba600ec120 con 0x7fba780c6ff0 2023-11-28T20:40:51.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fba78075c90 con 0x7fba780c6ff0 2023-11-28T20:40:51.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba6f7fe640 1 -- 172.21.15.167:0/2376167655 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7fba600bd620 con 0x7fba780c6ff0 2023-11-28T20:40:51.743 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":24,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:40:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba58066470 msgr2=0x7fba58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba58066470 0x7fba58068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba6800b930 tx=0x7fba68008040 comp rx=0 tx=0).stop 2023-11-28T20:40:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 msgr2=0x7fba781f27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 0x7fba781f27e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fba6001c810 tx=0x7fba6001b980 comp rx=0 tx=0).stop 2023-11-28T20:40:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 shutdown_connections 2023-11-28T20:40:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba58066470 0x7fba58068930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba78150b40 0x7fba781470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba780c6ff0 0x7fba781f27e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 --2- 172.21.15.167:0/2376167655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba780c5be0 0x7fba780c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 >> 172.21.15.167:0/2376167655 conn(0x7fba780cb1e0 msgr2=0x7fba78073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:51.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 shutdown_connections 2023-11-28T20:40:51.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.739+0000 7fba7cac9640 1 -- 172.21.15.167:0/2376167655 wait complete. 2023-11-28T20:40:51.756 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 290 2023-11-28T20:40:51.768 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:40:51.769 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:40:51.769 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:40:51.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb557609640 1 Processor -- start 2023-11-28T20:40:51.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb557609640 1 -- start start 2023-11-28T20:40:51.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb557609640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb550150b40 0x7fb550157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb557609640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5500c6ff0 0x7fb5500c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb557609640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5500c5be0 0x7fb55006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb557609640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5500c6ac0 con 0x7fb550150b40 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb557609640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5500c6500 con 0x7fb5500c6ff0 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb557609640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500c67e0 con 0x7fb5500c5be0 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb5553a5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb550150b40 0x7fb550157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb5553a5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb550150b40 0x7fb550157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58856/0 (socket says 172.21.15.167:58856) 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb5553a5640 1 -- 172.21.15.167:0/1147185383 learned_addr learned my addr 172.21.15.167:0/1147185383 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb554ba4640 1 --2- 172.21.15.167:0/1147185383 >> v2:172.21.15.178:3300/0 conn(0x7fb5500c6ff0 0x7fb5500c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb555ba6640 1 --2- 172.21.15.167:0/1147185383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5500c5be0 0x7fb55006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb5553a5640 1 -- 172.21.15.167:0/1147185383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5500c5be0 msgr2=0x7fb55006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb5553a5640 1 --2- 172.21.15.167:0/1147185383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5500c5be0 0x7fb55006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb5553a5640 1 -- 172.21.15.167:0/1147185383 >> v2:172.21.15.178:3300/0 conn(0x7fb5500c6ff0 msgr2=0x7fb5500c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb5553a5640 1 --2- 172.21.15.167:0/1147185383 >> v2:172.21.15.178:3300/0 conn(0x7fb5500c6ff0 0x7fb5500c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb5553a5640 1 -- 172.21.15.167:0/1147185383 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550156a80 con 0x7fb550150b40 2023-11-28T20:40:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.915+0000 7fb554ba4640 1 --2- 172.21.15.167:0/1147185383 >> v2:172.21.15.178:3300/0 conn(0x7fb5500c6ff0 0x7fb5500c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:40:51.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb5553a5640 1 --2- 172.21.15.167:0/1147185383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550150b40 0x7fb550157560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb55006bba0 tx=0x7fb54c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba6e214c3ef2b9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:51.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb547fff640 1 -- 172.21.15.167:0/1147185383 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0aa5f0 con 0x7fb550150b40 2023-11-28T20:40:51.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb547fff640 1 -- 172.21.15.167:0/1147185383 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c0aa750 con 0x7fb550150b40 2023-11-28T20:40:51.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb547fff640 1 -- 172.21.15.167:0/1147185383 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0aaae0 con 0x7fb550150b40 2023-11-28T20:40:51.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb557609640 1 -- 172.21.15.167:0/1147185383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550150b40 msgr2=0x7fb550157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb557609640 1 --2- 172.21.15.167:0/1147185383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550150b40 0x7fb550157560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb55006bba0 tx=0x7fb54c01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb557609640 1 -- 172.21.15.167:0/1147185383 shutdown_connections 2023-11-28T20:40:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb557609640 1 --2- 172.21.15.167:0/1147185383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5500c5be0 0x7fb55006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb557609640 1 --2- 172.21.15.167:0/1147185383 >> v2:172.21.15.178:3300/0 conn(0x7fb5500c6ff0 0x7fb5500c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb557609640 1 --2- 172.21.15.167:0/1147185383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550150b40 0x7fb550157560 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb557609640 1 -- 172.21.15.167:0/1147185383 >> 172.21.15.167:0/1147185383 conn(0x7fb5500cb1e0 msgr2=0x7fb5500cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb557609640 1 -- 172.21.15.167:0/1147185383 shutdown_connections 2023-11-28T20:40:51.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.919+0000 7fb557609640 1 -- 172.21.15.167:0/1147185383 wait complete. 2023-11-28T20:40:51.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 Processor -- start 2023-11-28T20:40:51.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 -- start start 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5500c5be0 0x7fb5500ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5500c6ff0 0x7fb5501f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb550150b40 0x7fb5501f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501f69e0 con 0x7fb5500c5be0 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501597a0 con 0x7fb550150b40 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501599b0 con 0x7fb5500c6ff0 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb5553a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5500c5be0 0x7fb5500ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb5553a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5500c5be0 0x7fb5500ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58858/0 (socket says 172.21.15.167:58858) 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb5553a5640 1 -- 172.21.15.167:0/2493488332 learned_addr learned my addr 172.21.15.167:0/2493488332 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb555ba6640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb550150b40 0x7fb5501f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb554ba4640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5500c6ff0 0x7fb5501f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb5553a5640 1 -- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5500c6ff0 msgr2=0x7fb5501f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb5553a5640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5500c6ff0 0x7fb5501f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb5553a5640 1 -- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb550150b40 msgr2=0x7fb5501f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb5553a5640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb550150b40 0x7fb5501f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb5553a5640 1 -- 172.21.15.167:0/2493488332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0094d0 con 0x7fb5500c5be0 2023-11-28T20:40:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb555ba6640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb550150b40 0x7fb5501f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:40:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb5553a5640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5500c5be0 0x7fb5500ca090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb54c01ab80 tx=0x7fb54c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0b3800 con 0x7fb5500c5be0 2023-11-28T20:40:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c0b3980 con 0x7fb5500c5be0 2023-11-28T20:40:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0b3d30 con 0x7fb5500c5be0 2023-11-28T20:40:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5500c95b0 con 0x7fb5500c5be0 2023-11-28T20:40:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.923+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5500c9b70 con 0x7fb5500c5be0 2023-11-28T20:40:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb557609640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb55006ddd0 0x7fb550149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb550074770 con 0x7fb55006ddd0 2023-11-28T20:40:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb554ba4640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb55006ddd0 0x7fb550149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb554ba4640 1 -- 172.21.15.167:0/2493488332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5500c3a50 con 0x7fb55006ddd0 2023-11-28T20:40:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb554ba4640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb55006ddd0 0x7fb550149870 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb5500710b0 tx=0x7fb54000f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb54c0b2380 con 0x7fb5500c5be0 2023-11-28T20:40:51.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb545ffb640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5340664a0 0x7fb534068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb54c0a7070 con 0x7fb5500c5be0 2023-11-28T20:40:51.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540004230 con 0x7fb55006ddd0 2023-11-28T20:40:51.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb54000c030 con 0x7fb55006ddd0 2023-11-28T20:40:51.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb55006ddd0 msgr2=0x7fb550149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb545ffb640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb55006ddd0 0x7fb550149870 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb5500710b0 tx=0x7fb54000f8a0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb55006ddd0 msgr2=0x7fb550149870 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:51.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb545ffb640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb55006ddd0 0x7fb550149870 secure :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb5500710b0 tx=0x7fb54000f8a0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb555ba6640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5340664a0 0x7fb534068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.927+0000 7fb555ba6640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5340664a0 0x7fb534068960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb548007380 tx=0x7fb54800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:51.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550149db0 0x7fb5501f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:51.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500c9740 con 0x7fb550149db0 2023-11-28T20:40:51.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb554ba4640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550149db0 0x7fb5501f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:51.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb554ba4640 1 -- 172.21.15.167:0/2493488332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb55015a770 con 0x7fb550149db0 2023-11-28T20:40:51.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb554ba4640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550149db0 0x7fb5501f2790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb5501f6dc0 tx=0x7fb5400046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:51.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540003cb0 con 0x7fb550149db0 2023-11-28T20:40:51.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4981 (secure 0 0 0) 0x7fb540022040 con 0x7fb550149db0 2023-11-28T20:40:51.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550149db0 msgr2=0x7fb5501f2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb545ffb640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550149db0 0x7fb5501f2790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb5501f6dc0 tx=0x7fb5400046d0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb545ffb640 1 -- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550149db0 msgr2=0x7fb5501f2790 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:51.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb545ffb640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb550149db0 0x7fb5501f2790 secure :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb5501f6dc0 tx=0x7fb5400046d0 comp rx=0 tx=0).stop 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 24, 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:40:51.940 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:51.941 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:51.942 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:40:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:51.944 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:51.945 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:40:51.946 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:40:51.947 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:51.950 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.951 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:40:51.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:51.953 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:51.954 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:51.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:51.954 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:40:51.954 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:40:51.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5340664a0 msgr2=0x7fb534068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5340664a0 0x7fb534068960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb548007380 tx=0x7fb54800b040 comp rx=0 tx=0).stop 2023-11-28T20:40:51.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5500c5be0 msgr2=0x7fb5500ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:51.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 --2- 172.21.15.167:0/2493488332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5500c5be0 0x7fb5500ca090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb54c01ab80 tx=0x7fb54c01ad10 comp rx=0 tx=0).stop 2023-11-28T20:40:51.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb555ba6640 1 -- 172.21.15.167:0/2493488332 reap_dead start 2023-11-28T20:40:51.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb555ba6640 1 -- 172.21.15.167:0/2493488332 reap_dead start 2023-11-28T20:40:51.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 shutdown_connections 2023-11-28T20:40:51.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 >> 172.21.15.167:0/2493488332 conn(0x7fb5500cb1e0 msgr2=0x7fb5500cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:51.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 shutdown_connections 2023-11-28T20:40:51.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:51.935+0000 7fb557609640 1 -- 172.21.15.167:0/2493488332 wait complete. 2023-11-28T20:40:51.959 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:40:51.959 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:40:51.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:40:52.033 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 291 2023-11-28T20:40:52.054 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 292 2023-11-28T20:40:52.074 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 293 2023-11-28T20:40:52.098 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 294 2023-11-28T20:40:52.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0852d80640 1 Processor -- start 2023-11-28T20:40:52.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0852d80640 1 -- start start 2023-11-28T20:40:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0852d80640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f084c0cb770 0x7f084c15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0852d80640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084c15ac00 con 0x7f084c0cfc40 2023-11-28T20:40:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0852d80640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084c0cbd60 con 0x7f084c0cf860 2023-11-28T20:40:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0852d80640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084c159ff0 con 0x7f084c0cb770 2023-11-28T20:40:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f084c0cfc40 0x7f084c153ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55176/0 (socket says 172.21.15.167:55176) 2023-11-28T20:40:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084bfff640 1 -- 172.21.15.167:0/163088730 learned_addr learned my addr 172.21.15.167:0/163088730 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:40:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f085131d640 1 --2- 172.21.15.167:0/163088730 >> v2:172.21.15.178:3300/0 conn(0x7f084c0cb770 0x7f084c15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331487269 0 0) 0x7f084c15ac00 con 0x7f084c0cfc40 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f083c003530 con 0x7f084c0cfc40 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88834311 0 0) 0x7f083c003530 con 0x7f084c0cfc40 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 >> v2:172.21.15.178:3300/0 conn(0x7f084c0cb770 msgr2=0x7f084c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 --2- 172.21.15.167:0/163088730 >> v2:172.21.15.178:3300/0 conn(0x7f084c0cb770 0x7f084c15d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 >> v1:172.21.15.178:6789/0 conn(0x7f084c0cf860 legacy=0x7f084c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c15a2d0 con 0x7f084c0cfc40 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f0838001680 con 0x7f084c0cfc40 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 >> v1:172.21.15.167:6789/0 conn(0x7f084c0cfc40 legacy=0x7f084c153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f083c0039d0 0x7f083c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f083c0047d0 0x7f083c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c005190 0x7f083c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c159ff0 con 0x7f083c0039d0 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c00c090 con 0x7f083c005190 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c00c250 con 0x7f083c0047d0 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0850b1c640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f083c0039d0 0x7f083c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f084bfff640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f083c0047d0 0x7f083c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f085131d640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c005190 0x7f083c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0850b1c640 1 -- 172.21.15.167:0/163088730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f083c0047d0 msgr2=0x7f083c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0850b1c640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f083c0047d0 0x7f083c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0850b1c640 1 -- 172.21.15.167:0/163088730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c005190 msgr2=0x7f083c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0850b1c640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c005190 0x7f083c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f0850b1c640 1 -- 172.21.15.167:0/163088730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c003530 con 0x7f083c0039d0 2023-11-28T20:40:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f085131d640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c005190 0x7f083c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:40:52.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.103+0000 7f085131d640 1 -- 172.21.15.167:0/163088730 reap_dead start 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f0850b1c640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f083c0039d0 0x7f083c003df0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0840001780 tx=0x7f084001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddb606743bfe93b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08400052d0 con 0x7f083c0039d0 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08400a7050 con 0x7f083c0039d0 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f084b7fe640 1 -- 172.21.15.167:0/163088730 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840003600 con 0x7f083c0039d0 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f0852d80640 1 -- 172.21.15.167:0/163088730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f083c0039d0 msgr2=0x7f083c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f0852d80640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f083c0039d0 0x7f083c003df0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0840001780 tx=0x7f084001c370 comp rx=0 tx=0).stop 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f0852d80640 1 -- 172.21.15.167:0/163088730 shutdown_connections 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f0852d80640 1 --2- 172.21.15.167:0/163088730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f083c0039d0 0x7f083c003df0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f0852d80640 1 -- 172.21.15.167:0/163088730 >> 172.21.15.167:0/163088730 conn(0x7f084c06c1f0 msgr2=0x7f084c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f0852d80640 1 -- 172.21.15.167:0/163088730 shutdown_connections 2023-11-28T20:40:52.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.107+0000 7f0852d80640 1 -- 172.21.15.167:0/163088730 wait complete. 2023-11-28T20:40:52.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 Processor -- start 2023-11-28T20:40:52.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 -- start start 2023-11-28T20:40:52.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c0039d0 0x7f084c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f084c14a7a0 0x7f084c1474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f084c0b4470 0x7f084c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0b4e60 con 0x7f084c14a7a0 2023-11-28T20:40:52.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0ce2d0 con 0x7f083c0039d0 2023-11-28T20:40:52.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0ce570 con 0x7f084c0b4470 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f084bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f084c14a7a0 0x7f084c1474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f084bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f084c14a7a0 0x7f084c1474c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58884/0 (socket says 172.21.15.167:58884) 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f084bfff640 1 -- 172.21.15.167:0/3159642044 learned_addr learned my addr 172.21.15.167:0/3159642044 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0850b1c640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c0039d0 0x7f084c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f085131d640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f084c0b4470 0x7f084c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f084bfff640 1 -- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f084c0b4470 msgr2=0x7f084c0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f084bfff640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f084c0b4470 0x7f084c0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f084bfff640 1 -- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c0039d0 msgr2=0x7f084c146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f084bfff640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c0039d0 0x7f084c146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f084bfff640 1 -- 172.21.15.167:0/3159642044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c0ce810 con 0x7f084c14a7a0 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0850b1c640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f083c0039d0 0x7f084c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f084bfff640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f084c14a7a0 0x7f084c1474c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f083800e7b0 tx=0x7f083800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:52.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800c6c0 con 0x7f084c14a7a0 2023-11-28T20:40:52.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083800c840 con 0x7f084c14a7a0 2023-11-28T20:40:52.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800cbf0 con 0x7f084c14a7a0 2023-11-28T20:40:52.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084c0ceaf0 con 0x7f084c14a7a0 2023-11-28T20:40:52.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.111+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084c0b3c70 con 0x7f084c14a7a0 2023-11-28T20:40:52.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f0852d80640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c0b3e30 0x7f084c1f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c072860 con 0x7f084c0b3e30 2023-11-28T20:40:52.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f0850b1c640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c0b3e30 0x7f084c1f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f0850b1c640 1 -- 172.21.15.167:0/3159642044 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f084c0b2ba0 con 0x7f084c0b3e30 2023-11-28T20:40:52.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f083800cd50 con 0x7f084c14a7a0 2023-11-28T20:40:52.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f0850b1c640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c0b3e30 0x7f084c1f6870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0840004000 tx=0x7f083c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:52.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f08497fa640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f08300664a0 0x7f0830068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0838084130 con 0x7f084c14a7a0 2023-11-28T20:40:52.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840007040 con 0x7f084c0b3e30 2023-11-28T20:40:52.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f085131d640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f08300664a0 0x7f0830068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f08400071a0 con 0x7f084c0b3e30 2023-11-28T20:40:52.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f085131d640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f08300664a0 0x7f0830068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f084c0cd160 tx=0x7f084400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:52.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c0b3e30 msgr2=0x7f084c1f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f08497fa640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c0b3e30 0x7f084c1f6870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0840004000 tx=0x7f083c005800 comp rx=0 tx=0).stop 2023-11-28T20:40:52.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c0b3e30 msgr2=0x7f084c1f6870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:52.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.115+0000 7f08497fa640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c0b3e30 0x7f084c1f6870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.122 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 295 2023-11-28T20:40:52.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.123+0000 7f0852d80640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c1e9590 0x7f084c1f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.123+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c15d4b0 con 0x7f084c1e9590 2023-11-28T20:40:52.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.123+0000 7f0850b1c640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c1e9590 0x7f084c1f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.123+0000 7f0850b1c640 1 -- 172.21.15.167:0/3159642044 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f084c067c40 con 0x7f084c1e9590 2023-11-28T20:40:52.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.123+0000 7f0850b1c640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c1e9590 0x7f084c1f30a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f084001c3b0 tx=0x7f08400a6000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:52.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.123+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08400c5070 con 0x7f084c1e9590 2023-11-28T20:40:52.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4952 (secure 0 0 0) 0x7f0840003810 con 0x7f084c1e9590 2023-11-28T20:40:52.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c1e9590 msgr2=0x7f084c1f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f08497fa640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c1e9590 0x7f084c1f30a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f084001c3b0 tx=0x7f08400a6000 comp rx=0 tx=0).stop 2023-11-28T20:40:52.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f08497fa640 1 -- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c1e9590 msgr2=0x7f084c1f30a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:52.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f08497fa640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f084c1e9590 0x7f084c1f30a0 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f084001c3b0 tx=0x7f08400a6000 comp rx=0 tx=0).stop 2023-11-28T20:40:52.131 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:40:52.131 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:52.131 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:52.131 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 24, 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:52.132 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:40:52.133 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:52.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:40:52.135 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:52.136 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:52.137 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:52.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:52.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.140 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.141 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.142 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:52.143 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.144 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:52.145 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:52.146 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:40:52.146 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:52.146 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:52.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:52.146 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:40:52.146 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:40:52.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f08300664a0 msgr2=0x7f0830068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f0852d80640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f08300664a0 0x7f0830068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f084c0cd160 tx=0x7f084400b040 comp rx=0 tx=0).stop 2023-11-28T20:40:52.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f084c14a7a0 msgr2=0x7f084c1474c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f0852d80640 1 --2- 172.21.15.167:0/3159642044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f084c14a7a0 0x7f084c1474c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f083800e7b0 tx=0x7f083800ec70 comp rx=0 tx=0).stop 2023-11-28T20:40:52.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f085131d640 1 -- 172.21.15.167:0/3159642044 reap_dead start 2023-11-28T20:40:52.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f085131d640 1 -- 172.21.15.167:0/3159642044 reap_dead start 2023-11-28T20:40:52.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 shutdown_connections 2023-11-28T20:40:52.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 >> 172.21.15.167:0/3159642044 conn(0x7f084c06c1f0 msgr2=0x7f084c15d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:52.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 shutdown_connections 2023-11-28T20:40:52.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.127+0000 7f0852d80640 1 -- 172.21.15.167:0/3159642044 wait complete. 2023-11-28T20:40:52.151 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:40:52.151 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:40:52.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:40:52.155 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 296 2023-11-28T20:40:52.185 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 297 2023-11-28T20:40:52.218 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 298 2023-11-28T20:40:52.252 INFO:tasks.workunit.client.0.smithi167.stdout: create dir 299 2023-11-28T20:40:52.286 INFO:tasks.workunit.client.0.smithi167.stdout:Create a snapshot in every first level dir ... 2023-11-28T20:40:52.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.287+0000 7f410de5a640 1 Processor -- start 2023-11-28T20:40:52.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.287+0000 7f410de5a640 1 -- start start 2023-11-28T20:40:52.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f410de5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4108150b40 0x7f4108157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f410de5a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f41080c4510 0x7f410806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f410de5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41080c48f0 con 0x7f41080c6ff0 2023-11-28T20:40:52.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f410de5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41080c62f0 con 0x7f4108150b40 2023-11-28T20:40:52.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f410de5a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41080c6ac0 con 0x7f41080c4510 2023-11-28T20:40:52.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f41077fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4108150b40 0x7f4108157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f41077fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4108150b40 0x7f4108157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58890/0 (socket says 172.21.15.167:58890) 2023-11-28T20:40:52.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f4106ffd640 1 --1- 172.21.15.167:0/1151386084 >> v1:172.21.15.167:6789/0 conn(0x7f41080c6ff0 0x7f41080c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55188/0 (socket says 172.21.15.167:55188) 2023-11-28T20:40:52.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f41077fe640 1 -- 172.21.15.167:0/1151386084 learned_addr learned my addr 172.21.15.167:0/1151386084 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:52.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f4107fff640 1 --2- 172.21.15.167:0/1151386084 >> v2:172.21.15.178:3300/0 conn(0x7f41080c4510 0x7f410806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f41077fe640 1 -- 172.21.15.167:0/1151386084 >> v2:172.21.15.178:3300/0 conn(0x7f41080c4510 msgr2=0x7f410806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:52.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f41077fe640 1 --2- 172.21.15.167:0/1151386084 >> v2:172.21.15.178:3300/0 conn(0x7f41080c4510 0x7f410806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f41077fe640 1 -- 172.21.15.167:0/1151386084 >> v1:172.21.15.167:6789/0 conn(0x7f41080c6ff0 legacy=0x7f41080c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f41077fe640 1 -- 172.21.15.167:0/1151386084 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080c6500 con 0x7f4108150b40 2023-11-28T20:40:52.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.291+0000 7f41067fc640 1 -- 172.21.15.167:0/1151386084 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575125612 0 0) 0x7f41080c48f0 con 0x7f41080c6ff0 2023-11-28T20:40:52.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f41077fe640 1 --2- 172.21.15.167:0/1151386084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 0x7f4108157560 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f41080cc270 tx=0x7f40f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dcf88b1d104356 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:52.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f41067fc640 1 -- 172.21.15.167:0/1151386084 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f80ac640 con 0x7f4108150b40 2023-11-28T20:40:52.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f41067fc640 1 -- 172.21.15.167:0/1151386084 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f80ac7a0 con 0x7f4108150b40 2023-11-28T20:40:52.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f41067fc640 1 -- 172.21.15.167:0/1151386084 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f80acb30 con 0x7f4108150b40 2023-11-28T20:40:52.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f410de5a640 1 -- 172.21.15.167:0/1151386084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 msgr2=0x7f4108157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f410de5a640 1 --2- 172.21.15.167:0/1151386084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 0x7f4108157560 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f41080cc270 tx=0x7f40f801c4d0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f410de5a640 1 -- 172.21.15.167:0/1151386084 shutdown_connections 2023-11-28T20:40:52.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f410de5a640 1 --2- 172.21.15.167:0/1151386084 >> v2:172.21.15.178:3300/0 conn(0x7f41080c4510 0x7f410806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f410de5a640 1 --2- 172.21.15.167:0/1151386084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 0x7f4108157560 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f410de5a640 1 -- 172.21.15.167:0/1151386084 >> 172.21.15.167:0/1151386084 conn(0x7f41080cb1e0 msgr2=0x7f41080cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:52.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f410de5a640 1 -- 172.21.15.167:0/1151386084 shutdown_connections 2023-11-28T20:40:52.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.295+0000 7f410de5a640 1 -- 172.21.15.167:0/1151386084 wait complete. 2023-11-28T20:40:52.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f410de5a640 1 Processor -- start 2023-11-28T20:40:52.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f410de5a640 1 -- start start 2023-11-28T20:40:52.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f410de5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41080c4510 0x7f410814d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f410de5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41080c6ff0 0x7f41081f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f410de5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 0x7f41081438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f410de5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410814b790 con 0x7f4108150b40 2023-11-28T20:40:52.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f410de5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108148b60 con 0x7f41080c4510 2023-11-28T20:40:52.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f410de5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4108148e40 con 0x7f41080c6ff0 2023-11-28T20:40:52.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4107fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 0x7f41081438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4107fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 0x7f41081438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58906/0 (socket says 172.21.15.167:58906) 2023-11-28T20:40:52.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4107fff640 1 -- 172.21.15.167:0/2563388921 learned_addr learned my addr 172.21.15.167:0/2563388921 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:52.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41080c4510 0x7f410814d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4106ffd640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41080c6ff0 0x7f41081f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4107fff640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41080c6ff0 msgr2=0x7f41081f3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4107fff640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41080c6ff0 0x7f41081f3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4107fff640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41080c4510 msgr2=0x7f410814d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:52.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4107fff640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41080c4510 0x7f410814d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:52.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4107fff640 1 -- 172.21.15.167:0/2563388921 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80094d0 con 0x7f4108150b40 2023-11-28T20:40:52.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f4107fff640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 0x7f41081438a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4100007e40 tx=0x7f410000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:52.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.299+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100014620 con 0x7f4108150b40 2023-11-28T20:40:52.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410000ee90 con 0x7f4108150b40 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000149e0 con 0x7f4108150b40 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4108149120 con 0x7f4108150b40 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41081f3620 con 0x7f4108150b40 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f410de5a640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4108074770 con 0x7f410814b220 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f41077fe640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 msgr2=0x7f4108071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f41077fe640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 msgr2=0x7f4108071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:40:52.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4100014b40 con 0x7f4108150b40 2023-11-28T20:40:52.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f40effff640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f40f4066470 0x7f40f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:52.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4100084c10 con 0x7f4108150b40 2023-11-28T20:40:52.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.303+0000 7f4106ffd640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f40f4066470 0x7f40f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.307+0000 7f4106ffd640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f40f4066470 0x7f40f4068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41080c3040 tx=0x7f40fc007b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:52.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.507+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.507+0000 7f41077fe640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 msgr2=0x7f4108071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:40:52.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.507+0000 7f41077fe640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 msgr2=0x7f4108071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:40:52.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.507+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:52.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.507+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:40:52.525 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/.snap/snap-subdir-test 2023-11-28T20:40:52.549 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/30 file after the snapshot 2023-11-28T20:40:52.553 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/31 file after the snapshot 2023-11-28T20:40:52.553 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/32 file after the snapshot 2023-11-28T20:40:52.553 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/33 file after the snapshot 2023-11-28T20:40:52.553 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/34 file after the snapshot 2023-11-28T20:40:52.553 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/35 file after the snapshot 2023-11-28T20:40:52.553 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/36 file after the snapshot 2023-11-28T20:40:52.553 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/37 file after the snapshot 2023-11-28T20:40:52.554 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/38 file after the snapshot 2023-11-28T20:40:52.554 INFO:tasks.workunit.client.0.smithi167.stdout: create 100/39 file after the snapshot 2023-11-28T20:40:52.554 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/.snap/snap-subdir-test 2023-11-28T20:40:52.600 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/30 file after the snapshot 2023-11-28T20:40:52.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/31 file after the snapshot 2023-11-28T20:40:52.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/32 file after the snapshot 2023-11-28T20:40:52.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/33 file after the snapshot 2023-11-28T20:40:52.606 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/34 file after the snapshot 2023-11-28T20:40:52.606 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/35 file after the snapshot 2023-11-28T20:40:52.606 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/36 file after the snapshot 2023-11-28T20:40:52.606 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/37 file after the snapshot 2023-11-28T20:40:52.606 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/38 file after the snapshot 2023-11-28T20:40:52.606 INFO:tasks.workunit.client.0.smithi167.stdout: create 101/39 file after the snapshot 2023-11-28T20:40:52.606 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/.snap/snap-subdir-test 2023-11-28T20:40:52.660 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/30 file after the snapshot 2023-11-28T20:40:52.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/31 file after the snapshot 2023-11-28T20:40:52.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/32 file after the snapshot 2023-11-28T20:40:52.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/33 file after the snapshot 2023-11-28T20:40:52.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/34 file after the snapshot 2023-11-28T20:40:52.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/35 file after the snapshot 2023-11-28T20:40:52.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/36 file after the snapshot 2023-11-28T20:40:52.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/37 file after the snapshot 2023-11-28T20:40:52.665 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/38 file after the snapshot 2023-11-28T20:40:52.665 INFO:tasks.workunit.client.0.smithi167.stdout: create 102/39 file after the snapshot 2023-11-28T20:40:52.665 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/.snap/snap-subdir-test 2023-11-28T20:40:52.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.911+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:52.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.911+0000 7f41077fe640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 msgr2=0x7f4108071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:40:52.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.911+0000 7f41077fe640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 msgr2=0x7f4108071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:40:52.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.911+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:40:52.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:52.911+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:40:52.957 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/30 file after the snapshot 2023-11-28T20:40:52.959 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/31 file after the snapshot 2023-11-28T20:40:52.959 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/32 file after the snapshot 2023-11-28T20:40:52.960 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/33 file after the snapshot 2023-11-28T20:40:52.960 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/34 file after the snapshot 2023-11-28T20:40:52.960 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/35 file after the snapshot 2023-11-28T20:40:52.960 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/36 file after the snapshot 2023-11-28T20:40:52.960 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/37 file after the snapshot 2023-11-28T20:40:52.960 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/38 file after the snapshot 2023-11-28T20:40:52.960 INFO:tasks.workunit.client.0.smithi167.stdout: create 103/39 file after the snapshot 2023-11-28T20:40:52.960 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/.snap/snap-subdir-test 2023-11-28T20:40:53.031 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/30 file after the snapshot 2023-11-28T20:40:53.034 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/31 file after the snapshot 2023-11-28T20:40:53.034 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/32 file after the snapshot 2023-11-28T20:40:53.034 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/33 file after the snapshot 2023-11-28T20:40:53.034 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/34 file after the snapshot 2023-11-28T20:40:53.034 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/35 file after the snapshot 2023-11-28T20:40:53.034 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/36 file after the snapshot 2023-11-28T20:40:53.034 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/37 file after the snapshot 2023-11-28T20:40:53.034 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/38 file after the snapshot 2023-11-28T20:40:53.035 INFO:tasks.workunit.client.0.smithi167.stdout: create 104/39 file after the snapshot 2023-11-28T20:40:53.035 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/.snap/snap-subdir-test 2023-11-28T20:40:53.104 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/30 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/31 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/32 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/33 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/34 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/35 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/36 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/37 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/38 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 105/39 file after the snapshot 2023-11-28T20:40:53.107 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/.snap/snap-subdir-test 2023-11-28T20:40:53.177 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/30 file after the snapshot 2023-11-28T20:40:53.180 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/31 file after the snapshot 2023-11-28T20:40:53.180 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/32 file after the snapshot 2023-11-28T20:40:53.180 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/33 file after the snapshot 2023-11-28T20:40:53.180 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/34 file after the snapshot 2023-11-28T20:40:53.180 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/35 file after the snapshot 2023-11-28T20:40:53.180 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/36 file after the snapshot 2023-11-28T20:40:53.180 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/37 file after the snapshot 2023-11-28T20:40:53.180 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/38 file after the snapshot 2023-11-28T20:40:53.181 INFO:tasks.workunit.client.0.smithi167.stdout: create 106/39 file after the snapshot 2023-11-28T20:40:53.181 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/.snap/snap-subdir-test 2023-11-28T20:40:53.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.715+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.715+0000 7f41077fe640 1 -- 172.21.15.167:0/2563388921 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4108157040 con 0x7f410814b220 2023-11-28T20:40:53.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.715+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f410806bba0 tx=0x7f40f801ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:53.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.715+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f80b6640 con 0x7f410814b220 2023-11-28T20:40:53.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.715+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f40f80b67a0 con 0x7f410814b220 2023-11-28T20:40:53.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.715+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 msgr2=0x7f4108071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:53.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.715+0000 7f40effff640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f410806bba0 tx=0x7f40f801ad10 comp rx=0 tx=0).stop 2023-11-28T20:40:53.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.715+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 msgr2=0x7f4108071c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:53.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.715+0000 7f40effff640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f410814b220 0x7f4108071c00 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f410806bba0 tx=0x7f40f801ad10 comp rx=0 tx=0).stop 2023-11-28T20:40:53.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f410de5a640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4108072140 0x7f410814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:53.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41080682c0 con 0x7f4108072140 2023-11-28T20:40:53.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4108072140 0x7f410814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f41077fe640 1 -- 172.21.15.167:0/2563388921 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f41081f3840 con 0x7f4108072140 2023-11-28T20:40:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f41077fe640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4108072140 0x7f410814e780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40f801c510 tx=0x7f40f8019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:53.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8003830 con 0x7f4108072140 2023-11-28T20:40:53.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7f40f8003990 con 0x7f4108072140 2023-11-28T20:40:53.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4108072140 msgr2=0x7f410814e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:53.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f40effff640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4108072140 0x7f410814e780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40f801c510 tx=0x7f40f8019270 comp rx=0 tx=0).stop 2023-11-28T20:40:53.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f40effff640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4108072140 msgr2=0x7f410814e780 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:40:53.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.723+0000 7f40effff640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4108072140 0x7f410814e780 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40f801c510 tx=0x7f40f8019270 comp rx=0 tx=0).stop 2023-11-28T20:40:53.730 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:40:53.730 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:53.730 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:53.730 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:40:53.730 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 24, 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 4, 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:53.731 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:53.732 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:53.732 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:53.732 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:53.732 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:53.732 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:53.732 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:53.732 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:53.732 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:53.732 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:53.733 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:40:53.734 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:40:53.735 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:40:53.736 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:53.737 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:53.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.739 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:53.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.741 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:40:53.742 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:40:53.743 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:40:53.744 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:40:53.744 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:40:53.744 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:40:53.744 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:40:53.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:40:53.744 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:40:53.744 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f40f4066470 msgr2=0x7f40f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f410de5a640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f40f4066470 0x7f40f4068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f41080c3040 tx=0x7f40fc007b80 comp rx=0 tx=0).stop 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 msgr2=0x7f41081438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f410de5a640 1 --2- 172.21.15.167:0/2563388921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4108150b40 0x7f41081438a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4100007e40 tx=0x7f410000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f4107fff640 1 -- 172.21.15.167:0/2563388921 reap_dead start 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f4107fff640 1 -- 172.21.15.167:0/2563388921 reap_dead start 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 shutdown_connections 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 >> 172.21.15.167:0/2563388921 conn(0x7f41080cb1e0 msgr2=0x7f410814ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 shutdown_connections 2023-11-28T20:40:53.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.727+0000 7f410de5a640 1 -- 172.21.15.167:0/2563388921 wait complete. 2023-11-28T20:40:53.752 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:40:53.752 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:40:53.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:40:53.872 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/30 file after the snapshot 2023-11-28T20:40:53.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/31 file after the snapshot 2023-11-28T20:40:53.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/32 file after the snapshot 2023-11-28T20:40:53.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/33 file after the snapshot 2023-11-28T20:40:53.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/34 file after the snapshot 2023-11-28T20:40:53.876 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/35 file after the snapshot 2023-11-28T20:40:53.876 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/36 file after the snapshot 2023-11-28T20:40:53.876 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/37 file after the snapshot 2023-11-28T20:40:53.876 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/38 file after the snapshot 2023-11-28T20:40:53.876 INFO:tasks.workunit.client.0.smithi167.stdout: create 107/39 file after the snapshot 2023-11-28T20:40:53.876 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/.snap/snap-subdir-test 2023-11-28T20:40:53.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d31c9c640 1 Processor -- start 2023-11-28T20:40:53.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d31c9c640 1 -- start start 2023-11-28T20:40:53.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d31c9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c0cfc40 0x7f9d2c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:53.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d31c9c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c15ac00 con 0x7f9d2c153ae0 2023-11-28T20:40:53.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d31c9c640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c0cbd60 con 0x7f9d2c0cf860 2023-11-28T20:40:53.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d31c9c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c159ff0 con 0x7f9d2c0cfc40 2023-11-28T20:40:53.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9d2c153ae0 0x7f9d2c15d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39378/0 (socket says 172.21.15.167:39378) 2023-11-28T20:40:53.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2bfff640 1 -- 172.21.15.167:0/1783767511 learned_addr learned my addr 172.21.15.167:0/1783767511 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:40:53.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2affd640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c0cfc40 0x7f9d2c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286036903 0 0) 0x7f9d2c15ac00 con 0x7f9d2c153ae0 2023-11-28T20:40:53.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d14003530 con 0x7f9d2c153ae0 2023-11-28T20:40:53.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 500722121 0 0) 0x7f9d14003530 con 0x7f9d2c153ae0 2023-11-28T20:40:53.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c0cfc40 msgr2=0x7f9d2c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:53.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c0cfc40 0x7f9d2c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:53.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 >> v1:172.21.15.178:6789/0 conn(0x7f9d2c0cf860 legacy=0x7f9d2c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:53.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c15a2d0 con 0x7f9d2c153ae0 2023-11-28T20:40:53.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9d24001a00 con 0x7f9d2c153ae0 2023-11-28T20:40:53.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 >> v1:172.21.15.167:6789/0 conn(0x7f9d2c153ae0 legacy=0x7f9d2c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:53.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d140039b0 0x7f9d14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:53.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d140047d0 0x7f9d14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:53.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d14005190 0x7f9d1400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:53.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c159ff0 con 0x7f9d140039b0 2023-11-28T20:40:53.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1400bf80 con 0x7f9d14005190 2023-11-28T20:40:53.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1400c110 con 0x7f9d140047d0 2023-11-28T20:40:53.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2affd640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c0cfc40 0x7f9d2c0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:40:53.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2b7fe640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d140039b0 0x7f9d14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.935+0000 7f9d2bfff640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d14005190 0x7f9d1400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.939+0000 7f9d2affd640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d140047d0 0x7f9d14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.939+0000 7f9d2b7fe640 1 -- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d140047d0 msgr2=0x7f9d14004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:53.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.939+0000 7f9d2b7fe640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d140047d0 0x7f9d14004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:53.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.939+0000 7f9d2b7fe640 1 -- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d14005190 msgr2=0x7f9d1400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:40:53.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.939+0000 7f9d2b7fe640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d14005190 0x7f9d1400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:53.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.939+0000 7f9d2b7fe640 1 -- 172.21.15.167:0/1783767511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14003530 con 0x7f9d140039b0 2023-11-28T20:40:53.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.939+0000 7f9d2affd640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d140047d0 0x7f9d14004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:40:53.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.939+0000 7f9d2bfff640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d14005190 0x7f9d1400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:40:53.946 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/30 file after the snapshot 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d2b7fe640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d140039b0 0x7f9d14003d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c001890 tx=0x7f9d1c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec615b9226149e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0ac630 con 0x7f9d140039b0 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0ac790 con 0x7f9d140039b0 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d2a7fc640 1 -- 172.21.15.167:0/1783767511 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0acb40 con 0x7f9d140039b0 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d31c9c640 1 -- 172.21.15.167:0/1783767511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d140039b0 msgr2=0x7f9d14003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d31c9c640 1 --2- 172.21.15.167:0/1783767511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d140039b0 0x7f9d14003d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c001890 tx=0x7f9d1c01c4b0 comp rx=0 tx=0).stop 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d2bfff640 1 -- 172.21.15.167:0/1783767511 reap_dead start 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d31c9c640 1 -- 172.21.15.167:0/1783767511 shutdown_connections 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d31c9c640 1 -- 172.21.15.167:0/1783767511 >> 172.21.15.167:0/1783767511 conn(0x7f9d2c06c1f0 msgr2=0x7f9d2c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:53.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d31c9c640 1 -- 172.21.15.167:0/1783767511 shutdown_connections 2023-11-28T20:40:53.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d31c9c640 1 -- 172.21.15.167:0/1783767511 wait complete. 2023-11-28T20:40:53.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d31c9c640 1 Processor -- start 2023-11-28T20:40:53.949 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/31 file after the snapshot 2023-11-28T20:40:53.949 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/32 file after the snapshot 2023-11-28T20:40:53.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.943+0000 7f9d31c9c640 1 -- start start 2023-11-28T20:40:53.950 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/33 file after the snapshot 2023-11-28T20:40:53.950 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/34 file after the snapshot 2023-11-28T20:40:53.950 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/35 file after the snapshot 2023-11-28T20:40:53.950 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/36 file after the snapshot 2023-11-28T20:40:53.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d31c9c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d140039b0 0x7f9d2c15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:53.951 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/37 file after the snapshot 2023-11-28T20:40:53.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d31c9c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d2c15ccb0 0x7f9d2c158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:53.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d31c9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c148c60 0x7f9d2c149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:53.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d31c9c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c159490 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d31c9c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1584e0 con 0x7f9d140039b0 2023-11-28T20:40:53.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d31c9c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1471e0 con 0x7f9d2c148c60 2023-11-28T20:40:53.952 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/38 file after the snapshot 2023-11-28T20:40:53.952 INFO:tasks.workunit.client.0.smithi167.stdout: create 108/39 file after the snapshot 2023-11-28T20:40:53.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d2c15ccb0 0x7f9d2c158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d2c15ccb0 0x7f9d2c158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35316/0 (socket says 172.21.15.167:35316) 2023-11-28T20:40:53.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2affd640 1 -- 172.21.15.167:0/3395064748 learned_addr learned my addr 172.21.15.167:0/3395064748 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:40:53.953 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/.snap/snap-subdir-test 2023-11-28T20:40:53.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2b7fe640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d140039b0 0x7f9d2c15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2bfff640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c148c60 0x7f9d2c149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2affd640 1 -- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c148c60 msgr2=0x7f9d2c149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:53.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2affd640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c148c60 0x7f9d2c149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:53.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2affd640 1 -- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d140039b0 msgr2=0x7f9d2c15ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:53.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2affd640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d140039b0 0x7f9d2c15ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:53.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2affd640 1 -- 172.21.15.167:0/3395064748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c147480 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d2affd640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d2c15ccb0 0x7f9d2c158f50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9d20010850 tx=0x7f9d20010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:53.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d13fff640 1 -- 172.21.15.167:0/3395064748 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000eb60 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d13fff640 1 -- 172.21.15.167:0/3395064748 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2000ecc0 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d13fff640 1 -- 172.21.15.167:0/3395064748 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2001c400 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c158750 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c1490e0 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.947+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c067c40 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.951+0000 7f9d13fff640 1 -- 172.21.15.167:0/3395064748 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d2001c560 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.951+0000 7f9d13fff640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d180664a0 0x7f9d18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:40:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.951+0000 7f9d13fff640 1 -- 172.21.15.167:0/3395064748 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9d20084660 con 0x7f9d2c15ccb0 2023-11-28T20:40:53.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.951+0000 7f9d2b7fe640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d180664a0 0x7f9d18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:40:53.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.951+0000 7f9d2b7fe640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d180664a0 0x7f9d18068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0ae000 tx=0x7f9d1c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:40:53.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:53.955+0000 7f9d13fff640 1 -- 172.21.15.167:0/3395064748 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d20051700 con 0x7f9d2c15ccb0 2023-11-28T20:40:54.013 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/30 file after the snapshot 2023-11-28T20:40:54.019 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/31 file after the snapshot 2023-11-28T20:40:54.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/32 file after the snapshot 2023-11-28T20:40:54.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/33 file after the snapshot 2023-11-28T20:40:54.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/34 file after the snapshot 2023-11-28T20:40:54.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/35 file after the snapshot 2023-11-28T20:40:54.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/36 file after the snapshot 2023-11-28T20:40:54.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/37 file after the snapshot 2023-11-28T20:40:54.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/38 file after the snapshot 2023-11-28T20:40:54.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 109/39 file after the snapshot 2023-11-28T20:40:54.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/.snap/snap-subdir-test 2023-11-28T20:40:54.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.411+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f9d2c075c90 con 0x7f9d2c15ccb0 2023-11-28T20:40:54.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.419+0000 7f9d13fff640 1 -- 172.21.15.167:0/3395064748 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f9d20054d20 con 0x7f9d2c15ccb0 2023-11-28T20:40:54.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d180664a0 msgr2=0x7f9d18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:54.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d180664a0 0x7f9d18068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0ae000 tx=0x7f9d1c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:40:54.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d2c15ccb0 msgr2=0x7f9d2c158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:40:54.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d2c15ccb0 0x7f9d2c158f50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9d20010850 tx=0x7f9d20010d10 comp rx=0 tx=0).stop 2023-11-28T20:40:54.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 shutdown_connections 2023-11-28T20:40:54.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9d180664a0 0x7f9d18068960 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:54.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d2c148c60 0x7f9d2c149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:54.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d2c15ccb0 0x7f9d2c158f50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:54.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 --2- 172.21.15.167:0/3395064748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d140039b0 0x7f9d2c15ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:40:54.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.431+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 >> 172.21.15.167:0/3395064748 conn(0x7f9d2c06c1f0 msgr2=0x7f9d2c152180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:40:54.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.439+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 shutdown_connections 2023-11-28T20:40:54.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:40:54.443+0000 7f9d31c9c640 1 -- 172.21.15.167:0/3395064748 wait complete. 2023-11-28T20:40:54.472 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/30 file after the snapshot 2023-11-28T20:40:54.541 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:40:55.120 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/31 file after the snapshot 2023-11-28T20:40:55.120 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/32 file after the snapshot 2023-11-28T20:40:55.121 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/33 file after the snapshot 2023-11-28T20:40:55.121 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/34 file after the snapshot 2023-11-28T20:40:55.121 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/35 file after the snapshot 2023-11-28T20:40:55.121 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/36 file after the snapshot 2023-11-28T20:40:55.121 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/37 file after the snapshot 2023-11-28T20:40:55.121 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/38 file after the snapshot 2023-11-28T20:40:55.121 INFO:tasks.workunit.client.0.smithi167.stdout: create 110/39 file after the snapshot 2023-11-28T20:40:55.121 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/.snap/snap-subdir-test 2023-11-28T20:40:55.903 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/30 file after the snapshot 2023-11-28T20:40:55.907 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/31 file after the snapshot 2023-11-28T20:40:55.908 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/32 file after the snapshot 2023-11-28T20:40:55.908 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/33 file after the snapshot 2023-11-28T20:40:55.908 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/34 file after the snapshot 2023-11-28T20:40:55.908 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/35 file after the snapshot 2023-11-28T20:40:55.908 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/36 file after the snapshot 2023-11-28T20:40:55.909 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/37 file after the snapshot 2023-11-28T20:40:55.909 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/38 file after the snapshot 2023-11-28T20:40:55.909 INFO:tasks.workunit.client.0.smithi167.stdout: create 111/39 file after the snapshot 2023-11-28T20:40:55.909 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/.snap/snap-subdir-test 2023-11-28T20:40:55.952 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/30 file after the snapshot 2023-11-28T20:40:55.955 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/31 file after the snapshot 2023-11-28T20:40:55.956 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/32 file after the snapshot 2023-11-28T20:40:55.956 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/33 file after the snapshot 2023-11-28T20:40:55.956 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/34 file after the snapshot 2023-11-28T20:40:55.956 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/35 file after the snapshot 2023-11-28T20:40:55.956 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/36 file after the snapshot 2023-11-28T20:40:55.956 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/37 file after the snapshot 2023-11-28T20:40:55.956 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/38 file after the snapshot 2023-11-28T20:40:55.956 INFO:tasks.workunit.client.0.smithi167.stdout: create 112/39 file after the snapshot 2023-11-28T20:40:55.956 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/.snap/snap-subdir-test 2023-11-28T20:40:56.032 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/30 file after the snapshot 2023-11-28T20:40:56.035 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/31 file after the snapshot 2023-11-28T20:40:56.035 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/32 file after the snapshot 2023-11-28T20:40:56.035 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/33 file after the snapshot 2023-11-28T20:40:56.035 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/34 file after the snapshot 2023-11-28T20:40:56.035 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/35 file after the snapshot 2023-11-28T20:40:56.035 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/36 file after the snapshot 2023-11-28T20:40:56.035 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/37 file after the snapshot 2023-11-28T20:40:56.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/38 file after the snapshot 2023-11-28T20:40:56.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 113/39 file after the snapshot 2023-11-28T20:40:56.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/.snap/snap-subdir-test 2023-11-28T20:40:56.102 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/30 file after the snapshot 2023-11-28T20:40:56.103 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/31 file after the snapshot 2023-11-28T20:40:56.103 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/32 file after the snapshot 2023-11-28T20:40:56.103 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/33 file after the snapshot 2023-11-28T20:40:56.103 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/34 file after the snapshot 2023-11-28T20:40:56.103 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/35 file after the snapshot 2023-11-28T20:40:56.104 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/36 file after the snapshot 2023-11-28T20:40:56.104 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/37 file after the snapshot 2023-11-28T20:40:56.104 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/38 file after the snapshot 2023-11-28T20:40:56.104 INFO:tasks.workunit.client.0.smithi167.stdout: create 114/39 file after the snapshot 2023-11-28T20:40:56.104 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/.snap/snap-subdir-test 2023-11-28T20:40:56.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/30 file after the snapshot 2023-11-28T20:40:56.172 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/31 file after the snapshot 2023-11-28T20:40:56.172 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/32 file after the snapshot 2023-11-28T20:40:56.172 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/33 file after the snapshot 2023-11-28T20:40:56.172 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/34 file after the snapshot 2023-11-28T20:40:56.172 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/35 file after the snapshot 2023-11-28T20:40:56.172 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/36 file after the snapshot 2023-11-28T20:40:56.172 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/37 file after the snapshot 2023-11-28T20:40:56.173 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/38 file after the snapshot 2023-11-28T20:40:56.173 INFO:tasks.workunit.client.0.smithi167.stdout: create 115/39 file after the snapshot 2023-11-28T20:40:56.173 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/.snap/snap-subdir-test 2023-11-28T20:40:56.561 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/30 file after the snapshot 2023-11-28T20:40:56.564 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/31 file after the snapshot 2023-11-28T20:40:56.564 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/32 file after the snapshot 2023-11-28T20:40:56.564 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/33 file after the snapshot 2023-11-28T20:40:56.564 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/34 file after the snapshot 2023-11-28T20:40:56.564 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/35 file after the snapshot 2023-11-28T20:40:56.564 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/36 file after the snapshot 2023-11-28T20:40:56.564 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/37 file after the snapshot 2023-11-28T20:40:56.564 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/38 file after the snapshot 2023-11-28T20:40:56.565 INFO:tasks.workunit.client.0.smithi167.stdout: create 116/39 file after the snapshot 2023-11-28T20:40:56.565 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/.snap/snap-subdir-test 2023-11-28T20:40:57.279 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/30 file after the snapshot 2023-11-28T20:40:57.281 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/31 file after the snapshot 2023-11-28T20:40:57.282 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/32 file after the snapshot 2023-11-28T20:40:57.282 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/33 file after the snapshot 2023-11-28T20:40:57.282 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/34 file after the snapshot 2023-11-28T20:40:57.282 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/35 file after the snapshot 2023-11-28T20:40:57.282 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/36 file after the snapshot 2023-11-28T20:40:57.282 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/37 file after the snapshot 2023-11-28T20:40:57.282 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/38 file after the snapshot 2023-11-28T20:40:57.282 INFO:tasks.workunit.client.0.smithi167.stdout: create 117/39 file after the snapshot 2023-11-28T20:40:57.282 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/.snap/snap-subdir-test 2023-11-28T20:40:57.343 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/30 file after the snapshot 2023-11-28T20:40:57.346 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/31 file after the snapshot 2023-11-28T20:40:57.346 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/32 file after the snapshot 2023-11-28T20:40:57.346 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/33 file after the snapshot 2023-11-28T20:40:57.346 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/34 file after the snapshot 2023-11-28T20:40:57.346 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/35 file after the snapshot 2023-11-28T20:40:57.346 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/36 file after the snapshot 2023-11-28T20:40:57.346 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/37 file after the snapshot 2023-11-28T20:40:57.346 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/38 file after the snapshot 2023-11-28T20:40:57.347 INFO:tasks.workunit.client.0.smithi167.stdout: create 118/39 file after the snapshot 2023-11-28T20:40:57.347 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/.snap/snap-subdir-test 2023-11-28T20:40:57.920 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/30 file after the snapshot 2023-11-28T20:40:57.923 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/31 file after the snapshot 2023-11-28T20:40:57.923 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/32 file after the snapshot 2023-11-28T20:40:57.923 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/33 file after the snapshot 2023-11-28T20:40:57.923 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/34 file after the snapshot 2023-11-28T20:40:57.923 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/35 file after the snapshot 2023-11-28T20:40:57.924 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/36 file after the snapshot 2023-11-28T20:40:57.924 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/37 file after the snapshot 2023-11-28T20:40:57.924 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/38 file after the snapshot 2023-11-28T20:40:57.924 INFO:tasks.workunit.client.0.smithi167.stdout: create 119/39 file after the snapshot 2023-11-28T20:40:57.924 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/.snap/snap-subdir-test 2023-11-28T20:40:58.688 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/30 file after the snapshot 2023-11-28T20:40:58.691 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/31 file after the snapshot 2023-11-28T20:40:58.691 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/32 file after the snapshot 2023-11-28T20:40:58.691 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/33 file after the snapshot 2023-11-28T20:40:58.692 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/34 file after the snapshot 2023-11-28T20:40:58.692 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/35 file after the snapshot 2023-11-28T20:40:58.692 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/36 file after the snapshot 2023-11-28T20:40:58.692 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/37 file after the snapshot 2023-11-28T20:40:58.692 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/38 file after the snapshot 2023-11-28T20:40:58.692 INFO:tasks.workunit.client.0.smithi167.stdout: create 120/39 file after the snapshot 2023-11-28T20:40:58.692 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/.snap/snap-subdir-test 2023-11-28T20:40:59.191 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/30 file after the snapshot 2023-11-28T20:40:59.194 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/31 file after the snapshot 2023-11-28T20:40:59.194 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/32 file after the snapshot 2023-11-28T20:40:59.194 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/33 file after the snapshot 2023-11-28T20:40:59.194 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/34 file after the snapshot 2023-11-28T20:40:59.194 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/35 file after the snapshot 2023-11-28T20:40:59.195 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/36 file after the snapshot 2023-11-28T20:40:59.195 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/37 file after the snapshot 2023-11-28T20:40:59.195 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/38 file after the snapshot 2023-11-28T20:40:59.195 INFO:tasks.workunit.client.0.smithi167.stdout: create 121/39 file after the snapshot 2023-11-28T20:40:59.195 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/.snap/snap-subdir-test 2023-11-28T20:40:59.258 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/30 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/31 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/32 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/33 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/34 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/35 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/36 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/37 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/38 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 122/39 file after the snapshot 2023-11-28T20:40:59.262 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/.snap/snap-subdir-test 2023-11-28T20:40:59.324 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/30 file after the snapshot 2023-11-28T20:40:59.327 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/31 file after the snapshot 2023-11-28T20:40:59.327 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/32 file after the snapshot 2023-11-28T20:40:59.327 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/33 file after the snapshot 2023-11-28T20:40:59.327 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/34 file after the snapshot 2023-11-28T20:40:59.328 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/35 file after the snapshot 2023-11-28T20:40:59.328 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/36 file after the snapshot 2023-11-28T20:40:59.328 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/37 file after the snapshot 2023-11-28T20:40:59.328 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/38 file after the snapshot 2023-11-28T20:40:59.328 INFO:tasks.workunit.client.0.smithi167.stdout: create 123/39 file after the snapshot 2023-11-28T20:40:59.328 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/.snap/snap-subdir-test 2023-11-28T20:40:59.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/30 file after the snapshot 2023-11-28T20:40:59.396 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/31 file after the snapshot 2023-11-28T20:40:59.396 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/32 file after the snapshot 2023-11-28T20:40:59.396 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/33 file after the snapshot 2023-11-28T20:40:59.397 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/34 file after the snapshot 2023-11-28T20:40:59.397 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/35 file after the snapshot 2023-11-28T20:40:59.397 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/36 file after the snapshot 2023-11-28T20:40:59.397 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/37 file after the snapshot 2023-11-28T20:40:59.397 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/38 file after the snapshot 2023-11-28T20:40:59.397 INFO:tasks.workunit.client.0.smithi167.stdout: create 124/39 file after the snapshot 2023-11-28T20:40:59.397 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/.snap/snap-subdir-test 2023-11-28T20:40:59.955 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/30 file after the snapshot 2023-11-28T20:40:59.958 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/31 file after the snapshot 2023-11-28T20:40:59.958 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/32 file after the snapshot 2023-11-28T20:40:59.958 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/33 file after the snapshot 2023-11-28T20:40:59.958 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/34 file after the snapshot 2023-11-28T20:40:59.958 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/35 file after the snapshot 2023-11-28T20:40:59.959 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/36 file after the snapshot 2023-11-28T20:40:59.959 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/37 file after the snapshot 2023-11-28T20:40:59.959 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/38 file after the snapshot 2023-11-28T20:40:59.959 INFO:tasks.workunit.client.0.smithi167.stdout: create 125/39 file after the snapshot 2023-11-28T20:40:59.959 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/.snap/snap-subdir-test 2023-11-28T20:41:00.023 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/30 file after the snapshot 2023-11-28T20:41:00.026 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/31 file after the snapshot 2023-11-28T20:41:00.026 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/32 file after the snapshot 2023-11-28T20:41:00.026 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/33 file after the snapshot 2023-11-28T20:41:00.026 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/34 file after the snapshot 2023-11-28T20:41:00.026 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/35 file after the snapshot 2023-11-28T20:41:00.026 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/36 file after the snapshot 2023-11-28T20:41:00.026 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/37 file after the snapshot 2023-11-28T20:41:00.026 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/38 file after the snapshot 2023-11-28T20:41:00.026 INFO:tasks.workunit.client.0.smithi167.stdout: create 126/39 file after the snapshot 2023-11-28T20:41:00.027 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/.snap/snap-subdir-test 2023-11-28T20:41:00.091 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/30 file after the snapshot 2023-11-28T20:41:00.094 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/31 file after the snapshot 2023-11-28T20:41:00.095 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/32 file after the snapshot 2023-11-28T20:41:00.095 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/33 file after the snapshot 2023-11-28T20:41:00.095 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/34 file after the snapshot 2023-11-28T20:41:00.095 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/35 file after the snapshot 2023-11-28T20:41:00.095 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/36 file after the snapshot 2023-11-28T20:41:00.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/37 file after the snapshot 2023-11-28T20:41:00.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/38 file after the snapshot 2023-11-28T20:41:00.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 127/39 file after the snapshot 2023-11-28T20:41:00.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/.snap/snap-subdir-test 2023-11-28T20:41:00.154 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/30 file after the snapshot 2023-11-28T20:41:00.158 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/31 file after the snapshot 2023-11-28T20:41:00.158 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/32 file after the snapshot 2023-11-28T20:41:00.158 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/33 file after the snapshot 2023-11-28T20:41:00.158 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/34 file after the snapshot 2023-11-28T20:41:00.159 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/35 file after the snapshot 2023-11-28T20:41:00.159 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/36 file after the snapshot 2023-11-28T20:41:00.159 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/37 file after the snapshot 2023-11-28T20:41:00.159 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/38 file after the snapshot 2023-11-28T20:41:00.159 INFO:tasks.workunit.client.0.smithi167.stdout: create 128/39 file after the snapshot 2023-11-28T20:41:00.159 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/.snap/snap-subdir-test 2023-11-28T20:41:00.790 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/30 file after the snapshot 2023-11-28T20:41:00.794 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/31 file after the snapshot 2023-11-28T20:41:00.794 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/32 file after the snapshot 2023-11-28T20:41:00.794 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/33 file after the snapshot 2023-11-28T20:41:00.794 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/34 file after the snapshot 2023-11-28T20:41:00.794 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/35 file after the snapshot 2023-11-28T20:41:00.794 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/36 file after the snapshot 2023-11-28T20:41:00.794 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/37 file after the snapshot 2023-11-28T20:41:00.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/38 file after the snapshot 2023-11-28T20:41:00.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 129/39 file after the snapshot 2023-11-28T20:41:00.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/.snap/snap-subdir-test 2023-11-28T20:41:00.851 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/30 file after the snapshot 2023-11-28T20:41:00.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/31 file after the snapshot 2023-11-28T20:41:00.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/32 file after the snapshot 2023-11-28T20:41:00.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/33 file after the snapshot 2023-11-28T20:41:00.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/34 file after the snapshot 2023-11-28T20:41:00.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/35 file after the snapshot 2023-11-28T20:41:00.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/36 file after the snapshot 2023-11-28T20:41:00.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/37 file after the snapshot 2023-11-28T20:41:00.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/38 file after the snapshot 2023-11-28T20:41:00.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 130/39 file after the snapshot 2023-11-28T20:41:00.856 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/.snap/snap-subdir-test 2023-11-28T20:41:00.913 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/30 file after the snapshot 2023-11-28T20:41:00.916 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/31 file after the snapshot 2023-11-28T20:41:00.916 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/32 file after the snapshot 2023-11-28T20:41:00.916 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/33 file after the snapshot 2023-11-28T20:41:00.916 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/34 file after the snapshot 2023-11-28T20:41:00.916 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/35 file after the snapshot 2023-11-28T20:41:00.916 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/36 file after the snapshot 2023-11-28T20:41:00.917 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/37 file after the snapshot 2023-11-28T20:41:00.917 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/38 file after the snapshot 2023-11-28T20:41:00.917 INFO:tasks.workunit.client.0.smithi167.stdout: create 131/39 file after the snapshot 2023-11-28T20:41:00.917 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/.snap/snap-subdir-test 2023-11-28T20:41:00.982 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/30 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/31 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/32 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/33 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/34 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/35 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/36 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/37 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/38 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 132/39 file after the snapshot 2023-11-28T20:41:00.985 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/.snap/snap-subdir-test 2023-11-28T20:41:01.013 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/30 file after the snapshot 2023-11-28T20:41:01.017 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/31 file after the snapshot 2023-11-28T20:41:01.019 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/32 file after the snapshot 2023-11-28T20:41:01.019 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/33 file after the snapshot 2023-11-28T20:41:01.019 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/34 file after the snapshot 2023-11-28T20:41:01.019 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/35 file after the snapshot 2023-11-28T20:41:01.019 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/36 file after the snapshot 2023-11-28T20:41:01.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/37 file after the snapshot 2023-11-28T20:41:01.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/38 file after the snapshot 2023-11-28T20:41:01.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 133/39 file after the snapshot 2023-11-28T20:41:01.020 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/.snap/snap-subdir-test 2023-11-28T20:41:01.518 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/30 file after the snapshot 2023-11-28T20:41:01.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/31 file after the snapshot 2023-11-28T20:41:01.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/32 file after the snapshot 2023-11-28T20:41:01.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/33 file after the snapshot 2023-11-28T20:41:01.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/34 file after the snapshot 2023-11-28T20:41:01.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/35 file after the snapshot 2023-11-28T20:41:01.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/36 file after the snapshot 2023-11-28T20:41:01.523 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/37 file after the snapshot 2023-11-28T20:41:01.523 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/38 file after the snapshot 2023-11-28T20:41:01.523 INFO:tasks.workunit.client.0.smithi167.stdout: create 134/39 file after the snapshot 2023-11-28T20:41:01.523 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/.snap/snap-subdir-test 2023-11-28T20:41:01.579 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/30 file after the snapshot 2023-11-28T20:41:01.582 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/31 file after the snapshot 2023-11-28T20:41:01.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/32 file after the snapshot 2023-11-28T20:41:01.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/33 file after the snapshot 2023-11-28T20:41:01.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/34 file after the snapshot 2023-11-28T20:41:01.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/35 file after the snapshot 2023-11-28T20:41:01.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/36 file after the snapshot 2023-11-28T20:41:01.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/37 file after the snapshot 2023-11-28T20:41:01.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/38 file after the snapshot 2023-11-28T20:41:01.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 135/39 file after the snapshot 2023-11-28T20:41:01.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/.snap/snap-subdir-test 2023-11-28T20:41:01.641 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/30 file after the snapshot 2023-11-28T20:41:01.644 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/31 file after the snapshot 2023-11-28T20:41:01.644 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/32 file after the snapshot 2023-11-28T20:41:01.644 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/33 file after the snapshot 2023-11-28T20:41:01.644 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/34 file after the snapshot 2023-11-28T20:41:01.644 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/35 file after the snapshot 2023-11-28T20:41:01.644 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/36 file after the snapshot 2023-11-28T20:41:01.644 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/37 file after the snapshot 2023-11-28T20:41:01.644 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/38 file after the snapshot 2023-11-28T20:41:01.645 INFO:tasks.workunit.client.0.smithi167.stdout: create 136/39 file after the snapshot 2023-11-28T20:41:01.645 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/.snap/snap-subdir-test 2023-11-28T20:41:01.701 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/30 file after the snapshot 2023-11-28T20:41:01.705 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/31 file after the snapshot 2023-11-28T20:41:01.705 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/32 file after the snapshot 2023-11-28T20:41:01.705 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/33 file after the snapshot 2023-11-28T20:41:01.705 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/34 file after the snapshot 2023-11-28T20:41:01.705 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/35 file after the snapshot 2023-11-28T20:41:01.705 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/36 file after the snapshot 2023-11-28T20:41:01.705 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/37 file after the snapshot 2023-11-28T20:41:01.705 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/38 file after the snapshot 2023-11-28T20:41:01.705 INFO:tasks.workunit.client.0.smithi167.stdout: create 137/39 file after the snapshot 2023-11-28T20:41:01.706 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/.snap/snap-subdir-test 2023-11-28T20:41:01.762 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/30 file after the snapshot 2023-11-28T20:41:01.765 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/31 file after the snapshot 2023-11-28T20:41:01.765 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/32 file after the snapshot 2023-11-28T20:41:01.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/33 file after the snapshot 2023-11-28T20:41:01.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/34 file after the snapshot 2023-11-28T20:41:01.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/35 file after the snapshot 2023-11-28T20:41:01.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/36 file after the snapshot 2023-11-28T20:41:01.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/37 file after the snapshot 2023-11-28T20:41:01.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/38 file after the snapshot 2023-11-28T20:41:01.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 138/39 file after the snapshot 2023-11-28T20:41:01.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/.snap/snap-subdir-test 2023-11-28T20:41:02.236 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/30 file after the snapshot 2023-11-28T20:41:02.488 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/31 file after the snapshot 2023-11-28T20:41:02.488 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/32 file after the snapshot 2023-11-28T20:41:02.488 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/33 file after the snapshot 2023-11-28T20:41:02.489 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/34 file after the snapshot 2023-11-28T20:41:02.489 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/35 file after the snapshot 2023-11-28T20:41:02.489 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/36 file after the snapshot 2023-11-28T20:41:02.489 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/37 file after the snapshot 2023-11-28T20:41:02.489 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/38 file after the snapshot 2023-11-28T20:41:02.489 INFO:tasks.workunit.client.0.smithi167.stdout: create 139/39 file after the snapshot 2023-11-28T20:41:02.489 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/.snap/snap-subdir-test 2023-11-28T20:41:02.520 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/30 file after the snapshot 2023-11-28T20:41:02.521 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/31 file after the snapshot 2023-11-28T20:41:02.521 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/32 file after the snapshot 2023-11-28T20:41:02.521 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/33 file after the snapshot 2023-11-28T20:41:02.521 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/34 file after the snapshot 2023-11-28T20:41:02.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/35 file after the snapshot 2023-11-28T20:41:02.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/36 file after the snapshot 2023-11-28T20:41:02.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/37 file after the snapshot 2023-11-28T20:41:02.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/38 file after the snapshot 2023-11-28T20:41:02.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 140/39 file after the snapshot 2023-11-28T20:41:02.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/.snap/snap-subdir-test 2023-11-28T20:41:02.559 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/30 file after the snapshot 2023-11-28T20:41:02.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/31 file after the snapshot 2023-11-28T20:41:02.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/32 file after the snapshot 2023-11-28T20:41:02.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/33 file after the snapshot 2023-11-28T20:41:02.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/34 file after the snapshot 2023-11-28T20:41:02.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/35 file after the snapshot 2023-11-28T20:41:02.563 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/36 file after the snapshot 2023-11-28T20:41:02.563 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/37 file after the snapshot 2023-11-28T20:41:02.563 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/38 file after the snapshot 2023-11-28T20:41:02.563 INFO:tasks.workunit.client.0.smithi167.stdout: create 141/39 file after the snapshot 2023-11-28T20:41:02.563 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/.snap/snap-subdir-test 2023-11-28T20:41:02.595 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/30 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/31 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/32 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/33 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/34 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/35 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/36 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/37 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/38 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 142/39 file after the snapshot 2023-11-28T20:41:02.598 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/.snap/snap-subdir-test 2023-11-28T20:41:02.635 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/30 file after the snapshot 2023-11-28T20:41:02.638 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/31 file after the snapshot 2023-11-28T20:41:02.638 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/32 file after the snapshot 2023-11-28T20:41:02.638 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/33 file after the snapshot 2023-11-28T20:41:02.639 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/34 file after the snapshot 2023-11-28T20:41:02.639 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/35 file after the snapshot 2023-11-28T20:41:02.639 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/36 file after the snapshot 2023-11-28T20:41:02.639 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/37 file after the snapshot 2023-11-28T20:41:02.639 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/38 file after the snapshot 2023-11-28T20:41:02.639 INFO:tasks.workunit.client.0.smithi167.stdout: create 143/39 file after the snapshot 2023-11-28T20:41:02.639 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/.snap/snap-subdir-test 2023-11-28T20:41:02.696 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/30 file after the snapshot 2023-11-28T20:41:02.699 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/31 file after the snapshot 2023-11-28T20:41:02.699 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/32 file after the snapshot 2023-11-28T20:41:02.699 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/33 file after the snapshot 2023-11-28T20:41:02.699 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/34 file after the snapshot 2023-11-28T20:41:02.699 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/35 file after the snapshot 2023-11-28T20:41:02.699 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/36 file after the snapshot 2023-11-28T20:41:02.699 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/37 file after the snapshot 2023-11-28T20:41:02.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/38 file after the snapshot 2023-11-28T20:41:02.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 144/39 file after the snapshot 2023-11-28T20:41:02.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/.snap/snap-subdir-test 2023-11-28T20:41:02.755 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/30 file after the snapshot 2023-11-28T20:41:02.758 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/31 file after the snapshot 2023-11-28T20:41:02.758 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/32 file after the snapshot 2023-11-28T20:41:02.758 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/33 file after the snapshot 2023-11-28T20:41:02.759 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/34 file after the snapshot 2023-11-28T20:41:02.759 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/35 file after the snapshot 2023-11-28T20:41:02.759 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/36 file after the snapshot 2023-11-28T20:41:02.759 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/37 file after the snapshot 2023-11-28T20:41:02.759 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/38 file after the snapshot 2023-11-28T20:41:02.759 INFO:tasks.workunit.client.0.smithi167.stdout: create 145/39 file after the snapshot 2023-11-28T20:41:02.759 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/.snap/snap-subdir-test 2023-11-28T20:41:02.815 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/30 file after the snapshot 2023-11-28T20:41:02.818 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/31 file after the snapshot 2023-11-28T20:41:02.818 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/32 file after the snapshot 2023-11-28T20:41:02.818 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/33 file after the snapshot 2023-11-28T20:41:02.818 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/34 file after the snapshot 2023-11-28T20:41:02.818 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/35 file after the snapshot 2023-11-28T20:41:02.818 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/36 file after the snapshot 2023-11-28T20:41:02.819 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/37 file after the snapshot 2023-11-28T20:41:02.819 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/38 file after the snapshot 2023-11-28T20:41:02.819 INFO:tasks.workunit.client.0.smithi167.stdout: create 146/39 file after the snapshot 2023-11-28T20:41:02.819 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/.snap/snap-subdir-test 2023-11-28T20:41:02.850 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/30 file after the snapshot 2023-11-28T20:41:02.851 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/31 file after the snapshot 2023-11-28T20:41:02.851 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/32 file after the snapshot 2023-11-28T20:41:02.851 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/33 file after the snapshot 2023-11-28T20:41:02.851 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/34 file after the snapshot 2023-11-28T20:41:02.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/35 file after the snapshot 2023-11-28T20:41:02.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/36 file after the snapshot 2023-11-28T20:41:02.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/37 file after the snapshot 2023-11-28T20:41:02.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/38 file after the snapshot 2023-11-28T20:41:02.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 147/39 file after the snapshot 2023-11-28T20:41:02.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/.snap/snap-subdir-test 2023-11-28T20:41:02.889 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/30 file after the snapshot 2023-11-28T20:41:02.892 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/31 file after the snapshot 2023-11-28T20:41:02.892 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/32 file after the snapshot 2023-11-28T20:41:02.892 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/33 file after the snapshot 2023-11-28T20:41:02.892 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/34 file after the snapshot 2023-11-28T20:41:02.892 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/35 file after the snapshot 2023-11-28T20:41:02.892 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/36 file after the snapshot 2023-11-28T20:41:02.892 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/37 file after the snapshot 2023-11-28T20:41:02.893 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/38 file after the snapshot 2023-11-28T20:41:02.893 INFO:tasks.workunit.client.0.smithi167.stdout: create 148/39 file after the snapshot 2023-11-28T20:41:02.893 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/.snap/snap-subdir-test 2023-11-28T20:41:02.924 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/30 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/31 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/32 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/33 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/34 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/35 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/36 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/37 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/38 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 149/39 file after the snapshot 2023-11-28T20:41:02.927 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/.snap/snap-subdir-test 2023-11-28T20:41:02.964 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/30 file after the snapshot 2023-11-28T20:41:03.219 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/31 file after the snapshot 2023-11-28T20:41:03.219 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/32 file after the snapshot 2023-11-28T20:41:03.219 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/33 file after the snapshot 2023-11-28T20:41:03.220 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/34 file after the snapshot 2023-11-28T20:41:03.220 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/35 file after the snapshot 2023-11-28T20:41:03.220 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/36 file after the snapshot 2023-11-28T20:41:03.220 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/37 file after the snapshot 2023-11-28T20:41:03.220 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/38 file after the snapshot 2023-11-28T20:41:03.220 INFO:tasks.workunit.client.0.smithi167.stdout: create 150/39 file after the snapshot 2023-11-28T20:41:03.220 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/.snap/snap-subdir-test 2023-11-28T20:41:03.243 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/30 file after the snapshot 2023-11-28T20:41:03.244 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/31 file after the snapshot 2023-11-28T20:41:03.245 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/32 file after the snapshot 2023-11-28T20:41:03.245 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/33 file after the snapshot 2023-11-28T20:41:03.245 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/34 file after the snapshot 2023-11-28T20:41:03.245 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/35 file after the snapshot 2023-11-28T20:41:03.245 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/36 file after the snapshot 2023-11-28T20:41:03.245 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/37 file after the snapshot 2023-11-28T20:41:03.245 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/38 file after the snapshot 2023-11-28T20:41:03.245 INFO:tasks.workunit.client.0.smithi167.stdout: create 151/39 file after the snapshot 2023-11-28T20:41:03.245 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/.snap/snap-subdir-test 2023-11-28T20:41:03.276 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/30 file after the snapshot 2023-11-28T20:41:03.278 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/31 file after the snapshot 2023-11-28T20:41:03.278 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/32 file after the snapshot 2023-11-28T20:41:03.278 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/33 file after the snapshot 2023-11-28T20:41:03.279 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/34 file after the snapshot 2023-11-28T20:41:03.279 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/35 file after the snapshot 2023-11-28T20:41:03.279 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/36 file after the snapshot 2023-11-28T20:41:03.279 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/37 file after the snapshot 2023-11-28T20:41:03.279 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/38 file after the snapshot 2023-11-28T20:41:03.279 INFO:tasks.workunit.client.0.smithi167.stdout: create 152/39 file after the snapshot 2023-11-28T20:41:03.279 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/.snap/snap-subdir-test 2023-11-28T20:41:03.335 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/30 file after the snapshot 2023-11-28T20:41:03.338 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/31 file after the snapshot 2023-11-28T20:41:03.339 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/32 file after the snapshot 2023-11-28T20:41:03.339 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/33 file after the snapshot 2023-11-28T20:41:03.339 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/34 file after the snapshot 2023-11-28T20:41:03.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/35 file after the snapshot 2023-11-28T20:41:03.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/36 file after the snapshot 2023-11-28T20:41:03.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/37 file after the snapshot 2023-11-28T20:41:03.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/38 file after the snapshot 2023-11-28T20:41:03.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 153/39 file after the snapshot 2023-11-28T20:41:03.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/.snap/snap-subdir-test 2023-11-28T20:41:03.396 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/30 file after the snapshot 2023-11-28T20:41:03.399 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/31 file after the snapshot 2023-11-28T20:41:03.399 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/32 file after the snapshot 2023-11-28T20:41:03.399 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/33 file after the snapshot 2023-11-28T20:41:03.399 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/34 file after the snapshot 2023-11-28T20:41:03.400 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/35 file after the snapshot 2023-11-28T20:41:03.400 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/36 file after the snapshot 2023-11-28T20:41:03.400 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/37 file after the snapshot 2023-11-28T20:41:03.400 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/38 file after the snapshot 2023-11-28T20:41:03.400 INFO:tasks.workunit.client.0.smithi167.stdout: create 154/39 file after the snapshot 2023-11-28T20:41:03.400 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/.snap/snap-subdir-test 2023-11-28T20:41:03.457 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/30 file after the snapshot 2023-11-28T20:41:03.459 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/31 file after the snapshot 2023-11-28T20:41:03.460 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/32 file after the snapshot 2023-11-28T20:41:03.460 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/33 file after the snapshot 2023-11-28T20:41:03.460 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/34 file after the snapshot 2023-11-28T20:41:03.460 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/35 file after the snapshot 2023-11-28T20:41:03.460 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/36 file after the snapshot 2023-11-28T20:41:03.460 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/37 file after the snapshot 2023-11-28T20:41:03.460 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/38 file after the snapshot 2023-11-28T20:41:03.460 INFO:tasks.workunit.client.0.smithi167.stdout: create 155/39 file after the snapshot 2023-11-28T20:41:03.460 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/.snap/snap-subdir-test 2023-11-28T20:41:03.517 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/30 file after the snapshot 2023-11-28T20:41:03.520 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/31 file after the snapshot 2023-11-28T20:41:03.520 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/32 file after the snapshot 2023-11-28T20:41:03.520 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/33 file after the snapshot 2023-11-28T20:41:03.520 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/34 file after the snapshot 2023-11-28T20:41:03.520 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/35 file after the snapshot 2023-11-28T20:41:03.521 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/36 file after the snapshot 2023-11-28T20:41:03.521 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/37 file after the snapshot 2023-11-28T20:41:03.521 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/38 file after the snapshot 2023-11-28T20:41:03.521 INFO:tasks.workunit.client.0.smithi167.stdout: create 156/39 file after the snapshot 2023-11-28T20:41:03.521 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/.snap/snap-subdir-test 2023-11-28T20:41:03.579 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/30 file after the snapshot 2023-11-28T20:41:03.582 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/31 file after the snapshot 2023-11-28T20:41:03.582 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/32 file after the snapshot 2023-11-28T20:41:03.582 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/33 file after the snapshot 2023-11-28T20:41:03.582 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/34 file after the snapshot 2023-11-28T20:41:03.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/35 file after the snapshot 2023-11-28T20:41:03.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/36 file after the snapshot 2023-11-28T20:41:03.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/37 file after the snapshot 2023-11-28T20:41:03.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/38 file after the snapshot 2023-11-28T20:41:03.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 157/39 file after the snapshot 2023-11-28T20:41:03.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/.snap/snap-subdir-test 2023-11-28T20:41:03.616 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/30 file after the snapshot 2023-11-28T20:41:03.618 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/31 file after the snapshot 2023-11-28T20:41:03.618 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/32 file after the snapshot 2023-11-28T20:41:03.619 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/33 file after the snapshot 2023-11-28T20:41:03.619 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/34 file after the snapshot 2023-11-28T20:41:03.619 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/35 file after the snapshot 2023-11-28T20:41:03.619 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/36 file after the snapshot 2023-11-28T20:41:03.619 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/37 file after the snapshot 2023-11-28T20:41:03.619 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/38 file after the snapshot 2023-11-28T20:41:03.619 INFO:tasks.workunit.client.0.smithi167.stdout: create 158/39 file after the snapshot 2023-11-28T20:41:03.619 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/.snap/snap-subdir-test 2023-11-28T20:41:03.651 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/30 file after the snapshot 2023-11-28T20:41:03.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/31 file after the snapshot 2023-11-28T20:41:03.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/32 file after the snapshot 2023-11-28T20:41:03.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/33 file after the snapshot 2023-11-28T20:41:03.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/34 file after the snapshot 2023-11-28T20:41:03.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/35 file after the snapshot 2023-11-28T20:41:03.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/36 file after the snapshot 2023-11-28T20:41:03.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/37 file after the snapshot 2023-11-28T20:41:03.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/38 file after the snapshot 2023-11-28T20:41:03.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 159/39 file after the snapshot 2023-11-28T20:41:03.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/.snap/snap-subdir-test 2023-11-28T20:41:03.709 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/30 file after the snapshot 2023-11-28T20:41:03.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/31 file after the snapshot 2023-11-28T20:41:03.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/32 file after the snapshot 2023-11-28T20:41:03.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/33 file after the snapshot 2023-11-28T20:41:03.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/34 file after the snapshot 2023-11-28T20:41:03.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/35 file after the snapshot 2023-11-28T20:41:03.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/36 file after the snapshot 2023-11-28T20:41:03.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/37 file after the snapshot 2023-11-28T20:41:03.713 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/38 file after the snapshot 2023-11-28T20:41:03.713 INFO:tasks.workunit.client.0.smithi167.stdout: create 160/39 file after the snapshot 2023-11-28T20:41:03.713 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/.snap/snap-subdir-test 2023-11-28T20:41:03.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/30 file after the snapshot 2023-11-28T20:41:03.769 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/31 file after the snapshot 2023-11-28T20:41:03.769 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/32 file after the snapshot 2023-11-28T20:41:03.769 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/33 file after the snapshot 2023-11-28T20:41:03.769 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/34 file after the snapshot 2023-11-28T20:41:03.769 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/35 file after the snapshot 2023-11-28T20:41:03.769 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/36 file after the snapshot 2023-11-28T20:41:03.770 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/37 file after the snapshot 2023-11-28T20:41:03.770 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/38 file after the snapshot 2023-11-28T20:41:03.770 INFO:tasks.workunit.client.0.smithi167.stdout: create 161/39 file after the snapshot 2023-11-28T20:41:03.770 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/.snap/snap-subdir-test 2023-11-28T20:41:04.361 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/30 file after the snapshot 2023-11-28T20:41:04.364 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/31 file after the snapshot 2023-11-28T20:41:04.364 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/32 file after the snapshot 2023-11-28T20:41:04.364 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/33 file after the snapshot 2023-11-28T20:41:04.364 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/34 file after the snapshot 2023-11-28T20:41:04.364 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/35 file after the snapshot 2023-11-28T20:41:04.364 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/36 file after the snapshot 2023-11-28T20:41:04.364 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/37 file after the snapshot 2023-11-28T20:41:04.364 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/38 file after the snapshot 2023-11-28T20:41:04.364 INFO:tasks.workunit.client.0.smithi167.stdout: create 162/39 file after the snapshot 2023-11-28T20:41:04.365 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/.snap/snap-subdir-test 2023-11-28T20:41:04.541 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:41:04.542 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:41:04.660 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/30 file after the snapshot 2023-11-28T20:41:04.663 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/31 file after the snapshot 2023-11-28T20:41:04.663 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/32 file after the snapshot 2023-11-28T20:41:04.663 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/33 file after the snapshot 2023-11-28T20:41:04.663 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/34 file after the snapshot 2023-11-28T20:41:04.663 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/35 file after the snapshot 2023-11-28T20:41:04.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/36 file after the snapshot 2023-11-28T20:41:04.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/37 file after the snapshot 2023-11-28T20:41:04.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/38 file after the snapshot 2023-11-28T20:41:04.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 163/39 file after the snapshot 2023-11-28T20:41:04.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/.snap/snap-subdir-test 2023-11-28T20:41:04.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26af417640 1 Processor -- start 2023-11-28T20:41:04.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26af417640 1 -- start start 2023-11-28T20:41:04.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26af417640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f26a815e130 0x7f26a8161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:04.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26af417640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a815e5e0 con 0x7f26a80c7720 2023-11-28T20:41:04.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26af417640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a815e8c0 con 0x7f26a81585d0 2023-11-28T20:41:04.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26af417640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a815f160 con 0x7f26a815e130 2023-11-28T20:41:04.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26ad9b4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f26a80c7720 0x7f26a806a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35954/0 (socket says 172.21.15.167:35954) 2023-11-28T20:41:04.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26ad9b4640 1 -- 172.21.15.167:0/665960538 learned_addr learned my addr 172.21.15.167:0/665960538 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:41:04.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26ac9b2640 1 --2- 172.21.15.167:0/665960538 >> v2:172.21.15.178:3300/0 conn(0x7f26a815e130 0x7f26a8161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:04.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754685916 0 0) 0x7f26a815e5e0 con 0x7f26a80c7720 2023-11-28T20:41:04.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2694003530 con 0x7f26a80c7720 2023-11-28T20:41:04.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058725027 0 0) 0x7f26a815e8c0 con 0x7f26a81585d0 2023-11-28T20:41:04.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a815e5e0 con 0x7f26a81585d0 2023-11-28T20:41:04.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3145359127 0 0) 0x7f2694003530 con 0x7f26a80c7720 2023-11-28T20:41:04.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 >> v2:172.21.15.178:3300/0 conn(0x7f26a815e130 msgr2=0x7f26a8161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:41:04.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 --2- 172.21.15.167:0/665960538 >> v2:172.21.15.178:3300/0 conn(0x7f26a815e130 0x7f26a8161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 >> v1:172.21.15.178:6789/0 conn(0x7f26a81585d0 legacy=0x7f26a80c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:04.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a815eba0 con 0x7f26a80c7720 2023-11-28T20:41:04.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f26a0001a00 con 0x7f26a80c7720 2023-11-28T20:41:04.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 >> v1:172.21.15.167:6789/0 conn(0x7f26a80c7720 legacy=0x7f26a806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:04.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2694003b60 0x7f2694003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:04.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26940047d0 0x7f2694004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:04.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f269400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:04.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a815f160 con 0x7f2694005190 2023-11-28T20:41:04.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269400c060 con 0x7f26940047d0 2023-11-28T20:41:04.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269400c220 con 0x7f2694003b60 2023-11-28T20:41:04.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.687+0000 7f26ad9b4640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f269400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:04.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ac9b2640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26940047d0 0x7f2694004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:04.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ad1b3640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2694003b60 0x7f2694003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:04.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ad9b4640 1 -- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2694003b60 msgr2=0x7f2694003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:41:04.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ad9b4640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2694003b60 0x7f2694003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ad9b4640 1 -- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26940047d0 msgr2=0x7f2694004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:41:04.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ad9b4640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26940047d0 0x7f2694004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ad9b4640 1 -- 172.21.15.167:0/665960538 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2694003530 con 0x7f2694005190 2023-11-28T20:41:04.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ad1b3640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2694003b60 0x7f2694003f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:41:04.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ac9b2640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26940047d0 0x7f2694004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:41:04.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ad9b4640 1 -- 172.21.15.167:0/665960538 reap_dead start 2023-11-28T20:41:04.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f26ad9b4640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f269400b990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f26a000a710 tx=0x7f26a001f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2172addd5af45a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:04.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a00b0070 con 0x7f2694005190 2023-11-28T20:41:04.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a00ac410 con 0x7f2694005190 2023-11-28T20:41:04.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.691+0000 7f269ffff640 1 -- 172.21.15.167:0/665960538 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a00ac7c0 con 0x7f2694005190 2023-11-28T20:41:04.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 -- 172.21.15.167:0/665960538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 msgr2=0x7f269400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:04.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f269400b990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f26a000a710 tx=0x7f26a001f960 comp rx=0 tx=0).stop 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 -- 172.21.15.167:0/665960538 shutdown_connections 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 --2- 172.21.15.167:0/665960538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f269400b990 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 -- 172.21.15.167:0/665960538 >> 172.21.15.167:0/665960538 conn(0x7f26a80cb1e0 msgr2=0x7f26a80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 -- 172.21.15.167:0/665960538 shutdown_connections 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 -- 172.21.15.167:0/665960538 wait complete. 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 Processor -- start 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 -- start start 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f26a8157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26a80c7ed0 0x7f26a81f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26a80c8310 0x7f26a814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:04.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80c9880 con 0x7f2694005190 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80ca120 con 0x7f26a80c7ed0 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26af417640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a81e8bf0 con 0x7f26a80c8310 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ad1b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f26a8157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ad1b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f26a8157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59664/0 (socket says 172.21.15.167:59664) 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ad1b3640 1 -- 172.21.15.167:0/2853177802 learned_addr learned my addr 172.21.15.167:0/2853177802 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ac9b2640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26a80c7ed0 0x7f26a81f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ad9b4640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26a80c8310 0x7f26a814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ad1b3640 1 -- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26a80c8310 msgr2=0x7f26a814a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ad1b3640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26a80c8310 0x7f26a814a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ad1b3640 1 -- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26a80c7ed0 msgr2=0x7f26a81f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:04.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ad1b3640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26a80c7ed0 0x7f26a81f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ad1b3640 1 -- 172.21.15.167:0/2853177802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a8157900 con 0x7f2694005190 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.695+0000 7f26ac9b2640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26a80c7ed0 0x7f26a81f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f26ad1b3640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f26a8157300 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f26a400e780 tx=0x7f26a400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f269dffb640 1 -- 172.21.15.167:0/2853177802 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4017070 con 0x7f2694005190 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f269dffb640 1 -- 172.21.15.167:0/2853177802 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a40050d0 con 0x7f2694005190 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f269dffb640 1 -- 172.21.15.167:0/2853177802 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4005240 con 0x7f2694005190 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a8157be0 con 0x7f2694005190 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a80c9db0 con 0x7f2694005190 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a80682c0 con 0x7f2694005190 2023-11-28T20:41:04.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f269dffb640 1 -- 172.21.15.167:0/2853177802 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26a4007020 con 0x7f2694005190 2023-11-28T20:41:04.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f269dffb640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f268c0664a0 0x7f268c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:04.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f269dffb640 1 -- 172.21.15.167:0/2853177802 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f26a4083a80 con 0x7f2694005190 2023-11-28T20:41:04.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.699+0000 7f26ac9b2640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f268c0664a0 0x7f268c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:04.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.703+0000 7f26ac9b2640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f268c0664a0 0x7f268c068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f26a81f1260 tx=0x7f2698008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:04.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.703+0000 7f269dffb640 1 -- 172.21.15.167:0/2853177802 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26a4050b10 con 0x7f2694005190 2023-11-28T20:41:04.721 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/30 file after the snapshot 2023-11-28T20:41:04.724 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/31 file after the snapshot 2023-11-28T20:41:04.724 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/32 file after the snapshot 2023-11-28T20:41:04.724 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/33 file after the snapshot 2023-11-28T20:41:04.724 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/34 file after the snapshot 2023-11-28T20:41:04.724 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/35 file after the snapshot 2023-11-28T20:41:04.725 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/36 file after the snapshot 2023-11-28T20:41:04.725 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/37 file after the snapshot 2023-11-28T20:41:04.725 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/38 file after the snapshot 2023-11-28T20:41:04.725 INFO:tasks.workunit.client.0.smithi167.stdout: create 164/39 file after the snapshot 2023-11-28T20:41:04.725 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/.snap/snap-subdir-test 2023-11-28T20:41:04.783 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/30 file after the snapshot 2023-11-28T20:41:04.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/31 file after the snapshot 2023-11-28T20:41:04.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/32 file after the snapshot 2023-11-28T20:41:04.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/33 file after the snapshot 2023-11-28T20:41:04.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/34 file after the snapshot 2023-11-28T20:41:04.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/35 file after the snapshot 2023-11-28T20:41:04.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/36 file after the snapshot 2023-11-28T20:41:04.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/37 file after the snapshot 2023-11-28T20:41:04.787 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/38 file after the snapshot 2023-11-28T20:41:04.787 INFO:tasks.workunit.client.0.smithi167.stdout: create 165/39 file after the snapshot 2023-11-28T20:41:04.787 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/.snap/snap-subdir-test 2023-11-28T20:41:04.819 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/30 file after the snapshot 2023-11-28T20:41:04.821 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/31 file after the snapshot 2023-11-28T20:41:04.821 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/32 file after the snapshot 2023-11-28T20:41:04.821 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/33 file after the snapshot 2023-11-28T20:41:04.821 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/34 file after the snapshot 2023-11-28T20:41:04.821 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/35 file after the snapshot 2023-11-28T20:41:04.821 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/36 file after the snapshot 2023-11-28T20:41:04.822 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/37 file after the snapshot 2023-11-28T20:41:04.822 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/38 file after the snapshot 2023-11-28T20:41:04.822 INFO:tasks.workunit.client.0.smithi167.stdout: create 166/39 file after the snapshot 2023-11-28T20:41:04.822 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/.snap/snap-subdir-test 2023-11-28T20:41:04.860 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/30 file after the snapshot 2023-11-28T20:41:04.861 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/31 file after the snapshot 2023-11-28T20:41:04.861 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/32 file after the snapshot 2023-11-28T20:41:04.862 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/33 file after the snapshot 2023-11-28T20:41:04.862 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/34 file after the snapshot 2023-11-28T20:41:04.862 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/35 file after the snapshot 2023-11-28T20:41:04.862 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/36 file after the snapshot 2023-11-28T20:41:04.862 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/37 file after the snapshot 2023-11-28T20:41:04.862 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/38 file after the snapshot 2023-11-28T20:41:04.862 INFO:tasks.workunit.client.0.smithi167.stdout: create 167/39 file after the snapshot 2023-11-28T20:41:04.862 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/.snap/snap-subdir-test 2023-11-28T20:41:04.906 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/30 file after the snapshot 2023-11-28T20:41:04.909 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/31 file after the snapshot 2023-11-28T20:41:04.909 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/32 file after the snapshot 2023-11-28T20:41:04.910 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/33 file after the snapshot 2023-11-28T20:41:04.910 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/34 file after the snapshot 2023-11-28T20:41:04.910 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/35 file after the snapshot 2023-11-28T20:41:04.910 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/36 file after the snapshot 2023-11-28T20:41:04.910 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/37 file after the snapshot 2023-11-28T20:41:04.910 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/38 file after the snapshot 2023-11-28T20:41:04.910 INFO:tasks.workunit.client.0.smithi167.stdout: create 168/39 file after the snapshot 2023-11-28T20:41:04.910 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/.snap/snap-subdir-test 2023-11-28T20:41:04.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.915+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f26a8075c90 con 0x7f2694005190 2023-11-28T20:41:04.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.915+0000 7f269dffb640 1 -- 172.21.15.167:0/2853177802 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f26a401b370 con 0x7f2694005190 2023-11-28T20:41:04.916 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":24,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:41:04.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f268c0664a0 msgr2=0x7f268c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:04.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f268c0664a0 0x7f268c068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f26a81f1260 tx=0x7f2698008040 comp rx=0 tx=0).stop 2023-11-28T20:41:04.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 msgr2=0x7f26a8157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:04.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f26a8157300 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f26a400e780 tx=0x7f26a400ec40 comp rx=0 tx=0).stop 2023-11-28T20:41:04.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 shutdown_connections 2023-11-28T20:41:04.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f268c0664a0 0x7f268c068960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26a80c8310 0x7f26a814a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26a80c7ed0 0x7f26a81f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 --2- 172.21.15.167:0/2853177802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2694005190 0x7f26a8157300 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:04.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 >> 172.21.15.167:0/2853177802 conn(0x7f26a80cb1e0 msgr2=0x7f26a814af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:04.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 shutdown_connections 2023-11-28T20:41:04.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:04.919+0000 7f26af417640 1 -- 172.21.15.167:0/2853177802 wait complete. 2023-11-28T20:41:04.937 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:41:04.937 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:41:04.937 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:41:04.937 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:41:04.966 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/30 file after the snapshot 2023-11-28T20:41:04.969 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/31 file after the snapshot 2023-11-28T20:41:04.969 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/32 file after the snapshot 2023-11-28T20:41:04.969 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/33 file after the snapshot 2023-11-28T20:41:04.969 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/34 file after the snapshot 2023-11-28T20:41:04.969 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/35 file after the snapshot 2023-11-28T20:41:04.969 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/36 file after the snapshot 2023-11-28T20:41:04.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/37 file after the snapshot 2023-11-28T20:41:04.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/38 file after the snapshot 2023-11-28T20:41:04.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 169/39 file after the snapshot 2023-11-28T20:41:04.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/.snap/snap-subdir-test 2023-11-28T20:41:05.004 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/30 file after the snapshot 2023-11-28T20:41:05.006 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/31 file after the snapshot 2023-11-28T20:41:05.006 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/32 file after the snapshot 2023-11-28T20:41:05.006 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/33 file after the snapshot 2023-11-28T20:41:05.006 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/34 file after the snapshot 2023-11-28T20:41:05.006 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/35 file after the snapshot 2023-11-28T20:41:05.006 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/36 file after the snapshot 2023-11-28T20:41:05.006 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/37 file after the snapshot 2023-11-28T20:41:05.006 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/38 file after the snapshot 2023-11-28T20:41:05.006 INFO:tasks.workunit.client.0.smithi167.stdout: create 170/39 file after the snapshot 2023-11-28T20:41:05.007 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/.snap/snap-subdir-test 2023-11-28T20:41:05.046 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/30 file after the snapshot 2023-11-28T20:41:05.049 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/31 file after the snapshot 2023-11-28T20:41:05.049 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/32 file after the snapshot 2023-11-28T20:41:05.049 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/33 file after the snapshot 2023-11-28T20:41:05.049 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/34 file after the snapshot 2023-11-28T20:41:05.050 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/35 file after the snapshot 2023-11-28T20:41:05.050 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/36 file after the snapshot 2023-11-28T20:41:05.050 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/37 file after the snapshot 2023-11-28T20:41:05.050 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/38 file after the snapshot 2023-11-28T20:41:05.050 INFO:tasks.workunit.client.0.smithi167.stdout: create 171/39 file after the snapshot 2023-11-28T20:41:05.050 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/.snap/snap-subdir-test 2023-11-28T20:41:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.083+0000 7f667f59e640 1 Processor -- start 2023-11-28T20:41:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.083+0000 7f667f59e640 1 -- start start 2023-11-28T20:41:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667f59e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66800c4d60 0x7f668006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667f59e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c7a50 0x7f6680151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667f59e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66800c5df0 con 0x7f66800c5140 2023-11-28T20:41:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667f59e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668006e460 con 0x7f66800c4d60 2023-11-28T20:41:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667f59e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668006ed40 con 0x7f66800c7a50 2023-11-28T20:41:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667e59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66800c4d60 0x7f668006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667dd9b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c7a50 0x7f6680151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667ed9d640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f66800c5140 0x7f668015b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:40238/0 (socket says 172.21.15.167:40238) 2023-11-28T20:41:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667e59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66800c4d60 0x7f668006e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:46450/0 (socket says 172.21.15.167:46450) 2023-11-28T20:41:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667ed9d640 1 -- 172.21.15.167:0/3817512792 learned_addr learned my addr 172.21.15.167:0/3817512792 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:41:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667dd9b640 1 -- 172.21.15.167:0/3817512792 >> v2:172.21.15.178:3300/0 conn(0x7f66800c4d60 msgr2=0x7f668006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:41:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667dd9b640 1 --2- 172.21.15.167:0/3817512792 >> v2:172.21.15.178:3300/0 conn(0x7f66800c4d60 0x7f668006e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667dd9b640 1 -- 172.21.15.167:0/3817512792 >> v1:172.21.15.178:6789/0 conn(0x7f66800c5140 legacy=0x7f668015b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.087+0000 7f667dd9b640 1 -- 172.21.15.167:0/3817512792 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668006d970 con 0x7f66800c7a50 2023-11-28T20:41:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667dd9b640 1 --2- 172.21.15.167:0/3817512792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c7a50 0x7f6680151820 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f66740097c0 tx=0x7f667401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8599c7f9cfcacf34 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667d59a640 1 -- 172.21.15.167:0/3817512792 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740ab600 con 0x7f66800c7a50 2023-11-28T20:41:05.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667d59a640 1 -- 172.21.15.167:0/3817512792 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66740a7050 con 0x7f66800c7a50 2023-11-28T20:41:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667d59a640 1 -- 172.21.15.167:0/3817512792 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740ab980 con 0x7f66800c7a50 2023-11-28T20:41:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 -- 172.21.15.167:0/3817512792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c7a50 msgr2=0x7f6680151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 --2- 172.21.15.167:0/3817512792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c7a50 0x7f6680151820 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f66740097c0 tx=0x7f667401c480 comp rx=0 tx=0).stop 2023-11-28T20:41:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 -- 172.21.15.167:0/3817512792 shutdown_connections 2023-11-28T20:41:05.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 --2- 172.21.15.167:0/3817512792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c7a50 0x7f6680151820 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 --2- 172.21.15.167:0/3817512792 >> v2:172.21.15.178:3300/0 conn(0x7f66800c4d60 0x7f668006e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 -- 172.21.15.167:0/3817512792 >> 172.21.15.167:0/3817512792 conn(0x7f66800cb3f0 msgr2=0x7f66800cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:05.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 -- 172.21.15.167:0/3817512792 shutdown_connections 2023-11-28T20:41:05.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 -- 172.21.15.167:0/3817512792 wait complete. 2023-11-28T20:41:05.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 Processor -- start 2023-11-28T20:41:05.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.091+0000 7f667f59e640 1 -- start start 2023-11-28T20:41:05.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66800c4d60 0x7f6680137f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c5140 0x7f66801440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66800c7a50 0x7f66801f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680158d60 con 0x7f66800c7a50 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680143c40 con 0x7f66800c4d60 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6680159a20 con 0x7f66800c5140 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66800c7a50 0x7f66801f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66800c7a50 0x7f66801f6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59672/0 (socket says 172.21.15.167:59672) 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667ed9d640 1 -- 172.21.15.167:0/4018290489 learned_addr learned my addr 172.21.15.167:0/4018290489 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667e59c640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66800c4d60 0x7f6680137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667dd9b640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c5140 0x7f66801440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667ed9d640 1 -- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c5140 msgr2=0x7f66801440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667ed9d640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800c5140 0x7f66801440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667ed9d640 1 -- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66800c4d60 msgr2=0x7f6680137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667ed9d640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66800c4d60 0x7f6680137f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667ed9d640 1 -- 172.21.15.167:0/4018290489 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674009420 con 0x7f66800c7a50 2023-11-28T20:41:05.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667ed9d640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66800c7a50 0x7f66801f6490 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f667800cbc0 tx=0x7f667800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800ad40 con 0x7f66800c7a50 2023-11-28T20:41:05.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678012400 con 0x7f66800c7a50 2023-11-28T20:41:05.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800aea0 con 0x7f66800c7a50 2023-11-28T20:41:05.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6680159460 con 0x7f66800c7a50 2023-11-28T20:41:05.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66801438d0 con 0x7f66800c7a50 2023-11-28T20:41:05.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680159c70 0x7f66801f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680074740 con 0x7f6680159c70 2023-11-28T20:41:05.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667e59c640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680159c70 0x7f66801f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667e59c640 1 -- 172.21.15.167:0/4018290489 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f668006e040 con 0x7f6680159c70 2023-11-28T20:41:05.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f667e59c640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680159c70 0x7f66801f69d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6670011900 tx=0x7f6670011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.095+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670004300 con 0x7f6680159c70 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6678007070 con 0x7f66800c7a50 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f666effd640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6660066510 0x7f66600689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f66780841d0 con 0x7f66800c7a50 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6670004460 con 0x7f6680159c70 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680159c70 msgr2=0x7f66801f69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f666effd640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680159c70 0x7f66801f69d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6670011900 tx=0x7f6670011dc0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680159c70 msgr2=0x7f66801f69d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f666effd640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680159c70 0x7f66801f69d0 secure :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6670011900 tx=0x7f6670011dc0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f667dd9b640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6660066510 0x7f66600689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.099+0000 7f667dd9b640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6660066510 0x7f66600689d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66740097c0 tx=0x7f6674008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.104 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/30 file after the snapshot 2023-11-28T20:41:05.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.103+0000 7f667f59e640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680151d60 0x7f66801f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.103+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680143ac0 con 0x7f6680151d60 2023-11-28T20:41:05.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667e59c640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680151d60 0x7f66801f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667e59c640 1 -- 172.21.15.167:0/4018290489 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6680067c40 con 0x7f6680151d60 2023-11-28T20:41:05.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667e59c640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680151d60 0x7f66801f2f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6670011900 tx=0x7f66700046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667001e450 con 0x7f6680151d60 2023-11-28T20:41:05.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4982 (secure 0 0 0) 0x7f66700133a0 con 0x7f6680151d60 2023-11-28T20:41:05.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680151d60 msgr2=0x7f66801f2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f666effd640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680151d60 0x7f66801f2f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6670011900 tx=0x7f66700046d0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f666effd640 1 -- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680151d60 msgr2=0x7f66801f2f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:05.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f666effd640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6680151d60 0x7f66801f2f20 secure :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6670011900 tx=0x7f66700046d0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.107 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 24, 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.108 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 15, 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:05.109 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:05.110 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:41:05.111 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:41:05.112 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.113 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:41:05.114 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:41:05.115 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:05.116 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:41:05.117 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:05.118 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:41:05.119 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:41:05.120 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.121 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:41:05.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.123 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.123 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.123 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:41:05.123 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.123 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.123 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:41:05.123 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:41:05.123 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/31 file after the snapshot 2023-11-28T20:41:05.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6660066510 msgr2=0x7f66600689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667f59e640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6660066510 0x7f66600689d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66740097c0 tx=0x7f6674008040 comp rx=0 tx=0).stop 2023-11-28T20:41:05.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66800c7a50 msgr2=0x7f66801f6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667f59e640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66800c7a50 0x7f66801f6490 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f667800cbc0 tx=0x7f667800a430 comp rx=0 tx=0).stop 2023-11-28T20:41:05.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667ed9d640 1 -- 172.21.15.167:0/4018290489 reap_dead start 2023-11-28T20:41:05.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 shutdown_connections 2023-11-28T20:41:05.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667f59e640 1 --2- 172.21.15.167:0/4018290489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66800c7a50 0x7f66801f6490 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 >> 172.21.15.167:0/4018290489 conn(0x7f66800cb3f0 msgr2=0x7f668015b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:05.125 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/32 file after the snapshot 2023-11-28T20:41:05.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 shutdown_connections 2023-11-28T20:41:05.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.107+0000 7f667f59e640 1 -- 172.21.15.167:0/4018290489 wait complete. 2023-11-28T20:41:05.126 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/33 file after the snapshot 2023-11-28T20:41:05.127 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/34 file after the snapshot 2023-11-28T20:41:05.127 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/35 file after the snapshot 2023-11-28T20:41:05.127 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/36 file after the snapshot 2023-11-28T20:41:05.127 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/37 file after the snapshot 2023-11-28T20:41:05.127 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/38 file after the snapshot 2023-11-28T20:41:05.127 INFO:tasks.workunit.client.0.smithi167.stdout: create 172/39 file after the snapshot 2023-11-28T20:41:05.127 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/.snap/snap-subdir-test 2023-11-28T20:41:05.128 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:41:05.128 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:41:05.128 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:41:05.170 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/30 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/31 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/32 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/33 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/34 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/35 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/36 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/37 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/38 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 173/39 file after the snapshot 2023-11-28T20:41:05.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/.snap/snap-subdir-test 2023-11-28T20:41:05.197 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/30 file after the snapshot 2023-11-28T20:41:05.198 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/31 file after the snapshot 2023-11-28T20:41:05.199 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/32 file after the snapshot 2023-11-28T20:41:05.199 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/33 file after the snapshot 2023-11-28T20:41:05.199 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/34 file after the snapshot 2023-11-28T20:41:05.199 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/35 file after the snapshot 2023-11-28T20:41:05.199 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/36 file after the snapshot 2023-11-28T20:41:05.199 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/37 file after the snapshot 2023-11-28T20:41:05.199 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/38 file after the snapshot 2023-11-28T20:41:05.199 INFO:tasks.workunit.client.0.smithi167.stdout: create 174/39 file after the snapshot 2023-11-28T20:41:05.199 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/.snap/snap-subdir-test 2023-11-28T20:41:05.230 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/30 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/31 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/32 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/33 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/34 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/35 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/36 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/37 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/38 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 175/39 file after the snapshot 2023-11-28T20:41:05.233 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/.snap/snap-subdir-test 2023-11-28T20:41:05.290 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/30 file after the snapshot 2023-11-28T20:41:05.293 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/31 file after the snapshot 2023-11-28T20:41:05.293 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/32 file after the snapshot 2023-11-28T20:41:05.293 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/33 file after the snapshot 2023-11-28T20:41:05.293 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/34 file after the snapshot 2023-11-28T20:41:05.293 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/35 file after the snapshot 2023-11-28T20:41:05.293 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/36 file after the snapshot 2023-11-28T20:41:05.293 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/37 file after the snapshot 2023-11-28T20:41:05.294 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/38 file after the snapshot 2023-11-28T20:41:05.294 INFO:tasks.workunit.client.0.smithi167.stdout: create 176/39 file after the snapshot 2023-11-28T20:41:05.294 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/.snap/snap-subdir-test 2023-11-28T20:41:05.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.314+0000 7f1f0fc5f640 1 Processor -- start 2023-11-28T20:41:05.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.314+0000 7f1f0fc5f640 1 -- start start 2023-11-28T20:41:05.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.314+0000 7f1f0fc5f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f08150b40 0x7f1f08157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.314+0000 7f1f0fc5f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1f080c4510 0x7f1f0806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.314+0000 7f1f0fc5f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f080c48f0 con 0x7f1f080c6ff0 2023-11-28T20:41:05.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0fc5f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080c62f0 con 0x7f1f08150b40 2023-11-28T20:41:05.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0fc5f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080c6ac0 con 0x7f1f080c4510 2023-11-28T20:41:05.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0d9fb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f08150b40 0x7f1f08157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0d9fb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f08150b40 0x7f1f08157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59698/0 (socket says 172.21.15.167:59698) 2023-11-28T20:41:05.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0d9fb640 1 -- 172.21.15.167:0/679880129 learned_addr learned my addr 172.21.15.167:0/679880129 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:05.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0e1fc640 1 --2- 172.21.15.167:0/679880129 >> v2:172.21.15.178:3300/0 conn(0x7f1f080c4510 0x7f1f0806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0d9fb640 1 -- 172.21.15.167:0/679880129 >> v2:172.21.15.178:3300/0 conn(0x7f1f080c4510 msgr2=0x7f1f0806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:41:05.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0d9fb640 1 --2- 172.21.15.167:0/679880129 >> v2:172.21.15.178:3300/0 conn(0x7f1f080c4510 0x7f1f0806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0d9fb640 1 -- 172.21.15.167:0/679880129 >> v1:172.21.15.178:6789/0 conn(0x7f1f080c6ff0 legacy=0x7f1f080c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0d9fb640 1 -- 172.21.15.167:0/679880129 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080c6500 con 0x7f1f08150b40 2023-11-28T20:41:05.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0d9fb640 1 --2- 172.21.15.167:0/679880129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 0x7f1f08157560 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1f080cc270 tx=0x7f1f0401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136d56c391017497 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0c9f9640 1 -- 172.21.15.167:0/679880129 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040ac640 con 0x7f1f08150b40 2023-11-28T20:41:05.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0c9f9640 1 -- 172.21.15.167:0/679880129 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f040ac7a0 con 0x7f1f08150b40 2023-11-28T20:41:05.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.318+0000 7f1f0c9f9640 1 -- 172.21.15.167:0/679880129 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040acb30 con 0x7f1f08150b40 2023-11-28T20:41:05.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/679880129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 msgr2=0x7f1f08157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 --2- 172.21.15.167:0/679880129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 0x7f1f08157560 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1f080cc270 tx=0x7f1f0401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/679880129 shutdown_connections 2023-11-28T20:41:05.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 --2- 172.21.15.167:0/679880129 >> v2:172.21.15.178:3300/0 conn(0x7f1f080c4510 0x7f1f0806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 --2- 172.21.15.167:0/679880129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 0x7f1f08157560 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/679880129 >> 172.21.15.167:0/679880129 conn(0x7f1f080cb1e0 msgr2=0x7f1f080cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:05.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/679880129 shutdown_connections 2023-11-28T20:41:05.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/679880129 wait complete. 2023-11-28T20:41:05.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 Processor -- start 2023-11-28T20:41:05.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 -- start start 2023-11-28T20:41:05.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f080c4510 0x7f1f08148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f080c6ff0 0x7f1f081522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 0x7f1f08152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08152d40 con 0x7f1f08150b40 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f081501f0 con 0x7f1f080c4510 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0fc5f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08151fc0 con 0x7f1f080c6ff0 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0e1fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 0x7f1f08152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0e1fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 0x7f1f08152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59714/0 (socket says 172.21.15.167:59714) 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0e1fc640 1 -- 172.21.15.167:0/3362942212 learned_addr learned my addr 172.21.15.167:0/3362942212 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0d9fb640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f080c4510 0x7f1f08148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.322+0000 7f1f0d1fa640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f080c6ff0 0x7f1f081522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0e1fc640 1 -- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f080c6ff0 msgr2=0x7f1f081522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0e1fc640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f080c6ff0 0x7f1f081522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0e1fc640 1 -- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f080c4510 msgr2=0x7f1f08148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0e1fc640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f080c4510 0x7f1f08148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0e1fc640 1 -- 172.21.15.167:0/3362942212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f040094d0 con 0x7f1f08150b40 2023-11-28T20:41:05.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0e1fc640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 0x7f1f08152800 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000efc0 tx=0x7f1f0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00014480 con 0x7f1f08150b40 2023-11-28T20:41:05.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0000f040 con 0x7f1f08150b40 2023-11-28T20:41:05.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00014820 con 0x7f1f08150b40 2023-11-28T20:41:05.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f08154670 con 0x7f1f08150b40 2023-11-28T20:41:05.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0814f8c0 con 0x7f1f08150b40 2023-11-28T20:41:05.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0fc5f640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081477a0 0x7f1f0814fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08074770 con 0x7f1f081477a0 2023-11-28T20:41:05.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0d9fb640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081477a0 0x7f1f0814fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0d9fb640 1 -- 172.21.15.167:0/3362942212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f08157040 con 0x7f1f081477a0 2023-11-28T20:41:05.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f00014980 con 0x7f1f08150b40 2023-11-28T20:41:05.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.326+0000 7f1f0d9fb640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081477a0 0x7f1f0814fae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f0806bba0 tx=0x7f1f04019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1efe7fc640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1eec066470 0x7f1eec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1f000850e0 con 0x7f1f08150b40 2023-11-28T20:41:05.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040b6670 con 0x7f1f081477a0 2023-11-28T20:41:05.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1f040b67d0 con 0x7f1f081477a0 2023-11-28T20:41:05.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081477a0 msgr2=0x7f1f0814fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1efe7fc640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081477a0 0x7f1f0814fae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1f0806bba0 tx=0x7f1f04019270 comp rx=0 tx=0).stop 2023-11-28T20:41:05.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1f0d1fa640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1eec066470 0x7f1eec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081477a0 msgr2=0x7f1f0814fae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:05.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1efe7fc640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081477a0 0x7f1f0814fae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.330+0000 7f1f0d1fa640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1eec066470 0x7f1eec068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f08147ff0 tx=0x7f1ef8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.334+0000 7f1f0fc5f640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081540a0 0x7f1f08145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.334+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080682c0 con 0x7f1f081540a0 2023-11-28T20:41:05.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.334+0000 7f1f0d9fb640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081540a0 0x7f1f08145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.334+0000 7f1f0d9fb640 1 -- 172.21.15.167:0/3362942212 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1f081503a0 con 0x7f1f081540a0 2023-11-28T20:41:05.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0d9fb640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081540a0 0x7f1f08145e60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f040190e0 tx=0x7f1f04009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040abe20 con 0x7f1f081540a0 2023-11-28T20:41:05.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4953 (secure 0 0 0) 0x7f1f04004020 con 0x7f1f081540a0 2023-11-28T20:41:05.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081540a0 msgr2=0x7f1f08145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1efe7fc640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081540a0 0x7f1f08145e60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f040190e0 tx=0x7f1f04009240 comp rx=0 tx=0).stop 2023-11-28T20:41:05.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1efe7fc640 1 -- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081540a0 msgr2=0x7f1f08145e60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:05.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1efe7fc640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f081540a0 0x7f1f08145e60 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f040190e0 tx=0x7f1f04009240 comp rx=0 tx=0).stop 2023-11-28T20:41:05.339 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:41:05.339 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:41:05.339 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:41:05.339 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:41:05.339 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 24, 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 15, 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:05.340 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:05.341 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:41:05.342 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:41:05.343 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:05.344 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.345 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:41:05.346 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:05.347 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:41:05.348 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:41:05.349 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:05.350 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.351 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:41:05.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:41:05.353 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.354 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.354 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:41:05.354 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1eec066470 msgr2=0x7f1eec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0fc5f640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1eec066470 0x7f1eec068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f08147ff0 tx=0x7f1ef8009040 comp rx=0 tx=0).stop 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 msgr2=0x7f1f08152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0fc5f640 1 --2- 172.21.15.167:0/3362942212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f08150b40 0x7f1f08152800 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000efc0 tx=0x7f1f0000c490 comp rx=0 tx=0).stop 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0e1fc640 1 -- 172.21.15.167:0/3362942212 reap_dead start 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0e1fc640 1 -- 172.21.15.167:0/3362942212 reap_dead start 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 shutdown_connections 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 >> 172.21.15.167:0/3362942212 conn(0x7f1f080cb1e0 msgr2=0x7f1f080cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 shutdown_connections 2023-11-28T20:41:05.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.338+0000 7f1f0fc5f640 1 -- 172.21.15.167:0/3362942212 wait complete. 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/30 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/31 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/32 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/33 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/34 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/35 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/36 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/37 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/38 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 177/39 file after the snapshot 2023-11-28T20:41:05.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/.snap/snap-subdir-test 2023-11-28T20:41:05.358 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:41:05.358 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:41:05.359 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:41:05.415 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/30 file after the snapshot 2023-11-28T20:41:05.418 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/31 file after the snapshot 2023-11-28T20:41:05.418 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/32 file after the snapshot 2023-11-28T20:41:05.418 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/33 file after the snapshot 2023-11-28T20:41:05.418 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/34 file after the snapshot 2023-11-28T20:41:05.419 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/35 file after the snapshot 2023-11-28T20:41:05.419 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/36 file after the snapshot 2023-11-28T20:41:05.419 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/37 file after the snapshot 2023-11-28T20:41:05.420 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/38 file after the snapshot 2023-11-28T20:41:05.420 INFO:tasks.workunit.client.0.smithi167.stdout: create 178/39 file after the snapshot 2023-11-28T20:41:05.420 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/.snap/snap-subdir-test 2023-11-28T20:41:05.474 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/30 file after the snapshot 2023-11-28T20:41:05.476 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/31 file after the snapshot 2023-11-28T20:41:05.476 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/32 file after the snapshot 2023-11-28T20:41:05.476 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/33 file after the snapshot 2023-11-28T20:41:05.476 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/34 file after the snapshot 2023-11-28T20:41:05.476 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/35 file after the snapshot 2023-11-28T20:41:05.477 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/36 file after the snapshot 2023-11-28T20:41:05.477 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/37 file after the snapshot 2023-11-28T20:41:05.477 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/38 file after the snapshot 2023-11-28T20:41:05.477 INFO:tasks.workunit.client.0.smithi167.stdout: create 179/39 file after the snapshot 2023-11-28T20:41:05.477 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/.snap/snap-subdir-test 2023-11-28T20:41:05.536 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/30 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/31 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/32 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/33 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/34 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/35 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/36 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/37 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/38 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 180/39 file after the snapshot 2023-11-28T20:41:05.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/.snap/snap-subdir-test 2023-11-28T20:41:05.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.546+0000 7fa2c269e640 1 Processor -- start 2023-11-28T20:41:05.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.546+0000 7fa2c269e640 1 -- start start 2023-11-28T20:41:05.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.546+0000 7fa2c269e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2bc0ca560 0x7fa2bc0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2c269e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc159e60 con 0x7fa2bc0c6d00 2023-11-28T20:41:05.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2c269e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc154410 con 0x7fa2bc0ca940 2023-11-28T20:41:05.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2c269e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc0c32f0 con 0x7fa2bc0ca560 2023-11-28T20:41:05.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2bbfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2bc0ca560 0x7fa2bc0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2bbfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2bc0ca560 0x7fa2bc0c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59716/0 (socket says 172.21.15.167:59716) 2023-11-28T20:41:05.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2bbfff640 1 -- 172.21.15.167:0/2708499845 learned_addr learned my addr 172.21.15.167:0/2708499845 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:05.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2c0c3b640 1 --1- 172.21.15.167:0/2708499845 >> v1:172.21.15.167:6789/0 conn(0x7fa2bc0c6d00 0x7fa2bc0c7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35964/0 (socket says 172.21.15.167:35964) 2023-11-28T20:41:05.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2bbfff640 1 -- 172.21.15.167:0/2708499845 >> v1:172.21.15.178:6789/0 conn(0x7fa2bc0ca940 legacy=0x7fa2bc0cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2bbfff640 1 -- 172.21.15.167:0/2708499845 >> v1:172.21.15.167:6789/0 conn(0x7fa2bc0c6d00 legacy=0x7fa2bc0c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.550+0000 7fa2bbfff640 1 -- 172.21.15.167:0/2708499845 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc15a100 con 0x7fa2bc0ca560 2023-11-28T20:41:05.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2bbfff640 1 --2- 172.21.15.167:0/2708499845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca560 0x7fa2bc0c97c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009870 tx=0x7fa2ac01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7192926cd58a9df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2baffd640 1 -- 172.21.15.167:0/2708499845 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0ac640 con 0x7fa2bc0ca560 2023-11-28T20:41:05.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2baffd640 1 -- 172.21.15.167:0/2708499845 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac0ac7a0 con 0x7fa2bc0ca560 2023-11-28T20:41:05.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2baffd640 1 -- 172.21.15.167:0/2708499845 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0acb30 con 0x7fa2bc0ca560 2023-11-28T20:41:05.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2c269e640 1 -- 172.21.15.167:0/2708499845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca560 msgr2=0x7fa2bc0c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2c269e640 1 --2- 172.21.15.167:0/2708499845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca560 0x7fa2bc0c97c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009870 tx=0x7fa2ac01c420 comp rx=0 tx=0).stop 2023-11-28T20:41:05.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2c269e640 1 -- 172.21.15.167:0/2708499845 shutdown_connections 2023-11-28T20:41:05.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2c269e640 1 --2- 172.21.15.167:0/2708499845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca560 0x7fa2bc0c97c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2c269e640 1 -- 172.21.15.167:0/2708499845 >> 172.21.15.167:0/2708499845 conn(0x7fa2bc06a580 msgr2=0x7fa2bc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:05.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2c269e640 1 -- 172.21.15.167:0/2708499845 shutdown_connections 2023-11-28T20:41:05.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2c269e640 1 -- 172.21.15.167:0/2708499845 wait complete. 2023-11-28T20:41:05.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2c269e640 1 Processor -- start 2023-11-28T20:41:05.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.554+0000 7fa2c269e640 1 -- start start 2023-11-28T20:41:05.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c269e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2bc0c6d00 0x7fa2bc145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c269e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0ca560 0x7fa2bc1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c269e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca940 0x7fa2bc158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c269e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc153190 con 0x7fa2bc0ca940 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c269e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc157d80 con 0x7fa2bc0c6d00 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c269e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc1f6d50 con 0x7fa2bc0ca560 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c0c3b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca940 0x7fa2bc158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c0c3b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca940 0x7fa2bc158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59720/0 (socket says 172.21.15.167:59720) 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c0c3b640 1 -- 172.21.15.167:0/1053060127 learned_addr learned my addr 172.21.15.167:0/1053060127 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2bbfff640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2bc0c6d00 0x7fa2bc145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2bb7fe640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0ca560 0x7fa2bc1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c0c3b640 1 -- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0ca560 msgr2=0x7fa2bc1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c0c3b640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0ca560 0x7fa2bc1584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c0c3b640 1 -- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2bc0c6d00 msgr2=0x7fa2bc145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c0c3b640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2bc0c6d00 0x7fa2bc145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c0c3b640 1 -- 172.21.15.167:0/1053060127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0094d0 con 0x7fa2bc0ca940 2023-11-28T20:41:05.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2c0c3b640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca940 0x7fa2bc158a20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400c700 tx=0x7fa2b400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.558+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400ce10 con 0x7fa2bc0ca940 2023-11-28T20:41:05.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc1f67f0 con 0x7fa2bc0ca940 2023-11-28T20:41:05.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b400a640 con 0x7fa2bc0ca940 2023-11-28T20:41:05.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400a9b0 con 0x7fa2bc0ca940 2023-11-28T20:41:05.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc159460 con 0x7fa2bc0ca940 2023-11-28T20:41:05.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2c269e640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc1534a0 0x7fa2bc142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc074700 con 0x7fa2bc1534a0 2023-11-28T20:41:05.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2bbfff640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc1534a0 0x7fa2bc142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2b400ab10 con 0x7fa2bc0ca940 2023-11-28T20:41:05.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2bbfff640 1 -- 172.21.15.167:0/1053060127 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2bc0cad50 con 0x7fa2bc1534a0 2023-11-28T20:41:05.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2bbfff640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc1534a0 0x7fa2bc142580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc157900 tx=0x7fa2ac01ac60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2b8ff9640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2a8066470 0x7fa2a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa2b4083a30 con 0x7fa2bc0ca940 2023-11-28T20:41:05.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.562+0000 7fa2bb7fe640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2a8066470 0x7fa2a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.566+0000 7fa2bb7fe640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2a8066470 0x7fa2a8068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc159b70 tx=0x7fa2b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.566+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0b8660 con 0x7fa2bc1534a0 2023-11-28T20:41:05.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.570+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa2ac0b87c0 con 0x7fa2bc1534a0 2023-11-28T20:41:05.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.570+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc1534a0 msgr2=0x7fa2bc142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.570+0000 7fa2b8ff9640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc1534a0 0x7fa2bc142580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc157900 tx=0x7fa2ac01ac60 comp rx=0 tx=0).stop 2023-11-28T20:41:05.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.570+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc1534a0 msgr2=0x7fa2bc142580 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:05.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.570+0000 7fa2b8ff9640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc1534a0 0x7fa2bc142580 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc157900 tx=0x7fa2ac01ac60 comp rx=0 tx=0).stop 2023-11-28T20:41:05.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.574+0000 7fa2c269e640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0c2710 0x7fa2bc142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:05.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.574+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0c9e50 con 0x7fa2bc0c2710 2023-11-28T20:41:05.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.574+0000 7fa2bbfff640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0c2710 0x7fa2bc142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:05.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2bbfff640 1 -- 172.21.15.167:0/1053060127 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa2bc153fd0 con 0x7fa2bc0c2710 2023-11-28T20:41:05.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2bbfff640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0c2710 0x7fa2bc142ac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac019030 tx=0x7fa2ac0191c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:05.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0c2c20 con 0x7fa2bc0c2710 2023-11-28T20:41:05.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7fa2ac0c2d80 con 0x7fa2bc0c2710 2023-11-28T20:41:05.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0c2710 msgr2=0x7fa2bc142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2b8ff9640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0c2710 0x7fa2bc142ac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac019030 tx=0x7fa2ac0191c0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2b8ff9640 1 -- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0c2710 msgr2=0x7fa2bc142ac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:05.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2b8ff9640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2bc0c2710 0x7fa2bc142ac0 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac019030 tx=0x7fa2ac0191c0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.579 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 24, 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 16, 2023-11-28T20:41:05.580 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:05.581 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:05.582 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:05.583 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:05.584 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:41:05.585 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.586 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:41:05.587 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.588 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:05.589 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.590 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:41:05.591 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:41:05.592 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:05.593 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:05.593 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:05.593 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:41:05.593 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:41:05.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2a8066470 msgr2=0x7fa2a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c269e640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2a8066470 0x7fa2a8068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc159b70 tx=0x7fa2b0009040 comp rx=0 tx=0).stop 2023-11-28T20:41:05.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca940 msgr2=0x7fa2bc158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:05.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c269e640 1 --2- 172.21.15.167:0/1053060127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2bc0ca940 0x7fa2bc158a20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400c700 tx=0x7fa2b400cbc0 comp rx=0 tx=0).stop 2023-11-28T20:41:05.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c0c3b640 1 -- 172.21.15.167:0/1053060127 reap_dead start 2023-11-28T20:41:05.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c0c3b640 1 -- 172.21.15.167:0/1053060127 reap_dead start 2023-11-28T20:41:05.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 shutdown_connections 2023-11-28T20:41:05.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 >> 172.21.15.167:0/1053060127 conn(0x7fa2bc06a580 msgr2=0x7fa2bc06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:05.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 shutdown_connections 2023-11-28T20:41:05.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:05.578+0000 7fa2c269e640 1 -- 172.21.15.167:0/1053060127 wait complete. 2023-11-28T20:41:05.598 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:41:05.599 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2023-11-28T20:41:05.599 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2023-11-28T20:41:05.599 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2023-11-28T20:41:05.599 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:41:05.599 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:41:05.599 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:41:05.614 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:41:05.614 INFO:tasks.mon_thrash:Sending STOP to mon b 2023-11-28T20:41:05.614 INFO:tasks.ceph.mon.b:Sent signal 19 2023-11-28T20:41:05.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2023-11-28T20:41:06.455 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/30 file after the snapshot 2023-11-28T20:41:06.480 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/31 file after the snapshot 2023-11-28T20:41:06.482 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/32 file after the snapshot 2023-11-28T20:41:06.482 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/33 file after the snapshot 2023-11-28T20:41:06.482 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/34 file after the snapshot 2023-11-28T20:41:06.482 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/35 file after the snapshot 2023-11-28T20:41:06.482 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/36 file after the snapshot 2023-11-28T20:41:06.483 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/37 file after the snapshot 2023-11-28T20:41:06.483 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/38 file after the snapshot 2023-11-28T20:41:06.483 INFO:tasks.workunit.client.0.smithi167.stdout: create 181/39 file after the snapshot 2023-11-28T20:41:06.483 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/.snap/snap-subdir-test 2023-11-28T20:41:07.440 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/30 file after the snapshot 2023-11-28T20:41:07.443 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/31 file after the snapshot 2023-11-28T20:41:07.443 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/32 file after the snapshot 2023-11-28T20:41:07.444 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/33 file after the snapshot 2023-11-28T20:41:07.444 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/34 file after the snapshot 2023-11-28T20:41:07.444 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/35 file after the snapshot 2023-11-28T20:41:07.444 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/36 file after the snapshot 2023-11-28T20:41:07.444 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/37 file after the snapshot 2023-11-28T20:41:07.444 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/38 file after the snapshot 2023-11-28T20:41:07.444 INFO:tasks.workunit.client.0.smithi167.stdout: create 182/39 file after the snapshot 2023-11-28T20:41:07.444 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/.snap/snap-subdir-test 2023-11-28T20:41:07.481 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/30 file after the snapshot 2023-11-28T20:41:07.485 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/31 file after the snapshot 2023-11-28T20:41:07.485 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/32 file after the snapshot 2023-11-28T20:41:07.485 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/33 file after the snapshot 2023-11-28T20:41:07.485 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/34 file after the snapshot 2023-11-28T20:41:07.485 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/35 file after the snapshot 2023-11-28T20:41:07.485 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/36 file after the snapshot 2023-11-28T20:41:07.485 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/37 file after the snapshot 2023-11-28T20:41:07.485 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/38 file after the snapshot 2023-11-28T20:41:07.486 INFO:tasks.workunit.client.0.smithi167.stdout: create 183/39 file after the snapshot 2023-11-28T20:41:07.486 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/.snap/snap-subdir-test 2023-11-28T20:41:07.526 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/30 file after the snapshot 2023-11-28T20:41:07.529 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/31 file after the snapshot 2023-11-28T20:41:07.529 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/32 file after the snapshot 2023-11-28T20:41:07.529 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/33 file after the snapshot 2023-11-28T20:41:07.529 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/34 file after the snapshot 2023-11-28T20:41:07.529 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/35 file after the snapshot 2023-11-28T20:41:07.529 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/36 file after the snapshot 2023-11-28T20:41:07.529 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/37 file after the snapshot 2023-11-28T20:41:07.530 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/38 file after the snapshot 2023-11-28T20:41:07.530 INFO:tasks.workunit.client.0.smithi167.stdout: create 184/39 file after the snapshot 2023-11-28T20:41:07.530 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/.snap/snap-subdir-test 2023-11-28T20:41:07.969 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/30 file after the snapshot 2023-11-28T20:41:07.972 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/31 file after the snapshot 2023-11-28T20:41:07.973 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/32 file after the snapshot 2023-11-28T20:41:07.973 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/33 file after the snapshot 2023-11-28T20:41:07.973 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/34 file after the snapshot 2023-11-28T20:41:07.973 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/35 file after the snapshot 2023-11-28T20:41:07.973 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/36 file after the snapshot 2023-11-28T20:41:07.973 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/37 file after the snapshot 2023-11-28T20:41:07.973 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/38 file after the snapshot 2023-11-28T20:41:07.973 INFO:tasks.workunit.client.0.smithi167.stdout: create 185/39 file after the snapshot 2023-11-28T20:41:07.973 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/.snap/snap-subdir-test 2023-11-28T20:41:08.019 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/30 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/31 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/32 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/33 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/34 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/35 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/36 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/37 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/38 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 186/39 file after the snapshot 2023-11-28T20:41:08.022 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/.snap/snap-subdir-test 2023-11-28T20:41:08.939 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/30 file after the snapshot 2023-11-28T20:41:08.942 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/31 file after the snapshot 2023-11-28T20:41:08.942 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/32 file after the snapshot 2023-11-28T20:41:08.942 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/33 file after the snapshot 2023-11-28T20:41:08.942 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/34 file after the snapshot 2023-11-28T20:41:08.942 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/35 file after the snapshot 2023-11-28T20:41:08.943 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/36 file after the snapshot 2023-11-28T20:41:08.943 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/37 file after the snapshot 2023-11-28T20:41:08.943 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/38 file after the snapshot 2023-11-28T20:41:08.943 INFO:tasks.workunit.client.0.smithi167.stdout: create 187/39 file after the snapshot 2023-11-28T20:41:08.943 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/.snap/snap-subdir-test 2023-11-28T20:41:08.998 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/30 file after the snapshot 2023-11-28T20:41:09.001 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/31 file after the snapshot 2023-11-28T20:41:09.001 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/32 file after the snapshot 2023-11-28T20:41:09.001 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/33 file after the snapshot 2023-11-28T20:41:09.001 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/34 file after the snapshot 2023-11-28T20:41:09.001 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/35 file after the snapshot 2023-11-28T20:41:09.001 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/36 file after the snapshot 2023-11-28T20:41:09.001 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/37 file after the snapshot 2023-11-28T20:41:09.002 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/38 file after the snapshot 2023-11-28T20:41:09.002 INFO:tasks.workunit.client.0.smithi167.stdout: create 188/39 file after the snapshot 2023-11-28T20:41:09.002 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/.snap/snap-subdir-test 2023-11-28T20:41:09.034 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/30 file after the snapshot 2023-11-28T20:41:09.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/31 file after the snapshot 2023-11-28T20:41:09.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/32 file after the snapshot 2023-11-28T20:41:09.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/33 file after the snapshot 2023-11-28T20:41:09.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/34 file after the snapshot 2023-11-28T20:41:09.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/35 file after the snapshot 2023-11-28T20:41:09.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/36 file after the snapshot 2023-11-28T20:41:09.036 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/37 file after the snapshot 2023-11-28T20:41:09.037 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/38 file after the snapshot 2023-11-28T20:41:09.037 INFO:tasks.workunit.client.0.smithi167.stdout: create 189/39 file after the snapshot 2023-11-28T20:41:09.037 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/.snap/snap-subdir-test 2023-11-28T20:41:09.079 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/30 file after the snapshot 2023-11-28T20:41:09.082 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/31 file after the snapshot 2023-11-28T20:41:09.082 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/32 file after the snapshot 2023-11-28T20:41:09.082 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/33 file after the snapshot 2023-11-28T20:41:09.082 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/34 file after the snapshot 2023-11-28T20:41:09.083 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/35 file after the snapshot 2023-11-28T20:41:09.083 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/36 file after the snapshot 2023-11-28T20:41:09.083 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/37 file after the snapshot 2023-11-28T20:41:09.083 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/38 file after the snapshot 2023-11-28T20:41:09.083 INFO:tasks.workunit.client.0.smithi167.stdout: create 190/39 file after the snapshot 2023-11-28T20:41:09.083 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/.snap/snap-subdir-test 2023-11-28T20:41:09.113 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/30 file after the snapshot 2023-11-28T20:41:09.116 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/31 file after the snapshot 2023-11-28T20:41:09.116 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/32 file after the snapshot 2023-11-28T20:41:09.117 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/33 file after the snapshot 2023-11-28T20:41:09.117 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/34 file after the snapshot 2023-11-28T20:41:09.117 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/35 file after the snapshot 2023-11-28T20:41:09.117 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/36 file after the snapshot 2023-11-28T20:41:09.117 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/37 file after the snapshot 2023-11-28T20:41:09.117 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/38 file after the snapshot 2023-11-28T20:41:09.117 INFO:tasks.workunit.client.0.smithi167.stdout: create 191/39 file after the snapshot 2023-11-28T20:41:09.117 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/.snap/snap-subdir-test 2023-11-28T20:41:09.172 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/30 file after the snapshot 2023-11-28T20:41:09.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/31 file after the snapshot 2023-11-28T20:41:09.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/32 file after the snapshot 2023-11-28T20:41:09.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/33 file after the snapshot 2023-11-28T20:41:09.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/34 file after the snapshot 2023-11-28T20:41:09.175 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/35 file after the snapshot 2023-11-28T20:41:09.176 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/36 file after the snapshot 2023-11-28T20:41:09.176 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/37 file after the snapshot 2023-11-28T20:41:09.176 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/38 file after the snapshot 2023-11-28T20:41:09.176 INFO:tasks.workunit.client.0.smithi167.stdout: create 192/39 file after the snapshot 2023-11-28T20:41:09.176 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/.snap/snap-subdir-test 2023-11-28T20:41:09.221 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/30 file after the snapshot 2023-11-28T20:41:09.224 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/31 file after the snapshot 2023-11-28T20:41:09.224 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/32 file after the snapshot 2023-11-28T20:41:09.224 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/33 file after the snapshot 2023-11-28T20:41:09.224 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/34 file after the snapshot 2023-11-28T20:41:09.225 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/35 file after the snapshot 2023-11-28T20:41:09.225 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/36 file after the snapshot 2023-11-28T20:41:09.225 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/37 file after the snapshot 2023-11-28T20:41:09.225 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/38 file after the snapshot 2023-11-28T20:41:09.225 INFO:tasks.workunit.client.0.smithi167.stdout: create 193/39 file after the snapshot 2023-11-28T20:41:09.225 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/.snap/snap-subdir-test 2023-11-28T20:41:09.613 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/30 file after the snapshot 2023-11-28T20:41:09.617 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/31 file after the snapshot 2023-11-28T20:41:09.617 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/32 file after the snapshot 2023-11-28T20:41:09.617 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/33 file after the snapshot 2023-11-28T20:41:09.617 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/34 file after the snapshot 2023-11-28T20:41:09.617 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/35 file after the snapshot 2023-11-28T20:41:09.617 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/36 file after the snapshot 2023-11-28T20:41:09.617 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/37 file after the snapshot 2023-11-28T20:41:09.617 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/38 file after the snapshot 2023-11-28T20:41:09.617 INFO:tasks.workunit.client.0.smithi167.stdout: create 194/39 file after the snapshot 2023-11-28T20:41:09.618 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/.snap/snap-subdir-test 2023-11-28T20:41:09.664 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/30 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/31 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/32 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/33 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/34 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/35 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/36 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/37 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/38 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 195/39 file after the snapshot 2023-11-28T20:41:09.667 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/.snap/snap-subdir-test 2023-11-28T20:41:09.709 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/30 file after the snapshot 2023-11-28T20:41:09.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/31 file after the snapshot 2023-11-28T20:41:09.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/32 file after the snapshot 2023-11-28T20:41:09.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/33 file after the snapshot 2023-11-28T20:41:09.712 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/34 file after the snapshot 2023-11-28T20:41:09.713 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/35 file after the snapshot 2023-11-28T20:41:09.713 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/36 file after the snapshot 2023-11-28T20:41:09.713 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/37 file after the snapshot 2023-11-28T20:41:09.713 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/38 file after the snapshot 2023-11-28T20:41:09.713 INFO:tasks.workunit.client.0.smithi167.stdout: create 196/39 file after the snapshot 2023-11-28T20:41:09.713 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/.snap/snap-subdir-test 2023-11-28T20:41:09.779 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/30 file after the snapshot 2023-11-28T20:41:09.782 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/31 file after the snapshot 2023-11-28T20:41:09.782 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/32 file after the snapshot 2023-11-28T20:41:09.782 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/33 file after the snapshot 2023-11-28T20:41:09.782 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/34 file after the snapshot 2023-11-28T20:41:09.782 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/35 file after the snapshot 2023-11-28T20:41:09.782 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/36 file after the snapshot 2023-11-28T20:41:09.782 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/37 file after the snapshot 2023-11-28T20:41:09.783 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/38 file after the snapshot 2023-11-28T20:41:09.783 INFO:tasks.workunit.client.0.smithi167.stdout: create 197/39 file after the snapshot 2023-11-28T20:41:09.783 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/.snap/snap-subdir-test 2023-11-28T20:41:09.849 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/30 file after the snapshot 2023-11-28T20:41:09.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/31 file after the snapshot 2023-11-28T20:41:09.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/32 file after the snapshot 2023-11-28T20:41:09.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/33 file after the snapshot 2023-11-28T20:41:09.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/34 file after the snapshot 2023-11-28T20:41:09.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/35 file after the snapshot 2023-11-28T20:41:09.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/36 file after the snapshot 2023-11-28T20:41:09.852 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/37 file after the snapshot 2023-11-28T20:41:09.853 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/38 file after the snapshot 2023-11-28T20:41:09.853 INFO:tasks.workunit.client.0.smithi167.stdout: create 198/39 file after the snapshot 2023-11-28T20:41:09.853 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/.snap/snap-subdir-test 2023-11-28T20:41:09.902 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/30 file after the snapshot 2023-11-28T20:41:09.906 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/31 file after the snapshot 2023-11-28T20:41:09.906 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/32 file after the snapshot 2023-11-28T20:41:09.906 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/33 file after the snapshot 2023-11-28T20:41:09.906 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/34 file after the snapshot 2023-11-28T20:41:09.907 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/35 file after the snapshot 2023-11-28T20:41:09.907 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/36 file after the snapshot 2023-11-28T20:41:09.907 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/37 file after the snapshot 2023-11-28T20:41:09.907 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/38 file after the snapshot 2023-11-28T20:41:09.907 INFO:tasks.workunit.client.0.smithi167.stdout: create 199/39 file after the snapshot 2023-11-28T20:41:09.907 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/.snap/snap-subdir-test 2023-11-28T20:41:09.966 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/30 file after the snapshot 2023-11-28T20:41:09.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/31 file after the snapshot 2023-11-28T20:41:09.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/32 file after the snapshot 2023-11-28T20:41:09.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/33 file after the snapshot 2023-11-28T20:41:09.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/34 file after the snapshot 2023-11-28T20:41:09.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/35 file after the snapshot 2023-11-28T20:41:09.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/36 file after the snapshot 2023-11-28T20:41:09.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/37 file after the snapshot 2023-11-28T20:41:09.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/38 file after the snapshot 2023-11-28T20:41:09.970 INFO:tasks.workunit.client.0.smithi167.stdout: create 200/39 file after the snapshot 2023-11-28T20:41:09.971 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/.snap/snap-subdir-test 2023-11-28T20:41:10.005 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/30 file after the snapshot 2023-11-28T20:41:10.007 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/31 file after the snapshot 2023-11-28T20:41:10.008 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/32 file after the snapshot 2023-11-28T20:41:10.008 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/33 file after the snapshot 2023-11-28T20:41:10.008 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/34 file after the snapshot 2023-11-28T20:41:10.008 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/35 file after the snapshot 2023-11-28T20:41:10.008 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/36 file after the snapshot 2023-11-28T20:41:10.008 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/37 file after the snapshot 2023-11-28T20:41:10.008 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/38 file after the snapshot 2023-11-28T20:41:10.008 INFO:tasks.workunit.client.0.smithi167.stdout: create 201/39 file after the snapshot 2023-11-28T20:41:10.008 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/.snap/snap-subdir-test 2023-11-28T20:41:10.500 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/30 file after the snapshot 2023-11-28T20:41:10.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/31 file after the snapshot 2023-11-28T20:41:10.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/32 file after the snapshot 2023-11-28T20:41:10.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/33 file after the snapshot 2023-11-28T20:41:10.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/34 file after the snapshot 2023-11-28T20:41:10.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/35 file after the snapshot 2023-11-28T20:41:10.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/36 file after the snapshot 2023-11-28T20:41:10.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/37 file after the snapshot 2023-11-28T20:41:10.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/38 file after the snapshot 2023-11-28T20:41:10.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 202/39 file after the snapshot 2023-11-28T20:41:10.504 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/.snap/snap-subdir-test 2023-11-28T20:41:10.557 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/30 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/31 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/32 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/33 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/34 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/35 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/36 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/37 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/38 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 203/39 file after the snapshot 2023-11-28T20:41:10.562 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/.snap/snap-subdir-test 2023-11-28T20:41:10.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/30 file after the snapshot 2023-11-28T20:41:10.608 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/31 file after the snapshot 2023-11-28T20:41:10.608 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/32 file after the snapshot 2023-11-28T20:41:10.608 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/33 file after the snapshot 2023-11-28T20:41:10.608 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/34 file after the snapshot 2023-11-28T20:41:10.608 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/35 file after the snapshot 2023-11-28T20:41:10.608 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/36 file after the snapshot 2023-11-28T20:41:10.608 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/37 file after the snapshot 2023-11-28T20:41:10.608 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/38 file after the snapshot 2023-11-28T20:41:10.609 INFO:tasks.workunit.client.0.smithi167.stdout: create 204/39 file after the snapshot 2023-11-28T20:41:10.609 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/.snap/snap-subdir-test 2023-11-28T20:41:10.673 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/30 file after the snapshot 2023-11-28T20:41:10.677 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/31 file after the snapshot 2023-11-28T20:41:10.677 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/32 file after the snapshot 2023-11-28T20:41:10.678 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/33 file after the snapshot 2023-11-28T20:41:10.678 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/34 file after the snapshot 2023-11-28T20:41:10.678 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/35 file after the snapshot 2023-11-28T20:41:10.678 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/36 file after the snapshot 2023-11-28T20:41:10.678 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/37 file after the snapshot 2023-11-28T20:41:10.678 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/38 file after the snapshot 2023-11-28T20:41:10.679 INFO:tasks.workunit.client.0.smithi167.stdout: create 205/39 file after the snapshot 2023-11-28T20:41:10.679 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/.snap/snap-subdir-test 2023-11-28T20:41:10.742 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/30 file after the snapshot 2023-11-28T20:41:10.746 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/31 file after the snapshot 2023-11-28T20:41:10.746 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/32 file after the snapshot 2023-11-28T20:41:10.746 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/33 file after the snapshot 2023-11-28T20:41:10.746 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/34 file after the snapshot 2023-11-28T20:41:10.746 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/35 file after the snapshot 2023-11-28T20:41:10.746 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/36 file after the snapshot 2023-11-28T20:41:10.746 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/37 file after the snapshot 2023-11-28T20:41:10.746 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/38 file after the snapshot 2023-11-28T20:41:10.747 INFO:tasks.workunit.client.0.smithi167.stdout: create 206/39 file after the snapshot 2023-11-28T20:41:10.747 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/.snap/snap-subdir-test 2023-11-28T20:41:10.799 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/30 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/31 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/32 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/33 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/34 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/35 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/36 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/37 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/38 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 207/39 file after the snapshot 2023-11-28T20:41:10.802 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/.snap/snap-subdir-test 2023-11-28T20:41:10.834 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/30 file after the snapshot 2023-11-28T20:41:10.836 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/31 file after the snapshot 2023-11-28T20:41:10.836 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/32 file after the snapshot 2023-11-28T20:41:10.836 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/33 file after the snapshot 2023-11-28T20:41:10.836 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/34 file after the snapshot 2023-11-28T20:41:10.836 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/35 file after the snapshot 2023-11-28T20:41:10.836 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/36 file after the snapshot 2023-11-28T20:41:10.836 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/37 file after the snapshot 2023-11-28T20:41:10.837 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/38 file after the snapshot 2023-11-28T20:41:10.837 INFO:tasks.workunit.client.0.smithi167.stdout: create 208/39 file after the snapshot 2023-11-28T20:41:10.837 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/.snap/snap-subdir-test 2023-11-28T20:41:10.863 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/30 file after the snapshot 2023-11-28T20:41:10.865 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/31 file after the snapshot 2023-11-28T20:41:10.865 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/32 file after the snapshot 2023-11-28T20:41:10.865 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/33 file after the snapshot 2023-11-28T20:41:10.865 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/34 file after the snapshot 2023-11-28T20:41:10.865 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/35 file after the snapshot 2023-11-28T20:41:10.865 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/36 file after the snapshot 2023-11-28T20:41:10.866 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/37 file after the snapshot 2023-11-28T20:41:10.866 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/38 file after the snapshot 2023-11-28T20:41:10.866 INFO:tasks.workunit.client.0.smithi167.stdout: create 209/39 file after the snapshot 2023-11-28T20:41:10.866 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/.snap/snap-subdir-test 2023-11-28T20:41:10.896 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/30 file after the snapshot 2023-11-28T20:41:10.897 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/31 file after the snapshot 2023-11-28T20:41:10.897 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/32 file after the snapshot 2023-11-28T20:41:10.898 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/33 file after the snapshot 2023-11-28T20:41:10.898 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/34 file after the snapshot 2023-11-28T20:41:10.898 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/35 file after the snapshot 2023-11-28T20:41:10.898 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/36 file after the snapshot 2023-11-28T20:41:10.898 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/37 file after the snapshot 2023-11-28T20:41:10.898 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/38 file after the snapshot 2023-11-28T20:41:10.898 INFO:tasks.workunit.client.0.smithi167.stdout: create 210/39 file after the snapshot 2023-11-28T20:41:10.898 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/.snap/snap-subdir-test 2023-11-28T20:41:10.928 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/30 file after the snapshot 2023-11-28T20:41:10.931 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/31 file after the snapshot 2023-11-28T20:41:10.932 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/32 file after the snapshot 2023-11-28T20:41:10.932 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/33 file after the snapshot 2023-11-28T20:41:10.932 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/34 file after the snapshot 2023-11-28T20:41:10.932 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/35 file after the snapshot 2023-11-28T20:41:10.932 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/36 file after the snapshot 2023-11-28T20:41:10.932 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/37 file after the snapshot 2023-11-28T20:41:10.932 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/38 file after the snapshot 2023-11-28T20:41:10.932 INFO:tasks.workunit.client.0.smithi167.stdout: create 211/39 file after the snapshot 2023-11-28T20:41:10.932 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/.snap/snap-subdir-test 2023-11-28T20:41:11.250 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/30 file after the snapshot 2023-11-28T20:41:11.253 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/31 file after the snapshot 2023-11-28T20:41:11.253 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/32 file after the snapshot 2023-11-28T20:41:11.253 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/33 file after the snapshot 2023-11-28T20:41:11.254 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/34 file after the snapshot 2023-11-28T20:41:11.254 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/35 file after the snapshot 2023-11-28T20:41:11.254 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/36 file after the snapshot 2023-11-28T20:41:11.254 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/37 file after the snapshot 2023-11-28T20:41:11.254 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/38 file after the snapshot 2023-11-28T20:41:11.254 INFO:tasks.workunit.client.0.smithi167.stdout: create 212/39 file after the snapshot 2023-11-28T20:41:11.254 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/.snap/snap-subdir-test 2023-11-28T20:41:11.300 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/30 file after the snapshot 2023-11-28T20:41:11.303 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/31 file after the snapshot 2023-11-28T20:41:11.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/32 file after the snapshot 2023-11-28T20:41:11.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/33 file after the snapshot 2023-11-28T20:41:11.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/34 file after the snapshot 2023-11-28T20:41:11.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/35 file after the snapshot 2023-11-28T20:41:11.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/36 file after the snapshot 2023-11-28T20:41:11.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/37 file after the snapshot 2023-11-28T20:41:11.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/38 file after the snapshot 2023-11-28T20:41:11.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 213/39 file after the snapshot 2023-11-28T20:41:11.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/.snap/snap-subdir-test 2023-11-28T20:41:11.327 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/30 file after the snapshot 2023-11-28T20:41:11.328 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/31 file after the snapshot 2023-11-28T20:41:11.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/32 file after the snapshot 2023-11-28T20:41:11.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/33 file after the snapshot 2023-11-28T20:41:11.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/34 file after the snapshot 2023-11-28T20:41:11.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/35 file after the snapshot 2023-11-28T20:41:11.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/36 file after the snapshot 2023-11-28T20:41:11.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/37 file after the snapshot 2023-11-28T20:41:11.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/38 file after the snapshot 2023-11-28T20:41:11.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 214/39 file after the snapshot 2023-11-28T20:41:11.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/.snap/snap-subdir-test 2023-11-28T20:41:11.354 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/30 file after the snapshot 2023-11-28T20:41:11.357 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/31 file after the snapshot 2023-11-28T20:41:11.358 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/32 file after the snapshot 2023-11-28T20:41:11.358 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/33 file after the snapshot 2023-11-28T20:41:11.358 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/34 file after the snapshot 2023-11-28T20:41:11.358 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/35 file after the snapshot 2023-11-28T20:41:11.358 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/36 file after the snapshot 2023-11-28T20:41:11.358 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/37 file after the snapshot 2023-11-28T20:41:11.358 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/38 file after the snapshot 2023-11-28T20:41:11.358 INFO:tasks.workunit.client.0.smithi167.stdout: create 215/39 file after the snapshot 2023-11-28T20:41:11.358 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/.snap/snap-subdir-test 2023-11-28T20:41:11.423 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/30 file after the snapshot 2023-11-28T20:41:11.426 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/31 file after the snapshot 2023-11-28T20:41:11.426 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/32 file after the snapshot 2023-11-28T20:41:11.426 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/33 file after the snapshot 2023-11-28T20:41:11.426 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/34 file after the snapshot 2023-11-28T20:41:11.426 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/35 file after the snapshot 2023-11-28T20:41:11.427 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/36 file after the snapshot 2023-11-28T20:41:11.427 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/37 file after the snapshot 2023-11-28T20:41:11.427 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/38 file after the snapshot 2023-11-28T20:41:11.427 INFO:tasks.workunit.client.0.smithi167.stdout: create 216/39 file after the snapshot 2023-11-28T20:41:11.427 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/.snap/snap-subdir-test 2023-11-28T20:41:11.519 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/30 file after the snapshot 2023-11-28T20:41:11.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/31 file after the snapshot 2023-11-28T20:41:11.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/32 file after the snapshot 2023-11-28T20:41:11.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/33 file after the snapshot 2023-11-28T20:41:11.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/34 file after the snapshot 2023-11-28T20:41:11.522 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/35 file after the snapshot 2023-11-28T20:41:11.523 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/36 file after the snapshot 2023-11-28T20:41:11.523 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/37 file after the snapshot 2023-11-28T20:41:11.523 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/38 file after the snapshot 2023-11-28T20:41:11.523 INFO:tasks.workunit.client.0.smithi167.stdout: create 217/39 file after the snapshot 2023-11-28T20:41:11.523 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/.snap/snap-subdir-test 2023-11-28T20:41:11.553 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/30 file after the snapshot 2023-11-28T20:41:11.555 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/31 file after the snapshot 2023-11-28T20:41:11.555 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/32 file after the snapshot 2023-11-28T20:41:11.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/33 file after the snapshot 2023-11-28T20:41:11.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/34 file after the snapshot 2023-11-28T20:41:11.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/35 file after the snapshot 2023-11-28T20:41:11.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/36 file after the snapshot 2023-11-28T20:41:11.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/37 file after the snapshot 2023-11-28T20:41:11.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/38 file after the snapshot 2023-11-28T20:41:11.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 218/39 file after the snapshot 2023-11-28T20:41:11.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/.snap/snap-subdir-test 2023-11-28T20:41:11.585 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/30 file after the snapshot 2023-11-28T20:41:11.589 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/31 file after the snapshot 2023-11-28T20:41:11.589 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/32 file after the snapshot 2023-11-28T20:41:11.589 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/33 file after the snapshot 2023-11-28T20:41:11.589 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/34 file after the snapshot 2023-11-28T20:41:11.590 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/35 file after the snapshot 2023-11-28T20:41:11.590 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/36 file after the snapshot 2023-11-28T20:41:11.590 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/37 file after the snapshot 2023-11-28T20:41:11.590 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/38 file after the snapshot 2023-11-28T20:41:11.590 INFO:tasks.workunit.client.0.smithi167.stdout: create 219/39 file after the snapshot 2023-11-28T20:41:11.590 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/.snap/snap-subdir-test 2023-11-28T20:41:11.770 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/30 file after the snapshot 2023-11-28T20:41:11.773 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/31 file after the snapshot 2023-11-28T20:41:11.773 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/32 file after the snapshot 2023-11-28T20:41:11.774 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/33 file after the snapshot 2023-11-28T20:41:11.774 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/34 file after the snapshot 2023-11-28T20:41:11.774 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/35 file after the snapshot 2023-11-28T20:41:11.774 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/36 file after the snapshot 2023-11-28T20:41:11.774 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/37 file after the snapshot 2023-11-28T20:41:11.774 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/38 file after the snapshot 2023-11-28T20:41:11.774 INFO:tasks.workunit.client.0.smithi167.stdout: create 220/39 file after the snapshot 2023-11-28T20:41:11.774 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/.snap/snap-subdir-test 2023-11-28T20:41:11.793 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/30 file after the snapshot 2023-11-28T20:41:11.794 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/31 file after the snapshot 2023-11-28T20:41:11.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/32 file after the snapshot 2023-11-28T20:41:11.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/33 file after the snapshot 2023-11-28T20:41:11.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/34 file after the snapshot 2023-11-28T20:41:11.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/35 file after the snapshot 2023-11-28T20:41:11.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/36 file after the snapshot 2023-11-28T20:41:11.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/37 file after the snapshot 2023-11-28T20:41:11.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/38 file after the snapshot 2023-11-28T20:41:11.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 221/39 file after the snapshot 2023-11-28T20:41:11.795 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/.snap/snap-subdir-test 2023-11-28T20:41:11.824 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/30 file after the snapshot 2023-11-28T20:41:11.827 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/31 file after the snapshot 2023-11-28T20:41:11.827 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/32 file after the snapshot 2023-11-28T20:41:11.827 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/33 file after the snapshot 2023-11-28T20:41:11.827 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/34 file after the snapshot 2023-11-28T20:41:11.827 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/35 file after the snapshot 2023-11-28T20:41:11.828 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/36 file after the snapshot 2023-11-28T20:41:11.828 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/37 file after the snapshot 2023-11-28T20:41:11.828 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/38 file after the snapshot 2023-11-28T20:41:11.828 INFO:tasks.workunit.client.0.smithi167.stdout: create 222/39 file after the snapshot 2023-11-28T20:41:11.828 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/.snap/snap-subdir-test 2023-11-28T20:41:11.871 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/30 file after the snapshot 2023-11-28T20:41:11.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/31 file after the snapshot 2023-11-28T20:41:11.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/32 file after the snapshot 2023-11-28T20:41:11.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/33 file after the snapshot 2023-11-28T20:41:11.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/34 file after the snapshot 2023-11-28T20:41:11.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/35 file after the snapshot 2023-11-28T20:41:11.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/36 file after the snapshot 2023-11-28T20:41:11.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/37 file after the snapshot 2023-11-28T20:41:11.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/38 file after the snapshot 2023-11-28T20:41:11.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 223/39 file after the snapshot 2023-11-28T20:41:11.876 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/.snap/snap-subdir-test 2023-11-28T20:41:11.899 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/30 file after the snapshot 2023-11-28T20:41:12.152 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/31 file after the snapshot 2023-11-28T20:41:12.152 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/32 file after the snapshot 2023-11-28T20:41:12.153 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/33 file after the snapshot 2023-11-28T20:41:12.153 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/34 file after the snapshot 2023-11-28T20:41:12.153 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/35 file after the snapshot 2023-11-28T20:41:12.153 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/36 file after the snapshot 2023-11-28T20:41:12.153 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/37 file after the snapshot 2023-11-28T20:41:12.153 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/38 file after the snapshot 2023-11-28T20:41:12.153 INFO:tasks.workunit.client.0.smithi167.stdout: create 224/39 file after the snapshot 2023-11-28T20:41:12.154 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/.snap/snap-subdir-test 2023-11-28T20:41:12.200 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/30 file after the snapshot 2023-11-28T20:41:12.203 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/31 file after the snapshot 2023-11-28T20:41:12.203 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/32 file after the snapshot 2023-11-28T20:41:12.203 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/33 file after the snapshot 2023-11-28T20:41:12.204 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/34 file after the snapshot 2023-11-28T20:41:12.204 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/35 file after the snapshot 2023-11-28T20:41:12.204 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/36 file after the snapshot 2023-11-28T20:41:12.204 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/37 file after the snapshot 2023-11-28T20:41:12.204 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/38 file after the snapshot 2023-11-28T20:41:12.204 INFO:tasks.workunit.client.0.smithi167.stdout: create 225/39 file after the snapshot 2023-11-28T20:41:12.205 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/.snap/snap-subdir-test 2023-11-28T20:41:12.236 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/30 file after the snapshot 2023-11-28T20:41:12.237 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/31 file after the snapshot 2023-11-28T20:41:12.238 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/32 file after the snapshot 2023-11-28T20:41:12.238 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/33 file after the snapshot 2023-11-28T20:41:12.238 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/34 file after the snapshot 2023-11-28T20:41:12.238 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/35 file after the snapshot 2023-11-28T20:41:12.238 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/36 file after the snapshot 2023-11-28T20:41:12.238 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/37 file after the snapshot 2023-11-28T20:41:12.238 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/38 file after the snapshot 2023-11-28T20:41:12.239 INFO:tasks.workunit.client.0.smithi167.stdout: create 226/39 file after the snapshot 2023-11-28T20:41:12.239 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/.snap/snap-subdir-test 2023-11-28T20:41:12.645 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/30 file after the snapshot 2023-11-28T20:41:12.648 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/31 file after the snapshot 2023-11-28T20:41:12.648 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/32 file after the snapshot 2023-11-28T20:41:12.649 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/33 file after the snapshot 2023-11-28T20:41:12.649 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/34 file after the snapshot 2023-11-28T20:41:12.649 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/35 file after the snapshot 2023-11-28T20:41:12.649 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/36 file after the snapshot 2023-11-28T20:41:12.649 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/37 file after the snapshot 2023-11-28T20:41:12.649 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/38 file after the snapshot 2023-11-28T20:41:12.649 INFO:tasks.workunit.client.0.smithi167.stdout: create 227/39 file after the snapshot 2023-11-28T20:41:12.649 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/.snap/snap-subdir-test 2023-11-28T20:41:12.745 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/30 file after the snapshot 2023-11-28T20:41:12.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/31 file after the snapshot 2023-11-28T20:41:12.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/32 file after the snapshot 2023-11-28T20:41:12.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/33 file after the snapshot 2023-11-28T20:41:12.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/34 file after the snapshot 2023-11-28T20:41:12.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/35 file after the snapshot 2023-11-28T20:41:12.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/36 file after the snapshot 2023-11-28T20:41:12.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/37 file after the snapshot 2023-11-28T20:41:12.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/38 file after the snapshot 2023-11-28T20:41:12.750 INFO:tasks.workunit.client.0.smithi167.stdout: create 228/39 file after the snapshot 2023-11-28T20:41:12.750 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/.snap/snap-subdir-test 2023-11-28T20:41:12.797 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/30 file after the snapshot 2023-11-28T20:41:12.800 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/31 file after the snapshot 2023-11-28T20:41:12.801 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/32 file after the snapshot 2023-11-28T20:41:12.801 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/33 file after the snapshot 2023-11-28T20:41:12.801 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/34 file after the snapshot 2023-11-28T20:41:12.801 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/35 file after the snapshot 2023-11-28T20:41:12.801 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/36 file after the snapshot 2023-11-28T20:41:12.801 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/37 file after the snapshot 2023-11-28T20:41:12.801 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/38 file after the snapshot 2023-11-28T20:41:12.801 INFO:tasks.workunit.client.0.smithi167.stdout: create 229/39 file after the snapshot 2023-11-28T20:41:12.801 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/.snap/snap-subdir-test 2023-11-28T20:41:13.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/30 file after the snapshot 2023-11-28T20:41:13.095 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/31 file after the snapshot 2023-11-28T20:41:13.095 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/32 file after the snapshot 2023-11-28T20:41:13.095 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/33 file after the snapshot 2023-11-28T20:41:13.095 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/34 file after the snapshot 2023-11-28T20:41:13.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/35 file after the snapshot 2023-11-28T20:41:13.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/36 file after the snapshot 2023-11-28T20:41:13.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/37 file after the snapshot 2023-11-28T20:41:13.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/38 file after the snapshot 2023-11-28T20:41:13.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 230/39 file after the snapshot 2023-11-28T20:41:13.096 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/.snap/snap-subdir-test 2023-11-28T20:41:13.131 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/30 file after the snapshot 2023-11-28T20:41:13.133 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/31 file after the snapshot 2023-11-28T20:41:13.133 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/32 file after the snapshot 2023-11-28T20:41:13.133 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/33 file after the snapshot 2023-11-28T20:41:13.133 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/34 file after the snapshot 2023-11-28T20:41:13.133 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/35 file after the snapshot 2023-11-28T20:41:13.133 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/36 file after the snapshot 2023-11-28T20:41:13.134 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/37 file after the snapshot 2023-11-28T20:41:13.134 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/38 file after the snapshot 2023-11-28T20:41:13.134 INFO:tasks.workunit.client.0.smithi167.stdout: create 231/39 file after the snapshot 2023-11-28T20:41:13.134 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/.snap/snap-subdir-test 2023-11-28T20:41:13.164 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/30 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/31 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/32 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/33 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/34 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/35 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/36 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/37 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/38 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 232/39 file after the snapshot 2023-11-28T20:41:13.169 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/.snap/snap-subdir-test 2023-11-28T20:41:13.231 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/30 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/31 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/32 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/33 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/34 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/35 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/36 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/37 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/38 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 233/39 file after the snapshot 2023-11-28T20:41:13.235 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/.snap/snap-subdir-test 2023-11-28T20:41:13.281 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/30 file after the snapshot 2023-11-28T20:41:13.284 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/31 file after the snapshot 2023-11-28T20:41:13.284 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/32 file after the snapshot 2023-11-28T20:41:13.284 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/33 file after the snapshot 2023-11-28T20:41:13.285 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/34 file after the snapshot 2023-11-28T20:41:13.285 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/35 file after the snapshot 2023-11-28T20:41:13.285 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/36 file after the snapshot 2023-11-28T20:41:13.285 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/37 file after the snapshot 2023-11-28T20:41:13.285 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/38 file after the snapshot 2023-11-28T20:41:13.285 INFO:tasks.workunit.client.0.smithi167.stdout: create 234/39 file after the snapshot 2023-11-28T20:41:13.285 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/.snap/snap-subdir-test 2023-11-28T20:41:13.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/30 file after the snapshot 2023-11-28T20:41:13.332 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/31 file after the snapshot 2023-11-28T20:41:13.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/32 file after the snapshot 2023-11-28T20:41:13.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/33 file after the snapshot 2023-11-28T20:41:13.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/34 file after the snapshot 2023-11-28T20:41:13.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/35 file after the snapshot 2023-11-28T20:41:13.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/36 file after the snapshot 2023-11-28T20:41:13.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/37 file after the snapshot 2023-11-28T20:41:13.334 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/38 file after the snapshot 2023-11-28T20:41:13.334 INFO:tasks.workunit.client.0.smithi167.stdout: create 235/39 file after the snapshot 2023-11-28T20:41:13.334 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/.snap/snap-subdir-test 2023-11-28T20:41:13.365 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/30 file after the snapshot 2023-11-28T20:41:13.369 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/31 file after the snapshot 2023-11-28T20:41:13.369 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/32 file after the snapshot 2023-11-28T20:41:13.369 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/33 file after the snapshot 2023-11-28T20:41:13.369 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/34 file after the snapshot 2023-11-28T20:41:13.370 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/35 file after the snapshot 2023-11-28T20:41:13.370 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/36 file after the snapshot 2023-11-28T20:41:13.370 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/37 file after the snapshot 2023-11-28T20:41:13.370 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/38 file after the snapshot 2023-11-28T20:41:13.370 INFO:tasks.workunit.client.0.smithi167.stdout: create 236/39 file after the snapshot 2023-11-28T20:41:13.371 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/.snap/snap-subdir-test 2023-11-28T20:41:13.415 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/30 file after the snapshot 2023-11-28T20:41:13.417 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/31 file after the snapshot 2023-11-28T20:41:13.417 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/32 file after the snapshot 2023-11-28T20:41:13.417 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/33 file after the snapshot 2023-11-28T20:41:13.418 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/34 file after the snapshot 2023-11-28T20:41:13.418 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/35 file after the snapshot 2023-11-28T20:41:13.418 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/36 file after the snapshot 2023-11-28T20:41:13.419 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/37 file after the snapshot 2023-11-28T20:41:13.419 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/38 file after the snapshot 2023-11-28T20:41:13.419 INFO:tasks.workunit.client.0.smithi167.stdout: create 237/39 file after the snapshot 2023-11-28T20:41:13.419 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/.snap/snap-subdir-test 2023-11-28T20:41:13.453 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/30 file after the snapshot 2023-11-28T20:41:13.456 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/31 file after the snapshot 2023-11-28T20:41:13.456 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/32 file after the snapshot 2023-11-28T20:41:13.456 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/33 file after the snapshot 2023-11-28T20:41:13.456 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/34 file after the snapshot 2023-11-28T20:41:13.456 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/35 file after the snapshot 2023-11-28T20:41:13.457 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/36 file after the snapshot 2023-11-28T20:41:13.457 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/37 file after the snapshot 2023-11-28T20:41:13.457 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/38 file after the snapshot 2023-11-28T20:41:13.457 INFO:tasks.workunit.client.0.smithi167.stdout: create 238/39 file after the snapshot 2023-11-28T20:41:13.457 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/.snap/snap-subdir-test 2023-11-28T20:41:13.500 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/30 file after the snapshot 2023-11-28T20:41:13.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/31 file after the snapshot 2023-11-28T20:41:13.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/32 file after the snapshot 2023-11-28T20:41:13.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/33 file after the snapshot 2023-11-28T20:41:13.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/34 file after the snapshot 2023-11-28T20:41:13.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/35 file after the snapshot 2023-11-28T20:41:13.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/36 file after the snapshot 2023-11-28T20:41:13.504 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/37 file after the snapshot 2023-11-28T20:41:13.504 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/38 file after the snapshot 2023-11-28T20:41:13.504 INFO:tasks.workunit.client.0.smithi167.stdout: create 239/39 file after the snapshot 2023-11-28T20:41:13.504 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/.snap/snap-subdir-test 2023-11-28T20:41:13.721 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/30 file after the snapshot 2023-11-28T20:41:13.726 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/31 file after the snapshot 2023-11-28T20:41:13.726 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/32 file after the snapshot 2023-11-28T20:41:13.726 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/33 file after the snapshot 2023-11-28T20:41:13.726 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/34 file after the snapshot 2023-11-28T20:41:13.727 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/35 file after the snapshot 2023-11-28T20:41:13.727 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/36 file after the snapshot 2023-11-28T20:41:13.727 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/37 file after the snapshot 2023-11-28T20:41:13.727 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/38 file after the snapshot 2023-11-28T20:41:13.727 INFO:tasks.workunit.client.0.smithi167.stdout: create 240/39 file after the snapshot 2023-11-28T20:41:13.727 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/.snap/snap-subdir-test 2023-11-28T20:41:13.780 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/30 file after the snapshot 2023-11-28T20:41:13.785 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/31 file after the snapshot 2023-11-28T20:41:13.785 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/32 file after the snapshot 2023-11-28T20:41:13.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/33 file after the snapshot 2023-11-28T20:41:13.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/34 file after the snapshot 2023-11-28T20:41:13.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/35 file after the snapshot 2023-11-28T20:41:13.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/36 file after the snapshot 2023-11-28T20:41:13.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/37 file after the snapshot 2023-11-28T20:41:13.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/38 file after the snapshot 2023-11-28T20:41:13.786 INFO:tasks.workunit.client.0.smithi167.stdout: create 241/39 file after the snapshot 2023-11-28T20:41:13.787 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/.snap/snap-subdir-test 2023-11-28T20:41:13.822 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/30 file after the snapshot 2023-11-28T20:41:13.824 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/31 file after the snapshot 2023-11-28T20:41:13.824 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/32 file after the snapshot 2023-11-28T20:41:13.824 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/33 file after the snapshot 2023-11-28T20:41:13.824 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/34 file after the snapshot 2023-11-28T20:41:13.824 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/35 file after the snapshot 2023-11-28T20:41:13.825 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/36 file after the snapshot 2023-11-28T20:41:13.825 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/37 file after the snapshot 2023-11-28T20:41:13.825 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/38 file after the snapshot 2023-11-28T20:41:13.825 INFO:tasks.workunit.client.0.smithi167.stdout: create 242/39 file after the snapshot 2023-11-28T20:41:13.825 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/.snap/snap-subdir-test 2023-11-28T20:41:13.855 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/30 file after the snapshot 2023-11-28T20:41:13.856 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/31 file after the snapshot 2023-11-28T20:41:13.857 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/32 file after the snapshot 2023-11-28T20:41:13.857 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/33 file after the snapshot 2023-11-28T20:41:13.857 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/34 file after the snapshot 2023-11-28T20:41:13.857 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/35 file after the snapshot 2023-11-28T20:41:13.857 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/36 file after the snapshot 2023-11-28T20:41:13.857 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/37 file after the snapshot 2023-11-28T20:41:13.857 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/38 file after the snapshot 2023-11-28T20:41:13.857 INFO:tasks.workunit.client.0.smithi167.stdout: create 243/39 file after the snapshot 2023-11-28T20:41:13.857 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/.snap/snap-subdir-test 2023-11-28T20:41:14.338 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/30 file after the snapshot 2023-11-28T20:41:14.339 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/31 file after the snapshot 2023-11-28T20:41:14.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/32 file after the snapshot 2023-11-28T20:41:14.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/33 file after the snapshot 2023-11-28T20:41:14.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/34 file after the snapshot 2023-11-28T20:41:14.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/35 file after the snapshot 2023-11-28T20:41:14.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/36 file after the snapshot 2023-11-28T20:41:14.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/37 file after the snapshot 2023-11-28T20:41:14.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/38 file after the snapshot 2023-11-28T20:41:14.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 244/39 file after the snapshot 2023-11-28T20:41:14.340 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/.snap/snap-subdir-test 2023-11-28T20:41:14.368 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/30 file after the snapshot 2023-11-28T20:41:14.371 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/31 file after the snapshot 2023-11-28T20:41:14.371 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/32 file after the snapshot 2023-11-28T20:41:14.371 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/33 file after the snapshot 2023-11-28T20:41:14.371 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/34 file after the snapshot 2023-11-28T20:41:14.371 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/35 file after the snapshot 2023-11-28T20:41:14.371 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/36 file after the snapshot 2023-11-28T20:41:14.371 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/37 file after the snapshot 2023-11-28T20:41:14.372 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/38 file after the snapshot 2023-11-28T20:41:14.372 INFO:tasks.workunit.client.0.smithi167.stdout: create 245/39 file after the snapshot 2023-11-28T20:41:14.372 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/.snap/snap-subdir-test 2023-11-28T20:41:14.394 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/30 file after the snapshot 2023-11-28T20:41:14.398 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/31 file after the snapshot 2023-11-28T20:41:14.398 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/32 file after the snapshot 2023-11-28T20:41:14.398 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/33 file after the snapshot 2023-11-28T20:41:14.398 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/34 file after the snapshot 2023-11-28T20:41:14.398 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/35 file after the snapshot 2023-11-28T20:41:14.398 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/36 file after the snapshot 2023-11-28T20:41:14.398 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/37 file after the snapshot 2023-11-28T20:41:14.399 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/38 file after the snapshot 2023-11-28T20:41:14.399 INFO:tasks.workunit.client.0.smithi167.stdout: create 246/39 file after the snapshot 2023-11-28T20:41:14.399 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/.snap/snap-subdir-test 2023-11-28T20:41:14.430 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/30 file after the snapshot 2023-11-28T20:41:14.432 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/31 file after the snapshot 2023-11-28T20:41:14.432 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/32 file after the snapshot 2023-11-28T20:41:14.432 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/33 file after the snapshot 2023-11-28T20:41:14.432 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/34 file after the snapshot 2023-11-28T20:41:14.432 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/35 file after the snapshot 2023-11-28T20:41:14.432 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/36 file after the snapshot 2023-11-28T20:41:14.432 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/37 file after the snapshot 2023-11-28T20:41:14.433 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/38 file after the snapshot 2023-11-28T20:41:14.433 INFO:tasks.workunit.client.0.smithi167.stdout: create 247/39 file after the snapshot 2023-11-28T20:41:14.433 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/.snap/snap-subdir-test 2023-11-28T20:41:14.463 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/30 file after the snapshot 2023-11-28T20:41:14.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/31 file after the snapshot 2023-11-28T20:41:14.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/32 file after the snapshot 2023-11-28T20:41:14.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/33 file after the snapshot 2023-11-28T20:41:14.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/34 file after the snapshot 2023-11-28T20:41:14.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/35 file after the snapshot 2023-11-28T20:41:14.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/36 file after the snapshot 2023-11-28T20:41:14.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/37 file after the snapshot 2023-11-28T20:41:14.466 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/38 file after the snapshot 2023-11-28T20:41:14.466 INFO:tasks.workunit.client.0.smithi167.stdout: create 248/39 file after the snapshot 2023-11-28T20:41:14.466 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/.snap/snap-subdir-test 2023-11-28T20:41:14.488 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/30 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/31 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/32 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/33 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/34 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/35 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/36 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/37 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/38 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 249/39 file after the snapshot 2023-11-28T20:41:14.490 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/.snap/snap-subdir-test 2023-11-28T20:41:14.513 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/30 file after the snapshot 2023-11-28T20:41:14.515 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/31 file after the snapshot 2023-11-28T20:41:14.515 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/32 file after the snapshot 2023-11-28T20:41:14.515 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/33 file after the snapshot 2023-11-28T20:41:14.515 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/34 file after the snapshot 2023-11-28T20:41:14.515 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/35 file after the snapshot 2023-11-28T20:41:14.515 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/36 file after the snapshot 2023-11-28T20:41:14.515 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/37 file after the snapshot 2023-11-28T20:41:14.515 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/38 file after the snapshot 2023-11-28T20:41:14.515 INFO:tasks.workunit.client.0.smithi167.stdout: create 250/39 file after the snapshot 2023-11-28T20:41:14.516 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/.snap/snap-subdir-test 2023-11-28T20:41:14.545 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/30 file after the snapshot 2023-11-28T20:41:14.548 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/31 file after the snapshot 2023-11-28T20:41:14.548 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/32 file after the snapshot 2023-11-28T20:41:14.548 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/33 file after the snapshot 2023-11-28T20:41:14.548 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/34 file after the snapshot 2023-11-28T20:41:14.549 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/35 file after the snapshot 2023-11-28T20:41:14.549 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/36 file after the snapshot 2023-11-28T20:41:14.549 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/37 file after the snapshot 2023-11-28T20:41:14.549 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/38 file after the snapshot 2023-11-28T20:41:14.549 INFO:tasks.workunit.client.0.smithi167.stdout: create 251/39 file after the snapshot 2023-11-28T20:41:14.549 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/.snap/snap-subdir-test 2023-11-28T20:41:14.578 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/30 file after the snapshot 2023-11-28T20:41:14.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/31 file after the snapshot 2023-11-28T20:41:14.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/32 file after the snapshot 2023-11-28T20:41:14.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/33 file after the snapshot 2023-11-28T20:41:14.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/34 file after the snapshot 2023-11-28T20:41:14.583 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/35 file after the snapshot 2023-11-28T20:41:14.584 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/36 file after the snapshot 2023-11-28T20:41:14.584 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/37 file after the snapshot 2023-11-28T20:41:14.584 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/38 file after the snapshot 2023-11-28T20:41:14.584 INFO:tasks.workunit.client.0.smithi167.stdout: create 252/39 file after the snapshot 2023-11-28T20:41:14.584 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/.snap/snap-subdir-test 2023-11-28T20:41:14.621 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/30 file after the snapshot 2023-11-28T20:41:14.623 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/31 file after the snapshot 2023-11-28T20:41:14.623 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/32 file after the snapshot 2023-11-28T20:41:14.623 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/33 file after the snapshot 2023-11-28T20:41:14.623 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/34 file after the snapshot 2023-11-28T20:41:14.623 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/35 file after the snapshot 2023-11-28T20:41:14.623 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/36 file after the snapshot 2023-11-28T20:41:14.623 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/37 file after the snapshot 2023-11-28T20:41:14.624 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/38 file after the snapshot 2023-11-28T20:41:14.624 INFO:tasks.workunit.client.0.smithi167.stdout: create 253/39 file after the snapshot 2023-11-28T20:41:14.624 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/.snap/snap-subdir-test 2023-11-28T20:41:14.650 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/30 file after the snapshot 2023-11-28T20:41:14.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/31 file after the snapshot 2023-11-28T20:41:14.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/32 file after the snapshot 2023-11-28T20:41:14.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/33 file after the snapshot 2023-11-28T20:41:14.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/34 file after the snapshot 2023-11-28T20:41:14.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/35 file after the snapshot 2023-11-28T20:41:14.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/36 file after the snapshot 2023-11-28T20:41:14.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/37 file after the snapshot 2023-11-28T20:41:14.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/38 file after the snapshot 2023-11-28T20:41:14.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 254/39 file after the snapshot 2023-11-28T20:41:14.654 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/.snap/snap-subdir-test 2023-11-28T20:41:14.697 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/30 file after the snapshot 2023-11-28T20:41:14.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/31 file after the snapshot 2023-11-28T20:41:14.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/32 file after the snapshot 2023-11-28T20:41:14.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/33 file after the snapshot 2023-11-28T20:41:14.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/34 file after the snapshot 2023-11-28T20:41:14.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/35 file after the snapshot 2023-11-28T20:41:14.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/36 file after the snapshot 2023-11-28T20:41:14.700 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/37 file after the snapshot 2023-11-28T20:41:14.701 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/38 file after the snapshot 2023-11-28T20:41:14.701 INFO:tasks.workunit.client.0.smithi167.stdout: create 255/39 file after the snapshot 2023-11-28T20:41:14.701 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/.snap/snap-subdir-test 2023-11-28T20:41:14.733 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/30 file after the snapshot 2023-11-28T20:41:14.735 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/31 file after the snapshot 2023-11-28T20:41:14.735 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/32 file after the snapshot 2023-11-28T20:41:14.735 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/33 file after the snapshot 2023-11-28T20:41:14.735 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/34 file after the snapshot 2023-11-28T20:41:14.735 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/35 file after the snapshot 2023-11-28T20:41:14.735 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/36 file after the snapshot 2023-11-28T20:41:14.735 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/37 file after the snapshot 2023-11-28T20:41:14.736 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/38 file after the snapshot 2023-11-28T20:41:14.736 INFO:tasks.workunit.client.0.smithi167.stdout: create 256/39 file after the snapshot 2023-11-28T20:41:14.736 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/.snap/snap-subdir-test 2023-11-28T20:41:14.763 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/30 file after the snapshot 2023-11-28T20:41:14.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/31 file after the snapshot 2023-11-28T20:41:14.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/32 file after the snapshot 2023-11-28T20:41:14.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/33 file after the snapshot 2023-11-28T20:41:14.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/34 file after the snapshot 2023-11-28T20:41:14.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/35 file after the snapshot 2023-11-28T20:41:14.766 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/36 file after the snapshot 2023-11-28T20:41:14.767 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/37 file after the snapshot 2023-11-28T20:41:14.767 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/38 file after the snapshot 2023-11-28T20:41:14.767 INFO:tasks.workunit.client.0.smithi167.stdout: create 257/39 file after the snapshot 2023-11-28T20:41:14.767 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/.snap/snap-subdir-test 2023-11-28T20:41:14.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:14.998 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:15.531 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/30 file after the snapshot 2023-11-28T20:41:15.532 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/31 file after the snapshot 2023-11-28T20:41:15.532 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/32 file after the snapshot 2023-11-28T20:41:15.532 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/33 file after the snapshot 2023-11-28T20:41:15.533 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/34 file after the snapshot 2023-11-28T20:41:15.533 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/35 file after the snapshot 2023-11-28T20:41:15.533 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/36 file after the snapshot 2023-11-28T20:41:15.533 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/37 file after the snapshot 2023-11-28T20:41:15.533 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/38 file after the snapshot 2023-11-28T20:41:15.533 INFO:tasks.workunit.client.0.smithi167.stdout: create 258/39 file after the snapshot 2023-11-28T20:41:15.533 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/.snap/snap-subdir-test 2023-11-28T20:41:15.552 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/30 file after the snapshot 2023-11-28T20:41:15.555 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/31 file after the snapshot 2023-11-28T20:41:15.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/32 file after the snapshot 2023-11-28T20:41:15.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/33 file after the snapshot 2023-11-28T20:41:15.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/34 file after the snapshot 2023-11-28T20:41:15.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/35 file after the snapshot 2023-11-28T20:41:15.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/36 file after the snapshot 2023-11-28T20:41:15.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/37 file after the snapshot 2023-11-28T20:41:15.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/38 file after the snapshot 2023-11-28T20:41:15.556 INFO:tasks.workunit.client.0.smithi167.stdout: create 259/39 file after the snapshot 2023-11-28T20:41:15.557 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/.snap/snap-subdir-test 2023-11-28T20:41:15.601 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/30 file after the snapshot 2023-11-28T20:41:15.604 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/31 file after the snapshot 2023-11-28T20:41:15.604 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/32 file after the snapshot 2023-11-28T20:41:15.604 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/33 file after the snapshot 2023-11-28T20:41:15.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/34 file after the snapshot 2023-11-28T20:41:15.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/35 file after the snapshot 2023-11-28T20:41:15.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/36 file after the snapshot 2023-11-28T20:41:15.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/37 file after the snapshot 2023-11-28T20:41:15.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/38 file after the snapshot 2023-11-28T20:41:15.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 260/39 file after the snapshot 2023-11-28T20:41:15.605 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/.snap/snap-subdir-test 2023-11-28T20:41:16.248 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/30 file after the snapshot 2023-11-28T20:41:16.251 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/31 file after the snapshot 2023-11-28T20:41:16.251 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/32 file after the snapshot 2023-11-28T20:41:16.251 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/33 file after the snapshot 2023-11-28T20:41:16.251 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/34 file after the snapshot 2023-11-28T20:41:16.251 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/35 file after the snapshot 2023-11-28T20:41:16.251 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/36 file after the snapshot 2023-11-28T20:41:16.251 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/37 file after the snapshot 2023-11-28T20:41:16.251 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/38 file after the snapshot 2023-11-28T20:41:16.252 INFO:tasks.workunit.client.0.smithi167.stdout: create 261/39 file after the snapshot 2023-11-28T20:41:16.252 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/.snap/snap-subdir-test 2023-11-28T20:41:16.284 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/30 file after the snapshot 2023-11-28T20:41:16.286 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/31 file after the snapshot 2023-11-28T20:41:16.286 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/32 file after the snapshot 2023-11-28T20:41:16.286 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/33 file after the snapshot 2023-11-28T20:41:16.286 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/34 file after the snapshot 2023-11-28T20:41:16.286 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/35 file after the snapshot 2023-11-28T20:41:16.286 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/36 file after the snapshot 2023-11-28T20:41:16.287 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/37 file after the snapshot 2023-11-28T20:41:16.287 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/38 file after the snapshot 2023-11-28T20:41:16.287 INFO:tasks.workunit.client.0.smithi167.stdout: create 262/39 file after the snapshot 2023-11-28T20:41:16.287 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/.snap/snap-subdir-test 2023-11-28T20:41:16.328 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/30 file after the snapshot 2023-11-28T20:41:16.332 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/31 file after the snapshot 2023-11-28T20:41:16.332 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/32 file after the snapshot 2023-11-28T20:41:16.332 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/33 file after the snapshot 2023-11-28T20:41:16.332 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/34 file after the snapshot 2023-11-28T20:41:16.332 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/35 file after the snapshot 2023-11-28T20:41:16.332 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/36 file after the snapshot 2023-11-28T20:41:16.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/37 file after the snapshot 2023-11-28T20:41:16.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/38 file after the snapshot 2023-11-28T20:41:16.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 263/39 file after the snapshot 2023-11-28T20:41:16.333 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/.snap/snap-subdir-test 2023-11-28T20:41:16.359 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/30 file after the snapshot 2023-11-28T20:41:16.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/31 file after the snapshot 2023-11-28T20:41:16.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/32 file after the snapshot 2023-11-28T20:41:16.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/33 file after the snapshot 2023-11-28T20:41:16.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/34 file after the snapshot 2023-11-28T20:41:16.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/35 file after the snapshot 2023-11-28T20:41:16.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/36 file after the snapshot 2023-11-28T20:41:16.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/37 file after the snapshot 2023-11-28T20:41:16.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/38 file after the snapshot 2023-11-28T20:41:16.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 264/39 file after the snapshot 2023-11-28T20:41:16.363 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/.snap/snap-subdir-test 2023-11-28T20:41:16.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/30 file after the snapshot 2023-11-28T20:41:16.396 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/31 file after the snapshot 2023-11-28T20:41:16.396 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/32 file after the snapshot 2023-11-28T20:41:16.397 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/33 file after the snapshot 2023-11-28T20:41:16.397 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/34 file after the snapshot 2023-11-28T20:41:16.398 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/35 file after the snapshot 2023-11-28T20:41:16.398 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/36 file after the snapshot 2023-11-28T20:41:16.399 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/37 file after the snapshot 2023-11-28T20:41:16.399 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/38 file after the snapshot 2023-11-28T20:41:16.400 INFO:tasks.workunit.client.0.smithi167.stdout: create 265/39 file after the snapshot 2023-11-28T20:41:16.400 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/.snap/snap-subdir-test 2023-11-28T20:41:16.422 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/30 file after the snapshot 2023-11-28T20:41:16.425 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/31 file after the snapshot 2023-11-28T20:41:16.425 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/32 file after the snapshot 2023-11-28T20:41:16.425 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/33 file after the snapshot 2023-11-28T20:41:16.425 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/34 file after the snapshot 2023-11-28T20:41:16.425 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/35 file after the snapshot 2023-11-28T20:41:16.425 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/36 file after the snapshot 2023-11-28T20:41:16.426 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/37 file after the snapshot 2023-11-28T20:41:16.426 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/38 file after the snapshot 2023-11-28T20:41:16.426 INFO:tasks.workunit.client.0.smithi167.stdout: create 266/39 file after the snapshot 2023-11-28T20:41:16.426 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/.snap/snap-subdir-test 2023-11-28T20:41:16.746 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/30 file after the snapshot 2023-11-28T20:41:16.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/31 file after the snapshot 2023-11-28T20:41:16.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/32 file after the snapshot 2023-11-28T20:41:16.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/33 file after the snapshot 2023-11-28T20:41:16.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/34 file after the snapshot 2023-11-28T20:41:16.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/35 file after the snapshot 2023-11-28T20:41:16.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/36 file after the snapshot 2023-11-28T20:41:16.749 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/37 file after the snapshot 2023-11-28T20:41:16.750 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/38 file after the snapshot 2023-11-28T20:41:16.750 INFO:tasks.workunit.client.0.smithi167.stdout: create 267/39 file after the snapshot 2023-11-28T20:41:16.750 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/.snap/snap-subdir-test 2023-11-28T20:41:16.776 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/30 file after the snapshot 2023-11-28T20:41:16.777 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/31 file after the snapshot 2023-11-28T20:41:16.778 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/32 file after the snapshot 2023-11-28T20:41:16.778 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/33 file after the snapshot 2023-11-28T20:41:16.778 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/34 file after the snapshot 2023-11-28T20:41:16.778 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/35 file after the snapshot 2023-11-28T20:41:16.778 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/36 file after the snapshot 2023-11-28T20:41:16.778 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/37 file after the snapshot 2023-11-28T20:41:16.778 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/38 file after the snapshot 2023-11-28T20:41:16.778 INFO:tasks.workunit.client.0.smithi167.stdout: create 268/39 file after the snapshot 2023-11-28T20:41:16.778 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/.snap/snap-subdir-test 2023-11-28T20:41:16.809 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/30 file after the snapshot 2023-11-28T20:41:16.811 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/31 file after the snapshot 2023-11-28T20:41:16.811 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/32 file after the snapshot 2023-11-28T20:41:16.811 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/33 file after the snapshot 2023-11-28T20:41:16.811 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/34 file after the snapshot 2023-11-28T20:41:16.811 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/35 file after the snapshot 2023-11-28T20:41:16.811 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/36 file after the snapshot 2023-11-28T20:41:16.811 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/37 file after the snapshot 2023-11-28T20:41:16.811 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/38 file after the snapshot 2023-11-28T20:41:16.811 INFO:tasks.workunit.client.0.smithi167.stdout: create 269/39 file after the snapshot 2023-11-28T20:41:16.812 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/.snap/snap-subdir-test 2023-11-28T20:41:16.830 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/30 file after the snapshot 2023-11-28T20:41:16.834 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/31 file after the snapshot 2023-11-28T20:41:16.834 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/32 file after the snapshot 2023-11-28T20:41:16.834 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/33 file after the snapshot 2023-11-28T20:41:16.834 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/34 file after the snapshot 2023-11-28T20:41:16.834 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/35 file after the snapshot 2023-11-28T20:41:16.834 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/36 file after the snapshot 2023-11-28T20:41:16.834 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/37 file after the snapshot 2023-11-28T20:41:16.835 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/38 file after the snapshot 2023-11-28T20:41:16.835 INFO:tasks.workunit.client.0.smithi167.stdout: create 270/39 file after the snapshot 2023-11-28T20:41:16.835 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/.snap/snap-subdir-test 2023-11-28T20:41:16.871 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/30 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/31 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/32 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/33 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/34 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/35 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/36 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/37 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/38 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 271/39 file after the snapshot 2023-11-28T20:41:16.873 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/.snap/snap-subdir-test 2023-11-28T20:41:16.926 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/30 file after the snapshot 2023-11-28T20:41:16.929 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/31 file after the snapshot 2023-11-28T20:41:16.929 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/32 file after the snapshot 2023-11-28T20:41:16.929 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/33 file after the snapshot 2023-11-28T20:41:16.929 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/34 file after the snapshot 2023-11-28T20:41:16.929 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/35 file after the snapshot 2023-11-28T20:41:16.929 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/36 file after the snapshot 2023-11-28T20:41:16.929 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/37 file after the snapshot 2023-11-28T20:41:16.929 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/38 file after the snapshot 2023-11-28T20:41:16.930 INFO:tasks.workunit.client.0.smithi167.stdout: create 272/39 file after the snapshot 2023-11-28T20:41:16.930 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/.snap/snap-subdir-test 2023-11-28T20:41:17.083 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/30 file after the snapshot 2023-11-28T20:41:17.335 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/31 file after the snapshot 2023-11-28T20:41:17.336 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/32 file after the snapshot 2023-11-28T20:41:17.336 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/33 file after the snapshot 2023-11-28T20:41:17.336 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/34 file after the snapshot 2023-11-28T20:41:17.336 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/35 file after the snapshot 2023-11-28T20:41:17.336 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/36 file after the snapshot 2023-11-28T20:41:17.336 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/37 file after the snapshot 2023-11-28T20:41:17.336 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/38 file after the snapshot 2023-11-28T20:41:17.336 INFO:tasks.workunit.client.0.smithi167.stdout: create 273/39 file after the snapshot 2023-11-28T20:41:17.336 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/.snap/snap-subdir-test 2023-11-28T20:41:17.359 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/30 file after the snapshot 2023-11-28T20:41:17.361 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/31 file after the snapshot 2023-11-28T20:41:17.361 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/32 file after the snapshot 2023-11-28T20:41:17.361 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/33 file after the snapshot 2023-11-28T20:41:17.361 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/34 file after the snapshot 2023-11-28T20:41:17.361 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/35 file after the snapshot 2023-11-28T20:41:17.361 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/36 file after the snapshot 2023-11-28T20:41:17.361 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/37 file after the snapshot 2023-11-28T20:41:17.361 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/38 file after the snapshot 2023-11-28T20:41:17.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 274/39 file after the snapshot 2023-11-28T20:41:17.362 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/.snap/snap-subdir-test 2023-11-28T20:41:17.389 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/30 file after the snapshot 2023-11-28T20:41:17.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/31 file after the snapshot 2023-11-28T20:41:17.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/32 file after the snapshot 2023-11-28T20:41:17.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/33 file after the snapshot 2023-11-28T20:41:17.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/34 file after the snapshot 2023-11-28T20:41:17.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/35 file after the snapshot 2023-11-28T20:41:17.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/36 file after the snapshot 2023-11-28T20:41:17.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/37 file after the snapshot 2023-11-28T20:41:17.393 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/38 file after the snapshot 2023-11-28T20:41:17.394 INFO:tasks.workunit.client.0.smithi167.stdout: create 275/39 file after the snapshot 2023-11-28T20:41:17.394 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/.snap/snap-subdir-test 2023-11-28T20:41:17.446 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/30 file after the snapshot 2023-11-28T20:41:17.449 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/31 file after the snapshot 2023-11-28T20:41:17.449 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/32 file after the snapshot 2023-11-28T20:41:17.450 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/33 file after the snapshot 2023-11-28T20:41:17.450 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/34 file after the snapshot 2023-11-28T20:41:17.450 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/35 file after the snapshot 2023-11-28T20:41:17.450 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/36 file after the snapshot 2023-11-28T20:41:17.450 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/37 file after the snapshot 2023-11-28T20:41:17.450 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/38 file after the snapshot 2023-11-28T20:41:17.450 INFO:tasks.workunit.client.0.smithi167.stdout: create 276/39 file after the snapshot 2023-11-28T20:41:17.450 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/.snap/snap-subdir-test 2023-11-28T20:41:17.499 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/30 file after the snapshot 2023-11-28T20:41:17.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/31 file after the snapshot 2023-11-28T20:41:17.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/32 file after the snapshot 2023-11-28T20:41:17.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/33 file after the snapshot 2023-11-28T20:41:17.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/34 file after the snapshot 2023-11-28T20:41:17.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/35 file after the snapshot 2023-11-28T20:41:17.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/36 file after the snapshot 2023-11-28T20:41:17.504 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/37 file after the snapshot 2023-11-28T20:41:17.504 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/38 file after the snapshot 2023-11-28T20:41:17.504 INFO:tasks.workunit.client.0.smithi167.stdout: create 277/39 file after the snapshot 2023-11-28T20:41:17.504 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/.snap/snap-subdir-test 2023-11-28T20:41:17.530 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/30 file after the snapshot 2023-11-28T20:41:17.533 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/31 file after the snapshot 2023-11-28T20:41:17.534 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/32 file after the snapshot 2023-11-28T20:41:17.534 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/33 file after the snapshot 2023-11-28T20:41:17.534 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/34 file after the snapshot 2023-11-28T20:41:17.534 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/35 file after the snapshot 2023-11-28T20:41:17.534 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/36 file after the snapshot 2023-11-28T20:41:17.534 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/37 file after the snapshot 2023-11-28T20:41:17.534 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/38 file after the snapshot 2023-11-28T20:41:17.534 INFO:tasks.workunit.client.0.smithi167.stdout: create 278/39 file after the snapshot 2023-11-28T20:41:17.534 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/.snap/snap-subdir-test 2023-11-28T20:41:18.173 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/30 file after the snapshot 2023-11-28T20:41:18.763 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/31 file after the snapshot 2023-11-28T20:41:18.763 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/32 file after the snapshot 2023-11-28T20:41:18.763 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/33 file after the snapshot 2023-11-28T20:41:18.763 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/34 file after the snapshot 2023-11-28T20:41:18.763 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/35 file after the snapshot 2023-11-28T20:41:18.763 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/36 file after the snapshot 2023-11-28T20:41:18.763 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/37 file after the snapshot 2023-11-28T20:41:18.764 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/38 file after the snapshot 2023-11-28T20:41:18.764 INFO:tasks.workunit.client.0.smithi167.stdout: create 279/39 file after the snapshot 2023-11-28T20:41:18.764 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/.snap/snap-subdir-test 2023-11-28T20:41:20.615 INFO:tasks.mon_thrash:Sending CONT to mon b 2023-11-28T20:41:20.616 INFO:tasks.ceph.mon.b:Sent signal 18 2023-11-28T20:41:20.616 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:41:20.616 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:41:20.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c5d716640 1 Processor -- start 2023-11-28T20:41:20.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c5d716640 1 -- start start 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c5d716640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c5d716640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c5d716640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c580c48f0 con 0x7f1c58150b40 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c5d716640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c580c62f0 con 0x7f1c580c6ff0 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c5d716640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c580c6ac0 con 0x7f1c580c4510 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c567fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c567fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42114/0 (socket says 172.21.15.167:42114) 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c567fc640 1 -- 172.21.15.167:0/2744465080 learned_addr learned my addr 172.21.15.167:0/2744465080 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c567fc640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 msgr2=0x7f1c58157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:41:20.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c567fc640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 msgr2=0x7f1c58157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:41:20.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:41:20.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:41:20.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:20.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 msgr2=0x7f1c5806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:41:20.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 msgr2=0x7f1c5806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:41:20.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:41:20.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.786+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:41:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c567fc640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 msgr2=0x7f1c58157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:41:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c567fc640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 msgr2=0x7f1c58157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:41:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:41:20.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:20.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:41:20.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 msgr2=0x7f1c5806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:41:20.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 msgr2=0x7f1c5806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:41:20.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:41:20.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:20.990+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:41:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c567fc640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 msgr2=0x7f1c58157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:41:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c567fc640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 msgr2=0x7f1c58157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:41:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:41:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:21.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:41:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 msgr2=0x7f1c5806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:41:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 msgr2=0x7f1c5806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:41:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:41:21.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:21.394+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:41:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c567fc640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 msgr2=0x7f1c58157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:41:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c567fc640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 msgr2=0x7f1c58157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:41:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:41:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:41:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 msgr2=0x7f1c5806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:41:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 msgr2=0x7f1c5806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:41:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:41:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:22.198+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:41:23.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c54ff9640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 msgr2=0x7f1c5806a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:41:23.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c54ff9640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.178:3300/0 conn(0x7f1c580c4510 0x7f1c5806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:23.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c54ff9640 1 -- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 msgr2=0x7f1c58157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:41:23.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c54ff9640 1 --2- 172.21.15.167:0/2744465080 >> v2:172.21.15.167:3300/0 conn(0x7f1c580c6ff0 0x7f1c58157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:23.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c54ff9640 1 -- 172.21.15.167:0/2744465080 >> v1:172.21.15.167:6789/0 conn(0x7f1c58150b40 legacy=0x7f1c580c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:23.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c54ff9640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c44005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:23.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c54ff9640 1 -- 172.21.15.167:0/2744465080 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c580c6500 con 0x7f1c44006160 2023-11-28T20:41:23.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c54ff9640 1 -- 172.21.15.167:0/2744465080 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580c62f0 con 0x7f1c440036a0 2023-11-28T20:41:23.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c56ffd640 1 -- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 msgr2=0x7f1c44005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:41:23.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.786+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:41:23.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.990+0000 7f1c56ffd640 1 -- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 msgr2=0x7f1c44005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:41:23.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:23.990+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:41:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:24.394+0000 7f1c56ffd640 1 -- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 msgr2=0x7f1c44005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:41:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:24.394+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:41:25.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.198+0000 7f1c56ffd640 1 -- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 msgr2=0x7f1c44005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:41:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.198+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:41:25.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.654+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913845440 0 0) 0x7f1c580c6500 con 0x7f1c44006160 2023-11-28T20:41:25.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.654+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c40003530 con 0x7f1c44006160 2023-11-28T20:41:25.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2422770367 0 0) 0x7f1c40003530 con 0x7f1c44006160 2023-11-28T20:41:25.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 msgr2=0x7f1c44005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:41:25.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c44005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4400af50 con 0x7f1c44006160 2023-11-28T20:41:25.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f1c4c00c570 con 0x7f1c44006160 2023-11-28T20:41:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 >> v1:172.21.15.178:6789/0 conn(0x7f1c44006160 legacy=0x7f1c44008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 reap_dead start 2023-11-28T20:41:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c40003980 0x7f1c40003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 0x7f1c40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c580c62f0 con 0x7f1c40003980 2023-11-28T20:41:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40005530 con 0x7f1c400047d0 2023-11-28T20:41:25.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4000bed0 con 0x7f1c440036a0 2023-11-28T20:41:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c577fe640 1 -- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 msgr2=0x7f1c4000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:41:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c577fe640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c4000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:41:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c40003980 0x7f1c40003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c567fc640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 0x7f1c40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c56ffd640 1 -- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 msgr2=0x7f1c4000b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:41:25.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c4000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c56ffd640 1 -- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 msgr2=0x7f1c40004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:41:25.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 0x7f1c40004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.662+0000 7f1c56ffd640 1 -- 172.21.15.167:0/2744465080 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c40003530 con 0x7f1c40003980 2023-11-28T20:41:25.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c40003980 0x7f1c40003d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1c48001b10 tx=0x7f1c4801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b3dcf54e0feade server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:25.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c48004220 con 0x7f1c40003980 2023-11-28T20:41:25.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c48004380 con 0x7f1c40003980 2023-11-28T20:41:25.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c55ffb640 1 -- 172.21.15.167:0/2744465080 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c480044f0 con 0x7f1c40003980 2023-11-28T20:41:25.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c5d716640 1 -- 172.21.15.167:0/2744465080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c40003980 msgr2=0x7f1c40003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:25.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c5d716640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c40003980 0x7f1c40003d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1c48001b10 tx=0x7f1c4801c760 comp rx=0 tx=0).stop 2023-11-28T20:41:25.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c5d716640 1 -- 172.21.15.167:0/2744465080 shutdown_connections 2023-11-28T20:41:25.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c5d716640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 0x7f1c40004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c5d716640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c40003980 0x7f1c40003d80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c5d716640 1 --2- 172.21.15.167:0/2744465080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c440036a0 0x7f1c4000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c5d716640 1 -- 172.21.15.167:0/2744465080 >> 172.21.15.167:0/2744465080 conn(0x7f1c580cb1e0 msgr2=0x7f1c580cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:25.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c5d716640 1 -- 172.21.15.167:0/2744465080 shutdown_connections 2023-11-28T20:41:25.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.666+0000 7f1c5d716640 1 -- 172.21.15.167:0/2744465080 wait complete. 2023-11-28T20:41:25.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 Processor -- start 2023-11-28T20:41:25.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 -- start start 2023-11-28T20:41:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c40003980 0x7f1c58143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 0x7f1c58071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c440036a0 0x7f1c5813fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c581403a0 con 0x7f1c440036a0 2023-11-28T20:41:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c58145cc0 con 0x7f1c400047d0 2023-11-28T20:41:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c58149c20 con 0x7f1c40003980 2023-11-28T20:41:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c56ffd640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c40003980 msgr2=0x7f1c58143460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:41:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c577fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c440036a0 0x7f1c5813fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c56ffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c40003980 0x7f1c58143460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:41:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c577fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c440036a0 0x7f1c5813fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45452/0 (socket says 172.21.15.167:45452) 2023-11-28T20:41:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c577fe640 1 -- 172.21.15.167:0/1486784132 learned_addr learned my addr 172.21.15.167:0/1486784132 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c567fc640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 0x7f1c58071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c577fe640 1 -- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c40003980 msgr2=0x7f1c58143460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:41:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c577fe640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c40003980 0x7f1c58143460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c577fe640 1 -- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 msgr2=0x7f1c58071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c577fe640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 0x7f1c58071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c577fe640 1 -- 172.21.15.167:0/1486784132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58149010 con 0x7f1c440036a0 2023-11-28T20:41:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c577fe640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c440036a0 0x7f1c5813fe60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1c580c2580 tx=0x7f1c5000ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c3f7fe640 1 -- 172.21.15.167:0/1486784132 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50011cb0 con 0x7f1c440036a0 2023-11-28T20:41:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c3f7fe640 1 -- 172.21.15.167:0/1486784132 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5000f040 con 0x7f1c440036a0 2023-11-28T20:41:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c58149960 con 0x7f1c440036a0 2023-11-28T20:41:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c3f7fe640 1 -- 172.21.15.167:0/1486784132 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50017460 con 0x7f1c440036a0 2023-11-28T20:41:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.670+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c581492b0 con 0x7f1c440036a0 2023-11-28T20:41:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.674+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c580682c0 con 0x7f1c440036a0 2023-11-28T20:41:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.674+0000 7f1c3f7fe640 1 -- 172.21.15.167:0/1486784132 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1c500175c0 con 0x7f1c440036a0 2023-11-28T20:41:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.674+0000 7f1c3f7fe640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c440699f0 0x7f1c4406beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.674+0000 7f1c3f7fe640 1 -- 172.21.15.167:0/1486784132 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1c50085ae0 con 0x7f1c440036a0 2023-11-28T20:41:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.674+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c440699f0 0x7f1c4406beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.678+0000 7f1c56ffd640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c440699f0 0x7f1c4406beb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1c580c25b0 tx=0x7f1c48001540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.678+0000 7f1c3f7fe640 1 -- 172.21.15.167:0/1486784132 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c50052b50 con 0x7f1c440036a0 2023-11-28T20:41:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1c58075c90 con 0x7f1c440036a0 2023-11-28T20:41:25.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c3f7fe640 1 -- 172.21.15.167:0/1486784132 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f1c50056170 con 0x7f1c440036a0 2023-11-28T20:41:25.887 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":26,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:41:25.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c440699f0 msgr2=0x7f1c4406beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:25.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c440699f0 0x7f1c4406beb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1c580c25b0 tx=0x7f1c48001540 comp rx=0 tx=0).stop 2023-11-28T20:41:25.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c440036a0 msgr2=0x7f1c5813fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:25.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c440036a0 0x7f1c5813fe60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1c580c2580 tx=0x7f1c5000ade0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 shutdown_connections 2023-11-28T20:41:25.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c440699f0 0x7f1c4406beb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c440036a0 0x7f1c5813fe60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c400047d0 0x7f1c58071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 --2- 172.21.15.167:0/1486784132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c40003980 0x7f1c58143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:25.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 >> 172.21.15.167:0/1486784132 conn(0x7f1c580cb1e0 msgr2=0x7f1c58071740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:25.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 shutdown_connections 2023-11-28T20:41:25.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:25.886+0000 7f1c5d716640 1 -- 172.21.15.167:0/1486784132 wait complete. 2023-11-28T20:41:25.908 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:41:25.908 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:41:25.908 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:41:26.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433c217640 1 Processor -- start 2023-11-28T20:41:26.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433c217640 1 -- start start 2023-11-28T20:41:26.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433c217640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f43341585d0 0x7f43340c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433c217640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f43340c7720 0x7f433406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433c217640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433415e5e0 con 0x7f433415e130 2023-11-28T20:41:26.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433c217640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433415f160 con 0x7f43340c7720 2023-11-28T20:41:26.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433c217640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433415e8c0 con 0x7f43341585d0 2023-11-28T20:41:26.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433a7b4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f43340c7720 0x7f433406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f43397b2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f433415e130 0x7f4334161de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:43520/0 (socket says 172.21.15.167:43520) 2023-11-28T20:41:26.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f43397b2640 1 -- 172.21.15.167:0/2714924082 learned_addr learned my addr 172.21.15.167:0/2714924082 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:41:26.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f4339fb3640 1 --2- 172.21.15.167:0/2714924082 >> v2:172.21.15.178:3300/0 conn(0x7f43341585d0 0x7f43340c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433a7b4640 1 -- 172.21.15.167:0/2714924082 >> v2:172.21.15.178:3300/0 conn(0x7f43341585d0 msgr2=0x7f43340c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:41:26.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433a7b4640 1 --2- 172.21.15.167:0/2714924082 >> v2:172.21.15.178:3300/0 conn(0x7f43341585d0 0x7f43340c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433a7b4640 1 -- 172.21.15.167:0/2714924082 >> v1:172.21.15.167:6789/0 conn(0x7f433415e130 legacy=0x7f4334161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f433a7b4640 1 -- 172.21.15.167:0/2714924082 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433415eba0 con 0x7f43340c7720 2023-11-28T20:41:26.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.046+0000 7f4338fb1640 1 -- 172.21.15.167:0/2714924082 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784130754 0 0) 0x7f433415e5e0 con 0x7f433415e130 2023-11-28T20:41:26.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f433a7b4640 1 --2- 172.21.15.167:0/2714924082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340c7720 0x7f433406a580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f43340c5e20 tx=0x7f432c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f8f916ed7084da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f4338fb1640 1 -- 172.21.15.167:0/2714924082 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0a58b0 con 0x7f43340c7720 2023-11-28T20:41:26.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f4338fb1640 1 -- 172.21.15.167:0/2714924082 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c0a5a10 con 0x7f43340c7720 2023-11-28T20:41:26.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f4338fb1640 1 -- 172.21.15.167:0/2714924082 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0a5da0 con 0x7f43340c7720 2023-11-28T20:41:26.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f433c217640 1 -- 172.21.15.167:0/2714924082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340c7720 msgr2=0x7f433406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f433c217640 1 --2- 172.21.15.167:0/2714924082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340c7720 0x7f433406a580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f43340c5e20 tx=0x7f432c01c8e0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f433c217640 1 -- 172.21.15.167:0/2714924082 shutdown_connections 2023-11-28T20:41:26.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f433c217640 1 --2- 172.21.15.167:0/2714924082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340c7720 0x7f433406a580 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f433c217640 1 --2- 172.21.15.167:0/2714924082 >> v2:172.21.15.178:3300/0 conn(0x7f43341585d0 0x7f43340c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f433c217640 1 -- 172.21.15.167:0/2714924082 >> 172.21.15.167:0/2714924082 conn(0x7f43340cb1e0 msgr2=0x7f43340cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:26.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f433c217640 1 -- 172.21.15.167:0/2714924082 shutdown_connections 2023-11-28T20:41:26.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.050+0000 7f433c217640 1 -- 172.21.15.167:0/2714924082 wait complete. 2023-11-28T20:41:26.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 Processor -- start 2023-11-28T20:41:26.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 -- start start 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43340c7720 0x7f433415f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43341585d0 0x7f4334147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f433415e130 0x7f4334160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43341513f0 con 0x7f43341585d0 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43341f7040 con 0x7f433415e130 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43340c4080 con 0x7f43340c7720 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f4339fb3640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43340c7720 msgr2=0x7f433415f2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f43397b2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43341585d0 0x7f4334147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f4339fb3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43340c7720 0x7f433415f2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:41:26.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f43397b2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43341585d0 0x7f4334147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45458/0 (socket says 172.21.15.167:45458) 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f43397b2640 1 -- 172.21.15.167:0/475751204 learned_addr learned my addr 172.21.15.167:0/475751204 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433a7b4640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f433415e130 0x7f4334160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f43397b2640 1 -- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43340c7720 msgr2=0x7f433415f2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f43397b2640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43340c7720 0x7f433415f2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f43397b2640 1 -- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f433415e130 msgr2=0x7f4334160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f43397b2640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f433415e130 0x7f4334160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f43397b2640 1 -- 172.21.15.167:0/475751204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c009a70 con 0x7f43341585d0 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f43397b2640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43341585d0 0x7f4334147d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f432400c520 tx=0x7f432400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240074e0 con 0x7f43341585d0 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324007640 con 0x7f43341585d0 2023-11-28T20:41:26.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240049f0 con 0x7f43341585d0 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43341f6700 con 0x7f43341585d0 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43341f6980 con 0x7f43341585d0 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4334148260 0x7f4334160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4334074770 con 0x7f4334148260 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.054+0000 7f4339fb3640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4334148260 0x7f4334160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f4339fb3640 1 -- 172.21.15.167:0/475751204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f433416b2d0 con 0x7f4334148260 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f4339fb3640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4334148260 0x7f4334160c60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4330000ee0 tx=0x7f433000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433000eed0 con 0x7f4334148260 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4324004b50 con 0x7f43341585d0 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f432a7fc640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4318066540 0x7f4318068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f433000c740 con 0x7f4334148260 2023-11-28T20:41:26.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4334148260 msgr2=0x7f4334160c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f432a7fc640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4334148260 0x7f4334160c60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4330000ee0 tx=0x7f433000eba0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4334148260 msgr2=0x7f4334160c60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:26.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f432a7fc640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4334148260 0x7f4334160c60 secure :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4330000ee0 tx=0x7f433000eba0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4324083430 con 0x7f43341585d0 2023-11-28T20:41:26.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f433a7b4640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4318066540 0x7f4318068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.058+0000 7f433a7b4640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4318066540 0x7f4318068a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f432c0af000 tx=0x7f432c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340caa40 0x7f43341f9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4334068270 con 0x7f43340caa40 2023-11-28T20:41:26.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f4339fb3640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340caa40 0x7f43341f9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f4339fb3640 1 -- 172.21.15.167:0/475751204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4334075c90 con 0x7f43340caa40 2023-11-28T20:41:26.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f4339fb3640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340caa40 0x7f43341f9c70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4330000ee0 tx=0x7f4330004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4330023070 con 0x7f43340caa40 2023-11-28T20:41:26.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4970 (secure 0 0 0) 0x7f433001e2e0 con 0x7f43340caa40 2023-11-28T20:41:26.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340caa40 msgr2=0x7f43341f9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f432a7fc640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340caa40 0x7f43341f9c70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4330000ee0 tx=0x7f4330004740 comp rx=0 tx=0).stop 2023-11-28T20:41:26.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f432a7fc640 1 -- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340caa40 msgr2=0x7f43341f9c70 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:26.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f432a7fc640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43340caa40 0x7f43341f9c70 secure :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4330000ee0 tx=0x7f4330004740 comp rx=0 tx=0).stop 2023-11-28T20:41:26.068 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:41:26.068 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:41:26.068 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:41:26.068 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:41:26.068 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 26, 2023-11-28T20:41:26.068 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:26.069 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:26.070 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:41:26.071 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:41:26.072 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:26.073 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.075 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.076 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.077 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.078 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:26.079 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:41:26.079 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.079 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:26.079 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:41:26.079 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.079 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.079 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:41:26.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:41:26.081 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:26.082 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.083 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:41:26.084 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:41:26.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4318066540 msgr2=0x7f4318068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4318066540 0x7f4318068a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f432c0af000 tx=0x7f432c0a7070 comp rx=0 tx=0).stop 2023-11-28T20:41:26.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43341585d0 msgr2=0x7f4334147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 --2- 172.21.15.167:0/475751204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43341585d0 0x7f4334147d20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f432400c520 tx=0x7f432400c9e0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433a7b4640 1 -- 172.21.15.167:0/475751204 reap_dead start 2023-11-28T20:41:26.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433a7b4640 1 -- 172.21.15.167:0/475751204 reap_dead start 2023-11-28T20:41:26.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 shutdown_connections 2023-11-28T20:41:26.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 >> 172.21.15.167:0/475751204 conn(0x7f43340cb1e0 msgr2=0x7f433414e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:26.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 shutdown_connections 2023-11-28T20:41:26.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.066+0000 7f433c217640 1 -- 172.21.15.167:0/475751204 wait complete. 2023-11-28T20:41:26.086 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:41:26.086 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:41:26.086 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:41:26.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.222+0000 7f5cc5a79640 1 Processor -- start 2023-11-28T20:41:26.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.222+0000 7f5cc5a79640 1 -- start start 2023-11-28T20:41:26.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cc5a79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc0150b40 0x7f5cc0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cc5a79640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5cc00c4510 0x7f5cc006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cc5a79640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00c4940 con 0x7f5cc00c6ff0 2023-11-28T20:41:26.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cc5a79640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc00c62f0 con 0x7f5cc00c4510 2023-11-28T20:41:26.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cc5a79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00c6ac0 con 0x7f5cc0150b40 2023-11-28T20:41:26.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbf7fe640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc0150b40 msgr2=0x7f5cc0157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:41:26.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbf7fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc0150b40 0x7f5cc0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:41:26.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbeffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f5cc00c6ff0 0x7f5cc00c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:43526/0 (socket says 172.21.15.167:43526) 2023-11-28T20:41:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbeffd640 1 -- 172.21.15.167:0/3698644569 learned_addr learned my addr 172.21.15.167:0/3698644569 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:41:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbffff640 1 --2- 172.21.15.167:0/3698644569 >> v2:172.21.15.178:3300/0 conn(0x7f5cc00c4510 0x7f5cc006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbe7fc640 1 -- 172.21.15.167:0/3698644569 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333155253 0 0) 0x7f5cc00c4940 con 0x7f5cc00c6ff0 2023-11-28T20:41:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbe7fc640 1 -- 172.21.15.167:0/3698644569 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca8003530 con 0x7f5cc00c6ff0 2023-11-28T20:41:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbffff640 1 -- 172.21.15.167:0/3698644569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc0150b40 msgr2=0x7f5cc0157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:41:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbffff640 1 --2- 172.21.15.167:0/3698644569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc0150b40 0x7f5cc0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbffff640 1 -- 172.21.15.167:0/3698644569 >> v1:172.21.15.167:6789/0 conn(0x7f5cc00c6ff0 legacy=0x7f5cc00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbe7fc640 1 -- 172.21.15.167:0/3698644569 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192989950 0 0) 0x7f5ca8003530 con 0x7f5cc00c6ff0 2023-11-28T20:41:26.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.226+0000 7f5cbffff640 1 -- 172.21.15.167:0/3698644569 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00c6500 con 0x7f5cc00c4510 2023-11-28T20:41:26.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cbffff640 1 --2- 172.21.15.167:0/3698644569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc00c4510 0x7f5cc006a580 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009d90 tx=0x7f5cb801c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6565f18d7a14eba8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cbe7fc640 1 -- 172.21.15.167:0/3698644569 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4001680 con 0x7f5cc00c4510 2023-11-28T20:41:26.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cbe7fc640 1 -- 172.21.15.167:0/3698644569 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb80a5570 con 0x7f5cc00c4510 2023-11-28T20:41:26.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cbe7fc640 1 -- 172.21.15.167:0/3698644569 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80a58e0 con 0x7f5cc00c4510 2023-11-28T20:41:26.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3698644569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc00c4510 msgr2=0x7f5cc006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 --2- 172.21.15.167:0/3698644569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc00c4510 0x7f5cc006a580 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009d90 tx=0x7f5cb801c860 comp rx=0 tx=0).stop 2023-11-28T20:41:26.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3698644569 shutdown_connections 2023-11-28T20:41:26.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 --2- 172.21.15.167:0/3698644569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc00c4510 0x7f5cc006a580 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 --2- 172.21.15.167:0/3698644569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc0150b40 0x7f5cc0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3698644569 >> 172.21.15.167:0/3698644569 conn(0x7f5cc00cb1e0 msgr2=0x7f5cc00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:26.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3698644569 shutdown_connections 2023-11-28T20:41:26.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3698644569 wait complete. 2023-11-28T20:41:26.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 Processor -- start 2023-11-28T20:41:26.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.230+0000 7f5cc5a79640 1 -- start start 2023-11-28T20:41:26.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc00c4510 0x7f5cc014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc00c6ff0 0x7f5cc01f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cc0150b40 0x7f5cc0152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0067870 con 0x7f5cc0150b40 2023-11-28T20:41:26.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0151af0 con 0x7f5cc00c6ff0 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc01f2bb0 con 0x7f5cc00c4510 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbf7fe640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc00c4510 msgr2=0x7f5cc014cd90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbf7fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc00c4510 0x7f5cc014cd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cc0150b40 0x7f5cc0152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cc0150b40 0x7f5cc0152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45490/0 (socket says 172.21.15.167:45490) 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbffff640 1 -- 172.21.15.167:0/3870724285 learned_addr learned my addr 172.21.15.167:0/3870724285 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbeffd640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc00c6ff0 0x7f5cc01f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbffff640 1 -- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc00c4510 msgr2=0x7f5cc014cd90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbffff640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc00c4510 0x7f5cc014cd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbffff640 1 -- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc00c6ff0 msgr2=0x7f5cc01f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbffff640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc00c6ff0 0x7f5cc01f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:41:26.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbffff640 1 -- 172.21.15.167:0/3870724285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8009a70 con 0x7f5cc0150b40 2023-11-28T20:41:26.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbeffd640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc00c6ff0 0x7f5cc01f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:41:26.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbffff640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cc0150b40 0x7f5cc0152820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5cb801af10 tx=0x7f5cb8019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8007000 con 0x7f5cc0150b40 2023-11-28T20:41:26.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb80a5e70 con 0x7f5cc0150b40 2023-11-28T20:41:26.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80ad850 con 0x7f5cc0150b40 2023-11-28T20:41:26.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc01f2e90 con 0x7f5cc0150b40 2023-11-28T20:41:26.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc0152020 con 0x7f5cc0150b40 2023-11-28T20:41:26.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc014d2d0 0x7f5cc0152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0074770 con 0x7f5cc014d2d0 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbf7fe640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc014d2d0 0x7f5cc0152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.234+0000 7f5cbf7fe640 1 -- 172.21.15.167:0/3870724285 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cc0157040 con 0x7f5cc014d2d0 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5cb80ad9b0 con 0x7f5cc0150b40 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5cbf7fe640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc014d2d0 0x7f5cc0152d60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000b450 tx=0x7f5cb000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5ca7fff640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5cac066450 0x7f5cac068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5cb811eef0 con 0x7f5cc0150b40 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0003e20 con 0x7f5cc014d2d0 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5cbeffd640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5cac066450 0x7f5cac068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f5cb0005070 con 0x7f5cc014d2d0 2023-11-28T20:41:26.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc014d2d0 msgr2=0x7f5cc0152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5ca7fff640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc014d2d0 0x7f5cc0152d60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000b450 tx=0x7f5cb000b910 comp rx=0 tx=0).stop 2023-11-28T20:41:26.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc014d2d0 msgr2=0x7f5cc0152d60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:26.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5ca7fff640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc014d2d0 0x7f5cc0152d60 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000b450 tx=0x7f5cb000b910 comp rx=0 tx=0).stop 2023-11-28T20:41:26.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.238+0000 7f5cbeffd640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5cac066450 0x7f5cac068910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0067a50 tx=0x7f5cb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.242+0000 7f5cc5a79640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc01f2640 0x7f5cc0159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:41:26.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.242+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00682c0 con 0x7f5cc01f2640 2023-11-28T20:41:26.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.242+0000 7f5cbf7fe640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc01f2640 0x7f5cc0159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:41:26.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cbf7fe640 1 -- 172.21.15.167:0/3870724285 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5cc0075c90 con 0x7f5cc01f2640 2023-11-28T20:41:26.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cbf7fe640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc01f2640 0x7f5cc0159a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000b450 tx=0x7f5cb0005a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:41:26.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb001f070 con 0x7f5cc01f2640 2023-11-28T20:41:26.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4941 (secure 0 0 0) 0x7f5cb0010480 con 0x7f5cc01f2640 2023-11-28T20:41:26.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc01f2640 msgr2=0x7f5cc0159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5ca7fff640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc01f2640 0x7f5cc0159a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000b450 tx=0x7f5cb0005a30 comp rx=0 tx=0).stop 2023-11-28T20:41:26.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5ca7fff640 1 -- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc01f2640 msgr2=0x7f5cc0159a50 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:41:26.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5ca7fff640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc01f2640 0x7f5cc0159a50 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000b450 tx=0x7f5cb0005a30 comp rx=0 tx=0).stop 2023-11-28T20:41:26.248 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:41:26.248 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:41:26.248 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:41:26.248 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:41:26.248 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 26, 2023-11-28T20:41:26.248 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:26.249 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:41:26.250 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:26.251 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:41:26.252 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:41:26.253 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:41:26.254 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:41:26.254 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:41:26.254 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:41:26.254 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:41:26.254 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:41:26.254 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:41:26.254 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:41:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.258 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:26.258 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:41:26.258 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.258 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.258 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.258 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:41:26.261 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:41:26.261 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:26.261 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:26.261 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:26.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.261 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.262 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.263 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.264 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.265 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:41:26.266 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:41:26.267 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:41:26.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:41:26.267 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:41:26.267 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:41:26.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5cac066450 msgr2=0x7f5cac068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cc5a79640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5cac066450 0x7f5cac068910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0067a50 tx=0x7f5cb4009040 comp rx=0 tx=0).stop 2023-11-28T20:41:26.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cc0150b40 msgr2=0x7f5cc0152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:41:26.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cc5a79640 1 --2- 172.21.15.167:0/3870724285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cc0150b40 0x7f5cc0152820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5cb801af10 tx=0x7f5cb8019600 comp rx=0 tx=0).stop 2023-11-28T20:41:26.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cbffff640 1 -- 172.21.15.167:0/3870724285 reap_dead start 2023-11-28T20:41:26.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cbffff640 1 -- 172.21.15.167:0/3870724285 reap_dead start 2023-11-28T20:41:26.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 shutdown_connections 2023-11-28T20:41:26.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 >> 172.21.15.167:0/3870724285 conn(0x7f5cc00cb1e0 msgr2=0x7f5cc015ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:41:26.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 shutdown_connections 2023-11-28T20:41:26.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:41:26.246+0000 7f5cc5a79640 1 -- 172.21.15.167:0/3870724285 wait complete. 2023-11-28T20:41:26.269 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:41:26.270 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:41:27.275 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/30 file after the snapshot 2023-11-28T20:41:27.277 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/31 file after the snapshot 2023-11-28T20:41:27.277 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/32 file after the snapshot 2023-11-28T20:41:27.277 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/33 file after the snapshot 2023-11-28T20:41:27.277 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/34 file after the snapshot 2023-11-28T20:41:27.277 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/35 file after the snapshot 2023-11-28T20:41:27.277 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/36 file after the snapshot 2023-11-28T20:41:27.277 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/37 file after the snapshot 2023-11-28T20:41:27.277 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/38 file after the snapshot 2023-11-28T20:41:27.278 INFO:tasks.workunit.client.0.smithi167.stdout: create 280/39 file after the snapshot 2023-11-28T20:41:27.278 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/.snap/snap-subdir-test 2023-11-28T20:41:27.289 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/30 file after the snapshot 2023-11-28T20:41:27.291 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/31 file after the snapshot 2023-11-28T20:41:27.291 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/32 file after the snapshot 2023-11-28T20:41:27.291 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/33 file after the snapshot 2023-11-28T20:41:27.292 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/34 file after the snapshot 2023-11-28T20:41:27.292 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/35 file after the snapshot 2023-11-28T20:41:27.292 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/36 file after the snapshot 2023-11-28T20:41:27.292 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/37 file after the snapshot 2023-11-28T20:41:27.292 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/38 file after the snapshot 2023-11-28T20:41:27.292 INFO:tasks.workunit.client.0.smithi167.stdout: create 281/39 file after the snapshot 2023-11-28T20:41:27.292 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/.snap/snap-subdir-test 2023-11-28T20:41:27.304 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/30 file after the snapshot 2023-11-28T20:41:27.306 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/31 file after the snapshot 2023-11-28T20:41:27.306 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/32 file after the snapshot 2023-11-28T20:41:27.306 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/33 file after the snapshot 2023-11-28T20:41:27.306 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/34 file after the snapshot 2023-11-28T20:41:27.307 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/35 file after the snapshot 2023-11-28T20:41:27.307 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/36 file after the snapshot 2023-11-28T20:41:27.307 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/37 file after the snapshot 2023-11-28T20:41:27.307 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/38 file after the snapshot 2023-11-28T20:41:27.307 INFO:tasks.workunit.client.0.smithi167.stdout: create 282/39 file after the snapshot 2023-11-28T20:41:27.307 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/.snap/snap-subdir-test 2023-11-28T20:41:27.327 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/30 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/31 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/32 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/33 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/34 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/35 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/36 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/37 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/38 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 283/39 file after the snapshot 2023-11-28T20:41:27.329 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/.snap/snap-subdir-test 2023-11-28T20:41:27.350 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/30 file after the snapshot 2023-11-28T20:41:27.352 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/31 file after the snapshot 2023-11-28T20:41:27.352 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/32 file after the snapshot 2023-11-28T20:41:27.352 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/33 file after the snapshot 2023-11-28T20:41:27.352 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/34 file after the snapshot 2023-11-28T20:41:27.352 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/35 file after the snapshot 2023-11-28T20:41:27.352 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/36 file after the snapshot 2023-11-28T20:41:27.352 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/37 file after the snapshot 2023-11-28T20:41:27.353 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/38 file after the snapshot 2023-11-28T20:41:27.353 INFO:tasks.workunit.client.0.smithi167.stdout: create 284/39 file after the snapshot 2023-11-28T20:41:27.353 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/.snap/snap-subdir-test 2023-11-28T20:41:27.374 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/30 file after the snapshot 2023-11-28T20:41:27.375 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/31 file after the snapshot 2023-11-28T20:41:27.375 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/32 file after the snapshot 2023-11-28T20:41:27.375 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/33 file after the snapshot 2023-11-28T20:41:27.375 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/34 file after the snapshot 2023-11-28T20:41:27.376 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/35 file after the snapshot 2023-11-28T20:41:27.376 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/36 file after the snapshot 2023-11-28T20:41:27.376 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/37 file after the snapshot 2023-11-28T20:41:27.376 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/38 file after the snapshot 2023-11-28T20:41:27.376 INFO:tasks.workunit.client.0.smithi167.stdout: create 285/39 file after the snapshot 2023-11-28T20:41:27.376 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/.snap/snap-subdir-test 2023-11-28T20:41:27.405 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/30 file after the snapshot 2023-11-28T20:41:27.407 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/31 file after the snapshot 2023-11-28T20:41:27.407 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/32 file after the snapshot 2023-11-28T20:41:27.408 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/33 file after the snapshot 2023-11-28T20:41:27.408 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/34 file after the snapshot 2023-11-28T20:41:27.408 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/35 file after the snapshot 2023-11-28T20:41:27.408 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/36 file after the snapshot 2023-11-28T20:41:27.408 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/37 file after the snapshot 2023-11-28T20:41:27.408 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/38 file after the snapshot 2023-11-28T20:41:27.408 INFO:tasks.workunit.client.0.smithi167.stdout: create 286/39 file after the snapshot 2023-11-28T20:41:27.408 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/.snap/snap-subdir-test 2023-11-28T20:41:27.431 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/30 file after the snapshot 2023-11-28T20:41:27.433 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/31 file after the snapshot 2023-11-28T20:41:27.433 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/32 file after the snapshot 2023-11-28T20:41:27.433 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/33 file after the snapshot 2023-11-28T20:41:27.434 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/34 file after the snapshot 2023-11-28T20:41:27.434 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/35 file after the snapshot 2023-11-28T20:41:27.434 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/36 file after the snapshot 2023-11-28T20:41:27.434 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/37 file after the snapshot 2023-11-28T20:41:27.434 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/38 file after the snapshot 2023-11-28T20:41:27.434 INFO:tasks.workunit.client.0.smithi167.stdout: create 287/39 file after the snapshot 2023-11-28T20:41:27.434 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/.snap/snap-subdir-test 2023-11-28T20:41:27.463 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/30 file after the snapshot 2023-11-28T20:41:27.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/31 file after the snapshot 2023-11-28T20:41:27.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/32 file after the snapshot 2023-11-28T20:41:27.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/33 file after the snapshot 2023-11-28T20:41:27.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/34 file after the snapshot 2023-11-28T20:41:27.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/35 file after the snapshot 2023-11-28T20:41:27.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/36 file after the snapshot 2023-11-28T20:41:27.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/37 file after the snapshot 2023-11-28T20:41:27.465 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/38 file after the snapshot 2023-11-28T20:41:27.466 INFO:tasks.workunit.client.0.smithi167.stdout: create 288/39 file after the snapshot 2023-11-28T20:41:27.466 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/.snap/snap-subdir-test 2023-11-28T20:41:27.503 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/30 file after the snapshot 2023-11-28T20:41:27.505 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/31 file after the snapshot 2023-11-28T20:41:27.505 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/32 file after the snapshot 2023-11-28T20:41:27.505 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/33 file after the snapshot 2023-11-28T20:41:27.505 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/34 file after the snapshot 2023-11-28T20:41:27.505 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/35 file after the snapshot 2023-11-28T20:41:27.506 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/36 file after the snapshot 2023-11-28T20:41:27.506 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/37 file after the snapshot 2023-11-28T20:41:27.506 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/38 file after the snapshot 2023-11-28T20:41:27.506 INFO:tasks.workunit.client.0.smithi167.stdout: create 289/39 file after the snapshot 2023-11-28T20:41:27.507 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/.snap/snap-subdir-test 2023-11-28T20:41:27.536 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/30 file after the snapshot 2023-11-28T20:41:27.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/31 file after the snapshot 2023-11-28T20:41:27.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/32 file after the snapshot 2023-11-28T20:41:27.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/33 file after the snapshot 2023-11-28T20:41:27.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/34 file after the snapshot 2023-11-28T20:41:27.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/35 file after the snapshot 2023-11-28T20:41:27.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/36 file after the snapshot 2023-11-28T20:41:27.539 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/37 file after the snapshot 2023-11-28T20:41:27.540 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/38 file after the snapshot 2023-11-28T20:41:27.540 INFO:tasks.workunit.client.0.smithi167.stdout: create 290/39 file after the snapshot 2023-11-28T20:41:27.540 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/.snap/snap-subdir-test 2023-11-28T20:41:29.885 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/30 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/31 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/32 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/33 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/34 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/35 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/36 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/37 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/38 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 291/39 file after the snapshot 2023-11-28T20:41:29.888 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/.snap/snap-subdir-test 2023-11-28T20:41:29.920 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/30 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/31 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/32 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/33 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/34 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/35 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/36 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/37 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/38 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 292/39 file after the snapshot 2023-11-28T20:41:29.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/.snap/snap-subdir-test 2023-11-28T20:41:30.049 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/30 file after the snapshot 2023-11-28T20:41:30.052 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/31 file after the snapshot 2023-11-28T20:41:30.052 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/32 file after the snapshot 2023-11-28T20:41:30.052 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/33 file after the snapshot 2023-11-28T20:41:30.052 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/34 file after the snapshot 2023-11-28T20:41:30.052 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/35 file after the snapshot 2023-11-28T20:41:30.052 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/36 file after the snapshot 2023-11-28T20:41:30.052 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/37 file after the snapshot 2023-11-28T20:41:30.053 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/38 file after the snapshot 2023-11-28T20:41:30.053 INFO:tasks.workunit.client.0.smithi167.stdout: create 293/39 file after the snapshot 2023-11-28T20:41:30.053 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/.snap/snap-subdir-test 2023-11-28T20:41:30.089 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/30 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/31 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/32 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/33 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/34 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/35 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/36 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/37 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/38 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 294/39 file after the snapshot 2023-11-28T20:41:30.092 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/.snap/snap-subdir-test 2023-11-28T20:41:30.147 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/30 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/31 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/32 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/33 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/34 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/35 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/36 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/37 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/38 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 295/39 file after the snapshot 2023-11-28T20:41:30.150 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/.snap/snap-subdir-test 2023-11-28T20:41:30.653 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/30 file after the snapshot 2023-11-28T20:41:30.656 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/31 file after the snapshot 2023-11-28T20:41:30.656 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/32 file after the snapshot 2023-11-28T20:41:30.656 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/33 file after the snapshot 2023-11-28T20:41:30.656 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/34 file after the snapshot 2023-11-28T20:41:30.656 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/35 file after the snapshot 2023-11-28T20:41:30.656 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/36 file after the snapshot 2023-11-28T20:41:30.656 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/37 file after the snapshot 2023-11-28T20:41:30.656 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/38 file after the snapshot 2023-11-28T20:41:30.656 INFO:tasks.workunit.client.0.smithi167.stdout: create 296/39 file after the snapshot 2023-11-28T20:41:30.657 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/.snap/snap-subdir-test 2023-11-28T20:41:30.871 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/30 file after the snapshot 2023-11-28T20:41:30.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/31 file after the snapshot 2023-11-28T20:41:30.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/32 file after the snapshot 2023-11-28T20:41:30.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/33 file after the snapshot 2023-11-28T20:41:30.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/34 file after the snapshot 2023-11-28T20:41:30.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/35 file after the snapshot 2023-11-28T20:41:30.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/36 file after the snapshot 2023-11-28T20:41:30.874 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/37 file after the snapshot 2023-11-28T20:41:30.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/38 file after the snapshot 2023-11-28T20:41:30.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 297/39 file after the snapshot 2023-11-28T20:41:30.875 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/.snap/snap-subdir-test 2023-11-28T20:41:30.922 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/30 file after the snapshot 2023-11-28T20:41:30.925 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/31 file after the snapshot 2023-11-28T20:41:30.925 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/32 file after the snapshot 2023-11-28T20:41:30.925 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/33 file after the snapshot 2023-11-28T20:41:30.925 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/34 file after the snapshot 2023-11-28T20:41:30.925 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/35 file after the snapshot 2023-11-28T20:41:30.925 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/36 file after the snapshot 2023-11-28T20:41:30.925 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/37 file after the snapshot 2023-11-28T20:41:30.925 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/38 file after the snapshot 2023-11-28T20:41:30.925 INFO:tasks.workunit.client.0.smithi167.stdout: create 298/39 file after the snapshot 2023-11-28T20:41:30.926 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/.snap/snap-subdir-test 2023-11-28T20:41:30.960 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/30 file after the snapshot 2023-11-28T20:41:30.961 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/31 file after the snapshot 2023-11-28T20:41:30.962 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/32 file after the snapshot 2023-11-28T20:41:30.962 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/33 file after the snapshot 2023-11-28T20:41:30.962 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/34 file after the snapshot 2023-11-28T20:41:30.962 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/35 file after the snapshot 2023-11-28T20:41:30.962 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/36 file after the snapshot 2023-11-28T20:41:30.962 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/37 file after the snapshot 2023-11-28T20:41:30.962 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/38 file after the snapshot 2023-11-28T20:41:30.962 INFO:tasks.workunit.client.0.smithi167.stdout: create 299/39 file after the snapshot 2023-11-28T20:41:30.962 INFO:tasks.workunit.client.0.smithi167.stdout:Take second snapshot .snap/test2 2023-11-28T20:41:31.246 INFO:tasks.workunit.client.0.smithi167.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2023-11-28T20:41:32.039 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2023-11-28T20:41:32.039 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2023-11-28T20:41:32.039 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2023-11-28T20:41:32.039 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2023-11-28T20:41:32.039 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2023-11-28T20:41:32.039 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2023-11-28T20:41:32.039 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2023-11-28T20:41:32.040 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2023-11-28T20:41:32.041 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2023-11-28T20:41:32.042 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2023-11-28T20:41:32.043 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2023-11-28T20:41:32.044 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2023-11-28T20:41:32.045 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2023-11-28T20:41:32.046 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2023-11-28T20:41:32.630 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2023-11-28T20:41:32.630 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2023-11-28T20:41:32.630 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2023-11-28T20:41:32.630 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2023-11-28T20:41:32.630 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2023-11-28T20:41:32.630 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2023-11-28T20:41:32.630 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2023-11-28T20:41:32.630 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2023-11-28T20:41:32.631 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2023-11-28T20:41:32.632 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2023-11-28T20:41:32.633 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2023-11-28T20:41:32.634 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2023-11-28T20:41:32.635 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2023-11-28T20:41:32.636 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2023-11-28T20:41:34.300 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2023-11-28T20:41:34.301 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2023-11-28T20:41:34.301 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2023-11-28T20:41:34.301 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2023-11-28T20:41:34.301 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2023-11-28T20:41:34.301 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2023-11-28T20:41:34.301 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2023-11-28T20:41:34.301 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2023-11-28T20:41:34.301 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2023-11-28T20:41:34.301 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2023-11-28T20:41:34.302 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2023-11-28T20:41:34.303 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2023-11-28T20:41:34.304 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2023-11-28T20:41:34.305 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2023-11-28T20:41:34.306 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2023-11-28T20:41:34.307 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2023-11-28T20:41:34.308 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2023-11-28T20:41:35.132 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2023-11-28T20:41:35.132 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2023-11-28T20:41:35.132 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2023-11-28T20:41:35.133 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2023-11-28T20:41:35.134 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2023-11-28T20:41:35.135 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2023-11-28T20:41:35.136 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2023-11-28T20:41:35.137 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2023-11-28T20:41:35.138 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2023-11-28T20:41:35.139 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2023-11-28T20:41:35.139 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2023-11-28T20:41:35.139 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2023-11-28T20:41:35.139 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2023-11-28T20:41:35.139 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2023-11-28T20:41:35.139 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2023-11-28T20:41:35.139 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2023-11-28T20:41:35.139 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2023-11-28T20:41:36.275 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2023-11-28T20:41:36.275 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2023-11-28T20:41:36.276 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2023-11-28T20:41:36.277 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2023-11-28T20:41:36.278 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2023-11-28T20:41:36.279 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2023-11-28T20:41:36.280 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2023-11-28T20:41:36.281 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2023-11-28T20:41:36.282 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2023-11-28T20:41:38.815 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2023-11-28T20:41:38.815 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2023-11-28T20:41:38.815 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2023-11-28T20:41:38.815 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2023-11-28T20:41:38.816 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2023-11-28T20:41:38.816 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2023-11-28T20:41:38.816 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2023-11-28T20:41:38.816 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2023-11-28T20:41:38.816 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2023-11-28T20:41:38.816 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2023-11-28T20:41:38.817 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2023-11-28T20:41:38.817 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2023-11-28T20:41:38.817 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2023-11-28T20:41:38.817 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2023-11-28T20:41:38.817 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2023-11-28T20:41:38.817 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2023-11-28T20:41:38.818 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2023-11-28T20:41:38.818 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2023-11-28T20:41:38.818 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2023-11-28T20:41:38.818 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2023-11-28T20:41:38.818 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2023-11-28T20:41:38.819 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2023-11-28T20:41:38.819 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2023-11-28T20:41:38.819 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2023-11-28T20:41:38.819 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2023-11-28T20:41:38.819 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2023-11-28T20:41:38.819 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2023-11-28T20:41:38.820 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2023-11-28T20:41:38.820 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2023-11-28T20:41:38.820 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2023-11-28T20:41:38.820 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2023-11-28T20:41:38.820 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2023-11-28T20:41:38.820 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2023-11-28T20:41:38.820 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2023-11-28T20:41:38.821 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2023-11-28T20:41:38.821 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2023-11-28T20:41:38.821 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2023-11-28T20:41:38.821 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2023-11-28T20:41:38.821 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2023-11-28T20:41:38.821 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2023-11-28T20:41:38.821 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2023-11-28T20:41:38.822 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2023-11-28T20:41:38.822 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2023-11-28T20:41:38.822 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2023-11-28T20:41:38.822 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2023-11-28T20:41:38.822 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2023-11-28T20:41:38.822 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2023-11-28T20:41:38.822 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2023-11-28T20:41:38.823 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2023-11-28T20:41:38.823 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2023-11-28T20:41:38.823 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2023-11-28T20:41:38.823 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2023-11-28T20:41:38.823 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2023-11-28T20:41:38.823 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2023-11-28T20:41:38.823 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2023-11-28T20:41:38.824 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2023-11-28T20:41:38.824 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2023-11-28T20:41:38.824 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2023-11-28T20:41:38.824 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2023-11-28T20:41:38.824 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2023-11-28T20:41:38.824 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2023-11-28T20:41:38.825 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2023-11-28T20:41:38.825 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2023-11-28T20:41:38.825 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2023-11-28T20:41:38.825 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2023-11-28T20:41:38.825 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2023-11-28T20:41:38.825 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2023-11-28T20:41:38.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2023-11-28T20:41:38.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2023-11-28T20:41:38.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2023-11-28T20:41:38.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2023-11-28T20:41:38.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2023-11-28T20:41:38.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2023-11-28T20:41:38.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2023-11-28T20:41:38.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2023-11-28T20:41:38.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2023-11-28T20:41:38.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2023-11-28T20:41:38.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2023-11-28T20:41:38.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2023-11-28T20:41:38.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2023-11-28T20:41:38.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2023-11-28T20:41:39.890 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2023-11-28T20:41:39.890 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2023-11-28T20:41:39.890 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2023-11-28T20:41:39.890 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2023-11-28T20:41:39.891 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2023-11-28T20:41:39.892 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2023-11-28T20:41:39.893 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2023-11-28T20:41:39.894 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2023-11-28T20:41:39.895 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2023-11-28T20:41:39.896 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2023-11-28T20:41:39.897 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2023-11-28T20:41:39.897 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2023-11-28T20:41:39.897 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2023-11-28T20:41:39.897 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2023-11-28T20:41:39.897 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2023-11-28T20:41:39.897 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2023-11-28T20:41:39.897 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2023-11-28T20:41:41.181 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2023-11-28T20:41:41.181 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2023-11-28T20:41:41.181 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2023-11-28T20:41:41.181 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2023-11-28T20:41:41.182 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2023-11-28T20:41:41.183 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2023-11-28T20:41:41.184 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2023-11-28T20:41:41.185 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2023-11-28T20:41:41.186 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2023-11-28T20:41:41.187 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2023-11-28T20:41:41.188 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2023-11-28T20:41:41.188 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2023-11-28T20:41:41.188 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2023-11-28T20:41:44.568 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2023-11-28T20:41:44.568 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2023-11-28T20:41:44.568 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2023-11-28T20:41:44.568 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2023-11-28T20:41:44.569 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2023-11-28T20:41:44.570 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2023-11-28T20:41:44.571 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2023-11-28T20:41:44.572 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2023-11-28T20:41:44.573 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2023-11-28T20:41:44.574 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2023-11-28T20:41:44.575 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2023-11-28T20:41:44.575 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2023-11-28T20:41:44.575 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2023-11-28T20:41:44.575 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2023-11-28T20:41:44.575 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2023-11-28T20:41:44.575 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2023-11-28T20:41:44.575 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2023-11-28T20:41:45.245 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:45.249 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:45.649 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2023-11-28T20:41:45.649 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2023-11-28T20:41:45.649 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2023-11-28T20:41:45.649 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2023-11-28T20:41:45.649 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2023-11-28T20:41:45.649 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2023-11-28T20:41:45.650 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2023-11-28T20:41:45.651 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2023-11-28T20:41:45.652 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2023-11-28T20:41:45.653 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2023-11-28T20:41:45.654 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2023-11-28T20:41:45.655 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2023-11-28T20:41:45.656 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2023-11-28T20:41:45.656 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2023-11-28T20:41:46.270 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:41:46.270 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2023-11-28T20:41:46.270 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:41:46.271 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:41:46.273 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:41:46.273 INFO:tasks.mon_thrash:Sending STOP to mon b 2023-11-28T20:41:46.274 INFO:tasks.ceph.mon.b:Sent signal 19 2023-11-28T20:41:46.274 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2023-11-28T20:41:47.755 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2023-11-28T20:41:47.756 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2023-11-28T20:41:47.757 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2023-11-28T20:41:47.758 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2023-11-28T20:41:47.759 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2023-11-28T20:41:47.760 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2023-11-28T20:41:47.761 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2023-11-28T20:41:47.762 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2023-11-28T20:41:47.763 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2023-11-28T20:41:47.763 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2023-11-28T20:41:47.763 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2023-11-28T20:41:47.763 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2023-11-28T20:41:47.763 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2023-11-28T20:41:50.767 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2023-11-28T20:41:50.767 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2023-11-28T20:41:50.767 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2023-11-28T20:41:50.767 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2023-11-28T20:41:50.767 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2023-11-28T20:41:50.767 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2023-11-28T20:41:50.767 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2023-11-28T20:41:50.767 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2023-11-28T20:41:50.767 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2023-11-28T20:41:50.768 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2023-11-28T20:41:50.769 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2023-11-28T20:41:50.770 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2023-11-28T20:41:50.770 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2023-11-28T20:41:50.770 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2023-11-28T20:41:50.770 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2023-11-28T20:41:50.770 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2023-11-28T20:41:50.770 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2023-11-28T20:41:50.770 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2023-11-28T20:41:50.770 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2023-11-28T20:41:50.770 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2023-11-28T20:41:50.771 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2023-11-28T20:41:50.772 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2023-11-28T20:41:50.773 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2023-11-28T20:41:51.825 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2023-11-28T20:41:51.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2023-11-28T20:41:51.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2023-11-28T20:41:51.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2023-11-28T20:41:51.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2023-11-28T20:41:51.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2023-11-28T20:41:51.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2023-11-28T20:41:51.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2023-11-28T20:41:51.826 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2023-11-28T20:41:51.827 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2023-11-28T20:41:51.828 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2023-11-28T20:41:51.829 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2023-11-28T20:41:51.830 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2023-11-28T20:41:51.831 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2023-11-28T20:41:51.832 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2023-11-28T20:41:51.832 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2023-11-28T20:41:51.832 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2023-11-28T20:41:51.832 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2023-11-28T20:41:51.832 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2023-11-28T20:41:51.832 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2023-11-28T20:41:51.832 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2023-11-28T20:41:51.832 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2023-11-28T20:41:51.833 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2023-11-28T20:41:51.833 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2023-11-28T20:41:51.833 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2023-11-28T20:41:51.833 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2023-11-28T20:41:53.866 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2023-11-28T20:41:53.867 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2023-11-28T20:41:53.868 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2023-11-28T20:41:53.869 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2023-11-28T20:41:53.870 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2023-11-28T20:41:53.871 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2023-11-28T20:41:53.872 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2023-11-28T20:41:53.873 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2023-11-28T20:41:53.873 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2023-11-28T20:41:53.873 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2023-11-28T20:41:53.873 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2023-11-28T20:41:53.873 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2023-11-28T20:41:53.873 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2023-11-28T20:41:53.873 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2023-11-28T20:41:53.873 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2023-11-28T20:41:53.873 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2023-11-28T20:41:55.433 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2023-11-28T20:41:55.434 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2023-11-28T20:41:55.434 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2023-11-28T20:41:55.434 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2023-11-28T20:41:55.434 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2023-11-28T20:41:55.434 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2023-11-28T20:41:55.434 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2023-11-28T20:41:55.434 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2023-11-28T20:41:55.435 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2023-11-28T20:41:55.435 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2023-11-28T20:41:55.435 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2023-11-28T20:41:55.435 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2023-11-28T20:41:55.435 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2023-11-28T20:41:55.435 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2023-11-28T20:41:55.436 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2023-11-28T20:41:55.436 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2023-11-28T20:41:55.436 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2023-11-28T20:41:55.436 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2023-11-28T20:41:55.436 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2023-11-28T20:41:55.436 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2023-11-28T20:41:55.437 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2023-11-28T20:41:55.437 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2023-11-28T20:41:55.437 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2023-11-28T20:41:55.437 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2023-11-28T20:41:55.437 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2023-11-28T20:41:55.437 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2023-11-28T20:41:55.437 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2023-11-28T20:41:55.438 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2023-11-28T20:41:55.438 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2023-11-28T20:41:55.438 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2023-11-28T20:41:55.438 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2023-11-28T20:41:55.438 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2023-11-28T20:41:55.438 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2023-11-28T20:41:55.439 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2023-11-28T20:41:55.439 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2023-11-28T20:41:55.439 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2023-11-28T20:41:55.439 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2023-11-28T20:41:55.439 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2023-11-28T20:41:55.439 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2023-11-28T20:41:55.440 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2023-11-28T20:41:55.440 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2023-11-28T20:41:55.440 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2023-11-28T20:41:55.440 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2023-11-28T20:41:55.440 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2023-11-28T20:41:55.440 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2023-11-28T20:41:55.440 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2023-11-28T20:41:55.441 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2023-11-28T20:41:55.441 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2023-11-28T20:41:55.441 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2023-11-28T20:41:55.441 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2023-11-28T20:41:55.441 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2023-11-28T20:41:55.441 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2023-11-28T20:41:55.442 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2023-11-28T20:41:55.442 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2023-11-28T20:41:55.442 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2023-11-28T20:41:55.442 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2023-11-28T20:41:55.442 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2023-11-28T20:41:55.442 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2023-11-28T20:41:55.443 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2023-11-28T20:41:55.443 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2023-11-28T20:41:55.443 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2023-11-28T20:41:55.443 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2023-11-28T20:41:55.443 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2023-11-28T20:41:55.443 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2023-11-28T20:41:55.444 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2023-11-28T20:41:55.444 INFO:tasks.workunit.client.0.smithi167.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2023-11-28T20:41:55.444 INFO:tasks.workunit.client.0.smithi167.stdout:Take third snapshot .snap/test3 2023-11-28T20:41:55.455 INFO:tasks.workunit.client.0.smithi167.stdout:Delete the snapshots... 2023-11-28T20:42:01.274 INFO:tasks.mon_thrash:Sending CONT to mon b 2023-11-28T20:42:01.275 INFO:tasks.ceph.mon.b:Sent signal 18 2023-11-28T20:42:01.275 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:42:01.275 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:42:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff4143d1640 1 Processor -- start 2023-11-28T20:42:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff4143d1640 1 -- start start 2023-11-28T20:42:01.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff4143d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff40c0c75c0 0x7ff40c0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff4143d1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff40c06a580 0x7ff40c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff4143d1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40c15b220 con 0x7ff40c151f60 2023-11-28T20:42:01.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff4143d1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c0c4da0 con 0x7ff40c06a580 2023-11-28T20:42:01.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff4143d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c2df0 con 0x7ff40c0c75c0 2023-11-28T20:42:01.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41216d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff40c151f60 0x7ff40c0c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55104/0 (socket says 172.21.15.167:55104) 2023-11-28T20:42:01.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41216d640 1 -- 172.21.15.167:0/2704072360 learned_addr learned my addr 172.21.15.167:0/2704072360 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:42:01.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41196c640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff40c0c75c0 0x7ff40c0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41296e640 1 --2- 172.21.15.167:0/2704072360 >> v2:172.21.15.178:3300/0 conn(0x7ff40c06a580 0x7ff40c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882623856 0 0) 0x7ff40c15b220 con 0x7ff40c151f60 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f8003530 con 0x7ff40c151f60 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2995542399 0 0) 0x7ff3f8003530 con 0x7ff40c151f60 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff40c0c75c0 msgr2=0x7ff40c0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff40c0c75c0 0x7ff40c0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 >> v2:172.21.15.178:3300/0 conn(0x7ff40c06a580 msgr2=0x7ff40c06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 --2- 172.21.15.167:0/2704072360 >> v2:172.21.15.178:3300/0 conn(0x7ff40c06a580 0x7ff40c06a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c0c7a20 con 0x7ff40c151f60 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7ff408001680 con 0x7ff40c151f60 2023-11-28T20:42:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 >> v1:172.21.15.167:6789/0 conn(0x7ff40c151f60 legacy=0x7ff40c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff40c0c75c0 0x7ff3f80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3f8003f30 0x7ff3f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004d10 0x7ff3f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c2df0 con 0x7ff3f8003f30 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f800b990 con 0x7ff3f8004d10 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f800bb50 con 0x7ff40c0c75c0 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41196c640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3f8003f30 0x7ff3f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41296e640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004d10 0x7ff3f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.430+0000 7ff41216d640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff40c0c75c0 0x7ff3f80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41196c640 1 -- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff40c0c75c0 msgr2=0x7ff3f80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41196c640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff40c0c75c0 0x7ff3f80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41196c640 1 -- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004d10 msgr2=0x7ff3f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:01.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41196c640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004d10 0x7ff3f8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41196c640 1 -- 172.21.15.167:0/2704072360 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f8003530 con 0x7ff3f8003f30 2023-11-28T20:42:01.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41296e640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004d10 0x7ff3f8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:42:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41196c640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3f8003f30 0x7ff3f80047d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009ae0 tx=0x7ff3fc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96112681a7abcb68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0a5530 con 0x7ff3f8003f30 2023-11-28T20:42:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0a5690 con 0x7ff3f8003f30 2023-11-28T20:42:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41116b640 1 -- 172.21.15.167:0/2704072360 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0a5a40 con 0x7ff3f8003f30 2023-11-28T20:42:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff4143d1640 1 -- 172.21.15.167:0/2704072360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3f8003f30 msgr2=0x7ff3f80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff4143d1640 1 --2- 172.21.15.167:0/2704072360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3f8003f30 0x7ff3f80047d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009ae0 tx=0x7ff3fc01ca50 comp rx=0 tx=0).stop 2023-11-28T20:42:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.434+0000 7ff41296e640 1 -- 172.21.15.167:0/2704072360 reap_dead start 2023-11-28T20:42:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 -- 172.21.15.167:0/2704072360 shutdown_connections 2023-11-28T20:42:01.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 -- 172.21.15.167:0/2704072360 >> 172.21.15.167:0/2704072360 conn(0x7ff40c0cb1e0 msgr2=0x7ff40c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:01.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 -- 172.21.15.167:0/2704072360 shutdown_connections 2023-11-28T20:42:01.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 -- 172.21.15.167:0/2704072360 wait complete. 2023-11-28T20:42:01.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 Processor -- start 2023-11-28T20:42:01.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 -- start start 2023-11-28T20:42:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f8003f30 0x7ff40c157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff40c156ee0 0x7ff40c145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff40c1f6240 0x7ff40c1f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c7290 con 0x7ff40c156ee0 2023-11-28T20:42:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c1f2610 con 0x7ff40c1f6240 2023-11-28T20:42:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff4143d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c157970 con 0x7ff3f8003f30 2023-11-28T20:42:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41196c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff40c156ee0 0x7ff40c145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41196c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff40c156ee0 0x7ff40c145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37170/0 (socket says 172.21.15.167:37170) 2023-11-28T20:42:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41196c640 1 -- 172.21.15.167:0/511121240 learned_addr learned my addr 172.21.15.167:0/511121240 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41296e640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff40c1f6240 0x7ff40c1f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41216d640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f8003f30 0x7ff40c157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41196c640 1 -- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f8003f30 msgr2=0x7ff40c157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41196c640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f8003f30 0x7ff40c157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41196c640 1 -- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff40c1f6240 msgr2=0x7ff40c1f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41196c640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff40c1f6240 0x7ff40c1f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.438+0000 7ff41196c640 1 -- 172.21.15.167:0/511121240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c15bf50 con 0x7ff40c156ee0 2023-11-28T20:42:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff41196c640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff40c156ee0 0x7ff40c145de0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0b0040 tx=0x7ff3f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:01.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff402ffd640 1 -- 172.21.15.167:0/511121240 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc004020 con 0x7ff40c156ee0 2023-11-28T20:42:01.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff402ffd640 1 -- 172.21.15.167:0/511121240 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0041c0 con 0x7ff40c156ee0 2023-11-28T20:42:01.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff402ffd640 1 -- 172.21.15.167:0/511121240 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc003620 con 0x7ff40c156ee0 2023-11-28T20:42:01.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c15c230 con 0x7ff40c156ee0 2023-11-28T20:42:01.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c15c7f0 con 0x7ff40c156ee0 2023-11-28T20:42:01.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c0682c0 con 0x7ff40c156ee0 2023-11-28T20:42:01.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff402ffd640 1 -- 172.21.15.167:0/511121240 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff3fc0b4040 con 0x7ff40c156ee0 2023-11-28T20:42:01.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff402ffd640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3f0066470 0x7ff3f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff402ffd640 1 -- 172.21.15.167:0/511121240 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff3fc11da20 con 0x7ff40c156ee0 2023-11-28T20:42:01.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.442+0000 7ff41216d640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3f0066470 0x7ff3f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.446+0000 7ff41216d640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3f0066470 0x7ff3f0068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff408001060 tx=0x7ff408009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:01.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.446+0000 7ff402ffd640 1 -- 172.21.15.167:0/511121240 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3fc0ea980 con 0x7ff40c156ee0 2023-11-28T20:42:01.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.662+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff40c15c9e0 con 0x7ff40c156ee0 2023-11-28T20:42:01.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.662+0000 7ff402ffd640 1 -- 172.21.15.167:0/511121240 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7ff3fc0be620 con 0x7ff40c156ee0 2023-11-28T20:42:01.665 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3f0066470 msgr2=0x7ff3f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3f0066470 0x7ff3f0068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff408001060 tx=0x7ff408009040 comp rx=0 tx=0).stop 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff40c156ee0 msgr2=0x7ff40c145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff40c156ee0 0x7ff40c145de0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0b0040 tx=0x7ff3f8005800 comp rx=0 tx=0).stop 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 shutdown_connections 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3f0066470 0x7ff3f0068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff40c1f6240 0x7ff40c1f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff40c156ee0 0x7ff40c145de0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 --2- 172.21.15.167:0/511121240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f8003f30 0x7ff40c157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 >> 172.21.15.167:0/511121240 conn(0x7ff40c0cb1e0 msgr2=0x7ff40c144e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:01.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 shutdown_connections 2023-11-28T20:42:01.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.666+0000 7ff4143d1640 1 -- 172.21.15.167:0/511121240 wait complete. 2023-11-28T20:42:01.686 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:42:01.686 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:42:01.686 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:42:01.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd0a6557640 1 Processor -- start 2023-11-28T20:42:01.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd0a6557640 1 -- start start 2023-11-28T20:42:01.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd0a6557640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd0a00c5c90 0x7fd0a01635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd0a6557640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a00c7a50 con 0x7fd0a00c75c0 2023-11-28T20:42:01.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd0a6557640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a015b220 con 0x7fd0a0151f60 2023-11-28T20:42:01.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd0a6557640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00c4da0 con 0x7fd0a00c5c90 2023-11-28T20:42:01.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd0a00c75c0 0x7fd0a006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55120/0 (socket says 172.21.15.167:55120) 2023-11-28T20:42:01.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09f7fe640 1 -- 172.21.15.167:0/1537574746 learned_addr learned my addr 172.21.15.167:0/1537574746 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:42:01.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd0a4af4640 1 --2- 172.21.15.167:0/1537574746 >> v2:172.21.15.178:3300/0 conn(0x7fd0a00c5c90 0x7fd0a01635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217350505 0 0) 0x7fd094001120 con 0x7fd0a00c75c0 2023-11-28T20:42:01.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd088003530 con 0x7fd0a00c75c0 2023-11-28T20:42:01.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1881371165 0 0) 0x7fd088003530 con 0x7fd0a00c75c0 2023-11-28T20:42:01.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 >> v2:172.21.15.178:3300/0 conn(0x7fd0a00c5c90 msgr2=0x7fd0a01635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:01.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 --2- 172.21.15.167:0/1537574746 >> v2:172.21.15.178:3300/0 conn(0x7fd0a00c5c90 0x7fd0a01635c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 >> v1:172.21.15.178:6789/0 conn(0x7fd0a0151f60 legacy=0x7fd0a00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0152340 con 0x7fd0a00c75c0 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fd094001810 con 0x7fd0a00c75c0 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 >> v1:172.21.15.167:6789/0 conn(0x7fd0a00c75c0 legacy=0x7fd0a006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0880039d0 0x7fd088003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0880047d0 0x7fd088004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0880051e0 0x7fd08800fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088010510 con 0x7fd0880039d0 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088010680 con 0x7fd0880047d0 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd088010840 con 0x7fd0880051e0 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09ffff640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0880039d0 0x7fd088003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09f7fe640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0880047d0 0x7fd088004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd0a4af4640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0880051e0 0x7fd08800fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09ffff640 1 -- 172.21.15.167:0/1537574746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0880051e0 msgr2=0x7fd08800fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:01.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09ffff640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0880051e0 0x7fd08800fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09ffff640 1 -- 172.21.15.167:0/1537574746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0880047d0 msgr2=0x7fd088004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:01.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09ffff640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0880047d0 0x7fd088004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09ffff640 1 -- 172.21.15.167:0/1537574746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088003530 con 0x7fd0880039d0 2023-11-28T20:42:01.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd0a4af4640 1 -- 172.21.15.167:0/1537574746 reap_dead start 2023-11-28T20:42:01.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.826+0000 7fd09f7fe640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0880047d0 0x7fd088004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:42:01.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd09ffff640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0880039d0 0x7fd088003df0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd090001750 tx=0x7fd09001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ea3cab3ec1b291 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:01.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0900052d0 con 0x7fd0880039d0 2023-11-28T20:42:01.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0900a7050 con 0x7fd0880039d0 2023-11-28T20:42:01.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd09effd640 1 -- 172.21.15.167:0/1537574746 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090003600 con 0x7fd0880039d0 2023-11-28T20:42:01.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd0a6557640 1 -- 172.21.15.167:0/1537574746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0880039d0 msgr2=0x7fd088003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd0a6557640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0880039d0 0x7fd088003df0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd090001750 tx=0x7fd09001c3c0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd0a6557640 1 -- 172.21.15.167:0/1537574746 shutdown_connections 2023-11-28T20:42:01.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd0a6557640 1 --2- 172.21.15.167:0/1537574746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0880039d0 0x7fd088003df0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd0a6557640 1 -- 172.21.15.167:0/1537574746 >> 172.21.15.167:0/1537574746 conn(0x7fd0a00cb1e0 msgr2=0x7fd0a00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:01.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd0a6557640 1 -- 172.21.15.167:0/1537574746 shutdown_connections 2023-11-28T20:42:01.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.830+0000 7fd0a6557640 1 -- 172.21.15.167:0/1537574746 wait complete. 2023-11-28T20:42:01.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 Processor -- start 2023-11-28T20:42:01.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 -- start start 2023-11-28T20:42:01.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0880039d0 0x7fd0a0158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0157a40 0x7fd0a0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a0154cc0 0x7fd0a01426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0157ea0 con 0x7fd0a0157a40 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0155ac0 con 0x7fd0880039d0 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01575b0 con 0x7fd0a0154cc0 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0157a40 0x7fd0a0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0157a40 0x7fd0a0152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37192/0 (socket says 172.21.15.167:37192) 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09f7fe640 1 -- 172.21.15.167:0/82931169 learned_addr learned my addr 172.21.15.167:0/82931169 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09ffff640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0880039d0 0x7fd0a0158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a4af4640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a0154cc0 0x7fd0a01426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09f7fe640 1 -- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a0154cc0 msgr2=0x7fd0a01426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09f7fe640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a0154cc0 0x7fd0a01426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09f7fe640 1 -- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0880039d0 msgr2=0x7fd0a0158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09f7fe640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0880039d0 0x7fd0a0158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09f7fe640 1 -- 172.21.15.167:0/82931169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a014d980 con 0x7fd0a0157a40 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09f7fe640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0157a40 0x7fd0a0152f00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd094005fd0 tx=0x7fd09400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400c660 con 0x7fd0a0157a40 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09400c7c0 con 0x7fd0a0157a40 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400cb50 con 0x7fd0a0157a40 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a0155d10 con 0x7fd0a0157a40 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.834+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a01562d0 con 0x7fd0a0157a40 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd0a6557640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a01550a0 0x7fd0a0142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0074770 con 0x7fd0a01550a0 2023-11-28T20:42:01.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09ffff640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a01550a0 0x7fd0a0142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09ffff640 1 -- 172.21.15.167:0/82931169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0a015ba30 con 0x7fd0a01550a0 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09ffff640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a01550a0 0x7fd0a0142c00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd090004000 tx=0x7fd088005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090007250 con 0x7fd0a01550a0 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd09400ccb0 con 0x7fd0a0157a40 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09cff9640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd08c066510 0x7fd08c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd094083e80 con 0x7fd0a0157a40 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd0900073b0 con 0x7fd0a01550a0 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a01550a0 msgr2=0x7fd0a0142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09cff9640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a01550a0 0x7fd0a0142c00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd090004000 tx=0x7fd088005800 comp rx=0 tx=0).stop 2023-11-28T20:42:01.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a01550a0 msgr2=0x7fd0a0142c00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:01.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd09cff9640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a01550a0 0x7fd0a0142c00 secure :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd090004000 tx=0x7fd088005800 comp rx=0 tx=0).stop 2023-11-28T20:42:01.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd0a4af4640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd08c066510 0x7fd08c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.838+0000 7fd0a4af4640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd08c066510 0x7fd08c0689d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00c79a0 tx=0x7fd09800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:01.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0156ec0 0x7fd0a01f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:01.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a0143140 con 0x7fd0a0156ec0 2023-11-28T20:42:01.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd09ffff640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0156ec0 0x7fd0a01f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:01.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd09ffff640 1 -- 172.21.15.167:0/82931169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd0a015b750 con 0x7fd0a0156ec0 2023-11-28T20:42:01.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd09ffff640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0156ec0 0x7fd0a01f19d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd09001c400 tx=0x7fd0900a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:01.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0900c5070 con 0x7fd0a0156ec0 2023-11-28T20:42:01.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4981 (secure 0 0 0) 0x7fd0900c02e0 con 0x7fd0a0156ec0 2023-11-28T20:42:01.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0156ec0 msgr2=0x7fd0a01f19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd09cff9640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0156ec0 0x7fd0a01f19d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd09001c400 tx=0x7fd0900a6000 comp rx=0 tx=0).stop 2023-11-28T20:42:01.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd09cff9640 1 -- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0156ec0 msgr2=0x7fd0a01f19d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:01.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd09cff9640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0156ec0 0x7fd0a01f19d0 secure :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd09001c400 tx=0x7fd0900a6000 comp rx=0 tx=0).stop 2023-11-28T20:42:01.848 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:42:01.848 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:01.848 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:01.848 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:42:01.848 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 30, 2023-11-28T20:42:01.848 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:42:01.848 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:42:01.848 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:01.849 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:01.850 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:42:01.851 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:42:01.852 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.853 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.854 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:01.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:01.858 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:01.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:01.860 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:01.861 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:01.862 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:42:01.863 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:42:01.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd08c066510 msgr2=0x7fd08c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd08c066510 0x7fd08c0689d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00c79a0 tx=0x7fd09800b040 comp rx=0 tx=0).stop 2023-11-28T20:42:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0157a40 msgr2=0x7fd0a0152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 --2- 172.21.15.167:0/82931169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0a0157a40 0x7fd0a0152f00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd094005fd0 tx=0x7fd09400ec10 comp rx=0 tx=0).stop 2023-11-28T20:42:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a4af4640 1 -- 172.21.15.167:0/82931169 reap_dead start 2023-11-28T20:42:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a4af4640 1 -- 172.21.15.167:0/82931169 reap_dead start 2023-11-28T20:42:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 shutdown_connections 2023-11-28T20:42:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 >> 172.21.15.167:0/82931169 conn(0x7fd0a00cb1e0 msgr2=0x7fd0a006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 shutdown_connections 2023-11-28T20:42:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:01.846+0000 7fd0a6557640 1 -- 172.21.15.167:0/82931169 wait complete. 2023-11-28T20:42:01.865 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:42:01.866 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:42:01.866 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:42:02.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.002+0000 7f1f893df640 1 Processor -- start 2023-11-28T20:42:02.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.002+0000 7f1f893df640 1 -- start start 2023-11-28T20:42:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f893df640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f840c8010 0x7f1f8415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f893df640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f8406bda0 0x7f1f84066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f893df640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8406a8d0 con 0x7f1f840b0110 2023-11-28T20:42:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f893df640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f840ca230 con 0x7f1f840c8010 2023-11-28T20:42:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f893df640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c8990 con 0x7f1f8406bda0 2023-11-28T20:42:02.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f82ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1f840b0110 0x7f1f8406b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55128/0 (socket says 172.21.15.167:55128) 2023-11-28T20:42:02.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f82ffd640 1 -- 172.21.15.167:0/3708812451 learned_addr learned my addr 172.21.15.167:0/3708812451 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:42:02.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f7a7fc640 1 --2- 172.21.15.167:0/3708812451 >> v2:172.21.15.167:3300/0 conn(0x7f1f840c8010 0x7f1f8415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f837fe640 1 --2- 172.21.15.167:0/3708812451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f8406bda0 0x7f1f84066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f7a7fc640 1 -- 172.21.15.167:0/3708812451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f8406bda0 msgr2=0x7f1f84066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:02.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f7a7fc640 1 --2- 172.21.15.167:0/3708812451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f8406bda0 0x7f1f84066730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f7a7fc640 1 -- 172.21.15.167:0/3708812451 >> v1:172.21.15.167:6789/0 conn(0x7f1f840b0110 legacy=0x7f1f8406b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f7a7fc640 1 -- 172.21.15.167:0/3708812451 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f840ca480 con 0x7f1f840c8010 2023-11-28T20:42:02.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.006+0000 7f1f7a7fc640 1 --2- 172.21.15.167:0/3708812451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f840c8010 0x7f1f8415d3b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097c0 tx=0x7f1f6c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14194f30c30ce60 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f827fc640 1 -- 172.21.15.167:0/3708812451 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0a8970 con 0x7f1f840c8010 2023-11-28T20:42:02.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f827fc640 1 -- 172.21.15.167:0/3708812451 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c0a8ad0 con 0x7f1f840c8010 2023-11-28T20:42:02.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f827fc640 1 -- 172.21.15.167:0/3708812451 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0a8e60 con 0x7f1f840c8010 2023-11-28T20:42:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 -- 172.21.15.167:0/3708812451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f840c8010 msgr2=0x7f1f8415d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 --2- 172.21.15.167:0/3708812451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f840c8010 0x7f1f8415d3b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097c0 tx=0x7f1f6c01ec70 comp rx=0 tx=0).stop 2023-11-28T20:42:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 -- 172.21.15.167:0/3708812451 shutdown_connections 2023-11-28T20:42:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 --2- 172.21.15.167:0/3708812451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f840c8010 0x7f1f8415d3b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 --2- 172.21.15.167:0/3708812451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f8406bda0 0x7f1f84066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 -- 172.21.15.167:0/3708812451 >> 172.21.15.167:0/3708812451 conn(0x7f1f8406ee30 msgr2=0x7f1f8406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 -- 172.21.15.167:0/3708812451 shutdown_connections 2023-11-28T20:42:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 -- 172.21.15.167:0/3708812451 wait complete. 2023-11-28T20:42:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 Processor -- start 2023-11-28T20:42:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 -- start start 2023-11-28T20:42:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8406bda0 0x7f1f84149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f840b0110 0x7f1f840b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c8010 0x7f1f841efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c55a0 con 0x7f1f8406bda0 2023-11-28T20:42:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c4ac0 con 0x7f1f840c8010 2023-11-28T20:42:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f893df640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c6a90 con 0x7f1f840b0110 2023-11-28T20:42:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f82ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8406bda0 0x7f1f84149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f82ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8406bda0 0x7f1f84149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37228/0 (socket says 172.21.15.167:37228) 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.010+0000 7f1f82ffd640 1 -- 172.21.15.167:0/3671270688 learned_addr learned my addr 172.21.15.167:0/3671270688 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7a7fc640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f840b0110 0x7f1f840b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f837fe640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c8010 0x7f1f841efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f82ffd640 1 -- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f840b0110 msgr2=0x7f1f840b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f82ffd640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f840b0110 0x7f1f840b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f82ffd640 1 -- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c8010 msgr2=0x7f1f841efba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f82ffd640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c8010 0x7f1f841efba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f82ffd640 1 -- 172.21.15.167:0/3671270688 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c009420 con 0x7f1f8406bda0 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7a7fc640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f840b0110 0x7f1f840b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f82ffd640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8406bda0 0x7f1f84149290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c500 tx=0x7f1f7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f74005cf0 con 0x7f1f8406bda0 2023-11-28T20:42:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f74005e50 con 0x7f1f8406bda0 2023-11-28T20:42:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f841497d0 con 0x7f1f8406bda0 2023-11-28T20:42:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f740072f0 con 0x7f1f8406bda0 2023-11-28T20:42:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f840b2b60 con 0x7f1f8406bda0 2023-11-28T20:42:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f893df640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c6f00 0x7f1f840c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8406b130 con 0x7f1f840c6f00 2023-11-28T20:42:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7a7fc640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c6f00 0x7f1f840c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7a7fc640 1 -- 172.21.15.167:0/3671270688 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f840ca760 con 0x7f1f840c6f00 2023-11-28T20:42:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f74007450 con 0x7f1f8406bda0 2023-11-28T20:42:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7a7fc640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c6f00 0x7f1f840c6420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f840ce6b0 tx=0x7f1f6c01ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.014+0000 7f1f7bfff640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1f64066470 0x7f1f64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.018+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1f74083730 con 0x7f1f8406bda0 2023-11-28T20:42:02.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.018+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0b0de0 con 0x7f1f840c6f00 2023-11-28T20:42:02.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.018+0000 7f1f837fe640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1f64066470 0x7f1f64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.018+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1f6c0ba470 con 0x7f1f840c6f00 2023-11-28T20:42:02.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.018+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c6f00 msgr2=0x7f1f840c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.018+0000 7f1f7bfff640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c6f00 0x7f1f840c6420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f840ce6b0 tx=0x7f1f6c01ba10 comp rx=0 tx=0).stop 2023-11-28T20:42:02.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.018+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c6f00 msgr2=0x7f1f840c6420 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:02.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.018+0000 7f1f7bfff640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840c6f00 0x7f1f840c6420 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1f840ce6b0 tx=0x7f1f6c01ba10 comp rx=0 tx=0).stop 2023-11-28T20:42:02.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.018+0000 7f1f837fe640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1f64066470 0x7f1f64068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1f840b2310 tx=0x7f1f7c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.022+0000 7f1f893df640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840b1600 0x7f1f840b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.022+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840c6c00 con 0x7f1f840b1600 2023-11-28T20:42:02.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.022+0000 7f1f7a7fc640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840b1600 0x7f1f840b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.022+0000 7f1f7a7fc640 1 -- 172.21.15.167:0/3671270688 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1f840c8f10 con 0x7f1f840b1600 2023-11-28T20:42:02.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f7a7fc640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840b1600 0x7f1f840b1a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097c0 tx=0x7f1f6c0aa000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0bad90 con 0x7f1f840b1600 2023-11-28T20:42:02.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4952 (secure 0 0 0) 0x7f1f6c0d0400 con 0x7f1f840b1600 2023-11-28T20:42:02.026 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:42:02.026 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 30, 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:42:02.027 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:42:02.028 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:42:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:42:02.030 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:02.031 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:02.032 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:02.033 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:02.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.036 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.037 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:02.038 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.039 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:42:02.040 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:42:02.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840b1600 msgr2=0x7f1f840b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f7bfff640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840b1600 0x7f1f840b1a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097c0 tx=0x7f1f6c0aa000 comp rx=0 tx=0).stop 2023-11-28T20:42:02.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f7bfff640 1 -- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840b1600 msgr2=0x7f1f840b1a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:02.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f7bfff640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f840b1600 0x7f1f840b1a10 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0097c0 tx=0x7f1f6c0aa000 comp rx=0 tx=0).stop 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1f64066470 msgr2=0x7f1f64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f893df640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1f64066470 0x7f1f64068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1f840b2310 tx=0x7f1f7c00b040 comp rx=0 tx=0).stop 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8406bda0 msgr2=0x7f1f84149290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f893df640 1 --2- 172.21.15.167:0/3671270688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f8406bda0 0x7f1f84149290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c500 tx=0x7f1f7400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f837fe640 1 -- 172.21.15.167:0/3671270688 reap_dead start 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f837fe640 1 -- 172.21.15.167:0/3671270688 reap_dead start 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 shutdown_connections 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 >> 172.21.15.167:0/3671270688 conn(0x7f1f8406ee30 msgr2=0x7f1f840cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 shutdown_connections 2023-11-28T20:42:02.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.026+0000 7f1f893df640 1 -- 172.21.15.167:0/3671270688 wait complete. 2023-11-28T20:42:02.045 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:42:02.045 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:42:02.045 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:42:02.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.186+0000 7f589ec5a640 1 Processor -- start 2023-11-28T20:42:02.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.186+0000 7f589ec5a640 1 -- start start 2023-11-28T20:42:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589ec5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898150b40 0x7f5898157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589ec5a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f58980c6ff0 0x7f58980c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589ec5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f58980c5be0 0x7f589806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589ec5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58980c6ac0 con 0x7f58980c5be0 2023-11-28T20:42:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589ec5a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58980c6500 con 0x7f58980c6ff0 2023-11-28T20:42:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589ec5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980c67e0 con 0x7f5898150b40 2023-11-28T20:42:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589d1f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f58980c5be0 0x7f589806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589d1f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f58980c5be0 0x7f589806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37230/0 (socket says 172.21.15.167:37230) 2023-11-28T20:42:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589d1f7640 1 -- 172.21.15.167:0/2195390891 learned_addr learned my addr 172.21.15.167:0/2195390891 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589c9f6640 1 --2- 172.21.15.167:0/2195390891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898150b40 0x7f5898157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f588ffff640 1 --2- 172.21.15.167:0/2195390891 >> v2:172.21.15.178:3300/0 conn(0x7f58980c6ff0 0x7f58980c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589d1f7640 1 -- 172.21.15.167:0/2195390891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898150b40 msgr2=0x7f5898157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589d1f7640 1 --2- 172.21.15.167:0/2195390891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898150b40 0x7f5898157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589d1f7640 1 -- 172.21.15.167:0/2195390891 >> v2:172.21.15.178:3300/0 conn(0x7f58980c6ff0 msgr2=0x7f58980c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589d1f7640 1 --2- 172.21.15.167:0/2195390891 >> v2:172.21.15.178:3300/0 conn(0x7f58980c6ff0 0x7f58980c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f589d1f7640 1 -- 172.21.15.167:0/2195390891 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898156a80 con 0x7f58980c5be0 2023-11-28T20:42:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.190+0000 7f588ffff640 1 --2- 172.21.15.167:0/2195390891 >> v2:172.21.15.178:3300/0 conn(0x7f58980c6ff0 0x7f58980c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:42:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589d1f7640 1 --2- 172.21.15.167:0/2195390891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 0x7f589806a580 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f589806ef70 tx=0x7f589001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a06b97db6ddd73e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f588f7fe640 1 -- 172.21.15.167:0/2195390891 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58900a5820 con 0x7f58980c5be0 2023-11-28T20:42:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f588f7fe640 1 -- 172.21.15.167:0/2195390891 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58900a5980 con 0x7f58980c5be0 2023-11-28T20:42:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f588f7fe640 1 -- 172.21.15.167:0/2195390891 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58900a5d10 con 0x7f58980c5be0 2023-11-28T20:42:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 -- 172.21.15.167:0/2195390891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 msgr2=0x7f589806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 --2- 172.21.15.167:0/2195390891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 0x7f589806a580 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f589806ef70 tx=0x7f589001c9a0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 -- 172.21.15.167:0/2195390891 shutdown_connections 2023-11-28T20:42:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 --2- 172.21.15.167:0/2195390891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 0x7f589806a580 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 --2- 172.21.15.167:0/2195390891 >> v2:172.21.15.178:3300/0 conn(0x7f58980c6ff0 0x7f58980c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 --2- 172.21.15.167:0/2195390891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898150b40 0x7f5898157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 -- 172.21.15.167:0/2195390891 >> 172.21.15.167:0/2195390891 conn(0x7f58980cb1e0 msgr2=0x7f58980cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 -- 172.21.15.167:0/2195390891 shutdown_connections 2023-11-28T20:42:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 -- 172.21.15.167:0/2195390891 wait complete. 2023-11-28T20:42:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 Processor -- start 2023-11-28T20:42:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.194+0000 7f589ec5a640 1 -- start start 2023-11-28T20:42:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 0x7f589815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58980c6ff0 0x7f589814b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898150b40 0x7f5898143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898160f30 con 0x7f58980c5be0 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981568a0 con 0x7f5898150b40 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589815f970 con 0x7f58980c6ff0 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589c9f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 0x7f589815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589c9f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 0x7f589815fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37240/0 (socket says 172.21.15.167:37240) 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589c9f6640 1 -- 172.21.15.167:0/57736019 learned_addr learned my addr 172.21.15.167:0/57736019 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589d1f7640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898150b40 0x7f5898143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f588ffff640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58980c6ff0 0x7f589814b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589c9f6640 1 -- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58980c6ff0 msgr2=0x7f589814b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589c9f6640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58980c6ff0 0x7f589814b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589c9f6640 1 -- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898150b40 msgr2=0x7f5898143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589c9f6640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898150b40 0x7f5898143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589c9f6640 1 -- 172.21.15.167:0/57736019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009b30 con 0x7f58980c5be0 2023-11-28T20:42:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589c9f6640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 0x7f589815fe00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f589400d620 tx=0x7f589400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589400b620 con 0x7f58980c5be0 2023-11-28T20:42:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589400b780 con 0x7f58980c5be0 2023-11-28T20:42:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589400bb10 con 0x7f58980c5be0 2023-11-28T20:42:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5898142400 con 0x7f58980c5be0 2023-11-28T20:42:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58981562e0 con 0x7f58980c5be0 2023-11-28T20:42:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898156470 0x7f58981442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5898074770 con 0x7f5898156470 2023-11-28T20:42:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f588ffff640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898156470 0x7f58981442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.198+0000 7f588ffff640 1 -- 172.21.15.167:0/57736019 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f589815a770 con 0x7f5898156470 2023-11-28T20:42:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f589400bc70 con 0x7f58980c5be0 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588ffff640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898156470 0x7f58981442f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58880107c0 tx=0x7f5888010c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588d7fa640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5894084690 con 0x7f58980c5be0 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800ebd0 con 0x7f5898156470 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f589d1f7640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f588800c050 con 0x7f5898156470 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898156470 msgr2=0x7f58981442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588d7fa640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898156470 0x7f58981442f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58880107c0 tx=0x7f5888010c80 comp rx=0 tx=0).stop 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898156470 msgr2=0x7f58981442f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f588d7fa640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898156470 0x7f58981442f0 secure :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58880107c0 tx=0x7f5888010c80 comp rx=0 tx=0).stop 2023-11-28T20:42:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.202+0000 7f589d1f7640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5884066470 0x7f5884068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58900ae000 tx=0x7f58900a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.206+0000 7f589ec5a640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143110 0x7f5898144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.206+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980682c0 con 0x7f5898143110 2023-11-28T20:42:02.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f588ffff640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143110 0x7f5898144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f588ffff640 1 -- 172.21.15.167:0/57736019 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5898075c90 con 0x7f5898143110 2023-11-28T20:42:02.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f588ffff640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143110 0x7f5898144830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f588801b000 tx=0x7f58880046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888015470 con 0x7f5898143110 2023-11-28T20:42:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7f58880155d0 con 0x7f5898143110 2023-11-28T20:42:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143110 msgr2=0x7f5898144830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f588d7fa640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143110 0x7f5898144830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f588801b000 tx=0x7f58880046d0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f588d7fa640 1 -- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143110 msgr2=0x7f5898144830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:02.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f588d7fa640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143110 0x7f5898144830 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.212 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 30, 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.213 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:02.214 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:02.215 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:42:02.216 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:02.217 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:42:02.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:02.220 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:02.222 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:02.224 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:42:02.225 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:02.226 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:42:02.226 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:42:02.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5884066470 msgr2=0x7f5884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589ec5a640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5884066470 0x7f5884068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f58900ae000 tx=0x7f58900a7070 comp rx=0 tx=0).stop 2023-11-28T20:42:02.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 msgr2=0x7f589815fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589ec5a640 1 --2- 172.21.15.167:0/57736019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5be0 0x7f589815fe00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f589400d620 tx=0x7f589400dae0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589d1f7640 1 -- 172.21.15.167:0/57736019 reap_dead start 2023-11-28T20:42:02.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589d1f7640 1 -- 172.21.15.167:0/57736019 reap_dead start 2023-11-28T20:42:02.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 shutdown_connections 2023-11-28T20:42:02.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 >> 172.21.15.167:0/57736019 conn(0x7f58980cb1e0 msgr2=0x7f58980cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:02.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 shutdown_connections 2023-11-28T20:42:02.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.210+0000 7f589ec5a640 1 -- 172.21.15.167:0/57736019 wait complete. 2023-11-28T20:42:02.231 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:42:02.231 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:42:02.231 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:42:02.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.366+0000 7f5d94bdf640 1 Processor -- start 2023-11-28T20:42:02.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.366+0000 7f5d94bdf640 1 -- start start 2023-11-28T20:42:02.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d94bdf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d900cf860 0x7f5d900cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d94bdf640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 0x7f5d900ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d94bdf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9015ac00 con 0x7f5d90153ae0 2023-11-28T20:42:02.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d94bdf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d900cbd60 con 0x7f5d900cf860 2023-11-28T20:42:02.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d94bdf640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d90159ff0 con 0x7f5d900cfc40 2023-11-28T20:42:02.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d8e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d900cf860 0x7f5d900cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d8e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d900cf860 0x7f5d900cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37246/0 (socket says 172.21.15.167:37246) 2023-11-28T20:42:02.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d8e59c640 1 -- 172.21.15.167:0/355376218 learned_addr learned my addr 172.21.15.167:0/355376218 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:02.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d8ed9d640 1 --1- 172.21.15.167:0/355376218 >> v1:172.21.15.167:6789/0 conn(0x7f5d90153ae0 0x7f5d9015d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55136/0 (socket says 172.21.15.167:55136) 2023-11-28T20:42:02.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d8dd9b640 1 --2- 172.21.15.167:0/355376218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 0x7f5d900ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d8e59c640 1 -- 172.21.15.167:0/355376218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 msgr2=0x7f5d900ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:02.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d8e59c640 1 --2- 172.21.15.167:0/355376218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 0x7f5d900ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d8e59c640 1 -- 172.21.15.167:0/355376218 >> v1:172.21.15.167:6789/0 conn(0x7f5d90153ae0 legacy=0x7f5d9015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.370+0000 7f5d8e59c640 1 -- 172.21.15.167:0/355376218 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9015a2d0 con 0x7f5d900cf860 2023-11-28T20:42:02.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d8e59c640 1 --2- 172.21.15.167:0/355376218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 0x7f5d900cb770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009870 tx=0x7f5d8001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e9ca8df63ca95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d8d59a640 1 -- 172.21.15.167:0/355376218 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800aa670 con 0x7f5d900cf860 2023-11-28T20:42:02.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d8d59a640 1 -- 172.21.15.167:0/355376218 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d800aa7d0 con 0x7f5d900cf860 2023-11-28T20:42:02.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d8d59a640 1 -- 172.21.15.167:0/355376218 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800aab60 con 0x7f5d900cf860 2023-11-28T20:42:02.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d94bdf640 1 -- 172.21.15.167:0/355376218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 msgr2=0x7f5d900cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d94bdf640 1 --2- 172.21.15.167:0/355376218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 0x7f5d900cb770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009870 tx=0x7f5d8001c510 comp rx=0 tx=0).stop 2023-11-28T20:42:02.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d94bdf640 1 -- 172.21.15.167:0/355376218 shutdown_connections 2023-11-28T20:42:02.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d94bdf640 1 --2- 172.21.15.167:0/355376218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 0x7f5d900ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d94bdf640 1 --2- 172.21.15.167:0/355376218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 0x7f5d900cb770 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d94bdf640 1 -- 172.21.15.167:0/355376218 >> 172.21.15.167:0/355376218 conn(0x7f5d9006c1f0 msgr2=0x7f5d90071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:02.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d94bdf640 1 -- 172.21.15.167:0/355376218 shutdown_connections 2023-11-28T20:42:02.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d94bdf640 1 -- 172.21.15.167:0/355376218 wait complete. 2023-11-28T20:42:02.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.374+0000 7f5d94bdf640 1 Processor -- start 2023-11-28T20:42:02.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 -- start start 2023-11-28T20:42:02.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 0x7f5d900c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 0x7f5d90149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d90153ae0 0x7f5d900c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9015d140 con 0x7f5d900cf860 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900c7fd0 con 0x7f5d90153ae0 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900c6af0 con 0x7f5d900cfc40 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 0x7f5d900c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 0x7f5d900c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37256/0 (socket says 172.21.15.167:37256) 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8e59c640 1 -- 172.21.15.167:0/1888654282 learned_addr learned my addr 172.21.15.167:0/1888654282 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8ed9d640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d90153ae0 0x7f5d900c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8dd9b640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 0x7f5d90149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8e59c640 1 -- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 msgr2=0x7f5d90149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8e59c640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 0x7f5d90149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8e59c640 1 -- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d90153ae0 msgr2=0x7f5d900c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8e59c640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d90153ae0 0x7f5d900c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8e59c640 1 -- 172.21.15.167:0/1888654282 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800094d0 con 0x7f5d900cf860 2023-11-28T20:42:02.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d8e59c640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 0x7f5d900c7a90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001abc0 tx=0x7f5d8001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d7effd640 1 -- 172.21.15.167:0/1888654282 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800b3800 con 0x7f5d900cf860 2023-11-28T20:42:02.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d7effd640 1 -- 172.21.15.167:0/1888654282 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d800b3980 con 0x7f5d900cf860 2023-11-28T20:42:02.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d7effd640 1 -- 172.21.15.167:0/1888654282 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800b3d30 con 0x7f5d900cf860 2023-11-28T20:42:02.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d900c6db0 con 0x7f5d900cf860 2023-11-28T20:42:02.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9015cd60 con 0x7f5d900cf860 2023-11-28T20:42:02.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.378+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d90075c90 con 0x7f5d900cf860 2023-11-28T20:42:02.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.382+0000 7f5d7effd640 1 -- 172.21.15.167:0/1888654282 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d800b2380 con 0x7f5d900cf860 2023-11-28T20:42:02.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.382+0000 7f5d7effd640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d70066470 0x7f5d70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:02.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.382+0000 7f5d7effd640 1 -- 172.21.15.167:0/1888654282 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5d8011e700 con 0x7f5d900cf860 2023-11-28T20:42:02.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.382+0000 7f5d8dd9b640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d70066470 0x7f5d70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:02.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.382+0000 7f5d8dd9b640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d70066470 0x7f5d70068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5d901597b0 tx=0x7f5d84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:02.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.386+0000 7f5d7effd640 1 -- 172.21.15.167:0/1888654282 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5d800eb830 con 0x7f5d900cf860 2023-11-28T20:42:02.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.594+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f5d900cb070 con 0x7f5d900cf860 2023-11-28T20:42:02.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.594+0000 7f5d7effd640 1 -- 172.21.15.167:0/1888654282 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f5d800aa630 con 0x7f5d900cf860 2023-11-28T20:42:02.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d70066470 msgr2=0x7f5d70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d70066470 0x7f5d70068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5d901597b0 tx=0x7f5d84008040 comp rx=0 tx=0).stop 2023-11-28T20:42:02.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 msgr2=0x7f5d900c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:02.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 0x7f5d900c7a90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001abc0 tx=0x7f5d8001ad50 comp rx=0 tx=0).stop 2023-11-28T20:42:02.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 shutdown_connections 2023-11-28T20:42:02.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d70066470 0x7f5d70068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d90153ae0 0x7f5d900c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d900cfc40 0x7f5d90149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 --2- 172.21.15.167:0/1888654282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d900cf860 0x7f5d900c7a90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:02.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 >> 172.21.15.167:0/1888654282 conn(0x7f5d9006c1f0 msgr2=0x7f5d90147100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:02.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 shutdown_connections 2023-11-28T20:42:02.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:02.598+0000 7f5d94bdf640 1 -- 172.21.15.167:0/1888654282 wait complete. 2023-11-28T20:42:02.616 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:42:02.756 INFO:tasks.workunit.client.0.smithi167.stdout:.//.snap/test1 2023-11-28T20:42:02.756 INFO:tasks.workunit.client.0.smithi167.stdout:.//.snap/test2 2023-11-28T20:42:02.756 INFO:tasks.workunit.client.0.smithi167.stdout:.//.snap/test3 2023-11-28T20:42:02.766 INFO:tasks.workunit.client.0.smithi167.stdout:./274/.snap/snap-subdir-test 2023-11-28T20:42:02.774 INFO:tasks.workunit.client.0.smithi167.stdout:./166/.snap/snap-subdir-test 2023-11-28T20:42:02.783 INFO:tasks.workunit.client.0.smithi167.stdout:./256/.snap/snap-subdir-test 2023-11-28T20:42:02.791 INFO:tasks.workunit.client.0.smithi167.stdout:./247/.snap/snap-subdir-test 2023-11-28T20:42:02.799 INFO:tasks.workunit.client.0.smithi167.stdout:./248/.snap/snap-subdir-test 2023-11-28T20:42:02.809 INFO:tasks.workunit.client.0.smithi167.stdout:./147/.snap/snap-subdir-test 2023-11-28T20:42:02.814 INFO:tasks.workunit.client.0.smithi167.stdout:./151/.snap/snap-subdir-test 2023-11-28T20:42:02.821 INFO:tasks.workunit.client.0.smithi167.stdout:./170/.snap/snap-subdir-test 2023-11-28T20:42:02.829 INFO:tasks.workunit.client.0.smithi167.stdout:./167/.snap/snap-subdir-test 2023-11-28T20:42:02.836 INFO:tasks.workunit.client.0.smithi167.stdout:./140/.snap/snap-subdir-test 2023-11-28T20:42:02.843 INFO:tasks.workunit.client.0.smithi167.stdout:./142/.snap/snap-subdir-test 2023-11-28T20:42:02.848 INFO:tasks.workunit.client.0.smithi167.stdout:./150/.snap/snap-subdir-test 2023-11-28T20:42:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:./273/.snap/snap-subdir-test 2023-11-28T20:42:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:./269/.snap/snap-subdir-test 2023-11-28T20:42:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:./105/.snap/snap-subdir-test 2023-11-28T20:42:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:./210/.snap/snap-subdir-test 2023-11-28T20:42:03.734 INFO:tasks.workunit.client.0.smithi167.stdout:./265/.snap/snap-subdir-test 2023-11-28T20:42:03.743 INFO:tasks.workunit.client.0.smithi167.stdout:./218/.snap/snap-subdir-test 2023-11-28T20:42:03.753 INFO:tasks.workunit.client.0.smithi167.stdout:./290/.snap/snap-subdir-test 2023-11-28T20:42:03.761 INFO:tasks.workunit.client.0.smithi167.stdout:./149/.snap/snap-subdir-test 2023-11-28T20:42:03.769 INFO:tasks.workunit.client.0.smithi167.stdout:./109/.snap/snap-subdir-test 2023-11-28T20:42:03.777 INFO:tasks.workunit.client.0.smithi167.stdout:./292/.snap/snap-subdir-test 2023-11-28T20:42:03.785 INFO:tasks.workunit.client.0.smithi167.stdout:./242/.snap/snap-subdir-test 2023-11-28T20:42:03.792 INFO:tasks.workunit.client.0.smithi167.stdout:./158/.snap/snap-subdir-test 2023-11-28T20:42:03.801 INFO:tasks.workunit.client.0.smithi167.stdout:./243/.snap/snap-subdir-test 2023-11-28T20:42:03.809 INFO:tasks.workunit.client.0.smithi167.stdout:./106/.snap/snap-subdir-test 2023-11-28T20:42:03.818 INFO:tasks.workunit.client.0.smithi167.stdout:./250/.snap/snap-subdir-test 2023-11-28T20:42:03.829 INFO:tasks.workunit.client.0.smithi167.stdout:./221/.snap/snap-subdir-test 2023-11-28T20:42:03.839 INFO:tasks.workunit.client.0.smithi167.stdout:./244/.snap/snap-subdir-test 2023-11-28T20:42:03.846 INFO:tasks.workunit.client.0.smithi167.stdout:./258/.snap/snap-subdir-test 2023-11-28T20:42:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:./268/.snap/snap-subdir-test 2023-11-28T20:42:03.863 INFO:tasks.workunit.client.0.smithi167.stdout:./189/.snap/snap-subdir-test 2023-11-28T20:42:04.569 INFO:tasks.workunit.client.0.smithi167.stdout:./285/.snap/snap-subdir-test 2023-11-28T20:42:04.663 INFO:tasks.workunit.client.0.smithi167.stdout:./208/.snap/snap-subdir-test 2023-11-28T20:42:04.672 INFO:tasks.workunit.client.0.smithi167.stdout:./288/.snap/snap-subdir-test 2023-11-28T20:42:04.682 INFO:tasks.workunit.client.0.smithi167.stdout:./209/.snap/snap-subdir-test 2023-11-28T20:42:04.692 INFO:tasks.workunit.client.0.smithi167.stdout:./253/.snap/snap-subdir-test 2023-11-28T20:42:04.701 INFO:tasks.workunit.client.0.smithi167.stdout:./249/.snap/snap-subdir-test 2023-11-28T20:42:04.709 INFO:tasks.workunit.client.0.smithi167.stdout:./133/.snap/snap-subdir-test 2023-11-28T20:42:04.715 INFO:tasks.workunit.client.0.smithi167.stdout:./291/.snap/snap-subdir-test 2023-11-28T20:42:04.724 INFO:tasks.workunit.client.0.smithi167.stdout:./226/.snap/snap-subdir-test 2023-11-28T20:42:04.733 INFO:tasks.workunit.client.0.smithi167.stdout:./173/.snap/snap-subdir-test 2023-11-28T20:42:04.743 INFO:tasks.workunit.client.0.smithi167.stdout:./174/.snap/snap-subdir-test 2023-11-28T20:42:05.001 INFO:tasks.workunit.client.0.smithi167.stdout:./299/.snap/snap-subdir-test 2023-11-28T20:42:05.010 INFO:tasks.workunit.client.0.smithi167.stdout:./262/.snap/snap-subdir-test 2023-11-28T20:42:05.018 INFO:tasks.workunit.client.0.smithi167.stdout:./231/.snap/snap-subdir-test 2023-11-28T20:42:05.030 INFO:tasks.workunit.client.0.smithi167.stdout:./214/.snap/snap-subdir-test 2023-11-28T20:42:05.038 INFO:tasks.workunit.client.0.smithi167.stdout:./281/.snap/snap-subdir-test 2023-11-28T20:42:05.048 INFO:tasks.workunit.client.0.smithi167.stdout:./289/.snap/snap-subdir-test 2023-11-28T20:42:05.058 INFO:tasks.workunit.client.0.smithi167.stdout:./283/.snap/snap-subdir-test 2023-11-28T20:42:05.068 INFO:tasks.workunit.client.0.smithi167.stdout:./232/.snap/snap-subdir-test 2023-11-28T20:42:05.078 INFO:tasks.workunit.client.0.smithi167.stdout:./298/.snap/snap-subdir-test 2023-11-28T20:42:05.086 INFO:tasks.workunit.client.0.smithi167.stdout:./233/.snap/snap-subdir-test 2023-11-28T20:42:05.094 INFO:tasks.workunit.client.0.smithi167.stdout:./155/.snap/snap-subdir-test 2023-11-28T20:42:05.535 INFO:tasks.workunit.client.0.smithi167.stdout:./114/.snap/snap-subdir-test 2023-11-28T20:42:05.546 INFO:tasks.workunit.client.0.smithi167.stdout:./159/.snap/snap-subdir-test 2023-11-28T20:42:05.553 INFO:tasks.workunit.client.0.smithi167.stdout:./187/.snap/snap-subdir-test 2023-11-28T20:42:05.562 INFO:tasks.workunit.client.0.smithi167.stdout:./185/.snap/snap-subdir-test 2023-11-28T20:42:05.572 INFO:tasks.workunit.client.0.smithi167.stdout:./293/.snap/snap-subdir-test 2023-11-28T20:42:05.586 INFO:tasks.workunit.client.0.smithi167.stdout:./228/.snap/snap-subdir-test 2023-11-28T20:42:05.595 INFO:tasks.workunit.client.0.smithi167.stdout:./120/.snap/snap-subdir-test 2023-11-28T20:42:05.602 INFO:tasks.workunit.client.0.smithi167.stdout:./110/.snap/snap-subdir-test 2023-11-28T20:42:05.612 INFO:tasks.workunit.client.0.smithi167.stdout:./267/.snap/snap-subdir-test 2023-11-28T20:42:05.619 INFO:tasks.workunit.client.0.smithi167.stdout:./202/.snap/snap-subdir-test 2023-11-28T20:42:05.627 INFO:tasks.workunit.client.0.smithi167.stdout:./137/.snap/snap-subdir-test 2023-11-28T20:42:05.637 INFO:tasks.workunit.client.0.smithi167.stdout:./246/.snap/snap-subdir-test 2023-11-28T20:42:05.644 INFO:tasks.workunit.client.0.smithi167.stdout:./219/.snap/snap-subdir-test 2023-11-28T20:42:05.651 INFO:tasks.workunit.client.0.smithi167.stdout:./198/.snap/snap-subdir-test 2023-11-28T20:42:05.661 INFO:tasks.workunit.client.0.smithi167.stdout:./136/.snap/snap-subdir-test 2023-11-28T20:42:05.667 INFO:tasks.workunit.client.0.smithi167.stdout:./270/.snap/snap-subdir-test 2023-11-28T20:42:05.676 INFO:tasks.workunit.client.0.smithi167.stdout:./125/.snap/snap-subdir-test 2023-11-28T20:42:05.683 INFO:tasks.workunit.client.0.smithi167.stdout:./194/.snap/snap-subdir-test 2023-11-28T20:42:05.692 INFO:tasks.workunit.client.0.smithi167.stdout:./119/.snap/snap-subdir-test 2023-11-28T20:42:05.701 INFO:tasks.workunit.client.0.smithi167.stdout:./297/.snap/snap-subdir-test 2023-11-28T20:42:05.708 INFO:tasks.workunit.client.0.smithi167.stdout:./230/.snap/snap-subdir-test 2023-11-28T20:42:05.716 INFO:tasks.workunit.client.0.smithi167.stdout:./260/.snap/snap-subdir-test 2023-11-28T20:42:05.727 INFO:tasks.workunit.client.0.smithi167.stdout:./157/.snap/snap-subdir-test 2023-11-28T20:42:05.738 INFO:tasks.workunit.client.0.smithi167.stdout:./172/.snap/snap-subdir-test 2023-11-28T20:42:05.750 INFO:tasks.workunit.client.0.smithi167.stdout:./277/.snap/snap-subdir-test 2023-11-28T20:42:05.763 INFO:tasks.workunit.client.0.smithi167.stdout:./186/.snap/snap-subdir-test 2023-11-28T20:42:05.775 INFO:tasks.workunit.client.0.smithi167.stdout:./237/.snap/snap-subdir-test 2023-11-28T20:42:05.784 INFO:tasks.workunit.client.0.smithi167.stdout:./190/.snap/snap-subdir-test 2023-11-28T20:42:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:./213/.snap/snap-subdir-test 2023-11-28T20:42:05.808 INFO:tasks.workunit.client.0.smithi167.stdout:./104/.snap/snap-subdir-test 2023-11-28T20:42:05.821 INFO:tasks.workunit.client.0.smithi167.stdout:./164/.snap/snap-subdir-test 2023-11-28T20:42:05.834 INFO:tasks.workunit.client.0.smithi167.stdout:./112/.snap/snap-subdir-test 2023-11-28T20:42:05.893 INFO:tasks.workunit.client.0.smithi167.stdout:./295/.snap/snap-subdir-test 2023-11-28T20:42:05.905 INFO:tasks.workunit.client.0.smithi167.stdout:./272/.snap/snap-subdir-test 2023-11-28T20:42:05.980 INFO:tasks.workunit.client.0.smithi167.stdout:./100/.snap/snap-subdir-test 2023-11-28T20:42:05.992 INFO:tasks.workunit.client.0.smithi167.stdout:./134/.snap/snap-subdir-test 2023-11-28T20:42:06.671 INFO:tasks.workunit.client.0.smithi167.stdout:./200/.snap/snap-subdir-test 2023-11-28T20:42:06.684 INFO:tasks.workunit.client.0.smithi167.stdout:./115/.snap/snap-subdir-test 2023-11-28T20:42:06.697 INFO:tasks.workunit.client.0.smithi167.stdout:./284/.snap/snap-subdir-test 2023-11-28T20:42:06.710 INFO:tasks.workunit.client.0.smithi167.stdout:./280/.snap/snap-subdir-test 2023-11-28T20:42:06.721 INFO:tasks.workunit.client.0.smithi167.stdout:./116/.snap/snap-subdir-test 2023-11-28T20:42:06.734 INFO:tasks.workunit.client.0.smithi167.stdout:./245/.snap/snap-subdir-test 2023-11-28T20:42:07.280 INFO:tasks.workunit.client.0.smithi167.stdout:./195/.snap/snap-subdir-test 2023-11-28T20:42:07.292 INFO:tasks.workunit.client.0.smithi167.stdout:./138/.snap/snap-subdir-test 2023-11-28T20:42:07.301 INFO:tasks.workunit.client.0.smithi167.stdout:./135/.snap/snap-subdir-test 2023-11-28T20:42:07.307 INFO:tasks.workunit.client.0.smithi167.stdout:./117/.snap/snap-subdir-test 2023-11-28T20:42:07.311 INFO:tasks.workunit.client.0.smithi167.stdout:./241/.snap/snap-subdir-test 2023-11-28T20:42:07.317 INFO:tasks.workunit.client.0.smithi167.stdout:./143/.snap/snap-subdir-test 2023-11-28T20:42:07.326 INFO:tasks.workunit.client.0.smithi167.stdout:./180/.snap/snap-subdir-test 2023-11-28T20:42:08.628 INFO:tasks.workunit.client.0.smithi167.stdout:./126/.snap/snap-subdir-test 2023-11-28T20:42:08.635 INFO:tasks.workunit.client.0.smithi167.stdout:./161/.snap/snap-subdir-test 2023-11-28T20:42:08.638 INFO:tasks.workunit.client.0.smithi167.stdout:./204/.snap/snap-subdir-test 2023-11-28T20:42:09.277 INFO:tasks.workunit.client.0.smithi167.stdout:./176/.snap/snap-subdir-test 2023-11-28T20:42:09.280 INFO:tasks.workunit.client.0.smithi167.stdout:./255/.snap/snap-subdir-test 2023-11-28T20:42:09.283 INFO:tasks.workunit.client.0.smithi167.stdout:./215/.snap/snap-subdir-test 2023-11-28T20:42:09.291 INFO:tasks.workunit.client.0.smithi167.stdout:./111/.snap/snap-subdir-test 2023-11-28T20:42:09.295 INFO:tasks.workunit.client.0.smithi167.stdout:./238/.snap/snap-subdir-test 2023-11-28T20:42:09.302 INFO:tasks.workunit.client.0.smithi167.stdout:./191/.snap/snap-subdir-test 2023-11-28T20:42:09.309 INFO:tasks.workunit.client.0.smithi167.stdout:./184/.snap/snap-subdir-test 2023-11-28T20:42:09.319 INFO:tasks.workunit.client.0.smithi167.stdout:./192/.snap/snap-subdir-test 2023-11-28T20:42:09.327 INFO:tasks.workunit.client.0.smithi167.stdout:./103/.snap/snap-subdir-test 2023-11-28T20:42:09.335 INFO:tasks.workunit.client.0.smithi167.stdout:./128/.snap/snap-subdir-test 2023-11-28T20:42:09.338 INFO:tasks.workunit.client.0.smithi167.stdout:./229/.snap/snap-subdir-test 2023-11-28T20:42:09.348 INFO:tasks.workunit.client.0.smithi167.stdout:./144/.snap/snap-subdir-test 2023-11-28T20:42:09.354 INFO:tasks.workunit.client.0.smithi167.stdout:./146/.snap/snap-subdir-test 2023-11-28T20:42:09.357 INFO:tasks.workunit.client.0.smithi167.stdout:./227/.snap/snap-subdir-test 2023-11-28T20:42:09.360 INFO:tasks.workunit.client.0.smithi167.stdout:./278/.snap/snap-subdir-test 2023-11-28T20:42:09.991 INFO:tasks.workunit.client.0.smithi167.stdout:./141/.snap/snap-subdir-test 2023-11-28T20:42:09.994 INFO:tasks.workunit.client.0.smithi167.stdout:./234/.snap/snap-subdir-test 2023-11-28T20:42:09.998 INFO:tasks.workunit.client.0.smithi167.stdout:./225/.snap/snap-subdir-test 2023-11-28T20:42:10.006 INFO:tasks.workunit.client.0.smithi167.stdout:./182/.snap/snap-subdir-test 2023-11-28T20:42:10.016 INFO:tasks.workunit.client.0.smithi167.stdout:./107/.snap/snap-subdir-test 2023-11-28T20:42:10.023 INFO:tasks.workunit.client.0.smithi167.stdout:./178/.snap/snap-subdir-test 2023-11-28T20:42:10.033 INFO:tasks.workunit.client.0.smithi167.stdout:./266/.snap/snap-subdir-test 2023-11-28T20:42:10.040 INFO:tasks.workunit.client.0.smithi167.stdout:./240/.snap/snap-subdir-test 2023-11-28T20:42:10.048 INFO:tasks.workunit.client.0.smithi167.stdout:./156/.snap/snap-subdir-test 2023-11-28T20:42:10.056 INFO:tasks.workunit.client.0.smithi167.stdout:./131/.snap/snap-subdir-test 2023-11-28T20:42:10.066 INFO:tasks.workunit.client.0.smithi167.stdout:./123/.snap/snap-subdir-test 2023-11-28T20:42:10.072 INFO:tasks.workunit.client.0.smithi167.stdout:./160/.snap/snap-subdir-test 2023-11-28T20:42:10.264 INFO:tasks.workunit.client.0.smithi167.stdout:./165/.snap/snap-subdir-test 2023-11-28T20:42:10.269 INFO:tasks.workunit.client.0.smithi167.stdout:./101/.snap/snap-subdir-test 2023-11-28T20:42:10.279 INFO:tasks.workunit.client.0.smithi167.stdout:./148/.snap/snap-subdir-test 2023-11-28T20:42:11.000 INFO:tasks.workunit.client.0.smithi167.stdout:./168/.snap/snap-subdir-test 2023-11-28T20:42:11.009 INFO:tasks.workunit.client.0.smithi167.stdout:./179/.snap/snap-subdir-test 2023-11-28T20:42:11.017 INFO:tasks.workunit.client.0.smithi167.stdout:./257/.snap/snap-subdir-test 2023-11-28T20:42:11.367 INFO:tasks.workunit.client.0.smithi167.stdout:./252/.snap/snap-subdir-test 2023-11-28T20:42:11.378 INFO:tasks.workunit.client.0.smithi167.stdout:./132/.snap/snap-subdir-test 2023-11-28T20:42:11.388 INFO:tasks.workunit.client.0.smithi167.stdout:./236/.snap/snap-subdir-test 2023-11-28T20:42:11.477 INFO:tasks.workunit.client.0.smithi167.stdout:./211/.snap/snap-subdir-test 2023-11-28T20:42:11.487 INFO:tasks.workunit.client.0.smithi167.stdout:./199/.snap/snap-subdir-test 2023-11-28T20:42:11.497 INFO:tasks.workunit.client.0.smithi167.stdout:./205/.snap/snap-subdir-test 2023-11-28T20:42:11.506 INFO:tasks.workunit.client.0.smithi167.stdout:./163/.snap/snap-subdir-test 2023-11-28T20:42:12.068 INFO:tasks.workunit.client.0.smithi167.stdout:./261/.snap/snap-subdir-test 2023-11-28T20:42:12.617 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:42:12.618 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:42:12.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.762+0000 7ffb4806b640 1 Processor -- start 2023-11-28T20:42:12.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb4806b640 1 -- start start 2023-11-28T20:42:12.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb4806b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffb400cb770 0x7ffb4015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb4806b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4015ac00 con 0x7ffb400cf860 2023-11-28T20:42:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb4806b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb400cbd60 con 0x7ffb400cfc40 2023-11-28T20:42:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb4806b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb40159ff0 con 0x7ffb400cb770 2023-11-28T20:42:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb46608640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffb400cb770 0x7ffb4015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb46608640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffb400cb770 0x7ffb4015d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46256/0 (socket says 172.21.15.167:46256) 2023-11-28T20:42:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb46608640 1 -- 172.21.15.167:0/4086865711 learned_addr learned my addr 172.21.15.167:0/4086865711 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb46608640 1 -- 172.21.15.167:0/4086865711 >> v1:172.21.15.178:6789/0 conn(0x7ffb400cfc40 legacy=0x7ffb40153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:12.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb46608640 1 -- 172.21.15.167:0/4086865711 >> v1:172.21.15.167:6789/0 conn(0x7ffb400cf860 legacy=0x7ffb400ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:12.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.766+0000 7ffb46608640 1 -- 172.21.15.167:0/4086865711 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4015a2d0 con 0x7ffb400cb770 2023-11-28T20:42:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb46608640 1 --2- 172.21.15.167:0/4086865711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cb770 0x7ffb4015d4d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009e50 tx=0x7ffb3801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f191708cc0a679af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb44e05640 1 -- 172.21.15.167:0/4086865711 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb380a58a0 con 0x7ffb400cb770 2023-11-28T20:42:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb44e05640 1 -- 172.21.15.167:0/4086865711 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb380a5a00 con 0x7ffb400cb770 2023-11-28T20:42:12.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb44e05640 1 -- 172.21.15.167:0/4086865711 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb380a5d90 con 0x7ffb400cb770 2023-11-28T20:42:12.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb4806b640 1 -- 172.21.15.167:0/4086865711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cb770 msgr2=0x7ffb4015d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:12.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb4806b640 1 --2- 172.21.15.167:0/4086865711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cb770 0x7ffb4015d4d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009e50 tx=0x7ffb3801c9e0 comp rx=0 tx=0).stop 2023-11-28T20:42:12.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb4806b640 1 -- 172.21.15.167:0/4086865711 shutdown_connections 2023-11-28T20:42:12.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb4806b640 1 --2- 172.21.15.167:0/4086865711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cb770 0x7ffb4015d4d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:12.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb4806b640 1 -- 172.21.15.167:0/4086865711 >> 172.21.15.167:0/4086865711 conn(0x7ffb4006c1f0 msgr2=0x7ffb40071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb4806b640 1 -- 172.21.15.167:0/4086865711 shutdown_connections 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb4806b640 1 -- 172.21.15.167:0/4086865711 wait complete. 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb4806b640 1 Processor -- start 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.770+0000 7ffb4806b640 1 -- start start 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb4806b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb400cb770 0x7ffb400c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb4806b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb400cf860 0x7ffb400b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb4806b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cfc40 0x7ffb400cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb4806b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400b50c0 con 0x7ffb400cfc40 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb4806b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400b5850 con 0x7ffb400cf860 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb4806b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400b52d0 con 0x7ffb400cb770 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb46608640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cfc40 0x7ffb400cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:12.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb46608640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cfc40 0x7ffb400cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46258/0 (socket says 172.21.15.167:46258) 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb46608640 1 -- 172.21.15.167:0/3290980476 learned_addr learned my addr 172.21.15.167:0/3290980476 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb45606640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb400cf860 0x7ffb400b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb45e07640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb400cb770 0x7ffb400c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb46608640 1 -- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb400cb770 msgr2=0x7ffb400c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb46608640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb400cb770 0x7ffb400c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb46608640 1 -- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb400cf860 msgr2=0x7ffb400b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb46608640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb400cf860 0x7ffb400b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb46608640 1 -- 172.21.15.167:0/3290980476 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38009b30 con 0x7ffb400cfc40 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb46608640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cfc40 0x7ffb400cdce0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ffb380195f0 tx=0x7ffb38019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb367fc640 1 -- 172.21.15.167:0/3290980476 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb380b8670 con 0x7ffb400cfc40 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb367fc640 1 -- 172.21.15.167:0/3290980476 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb380b87d0 con 0x7ffb400cfc40 2023-11-28T20:42:12.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb367fc640 1 -- 172.21.15.167:0/3290980476 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb380b8b60 con 0x7ffb400cfc40 2023-11-28T20:42:12.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb400b5570 con 0x7ffb400cfc40 2023-11-28T20:42:12.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb400b3b00 con 0x7ffb400cfc40 2023-11-28T20:42:12.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb40075c90 con 0x7ffb400cfc40 2023-11-28T20:42:12.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.774+0000 7ffb367fc640 1 -- 172.21.15.167:0/3290980476 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffb380b8cc0 con 0x7ffb400cfc40 2023-11-28T20:42:12.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.778+0000 7ffb367fc640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffb240664a0 0x7ffb24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:12.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.778+0000 7ffb367fc640 1 -- 172.21.15.167:0/3290980476 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ffb3811f930 con 0x7ffb400cfc40 2023-11-28T20:42:12.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.778+0000 7ffb45e07640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffb240664a0 0x7ffb24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:12.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.778+0000 7ffb45e07640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffb240664a0 0x7ffb24068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c000f70 tx=0x7ffb3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:12.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.782+0000 7ffb367fc640 1 -- 172.21.15.167:0/3290980476 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb380ecb90 con 0x7ffb400cfc40 2023-11-28T20:42:12.806 INFO:tasks.workunit.client.0.smithi167.stdout:./201/.snap/snap-subdir-test 2023-11-28T20:42:12.816 INFO:tasks.workunit.client.0.smithi167.stdout:./282/.snap/snap-subdir-test 2023-11-28T20:42:12.826 INFO:tasks.workunit.client.0.smithi167.stdout:./296/.snap/snap-subdir-test 2023-11-28T20:42:12.837 INFO:tasks.workunit.client.0.smithi167.stdout:./217/.snap/snap-subdir-test 2023-11-28T20:42:12.847 INFO:tasks.workunit.client.0.smithi167.stdout:./153/.snap/snap-subdir-test 2023-11-28T20:42:12.862 INFO:tasks.workunit.client.0.smithi167.stdout:./206/.snap/snap-subdir-test 2023-11-28T20:42:12.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ffb400cb070 con 0x7ffb400cfc40 2023-11-28T20:42:12.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb367fc640 1 -- 172.21.15.167:0/3290980476 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7ffb380f01b0 con 0x7ffb400cfc40 2023-11-28T20:42:12.999 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:42:13.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffb240664a0 msgr2=0x7ffb24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffb240664a0 0x7ffb24068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c000f70 tx=0x7ffb3c009040 comp rx=0 tx=0).stop 2023-11-28T20:42:13.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cfc40 msgr2=0x7ffb400cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cfc40 0x7ffb400cdce0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ffb380195f0 tx=0x7ffb38019780 comp rx=0 tx=0).stop 2023-11-28T20:42:13.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 shutdown_connections 2023-11-28T20:42:13.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffb240664a0 0x7ffb24068960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb400cfc40 0x7ffb400cdce0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb400cf860 0x7ffb400b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 --2- 172.21.15.167:0/3290980476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb400cb770 0x7ffb400c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 >> 172.21.15.167:0/3290980476 conn(0x7ffb4006c1f0 msgr2=0x7ffb400c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:13.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 shutdown_connections 2023-11-28T20:42:13.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:12.998+0000 7ffb4806b640 1 -- 172.21.15.167:0/3290980476 wait complete. 2023-11-28T20:42:13.019 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:42:13.020 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:42:13.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:42:13.020 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:42:13.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c614ea640 1 Processor -- start 2023-11-28T20:42:13.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c614ea640 1 -- start start 2023-11-28T20:42:13.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c614ea640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2c5c0b0110 0x7f2c5c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c614ea640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2c5c0c8010 0x7f2c5c066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c614ea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 0x7f2c5c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c614ea640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5c06a8d0 con 0x7f2c5c0c8010 2023-11-28T20:42:13.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c614ea640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5c0ca230 con 0x7f2c5c0b0110 2023-11-28T20:42:13.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c614ea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c0c8990 con 0x7f2c5c06d530 2023-11-28T20:42:13.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c53fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2c5c0c8010 0x7f2c5c066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c53fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2c5c0c8010 0x7f2c5c066730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38320/0 (socket says 172.21.15.167:38320) 2023-11-28T20:42:13.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c53fff640 1 -- 172.21.15.167:0/291373701 learned_addr learned my addr 172.21.15.167:0/291373701 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:13.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c5affd640 1 --2- 172.21.15.167:0/291373701 >> v2:172.21.15.178:3300/0 conn(0x7f2c5c0b0110 0x7f2c5c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c5b7fe640 1 --2- 172.21.15.167:0/291373701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 0x7f2c5c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c53fff640 1 -- 172.21.15.167:0/291373701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 msgr2=0x7f2c5c06b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:13.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c53fff640 1 --2- 172.21.15.167:0/291373701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 0x7f2c5c06b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c53fff640 1 -- 172.21.15.167:0/291373701 >> v2:172.21.15.178:3300/0 conn(0x7f2c5c0b0110 msgr2=0x7f2c5c15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:13.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c53fff640 1 --2- 172.21.15.167:0/291373701 >> v2:172.21.15.178:3300/0 conn(0x7f2c5c0b0110 0x7f2c5c15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.158+0000 7f2c53fff640 1 -- 172.21.15.167:0/291373701 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0ca480 con 0x7f2c5c0c8010 2023-11-28T20:42:13.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c53fff640 1 --2- 172.21.15.167:0/291373701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0c8010 0x7f2c5c066730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0ce6b0 tx=0x7f2c4401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e043f0ab9b0f74 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c5a7fc640 1 -- 172.21.15.167:0/291373701 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440a89b0 con 0x7f2c5c0c8010 2023-11-28T20:42:13.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c5a7fc640 1 -- 172.21.15.167:0/291373701 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c440a8b10 con 0x7f2c5c0c8010 2023-11-28T20:42:13.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c5a7fc640 1 -- 172.21.15.167:0/291373701 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440a8ea0 con 0x7f2c5c0c8010 2023-11-28T20:42:13.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c614ea640 1 -- 172.21.15.167:0/291373701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0c8010 msgr2=0x7f2c5c066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c614ea640 1 --2- 172.21.15.167:0/291373701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0c8010 0x7f2c5c066730 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0ce6b0 tx=0x7f2c4401ecf0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c614ea640 1 -- 172.21.15.167:0/291373701 shutdown_connections 2023-11-28T20:42:13.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c614ea640 1 --2- 172.21.15.167:0/291373701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 0x7f2c5c06b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c614ea640 1 --2- 172.21.15.167:0/291373701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0c8010 0x7f2c5c066730 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c614ea640 1 --2- 172.21.15.167:0/291373701 >> v2:172.21.15.178:3300/0 conn(0x7f2c5c0b0110 0x7f2c5c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c614ea640 1 -- 172.21.15.167:0/291373701 >> 172.21.15.167:0/291373701 conn(0x7f2c5c06ee30 msgr2=0x7f2c5c06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:13.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c614ea640 1 -- 172.21.15.167:0/291373701 shutdown_connections 2023-11-28T20:42:13.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.162+0000 7f2c614ea640 1 -- 172.21.15.167:0/291373701 wait complete. 2023-11-28T20:42:13.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 Processor -- start 2023-11-28T20:42:13.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 -- start start 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 0x7f2c5c1f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b0110 0x7f2c5c0c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c5c0c8010 0x7f2c5c1ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c1f39b0 con 0x7f2c5c0b0110 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c0c4e40 con 0x7f2c5c0c8010 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c15d0d0 con 0x7f2c5c06d530 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c53fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b0110 0x7f2c5c0c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c53fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b0110 0x7f2c5c0c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38332/0 (socket says 172.21.15.167:38332) 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c53fff640 1 -- 172.21.15.167:0/1432824829 learned_addr learned my addr 172.21.15.167:0/1432824829 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c5b7fe640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c5c0c8010 0x7f2c5c1ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c5affd640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 0x7f2c5c1f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c53fff640 1 -- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 msgr2=0x7f2c5c1f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c53fff640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 0x7f2c5c1f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c53fff640 1 -- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c5c0c8010 msgr2=0x7f2c5c1ef7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c53fff640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c5c0c8010 0x7f2c5c1ef7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c53fff640 1 -- 172.21.15.167:0/1432824829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c440094d0 con 0x7f2c5c0b0110 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c5affd640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c5c06d530 0x7f2c5c1f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c53fff640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b0110 0x7f2c5c0c3230 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c4401d3a0 tx=0x7f2c4401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440ba600 con 0x7f2c5c0b0110 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c440ba760 con 0x7f2c5c0b0110 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440bab10 con 0x7f2c5c0b0110 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5c0c4830 con 0x7f2c5c0b0110 2023-11-28T20:42:13.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5c0c4ad0 con 0x7f2c5c0b0110 2023-11-28T20:42:13.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b05b0 0x7f2c5c1efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c06b130 con 0x7f2c5c0b05b0 2023-11-28T20:42:13.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.166+0000 7f2c5affd640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b05b0 0x7f2c5c1efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c5affd640 1 -- 172.21.15.167:0/1432824829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c5c1ef4f0 con 0x7f2c5c0b05b0 2023-11-28T20:42:13.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c5affd640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b05b0 0x7f2c5c1efce0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00f550 tx=0x7f2c4c00fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c440bac70 con 0x7f2c5c0b0110 2023-11-28T20:42:13.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c537fe640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2c3c066470 0x7f2c3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c004020 con 0x7f2c5c0b05b0 2023-11-28T20:42:13.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2c441227c0 con 0x7f2c5c0b0110 2023-11-28T20:42:13.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2c4c004180 con 0x7f2c5c0b05b0 2023-11-28T20:42:13.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b05b0 msgr2=0x7f2c5c1efce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c537fe640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b05b0 0x7f2c5c1efce0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00f550 tx=0x7f2c4c00fa10 comp rx=0 tx=0).stop 2023-11-28T20:42:13.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b05b0 msgr2=0x7f2c5c1efce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:13.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c537fe640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b05b0 0x7f2c5c1efce0 secure :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00f550 tx=0x7f2c4c00fa10 comp rx=0 tx=0).stop 2023-11-28T20:42:13.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c5b7fe640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2c3c066470 0x7f2c3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.170+0000 7f2c5b7fe640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2c3c066470 0x7f2c3c068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2c54003ab0 tx=0x7f2c54009790 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c152090 0x7f2c5c1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c0c4cc0 con 0x7f2c5c152090 2023-11-28T20:42:13.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c5affd640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c152090 0x7f2c5c1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c5affd640 1 -- 172.21.15.167:0/1432824829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2c5c0ca760 con 0x7f2c5c152090 2023-11-28T20:42:13.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c5affd640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c152090 0x7f2c5c1524a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00f550 tx=0x7f2c4c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c014d00 con 0x7f2c5c152090 2023-11-28T20:42:13.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4982 (secure 0 0 0) 0x7f2c4c014e60 con 0x7f2c5c152090 2023-11-28T20:42:13.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c152090 msgr2=0x7f2c5c1524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c537fe640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c152090 0x7f2c5c1524a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00f550 tx=0x7f2c4c0046d0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c537fe640 1 -- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c152090 msgr2=0x7f2c5c1524a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:13.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c537fe640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c152090 0x7f2c5c1524a0 secure :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00f550 tx=0x7f2c4c0046d0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.180 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:42:13.180 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:13.180 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:13.180 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 30, 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 11, 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:13.181 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:42:13.182 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.183 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:42:13.184 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:42:13.184 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:42:13.184 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:42:13.184 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:42:13.184 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:42:13.184 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:13.184 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:13.185 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:42:13.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:42:13.187 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.188 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:42:13.189 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.190 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:42:13.191 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:42:13.192 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:42:13.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.193 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.193 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.193 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:13.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.193 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.193 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:42:13.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.193 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:42:13.194 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.195 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.195 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:13.196 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.197 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.197 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:42:13.197 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:42:13.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2c3c066470 msgr2=0x7f2c3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2c3c066470 0x7f2c3c068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2c54003ab0 tx=0x7f2c54009790 comp rx=0 tx=0).stop 2023-11-28T20:42:13.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b0110 msgr2=0x7f2c5c0c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 --2- 172.21.15.167:0/1432824829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c5c0b0110 0x7f2c5c0c3230 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c4401d3a0 tx=0x7f2c4401ba90 comp rx=0 tx=0).stop 2023-11-28T20:42:13.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c5b7fe640 1 -- 172.21.15.167:0/1432824829 reap_dead start 2023-11-28T20:42:13.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c5b7fe640 1 -- 172.21.15.167:0/1432824829 reap_dead start 2023-11-28T20:42:13.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 shutdown_connections 2023-11-28T20:42:13.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 >> 172.21.15.167:0/1432824829 conn(0x7f2c5c06ee30 msgr2=0x7f2c5c0cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:13.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 shutdown_connections 2023-11-28T20:42:13.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.178+0000 7f2c614ea640 1 -- 172.21.15.167:0/1432824829 wait complete. 2023-11-28T20:42:13.199 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:42:13.199 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:42:13.199 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:42:13.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2febaa640 1 Processor -- start 2023-11-28T20:42:13.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2febaa640 1 -- start start 2023-11-28T20:42:13.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2febaa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2f80c75c0 0x7ff2f80c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2febaa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff2f806a580 0x7ff2f806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2febaa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80c7a50 con 0x7ff2f8151f60 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2febaa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f806aed0 con 0x7ff2f806a580 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2febaa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f80c4da0 con 0x7ff2f80c75c0 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2fd147640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff2f806a580 0x7ff2f806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2fd147640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff2f806a580 0x7ff2f806a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38338/0 (socket says 172.21.15.167:38338) 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2fd147640 1 -- 172.21.15.167:0/747763488 learned_addr learned my addr 172.21.15.167:0/747763488 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2effff640 1 --2- 172.21.15.167:0/747763488 >> v2:172.21.15.178:3300/0 conn(0x7ff2f80c75c0 0x7ff2f80c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2fd147640 1 -- 172.21.15.167:0/747763488 >> v2:172.21.15.178:3300/0 conn(0x7ff2f80c75c0 msgr2=0x7ff2f80c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2fd147640 1 --2- 172.21.15.167:0/747763488 >> v2:172.21.15.178:3300/0 conn(0x7ff2f80c75c0 0x7ff2f80c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2fd147640 1 -- 172.21.15.167:0/747763488 >> v1:172.21.15.178:6789/0 conn(0x7ff2f8151f60 legacy=0x7ff2f80c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:13.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.338+0000 7ff2fd147640 1 -- 172.21.15.167:0/747763488 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f815b220 con 0x7ff2f806a580 2023-11-28T20:42:13.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2fd147640 1 --2- 172.21.15.167:0/747763488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 0x7ff2f806a990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80c8d80 tx=0x7ff2f001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6128517ab75ae8d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2ef7fe640 1 -- 172.21.15.167:0/747763488 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f00a55c0 con 0x7ff2f806a580 2023-11-28T20:42:13.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2ef7fe640 1 -- 172.21.15.167:0/747763488 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f00a5720 con 0x7ff2f806a580 2023-11-28T20:42:13.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2ef7fe640 1 -- 172.21.15.167:0/747763488 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f00a5ab0 con 0x7ff2f806a580 2023-11-28T20:42:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2febaa640 1 -- 172.21.15.167:0/747763488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 msgr2=0x7ff2f806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2febaa640 1 --2- 172.21.15.167:0/747763488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 0x7ff2f806a990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80c8d80 tx=0x7ff2f001c900 comp rx=0 tx=0).stop 2023-11-28T20:42:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2febaa640 1 -- 172.21.15.167:0/747763488 shutdown_connections 2023-11-28T20:42:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2febaa640 1 --2- 172.21.15.167:0/747763488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 0x7ff2f806a990 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2febaa640 1 --2- 172.21.15.167:0/747763488 >> v2:172.21.15.178:3300/0 conn(0x7ff2f80c75c0 0x7ff2f80c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2febaa640 1 -- 172.21.15.167:0/747763488 >> 172.21.15.167:0/747763488 conn(0x7ff2f80cb1e0 msgr2=0x7ff2f80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2febaa640 1 -- 172.21.15.167:0/747763488 shutdown_connections 2023-11-28T20:42:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.342+0000 7ff2febaa640 1 -- 172.21.15.167:0/747763488 wait complete. 2023-11-28T20:42:13.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 Processor -- start 2023-11-28T20:42:13.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 -- start start 2023-11-28T20:42:13.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 0x7ff2f814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2f80c75c0 0x7ff2f815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f8151f60 0x7ff2f8140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f81559d0 con 0x7ff2f806a580 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f81f2420 con 0x7ff2f8151f60 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f81f5ac0 con 0x7ff2f80c75c0 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fc946640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 0x7ff2f814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fc946640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 0x7ff2f814f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38354/0 (socket says 172.21.15.167:38354) 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fc946640 1 -- 172.21.15.167:0/3120406862 learned_addr learned my addr 172.21.15.167:0/3120406862 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2effff640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2f80c75c0 0x7ff2f815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fd147640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f8151f60 0x7ff2f8140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fc946640 1 -- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2f80c75c0 msgr2=0x7ff2f815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fc946640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2f80c75c0 0x7ff2f815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fc946640 1 -- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f8151f60 msgr2=0x7ff2f8140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fc946640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f8151f60 0x7ff2f8140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fc946640 1 -- 172.21.15.167:0/3120406862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f0009b30 con 0x7ff2f806a580 2023-11-28T20:42:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2fc946640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 0x7ff2f814f720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c450 tx=0x7ff2f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4012830 con 0x7ff2f806a580 2023-11-28T20:42:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f40129b0 con 0x7ff2f806a580 2023-11-28T20:42:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f81f5d60 con 0x7ff2f806a580 2023-11-28T20:42:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4012d60 con 0x7ff2f806a580 2023-11-28T20:42:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f81f6320 con 0x7ff2f806a580 2023-11-28T20:42:13.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f81f64e0 0x7ff2f8140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8074770 con 0x7ff2f81f64e0 2023-11-28T20:42:13.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.346+0000 7ff2effff640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f81f64e0 0x7ff2f8140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2effff640 1 -- 172.21.15.167:0/3120406862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2f815ba30 con 0x7ff2f81f64e0 2023-11-28T20:42:13.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2f401c460 con 0x7ff2f806a580 2023-11-28T20:42:13.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2effff640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f81f64e0 0x7ff2f8140fb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8148a10 tx=0x7ff2e8010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2ed7fa640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2e4066470 0x7ff2e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff2f4083f40 con 0x7ff2f806a580 2023-11-28T20:42:13.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2fd147640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2e4066470 0x7ff2e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8004240 con 0x7ff2f81f64e0 2023-11-28T20:42:13.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff2e80043a0 con 0x7ff2f81f64e0 2023-11-28T20:42:13.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f81f64e0 msgr2=0x7ff2f8140fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2ed7fa640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f81f64e0 0x7ff2f8140fb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8148a10 tx=0x7ff2e8010c80 comp rx=0 tx=0).stop 2023-11-28T20:42:13.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f81f64e0 msgr2=0x7ff2f8140fb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:13.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2ed7fa640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f81f64e0 0x7ff2f8140fb0 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8148a10 tx=0x7ff2e8010c80 comp rx=0 tx=0).stop 2023-11-28T20:42:13.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.350+0000 7ff2fd147640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2e4066470 0x7ff2e4068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00ae000 tx=0x7ff2f00a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f814fd00 0x7ff2f81f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8158750 con 0x7ff2f814fd00 2023-11-28T20:42:13.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2effff640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f814fd00 0x7ff2f81f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2effff640 1 -- 172.21.15.167:0/3120406862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff2f815bf50 con 0x7ff2f814fd00 2023-11-28T20:42:13.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2effff640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f814fd00 0x7ff2f81f2850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8007fd0 tx=0x7ff2e80046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8024070 con 0x7ff2f814fd00 2023-11-28T20:42:13.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4953 (secure 0 0 0) 0x7ff2e8004510 con 0x7ff2f814fd00 2023-11-28T20:42:13.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f814fd00 msgr2=0x7ff2f81f2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2ed7fa640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f814fd00 0x7ff2f81f2850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8007fd0 tx=0x7ff2e80046d0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2ed7fa640 1 -- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f814fd00 msgr2=0x7ff2f81f2850 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:13.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2ed7fa640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2f814fd00 0x7ff2f81f2850 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8007fd0 tx=0x7ff2e80046d0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.362 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:42:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:42:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 30, 2023-11-28T20:42:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:42:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:42:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:42:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:42:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:42:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:42:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:42:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:42:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:42:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:42:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:42:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:42:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:42:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:42:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:42:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:42:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:13.371 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:42:13.372 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.372 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.372 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.372 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:42:13.372 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:42:13.372 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:13.372 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:42:13.373 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.374 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:13.374 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:42:13.374 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.375 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.375 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.375 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:42:13.375 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:42:13.375 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:13.375 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:13.376 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:13.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.376 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:13.376 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:13.376 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:13.376 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:13.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.376 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.377 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.378 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.379 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:42:13.380 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:42:13.381 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:42:13.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2e4066470 msgr2=0x7ff2e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2e4066470 0x7ff2e4068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00ae000 tx=0x7ff2f00a7070 comp rx=0 tx=0).stop 2023-11-28T20:42:13.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 msgr2=0x7ff2f814f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 --2- 172.21.15.167:0/3120406862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f806a580 0x7ff2f814f720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c450 tx=0x7ff2f400c910 comp rx=0 tx=0).stop 2023-11-28T20:42:13.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2fd147640 1 -- 172.21.15.167:0/3120406862 reap_dead start 2023-11-28T20:42:13.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2fd147640 1 -- 172.21.15.167:0/3120406862 reap_dead start 2023-11-28T20:42:13.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 shutdown_connections 2023-11-28T20:42:13.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 >> 172.21.15.167:0/3120406862 conn(0x7ff2f80cb1e0 msgr2=0x7ff2f8161900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:13.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 shutdown_connections 2023-11-28T20:42:13.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.358+0000 7ff2febaa640 1 -- 172.21.15.167:0/3120406862 wait complete. 2023-11-28T20:42:13.384 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:42:13.385 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:42:13.385 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:42:13.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.522+0000 7f03fadf8640 1 Processor -- start 2023-11-28T20:42:13.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.522+0000 7f03fadf8640 1 -- start start 2023-11-28T20:42:13.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03fadf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4070480 0x7f03f4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03fadf8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f03f406e410 0x7f03f4072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03fadf8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f41571d0 con 0x7f03f406e030 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03fadf8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f4071a90 con 0x7f03f406e410 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03fadf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40c70d0 con 0x7f03f4070480 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03f8b94640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f03f406e030 0x7f03f41500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39016/0 (socket says 172.21.15.167:39016) 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03f8b94640 1 -- 172.21.15.167:0/1059106775 learned_addr learned my addr 172.21.15.167:0/1059106775 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03f9395640 1 --2- 172.21.15.167:0/1059106775 >> v2:172.21.15.178:3300/0 conn(0x7f03f406e410 0x7f03f4072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03ebfff640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4070480 0x7f03f4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747408471 0 0) 0x7f03f41571d0 con 0x7f03f406e030 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc003530 con 0x7f03f406e030 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 984772164 0 0) 0x7f03dc003530 con 0x7f03f406e030 2023-11-28T20:42:13.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4070480 msgr2=0x7f03f4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:13.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4070480 0x7f03f4071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 >> v2:172.21.15.178:3300/0 conn(0x7f03f406e410 msgr2=0x7f03f4072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:13.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 --2- 172.21.15.167:0/1059106775 >> v2:172.21.15.178:3300/0 conn(0x7f03f406e410 0x7f03f4072460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40c73b0 con 0x7f03f406e030 2023-11-28T20:42:13.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f03f0001680 con 0x7f03f406e030 2023-11-28T20:42:13.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 >> v1:172.21.15.167:6789/0 conn(0x7f03f406e030 legacy=0x7f03f41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4070480 0x7f03dc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 0x7f03dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03dc004d10 0x7f03dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4071a90 con 0x7f03dc003f50 2023-11-28T20:42:13.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40c70d0 con 0x7f03dc004d10 2023-11-28T20:42:13.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc00b990 con 0x7f03f4070480 2023-11-28T20:42:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03ebfff640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 0x7f03dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03f8b94640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4070480 0x7f03dc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03f9395640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03dc004d10 0x7f03dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03ebfff640 1 -- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4070480 msgr2=0x7f03dc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03ebfff640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4070480 0x7f03dc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03ebfff640 1 -- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03dc004d10 msgr2=0x7f03dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03ebfff640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03dc004d10 0x7f03dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03ebfff640 1 -- 172.21.15.167:0/1059106775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc003530 con 0x7f03dc003f50 2023-11-28T20:42:13.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.526+0000 7f03f9395640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03dc004d10 0x7f03dc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:42:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03ebfff640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 0x7f03dc0047d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009670 tx=0x7f03e401ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4662b8065cb59287 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e40a7860 con 0x7f03dc003f50 2023-11-28T20:42:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e40a79c0 con 0x7f03dc003f50 2023-11-28T20:42:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03eb7fe640 1 -- 172.21.15.167:0/1059106775 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e40a7d70 con 0x7f03dc003f50 2023-11-28T20:42:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03fadf8640 1 -- 172.21.15.167:0/1059106775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 msgr2=0x7f03dc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03fadf8640 1 --2- 172.21.15.167:0/1059106775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 0x7f03dc0047d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009670 tx=0x7f03e401ec60 comp rx=0 tx=0).stop 2023-11-28T20:42:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03f9395640 1 -- 172.21.15.167:0/1059106775 reap_dead start 2023-11-28T20:42:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03fadf8640 1 -- 172.21.15.167:0/1059106775 shutdown_connections 2023-11-28T20:42:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03fadf8640 1 -- 172.21.15.167:0/1059106775 >> 172.21.15.167:0/1059106775 conn(0x7f03f40cb1e0 msgr2=0x7f03f40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03fadf8640 1 -- 172.21.15.167:0/1059106775 shutdown_connections 2023-11-28T20:42:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03fadf8640 1 -- 172.21.15.167:0/1059106775 wait complete. 2023-11-28T20:42:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03fadf8640 1 Processor -- start 2023-11-28T20:42:13.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.530+0000 7f03fadf8640 1 -- start start 2023-11-28T20:42:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 0x7f03f414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f41e0d30 0x7f03f41e3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f41e4df0 0x7f03f41e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41e2d00 con 0x7f03dc003f50 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41e2300 con 0x7f03f41e0d30 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41e1a80 con 0x7f03f41e4df0 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f8b94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 0x7f03f414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f8b94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 0x7f03f414f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38370/0 (socket says 172.21.15.167:38370) 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f8b94640 1 -- 172.21.15.167:0/444984902 learned_addr learned my addr 172.21.15.167:0/444984902 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f9395640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f41e4df0 0x7f03f41e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03ebfff640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f41e0d30 0x7f03f41e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f8b94640 1 -- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f41e4df0 msgr2=0x7f03f41e36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f8b94640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f41e4df0 0x7f03f41e36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f8b94640 1 -- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f41e0d30 msgr2=0x7f03f41e3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f8b94640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f41e0d30 0x7f03f41e3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f8b94640 1 -- 172.21.15.167:0/444984902 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f41e1d40 con 0x7f03dc003f50 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03f8b94640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 0x7f03f414f340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f03f00124f0 tx=0x7f03f00129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0014810 con 0x7f03dc003f50 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f0014990 con 0x7f03dc003f50 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0014d40 con 0x7f03dc003f50 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f41e2020 con 0x7f03dc003f50 2023-11-28T20:42:13.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f414d560 con 0x7f03dc003f50 2023-11-28T20:42:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c90c0 0x7f03f40c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4074770 con 0x7f03f40c90c0 2023-11-28T20:42:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03ebfff640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c90c0 0x7f03f40c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.534+0000 7f03ebfff640 1 -- 172.21.15.167:0/444984902 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03f40c2770 con 0x7f03f40c90c0 2023-11-28T20:42:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f03f0016480 con 0x7f03dc003f50 2023-11-28T20:42:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03ebfff640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c90c0 0x7f03f40c94e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009ae0 tx=0x7f03e401ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03e97fa640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03e0066470 0x7f03e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f03f0087890 con 0x7f03dc003f50 2023-11-28T20:42:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4006be0 con 0x7f03f40c90c0 2023-11-28T20:42:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f03e4004240 con 0x7f03f40c90c0 2023-11-28T20:42:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03f9395640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03e0066470 0x7f03e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c90c0 msgr2=0x7f03f40c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03e97fa640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c90c0 0x7f03f40c94e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009ae0 tx=0x7f03e401ba00 comp rx=0 tx=0).stop 2023-11-28T20:42:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c90c0 msgr2=0x7f03f40c94e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03e97fa640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c90c0 0x7f03f40c94e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.538+0000 7f03f9395640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03e0066470 0x7f03e0068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00bb20 tx=0x7f03ec00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.542+0000 7f03fadf8640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c9a20 0x7f03f41407b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.542+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41e2b60 con 0x7f03f40c9a20 2023-11-28T20:42:13.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.542+0000 7f03ebfff640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c9a20 0x7f03f41407b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03ebfff640 1 -- 172.21.15.167:0/444984902 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f03f406b4b0 con 0x7f03f40c9a20 2023-11-28T20:42:13.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03ebfff640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c9a20 0x7f03f41407b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009ab0 tx=0x7f03dc005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e40c1ad0 con 0x7f03f40c9a20 2023-11-28T20:42:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f03e40c5070 con 0x7f03f40c9a20 2023-11-28T20:42:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c9a20 msgr2=0x7f03f41407b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03e97fa640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c9a20 0x7f03f41407b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009ab0 tx=0x7f03dc005800 comp rx=0 tx=0).stop 2023-11-28T20:42:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03e97fa640 1 -- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c9a20 msgr2=0x7f03f41407b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03e97fa640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f40c9a20 0x7f03f41407b0 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009ab0 tx=0x7f03dc005800 comp rx=0 tx=0).stop 2023-11-28T20:42:13.547 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:42:13.547 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 30, 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:13.548 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:13.549 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:13.550 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:42:13.551 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:42:13.552 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:42:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:13.554 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.555 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:13.556 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.557 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:42:13.562 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:42:13.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03e0066470 msgr2=0x7f03e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03fadf8640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03e0066470 0x7f03e0068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00bb20 tx=0x7f03ec00b040 comp rx=0 tx=0).stop 2023-11-28T20:42:13.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 msgr2=0x7f03f414f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03fadf8640 1 --2- 172.21.15.167:0/444984902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03dc003f50 0x7f03f414f340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f03f00124f0 tx=0x7f03f00129b0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03f9395640 1 -- 172.21.15.167:0/444984902 reap_dead start 2023-11-28T20:42:13.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03f9395640 1 -- 172.21.15.167:0/444984902 reap_dead start 2023-11-28T20:42:13.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 shutdown_connections 2023-11-28T20:42:13.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 >> 172.21.15.167:0/444984902 conn(0x7f03f40cb1e0 msgr2=0x7f03f406e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:13.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 shutdown_connections 2023-11-28T20:42:13.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.546+0000 7f03fadf8640 1 -- 172.21.15.167:0/444984902 wait complete. 2023-11-28T20:42:13.565 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:42:13.566 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2023-11-28T20:42:13.566 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:42:13.566 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2023-11-28T20:42:13.566 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:42:13.566 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T20:42:13.566 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:42:13.586 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T20:42:13.586 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:42:13.586 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:42:13.593 INFO:tasks.workunit.client.0.smithi167.stdout:./122/.snap/snap-subdir-test 2023-11-28T20:42:13.605 INFO:tasks.workunit.client.0.smithi167.stdout:./162/.snap/snap-subdir-test 2023-11-28T20:42:13.614 INFO:tasks.workunit.client.0.smithi167.stdout:./197/.snap/snap-subdir-test 2023-11-28T20:42:13.623 INFO:tasks.workunit.client.0.smithi167.stdout:./216/.snap/snap-subdir-test 2023-11-28T20:42:13.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.734+0000 7f2d4753b640 1 Processor -- start 2023-11-28T20:42:13.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.734+0000 7f2d4753b640 1 -- start start 2023-11-28T20:42:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d4753b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d4015a540 0x7f2d400ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d4753b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d400cfef0 con 0x7f2d400ccb70 2023-11-28T20:42:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d4753b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d400cc6e0 con 0x7f2d40153db0 2023-11-28T20:42:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d4753b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4015a9d0 con 0x7f2d4015a540 2023-11-28T20:42:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45d38640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f2d400ccb70 legacy=0x7f2d400cf440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:42:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d46d3a640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f2d4015a540 msgr2=0x7f2d400ca350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d46d3a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d4015a540 0x7f2d400ca350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d46539640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2d40153db0 0x7f2d400c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:53326/0 (socket says 172.21.15.167:53326) 2023-11-28T20:42:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d46539640 1 -- 172.21.15.167:0/2277731834 learned_addr learned my addr 172.21.15.167:0/2277731834 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:42:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594994336 0 0) 0x7f2d400cc6e0 con 0x7f2d40153db0 2023-11-28T20:42:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d2c003530 con 0x7f2d40153db0 2023-11-28T20:42:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009914097 0 0) 0x7f2d2c003530 con 0x7f2d40153db0 2023-11-28T20:42:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 >> v2:172.21.15.167:3300/0 conn(0x7f2d4015a540 msgr2=0x7f2d400ca350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 --2- 172.21.15.167:0/2277731834 >> v2:172.21.15.167:3300/0 conn(0x7f2d4015a540 0x7f2d400ca350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 >> v1:172.21.15.167:6789/0 conn(0x7f2d400ccb70 legacy=0x7f2d400cf440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40154190 con 0x7f2d40153db0 2023-11-28T20:42:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f2d3c001680 con 0x7f2d40153db0 2023-11-28T20:42:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 >> v1:172.21.15.178:6789/0 conn(0x7f2d40153db0 legacy=0x7f2d400c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d2c003980 0x7f2d2c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d2c005200 0x7f2d2c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4015a9d0 con 0x7f2d2c003980 2023-11-28T20:42:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c00c160 con 0x7f2d2c005200 2023-11-28T20:42:13.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c00c320 con 0x7f2d2c0047d0 2023-11-28T20:42:13.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d46539640 1 -- 172.21.15.167:0/2277731834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d2c003980 msgr2=0x7f2d2c003d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:13.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d46539640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d2c003980 0x7f2d2c003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:13.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45d38640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d46d3a640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d2c005200 0x7f2d2c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45d38640 1 -- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d2c005200 msgr2=0x7f2d2c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45d38640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d2c005200 0x7f2d2c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45d38640 1 -- 172.21.15.167:0/2277731834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d2c003980 msgr2=0x7f2d2c003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45d38640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d2c003980 0x7f2d2c003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d45d38640 1 -- 172.21.15.167:0/2277731834 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c003530 con 0x7f2d2c0047d0 2023-11-28T20:42:13.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d46d3a640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d2c005200 0x7f2d2c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:42:13.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.738+0000 7f2d46d3a640 1 -- 172.21.15.167:0/2277731834 reap_dead start 2023-11-28T20:42:13.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d45d38640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2d30003990 tx=0x7f2d3001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbb9af1dc84ccd04 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d300039c0 con 0x7f2d2c0047d0 2023-11-28T20:42:13.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30003b20 con 0x7f2d2c0047d0 2023-11-28T20:42:13.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d45537640 1 -- 172.21.15.167:0/2277731834 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30003cd0 con 0x7f2d2c0047d0 2023-11-28T20:42:13.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d4753b640 1 -- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 msgr2=0x7f2d2c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d4753b640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2d30003990 tx=0x7f2d3001c3f0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d4753b640 1 -- 172.21.15.167:0/2277731834 shutdown_connections 2023-11-28T20:42:13.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d4753b640 1 --2- 172.21.15.167:0/2277731834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d4753b640 1 -- 172.21.15.167:0/2277731834 >> 172.21.15.167:0/2277731834 conn(0x7f2d4006b800 msgr2=0x7f2d4006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:13.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d4753b640 1 -- 172.21.15.167:0/2277731834 shutdown_connections 2023-11-28T20:42:13.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.742+0000 7f2d4753b640 1 -- 172.21.15.167:0/2277731834 wait complete. 2023-11-28T20:42:13.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d4753b640 1 Processor -- start 2023-11-28T20:42:13.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d4753b640 1 -- start start 2023-11-28T20:42:13.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d4753b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d401545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d4753b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d401558f0 0x7f2d401582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d4753b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d40158830 0x7f2d401f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d4753b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40156c80 con 0x7f2d401558f0 2023-11-28T20:42:13.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d4753b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40157e60 con 0x7f2d40158830 2023-11-28T20:42:13.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d4753b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40158cb0 con 0x7f2d2c0047d0 2023-11-28T20:42:13.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d45d38640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d401558f0 msgr2=0x7f2d401582f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:13.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d45d38640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d401558f0 0x7f2d401582f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:13.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46539640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d401545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46d3a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d40158830 0x7f2d401f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46539640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d401545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:53614/0 (socket says 172.21.15.167:53614) 2023-11-28T20:42:13.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46539640 1 -- 172.21.15.167:0/2178013744 learned_addr learned my addr 172.21.15.167:0/2178013744 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:13.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46d3a640 1 -- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 msgr2=0x7f2d401545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46d3a640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d401545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46d3a640 1 -- 172.21.15.167:0/2178013744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d401558f0 msgr2=0x7f2d401582f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:42:13.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46d3a640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d401558f0 0x7f2d401582f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46d3a640 1 -- 172.21.15.167:0/2178013744 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d401566c0 con 0x7f2d40158830 2023-11-28T20:42:13.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d46d3a640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d40158830 0x7f2d401f5630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d400c4ae0 tx=0x7f2d3800c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.746+0000 7f2d36ffd640 1 -- 172.21.15.167:0/2178013744 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38017640 con 0x7f2d40158830 2023-11-28T20:42:13.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.750+0000 7f2d36ffd640 1 -- 172.21.15.167:0/2178013744 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d380177c0 con 0x7f2d40158830 2023-11-28T20:42:13.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.750+0000 7f2d36ffd640 1 -- 172.21.15.167:0/2178013744 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38017b70 con 0x7f2d40158830 2023-11-28T20:42:13.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.750+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d401569a0 con 0x7f2d40158830 2023-11-28T20:42:13.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.750+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d40157af0 con 0x7f2d40158830 2023-11-28T20:42:13.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.750+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d40157670 con 0x7f2d40158830 2023-11-28T20:42:13.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.750+0000 7f2d36ffd640 1 -- 172.21.15.167:0/2178013744 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d3800b3a0 con 0x7f2d40158830 2023-11-28T20:42:13.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.750+0000 7f2d36ffd640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d24066450 0x7f2d24068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:13.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.750+0000 7f2d36ffd640 1 -- 172.21.15.167:0/2178013744 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2d38084dc0 con 0x7f2d40158830 2023-11-28T20:42:13.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.754+0000 7f2d46539640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d24066450 0x7f2d24068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:13.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.754+0000 7f2d46539640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d24066450 0x7f2d24068910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c004c60 tx=0x7f2d3c001b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:13.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.762+0000 7f2d36ffd640 1 -- 172.21.15.167:0/2178013744 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2d38051da0 con 0x7f2d40158830 2023-11-28T20:42:13.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.966+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2d40157640 con 0x7f2d40158830 2023-11-28T20:42:13.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.966+0000 7f2d36ffd640 1 -- 172.21.15.167:0/2178013744 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f2d380553c0 con 0x7f2d40158830 2023-11-28T20:42:13.967 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:42:13.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.966+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d24066450 msgr2=0x7f2d24068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.966+0000 7f2d4753b640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d24066450 0x7f2d24068910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c004c60 tx=0x7f2d3c001b20 comp rx=0 tx=0).stop 2023-11-28T20:42:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.966+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d40158830 msgr2=0x7f2d401f5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.966+0000 7f2d4753b640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d40158830 0x7f2d401f5630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d400c4ae0 tx=0x7f2d3800c750 comp rx=0 tx=0).stop 2023-11-28T20:42:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.970+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 shutdown_connections 2023-11-28T20:42:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.970+0000 7f2d4753b640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2d24066450 0x7f2d24068910 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.970+0000 7f2d4753b640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d40158830 0x7f2d401f5630 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.970+0000 7f2d4753b640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d401558f0 0x7f2d401582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.970+0000 7f2d4753b640 1 --2- 172.21.15.167:0/2178013744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d2c0047d0 0x7f2d401545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.970+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 >> 172.21.15.167:0/2178013744 conn(0x7f2d4006b800 msgr2=0x7f2d400cb090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.970+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 shutdown_connections 2023-11-28T20:42:13.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:13.970+0000 7f2d4753b640 1 -- 172.21.15.167:0/2178013744 wait complete. 2023-11-28T20:42:15.310 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:15.315 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:16.366 INFO:tasks.workunit.client.0.smithi167.stdout:./254/.snap/snap-subdir-test 2023-11-28T20:42:16.378 INFO:tasks.workunit.client.0.smithi167.stdout:./113/.snap/snap-subdir-test 2023-11-28T20:42:16.389 INFO:tasks.workunit.client.0.smithi167.stdout:./152/.snap/snap-subdir-test 2023-11-28T20:42:16.403 INFO:tasks.workunit.client.0.smithi167.stdout:./121/.snap/snap-subdir-test 2023-11-28T20:42:16.414 INFO:tasks.workunit.client.0.smithi167.stdout:./118/.snap/snap-subdir-test 2023-11-28T20:42:16.678 INFO:tasks.workunit.client.0.smithi167.stdout:./196/.snap/snap-subdir-test 2023-11-28T20:42:16.691 INFO:tasks.workunit.client.0.smithi167.stdout:./124/.snap/snap-subdir-test 2023-11-28T20:42:16.704 INFO:tasks.workunit.client.0.smithi167.stdout:./239/.snap/snap-subdir-test 2023-11-28T20:42:16.714 INFO:tasks.workunit.client.0.smithi167.stdout:./188/.snap/snap-subdir-test 2023-11-28T20:42:16.726 INFO:tasks.workunit.client.0.smithi167.stdout:./287/.snap/snap-subdir-test 2023-11-28T20:42:16.737 INFO:tasks.workunit.client.0.smithi167.stdout:./275/.snap/snap-subdir-test 2023-11-28T20:42:16.748 INFO:tasks.workunit.client.0.smithi167.stdout:./259/.snap/snap-subdir-test 2023-11-28T20:42:16.989 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:42:17.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.130+0000 7f5202d0f640 1 Processor -- start 2023-11-28T20:42:17.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.130+0000 7f5202d0f640 1 -- start start 2023-11-28T20:42:17.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f5202d0f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51fc150b40 0x7f51fc157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:17.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f5202d0f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51fc0c6ff0 0x7f51fc0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:17.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f5202d0f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c5be0 0x7f51fc06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:17.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f5202d0f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51fc0c6ac0 con 0x7f51fc150b40 2023-11-28T20:42:17.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f5202d0f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51fc0c6500 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f5202d0f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc0c67e0 con 0x7f51fc0c5be0 2023-11-28T20:42:17.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f5200aab640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f51fc150b40 msgr2=0x7f51fc157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:17.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f5200aab640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51fc150b40 0x7f51fc157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:17.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f51fbfff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51fc0c6ff0 0x7f51fc0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:17.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f52012ac640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c5be0 0x7f51fc06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:17.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f51fbfff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51fc0c6ff0 0x7f51fc0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:57772/0 (socket says 172.21.15.167:57772) 2023-11-28T20:42:17.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f51fbfff640 1 -- 172.21.15.167:0/1080244154 learned_addr learned my addr 172.21.15.167:0/1080244154 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:17.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f51fbfff640 1 -- 172.21.15.167:0/1080244154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c5be0 msgr2=0x7f51fc06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:17.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f51fbfff640 1 --2- 172.21.15.167:0/1080244154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c5be0 0x7f51fc06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f51fbfff640 1 -- 172.21.15.167:0/1080244154 >> v2:172.21.15.167:3300/0 conn(0x7f51fc150b40 msgr2=0x7f51fc157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:17.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f51fbfff640 1 --2- 172.21.15.167:0/1080244154 >> v2:172.21.15.167:3300/0 conn(0x7f51fc150b40 0x7f51fc157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f51fbfff640 1 -- 172.21.15.167:0/1080244154 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc156a80 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.134+0000 7f52012ac640 1 --2- 172.21.15.167:0/1080244154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c5be0 0x7f51fc06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:42:17.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f51fbfff640 1 --2- 172.21.15.167:0/1080244154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51fc0c6ff0 0x7f51fc0c4510 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51fc06bba0 tx=0x7f51e801e700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62dfd1b31d02e468 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:17.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f51fb7fe640 1 -- 172.21.15.167:0/1080244154 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80a8690 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f51fb7fe640 1 -- 172.21.15.167:0/1080244154 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e80a87f0 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f51fb7fe640 1 -- 172.21.15.167:0/1080244154 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80a8b80 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 -- 172.21.15.167:0/1080244154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51fc0c6ff0 msgr2=0x7f51fc0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:17.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1080244154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51fc0c6ff0 0x7f51fc0c4510 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51fc06bba0 tx=0x7f51e801e700 comp rx=0 tx=0).stop 2023-11-28T20:42:17.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 -- 172.21.15.167:0/1080244154 shutdown_connections 2023-11-28T20:42:17.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1080244154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c5be0 0x7f51fc06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1080244154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51fc0c6ff0 0x7f51fc0c4510 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1080244154 >> v2:172.21.15.167:3300/0 conn(0x7f51fc150b40 0x7f51fc157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 -- 172.21.15.167:0/1080244154 >> 172.21.15.167:0/1080244154 conn(0x7f51fc0cb1e0 msgr2=0x7f51fc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:17.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 -- 172.21.15.167:0/1080244154 shutdown_connections 2023-11-28T20:42:17.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 -- 172.21.15.167:0/1080244154 wait complete. 2023-11-28T20:42:17.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.138+0000 7f5202d0f640 1 Processor -- start 2023-11-28T20:42:17.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 -- start start 2023-11-28T20:42:17.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51fc0c5be0 0x7f51fc160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:17.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c6ff0 0x7f51fc1f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:17.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51fc150b40 0x7f51fc071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:17.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc15fc80 con 0x7f51fc0c5be0 2023-11-28T20:42:17.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc1475c0 con 0x7f51fc150b40 2023-11-28T20:42:17.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc148420 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5200aab640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51fc0c5be0 msgr2=0x7f51fc160af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:17.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5200aab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51fc0c5be0 0x7f51fc160af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:17.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51fbfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c6ff0 0x7f51fc1f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:17.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f52012ac640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51fc150b40 0x7f51fc071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:17.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51fbfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c6ff0 0x7f51fc1f43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:53634/0 (socket says 172.21.15.167:53634) 2023-11-28T20:42:17.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51fbfff640 1 -- 172.21.15.167:0/1023099591 learned_addr learned my addr 172.21.15.167:0/1023099591 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:17.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51fbfff640 1 -- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51fc150b40 msgr2=0x7f51fc071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:17.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51fbfff640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51fc150b40 0x7f51fc071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51fbfff640 1 -- 172.21.15.167:0/1023099591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51fc0c5be0 msgr2=0x7f51fc160af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:42:17.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51fbfff640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51fc0c5be0 0x7f51fc160af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51fbfff640 1 -- 172.21.15.167:0/1023099591 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4009a70 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51fbfff640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c6ff0 0x7f51fc1f43e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f51e8024cb0 tx=0x7f51e801b4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:17.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51f97fa640 1 -- 172.21.15.167:0/1023099591 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8006ea0 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e80094d0 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51f97fa640 1 -- 172.21.15.167:0/1023099591 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e80a98a0 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f51f97fa640 1 -- 172.21.15.167:0/1023099591 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80a8690 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc148d70 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.142+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc0682c0 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.146+0000 7f51f97fa640 1 -- 172.21.15.167:0/1023099591 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f51e80a9c50 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.146+0000 7f51f97fa640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51e0066420 0x7f51e00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:17.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.146+0000 7f51f97fa640 1 -- 172.21.15.167:0/1023099591 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f51e811ebb0 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.146+0000 7f5200aab640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51e0066420 0x7f51e00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:17.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.146+0000 7f5200aab640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51e0066420 0x7f51e00688e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51f0003990 tx=0x7f51f0006d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:17.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.158+0000 7f51f97fa640 1 -- 172.21.15.167:0/1023099591 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51e80ebc40 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f51fc075c90 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f51f97fa640 1 -- 172.21.15.167:0/1023099591 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f51e80ef260 con 0x7f51fc0c6ff0 2023-11-28T20:42:17.363 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:42:17.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51e0066420 msgr2=0x7f51e00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:17.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51e0066420 0x7f51e00688e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51f0003990 tx=0x7f51f0006d90 comp rx=0 tx=0).stop 2023-11-28T20:42:17.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c6ff0 msgr2=0x7f51fc1f43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:17.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c6ff0 0x7f51fc1f43e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f51e8024cb0 tx=0x7f51e801b4a0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 shutdown_connections 2023-11-28T20:42:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51e0066420 0x7f51e00688e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51fc150b40 0x7f51fc071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51fc0c6ff0 0x7f51fc1f43e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 --2- 172.21.15.167:0/1023099591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51fc0c5be0 0x7f51fc160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:17.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 >> 172.21.15.167:0/1023099591 conn(0x7f51fc0cb1e0 msgr2=0x7f51fc154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:17.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 shutdown_connections 2023-11-28T20:42:17.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:17.362+0000 7f5202d0f640 1 -- 172.21.15.167:0/1023099591 wait complete. 2023-11-28T20:42:17.535 INFO:tasks.workunit.client.0.smithi167.stdout:./224/.snap/snap-subdir-test 2023-11-28T20:42:17.548 INFO:tasks.workunit.client.0.smithi167.stdout:./264/.snap/snap-subdir-test 2023-11-28T20:42:17.562 INFO:tasks.workunit.client.0.smithi167.stdout:./145/.snap/snap-subdir-test 2023-11-28T20:42:17.575 INFO:tasks.workunit.client.0.smithi167.stdout:./279/.snap/snap-subdir-test 2023-11-28T20:42:17.908 INFO:tasks.workunit.client.0.smithi167.stdout:./263/.snap/snap-subdir-test 2023-11-28T20:42:17.920 INFO:tasks.workunit.client.0.smithi167.stdout:./130/.snap/snap-subdir-test 2023-11-28T20:42:20.386 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:42:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9f957640 1 Processor -- start 2023-11-28T20:42:20.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9f957640 1 -- start start 2023-11-28T20:42:20.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9f957640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf98150b40 0x7fcf98157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:20.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9f957640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcf980c6ff0 0x7fcf980c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:20.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9f957640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf980c6ac0 con 0x7fcf980c5be0 2023-11-28T20:42:20.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9f957640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf980c6500 con 0x7fcf980c6ff0 2023-11-28T20:42:20.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9f957640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf980c67e0 con 0x7fcf98150b40 2023-11-28T20:42:20.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9cef2640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fcf980c6ff0 msgr2=0x7fcf980c4510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:20.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9cef2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcf980c6ff0 0x7fcf980c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9d6f3640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf98150b40 0x7fcf98157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9d6f3640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf98150b40 0x7fcf98157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:57788/0 (socket says 172.21.15.167:57788) 2023-11-28T20:42:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9d6f3640 1 -- 172.21.15.167:0/738392081 learned_addr learned my addr 172.21.15.167:0/738392081 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9d6f3640 1 -- 172.21.15.167:0/738392081 >> v2:172.21.15.167:3300/0 conn(0x7fcf980c6ff0 msgr2=0x7fcf980c4510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:20.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9d6f3640 1 --2- 172.21.15.167:0/738392081 >> v2:172.21.15.167:3300/0 conn(0x7fcf980c6ff0 0x7fcf980c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9d6f3640 1 -- 172.21.15.167:0/738392081 >> v1:172.21.15.178:6789/0 conn(0x7fcf980c5be0 legacy=0x7fcf9806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:20.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.533+0000 7fcf9d6f3640 1 -- 172.21.15.167:0/738392081 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98156a80 con 0x7fcf98150b40 2023-11-28T20:42:20.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf9d6f3640 1 --2- 172.21.15.167:0/738392081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf98150b40 0x7fcf98157560 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcf980cc090 tx=0x7fcf9401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=864311dd21899625 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:20.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf8ffff640 1 -- 172.21.15.167:0/738392081 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940aa650 con 0x7fcf98150b40 2023-11-28T20:42:20.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf8ffff640 1 -- 172.21.15.167:0/738392081 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf940aa7b0 con 0x7fcf98150b40 2023-11-28T20:42:20.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf8ffff640 1 -- 172.21.15.167:0/738392081 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940aab40 con 0x7fcf98150b40 2023-11-28T20:42:20.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf9f957640 1 -- 172.21.15.167:0/738392081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf98150b40 msgr2=0x7fcf98157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:20.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf9f957640 1 --2- 172.21.15.167:0/738392081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf98150b40 0x7fcf98157560 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcf980cc090 tx=0x7fcf9401c4f0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf9f957640 1 -- 172.21.15.167:0/738392081 shutdown_connections 2023-11-28T20:42:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf9f957640 1 --2- 172.21.15.167:0/738392081 >> v2:172.21.15.167:3300/0 conn(0x7fcf980c6ff0 0x7fcf980c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf9f957640 1 --2- 172.21.15.167:0/738392081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf98150b40 0x7fcf98157560 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf9f957640 1 -- 172.21.15.167:0/738392081 >> 172.21.15.167:0/738392081 conn(0x7fcf980cb1e0 msgr2=0x7fcf980cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf9f957640 1 -- 172.21.15.167:0/738392081 shutdown_connections 2023-11-28T20:42:20.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.537+0000 7fcf9f957640 1 -- 172.21.15.167:0/738392081 wait complete. 2023-11-28T20:42:20.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9f957640 1 Processor -- start 2023-11-28T20:42:20.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9f957640 1 -- start start 2023-11-28T20:42:20.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9f957640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf980c5be0 0x7fcf98071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9f957640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf980c6ff0 0x7fcf98149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9f957640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf98150b40 0x7fcf981f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9f957640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9814ac10 con 0x7fcf98150b40 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9f957640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf981f6a60 con 0x7fcf980c6ff0 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9f957640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf980722a0 con 0x7fcf980c5be0 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9def4640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf98150b40 msgr2=0x7fcf981f25b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9def4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf98150b40 0x7fcf981f25b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9d6f3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf980c5be0 0x7fcf98071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9cef2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf980c6ff0 0x7fcf98149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9d6f3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf980c5be0 0x7fcf98071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:53640/0 (socket says 172.21.15.167:53640) 2023-11-28T20:42:20.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9d6f3640 1 -- 172.21.15.167:0/960777499 learned_addr learned my addr 172.21.15.167:0/960777499 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:20.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9d6f3640 1 -- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf980c6ff0 msgr2=0x7fcf98149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:20.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9d6f3640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf980c6ff0 0x7fcf98149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9d6f3640 1 -- 172.21.15.167:0/960777499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf98150b40 msgr2=0x7fcf981f25b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:42:20.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9d6f3640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf98150b40 0x7fcf981f25b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9d6f3640 1 -- 172.21.15.167:0/960777499 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940094d0 con 0x7fcf980c5be0 2023-11-28T20:42:20.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9d6f3640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf980c5be0 0x7fcf98071d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf94019100 tx=0x7fcf9401ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:20.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf8dffb640 1 -- 172.21.15.167:0/960777499 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940b38c0 con 0x7fcf980c5be0 2023-11-28T20:42:20.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf8dffb640 1 -- 172.21.15.167:0/960777499 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf940b3a40 con 0x7fcf980c5be0 2023-11-28T20:42:20.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf8dffb640 1 -- 172.21.15.167:0/960777499 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940b3df0 con 0x7fcf980c5be0 2023-11-28T20:42:20.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.541+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf980c94d0 con 0x7fcf980c5be0 2023-11-28T20:42:20.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.545+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf981f5f80 con 0x7fcf980c5be0 2023-11-28T20:42:20.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.545+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf980682c0 con 0x7fcf980c5be0 2023-11-28T20:42:20.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.545+0000 7fcf8dffb640 1 -- 172.21.15.167:0/960777499 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf940c73e0 con 0x7fcf980c5be0 2023-11-28T20:42:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.545+0000 7fcf8dffb640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf7c066450 0x7fcf7c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.549+0000 7fcf8dffb640 1 -- 172.21.15.167:0/960777499 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fcf9411eed0 con 0x7fcf980c5be0 2023-11-28T20:42:20.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.549+0000 7fcf9cef2640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf7c066450 0x7fcf7c068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.549+0000 7fcf9cef2640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf7c066450 0x7fcf7c068910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf880093d0 tx=0x7fcf88009360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:20.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.557+0000 7fcf8dffb640 1 -- 172.21.15.167:0/960777499 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf940ebff0 con 0x7fcf980c5be0 2023-11-28T20:42:20.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.765+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcf98075c90 con 0x7fcf980c5be0 2023-11-28T20:42:20.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.765+0000 7fcf8dffb640 1 -- 172.21.15.167:0/960777499 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fcf940c3620 con 0x7fcf980c5be0 2023-11-28T20:42:20.770 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":30,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:42:20.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf7c066450 msgr2=0x7fcf7c068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:20.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf7c066450 0x7fcf7c068910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcf880093d0 tx=0x7fcf88009360 comp rx=0 tx=0).stop 2023-11-28T20:42:20.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf980c5be0 msgr2=0x7fcf98071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:20.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf980c5be0 0x7fcf98071d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf94019100 tx=0x7fcf9401ad30 comp rx=0 tx=0).stop 2023-11-28T20:42:20.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 shutdown_connections 2023-11-28T20:42:20.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcf7c066450 0x7fcf7c068910 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf98150b40 0x7fcf981f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf980c6ff0 0x7fcf98149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 --2- 172.21.15.167:0/960777499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf980c5be0 0x7fcf98071d60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:20.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 >> 172.21.15.167:0/960777499 conn(0x7fcf980cb1e0 msgr2=0x7fcf980c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:20.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 shutdown_connections 2023-11-28T20:42:20.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:20.769+0000 7fcf9f957640 1 -- 172.21.15.167:0/960777499 wait complete. 2023-11-28T20:42:23.791 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:42:23.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f5b91d640 1 Processor -- start 2023-11-28T20:42:23.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f5b91d640 1 -- start start 2023-11-28T20:42:23.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f5b91d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:23.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f5b91d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5415b220 con 0x7f3f5406a580 2023-11-28T20:42:23.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f5b91d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540c7a20 con 0x7f3f54151f60 2023-11-28T20:42:23.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f5b91d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540c4da0 con 0x7f3f540c75c0 2023-11-28T20:42:23.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f59eba640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f3f5406a580 legacy=0x7f3f541625b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:42:23.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f596b9640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3f54151f60 0x7f3f540c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:38704/0 (socket says 172.21.15.167:38704) 2023-11-28T20:42:23.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f596b9640 1 -- 172.21.15.167:0/3251362668 learned_addr learned my addr 172.21.15.167:0/3251362668 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:42:23.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:23.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 msgr2=0x7f3f540c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:42:23.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 msgr2=0x7f3f540c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:23.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:23.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:23.937+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:24.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.141+0000 7f3f59eba640 1 -- 172.21.15.167:0/3251362668 >> v1:172.21.15.167:6789/0 conn(0x7f3f5406a580 legacy=0x7f3f541625b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:42:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.141+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.141+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 msgr2=0x7f3f540c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:42:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.141+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 msgr2=0x7f3f540c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.141+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:24.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.141+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:42:24.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.545+0000 7f3f59eba640 1 -- 172.21.15.167:0/3251362668 >> v1:172.21.15.167:6789/0 conn(0x7f3f5406a580 legacy=0x7f3f541625b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:42:24.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.545+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:24.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.545+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 msgr2=0x7f3f540c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:42:24.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.545+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 msgr2=0x7f3f540c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:24.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.545+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:24.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:24.545+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:42:25.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:25.349+0000 7f3f59eba640 1 -- 172.21.15.167:0/3251362668 >> v1:172.21.15.167:6789/0 conn(0x7f3f5406a580 legacy=0x7f3f541625b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:42:25.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:25.349+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:25.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:25.349+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 msgr2=0x7f3f540c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:42:25.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:25.349+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 msgr2=0x7f3f540c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:25.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:25.349+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:25.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:25.349+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:42:26.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f4affd640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 msgr2=0x7f3f540c5c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:26.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f4affd640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540c75c0 0x7f3f540c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:26.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f4affd640 1 -- 172.21.15.167:0/3251362668 >> v1:172.21.15.178:6789/0 conn(0x7f3f54151f60 legacy=0x7f3f540c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:26.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f4affd640 1 -- 172.21.15.167:0/3251362668 >> v1:172.21.15.167:6789/0 conn(0x7f3f5406a580 legacy=0x7f3f541625b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:26.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f4affd640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:26.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f4affd640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 0x7f3f38008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:26.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f4affd640 1 -- 172.21.15.167:0/3251362668 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f38008d00 con 0x7f3f380061b0 2023-11-28T20:42:26.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f4affd640 1 -- 172.21.15.167:0/3251362668 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f38008e70 con 0x7f3f380036e0 2023-11-28T20:42:26.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 msgr2=0x7f3f38008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:26.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 0x7f3f38008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:26.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:26.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f596b9640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 msgr2=0x7f3f38005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:42:26.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f596b9640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 msgr2=0x7f3f38005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:26.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:26.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:26.937+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:27.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.141+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 msgr2=0x7f3f38008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:27.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.141+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 0x7f3f38008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:42:27.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.141+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:27.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.141+0000 7f3f596b9640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 msgr2=0x7f3f38005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:42:27.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.141+0000 7f3f596b9640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 msgr2=0x7f3f38005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:27.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.141+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:27.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.141+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:42:27.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.545+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 msgr2=0x7f3f38008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:27.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.545+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 0x7f3f38008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:42:27.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.545+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:27.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.545+0000 7f3f596b9640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 msgr2=0x7f3f38005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:42:27.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.545+0000 7f3f596b9640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 msgr2=0x7f3f38005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:27.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.545+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:27.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:27.545+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:42:27.632 INFO:tasks.workunit.client.0.smithi167.stdout:./193/.snap/snap-subdir-test 2023-11-28T20:42:27.647 INFO:tasks.workunit.client.0.smithi167.stdout:./223/.snap/snap-subdir-test 2023-11-28T20:42:27.658 INFO:tasks.workunit.client.0.smithi167.stdout:./207/.snap/snap-subdir-test 2023-11-28T20:42:27.670 INFO:tasks.workunit.client.0.smithi167.stdout:./276/.snap/snap-subdir-test 2023-11-28T20:42:27.698 INFO:tasks.workunit.client.0.smithi167.stdout:./271/.snap/snap-subdir-test 2023-11-28T20:42:27.718 INFO:tasks.workunit.client.0.smithi167.stdout:./251/.snap/snap-subdir-test 2023-11-28T20:42:27.981 INFO:tasks.workunit.client.0.smithi167.stdout:./175/.snap/snap-subdir-test 2023-11-28T20:42:28.003 INFO:tasks.workunit.client.0.smithi167.stdout:./222/.snap/snap-subdir-test 2023-11-28T20:42:28.025 INFO:tasks.workunit.client.0.smithi167.stdout:./220/.snap/snap-subdir-test 2023-11-28T20:42:28.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.349+0000 7f3f58eb8640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 msgr2=0x7f3f38008670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:28.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.349+0000 7f3f58eb8640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 0x7f3f38008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:42:28.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.349+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.178:3300/0 conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.349+0000 7f3f596b9640 1 -- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 msgr2=0x7f3f38008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:28.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.349+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> v2:172.21.15.167:3300/0 conn(0x7f3f380061b0 0x7f3f38008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.349+0000 7f3f596b9640 1 -- 172.21.15.167:0/3251362668 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54152340 con 0x7f3f380036e0 2023-11-28T20:42:28.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f380036e0 0x7f3f38005b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f38003690 tx=0x7f3f5001ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2731e3ecdc0e935d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:28.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f4bfff640 1 -- 172.21.15.167:0/3251362668 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500a5750 con 0x7f3f380036e0 2023-11-28T20:42:28.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f4bfff640 1 -- 172.21.15.167:0/3251362668 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f500a9070 con 0x7f3f380036e0 2023-11-28T20:42:28.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f4bfff640 1 -- 172.21.15.167:0/3251362668 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f500a5af0 con 0x7f3f380036e0 2023-11-28T20:42:28.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f380036e0 msgr2=0x7f3f38005b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f5b91d640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f380036e0 0x7f3f38005b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f38003690 tx=0x7f3f5001ca90 comp rx=0 tx=0).stop 2023-11-28T20:42:28.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f59eba640 1 -- 172.21.15.167:0/3251362668 reap_dead start 2023-11-28T20:42:28.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3251362668 shutdown_connections 2023-11-28T20:42:28.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f5b91d640 1 --2- 172.21.15.167:0/3251362668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f380036e0 0x7f3f38005b60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3251362668 >> 172.21.15.167:0/3251362668 conn(0x7f3f540cb1e0 msgr2=0x7f3f540cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:28.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3251362668 shutdown_connections 2023-11-28T20:42:28.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.353+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3251362668 wait complete. 2023-11-28T20:42:28.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f5b91d640 1 Processor -- start 2023-11-28T20:42:28.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f5b91d640 1 -- start start 2023-11-28T20:42:28.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f5b91d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f380036e0 0x7f3f54070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f5b91d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f541591b0 0x7f3f54070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f5b91d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540714e0 0x7f3f54160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f5b91d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f541618b0 con 0x7f3f541591b0 2023-11-28T20:42:28.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f5b91d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54162720 con 0x7f3f380036e0 2023-11-28T20:42:28.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f5b91d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f541f2fe0 con 0x7f3f540714e0 2023-11-28T20:42:28.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f58eb8640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f541591b0 msgr2=0x7f3f54070fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:28.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f58eb8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f541591b0 0x7f3f54070fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:28.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f596b9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f380036e0 0x7f3f54070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f59eba640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540714e0 0x7f3f54160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f59eba640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540714e0 0x7f3f54160610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:40058/0 (socket says 172.21.15.167:40058) 2023-11-28T20:42:28.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f59eba640 1 -- 172.21.15.167:0/3803171273 learned_addr learned my addr 172.21.15.167:0/3803171273 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:28.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f59eba640 1 -- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f380036e0 msgr2=0x7f3f54070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f59eba640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f380036e0 0x7f3f54070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f59eba640 1 -- 172.21.15.167:0/3803171273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f541591b0 msgr2=0x7f3f54070fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:42:28.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f59eba640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f541591b0 0x7f3f54070fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f59eba640 1 -- 172.21.15.167:0/3803171273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5000f040 con 0x7f3f540714e0 2023-11-28T20:42:28.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f59eba640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540714e0 0x7f3f54160610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3f54155790 tx=0x7f3f4c00cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:28.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f49ffb640 1 -- 172.21.15.167:0/3803171273 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00a850 con 0x7f3f540714e0 2023-11-28T20:42:28.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f49ffb640 1 -- 172.21.15.167:0/3803171273 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c00a9b0 con 0x7f3f540714e0 2023-11-28T20:42:28.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f541f26d0 con 0x7f3f540714e0 2023-11-28T20:42:28.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.357+0000 7f3f49ffb640 1 -- 172.21.15.167:0/3803171273 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00ad60 con 0x7f3f540714e0 2023-11-28T20:42:28.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.361+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f540722d0 con 0x7f3f540714e0 2023-11-28T20:42:28.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.361+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f540682c0 con 0x7f3f540714e0 2023-11-28T20:42:28.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.361+0000 7f3f49ffb640 1 -- 172.21.15.167:0/3803171273 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f4c01c5c0 con 0x7f3f540714e0 2023-11-28T20:42:28.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.361+0000 7f3f49ffb640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f380673b0 0x7f3f38069870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.361+0000 7f3f49ffb640 1 -- 172.21.15.167:0/3803171273 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3f4c00e040 con 0x7f3f540714e0 2023-11-28T20:42:28.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.361+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f380673b0 0x7f3f38069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.365+0000 7f3f596b9640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f380673b0 0x7f3f38069870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3f500b0000 tx=0x7f3f500a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:28.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.373+0000 7f3f49ffb640 1 -- 172.21.15.167:0/3803171273 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f4c050b80 con 0x7f3f540714e0 2023-11-28T20:42:28.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.577+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3f54075c90 con 0x7f3f540714e0 2023-11-28T20:42:28.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.577+0000 7f3f49ffb640 1 -- 172.21.15.167:0/3803171273 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f3f4c018080 con 0x7f3f540714e0 2023-11-28T20:42:28.580 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":32,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:42:28.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f380673b0 msgr2=0x7f3f38069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f380673b0 0x7f3f38069870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3f500b0000 tx=0x7f3f500a7070 comp rx=0 tx=0).stop 2023-11-28T20:42:28.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540714e0 msgr2=0x7f3f54160610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540714e0 0x7f3f54160610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3f54155790 tx=0x7f3f4c00cbd0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 shutdown_connections 2023-11-28T20:42:28.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3f380673b0 0x7f3f38069870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f540714e0 0x7f3f54160610 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f541591b0 0x7f3f54070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 --2- 172.21.15.167:0/3803171273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f380036e0 0x7f3f54070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 >> 172.21.15.167:0/3803171273 conn(0x7f3f540cb1e0 msgr2=0x7f3f541503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:28.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 shutdown_connections 2023-11-28T20:42:28.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.581+0000 7f3f5b91d640 1 -- 172.21.15.167:0/3803171273 wait complete. 2023-11-28T20:42:28.602 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:42:28.602 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:42:28.602 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:42:28.715 INFO:tasks.workunit.client.0.smithi167.stdout:./203/.snap/snap-subdir-test 2023-11-28T20:42:28.724 INFO:tasks.workunit.client.0.smithi167.stdout:./181/.snap/snap-subdir-test 2023-11-28T20:42:28.735 INFO:tasks.workunit.client.0.smithi167.stdout:./286/.snap/snap-subdir-test 2023-11-28T20:42:28.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3471356640 1 Processor -- start 2023-11-28T20:42:28.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3471356640 1 -- start start 2023-11-28T20:42:28.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3471356640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f346c0c4d60 0x7f346c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3471356640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f346c0c7a50 0x7f346c151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3471356640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c5140 0x7f346c151d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3471356640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c06e460 con 0x7f346c0c7a50 2023-11-28T20:42:28.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3471356640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c06ed40 con 0x7f346c0c4d60 2023-11-28T20:42:28.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3471356640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0c5df0 con 0x7f346c0c5140 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f346b7fe640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f346c0c7a50 msgr2=0x7f346c151820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f346b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f346c0c7a50 0x7f346c151820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3470b55640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c5140 0x7f346c151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3470b55640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c5140 0x7f346c151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:40072/0 (socket says 172.21.15.167:40072) 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f346bfff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f346c0c4d60 0x7f346c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.741+0000 7f3470b55640 1 -- 172.21.15.167:0/1583825681 learned_addr learned my addr 172.21.15.167:0/1583825681 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f3470b55640 1 -- 172.21.15.167:0/1583825681 >> v2:172.21.15.178:3300/0 conn(0x7f346c0c4d60 msgr2=0x7f346c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f3470b55640 1 --2- 172.21.15.167:0/1583825681 >> v2:172.21.15.178:3300/0 conn(0x7f346c0c4d60 0x7f346c06e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f3470b55640 1 -- 172.21.15.167:0/1583825681 >> v2:172.21.15.167:3300/0 conn(0x7f346c0c7a50 msgr2=0x7f346c151820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:28.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f3470b55640 1 --2- 172.21.15.167:0/1583825681 >> v2:172.21.15.167:3300/0 conn(0x7f346c0c7a50 0x7f346c151820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f3470b55640 1 -- 172.21.15.167:0/1583825681 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c06d970 con 0x7f346c0c5140 2023-11-28T20:42:28.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f346bfff640 1 --2- 172.21.15.167:0/1583825681 >> v2:172.21.15.178:3300/0 conn(0x7f346c0c4d60 0x7f346c06e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:42:28.747 INFO:tasks.workunit.client.0.smithi167.stdout:./127/.snap/snap-subdir-test 2023-11-28T20:42:28.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f3470b55640 1 --2- 172.21.15.167:0/1583825681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c5140 0x7f346c151d60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f346c06b600 tx=0x7f346401c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9362f02c3baeb0a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:28.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f346affd640 1 -- 172.21.15.167:0/1583825681 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640a5670 con 0x7f346c0c5140 2023-11-28T20:42:28.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f346affd640 1 -- 172.21.15.167:0/1583825681 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34640a57d0 con 0x7f346c0c5140 2023-11-28T20:42:28.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.745+0000 7f346affd640 1 -- 172.21.15.167:0/1583825681 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640a5b60 con 0x7f346c0c5140 2023-11-28T20:42:28.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 -- 172.21.15.167:0/1583825681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c5140 msgr2=0x7f346c151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 --2- 172.21.15.167:0/1583825681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c5140 0x7f346c151d60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f346c06b600 tx=0x7f346401c9f0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 -- 172.21.15.167:0/1583825681 shutdown_connections 2023-11-28T20:42:28.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 --2- 172.21.15.167:0/1583825681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c5140 0x7f346c151d60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 --2- 172.21.15.167:0/1583825681 >> v2:172.21.15.167:3300/0 conn(0x7f346c0c7a50 0x7f346c151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 --2- 172.21.15.167:0/1583825681 >> v2:172.21.15.178:3300/0 conn(0x7f346c0c4d60 0x7f346c06e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 -- 172.21.15.167:0/1583825681 >> 172.21.15.167:0/1583825681 conn(0x7f346c0cb3f0 msgr2=0x7f346c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:28.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 -- 172.21.15.167:0/1583825681 shutdown_connections 2023-11-28T20:42:28.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 -- 172.21.15.167:0/1583825681 wait complete. 2023-11-28T20:42:28.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 Processor -- start 2023-11-28T20:42:28.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 -- start start 2023-11-28T20:42:28.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c0c4d60 0x7f346c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f346c0c5140 0x7f346c146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c7a50 0x7f346c150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c157ac0 con 0x7f346c0c5140 2023-11-28T20:42:28.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c1465a0 con 0x7f346c0c4d60 2023-11-28T20:42:28.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3471356640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c158140 con 0x7f346c0c7a50 2023-11-28T20:42:28.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346b7fe640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f346c0c5140 msgr2=0x7f346c146060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f346c0c5140 0x7f346c146060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c0c4d60 0x7f346c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c0c4d60 0x7f346c15a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55498/0 (socket says 172.21.15.167:55498) 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346bfff640 1 -- 172.21.15.167:0/3181630756 learned_addr learned my addr 172.21.15.167:0/3181630756 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f3470b55640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c7a50 0x7f346c150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346bfff640 1 -- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c7a50 msgr2=0x7f346c150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346bfff640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346c0c7a50 0x7f346c150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346bfff640 1 -- 172.21.15.167:0/3181630756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f346c0c5140 msgr2=0x7f346c146060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346bfff640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f346c0c5140 0x7f346c146060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.749+0000 7f346bfff640 1 -- 172.21.15.167:0/3181630756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c009420 con 0x7f346c0c4d60 2023-11-28T20:42:28.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f346bfff640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c0c4d60 0x7f346c15a610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f345c00ec10 tx=0x7f345c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:28.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c00cc30 con 0x7f346c0c4d60 2023-11-28T20:42:28.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c00cd90 con 0x7f346c0c4d60 2023-11-28T20:42:28.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c013670 con 0x7f346c0c4d60 2023-11-28T20:42:28.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3464009b30 con 0x7f346c0c4d60 2023-11-28T20:42:28.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c1f6b90 con 0x7f346c0c4d60 2023-11-28T20:42:28.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f3471356640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c15acb0 0x7f346c150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c074740 con 0x7f346c15acb0 2023-11-28T20:42:28.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f346b7fe640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c15acb0 0x7f346c150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f346b7fe640 1 -- 172.21.15.167:0/3181630756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f346c067c40 con 0x7f346c15acb0 2023-11-28T20:42:28.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f346b7fe640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c15acb0 0x7f346c150ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f346c06d450 tx=0x7f346000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:28.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f345c0137d0 con 0x7f346c0c4d60 2023-11-28T20:42:28.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.753+0000 7f3468ff9640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3458066420 0x7f34580688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.757+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f345c084890 con 0x7f346c0c4d60 2023-11-28T20:42:28.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.757+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460003dd0 con 0x7f346c15acb0 2023-11-28T20:42:28.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.757+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3460005070 con 0x7f346c15acb0 2023-11-28T20:42:28.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.757+0000 7f3470b55640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3458066420 0x7f34580688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.757+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c15acb0 msgr2=0x7f346c150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.757+0000 7f3468ff9640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c15acb0 0x7f346c150ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f346c06d450 tx=0x7f346000b8e0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.757+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c15acb0 msgr2=0x7f346c150ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:28.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.757+0000 7f3468ff9640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c15acb0 0x7f346c150ec0 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f346c06d450 tx=0x7f346000b8e0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.757+0000 7f3470b55640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3458066420 0x7f34580688e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f34640ae000 tx=0x7f34640a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:28.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.761+0000 7f3471356640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c14b590 0x7f346c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:28.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.761+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c04e850 con 0x7f346c14b590 2023-11-28T20:42:28.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.761+0000 7f346b7fe640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c14b590 0x7f346c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:28.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.761+0000 7f346b7fe640 1 -- 172.21.15.167:0/3181630756 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f346c06e5e0 con 0x7f346c14b590 2023-11-28T20:42:28.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f346b7fe640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c14b590 0x7f346c1582b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3460011000 tx=0x7f34600059e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:28.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346001e070 con 0x7f346c14b590 2023-11-28T20:42:28.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5113 (secure 0 0 0) 0x7f3460022400 con 0x7f346c14b590 2023-11-28T20:42:28.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c14b590 msgr2=0x7f346c1582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3468ff9640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c14b590 0x7f346c1582b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3460011000 tx=0x7f34600059e0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3468ff9640 1 -- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c14b590 msgr2=0x7f346c1582b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:28.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3468ff9640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c14b590 0x7f346c1582b0 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3460011000 tx=0x7f34600059e0 comp rx=0 tx=0).stop 2023-11-28T20:42:28.767 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:42:28.767 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:28.767 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:28.767 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:42:28.767 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 32, 2023-11-28T20:42:28.767 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:28.768 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:42:28.769 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:28.770 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:28.770 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:28.770 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:28.770 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:28.770 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:28.770 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:28.770 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:28.770 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:28.770 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:28.771 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:42:28.772 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:28.773 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:28.773 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:28.773 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:28.773 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:28.773 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:28.773 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:28.773 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:28.773 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:28.773 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:28.774 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:28.774 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:42:28.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.774 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:42:28.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.774 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:28.774 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:28.774 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:28.774 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:28.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:28.776 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:28.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.776 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:42:28.776 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:42:28.776 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:28.776 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:28.776 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:28.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.777 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.778 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:28.778 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:42:28.778 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:28.778 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:28.778 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:28.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.778 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:42:28.778 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:42:28.778 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:28.779 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:28.779 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:28.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.779 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.779 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:28.779 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:28.779 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:28.779 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:28.780 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.781 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.782 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:42:28.783 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:28.784 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:28.785 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:28.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:28.786 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:42:28.786 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:42:28.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3458066420 msgr2=0x7f34580688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3471356640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3458066420 0x7f34580688e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f34640ae000 tx=0x7f34640a7070 comp rx=0 tx=0).stop 2023-11-28T20:42:28.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c0c4d60 msgr2=0x7f346c15a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:28.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3471356640 1 --2- 172.21.15.167:0/3181630756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f346c0c4d60 0x7f346c15a610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f345c00ec10 tx=0x7f345c00c520 comp rx=0 tx=0).stop 2023-11-28T20:42:28.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3470b55640 1 -- 172.21.15.167:0/3181630756 reap_dead start 2023-11-28T20:42:28.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3470b55640 1 -- 172.21.15.167:0/3181630756 reap_dead start 2023-11-28T20:42:28.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 shutdown_connections 2023-11-28T20:42:28.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 >> 172.21.15.167:0/3181630756 conn(0x7f346c0cb3f0 msgr2=0x7f346c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:28.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 shutdown_connections 2023-11-28T20:42:28.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.765+0000 7f3471356640 1 -- 172.21.15.167:0/3181630756 wait complete. 2023-11-28T20:42:28.789 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:42:28.789 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:42:28.789 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:42:28.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.925+0000 7f4528bf8640 1 Processor -- start 2023-11-28T20:42:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.925+0000 7f4528bf8640 1 -- start start 2023-11-28T20:42:29.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4528bf8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4524150b40 0x7f4524157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:29.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4528bf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c4510 0x7f452406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:29.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4528bf8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45240c4920 con 0x7f45240c6ff0 2023-11-28T20:42:29.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4528bf8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240c62f0 con 0x7f4524150b40 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4528bf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240c6ac0 con 0x7f45240c4510 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4519d9b640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f45240c6ff0 legacy=0x7f45240c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4522d9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c4510 0x7f452406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f452259c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4524150b40 0x7f4524157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4522d9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c4510 0x7f452406a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:40092/0 (socket says 172.21.15.167:40092) 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4522d9d640 1 -- 172.21.15.167:0/1221736467 learned_addr learned my addr 172.21.15.167:0/1221736467 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f452259c640 1 -- 172.21.15.167:0/1221736467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c4510 msgr2=0x7f452406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f452259c640 1 --2- 172.21.15.167:0/1221736467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c4510 0x7f452406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f452259c640 1 -- 172.21.15.167:0/1221736467 >> v1:172.21.15.167:6789/0 conn(0x7f45240c6ff0 legacy=0x7f45240c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f452259c640 1 -- 172.21.15.167:0/1221736467 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45240c6500 con 0x7f4524150b40 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.929+0000 7f4522d9d640 1 --2- 172.21.15.167:0/1221736467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c4510 0x7f452406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:42:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f452259c640 1 --2- 172.21.15.167:0/1221736467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4524150b40 0x7f4524157560 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f45240cc090 tx=0x7f450c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37a82ae8a4925ebe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4521d9b640 1 -- 172.21.15.167:0/1221736467 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c0ab600 con 0x7f4524150b40 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4521d9b640 1 -- 172.21.15.167:0/1221736467 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c0a7050 con 0x7f4524150b40 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4521d9b640 1 -- 172.21.15.167:0/1221736467 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c0ab980 con 0x7f4524150b40 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 -- 172.21.15.167:0/1221736467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4524150b40 msgr2=0x7f4524157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 --2- 172.21.15.167:0/1221736467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4524150b40 0x7f4524157560 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f45240cc090 tx=0x7f450c01c410 comp rx=0 tx=0).stop 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 -- 172.21.15.167:0/1221736467 shutdown_connections 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 --2- 172.21.15.167:0/1221736467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c4510 0x7f452406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 --2- 172.21.15.167:0/1221736467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4524150b40 0x7f4524157560 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 -- 172.21.15.167:0/1221736467 >> 172.21.15.167:0/1221736467 conn(0x7f45240cb1e0 msgr2=0x7f45240cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 -- 172.21.15.167:0/1221736467 shutdown_connections 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 -- 172.21.15.167:0/1221736467 wait complete. 2023-11-28T20:42:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 Processor -- start 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.933+0000 7f4528bf8640 1 -- start start 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45240c4510 0x7f45240ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c6ff0 0x7f4524145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4524150b40 0x7f452413ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240cac60 con 0x7f4524150b40 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452413eb70 con 0x7f45240c4510 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240c9740 con 0x7f45240c6ff0 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4522d9d640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4524150b40 msgr2=0x7f452413ef90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4522d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4524150b40 0x7f452413ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4519d9b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c6ff0 0x7f4524145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f452259c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45240c4510 0x7f45240ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4519d9b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c6ff0 0x7f4524145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:40096/0 (socket says 172.21.15.167:40096) 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4519d9b640 1 -- 172.21.15.167:0/14882008 learned_addr learned my addr 172.21.15.167:0/14882008 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4519d9b640 1 -- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45240c4510 msgr2=0x7f45240ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4519d9b640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45240c4510 0x7f45240ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4519d9b640 1 -- 172.21.15.167:0/14882008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4524150b40 msgr2=0x7f452413ef90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4519d9b640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4524150b40 0x7f452413ef90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4519d9b640 1 -- 172.21.15.167:0/14882008 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c00bd40 con 0x7f45240c6ff0 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f452259c640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45240c4510 0x7f45240ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4519d9b640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c6ff0 0x7f4524145750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f451400b560 tx=0x7f451400ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514003dd0 con 0x7f45240c6ff0 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4514005070 con 0x7f45240c6ff0 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c009420 con 0x7f45240c6ff0 2023-11-28T20:42:29.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514005420 con 0x7f45240c6ff0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4524145210 con 0x7f45240c6ff0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452413e5f0 0x7f452413f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.937+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4524074770 con 0x7f452413e5f0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f452259c640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452413e5f0 0x7f452413f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f452259c640 1 -- 172.21.15.167:0/14882008 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4524157040 con 0x7f452413e5f0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f452259c640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452413e5f0 0x7f452413f4d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f452406bba0 tx=0x7f450c01ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4514005580 con 0x7f45240c6ff0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f451b7fe640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4504066450 0x7f4504068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4514083f60 con 0x7f45240c6ff0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c0b6890 con 0x7f452413e5f0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f450c006de0 con 0x7f452413e5f0 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452413e5f0 msgr2=0x7f452413f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f451b7fe640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452413e5f0 0x7f452413f4d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f452406bba0 tx=0x7f450c01ac50 comp rx=0 tx=0).stop 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f4522d9d640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4504066450 0x7f4504068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452413e5f0 msgr2=0x7f452413f4d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f451b7fe640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452413e5f0 0x7f452413f4d0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f452406bba0 tx=0x7f450c01ac50 comp rx=0 tx=0).stop 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.941+0000 7f4522d9d640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4504066450 0x7f4504068910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f452413dba0 tx=0x7f451c00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f4528bf8640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4524155e90 0x7f452413ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240682c0 con 0x7f4524155e90 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f452259c640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4524155e90 0x7f452413ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f452259c640 1 -- 172.21.15.167:0/14882008 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f452413ecb0 con 0x7f4524155e90 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f452259c640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4524155e90 0x7f452413ca10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f450c01c450 tx=0x7f450c0191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c0b58b0 con 0x7f4524155e90 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4968 (secure 0 0 0) 0x7f450c0b5a10 con 0x7f4524155e90 2023-11-28T20:42:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4524155e90 msgr2=0x7f452413ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:29.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f451b7fe640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4524155e90 0x7f452413ca10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f450c01c450 tx=0x7f450c0191b0 comp rx=0 tx=0).stop 2023-11-28T20:42:29.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f451b7fe640 1 -- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4524155e90 msgr2=0x7f452413ca10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:42:29.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.949+0000 7f451b7fe640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4524155e90 0x7f452413ca10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:29.214 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:42:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:42:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 32, 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:42:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:42:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:42:29.224 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:29.225 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:29.226 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:42:29.227 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:42:29.228 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:42:29.229 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:42:29.229 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:42:29.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4504066450 msgr2=0x7f4504068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:29.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4528bf8640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4504066450 0x7f4504068910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f452413dba0 tx=0x7f451c00d040 comp rx=0 tx=0).stop 2023-11-28T20:42:29.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c6ff0 msgr2=0x7f4524145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:29.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4528bf8640 1 --2- 172.21.15.167:0/14882008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45240c6ff0 0x7f4524145750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f451400b560 tx=0x7f451400ba20 comp rx=0 tx=0).stop 2023-11-28T20:42:29.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4522d9d640 1 -- 172.21.15.167:0/14882008 reap_dead start 2023-11-28T20:42:29.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4522d9d640 1 -- 172.21.15.167:0/14882008 reap_dead start 2023-11-28T20:42:29.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 shutdown_connections 2023-11-28T20:42:29.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 >> 172.21.15.167:0/14882008 conn(0x7f45240cb1e0 msgr2=0x7f45240cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:29.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 shutdown_connections 2023-11-28T20:42:29.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:28.953+0000 7f4528bf8640 1 -- 172.21.15.167:0/14882008 wait complete. 2023-11-28T20:42:29.231 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:42:29.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:42:29.232 INFO:tasks.workunit.client.0.smithi167.stdout:./108/.snap/snap-subdir-test 2023-11-28T20:42:29.232 INFO:tasks.workunit.client.0.smithi167.stdout:./183/.snap/snap-subdir-test 2023-11-28T20:42:29.232 INFO:tasks.workunit.client.0.smithi167.stdout:./294/.snap/snap-subdir-test 2023-11-28T20:42:29.232 INFO:tasks.workunit.client.0.smithi167.stdout:./235/.snap/snap-subdir-test 2023-11-28T20:42:29.232 INFO:tasks.workunit.client.0.smithi167.stdout:./177/.snap/snap-subdir-test 2023-11-28T20:42:29.232 INFO:tasks.workunit.client.0.smithi167.stdout:./169/.snap/snap-subdir-test 2023-11-28T20:42:29.233 INFO:tasks.workunit.client.0.smithi167.stdout:./212/.snap/snap-subdir-test 2023-11-28T20:42:29.233 INFO:tasks.workunit.client.0.smithi167.stdout:./154/.snap/snap-subdir-test 2023-11-28T20:42:29.247 INFO:tasks.workunit.client.0.smithi167.stdout:./171/.snap/snap-subdir-test 2023-11-28T20:42:29.259 INFO:tasks.workunit.client.0.smithi167.stdout:./139/.snap/snap-subdir-test 2023-11-28T20:42:29.274 INFO:tasks.workunit.client.0.smithi167.stdout:./102/.snap/snap-subdir-test 2023-11-28T20:42:29.285 INFO:tasks.workunit.client.0.smithi167.stdout:./129/.snap/snap-subdir-test 2023-11-28T20:42:43.471 INFO:tasks.workunit.client.0.smithi167.stdout:Delete all the files and directories ... 2023-11-28T20:42:44.130 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/19' 2023-11-28T20:42:44.130 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/15' 2023-11-28T20:42:44.130 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/31' 2023-11-28T20:42:44.130 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/36' 2023-11-28T20:42:44.131 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/20' 2023-11-28T20:42:44.131 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/12' 2023-11-28T20:42:44.131 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/39' 2023-11-28T20:42:44.131 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/10' 2023-11-28T20:42:44.131 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/34' 2023-11-28T20:42:44.131 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/38' 2023-11-28T20:42:44.131 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/11' 2023-11-28T20:42:44.131 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/16' 2023-11-28T20:42:44.131 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/32' 2023-11-28T20:42:44.132 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/30' 2023-11-28T20:42:44.132 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/14' 2023-11-28T20:42:44.132 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/18' 2023-11-28T20:42:44.132 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/13' 2023-11-28T20:42:44.132 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/33' 2023-11-28T20:42:44.132 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/17' 2023-11-28T20:42:44.132 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/35' 2023-11-28T20:42:44.132 INFO:tasks.workunit.client.0.smithi167.stdout:removed './100/37' 2023-11-28T20:42:44.132 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './100' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/19' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/15' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/31' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/36' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/20' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/12' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/39' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/10' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/34' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/38' 2023-11-28T20:42:44.133 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/11' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/16' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/32' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/30' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/14' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/18' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/13' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/33' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/17' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/35' 2023-11-28T20:42:44.134 INFO:tasks.workunit.client.0.smithi167.stdout:removed './101/37' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './101' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/19' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/15' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/31' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/36' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/20' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/12' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/39' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/10' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/34' 2023-11-28T20:42:44.135 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/38' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/11' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/16' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/32' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/30' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/14' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/18' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/13' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/33' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/17' 2023-11-28T20:42:44.136 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/35' 2023-11-28T20:42:44.137 INFO:tasks.workunit.client.0.smithi167.stdout:removed './102/37' 2023-11-28T20:42:44.137 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './102' 2023-11-28T20:42:44.137 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/19' 2023-11-28T20:42:44.137 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/15' 2023-11-28T20:42:44.137 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/31' 2023-11-28T20:42:44.137 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/36' 2023-11-28T20:42:44.137 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/20' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/12' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/39' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/10' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/34' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/38' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/11' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/16' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/32' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/30' 2023-11-28T20:42:44.138 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/14' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/18' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/13' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/33' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/17' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/35' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed './103/37' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './103' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/19' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/15' 2023-11-28T20:42:44.139 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/31' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/36' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/20' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/12' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/39' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/10' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/34' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/38' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/11' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/16' 2023-11-28T20:42:44.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/32' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/30' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/14' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/18' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/13' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/33' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/17' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/35' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './104/37' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './104' 2023-11-28T20:42:44.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/19' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/15' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/31' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/36' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/20' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/12' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/39' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/10' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/34' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/38' 2023-11-28T20:42:44.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/11' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/16' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/32' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/30' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/14' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/18' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/13' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/33' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/17' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/35' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './105/37' 2023-11-28T20:42:44.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './105' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/19' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/15' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/31' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/36' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/20' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/12' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/39' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/10' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/34' 2023-11-28T20:42:44.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/38' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/11' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/16' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/32' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/30' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/14' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/18' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/13' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/33' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/17' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/35' 2023-11-28T20:42:44.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './106/37' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './106' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/19' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/15' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/31' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/36' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/20' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/12' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/39' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/10' 2023-11-28T20:42:44.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/34' 2023-11-28T20:42:44.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/38' 2023-11-28T20:42:44.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/11' 2023-11-28T20:42:44.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/16' 2023-11-28T20:42:44.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/32' 2023-11-28T20:42:44.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/30' 2023-11-28T20:42:44.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/14' 2023-11-28T20:42:44.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/18' 2023-11-28T20:42:44.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/13' 2023-11-28T20:42:44.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/33' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/17' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/35' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './107/37' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './107' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/19' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/15' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/31' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/36' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/20' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/12' 2023-11-28T20:42:44.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/39' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/10' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/34' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/38' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/11' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/16' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/32' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/30' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/14' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/18' 2023-11-28T20:42:44.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/13' 2023-11-28T20:42:44.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/33' 2023-11-28T20:42:44.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/17' 2023-11-28T20:42:44.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/35' 2023-11-28T20:42:44.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './108/37' 2023-11-28T20:42:44.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './108' 2023-11-28T20:42:44.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/19' 2023-11-28T20:42:44.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/15' 2023-11-28T20:42:44.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/31' 2023-11-28T20:42:44.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/36' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/20' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/12' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/39' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/10' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/34' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/38' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/11' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/16' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/32' 2023-11-28T20:42:44.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/30' 2023-11-28T20:42:45.367 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:45.374 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:49.232 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:42:49.233 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2023-11-28T20:42:49.233 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T20:42:49.233 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T20:42:49.237 INFO:tasks.ceph.mon.a:Started 2023-11-28T20:42:49.237 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:42:49.237 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:42:49.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b3479640 1 Processor -- start 2023-11-28T20:42:49.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b3479640 1 -- start start 2023-11-28T20:42:49.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b3479640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66ac15d3b0 0x7f66ac066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:49.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b3479640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ac0c8280 con 0x7f66ac0aff70 2023-11-28T20:42:49.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b3479640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ac0c8910 con 0x7f66ac06d530 2023-11-28T20:42:49.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b3479640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ac066bc0 con 0x7f66ac15d3b0 2023-11-28T20:42:49.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b1215640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f66ac0aff70 legacy=0x7f66ac06b690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:42:49.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b1a16640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66ac15d3b0 0x7f66ac066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:49.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b1a16640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66ac15d3b0 0x7f66ac066680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:46788/0 (socket says 172.21.15.167:46788) 2023-11-28T20:42:49.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b1a16640 1 -- 172.21.15.167:0/2815633115 learned_addr learned my addr 172.21.15.167:0/2815633115 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:49.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b0a14640 1 --1- 172.21.15.167:0/2815633115 >> v1:172.21.15.178:6789/0 conn(0x7f66ac06d530 0x7f66ac1626d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:52984/0 (socket says 172.21.15.167:52984) 2023-11-28T20:42:49.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b1a16640 1 -- 172.21.15.167:0/2815633115 >> v1:172.21.15.178:6789/0 conn(0x7f66ac06d530 legacy=0x7f66ac1626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:49.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b1a16640 1 -- 172.21.15.167:0/2815633115 >> v1:172.21.15.167:6789/0 conn(0x7f66ac0aff70 legacy=0x7f66ac06b690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:49.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.385+0000 7f66b1a16640 1 -- 172.21.15.167:0/2815633115 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac0ca3b0 con 0x7f66ac15d3b0 2023-11-28T20:42:49.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b1a16640 1 --2- 172.21.15.167:0/2815633115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac15d3b0 0x7f66ac066680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009e50 tx=0x7f66a401c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741868cd8cb1333b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:49.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66a3fff640 1 -- 172.21.15.167:0/2815633115 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40a5860 con 0x7f66ac15d3b0 2023-11-28T20:42:49.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66a3fff640 1 -- 172.21.15.167:0/2815633115 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a40a59c0 con 0x7f66ac15d3b0 2023-11-28T20:42:49.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66a3fff640 1 -- 172.21.15.167:0/2815633115 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40a5d50 con 0x7f66ac15d3b0 2023-11-28T20:42:49.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b3479640 1 -- 172.21.15.167:0/2815633115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac15d3b0 msgr2=0x7f66ac066680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:49.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b3479640 1 --2- 172.21.15.167:0/2815633115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac15d3b0 0x7f66ac066680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009e50 tx=0x7f66a401c9a0 comp rx=0 tx=0).stop 2023-11-28T20:42:49.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b3479640 1 -- 172.21.15.167:0/2815633115 shutdown_connections 2023-11-28T20:42:49.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b3479640 1 --2- 172.21.15.167:0/2815633115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac15d3b0 0x7f66ac066680 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:49.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b3479640 1 -- 172.21.15.167:0/2815633115 >> 172.21.15.167:0/2815633115 conn(0x7f66ac06ee00 msgr2=0x7f66ac06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:49.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b3479640 1 -- 172.21.15.167:0/2815633115 shutdown_connections 2023-11-28T20:42:49.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b3479640 1 -- 172.21.15.167:0/2815633115 wait complete. 2023-11-28T20:42:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b3479640 1 Processor -- start 2023-11-28T20:42:49.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.393+0000 7f66b3479640 1 -- start start 2023-11-28T20:42:49.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b3479640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac06d530 0x7f66ac156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b3479640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ac0aff70 0x7f66ac14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b3479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66ac15d3b0 0x7f66ac0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b3479640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac0b1370 con 0x7f66ac0aff70 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b3479640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac156890 con 0x7f66ac06d530 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b3479640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac0b0a60 con 0x7f66ac15d3b0 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b0a14640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ac0aff70 msgr2=0x7f66ac14f580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b0a14640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ac0aff70 0x7f66ac14f580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1215640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac06d530 0x7f66ac156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1215640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac06d530 0x7f66ac156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:46798/0 (socket says 172.21.15.167:46798) 2023-11-28T20:42:49.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1215640 1 -- 172.21.15.167:0/3813424327 learned_addr learned my addr 172.21.15.167:0/3813424327 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:49.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1a16640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66ac15d3b0 0x7f66ac0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1215640 1 -- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66ac15d3b0 msgr2=0x7f66ac0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1215640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66ac15d3b0 0x7f66ac0b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1215640 1 -- 172.21.15.167:0/3813424327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ac0aff70 msgr2=0x7f66ac14f580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1215640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ac0aff70 0x7f66ac14f580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1215640 1 -- 172.21.15.167:0/3813424327 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4009b30 con 0x7f66ac06d530 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b1215640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac06d530 0x7f66ac156350 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f66a800b590 tx=0x7f66a800ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66a1ffb640 1 -- 172.21.15.167:0/3813424327 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8003dd0 con 0x7f66ac06d530 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66a1ffb640 1 -- 172.21.15.167:0/3813424327 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a8005070 con 0x7f66ac06d530 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac14fac0 con 0x7f66ac06d530 2023-11-28T20:42:49.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66a1ffb640 1 -- 172.21.15.167:0/3813424327 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8005420 con 0x7f66ac06d530 2023-11-28T20:42:49.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac0b2420 con 0x7f66ac06d530 2023-11-28T20:42:49.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.397+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac067c40 con 0x7f66ac06d530 2023-11-28T20:42:49.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.401+0000 7f66a1ffb640 1 -- 172.21.15.167:0/3813424327 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66a8005580 con 0x7f66ac06d530 2023-11-28T20:42:49.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.401+0000 7f66a1ffb640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6690066420 0x7f66900688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:49.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.401+0000 7f66a1ffb640 1 -- 172.21.15.167:0/3813424327 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7707+0+0 (secure 0 0 0) 0x7f66a8084620 con 0x7f66ac06d530 2023-11-28T20:42:49.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.401+0000 7f66b0a14640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6690066420 0x7f66900688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:49.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.401+0000 7f66b0a14640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6690066420 0x7f66900688e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0cacd0 tx=0x7f669c007a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:49.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.413+0000 7f66a1ffb640 1 -- 172.21.15.167:0/3813424327 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f66a80512c0 con 0x7f66ac06d530 2023-11-28T20:42:49.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.617+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f66ac154930 con 0x7f66ac06d530 2023-11-28T20:42:49.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66a1ffb640 1 -- 172.21.15.167:0/3813424327 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f66ac154930 con 0x7f66ac06d530 2023-11-28T20:42:49.622 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":32,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:42:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6690066420 msgr2=0x7f66900688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6690066420 0x7f66900688e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0cacd0 tx=0x7f669c007a30 comp rx=0 tx=0).stop 2023-11-28T20:42:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac06d530 msgr2=0x7f66ac156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac06d530 0x7f66ac156350 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f66a800b590 tx=0x7f66a800ba50 comp rx=0 tx=0).stop 2023-11-28T20:42:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 shutdown_connections 2023-11-28T20:42:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6690066420 0x7f66900688e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66ac15d3b0 0x7f66ac0b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ac0aff70 0x7f66ac14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 --2- 172.21.15.167:0/3813424327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66ac06d530 0x7f66ac156350 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:49.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 >> 172.21.15.167:0/3813424327 conn(0x7f66ac06ee00 msgr2=0x7f66ac06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:49.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 shutdown_connections 2023-11-28T20:42:49.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:49.621+0000 7f66b3479640 1 -- 172.21.15.167:0/3813424327 wait complete. 2023-11-28T20:42:52.644 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:42:52.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf5817640 1 Processor -- start 2023-11-28T20:42:52.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf5817640 1 -- start start 2023-11-28T20:42:52.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf5817640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:52.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf5817640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:52.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf5817640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf00cfef0 con 0x7fdcf00cf440 2023-11-28T20:42:52.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf5817640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf00cc6e0 con 0x7fdcf0153db0 2023-11-28T20:42:52.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf5817640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0154190 con 0x7fdcf00ccb70 2023-11-28T20:42:52.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf4815640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:52.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf4815640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60416/0 (socket says 172.21.15.167:60416) 2023-11-28T20:42:52.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf4815640 1 -- 172.21.15.167:0/3247644578 learned_addr learned my addr 172.21.15.167:0/3247644578 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:52.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:52.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf4815640 1 -- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 msgr2=0x7fdcf015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:42:52.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf4815640 1 -- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 msgr2=0x7fdcf015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:52.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:52.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:52.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdcf00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:42:52.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdcf00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:52.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:52.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.793+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:52.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:52.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdcf4815640 1 -- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 msgr2=0x7fdcf015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:42:52.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdcf4815640 1 -- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 msgr2=0x7fdcf015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:52.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:52.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:52.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:42:52.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdcf00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:42:52.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdcf00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:53.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:53.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:52.997+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:42:53.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:53.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdcf4815640 1 -- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 msgr2=0x7fdcf015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:42:53.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:53.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdcf4815640 1 -- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 msgr2=0x7fdcf015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:53.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:53.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:42:53.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdcf00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:42:53.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdcf00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:53.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:53.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:53.401+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:42:54.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:54.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdcf4815640 1 -- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 msgr2=0x7fdcf015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:42:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdcf4815640 1 -- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 msgr2=0x7fdcf015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:42:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdcf00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:42:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdcf00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:42:54.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:54.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.205+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:42:54.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.665+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587465031 0 0) 0x7fdcf00cfef0 con 0x7fdcf00cf440 2023-11-28T20:42:54.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.665+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce0003530 con 0x7fdcf00cf440 2023-11-28T20:42:54.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477539644 0 0) 0x7fdce0003530 con 0x7fdcf00cf440 2023-11-28T20:42:54.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdcf00c43d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:54.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdcf00c43d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 msgr2=0x7fdcf015a540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:42:54.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 --2- 172.21.15.167:0/3247644578 >> v2:172.21.15.167:3300/0 conn(0x7fdcf0153db0 0x7fdcf015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf00c4910 con 0x7fdcf00cf440 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fdce8001a00 con 0x7fdcf00cf440 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 >> v1:172.21.15.178:6789/0 conn(0x7fdcf00cf440 legacy=0x7fdcf00ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce0003980 0x7fdce0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce00047d0 0x7fdce0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdce0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00cc6e0 con 0x7fdce00047d0 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0154190 con 0x7fdce0003980 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce000ba90 con 0x7fdcf00ccb70 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce00047d0 0x7fdce0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:54.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcf4815640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce0003980 0x7fdce0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:54.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdcf5016640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdce0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:54.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 msgr2=0x7fdce0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:54.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf00ccb70 0x7fdce0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce0003980 msgr2=0x7fdce0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:42:54.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce0003980 0x7fdce0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.673+0000 7fdceffff640 1 -- 172.21.15.167:0/3247644578 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce0003530 con 0x7fdce00047d0 2023-11-28T20:42:54.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdceffff640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce00047d0 0x7fdce0004c50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc000ee0 tx=0x7fdcdc01d0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e135adf993538f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:54.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0af400 con 0x7fdce00047d0 2023-11-28T20:42:54.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc0a9070 con 0x7fdce00047d0 2023-11-28T20:42:54.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcef7fe640 1 -- 172.21.15.167:0/3247644578 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0af7c0 con 0x7fdce00047d0 2023-11-28T20:42:54.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcf5817640 1 -- 172.21.15.167:0/3247644578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce00047d0 msgr2=0x7fdce0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:54.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcf5817640 1 --2- 172.21.15.167:0/3247644578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce00047d0 0x7fdce0004c50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc000ee0 tx=0x7fdcdc01d0d0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcf5016640 1 -- 172.21.15.167:0/3247644578 reap_dead start 2023-11-28T20:42:54.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcf5817640 1 -- 172.21.15.167:0/3247644578 shutdown_connections 2023-11-28T20:42:54.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcf5817640 1 -- 172.21.15.167:0/3247644578 >> 172.21.15.167:0/3247644578 conn(0x7fdcf006b800 msgr2=0x7fdcf006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:54.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcf5817640 1 -- 172.21.15.167:0/3247644578 shutdown_connections 2023-11-28T20:42:54.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.677+0000 7fdcf5817640 1 -- 172.21.15.167:0/3247644578 wait complete. 2023-11-28T20:42:54.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5817640 1 Processor -- start 2023-11-28T20:42:54.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5817640 1 -- start start 2023-11-28T20:42:54.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5817640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce00047d0 0x7fdcf01588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:54.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5817640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf0154380 0x7fdcf015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5817640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcf00b4be0 0x7fdcf0149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5817640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0155490 con 0x7fdcf00b4be0 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5817640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0159f70 con 0x7fdce00047d0 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5817640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf015c6a0 con 0x7fdcf0154380 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5016640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcf00b4be0 0x7fdcf0149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5016640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcf00b4be0 0x7fdcf0149c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53392/0 (socket says 172.21.15.167:53392) 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf5016640 1 -- 172.21.15.167:0/479816735 learned_addr learned my addr 172.21.15.167:0/479816735 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdcf4815640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce00047d0 0x7fdcf01588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdceffff640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf0154380 0x7fdcf015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdceffff640 1 -- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf0154380 msgr2=0x7fdcf015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:42:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdceffff640 1 -- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf0154380 msgr2=0x7fdcf015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:42:54.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdceffff640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf0154380 0x7fdcf015da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:42:54.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.681+0000 7fdceffff640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf0154380 0x7fdcf015da20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:42:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdcf5016640 1 -- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf0154380 msgr2=0x7fdcf015da20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:42:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdcf5016640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf0154380 0x7fdcf015da20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdcf5016640 1 -- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce00047d0 msgr2=0x7fdcf01588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdcf5016640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce00047d0 0x7fdcf01588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdcf5016640 1 -- 172.21.15.167:0/479816735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf0155a70 con 0x7fdcf00b4be0 2023-11-28T20:42:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdcf5016640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcf00b4be0 0x7fdcf0149c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0157640 tx=0x7fdce8011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdced7fa640 1 -- 172.21.15.167:0/479816735 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8006d70 con 0x7fdcf00b4be0 2023-11-28T20:42:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdced7fa640 1 -- 172.21.15.167:0/479816735 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce8003980 con 0x7fdcf00b4be0 2023-11-28T20:42:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdced7fa640 1 -- 172.21.15.167:0/479816735 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8003d30 con 0x7fdcf00b4be0 2023-11-28T20:42:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf015d260 con 0x7fdcf00b4be0 2023-11-28T20:42:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf015c0e0 con 0x7fdcf00b4be0 2023-11-28T20:42:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf015d0c0 con 0x7fdcf00b4be0 2023-11-28T20:42:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.685+0000 7fdced7fa640 1 -- 172.21.15.167:0/479816735 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdce8005070 con 0x7fdcf00b4be0 2023-11-28T20:42:54.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.689+0000 7fdced7fa640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdcd40664a0 0x7fdcd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:54.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.689+0000 7fdced7fa640 1 -- 172.21.15.167:0/479816735 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7707+0+0 (secure 0 0 0) 0x7fdce8086d20 con 0x7fdcf00b4be0 2023-11-28T20:42:54.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.689+0000 7fdcf4815640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdcd40664a0 0x7fdcd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.689+0000 7fdcf4815640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdcd40664a0 0x7fdcd4068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009100 tx=0x7fdce4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:54.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.693+0000 7fdced7fa640 1 -- 172.21.15.167:0/479816735 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdcf015d0c0 con 0x7fdcf00b4be0 2023-11-28T20:42:54.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.929+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdcf015d0c0 con 0x7fdcf00b4be0 2023-11-28T20:42:54.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.929+0000 7fdced7fa640 1 -- 172.21.15.167:0/479816735 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7fdcf015d0c0 con 0x7fdcf00b4be0 2023-11-28T20:42:54.932 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":36,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:42:54.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdcd40664a0 msgr2=0x7fdcd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:54.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdcd40664a0 0x7fdcd4068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009100 tx=0x7fdce4008040 comp rx=0 tx=0).stop 2023-11-28T20:42:54.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcf00b4be0 msgr2=0x7fdcf0149c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:54.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcf00b4be0 0x7fdcf0149c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0157640 tx=0x7fdce8011c80 comp rx=0 tx=0).stop 2023-11-28T20:42:54.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 shutdown_connections 2023-11-28T20:42:54.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdcd40664a0 0x7fdcd4068960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdcf00b4be0 0x7fdcf0149c80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcf0154380 0x7fdcf015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 --2- 172.21.15.167:0/479816735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce00047d0 0x7fdcf01588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:54.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 >> 172.21.15.167:0/479816735 conn(0x7fdcf006b800 msgr2=0x7fdcf014ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:54.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 shutdown_connections 2023-11-28T20:42:54.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:54.933+0000 7fdcf5817640 1 -- 172.21.15.167:0/479816735 wait complete. 2023-11-28T20:42:56.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/14' 2023-11-28T20:42:56.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/18' 2023-11-28T20:42:56.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/13' 2023-11-28T20:42:56.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/33' 2023-11-28T20:42:56.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/17' 2023-11-28T20:42:56.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/35' 2023-11-28T20:42:56.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './109/37' 2023-11-28T20:42:56.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './109' 2023-11-28T20:42:56.140 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/19' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/15' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/31' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/36' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/20' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/12' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/39' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/10' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/34' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/38' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/11' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/16' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/32' 2023-11-28T20:42:56.141 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/30' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/14' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/18' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/13' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/33' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/17' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/35' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './110/37' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './110' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/19' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/15' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/31' 2023-11-28T20:42:56.142 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/36' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/20' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/12' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/39' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/10' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/34' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/38' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/11' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/16' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/32' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/30' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/14' 2023-11-28T20:42:56.143 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/18' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/13' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/33' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/17' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/35' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './111/37' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './111' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/19' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/15' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/31' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/36' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/20' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/12' 2023-11-28T20:42:56.144 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/39' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/10' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/34' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/38' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/11' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/16' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/32' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/30' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/14' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/18' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/13' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/33' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/17' 2023-11-28T20:42:56.145 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/35' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './112/37' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './112' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/19' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/15' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/31' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/36' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/20' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/12' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/39' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/10' 2023-11-28T20:42:56.146 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/34' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/38' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/11' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/16' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/32' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/30' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/14' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/18' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/13' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/33' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/17' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/35' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed './113/37' 2023-11-28T20:42:56.147 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './113' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/19' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/15' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/31' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/36' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/20' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/12' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/39' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/10' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/34' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/38' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/11' 2023-11-28T20:42:56.148 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/16' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/32' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/30' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/14' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/18' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/13' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/33' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/17' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/35' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './114/37' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './114' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/19' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/15' 2023-11-28T20:42:56.149 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/31' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/36' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/20' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/12' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/39' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/10' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/34' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/38' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/11' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/16' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/32' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/30' 2023-11-28T20:42:56.150 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/14' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/18' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/13' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/33' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/17' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/35' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './115/37' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './115' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/19' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/15' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/31' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/36' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/20' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/12' 2023-11-28T20:42:56.151 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/39' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/10' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/34' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/38' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/11' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/16' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/32' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/30' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/14' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/18' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/13' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/33' 2023-11-28T20:42:56.152 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/17' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/35' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './116/37' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './116' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/19' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/15' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/31' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/36' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/20' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/12' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/39' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/10' 2023-11-28T20:42:56.153 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/34' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/38' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/11' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/16' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/32' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/30' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/14' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/18' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/13' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/33' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/17' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/35' 2023-11-28T20:42:56.154 INFO:tasks.workunit.client.0.smithi167.stdout:removed './117/37' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './117' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/19' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/15' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/31' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/36' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/20' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/12' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/39' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/10' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/34' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/38' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/11' 2023-11-28T20:42:56.155 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/16' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/32' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/30' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/14' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/18' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/13' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/33' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/17' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/35' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './118/37' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './118' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/19' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/15' 2023-11-28T20:42:56.156 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/31' 2023-11-28T20:42:56.157 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/36' 2023-11-28T20:42:56.157 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/20' 2023-11-28T20:42:56.157 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/12' 2023-11-28T20:42:57.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/39' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/10' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/34' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/38' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/11' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/16' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/32' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/30' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/14' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/18' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/13' 2023-11-28T20:42:57.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/33' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/17' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/35' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './119/37' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './119' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/19' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/15' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/31' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/36' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/20' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/12' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/39' 2023-11-28T20:42:57.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/10' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/34' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/38' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/11' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/16' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/32' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/30' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/14' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/18' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/13' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/33' 2023-11-28T20:42:57.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/17' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/35' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './120/37' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './120' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/19' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/15' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/31' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/36' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/20' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/12' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/39' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/10' 2023-11-28T20:42:57.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/34' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/38' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/11' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/16' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/32' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/30' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/14' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/18' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/13' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/33' 2023-11-28T20:42:57.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/17' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/35' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './121/37' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './121' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/19' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/15' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/31' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/36' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/20' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/12' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/39' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/10' 2023-11-28T20:42:57.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/34' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/38' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/11' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/16' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/32' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/30' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/14' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/18' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/13' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/33' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/17' 2023-11-28T20:42:57.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/35' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './122/37' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './122' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/19' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/15' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/31' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/36' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/20' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/12' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/39' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/10' 2023-11-28T20:42:57.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/34' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/38' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/11' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/16' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/32' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/30' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/14' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/18' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/13' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/33' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/17' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/35' 2023-11-28T20:42:57.344 INFO:tasks.workunit.client.0.smithi167.stdout:removed './123/37' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './123' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/19' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/15' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/31' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/36' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/20' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/12' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/39' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/10' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/34' 2023-11-28T20:42:57.345 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/38' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/11' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/16' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/32' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/30' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/14' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/18' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/13' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/33' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/17' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/35' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed './124/37' 2023-11-28T20:42:57.346 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './124' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/19' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/15' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/31' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/36' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/20' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/12' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/39' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/10' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/34' 2023-11-28T20:42:57.347 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/38' 2023-11-28T20:42:57.348 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/11' 2023-11-28T20:42:57.348 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/16' 2023-11-28T20:42:57.348 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/32' 2023-11-28T20:42:57.348 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/30' 2023-11-28T20:42:57.348 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/14' 2023-11-28T20:42:57.348 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/18' 2023-11-28T20:42:57.348 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/13' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/33' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/17' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/35' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './125/37' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './125' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/19' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/15' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/31' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/36' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/20' 2023-11-28T20:42:57.349 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/12' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/39' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/10' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/34' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/38' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/11' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/16' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/32' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/30' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/14' 2023-11-28T20:42:57.350 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/18' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/13' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/33' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/17' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/35' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './126/37' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './126' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/19' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/15' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/31' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/36' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/20' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/12' 2023-11-28T20:42:57.351 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/39' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/10' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/34' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/38' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/11' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/16' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/32' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/30' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/14' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/18' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/13' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/33' 2023-11-28T20:42:57.352 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/17' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/35' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './127/37' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './127' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/19' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/15' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/31' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/36' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/20' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/12' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/39' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/10' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/34' 2023-11-28T20:42:57.353 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/38' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/11' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/16' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/32' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/30' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/14' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/18' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/13' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/33' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/17' 2023-11-28T20:42:57.354 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/35' 2023-11-28T20:42:57.954 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:42:58.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.093+0000 7f1762c88640 1 Processor -- start 2023-11-28T20:42:58.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.093+0000 7f1762c88640 1 -- start start 2023-11-28T20:42:58.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1762c88640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f175c0c5d00 0x7f175c0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:58.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1762c88640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c158820 con 0x7f175c0c52d0 2023-11-28T20:42:58.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1762c88640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c161f20 con 0x7f175c158440 2023-11-28T20:42:58.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1762c88640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0725e0 con 0x7f175c0c5d00 2023-11-28T20:42:58.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1762487640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f175c0c5d00 0x7f175c0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:58.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1761485640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f175c0c52d0 0x7f175c0c6ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56204/0 (socket says 172.21.15.167:56204) 2023-11-28T20:42:58.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1761485640 1 -- 172.21.15.167:0/2077730240 learned_addr learned my addr 172.21.15.167:0/2077730240 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:42:58.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1760c84640 1 -- 172.21.15.167:0/2077730240 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130405614 0 0) 0x7f175c158820 con 0x7f175c0c52d0 2023-11-28T20:42:58.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1760c84640 1 -- 172.21.15.167:0/2077730240 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1748003530 con 0x7f175c0c52d0 2023-11-28T20:42:58.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1762487640 1 -- 172.21.15.167:0/2077730240 >> v1:172.21.15.178:6789/0 conn(0x7f175c158440 legacy=0x7f175c06dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:58.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1762487640 1 -- 172.21.15.167:0/2077730240 >> v1:172.21.15.167:6789/0 conn(0x7f175c0c52d0 legacy=0x7f175c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:58.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.097+0000 7f1762487640 1 -- 172.21.15.167:0/2077730240 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c161610 con 0x7f175c0c5d00 2023-11-28T20:42:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762487640 1 --2- 172.21.15.167:0/2077730240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c5d00 0x7f175c0c7610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1754009dc0 tx=0x7f175401f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911e7aa90b965040 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1760c84640 1 -- 172.21.15.167:0/2077730240 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17540af600 con 0x7f175c0c5d00 2023-11-28T20:42:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1760c84640 1 -- 172.21.15.167:0/2077730240 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17540ab050 con 0x7f175c0c5d00 2023-11-28T20:42:58.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1760c84640 1 -- 172.21.15.167:0/2077730240 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17540af980 con 0x7f175c0c5d00 2023-11-28T20:42:58.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762c88640 1 -- 172.21.15.167:0/2077730240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c5d00 msgr2=0x7f175c0c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:58.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762c88640 1 --2- 172.21.15.167:0/2077730240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c5d00 0x7f175c0c7610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1754009dc0 tx=0x7f175401f120 comp rx=0 tx=0).stop 2023-11-28T20:42:58.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762c88640 1 -- 172.21.15.167:0/2077730240 shutdown_connections 2023-11-28T20:42:58.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762c88640 1 --2- 172.21.15.167:0/2077730240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c5d00 0x7f175c0c7610 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:58.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762c88640 1 -- 172.21.15.167:0/2077730240 >> 172.21.15.167:0/2077730240 conn(0x7f175c0cb1e0 msgr2=0x7f175c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:58.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762c88640 1 -- 172.21.15.167:0/2077730240 shutdown_connections 2023-11-28T20:42:58.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762c88640 1 -- 172.21.15.167:0/2077730240 wait complete. 2023-11-28T20:42:58.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762c88640 1 Processor -- start 2023-11-28T20:42:58.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.101+0000 7f1762c88640 1 -- start start 2023-11-28T20:42:58.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762c88640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c52d0 0x7f175c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762c88640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175c0c5d00 0x7f175c154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762c88640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c158440 0x7f175c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762c88640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c1526d0 con 0x7f175c0c52d0 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762c88640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c14fc60 con 0x7f175c158440 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762c88640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c1534a0 con 0x7f175c0c5d00 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761c86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c52d0 0x7f175c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761c86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c52d0 0x7f175c152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53408/0 (socket says 172.21.15.167:53408) 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761c86640 1 -- 172.21.15.167:0/4071482498 learned_addr learned my addr 172.21.15.167:0/4071482498 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761485640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175c0c5d00 0x7f175c154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762487640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c158440 0x7f175c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:58.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761c86640 1 -- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175c0c5d00 msgr2=0x7f175c154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761c86640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175c0c5d00 0x7f175c154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761c86640 1 -- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c158440 msgr2=0x7f175c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761c86640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c158440 0x7f175c0c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761c86640 1 -- 172.21.15.167:0/4071482498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1754009a70 con 0x7f175c0c52d0 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1761c86640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c52d0 0x7f175c152af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f175800c530 tx=0x7f175800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f17527fc640 1 -- 172.21.15.167:0/4071482498 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758005220 con 0x7f175c0c52d0 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f17527fc640 1 -- 172.21.15.167:0/4071482498 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758005380 con 0x7f175c0c52d0 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f17527fc640 1 -- 172.21.15.167:0/4071482498 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758007270 con 0x7f175c0c52d0 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175c153740 con 0x7f175c0c52d0 2023-11-28T20:42:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c151d30 con 0x7f175c0c52d0 2023-11-28T20:42:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c152810 con 0x7f175c0c52d0 2023-11-28T20:42:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.105+0000 7f17527fc640 1 -- 172.21.15.167:0/4071482498 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17580073d0 con 0x7f175c0c52d0 2023-11-28T20:42:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.109+0000 7f17527fc640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1740066470 0x7f1740068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:42:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.109+0000 7f17527fc640 1 -- 172.21.15.167:0/4071482498 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7707+0+0 (secure 0 0 0) 0x7f1758083f60 con 0x7f175c0c52d0 2023-11-28T20:42:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.109+0000 7f1761485640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1740066470 0x7f1740068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:42:58.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.109+0000 7f1761485640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1740066470 0x7f1740068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f175c150930 tx=0x7f174c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:42:58.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.109+0000 7f17527fc640 1 -- 172.21.15.167:0/4071482498 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f175c152810 con 0x7f175c0c52d0 2023-11-28T20:42:58.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f175c152810 con 0x7f175c0c52d0 2023-11-28T20:42:58.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f17527fc640 1 -- 172.21.15.167:0/4071482498 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f175c152810 con 0x7f175c0c52d0 2023-11-28T20:42:58.318 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":36,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:42:58.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1740066470 msgr2=0x7f1740068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:58.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1740066470 0x7f1740068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f175c150930 tx=0x7f174c009040 comp rx=0 tx=0).stop 2023-11-28T20:42:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c52d0 msgr2=0x7f175c152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:42:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c52d0 0x7f175c152af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f175800c530 tx=0x7f175800c9f0 comp rx=0 tx=0).stop 2023-11-28T20:42:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 shutdown_connections 2023-11-28T20:42:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1740066470 0x7f1740068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c158440 0x7f175c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f175c0c5d00 0x7f175c154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 --2- 172.21.15.167:0/4071482498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f175c0c52d0 0x7f175c152af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:42:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 >> 172.21.15.167:0/4071482498 conn(0x7f175c0cb1e0 msgr2=0x7f175c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:42:58.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 shutdown_connections 2023-11-28T20:42:58.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:42:58.317+0000 7f1762c88640 1 -- 172.21.15.167:0/4071482498 wait complete. 2023-11-28T20:43:01.339 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:43:01.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.505+0000 7f8dbb59e640 1 Processor -- start 2023-11-28T20:43:01.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.505+0000 7f8dbb59e640 1 -- start start 2023-11-28T20:43:01.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.505+0000 7f8dbb59e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8dbc150b20 0x7f8dbc070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8dbb59e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dbc06ac90 0x7f8dbc071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8dbb59e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc071cc0 con 0x7f8dbc0c2750 2023-11-28T20:43:01.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8dbb59e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc072840 con 0x7f8dbc150b20 2023-11-28T20:43:01.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8dbb59e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc071fa0 con 0x7f8dbc06ac90 2023-11-28T20:43:01.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8dba59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8dbc150b20 0x7f8dbc070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8dba59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8dbc150b20 0x7f8dbc070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:51232/0 (socket says 172.21.15.167:51232) 2023-11-28T20:43:01.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8dba59c640 1 -- 172.21.15.167:0/410289039 learned_addr learned my addr 172.21.15.167:0/410289039 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:01.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8dbad9d640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dbc06ac90 0x7f8dbc071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794643866 0 0) 0x7f8dbc071cc0 con 0x7f8dbc0c2750 2023-11-28T20:43:01.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8da4003530 con 0x7f8dbc0c2750 2023-11-28T20:43:01.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2060532769 0 0) 0x7f8da4003530 con 0x7f8dbc0c2750 2023-11-28T20:43:01.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dbc06ac90 msgr2=0x7f8dbc071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:01.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dbc06ac90 0x7f8dbc071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 >> v2:172.21.15.178:3300/0 conn(0x7f8dbc150b20 msgr2=0x7f8dbc070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:01.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 --2- 172.21.15.167:0/410289039 >> v2:172.21.15.178:3300/0 conn(0x7f8dbc150b20 0x7f8dbc070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc072280 con 0x7f8dbc0c2750 2023-11-28T20:43:01.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f8db0001680 con 0x7f8dbc0c2750 2023-11-28T20:43:01.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 >> v1:172.21.15.178:6789/0 conn(0x7f8dbc0c2750 legacy=0x7f8dbc06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8da4003980 0x7f8da4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8da40047d0 0x7f8da4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.509+0000 7f8db959a640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dbc06ac90 0x7f8da4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc072840 con 0x7f8da4003980 2023-11-28T20:43:01.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc071fa0 con 0x7f8da40047d0 2023-11-28T20:43:01.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da400ba70 con 0x7f8dbc06ac90 2023-11-28T20:43:01.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8dba59c640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8da4003980 0x7f8da4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8dbad9d640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dbc06ac90 0x7f8da4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8db9d9b640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8da40047d0 0x7f8da4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8dba59c640 1 -- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dbc06ac90 msgr2=0x7f8da4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:01.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8dba59c640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8dbc06ac90 0x7f8da4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8dba59c640 1 -- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8da40047d0 msgr2=0x7f8da4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:01.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8dba59c640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8da40047d0 0x7f8da4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.513+0000 7f8dba59c640 1 -- 172.21.15.167:0/410289039 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da4003530 con 0x7f8da4003980 2023-11-28T20:43:01.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8dba59c640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8da4003980 0x7f8da4003da0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009b90 tx=0x7f8dac01cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8245fae77a17a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:01.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0a5550 con 0x7f8da4003980 2023-11-28T20:43:01.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac0a56b0 con 0x7f8da4003980 2023-11-28T20:43:01.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8db959a640 1 -- 172.21.15.167:0/410289039 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0a5a40 con 0x7f8da4003980 2023-11-28T20:43:01.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8dbb59e640 1 -- 172.21.15.167:0/410289039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8da4003980 msgr2=0x7f8da4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8dbb59e640 1 --2- 172.21.15.167:0/410289039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8da4003980 0x7f8da4003da0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009b90 tx=0x7f8dac01cb50 comp rx=0 tx=0).stop 2023-11-28T20:43:01.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8dbad9d640 1 -- 172.21.15.167:0/410289039 reap_dead start 2023-11-28T20:43:01.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8dbb59e640 1 -- 172.21.15.167:0/410289039 shutdown_connections 2023-11-28T20:43:01.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8dbb59e640 1 -- 172.21.15.167:0/410289039 >> 172.21.15.167:0/410289039 conn(0x7f8dbc0cb1e0 msgr2=0x7f8dbc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:01.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8dbb59e640 1 -- 172.21.15.167:0/410289039 shutdown_connections 2023-11-28T20:43:01.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.517+0000 7f8dbb59e640 1 -- 172.21.15.167:0/410289039 wait complete. 2023-11-28T20:43:01.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dbb59e640 1 Processor -- start 2023-11-28T20:43:01.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dbb59e640 1 -- start start 2023-11-28T20:43:01.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dbb59e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 0x7f8dbc14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dbb59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dbc152330 0x7f8dbc152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dbb59e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dbc1532a0 0x7f8dbc14bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dbb59e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc14f060 con 0x7f8dbc152330 2023-11-28T20:43:01.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dbb59e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc153f40 con 0x7f8dbc1532a0 2023-11-28T20:43:01.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dbb59e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc151610 con 0x7f8da4003980 2023-11-28T20:43:01.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dba59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 0x7f8dbc14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dba59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 0x7f8dbc14f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:36266/0 (socket says 172.21.15.167:36266) 2023-11-28T20:43:01.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dba59c640 1 -- 172.21.15.167:0/1564783165 learned_addr learned my addr 172.21.15.167:0/1564783165 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:01.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dba59c640 1 -- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 msgr2=0x7f8dbc14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:43:01.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dba59c640 1 -- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 msgr2=0x7f8dbc14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:43:01.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dba59c640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 0x7f8dbc14f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:01.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.521+0000 7f8dba59c640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 0x7f8dbc14f7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:01.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8dbad9d640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dbc1532a0 0x7f8dbc14bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8db9d9b640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dbc152330 0x7f8dbc152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8db9d9b640 1 -- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 msgr2=0x7f8dbc14f7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:43:01.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8db9d9b640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 0x7f8dbc14f7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8db9d9b640 1 -- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dbc1532a0 msgr2=0x7f8dbc14bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8db9d9b640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dbc1532a0 0x7f8dbc14bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8db9d9b640 1 -- 172.21.15.167:0/1564783165 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc14f2b0 con 0x7f8dbc152330 2023-11-28T20:43:01.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8db9d9b640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dbc152330 0x7f8dbc152d60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8db000afd0 tx=0x7f8db0011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:01.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8daaffd640 1 -- 172.21.15.167:0/1564783165 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db00052e0 con 0x7f8dbc152330 2023-11-28T20:43:01.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8daaffd640 1 -- 172.21.15.167:0/1564783165 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db0005440 con 0x7f8dbc152330 2023-11-28T20:43:01.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8daaffd640 1 -- 172.21.15.167:0/1564783165 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0003840 con 0x7f8dbc152330 2023-11-28T20:43:01.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc14f590 con 0x7f8dbc152330 2023-11-28T20:43:01.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.525+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc1512b0 con 0x7f8dbc152330 2023-11-28T20:43:01.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.529+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc153680 con 0x7f8dbc152330 2023-11-28T20:43:01.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.529+0000 7f8daaffd640 1 -- 172.21.15.167:0/1564783165 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8db00039a0 con 0x7f8dbc152330 2023-11-28T20:43:01.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.529+0000 7f8daaffd640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8d9c0664c0 0x7f8d9c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.529+0000 7f8daaffd640 1 -- 172.21.15.167:0/1564783165 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7227+0+0 (secure 0 0 0) 0x7f8db00873a0 con 0x7f8dbc152330 2023-11-28T20:43:01.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.529+0000 7f8dba59c640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8d9c0664c0 0x7f8d9c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.537+0000 7f8dba59c640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8d9c0664c0 0x7f8d9c068980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8dac01cb90 tx=0x7f8dac0bc040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:01.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.537+0000 7f8daaffd640 1 -- 172.21.15.167:0/1564783165 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8db0054320 con 0x7f8dbc152330 2023-11-28T20:43:01.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.749+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8dbc04e850 con 0x7f8dbc152330 2023-11-28T20:43:01.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.749+0000 7f8daaffd640 1 -- 172.21.15.167:0/1564783165 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7f8db0019620 con 0x7f8dbc152330 2023-11-28T20:43:01.753 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:43:01.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8d9c0664c0 msgr2=0x7f8d9c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8d9c0664c0 0x7f8d9c068980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8dac01cb90 tx=0x7f8dac0bc040 comp rx=0 tx=0).stop 2023-11-28T20:43:01.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dbc152330 msgr2=0x7f8dbc152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dbc152330 0x7f8dbc152d60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8db000afd0 tx=0x7f8db0011a00 comp rx=0 tx=0).stop 2023-11-28T20:43:01.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 shutdown_connections 2023-11-28T20:43:01.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8d9c0664c0 0x7f8d9c068980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dbc1532a0 0x7f8dbc14bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8dbc152330 0x7f8dbc152d60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 --2- 172.21.15.167:0/1564783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8da4003980 0x7f8dbc14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 >> 172.21.15.167:0/1564783165 conn(0x7f8dbc0cb1e0 msgr2=0x7f8dbc0c4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:01.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 shutdown_connections 2023-11-28T20:43:01.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.753+0000 7f8dbb59e640 1 -- 172.21.15.167:0/1564783165 wait complete. 2023-11-28T20:43:01.773 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:43:01.773 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:43:01.774 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:43:01.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e4d0c9640 1 Processor -- start 2023-11-28T20:43:01.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e4d0c9640 1 -- start start 2023-11-28T20:43:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e4d0c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e4806a7e0 0x7f1e48071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e4d0c9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e4806abc0 0x7f1e480c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e4d0c9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4815d670 con 0x7f1e48153a10 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e4d0c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e48071870 con 0x7f1e4806a7e0 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e4d0c9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e480c6420 con 0x7f1e4806abc0 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e46d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e4806a7e0 0x7f1e48071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e46d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e4806a7e0 0x7f1e48071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53470/0 (socket says 172.21.15.167:53470) 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e46d9d640 1 -- 172.21.15.167:0/2876680337 learned_addr learned my addr 172.21.15.167:0/2876680337 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e3ffff640 1 --2- 172.21.15.167:0/2876680337 >> v2:172.21.15.178:3300/0 conn(0x7f1e4806abc0 0x7f1e480c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e46d9d640 1 -- 172.21.15.167:0/2876680337 >> v2:172.21.15.178:3300/0 conn(0x7f1e4806abc0 msgr2=0x7f1e480c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e46d9d640 1 --2- 172.21.15.167:0/2876680337 >> v2:172.21.15.178:3300/0 conn(0x7f1e4806abc0 0x7f1e480c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e46d9d640 1 -- 172.21.15.167:0/2876680337 >> v1:172.21.15.178:6789/0 conn(0x7f1e48153a10 legacy=0x7f1e48153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.913+0000 7f1e46d9d640 1 -- 172.21.15.167:0/2876680337 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4815aca0 con 0x7f1e4806a7e0 2023-11-28T20:43:01.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e46d9d640 1 --2- 172.21.15.167:0/2876680337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4806a7e0 0x7f1e48071d00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e48072a10 tx=0x7f1e3801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c155deead3fe98d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:01.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4659c640 1 -- 172.21.15.167:0/2876680337 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380a89f0 con 0x7f1e4806a7e0 2023-11-28T20:43:01.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4659c640 1 -- 172.21.15.167:0/2876680337 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e380a8b50 con 0x7f1e4806a7e0 2023-11-28T20:43:01.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4659c640 1 -- 172.21.15.167:0/2876680337 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380b0440 con 0x7f1e4806a7e0 2023-11-28T20:43:01.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/2876680337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4806a7e0 msgr2=0x7f1e48071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4d0c9640 1 --2- 172.21.15.167:0/2876680337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4806a7e0 0x7f1e48071d00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e48072a10 tx=0x7f1e3801ecf0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/2876680337 shutdown_connections 2023-11-28T20:43:01.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4d0c9640 1 --2- 172.21.15.167:0/2876680337 >> v2:172.21.15.178:3300/0 conn(0x7f1e4806abc0 0x7f1e480c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4d0c9640 1 --2- 172.21.15.167:0/2876680337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4806a7e0 0x7f1e48071d00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/2876680337 >> 172.21.15.167:0/2876680337 conn(0x7f1e480cb1e0 msgr2=0x7f1e480cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:01.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/2876680337 shutdown_connections 2023-11-28T20:43:01.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.917+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/2876680337 wait complete. 2023-11-28T20:43:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 Processor -- start 2023-11-28T20:43:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 -- start start 2023-11-28T20:43:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e4806a7e0 0x7f1e481efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e4806abc0 0x7f1e480ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e48153a10 0x7f1e481f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48159cb0 con 0x7f1e48153a10 2023-11-28T20:43:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e481ef6a0 con 0x7f1e4806a7e0 2023-11-28T20:43:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e480c33d0 con 0x7f1e4806abc0 2023-11-28T20:43:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e48153a10 0x7f1e481f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e48153a10 0x7f1e481f2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53486/0 (socket says 172.21.15.167:53486) 2023-11-28T20:43:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4759e640 1 -- 172.21.15.167:0/1865262373 learned_addr learned my addr 172.21.15.167:0/1865262373 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e3ffff640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e4806abc0 0x7f1e480ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e46d9d640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e4806a7e0 0x7f1e481efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4759e640 1 -- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e4806abc0 msgr2=0x7f1e480ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4759e640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e4806abc0 0x7f1e480ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4759e640 1 -- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e4806a7e0 msgr2=0x7f1e481efb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4759e640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e4806a7e0 0x7f1e481efb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:01.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4759e640 1 -- 172.21.15.167:0/1865262373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e380094d0 con 0x7f1e48153a10 2023-11-28T20:43:01.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4759e640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e48153a10 0x7f1e481f2780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c760 tx=0x7f1e4000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:01.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40003b80 con 0x7f1e48153a10 2023-11-28T20:43:01.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e40003ce0 con 0x7f1e48153a10 2023-11-28T20:43:01.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000aa30 con 0x7f1e48153a10 2023-11-28T20:43:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e481596f0 con 0x7f1e48153a10 2023-11-28T20:43:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e481ef330 con 0x7f1e48153a10 2023-11-28T20:43:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c8880 0x7f1e481f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.921+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48074770 con 0x7f1e480c8880 2023-11-28T20:43:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e46d9d640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c8880 0x7f1e481f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e46d9d640 1 -- 172.21.15.167:0/1865262373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e48071220 con 0x7f1e480c8880 2023-11-28T20:43:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e46d9d640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c8880 0x7f1e481f2cc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e48070960 tx=0x7f1e3801d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e4000ab90 con 0x7f1e48153a10 2023-11-28T20:43:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3f7fe640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e28066470 0x7f1e28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7227+0+0 (secure 0 0 0) 0x7f1e40083fa0 con 0x7f1e48153a10 2023-11-28T20:43:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380b0e90 con 0x7f1e480c8880 2023-11-28T20:43:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1e380bb420 con 0x7f1e480c8880 2023-11-28T20:43:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c8880 msgr2=0x7f1e481f2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3f7fe640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c8880 0x7f1e481f2cc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e48070960 tx=0x7f1e3801d530 comp rx=0 tx=0).stop 2023-11-28T20:43:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3ffff640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e28066470 0x7f1e28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c8880 msgr2=0x7f1e481f2cc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:01.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3f7fe640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c8880 0x7f1e481f2cc0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1e48070960 tx=0x7f1e3801d530 comp rx=0 tx=0).stop 2023-11-28T20:43:01.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.925+0000 7f1e3ffff640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e28066470 0x7f1e28068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1e4815b0b0 tx=0x7f1e30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.929+0000 7f1e4d0c9640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c7000 0x7f1e481f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.929+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48070f40 con 0x7f1e480c7000 2023-11-28T20:43:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e46d9d640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c7000 0x7f1e481f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e46d9d640 1 -- 172.21.15.167:0/1865262373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1e48071500 con 0x7f1e480c7000 2023-11-28T20:43:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e46d9d640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c7000 0x7f1e481f3200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e3801c920 tx=0x7f1e380aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380c3b20 con 0x7f1e480c7000 2023-11-28T20:43:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4641 (secure 0 0 0) 0x7f1e380c3c80 con 0x7f1e480c7000 2023-11-28T20:43:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c7000 msgr2=0x7f1e481f3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e3f7fe640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c7000 0x7f1e481f3200 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e3801c920 tx=0x7f1e380aa000 comp rx=0 tx=0).stop 2023-11-28T20:43:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e3f7fe640 1 -- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c7000 msgr2=0x7f1e481f3200 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:01.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e3f7fe640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e480c7000 0x7f1e481f3200 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1e3801c920 tx=0x7f1e380aa000 comp rx=0 tx=0).stop 2023-11-28T20:43:01.941 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:01.941 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:01.941 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:01.942 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:43:01.942 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 40, 2023-11-28T20:43:01.942 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:01.942 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:01.942 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:43:01.942 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:01.943 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:01.943 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:43:01.943 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:01.943 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:01.943 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:01.944 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:01.944 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:01.944 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:01.944 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:01.944 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:01.944 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:01.945 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:01.945 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:01.945 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:01.945 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:01.945 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:01.946 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:01.946 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:01.946 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:01.947 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:01.948 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:01.949 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:01.950 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:01.951 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:01.952 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:01.953 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:01.954 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:01.955 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:01.956 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:01.957 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:01.958 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:43:01.959 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:01.960 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:01.961 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:01.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:01.963 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:01.963 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:01.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e28066470 msgr2=0x7f1e28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4d0c9640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e28066470 0x7f1e28068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1e4815b0b0 tx=0x7f1e30008040 comp rx=0 tx=0).stop 2023-11-28T20:43:01.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e48153a10 msgr2=0x7f1e481f2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:01.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4d0c9640 1 --2- 172.21.15.167:0/1865262373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e48153a10 0x7f1e481f2780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c760 tx=0x7f1e4000cc20 comp rx=0 tx=0).stop 2023-11-28T20:43:01.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4759e640 1 -- 172.21.15.167:0/1865262373 reap_dead start 2023-11-28T20:43:01.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4759e640 1 -- 172.21.15.167:0/1865262373 reap_dead start 2023-11-28T20:43:01.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 shutdown_connections 2023-11-28T20:43:01.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 >> 172.21.15.167:0/1865262373 conn(0x7f1e480cb1e0 msgr2=0x7f1e48152750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:01.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 shutdown_connections 2023-11-28T20:43:01.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:01.933+0000 7f1e4d0c9640 1 -- 172.21.15.167:0/1865262373 wait complete. 2023-11-28T20:43:01.967 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:43:01.967 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:43:01.967 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:43:02.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f2225f57640 1 Processor -- start 2023-11-28T20:43:02.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f2225f57640 1 -- start start 2023-11-28T20:43:02.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f2225f57640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22200c6ff0 0x7f2220157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f2225f57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 0x7f222006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f2225f57640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22200c4920 con 0x7f2220150b40 2023-11-28T20:43:02.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f2225f57640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22200c62f0 con 0x7f22200c6ff0 2023-11-28T20:43:02.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f2225f57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200c6ac0 con 0x7f22200c4510 2023-11-28T20:43:02.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f221effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22200c6ff0 0x7f2220157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f221effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22200c6ff0 0x7f2220157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53512/0 (socket says 172.21.15.167:53512) 2023-11-28T20:43:02.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f221effd640 1 -- 172.21.15.167:0/961239500 learned_addr learned my addr 172.21.15.167:0/961239500 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:02.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f221ffff640 1 --2- 172.21.15.167:0/961239500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 0x7f222006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f221effd640 1 -- 172.21.15.167:0/961239500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 msgr2=0x7f222006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:02.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f221effd640 1 --2- 172.21.15.167:0/961239500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 0x7f222006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f221effd640 1 -- 172.21.15.167:0/961239500 >> v1:172.21.15.178:6789/0 conn(0x7f2220150b40 legacy=0x7f22200c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.117+0000 7f221effd640 1 -- 172.21.15.167:0/961239500 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200c6500 con 0x7f22200c6ff0 2023-11-28T20:43:02.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f221effd640 1 --2- 172.21.15.167:0/961239500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 0x7f2220157560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2214009870 tx=0x7f221401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b184b4b7b8d8e6d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f221e7fc640 1 -- 172.21.15.167:0/961239500 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140ab620 con 0x7f22200c6ff0 2023-11-28T20:43:02.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f221e7fc640 1 -- 172.21.15.167:0/961239500 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22140ab780 con 0x7f22200c6ff0 2023-11-28T20:43:02.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f221e7fc640 1 -- 172.21.15.167:0/961239500 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140abb10 con 0x7f22200c6ff0 2023-11-28T20:43:02.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f2225f57640 1 -- 172.21.15.167:0/961239500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 msgr2=0x7f2220157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f2225f57640 1 --2- 172.21.15.167:0/961239500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 0x7f2220157560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2214009870 tx=0x7f221401c510 comp rx=0 tx=0).stop 2023-11-28T20:43:02.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f2225f57640 1 -- 172.21.15.167:0/961239500 shutdown_connections 2023-11-28T20:43:02.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f2225f57640 1 --2- 172.21.15.167:0/961239500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 0x7f222006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f2225f57640 1 --2- 172.21.15.167:0/961239500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 0x7f2220157560 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f2225f57640 1 -- 172.21.15.167:0/961239500 >> 172.21.15.167:0/961239500 conn(0x7f22200cb1e0 msgr2=0x7f22200cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:02.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f2225f57640 1 -- 172.21.15.167:0/961239500 shutdown_connections 2023-11-28T20:43:02.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.121+0000 7f2225f57640 1 -- 172.21.15.167:0/961239500 wait complete. 2023-11-28T20:43:02.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.125+0000 7f2225f57640 1 Processor -- start 2023-11-28T20:43:02.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.125+0000 7f2225f57640 1 -- start start 2023-11-28T20:43:02.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.125+0000 7f2225f57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 0x7f22201f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.125+0000 7f2225f57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 0x7f22201f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.125+0000 7f2225f57640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220150b40 0x7f222014dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.125+0000 7f2225f57640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222014b650 con 0x7f22200c6ff0 2023-11-28T20:43:02.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.125+0000 7f2225f57640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22201f7390 con 0x7f2220150b40 2023-11-28T20:43:02.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.125+0000 7f2225f57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22201f3720 con 0x7f22200c4510 2023-11-28T20:43:02.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.125+0000 7f221effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 0x7f22201f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 0x7f22201f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53516/0 (socket says 172.21.15.167:53516) 2023-11-28T20:43:02.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221effd640 1 -- 172.21.15.167:0/3897372266 learned_addr learned my addr 172.21.15.167:0/3897372266 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:02.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221f7fe640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 0x7f22201f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221ffff640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220150b40 0x7f222014dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221effd640 1 -- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 msgr2=0x7f22201f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221effd640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 0x7f22201f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221effd640 1 -- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220150b40 msgr2=0x7f222014dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221effd640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220150b40 0x7f222014dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221effd640 1 -- 172.21.15.167:0/3897372266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140094d0 con 0x7f22200c6ff0 2023-11-28T20:43:02.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221f7fe640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22200c4510 0x7f22201f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:43:02.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221ffff640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220150b40 0x7f222014dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:43:02.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221effd640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 0x7f22201f2f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f221401a140 tx=0x7f221401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140be3f0 con 0x7f22200c6ff0 2023-11-28T20:43:02.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22140be550 con 0x7f22200c6ff0 2023-11-28T20:43:02.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22201f3a00 con 0x7f22200c6ff0 2023-11-28T20:43:02.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140be900 con 0x7f22200c6ff0 2023-11-28T20:43:02.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222014b8a0 con 0x7f22200c6ff0 2023-11-28T20:43:02.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f2225f57640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f222014ba90 0x7f2220143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222014d070 con 0x7f222014ba90 2023-11-28T20:43:02.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221f7fe640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f222014ba90 0x7f2220143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22140b43f0 con 0x7f22200c6ff0 2023-11-28T20:43:02.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221f7fe640 1 -- 172.21.15.167:0/3897372266 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22200c3a50 con 0x7f222014ba90 2023-11-28T20:43:02.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f221f7fe640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f222014ba90 0x7f2220143b40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f22200cc2a0 tx=0x7f221000e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.129+0000 7f2207fff640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f220c066470 0x7f220c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.133+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7227+0+0 (secure 0 0 0) 0x7f221411e800 con 0x7f22200c6ff0 2023-11-28T20:43:02.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.133+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22100052e0 con 0x7f222014ba90 2023-11-28T20:43:02.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.133+0000 7f221ffff640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f220c066470 0x7f220c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.133+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2210005440 con 0x7f222014ba90 2023-11-28T20:43:02.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.133+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f222014ba90 msgr2=0x7f2220143b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.133+0000 7f2207fff640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f222014ba90 0x7f2220143b40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f22200cc2a0 tx=0x7f221000e960 comp rx=0 tx=0).stop 2023-11-28T20:43:02.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.133+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f222014ba90 msgr2=0x7f2220143b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:02.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.133+0000 7f2207fff640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f222014ba90 0x7f2220143b40 secure :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f22200cc2a0 tx=0x7f221000e960 comp rx=0 tx=0).stop 2023-11-28T20:43:02.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.133+0000 7f221ffff640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f220c066470 0x7f220c068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2218007380 tx=0x7f221800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.137+0000 7f2225f57640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220144080 0x7f222014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.137+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220144490 con 0x7f2220144080 2023-11-28T20:43:02.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.137+0000 7f221f7fe640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220144080 0x7f222014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.137+0000 7f221f7fe640 1 -- 172.21.15.167:0/3897372266 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f222006e390 con 0x7f2220144080 2023-11-28T20:43:02.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f221f7fe640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220144080 0x7f222014c0a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22200cc2a0 tx=0x7f2210001090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210003b80 con 0x7f2220144080 2023-11-28T20:43:02.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5122 (secure 0 0 0) 0x7f2210003ce0 con 0x7f2220144080 2023-11-28T20:43:02.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220144080 msgr2=0x7f222014c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2207fff640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220144080 0x7f222014c0a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22200cc2a0 tx=0x7f2210001090 comp rx=0 tx=0).stop 2023-11-28T20:43:02.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2207fff640 1 -- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220144080 msgr2=0x7f222014c0a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:02.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2207fff640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2220144080 0x7f222014c0a0 secure :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22200cc2a0 tx=0x7f2210001090 comp rx=0 tx=0).stop 2023-11-28T20:43:02.146 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:02.146 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:02.146 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:02.146 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 40, 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:02.147 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:02.148 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:02.149 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:02.150 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:02.151 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:02.152 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:02.152 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:02.152 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:02.152 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:02.152 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:02.152 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:02.152 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:02.152 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:02.153 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.155 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:02.155 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:02.155 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:02.155 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:02.155 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:02.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.155 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:02.155 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:02.156 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.157 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.157 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.157 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.157 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:02.157 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:02.157 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:02.157 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:02.157 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:02.158 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:02.159 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:02.160 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:02.160 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.160 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.160 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:02.160 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:02.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.160 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:02.160 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.161 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 7 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.162 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:43:02.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.164 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:02.164 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:02.164 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:02.164 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.164 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.164 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:02.164 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:02.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f220c066470 msgr2=0x7f220c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2225f57640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f220c066470 0x7f220c068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2218007380 tx=0x7f221800b040 comp rx=0 tx=0).stop 2023-11-28T20:43:02.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 msgr2=0x7f22201f2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2225f57640 1 --2- 172.21.15.167:0/3897372266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22200c6ff0 0x7f22201f2f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f221401a140 tx=0x7f221401ad50 comp rx=0 tx=0).stop 2023-11-28T20:43:02.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f221ffff640 1 -- 172.21.15.167:0/3897372266 reap_dead start 2023-11-28T20:43:02.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f221ffff640 1 -- 172.21.15.167:0/3897372266 reap_dead start 2023-11-28T20:43:02.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 shutdown_connections 2023-11-28T20:43:02.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 >> 172.21.15.167:0/3897372266 conn(0x7f22200cb1e0 msgr2=0x7f22200c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:02.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 shutdown_connections 2023-11-28T20:43:02.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.141+0000 7f2225f57640 1 -- 172.21.15.167:0/3897372266 wait complete. 2023-11-28T20:43:02.167 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:43:02.167 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:43:02.167 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:43:02.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f3801d55640 1 Processor -- start 2023-11-28T20:43:02.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f3801d55640 1 -- start start 2023-11-28T20:43:02.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f3801d55640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37fc151f60 0x7f37fc0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f3801d55640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f37fc06a580 0x7f37fc06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f3801d55640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc0c6120 con 0x7f37fc0c5c90 2023-11-28T20:43:02.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f3801d55640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc06aed0 con 0x7f37fc06a580 2023-11-28T20:43:02.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f3801d55640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc0c4da0 con 0x7f37fc151f60 2023-11-28T20:43:02.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f37fbfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f37fc06a580 0x7f37fc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f37fbfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f37fc06a580 0x7f37fc06a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53522/0 (socket says 172.21.15.167:53522) 2023-11-28T20:43:02.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f37fbfff640 1 -- 172.21.15.167:0/4005780492 learned_addr learned my addr 172.21.15.167:0/4005780492 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:02.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f37fb7fe640 1 --2- 172.21.15.167:0/4005780492 >> v2:172.21.15.178:3300/0 conn(0x7f37fc151f60 0x7f37fc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f37fbfff640 1 -- 172.21.15.167:0/4005780492 >> v2:172.21.15.178:3300/0 conn(0x7f37fc151f60 msgr2=0x7f37fc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:02.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f37fbfff640 1 --2- 172.21.15.167:0/4005780492 >> v2:172.21.15.178:3300/0 conn(0x7f37fc151f60 0x7f37fc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f37fbfff640 1 -- 172.21.15.167:0/4005780492 >> v1:172.21.15.178:6789/0 conn(0x7f37fc0c5c90 legacy=0x7f37fc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.321+0000 7f37fbfff640 1 -- 172.21.15.167:0/4005780492 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc15b220 con 0x7f37fc06a580 2023-11-28T20:43:02.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f37fbfff640 1 --2- 172.21.15.167:0/4005780492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc06a580 0x7f37fc06a990 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0c62c0 tx=0x7f37f401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871d1bac73959b80 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f37fa7fc640 1 -- 172.21.15.167:0/4005780492 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40a5600 con 0x7f37fc06a580 2023-11-28T20:43:02.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f37fa7fc640 1 -- 172.21.15.167:0/4005780492 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40a5760 con 0x7f37fc06a580 2023-11-28T20:43:02.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f37fa7fc640 1 -- 172.21.15.167:0/4005780492 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40a5af0 con 0x7f37fc06a580 2023-11-28T20:43:02.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f3801d55640 1 -- 172.21.15.167:0/4005780492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc06a580 msgr2=0x7f37fc06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f3801d55640 1 --2- 172.21.15.167:0/4005780492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc06a580 0x7f37fc06a990 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0c62c0 tx=0x7f37f401c940 comp rx=0 tx=0).stop 2023-11-28T20:43:02.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f3801d55640 1 -- 172.21.15.167:0/4005780492 shutdown_connections 2023-11-28T20:43:02.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f3801d55640 1 --2- 172.21.15.167:0/4005780492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc06a580 0x7f37fc06a990 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f3801d55640 1 --2- 172.21.15.167:0/4005780492 >> v2:172.21.15.178:3300/0 conn(0x7f37fc151f60 0x7f37fc0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f3801d55640 1 -- 172.21.15.167:0/4005780492 >> 172.21.15.167:0/4005780492 conn(0x7f37fc0cb1e0 msgr2=0x7f37fc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:02.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f3801d55640 1 -- 172.21.15.167:0/4005780492 shutdown_connections 2023-11-28T20:43:02.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f3801d55640 1 -- 172.21.15.167:0/4005780492 wait complete. 2023-11-28T20:43:02.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.325+0000 7f3801d55640 1 Processor -- start 2023-11-28T20:43:02.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 -- start start 2023-11-28T20:43:02.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc06a580 0x7f37fc161c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37fc0c5c90 0x7f37fc1f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc151f60 0x7f37fc1394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc1f3530 con 0x7f37fc151f60 2023-11-28T20:43:02.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc1f2990 con 0x7f37fc0c5c90 2023-11-28T20:43:02.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc1f2c00 con 0x7f37fc06a580 2023-11-28T20:43:02.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc151f60 0x7f37fc1394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc151f60 0x7f37fc1394b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53530/0 (socket says 172.21.15.167:53530) 2023-11-28T20:43:02.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fbfff640 1 -- 172.21.15.167:0/71774824 learned_addr learned my addr 172.21.15.167:0/71774824 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:02.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fb7fe640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc06a580 0x7f37fc161c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37faffd640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37fc0c5c90 0x7f37fc1f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fbfff640 1 -- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc06a580 msgr2=0x7f37fc161c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fbfff640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc06a580 0x7f37fc161c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fbfff640 1 -- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37fc0c5c90 msgr2=0x7f37fc1f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fbfff640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37fc0c5c90 0x7f37fc1f65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fbfff640 1 -- 172.21.15.167:0/71774824 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f4009b30 con 0x7f37fc151f60 2023-11-28T20:43:02.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fbfff640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc151f60 0x7f37fc1394b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f37f401a570 tx=0x7f37f40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40a5600 con 0x7f37fc151f60 2023-11-28T20:43:02.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40b8670 con 0x7f37fc151f60 2023-11-28T20:43:02.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc1f2ee0 con 0x7f37fc151f60 2023-11-28T20:43:02.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f40b8a20 con 0x7f37fc151f60 2023-11-28T20:43:02.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc162300 con 0x7f37fc151f60 2023-11-28T20:43:02.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1f6ae0 0x7f37fc1399f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc074770 con 0x7f37fc1f6ae0 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.329+0000 7f37fb7fe640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1f6ae0 0x7f37fc1399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37fb7fe640 1 -- 172.21.15.167:0/71774824 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37fc15ba30 con 0x7f37fc1f6ae0 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37f40b8b80 con 0x7f37fc151f60 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37fb7fe640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1f6ae0 0x7f37fc1399f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37ec011600 tx=0x7f37ec011ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37e3fff640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37e8066470 0x7f37e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7227+0+0 (secure 0 0 0) 0x7f37f411f8c0 con 0x7f37fc151f60 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec00f940 con 0x7f37fc1f6ae0 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37faffd640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37e8066470 0x7f37e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f37ec00faa0 con 0x7f37fc1f6ae0 2023-11-28T20:43:02.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1f6ae0 msgr2=0x7f37fc1399f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37e3fff640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1f6ae0 0x7f37fc1399f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37ec011600 tx=0x7f37ec011ac0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1f6ae0 msgr2=0x7f37fc1399f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:02.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37e3fff640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1f6ae0 0x7f37fc1399f0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37ec011600 tx=0x7f37ec011ac0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.333+0000 7f37faffd640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37e8066470 0x7f37e8068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0c72c0 tx=0x7f37f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.337+0000 7f3801d55640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1502a0 0x7f37fc1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.337+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc150bf0 con 0x7f37fc1502a0 2023-11-28T20:43:02.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.337+0000 7f37fb7fe640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1502a0 0x7f37fc1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37fb7fe640 1 -- 172.21.15.167:0/71774824 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f37fc158750 con 0x7f37fc1502a0 2023-11-28T20:43:02.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37fb7fe640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1502a0 0x7f37fc1506b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37ec011600 tx=0x7f37ec0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec021040 con 0x7f37fc1502a0 2023-11-28T20:43:02.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4639 (secure 0 0 0) 0x7f37ec0222d0 con 0x7f37fc1502a0 2023-11-28T20:43:02.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1502a0 msgr2=0x7f37fc1506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37e3fff640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1502a0 0x7f37fc1506b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37ec011600 tx=0x7f37ec0046d0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37e3fff640 1 -- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1502a0 msgr2=0x7f37fc1506b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:02.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37e3fff640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37fc1502a0 0x7f37fc1506b0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37ec011600 tx=0x7f37ec0046d0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.343 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:02.343 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 40, 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:02.344 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:02.345 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:02.346 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:02.349 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:02.350 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:02.351 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.352 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:02.353 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.354 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:02.355 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:02.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.358 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:02.359 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:02.360 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:02.361 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:02.362 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:02.362 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:02.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37e8066470 msgr2=0x7f37e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f3801d55640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37e8066470 0x7f37e8068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0c72c0 tx=0x7f37f0009040 comp rx=0 tx=0).stop 2023-11-28T20:43:02.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc151f60 msgr2=0x7f37fc1394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f3801d55640 1 --2- 172.21.15.167:0/71774824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37fc151f60 0x7f37fc1394b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f37f401a570 tx=0x7f37f40196e0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37fbfff640 1 -- 172.21.15.167:0/71774824 reap_dead start 2023-11-28T20:43:02.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f37fbfff640 1 -- 172.21.15.167:0/71774824 reap_dead start 2023-11-28T20:43:02.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 shutdown_connections 2023-11-28T20:43:02.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 >> 172.21.15.167:0/71774824 conn(0x7f37fc0cb1e0 msgr2=0x7f37fc14f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:02.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 shutdown_connections 2023-11-28T20:43:02.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.341+0000 7f3801d55640 1 -- 172.21.15.167:0/71774824 wait complete. 2023-11-28T20:43:02.365 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:43:02.365 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:43:02.365 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:43:02.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd19e32a640 1 Processor -- start 2023-11-28T20:43:02.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd19e32a640 1 -- start start 2023-11-28T20:43:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd19e32a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1980c97c0 0x7fd1980ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd19e32a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd1980c6d00 0x7fd1980c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd19e32a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1980cae80 con 0x7fd1980ca560 2023-11-28T20:43:02.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd19e32a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1980c32f0 con 0x7fd1980c97c0 2023-11-28T20:43:02.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd19e32a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1980c9bf0 con 0x7fd1980c6d00 2023-11-28T20:43:02.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd1977fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1980c97c0 0x7fd1980ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd1977fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1980c97c0 0x7fd1980ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53532/0 (socket says 172.21.15.167:53532) 2023-11-28T20:43:02.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd1977fe640 1 -- 172.21.15.167:0/1916306473 learned_addr learned my addr 172.21.15.167:0/1916306473 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:02.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd19c8c7640 1 --2- 172.21.15.167:0/1916306473 >> v2:172.21.15.178:3300/0 conn(0x7fd1980c6d00 0x7fd1980c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd1977fe640 1 -- 172.21.15.167:0/1916306473 >> v2:172.21.15.178:3300/0 conn(0x7fd1980c6d00 msgr2=0x7fd1980c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:02.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd1977fe640 1 --2- 172.21.15.167:0/1916306473 >> v2:172.21.15.178:3300/0 conn(0x7fd1980c6d00 0x7fd1980c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd1977fe640 1 -- 172.21.15.167:0/1916306473 >> v1:172.21.15.178:6789/0 conn(0x7fd1980ca560 legacy=0x7fd1980cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.505+0000 7fd1977fe640 1 -- 172.21.15.167:0/1916306473 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1980c76d0 con 0x7fd1980c97c0 2023-11-28T20:43:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd1977fe640 1 --2- 172.21.15.167:0/1916306473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c97c0 0x7fd1980ca940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd19806caf0 tx=0x7fd18c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25805ee387ac4da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd196ffd640 1 -- 172.21.15.167:0/1916306473 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0ab600 con 0x7fd1980c97c0 2023-11-28T20:43:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd196ffd640 1 -- 172.21.15.167:0/1916306473 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c0a7050 con 0x7fd1980c97c0 2023-11-28T20:43:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd196ffd640 1 -- 172.21.15.167:0/1916306473 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0ab980 con 0x7fd1980c97c0 2023-11-28T20:43:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd19e32a640 1 -- 172.21.15.167:0/1916306473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c97c0 msgr2=0x7fd1980ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd19e32a640 1 --2- 172.21.15.167:0/1916306473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c97c0 0x7fd1980ca940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd19806caf0 tx=0x7fd18c01c3e0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd19e32a640 1 -- 172.21.15.167:0/1916306473 shutdown_connections 2023-11-28T20:43:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd19e32a640 1 --2- 172.21.15.167:0/1916306473 >> v2:172.21.15.178:3300/0 conn(0x7fd1980c6d00 0x7fd1980c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd19e32a640 1 --2- 172.21.15.167:0/1916306473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c97c0 0x7fd1980ca940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd19e32a640 1 -- 172.21.15.167:0/1916306473 >> 172.21.15.167:0/1916306473 conn(0x7fd19806a580 msgr2=0x7fd19806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd19e32a640 1 -- 172.21.15.167:0/1916306473 shutdown_connections 2023-11-28T20:43:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.509+0000 7fd19e32a640 1 -- 172.21.15.167:0/1916306473 wait complete. 2023-11-28T20:43:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 Processor -- start 2023-11-28T20:43:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 -- start start 2023-11-28T20:43:02.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c6d00 0x7fd198158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1980c97c0 0x7fd19814a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1980ca560 0x7fd19814aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1981f2520 con 0x7fd1980c6d00 2023-11-28T20:43:02.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1981f5c30 con 0x7fd1980c97c0 2023-11-28T20:43:02.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1981f5ed0 con 0x7fd1980ca560 2023-11-28T20:43:02.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd197fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c6d00 0x7fd198158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd197fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c6d00 0x7fd198158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53538/0 (socket says 172.21.15.167:53538) 2023-11-28T20:43:02.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd197fff640 1 -- 172.21.15.167:0/1706880217 learned_addr learned my addr 172.21.15.167:0/1706880217 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:02.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd1977fe640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1980c97c0 0x7fd19814a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19c8c7640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1980ca560 0x7fd19814aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd197fff640 1 -- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1980ca560 msgr2=0x7fd19814aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd197fff640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1980ca560 0x7fd19814aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd197fff640 1 -- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1980c97c0 msgr2=0x7fd19814a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd197fff640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1980c97c0 0x7fd19814a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd197fff640 1 -- 172.21.15.167:0/1706880217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0094d0 con 0x7fd1980c6d00 2023-11-28T20:43:02.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd197fff640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c6d00 0x7fd198158d90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c3c0 tx=0x7fd18800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd194ff9640 1 -- 172.21.15.167:0/1706880217 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1880052d0 con 0x7fd1980c6d00 2023-11-28T20:43:02.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd194ff9640 1 -- 172.21.15.167:0/1706880217 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd188005430 con 0x7fd1980c6d00 2023-11-28T20:43:02.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1981f61b0 con 0x7fd1980c6d00 2023-11-28T20:43:02.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd194ff9640 1 -- 172.21.15.167:0/1706880217 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188003840 con 0x7fd1980c6d00 2023-11-28T20:43:02.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1981f6770 con 0x7fd1980c6d00 2023-11-28T20:43:02.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.513+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1981f6960 con 0x7fd1980c6d00 2023-11-28T20:43:02.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.517+0000 7fd194ff9640 1 -- 172.21.15.167:0/1706880217 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1880039a0 con 0x7fd1980c6d00 2023-11-28T20:43:02.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.517+0000 7fd194ff9640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd184066470 0x7fd184068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:02.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.517+0000 7fd194ff9640 1 -- 172.21.15.167:0/1706880217 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7227+0+0 (secure 0 0 0) 0x7fd1880838d0 con 0x7fd1980c6d00 2023-11-28T20:43:02.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.517+0000 7fd1977fe640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd184066470 0x7fd184068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:02.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.517+0000 7fd1977fe640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd184066470 0x7fd184068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0ad000 tx=0x7fd18c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:02.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.521+0000 7fd194ff9640 1 -- 172.21.15.167:0/1706880217 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1880506c0 con 0x7fd1980c6d00 2023-11-28T20:43:02.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.733+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fd198075c90 con 0x7fd1980c6d00 2023-11-28T20:43:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd194ff9640 1 -- 172.21.15.167:0/1706880217 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fd188053ce0 con 0x7fd1980c6d00 2023-11-28T20:43:02.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd184066470 msgr2=0x7fd184068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd184066470 0x7fd184068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0ad000 tx=0x7fd18c008040 comp rx=0 tx=0).stop 2023-11-28T20:43:02.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c6d00 msgr2=0x7fd198158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:02.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c6d00 0x7fd198158d90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c3c0 tx=0x7fd18800c880 comp rx=0 tx=0).stop 2023-11-28T20:43:02.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 shutdown_connections 2023-11-28T20:43:02.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd184066470 0x7fd184068930 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1980ca560 0x7fd19814aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1980c97c0 0x7fd19814a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 --2- 172.21.15.167:0/1706880217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1980c6d00 0x7fd198158d90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 >> 172.21.15.167:0/1706880217 conn(0x7fd19806a580 msgr2=0x7fd198071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 shutdown_connections 2023-11-28T20:43:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:02.737+0000 7fd19e32a640 1 -- 172.21.15.167:0/1706880217 wait complete. 2023-11-28T20:43:02.768 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:43:02.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './128/37' 2023-11-28T20:43:02.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './128' 2023-11-28T20:43:02.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/19' 2023-11-28T20:43:02.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/15' 2023-11-28T20:43:02.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/31' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/36' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/20' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/12' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/39' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/10' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/34' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/38' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/11' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/16' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/32' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/30' 2023-11-28T20:43:02.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/14' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/18' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/13' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/33' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/17' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/35' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './129/37' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './129' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/19' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/15' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/31' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/36' 2023-11-28T20:43:02.857 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/20' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/12' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/39' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/10' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/34' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/38' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/11' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/16' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/32' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/30' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/14' 2023-11-28T20:43:02.858 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/18' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/13' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/33' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/17' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/35' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './130/37' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './130' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/19' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/15' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/31' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/36' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/20' 2023-11-28T20:43:02.859 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/12' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/39' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/10' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/34' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/38' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/11' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/16' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/32' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/30' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/14' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/18' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/13' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/33' 2023-11-28T20:43:02.860 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/17' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/35' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './131/37' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './131' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/19' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/15' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/31' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/36' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/20' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/12' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/39' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/10' 2023-11-28T20:43:02.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/34' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/38' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/11' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/16' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/32' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/30' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/14' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/18' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/13' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/33' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/17' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/35' 2023-11-28T20:43:02.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './132/37' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './132' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/19' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/15' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/31' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/36' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/20' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/12' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/39' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/10' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/34' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/38' 2023-11-28T20:43:02.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/11' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/16' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/32' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/30' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/14' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/18' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/13' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/33' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/17' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/35' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './133/37' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './133' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/19' 2023-11-28T20:43:02.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/15' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/31' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/36' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/20' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/12' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/39' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/10' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/34' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/38' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/11' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/16' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/32' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/30' 2023-11-28T20:43:02.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/14' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/18' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/13' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/33' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/17' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/35' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './134/37' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './134' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/19' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/15' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/31' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/36' 2023-11-28T20:43:02.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/20' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/12' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/39' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/10' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/34' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/38' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/11' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/16' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/32' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/30' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/14' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/18' 2023-11-28T20:43:02.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/13' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/33' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/17' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/35' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './135/37' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './135' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/19' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/15' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/31' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/36' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/20' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/12' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/39' 2023-11-28T20:43:02.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/10' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/34' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/38' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/11' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/16' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/32' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/30' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/14' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/18' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/13' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/33' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/17' 2023-11-28T20:43:02.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/35' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './136/37' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './136' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/19' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/15' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/31' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/36' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/20' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/12' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/39' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/10' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/34' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/38' 2023-11-28T20:43:02.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/11' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/16' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/32' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/30' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/14' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/18' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/13' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/33' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/17' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/35' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './137/37' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './137' 2023-11-28T20:43:02.871 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/19' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/15' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/31' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/36' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/20' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/12' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/39' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/10' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/34' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/38' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/11' 2023-11-28T20:43:02.872 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/16' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/32' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/30' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/14' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/18' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/13' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/33' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/17' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/35' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed './138/37' 2023-11-28T20:43:03.711 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './138' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/19' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/15' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/31' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/36' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/20' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/12' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/39' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/10' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/34' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/38' 2023-11-28T20:43:03.712 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/11' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/16' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/32' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/30' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/14' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/18' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/13' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/33' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/17' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/35' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './139/37' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './139' 2023-11-28T20:43:03.713 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/19' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/15' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/31' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/36' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/20' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/12' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/39' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/10' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/34' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/38' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/11' 2023-11-28T20:43:03.714 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/16' 2023-11-28T20:43:03.715 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/32' 2023-11-28T20:43:03.715 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/30' 2023-11-28T20:43:03.715 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/14' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/18' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/13' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/33' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/17' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/35' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './140/37' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './140' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/19' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/15' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/31' 2023-11-28T20:43:03.716 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/36' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/20' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/12' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/39' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/10' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/34' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/38' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/11' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/16' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/32' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/30' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/14' 2023-11-28T20:43:03.717 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/18' 2023-11-28T20:43:03.718 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/13' 2023-11-28T20:43:03.718 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/33' 2023-11-28T20:43:03.718 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/17' 2023-11-28T20:43:03.718 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/35' 2023-11-28T20:43:03.718 INFO:tasks.workunit.client.0.smithi167.stdout:removed './141/37' 2023-11-28T20:43:03.718 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './141' 2023-11-28T20:43:03.718 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/19' 2023-11-28T20:43:03.718 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/15' 2023-11-28T20:43:03.718 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/31' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/36' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/20' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/12' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/39' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/10' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/34' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/38' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/11' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/16' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/32' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/30' 2023-11-28T20:43:03.719 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/14' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/18' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/13' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/33' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/17' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/35' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './142/37' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './142' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/19' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/15' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/31' 2023-11-28T20:43:03.720 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/36' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/20' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/12' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/39' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/10' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/34' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/38' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/11' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/16' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/32' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/30' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/14' 2023-11-28T20:43:03.721 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/18' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/13' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/33' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/17' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/35' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './143/37' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './143' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/19' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/15' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/31' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/36' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/20' 2023-11-28T20:43:03.722 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/12' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/39' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/10' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/34' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/38' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/11' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/16' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/32' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/30' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/14' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/18' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/13' 2023-11-28T20:43:03.723 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/33' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/17' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/35' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './144/37' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './144' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/19' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/15' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/31' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/36' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/20' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/12' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/39' 2023-11-28T20:43:03.724 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/10' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/34' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/38' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/11' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/16' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/32' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/30' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/14' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/18' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/13' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/33' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/17' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/35' 2023-11-28T20:43:03.725 INFO:tasks.workunit.client.0.smithi167.stdout:removed './145/37' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './145' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/19' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/15' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/31' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/36' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/20' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/12' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/39' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/10' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/34' 2023-11-28T20:43:03.726 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/38' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/11' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/16' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/32' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/30' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/14' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/18' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/13' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/33' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/17' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/35' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed './146/37' 2023-11-28T20:43:03.727 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './146' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/19' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/15' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/31' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/36' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/20' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/12' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/39' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/10' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/34' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/38' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/11' 2023-11-28T20:43:03.728 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/16' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/32' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/30' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/14' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/18' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/13' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/33' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/17' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/35' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './147/37' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './147' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/19' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/15' 2023-11-28T20:43:03.729 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/31' 2023-11-28T20:43:03.730 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/36' 2023-11-28T20:43:09.774 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/20' 2023-11-28T20:43:09.775 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/12' 2023-11-28T20:43:09.775 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/39' 2023-11-28T20:43:09.775 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/10' 2023-11-28T20:43:09.775 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/34' 2023-11-28T20:43:09.776 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/38' 2023-11-28T20:43:09.776 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/11' 2023-11-28T20:43:09.776 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/16' 2023-11-28T20:43:09.776 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/32' 2023-11-28T20:43:09.776 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/30' 2023-11-28T20:43:09.776 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/14' 2023-11-28T20:43:09.776 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/18' 2023-11-28T20:43:09.776 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/13' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/33' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/17' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/35' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './148/37' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './148' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/19' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/15' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/31' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/36' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/20' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/12' 2023-11-28T20:43:09.777 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/39' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/10' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/34' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/38' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/11' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/16' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/32' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/30' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/14' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/18' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/13' 2023-11-28T20:43:09.778 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/33' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/17' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/35' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './149/37' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './149' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/19' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/15' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/31' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/36' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/20' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/12' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/39' 2023-11-28T20:43:09.779 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/10' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/34' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/38' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/11' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/16' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/32' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/30' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/14' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/18' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/13' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/33' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/17' 2023-11-28T20:43:09.780 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/35' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './150/37' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './150' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/19' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/15' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/31' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/36' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/20' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/12' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/39' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/10' 2023-11-28T20:43:09.781 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/34' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/38' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/11' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/16' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/32' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/30' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/14' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/18' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/13' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/33' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/17' 2023-11-28T20:43:09.782 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/35' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './151/37' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './151' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/19' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/15' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/31' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/36' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/20' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/12' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/39' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/10' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/34' 2023-11-28T20:43:09.783 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/38' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/11' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/16' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/32' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/30' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/14' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/18' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/13' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/33' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/17' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/35' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed './152/37' 2023-11-28T20:43:09.784 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './152' 2023-11-28T20:43:09.785 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/19' 2023-11-28T20:43:09.785 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/15' 2023-11-28T20:43:09.785 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/31' 2023-11-28T20:43:09.785 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/36' 2023-11-28T20:43:09.785 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/20' 2023-11-28T20:43:09.785 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/12' 2023-11-28T20:43:09.785 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/39' 2023-11-28T20:43:09.785 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/10' 2023-11-28T20:43:09.785 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/34' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/38' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/11' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/16' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/32' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/30' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/14' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/18' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/13' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/33' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/17' 2023-11-28T20:43:09.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/35' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './153/37' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './153' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/19' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/15' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/31' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/36' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/20' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/12' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/39' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/10' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/34' 2023-11-28T20:43:09.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/38' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/11' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/16' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/32' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/30' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/14' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/18' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/13' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/33' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/17' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/35' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './154/37' 2023-11-28T20:43:09.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './154' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/19' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/15' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/31' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/36' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/20' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/12' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/39' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/10' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/34' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/38' 2023-11-28T20:43:09.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/11' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/16' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/32' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/30' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/14' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/18' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/13' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/33' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/17' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/35' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './155/37' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './155' 2023-11-28T20:43:09.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/19' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/15' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/31' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/36' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/20' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/12' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/39' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/10' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/34' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/38' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/11' 2023-11-28T20:43:09.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/16' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/32' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/30' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/14' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/18' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/13' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/33' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/17' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/35' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './156/37' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './156' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/19' 2023-11-28T20:43:09.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/15' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/31' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/36' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/20' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/12' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/39' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/10' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/34' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/38' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/11' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/16' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/32' 2023-11-28T20:43:09.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/30' 2023-11-28T20:43:09.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/14' 2023-11-28T20:43:09.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/18' 2023-11-28T20:43:09.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/13' 2023-11-28T20:43:09.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/33' 2023-11-28T20:43:12.769 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:43:12.769 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:43:12.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.905+0000 7f07ade9e640 1 Processor -- start 2023-11-28T20:43:12.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.905+0000 7f07ade9e640 1 -- start start 2023-11-28T20:43:12.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07ade9e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f07a80c75c0 0x7f07a80c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:12.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07ade9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f07a806a580 0x7f07a806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:12.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07ade9e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a80c7a50 con 0x7f07a8151f60 2023-11-28T20:43:12.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07ade9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a806aed0 con 0x7f07a806a580 2023-11-28T20:43:12.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07ade9e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a80c4da0 con 0x7f07a80c75c0 2023-11-28T20:43:12.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07a7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f07a806a580 0x7f07a806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:12.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07a77fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f07a8151f60 0x7f07a80c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57172/0 (socket says 172.21.15.167:57172) 2023-11-28T20:43:12.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07a77fe640 1 -- 172.21.15.167:0/2392522299 learned_addr learned my addr 172.21.15.167:0/2392522299 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:43:12.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f079ffff640 1 --2- 172.21.15.167:0/2392522299 >> v2:172.21.15.178:3300/0 conn(0x7f07a80c75c0 0x7f07a80c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:12.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07a7fff640 1 -- 172.21.15.167:0/2392522299 >> v2:172.21.15.178:3300/0 conn(0x7f07a80c75c0 msgr2=0x7f07a80c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:12.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07a7fff640 1 --2- 172.21.15.167:0/2392522299 >> v2:172.21.15.178:3300/0 conn(0x7f07a80c75c0 0x7f07a80c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:12.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07a7fff640 1 -- 172.21.15.167:0/2392522299 >> v1:172.21.15.167:6789/0 conn(0x7f07a8151f60 legacy=0x7f07a80c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:12.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07a7fff640 1 -- 172.21.15.167:0/2392522299 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a815b220 con 0x7f07a806a580 2023-11-28T20:43:12.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.909+0000 7f07a6ffd640 1 -- 172.21.15.167:0/2392522299 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065258817 0 0) 0x7f0798001120 con 0x7f07a8151f60 2023-11-28T20:43:12.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07a7fff640 1 --2- 172.21.15.167:0/2392522299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a806a580 0x7f07a806a990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07a80c8d80 tx=0x7f07a001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc16bd970199e0c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:12.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07a6ffd640 1 -- 172.21.15.167:0/2392522299 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a00a5740 con 0x7f07a806a580 2023-11-28T20:43:12.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07a6ffd640 1 -- 172.21.15.167:0/2392522299 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a00a58a0 con 0x7f07a806a580 2023-11-28T20:43:12.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07a6ffd640 1 -- 172.21.15.167:0/2392522299 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a00a5c30 con 0x7f07a806a580 2023-11-28T20:43:12.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 -- 172.21.15.167:0/2392522299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a806a580 msgr2=0x7f07a806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:12.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 --2- 172.21.15.167:0/2392522299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a806a580 0x7f07a806a990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07a80c8d80 tx=0x7f07a001c880 comp rx=0 tx=0).stop 2023-11-28T20:43:12.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 -- 172.21.15.167:0/2392522299 shutdown_connections 2023-11-28T20:43:12.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 --2- 172.21.15.167:0/2392522299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a806a580 0x7f07a806a990 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:12.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 --2- 172.21.15.167:0/2392522299 >> v2:172.21.15.178:3300/0 conn(0x7f07a80c75c0 0x7f07a80c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:12.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 -- 172.21.15.167:0/2392522299 >> 172.21.15.167:0/2392522299 conn(0x7f07a80cb1e0 msgr2=0x7f07a80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:12.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 -- 172.21.15.167:0/2392522299 shutdown_connections 2023-11-28T20:43:12.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 -- 172.21.15.167:0/2392522299 wait complete. 2023-11-28T20:43:12.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 Processor -- start 2023-11-28T20:43:12.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.913+0000 7f07ade9e640 1 -- start start 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07ade9e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a806a580 0x7f07a80ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07ade9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a80c75c0 0x7f07a8157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07ade9e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07a8151f60 0x7f07a813e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07ade9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a813f7b0 con 0x7f07a80c75c0 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07ade9e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8156640 con 0x7f07a806a580 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07ade9e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80ca6d0 con 0x7f07a8151f60 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f079ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a80c75c0 0x7f07a8157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f079ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a80c75c0 0x7f07a8157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46564/0 (socket says 172.21.15.167:46564) 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f079ffff640 1 -- 172.21.15.167:0/559670309 learned_addr learned my addr 172.21.15.167:0/559670309 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07a77fe640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a806a580 0x7f07a80ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:12.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07a7fff640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07a8151f60 0x7f07a813e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f079ffff640 1 -- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07a8151f60 msgr2=0x7f07a813e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f079ffff640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07a8151f60 0x7f07a813e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f079ffff640 1 -- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a806a580 msgr2=0x7f07a80ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f079ffff640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a806a580 0x7f07a80ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f079ffff640 1 -- 172.21.15.167:0/559670309 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a0009a70 con 0x7f07a80c75c0 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f079ffff640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a80c75c0 0x7f07a8157370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f079000e9b0 tx=0x7f079000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07a4ff9640 1 -- 172.21.15.167:0/559670309 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900096b0 con 0x7f07a80c75c0 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07a4ff9640 1 -- 172.21.15.167:0/559670309 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079000c9a0 con 0x7f07a80c75c0 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a8161b60 con 0x7f07a80c75c0 2023-11-28T20:43:12.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07a4ff9640 1 -- 172.21.15.167:0/559670309 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079000cd30 con 0x7f07a80c75c0 2023-11-28T20:43:12.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a8156890 con 0x7f07a80c75c0 2023-11-28T20:43:12.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a80682c0 con 0x7f07a80c75c0 2023-11-28T20:43:12.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.917+0000 7f07a4ff9640 1 -- 172.21.15.167:0/559670309 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0790013470 con 0x7f07a80c75c0 2023-11-28T20:43:12.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.921+0000 7f07a4ff9640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0788066470 0x7f0788068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:12.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.921+0000 7f07a4ff9640 1 -- 172.21.15.167:0/559670309 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f0790084690 con 0x7f07a80c75c0 2023-11-28T20:43:12.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.921+0000 7f07a77fe640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0788066470 0x7f0788068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:12.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.921+0000 7f07a77fe640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0788066470 0x7f0788068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f07980079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:12.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:12.925+0000 7f07a4ff9640 1 -- 172.21.15.167:0/559670309 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07900515d0 con 0x7f07a80c75c0 2023-11-28T20:43:13.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.129+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f07a80cbed0 con 0x7f07a80c75c0 2023-11-28T20:43:13.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.129+0000 7f07a4ff9640 1 -- 172.21.15.167:0/559670309 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f0790017620 con 0x7f07a80c75c0 2023-11-28T20:43:13.132 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:43:13.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0788066470 msgr2=0x7f0788068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0788066470 0x7f0788068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f07980079c0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a80c75c0 msgr2=0x7f07a8157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a80c75c0 0x7f07a8157370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f079000e9b0 tx=0x7f079000ee70 comp rx=0 tx=0).stop 2023-11-28T20:43:13.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 shutdown_connections 2023-11-28T20:43:13.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0788066470 0x7f0788068930 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07a8151f60 0x7f07a813e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07a80c75c0 0x7f07a8157370 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 --2- 172.21.15.167:0/559670309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a806a580 0x7f07a80ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 >> 172.21.15.167:0/559670309 conn(0x7f07a80cb1e0 msgr2=0x7f07a80c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:13.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 shutdown_connections 2023-11-28T20:43:13.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.133+0000 7f07ade9e640 1 -- 172.21.15.167:0/559670309 wait complete. 2023-11-28T20:43:13.153 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:43:13.153 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:43:13.153 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:43:13.154 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:43:13.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e7a901640 1 Processor -- start 2023-11-28T20:43:13.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e7a901640 1 -- start start 2023-11-28T20:43:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e7a901640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3e740cf860 0x7f3e740cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e7a901640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3e74153ae0 0x7f3e74153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e7a901640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7415ac00 con 0x7f3e740cfc40 2023-11-28T20:43:13.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e7a901640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740cbd60 con 0x7f3e740cf860 2023-11-28T20:43:13.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e7a901640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e74159ff0 con 0x7f3e74153ae0 2023-11-28T20:43:13.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e73fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3e740cf860 0x7f3e740cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e73fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3e740cf860 0x7f3e740cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46572/0 (socket says 172.21.15.167:46572) 2023-11-28T20:43:13.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e73fff640 1 -- 172.21.15.167:0/2677023836 learned_addr learned my addr 172.21.15.167:0/2677023836 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:13.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e78e9e640 1 --2- 172.21.15.167:0/2677023836 >> v2:172.21.15.178:3300/0 conn(0x7f3e74153ae0 0x7f3e74153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e73fff640 1 -- 172.21.15.167:0/2677023836 >> v2:172.21.15.178:3300/0 conn(0x7f3e74153ae0 msgr2=0x7f3e74153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:13.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e73fff640 1 --2- 172.21.15.167:0/2677023836 >> v2:172.21.15.178:3300/0 conn(0x7f3e74153ae0 0x7f3e74153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e73fff640 1 -- 172.21.15.167:0/2677023836 >> v1:172.21.15.178:6789/0 conn(0x7f3e740cfc40 legacy=0x7f3e740ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.325+0000 7f3e73fff640 1 -- 172.21.15.167:0/2677023836 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7415a2d0 con 0x7f3e740cf860 2023-11-28T20:43:13.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e73fff640 1 --2- 172.21.15.167:0/2677023836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e740cf860 0x7f3e740cb770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e740b2240 tx=0x7f3e6401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634992e2596fc96a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e72ffd640 1 -- 172.21.15.167:0/2677023836 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640aa660 con 0x7f3e740cf860 2023-11-28T20:43:13.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e72ffd640 1 -- 172.21.15.167:0/2677023836 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e640aa7c0 con 0x7f3e740cf860 2023-11-28T20:43:13.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e72ffd640 1 -- 172.21.15.167:0/2677023836 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640aab50 con 0x7f3e740cf860 2023-11-28T20:43:13.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e7a901640 1 -- 172.21.15.167:0/2677023836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e740cf860 msgr2=0x7f3e740cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e7a901640 1 --2- 172.21.15.167:0/2677023836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e740cf860 0x7f3e740cb770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e740b2240 tx=0x7f3e6401c500 comp rx=0 tx=0).stop 2023-11-28T20:43:13.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e7a901640 1 -- 172.21.15.167:0/2677023836 shutdown_connections 2023-11-28T20:43:13.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e7a901640 1 --2- 172.21.15.167:0/2677023836 >> v2:172.21.15.178:3300/0 conn(0x7f3e74153ae0 0x7f3e74153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e7a901640 1 --2- 172.21.15.167:0/2677023836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e740cf860 0x7f3e740cb770 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e7a901640 1 -- 172.21.15.167:0/2677023836 >> 172.21.15.167:0/2677023836 conn(0x7f3e7406c1f0 msgr2=0x7f3e74071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:13.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e7a901640 1 -- 172.21.15.167:0/2677023836 shutdown_connections 2023-11-28T20:43:13.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.329+0000 7f3e7a901640 1 -- 172.21.15.167:0/2677023836 wait complete. 2023-11-28T20:43:13.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 Processor -- start 2023-11-28T20:43:13.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 -- start start 2023-11-28T20:43:13.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e740cf860 0x7f3e74149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e740cfc40 0x7f3e74158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74153ae0 0x7f3e74158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74148d50 con 0x7f3e74153ae0 2023-11-28T20:43:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74157b10 con 0x7f3e740cfc40 2023-11-28T20:43:13.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e741580d0 con 0x7f3e740cf860 2023-11-28T20:43:13.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e78e9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74153ae0 0x7f3e74158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e740cf860 0x7f3e74149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e737fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e740cfc40 0x7f3e74158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e78e9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74153ae0 0x7f3e74158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46582/0 (socket says 172.21.15.167:46582) 2023-11-28T20:43:13.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e78e9e640 1 -- 172.21.15.167:0/2222384960 learned_addr learned my addr 172.21.15.167:0/2222384960 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:13.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e78e9e640 1 -- 172.21.15.167:0/2222384960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e740cf860 msgr2=0x7f3e74149380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e78e9e640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e740cf860 0x7f3e74149380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e78e9e640 1 -- 172.21.15.167:0/2222384960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e740cfc40 msgr2=0x7f3e74158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e78e9e640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e740cfc40 0x7f3e74158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e78e9e640 1 -- 172.21.15.167:0/2222384960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640094d0 con 0x7f3e74153ae0 2023-11-28T20:43:13.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e78e9e640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74153ae0 0x7f3e74158aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c007e70 tx=0x7f3e6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c014620 con 0x7f3e74153ae0 2023-11-28T20:43:13.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c0147a0 con 0x7f3e74153ae0 2023-11-28T20:43:13.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e740cdb90 con 0x7f3e74153ae0 2023-11-28T20:43:13.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c014b50 con 0x7f3e74153ae0 2023-11-28T20:43:13.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.333+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7414a2c0 con 0x7f3e74153ae0 2023-11-28T20:43:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e7a901640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74157c50 0x7f3e741f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74072860 con 0x7f3e74157c50 2023-11-28T20:43:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e73fff640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74157c50 0x7f3e741f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e73fff640 1 -- 172.21.15.167:0/2222384960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e740d0070 con 0x7f3e74157c50 2023-11-28T20:43:13.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e6c014cb0 con 0x7f3e74153ae0 2023-11-28T20:43:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e73fff640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74157c50 0x7f3e741f6950 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e740c9c50 tx=0x7f3e6401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e70ff9640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e60066470 0x7f3e60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f3e6c084bf0 con 0x7f3e74153ae0 2023-11-28T20:43:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640aadf0 con 0x7f3e74157c50 2023-11-28T20:43:13.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3e640bd410 con 0x7f3e74157c50 2023-11-28T20:43:13.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74157c50 msgr2=0x7f3e741f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e70ff9640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74157c50 0x7f3e741f6950 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e740c9c50 tx=0x7f3e6401ad40 comp rx=0 tx=0).stop 2023-11-28T20:43:13.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74157c50 msgr2=0x7f3e741f6950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:13.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e70ff9640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74157c50 0x7f3e741f6950 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e737fe640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e60066470 0x7f3e60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.337+0000 7f3e737fe640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e60066470 0x7f3e60068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e74159c90 tx=0x7f3e68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74166630 0x7f3e741f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74075c90 con 0x7f3e74166630 2023-11-28T20:43:13.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e73fff640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74166630 0x7f3e741f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e73fff640 1 -- 172.21.15.167:0/2222384960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3e74158210 con 0x7f3e74166630 2023-11-28T20:43:13.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e73fff640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74166630 0x7f3e741f6e90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3e64019110 tx=0x7f3e640192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640c5ad0 con 0x7f3e74166630 2023-11-28T20:43:13.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4642 (secure 0 0 0) 0x7f3e640c5300 con 0x7f3e74166630 2023-11-28T20:43:13.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74166630 msgr2=0x7f3e741f6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e70ff9640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74166630 0x7f3e741f6e90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3e64019110 tx=0x7f3e640192a0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e70ff9640 1 -- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74166630 msgr2=0x7f3e741f6e90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e70ff9640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74166630 0x7f3e741f6e90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 40, 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:13.356 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 11, 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:13.357 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:13.358 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:13.359 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:13.360 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:13.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.362 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:13.363 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.364 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.365 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:13.366 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.367 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.368 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.369 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.370 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:13.371 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:13.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e60066470 msgr2=0x7f3e60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3e60066470 0x7f3e60068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e74159c90 tx=0x7f3e68009040 comp rx=0 tx=0).stop 2023-11-28T20:43:13.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74153ae0 msgr2=0x7f3e74158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74153ae0 0x7f3e74158aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c007e70 tx=0x7f3e6c00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e78e9e640 1 -- 172.21.15.167:0/2222384960 reap_dead start 2023-11-28T20:43:13.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 shutdown_connections 2023-11-28T20:43:13.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 --2- 172.21.15.167:0/2222384960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e74153ae0 0x7f3e74158aa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 >> 172.21.15.167:0/2222384960 conn(0x7f3e7406c1f0 msgr2=0x7f3e74071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:13.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 shutdown_connections 2023-11-28T20:43:13.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.345+0000 7f3e7a901640 1 -- 172.21.15.167:0/2222384960 wait complete. 2023-11-28T20:43:13.373 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:43:13.373 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:43:13.373 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:43:13.504 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/17' 2023-11-28T20:43:13.504 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/35' 2023-11-28T20:43:13.504 INFO:tasks.workunit.client.0.smithi167.stdout:removed './157/37' 2023-11-28T20:43:13.504 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './157' 2023-11-28T20:43:13.504 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/19' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/15' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/31' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/36' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/20' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/12' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/39' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/10' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/34' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/38' 2023-11-28T20:43:13.505 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/11' 2023-11-28T20:43:13.506 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/16' 2023-11-28T20:43:13.506 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/32' 2023-11-28T20:43:13.506 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/30' 2023-11-28T20:43:13.506 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/14' 2023-11-28T20:43:13.507 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/18' 2023-11-28T20:43:13.507 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/13' 2023-11-28T20:43:13.507 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/33' 2023-11-28T20:43:13.508 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/17' 2023-11-28T20:43:13.508 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/35' 2023-11-28T20:43:13.508 INFO:tasks.workunit.client.0.smithi167.stdout:removed './158/37' 2023-11-28T20:43:13.508 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './158' 2023-11-28T20:43:13.509 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/19' 2023-11-28T20:43:13.510 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/15' 2023-11-28T20:43:13.510 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/31' 2023-11-28T20:43:13.510 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/36' 2023-11-28T20:43:13.510 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/20' 2023-11-28T20:43:13.510 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/12' 2023-11-28T20:43:13.510 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/39' 2023-11-28T20:43:13.510 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/10' 2023-11-28T20:43:13.510 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/34' 2023-11-28T20:43:13.511 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/38' 2023-11-28T20:43:13.511 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/11' 2023-11-28T20:43:13.511 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/16' 2023-11-28T20:43:13.512 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/32' 2023-11-28T20:43:13.512 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/30' 2023-11-28T20:43:13.512 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/14' 2023-11-28T20:43:13.513 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/18' 2023-11-28T20:43:13.513 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/13' 2023-11-28T20:43:13.513 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/33' 2023-11-28T20:43:13.513 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/17' 2023-11-28T20:43:13.513 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/35' 2023-11-28T20:43:13.514 INFO:tasks.workunit.client.0.smithi167.stdout:removed './159/37' 2023-11-28T20:43:13.514 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './159' 2023-11-28T20:43:13.514 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/19' 2023-11-28T20:43:13.514 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/15' 2023-11-28T20:43:13.515 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/31' 2023-11-28T20:43:13.515 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/36' 2023-11-28T20:43:13.515 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/20' 2023-11-28T20:43:13.515 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/12' 2023-11-28T20:43:13.515 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/39' 2023-11-28T20:43:13.515 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/10' 2023-11-28T20:43:13.515 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/34' 2023-11-28T20:43:13.515 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/38' 2023-11-28T20:43:13.515 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/11' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/16' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/32' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/30' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/14' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/18' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/13' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/33' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/17' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/35' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed './160/37' 2023-11-28T20:43:13.516 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './160' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/19' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/15' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/31' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/36' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/20' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/12' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/39' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/10' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/34' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/38' 2023-11-28T20:43:13.517 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/11' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/16' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/32' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/30' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/14' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/18' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/13' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/33' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/17' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/35' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed './161/37' 2023-11-28T20:43:13.518 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './161' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/19' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/15' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/31' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/36' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/20' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/12' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/39' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/10' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/34' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/38' 2023-11-28T20:43:13.519 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/11' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/16' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/32' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/30' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/14' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/18' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/13' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/33' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/17' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/35' 2023-11-28T20:43:13.520 INFO:tasks.workunit.client.0.smithi167.stdout:removed './162/37' 2023-11-28T20:43:13.521 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './162' 2023-11-28T20:43:13.521 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/19' 2023-11-28T20:43:13.521 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/15' 2023-11-28T20:43:13.521 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/31' 2023-11-28T20:43:13.521 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/36' 2023-11-28T20:43:13.522 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/20' 2023-11-28T20:43:13.522 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/12' 2023-11-28T20:43:13.522 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/39' 2023-11-28T20:43:13.522 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/10' 2023-11-28T20:43:13.523 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/34' 2023-11-28T20:43:13.523 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/38' 2023-11-28T20:43:13.523 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/11' 2023-11-28T20:43:13.523 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/16' 2023-11-28T20:43:13.523 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/32' 2023-11-28T20:43:13.523 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/30' 2023-11-28T20:43:13.523 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/14' 2023-11-28T20:43:13.523 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/18' 2023-11-28T20:43:13.523 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/13' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/33' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/17' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/35' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './163/37' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './163' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/19' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/15' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/31' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/36' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/20' 2023-11-28T20:43:13.524 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/12' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/39' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/10' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/34' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/38' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/11' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/16' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/32' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/30' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/14' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/18' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/13' 2023-11-28T20:43:13.525 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/33' 2023-11-28T20:43:13.526 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/17' 2023-11-28T20:43:13.526 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/35' 2023-11-28T20:43:13.526 INFO:tasks.workunit.client.0.smithi167.stdout:removed './164/37' 2023-11-28T20:43:13.526 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './164' 2023-11-28T20:43:13.526 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/19' 2023-11-28T20:43:13.526 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/15' 2023-11-28T20:43:13.526 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/31' 2023-11-28T20:43:13.526 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/36' 2023-11-28T20:43:13.526 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/20' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/12' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/39' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/10' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/34' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/38' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/11' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/16' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/32' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/30' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/14' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/18' 2023-11-28T20:43:13.527 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/13' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/33' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/17' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/35' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './165/37' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './165' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/19' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/15' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/31' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/36' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/20' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/12' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/39' 2023-11-28T20:43:13.528 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/10' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/34' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/38' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/11' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/16' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/32' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/30' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/14' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/18' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/13' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/33' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/17' 2023-11-28T20:43:13.529 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/35' 2023-11-28T20:43:13.530 INFO:tasks.workunit.client.0.smithi167.stdout:removed './166/37' 2023-11-28T20:43:13.530 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './166' 2023-11-28T20:43:13.530 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/19' 2023-11-28T20:43:13.530 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/15' 2023-11-28T20:43:13.530 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/31' 2023-11-28T20:43:13.530 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/36' 2023-11-28T20:43:13.530 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/20' 2023-11-28T20:43:13.530 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/12' 2023-11-28T20:43:13.531 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/39' 2023-11-28T20:43:13.531 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/10' 2023-11-28T20:43:13.531 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/34' 2023-11-28T20:43:13.531 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/38' 2023-11-28T20:43:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a7dc4640 1 Processor -- start 2023-11-28T20:43:13.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a7dc4640 1 -- start start 2023-11-28T20:43:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a7dc4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2a0151f60 0x7fc2a00c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a7dc4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006a580 0x7fc2a006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a7dc4640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a00c6120 con 0x7fc2a00c5c90 2023-11-28T20:43:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a7dc4640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a006aed0 con 0x7fc2a0151f60 2023-11-28T20:43:13.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a7dc4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00c4da0 con 0x7fc2a006a580 2023-11-28T20:43:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a5b60640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2a0151f60 0x7fc2a00c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a6361640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006a580 0x7fc2a006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a5b60640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2a0151f60 0x7fc2a00c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:45776/0 (socket says 172.21.15.167:45776) 2023-11-28T20:43:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a5b60640 1 -- 172.21.15.167:0/2538792562 learned_addr learned my addr 172.21.15.167:0/2538792562 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a5b60640 1 -- 172.21.15.167:0/2538792562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006a580 msgr2=0x7fc2a006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a5b60640 1 --2- 172.21.15.167:0/2538792562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006a580 0x7fc2a006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a5b60640 1 -- 172.21.15.167:0/2538792562 >> v1:172.21.15.178:6789/0 conn(0x7fc2a00c5c90 legacy=0x7fc2a00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.533+0000 7fc2a5b60640 1 -- 172.21.15.167:0/2538792562 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a015b220 con 0x7fc2a0151f60 2023-11-28T20:43:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a5b60640 1 --2- 172.21.15.167:0/2538792562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0151f60 0x7fc2a00c75c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009870 tx=0x7fc29c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=165b07760b21e2b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a4b5e640 1 -- 172.21.15.167:0/2538792562 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0ab600 con 0x7fc2a0151f60 2023-11-28T20:43:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a4b5e640 1 -- 172.21.15.167:0/2538792562 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c0a7050 con 0x7fc2a0151f60 2023-11-28T20:43:13.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a4b5e640 1 -- 172.21.15.167:0/2538792562 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0ab980 con 0x7fc2a0151f60 2023-11-28T20:43:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2538792562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0151f60 msgr2=0x7fc2a00c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a7dc4640 1 --2- 172.21.15.167:0/2538792562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0151f60 0x7fc2a00c75c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009870 tx=0x7fc29c01c4b0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2538792562 shutdown_connections 2023-11-28T20:43:13.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a7dc4640 1 --2- 172.21.15.167:0/2538792562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006a580 0x7fc2a006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a7dc4640 1 --2- 172.21.15.167:0/2538792562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0151f60 0x7fc2a00c75c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2538792562 >> 172.21.15.167:0/2538792562 conn(0x7fc2a00cb1e0 msgr2=0x7fc2a00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:13.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2538792562 shutdown_connections 2023-11-28T20:43:13.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.537+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2538792562 wait complete. 2023-11-28T20:43:13.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 Processor -- start 2023-11-28T20:43:13.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 -- start start 2023-11-28T20:43:13.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a006a580 0x7fc2a0141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a00c5c90 0x7fc2a01f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a0151f60 0x7fc2a0071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01614e0 con 0x7fc2a0151f60 2023-11-28T20:43:13.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0160650 con 0x7fc2a006a580 2023-11-28T20:43:13.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00c3f20 con 0x7fc2a00c5c90 2023-11-28T20:43:13.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a6361640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a0151f60 0x7fc2a0071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a6361640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a0151f60 0x7fc2a0071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46612/0 (socket says 172.21.15.167:46612) 2023-11-28T20:43:13.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a6361640 1 -- 172.21.15.167:0/2711696192 learned_addr learned my addr 172.21.15.167:0/2711696192 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:13.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a535f640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a00c5c90 0x7fc2a01f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a5b60640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a006a580 0x7fc2a0141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a6361640 1 -- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a00c5c90 msgr2=0x7fc2a01f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a6361640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a00c5c90 0x7fc2a01f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a6361640 1 -- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a006a580 msgr2=0x7fc2a0141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a6361640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a006a580 0x7fc2a0141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a6361640 1 -- 172.21.15.167:0/2711696192 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0094d0 con 0x7fc2a0151f60 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a6361640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a0151f60 0x7fc2a0071aa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc29800efc0 tx=0x7fc29800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800ced0 con 0x7fc2a0151f60 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29800f040 con 0x7fc2a0151f60 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a00717e0 con 0x7fc2a0151f60 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980146c0 con 0x7fc2a0151f60 2023-11-28T20:43:13.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.541+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a0160b40 con 0x7fc2a0151f60 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2a7dc4640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0161ea0 0x7fc2a0071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0074770 con 0x7fc2a0161ea0 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2a5b60640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0161ea0 0x7fc2a0071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2a5b60640 1 -- 172.21.15.167:0/2711696192 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2a015ba30 con 0x7fc2a0161ea0 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2a5b60640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0161ea0 0x7fc2a0071fe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c8d80 tx=0x7fc29c019250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc298014820 con 0x7fc2a0151f60 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2967fc640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc284066470 0x7fc284068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7fc298084b00 con 0x7fc2a0151f60 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0abea0 con 0x7fc2a0161ea0 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc29c0bf440 con 0x7fc2a0161ea0 2023-11-28T20:43:13.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0161ea0 msgr2=0x7fc2a0071fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2967fc640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0161ea0 0x7fc2a0071fe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c8d80 tx=0x7fc29c019250 comp rx=0 tx=0).stop 2023-11-28T20:43:13.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2a535f640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc284066470 0x7fc284068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0161ea0 msgr2=0x7fc2a0071fe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:13.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.545+0000 7fc2967fc640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0161ea0 0x7fc2a0071fe0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.549+0000 7fc2a535f640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc284066470 0x7fc284068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c8760 tx=0x7fc290009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.553+0000 7fc2a7dc4640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0160d60 0x7fc2a015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.553+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0158750 con 0x7fc2a0160d60 2023-11-28T20:43:13.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.553+0000 7fc2a5b60640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0160d60 0x7fc2a015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.553+0000 7fc2a5b60640 1 -- 172.21.15.167:0/2711696192 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc2a015bf50 con 0x7fc2a0160d60 2023-11-28T20:43:13.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.553+0000 7fc2a5b60640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0160d60 0x7fc2a015a050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc29c01ab60 tx=0x7fc29c0a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.553+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0c3040 con 0x7fc2a0160d60 2023-11-28T20:43:13.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7fc29c0bf7b0 con 0x7fc2a0160d60 2023-11-28T20:43:13.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0160d60 msgr2=0x7fc2a015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2967fc640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0160d60 0x7fc2a015a050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc29c01ab60 tx=0x7fc29c0a8000 comp rx=0 tx=0).stop 2023-11-28T20:43:13.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2967fc640 1 -- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0160d60 msgr2=0x7fc2a015a050 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:13.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2967fc640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a0160d60 0x7fc2a015a050 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc29c01ab60 tx=0x7fc29c0a8000 comp rx=0 tx=0).stop 2023-11-28T20:43:13.557 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 40, 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.558 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 11, 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:13.559 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:13.560 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:13.561 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:13.562 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.563 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:13.565 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:13.566 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:13.567 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:13.568 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:13.569 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:13.570 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.571 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 7 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:43:13.572 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:13.573 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:13.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc284066470 msgr2=0x7fc284068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a7dc4640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc284066470 0x7fc284068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c8760 tx=0x7fc290009040 comp rx=0 tx=0).stop 2023-11-28T20:43:13.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a0151f60 msgr2=0x7fc2a0071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a7dc4640 1 --2- 172.21.15.167:0/2711696192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2a0151f60 0x7fc2a0071aa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc29800efc0 tx=0x7fc29800c490 comp rx=0 tx=0).stop 2023-11-28T20:43:13.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a6361640 1 -- 172.21.15.167:0/2711696192 reap_dead start 2023-11-28T20:43:13.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a6361640 1 -- 172.21.15.167:0/2711696192 reap_dead start 2023-11-28T20:43:13.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 shutdown_connections 2023-11-28T20:43:13.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 >> 172.21.15.167:0/2711696192 conn(0x7fc2a00cb1e0 msgr2=0x7fc2a0150f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:13.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 shutdown_connections 2023-11-28T20:43:13.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.557+0000 7fc2a7dc4640 1 -- 172.21.15.167:0/2711696192 wait complete. 2023-11-28T20:43:13.576 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:43:13.576 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:43:13.576 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:43:13.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.721+0000 7f7490165640 1 Processor -- start 2023-11-28T20:43:13.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.721+0000 7f7490165640 1 -- start start 2023-11-28T20:43:13.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.721+0000 7f7490165640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f74880cb770 0x7f748815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.721+0000 7f7490165640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748815ac00 con 0x7f74880cf860 2023-11-28T20:43:13.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.721+0000 7f7490165640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74880cbd60 con 0x7f74880cfc40 2023-11-28T20:43:13.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.721+0000 7f7490165640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7488159ff0 con 0x7f74880cb770 2023-11-28T20:43:13.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.725+0000 7f748df01640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f74880cf860 0x7f74880ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57176/0 (socket says 172.21.15.167:57176) 2023-11-28T20:43:13.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.725+0000 7f748df01640 1 -- 172.21.15.167:0/2837752314 learned_addr learned my addr 172.21.15.167:0/2837752314 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:43:13.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.725+0000 7f748e702640 1 --2- 172.21.15.167:0/2837752314 >> v2:172.21.15.167:3300/0 conn(0x7f74880cb770 0x7f748815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.725+0000 7f748e702640 1 -- 172.21.15.167:0/2837752314 >> v1:172.21.15.178:6789/0 conn(0x7f74880cfc40 legacy=0x7f7488153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.725+0000 7f748e702640 1 -- 172.21.15.167:0/2837752314 >> v1:172.21.15.167:6789/0 conn(0x7f74880cf860 legacy=0x7f74880ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.725+0000 7f748e702640 1 -- 172.21.15.167:0/2837752314 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748815a2d0 con 0x7f74880cb770 2023-11-28T20:43:13.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.725+0000 7f748ceff640 1 -- 172.21.15.167:0/2837752314 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679239649 0 0) 0x7f748815ac00 con 0x7f74880cf860 2023-11-28T20:43:13.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.725+0000 7f748e702640 1 --2- 172.21.15.167:0/2837752314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 0x7f748815d4d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7480009d90 tx=0x7f748001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a276fc3dd984932 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.725+0000 7f748ceff640 1 -- 172.21.15.167:0/2837752314 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800a59e0 con 0x7f74880cb770 2023-11-28T20:43:13.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f748ceff640 1 -- 172.21.15.167:0/2837752314 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74800a5b40 con 0x7f74880cb770 2023-11-28T20:43:13.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f748ceff640 1 -- 172.21.15.167:0/2837752314 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800ad440 con 0x7f74880cb770 2023-11-28T20:43:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 -- 172.21.15.167:0/2837752314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 msgr2=0x7f748815d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 --2- 172.21.15.167:0/2837752314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 0x7f748815d4d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7480009d90 tx=0x7f748001c920 comp rx=0 tx=0).stop 2023-11-28T20:43:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 -- 172.21.15.167:0/2837752314 shutdown_connections 2023-11-28T20:43:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 --2- 172.21.15.167:0/2837752314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 0x7f748815d4d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 -- 172.21.15.167:0/2837752314 >> 172.21.15.167:0/2837752314 conn(0x7f748806c1f0 msgr2=0x7f7488071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:13.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 -- 172.21.15.167:0/2837752314 shutdown_connections 2023-11-28T20:43:13.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 -- 172.21.15.167:0/2837752314 wait complete. 2023-11-28T20:43:13.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 Processor -- start 2023-11-28T20:43:13.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 -- start start 2023-11-28T20:43:13.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 0x7f7488153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880cf860 0x7f7488141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74880cfc40 0x7f74880b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7488149270 con 0x7f74880cb770 2023-11-28T20:43:13.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7488147b20 con 0x7f74880cfc40 2023-11-28T20:43:13.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f7490165640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7488147e00 con 0x7f74880cf860 2023-11-28T20:43:13.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.729+0000 7f748df01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 0x7f7488153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748df01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 0x7f7488153220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46636/0 (socket says 172.21.15.167:46636) 2023-11-28T20:43:13.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748df01640 1 -- 172.21.15.167:0/2138977828 learned_addr learned my addr 172.21.15.167:0/2138977828 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:13.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748d700640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880cf860 0x7f7488141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748e702640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74880cfc40 0x7f74880b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748df01640 1 -- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880cf860 msgr2=0x7f7488141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748df01640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880cf860 0x7f7488141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748df01640 1 -- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74880cfc40 msgr2=0x7f74880b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748df01640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74880cfc40 0x7f74880b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748df01640 1 -- 172.21.15.167:0/2138977828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7480009a70 con 0x7f74880cb770 2023-11-28T20:43:13.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748e702640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74880cfc40 0x7f74880b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:43:13.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748df01640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 0x7f7488153220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f748400c410 tx=0x7f748400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840074e0 con 0x7f74880cb770 2023-11-28T20:43:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484007640 con 0x7f74880cb770 2023-11-28T20:43:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484004a30 con 0x7f74880cb770 2023-11-28T20:43:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74881480e0 con 0x7f74880cb770 2023-11-28T20:43:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74881486a0 con 0x7f74880cb770 2023-11-28T20:43:13.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f7490165640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880b4070 0x7f74880b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7488072860 con 0x7f74880b4070 2023-11-28T20:43:13.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748d700640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880b4070 0x7f74880b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7484004b90 con 0x7f74880cb770 2023-11-28T20:43:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748d700640 1 -- 172.21.15.167:0/2138977828 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7488159cc0 con 0x7f74880b4070 2023-11-28T20:43:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f748d700640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880b4070 0x7f74880b4ea0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7488074d50 tx=0x7f747800fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f747e7fc640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f746c0664a0 0x7f746c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f74840840b0 con 0x7f74880cb770 2023-11-28T20:43:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.733+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780050d0 con 0x7f74880b4070 2023-11-28T20:43:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.737+0000 7f748e702640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f746c0664a0 0x7f746c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.737+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7478005230 con 0x7f74880b4070 2023-11-28T20:43:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.737+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880b4070 msgr2=0x7f74880b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.737+0000 7f747e7fc640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880b4070 0x7f74880b4ea0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7488074d50 tx=0x7f747800fc00 comp rx=0 tx=0).stop 2023-11-28T20:43:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.737+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880b4070 msgr2=0x7f74880b4ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.737+0000 7f747e7fc640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74880b4070 0x7f74880b4ea0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7488074d50 tx=0x7f747800fc00 comp rx=0 tx=0).stop 2023-11-28T20:43:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.737+0000 7f748e702640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f746c0664a0 0x7f746c068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f74800af000 tx=0x7f74800a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.741+0000 7f7490165640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74881f5bf0 0x7f74881f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.741+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7488148270 con 0x7f74881f5bf0 2023-11-28T20:43:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.741+0000 7f748d700640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74881f5bf0 0x7f74881f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.741+0000 7f748d700640 1 -- 172.21.15.167:0/2138977828 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7488067c40 con 0x7f74881f5bf0 2023-11-28T20:43:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f748d700640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74881f5bf0 0x7f74881f6000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7478007000 tx=0x7f7478001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478023070 con 0x7f74881f5bf0 2023-11-28T20:43:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4640 (secure 0 0 0) 0x7f7478007650 con 0x7f74881f5bf0 2023-11-28T20:43:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74881f5bf0 msgr2=0x7f74881f6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f747e7fc640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74881f5bf0 0x7f74881f6000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7478007000 tx=0x7f7478001130 comp rx=0 tx=0).stop 2023-11-28T20:43:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f747e7fc640 1 -- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74881f5bf0 msgr2=0x7f74881f6000 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f747e7fc640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74881f5bf0 0x7f74881f6000 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.747 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:43:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 40, 2023-11-28T20:43:13.747 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:13.748 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:13.749 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:13.750 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:13.751 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:13.752 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:13.753 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:13.754 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:13.755 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:13.756 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:13.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.758 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:13.759 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:13.760 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.761 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.762 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:13.763 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:13.764 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:13.764 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:13.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f746c0664a0 msgr2=0x7f746c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f7490165640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f746c0664a0 0x7f746c068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f74800af000 tx=0x7f74800a7070 comp rx=0 tx=0).stop 2023-11-28T20:43:13.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 msgr2=0x7f7488153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f7490165640 1 --2- 172.21.15.167:0/2138977828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74880cb770 0x7f7488153220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f748400c410 tx=0x7f748400c8d0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f748e702640 1 -- 172.21.15.167:0/2138977828 reap_dead start 2023-11-28T20:43:13.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f748e702640 1 -- 172.21.15.167:0/2138977828 reap_dead start 2023-11-28T20:43:13.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 shutdown_connections 2023-11-28T20:43:13.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 >> 172.21.15.167:0/2138977828 conn(0x7f748806c1f0 msgr2=0x7f74880c5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:13.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 shutdown_connections 2023-11-28T20:43:13.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.745+0000 7f7490165640 1 -- 172.21.15.167:0/2138977828 wait complete. 2023-11-28T20:43:13.767 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:43:13.767 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2023-11-28T20:43:13.767 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:43:13.767 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2023-11-28T20:43:13.767 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:43:13.768 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T20:43:13.768 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:43:13.796 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T20:43:13.797 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:43:13.797 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:43:13.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.941+0000 7f87a27f5640 1 Processor -- start 2023-11-28T20:43:13.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.941+0000 7f87a27f5640 1 -- start start 2023-11-28T20:43:13.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a27f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f879c0c5c90 0x7f879c1635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a27f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c0c7a50 con 0x7f879c0c75c0 2023-11-28T20:43:13.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a27f5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c15b220 con 0x7f879c151f60 2023-11-28T20:43:13.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a27f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c0c4da0 con 0x7f879c0c5c90 2023-11-28T20:43:13.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f879bfff640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f879c151f60 legacy=0x7f879c0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:43:13.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a0d92640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f879c0c5c90 0x7f879c1635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a0d92640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f879c0c5c90 0x7f879c1635c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46698/0 (socket says 172.21.15.167:46698) 2023-11-28T20:43:13.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a0d92640 1 -- 172.21.15.167:0/1215008199 learned_addr learned my addr 172.21.15.167:0/1215008199 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:13.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a0d92640 1 -- 172.21.15.167:0/1215008199 >> v1:172.21.15.178:6789/0 conn(0x7f879c151f60 legacy=0x7f879c0c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:13.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a0d92640 1 -- 172.21.15.167:0/1215008199 >> v1:172.21.15.167:6789/0 conn(0x7f879c0c75c0 legacy=0x7f879c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.945+0000 7f87a0d92640 1 -- 172.21.15.167:0/1215008199 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c152340 con 0x7f879c0c5c90 2023-11-28T20:43:13.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a0d92640 1 --2- 172.21.15.167:0/1215008199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c5c90 0x7f879c1635c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8794009e50 tx=0x7f879401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26982d8207475877 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f879affd640 1 -- 172.21.15.167:0/1215008199 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940a5600 con 0x7f879c0c5c90 2023-11-28T20:43:13.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f879affd640 1 -- 172.21.15.167:0/1215008199 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87940a5760 con 0x7f879c0c5c90 2023-11-28T20:43:13.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f879affd640 1 -- 172.21.15.167:0/1215008199 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940a5af0 con 0x7f879c0c5c90 2023-11-28T20:43:13.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a27f5640 1 -- 172.21.15.167:0/1215008199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c5c90 msgr2=0x7f879c1635c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a27f5640 1 --2- 172.21.15.167:0/1215008199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c5c90 0x7f879c1635c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8794009e50 tx=0x7f879401c940 comp rx=0 tx=0).stop 2023-11-28T20:43:13.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a27f5640 1 -- 172.21.15.167:0/1215008199 shutdown_connections 2023-11-28T20:43:13.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a27f5640 1 --2- 172.21.15.167:0/1215008199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c5c90 0x7f879c1635c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a27f5640 1 -- 172.21.15.167:0/1215008199 >> 172.21.15.167:0/1215008199 conn(0x7f879c0cb1e0 msgr2=0x7f879c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:13.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a27f5640 1 -- 172.21.15.167:0/1215008199 shutdown_connections 2023-11-28T20:43:13.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a27f5640 1 -- 172.21.15.167:0/1215008199 wait complete. 2023-11-28T20:43:13.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a27f5640 1 Processor -- start 2023-11-28T20:43:13.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.949+0000 7f87a27f5640 1 -- start start 2023-11-28T20:43:13.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a27f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f879c0c5c90 0x7f879c1f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a27f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c75c0 0x7f879c145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a27f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f879c151f60 0x7f879c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a27f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c157190 con 0x7f879c0c75c0 2023-11-28T20:43:13.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a27f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c1f7000 con 0x7f879c0c5c90 2023-11-28T20:43:13.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a27f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c1f2b90 con 0x7f879c151f60 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879bfff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f879c0c5c90 msgr2=0x7f879c1f6ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f879c0c5c90 0x7f879c1f6ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c75c0 0x7f879c145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c75c0 0x7f879c145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46708/0 (socket says 172.21.15.167:46708) 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879b7fe640 1 -- 172.21.15.167:0/2451073663 learned_addr learned my addr 172.21.15.167:0/2451073663 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a0d92640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f879c151f60 0x7f879c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879b7fe640 1 -- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f879c151f60 msgr2=0x7f879c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879b7fe640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f879c151f60 0x7f879c155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879b7fe640 1 -- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f879c0c5c90 msgr2=0x7f879c1f6ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879b7fe640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f879c0c5c90 0x7f879c1f6ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879b7fe640 1 -- 172.21.15.167:0/2451073663 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794009b30 con 0x7f879c0c75c0 2023-11-28T20:43:13.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f879b7fe640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c75c0 0x7f879c145c00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f879000c500 tx=0x7f879000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f8798ff9640 1 -- 172.21.15.167:0/2451073663 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790005220 con 0x7f879c0c75c0 2023-11-28T20:43:13.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f8798ff9640 1 -- 172.21.15.167:0/2451073663 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790005380 con 0x7f879c0c75c0 2023-11-28T20:43:13.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f8798ff9640 1 -- 172.21.15.167:0/2451073663 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790007270 con 0x7f879c0c75c0 2023-11-28T20:43:13.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c1f2e30 con 0x7f879c0c75c0 2023-11-28T20:43:13.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c1f33f0 con 0x7f879c0c75c0 2023-11-28T20:43:13.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c0682c0 con 0x7f879c0c75c0 2023-11-28T20:43:13.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.953+0000 7f8798ff9640 1 -- 172.21.15.167:0/2451073663 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87900073d0 con 0x7f879c0c75c0 2023-11-28T20:43:13.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.957+0000 7f8798ff9640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8788066420 0x7f87880688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:13.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.957+0000 7f8798ff9640 1 -- 172.21.15.167:0/2451073663 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f8790083ad0 con 0x7f879c0c75c0 2023-11-28T20:43:13.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.957+0000 7f879bfff640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8788066420 0x7f87880688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:13.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.957+0000 7f879bfff640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8788066420 0x7f87880688e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f878c003940 tx=0x7f878c006d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:13.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:13.961+0000 7f8798ff9640 1 -- 172.21.15.167:0/2451073663 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8790050ab0 con 0x7f879c0c75c0 2023-11-28T20:43:14.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f879c075c90 con 0x7f879c0c75c0 2023-11-28T20:43:14.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f8798ff9640 1 -- 172.21.15.167:0/2451073663 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f87900540d0 con 0x7f879c0c75c0 2023-11-28T20:43:14.183 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:43:14.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8788066420 msgr2=0x7f87880688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:14.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8788066420 0x7f87880688e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f878c003940 tx=0x7f878c006d90 comp rx=0 tx=0).stop 2023-11-28T20:43:14.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c75c0 msgr2=0x7f879c145c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:14.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c75c0 0x7f879c145c00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f879000c500 tx=0x7f879000c9c0 comp rx=0 tx=0).stop 2023-11-28T20:43:14.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 shutdown_connections 2023-11-28T20:43:14.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8788066420 0x7f87880688e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:14.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f879c151f60 0x7f879c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:14.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f879c0c75c0 0x7f879c145c00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:14.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 --2- 172.21.15.167:0/2451073663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f879c0c5c90 0x7f879c1f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:14.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.181+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 >> 172.21.15.167:0/2451073663 conn(0x7f879c0cb1e0 msgr2=0x7f879c0c3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:14.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.185+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 shutdown_connections 2023-11-28T20:43:14.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:14.185+0000 7f87a27f5640 1 -- 172.21.15.167:0/2451073663 wait complete. 2023-11-28T20:43:15.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/11' 2023-11-28T20:43:15.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/16' 2023-11-28T20:43:15.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/32' 2023-11-28T20:43:15.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/30' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/14' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/18' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/13' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/33' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/17' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/35' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './167/37' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './167' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/19' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/15' 2023-11-28T20:43:15.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/31' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/36' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/20' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/12' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/39' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/10' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/34' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/38' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/11' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/16' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/32' 2023-11-28T20:43:15.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/30' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/14' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/18' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/13' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/33' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/17' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/35' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './168/37' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './168' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/19' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/15' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/31' 2023-11-28T20:43:15.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/36' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/20' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/12' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/39' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/10' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/34' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/38' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/11' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/16' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/32' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/30' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/14' 2023-11-28T20:43:15.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/18' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/13' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/33' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/17' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/35' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './169/37' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './169' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/19' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/15' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/31' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/36' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/20' 2023-11-28T20:43:15.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/12' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/39' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/10' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/34' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/38' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/11' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/16' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/32' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/30' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/14' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/18' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/13' 2023-11-28T20:43:15.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/33' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/17' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/35' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './170/37' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './170' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/19' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/15' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/31' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/36' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/20' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/12' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/39' 2023-11-28T20:43:15.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/10' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/34' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/38' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/11' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/16' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/32' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/30' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/14' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/18' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/13' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/33' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/17' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/35' 2023-11-28T20:43:15.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './171/37' 2023-11-28T20:43:15.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './171' 2023-11-28T20:43:15.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/19' 2023-11-28T20:43:15.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/15' 2023-11-28T20:43:15.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/31' 2023-11-28T20:43:15.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/36' 2023-11-28T20:43:15.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/20' 2023-11-28T20:43:15.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/12' 2023-11-28T20:43:15.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/39' 2023-11-28T20:43:15.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/10' 2023-11-28T20:43:15.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/34' 2023-11-28T20:43:15.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/38' 2023-11-28T20:43:15.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/11' 2023-11-28T20:43:15.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/16' 2023-11-28T20:43:15.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/32' 2023-11-28T20:43:15.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/30' 2023-11-28T20:43:15.186 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/14' 2023-11-28T20:43:15.186 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/18' 2023-11-28T20:43:15.186 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/13' 2023-11-28T20:43:15.186 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/33' 2023-11-28T20:43:15.186 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/17' 2023-11-28T20:43:15.186 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/35' 2023-11-28T20:43:15.186 INFO:tasks.workunit.client.0.smithi167.stdout:removed './172/37' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './172' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/19' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/15' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/31' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/36' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/20' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/12' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/39' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/10' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/34' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/38' 2023-11-28T20:43:15.187 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/11' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/16' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/32' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/30' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/14' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/18' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/13' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/33' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/17' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/35' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './173/37' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './173' 2023-11-28T20:43:15.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/19' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/15' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/31' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/36' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/20' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/12' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/39' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/10' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/34' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/38' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/11' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/16' 2023-11-28T20:43:15.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/32' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/30' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/14' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/18' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/13' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/33' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/17' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/35' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './174/37' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './174' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/19' 2023-11-28T20:43:15.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/15' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/31' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/36' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/20' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/12' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/39' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/10' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/34' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/38' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/11' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/16' 2023-11-28T20:43:15.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/32' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/30' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/14' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/18' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/13' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/33' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/17' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/35' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './175/37' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './175' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/19' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/15' 2023-11-28T20:43:15.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/31' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/36' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/20' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/12' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/39' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/10' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/34' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/38' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/11' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/16' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/32' 2023-11-28T20:43:15.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/30' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/14' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/18' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/13' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/33' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/17' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/35' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './176/37' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './176' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/19' 2023-11-28T20:43:15.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/15' 2023-11-28T20:43:16.763 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:16.767 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:17.204 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:43:17.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe2952c9640 1 Processor -- start 2023-11-28T20:43:17.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe2952c9640 1 -- start start 2023-11-28T20:43:17.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe2952c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe2900c97c0 0x7fe2900ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:17.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe2952c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900cae80 con 0x7fe2900ca560 2023-11-28T20:43:17.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe2952c9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900c9bf0 con 0x7fe2900c6d00 2023-11-28T20:43:17.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe2952c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900c32f0 con 0x7fe2900c97c0 2023-11-28T20:43:17.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe28f7fe640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7fe2900c6d00 legacy=0x7fe2900c7190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:43:17.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe2867fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe2900c97c0 0x7fe2900ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:17.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe2867fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe2900c97c0 0x7fe2900ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46716/0 (socket says 172.21.15.167:46716) 2023-11-28T20:43:17.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe2867fc640 1 -- 172.21.15.167:0/3885698091 learned_addr learned my addr 172.21.15.167:0/3885698091 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:17.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.341+0000 7fe28effd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe2900ca560 0x7fe2900cb0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57188/0 (socket says 172.21.15.167:57188) 2023-11-28T20:43:17.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe2867fc640 1 -- 172.21.15.167:0/3885698091 >> v1:172.21.15.178:6789/0 conn(0x7fe2900c6d00 legacy=0x7fe2900c7190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:17.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe2867fc640 1 -- 172.21.15.167:0/3885698091 >> v1:172.21.15.167:6789/0 conn(0x7fe2900ca560 legacy=0x7fe2900cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:17.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe2867fc640 1 -- 172.21.15.167:0/3885698091 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290159e60 con 0x7fe2900c97c0 2023-11-28T20:43:17.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe28e7fc640 1 -- 172.21.15.167:0/3885698091 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072969744 0 0) 0x7fe280001120 con 0x7fe2900ca560 2023-11-28T20:43:17.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe2867fc640 1 --2- 172.21.15.167:0/3885698091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c97c0 0x7fe2900ca940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe278009e50 tx=0x7fe27801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e988f78b9847b282 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:17.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe28e7fc640 1 -- 172.21.15.167:0/3885698091 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2780a5660 con 0x7fe2900c97c0 2023-11-28T20:43:17.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe28e7fc640 1 -- 172.21.15.167:0/3885698091 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2780a57c0 con 0x7fe2900c97c0 2023-11-28T20:43:17.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe28e7fc640 1 -- 172.21.15.167:0/3885698091 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2780a5b50 con 0x7fe2900c97c0 2023-11-28T20:43:17.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe2952c9640 1 -- 172.21.15.167:0/3885698091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c97c0 msgr2=0x7fe2900ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:17.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe2952c9640 1 --2- 172.21.15.167:0/3885698091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c97c0 0x7fe2900ca940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe278009e50 tx=0x7fe27801c8b0 comp rx=0 tx=0).stop 2023-11-28T20:43:17.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.345+0000 7fe2952c9640 1 -- 172.21.15.167:0/3885698091 shutdown_connections 2023-11-28T20:43:17.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 --2- 172.21.15.167:0/3885698091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c97c0 0x7fe2900ca940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:17.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 -- 172.21.15.167:0/3885698091 >> 172.21.15.167:0/3885698091 conn(0x7fe29006a580 msgr2=0x7fe29006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:17.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 -- 172.21.15.167:0/3885698091 shutdown_connections 2023-11-28T20:43:17.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 -- 172.21.15.167:0/3885698091 wait complete. 2023-11-28T20:43:17.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 Processor -- start 2023-11-28T20:43:17.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 -- start start 2023-11-28T20:43:17.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c6d00 0x7fe2901565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:17.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900c97c0 0x7fe290156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900ca560 0x7fe29014bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290147950 con 0x7fe2900c6d00 2023-11-28T20:43:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c2790 con 0x7fe2900c97c0 2023-11-28T20:43:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29014cb80 con 0x7fe2900ca560 2023-11-28T20:43:17.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2867fc640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900c97c0 msgr2=0x7fe290156b10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:17.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2867fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900c97c0 0x7fe290156b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:17.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c6d00 0x7fe2901565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:17.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c6d00 0x7fe2901565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46722/0 (socket says 172.21.15.167:46722) 2023-11-28T20:43:17.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28effd640 1 -- 172.21.15.167:0/3679591438 learned_addr learned my addr 172.21.15.167:0/3679591438 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:17.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28f7fe640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900ca560 0x7fe29014bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:17.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28effd640 1 -- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900ca560 msgr2=0x7fe29014bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:17.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28effd640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900ca560 0x7fe29014bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:17.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28effd640 1 -- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900c97c0 msgr2=0x7fe290156b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:43:17.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28effd640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900c97c0 0x7fe290156b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28effd640 1 -- 172.21.15.167:0/3679591438 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278009b30 con 0x7fe2900c6d00 2023-11-28T20:43:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe28effd640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c6d00 0x7fe2901565d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c4b0 tx=0x7fe28000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe287fff640 1 -- 172.21.15.167:0/3679591438 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800074e0 con 0x7fe2900c6d00 2023-11-28T20:43:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe287fff640 1 -- 172.21.15.167:0/3679591438 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280007660 con 0x7fe2900c6d00 2023-11-28T20:43:17.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.349+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2900c69f0 con 0x7fe2900c6d00 2023-11-28T20:43:17.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.353+0000 7fe287fff640 1 -- 172.21.15.167:0/3679591438 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280004a30 con 0x7fe2900c6d00 2023-11-28T20:43:17.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.353+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2901f6d10 con 0x7fe2900c6d00 2023-11-28T20:43:17.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.353+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe290067c40 con 0x7fe2900c6d00 2023-11-28T20:43:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.353+0000 7fe287fff640 1 -- 172.21.15.167:0/3679591438 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe280004b90 con 0x7fe2900c6d00 2023-11-28T20:43:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.353+0000 7fe287fff640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe270066450 0x7fe270068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.353+0000 7fe287fff640 1 -- 172.21.15.167:0/3679591438 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7fe280083510 con 0x7fe2900c6d00 2023-11-28T20:43:17.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.353+0000 7fe2867fc640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe270066450 0x7fe270068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.357+0000 7fe2867fc640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe270066450 0x7fe270068910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2780ae000 tx=0x7fe2780a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:17.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.357+0000 7fe287fff640 1 -- 172.21.15.167:0/3679591438 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe280050610 con 0x7fe2900c6d00 2023-11-28T20:43:17.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.561+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe2900cae80 con 0x7fe2900c6d00 2023-11-28T20:43:17.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe287fff640 1 -- 172.21.15.167:0/3679591438 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fe280018620 con 0x7fe2900c6d00 2023-11-28T20:43:17.565 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:43:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe270066450 msgr2=0x7fe270068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe270066450 0x7fe270068910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2780ae000 tx=0x7fe2780a7070 comp rx=0 tx=0).stop 2023-11-28T20:43:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c6d00 msgr2=0x7fe2901565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c6d00 0x7fe2901565d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c4b0 tx=0x7fe28000c970 comp rx=0 tx=0).stop 2023-11-28T20:43:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 shutdown_connections 2023-11-28T20:43:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe270066450 0x7fe270068910 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900ca560 0x7fe29014bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:17.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900c97c0 0x7fe290156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:17.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 --2- 172.21.15.167:0/3679591438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2900c6d00 0x7fe2901565d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:17.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 >> 172.21.15.167:0/3679591438 conn(0x7fe29006a580 msgr2=0x7fe29006ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:17.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 shutdown_connections 2023-11-28T20:43:17.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:17.565+0000 7fe2952c9640 1 -- 172.21.15.167:0/3679591438 wait complete. 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/31' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/36' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/20' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/12' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/39' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/10' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/34' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/38' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/11' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/16' 2023-11-28T20:43:18.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/32' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/30' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/14' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/18' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/13' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/33' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/17' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/35' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './177/37' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './177' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/19' 2023-11-28T20:43:18.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/15' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/31' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/36' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/20' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/12' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/39' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/10' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/34' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/38' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/11' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/16' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/32' 2023-11-28T20:43:18.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/30' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/14' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/18' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/13' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/33' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/17' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/35' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './178/37' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './178' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/19' 2023-11-28T20:43:18.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/15' 2023-11-28T20:43:18.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/31' 2023-11-28T20:43:18.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/36' 2023-11-28T20:43:18.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/20' 2023-11-28T20:43:18.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/12' 2023-11-28T20:43:18.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/39' 2023-11-28T20:43:18.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/10' 2023-11-28T20:43:18.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/34' 2023-11-28T20:43:18.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/38' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/11' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/16' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/32' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/30' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/14' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/18' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/13' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/33' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/17' 2023-11-28T20:43:18.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/35' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './179/37' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './179' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/19' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/15' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/31' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/36' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/20' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/12' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/39' 2023-11-28T20:43:18.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/10' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/34' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/38' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/11' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/16' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/32' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/30' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/14' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/18' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/13' 2023-11-28T20:43:18.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/33' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/17' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/35' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './180/37' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './180' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/19' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/15' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/31' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/36' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/20' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/12' 2023-11-28T20:43:18.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/39' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/10' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/34' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/38' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/11' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/16' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/32' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/30' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/14' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/18' 2023-11-28T20:43:18.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/13' 2023-11-28T20:43:18.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/33' 2023-11-28T20:43:18.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/17' 2023-11-28T20:43:18.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/35' 2023-11-28T20:43:18.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './181/37' 2023-11-28T20:43:18.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './181' 2023-11-28T20:43:18.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/19' 2023-11-28T20:43:18.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/15' 2023-11-28T20:43:18.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/31' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/36' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/20' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/12' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/39' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/10' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/34' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/38' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/11' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/16' 2023-11-28T20:43:18.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/32' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/30' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/14' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/18' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/13' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/33' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/17' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/35' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './182/37' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './182' 2023-11-28T20:43:18.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/19' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/15' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/31' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/36' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/20' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/12' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/39' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/10' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/34' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/38' 2023-11-28T20:43:18.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/11' 2023-11-28T20:43:18.249 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/16' 2023-11-28T20:43:18.249 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/32' 2023-11-28T20:43:18.249 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/30' 2023-11-28T20:43:18.249 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/14' 2023-11-28T20:43:18.249 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/18' 2023-11-28T20:43:18.249 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/13' 2023-11-28T20:43:18.249 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/33' 2023-11-28T20:43:18.249 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/17' 2023-11-28T20:43:18.249 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/35' 2023-11-28T20:43:18.250 INFO:tasks.workunit.client.0.smithi167.stdout:removed './183/37' 2023-11-28T20:43:18.250 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './183' 2023-11-28T20:43:18.250 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/19' 2023-11-28T20:43:18.250 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/15' 2023-11-28T20:43:18.250 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/31' 2023-11-28T20:43:18.251 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/36' 2023-11-28T20:43:18.251 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/20' 2023-11-28T20:43:18.251 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/12' 2023-11-28T20:43:18.251 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/39' 2023-11-28T20:43:18.252 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/10' 2023-11-28T20:43:18.252 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/34' 2023-11-28T20:43:18.252 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/38' 2023-11-28T20:43:18.253 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/11' 2023-11-28T20:43:18.253 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/16' 2023-11-28T20:43:18.254 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/32' 2023-11-28T20:43:18.254 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/30' 2023-11-28T20:43:18.254 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/14' 2023-11-28T20:43:18.255 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/18' 2023-11-28T20:43:18.255 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/13' 2023-11-28T20:43:18.255 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/33' 2023-11-28T20:43:18.256 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/17' 2023-11-28T20:43:18.256 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/35' 2023-11-28T20:43:18.256 INFO:tasks.workunit.client.0.smithi167.stdout:removed './184/37' 2023-11-28T20:43:18.256 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './184' 2023-11-28T20:43:18.256 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/19' 2023-11-28T20:43:18.257 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/15' 2023-11-28T20:43:18.257 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/31' 2023-11-28T20:43:18.257 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/36' 2023-11-28T20:43:18.257 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/20' 2023-11-28T20:43:18.258 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/12' 2023-11-28T20:43:18.258 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/39' 2023-11-28T20:43:18.259 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/10' 2023-11-28T20:43:18.260 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/34' 2023-11-28T20:43:18.260 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/38' 2023-11-28T20:43:18.260 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/11' 2023-11-28T20:43:18.260 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/16' 2023-11-28T20:43:18.261 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/32' 2023-11-28T20:43:18.261 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/30' 2023-11-28T20:43:18.261 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/14' 2023-11-28T20:43:18.261 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/18' 2023-11-28T20:43:18.261 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/13' 2023-11-28T20:43:18.261 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/33' 2023-11-28T20:43:18.261 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/17' 2023-11-28T20:43:18.261 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/35' 2023-11-28T20:43:18.261 INFO:tasks.workunit.client.0.smithi167.stdout:removed './185/37' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './185' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/19' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/15' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/31' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/36' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/20' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/12' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/39' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/10' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/34' 2023-11-28T20:43:18.262 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/38' 2023-11-28T20:43:18.263 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/11' 2023-11-28T20:43:18.263 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/16' 2023-11-28T20:43:18.263 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/32' 2023-11-28T20:43:18.263 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/30' 2023-11-28T20:43:18.263 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/14' 2023-11-28T20:43:18.263 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/18' 2023-11-28T20:43:20.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:43:20.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc721e91640 1 Processor -- start 2023-11-28T20:43:20.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc721e91640 1 -- start start 2023-11-28T20:43:20.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc721e91640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc71c150b40 0x7fc71c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:20.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc721e91640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc71c0c6ff0 0x7fc71c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:20.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc721e91640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71c0c6ac0 con 0x7fc71c0c5be0 2023-11-28T20:43:20.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc721e91640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71c0c6500 con 0x7fc71c150b40 2023-11-28T20:43:20.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc721e91640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71c0c67e0 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71affd640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7fc71c0c6ff0 msgr2=0x7fc71c0c4510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:20.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71bfff640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7fc71c0c5be0 legacy=0x7fc71c06a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:43:20.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71affd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc71c0c6ff0 0x7fc71c0c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:20.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc71c150b40 0x7fc71c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:20.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc71c150b40 0x7fc71c157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46730/0 (socket says 172.21.15.167:46730) 2023-11-28T20:43:20.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71b7fe640 1 -- 172.21.15.167:0/1006338392 learned_addr learned my addr 172.21.15.167:0/1006338392 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:20.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71b7fe640 1 -- 172.21.15.167:0/1006338392 >> v2:172.21.15.178:3300/0 conn(0x7fc71c0c6ff0 msgr2=0x7fc71c0c4510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:20.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71b7fe640 1 --2- 172.21.15.167:0/1006338392 >> v2:172.21.15.178:3300/0 conn(0x7fc71c0c6ff0 0x7fc71c0c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:20.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71b7fe640 1 -- 172.21.15.167:0/1006338392 >> v1:172.21.15.178:6789/0 conn(0x7fc71c0c5be0 legacy=0x7fc71c06a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:20.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.729+0000 7fc71b7fe640 1 -- 172.21.15.167:0/1006338392 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c156a80 con 0x7fc71c150b40 2023-11-28T20:43:20.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc71b7fe640 1 --2- 172.21.15.167:0/1006338392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c150b40 0x7fc71c157560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc71c0cc090 tx=0x7fc70c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dc47d58871be9d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:20.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc71a7fc640 1 -- 172.21.15.167:0/1006338392 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c0aa610 con 0x7fc71c150b40 2023-11-28T20:43:20.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc71a7fc640 1 -- 172.21.15.167:0/1006338392 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70c0a6040 con 0x7fc71c150b40 2023-11-28T20:43:20.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc71a7fc640 1 -- 172.21.15.167:0/1006338392 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c0aa990 con 0x7fc71c150b40 2023-11-28T20:43:20.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc721e91640 1 -- 172.21.15.167:0/1006338392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c150b40 msgr2=0x7fc71c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:20.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc721e91640 1 --2- 172.21.15.167:0/1006338392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c150b40 0x7fc71c157560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc71c0cc090 tx=0x7fc70c01c4b0 comp rx=0 tx=0).stop 2023-11-28T20:43:20.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc721e91640 1 -- 172.21.15.167:0/1006338392 shutdown_connections 2023-11-28T20:43:20.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc721e91640 1 --2- 172.21.15.167:0/1006338392 >> v2:172.21.15.178:3300/0 conn(0x7fc71c0c6ff0 0x7fc71c0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:20.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc721e91640 1 --2- 172.21.15.167:0/1006338392 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c150b40 0x7fc71c157560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:20.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc721e91640 1 -- 172.21.15.167:0/1006338392 >> 172.21.15.167:0/1006338392 conn(0x7fc71c0cb1e0 msgr2=0x7fc71c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:20.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc721e91640 1 -- 172.21.15.167:0/1006338392 shutdown_connections 2023-11-28T20:43:20.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.733+0000 7fc721e91640 1 -- 172.21.15.167:0/1006338392 wait complete. 2023-11-28T20:43:20.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 Processor -- start 2023-11-28T20:43:20.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 -- start start 2023-11-28T20:43:20.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc71c0c5be0 0x7fc71c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:20.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c0c6ff0 0x7fc71c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:20.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc71c150b40 0x7fc71c154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:20.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c156600 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c155500 con 0x7fc71c150b40 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c15a7d0 con 0x7fc71c0c5be0 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71bfff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc71c150b40 msgr2=0x7fc71c154fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c0c6ff0 0x7fc71c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc71c150b40 0x7fc71c154fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c0c6ff0 0x7fc71c154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46742/0 (socket says 172.21.15.167:46742) 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71affd640 1 -- 172.21.15.167:0/175386133 learned_addr learned my addr 172.21.15.167:0/175386133 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71b7fe640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc71c0c5be0 0x7fc71c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71affd640 1 -- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc71c0c5be0 msgr2=0x7fc71c153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71affd640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc71c0c5be0 0x7fc71c153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71affd640 1 -- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc71c150b40 msgr2=0x7fc71c154fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71affd640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc71c150b40 0x7fc71c154fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:20.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71affd640 1 -- 172.21.15.167:0/175386133 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c0094d0 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc71affd640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c0c6ff0 0x7fc71c154a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc71000b560 tx=0x7fc71000ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:20.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc703fff640 1 -- 172.21.15.167:0/175386133 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710003dd0 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc703fff640 1 -- 172.21.15.167:0/175386133 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc710005070 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc703fff640 1 -- 172.21.15.167:0/175386133 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710005420 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71c1f2e70 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.737+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71c1f3150 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.741+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71c0682c0 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.741+0000 7fc703fff640 1 -- 172.21.15.167:0/175386133 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc710005580 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.741+0000 7fc703fff640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc708066420 0x7fc7080688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:20.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.741+0000 7fc703fff640 1 -- 172.21.15.167:0/175386133 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7fc710084340 con 0x7fc71c0c6ff0 2023-11-28T20:43:20.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.741+0000 7fc71b7fe640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc708066420 0x7fc7080688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:20.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.741+0000 7fc71b7fe640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc708066420 0x7fc7080688e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0ae000 tx=0x7fc70c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:20.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:20.745+0000 7fc703fff640 1 -- 172.21.15.167:0/175386133 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc710051310 con 0x7fc71c0c6ff0 2023-11-28T20:43:21.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/13' 2023-11-28T20:43:21.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/33' 2023-11-28T20:43:21.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/17' 2023-11-28T20:43:21.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/35' 2023-11-28T20:43:21.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './186/37' 2023-11-28T20:43:21.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './186' 2023-11-28T20:43:21.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/19' 2023-11-28T20:43:21.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/15' 2023-11-28T20:43:21.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/31' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/36' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/20' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/12' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/39' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/10' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/34' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/38' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/11' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/16' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/32' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/30' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/14' 2023-11-28T20:43:21.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/18' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/13' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/33' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/17' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/35' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './187/37' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './187' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/19' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/15' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/31' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/36' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/20' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/12' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/39' 2023-11-28T20:43:21.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/10' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/34' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/38' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/11' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/16' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/32' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/30' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/14' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/18' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/13' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/33' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/17' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/35' 2023-11-28T20:43:21.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './188/37' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './188' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/19' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/15' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/31' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/36' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/20' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/12' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/39' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/10' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/34' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/38' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/11' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/16' 2023-11-28T20:43:21.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/32' 2023-11-28T20:43:21.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/30' 2023-11-28T20:43:21.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/14' 2023-11-28T20:43:21.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/18' 2023-11-28T20:43:21.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/13' 2023-11-28T20:43:21.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/33' 2023-11-28T20:43:21.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/17' 2023-11-28T20:43:21.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/35' 2023-11-28T20:43:21.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './189/37' 2023-11-28T20:43:21.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './189' 2023-11-28T20:43:21.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/19' 2023-11-28T20:43:21.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/15' 2023-11-28T20:43:21.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/31' 2023-11-28T20:43:21.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/36' 2023-11-28T20:43:21.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/20' 2023-11-28T20:43:21.040 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/12' 2023-11-28T20:43:21.040 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/39' 2023-11-28T20:43:21.040 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/10' 2023-11-28T20:43:21.041 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/34' 2023-11-28T20:43:21.041 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/38' 2023-11-28T20:43:21.041 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/11' 2023-11-28T20:43:21.041 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/16' 2023-11-28T20:43:21.041 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/32' 2023-11-28T20:43:21.042 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/30' 2023-11-28T20:43:21.042 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/14' 2023-11-28T20:43:21.042 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/18' 2023-11-28T20:43:21.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/13' 2023-11-28T20:43:21.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/33' 2023-11-28T20:43:21.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/17' 2023-11-28T20:43:21.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/35' 2023-11-28T20:43:21.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed './190/37' 2023-11-28T20:43:21.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './190' 2023-11-28T20:43:21.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/19' 2023-11-28T20:43:21.045 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/15' 2023-11-28T20:43:21.045 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/31' 2023-11-28T20:43:21.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/36' 2023-11-28T20:43:21.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/20' 2023-11-28T20:43:21.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/12' 2023-11-28T20:43:21.047 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/39' 2023-11-28T20:43:21.047 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/10' 2023-11-28T20:43:21.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/34' 2023-11-28T20:43:21.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/38' 2023-11-28T20:43:21.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/11' 2023-11-28T20:43:21.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/16' 2023-11-28T20:43:21.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/32' 2023-11-28T20:43:21.050 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/30' 2023-11-28T20:43:21.050 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/14' 2023-11-28T20:43:21.050 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/18' 2023-11-28T20:43:21.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/13' 2023-11-28T20:43:21.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/33' 2023-11-28T20:43:21.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/17' 2023-11-28T20:43:21.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/35' 2023-11-28T20:43:21.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed './191/37' 2023-11-28T20:43:21.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './191' 2023-11-28T20:43:21.053 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/19' 2023-11-28T20:43:21.053 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/15' 2023-11-28T20:43:21.053 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/31' 2023-11-28T20:43:21.054 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/36' 2023-11-28T20:43:21.054 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/20' 2023-11-28T20:43:21.054 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/12' 2023-11-28T20:43:21.055 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/39' 2023-11-28T20:43:21.055 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/10' 2023-11-28T20:43:21.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/34' 2023-11-28T20:43:21.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/38' 2023-11-28T20:43:21.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/11' 2023-11-28T20:43:21.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/16' 2023-11-28T20:43:21.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/32' 2023-11-28T20:43:21.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/30' 2023-11-28T20:43:21.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/14' 2023-11-28T20:43:21.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/18' 2023-11-28T20:43:21.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/13' 2023-11-28T20:43:21.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/33' 2023-11-28T20:43:21.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/17' 2023-11-28T20:43:21.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/35' 2023-11-28T20:43:21.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './192/37' 2023-11-28T20:43:21.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './192' 2023-11-28T20:43:21.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/19' 2023-11-28T20:43:21.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/15' 2023-11-28T20:43:21.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/31' 2023-11-28T20:43:21.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/36' 2023-11-28T20:43:21.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/20' 2023-11-28T20:43:21.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/12' 2023-11-28T20:43:21.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/39' 2023-11-28T20:43:21.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/10' 2023-11-28T20:43:21.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/34' 2023-11-28T20:43:21.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/38' 2023-11-28T20:43:21.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/11' 2023-11-28T20:43:21.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/16' 2023-11-28T20:43:21.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/32' 2023-11-28T20:43:21.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/30' 2023-11-28T20:43:21.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/14' 2023-11-28T20:43:21.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/18' 2023-11-28T20:43:21.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/13' 2023-11-28T20:43:21.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/33' 2023-11-28T20:43:21.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/17' 2023-11-28T20:43:21.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/35' 2023-11-28T20:43:21.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './193/37' 2023-11-28T20:43:21.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './193' 2023-11-28T20:43:21.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/19' 2023-11-28T20:43:21.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/15' 2023-11-28T20:43:21.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/31' 2023-11-28T20:43:21.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/36' 2023-11-28T20:43:21.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/20' 2023-11-28T20:43:21.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/12' 2023-11-28T20:43:21.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/39' 2023-11-28T20:43:21.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/10' 2023-11-28T20:43:21.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/34' 2023-11-28T20:43:21.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/38' 2023-11-28T20:43:21.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/11' 2023-11-28T20:43:21.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/16' 2023-11-28T20:43:21.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/32' 2023-11-28T20:43:21.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/30' 2023-11-28T20:43:21.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/14' 2023-11-28T20:43:21.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/18' 2023-11-28T20:43:21.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/13' 2023-11-28T20:43:21.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/33' 2023-11-28T20:43:21.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/17' 2023-11-28T20:43:21.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/35' 2023-11-28T20:43:21.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed './194/37' 2023-11-28T20:43:21.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './194' 2023-11-28T20:43:21.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/19' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/15' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/31' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/36' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/20' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/12' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/39' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/10' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/34' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/38' 2023-11-28T20:43:21.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/11' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/16' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/32' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/30' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/14' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/18' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/13' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/33' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/17' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/35' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './195/37' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './195' 2023-11-28T20:43:21.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/19' 2023-11-28T20:43:21.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/15' 2023-11-28T20:43:21.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/31' 2023-11-28T20:43:21.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/36' 2023-11-28T20:43:21.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/20' 2023-11-28T20:43:21.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/12' 2023-11-28T20:43:21.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/39' 2023-11-28T20:43:21.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/10' 2023-11-28T20:43:21.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.105+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc71c075c90 con 0x7fc71c0c6ff0 2023-11-28T20:43:21.109 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:43:21.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.105+0000 7fc703fff640 1 -- 172.21.15.167:0/175386133 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fc710059e60 con 0x7fc71c0c6ff0 2023-11-28T20:43:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc708066420 msgr2=0x7fc7080688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc708066420 0x7fc7080688e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0ae000 tx=0x7fc70c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:43:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c0c6ff0 msgr2=0x7fc71c154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c0c6ff0 0x7fc71c154a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc71000b560 tx=0x7fc71000ba20 comp rx=0 tx=0).stop 2023-11-28T20:43:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 shutdown_connections 2023-11-28T20:43:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc708066420 0x7fc7080688e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc71c150b40 0x7fc71c154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c0c6ff0 0x7fc71c154a80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 --2- 172.21.15.167:0/175386133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc71c0c5be0 0x7fc71c153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.109+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 >> 172.21.15.167:0/175386133 conn(0x7fc71c0cb1e0 msgr2=0x7fc71c070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.113+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 shutdown_connections 2023-11-28T20:43:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:21.113+0000 7fc721e91640 1 -- 172.21.15.167:0/175386133 wait complete. 2023-11-28T20:43:24.041 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/34' 2023-11-28T20:43:24.042 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/38' 2023-11-28T20:43:24.042 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/11' 2023-11-28T20:43:24.042 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/16' 2023-11-28T20:43:24.042 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/32' 2023-11-28T20:43:24.042 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/30' 2023-11-28T20:43:24.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/14' 2023-11-28T20:43:24.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/18' 2023-11-28T20:43:24.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/13' 2023-11-28T20:43:24.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/33' 2023-11-28T20:43:24.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/17' 2023-11-28T20:43:24.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/35' 2023-11-28T20:43:24.043 INFO:tasks.workunit.client.0.smithi167.stdout:removed './196/37' 2023-11-28T20:43:24.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './196' 2023-11-28T20:43:24.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/19' 2023-11-28T20:43:24.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/15' 2023-11-28T20:43:24.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/31' 2023-11-28T20:43:24.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/36' 2023-11-28T20:43:24.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/20' 2023-11-28T20:43:24.044 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/12' 2023-11-28T20:43:24.045 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/39' 2023-11-28T20:43:24.045 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/10' 2023-11-28T20:43:24.045 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/34' 2023-11-28T20:43:24.045 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/38' 2023-11-28T20:43:24.045 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/11' 2023-11-28T20:43:24.045 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/16' 2023-11-28T20:43:24.045 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/32' 2023-11-28T20:43:24.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/30' 2023-11-28T20:43:24.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/14' 2023-11-28T20:43:24.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/18' 2023-11-28T20:43:24.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/13' 2023-11-28T20:43:24.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/33' 2023-11-28T20:43:24.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/17' 2023-11-28T20:43:24.046 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/35' 2023-11-28T20:43:24.047 INFO:tasks.workunit.client.0.smithi167.stdout:removed './197/37' 2023-11-28T20:43:24.047 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './197' 2023-11-28T20:43:24.047 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/19' 2023-11-28T20:43:24.047 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/15' 2023-11-28T20:43:24.047 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/31' 2023-11-28T20:43:24.047 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/36' 2023-11-28T20:43:24.047 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/20' 2023-11-28T20:43:24.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/12' 2023-11-28T20:43:24.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/39' 2023-11-28T20:43:24.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/10' 2023-11-28T20:43:24.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/34' 2023-11-28T20:43:24.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/38' 2023-11-28T20:43:24.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/11' 2023-11-28T20:43:24.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/16' 2023-11-28T20:43:24.048 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/32' 2023-11-28T20:43:24.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/30' 2023-11-28T20:43:24.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/14' 2023-11-28T20:43:24.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/18' 2023-11-28T20:43:24.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/13' 2023-11-28T20:43:24.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/33' 2023-11-28T20:43:24.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/17' 2023-11-28T20:43:24.049 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/35' 2023-11-28T20:43:24.050 INFO:tasks.workunit.client.0.smithi167.stdout:removed './198/37' 2023-11-28T20:43:24.050 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './198' 2023-11-28T20:43:24.050 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/19' 2023-11-28T20:43:24.050 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/15' 2023-11-28T20:43:24.050 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/31' 2023-11-28T20:43:24.050 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/36' 2023-11-28T20:43:24.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/20' 2023-11-28T20:43:24.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/12' 2023-11-28T20:43:24.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/39' 2023-11-28T20:43:24.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/10' 2023-11-28T20:43:24.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/34' 2023-11-28T20:43:24.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/38' 2023-11-28T20:43:24.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/11' 2023-11-28T20:43:24.051 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/16' 2023-11-28T20:43:24.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/32' 2023-11-28T20:43:24.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/30' 2023-11-28T20:43:24.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/14' 2023-11-28T20:43:24.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/18' 2023-11-28T20:43:24.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/13' 2023-11-28T20:43:24.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/33' 2023-11-28T20:43:24.052 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/17' 2023-11-28T20:43:24.053 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/35' 2023-11-28T20:43:24.053 INFO:tasks.workunit.client.0.smithi167.stdout:removed './199/37' 2023-11-28T20:43:24.053 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './199' 2023-11-28T20:43:24.053 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/21' 2023-11-28T20:43:24.053 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/27' 2023-11-28T20:43:24.053 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/31' 2023-11-28T20:43:24.054 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/36' 2023-11-28T20:43:24.054 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/20' 2023-11-28T20:43:24.054 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/39' 2023-11-28T20:43:24.054 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/34' 2023-11-28T20:43:24.054 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/38' 2023-11-28T20:43:24.055 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/28' 2023-11-28T20:43:24.055 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/24' 2023-11-28T20:43:24.055 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/29' 2023-11-28T20:43:24.055 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/32' 2023-11-28T20:43:24.055 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/22' 2023-11-28T20:43:24.055 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/25' 2023-11-28T20:43:24.055 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/30' 2023-11-28T20:43:24.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/33' 2023-11-28T20:43:24.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/23' 2023-11-28T20:43:24.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/35' 2023-11-28T20:43:24.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/26' 2023-11-28T20:43:24.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed './200/37' 2023-11-28T20:43:24.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './200' 2023-11-28T20:43:24.056 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/21' 2023-11-28T20:43:24.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/27' 2023-11-28T20:43:24.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/31' 2023-11-28T20:43:24.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/36' 2023-11-28T20:43:24.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/20' 2023-11-28T20:43:24.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/39' 2023-11-28T20:43:24.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/34' 2023-11-28T20:43:24.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/38' 2023-11-28T20:43:24.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/28' 2023-11-28T20:43:24.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/24' 2023-11-28T20:43:24.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/29' 2023-11-28T20:43:24.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/32' 2023-11-28T20:43:24.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/22' 2023-11-28T20:43:24.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/25' 2023-11-28T20:43:24.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/30' 2023-11-28T20:43:24.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/33' 2023-11-28T20:43:24.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/23' 2023-11-28T20:43:24.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/35' 2023-11-28T20:43:24.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/26' 2023-11-28T20:43:24.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './201/37' 2023-11-28T20:43:24.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './201' 2023-11-28T20:43:24.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/21' 2023-11-28T20:43:24.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/27' 2023-11-28T20:43:24.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/31' 2023-11-28T20:43:24.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/36' 2023-11-28T20:43:24.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/20' 2023-11-28T20:43:24.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/39' 2023-11-28T20:43:24.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/34' 2023-11-28T20:43:24.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/38' 2023-11-28T20:43:24.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/28' 2023-11-28T20:43:24.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/24' 2023-11-28T20:43:24.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/29' 2023-11-28T20:43:24.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/32' 2023-11-28T20:43:24.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/22' 2023-11-28T20:43:24.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/25' 2023-11-28T20:43:24.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/30' 2023-11-28T20:43:24.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/33' 2023-11-28T20:43:24.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/23' 2023-11-28T20:43:24.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/35' 2023-11-28T20:43:24.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/26' 2023-11-28T20:43:24.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './202/37' 2023-11-28T20:43:24.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './202' 2023-11-28T20:43:24.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/21' 2023-11-28T20:43:24.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/27' 2023-11-28T20:43:24.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/31' 2023-11-28T20:43:24.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/36' 2023-11-28T20:43:24.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/20' 2023-11-28T20:43:24.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/39' 2023-11-28T20:43:24.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/34' 2023-11-28T20:43:24.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/38' 2023-11-28T20:43:24.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/28' 2023-11-28T20:43:24.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/24' 2023-11-28T20:43:24.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/29' 2023-11-28T20:43:24.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/32' 2023-11-28T20:43:24.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/22' 2023-11-28T20:43:24.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/25' 2023-11-28T20:43:24.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/30' 2023-11-28T20:43:24.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/33' 2023-11-28T20:43:24.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/23' 2023-11-28T20:43:24.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/35' 2023-11-28T20:43:24.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/26' 2023-11-28T20:43:24.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './203/37' 2023-11-28T20:43:24.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './203' 2023-11-28T20:43:24.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/21' 2023-11-28T20:43:24.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/27' 2023-11-28T20:43:24.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/31' 2023-11-28T20:43:24.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/36' 2023-11-28T20:43:24.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/20' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/39' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/34' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/38' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/28' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/24' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/29' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/32' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/22' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/25' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/30' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/33' 2023-11-28T20:43:24.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/23' 2023-11-28T20:43:24.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/35' 2023-11-28T20:43:24.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/26' 2023-11-28T20:43:24.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './204/37' 2023-11-28T20:43:24.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './204' 2023-11-28T20:43:24.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/21' 2023-11-28T20:43:24.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/27' 2023-11-28T20:43:24.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/31' 2023-11-28T20:43:24.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/36' 2023-11-28T20:43:24.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/20' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/39' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/34' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/38' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/28' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/24' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/29' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/32' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/22' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/25' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/30' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/33' 2023-11-28T20:43:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/23' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/35' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/26' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './205/37' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './205' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/21' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/27' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/31' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/36' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/20' 2023-11-28T20:43:24.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/39' 2023-11-28T20:43:24.133 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:43:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.313+0000 7f846e846640 1 Processor -- start 2023-11-28T20:43:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f846e846640 1 -- start start 2023-11-28T20:43:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f846e846640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f846e846640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 0x7f846815db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f846e846640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84680c9d90 con 0x7f8468070900 2023-11-28T20:43:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f846e846640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84680c88b0 con 0x7f84681577e0 2023-11-28T20:43:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f846e846640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c8f50 con 0x7f846806ca10 2023-11-28T20:43:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f8467fff640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f8468070900 legacy=0x7f84681570d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:43:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f846cde3640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 msgr2=0x7f846815db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f846cde3640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 0x7f846815db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f84677fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f84677fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:60126/0 (socket says 172.21.15.167:60126) 2023-11-28T20:43:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 learned_addr learned my addr 172.21.15.167:0/2889373166 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:43:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:43:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.317+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:24.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.521+0000 7f846cde3640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 msgr2=0x7f846815db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.521+0000 7f8467fff640 1 -- 172.21.15.167:0/2889373166 >> v1:172.21.15.178:6789/0 conn(0x7f8468070900 legacy=0x7f84681570d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:43:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.521+0000 7f846cde3640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 0x7f846815db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:43:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.521+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.521+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:43:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.521+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:43:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.521+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.521+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:43:24.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.925+0000 7f846cde3640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 msgr2=0x7f846815db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:24.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.925+0000 7f8467fff640 1 -- 172.21.15.167:0/2889373166 >> v1:172.21.15.178:6789/0 conn(0x7f8468070900 legacy=0x7f84681570d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:43:24.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.925+0000 7f846cde3640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 0x7f846815db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:43:24.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.925+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.925+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:43:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.925+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:43:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.925+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:24.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:24.925+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:43:25.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/34' 2023-11-28T20:43:25.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/38' 2023-11-28T20:43:25.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/28' 2023-11-28T20:43:25.057 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/24' 2023-11-28T20:43:25.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/29' 2023-11-28T20:43:25.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/32' 2023-11-28T20:43:25.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/22' 2023-11-28T20:43:25.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/25' 2023-11-28T20:43:25.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/30' 2023-11-28T20:43:25.058 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/33' 2023-11-28T20:43:25.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/23' 2023-11-28T20:43:25.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/35' 2023-11-28T20:43:25.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/26' 2023-11-28T20:43:25.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './206/37' 2023-11-28T20:43:25.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './206' 2023-11-28T20:43:25.059 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/21' 2023-11-28T20:43:25.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/27' 2023-11-28T20:43:25.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/31' 2023-11-28T20:43:25.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/36' 2023-11-28T20:43:25.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/20' 2023-11-28T20:43:25.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/39' 2023-11-28T20:43:25.060 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/34' 2023-11-28T20:43:25.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/38' 2023-11-28T20:43:25.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/28' 2023-11-28T20:43:25.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/24' 2023-11-28T20:43:25.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/29' 2023-11-28T20:43:25.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/32' 2023-11-28T20:43:25.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/22' 2023-11-28T20:43:25.061 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/25' 2023-11-28T20:43:25.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/30' 2023-11-28T20:43:25.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/33' 2023-11-28T20:43:25.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/23' 2023-11-28T20:43:25.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/35' 2023-11-28T20:43:25.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/26' 2023-11-28T20:43:25.062 INFO:tasks.workunit.client.0.smithi167.stdout:removed './207/37' 2023-11-28T20:43:25.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './207' 2023-11-28T20:43:25.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/21' 2023-11-28T20:43:25.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/27' 2023-11-28T20:43:25.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/31' 2023-11-28T20:43:25.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/36' 2023-11-28T20:43:25.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/20' 2023-11-28T20:43:25.063 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/39' 2023-11-28T20:43:25.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/34' 2023-11-28T20:43:25.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/38' 2023-11-28T20:43:25.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/28' 2023-11-28T20:43:25.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/24' 2023-11-28T20:43:25.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/29' 2023-11-28T20:43:25.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/32' 2023-11-28T20:43:25.064 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/22' 2023-11-28T20:43:25.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/25' 2023-11-28T20:43:25.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/30' 2023-11-28T20:43:25.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/33' 2023-11-28T20:43:25.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/23' 2023-11-28T20:43:25.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/35' 2023-11-28T20:43:25.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/26' 2023-11-28T20:43:25.065 INFO:tasks.workunit.client.0.smithi167.stdout:removed './208/37' 2023-11-28T20:43:25.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './208' 2023-11-28T20:43:25.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/21' 2023-11-28T20:43:25.066 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/27' 2023-11-28T20:43:25.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/31' 2023-11-28T20:43:25.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/36' 2023-11-28T20:43:25.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/20' 2023-11-28T20:43:25.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/39' 2023-11-28T20:43:25.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/34' 2023-11-28T20:43:25.067 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/38' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/28' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/24' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/29' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/32' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/22' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/25' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/30' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/33' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/23' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/35' 2023-11-28T20:43:25.068 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/26' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './209/37' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './209' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/21' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/27' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/31' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/36' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/20' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/39' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/34' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/38' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/28' 2023-11-28T20:43:25.069 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/24' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/29' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/32' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/22' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/25' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/30' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/33' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/23' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/35' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/26' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './210/37' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './210' 2023-11-28T20:43:25.070 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/21' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/27' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/31' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/36' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/20' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/39' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/34' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/38' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/28' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/24' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/29' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/32' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/22' 2023-11-28T20:43:25.071 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/25' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/30' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/33' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/23' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/35' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/26' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './211/37' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './211' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/21' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/27' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/31' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/36' 2023-11-28T20:43:25.072 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/20' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/39' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/34' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/38' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/28' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/24' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/29' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/32' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/22' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/25' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/30' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/33' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/23' 2023-11-28T20:43:25.073 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/35' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/26' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './212/37' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './212' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/21' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/27' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/31' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/36' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/20' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/39' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/34' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/38' 2023-11-28T20:43:25.074 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/28' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/24' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/29' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/32' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/22' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/25' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/30' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/33' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/23' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/35' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/26' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed './213/37' 2023-11-28T20:43:25.075 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './213' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/21' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/27' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/31' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/36' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/20' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/39' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/34' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/38' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/28' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/24' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/29' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/32' 2023-11-28T20:43:25.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/22' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/25' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/30' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/33' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/23' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/35' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/26' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './214/37' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './214' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/21' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/27' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/31' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/36' 2023-11-28T20:43:25.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/20' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/39' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/34' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/38' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/28' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/24' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/29' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/32' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/22' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/25' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/30' 2023-11-28T20:43:25.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/33' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/23' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/35' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/26' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './215/37' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './215' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/21' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/27' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/31' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/36' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/20' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/39' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/34' 2023-11-28T20:43:25.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/38' 2023-11-28T20:43:25.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:25.729+0000 7f8467fff640 1 -- 172.21.15.167:0/2889373166 >> v1:172.21.15.178:6789/0 conn(0x7f8468070900 legacy=0x7f84681570d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:43:25.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:25.729+0000 7f846cde3640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 msgr2=0x7f846815db00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:25.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:25.729+0000 7f846cde3640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 0x7f846815db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:43:25.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:25.729+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:25.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:25.729+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:43:25.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:25.729+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:43:25.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:25.729+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:25.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:25.729+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:43:27.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f8465ffb640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:27.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f8465ffb640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f846806ca10 0x7f846815d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:27.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f8465ffb640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 msgr2=0x7f846815db00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:27.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f8465ffb640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.178:3300/0 conn(0x7f84681577e0 0x7f846815db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:27.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f8465ffb640 1 -- 172.21.15.167:0/2889373166 >> v1:172.21.15.178:6789/0 conn(0x7f8468070900 legacy=0x7f84681570d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:27.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f8465ffb640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:27.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f8465ffb640 1 -- 172.21.15.167:0/2889373166 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84680c85d0 con 0x7f84540036b0 2023-11-28T20:43:27.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f8465ffb640 1 -- 172.21.15.167:0/2889373166 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84680c88b0 con 0x7f84540073f0 2023-11-28T20:43:27.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:27.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 msgr2=0x7f84540098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:43:27.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 msgr2=0x7f84540098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:43:27.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:27.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.317+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:27.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.521+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:27.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.521+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 msgr2=0x7f84540098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:43:27.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.521+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 msgr2=0x7f84540098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:43:27.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.521+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:27.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.521+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:43:27.876 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/28' 2023-11-28T20:43:27.877 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/24' 2023-11-28T20:43:27.877 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/29' 2023-11-28T20:43:27.877 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/32' 2023-11-28T20:43:27.877 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/22' 2023-11-28T20:43:27.877 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/25' 2023-11-28T20:43:27.877 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/30' 2023-11-28T20:43:27.877 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/33' 2023-11-28T20:43:27.877 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/23' 2023-11-28T20:43:27.877 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/35' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/26' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed './216/37' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './216' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/21' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/27' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/31' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/36' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/20' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/39' 2023-11-28T20:43:27.878 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/34' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/38' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/28' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/24' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/29' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/32' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/22' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/25' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/30' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/33' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/23' 2023-11-28T20:43:27.879 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/35' 2023-11-28T20:43:27.880 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/26' 2023-11-28T20:43:27.880 INFO:tasks.workunit.client.0.smithi167.stdout:removed './217/37' 2023-11-28T20:43:27.880 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './217' 2023-11-28T20:43:27.880 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/21' 2023-11-28T20:43:27.880 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/27' 2023-11-28T20:43:27.880 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/31' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/36' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/20' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/39' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/34' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/38' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/28' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/24' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/29' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/32' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/22' 2023-11-28T20:43:27.881 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/25' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/30' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/33' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/23' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/35' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/26' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed './218/37' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './218' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/21' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/27' 2023-11-28T20:43:27.882 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/31' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/36' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/20' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/39' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/34' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/38' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/28' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/24' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/29' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/32' 2023-11-28T20:43:27.883 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/22' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/25' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/30' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/33' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/23' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/35' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/26' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './219/37' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './219' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/21' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/27' 2023-11-28T20:43:27.884 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/31' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/36' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/20' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/39' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/34' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/38' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/28' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/24' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/29' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/32' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/22' 2023-11-28T20:43:27.885 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/25' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/30' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/33' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/23' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/35' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/26' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed './220/37' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './220' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/21' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/27' 2023-11-28T20:43:27.886 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/31' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/36' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/20' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/39' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/34' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/38' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/28' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/24' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/29' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/32' 2023-11-28T20:43:27.887 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/22' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/25' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/30' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/33' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/23' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/35' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/26' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './221/37' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './221' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/21' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/27' 2023-11-28T20:43:27.888 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/31' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/36' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/20' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/39' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/34' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/38' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/28' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/24' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/29' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/32' 2023-11-28T20:43:27.889 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/22' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/25' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/30' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/33' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/23' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/35' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/26' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed './222/37' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './222' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/21' 2023-11-28T20:43:27.890 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/27' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/31' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/36' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/20' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/39' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/34' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/38' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/28' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/24' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/29' 2023-11-28T20:43:27.891 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/32' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/22' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/25' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/30' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/33' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/23' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/35' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/26' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed './223/37' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './223' 2023-11-28T20:43:27.892 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/21' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/27' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/31' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/36' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/20' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/39' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/34' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/38' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/28' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/24' 2023-11-28T20:43:27.893 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/29' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/32' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/22' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/25' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/30' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/33' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/23' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/35' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/26' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed './224/37' 2023-11-28T20:43:27.894 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './224' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/21' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/27' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/31' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/36' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/20' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/39' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/34' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/38' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/28' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/24' 2023-11-28T20:43:27.895 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/29' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/32' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/22' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/25' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/30' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/33' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/23' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/35' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/26' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './225/37' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './225' 2023-11-28T20:43:27.896 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/21' 2023-11-28T20:43:27.897 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/27' 2023-11-28T20:43:27.897 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/31' 2023-11-28T20:43:27.897 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/36' 2023-11-28T20:43:27.897 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/20' 2023-11-28T20:43:27.897 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/39' 2023-11-28T20:43:27.897 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/34' 2023-11-28T20:43:27.897 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/38' 2023-11-28T20:43:27.897 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/28' 2023-11-28T20:43:27.897 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/24' 2023-11-28T20:43:27.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.925+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:27.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.925+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 msgr2=0x7f84540098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:43:27.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.925+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 msgr2=0x7f84540098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:43:27.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.925+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:27.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:27.925+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:43:28.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.637+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072948636 0 0) 0x7f84680c85d0 con 0x7f84540036b0 2023-11-28T20:43:28.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.637+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8450003530 con 0x7f84540036b0 2023-11-28T20:43:28.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1928224379 0 0) 0x7f8450003530 con 0x7f84540036b0 2023-11-28T20:43:28.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 msgr2=0x7f84540098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:28.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 --2- 172.21.15.167:0/2889373166 >> v2:172.21.15.167:3300/0 conn(0x7f84540073f0 0x7f84540098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680c9d90 con 0x7f84540036b0 2023-11-28T20:43:28.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f8458004130 con 0x7f84540036b0 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 >> v1:172.21.15.167:6789/0 conn(0x7f84540036b0 legacy=0x7f8454005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f846cde3640 1 -- 172.21.15.167:0/2889373166 reap_dead start 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 0x7f8450003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500047d0 0x7f8450004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500051e0 0x7f845000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c88b0 con 0x7f84500051e0 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845000c110 con 0x7f84500047d0 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845000c2d0 con 0x7f8450003980 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f84677fe640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500047d0 msgr2=0x7f8450004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f84677fe640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500047d0 0x7f8450004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f846cde3640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500051e0 0x7f845000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:28.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8467fff640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 0x7f8450003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:28.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f846cde3640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 msgr2=0x7f8450003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:28.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f846cde3640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 0x7f8450003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f846cde3640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500047d0 msgr2=0x7f8450004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:28.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f846cde3640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500047d0 0x7f8450004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f846cde3640 1 -- 172.21.15.167:0/2889373166 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450003530 con 0x7f84500051e0 2023-11-28T20:43:28.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f8467fff640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 0x7f8450003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:43:28.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.641+0000 7f846cde3640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500051e0 0x7f845000b990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f846806bee0 tx=0x7f846001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac71f0d2272dd0c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:28.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84600a5750 con 0x7f84500051e0 2023-11-28T20:43:28.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84600a9070 con 0x7f84500051e0 2023-11-28T20:43:28.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f8466ffd640 1 -- 172.21.15.167:0/2889373166 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84600a5ad0 con 0x7f84500051e0 2023-11-28T20:43:28.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 -- 172.21.15.167:0/2889373166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500051e0 msgr2=0x7f845000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:28.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500051e0 0x7f845000b990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f846806bee0 tx=0x7f846001c7f0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 -- 172.21.15.167:0/2889373166 shutdown_connections 2023-11-28T20:43:28.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500051e0 0x7f845000b990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500047d0 0x7f8450004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 --2- 172.21.15.167:0/2889373166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 0x7f8450003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 -- 172.21.15.167:0/2889373166 >> 172.21.15.167:0/2889373166 conn(0x7f846806a580 msgr2=0x7f846806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:28.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 -- 172.21.15.167:0/2889373166 shutdown_connections 2023-11-28T20:43:28.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 -- 172.21.15.167:0/2889373166 wait complete. 2023-11-28T20:43:28.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 Processor -- start 2023-11-28T20:43:28.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 -- start start 2023-11-28T20:43:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 0x7f8468152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500051e0 0x7f846814cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846814deb0 con 0x7f84500047d0 2023-11-28T20:43:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680cbd80 con 0x7f84500051e0 2023-11-28T20:43:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.645+0000 7f846e846640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680ccd30 con 0x7f8450003980 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f846cde3640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500051e0 msgr2=0x7f846814cd00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f84677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f846cde3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500051e0 0x7f846814cd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f84677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846814c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47856/0 (socket says 172.21.15.167:47856) 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f84677fe640 1 -- 172.21.15.167:0/1654200772 learned_addr learned my addr 172.21.15.167:0/1654200772 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f8467fff640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 0x7f8468152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f84677fe640 1 -- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 msgr2=0x7f8468152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f84677fe640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 0x7f8468152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f84677fe640 1 -- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500051e0 msgr2=0x7f846814cd00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:43:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f84677fe640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500051e0 0x7f846814cd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f84677fe640 1 -- 172.21.15.167:0/1654200772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680cc770 con 0x7f84500047d0 2023-11-28T20:43:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f84677fe640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846814c7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f845c016790 tx=0x7f845c016c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f8464ff9640 1 -- 172.21.15.167:0/1654200772 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c01d070 con 0x7f84500047d0 2023-11-28T20:43:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f8464ff9640 1 -- 172.21.15.167:0/1654200772 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00c040 con 0x7f84500047d0 2023-11-28T20:43:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f8464ff9640 1 -- 172.21.15.167:0/1654200772 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c015d70 con 0x7f84500047d0 2023-11-28T20:43:28.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84680cca50 con 0x7f84500047d0 2023-11-28T20:43:28.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84680cba10 con 0x7f84500047d0 2023-11-28T20:43:28.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8468075c90 con 0x7f84500047d0 2023-11-28T20:43:28.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.649+0000 7f8464ff9640 1 -- 172.21.15.167:0/1654200772 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f845c02c440 con 0x7f84500047d0 2023-11-28T20:43:28.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.653+0000 7f8464ff9640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8454066b60 0x7f8454069020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:28.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.653+0000 7f8464ff9640 1 -- 172.21.15.167:0/1654200772 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f845c085210 con 0x7f84500047d0 2023-11-28T20:43:28.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.653+0000 7f8467fff640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8454066b60 0x7f8454069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:28.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.653+0000 7f8467fff640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8454066b60 0x7f8454069020 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8458007d20 tx=0x7f8458009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:28.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.653+0000 7f8464ff9640 1 -- 172.21.15.167:0/1654200772 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f845c052260 con 0x7f84500047d0 2023-11-28T20:43:28.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.877+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f846814f020 con 0x7f84500047d0 2023-11-28T20:43:28.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.877+0000 7f8464ff9640 1 -- 172.21.15.167:0/1654200772 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f845c016ea0 con 0x7f84500047d0 2023-11-28T20:43:28.878 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":44,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:43:28.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8454066b60 msgr2=0x7f8454069020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:28.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8454066b60 0x7f8454069020 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8458007d20 tx=0x7f8458009040 comp rx=0 tx=0).stop 2023-11-28T20:43:28.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 msgr2=0x7f846814c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:28.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846814c7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f845c016790 tx=0x7f845c016c50 comp rx=0 tx=0).stop 2023-11-28T20:43:28.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 shutdown_connections 2023-11-28T20:43:28.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8454066b60 0x7f8454069020 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84500051e0 0x7f846814cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84500047d0 0x7f846814c7c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 --2- 172.21.15.167:0/1654200772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8450003980 0x7f8468152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:28.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 >> 172.21.15.167:0/1654200772 conn(0x7f846806a580 msgr2=0x7f846815d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:28.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 shutdown_connections 2023-11-28T20:43:28.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:28.881+0000 7f846e846640 1 -- 172.21.15.167:0/1654200772 wait complete. 2023-11-28T20:43:28.912 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:43:28.912 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:43:28.912 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:43:29.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55984640 1 Processor -- start 2023-11-28T20:43:29.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55984640 1 -- start start 2023-11-28T20:43:29.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55984640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4a50159b20 0x7f4a500c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55984640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a500c5fb0 0x7f4a500cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55984640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a50159f70 con 0x7f4a50153d20 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55984640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5015a1b0 con 0x7f4a500c5fb0 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55984640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5015a450 con 0x7f4a50159b20 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55183640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a500c5fb0 0x7f4a500cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55183640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a500c5fb0 0x7f4a500cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47858/0 (socket says 172.21.15.167:47858) 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55183640 1 -- 172.21.15.167:0/137700385 learned_addr learned my addr 172.21.15.167:0/137700385 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a54982640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4a50153d20 0x7f4a500ca3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:60446/0 (socket says 172.21.15.167:60446) 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a4ffff640 1 -- 172.21.15.167:0/137700385 >> v2:172.21.15.178:3300/0 conn(0x7f4a50159b20 msgr2=0x7f4a500c5a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a4ffff640 1 --2- 172.21.15.167:0/137700385 >> v2:172.21.15.178:3300/0 conn(0x7f4a50159b20 0x7f4a500c5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55183640 1 -- 172.21.15.167:0/137700385 >> v2:172.21.15.178:3300/0 conn(0x7f4a50159b20 msgr2=0x7f4a500c5a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:29.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55183640 1 --2- 172.21.15.167:0/137700385 >> v2:172.21.15.178:3300/0 conn(0x7f4a50159b20 0x7f4a500c5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55183640 1 -- 172.21.15.167:0/137700385 >> v1:172.21.15.167:6789/0 conn(0x7f4a50153d20 legacy=0x7f4a500ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a55183640 1 -- 172.21.15.167:0/137700385 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5015a710 con 0x7f4a500c5fb0 2023-11-28T20:43:29.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.093+0000 7f4a4f7fe640 1 -- 172.21.15.167:0/137700385 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186145120 0 0) 0x7f4a44001120 con 0x7f4a50153d20 2023-11-28T20:43:29.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a55183640 1 --2- 172.21.15.167:0/137700385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 0x7f4a500cf440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4a5008d560 tx=0x7f4a4801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568999326d2c7f76 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a4f7fe640 1 -- 172.21.15.167:0/137700385 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480af400 con 0x7f4a500c5fb0 2023-11-28T20:43:29.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a4f7fe640 1 -- 172.21.15.167:0/137700385 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a480ab050 con 0x7f4a500c5fb0 2023-11-28T20:43:29.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a4f7fe640 1 -- 172.21.15.167:0/137700385 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480af780 con 0x7f4a500c5fb0 2023-11-28T20:43:29.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a55984640 1 -- 172.21.15.167:0/137700385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 msgr2=0x7f4a500cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a55984640 1 --2- 172.21.15.167:0/137700385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 0x7f4a500cf440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4a5008d560 tx=0x7f4a4801f1e0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a55984640 1 -- 172.21.15.167:0/137700385 shutdown_connections 2023-11-28T20:43:29.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a55984640 1 --2- 172.21.15.167:0/137700385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 0x7f4a500cf440 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a55984640 1 --2- 172.21.15.167:0/137700385 >> v2:172.21.15.178:3300/0 conn(0x7f4a50159b20 0x7f4a500c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a55984640 1 -- 172.21.15.167:0/137700385 >> 172.21.15.167:0/137700385 conn(0x7f4a5006b800 msgr2=0x7f4a5006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:29.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a55984640 1 -- 172.21.15.167:0/137700385 shutdown_connections 2023-11-28T20:43:29.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.097+0000 7f4a55984640 1 -- 172.21.15.167:0/137700385 wait complete. 2023-11-28T20:43:29.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 Processor -- start 2023-11-28T20:43:29.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 -- start start 2023-11-28T20:43:29.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 0x7f4a501f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a50153d20 0x7f4a50151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a50159b20 0x7f4a50146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5014ec50 con 0x7f4a500c5fb0 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a501ef9a0 con 0x7f4a50153d20 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a501eff20 con 0x7f4a50159b20 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a4ffff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a50153d20 msgr2=0x7f4a50151ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a54982640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 0x7f4a501f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a4ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a50153d20 0x7f4a50151ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a54982640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 0x7f4a501f03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47864/0 (socket says 172.21.15.167:47864) 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a54982640 1 -- 172.21.15.167:0/533221869 learned_addr learned my addr 172.21.15.167:0/533221869 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55183640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a50159b20 0x7f4a50146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a54982640 1 -- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a50159b20 msgr2=0x7f4a50146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a54982640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a50159b20 0x7f4a50146aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a54982640 1 -- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a50153d20 msgr2=0x7f4a50151ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a54982640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a50153d20 0x7f4a50151ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a54982640 1 -- 172.21.15.167:0/533221869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48009b30 con 0x7f4a500c5fb0 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a54982640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 0x7f4a501f03b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400c7b0 tx=0x7f4a4400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440072d0 con 0x7f4a500c5fb0 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a44007450 con 0x7f4a500c5fb0 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440047f0 con 0x7f4a500c5fb0 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a501f08f0 con 0x7f4a500c5fb0 2023-11-28T20:43:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a50152fa0 con 0x7f4a500c5fb0 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50151320 0x7f4a50146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.101+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50072740 con 0x7f4a50151320 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4ffff640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50151320 0x7f4a50146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4ffff640 1 -- 172.21.15.167:0/533221869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a500b3ea0 con 0x7f4a50151320 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4ffff640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50151320 0x7f4a50146fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a500cdac0 tx=0x7f4a3c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4a44004950 con 0x7f4a500c5fb0 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4d7fa640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a34066420 0x7f4a340688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f4a440833e0 con 0x7f4a500c5fb0 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c003e20 con 0x7f4a50151320 2023-11-28T20:43:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f4a3c005070 con 0x7f4a50151320 2023-11-28T20:43:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50151320 msgr2=0x7f4a50146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4d7fa640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50151320 0x7f4a50146fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a500cdac0 tx=0x7f4a3c00b8e0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50151320 msgr2=0x7f4a50146fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a4d7fa640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50151320 0x7f4a50146fe0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a55183640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a34066420 0x7f4a340688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.105+0000 7f4a55183640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a34066420 0x7f4a340688e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4a480b1000 tx=0x7f4a480aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50159000 0x7f4a50159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50159950 con 0x7f4a50159000 2023-11-28T20:43:29.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a4ffff640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50159000 0x7f4a50159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a4ffff640 1 -- 172.21.15.167:0/533221869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4a5014a700 con 0x7f4a50159000 2023-11-28T20:43:29.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a4ffff640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50159000 0x7f4a50159410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c011000 tx=0x7f4a3c005a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c01f070 con 0x7f4a50159000 2023-11-28T20:43:29.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4970 (secure 0 0 0) 0x7f4a3c010610 con 0x7f4a50159000 2023-11-28T20:43:29.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50159000 msgr2=0x7f4a50159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a4d7fa640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50159000 0x7f4a50159410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c011000 tx=0x7f4a3c005a30 comp rx=0 tx=0).stop 2023-11-28T20:43:29.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a4d7fa640 1 -- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50159000 msgr2=0x7f4a50159410 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:29.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a4d7fa640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a50159000 0x7f4a50159410 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c011000 tx=0x7f4a3c005a30 comp rx=0 tx=0).stop 2023-11-28T20:43:29.115 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:29.115 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:29.115 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 44, 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:29.116 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:29.117 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:29.119 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:29.120 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:29.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.122 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.123 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:29.124 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:29.125 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:29.126 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.127 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:29.128 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.129 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:29.130 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:29.130 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:29.130 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.130 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.130 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:29.130 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:29.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a34066420 msgr2=0x7f4a340688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a34066420 0x7f4a340688e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4a480b1000 tx=0x7f4a480aa000 comp rx=0 tx=0).stop 2023-11-28T20:43:29.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 msgr2=0x7f4a501f03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 --2- 172.21.15.167:0/533221869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a500c5fb0 0x7f4a501f03b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400c7b0 tx=0x7f4a4400cc70 comp rx=0 tx=0).stop 2023-11-28T20:43:29.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55183640 1 -- 172.21.15.167:0/533221869 reap_dead start 2023-11-28T20:43:29.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55183640 1 -- 172.21.15.167:0/533221869 reap_dead start 2023-11-28T20:43:29.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 shutdown_connections 2023-11-28T20:43:29.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 >> 172.21.15.167:0/533221869 conn(0x7f4a5006b800 msgr2=0x7f4a500ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:29.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 shutdown_connections 2023-11-28T20:43:29.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.113+0000 7f4a55984640 1 -- 172.21.15.167:0/533221869 wait complete. 2023-11-28T20:43:29.134 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:43:29.134 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:43:29.134 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:43:29.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.277+0000 7ff849d80640 1 Processor -- start 2023-11-28T20:43:29.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.277+0000 7ff849d80640 1 -- start start 2023-11-28T20:43:29.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.277+0000 7ff849d80640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff844150b40 0x7ff844157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.277+0000 7ff849d80640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440c48f0 con 0x7ff8440c6ff0 2023-11-28T20:43:29.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.277+0000 7ff849d80640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440c6ac0 con 0x7ff8440c4510 2023-11-28T20:43:29.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.277+0000 7ff849d80640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8440c62f0 con 0x7ff844150b40 2023-11-28T20:43:29.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.281+0000 7ff8437fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff844150b40 0x7ff844157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.281+0000 7ff843fff640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7ff8440c4510 legacy=0x7ff84406a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:43:29.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.281+0000 7ff8437fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff844150b40 0x7ff844157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47896/0 (socket says 172.21.15.167:47896) 2023-11-28T20:43:29.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.281+0000 7ff8437fe640 1 -- 172.21.15.167:0/1962300740 learned_addr learned my addr 172.21.15.167:0/1962300740 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:29.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.281+0000 7ff842ffd640 1 --1- 172.21.15.167:0/1962300740 >> v1:172.21.15.167:6789/0 conn(0x7ff8440c6ff0 0x7ff8440c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:60450/0 (socket says 172.21.15.167:60450) 2023-11-28T20:43:29.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.281+0000 7ff8437fe640 1 -- 172.21.15.167:0/1962300740 >> v1:172.21.15.178:6789/0 conn(0x7ff8440c4510 legacy=0x7ff84406a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:29.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.281+0000 7ff8437fe640 1 -- 172.21.15.167:0/1962300740 >> v1:172.21.15.167:6789/0 conn(0x7ff8440c6ff0 legacy=0x7ff8440c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.281+0000 7ff8437fe640 1 -- 172.21.15.167:0/1962300740 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440c6500 con 0x7ff844150b40 2023-11-28T20:43:29.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.281+0000 7ff8437fe640 1 --2- 172.21.15.167:0/1962300740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff844150b40 0x7ff844157560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff83400bb10 tx=0x7ff83401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4584c8630b26d18 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff8427fc640 1 -- 172.21.15.167:0/1962300740 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340a7b70 con 0x7ff844150b40 2023-11-28T20:43:29.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff8427fc640 1 -- 172.21.15.167:0/1962300740 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340a7cd0 con 0x7ff844150b40 2023-11-28T20:43:29.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff8427fc640 1 -- 172.21.15.167:0/1962300740 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340af660 con 0x7ff844150b40 2023-11-28T20:43:29.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 -- 172.21.15.167:0/1962300740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff844150b40 msgr2=0x7ff844157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 --2- 172.21.15.167:0/1962300740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff844150b40 0x7ff844157560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff83400bb10 tx=0x7ff83401eba0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 -- 172.21.15.167:0/1962300740 shutdown_connections 2023-11-28T20:43:29.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 --2- 172.21.15.167:0/1962300740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff844150b40 0x7ff844157560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 -- 172.21.15.167:0/1962300740 >> 172.21.15.167:0/1962300740 conn(0x7ff8440cb1e0 msgr2=0x7ff8440cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:29.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 -- 172.21.15.167:0/1962300740 shutdown_connections 2023-11-28T20:43:29.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 -- 172.21.15.167:0/1962300740 wait complete. 2023-11-28T20:43:29.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 Processor -- start 2023-11-28T20:43:29.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 -- start start 2023-11-28T20:43:29.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8440c4510 0x7ff844143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8440c6ff0 0x7ff8441f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff844150b40 0x7ff84413d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440ca910 con 0x7ff8440c4510 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440cabf0 con 0x7ff8440c6ff0 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff849d80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440caed0 con 0x7ff844150b40 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff842ffd640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8440c6ff0 msgr2=0x7ff8441f60a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff842ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8440c6ff0 0x7ff8441f60a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.285+0000 7ff8437fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8440c4510 0x7ff844143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff8437fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8440c4510 0x7ff844143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47906/0 (socket says 172.21.15.167:47906) 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff8437fe640 1 -- 172.21.15.167:0/671684815 learned_addr learned my addr 172.21.15.167:0/671684815 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff843fff640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff844150b40 0x7ff84413d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff8437fe640 1 -- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff844150b40 msgr2=0x7ff84413d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff8437fe640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff844150b40 0x7ff84413d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff8437fe640 1 -- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8440c6ff0 msgr2=0x7ff8441f60a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff8437fe640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8440c6ff0 0x7ff8441f60a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff8437fe640 1 -- 172.21.15.167:0/671684815 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83400b770 con 0x7ff8440c4510 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff8437fe640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8440c4510 0x7ff844143020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff83400b2c0 tx=0x7ff83401d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340ba480 con 0x7ff8440c4510 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340ba600 con 0x7ff8440c4510 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340ba9b0 con 0x7ff8440c4510 2023-11-28T20:43:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8441f58a0 con 0x7ff8440c4510 2023-11-28T20:43:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff844157b30 con 0x7ff8440c4510 2023-11-28T20:43:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff849d80640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440ca0a0 0x7ff84413ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff844074770 con 0x7ff8440ca0a0 2023-11-28T20:43:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff842ffd640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440ca0a0 0x7ff84413ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8340bab10 con 0x7ff8440c4510 2023-11-28T20:43:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff842ffd640 1 -- 172.21.15.167:0/671684815 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff844157040 con 0x7ff8440ca0a0 2023-11-28T20:43:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff842ffd640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440ca0a0 0x7ff84413ddf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff844150550 tx=0x7ff83800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.289+0000 7ff82bfff640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff830066450 0x7ff830068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.293+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7ff8340a7e40 con 0x7ff8440c4510 2023-11-28T20:43:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.293+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8380074e0 con 0x7ff8440ca0a0 2023-11-28T20:43:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.293+0000 7ff843fff640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff830066450 0x7ff830068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.293+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff838007640 con 0x7ff8440ca0a0 2023-11-28T20:43:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.293+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440ca0a0 msgr2=0x7ff84413ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.293+0000 7ff82bfff640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440ca0a0 0x7ff84413ddf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff844150550 tx=0x7ff83800c7f0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.293+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440ca0a0 msgr2=0x7ff84413ddf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:29.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.293+0000 7ff82bfff640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440ca0a0 0x7ff84413ddf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.293+0000 7ff843fff640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff830066450 0x7ff830068910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff83c003bd0 tx=0x7ff83c009470 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.297+0000 7ff849d80640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440c8fe0 0x7ff8440c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:29.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.297+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440cb060 con 0x7ff8440c8fe0 2023-11-28T20:43:29.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.297+0000 7ff842ffd640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440c8fe0 0x7ff8440c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:29.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff842ffd640 1 -- 172.21.15.167:0/671684815 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff8440682c0 con 0x7ff8440c8fe0 2023-11-28T20:43:29.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff842ffd640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440c8fe0 0x7ff8440c93f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff838005000 tx=0x7ff838000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:29.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83801f070 con 0x7ff8440c8fe0 2023-11-28T20:43:29.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4771 (secure 0 0 0) 0x7ff8380123f0 con 0x7ff8440c8fe0 2023-11-28T20:43:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440c8fe0 msgr2=0x7ff8440c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff82bfff640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440c8fe0 0x7ff8440c93f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff838005000 tx=0x7ff838000ee0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff82bfff640 1 -- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440c8fe0 msgr2=0x7ff8440c93f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff82bfff640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8440c8fe0 0x7ff8440c93f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.303 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:29.303 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:29.303 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:29.303 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 44, 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:29.304 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:29.305 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:29.306 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:29.307 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:29.308 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.309 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:29.310 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:43:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:29.317 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:29.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff830066450 msgr2=0x7ff830068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff849d80640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff830066450 0x7ff830068910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff83c003bd0 tx=0x7ff83c009470 comp rx=0 tx=0).stop 2023-11-28T20:43:29.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8440c4510 msgr2=0x7ff844143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:29.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff849d80640 1 --2- 172.21.15.167:0/671684815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8440c4510 0x7ff844143020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff83400b2c0 tx=0x7ff83401d3e0 comp rx=0 tx=0).stop 2023-11-28T20:43:29.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff843fff640 1 -- 172.21.15.167:0/671684815 reap_dead start 2023-11-28T20:43:29.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff843fff640 1 -- 172.21.15.167:0/671684815 reap_dead start 2023-11-28T20:43:29.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 shutdown_connections 2023-11-28T20:43:29.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 >> 172.21.15.167:0/671684815 conn(0x7ff8440cb1e0 msgr2=0x7ff844155420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:29.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 shutdown_connections 2023-11-28T20:43:29.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:29.301+0000 7ff849d80640 1 -- 172.21.15.167:0/671684815 wait complete. 2023-11-28T20:43:29.325 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:43:29.325 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:43:29.325 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/29' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/32' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/22' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/25' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/30' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/33' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/23' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/35' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/26' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './226/37' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './226' 2023-11-28T20:43:29.326 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/21' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/27' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/31' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/36' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/20' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/39' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/34' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/38' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/28' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/24' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/29' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/32' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/22' 2023-11-28T20:43:29.327 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/25' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/30' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/33' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/23' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/35' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/26' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './227/37' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './227' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/21' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/27' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/31' 2023-11-28T20:43:29.328 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/36' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/20' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/39' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/34' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/38' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/28' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/24' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/29' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/32' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/22' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/25' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/30' 2023-11-28T20:43:29.329 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/33' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/23' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/35' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/26' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './228/37' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './228' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/21' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/27' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/31' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/36' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/20' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/39' 2023-11-28T20:43:29.330 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/34' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/38' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/28' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/24' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/29' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/32' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/22' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/25' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/30' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/33' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/23' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/35' 2023-11-28T20:43:29.331 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/26' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './229/37' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './229' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/21' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/27' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/31' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/36' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/20' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/39' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/34' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/38' 2023-11-28T20:43:29.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/28' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/24' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/29' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/32' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/22' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/25' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/30' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/33' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/23' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/35' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/26' 2023-11-28T20:43:29.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './230/37' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './230' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/21' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/27' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/31' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/36' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/20' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/39' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/34' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/38' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/28' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/24' 2023-11-28T20:43:29.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/29' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/32' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/22' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/25' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/30' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/33' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/23' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/35' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/26' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './231/37' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './231' 2023-11-28T20:43:29.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/21' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/27' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/31' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/36' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/20' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/39' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/34' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/38' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/28' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/24' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/29' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/32' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/22' 2023-11-28T20:43:29.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/25' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/30' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/33' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/23' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/35' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/26' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './232/37' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './232' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/21' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/27' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/31' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/36' 2023-11-28T20:43:29.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/20' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/39' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/34' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/38' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/28' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/24' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/29' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/32' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/22' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/25' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/30' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/33' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/23' 2023-11-28T20:43:29.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/35' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/26' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './233/37' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './233' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/21' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/27' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/31' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/36' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/20' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/39' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/34' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/38' 2023-11-28T20:43:29.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/28' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/24' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/29' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/32' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/22' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/25' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/30' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/33' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/23' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/35' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/26' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './234/37' 2023-11-28T20:43:29.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './234' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/21' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/27' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/31' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/36' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/20' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/39' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/34' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/38' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/28' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/24' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/29' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/32' 2023-11-28T20:43:29.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/22' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/25' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/30' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/33' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/23' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/35' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/26' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './235/37' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './235' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/21' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/27' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/31' 2023-11-28T20:43:29.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/36' 2023-11-28T20:43:29.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/20' 2023-11-28T20:43:29.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/39' 2023-11-28T20:43:29.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/34' 2023-11-28T20:43:29.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/38' 2023-11-28T20:43:29.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/28' 2023-11-28T20:43:29.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/24' 2023-11-28T20:43:29.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/29' 2023-11-28T20:43:29.343 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/32' 2023-11-28T20:43:31.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/22' 2023-11-28T20:43:31.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/25' 2023-11-28T20:43:31.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/30' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/33' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/23' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/35' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/26' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './236/37' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './236' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/21' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/27' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/31' 2023-11-28T20:43:31.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/36' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/20' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/39' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/34' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/38' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/28' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/24' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/29' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/32' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/22' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/25' 2023-11-28T20:43:31.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/30' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/33' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/23' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/35' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/26' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './237/37' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './237' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/21' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/27' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/31' 2023-11-28T20:43:31.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/36' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/20' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/39' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/34' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/38' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/28' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/24' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/29' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/32' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/22' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/25' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/30' 2023-11-28T20:43:31.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/33' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/23' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/35' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/26' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './238/37' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './238' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/21' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/27' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/31' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/36' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/20' 2023-11-28T20:43:31.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/39' 2023-11-28T20:43:31.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/34' 2023-11-28T20:43:31.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/38' 2023-11-28T20:43:31.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/28' 2023-11-28T20:43:31.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/24' 2023-11-28T20:43:31.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/29' 2023-11-28T20:43:31.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/32' 2023-11-28T20:43:31.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/22' 2023-11-28T20:43:31.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/25' 2023-11-28T20:43:31.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/30' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/33' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/23' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/35' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/26' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './239/37' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './239' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/21' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/27' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/31' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/36' 2023-11-28T20:43:31.440 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/20' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/39' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/34' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/38' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/28' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/24' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/29' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/32' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/22' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/25' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/30' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/33' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/23' 2023-11-28T20:43:31.441 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/35' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/26' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed './240/37' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './240' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/21' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/27' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/31' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/36' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/20' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/39' 2023-11-28T20:43:31.442 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/34' 2023-11-28T20:43:31.443 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/38' 2023-11-28T20:43:31.443 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/28' 2023-11-28T20:43:31.443 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/24' 2023-11-28T20:43:31.443 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/29' 2023-11-28T20:43:31.443 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/32' 2023-11-28T20:43:31.443 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/22' 2023-11-28T20:43:31.443 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/25' 2023-11-28T20:43:31.443 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/30' 2023-11-28T20:43:31.443 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/33' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/23' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/35' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/26' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './241/37' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './241' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/21' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/27' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/31' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/36' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/20' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/39' 2023-11-28T20:43:31.444 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/34' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/38' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/28' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/24' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/29' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/32' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/22' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/25' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/30' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/33' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/23' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/35' 2023-11-28T20:43:31.445 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/26' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed './242/37' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './242' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/21' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/27' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/31' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/36' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/20' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/39' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/34' 2023-11-28T20:43:31.446 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/38' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/28' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/24' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/29' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/32' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/22' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/25' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/30' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/33' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/23' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/35' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/26' 2023-11-28T20:43:31.447 INFO:tasks.workunit.client.0.smithi167.stdout:removed './243/37' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './243' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/21' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/27' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/31' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/36' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/20' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/39' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/34' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/38' 2023-11-28T20:43:31.448 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/28' 2023-11-28T20:43:31.449 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/24' 2023-11-28T20:43:31.449 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/29' 2023-11-28T20:43:31.449 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/32' 2023-11-28T20:43:31.449 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/22' 2023-11-28T20:43:31.449 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/25' 2023-11-28T20:43:31.449 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/30' 2023-11-28T20:43:31.449 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/33' 2023-11-28T20:43:31.449 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/23' 2023-11-28T20:43:31.450 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/35' 2023-11-28T20:43:31.450 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/26' 2023-11-28T20:43:31.450 INFO:tasks.workunit.client.0.smithi167.stdout:removed './244/37' 2023-11-28T20:43:31.450 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './244' 2023-11-28T20:43:31.450 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/21' 2023-11-28T20:43:31.450 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/27' 2023-11-28T20:43:31.450 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/31' 2023-11-28T20:43:31.450 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/36' 2023-11-28T20:43:31.450 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/20' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/39' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/34' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/38' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/28' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/24' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/29' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/32' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/22' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/25' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/30' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/33' 2023-11-28T20:43:31.451 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/23' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/35' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/26' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './245/37' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './245' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/21' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/27' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/31' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/36' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/20' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/39' 2023-11-28T20:43:31.452 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/34' 2023-11-28T20:43:31.453 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/38' 2023-11-28T20:43:31.453 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/28' 2023-11-28T20:43:31.453 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/24' 2023-11-28T20:43:31.453 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/29' 2023-11-28T20:43:31.453 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/32' 2023-11-28T20:43:31.453 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/22' 2023-11-28T20:43:34.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/25' 2023-11-28T20:43:34.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/30' 2023-11-28T20:43:34.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/33' 2023-11-28T20:43:34.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/23' 2023-11-28T20:43:34.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/35' 2023-11-28T20:43:34.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/26' 2023-11-28T20:43:34.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed './246/37' 2023-11-28T20:43:34.076 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './246' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/21' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/27' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/31' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/36' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/20' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/39' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/34' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/38' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/28' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/24' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/29' 2023-11-28T20:43:34.077 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/32' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/22' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/25' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/30' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/33' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/23' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/35' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/26' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './247/37' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './247' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/21' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/27' 2023-11-28T20:43:34.078 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/31' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/36' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/20' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/39' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/34' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/38' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/28' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/24' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/29' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/32' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/22' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/25' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/30' 2023-11-28T20:43:34.079 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/33' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/23' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/35' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/26' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './248/37' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './248' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/21' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/27' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/31' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/36' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/20' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/39' 2023-11-28T20:43:34.080 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/34' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/38' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/28' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/24' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/29' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/32' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/22' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/25' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/30' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/33' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/23' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/35' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/26' 2023-11-28T20:43:34.081 INFO:tasks.workunit.client.0.smithi167.stdout:removed './249/37' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './249' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/21' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/27' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/31' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/36' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/20' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/39' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/34' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/38' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/28' 2023-11-28T20:43:34.082 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/24' 2023-11-28T20:43:34.083 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/29' 2023-11-28T20:43:34.083 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/32' 2023-11-28T20:43:34.083 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/22' 2023-11-28T20:43:34.083 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/25' 2023-11-28T20:43:34.083 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/30' 2023-11-28T20:43:34.083 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/33' 2023-11-28T20:43:34.083 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/23' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/35' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/26' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './250/37' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './250' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/21' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/27' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/31' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/36' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/20' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/39' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/34' 2023-11-28T20:43:34.084 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/38' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/28' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/24' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/29' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/32' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/22' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/25' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/30' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/33' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/23' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/35' 2023-11-28T20:43:34.085 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/26' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './251/37' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './251' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/21' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/27' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/31' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/36' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/20' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/39' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/34' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/38' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/28' 2023-11-28T20:43:34.086 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/24' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/29' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/32' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/22' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/25' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/30' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/33' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/23' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/35' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/26' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed './252/37' 2023-11-28T20:43:34.087 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './252' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/21' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/27' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/31' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/36' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/20' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/39' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/34' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/38' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/28' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/24' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/29' 2023-11-28T20:43:34.088 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/32' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/22' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/25' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/30' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/33' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/23' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/35' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/26' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './253/37' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './253' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/21' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/27' 2023-11-28T20:43:34.089 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/31' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/36' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/20' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/39' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/34' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/38' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/28' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/24' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/29' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/32' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/22' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/25' 2023-11-28T20:43:34.090 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/30' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/33' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/23' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/35' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/26' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './254/37' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './254' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/21' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/27' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/31' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/36' 2023-11-28T20:43:34.091 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/20' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/39' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/34' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/38' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/28' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/24' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/29' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/32' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/22' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/25' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/30' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/33' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/23' 2023-11-28T20:43:34.092 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/35' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/26' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './255/37' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './255' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/21' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/27' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/31' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/36' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/20' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/39' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/34' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/38' 2023-11-28T20:43:34.093 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/28' 2023-11-28T20:43:34.094 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/24' 2023-11-28T20:43:34.094 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/29' 2023-11-28T20:43:34.094 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/32' 2023-11-28T20:43:34.094 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/22' 2023-11-28T20:43:34.094 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/25' 2023-11-28T20:43:34.094 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/30' 2023-11-28T20:43:34.990 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/33' 2023-11-28T20:43:34.990 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/23' 2023-11-28T20:43:34.990 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/35' 2023-11-28T20:43:34.990 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/26' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './256/37' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './256' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/21' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/27' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/31' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/36' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/20' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/39' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/34' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/38' 2023-11-28T20:43:34.991 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/28' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/24' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/29' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/32' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/22' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/25' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/30' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/33' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/23' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/35' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/26' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed './257/37' 2023-11-28T20:43:34.992 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './257' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/21' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/27' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/31' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/36' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/20' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/39' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/34' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/38' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/28' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/24' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/29' 2023-11-28T20:43:34.993 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/32' 2023-11-28T20:43:34.994 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/22' 2023-11-28T20:43:34.994 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/25' 2023-11-28T20:43:34.994 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/30' 2023-11-28T20:43:34.994 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/33' 2023-11-28T20:43:34.994 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/23' 2023-11-28T20:43:34.994 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/35' 2023-11-28T20:43:34.994 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/26' 2023-11-28T20:43:34.994 INFO:tasks.workunit.client.0.smithi167.stdout:removed './258/37' 2023-11-28T20:43:34.994 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './258' 2023-11-28T20:43:34.995 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/21' 2023-11-28T20:43:34.995 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/27' 2023-11-28T20:43:34.995 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/31' 2023-11-28T20:43:34.995 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/36' 2023-11-28T20:43:34.995 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/20' 2023-11-28T20:43:34.995 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/39' 2023-11-28T20:43:34.995 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/34' 2023-11-28T20:43:34.995 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/38' 2023-11-28T20:43:34.995 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/28' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/24' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/29' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/32' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/22' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/25' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/30' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/33' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/23' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/35' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/26' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed './259/37' 2023-11-28T20:43:34.996 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './259' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/21' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/27' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/31' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/36' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/20' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/39' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/34' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/38' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/28' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/24' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/29' 2023-11-28T20:43:34.997 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/32' 2023-11-28T20:43:34.998 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/22' 2023-11-28T20:43:34.998 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/25' 2023-11-28T20:43:34.998 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/30' 2023-11-28T20:43:34.998 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/33' 2023-11-28T20:43:34.998 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/23' 2023-11-28T20:43:34.998 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/35' 2023-11-28T20:43:34.998 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/26' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './260/37' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './260' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/21' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/27' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/31' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/36' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/20' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/39' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/34' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/38' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/28' 2023-11-28T20:43:34.999 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/24' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/29' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/32' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/22' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/25' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/30' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/33' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/23' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/35' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/26' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed './261/37' 2023-11-28T20:43:35.000 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './261' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/21' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/27' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/31' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/36' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/20' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/39' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/34' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/38' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/28' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/24' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/29' 2023-11-28T20:43:35.001 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/32' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/22' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/25' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/30' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/33' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/23' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/35' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/26' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './262/37' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './262' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/21' 2023-11-28T20:43:35.002 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/27' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/31' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/36' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/20' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/39' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/34' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/38' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/28' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/24' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/29' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/32' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/22' 2023-11-28T20:43:35.003 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/25' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/30' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/33' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/23' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/35' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/26' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './263/37' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './263' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/21' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/27' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/31' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/36' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/20' 2023-11-28T20:43:35.004 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/39' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/34' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/38' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/28' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/24' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/29' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/32' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/22' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/25' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/30' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/33' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/23' 2023-11-28T20:43:35.005 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/35' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/26' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './264/37' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './264' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/21' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/27' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/31' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/36' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/20' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/39' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/34' 2023-11-28T20:43:35.006 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/38' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/28' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/24' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/29' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/32' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/22' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/25' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/30' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/33' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/23' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/35' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/26' 2023-11-28T20:43:35.007 INFO:tasks.workunit.client.0.smithi167.stdout:removed './265/37' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './265' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/21' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/27' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/31' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/36' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/20' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/39' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/34' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/38' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/28' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/24' 2023-11-28T20:43:35.008 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/29' 2023-11-28T20:43:35.009 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/32' 2023-11-28T20:43:35.009 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/22' 2023-11-28T20:43:35.009 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/25' 2023-11-28T20:43:35.009 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/30' 2023-11-28T20:43:35.009 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/33' 2023-11-28T20:43:35.009 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/23' 2023-11-28T20:43:36.210 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/35' 2023-11-28T20:43:36.210 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/26' 2023-11-28T20:43:36.211 INFO:tasks.workunit.client.0.smithi167.stdout:removed './266/37' 2023-11-28T20:43:36.211 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './266' 2023-11-28T20:43:36.211 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/21' 2023-11-28T20:43:36.211 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/27' 2023-11-28T20:43:36.211 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/31' 2023-11-28T20:43:36.212 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/36' 2023-11-28T20:43:36.212 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/20' 2023-11-28T20:43:36.212 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/39' 2023-11-28T20:43:36.212 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/34' 2023-11-28T20:43:36.212 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/38' 2023-11-28T20:43:36.213 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/28' 2023-11-28T20:43:36.213 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/24' 2023-11-28T20:43:36.213 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/29' 2023-11-28T20:43:36.213 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/32' 2023-11-28T20:43:36.213 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/22' 2023-11-28T20:43:36.213 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/25' 2023-11-28T20:43:36.214 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/30' 2023-11-28T20:43:36.214 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/33' 2023-11-28T20:43:36.214 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/23' 2023-11-28T20:43:36.214 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/35' 2023-11-28T20:43:36.214 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/26' 2023-11-28T20:43:36.215 INFO:tasks.workunit.client.0.smithi167.stdout:removed './267/37' 2023-11-28T20:43:36.215 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './267' 2023-11-28T20:43:36.215 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/21' 2023-11-28T20:43:36.215 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/27' 2023-11-28T20:43:36.215 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/31' 2023-11-28T20:43:36.216 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/36' 2023-11-28T20:43:36.216 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/20' 2023-11-28T20:43:36.216 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/39' 2023-11-28T20:43:36.216 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/34' 2023-11-28T20:43:36.216 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/38' 2023-11-28T20:43:36.216 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/28' 2023-11-28T20:43:36.217 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/24' 2023-11-28T20:43:36.217 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/29' 2023-11-28T20:43:36.217 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/32' 2023-11-28T20:43:36.217 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/22' 2023-11-28T20:43:36.217 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/25' 2023-11-28T20:43:36.218 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/30' 2023-11-28T20:43:36.218 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/33' 2023-11-28T20:43:36.218 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/23' 2023-11-28T20:43:36.218 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/35' 2023-11-28T20:43:36.218 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/26' 2023-11-28T20:43:36.219 INFO:tasks.workunit.client.0.smithi167.stdout:removed './268/37' 2023-11-28T20:43:36.219 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './268' 2023-11-28T20:43:36.219 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/21' 2023-11-28T20:43:36.219 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/27' 2023-11-28T20:43:36.219 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/31' 2023-11-28T20:43:36.220 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/36' 2023-11-28T20:43:36.220 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/20' 2023-11-28T20:43:36.220 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/39' 2023-11-28T20:43:36.220 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/34' 2023-11-28T20:43:36.220 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/38' 2023-11-28T20:43:36.221 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/28' 2023-11-28T20:43:36.221 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/24' 2023-11-28T20:43:36.221 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/29' 2023-11-28T20:43:36.221 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/32' 2023-11-28T20:43:36.221 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/22' 2023-11-28T20:43:36.222 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/25' 2023-11-28T20:43:36.222 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/30' 2023-11-28T20:43:36.222 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/33' 2023-11-28T20:43:36.222 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/23' 2023-11-28T20:43:36.222 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/35' 2023-11-28T20:43:36.223 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/26' 2023-11-28T20:43:36.223 INFO:tasks.workunit.client.0.smithi167.stdout:removed './269/37' 2023-11-28T20:43:36.223 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './269' 2023-11-28T20:43:36.223 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/21' 2023-11-28T20:43:36.223 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/27' 2023-11-28T20:43:36.224 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/31' 2023-11-28T20:43:36.224 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/36' 2023-11-28T20:43:36.224 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/20' 2023-11-28T20:43:36.224 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/39' 2023-11-28T20:43:36.224 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/34' 2023-11-28T20:43:36.224 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/38' 2023-11-28T20:43:36.225 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/28' 2023-11-28T20:43:36.225 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/24' 2023-11-28T20:43:36.225 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/29' 2023-11-28T20:43:36.225 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/32' 2023-11-28T20:43:36.225 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/22' 2023-11-28T20:43:36.226 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/25' 2023-11-28T20:43:36.226 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/30' 2023-11-28T20:43:36.226 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/33' 2023-11-28T20:43:36.226 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/23' 2023-11-28T20:43:36.226 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/35' 2023-11-28T20:43:36.227 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/26' 2023-11-28T20:43:36.227 INFO:tasks.workunit.client.0.smithi167.stdout:removed './270/37' 2023-11-28T20:43:36.227 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './270' 2023-11-28T20:43:36.227 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/21' 2023-11-28T20:43:36.227 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/27' 2023-11-28T20:43:36.227 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/31' 2023-11-28T20:43:36.228 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/36' 2023-11-28T20:43:36.228 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/20' 2023-11-28T20:43:36.228 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/39' 2023-11-28T20:43:36.228 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/34' 2023-11-28T20:43:36.228 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/38' 2023-11-28T20:43:36.229 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/28' 2023-11-28T20:43:36.229 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/24' 2023-11-28T20:43:36.229 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/29' 2023-11-28T20:43:36.229 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/32' 2023-11-28T20:43:36.229 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/22' 2023-11-28T20:43:36.229 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/25' 2023-11-28T20:43:36.230 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/30' 2023-11-28T20:43:36.230 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/33' 2023-11-28T20:43:36.230 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/23' 2023-11-28T20:43:36.230 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/35' 2023-11-28T20:43:36.230 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/26' 2023-11-28T20:43:36.230 INFO:tasks.workunit.client.0.smithi167.stdout:removed './271/37' 2023-11-28T20:43:36.231 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './271' 2023-11-28T20:43:36.231 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/21' 2023-11-28T20:43:36.231 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/27' 2023-11-28T20:43:36.231 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/31' 2023-11-28T20:43:36.231 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/36' 2023-11-28T20:43:36.232 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/20' 2023-11-28T20:43:36.232 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/39' 2023-11-28T20:43:36.232 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/34' 2023-11-28T20:43:36.232 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/38' 2023-11-28T20:43:36.232 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/28' 2023-11-28T20:43:36.232 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/24' 2023-11-28T20:43:36.233 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/29' 2023-11-28T20:43:36.233 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/32' 2023-11-28T20:43:36.233 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/22' 2023-11-28T20:43:36.233 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/25' 2023-11-28T20:43:36.233 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/30' 2023-11-28T20:43:36.233 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/33' 2023-11-28T20:43:36.234 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/23' 2023-11-28T20:43:36.234 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/35' 2023-11-28T20:43:36.234 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/26' 2023-11-28T20:43:36.234 INFO:tasks.workunit.client.0.smithi167.stdout:removed './272/37' 2023-11-28T20:43:36.234 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './272' 2023-11-28T20:43:36.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/21' 2023-11-28T20:43:36.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/27' 2023-11-28T20:43:36.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/31' 2023-11-28T20:43:36.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/36' 2023-11-28T20:43:36.235 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/20' 2023-11-28T20:43:36.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/39' 2023-11-28T20:43:36.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/34' 2023-11-28T20:43:36.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/38' 2023-11-28T20:43:36.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/28' 2023-11-28T20:43:36.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/24' 2023-11-28T20:43:36.236 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/29' 2023-11-28T20:43:36.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/32' 2023-11-28T20:43:36.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/22' 2023-11-28T20:43:36.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/25' 2023-11-28T20:43:36.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/30' 2023-11-28T20:43:36.237 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/33' 2023-11-28T20:43:36.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/23' 2023-11-28T20:43:36.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/35' 2023-11-28T20:43:36.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/26' 2023-11-28T20:43:36.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './273/37' 2023-11-28T20:43:36.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './273' 2023-11-28T20:43:36.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/21' 2023-11-28T20:43:36.238 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/27' 2023-11-28T20:43:36.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/31' 2023-11-28T20:43:36.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/36' 2023-11-28T20:43:36.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/20' 2023-11-28T20:43:36.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/39' 2023-11-28T20:43:36.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/34' 2023-11-28T20:43:36.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/38' 2023-11-28T20:43:36.239 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/28' 2023-11-28T20:43:36.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/24' 2023-11-28T20:43:36.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/29' 2023-11-28T20:43:36.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/32' 2023-11-28T20:43:36.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/22' 2023-11-28T20:43:36.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/25' 2023-11-28T20:43:36.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/30' 2023-11-28T20:43:36.240 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/33' 2023-11-28T20:43:36.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/23' 2023-11-28T20:43:36.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/35' 2023-11-28T20:43:36.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/26' 2023-11-28T20:43:36.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './274/37' 2023-11-28T20:43:36.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './274' 2023-11-28T20:43:36.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/21' 2023-11-28T20:43:36.241 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/27' 2023-11-28T20:43:36.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/31' 2023-11-28T20:43:36.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/36' 2023-11-28T20:43:36.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/20' 2023-11-28T20:43:36.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/39' 2023-11-28T20:43:36.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/34' 2023-11-28T20:43:36.242 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/38' 2023-11-28T20:43:36.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/28' 2023-11-28T20:43:36.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/24' 2023-11-28T20:43:36.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/29' 2023-11-28T20:43:36.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/32' 2023-11-28T20:43:36.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/22' 2023-11-28T20:43:36.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/25' 2023-11-28T20:43:36.243 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/30' 2023-11-28T20:43:36.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/33' 2023-11-28T20:43:36.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/23' 2023-11-28T20:43:36.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/35' 2023-11-28T20:43:36.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/26' 2023-11-28T20:43:36.244 INFO:tasks.workunit.client.0.smithi167.stdout:removed './275/37' 2023-11-28T20:43:36.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './275' 2023-11-28T20:43:36.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/21' 2023-11-28T20:43:36.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/27' 2023-11-28T20:43:36.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/31' 2023-11-28T20:43:36.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/36' 2023-11-28T20:43:36.245 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/20' 2023-11-28T20:43:36.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/39' 2023-11-28T20:43:36.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/34' 2023-11-28T20:43:36.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/38' 2023-11-28T20:43:36.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/28' 2023-11-28T20:43:36.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/24' 2023-11-28T20:43:36.246 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/29' 2023-11-28T20:43:36.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/32' 2023-11-28T20:43:36.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/22' 2023-11-28T20:43:36.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/25' 2023-11-28T20:43:36.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/30' 2023-11-28T20:43:36.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/33' 2023-11-28T20:43:36.247 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/23' 2023-11-28T20:43:36.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/35' 2023-11-28T20:43:36.248 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/26' 2023-11-28T20:43:41.416 INFO:tasks.workunit.client.0.smithi167.stdout:removed './276/37' 2023-11-28T20:43:41.416 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './276' 2023-11-28T20:43:41.416 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/21' 2023-11-28T20:43:41.416 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/27' 2023-11-28T20:43:41.416 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/31' 2023-11-28T20:43:41.416 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/36' 2023-11-28T20:43:41.416 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/20' 2023-11-28T20:43:41.416 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/39' 2023-11-28T20:43:41.416 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/34' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/38' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/28' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/24' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/29' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/32' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/22' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/25' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/30' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/33' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/23' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/35' 2023-11-28T20:43:41.417 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/26' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './277/37' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './277' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/21' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/27' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/31' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/36' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/20' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/39' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/34' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/38' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/28' 2023-11-28T20:43:41.418 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/24' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/29' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/32' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/22' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/25' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/30' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/33' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/23' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/35' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/26' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './278/37' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './278' 2023-11-28T20:43:41.419 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/21' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/27' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/31' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/36' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/20' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/39' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/34' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/38' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/28' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/24' 2023-11-28T20:43:41.420 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/29' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/32' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/22' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/25' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/30' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/33' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/23' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/35' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/26' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './279/37' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './279' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/21' 2023-11-28T20:43:41.421 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/27' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/31' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/36' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/20' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/39' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/34' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/38' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/28' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/24' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/29' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/32' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/22' 2023-11-28T20:43:41.422 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/25' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/30' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/33' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/23' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/35' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/26' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './280/37' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './280' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/21' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/27' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/31' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/36' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/20' 2023-11-28T20:43:41.423 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/39' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/34' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/38' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/28' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/24' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/29' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/32' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/22' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/25' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/30' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/33' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/23' 2023-11-28T20:43:41.424 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/35' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/26' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './281/37' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './281' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/21' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/27' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/31' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/36' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/20' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/39' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/34' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/38' 2023-11-28T20:43:41.425 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/28' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/24' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/29' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/32' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/22' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/25' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/30' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/33' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/23' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/35' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/26' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed './282/37' 2023-11-28T20:43:41.426 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './282' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/21' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/27' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/31' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/36' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/20' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/39' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/34' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/38' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/28' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/24' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/29' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/32' 2023-11-28T20:43:41.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/22' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/25' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/30' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/33' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/23' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/35' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/26' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './283/37' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './283' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/21' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/27' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/31' 2023-11-28T20:43:41.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/36' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/20' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/39' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/34' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/38' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/28' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/24' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/29' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/32' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/22' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/25' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/30' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/33' 2023-11-28T20:43:41.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/23' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/35' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/26' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './284/37' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './284' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/21' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/27' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/31' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/36' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/20' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/39' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/34' 2023-11-28T20:43:41.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/38' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/28' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/24' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/29' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/32' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/22' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/25' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/30' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/33' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/23' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/35' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/26' 2023-11-28T20:43:41.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './285/37' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './285' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/21' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/27' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/31' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/36' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/20' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/39' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/34' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/38' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/28' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/24' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/29' 2023-11-28T20:43:41.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/32' 2023-11-28T20:43:41.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/22' 2023-11-28T20:43:41.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/25' 2023-11-28T20:43:41.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/30' 2023-11-28T20:43:41.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/33' 2023-11-28T20:43:41.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/23' 2023-11-28T20:43:41.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/35' 2023-11-28T20:43:41.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/26' 2023-11-28T20:43:41.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './286/37' 2023-11-28T20:43:41.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './286' 2023-11-28T20:43:44.022 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/21' 2023-11-28T20:43:44.022 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/27' 2023-11-28T20:43:44.022 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/31' 2023-11-28T20:43:44.022 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/36' 2023-11-28T20:43:44.022 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/20' 2023-11-28T20:43:44.022 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/39' 2023-11-28T20:43:44.022 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/34' 2023-11-28T20:43:44.022 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/38' 2023-11-28T20:43:44.022 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/28' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/24' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/29' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/32' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/22' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/25' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/30' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/33' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/23' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/35' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/26' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed './287/37' 2023-11-28T20:43:44.023 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './287' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/21' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/27' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/31' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/36' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/20' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/39' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/34' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/38' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/28' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/24' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/29' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/32' 2023-11-28T20:43:44.024 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/22' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/25' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/30' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/33' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/23' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/35' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/26' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './288/37' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './288' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/21' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/27' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/31' 2023-11-28T20:43:44.025 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/36' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/20' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/39' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/34' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/38' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/28' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/24' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/29' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/32' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/22' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/25' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/30' 2023-11-28T20:43:44.026 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/33' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/23' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/35' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/26' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './289/37' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './289' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/21' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/27' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/31' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/36' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/20' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/39' 2023-11-28T20:43:44.027 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/34' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/38' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/28' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/24' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/29' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/32' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/22' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/25' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/30' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/33' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/23' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/35' 2023-11-28T20:43:44.028 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/26' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './290/37' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './290' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/21' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/27' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/31' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/36' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/20' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/39' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/34' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/38' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/28' 2023-11-28T20:43:44.029 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/24' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/29' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/32' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/22' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/25' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/30' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/33' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/23' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/35' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/26' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './291/37' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './291' 2023-11-28T20:43:44.030 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/21' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/27' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/31' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/36' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/20' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/39' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/34' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/38' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/28' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/24' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/29' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/32' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/22' 2023-11-28T20:43:44.031 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/25' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/30' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/33' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/23' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/35' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/26' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './292/37' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './292' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/21' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/27' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/31' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/36' 2023-11-28T20:43:44.032 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/20' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/39' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/34' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/38' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/28' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/24' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/29' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/32' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/22' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/25' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/30' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/33' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/23' 2023-11-28T20:43:44.033 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/35' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/26' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './293/37' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './293' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/21' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/27' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/31' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/36' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/20' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/39' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/34' 2023-11-28T20:43:44.034 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/38' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/28' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/24' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/29' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/32' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/22' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/25' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/30' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/33' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/23' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/35' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/26' 2023-11-28T20:43:44.035 INFO:tasks.workunit.client.0.smithi167.stdout:removed './294/37' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './294' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/21' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/27' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/31' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/36' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/20' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/39' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/34' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/38' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/28' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/24' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/29' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/32' 2023-11-28T20:43:44.036 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/22' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/25' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/30' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/33' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/23' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/35' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/26' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './295/37' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './295' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/21' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/27' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/31' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/36' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/20' 2023-11-28T20:43:44.037 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/39' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/34' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/38' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/28' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/24' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/29' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/32' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/22' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/25' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/30' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/33' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/23' 2023-11-28T20:43:44.038 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/35' 2023-11-28T20:43:44.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/26' 2023-11-28T20:43:44.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './296/37' 2023-11-28T20:43:44.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './296' 2023-11-28T20:43:44.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/21' 2023-11-28T20:43:44.039 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/27' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/31' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/36' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/20' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/39' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/34' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/38' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/28' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/24' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/29' 2023-11-28T20:43:46.674 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/32' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/22' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/25' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/30' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/33' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/23' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/35' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/26' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './297/37' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './297' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/21' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/27' 2023-11-28T20:43:46.675 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/31' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/36' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/20' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/39' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/34' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/38' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/28' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/24' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/29' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/32' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/22' 2023-11-28T20:43:46.676 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/25' 2023-11-28T20:43:46.677 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/30' 2023-11-28T20:43:46.677 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/33' 2023-11-28T20:43:46.677 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/23' 2023-11-28T20:43:46.677 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/35' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/26' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './298/37' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './298' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/21' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/27' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/31' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/36' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/20' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/39' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/34' 2023-11-28T20:43:46.678 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/38' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/28' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/24' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/29' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/32' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/22' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/25' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/30' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/33' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/23' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/35' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/26' 2023-11-28T20:43:46.679 INFO:tasks.workunit.client.0.smithi167.stdout:removed './299/37' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './299' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/19' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/15' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/20' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/12' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/10' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/11' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/16' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/14' 2023-11-28T20:43:46.680 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/18' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/13' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/166/17' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/166' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/19' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/15' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/20' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/12' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/10' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/11' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/16' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/14' 2023-11-28T20:43:46.681 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/18' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/13' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/147/17' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/147' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/19' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/15' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/20' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/12' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/10' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/11' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/16' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/14' 2023-11-28T20:43:46.682 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/18' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/13' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/151/17' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/151' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/19' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/15' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/20' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/12' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/10' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/11' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/16' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/14' 2023-11-28T20:43:46.683 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/18' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/13' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/170/17' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/170' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/19' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/15' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/20' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/12' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/10' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/11' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/16' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/14' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/18' 2023-11-28T20:43:46.684 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/13' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/167/17' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/167' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/19' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/15' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/20' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/12' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/10' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/11' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/16' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/14' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/18' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/13' 2023-11-28T20:43:46.685 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/140/17' 2023-11-28T20:43:46.686 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/140' 2023-11-28T20:43:46.686 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/19' 2023-11-28T20:43:46.686 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/15' 2023-11-28T20:43:46.686 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/20' 2023-11-28T20:43:46.686 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/12' 2023-11-28T20:43:46.686 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/10' 2023-11-28T20:43:46.823 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:46.827 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:47.466 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/11' 2023-11-28T20:43:47.466 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/16' 2023-11-28T20:43:47.466 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/14' 2023-11-28T20:43:47.466 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/18' 2023-11-28T20:43:47.466 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/13' 2023-11-28T20:43:47.466 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/142/17' 2023-11-28T20:43:47.466 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/142' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/19' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/15' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/20' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/12' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/10' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/11' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/16' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/14' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/18' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/13' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/150/17' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/150' 2023-11-28T20:43:47.467 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/19' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/15' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/20' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/12' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/10' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/11' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/16' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/14' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/18' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/13' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/105/17' 2023-11-28T20:43:47.468 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/105' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/19' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/15' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/20' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/12' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/10' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/11' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/16' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/14' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/18' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/13' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/149/17' 2023-11-28T20:43:47.469 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/149' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/19' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/15' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/20' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/12' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/10' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/11' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/16' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/14' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/18' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/13' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/109/17' 2023-11-28T20:43:47.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/109' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/19' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/15' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/20' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/12' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/10' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/11' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/16' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/14' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/18' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/13' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/158/17' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/158' 2023-11-28T20:43:47.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/19' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/15' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/20' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/12' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/10' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/11' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/16' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/14' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/18' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/13' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/106/17' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/106' 2023-11-28T20:43:47.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/19' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/15' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/20' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/12' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/10' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/11' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/16' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/14' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/18' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/13' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/189/17' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/189' 2023-11-28T20:43:47.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/19' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/15' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/20' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/12' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/10' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/11' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/16' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/14' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/18' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/13' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/133/17' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/133' 2023-11-28T20:43:47.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/19' 2023-11-28T20:43:47.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/15' 2023-11-28T20:43:47.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/20' 2023-11-28T20:43:47.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/12' 2023-11-28T20:43:47.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/10' 2023-11-28T20:43:47.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/11' 2023-11-28T20:43:49.326 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:43:49.327 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2023-11-28T20:43:49.327 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T20:43:49.327 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T20:43:49.331 INFO:tasks.ceph.mon.b:Started 2023-11-28T20:43:49.331 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:43:49.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:43:49.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe992b1d640 1 Processor -- start 2023-11-28T20:43:49.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe992b1d640 1 -- start start 2023-11-28T20:43:49.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe992b1d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe98c0cf860 0x7fe98c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:49.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe992b1d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe98c0cfc40 0x7fe98c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:49.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe992b1d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c15ac00 con 0x7fe98c153ae0 2023-11-28T20:43:49.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe992b1d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c0cbd60 con 0x7fe98c0cf860 2023-11-28T20:43:49.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe992b1d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c159ff0 con 0x7fe98c0cfc40 2023-11-28T20:43:49.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe98bfff640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7fe98c0cfc40 msgr2=0x7fe98c0ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:49.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe98bfff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe98c0cfc40 0x7fe98c0ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:49.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe9908b9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe98c0cf860 0x7fe98c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:49.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe9910ba640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe98c153ae0 0x7fe98c15d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35000/0 (socket says 172.21.15.167:35000) 2023-11-28T20:43:49.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe9908b9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe98c0cf860 0x7fe98c0cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53190/0 (socket says 172.21.15.167:53190) 2023-11-28T20:43:49.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe9910ba640 1 -- 172.21.15.167:0/678687789 learned_addr learned my addr 172.21.15.167:0/678687789 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:43:49.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe9908b9640 1 -- 172.21.15.167:0/678687789 >> v2:172.21.15.178:3300/0 conn(0x7fe98c0cfc40 msgr2=0x7fe98c0ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:43:49.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe9908b9640 1 --2- 172.21.15.167:0/678687789 >> v2:172.21.15.178:3300/0 conn(0x7fe98c0cfc40 0x7fe98c0ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:49.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe9908b9640 1 -- 172.21.15.167:0/678687789 >> v1:172.21.15.167:6789/0 conn(0x7fe98c153ae0 legacy=0x7fe98c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:49.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.476+0000 7fe9908b9640 1 -- 172.21.15.167:0/678687789 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c15a2d0 con 0x7fe98c0cf860 2023-11-28T20:43:49.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe9908b9640 1 --2- 172.21.15.167:0/678687789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 0x7fe98c0cb770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0c9c50 tx=0x7fe98001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b00dd1bbf67a8a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:49.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe98b7fe640 1 -- 172.21.15.167:0/678687789 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800ab650 con 0x7fe98c0cf860 2023-11-28T20:43:49.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe98b7fe640 1 -- 172.21.15.167:0/678687789 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9800ab7b0 con 0x7fe98c0cf860 2023-11-28T20:43:49.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe98b7fe640 1 -- 172.21.15.167:0/678687789 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800abb40 con 0x7fe98c0cf860 2023-11-28T20:43:49.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 -- 172.21.15.167:0/678687789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 msgr2=0x7fe98c0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:49.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 --2- 172.21.15.167:0/678687789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 0x7fe98c0cb770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0c9c50 tx=0x7fe98001c450 comp rx=0 tx=0).stop 2023-11-28T20:43:49.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 -- 172.21.15.167:0/678687789 shutdown_connections 2023-11-28T20:43:49.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 --2- 172.21.15.167:0/678687789 >> v2:172.21.15.178:3300/0 conn(0x7fe98c0cfc40 0x7fe98c0ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:49.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 --2- 172.21.15.167:0/678687789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 0x7fe98c0cb770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:49.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 -- 172.21.15.167:0/678687789 >> 172.21.15.167:0/678687789 conn(0x7fe98c06c1f0 msgr2=0x7fe98c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:49.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 -- 172.21.15.167:0/678687789 shutdown_connections 2023-11-28T20:43:49.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 -- 172.21.15.167:0/678687789 wait complete. 2023-11-28T20:43:49.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 Processor -- start 2023-11-28T20:43:49.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.480+0000 7fe992b1d640 1 -- start start 2023-11-28T20:43:49.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe992b1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 0x7fe98c0cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:49.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe992b1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe98c0cfc40 0x7fe98c13fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe992b1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe98c153ae0 0x7fe98c146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe992b1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0ce5f0 con 0x7fe98c0cf860 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe992b1d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0cebb0 con 0x7fe98c0cfc40 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe992b1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0b3a80 con 0x7fe98c153ae0 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe98bfff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe98c0cfc40 msgr2=0x7fe98c13fc80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe98c0cfc40 0x7fe98c13fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9908b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 0x7fe98c0cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9908b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 0x7fe98c0cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53202/0 (socket says 172.21.15.167:53202) 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9908b9640 1 -- 172.21.15.167:0/3600754187 learned_addr learned my addr 172.21.15.167:0/3600754187 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9910ba640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe98c153ae0 0x7fe98c146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9908b9640 1 -- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe98c153ae0 msgr2=0x7fe98c146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:49.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9908b9640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe98c153ae0 0x7fe98c146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9908b9640 1 -- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe98c0cfc40 msgr2=0x7fe98c13fc80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9908b9640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe98c0cfc40 0x7fe98c13fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9908b9640 1 -- 172.21.15.167:0/3600754187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980009420 con 0x7fe98c0cf860 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9908b9640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 0x7fe98c0cf040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe9800ad040 tx=0x7fe98001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9897fa640 1 -- 172.21.15.167:0/3600754187 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800b5810 con 0x7fe98c0cf860 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9897fa640 1 -- 172.21.15.167:0/3600754187 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9800b5970 con 0x7fe98c0cf860 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe9897fa640 1 -- 172.21.15.167:0/3600754187 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800b5d20 con 0x7fe98c0cf860 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c0b3d60 con 0x7fe98c0cf860 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c0ce840 con 0x7fe98c0cf860 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.484+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c067c40 con 0x7fe98c0cf860 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.488+0000 7fe9897fa640 1 -- 172.21.15.167:0/3600754187 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe9800bf410 con 0x7fe98c0cf860 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.488+0000 7fe9897fa640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe970066420 0x7fe9700688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:49.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.488+0000 7fe9897fa640 1 -- 172.21.15.167:0/3600754187 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7fe98011ee90 con 0x7fe98c0cf860 2023-11-28T20:43:49.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.488+0000 7fe98bfff640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe970066420 0x7fe9700688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:49.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.488+0000 7fe98bfff640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe970066420 0x7fe9700688e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe98c14a330 tx=0x7fe978006d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:49.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.492+0000 7fe9897fa640 1 -- 172.21.15.167:0/3600754187 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9800ebf00 con 0x7fe98c0cf860 2023-11-28T20:43:49.611 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/16' 2023-11-28T20:43:49.611 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/14' 2023-11-28T20:43:49.611 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/18' 2023-11-28T20:43:49.611 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/13' 2023-11-28T20:43:49.611 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/173/17' 2023-11-28T20:43:49.612 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/173' 2023-11-28T20:43:49.612 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/19' 2023-11-28T20:43:49.612 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/15' 2023-11-28T20:43:49.612 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/20' 2023-11-28T20:43:49.612 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/12' 2023-11-28T20:43:49.612 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/10' 2023-11-28T20:43:49.612 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/11' 2023-11-28T20:43:49.613 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/16' 2023-11-28T20:43:49.613 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/14' 2023-11-28T20:43:49.613 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/18' 2023-11-28T20:43:49.613 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/13' 2023-11-28T20:43:49.613 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/174/17' 2023-11-28T20:43:49.613 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/174' 2023-11-28T20:43:49.614 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/19' 2023-11-28T20:43:49.614 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/15' 2023-11-28T20:43:49.614 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/20' 2023-11-28T20:43:49.614 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/12' 2023-11-28T20:43:49.614 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/10' 2023-11-28T20:43:49.614 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/11' 2023-11-28T20:43:49.615 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/16' 2023-11-28T20:43:49.615 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/14' 2023-11-28T20:43:49.615 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/18' 2023-11-28T20:43:49.615 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/13' 2023-11-28T20:43:49.615 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/155/17' 2023-11-28T20:43:49.615 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/155' 2023-11-28T20:43:49.616 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/19' 2023-11-28T20:43:49.616 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/15' 2023-11-28T20:43:49.616 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/20' 2023-11-28T20:43:49.616 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/12' 2023-11-28T20:43:49.616 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/10' 2023-11-28T20:43:49.616 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/11' 2023-11-28T20:43:49.617 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/16' 2023-11-28T20:43:49.617 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/14' 2023-11-28T20:43:49.617 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/18' 2023-11-28T20:43:49.617 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/13' 2023-11-28T20:43:49.617 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/114/17' 2023-11-28T20:43:49.617 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/114' 2023-11-28T20:43:49.617 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/19' 2023-11-28T20:43:49.617 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/15' 2023-11-28T20:43:49.617 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/20' 2023-11-28T20:43:49.618 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/12' 2023-11-28T20:43:49.618 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/10' 2023-11-28T20:43:49.618 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/11' 2023-11-28T20:43:49.618 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/16' 2023-11-28T20:43:49.618 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/14' 2023-11-28T20:43:49.618 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/18' 2023-11-28T20:43:49.619 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/13' 2023-11-28T20:43:49.619 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/159/17' 2023-11-28T20:43:49.619 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/159' 2023-11-28T20:43:49.619 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/19' 2023-11-28T20:43:49.619 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/15' 2023-11-28T20:43:49.619 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/20' 2023-11-28T20:43:49.619 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/12' 2023-11-28T20:43:49.620 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/10' 2023-11-28T20:43:49.620 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/11' 2023-11-28T20:43:49.620 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/16' 2023-11-28T20:43:49.620 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/14' 2023-11-28T20:43:49.620 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/18' 2023-11-28T20:43:49.620 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/13' 2023-11-28T20:43:49.620 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/187/17' 2023-11-28T20:43:49.621 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/187' 2023-11-28T20:43:49.621 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/19' 2023-11-28T20:43:49.621 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/15' 2023-11-28T20:43:49.621 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/20' 2023-11-28T20:43:49.621 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/12' 2023-11-28T20:43:49.621 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/10' 2023-11-28T20:43:49.622 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/11' 2023-11-28T20:43:49.622 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/16' 2023-11-28T20:43:49.622 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/14' 2023-11-28T20:43:49.622 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/18' 2023-11-28T20:43:49.622 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/13' 2023-11-28T20:43:49.622 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/185/17' 2023-11-28T20:43:49.623 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/185' 2023-11-28T20:43:49.623 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/19' 2023-11-28T20:43:49.623 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/15' 2023-11-28T20:43:49.623 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/20' 2023-11-28T20:43:49.623 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/12' 2023-11-28T20:43:49.623 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/10' 2023-11-28T20:43:49.623 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/11' 2023-11-28T20:43:49.624 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/16' 2023-11-28T20:43:49.624 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/14' 2023-11-28T20:43:49.624 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/18' 2023-11-28T20:43:49.624 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/13' 2023-11-28T20:43:49.624 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/120/17' 2023-11-28T20:43:49.624 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/120' 2023-11-28T20:43:49.624 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/19' 2023-11-28T20:43:49.625 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/15' 2023-11-28T20:43:49.625 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/20' 2023-11-28T20:43:49.625 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/12' 2023-11-28T20:43:49.625 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/10' 2023-11-28T20:43:49.625 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/11' 2023-11-28T20:43:49.625 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/16' 2023-11-28T20:43:49.625 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/14' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/18' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/13' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/110/17' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/110' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/19' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/15' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/20' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/12' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/10' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/11' 2023-11-28T20:43:49.626 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/16' 2023-11-28T20:43:49.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.700+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe98c075c90 con 0x7fe98c0cf860 2023-11-28T20:43:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.700+0000 7fe9897fa640 1 -- 172.21.15.167:0/3600754187 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fe9800ef520 con 0x7fe98c0cf860 2023-11-28T20:43:49.703 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":44,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:43:49.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.700+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe970066420 msgr2=0x7fe9700688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:49.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.700+0000 7fe992b1d640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe970066420 0x7fe9700688e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe98c14a330 tx=0x7fe978006d90 comp rx=0 tx=0).stop 2023-11-28T20:43:49.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.700+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 msgr2=0x7fe98c0cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:49.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.700+0000 7fe992b1d640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 0x7fe98c0cf040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe9800ad040 tx=0x7fe98001ac90 comp rx=0 tx=0).stop 2023-11-28T20:43:49.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.704+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 shutdown_connections 2023-11-28T20:43:49.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.704+0000 7fe992b1d640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe970066420 0x7fe9700688e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:49.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.704+0000 7fe992b1d640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe98c153ae0 0x7fe98c146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.704+0000 7fe992b1d640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe98c0cfc40 0x7fe98c13fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.704+0000 7fe992b1d640 1 --2- 172.21.15.167:0/3600754187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe98c0cf860 0x7fe98c0cf040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.704+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 >> 172.21.15.167:0/3600754187 conn(0x7fe98c06c1f0 msgr2=0x7fe98c15d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.704+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 shutdown_connections 2023-11-28T20:43:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:49.704+0000 7fe992b1d640 1 -- 172.21.15.167:0/3600754187 wait complete. 2023-11-28T20:43:51.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/14' 2023-11-28T20:43:51.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/18' 2023-11-28T20:43:51.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/13' 2023-11-28T20:43:51.188 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/137/17' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/137' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/19' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/15' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/20' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/12' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/10' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/11' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/16' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/14' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/18' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/13' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/198/17' 2023-11-28T20:43:51.189 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/198' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/19' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/15' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/20' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/12' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/10' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/11' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/16' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/14' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/18' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/13' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/136/17' 2023-11-28T20:43:51.190 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/136' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/19' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/15' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/20' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/12' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/10' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/11' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/16' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/14' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/18' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/13' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/125/17' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/125' 2023-11-28T20:43:51.191 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/19' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/15' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/20' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/12' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/10' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/11' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/16' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/14' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/18' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/13' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/194/17' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/194' 2023-11-28T20:43:51.192 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/19' 2023-11-28T20:43:51.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/15' 2023-11-28T20:43:51.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/20' 2023-11-28T20:43:51.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/12' 2023-11-28T20:43:51.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/10' 2023-11-28T20:43:51.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/11' 2023-11-28T20:43:51.193 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/16' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/14' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/18' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/13' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/119/17' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/119' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/19' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/15' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/20' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/12' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/10' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/11' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/16' 2023-11-28T20:43:51.194 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/14' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/18' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/13' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/157/17' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/157' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/19' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/15' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/20' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/12' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/10' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/11' 2023-11-28T20:43:51.195 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/16' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/14' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/18' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/13' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/172/17' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/172' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/19' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/15' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/20' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/12' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/10' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/11' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/16' 2023-11-28T20:43:51.196 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/14' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/18' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/13' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/186/17' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/186' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/19' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/15' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/20' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/12' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/10' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/11' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/16' 2023-11-28T20:43:51.197 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/14' 2023-11-28T20:43:52.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:43:52.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cfd57640 1 Processor -- start 2023-11-28T20:43:52.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cfd57640 1 -- start start 2023-11-28T20:43:52.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cfd57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815d3b0 0x7f83c8066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cfd57640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c80c8280 con 0x7f83c80aff70 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cfd57640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c80c8910 con 0x7f83c806d530 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cfd57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8066bc0 con 0x7f83c815d3b0 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cdaf3640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f83c80aff70 0x7f83c806b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57654/0 (socket says 172.21.15.167:57654) 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cdaf3640 1 -- 172.21.15.167:0/3355919117 learned_addr learned my addr 172.21.15.167:0/3355919117 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ce2f4640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815d3b0 0x7f83c8066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842139482 0 0) 0x7f83c80c8280 con 0x7f83c80aff70 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b4003530 con 0x7f83c80aff70 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934089714 0 0) 0x7f83b4003530 con 0x7f83c80aff70 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815d3b0 msgr2=0x7f83c8066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815d3b0 0x7f83c8066680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 >> v1:172.21.15.178:6789/0 conn(0x7f83c806d530 legacy=0x7f83c81626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80ca3b0 con 0x7f83c80aff70 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f83c4001680 con 0x7f83c80aff70 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 >> v1:172.21.15.167:6789/0 conn(0x7f83c80aff70 legacy=0x7f83c806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b40047d0 0x7f83b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815d3b0 0x7f83b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8066bc0 con 0x7f83b40039b0 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b400ba40 con 0x7f83b40047d0 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b400bc00 con 0x7f83c815d3b0 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cdaf3640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:52.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83cd2f2640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b40047d0 0x7f83b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.876+0000 7f83ce2f4640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815d3b0 0x7f83b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cdaf3640 1 -- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815d3b0 msgr2=0x7f83b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cdaf3640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815d3b0 0x7f83b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cdaf3640 1 -- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b40047d0 msgr2=0x7f83b4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cdaf3640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b40047d0 0x7f83b4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cdaf3640 1 -- 172.21.15.167:0/3355919117 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4003530 con 0x7f83b40039b0 2023-11-28T20:43:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cdaf3640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83b4003dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f83c400c190 tx=0x7f83c401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f97b56443db25b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4005ae0 con 0x7f83b40039b0 2023-11-28T20:43:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4005c40 con 0x7f83b40039b0 2023-11-28T20:43:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83ccaf1640 1 -- 172.21.15.167:0/3355919117 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c40a5890 con 0x7f83b40039b0 2023-11-28T20:43:52.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cfd57640 1 -- 172.21.15.167:0/3355919117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 msgr2=0x7f83b4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:52.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cfd57640 1 --2- 172.21.15.167:0/3355919117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83b4003dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f83c400c190 tx=0x7f83c401cbb0 comp rx=0 tx=0).stop 2023-11-28T20:43:52.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83ce2f4640 1 -- 172.21.15.167:0/3355919117 reap_dead start 2023-11-28T20:43:52.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cfd57640 1 -- 172.21.15.167:0/3355919117 shutdown_connections 2023-11-28T20:43:52.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cfd57640 1 -- 172.21.15.167:0/3355919117 >> 172.21.15.167:0/3355919117 conn(0x7f83c806ee00 msgr2=0x7f83c806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:52.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.880+0000 7f83cfd57640 1 -- 172.21.15.167:0/3355919117 shutdown_connections 2023-11-28T20:43:52.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cfd57640 1 -- 172.21.15.167:0/3355919117 wait complete. 2023-11-28T20:43:52.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cfd57640 1 Processor -- start 2023-11-28T20:43:52.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cfd57640 1 -- start start 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cfd57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83c80b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cfd57640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c80b04d0 0x7f83c80c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cfd57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815bb20 0x7f83c815bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cfd57640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c815c4e0 con 0x7f83b40039b0 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cfd57640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c81f2c50 con 0x7f83c80b04d0 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cfd57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c81f2ef0 con 0x7f83c815bb20 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cdaf3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83c80b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cdaf3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83c80b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47752/0 (socket says 172.21.15.167:47752) 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cdaf3640 1 -- 172.21.15.167:0/2946388704 learned_addr learned my addr 172.21.15.167:0/2946388704 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cd2f2640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c80b04d0 0x7f83c80c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83ce2f4640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815bb20 0x7f83c815bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cdaf3640 1 -- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815bb20 msgr2=0x7f83c815bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cdaf3640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815bb20 0x7f83c815bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cd2f2640 1 -- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c80b04d0 msgr2=0x7f83c80c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cd2f2640 1 -- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c80b04d0 msgr2=0x7f83c80c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cd2f2640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c80b04d0 0x7f83c80c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cdaf3640 1 -- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c80b04d0 msgr2=0x7f83c80c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cd2f2640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c80b04d0 0x7f83c80c70b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cdaf3640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c80b04d0 0x7f83c80c70b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cdaf3640 1 -- 172.21.15.167:0/2946388704 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c81f31d0 con 0x7f83b40039b0 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83cdaf3640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83c80b1fa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83c401cbf0 tx=0x7f83b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.884+0000 7f83be7fc640 1 -- 172.21.15.167:0/2946388704 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c40b4070 con 0x7f83b40039b0 2023-11-28T20:43:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.888+0000 7f83be7fc640 1 -- 172.21.15.167:0/2946388704 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4005db0 con 0x7f83b40039b0 2023-11-28T20:43:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.888+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c81f34b0 con 0x7f83b40039b0 2023-11-28T20:43:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.888+0000 7f83be7fc640 1 -- 172.21.15.167:0/2946388704 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4001640 con 0x7f83b40039b0 2023-11-28T20:43:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.888+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c81f3a70 con 0x7f83b40039b0 2023-11-28T20:43:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.888+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c8067c40 con 0x7f83b40039b0 2023-11-28T20:43:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.888+0000 7f83be7fc640 1 -- 172.21.15.167:0/2946388704 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83c40a5890 con 0x7f83b40039b0 2023-11-28T20:43:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.888+0000 7f83be7fc640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f83ac0664a0 0x7f83ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.888+0000 7f83be7fc640 1 -- 172.21.15.167:0/2946388704 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f83c411d180 con 0x7f83b40039b0 2023-11-28T20:43:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.888+0000 7f83cd2f2640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f83ac0664a0 0x7f83ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.892+0000 7f83cd2f2640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f83ac0664a0 0x7f83ac068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f83c80c6c10 tx=0x7f83b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:52.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:52.892+0000 7f83be7fc640 1 -- 172.21.15.167:0/2946388704 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83c40ea0c0 con 0x7f83b40039b0 2023-11-28T20:43:53.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f83c8075c90 con 0x7f83b40039b0 2023-11-28T20:43:53.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83be7fc640 1 -- 172.21.15.167:0/2946388704 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f83c40ed6e0 con 0x7f83b40039b0 2023-11-28T20:43:53.098 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":44,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:43:53.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f83ac0664a0 msgr2=0x7f83ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:53.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f83ac0664a0 0x7f83ac068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f83c80c6c10 tx=0x7f83b8009040 comp rx=0 tx=0).stop 2023-11-28T20:43:53.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 msgr2=0x7f83c80b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:53.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83c80b1fa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83c401cbf0 tx=0x7f83b4005800 comp rx=0 tx=0).stop 2023-11-28T20:43:53.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 shutdown_connections 2023-11-28T20:43:53.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f83ac0664a0 0x7f83ac068960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:53.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c815bb20 0x7f83c815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:53.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c80b04d0 0x7f83c80c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:53.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 --2- 172.21.15.167:0/2946388704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83b40039b0 0x7f83c80b1fa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:53.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 >> 172.21.15.167:0/2946388704 conn(0x7f83c806ee00 msgr2=0x7f83c81553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:53.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 shutdown_connections 2023-11-28T20:43:53.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:53.096+0000 7f83cfd57640 1 -- 172.21.15.167:0/2946388704 wait complete. 2023-11-28T20:43:53.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/18' 2023-11-28T20:43:53.427 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/13' 2023-11-28T20:43:53.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/190/17' 2023-11-28T20:43:53.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/190' 2023-11-28T20:43:53.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/19' 2023-11-28T20:43:53.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/15' 2023-11-28T20:43:53.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/20' 2023-11-28T20:43:53.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/12' 2023-11-28T20:43:53.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/10' 2023-11-28T20:43:53.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/11' 2023-11-28T20:43:53.428 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/16' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/14' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/18' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/13' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/104/17' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/104' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/19' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/15' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/20' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/12' 2023-11-28T20:43:53.429 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/10' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/11' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/16' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/14' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/18' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/13' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/164/17' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/164' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/19' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/15' 2023-11-28T20:43:53.430 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/20' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/12' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/10' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/11' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/16' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/14' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/18' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/13' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/112/17' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/112' 2023-11-28T20:43:53.431 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/19' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/15' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/20' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/12' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/10' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/11' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/16' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/14' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/18' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/13' 2023-11-28T20:43:53.432 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/100/17' 2023-11-28T20:43:53.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/100' 2023-11-28T20:43:53.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/19' 2023-11-28T20:43:53.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/15' 2023-11-28T20:43:53.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/20' 2023-11-28T20:43:53.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/12' 2023-11-28T20:43:53.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/10' 2023-11-28T20:43:53.433 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/11' 2023-11-28T20:43:53.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/16' 2023-11-28T20:43:53.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/14' 2023-11-28T20:43:53.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/18' 2023-11-28T20:43:53.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/13' 2023-11-28T20:43:53.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/134/17' 2023-11-28T20:43:53.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/134' 2023-11-28T20:43:53.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/19' 2023-11-28T20:43:53.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/15' 2023-11-28T20:43:53.434 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/20' 2023-11-28T20:43:53.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/12' 2023-11-28T20:43:53.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/10' 2023-11-28T20:43:53.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/11' 2023-11-28T20:43:53.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/16' 2023-11-28T20:43:53.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/14' 2023-11-28T20:43:53.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/18' 2023-11-28T20:43:53.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/13' 2023-11-28T20:43:53.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/115/17' 2023-11-28T20:43:53.435 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/115' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/19' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/15' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/20' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/12' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/10' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/11' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/16' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/14' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/18' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/13' 2023-11-28T20:43:53.436 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/116/17' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/116' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/19' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/15' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/20' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/12' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/10' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/11' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/16' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/14' 2023-11-28T20:43:53.437 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/18' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/13' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/195/17' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/195' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/19' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/15' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/20' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/12' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/10' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/11' 2023-11-28T20:43:53.438 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/16' 2023-11-28T20:43:53.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/14' 2023-11-28T20:43:53.439 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/18' 2023-11-28T20:43:54.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/13' 2023-11-28T20:43:54.332 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/138/17' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/138' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/19' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/15' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/20' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/12' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/10' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/11' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/16' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/14' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/18' 2023-11-28T20:43:54.333 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/13' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/135/17' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/135' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/19' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/15' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/20' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/12' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/10' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/11' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/16' 2023-11-28T20:43:54.334 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/14' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/18' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/13' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/117/17' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/117' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/19' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/15' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/20' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/12' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/10' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/11' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/16' 2023-11-28T20:43:54.335 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/14' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/18' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/13' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/143/17' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/143' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/19' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/15' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/20' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/12' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/10' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/11' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/16' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/14' 2023-11-28T20:43:54.336 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/18' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/13' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/180/17' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/180' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/19' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/15' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/20' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/12' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/10' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/11' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/16' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/14' 2023-11-28T20:43:54.337 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/18' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/13' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/126/17' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/126' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/19' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/15' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/20' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/12' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/10' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/11' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/16' 2023-11-28T20:43:54.338 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/14' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/18' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/13' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/161/17' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/161' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/19' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/15' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/20' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/12' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/10' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/11' 2023-11-28T20:43:54.339 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/16' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/14' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/18' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/13' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/176/17' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/176' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/19' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/15' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/20' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/12' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/10' 2023-11-28T20:43:54.340 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/11' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/16' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/14' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/18' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/13' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/111/17' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/111' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/19' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/15' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/20' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/12' 2023-11-28T20:43:54.341 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/10' 2023-11-28T20:43:54.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/11' 2023-11-28T20:43:54.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/16' 2023-11-28T20:43:54.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/14' 2023-11-28T20:43:54.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/18' 2023-11-28T20:43:54.342 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/13' 2023-11-28T20:43:56.120 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:43:56.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf37879640 1 Processor -- start 2023-11-28T20:43:56.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf37879640 1 -- start start 2023-11-28T20:43:56.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf37879640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbf30151f60 0x7fbf300c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf37879640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf300c5c90 0x7fbf300c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf37879640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3015b220 con 0x7fbf3006a580 2023-11-28T20:43:56.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf37879640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf300c4da0 con 0x7fbf30151f60 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf37879640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf300c60f0 con 0x7fbf300c5c90 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf35615640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbf30151f60 0x7fbf300c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf35615640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbf30151f60 0x7fbf300c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47764/0 (socket says 172.21.15.167:47764) 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf35e16640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbf3006a580 0x7fbf3006ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57656/0 (socket says 172.21.15.167:57656) 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf35615640 1 -- 172.21.15.167:0/3139789539 learned_addr learned my addr 172.21.15.167:0/3139789539 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf34e14640 1 --2- 172.21.15.167:0/3139789539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf300c5c90 0x7fbf300c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf35615640 1 -- 172.21.15.167:0/3139789539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf300c5c90 msgr2=0x7fbf300c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf35615640 1 --2- 172.21.15.167:0/3139789539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf300c5c90 0x7fbf300c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf35615640 1 -- 172.21.15.167:0/3139789539 >> v1:172.21.15.167:6789/0 conn(0x7fbf3006a580 legacy=0x7fbf3006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.256+0000 7fbf35615640 1 -- 172.21.15.167:0/3139789539 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf30152340 con 0x7fbf30151f60 2023-11-28T20:43:56.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf35615640 1 --2- 172.21.15.167:0/3139789539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 0x7fbf300c75c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009870 tx=0x7fbf2c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8866de9811cfc0d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf27fff640 1 -- 172.21.15.167:0/3139789539 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0ac600 con 0x7fbf30151f60 2023-11-28T20:43:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf27fff640 1 -- 172.21.15.167:0/3139789539 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c0a8050 con 0x7fbf30151f60 2023-11-28T20:43:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf27fff640 1 -- 172.21.15.167:0/3139789539 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0ac980 con 0x7fbf30151f60 2023-11-28T20:43:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf37879640 1 -- 172.21.15.167:0/3139789539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 msgr2=0x7fbf300c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf37879640 1 --2- 172.21.15.167:0/3139789539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 0x7fbf300c75c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009870 tx=0x7fbf2c01c4b0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf37879640 1 -- 172.21.15.167:0/3139789539 shutdown_connections 2023-11-28T20:43:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf37879640 1 --2- 172.21.15.167:0/3139789539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf300c5c90 0x7fbf300c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf37879640 1 --2- 172.21.15.167:0/3139789539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 0x7fbf300c75c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf37879640 1 -- 172.21.15.167:0/3139789539 >> 172.21.15.167:0/3139789539 conn(0x7fbf300cb1e0 msgr2=0x7fbf300cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf37879640 1 -- 172.21.15.167:0/3139789539 shutdown_connections 2023-11-28T20:43:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.260+0000 7fbf37879640 1 -- 172.21.15.167:0/3139789539 wait complete. 2023-11-28T20:43:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 Processor -- start 2023-11-28T20:43:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 -- start start 2023-11-28T20:43:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3006a580 0x7fbf3013bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf300c5c90 0x7fbf30148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 0x7fbf3014d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30143860 con 0x7fbf30151f60 2023-11-28T20:43:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30141900 con 0x7fbf300c5c90 2023-11-28T20:43:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30147f50 con 0x7fbf3006a580 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35e16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 0x7fbf3014d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35e16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 0x7fbf3014d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47770/0 (socket says 172.21.15.167:47770) 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35e16640 1 -- 172.21.15.167:0/4238861881 learned_addr learned my addr 172.21.15.167:0/4238861881 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35615640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3006a580 0x7fbf3013bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf34e14640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf300c5c90 0x7fbf30148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf34e14640 1 -- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf300c5c90 msgr2=0x7fbf30148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf34e14640 1 -- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf300c5c90 msgr2=0x7fbf30148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf34e14640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf300c5c90 0x7fbf30148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35e16640 1 -- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3006a580 msgr2=0x7fbf3013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35e16640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3006a580 0x7fbf3013bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf34e14640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf300c5c90 0x7fbf30148210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:43:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35e16640 1 -- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf300c5c90 msgr2=0x7fbf30148210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:43:56.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35e16640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf300c5c90 0x7fbf30148210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35e16640 1 -- 172.21.15.167:0/4238861881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0094d0 con 0x7fbf30151f60 2023-11-28T20:43:56.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf35e16640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 0x7fbf3014d460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c7a0 tx=0x7fbf2800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf25ffb640 1 -- 172.21.15.167:0/4238861881 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800a5e0 con 0x7fbf30151f60 2023-11-28T20:43:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf25ffb640 1 -- 172.21.15.167:0/4238861881 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2800a740 con 0x7fbf30151f60 2023-11-28T20:43:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf25ffb640 1 -- 172.21.15.167:0/4238861881 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800aab0 con 0x7fbf30151f60 2023-11-28T20:43:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3014be30 con 0x7fbf30151f60 2023-11-28T20:43:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.264+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf30146990 con 0x7fbf30151f60 2023-11-28T20:43:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.268+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf300682c0 con 0x7fbf30151f60 2023-11-28T20:43:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.268+0000 7fbf25ffb640 1 -- 172.21.15.167:0/4238861881 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbf2800ac10 con 0x7fbf30151f60 2023-11-28T20:43:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.268+0000 7fbf25ffb640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf14066470 0x7fbf14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.268+0000 7fbf25ffb640 1 -- 172.21.15.167:0/4238861881 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7fbf28083920 con 0x7fbf30151f60 2023-11-28T20:43:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.268+0000 7fbf35615640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf14066470 0x7fbf14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.268+0000 7fbf35615640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf14066470 0x7fbf14068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0ae000 tx=0x7fbf2c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.272+0000 7fbf25ffb640 1 -- 172.21.15.167:0/4238861881 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbf280509a0 con 0x7fbf30151f60 2023-11-28T20:43:56.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/191/17' 2023-11-28T20:43:56.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/191' 2023-11-28T20:43:56.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/19' 2023-11-28T20:43:56.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/15' 2023-11-28T20:43:56.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/20' 2023-11-28T20:43:56.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/12' 2023-11-28T20:43:56.470 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/10' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/11' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/16' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/14' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/18' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/13' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/184/17' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/184' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/19' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/15' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/20' 2023-11-28T20:43:56.471 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/12' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/10' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/11' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/16' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/14' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/18' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/13' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/192/17' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/192' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/19' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/15' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/20' 2023-11-28T20:43:56.472 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/12' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/10' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/11' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/16' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/14' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/18' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/13' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/103/17' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/103' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/19' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/15' 2023-11-28T20:43:56.473 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/20' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/12' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/10' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/11' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/16' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/14' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/18' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/13' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/128/17' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/128' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/19' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/15' 2023-11-28T20:43:56.474 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/20' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/12' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/10' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/11' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/16' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/14' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/18' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/13' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/144/17' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/144' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/19' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/15' 2023-11-28T20:43:56.475 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/20' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/12' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/10' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/11' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/16' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/14' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/18' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/13' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/146/17' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/146' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/19' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/15' 2023-11-28T20:43:56.476 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/20' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/12' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/10' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/11' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/16' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/14' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/18' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/13' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/141/17' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/141' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/19' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/15' 2023-11-28T20:43:56.477 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/20' 2023-11-28T20:43:56.478 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/12' 2023-11-28T20:43:56.478 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/10' 2023-11-28T20:43:56.478 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/11' 2023-11-28T20:43:56.478 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/16' 2023-11-28T20:43:56.478 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/14' 2023-11-28T20:43:56.478 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/18' 2023-11-28T20:43:56.478 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/13' 2023-11-28T20:43:56.478 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/182/17' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/182' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/19' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/15' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/20' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/12' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/10' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/11' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/16' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/14' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/18' 2023-11-28T20:43:56.479 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/13' 2023-11-28T20:43:56.480 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/107/17' 2023-11-28T20:43:56.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.496+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbf3014be30 con 0x7fbf30151f60 2023-11-28T20:43:56.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.496+0000 7fbf25ffb640 1 -- 172.21.15.167:0/4238861881 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7fbf3014be30 con 0x7fbf30151f60 2023-11-28T20:43:56.503 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:43:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf14066470 msgr2=0x7fbf14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf14066470 0x7fbf14068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0ae000 tx=0x7fbf2c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:43:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 msgr2=0x7fbf3014d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 0x7fbf3014d460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c7a0 tx=0x7fbf2800cc60 comp rx=0 tx=0).stop 2023-11-28T20:43:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 shutdown_connections 2023-11-28T20:43:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf14066470 0x7fbf14068930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf30151f60 0x7fbf3014d460 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf300c5c90 0x7fbf30148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 --2- 172.21.15.167:0/4238861881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf3006a580 0x7fbf3013bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 >> 172.21.15.167:0/4238861881 conn(0x7fbf300cb1e0 msgr2=0x7fbf3014fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:56.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 shutdown_connections 2023-11-28T20:43:56.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.500+0000 7fbf37879640 1 -- 172.21.15.167:0/4238861881 wait complete. 2023-11-28T20:43:56.520 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:43:56.521 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:43:56.521 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:43:56.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.660+0000 7f190d9f8640 1 Processor -- start 2023-11-28T20:43:56.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.660+0000 7f190d9f8640 1 -- start start 2023-11-28T20:43:56.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f190d9f8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1908150a20 0x7f1908070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f190d9f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1908072670 0x7f1908159d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f190d9f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1908070420 0x7f19080c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f190d9f8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080721e0 con 0x7f1908150a20 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f190d9f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190806d600 con 0x7f1908072670 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f190d9f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1908071c20 con 0x7f1908070420 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f1906ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1908150a20 0x7f1908070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f1906ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1908150a20 0x7f1908070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47778/0 (socket says 172.21.15.167:47778) 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f1906ffd640 1 -- 172.21.15.167:0/1914300009 learned_addr learned my addr 172.21.15.167:0/1914300009 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f18fe7fc640 1 --2- 172.21.15.167:0/1914300009 >> v2:172.21.15.178:3300/0 conn(0x7f1908072670 0x7f1908159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f19077fe640 1 --2- 172.21.15.167:0/1914300009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1908070420 0x7f19080c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f1906ffd640 1 -- 172.21.15.167:0/1914300009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1908070420 msgr2=0x7f19080c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f1906ffd640 1 --2- 172.21.15.167:0/1914300009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1908070420 0x7f19080c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f1906ffd640 1 -- 172.21.15.167:0/1914300009 >> v2:172.21.15.178:3300/0 conn(0x7f1908072670 msgr2=0x7f1908159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:56.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f1906ffd640 1 --2- 172.21.15.167:0/1914300009 >> v2:172.21.15.178:3300/0 conn(0x7f1908072670 0x7f1908159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.664+0000 7f1906ffd640 1 -- 172.21.15.167:0/1914300009 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080c5640 con 0x7f1908150a20 2023-11-28T20:43:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f1906ffd640 1 --2- 172.21.15.167:0/1914300009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 0x7f1908070bc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f190806d2f0 tx=0x7f18f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d443876feae52b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f19067fc640 1 -- 172.21.15.167:0/1914300009 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00ac630 con 0x7f1908150a20 2023-11-28T20:43:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f19067fc640 1 -- 172.21.15.167:0/1914300009 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f00ac790 con 0x7f1908150a20 2023-11-28T20:43:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f19067fc640 1 -- 172.21.15.167:0/1914300009 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00acb20 con 0x7f1908150a20 2023-11-28T20:43:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 -- 172.21.15.167:0/1914300009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 msgr2=0x7f1908070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 --2- 172.21.15.167:0/1914300009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 0x7f1908070bc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f190806d2f0 tx=0x7f18f001c500 comp rx=0 tx=0).stop 2023-11-28T20:43:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 -- 172.21.15.167:0/1914300009 shutdown_connections 2023-11-28T20:43:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 --2- 172.21.15.167:0/1914300009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1908070420 0x7f19080c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 --2- 172.21.15.167:0/1914300009 >> v2:172.21.15.178:3300/0 conn(0x7f1908072670 0x7f1908159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 --2- 172.21.15.167:0/1914300009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 0x7f1908070bc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 -- 172.21.15.167:0/1914300009 >> 172.21.15.167:0/1914300009 conn(0x7f19080c7c50 msgr2=0x7f19080c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:56.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 -- 172.21.15.167:0/1914300009 shutdown_connections 2023-11-28T20:43:56.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 -- 172.21.15.167:0/1914300009 wait complete. 2023-11-28T20:43:56.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 Processor -- start 2023-11-28T20:43:56.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.668+0000 7f190d9f8640 1 -- start start 2023-11-28T20:43:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1908070420 0x7f19081f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1908072670 0x7f1908159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 0x7f19081483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190814c4c0 con 0x7f1908150a20 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190814cc60 con 0x7f1908072670 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1908159230 con 0x7f1908070420 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f19077fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 0x7f19081483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f19077fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 0x7f19081483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47794/0 (socket says 172.21.15.167:47794) 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f19077fe640 1 -- 172.21.15.167:0/1121731183 learned_addr learned my addr 172.21.15.167:0/1121731183 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f18fe7fc640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1908072670 0x7f1908159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f1906ffd640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1908070420 0x7f19081f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f19077fe640 1 -- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1908070420 msgr2=0x7f19081f0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f19077fe640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1908070420 0x7f19081f0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f19077fe640 1 -- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1908072670 msgr2=0x7f1908159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f19077fe640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1908072670 0x7f1908159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f19077fe640 1 -- 172.21.15.167:0/1121731183 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f00094d0 con 0x7f1908150a20 2023-11-28T20:43:56.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f19077fe640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 0x7f19081483d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1900007e70 tx=0x7f190000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900014620 con 0x7f1908150a20 2023-11-28T20:43:56.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19000147a0 con 0x7f1908150a20 2023-11-28T20:43:56.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900014b50 con 0x7f1908150a20 2023-11-28T20:43:56.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190814e100 con 0x7f1908150a20 2023-11-28T20:43:56.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190814c980 con 0x7f1908150a20 2023-11-28T20:43:56.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908158230 0x7f190814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908074730 con 0x7f1908158230 2023-11-28T20:43:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f1906ffd640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908158230 0x7f190814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f1906ffd640 1 -- 172.21.15.167:0/1121731183 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f190815a280 con 0x7f1908158230 2023-11-28T20:43:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f1906ffd640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908158230 0x7f190814e290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f190806b990 tx=0x7f18f00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00b5600 con 0x7f1908158230 2023-11-28T20:43:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.672+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1900014cb0 con 0x7f1908150a20 2023-11-28T20:43:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.676+0000 7f1904ff9640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18e8066510 0x7f18e80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.676+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f1900084c90 con 0x7f1908150a20 2023-11-28T20:43:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.676+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f18f00b5760 con 0x7f1908158230 2023-11-28T20:43:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.676+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908158230 msgr2=0x7f190814e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.676+0000 7f1904ff9640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908158230 0x7f190814e290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f190806b990 tx=0x7f18f00192a0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.676+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908158230 msgr2=0x7f190814e290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.676+0000 7f1904ff9640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908158230 0x7f190814e290 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.676+0000 7f18fe7fc640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18e8066510 0x7f18e80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.676+0000 7f18fe7fc640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18e8066510 0x7f18e80689d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f190814ddb0 tx=0x7f18f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.680+0000 7f190d9f8640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19080c8290 0x7f1908144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.680+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190814dab0 con 0x7f19080c8290 2023-11-28T20:43:56.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.680+0000 7f1906ffd640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19080c8290 0x7f1908144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.680+0000 7f1906ffd640 1 -- 172.21.15.167:0/1121731183 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f19081593a0 con 0x7f19080c8290 2023-11-28T20:43:56.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.680+0000 7f1906ffd640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19080c8290 0x7f1908144920 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18f001cda0 tx=0x7f19081577e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.680+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00abdf0 con 0x7f19080c8290 2023-11-28T20:43:56.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4981 (secure 0 0 0) 0x7f18f00c4070 con 0x7f19080c8290 2023-11-28T20:43:56.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19080c8290 msgr2=0x7f1908144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f1904ff9640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19080c8290 0x7f1908144920 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18f001cda0 tx=0x7f19081577e0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f1904ff9640 1 -- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19080c8290 msgr2=0x7f1908144920 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:56.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f1904ff9640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19080c8290 0x7f1908144920 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18f001cda0 tx=0x7f19081577e0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.685 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:56.685 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:56.686 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:56.686 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:43:56.686 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 46, 2023-11-28T20:43:56.686 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:56.686 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:56.687 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:56.688 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:56.689 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:56.690 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:56.690 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:56.690 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:56.690 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:56.690 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:56.690 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:56.690 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:56.690 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:56.690 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:56.693 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:56.694 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:56.695 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.696 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:56.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.696 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:56.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.696 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:56.697 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:56.697 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:56.697 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:56.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.697 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:56.698 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:56.698 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.698 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.698 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:56.698 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:56.699 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.699 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.699 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.699 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.699 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:56.699 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:56.700 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:56.700 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:56.700 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:56.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.700 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:56.701 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:56.701 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:56.701 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:56.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.701 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:56.701 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:56.702 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.702 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.702 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.702 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:56.702 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:56.702 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.703 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.703 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.703 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:56.703 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:56.703 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:56.704 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:56.704 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:56.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.705 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:56.705 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:56.705 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:56.705 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:56.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.706 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:56.706 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:56.707 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.707 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:56.707 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:56.708 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.708 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.708 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.708 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:56.708 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:56.708 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:56.709 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.710 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.711 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.712 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:43:56.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.712 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:56.712 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:56.712 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:56.712 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.712 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.712 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:56.713 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:56.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18e8066510 msgr2=0x7f18e80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f190d9f8640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18e8066510 0x7f18e80689d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f190814ddb0 tx=0x7f18f8008040 comp rx=0 tx=0).stop 2023-11-28T20:43:56.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 msgr2=0x7f19081483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f190d9f8640 1 --2- 172.21.15.167:0/1121731183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1908150a20 0x7f19081483d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1900007e70 tx=0x7f190000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f19077fe640 1 -- 172.21.15.167:0/1121731183 reap_dead start 2023-11-28T20:43:56.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f19077fe640 1 -- 172.21.15.167:0/1121731183 reap_dead start 2023-11-28T20:43:56.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 shutdown_connections 2023-11-28T20:43:56.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 >> 172.21.15.167:0/1121731183 conn(0x7f19080c7c50 msgr2=0x7f190814efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:56.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 shutdown_connections 2023-11-28T20:43:56.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.684+0000 7f190d9f8640 1 -- 172.21.15.167:0/1121731183 wait complete. 2023-11-28T20:43:56.715 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:43:56.715 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:43:56.715 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:43:56.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.856+0000 7f7103c79640 1 Processor -- start 2023-11-28T20:43:56.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.856+0000 7f7103c79640 1 -- start start 2023-11-28T20:43:56.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7103c79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cb770 0x7f70fc15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7103c79640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc15ac00 con 0x7f70fc0cf860 2023-11-28T20:43:56.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7103c79640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0cbd60 con 0x7f70fc0cfc40 2023-11-28T20:43:56.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7103c79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc159ff0 con 0x7f70fc0cb770 2023-11-28T20:43:56.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7101a15640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f70fc0cf860 0x7f70fc0ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57664/0 (socket says 172.21.15.167:57664) 2023-11-28T20:43:56.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7101a15640 1 -- 172.21.15.167:0/1229289661 learned_addr learned my addr 172.21.15.167:0/1229289661 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:43:56.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7102216640 1 --2- 172.21.15.167:0/1229289661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cb770 0x7f70fc15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7100a13640 1 -- 172.21.15.167:0/1229289661 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469454465 0 0) 0x7f70fc15ac00 con 0x7f70fc0cf860 2023-11-28T20:43:56.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7100a13640 1 -- 172.21.15.167:0/1229289661 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e8003530 con 0x7f70fc0cf860 2023-11-28T20:43:56.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7102216640 1 -- 172.21.15.167:0/1229289661 >> v1:172.21.15.178:6789/0 conn(0x7f70fc0cfc40 legacy=0x7f70fc153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7102216640 1 -- 172.21.15.167:0/1229289661 >> v1:172.21.15.167:6789/0 conn(0x7f70fc0cf860 legacy=0x7f70fc0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.860+0000 7f7102216640 1 -- 172.21.15.167:0/1229289661 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc15a2d0 con 0x7f70fc0cb770 2023-11-28T20:43:56.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.864+0000 7f7102216640 1 --2- 172.21.15.167:0/1229289661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cb770 0x7f70fc15d4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009dc0 tx=0x7f70f401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c0ec20ea9932a5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7100a13640 1 -- 172.21.15.167:0/1229289661 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40a5a00 con 0x7f70fc0cb770 2023-11-28T20:43:56.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7100a13640 1 -- 172.21.15.167:0/1229289661 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f40a5b60 con 0x7f70fc0cb770 2023-11-28T20:43:56.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7100a13640 1 -- 172.21.15.167:0/1229289661 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40ad440 con 0x7f70fc0cb770 2023-11-28T20:43:56.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7103c79640 1 -- 172.21.15.167:0/1229289661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cb770 msgr2=0x7f70fc15d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7103c79640 1 --2- 172.21.15.167:0/1229289661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cb770 0x7f70fc15d4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009dc0 tx=0x7f70f401c940 comp rx=0 tx=0).stop 2023-11-28T20:43:56.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7103c79640 1 -- 172.21.15.167:0/1229289661 shutdown_connections 2023-11-28T20:43:56.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7103c79640 1 --2- 172.21.15.167:0/1229289661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cb770 0x7f70fc15d4d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7103c79640 1 -- 172.21.15.167:0/1229289661 >> 172.21.15.167:0/1229289661 conn(0x7f70fc06c1f0 msgr2=0x7f70fc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:56.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7103c79640 1 -- 172.21.15.167:0/1229289661 shutdown_connections 2023-11-28T20:43:56.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7103c79640 1 -- 172.21.15.167:0/1229289661 wait complete. 2023-11-28T20:43:56.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7103c79640 1 Processor -- start 2023-11-28T20:43:56.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.872+0000 7f7103c79640 1 -- start start 2023-11-28T20:43:56.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc0cb770 0x7f70fc1f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70fc0cf860 0x7f70fc1483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cfc40 0x7f70fc155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc1f32f0 con 0x7f70fc0cf860 2023-11-28T20:43:56.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc1563d0 con 0x7f70fc0cb770 2023-11-28T20:43:56.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc146040 con 0x7f70fc0cfc40 2023-11-28T20:43:56.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101214640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70fc0cf860 0x7f70fc1483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101214640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70fc0cf860 0x7f70fc1483c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47826/0 (socket says 172.21.15.167:47826) 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101214640 1 -- 172.21.15.167:0/3897414283 learned_addr learned my addr 172.21.15.167:0/3897414283 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101a15640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc0cb770 0x7f70fc1f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7102216640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cfc40 0x7f70fc155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101214640 1 -- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cfc40 msgr2=0x7f70fc155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101214640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cfc40 0x7f70fc155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101214640 1 -- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc0cb770 msgr2=0x7f70fc1f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101214640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc0cb770 0x7f70fc1f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101214640 1 -- 172.21.15.167:0/3897414283 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f4009a70 con 0x7f70fc0cf860 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7102216640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70fc0cfc40 0x7f70fc155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101a15640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc0cb770 0x7f70fc1f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:43:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101214640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70fc0cf860 0x7f70fc1483c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c500 tx=0x7f70ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec005220 con 0x7f70fc0cf860 2023-11-28T20:43:56.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec005380 con 0x7f70fc0cf860 2023-11-28T20:43:56.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec007270 con 0x7f70fc0cf860 2023-11-28T20:43:56.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc1475c0 con 0x7f70fc0cf860 2023-11-28T20:43:56.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc147b80 con 0x7f70fc0cf860 2023-11-28T20:43:56.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc1470f0 0x7f70fc1f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc072860 con 0x7f70fc1470f0 2023-11-28T20:43:56.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101a15640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc1470f0 0x7f70fc1f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f7101a15640 1 -- 172.21.15.167:0/3897414283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70fc159cc0 con 0x7f70fc1470f0 2023-11-28T20:43:56.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.876+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70ec0073d0 con 0x7f70fc0cf860 2023-11-28T20:43:56.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f7101a15640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc1470f0 0x7f70fc1f2bc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000f70 tx=0x7f70f800eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f70f27fc640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f70e0066470 0x7f70e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f70ec083bf0 con 0x7f70fc0cf860 2023-11-28T20:43:56.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80058c0 con 0x7f70fc1470f0 2023-11-28T20:43:56.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f7102216640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f70e0066470 0x7f70e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f70f800eed0 con 0x7f70fc1470f0 2023-11-28T20:43:56.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc1470f0 msgr2=0x7f70fc1f2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f70f27fc640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc1470f0 0x7f70fc1f2bc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000f70 tx=0x7f70f800eb90 comp rx=0 tx=0).stop 2023-11-28T20:43:56.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc1470f0 msgr2=0x7f70fc1f2bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:56.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f70f27fc640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc1470f0 0x7f70fc1f2bc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.880+0000 7f7102216640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f70e0066470 0x7f70e0068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f70f40af000 tx=0x7f70f40a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.884+0000 7f7103c79640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc150a10 0x7f70fc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:56.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.884+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc1f3100 con 0x7f70fc150a10 2023-11-28T20:43:56.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.884+0000 7f7101a15640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc150a10 0x7f70fc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:56.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7101a15640 1 -- 172.21.15.167:0/3897414283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f70fc15d7e0 con 0x7f70fc150a10 2023-11-28T20:43:56.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7101a15640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc150a10 0x7f70fc1545b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000f70 tx=0x7f70f8001160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:56.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8005e60 con 0x7f70fc150a10 2023-11-28T20:43:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7f70f80072e0 con 0x7f70fc150a10 2023-11-28T20:43:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc150a10 msgr2=0x7f70fc1545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f70f27fc640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc150a10 0x7f70fc1545b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000f70 tx=0x7f70f8001160 comp rx=0 tx=0).stop 2023-11-28T20:43:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f70f27fc640 1 -- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc150a10 msgr2=0x7f70fc1545b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f70f27fc640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70fc150a10 0x7f70fc1545b0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000f70 tx=0x7f70f8001160 comp rx=0 tx=0).stop 2023-11-28T20:43:56.891 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 46, 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:56.892 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:56.893 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:56.894 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:56.895 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:56.896 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.897 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:56.899 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:56.901 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.901 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:56.901 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:56.901 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:56.901 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:56.901 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.901 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:56.901 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:56.902 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:56.903 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:56.904 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.905 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:56.906 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:56.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f70e0066470 msgr2=0x7f70e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7103c79640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f70e0066470 0x7f70e0068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f70f40af000 tx=0x7f70f40a7070 comp rx=0 tx=0).stop 2023-11-28T20:43:56.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70fc0cf860 msgr2=0x7f70fc1483c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:56.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7103c79640 1 --2- 172.21.15.167:0/3897414283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70fc0cf860 0x7f70fc1483c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c500 tx=0x7f70ec00c9c0 comp rx=0 tx=0).stop 2023-11-28T20:43:56.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7102216640 1 -- 172.21.15.167:0/3897414283 reap_dead start 2023-11-28T20:43:56.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7102216640 1 -- 172.21.15.167:0/3897414283 reap_dead start 2023-11-28T20:43:56.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 shutdown_connections 2023-11-28T20:43:56.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 >> 172.21.15.167:0/3897414283 conn(0x7f70fc06c1f0 msgr2=0x7f70fc0cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:56.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 shutdown_connections 2023-11-28T20:43:56.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:56.888+0000 7f7103c79640 1 -- 172.21.15.167:0/3897414283 wait complete. 2023-11-28T20:43:56.910 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:43:56.910 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:43:56.910 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:43:57.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1622ed6640 1 Processor -- start 2023-11-28T20:43:57.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1622ed6640 1 -- start start 2023-11-28T20:43:57.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1622ed6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f161c0c6ff0 0x7f161c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1622ed6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f161c0c4510 0x7f161c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1622ed6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c0c48f0 con 0x7f161c150b40 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1622ed6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c0c62f0 con 0x7f161c0c4510 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1622ed6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c0c6ac0 con 0x7f161c0c6ff0 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1621473640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f161c0c4510 0x7f161c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1621473640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f161c0c4510 0x7f161c06a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47834/0 (socket says 172.21.15.167:47834) 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1621473640 1 -- 172.21.15.167:0/1105607092 learned_addr learned my addr 172.21.15.167:0/1105607092 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f161bfff640 1 --2- 172.21.15.167:0/1105607092 >> v2:172.21.15.178:3300/0 conn(0x7f161c0c6ff0 0x7f161c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1621473640 1 -- 172.21.15.167:0/1105607092 >> v2:172.21.15.178:3300/0 conn(0x7f161c0c6ff0 msgr2=0x7f161c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1621473640 1 --2- 172.21.15.167:0/1105607092 >> v2:172.21.15.178:3300/0 conn(0x7f161c0c6ff0 0x7f161c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1621473640 1 -- 172.21.15.167:0/1105607092 >> v1:172.21.15.178:6789/0 conn(0x7f161c150b40 legacy=0x7f161c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:57.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.060+0000 7f1621473640 1 -- 172.21.15.167:0/1105607092 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0c6500 con 0x7f161c0c4510 2023-11-28T20:43:57.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f1621473640 1 --2- 172.21.15.167:0/1105607092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 0x7f161c06a580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f161c0cc270 tx=0x7f161401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c731484bcc57349 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:57.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f161b7fe640 1 -- 172.21.15.167:0/1105607092 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16140a5710 con 0x7f161c0c4510 2023-11-28T20:43:57.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f161b7fe640 1 -- 172.21.15.167:0/1105607092 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16140a5870 con 0x7f161c0c4510 2023-11-28T20:43:57.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f161b7fe640 1 -- 172.21.15.167:0/1105607092 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16140a5c00 con 0x7f161c0c4510 2023-11-28T20:43:57.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f1622ed6640 1 -- 172.21.15.167:0/1105607092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 msgr2=0x7f161c06a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f1622ed6640 1 --2- 172.21.15.167:0/1105607092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 0x7f161c06a580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f161c0cc270 tx=0x7f161401c940 comp rx=0 tx=0).stop 2023-11-28T20:43:57.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f1622ed6640 1 -- 172.21.15.167:0/1105607092 shutdown_connections 2023-11-28T20:43:57.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f1622ed6640 1 --2- 172.21.15.167:0/1105607092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 0x7f161c06a580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f1622ed6640 1 --2- 172.21.15.167:0/1105607092 >> v2:172.21.15.178:3300/0 conn(0x7f161c0c6ff0 0x7f161c157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f1622ed6640 1 -- 172.21.15.167:0/1105607092 >> 172.21.15.167:0/1105607092 conn(0x7f161c0cb1e0 msgr2=0x7f161c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:57.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f1622ed6640 1 -- 172.21.15.167:0/1105607092 shutdown_connections 2023-11-28T20:43:57.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.064+0000 7f1622ed6640 1 -- 172.21.15.167:0/1105607092 wait complete. 2023-11-28T20:43:57.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 Processor -- start 2023-11-28T20:43:57.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 -- start start 2023-11-28T20:43:57.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 0x7f161c162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f161c0c6ff0 0x7f161c1f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c150b40 0x7f161c143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c1f3b00 con 0x7f161c0c4510 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c1f2690 con 0x7f161c0c6ff0 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c1557b0 con 0x7f161c150b40 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1620c72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 0x7f161c162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1620c72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 0x7f161c162ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47842/0 (socket says 172.21.15.167:47842) 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1620c72640 1 -- 172.21.15.167:0/3136535373 learned_addr learned my addr 172.21.15.167:0/3136535373 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f161bfff640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f161c0c6ff0 0x7f161c1f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1621473640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c150b40 0x7f161c143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1620c72640 1 -- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c150b40 msgr2=0x7f161c143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1620c72640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c150b40 0x7f161c143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1620c72640 1 -- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f161c0c6ff0 msgr2=0x7f161c1f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1620c72640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f161c0c6ff0 0x7f161c1f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1620c72640 1 -- 172.21.15.167:0/3136535373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614009b30 con 0x7f161c0c4510 2023-11-28T20:43:57.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1620c72640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 0x7f161c162ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f161000c450 tx=0x7f161000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:57.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610012830 con 0x7f161c0c4510 2023-11-28T20:43:57.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100129b0 con 0x7f161c0c4510 2023-11-28T20:43:57.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c155a90 con 0x7f161c0c4510 2023-11-28T20:43:57.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610012d60 con 0x7f161c0c4510 2023-11-28T20:43:57.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.068+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c1f2950 con 0x7f161c0c4510 2023-11-28T20:43:57.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f1622ed6640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f33b0 0x7f161c143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c1f2800 con 0x7f161c1f33b0 2023-11-28T20:43:57.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f161bfff640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f33b0 0x7f161c143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f161001c460 con 0x7f161c0c4510 2023-11-28T20:43:57.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f161bfff640 1 -- 172.21.15.167:0/3136535373 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f161c157040 con 0x7f161c1f33b0 2023-11-28T20:43:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f161bfff640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f33b0 0x7f161c143d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f161c162d20 tx=0x7f160800f910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f16197fa640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16000664a0 0x7f1600068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f1610084060 con 0x7f161c0c4510 2023-11-28T20:43:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608014870 con 0x7f161c1f33b0 2023-11-28T20:43:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f1621473640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16000664a0 0x7f1600068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f16080149d0 con 0x7f161c1f33b0 2023-11-28T20:43:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f33b0 msgr2=0x7f161c143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f16197fa640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f33b0 0x7f161c143d50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f161c162d20 tx=0x7f160800f910 comp rx=0 tx=0).stop 2023-11-28T20:43:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f33b0 msgr2=0x7f161c143d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f16197fa640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f33b0 0x7f161c143d50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.072+0000 7f1621473640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16000664a0 0x7f1600068960 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f16140ae000 tx=0x7f16140a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f6610 0x7f161c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c074770 con 0x7f161c1f6610 2023-11-28T20:43:57.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f161bfff640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f6610 0x7f161c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f161bfff640 1 -- 172.21.15.167:0/3136535373 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f161c0682c0 con 0x7f161c1f6610 2023-11-28T20:43:57.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f161bfff640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f6610 0x7f161c147690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f160801a000 tx=0x7f16080046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:57.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608020220 con 0x7f161c1f6610 2023-11-28T20:43:57.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4782 (secure 0 0 0) 0x7f1608003620 con 0x7f161c1f6610 2023-11-28T20:43:57.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f6610 msgr2=0x7f161c147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f16197fa640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f6610 0x7f161c147690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f160801a000 tx=0x7f16080046d0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f16197fa640 1 -- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f6610 msgr2=0x7f161c147690 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:43:57.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f16197fa640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f161c1f6610 0x7f161c147690 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f160801a000 tx=0x7f16080046d0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.084 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 46, 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:57.085 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:57.086 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:57.087 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:57.088 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:43:57.089 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.090 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.091 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.092 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:57.093 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.094 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:43:57.095 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.096 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:57.097 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:43:57.098 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:43:57.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:43:57.099 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:43:57.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:43:57.099 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:43:57.099 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:43:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16000664a0 msgr2=0x7f1600068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16000664a0 0x7f1600068960 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f16140ae000 tx=0x7f16140a7070 comp rx=0 tx=0).stop 2023-11-28T20:43:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 msgr2=0x7f161c162ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 --2- 172.21.15.167:0/3136535373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f161c0c4510 0x7f161c162ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f161000c450 tx=0x7f161000c910 comp rx=0 tx=0).stop 2023-11-28T20:43:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1621473640 1 -- 172.21.15.167:0/3136535373 reap_dead start 2023-11-28T20:43:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1621473640 1 -- 172.21.15.167:0/3136535373 reap_dead start 2023-11-28T20:43:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 shutdown_connections 2023-11-28T20:43:57.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 >> 172.21.15.167:0/3136535373 conn(0x7f161c0cb1e0 msgr2=0x7f161c0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:57.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 shutdown_connections 2023-11-28T20:43:57.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.080+0000 7f1622ed6640 1 -- 172.21.15.167:0/3136535373 wait complete. 2023-11-28T20:43:57.105 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:43:57.106 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:43:57.106 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:43:57.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.240+0000 7fc38d1e6640 1 Processor -- start 2023-11-28T20:43:57.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.240+0000 7fc38d1e6640 1 -- start start 2023-11-28T20:43:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc38d1e6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc38806e030 0x7fc3881500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc38d1e6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc388072630 0x7fc3881505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc38d1e6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3881571d0 con 0x7fc388070480 2023-11-28T20:43:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc38d1e6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc388071a90 con 0x7fc38806e030 2023-11-28T20:43:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc38d1e6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3880c70d0 con 0x7fc388072630 2023-11-28T20:43:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc386d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc38806e030 0x7fc3881500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc386d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc38806e030 0x7fc3881500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47846/0 (socket says 172.21.15.167:47846) 2023-11-28T20:43:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc386d9d640 1 -- 172.21.15.167:0/8745346 learned_addr learned my addr 172.21.15.167:0/8745346 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:57.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc38759e640 1 --2- 172.21.15.167:0/8745346 >> v2:172.21.15.178:3300/0 conn(0x7fc388072630 0x7fc3881505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc386d9d640 1 -- 172.21.15.167:0/8745346 >> v2:172.21.15.178:3300/0 conn(0x7fc388072630 msgr2=0x7fc3881505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:57.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc386d9d640 1 --2- 172.21.15.167:0/8745346 >> v2:172.21.15.178:3300/0 conn(0x7fc388072630 0x7fc3881505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc386d9d640 1 -- 172.21.15.167:0/8745346 >> v1:172.21.15.178:6789/0 conn(0x7fc388070480 legacy=0x7fc388071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:43:57.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.244+0000 7fc386d9d640 1 -- 172.21.15.167:0/8745346 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880c73b0 con 0x7fc38806e030 2023-11-28T20:43:57.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc386d9d640 1 --2- 172.21.15.167:0/8745346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc38806e030 0x7fc3881500b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc38806c280 tx=0x7fc37801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be27ec83659478c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:57.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38659c640 1 -- 172.21.15.167:0/8745346 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3780aa5f0 con 0x7fc38806e030 2023-11-28T20:43:57.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38659c640 1 -- 172.21.15.167:0/8745346 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3780aa750 con 0x7fc38806e030 2023-11-28T20:43:57.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38659c640 1 -- 172.21.15.167:0/8745346 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3780aaae0 con 0x7fc38806e030 2023-11-28T20:43:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 -- 172.21.15.167:0/8745346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc38806e030 msgr2=0x7fc3881500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 --2- 172.21.15.167:0/8745346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc38806e030 0x7fc3881500b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc38806c280 tx=0x7fc37801c490 comp rx=0 tx=0).stop 2023-11-28T20:43:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 -- 172.21.15.167:0/8745346 shutdown_connections 2023-11-28T20:43:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 --2- 172.21.15.167:0/8745346 >> v2:172.21.15.178:3300/0 conn(0x7fc388072630 0x7fc3881505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 --2- 172.21.15.167:0/8745346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc38806e030 0x7fc3881500b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 -- 172.21.15.167:0/8745346 >> 172.21.15.167:0/8745346 conn(0x7fc3880cb1e0 msgr2=0x7fc3880cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:57.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 -- 172.21.15.167:0/8745346 shutdown_connections 2023-11-28T20:43:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 -- 172.21.15.167:0/8745346 wait complete. 2023-11-28T20:43:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 Processor -- start 2023-11-28T20:43:57.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 -- start start 2023-11-28T20:43:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc38806e030 0x7fc3881f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc388070480 0x7fc38815f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.248+0000 7fc38d1e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc388072630 0x7fc3881409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38d1e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc388154480 con 0x7fc388072630 2023-11-28T20:43:57.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38d1e6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3881602e0 con 0x7fc388070480 2023-11-28T20:43:57.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38d1e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3881f6bc0 con 0x7fc38806e030 2023-11-28T20:43:57.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc388072630 0x7fc3881409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc388072630 0x7fc3881409e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47850/0 (socket says 172.21.15.167:47850) 2023-11-28T20:43:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38759e640 1 -- 172.21.15.167:0/962942647 learned_addr learned my addr 172.21.15.167:0/962942647 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:43:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc37ffff640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc388070480 0x7fc38815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc386d9d640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc38806e030 0x7fc3881f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38759e640 1 -- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc38806e030 msgr2=0x7fc3881f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38759e640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc38806e030 0x7fc3881f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38759e640 1 -- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc388070480 msgr2=0x7fc38815f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38759e640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc388070480 0x7fc38815f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38759e640 1 -- 172.21.15.167:0/962942647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780094d0 con 0x7fc388072630 2023-11-28T20:43:57.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38759e640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc388072630 0x7fc3881409e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc380007d40 tx=0x7fc38000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:57.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc37f7fe640 1 -- 172.21.15.167:0/962942647 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380014420 con 0x7fc388072630 2023-11-28T20:43:57.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc37f7fe640 1 -- 172.21.15.167:0/962942647 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3800145a0 con 0x7fc388072630 2023-11-28T20:43:57.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3881f6e60 con 0x7fc388072630 2023-11-28T20:43:57.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc37f7fe640 1 -- 172.21.15.167:0/962942647 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380014950 con 0x7fc388072630 2023-11-28T20:43:57.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3881541a0 con 0x7fc388072630 2023-11-28T20:43:57.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3880682c0 con 0x7fc388072630 2023-11-28T20:43:57.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.252+0000 7fc37f7fe640 1 -- 172.21.15.167:0/962942647 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc380014ab0 con 0x7fc388072630 2023-11-28T20:43:57.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.256+0000 7fc37f7fe640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc368066470 0x7fc368068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:43:57.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.256+0000 7fc37f7fe640 1 -- 172.21.15.167:0/962942647 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7fc380084980 con 0x7fc388072630 2023-11-28T20:43:57.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.256+0000 7fc386d9d640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc368066470 0x7fc368068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:43:57.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.256+0000 7fc386d9d640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc368066470 0x7fc368068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc3780ae000 tx=0x7fc3780b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:43:57.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.260+0000 7fc37f7fe640 1 -- 172.21.15.167:0/962942647 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc380051b30 con 0x7fc388072630 2023-11-28T20:43:57.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.488+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fc388075c90 con 0x7fc388072630 2023-11-28T20:43:57.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.488+0000 7fc37f7fe640 1 -- 172.21.15.167:0/962942647 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fc380055150 con 0x7fc388072630 2023-11-28T20:43:57.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc368066470 msgr2=0x7fc368068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc368066470 0x7fc368068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc3780ae000 tx=0x7fc3780b5040 comp rx=0 tx=0).stop 2023-11-28T20:43:57.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc388072630 msgr2=0x7fc3881409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:43:57.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc388072630 0x7fc3881409e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc380007d40 tx=0x7fc38000e4b0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 shutdown_connections 2023-11-28T20:43:57.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc368066470 0x7fc368068930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc388072630 0x7fc3881409e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc388070480 0x7fc38815f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 --2- 172.21.15.167:0/962942647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc38806e030 0x7fc3881f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:43:57.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 >> 172.21.15.167:0/962942647 conn(0x7fc3880cb1e0 msgr2=0x7fc38814e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:43:57.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 shutdown_connections 2023-11-28T20:43:57.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:43:57.492+0000 7fc38d1e6640 1 -- 172.21.15.167:0/962942647 wait complete. 2023-11-28T20:43:57.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:43:58.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/107' 2023-11-28T20:43:58.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/19' 2023-11-28T20:43:58.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/15' 2023-11-28T20:43:58.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/20' 2023-11-28T20:43:58.861 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/12' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/10' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/11' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/16' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/14' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/18' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/13' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/178/17' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/178' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/19' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/15' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/20' 2023-11-28T20:43:58.862 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/12' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/10' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/11' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/16' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/14' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/18' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/13' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/156/17' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/156' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/19' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/15' 2023-11-28T20:43:58.863 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/20' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/12' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/10' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/11' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/16' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/14' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/18' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/13' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/131/17' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/131' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/19' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/15' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/20' 2023-11-28T20:43:58.864 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/12' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/10' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/11' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/16' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/14' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/18' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/13' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/123/17' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/123' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/19' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/15' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/20' 2023-11-28T20:43:58.865 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/12' 2023-11-28T20:43:58.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/10' 2023-11-28T20:43:58.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/11' 2023-11-28T20:43:58.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/16' 2023-11-28T20:43:58.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/14' 2023-11-28T20:43:58.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/18' 2023-11-28T20:43:58.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/13' 2023-11-28T20:43:58.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/160/17' 2023-11-28T20:43:58.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/160' 2023-11-28T20:43:58.866 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/19' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/15' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/20' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/12' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/10' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/11' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/16' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/14' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/18' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/13' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/165/17' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/165' 2023-11-28T20:43:58.867 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/19' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/15' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/20' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/12' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/10' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/11' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/16' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/14' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/18' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/13' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/101/17' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/101' 2023-11-28T20:43:58.868 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/19' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/15' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/20' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/12' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/10' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/11' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/16' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/14' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/18' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/13' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/148/17' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/148' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/19' 2023-11-28T20:43:58.869 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/15' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/20' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/12' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/10' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/11' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/16' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/14' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/18' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/13' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/168/17' 2023-11-28T20:43:58.870 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/168' 2023-11-28T20:44:02.169 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/19' 2023-11-28T20:44:02.169 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/15' 2023-11-28T20:44:02.169 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/20' 2023-11-28T20:44:02.169 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/12' 2023-11-28T20:44:02.170 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/10' 2023-11-28T20:44:02.170 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/11' 2023-11-28T20:44:02.170 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/16' 2023-11-28T20:44:02.170 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/14' 2023-11-28T20:44:02.170 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/18' 2023-11-28T20:44:02.170 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/13' 2023-11-28T20:44:02.171 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/179/17' 2023-11-28T20:44:02.171 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/179' 2023-11-28T20:44:02.171 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/19' 2023-11-28T20:44:02.171 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/15' 2023-11-28T20:44:02.171 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/20' 2023-11-28T20:44:02.171 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/12' 2023-11-28T20:44:02.171 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/10' 2023-11-28T20:44:02.172 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/11' 2023-11-28T20:44:02.172 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/16' 2023-11-28T20:44:02.172 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/14' 2023-11-28T20:44:02.172 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/18' 2023-11-28T20:44:02.172 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/13' 2023-11-28T20:44:02.172 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/132/17' 2023-11-28T20:44:02.172 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/132' 2023-11-28T20:44:02.172 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/19' 2023-11-28T20:44:02.173 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/15' 2023-11-28T20:44:02.173 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/20' 2023-11-28T20:44:02.173 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/12' 2023-11-28T20:44:02.173 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/10' 2023-11-28T20:44:02.173 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/11' 2023-11-28T20:44:02.173 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/16' 2023-11-28T20:44:02.173 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/14' 2023-11-28T20:44:02.173 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/18' 2023-11-28T20:44:02.174 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/13' 2023-11-28T20:44:02.174 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/199/17' 2023-11-28T20:44:02.174 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/199' 2023-11-28T20:44:02.174 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/19' 2023-11-28T20:44:02.174 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/15' 2023-11-28T20:44:02.174 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/20' 2023-11-28T20:44:02.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/12' 2023-11-28T20:44:02.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/10' 2023-11-28T20:44:02.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/11' 2023-11-28T20:44:02.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/16' 2023-11-28T20:44:02.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/14' 2023-11-28T20:44:02.175 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/18' 2023-11-28T20:44:02.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/13' 2023-11-28T20:44:02.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/163/17' 2023-11-28T20:44:02.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/163' 2023-11-28T20:44:02.176 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/19' 2023-11-28T20:44:02.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/15' 2023-11-28T20:44:02.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/20' 2023-11-28T20:44:02.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/12' 2023-11-28T20:44:02.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/10' 2023-11-28T20:44:02.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/11' 2023-11-28T20:44:02.177 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/16' 2023-11-28T20:44:02.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/14' 2023-11-28T20:44:02.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/18' 2023-11-28T20:44:02.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/13' 2023-11-28T20:44:02.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/153/17' 2023-11-28T20:44:02.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/153' 2023-11-28T20:44:02.178 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/19' 2023-11-28T20:44:02.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/15' 2023-11-28T20:44:02.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/20' 2023-11-28T20:44:02.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/12' 2023-11-28T20:44:02.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/10' 2023-11-28T20:44:02.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/11' 2023-11-28T20:44:02.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/16' 2023-11-28T20:44:02.179 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/14' 2023-11-28T20:44:02.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/18' 2023-11-28T20:44:02.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/13' 2023-11-28T20:44:02.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/122/17' 2023-11-28T20:44:02.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/122' 2023-11-28T20:44:02.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/19' 2023-11-28T20:44:02.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/15' 2023-11-28T20:44:02.180 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/20' 2023-11-28T20:44:02.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/12' 2023-11-28T20:44:02.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/10' 2023-11-28T20:44:02.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/11' 2023-11-28T20:44:02.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/16' 2023-11-28T20:44:02.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/14' 2023-11-28T20:44:02.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/18' 2023-11-28T20:44:02.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/13' 2023-11-28T20:44:02.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/162/17' 2023-11-28T20:44:02.181 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/162' 2023-11-28T20:44:02.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/19' 2023-11-28T20:44:02.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/15' 2023-11-28T20:44:02.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/20' 2023-11-28T20:44:02.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/12' 2023-11-28T20:44:02.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/10' 2023-11-28T20:44:02.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/11' 2023-11-28T20:44:02.182 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/16' 2023-11-28T20:44:02.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/14' 2023-11-28T20:44:02.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/18' 2023-11-28T20:44:02.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/13' 2023-11-28T20:44:02.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/197/17' 2023-11-28T20:44:02.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/197' 2023-11-28T20:44:02.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/19' 2023-11-28T20:44:02.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/15' 2023-11-28T20:44:02.183 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/20' 2023-11-28T20:44:02.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/12' 2023-11-28T20:44:02.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/10' 2023-11-28T20:44:02.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/11' 2023-11-28T20:44:02.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/16' 2023-11-28T20:44:02.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/14' 2023-11-28T20:44:02.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/18' 2023-11-28T20:44:02.184 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/13' 2023-11-28T20:44:02.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/113/17' 2023-11-28T20:44:02.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/113' 2023-11-28T20:44:02.185 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/19' 2023-11-28T20:44:03.846 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/15' 2023-11-28T20:44:03.846 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/20' 2023-11-28T20:44:03.846 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/12' 2023-11-28T20:44:03.846 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/10' 2023-11-28T20:44:03.846 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/11' 2023-11-28T20:44:03.846 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/16' 2023-11-28T20:44:03.846 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/14' 2023-11-28T20:44:03.846 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/18' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/13' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/152/17' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/152' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/19' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/15' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/20' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/12' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/10' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/11' 2023-11-28T20:44:03.847 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/16' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/14' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/18' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/13' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/121/17' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/121' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/19' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/15' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/20' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/12' 2023-11-28T20:44:03.848 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/10' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/11' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/16' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/14' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/18' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/13' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/118/17' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/118' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/19' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/15' 2023-11-28T20:44:03.849 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/20' 2023-11-28T20:44:03.850 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/12' 2023-11-28T20:44:03.850 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/10' 2023-11-28T20:44:03.850 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/11' 2023-11-28T20:44:03.850 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/16' 2023-11-28T20:44:03.850 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/14' 2023-11-28T20:44:03.850 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/18' 2023-11-28T20:44:03.850 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/13' 2023-11-28T20:44:03.850 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/196/17' 2023-11-28T20:44:03.850 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/196' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/19' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/15' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/20' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/12' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/10' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/11' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/16' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/14' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/18' 2023-11-28T20:44:03.851 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/13' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/124/17' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/124' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/19' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/15' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/20' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/12' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/10' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/11' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/16' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/14' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/18' 2023-11-28T20:44:03.852 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/13' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/188/17' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/188' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/19' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/15' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/20' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/12' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/10' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/11' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/16' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/14' 2023-11-28T20:44:03.853 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/18' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/13' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/145/17' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/145' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/19' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/15' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/20' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/12' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/10' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/11' 2023-11-28T20:44:03.854 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/16' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/14' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/18' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/13' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/130/17' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/130' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/19' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/15' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/20' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/12' 2023-11-28T20:44:03.855 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/10' 2023-11-28T20:44:03.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/11' 2023-11-28T20:44:03.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/16' 2023-11-28T20:44:03.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/14' 2023-11-28T20:44:03.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/18' 2023-11-28T20:44:03.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/13' 2023-11-28T20:44:03.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/193/17' 2023-11-28T20:44:03.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/193' 2023-11-28T20:44:03.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/19' 2023-11-28T20:44:03.856 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/15' 2023-11-28T20:44:05.786 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/20' 2023-11-28T20:44:05.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/12' 2023-11-28T20:44:05.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/10' 2023-11-28T20:44:05.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/11' 2023-11-28T20:44:05.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/16' 2023-11-28T20:44:05.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/14' 2023-11-28T20:44:05.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/18' 2023-11-28T20:44:05.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/13' 2023-11-28T20:44:05.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/175/17' 2023-11-28T20:44:05.787 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/175' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/19' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/15' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/20' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/12' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/10' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/11' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/16' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/14' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/18' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/13' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/181/17' 2023-11-28T20:44:05.788 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/181' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/19' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/15' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/20' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/12' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/10' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/11' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/16' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/14' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/18' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/13' 2023-11-28T20:44:05.789 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/127/17' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/127' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/19' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/15' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/20' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/12' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/10' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/11' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/16' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/14' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/18' 2023-11-28T20:44:05.790 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/13' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/108/17' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/108' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/19' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/15' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/20' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/12' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/10' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/11' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/16' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/14' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/18' 2023-11-28T20:44:05.791 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/13' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/183/17' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/183' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/19' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/15' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/20' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/12' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/10' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/11' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/16' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/14' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/18' 2023-11-28T20:44:05.792 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/13' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/177/17' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/177' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/19' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/15' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/20' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/12' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/10' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/11' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/16' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/14' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/18' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/13' 2023-11-28T20:44:05.793 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/169/17' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/169' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/19' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/15' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/20' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/12' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/10' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/11' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/16' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/14' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/18' 2023-11-28T20:44:05.794 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/13' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/154/17' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/154' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/19' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/15' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/20' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/12' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/10' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/11' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/16' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/14' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/18' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/13' 2023-11-28T20:44:05.795 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/171/17' 2023-11-28T20:44:05.796 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/171' 2023-11-28T20:44:05.796 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/19' 2023-11-28T20:44:05.796 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/15' 2023-11-28T20:44:05.796 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/20' 2023-11-28T20:44:06.281 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/12' 2023-11-28T20:44:06.281 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/10' 2023-11-28T20:44:06.281 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/11' 2023-11-28T20:44:06.281 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/16' 2023-11-28T20:44:06.281 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/14' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/18' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/13' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/139/17' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/139' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/19' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/15' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/20' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/12' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/10' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/11' 2023-11-28T20:44:06.282 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/16' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/14' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/18' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/13' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/102/17' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/102' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/19' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/15' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/20' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/12' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/10' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/11' 2023-11-28T20:44:06.283 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/16' 2023-11-28T20:44:06.284 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/14' 2023-11-28T20:44:06.284 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/18' 2023-11-28T20:44:06.284 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/13' 2023-11-28T20:44:06.284 INFO:tasks.workunit.client.0.smithi167.stdout:removed './copyofsnap1/test1/129/17' 2023-11-28T20:44:06.284 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1/129' 2023-11-28T20:44:06.284 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1/test1' 2023-11-28T20:44:06.284 INFO:tasks.workunit.client.0.smithi167.stdout:removed directory './copyofsnap1' 2023-11-28T20:44:06.284 INFO:tasks.workunit.client.0.smithi167.stdout:OK 2023-11-28T20:44:06.285 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T20:44:06.285 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T20:44:06.327 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2023-11-28T20:44:06.327 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2023-11-28T20:44:07.188 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2023-11-28T20:44:07.188 INFO:tasks.workunit.client.0.smithi167.stderr:+ touch foo 2023-11-28T20:44:07.192 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod +x foo 2023-11-28T20:44:07.193 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/s 2023-11-28T20:44:07.220 INFO:tasks.workunit.client.0.smithi167.stderr:+ find .snap/s/foo -executable 2023-11-28T20:44:07.220 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep foo 2023-11-28T20:44:07.236 INFO:tasks.workunit.client.0.smithi167.stdout:.snap/s/foo 2023-11-28T20:44:07.236 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir .snap/s 2023-11-28T20:44:07.248 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm foo 2023-11-28T20:44:07.254 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo OK 2023-11-28T20:44:07.255 INFO:tasks.workunit.client.0.smithi167.stdout:OK 2023-11-28T20:44:07.255 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T20:44:07.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T20:44:07.291 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2023-11-28T20:44:07.292 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2023-11-28T20:44:07.515 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:44:07.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:44:07.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.652+0000 7fb2993aa640 1 Processor -- start 2023-11-28T20:44:07.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.652+0000 7fb2993aa640 1 -- start start 2023-11-28T20:44:07.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.652+0000 7fb2993aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29406e030 0x7fb2941500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:07.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.652+0000 7fb2993aa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2941571d0 con 0x7fb294072630 2023-11-28T20:44:07.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.652+0000 7fb2993aa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb294071a90 con 0x7fb294070480 2023-11-28T20:44:07.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.652+0000 7fb2993aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940c70d0 con 0x7fb29406e030 2023-11-28T20:44:07.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2937fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb294072630 0x7fb294160b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46150/0 (socket says 172.21.15.167:46150) 2023-11-28T20:44:07.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2937fe640 1 -- 172.21.15.167:0/2462824657 learned_addr learned my addr 172.21.15.167:0/2462824657 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:44:07.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb292ffd640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29406e030 0x7fb2941500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:07.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604291233 0 0) 0x7fb2941571d0 con 0x7fb294072630 2023-11-28T20:44:07.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb280003530 con 0x7fb294072630 2023-11-28T20:44:07.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030331050 0 0) 0x7fb294071a90 con 0x7fb294070480 2023-11-28T20:44:07.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2941571d0 con 0x7fb294070480 2023-11-28T20:44:07.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834449757 0 0) 0x7fb280003530 con 0x7fb294072630 2023-11-28T20:44:07.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29406e030 msgr2=0x7fb2941500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:07.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29406e030 0x7fb2941500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:07.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 >> v1:172.21.15.178:6789/0 conn(0x7fb294070480 legacy=0x7fb294071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:07.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940c73b0 con 0x7fb294072630 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fb28c001a00 con 0x7fb294072630 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 >> v1:172.21.15.167:6789/0 conn(0x7fb294072630 legacy=0x7fb294160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb280003b40 0x7fb280003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29406e030 0x7fb2800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb280005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940c70d0 con 0x7fb280004d10 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28000ba40 con 0x7fb280003b40 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28000bbb0 con 0x7fb29406e030 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2937fe640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb280005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb292ffd640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb280003b40 0x7fb280003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb28a7fc640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29406e030 0x7fb2800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:07.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2937fe640 1 -- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29406e030 msgr2=0x7fb2800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:07.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2937fe640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29406e030 0x7fb2800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:07.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2937fe640 1 -- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb280003b40 msgr2=0x7fb280003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:07.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2937fe640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb280003b40 0x7fb280003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:07.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.656+0000 7fb2937fe640 1 -- 172.21.15.167:0/2462824657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280003530 con 0x7fb280004d10 2023-11-28T20:44:07.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2937fe640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb280005190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2940c9090 tx=0x7fb28c022070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5332b83a80f08c59 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:07.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0abda0 con 0x7fb280004d10 2023-11-28T20:44:07.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c0af070 con 0x7fb280004d10 2023-11-28T20:44:07.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2927fc640 1 -- 172.21.15.167:0/2462824657 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c007310 con 0x7fb280004d10 2023-11-28T20:44:07.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2993aa640 1 -- 172.21.15.167:0/2462824657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 msgr2=0x7fb280005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:07.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2993aa640 1 --2- 172.21.15.167:0/2462824657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb280005190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb2940c9090 tx=0x7fb28c022070 comp rx=0 tx=0).stop 2023-11-28T20:44:07.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2937fe640 1 -- 172.21.15.167:0/2462824657 reap_dead start 2023-11-28T20:44:07.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2993aa640 1 -- 172.21.15.167:0/2462824657 shutdown_connections 2023-11-28T20:44:07.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2993aa640 1 -- 172.21.15.167:0/2462824657 >> 172.21.15.167:0/2462824657 conn(0x7fb2940cb1e0 msgr2=0x7fb2940cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:07.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2993aa640 1 -- 172.21.15.167:0/2462824657 shutdown_connections 2023-11-28T20:44:07.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2993aa640 1 -- 172.21.15.167:0/2462824657 wait complete. 2023-11-28T20:44:07.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2993aa640 1 Processor -- start 2023-11-28T20:44:07.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.660+0000 7fb2993aa640 1 -- start start 2023-11-28T20:44:07.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2993aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb2941e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:07.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2993aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940c99e0 0x7fb29414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:07.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2993aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29413f8d0 0x7fb29413fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:07.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2993aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940ca850 con 0x7fb280004d10 2023-11-28T20:44:07.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2993aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940ca290 con 0x7fb29413f8d0 2023-11-28T20:44:07.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2993aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940ca570 con 0x7fb2940c99e0 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb292ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb2941e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb292ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb2941e0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33306/0 (socket says 172.21.15.167:33306) 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb292ffd640 1 -- 172.21.15.167:0/323622897 learned_addr learned my addr 172.21.15.167:0/323622897 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb28a7fc640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940c99e0 0x7fb29414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2937fe640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29413f8d0 0x7fb29413fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb292ffd640 1 -- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940c99e0 msgr2=0x7fb29414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb292ffd640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940c99e0 0x7fb29414b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb292ffd640 1 -- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29413f8d0 msgr2=0x7fb29413fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb292ffd640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29413f8d0 0x7fb29413fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb292ffd640 1 -- 172.21.15.167:0/323622897 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2941e0740 con 0x7fb280004d10 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb28a7fc640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940c99e0 0x7fb29414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:44:07.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2937fe640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29413f8d0 0x7fb29413fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:44:07.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb292ffd640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb2941e0f40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb2840119d0 tx=0x7fb284011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:07.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb28bfff640 1 -- 172.21.15.167:0/323622897 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400fb50 con 0x7fb280004d10 2023-11-28T20:44:07.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb28bfff640 1 -- 172.21.15.167:0/323622897 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400fcb0 con 0x7fb280004d10 2023-11-28T20:44:07.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2941e0a20 con 0x7fb280004d10 2023-11-28T20:44:07.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb28bfff640 1 -- 172.21.15.167:0/323622897 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284014440 con 0x7fb280004d10 2023-11-28T20:44:07.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2940c9f50 con 0x7fb280004d10 2023-11-28T20:44:07.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2940682c0 con 0x7fb280004d10 2023-11-28T20:44:07.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.664+0000 7fb28bfff640 1 -- 172.21.15.167:0/323622897 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb28401d400 con 0x7fb280004d10 2023-11-28T20:44:07.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.668+0000 7fb28bfff640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb274066470 0x7fb274068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:07.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.668+0000 7fb28bfff640 1 -- 172.21.15.167:0/323622897 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7fb284084ba0 con 0x7fb280004d10 2023-11-28T20:44:07.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.668+0000 7fb28a7fc640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb274066470 0x7fb274068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:07.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.668+0000 7fb28a7fc640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb274066470 0x7fb274068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb2940c9970 tx=0x7fb27c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:07.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.672+0000 7fb28bfff640 1 -- 172.21.15.167:0/323622897 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb284051cc0 con 0x7fb280004d10 2023-11-28T20:44:07.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb294075c90 con 0x7fb280004d10 2023-11-28T20:44:07.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb28bfff640 1 -- 172.21.15.167:0/323622897 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fb2840552e0 con 0x7fb280004d10 2023-11-28T20:44:07.883 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:44:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb274066470 msgr2=0x7fb274068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb274066470 0x7fb274068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb2940c9970 tx=0x7fb27c009040 comp rx=0 tx=0).stop 2023-11-28T20:44:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 msgr2=0x7fb2941e0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb2941e0f40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb2840119d0 tx=0x7fb284011e90 comp rx=0 tx=0).stop 2023-11-28T20:44:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 shutdown_connections 2023-11-28T20:44:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb274066470 0x7fb274068930 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:07.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29413f8d0 0x7fb29413fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:07.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940c99e0 0x7fb29414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:07.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.880+0000 7fb2993aa640 1 --2- 172.21.15.167:0/323622897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb280004d10 0x7fb2941e0f40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:07.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.884+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 >> 172.21.15.167:0/323622897 conn(0x7fb2940cb1e0 msgr2=0x7fb2940c4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:07.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.884+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 shutdown_connections 2023-11-28T20:44:07.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:07.884+0000 7fb2993aa640 1 -- 172.21.15.167:0/323622897 wait complete. 2023-11-28T20:44:07.904 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:44:07.904 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:44:07.904 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:44:07.904 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:44:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.040+0000 7fa6a4580640 1 Processor -- start 2023-11-28T20:44:08.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.040+0000 7fa6a4580640 1 -- start start 2023-11-28T20:44:08.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a4580640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa69c06e030 0x7fa69c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a4580640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c1571d0 con 0x7fa69c072630 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a4580640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c071a90 con 0x7fa69c070480 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a4580640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69c0c70d0 con 0x7fa69c06e030 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a231c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa69c06e030 0x7fa69c1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a231c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa69c06e030 0x7fa69c1500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33318/0 (socket says 172.21.15.167:33318) 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a231c640 1 -- 172.21.15.167:0/737816560 learned_addr learned my addr 172.21.15.167:0/737816560 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a2b1d640 1 --1- 172.21.15.167:0/737816560 >> v1:172.21.15.167:6789/0 conn(0x7fa69c072630 0x7fa69c160b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46160/0 (socket says 172.21.15.167:46160) 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a231c640 1 -- 172.21.15.167:0/737816560 >> v1:172.21.15.178:6789/0 conn(0x7fa69c070480 legacy=0x7fa69c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a231c640 1 -- 172.21.15.167:0/737816560 >> v1:172.21.15.167:6789/0 conn(0x7fa69c072630 legacy=0x7fa69c160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.044+0000 7fa6a231c640 1 -- 172.21.15.167:0/737816560 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c0c73b0 con 0x7fa69c06e030 2023-11-28T20:44:08.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a231c640 1 --2- 172.21.15.167:0/737816560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c06e030 0x7fa69c1500b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa698006fd0 tx=0x7fa69801e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d12b4fb9a05b4bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a131a640 1 -- 172.21.15.167:0/737816560 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698004230 con 0x7fa69c06e030 2023-11-28T20:44:08.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a131a640 1 -- 172.21.15.167:0/737816560 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6980ab070 con 0x7fa69c06e030 2023-11-28T20:44:08.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a131a640 1 -- 172.21.15.167:0/737816560 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980a7870 con 0x7fa69c06e030 2023-11-28T20:44:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a4580640 1 -- 172.21.15.167:0/737816560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c06e030 msgr2=0x7fa69c1500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a4580640 1 --2- 172.21.15.167:0/737816560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c06e030 0x7fa69c1500b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa698006fd0 tx=0x7fa69801e9a0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a4580640 1 -- 172.21.15.167:0/737816560 shutdown_connections 2023-11-28T20:44:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a4580640 1 --2- 172.21.15.167:0/737816560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c06e030 0x7fa69c1500b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a4580640 1 -- 172.21.15.167:0/737816560 >> 172.21.15.167:0/737816560 conn(0x7fa69c0cb1e0 msgr2=0x7fa69c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a4580640 1 -- 172.21.15.167:0/737816560 shutdown_connections 2023-11-28T20:44:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a4580640 1 -- 172.21.15.167:0/737816560 wait complete. 2023-11-28T20:44:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a4580640 1 Processor -- start 2023-11-28T20:44:08.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.048+0000 7fa6a4580640 1 -- start start 2023-11-28T20:44:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa69c06e030 0x7fa69c1f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa69c070480 0x7fa69c143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c072630 0x7fa69c143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c1576c0 con 0x7fa69c072630 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c157980 con 0x7fa69c070480 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c157c60 con 0x7fa69c06e030 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a2b1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c072630 0x7fa69c143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a2b1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c072630 0x7fa69c143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33324/0 (socket says 172.21.15.167:33324) 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a2b1d640 1 -- 172.21.15.167:0/1229606322 learned_addr learned my addr 172.21.15.167:0/1229606322 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a231c640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa69c06e030 0x7fa69c1f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a1b1b640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa69c070480 0x7fa69c143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a2b1d640 1 -- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa69c06e030 msgr2=0x7fa69c1f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a2b1d640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa69c06e030 0x7fa69c1f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a2b1d640 1 -- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa69c070480 msgr2=0x7fa69c143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a2b1d640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa69c070480 0x7fa69c143550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a2b1d640 1 -- 172.21.15.167:0/1229606322 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69800b780 con 0x7fa69c072630 2023-11-28T20:44:08.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a2b1d640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c072630 0x7fa69c143a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa69400c7a0 tx=0x7fa69400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400a640 con 0x7fa69c072630 2023-11-28T20:44:08.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69400a7a0 con 0x7fa69c072630 2023-11-28T20:44:08.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69c157f40 con 0x7fa69c072630 2023-11-28T20:44:08.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400ab10 con 0x7fa69c072630 2023-11-28T20:44:08.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69c158500 con 0x7fa69c072630 2023-11-28T20:44:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c15f1e0 0x7fa69c148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c074770 con 0x7fa69c15f1e0 2023-11-28T20:44:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a231c640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c15f1e0 0x7fa69c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a231c640 1 -- 172.21.15.167:0/1229606322 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa69c0723f0 con 0x7fa69c15f1e0 2023-11-28T20:44:08.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa6a231c640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c15f1e0 0x7fa69c148870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa69c06c280 tx=0x7fa69801b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.052+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980a7bc0 con 0x7fa69c15f1e0 2023-11-28T20:44:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa698003620 con 0x7fa69c15f1e0 2023-11-28T20:44:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c15f1e0 msgr2=0x7fa69c148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa692ffd640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c15f1e0 0x7fa69c148870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa69c06c280 tx=0x7fa69801b740 comp rx=0 tx=0).stop 2023-11-28T20:44:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c15f1e0 msgr2=0x7fa69c148870 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa692ffd640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c15f1e0 0x7fa69c148870 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa69c06c280 tx=0x7fa69801b740 comp rx=0 tx=0).stop 2023-11-28T20:44:08.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa69400ac70 con 0x7fa69c072630 2023-11-28T20:44:08.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa692ffd640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa680066220 0x7fa6800686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7fa694083a10 con 0x7fa69c072630 2023-11-28T20:44:08.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa6a231c640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa680066220 0x7fa6800686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.056+0000 7fa6a231c640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa680066220 0x7fa6800686e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa69c06d0d0 tx=0x7fa6980b3030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.060+0000 7fa6a4580640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c156c40 0x7fa69c148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.060+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0682c0 con 0x7fa69c156c40 2023-11-28T20:44:08.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.060+0000 7fa6a1b1b640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c156c40 0x7fa69c148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.060+0000 7fa6a1b1b640 1 -- 172.21.15.167:0/1229606322 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa69c075c90 con 0x7fa69c156c40 2023-11-28T20:44:08.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.060+0000 7fa6a1b1b640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c156c40 0x7fa69c148db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa69c1441d0 tx=0x7fa68c00e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0052e0 con 0x7fa69c156c40 2023-11-28T20:44:08.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4982 (secure 0 0 0) 0x7fa68c005440 con 0x7fa69c156c40 2023-11-28T20:44:08.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c156c40 msgr2=0x7fa69c148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa692ffd640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c156c40 0x7fa69c148db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa69c1441d0 tx=0x7fa68c00e890 comp rx=0 tx=0).stop 2023-11-28T20:44:08.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa692ffd640 1 -- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c156c40 msgr2=0x7fa69c148db0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:08.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa692ffd640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c156c40 0x7fa69c148db0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa69c1441d0 tx=0x7fa68c00e890 comp rx=0 tx=0).stop 2023-11-28T20:44:08.066 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:44:08.066 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:44:08.066 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:44:08.066 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:44:08.066 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 46, 2023-11-28T20:44:08.066 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:44:08.066 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:44:08.066 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:44:08.066 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:08.067 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:08.068 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:44:08.069 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:08.070 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.071 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:44:08.072 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:08.073 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:44:08.074 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:08.075 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:08.077 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.078 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.079 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.080 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:44:08.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.081 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.081 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.081 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:44:08.081 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.081 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.081 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:44:08.081 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:44:08.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa680066220 msgr2=0x7fa6800686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a4580640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa680066220 0x7fa6800686e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa69c06d0d0 tx=0x7fa6980b3030 comp rx=0 tx=0).stop 2023-11-28T20:44:08.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c072630 msgr2=0x7fa69c143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a4580640 1 --2- 172.21.15.167:0/1229606322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa69c072630 0x7fa69c143a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa69400c7a0 tx=0x7fa69400cc60 comp rx=0 tx=0).stop 2023-11-28T20:44:08.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a2b1d640 1 -- 172.21.15.167:0/1229606322 reap_dead start 2023-11-28T20:44:08.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a2b1d640 1 -- 172.21.15.167:0/1229606322 reap_dead start 2023-11-28T20:44:08.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 shutdown_connections 2023-11-28T20:44:08.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 >> 172.21.15.167:0/1229606322 conn(0x7fa69c0cb1e0 msgr2=0x7fa69c0c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:08.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 shutdown_connections 2023-11-28T20:44:08.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.064+0000 7fa6a4580640 1 -- 172.21.15.167:0/1229606322 wait complete. 2023-11-28T20:44:08.084 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:44:08.084 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:44:08.085 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:44:08.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.220+0000 7f5ef8479640 1 Processor -- start 2023-11-28T20:44:08.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef8479640 1 -- start start 2023-11-28T20:44:08.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef8479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ef0150b40 0x7f5ef0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef8479640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ef00c4510 0x7f5ef006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef8479640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef00c4940 con 0x7f5ef00c6ff0 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef8479640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef00c62f0 con 0x7f5ef00c4510 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef8479640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00c6ac0 con 0x7f5ef0150b40 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef6a16640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ef00c4510 0x7f5ef006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef6a16640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ef00c4510 0x7f5ef006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33354/0 (socket says 172.21.15.167:33354) 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1464792650 learned_addr learned my addr 172.21.15.167:0/1464792650 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef6215640 1 --2- 172.21.15.167:0/1464792650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ef0150b40 0x7f5ef0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1464792650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ef0150b40 msgr2=0x7f5ef0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef6a16640 1 --2- 172.21.15.167:0/1464792650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ef0150b40 0x7f5ef0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1464792650 >> v1:172.21.15.178:6789/0 conn(0x7f5ef00c6ff0 legacy=0x7f5ef00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.224+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1464792650 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00c6500 con 0x7f5ef00c4510 2023-11-28T20:44:08.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef6a16640 1 --2- 172.21.15.167:0/1464792650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef00c4510 0x7f5ef006a580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009e50 tx=0x7f5ee801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761a0b24773ca770 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef5213640 1 -- 172.21.15.167:0/1464792650 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80a57c0 con 0x7f5ef00c4510 2023-11-28T20:44:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef5213640 1 -- 172.21.15.167:0/1464792650 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee80a5920 con 0x7f5ef00c4510 2023-11-28T20:44:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef5213640 1 -- 172.21.15.167:0/1464792650 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80a5cb0 con 0x7f5ef00c4510 2023-11-28T20:44:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 -- 172.21.15.167:0/1464792650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef00c4510 msgr2=0x7f5ef006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 --2- 172.21.15.167:0/1464792650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef00c4510 0x7f5ef006a580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009e50 tx=0x7f5ee801c9e0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 -- 172.21.15.167:0/1464792650 shutdown_connections 2023-11-28T20:44:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 --2- 172.21.15.167:0/1464792650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef00c4510 0x7f5ef006a580 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 --2- 172.21.15.167:0/1464792650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ef0150b40 0x7f5ef0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 -- 172.21.15.167:0/1464792650 >> 172.21.15.167:0/1464792650 conn(0x7f5ef00cb1e0 msgr2=0x7f5ef00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 -- 172.21.15.167:0/1464792650 shutdown_connections 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 -- 172.21.15.167:0/1464792650 wait complete. 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 Processor -- start 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.228+0000 7f5ef8479640 1 -- start start 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef00c4510 0x7f5ef0160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ef00c6ff0 0x7f5ef01f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef0150b40 0x7f5ef01f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0158790 con 0x7f5ef0150b40 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0158a70 con 0x7f5ef00c4510 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00c9bd0 con 0x7f5ef00c6ff0 2023-11-28T20:44:08.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6a16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef0150b40 0x7f5ef01f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6a16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef0150b40 0x7f5ef01f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33370/0 (socket says 172.21.15.167:33370) 2023-11-28T20:44:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1446742621 learned_addr learned my addr 172.21.15.167:0/1446742621 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6215640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef00c4510 0x7f5ef0160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef5a14640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ef00c6ff0 0x7f5ef01f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ef00c6ff0 msgr2=0x7f5ef01f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6a16640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ef00c6ff0 0x7f5ef01f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef00c4510 msgr2=0x7f5ef0160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6a16640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef00c4510 0x7f5ef0160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1446742621 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009b30 con 0x7f5ef0150b40 2023-11-28T20:44:08.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6215640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef00c4510 0x7f5ef0160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:44:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6a16640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef0150b40 0x7f5ef01f32f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ee801a610 tx=0x7f5ee8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80b8670 con 0x7f5ef0150b40 2023-11-28T20:44:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee80b87d0 con 0x7f5ef0150b40 2023-11-28T20:44:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef0157b30 con 0x7f5ef0150b40 2023-11-28T20:44:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80b8b60 con 0x7f5ef0150b40 2023-11-28T20:44:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef0157df0 con 0x7f5ef0150b40 2023-11-28T20:44:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef0157fe0 0x7f5ef015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0074770 con 0x7f5ef0157fe0 2023-11-28T20:44:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6215640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef0157fe0 0x7f5ef015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ef6215640 1 -- 172.21.15.167:0/1446742621 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ef0157040 con 0x7f5ef0157fe0 2023-11-28T20:44:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.232+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ee80b8cc0 con 0x7f5ef0150b40 2023-11-28T20:44:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ef6215640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef0157fe0 0x7f5ef015a960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00f550 tx=0x7f5eec00fa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ee6ffd640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5ed4066470 0x7f5ed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f5ee811f890 con 0x7f5ef0150b40 2023-11-28T20:44:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec004020 con 0x7f5ef0157fe0 2023-11-28T20:44:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ef5a14640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5ed4066470 0x7f5ed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f5eec004180 con 0x7f5ef0157fe0 2023-11-28T20:44:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef0157fe0 msgr2=0x7f5ef015a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ee6ffd640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef0157fe0 0x7f5ef015a960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00f550 tx=0x7f5eec00fa10 comp rx=0 tx=0).stop 2023-11-28T20:44:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef0157fe0 msgr2=0x7f5ef015a960 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ee6ffd640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef0157fe0 0x7f5ef015a960 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00f550 tx=0x7f5eec00fa10 comp rx=0 tx=0).stop 2023-11-28T20:44:08.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.236+0000 7f5ef5a14640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5ed4066470 0x7f5ed4068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00ca5b0 tx=0x7f5ee0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.240+0000 7f5ef8479640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef014b440 0x7f5ef014b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.240+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00682c0 con 0x7f5ef014b440 2023-11-28T20:44:08.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.240+0000 7f5ef6215640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef014b440 0x7f5ef014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef6215640 1 -- 172.21.15.167:0/1446742621 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5ef01588d0 con 0x7f5ef014b440 2023-11-28T20:44:08.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef6215640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef014b440 0x7f5ef014b850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00f550 tx=0x7f5eec0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec014c20 con 0x7f5ef014b440 2023-11-28T20:44:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f5eec014d80 con 0x7f5ef014b440 2023-11-28T20:44:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef014b440 msgr2=0x7f5ef014b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ee6ffd640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef014b440 0x7f5ef014b850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00f550 tx=0x7f5eec0046d0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ee6ffd640 1 -- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef014b440 msgr2=0x7f5ef014b850 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:08.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ee6ffd640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ef014b440 0x7f5ef014b850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.247 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:44:08.248 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:44:08.248 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:44:08.248 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:44:08.248 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 46, 2023-11-28T20:44:08.248 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:44:08.248 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:44:08.248 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:44:08.248 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:44:08.249 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.249 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:44:08.249 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:08.249 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:44:08.249 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:44:08.249 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:08.249 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:08.249 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:08.249 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:08.250 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:08.250 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:08.250 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:08.250 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:08.250 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:08.250 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:08.250 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.250 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:44:08.250 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:44:08.251 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:08.251 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:08.251 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:08.251 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:08.251 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:08.251 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:08.251 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:08.251 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:08.252 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:08.252 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:08.252 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.252 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:44:08.252 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:44:08.252 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:44:08.252 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:44:08.253 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:44:08.254 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:44:08.254 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:08.254 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:44:08.254 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:08.254 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:08.254 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:08.254 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:08.254 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:44:08.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:08.257 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:08.258 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:08.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.258 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:44:08.258 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:44:08.258 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:08.258 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:08.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.258 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:44:08.260 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:44:08.261 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.262 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.263 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:44:08.263 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:44:08.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.263 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.263 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.263 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:08.263 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.263 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.264 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:44:08.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.264 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.264 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.264 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:08.264 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.264 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.264 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:44:08.265 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:44:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5ed4066470 msgr2=0x7f5ed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef8479640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5ed4066470 0x7f5ed4068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00ca5b0 tx=0x7f5ee0009040 comp rx=0 tx=0).stop 2023-11-28T20:44:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef0150b40 msgr2=0x7f5ef01f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef8479640 1 --2- 172.21.15.167:0/1446742621 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ef0150b40 0x7f5ef01f32f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ee801a610 tx=0x7f5ee8019780 comp rx=0 tx=0).stop 2023-11-28T20:44:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1446742621 reap_dead start 2023-11-28T20:44:08.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef6a16640 1 -- 172.21.15.167:0/1446742621 reap_dead start 2023-11-28T20:44:08.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 shutdown_connections 2023-11-28T20:44:08.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 >> 172.21.15.167:0/1446742621 conn(0x7f5ef00cb1e0 msgr2=0x7f5ef0154f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:08.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 shutdown_connections 2023-11-28T20:44:08.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.244+0000 7f5ef8479640 1 -- 172.21.15.167:0/1446742621 wait complete. 2023-11-28T20:44:08.267 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:44:08.267 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:44:08.268 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:44:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400d1c4640 1 Processor -- start 2023-11-28T20:44:08.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400d1c4640 1 -- start start 2023-11-28T20:44:08.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400d1c4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4008157560 0x7f40080c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400d1c4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4008157940 con 0x7f40080c6ff0 2023-11-28T20:44:08.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400d1c4640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40080c6ac0 con 0x7f4008150b40 2023-11-28T20:44:08.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400d1c4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40080c62f0 con 0x7f4008157560 2023-11-28T20:44:08.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f3ffe59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f40080c6ff0 0x7f400806a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46174/0 (socket says 172.21.15.167:46174) 2023-11-28T20:44:08.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f3ffe59c640 1 -- 172.21.15.167:0/3740779533 learned_addr learned my addr 172.21.15.167:0/3740779533 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:44:08.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400759e640 1 --2- 172.21.15.167:0/3740779533 >> v2:172.21.15.167:3300/0 conn(0x7f4008157560 0x7f40080c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400759e640 1 -- 172.21.15.167:0/3740779533 >> v1:172.21.15.178:6789/0 conn(0x7f4008150b40 legacy=0x7f40080c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400759e640 1 -- 172.21.15.167:0/3740779533 >> v1:172.21.15.167:6789/0 conn(0x7f40080c6ff0 legacy=0x7f400806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400759e640 1 -- 172.21.15.167:0/3740779533 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080c6500 con 0x7f4008157560 2023-11-28T20:44:08.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.404+0000 7f400659c640 1 -- 172.21.15.167:0/3740779533 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901518920 0 0) 0x7f4008157940 con 0x7f40080c6ff0 2023-11-28T20:44:08.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400759e640 1 --2- 172.21.15.167:0/3740779533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 0x7f40080c4510 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f40000097c0 tx=0x7f400001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80317450dcd31fce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400659c640 1 -- 172.21.15.167:0/3740779533 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40000a8970 con 0x7f4008157560 2023-11-28T20:44:08.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400659c640 1 -- 172.21.15.167:0/3740779533 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40000a8ad0 con 0x7f4008157560 2023-11-28T20:44:08.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400659c640 1 -- 172.21.15.167:0/3740779533 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40000a8e60 con 0x7f4008157560 2023-11-28T20:44:08.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400d1c4640 1 -- 172.21.15.167:0/3740779533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 msgr2=0x7f40080c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400d1c4640 1 --2- 172.21.15.167:0/3740779533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 0x7f40080c4510 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f40000097c0 tx=0x7f400001ec70 comp rx=0 tx=0).stop 2023-11-28T20:44:08.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400d1c4640 1 -- 172.21.15.167:0/3740779533 shutdown_connections 2023-11-28T20:44:08.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400d1c4640 1 --2- 172.21.15.167:0/3740779533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 0x7f40080c4510 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400d1c4640 1 -- 172.21.15.167:0/3740779533 >> 172.21.15.167:0/3740779533 conn(0x7f40080cb1e0 msgr2=0x7f40080cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:08.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400d1c4640 1 -- 172.21.15.167:0/3740779533 shutdown_connections 2023-11-28T20:44:08.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.408+0000 7f400d1c4640 1 -- 172.21.15.167:0/3740779533 wait complete. 2023-11-28T20:44:08.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 Processor -- start 2023-11-28T20:44:08.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 -- start start 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40080c6ff0 0x7f40081591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008150b40 0x7f40080c1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 0x7f40081f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40080ba2e0 con 0x7f4008157560 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40080c1a60 con 0x7f4008150b40 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40081ef1a0 con 0x7f40080c6ff0 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 0x7f40081f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 0x7f40081f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33394/0 (socket says 172.21.15.167:33394) 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400759e640 1 -- 172.21.15.167:0/2155673463 learned_addr learned my addr 172.21.15.167:0/2155673463 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:08.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f3ffe59c640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008150b40 0x7f40080c1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f4006d9d640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40080c6ff0 0x7f40081591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400759e640 1 -- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40080c6ff0 msgr2=0x7f40081591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400759e640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40080c6ff0 0x7f40081591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400759e640 1 -- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008150b40 msgr2=0x7f40080c1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400759e640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008150b40 0x7f40080c1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400759e640 1 -- 172.21.15.167:0/2155673463 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000009420 con 0x7f4008157560 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f4006d9d640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40080c6ff0 0x7f40081591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f3ffe59c640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008150b40 0x7f40080c1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400759e640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 0x7f40081f2710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f40000b3040 tx=0x7f400001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40000b0e20 con 0x7f4008157560 2023-11-28T20:44:08.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40000b9410 con 0x7f4008157560 2023-11-28T20:44:08.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40000b97c0 con 0x7f4008157560 2023-11-28T20:44:08.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4008157b30 con 0x7f4008157560 2023-11-28T20:44:08.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.412+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4008158100 con 0x7f4008157560 2023-11-28T20:44:08.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f400d1c4640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081efe90 0x7f4008159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4008074770 con 0x7f40081efe90 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f4006d9d640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081efe90 0x7f4008159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f4006d9d640 1 -- 172.21.15.167:0/2155673463 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4008156d60 con 0x7f40081efe90 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40000b7040 con 0x7f4008157560 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f4006d9d640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081efe90 0x7f4008159730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800e700 tx=0x7f3ff800ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffffff640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fe8066470 0x7f3fe8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f4000121f80 con 0x7f4008157560 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80050d0 con 0x7f40081efe90 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffe59c640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fe8066470 0x7f3fe8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3ff8005230 con 0x7f40081efe90 2023-11-28T20:44:08.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081efe90 msgr2=0x7f4008159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffffff640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081efe90 0x7f4008159730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800e700 tx=0x7f3ff800ebc0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081efe90 msgr2=0x7f4008159730 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:08.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffffff640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081efe90 0x7f4008159730 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800e700 tx=0x7f3ff800ebc0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.416+0000 7f3ffe59c640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fe8066470 0x7f3fe8068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f40081e9ae0 tx=0x7f3ff0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081ef310 0x7f40081ef720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4008156a80 con 0x7f40081ef310 2023-11-28T20:44:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f4006d9d640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081ef310 0x7f40081ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f4006d9d640 1 -- 172.21.15.167:0/2155673463 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4008157040 con 0x7f40081ef310 2023-11-28T20:44:08.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f4006d9d640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081ef310 0x7f40081ef720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800e700 tx=0x7f3ff8001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800c8e0 con 0x7f40081ef310 2023-11-28T20:44:08.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4783 (secure 0 0 0) 0x7f3ff800ca40 con 0x7f40081ef310 2023-11-28T20:44:08.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081ef310 msgr2=0x7f40081ef720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f3ffffff640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081ef310 0x7f40081ef720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800e700 tx=0x7f3ff8001130 comp rx=0 tx=0).stop 2023-11-28T20:44:08.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f3ffffff640 1 -- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081ef310 msgr2=0x7f40081ef720 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:08.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f3ffffff640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40081ef310 0x7f40081ef720 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800e700 tx=0x7f3ff8001130 comp rx=0 tx=0).stop 2023-11-28T20:44:08.428 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:44:08.428 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:44:08.428 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:44:08.428 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 46, 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:08.429 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.430 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:44:08.431 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:44:08.431 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:08.431 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:08.431 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:08.431 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:08.431 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:08.431 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:08.431 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:08.431 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:08.432 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:08.432 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:08.432 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.432 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.432 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:44:08.432 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:44:08.432 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:44:08.433 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:08.434 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:08.435 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:08.435 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:08.435 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:08.435 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.435 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:44:08.435 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.435 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:44:08.435 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.435 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:44:08.436 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:44:08.436 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:08.436 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:08.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.436 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:08.436 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:44:08.436 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:08.437 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:08.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.438 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:44:08.438 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:44:08.438 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:08.438 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:08.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.438 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:08.438 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:44:08.439 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:08.440 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:44:08.441 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:08.442 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.443 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:08.444 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:08.445 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:44:08.445 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:44:08.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fe8066470 msgr2=0x7f3fe8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fe8066470 0x7f3fe8068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f40081e9ae0 tx=0x7f3ff0009040 comp rx=0 tx=0).stop 2023-11-28T20:44:08.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 msgr2=0x7f40081f2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 --2- 172.21.15.167:0/2155673463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4008157560 0x7f40081f2710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f40000b3040 tx=0x7f400001ba10 comp rx=0 tx=0).stop 2023-11-28T20:44:08.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400759e640 1 -- 172.21.15.167:0/2155673463 reap_dead start 2023-11-28T20:44:08.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400759e640 1 -- 172.21.15.167:0/2155673463 reap_dead start 2023-11-28T20:44:08.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 shutdown_connections 2023-11-28T20:44:08.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 >> 172.21.15.167:0/2155673463 conn(0x7f40080cb1e0 msgr2=0x7f40080705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:08.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 shutdown_connections 2023-11-28T20:44:08.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.424+0000 7f400d1c4640 1 -- 172.21.15.167:0/2155673463 wait complete. 2023-11-28T20:44:08.448 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:44:08.448 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2023-11-28T20:44:08.448 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:44:08.448 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2023-11-28T20:44:08.448 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:44:08.449 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T20:44:08.449 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:44:08.467 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T20:44:08.467 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:44:08.468 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:44:08.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76bdc32640 1 Processor -- start 2023-11-28T20:44:08.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76bdc32640 1 -- start start 2023-11-28T20:44:08.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76bdc32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76bdc32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76b80cfc40 0x7f76b80ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76bdc32640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b815ac00 con 0x7f76b8153ae0 2023-11-28T20:44:08.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76bdc32640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b80cbd60 con 0x7f76b80cfc40 2023-11-28T20:44:08.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76bdc32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8159ff0 con 0x7f76b80cf860 2023-11-28T20:44:08.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b6ffd640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f76b80cfc40 msgr2=0x7f76b80ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:08.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76b80cfc40 0x7f76b80ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:08.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b77fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b7fff640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f76b8153ae0 0x7f76b815d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:42690/0 (socket says 172.21.15.167:42690) 2023-11-28T20:44:08.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b7fff640 1 -- 172.21.15.167:0/2563651908 learned_addr learned my addr 172.21.15.167:0/2563651908 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:44:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b67fc640 1 -- 172.21.15.167:0/2563651908 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776551707 0 0) 0x7f76b815ac00 con 0x7f76b8153ae0 2023-11-28T20:44:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b67fc640 1 -- 172.21.15.167:0/2563651908 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76a0003530 con 0x7f76b8153ae0 2023-11-28T20:44:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b77fe640 1 -- 172.21.15.167:0/2563651908 >> v2:172.21.15.167:3300/0 conn(0x7f76b80cfc40 msgr2=0x7f76b80ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:08.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b77fe640 1 --2- 172.21.15.167:0/2563651908 >> v2:172.21.15.167:3300/0 conn(0x7f76b80cfc40 0x7f76b80ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b77fe640 1 -- 172.21.15.167:0/2563651908 >> v1:172.21.15.178:6789/0 conn(0x7f76b8153ae0 legacy=0x7f76b815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.648+0000 7f76b77fe640 1 -- 172.21.15.167:0/2563651908 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b815a2d0 con 0x7f76b80cf860 2023-11-28T20:44:08.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76b77fe640 1 --2- 172.21.15.167:0/2563651908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80cb770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097c0 tx=0x7f76a801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1934af0f3ecfe47d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76b67fc640 1 -- 172.21.15.167:0/2563651908 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a80ab670 con 0x7f76b80cf860 2023-11-28T20:44:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76b67fc640 1 -- 172.21.15.167:0/2563651908 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a80ab7d0 con 0x7f76b80cf860 2023-11-28T20:44:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76b67fc640 1 -- 172.21.15.167:0/2563651908 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a80abb40 con 0x7f76b80cf860 2023-11-28T20:44:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76bdc32640 1 -- 172.21.15.167:0/2563651908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 msgr2=0x7f76b80cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76bdc32640 1 --2- 172.21.15.167:0/2563651908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80cb770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097c0 tx=0x7f76a801c470 comp rx=0 tx=0).stop 2023-11-28T20:44:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76bdc32640 1 -- 172.21.15.167:0/2563651908 shutdown_connections 2023-11-28T20:44:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76bdc32640 1 --2- 172.21.15.167:0/2563651908 >> v2:172.21.15.167:3300/0 conn(0x7f76b80cfc40 0x7f76b80ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76bdc32640 1 --2- 172.21.15.167:0/2563651908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80cb770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76bdc32640 1 -- 172.21.15.167:0/2563651908 >> 172.21.15.167:0/2563651908 conn(0x7f76b806c1f0 msgr2=0x7f76b8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76bdc32640 1 -- 172.21.15.167:0/2563651908 shutdown_connections 2023-11-28T20:44:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.652+0000 7f76bdc32640 1 -- 172.21.15.167:0/2563651908 wait complete. 2023-11-28T20:44:08.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76bdc32640 1 Processor -- start 2023-11-28T20:44:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76bdc32640 1 -- start start 2023-11-28T20:44:08.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76bdc32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76bdc32640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76b80cfc40 0x7f76b8145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76bdc32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b8153ae0 0x7f76b80c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76bdc32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b81462d0 con 0x7f76b8153ae0 2023-11-28T20:44:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76bdc32640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8145620 con 0x7f76b80cfc40 2023-11-28T20:44:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76bdc32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b815cd60 con 0x7f76b80cf860 2023-11-28T20:44:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b7fff640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b8153ae0 msgr2=0x7f76b80c84c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b8153ae0 0x7f76b80c84c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b77fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b6ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76b80cfc40 0x7f76b8145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b77fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:47332/0 (socket says 172.21.15.167:47332) 2023-11-28T20:44:08.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b77fe640 1 -- 172.21.15.167:0/3497377136 learned_addr learned my addr 172.21.15.167:0/3497377136 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:08.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b6ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76b80cfc40 0x7f76b8145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:53856/0 (socket says 172.21.15.167:53856) 2023-11-28T20:44:08.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b77fe640 1 -- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76b80cfc40 msgr2=0x7f76b8145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b77fe640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76b80cfc40 0x7f76b8145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b77fe640 1 -- 172.21.15.167:0/3497377136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b8153ae0 msgr2=0x7f76b80c84c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:08.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b77fe640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b8153ae0 0x7f76b80c84c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b77fe640 1 -- 172.21.15.167:0/3497377136 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8009420 con 0x7f76b80cf860 2023-11-28T20:44:08.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.656+0000 7f76b77fe640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80c6970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76a80ad040 tx=0x7f76a801acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.660+0000 7f769ffff640 1 -- 172.21.15.167:0/3497377136 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8004220 con 0x7f76b80cf860 2023-11-28T20:44:08.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.660+0000 7f769ffff640 1 -- 172.21.15.167:0/3497377136 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a80b9070 con 0x7f76b80cf860 2023-11-28T20:44:08.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.660+0000 7f769ffff640 1 -- 172.21.15.167:0/3497377136 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8003620 con 0x7f76b80cf860 2023-11-28T20:44:08.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.660+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b8147500 con 0x7f76b80cf860 2023-11-28T20:44:08.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.660+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b8147ac0 con 0x7f76b80cf860 2023-11-28T20:44:08.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.660+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b8067c40 con 0x7f76b80cf860 2023-11-28T20:44:08.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.660+0000 7f769ffff640 1 -- 172.21.15.167:0/3497377136 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76a8003780 con 0x7f76b80cf860 2023-11-28T20:44:08.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.660+0000 7f769ffff640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76a4066450 0x7f76a4068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:08.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.660+0000 7f769ffff640 1 -- 172.21.15.167:0/3497377136 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f76a80bb070 con 0x7f76b80cf860 2023-11-28T20:44:08.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.664+0000 7f76b6ffd640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76a4066450 0x7f76a4068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:08.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.664+0000 7f76b6ffd640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76a4066450 0x7f76a4068910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0093d0 tx=0x7f76ac009360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:08.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.672+0000 7f769ffff640 1 -- 172.21.15.167:0/3497377136 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76a80ec110 con 0x7f76b80cf860 2023-11-28T20:44:08.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f76b8075c90 con 0x7f76b80cf860 2023-11-28T20:44:08.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f769ffff640 1 -- 172.21.15.167:0/3497377136 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f76a80c4020 con 0x7f76b80cf860 2023-11-28T20:44:08.882 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:44:08.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76a4066450 msgr2=0x7f76a4068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76a4066450 0x7f76a4068910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0093d0 tx=0x7f76ac009360 comp rx=0 tx=0).stop 2023-11-28T20:44:08.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 msgr2=0x7f76b80c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:08.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80c6970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76a80ad040 tx=0x7f76a801acb0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 shutdown_connections 2023-11-28T20:44:08.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76a4066450 0x7f76a4068910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b8153ae0 0x7f76b80c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76b80cfc40 0x7f76b8145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 --2- 172.21.15.167:0/3497377136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76b80cf860 0x7f76b80c6970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:08.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.880+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 >> 172.21.15.167:0/3497377136 conn(0x7f76b806c1f0 msgr2=0x7f76b80c4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:08.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.884+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 shutdown_connections 2023-11-28T20:44:08.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:08.884+0000 7f76bdc32640 1 -- 172.21.15.167:0/3497377136 wait complete. 2023-11-28T20:44:09.586 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2023-11-28T20:44:09.586 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir foo 2023-11-28T20:44:09.594 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo x 2023-11-28T20:44:09.594 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:10.501 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir foo/.snap/ss 2023-11-28T20:44:10.515 INFO:tasks.workunit.client.0.smithi167.stderr:+ ln foo/x foo/xx 2023-11-28T20:44:10.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat foo/.snap/ss/x 2023-11-28T20:44:10.532 INFO:tasks.workunit.client.0.smithi167.stdout:x 2023-11-28T20:44:10.533 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir foo/.snap/ss 2023-11-28T20:44:10.544 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo a 2023-11-28T20:44:10.545 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo b 2023-11-28T20:44:10.545 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir foo/.snap/s 2023-11-28T20:44:10.562 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat foo/.snap/s/a 2023-11-28T20:44:10.577 INFO:tasks.workunit.client.0.smithi167.stderr:+ r=a 2023-11-28T20:44:10.578 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ -z a ] 2023-11-28T20:44:10.578 INFO:tasks.workunit.client.0.smithi167.stderr:+ ln foo/b foo/b2 2023-11-28T20:44:10.582 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat foo/.snap/s/b 2023-11-28T20:44:10.597 INFO:tasks.workunit.client.0.smithi167.stdout:b 2023-11-28T20:44:10.597 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo this used to hang: 2023-11-28T20:44:10.598 INFO:tasks.workunit.client.0.smithi167.stdout:this used to hang: 2023-11-28T20:44:10.598 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo more 2023-11-28T20:44:10.598 INFO:tasks.workunit.client.0.smithi167.stdout:oh, it didn't hang! good job. 2023-11-28T20:44:10.599 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo oh, it didn't hang! good job. 2023-11-28T20:44:10.599 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat foo/b 2023-11-28T20:44:10.599 INFO:tasks.workunit.client.0.smithi167.stdout:b 2023-11-28T20:44:10.599 INFO:tasks.workunit.client.0.smithi167.stdout:more 2023-11-28T20:44:10.599 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir foo/.snap/s 2023-11-28T20:44:10.610 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm -r foo 2023-11-28T20:44:10.642 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo OK 2023-11-28T20:44:10.643 INFO:tasks.workunit.client.0.smithi167.stdout:OK 2023-11-28T20:44:10.644 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T20:44:10.644 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T20:44:10.680 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2023-11-28T20:44:10.680 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2023-11-28T20:44:11.905 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:44:12.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29d0817640 1 Processor -- start 2023-11-28T20:44:12.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29d0817640 1 -- start start 2023-11-28T20:44:12.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29d0817640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:12.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29d0817640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29cc0cfc40 0x7f29cc0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:12.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29d0817640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29cc15ac00 con 0x7f29cc153ae0 2023-11-28T20:44:12.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29d0817640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc0cbd60 con 0x7f29cc0cfc40 2023-11-28T20:44:12.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29d0817640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc159ff0 con 0x7f29cc0cf860 2023-11-28T20:44:12.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29c1d9b640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f29cc0cfc40 msgr2=0x7f29cc0ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:12.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29c1d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29cc0cfc40 0x7f29cc0ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:12.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29cad9d640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f29cc153ae0 0x7f29cc15d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:42692/0 (socket says 172.21.15.167:42692) 2023-11-28T20:44:12.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29cad9d640 1 -- 172.21.15.167:0/2968354612 learned_addr learned my addr 172.21.15.167:0/2968354612 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:44:12.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29ca59c640 1 --2- 172.21.15.167:0/2968354612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:12.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29c9d9b640 1 -- 172.21.15.167:0/2968354612 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142702500 0 0) 0x7f29cc15ac00 con 0x7f29cc153ae0 2023-11-28T20:44:12.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29c9d9b640 1 -- 172.21.15.167:0/2968354612 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b8003530 con 0x7f29cc153ae0 2023-11-28T20:44:12.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29ca59c640 1 -- 172.21.15.167:0/2968354612 >> v2:172.21.15.167:3300/0 conn(0x7f29cc0cfc40 msgr2=0x7f29cc0ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:12.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29ca59c640 1 --2- 172.21.15.167:0/2968354612 >> v2:172.21.15.167:3300/0 conn(0x7f29cc0cfc40 0x7f29cc0ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:12.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29ca59c640 1 -- 172.21.15.167:0/2968354612 >> v1:172.21.15.178:6789/0 conn(0x7f29cc153ae0 legacy=0x7f29cc15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:12.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.052+0000 7f29ca59c640 1 -- 172.21.15.167:0/2968354612 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc15a2d0 con 0x7f29cc0cf860 2023-11-28T20:44:12.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29ca59c640 1 --2- 172.21.15.167:0/2968354612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc0cb770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009d90 tx=0x7f29bc01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=247e9ec4d7d91b08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:12.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29c9d9b640 1 -- 172.21.15.167:0/2968354612 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0a5a00 con 0x7f29cc0cf860 2023-11-28T20:44:12.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29c9d9b640 1 -- 172.21.15.167:0/2968354612 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc0a5b60 con 0x7f29cc0cf860 2023-11-28T20:44:12.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29c9d9b640 1 -- 172.21.15.167:0/2968354612 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0ad440 con 0x7f29cc0cf860 2023-11-28T20:44:12.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29d0817640 1 -- 172.21.15.167:0/2968354612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 msgr2=0x7f29cc0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:12.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29d0817640 1 --2- 172.21.15.167:0/2968354612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc0cb770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009d90 tx=0x7f29bc01c940 comp rx=0 tx=0).stop 2023-11-28T20:44:12.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29d0817640 1 -- 172.21.15.167:0/2968354612 shutdown_connections 2023-11-28T20:44:12.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29d0817640 1 --2- 172.21.15.167:0/2968354612 >> v2:172.21.15.167:3300/0 conn(0x7f29cc0cfc40 0x7f29cc0ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:12.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29d0817640 1 --2- 172.21.15.167:0/2968354612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc0cb770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:12.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29d0817640 1 -- 172.21.15.167:0/2968354612 >> 172.21.15.167:0/2968354612 conn(0x7f29cc06c1f0 msgr2=0x7f29cc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:12.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29d0817640 1 -- 172.21.15.167:0/2968354612 shutdown_connections 2023-11-28T20:44:12.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.056+0000 7f29d0817640 1 -- 172.21.15.167:0/2968354612 wait complete. 2023-11-28T20:44:12.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29d0817640 1 Processor -- start 2023-11-28T20:44:12.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29d0817640 1 -- start start 2023-11-28T20:44:12.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29d0817640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:12.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29d0817640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29cc0cfc40 0x7f29cc0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:12.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29d0817640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc153ae0 0x7f29cc0c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:12.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29d0817640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc14e500 con 0x7f29cc153ae0 2023-11-28T20:44:12.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29d0817640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c9310 con 0x7f29cc0cfc40 2023-11-28T20:44:12.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29d0817640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc14e220 con 0x7f29cc0cf860 2023-11-28T20:44:12.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29cad9d640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc153ae0 msgr2=0x7f29cc0c6c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:12.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29cad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc153ae0 0x7f29cc0c6c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:12.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29c1d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29cc0cfc40 0x7f29cc0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:12.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29ca59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:12.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29c1d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29cc0cfc40 0x7f29cc0ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:53860/0 (socket says 172.21.15.167:53860) 2023-11-28T20:44:12.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29ca59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:47352/0 (socket says 172.21.15.167:47352) 2023-11-28T20:44:12.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29c1d9b640 1 -- 172.21.15.167:0/1551679092 learned_addr learned my addr 172.21.15.167:0/1551679092 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:12.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29c1d9b640 1 -- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 msgr2=0x7f29cc150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:12.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29c1d9b640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:12.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29c1d9b640 1 -- 172.21.15.167:0/1551679092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc153ae0 msgr2=0x7f29cc0c6c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:12.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29c1d9b640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc153ae0 0x7f29cc0c6c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:12.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.060+0000 7f29c1d9b640 1 -- 172.21.15.167:0/1551679092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc009a70 con 0x7f29cc0cfc40 2023-11-28T20:44:12.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.064+0000 7f29c1d9b640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29cc0cfc40 0x7f29cc0ce830 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29b400b560 tx=0x7f29b400ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:12.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.064+0000 7f29c37fe640 1 -- 172.21.15.167:0/1551679092 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4003dd0 con 0x7f29cc0cfc40 2023-11-28T20:44:12.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.064+0000 7f29c37fe640 1 -- 172.21.15.167:0/1551679092 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4005070 con 0x7f29cc0cfc40 2023-11-28T20:44:12.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.064+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc0b2010 con 0x7f29cc0cfc40 2023-11-28T20:44:12.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.064+0000 7f29c37fe640 1 -- 172.21.15.167:0/1551679092 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4005420 con 0x7f29cc0cfc40 2023-11-28T20:44:12.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.064+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc0c9840 con 0x7f29cc0cfc40 2023-11-28T20:44:12.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.064+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29cc067c40 con 0x7f29cc0cfc40 2023-11-28T20:44:12.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.064+0000 7f29c37fe640 1 -- 172.21.15.167:0/1551679092 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29b4005580 con 0x7f29cc0cfc40 2023-11-28T20:44:12.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.068+0000 7f29c37fe640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29ac066420 0x7f29ac0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:12.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.068+0000 7f29c37fe640 1 -- 172.21.15.167:0/1551679092 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f29b4084860 con 0x7f29cc0cfc40 2023-11-28T20:44:12.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.068+0000 7f29ca59c640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29ac066420 0x7f29ac0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:12.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.068+0000 7f29ca59c640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29ac066420 0x7f29ac0688e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0af000 tx=0x7f29bc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:12.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.080+0000 7f29c37fe640 1 -- 172.21.15.167:0/1551679092 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29b40518b0 con 0x7f29cc0cfc40 2023-11-28T20:44:12.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.280+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f29cc14e670 con 0x7f29cc0cfc40 2023-11-28T20:44:12.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.280+0000 7f29c37fe640 1 -- 172.21.15.167:0/1551679092 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f29b4054ed0 con 0x7f29cc0cfc40 2023-11-28T20:44:12.284 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:44:12.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29ac066420 msgr2=0x7f29ac0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29ac066420 0x7f29ac0688e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0af000 tx=0x7f29bc0a7070 comp rx=0 tx=0).stop 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29cc0cfc40 msgr2=0x7f29cc0ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29cc0cfc40 0x7f29cc0ce830 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29b400b560 tx=0x7f29b400ba20 comp rx=0 tx=0).stop 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 shutdown_connections 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29ac066420 0x7f29ac0688e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29cc153ae0 0x7f29cc0c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29cc0cfc40 0x7f29cc0ce830 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 --2- 172.21.15.167:0/1551679092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29cc0cf860 0x7f29cc150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 >> 172.21.15.167:0/1551679092 conn(0x7f29cc06c1f0 msgr2=0x7f29cc0c4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 shutdown_connections 2023-11-28T20:44:12.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:12.284+0000 7f29d0817640 1 -- 172.21.15.167:0/1551679092 wait complete. 2023-11-28T20:44:14.599 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2023-11-28T20:44:14.599 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:14.604 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/bar 2023-11-28T20:44:14.770 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/foo 2023-11-28T20:44:14.783 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/foo 2023-11-28T20:44:14.794 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:14.802 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/bar/a 2023-11-28T20:44:14.809 INFO:tasks.workunit.client.0.smithi167.stdout: File: .snap/bar/a 2023-11-28T20:44:14.809 INFO:tasks.workunit.client.0.smithi167.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-11-28T20:44:14.809 INFO:tasks.workunit.client.0.smithi167.stdout:Device: fdh/253d Inode: 1099511633045 Links: 2 2023-11-28T20:44:14.809 INFO:tasks.workunit.client.0.smithi167.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2023-11-28T20:44:14.809 INFO:tasks.workunit.client.0.smithi167.stdout:Access: 2023-11-28 20:44:14.600542223 +0000 2023-11-28T20:44:14.809 INFO:tasks.workunit.client.0.smithi167.stdout:Modify: 2023-11-28 20:44:14.600542223 +0000 2023-11-28T20:44:14.809 INFO:tasks.workunit.client.0.smithi167.stdout:Change: 2023-11-28 20:44:14.600542223 +0000 2023-11-28T20:44:14.809 INFO:tasks.workunit.client.0.smithi167.stdout: Birth: 2023-11-28 20:44:14.600542223 +0000 2023-11-28T20:44:14.810 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir .snap/bar 2023-11-28T20:44:14.826 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo OK 2023-11-28T20:44:14.827 INFO:tasks.workunit.client.0.smithi167.stdout:OK 2023-11-28T20:44:14.827 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T20:44:14.827 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T20:44:14.865 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2023-11-28T20:44:14.865 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2023-11-28T20:44:14.929 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2023-11-28T20:44:14.930 INFO:tasks.workunit.client.0.smithi167.stderr:+ seq 1 20 2023-11-28T20:44:14.930 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:14.935 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:14.938 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:14.957 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:14.968 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:14.969 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:15.116 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:15.131 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:15.131 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:15.131 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:15.131 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:15.131 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:15.132 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:15.132 INFO:tasks.workunit.client.0.smithi167.stdout: 50852 ? 00:00:00 ps 2023-11-28T20:44:15.132 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:15.153 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:15.161 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:15.178 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:15.183 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:15.186 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:15.204 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:15.216 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:15.217 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:15.264 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:15.278 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:15.278 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:15.278 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:15.279 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:15.279 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:15.279 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:15.279 INFO:tasks.workunit.client.0.smithi167.stdout: 50862 ? 00:00:00 ps 2023-11-28T20:44:15.280 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:15.301 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:15.305 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:44:15.310 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:15.326 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:15.330 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:15.333 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:15.352 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:15.367 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:15.368 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:15.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.444+0000 7f4eedec9640 1 Processor -- start 2023-11-28T20:44:15.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.444+0000 7f4eedec9640 1 -- start start 2023-11-28T20:44:15.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4eedec9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ee80c6ff0 0x7f4ee8157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:15.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4eedec9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:15.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4eedec9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee80c4920 con 0x7f4ee8150b40 2023-11-28T20:44:15.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4eedec9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee80c62f0 con 0x7f4ee80c6ff0 2023-11-28T20:44:15.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4eedec9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80c6ac0 con 0x7f4ee80c4510 2023-11-28T20:44:15.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4ee77fe640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f4ee8150b40 legacy=0x7f4ee80c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:44:15.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4ee7fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:15.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4ee6ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ee80c6ff0 0x7f4ee8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:15.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4ee7fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:37910/0 (socket says 172.21.15.167:37910) 2023-11-28T20:44:15.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4ee7fff640 1 -- 172.21.15.167:0/4021956136 learned_addr learned my addr 172.21.15.167:0/4021956136 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:15.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4ee7fff640 1 -- 172.21.15.167:0/4021956136 >> v2:172.21.15.178:3300/0 conn(0x7f4ee80c6ff0 msgr2=0x7f4ee8157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:15.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4ee7fff640 1 --2- 172.21.15.167:0/4021956136 >> v2:172.21.15.178:3300/0 conn(0x7f4ee80c6ff0 0x7f4ee8157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:15.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4ee7fff640 1 -- 172.21.15.167:0/4021956136 >> v1:172.21.15.167:6789/0 conn(0x7f4ee8150b40 legacy=0x7f4ee80c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:15.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.448+0000 7f4ee7fff640 1 -- 172.21.15.167:0/4021956136 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80c6500 con 0x7f4ee80c4510 2023-11-28T20:44:15.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4ee7fff640 1 --2- 172.21.15.167:0/4021956136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee806a580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ee806bba0 tx=0x7f4ee001c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13d6f1e339e9ac44 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:15.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4ee67fc640 1 -- 172.21.15.167:0/4021956136 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee00a5710 con 0x7f4ee80c4510 2023-11-28T20:44:15.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4ee67fc640 1 -- 172.21.15.167:0/4021956136 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee00a5870 con 0x7f4ee80c4510 2023-11-28T20:44:15.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4ee67fc640 1 -- 172.21.15.167:0/4021956136 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee00a5c00 con 0x7f4ee80c4510 2023-11-28T20:44:15.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 -- 172.21.15.167:0/4021956136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 msgr2=0x7f4ee806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:15.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 --2- 172.21.15.167:0/4021956136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee806a580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ee806bba0 tx=0x7f4ee001c980 comp rx=0 tx=0).stop 2023-11-28T20:44:15.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 -- 172.21.15.167:0/4021956136 shutdown_connections 2023-11-28T20:44:15.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 --2- 172.21.15.167:0/4021956136 >> v2:172.21.15.178:3300/0 conn(0x7f4ee80c6ff0 0x7f4ee8157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:15.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 --2- 172.21.15.167:0/4021956136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee806a580 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:15.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 -- 172.21.15.167:0/4021956136 >> 172.21.15.167:0/4021956136 conn(0x7f4ee80cb1e0 msgr2=0x7f4ee80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:15.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 -- 172.21.15.167:0/4021956136 shutdown_connections 2023-11-28T20:44:15.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 -- 172.21.15.167:0/4021956136 wait complete. 2023-11-28T20:44:15.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 Processor -- start 2023-11-28T20:44:15.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.452+0000 7f4eedec9640 1 -- start start 2023-11-28T20:44:15.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4eedec9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee81eff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:15.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4eedec9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80c6ff0 0x7f4ee80ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:15.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4eedec9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee8150b40 0x7f4ee815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:15.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4eedec9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81f35a0 con 0x7f4ee8150b40 2023-11-28T20:44:15.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4eedec9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81f4390 con 0x7f4ee80c6ff0 2023-11-28T20:44:15.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4eedec9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81f3810 con 0x7f4ee80c4510 2023-11-28T20:44:15.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee7fff640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee8150b40 msgr2=0x7f4ee815a1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:15.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee8150b40 0x7f4ee815a1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:15.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee77fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee81eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:15.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee77fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee81eff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:37922/0 (socket says 172.21.15.167:37922) 2023-11-28T20:44:15.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee77fe640 1 -- 172.21.15.167:0/4191304616 learned_addr learned my addr 172.21.15.167:0/4191304616 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:15.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee6ffd640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80c6ff0 0x7f4ee80ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:15.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee77fe640 1 -- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80c6ff0 msgr2=0x7f4ee80ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:15.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee77fe640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80c6ff0 0x7f4ee80ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:15.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee77fe640 1 -- 172.21.15.167:0/4191304616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee8150b40 msgr2=0x7f4ee815a1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee77fe640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee8150b40 0x7f4ee815a1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee77fe640 1 -- 172.21.15.167:0/4191304616 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0009b30 con 0x7f4ee80c4510 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee6ffd640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80c6ff0 0x7f4ee80ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ee77fe640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee81eff10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800b550 tx=0x7f4ed800ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ecffff640 1 -- 172.21.15.167:0/4191304616 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8003dd0 con 0x7f4ee80c4510 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ecffff640 1 -- 172.21.15.167:0/4191304616 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed80050f0 con 0x7f4ee80c4510 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee81f3af0 con 0x7f4ee80c4510 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4ecffff640 1 -- 172.21.15.167:0/4191304616 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80054a0 con 0x7f4ee80c4510 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee81f40b0 con 0x7f4ee80c4510 2023-11-28T20:44:15.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.456+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee80682c0 con 0x7f4ee80c4510 2023-11-28T20:44:15.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.460+0000 7f4ecffff640 1 -- 172.21.15.167:0/4191304616 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ed8005600 con 0x7f4ee80c4510 2023-11-28T20:44:15.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.460+0000 7f4ecffff640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4ed4066420 0x7f4ed40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:15.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.460+0000 7f4ecffff640 1 -- 172.21.15.167:0/4191304616 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f4ed8084c20 con 0x7f4ee80c4510 2023-11-28T20:44:15.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.460+0000 7f4ee6ffd640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4ed4066420 0x7f4ed40688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:15.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.460+0000 7f4ee6ffd640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4ed4066420 0x7f4ed40688e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80cb1b0 tx=0x7f4edc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.472+0000 7f4ecffff640 1 -- 172.21.15.167:0/4191304616 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4ed8051c70 con 0x7f4ee80c4510 2023-11-28T20:44:15.589 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:15.606 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:15.606 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:15.606 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:15.606 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:15.606 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:15.606 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:15.607 INFO:tasks.workunit.client.0.smithi167.stdout: 50896 ? 00:00:00 ps 2023-11-28T20:44:15.607 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:15.626 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:15.631 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:15.644 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:15.647 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:15.649 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:15.666 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:15.677 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:15.677 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:15.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.684+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4ee8075c90 con 0x7f4ee80c4510 2023-11-28T20:44:15.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.684+0000 7f4ecffff640 1 -- 172.21.15.167:0/4191304616 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f4ed8055290 con 0x7f4ee80c4510 2023-11-28T20:44:15.688 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:44:15.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4ed4066420 msgr2=0x7f4ed40688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4ed4066420 0x7f4ed40688e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80cb1b0 tx=0x7f4edc009190 comp rx=0 tx=0).stop 2023-11-28T20:44:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 msgr2=0x7f4ee81eff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee81eff10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800b550 tx=0x7f4ed800ba10 comp rx=0 tx=0).stop 2023-11-28T20:44:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 shutdown_connections 2023-11-28T20:44:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4ed4066420 0x7f4ed40688e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:15.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ee8150b40 0x7f4ee815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80c6ff0 0x7f4ee80ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 --2- 172.21.15.167:0/4191304616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80c4510 0x7f4ee81eff10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 >> 172.21.15.167:0/4191304616 conn(0x7f4ee80cb1e0 msgr2=0x7f4ee80715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 shutdown_connections 2023-11-28T20:44:15.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:15.688+0000 7f4eedec9640 1 -- 172.21.15.167:0/4191304616 wait complete. 2023-11-28T20:44:15.730 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:15.744 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:15.745 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:15.745 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:15.745 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:15.745 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:15.745 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:15.745 INFO:tasks.workunit.client.0.smithi167.stdout: 50908 ? 00:00:00 ps 2023-11-28T20:44:15.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:15.770 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:15.775 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:15.788 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:15.791 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:15.794 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:15.814 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:15.824 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:15.825 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:15.940 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:15.954 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:15.954 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:15.955 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:15.955 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:15.955 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:15.955 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:15.955 INFO:tasks.workunit.client.0.smithi167.stdout: 50918 ? 00:00:00 ps 2023-11-28T20:44:15.956 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:15.977 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:15.982 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:15.994 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:15.998 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:16.000 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:16.018 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:16.028 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:16.030 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:16.081 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:16.095 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:16.095 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:16.095 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:16.095 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:16.095 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:16.095 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:16.095 INFO:tasks.workunit.client.0.smithi167.stdout: 50928 ? 00:00:00 ps 2023-11-28T20:44:16.096 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:16.116 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:16.122 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:16.134 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:16.138 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:16.141 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:16.159 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:16.170 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:16.171 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:16.240 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:16.255 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:16.255 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:16.255 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:16.255 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:16.255 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:16.255 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:16.255 INFO:tasks.workunit.client.0.smithi167.stdout: 50938 ? 00:00:00 ps 2023-11-28T20:44:16.256 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:16.275 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:16.280 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:16.294 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:16.297 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:16.300 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:16.318 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:16.329 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:16.330 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:16.383 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:16.397 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:16.397 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:16.397 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:16.397 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:16.398 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:16.398 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:16.398 INFO:tasks.workunit.client.0.smithi167.stdout: 50948 ? 00:00:00 ps 2023-11-28T20:44:16.398 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:16.419 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:16.425 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:16.438 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:16.442 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:16.444 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:16.467 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:16.480 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:16.481 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:16.718 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:16.732 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:16.732 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:16.732 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:16.732 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:16.732 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:16.732 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:16.732 INFO:tasks.workunit.client.0.smithi167.stdout: 50958 ? 00:00:00 ps 2023-11-28T20:44:16.733 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:16.780 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:16.786 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:16.798 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:16.802 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:16.804 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:16.822 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:16.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:16.834 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:16.880 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:44:16.884 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:44:16.920 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:16.934 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:16.934 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:16.935 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:16.935 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:16.935 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:16.935 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:16.935 INFO:tasks.workunit.client.0.smithi167.stdout: 50970 ? 00:00:00 ps 2023-11-28T20:44:16.935 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:16.956 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:16.961 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:17.489 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:17.495 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:17.496 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:17.515 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:17.527 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:17.528 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:17.635 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:17.650 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:17.650 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:17.650 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:17.650 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:17.650 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:17.650 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:17.650 INFO:tasks.workunit.client.0.smithi167.stdout: 50980 ? 00:00:00 ps 2023-11-28T20:44:17.651 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:18.439 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:18.445 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:18.710 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:44:18.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456e7f8640 1 Processor -- start 2023-11-28T20:44:18.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456e7f8640 1 -- start start 2023-11-28T20:44:18.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456e7f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:18.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456e7f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:18.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456e7f8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 0x7f456806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:18.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456e7f8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45680c4da0 con 0x7f456806a580 2023-11-28T20:44:18.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456e7f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456815b220 con 0x7f4568151f60 2023-11-28T20:44:18.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456e7f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45680c60f0 con 0x7f45680c5c90 2023-11-28T20:44:18.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456cd95640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 msgr2=0x7f456806a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:18.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f456cd95640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 0x7f456806a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:18.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f45677fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:18.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f4567fff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:18.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f45677fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:37924/0 (socket says 172.21.15.167:37924) 2023-11-28T20:44:18.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 learned_addr learned my addr 172.21.15.167:0/4003659536 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:18.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 msgr2=0x7f45680c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:44:18.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 msgr2=0x7f45680c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:18.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:18.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:18.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f4567fff640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 msgr2=0x7f45680c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:44:18.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f4567fff640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 msgr2=0x7f45680c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:18.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:18.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:18.856+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:19.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f456cd95640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 msgr2=0x7f456806a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:19.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f456cd95640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 0x7f456806a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:44:19.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:19.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:19.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 msgr2=0x7f45680c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:44:19.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 msgr2=0x7f45680c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:19.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:19.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:44:19.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f4567fff640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 msgr2=0x7f45680c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:44:19.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f4567fff640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 msgr2=0x7f45680c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:19.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:19.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.060+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:44:19.179 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:19.183 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:19.186 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:19.206 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:19.218 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:19.219 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:19.385 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:19.402 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:19.402 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:19.402 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:19.402 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:19.403 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:19.403 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:19.403 INFO:tasks.workunit.client.0.smithi167.stdout: 51005 ? 00:00:00 ps 2023-11-28T20:44:19.404 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:19.425 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:19.430 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:19.443 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:19.447 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:19.449 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f456cd95640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 msgr2=0x7f456806a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f456cd95640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 0x7f456806a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:44:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 msgr2=0x7f45680c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:44:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 msgr2=0x7f45680c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:44:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f4567fff640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 msgr2=0x7f45680c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:44:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f4567fff640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 msgr2=0x7f45680c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:19.464+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:44:19.468 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:19.481 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:19.482 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:19.564 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:19.580 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:19.581 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:19.581 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:19.581 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:19.581 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:19.581 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:19.581 INFO:tasks.workunit.client.0.smithi167.stdout: 51015 ? 00:00:00 ps 2023-11-28T20:44:19.582 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:19.604 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:19.610 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:19.623 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:19.628 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:19.630 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:19.648 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:19.660 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:19.661 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:19.717 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:19.731 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:19.731 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:19.732 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:19.732 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:19.732 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:19.732 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:19.732 INFO:tasks.workunit.client.0.smithi167.stdout: 51025 ? 00:00:00 ps 2023-11-28T20:44:19.733 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:19.755 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:19.761 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:19.774 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:19.778 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:19.780 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:19.801 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:19.813 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:19.814 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:19.875 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:19.889 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:19.890 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:19.890 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:19.890 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:19.890 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:19.890 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:19.890 INFO:tasks.workunit.client.0.smithi167.stdout: 51035 ? 00:00:00 ps 2023-11-28T20:44:19.890 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:19.912 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:19.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:19.930 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:19.934 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:19.937 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:19.957 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:19.970 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:19.971 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:20.026 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:20.040 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:20.040 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:20.040 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:20.040 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:20.040 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:20.040 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:20.040 INFO:tasks.workunit.client.0.smithi167.stdout: 51045 ? 00:00:00 ps 2023-11-28T20:44:20.041 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:20.065 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:20.072 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:20.090 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:20.096 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:20.099 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:20.119 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:20.131 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:20.132 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:20.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f456cd95640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 msgr2=0x7f456806a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:20.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f456cd95640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 0x7f456806a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:44:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f4567fff640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 msgr2=0x7f45680c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:44:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f4567fff640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 msgr2=0x7f45680c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:44:20.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 msgr2=0x7f45680c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:44:20.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 msgr2=0x7f45680c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:20.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:20.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:20.268+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:44:20.425 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:20.439 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:20.439 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:20.439 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:20.439 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:20.440 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:20.440 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:20.440 INFO:tasks.workunit.client.0.smithi167.stdout: 51055 ? 00:00:00 ps 2023-11-28T20:44:20.441 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:20.463 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:20.469 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:20.482 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:20.487 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:20.489 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:20.508 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:20.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:20.521 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:20.619 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:20.633 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:20.634 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:20.634 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:20.634 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:20.634 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:20.634 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:20.634 INFO:tasks.workunit.client.0.smithi167.stdout: 51065 ? 00:00:00 ps 2023-11-28T20:44:20.635 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:21.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:21.856+0000 7f4565ffb640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 msgr2=0x7f45680c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:21.856+0000 7f4565ffb640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45680c5c90 0x7f45680c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:21.856+0000 7f4565ffb640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 msgr2=0x7f45680c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:21.856+0000 7f4565ffb640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.178:3300/0 conn(0x7f4568151f60 0x7f45680c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:21.856+0000 7f4565ffb640 1 -- 172.21.15.167:0/4003659536 >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 msgr2=0x7f456806a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:21.856+0000 7f4565ffb640 1 --2- 172.21.15.167:0/4003659536 >> v2:172.21.15.167:3300/0 conn(0x7f456806a580 0x7f456806a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:21.856+0000 7f4565ffb640 1 -- 172.21.15.167:0/4003659536 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4568152340 con 0x7f4554007330 2023-11-28T20:44:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:21.856+0000 7f4565ffb640 1 -- 172.21.15.167:0/4003659536 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455400c0b0 con 0x7f4554003680 2023-11-28T20:44:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:21.856+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> v1:172.21.15.167:6789/0 conn(0x7f4554007330 legacy=0x7f45540097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:44:22.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.060+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> v1:172.21.15.167:6789/0 conn(0x7f4554007330 legacy=0x7f45540097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:44:22.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.464+0000 7f45677fe640 1 -- 172.21.15.167:0/4003659536 >> v1:172.21.15.167:6789/0 conn(0x7f4554007330 legacy=0x7f45540097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:44:22.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.700+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965022843 0 0) 0x7f455400c0b0 con 0x7f4554003680 2023-11-28T20:44:22.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.700+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4550003530 con 0x7f4554003680 2023-11-28T20:44:22.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.708+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4053796033 0 0) 0x7f4550003530 con 0x7f4554003680 2023-11-28T20:44:22.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.708+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 >> v1:172.21.15.167:6789/0 conn(0x7f4554007330 legacy=0x7f45540097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:22.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.708+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455400d2b0 con 0x7f4554003680 2023-11-28T20:44:22.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.708+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f455800e510 con 0x7f4554003680 2023-11-28T20:44:22.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.708+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 >> v1:172.21.15.178:6789/0 conn(0x7f4554003680 legacy=0x7f4554005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:22.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f456cd95640 1 -- 172.21.15.167:0/4003659536 reap_dead start 2023-11-28T20:44:22.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f4566ffd640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 0x7f4550003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f4566ffd640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500047d0 0x7f4550004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f4566ffd640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500052b0 0x7f455000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455000c1a0 con 0x7f4550003980 2023-11-28T20:44:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455000c310 con 0x7f45500052b0 2023-11-28T20:44:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455000c4d0 con 0x7f45500047d0 2023-11-28T20:44:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f4567fff640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 msgr2=0x7f4550003d60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f4567fff640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 0x7f4550003d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f456cd95640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500052b0 0x7f455000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:22.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500047d0 0x7f4550004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:22.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f456cd95640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500047d0 msgr2=0x7f4550004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:22.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f456cd95640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500047d0 0x7f4550004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:22.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f456cd95640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 msgr2=0x7f4550003d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:22.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f456cd95640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 0x7f4550003d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:22.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f456cd95640 1 -- 172.21.15.167:0/4003659536 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550003530 con 0x7f45500052b0 2023-11-28T20:44:22.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.712+0000 7f45677fe640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500047d0 0x7f4550004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:44:22.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456cd95640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500052b0 0x7f455000b990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f456806fde0 tx=0x7f456001cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47a749a75110a68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:22.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600a5b40 con 0x7f45500052b0 2023-11-28T20:44:22.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45600a5ca0 con 0x7f45500052b0 2023-11-28T20:44:22.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f4566ffd640 1 -- 172.21.15.167:0/4003659536 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600ae6b0 con 0x7f45500052b0 2023-11-28T20:44:22.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456e7f8640 1 -- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500052b0 msgr2=0x7f455000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:22.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456e7f8640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500052b0 0x7f455000b990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f456806fde0 tx=0x7f456001cce0 comp rx=0 tx=0).stop 2023-11-28T20:44:22.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456e7f8640 1 -- 172.21.15.167:0/4003659536 shutdown_connections 2023-11-28T20:44:22.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456e7f8640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500052b0 0x7f455000b990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:22.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456e7f8640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500047d0 0x7f4550004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:22.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456e7f8640 1 --2- 172.21.15.167:0/4003659536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 0x7f4550003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:22.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456e7f8640 1 -- 172.21.15.167:0/4003659536 >> 172.21.15.167:0/4003659536 conn(0x7f45680cb1e0 msgr2=0x7f45680cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:22.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456e7f8640 1 -- 172.21.15.167:0/4003659536 shutdown_connections 2023-11-28T20:44:22.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.716+0000 7f456e7f8640 1 -- 172.21.15.167:0/4003659536 wait complete. 2023-11-28T20:44:22.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f456e7f8640 1 Processor -- start 2023-11-28T20:44:22.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f456e7f8640 1 -- start start 2023-11-28T20:44:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f456e7f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 0x7f45681f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f456e7f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500047d0 0x7f4568146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f456e7f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500052b0 0x7f4568070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f456e7f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45680706b0 con 0x7f4550003980 2023-11-28T20:44:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f456e7f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45681f3b30 con 0x7f45500047d0 2023-11-28T20:44:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f456e7f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45680cac80 con 0x7f45500052b0 2023-11-28T20:44:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f4567fff640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 msgr2=0x7f45681f35f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:22.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f4567fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 0x7f45681f35f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f45677fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500047d0 0x7f4568146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f456cd95640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500052b0 0x7f4568070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f45677fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500047d0 0x7f4568146e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:58148/0 (socket says 172.21.15.167:58148) 2023-11-28T20:44:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f45677fe640 1 -- 172.21.15.167:0/1365962700 learned_addr learned my addr 172.21.15.167:0/1365962700 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f45677fe640 1 -- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500052b0 msgr2=0x7f4568070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f45677fe640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500052b0 0x7f4568070ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f45677fe640 1 -- 172.21.15.167:0/1365962700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 msgr2=0x7f45681f35f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f45677fe640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 0x7f45681f35f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:22.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f45677fe640 1 -- 172.21.15.167:0/1365962700 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4568156310 con 0x7f45500047d0 2023-11-28T20:44:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f45677fe640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500047d0 0x7f4568146e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f455c0169e0 tx=0x7f455c016ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.720+0000 7f4564ff9640 1 -- 172.21.15.167:0/1365962700 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c014c50 con 0x7f45500047d0 2023-11-28T20:44:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.724+0000 7f4564ff9640 1 -- 172.21.15.167:0/1365962700 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c00c040 con 0x7f45500047d0 2023-11-28T20:44:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.724+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45680ca140 con 0x7f45500047d0 2023-11-28T20:44:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.724+0000 7f4564ff9640 1 -- 172.21.15.167:0/1365962700 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c018450 con 0x7f45500047d0 2023-11-28T20:44:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.724+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45680ca6c0 con 0x7f45500047d0 2023-11-28T20:44:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.724+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4568070920 con 0x7f45500047d0 2023-11-28T20:44:22.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.724+0000 7f4564ff9640 1 -- 172.21.15.167:0/1365962700 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f455c0185b0 con 0x7f45500047d0 2023-11-28T20:44:22.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.724+0000 7f4564ff9640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4554066bf0 0x7f45540690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:22.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.728+0000 7f4564ff9640 1 -- 172.21.15.167:0/1365962700 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6751+0+0 (secure 0 0 0) 0x7f455c085160 con 0x7f45500047d0 2023-11-28T20:44:22.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.728+0000 7f4567fff640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4554066bf0 0x7f45540690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:22.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.728+0000 7f4567fff640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4554066bf0 0x7f45540690b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4558000eb0 tx=0x7f4558006be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:22.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:22.736+0000 7f4564ff9640 1 -- 172.21.15.167:0/1365962700 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f455c0522f0 con 0x7f45500047d0 2023-11-28T20:44:23.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.012+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f45680682c0 con 0x7f45500047d0 2023-11-28T20:44:23.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.012+0000 7f4564ff9640 1 -- 172.21.15.167:0/1365962700 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f455c027620 con 0x7f45500047d0 2023-11-28T20:44:23.015 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:44:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4554066bf0 msgr2=0x7f45540690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4554066bf0 0x7f45540690b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4558000eb0 tx=0x7f4558006be0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500047d0 msgr2=0x7f4568146e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500047d0 0x7f4568146e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f455c0169e0 tx=0x7f455c016ea0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 shutdown_connections 2023-11-28T20:44:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4554066bf0 0x7f45540690b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45500052b0 0x7f4568070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500047d0 0x7f4568146e60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 --2- 172.21.15.167:0/1365962700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4550003980 0x7f45681f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 >> 172.21.15.167:0/1365962700 conn(0x7f45680cb1e0 msgr2=0x7f456814f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:23.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 shutdown_connections 2023-11-28T20:44:23.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.016+0000 7f456e7f8640 1 -- 172.21.15.167:0/1365962700 wait complete. 2023-11-28T20:44:23.059 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:44:23.059 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:44:23.059 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:44:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.372+0000 7f68b7fff640 1 Processor -- start 2023-11-28T20:44:23.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.372+0000 7f68b7fff640 1 -- start start 2023-11-28T20:44:23.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68b814fe40 0x7f68b8070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b7fff640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b8159340 con 0x7f68b80709a0 2023-11-28T20:44:23.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b7fff640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b8159620 con 0x7f68b8071c20 2023-11-28T20:44:23.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b7fff640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b815a1a0 con 0x7f68b814fe40 2023-11-28T20:44:23.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b6ffd640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f68b814fe40 msgr2=0x7f68b8070460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:23.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b77fe640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f68b80709a0 legacy=0x7f68b8156020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:44:23.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68b814fe40 0x7f68b8070460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:23.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b67fc640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f68b8071c20 0x7f68b8071070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:55056/0 (socket says 172.21.15.167:55056) 2023-11-28T20:44:23.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b67fc640 1 -- 172.21.15.167:0/3784383917 learned_addr learned my addr 172.21.15.167:0/3784383917 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:44:23.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730595562 0 0) 0x7f68b8159620 con 0x7f68b8071c20 2023-11-28T20:44:23.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.376+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a0003530 con 0x7f68b8071c20 2023-11-28T20:44:23.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779181090 0 0) 0x7f68a0003530 con 0x7f68b8071c20 2023-11-28T20:44:23.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 >> v2:172.21.15.167:3300/0 conn(0x7f68b814fe40 msgr2=0x7f68b8070460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:23.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 --2- 172.21.15.167:0/3784383917 >> v2:172.21.15.167:3300/0 conn(0x7f68b814fe40 0x7f68b8070460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 >> v1:172.21.15.167:6789/0 conn(0x7f68b80709a0 legacy=0x7f68b8156020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8159900 con 0x7f68b8071c20 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f68ac000ee0 con 0x7f68b8071c20 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 >> v1:172.21.15.178:6789/0 conn(0x7f68b8071c20 legacy=0x7f68b8071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a0003980 0x7f68a0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a00047d0 0x7f68a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 0x7f68a000ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b815a1a0 con 0x7f68a0003980 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0009b80 con 0x7f68a00047d0 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0009d40 con 0x7f68a0005190 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b6ffd640 1 -- 172.21.15.167:0/3784383917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a0003980 msgr2=0x7f68a0003d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b6ffd640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a0003980 0x7f68a0003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b77fe640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 0x7f68a000ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b67fc640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a00047d0 0x7f68a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b77fe640 1 -- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a00047d0 msgr2=0x7f68a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:23.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b77fe640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a00047d0 0x7f68a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b77fe640 1 -- 172.21.15.167:0/3784383917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a0003980 msgr2=0x7f68a0003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:23.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b77fe640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68a0003980 0x7f68a0003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b77fe640 1 -- 172.21.15.167:0/3784383917 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a0003530 con 0x7f68a0005190 2023-11-28T20:44:23.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.380+0000 7f68b67fc640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a00047d0 0x7f68a0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:44:23.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.388+0000 7f68b77fe640 1 -- 172.21.15.167:0/3784383917 reap_dead start 2023-11-28T20:44:23.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.392+0000 7f68b77fe640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 0x7f68a000ffa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009e60 tx=0x7f68b001cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8973f51a11f3800d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.392+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00a59d0 con 0x7f68a0005190 2023-11-28T20:44:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.392+0000 7f68b5ffb640 1 -- 172.21.15.167:0/3784383917 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b00a5b70 con 0x7f68a0005190 2023-11-28T20:44:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.392+0000 7f68b7fff640 1 -- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 msgr2=0x7f68a000ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.392+0000 7f68b7fff640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 0x7f68a000ffa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009e60 tx=0x7f68b001cad0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.396+0000 7f68b7fff640 1 -- 172.21.15.167:0/3784383917 shutdown_connections 2023-11-28T20:44:23.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.396+0000 7f68b7fff640 1 --2- 172.21.15.167:0/3784383917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 0x7f68a000ffa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.396+0000 7f68b7fff640 1 -- 172.21.15.167:0/3784383917 >> 172.21.15.167:0/3784383917 conn(0x7f68b80cb3f0 msgr2=0x7f68b80cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:23.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.400+0000 7f68b7fff640 1 -- 172.21.15.167:0/3784383917 shutdown_connections 2023-11-28T20:44:23.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.400+0000 7f68b7fff640 1 -- 172.21.15.167:0/3784383917 wait complete. 2023-11-28T20:44:23.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.400+0000 7f68b7fff640 1 Processor -- start 2023-11-28T20:44:23.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.404+0000 7f68b7fff640 1 -- start start 2023-11-28T20:44:23.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b7fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 0x7f68b8141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68b80c50a0 0x7f68b81ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b7fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4230 0x7f68b80c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b7fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8141650 con 0x7f68b80c50a0 2023-11-28T20:44:23.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b7fff640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b814c0b0 con 0x7f68b80c4230 2023-11-28T20:44:23.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b7fff640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b814a1d0 con 0x7f68a0005190 2023-11-28T20:44:23.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4230 0x7f68b80c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4230 0x7f68b80c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41672/0 (socket says 172.21.15.167:41672) 2023-11-28T20:44:23.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b77fe640 1 -- 172.21.15.167:0/1390862707 learned_addr learned my addr 172.21.15.167:0/1390862707 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:23.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b67fc640 1 -- 172.21.15.167:0/1390862707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68b80c50a0 msgr2=0x7f68b81ebbd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:23.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b67fc640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68b80c50a0 0x7f68b81ebbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:23.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b6ffd640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 0x7f68b8141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b77fe640 1 -- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 msgr2=0x7f68b8141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b77fe640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a0005190 0x7f68b8141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b77fe640 1 -- 172.21.15.167:0/1390862707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68b80c50a0 msgr2=0x7f68b81ebbd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:23.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b77fe640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68b80c50a0 0x7f68b81ebbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.408+0000 7f68b77fe640 1 -- 172.21.15.167:0/1390862707 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b814a4b0 con 0x7f68b80c4230 2023-11-28T20:44:23.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.412+0000 7f68b77fe640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4230 0x7f68b80c46b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f68b001c540 tx=0x7f68a0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.412+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00ace80 con 0x7f68b80c4230 2023-11-28T20:44:23.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.412+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b00b3040 con 0x7f68b80c4230 2023-11-28T20:44:23.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.412+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00ad680 con 0x7f68b80c4230 2023-11-28T20:44:23.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.416+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b81eb3d0 con 0x7f68b80c4230 2023-11-28T20:44:23.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.416+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b814b850 con 0x7f68b80c4230 2023-11-28T20:44:23.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.416+0000 7f68b7fff640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4bf0 0x7f68b81ee830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.416+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80c3c60 con 0x7f68b80c4bf0 2023-11-28T20:44:23.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.416+0000 7f68b6ffd640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4bf0 0x7f68b81ee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.420+0000 7f68b6ffd640 1 -- 172.21.15.167:0/1390862707 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68b8159ec0 con 0x7f68b80c4bf0 2023-11-28T20:44:23.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f68b00ad7e0 con 0x7f68b80c4230 2023-11-28T20:44:23.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f68b6ffd640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4bf0 0x7f68b81ee830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009610 tx=0x7f68a8009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f689ffff640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68a4066420 0x7f68a40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f68b0008050 con 0x7f68b80c4230 2023-11-28T20:44:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8005a50 con 0x7f68b80c4bf0 2023-11-28T20:44:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f68a8005bb0 con 0x7f68b80c4bf0 2023-11-28T20:44:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4bf0 msgr2=0x7f68b81ee830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f689ffff640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4bf0 0x7f68b81ee830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009610 tx=0x7f68a8009ad0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4bf0 msgr2=0x7f68b81ee830 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f689ffff640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4bf0 0x7f68b81ee830 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009610 tx=0x7f68a8009ad0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.424+0000 7f68b67fc640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68a4066420 0x7f68a40688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.428+0000 7f68b67fc640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68a4066420 0x7f68a40688e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68ac004f90 tx=0x7f68ac0048a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.464+0000 7f68b7fff640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b814a640 0x7f68b81eed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.464+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8074740 con 0x7f68b814a640 2023-11-28T20:44:23.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.464+0000 7f68b6ffd640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b814a640 0x7f68b81eed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.464+0000 7f68b6ffd640 1 -- 172.21.15.167:0/1390862707 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f68b8067c40 con 0x7f68b814a640 2023-11-28T20:44:23.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.468+0000 7f68b6ffd640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b814a640 0x7f68b81eed70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009610 tx=0x7f68a80059e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.468+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a801bb20 con 0x7f68b814a640 2023-11-28T20:44:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.472+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4970 (secure 0 0 0) 0x7f68a801bc80 con 0x7f68b814a640 2023-11-28T20:44:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.472+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b814a640 msgr2=0x7f68b81eed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.472+0000 7f689ffff640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b814a640 0x7f68b81eed70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009610 tx=0x7f68a80059e0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.472+0000 7f689ffff640 1 -- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b814a640 msgr2=0x7f68b81eed70 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.472+0000 7f689ffff640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b814a640 0x7f68b81eed70 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009610 tx=0x7f68a80059e0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 48, 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.477 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:23.478 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:23.479 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:44:23.480 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:23.481 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:44:23.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.484 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:23.484 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:44:23.484 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:44:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:44:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:44:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:44:23.493 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:44:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.476+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68a4066420 msgr2=0x7f68a40688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.476+0000 7f68b7fff640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f68a4066420 0x7f68a40688e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68ac004f90 tx=0x7f68ac0048a0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.476+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4230 msgr2=0x7f68b80c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.476+0000 7f68b7fff640 1 --2- 172.21.15.167:0/1390862707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b80c4230 0x7f68b80c46b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f68b001c540 tx=0x7f68a0005800 comp rx=0 tx=0).stop 2023-11-28T20:44:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.476+0000 7f68b77fe640 1 -- 172.21.15.167:0/1390862707 reap_dead start 2023-11-28T20:44:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.476+0000 7f68b77fe640 1 -- 172.21.15.167:0/1390862707 reap_dead start 2023-11-28T20:44:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.476+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 shutdown_connections 2023-11-28T20:44:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.476+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 >> 172.21.15.167:0/1390862707 conn(0x7f68b80cb3f0 msgr2=0x7f68b8141fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.480+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 shutdown_connections 2023-11-28T20:44:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.480+0000 7f68b7fff640 1 -- 172.21.15.167:0/1390862707 wait complete. 2023-11-28T20:44:23.543 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:44:23.544 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:44:23.544 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:44:23.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb70691d640 1 Processor -- start 2023-11-28T20:44:23.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb70691d640 1 -- start start 2023-11-28T20:44:23.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb70691d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c8010 0x7fb70015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb70691d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb70006bda0 0x7fb700066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb70691d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70006a8d0 con 0x7fb7000b0110 2023-11-28T20:44:23.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb70691d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7000ca230 con 0x7fb70006bda0 2023-11-28T20:44:23.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb70691d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000c8990 con 0x7fb7000c8010 2023-11-28T20:44:23.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb704eba640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb70006bda0 0x7fb700066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb704eba640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb70006bda0 0x7fb700066730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41696/0 (socket says 172.21.15.167:41696) 2023-11-28T20:44:23.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb704eba640 1 -- 172.21.15.167:0/3973446988 learned_addr learned my addr 172.21.15.167:0/3973446988 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:23.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb6ff7fe640 1 --2- 172.21.15.167:0/3973446988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c8010 0x7fb70015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb704eba640 1 -- 172.21.15.167:0/3973446988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c8010 msgr2=0x7fb70015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:23.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb704eba640 1 --2- 172.21.15.167:0/3973446988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c8010 0x7fb70015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb704eba640 1 -- 172.21.15.167:0/3973446988 >> v1:172.21.15.178:6789/0 conn(0x7fb7000b0110 legacy=0x7fb70006b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.728+0000 7fb704eba640 1 -- 172.21.15.167:0/3973446988 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7000ca480 con 0x7fb70006bda0 2023-11-28T20:44:23.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb704eba640 1 --2- 172.21.15.167:0/3973446988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70006bda0 0x7fb700066730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009e50 tx=0x7fb6f801f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed544056b74caf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb6feffd640 1 -- 172.21.15.167:0/3973446988 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80af400 con 0x7fb70006bda0 2023-11-28T20:44:23.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb6feffd640 1 -- 172.21.15.167:0/3973446988 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80ab050 con 0x7fb70006bda0 2023-11-28T20:44:23.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb6feffd640 1 -- 172.21.15.167:0/3973446988 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80af780 con 0x7fb70006bda0 2023-11-28T20:44:23.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb70691d640 1 -- 172.21.15.167:0/3973446988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70006bda0 msgr2=0x7fb700066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb70691d640 1 --2- 172.21.15.167:0/3973446988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70006bda0 0x7fb700066730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009e50 tx=0x7fb6f801f1f0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb70691d640 1 -- 172.21.15.167:0/3973446988 shutdown_connections 2023-11-28T20:44:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb70691d640 1 --2- 172.21.15.167:0/3973446988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70006bda0 0x7fb700066730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb70691d640 1 --2- 172.21.15.167:0/3973446988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c8010 0x7fb70015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb70691d640 1 -- 172.21.15.167:0/3973446988 >> 172.21.15.167:0/3973446988 conn(0x7fb70006ee30 msgr2=0x7fb70006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb70691d640 1 -- 172.21.15.167:0/3973446988 shutdown_connections 2023-11-28T20:44:23.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.732+0000 7fb70691d640 1 -- 172.21.15.167:0/3973446988 wait complete. 2023-11-28T20:44:23.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 Processor -- start 2023-11-28T20:44:23.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 -- start start 2023-11-28T20:44:23.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70006bda0 0x7fb70015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000b0110 0x7fb7001f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7000c8010 0x7fb7001f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb700154080 con 0x7fb70006bda0 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7001f3880 con 0x7fb7000c8010 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7001f3b40 con 0x7fb7000b0110 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb6fffff640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70006bda0 msgr2=0x7fb70015a1a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70006bda0 0x7fb70015a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb704eba640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7000c8010 0x7fb7001f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb6ff7fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000b0110 0x7fb7001f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb704eba640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7000c8010 0x7fb7001f31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41708/0 (socket says 172.21.15.167:41708) 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb704eba640 1 -- 172.21.15.167:0/651518780 learned_addr learned my addr 172.21.15.167:0/651518780 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:23.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb704eba640 1 -- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000b0110 msgr2=0x7fb7001f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb704eba640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000b0110 0x7fb7001f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb704eba640 1 -- 172.21.15.167:0/651518780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70006bda0 msgr2=0x7fb70015a1a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb704eba640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70006bda0 0x7fb70015a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb704eba640 1 -- 172.21.15.167:0/651518780 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f8009b30 con 0x7fb7000c8010 2023-11-28T20:44:23.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb704eba640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7000c8010 0x7fb7001f31b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6f801d8a0 tx=0x7fb6f801bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8007000 con 0x7fb7000c8010 2023-11-28T20:44:23.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7000c5460 con 0x7fb7000c8010 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80afdb0 con 0x7fb7000c8010 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80b9630 con 0x7fb7000c8010 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.736+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7000c5a20 con 0x7fb7000c8010 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb70691d640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c6df0 0x7fb7000b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70006b130 con 0x7fb7000c6df0 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fffff640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c6df0 0x7fb7000b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fffff640 1 -- 172.21.15.167:0/651518780 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7000ca760 con 0x7fb7000c6df0 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fffff640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c6df0 0x7fb7000b15b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0000c10 tx=0x7fb6f000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f00074e0 con 0x7fb7000c6df0 2023-11-28T20:44:23.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6f80b6070 con 0x7fb7000c8010 2023-11-28T20:44:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fcff9640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066510 0x7fb6ec0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6775+0+0 (secure 0 0 0) 0x7fb6f8122270 con 0x7fb7000c8010 2023-11-28T20:44:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb6f0007640 con 0x7fb7000c6df0 2023-11-28T20:44:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c6df0 msgr2=0x7fb7000b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fcff9640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c6df0 0x7fb7000b15b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0000c10 tx=0x7fb6f000c830 comp rx=0 tx=0).stop 2023-11-28T20:44:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c6df0 msgr2=0x7fb7000b15b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6fcff9640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7000c6df0 0x7fb7000b15b0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0000c10 tx=0x7fb6f000c830 comp rx=0 tx=0).stop 2023-11-28T20:44:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.740+0000 7fb6ff7fe640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066510 0x7fb6ec0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.744+0000 7fb6ff7fe640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066510 0x7fb6ec0689d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb7000c7910 tx=0x7fb6f4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.748+0000 7fb70691d640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70015a6e0 0x7fb7000b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.748+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000c8f10 con 0x7fb70015a6e0 2023-11-28T20:44:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.748+0000 7fb6fffff640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70015a6e0 0x7fb7000b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:23.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.748+0000 7fb6fffff640 1 -- 172.21.15.167:0/651518780 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb70006d530 con 0x7fb70015a6e0 2023-11-28T20:44:23.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.748+0000 7fb6fffff640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70015a6e0 0x7fb7000b1af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0007fd0 tx=0x7fb6f0000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f001f070 con 0x7fb70015a6e0 2023-11-28T20:44:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5111 (secure 0 0 0) 0x7fb6f00192c0 con 0x7fb70015a6e0 2023-11-28T20:44:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70015a6e0 msgr2=0x7fb7000b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb6fcff9640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70015a6e0 0x7fb7000b1af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0007fd0 tx=0x7fb6f0000ee0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb6fcff9640 1 -- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70015a6e0 msgr2=0x7fb7000b1af0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:44:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb6fcff9640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70015a6e0 0x7fb7000b1af0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0007fd0 tx=0x7fb6f0000ee0 comp rx=0 tx=0).stop 2023-11-28T20:44:23.758 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:44:23.758 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:44:23.758 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 48, 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:44:23.759 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:23.760 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:23.761 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:23.762 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:44:23.763 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:44:23.764 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.765 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:23.766 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:44:23.766 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.766 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.766 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.766 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:44:23.766 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:23.767 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:44:23.768 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.769 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:44:23.770 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.771 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.772 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.773 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:44:23.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:44:23.775 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:44:23.775 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:44:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066510 msgr2=0x7fb6ec0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb70691d640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066510 0x7fb6ec0689d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb7000c7910 tx=0x7fb6f4009190 comp rx=0 tx=0).stop 2023-11-28T20:44:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7000c8010 msgr2=0x7fb7001f31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb70691d640 1 --2- 172.21.15.167:0/651518780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7000c8010 0x7fb7001f31b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6f801d8a0 tx=0x7fb6f801bf90 comp rx=0 tx=0).stop 2023-11-28T20:44:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb704eba640 1 -- 172.21.15.167:0/651518780 reap_dead start 2023-11-28T20:44:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb704eba640 1 -- 172.21.15.167:0/651518780 reap_dead start 2023-11-28T20:44:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 shutdown_connections 2023-11-28T20:44:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 >> 172.21.15.167:0/651518780 conn(0x7fb70006ee30 msgr2=0x7fb70006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 shutdown_connections 2023-11-28T20:44:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:23.756+0000 7fb70691d640 1 -- 172.21.15.167:0/651518780 wait complete. 2023-11-28T20:44:23.777 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:44:23.777 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:44:24.981 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:24.984 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:24.998 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:25.002 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:25.004 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:25.946 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:25.960 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:25.961 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:27.037 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:27.053 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:27.053 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:27.053 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:27.053 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:27.053 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:27.053 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:27.053 INFO:tasks.workunit.client.0.smithi167.stdout: 51139 ? 00:00:00 ps 2023-11-28T20:44:27.054 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:27.079 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:27.085 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:27.098 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a 2023-11-28T20:44:27.103 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/one 2023-11-28T20:44:27.104 INFO:tasks.workunit.client.0.smithi167.stderr:+ cat 2023-11-28T20:44:27.123 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir a/.snap/two 2023-11-28T20:44:27.136 INFO:tasks.workunit.client.0.smithi167.stderr:+ chmod 777 a/foo 2023-11-28T20:44:27.137 INFO:tasks.workunit.client.0.smithi167.stderr:+ sync 2023-11-28T20:44:27.195 INFO:tasks.workunit.client.0.smithi167.stderr:+ ps 2023-11-28T20:44:27.210 INFO:tasks.workunit.client.0.smithi167.stdout: PID TTY TIME CMD 2023-11-28T20:44:27.210 INFO:tasks.workunit.client.0.smithi167.stdout: 1294 ? 00:00:00 systemd 2023-11-28T20:44:27.210 INFO:tasks.workunit.client.0.smithi167.stdout: 1295 ? 00:00:00 (sd-pam) 2023-11-28T20:44:27.210 INFO:tasks.workunit.client.0.smithi167.stdout: 27967 ? 00:00:02 sshd 2023-11-28T20:44:27.210 INFO:tasks.workunit.client.0.smithi167.stdout: 50841 ? 00:00:00 timeout 2023-11-28T20:44:27.210 INFO:tasks.workunit.client.0.smithi167.stdout: 50844 ? 00:00:00 snaptest-double 2023-11-28T20:44:27.210 INFO:tasks.workunit.client.0.smithi167.stdout: 51149 ? 00:00:00 ps 2023-11-28T20:44:27.211 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a/.snap/one a/.snap/two 2023-11-28T20:44:27.235 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm a/foo 2023-11-28T20:44:27.242 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir a 2023-11-28T20:44:27.256 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo OK 2023-11-28T20:44:27.257 INFO:tasks.workunit.client.0.smithi167.stdout:OK 2023-11-28T20:44:27.257 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T20:44:27.257 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T20:44:27.295 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2023-11-28T20:44:27.295 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2023-11-28T20:44:29.602 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/foo 2023-11-28T20:44:29.628 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo We want ENOENT, not ESTALE, here. 2023-11-28T20:44:29.629 INFO:tasks.workunit.client.0.smithi167.stdout:We want ENOENT, not ESTALE, here. 2023-11-28T20:44:29.629 INFO:tasks.workunit.client.0.smithi167.stderr:+ seq 1 100 2023-11-28T20:44:29.631 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/1 2023-11-28T20:44:29.631 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.637 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2023-11-28T20:44:29.637 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/2 2023-11-28T20:44:29.638 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.639 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2023-11-28T20:44:29.640 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/3 2023-11-28T20:44:29.640 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.641 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2023-11-28T20:44:29.642 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/4 2023-11-28T20:44:29.643 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.644 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2023-11-28T20:44:29.645 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/5 2023-11-28T20:44:29.645 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.647 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2023-11-28T20:44:29.648 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/6 2023-11-28T20:44:29.648 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.649 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2023-11-28T20:44:29.650 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/7 2023-11-28T20:44:29.650 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.652 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2023-11-28T20:44:29.653 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/8 2023-11-28T20:44:29.653 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.655 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2023-11-28T20:44:29.656 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/9 2023-11-28T20:44:29.656 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.657 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2023-11-28T20:44:29.659 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/10 2023-11-28T20:44:29.659 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.660 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2023-11-28T20:44:29.661 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/11 2023-11-28T20:44:29.661 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.662 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2023-11-28T20:44:29.663 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/12 2023-11-28T20:44:29.663 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.667 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2023-11-28T20:44:29.668 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/13 2023-11-28T20:44:29.668 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.669 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2023-11-28T20:44:29.670 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/14 2023-11-28T20:44:29.670 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.671 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2023-11-28T20:44:29.672 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/15 2023-11-28T20:44:29.672 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.672 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2023-11-28T20:44:29.674 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/16 2023-11-28T20:44:29.674 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.675 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2023-11-28T20:44:29.676 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/17 2023-11-28T20:44:29.676 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.677 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2023-11-28T20:44:29.679 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/18 2023-11-28T20:44:29.679 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.680 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2023-11-28T20:44:29.681 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/19 2023-11-28T20:44:29.681 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.682 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2023-11-28T20:44:29.684 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/20 2023-11-28T20:44:29.684 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.685 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2023-11-28T20:44:29.687 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/21 2023-11-28T20:44:29.687 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.688 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2023-11-28T20:44:29.689 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/22 2023-11-28T20:44:29.689 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.690 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2023-11-28T20:44:29.691 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/23 2023-11-28T20:44:29.691 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.693 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2023-11-28T20:44:29.697 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/24 2023-11-28T20:44:29.698 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.698 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2023-11-28T20:44:29.700 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/25 2023-11-28T20:44:29.700 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.700 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2023-11-28T20:44:29.701 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/26 2023-11-28T20:44:29.701 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.701 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2023-11-28T20:44:29.702 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/27 2023-11-28T20:44:29.702 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.703 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2023-11-28T20:44:29.704 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/28 2023-11-28T20:44:29.704 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.705 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2023-11-28T20:44:29.706 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/29 2023-11-28T20:44:29.706 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.708 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2023-11-28T20:44:29.709 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/30 2023-11-28T20:44:29.710 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.710 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2023-11-28T20:44:29.711 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/31 2023-11-28T20:44:29.711 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.713 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2023-11-28T20:44:29.713 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/32 2023-11-28T20:44:29.715 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.715 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2023-11-28T20:44:29.716 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/33 2023-11-28T20:44:29.716 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.718 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2023-11-28T20:44:29.719 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/34 2023-11-28T20:44:29.719 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.720 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2023-11-28T20:44:29.721 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/35 2023-11-28T20:44:29.721 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.723 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2023-11-28T20:44:29.723 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/36 2023-11-28T20:44:29.724 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.725 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2023-11-28T20:44:29.726 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/37 2023-11-28T20:44:29.726 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.727 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2023-11-28T20:44:29.729 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/38 2023-11-28T20:44:29.729 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.731 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2023-11-28T20:44:29.732 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/39 2023-11-28T20:44:29.732 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.733 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2023-11-28T20:44:29.734 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/40 2023-11-28T20:44:29.734 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.735 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2023-11-28T20:44:29.736 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/41 2023-11-28T20:44:29.736 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.738 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2023-11-28T20:44:29.739 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/42 2023-11-28T20:44:29.739 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.740 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2023-11-28T20:44:29.741 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/43 2023-11-28T20:44:29.741 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.742 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2023-11-28T20:44:29.743 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/44 2023-11-28T20:44:29.743 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.745 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2023-11-28T20:44:29.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/45 2023-11-28T20:44:29.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.747 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2023-11-28T20:44:29.748 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/46 2023-11-28T20:44:29.748 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.750 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2023-11-28T20:44:29.750 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/47 2023-11-28T20:44:29.751 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.752 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2023-11-28T20:44:29.753 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/48 2023-11-28T20:44:29.753 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.754 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2023-11-28T20:44:29.755 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/49 2023-11-28T20:44:29.756 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.757 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2023-11-28T20:44:29.758 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/50 2023-11-28T20:44:29.758 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.759 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2023-11-28T20:44:29.760 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/51 2023-11-28T20:44:29.761 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.762 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2023-11-28T20:44:29.763 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/52 2023-11-28T20:44:29.763 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.764 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2023-11-28T20:44:29.765 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/53 2023-11-28T20:44:29.766 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.767 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2023-11-28T20:44:29.768 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/54 2023-11-28T20:44:29.768 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.769 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2023-11-28T20:44:29.770 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/55 2023-11-28T20:44:29.770 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.772 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2023-11-28T20:44:29.773 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/56 2023-11-28T20:44:29.773 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.774 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2023-11-28T20:44:29.775 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/57 2023-11-28T20:44:29.775 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.777 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2023-11-28T20:44:29.778 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/58 2023-11-28T20:44:29.778 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.779 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2023-11-28T20:44:29.780 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/59 2023-11-28T20:44:29.780 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.782 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2023-11-28T20:44:29.782 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/60 2023-11-28T20:44:29.783 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.785 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2023-11-28T20:44:29.786 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/61 2023-11-28T20:44:29.786 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.788 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2023-11-28T20:44:29.789 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/62 2023-11-28T20:44:29.790 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.791 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2023-11-28T20:44:29.792 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/63 2023-11-28T20:44:29.792 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.793 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2023-11-28T20:44:29.794 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/64 2023-11-28T20:44:29.794 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.795 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2023-11-28T20:44:29.797 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/65 2023-11-28T20:44:29.797 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.798 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2023-11-28T20:44:29.799 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/66 2023-11-28T20:44:29.799 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.800 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2023-11-28T20:44:29.802 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/67 2023-11-28T20:44:29.802 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.803 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2023-11-28T20:44:29.804 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/68 2023-11-28T20:44:29.804 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.806 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2023-11-28T20:44:29.807 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/69 2023-11-28T20:44:29.807 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.808 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2023-11-28T20:44:29.809 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/70 2023-11-28T20:44:29.809 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.810 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2023-11-28T20:44:29.811 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/71 2023-11-28T20:44:29.812 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.813 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2023-11-28T20:44:29.814 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/72 2023-11-28T20:44:29.814 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.816 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2023-11-28T20:44:29.817 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/73 2023-11-28T20:44:29.817 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.818 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2023-11-28T20:44:29.819 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/74 2023-11-28T20:44:29.819 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.821 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2023-11-28T20:44:29.821 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/75 2023-11-28T20:44:29.821 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.823 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2023-11-28T20:44:29.824 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/76 2023-11-28T20:44:29.824 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.825 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2023-11-28T20:44:29.826 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/77 2023-11-28T20:44:29.826 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.828 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2023-11-28T20:44:29.829 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/78 2023-11-28T20:44:29.829 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.830 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2023-11-28T20:44:29.831 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/79 2023-11-28T20:44:29.831 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.833 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2023-11-28T20:44:29.834 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/80 2023-11-28T20:44:29.834 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.835 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2023-11-28T20:44:29.836 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/81 2023-11-28T20:44:29.836 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:29.838 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2023-11-28T20:44:29.839 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/82 2023-11-28T20:44:29.839 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.002 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2023-11-28T20:44:30.003 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/83 2023-11-28T20:44:30.003 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.005 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2023-11-28T20:44:30.005 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/84 2023-11-28T20:44:30.006 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.006 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2023-11-28T20:44:30.007 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/85 2023-11-28T20:44:30.008 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.009 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2023-11-28T20:44:30.010 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/86 2023-11-28T20:44:30.011 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.012 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2023-11-28T20:44:30.013 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/87 2023-11-28T20:44:30.013 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.014 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2023-11-28T20:44:30.015 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/88 2023-11-28T20:44:30.015 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.017 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2023-11-28T20:44:30.018 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/89 2023-11-28T20:44:30.018 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.019 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2023-11-28T20:44:30.020 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/90 2023-11-28T20:44:30.020 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.022 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2023-11-28T20:44:30.023 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/91 2023-11-28T20:44:30.023 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.024 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2023-11-28T20:44:30.026 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/92 2023-11-28T20:44:30.026 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.027 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2023-11-28T20:44:30.028 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/93 2023-11-28T20:44:30.028 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.030 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2023-11-28T20:44:30.030 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/94 2023-11-28T20:44:30.031 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.032 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2023-11-28T20:44:30.033 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/95 2023-11-28T20:44:30.033 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.034 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2023-11-28T20:44:30.036 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/96 2023-11-28T20:44:30.037 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.037 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2023-11-28T20:44:30.038 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/97 2023-11-28T20:44:30.038 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.040 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2023-11-28T20:44:30.041 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/98 2023-11-28T20:44:30.041 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.042 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2023-11-28T20:44:30.043 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/99 2023-11-28T20:44:30.043 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.046 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2023-11-28T20:44:30.047 INFO:tasks.workunit.client.0.smithi167.stderr:+ stat .snap/foo/100 2023-11-28T20:44:30.047 INFO:tasks.workunit.client.0.smithi167.stderr:+ grep No such file 2023-11-28T20:44:30.047 INFO:tasks.workunit.client.0.smithi167.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2023-11-28T20:44:30.047 INFO:tasks.workunit.client.0.smithi167.stderr:+ rmdir .snap/foo 2023-11-28T20:44:30.059 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo OK 2023-11-28T20:44:30.060 INFO:tasks.workunit.client.0.smithi167.stdout:OK 2023-11-28T20:44:30.061 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-28T20:44:30.061 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-28T20:44:30.090 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2023-11-28T20:44:30.090 DEBUG:teuthology.orchestra.run.smithi167:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2023-11-28T20:44:30.150 INFO:tasks.workunit.client.0.smithi167.stderr:+ set -e 2023-11-28T20:44:30.150 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo git config --global http.sslVerify false 2023-11-28T20:44:30.169 INFO:tasks.workunit.client.0.smithi167.stderr:+ sudo git config --global http.postBuffer 1048576000 2023-11-28T20:44:30.182 INFO:tasks.workunit.client.0.smithi167.stderr:+ retried=false 2023-11-28T20:44:30.183 INFO:tasks.workunit.client.0.smithi167.stderr:+ trap -- retry EXIT 2023-11-28T20:44:30.183 INFO:tasks.workunit.client.0.smithi167.stderr:+ rm -rf ceph 2023-11-28T20:44:30.183 INFO:tasks.workunit.client.0.smithi167.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2023-11-28T20:44:30.758 INFO:tasks.workunit.client.0.smithi167.stderr:Cloning into 'ceph'... 2023-11-28T20:44:43.778 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:44:43.779 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2023-11-28T20:44:43.779 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T20:44:43.779 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T20:44:43.783 INFO:tasks.ceph.mon.a:Started 2023-11-28T20:44:43.784 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:44:43.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:44:43.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffe92a640 1 Processor -- start 2023-11-28T20:44:43.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffe92a640 1 -- start start 2023-11-28T20:44:43.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffe92a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ff806d530 0x7f2ff8066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:43.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffe92a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 0x7f2ff81646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:43.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffe92a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80c8280 con 0x7f2ff80aff70 2023-11-28T20:44:43.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffe92a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff80c8910 con 0x7f2ff815d3b0 2023-11-28T20:44:43.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffe92a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff8066bc0 con 0x7f2ff806d530 2023-11-28T20:44:43.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffcec7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 0x7f2ff81646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:43.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffcec7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 0x7f2ff81646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34450/0 (socket says 172.21.15.167:34450) 2023-11-28T20:44:43.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffcec7640 1 -- 172.21.15.167:0/1330617098 learned_addr learned my addr 172.21.15.167:0/1330617098 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:43.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ff77fe640 1 --2- 172.21.15.167:0/1330617098 >> v2:172.21.15.178:3300/0 conn(0x7f2ff806d530 0x7f2ff8066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:43.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffcec7640 1 -- 172.21.15.167:0/1330617098 >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 msgr2=0x7f2ff81646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:44:43.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffcec7640 1 -- 172.21.15.167:0/1330617098 >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 msgr2=0x7f2ff81646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:43.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.932+0000 7f2ffcec7640 1 --2- 172.21.15.167:0/1330617098 >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 0x7f2ff81646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:43.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.936+0000 7f2ffcec7640 1 --2- 172.21.15.167:0/1330617098 >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 0x7f2ff81646e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:43.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.936+0000 7f2ff77fe640 1 -- 172.21.15.167:0/1330617098 >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 msgr2=0x7f2ff81646e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:43.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.936+0000 7f2ff77fe640 1 --2- 172.21.15.167:0/1330617098 >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 0x7f2ff81646e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:43.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.936+0000 7f2ff77fe640 1 -- 172.21.15.167:0/1330617098 >> v1:172.21.15.178:6789/0 conn(0x7f2ff80aff70 legacy=0x7f2ff806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:43.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.936+0000 7f2ff77fe640 1 -- 172.21.15.167:0/1330617098 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80ca3b0 con 0x7f2ff806d530 2023-11-28T20:44:43.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.936+0000 7f2ff77fe640 1 --2- 172.21.15.167:0/1330617098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ff806d530 0x7f2ff8066680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80ca1a0 tx=0x7f2fec01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8d003a73e034437 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:43.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.936+0000 7f2ff6ffd640 1 -- 172.21.15.167:0/1330617098 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0a7070 con 0x7f2ff806d530 2023-11-28T20:44:43.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.936+0000 7f2ff6ffd640 1 -- 172.21.15.167:0/1330617098 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec0ab430 con 0x7f2ff806d530 2023-11-28T20:44:43.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.936+0000 7f2ff6ffd640 1 -- 172.21.15.167:0/1330617098 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0ab7c0 con 0x7f2ff806d530 2023-11-28T20:44:43.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 -- 172.21.15.167:0/1330617098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ff806d530 msgr2=0x7f2ff8066680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:43.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 --2- 172.21.15.167:0/1330617098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ff806d530 0x7f2ff8066680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80ca1a0 tx=0x7f2fec01c430 comp rx=0 tx=0).stop 2023-11-28T20:44:43.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 -- 172.21.15.167:0/1330617098 shutdown_connections 2023-11-28T20:44:43.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 --2- 172.21.15.167:0/1330617098 >> v2:172.21.15.167:3300/0 conn(0x7f2ff815d3b0 0x7f2ff81646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:43.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 --2- 172.21.15.167:0/1330617098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ff806d530 0x7f2ff8066680 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:43.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 -- 172.21.15.167:0/1330617098 >> 172.21.15.167:0/1330617098 conn(0x7f2ff806ee00 msgr2=0x7f2ff806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:43.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 -- 172.21.15.167:0/1330617098 shutdown_connections 2023-11-28T20:44:43.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 -- 172.21.15.167:0/1330617098 wait complete. 2023-11-28T20:44:43.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 Processor -- start 2023-11-28T20:44:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 -- start start 2023-11-28T20:44:43.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ff806d530 0x7f2ff81f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:43.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 0x7f2ff81591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:43.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ff815d3b0 0x7f2ff815b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:43.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff814db30 con 0x7f2ff80aff70 2023-11-28T20:44:43.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff814cfb0 con 0x7f2ff815d3b0 2023-11-28T20:44:43.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffe92a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff814d290 con 0x7f2ff806d530 2023-11-28T20:44:43.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ff77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 0x7f2ff81591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:43.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ff77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 0x7f2ff81591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34466/0 (socket says 172.21.15.167:34466) 2023-11-28T20:44:43.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ff77fe640 1 -- 172.21.15.167:0/541299472 learned_addr learned my addr 172.21.15.167:0/541299472 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ff77fe640 1 -- 172.21.15.167:0/541299472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 msgr2=0x7f2ff81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ff77fe640 1 -- 172.21.15.167:0/541299472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 msgr2=0x7f2ff81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ff77fe640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 0x7f2ff81591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ffcec7640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ff815d3b0 0x7f2ff815b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ff7fff640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ff806d530 0x7f2ff81f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.940+0000 7f2ff77fe640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 0x7f2ff81591e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff7fff640 1 -- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ff815d3b0 msgr2=0x7f2ff815b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff7fff640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ff815d3b0 0x7f2ff815b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff7fff640 1 -- 172.21.15.167:0/541299472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 msgr2=0x7f2ff81591e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff7fff640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 0x7f2ff81591e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff7fff640 1 -- 172.21.15.167:0/541299472 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec009420 con 0x7f2ff806d530 2023-11-28T20:44:43.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff7fff640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ff806d530 0x7f2ff81f3cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8000f70 tx=0x7f2fe800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:43.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff4ff9640 1 -- 172.21.15.167:0/541299472 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80052d0 con 0x7f2ff806d530 2023-11-28T20:44:43.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff4ff9640 1 -- 172.21.15.167:0/541299472 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8005430 con 0x7f2ff806d530 2023-11-28T20:44:43.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff4ff9640 1 -- 172.21.15.167:0/541299472 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8003840 con 0x7f2ff806d530 2023-11-28T20:44:43.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff814d570 con 0x7f2ff806d530 2023-11-28T20:44:43.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff815b040 con 0x7f2ff806d530 2023-11-28T20:44:43.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff815b230 con 0x7f2ff806d530 2023-11-28T20:44:43.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.944+0000 7f2ff4ff9640 1 -- 172.21.15.167:0/541299472 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2fe80039a0 con 0x7f2ff806d530 2023-11-28T20:44:43.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.948+0000 7f2ff4ff9640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2fe4066470 0x7f2fe4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:43.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.948+0000 7f2ff4ff9640 1 -- 172.21.15.167:0/541299472 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6775+0+0 (secure 0 0 0) 0x7f2fe8083d30 con 0x7f2ff806d530 2023-11-28T20:44:43.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.948+0000 7f2ff77fe640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2fe4066470 0x7f2fe4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:43.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.948+0000 7f2ff77fe640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2fe4066470 0x7f2fe4068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2fec000c10 tx=0x7f2fec0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:43.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:43.960+0000 7f2ff4ff9640 1 -- 172.21.15.167:0/541299472 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fe8050d80 con 0x7f2ff806d530 2023-11-28T20:44:44.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.160+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2ff8075c90 con 0x7f2ff806d530 2023-11-28T20:44:44.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.160+0000 7f2ff4ff9640 1 -- 172.21.15.167:0/541299472 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f2fe8017080 con 0x7f2ff806d530 2023-11-28T20:44:44.163 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":48,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:44:44.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2fe4066470 msgr2=0x7f2fe4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:44.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2fe4066470 0x7f2fe4068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2fec000c10 tx=0x7f2fec0a7000 comp rx=0 tx=0).stop 2023-11-28T20:44:44.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ff806d530 msgr2=0x7f2ff81f3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:44.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ff806d530 0x7f2ff81f3cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8000f70 tx=0x7f2fe800c820 comp rx=0 tx=0).stop 2023-11-28T20:44:44.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 shutdown_connections 2023-11-28T20:44:44.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2fe4066470 0x7f2fe4068930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:44.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ff815d3b0 0x7f2ff815b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:44.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff80aff70 0x7f2ff81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:44.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 --2- 172.21.15.167:0/541299472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ff806d530 0x7f2ff81f3cb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:44.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 >> 172.21.15.167:0/541299472 conn(0x7f2ff806ee00 msgr2=0x7f2ff806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 shutdown_connections 2023-11-28T20:44:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:44.164+0000 7f2ffe92a640 1 -- 172.21.15.167:0/541299472 wait complete. 2023-11-28T20:44:47.018 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:44:47.022 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:44:47.184 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:44:47.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.328+0000 7fdadc12a640 1 Processor -- start 2023-11-28T20:44:47.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.328+0000 7fdadc12a640 1 -- start start 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.328+0000 7fdadc12a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.328+0000 7fdadc12a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.328+0000 7fdadc12a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.328+0000 7fdadc12a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad40c4da0 con 0x7fdad40c5c90 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.328+0000 7fdadc12a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad415b220 con 0x7fdad406a580 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.328+0000 7fdadc12a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40c60f0 con 0x7fdad4151f60 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad96c5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad96c5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34468/0 (socket says 172.21.15.167:34468) 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad96c5640 1 -- 172.21.15.167:0/4241199301 learned_addr learned my addr 172.21.15.167:0/4241199301 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad96c5640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 msgr2=0x7fdad40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad96c5640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 msgr2=0x7fdad40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdada6c7640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 msgr2=0x7fdad406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdada6c7640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 msgr2=0x7fdad406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdad40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdad40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.332+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad96c5640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 msgr2=0x7fdad40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:44:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad96c5640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 msgr2=0x7fdad40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdada6c7640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 msgr2=0x7fdad406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdada6c7640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 msgr2=0x7fdad406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdad40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdad40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:47.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:44:47.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.536+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:44:47.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:47.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:47.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:47.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad96c5640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 msgr2=0x7fdad40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:44:47.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad96c5640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 msgr2=0x7fdad40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:47.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:47.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:44:47.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdad40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:44:47.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdad40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:47.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:47.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdada6c7640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 msgr2=0x7fdad406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:44:47.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdada6c7640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 msgr2=0x7fdad406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:47.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:47.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:44:47.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:47.940+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:44:48.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:48.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:48.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:48.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad96c5640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 msgr2=0x7fdad40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:44:48.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad96c5640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 msgr2=0x7fdad40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdada6c7640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 msgr2=0x7fdad406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdada6c7640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 msgr2=0x7fdad406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdad40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdad40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:48.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:48.744+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:44:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:50.332+0000 7fdacb7fe640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdad40c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:50.332+0000 7fdacb7fe640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdad40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:50.332+0000 7fdacb7fe640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 msgr2=0x7fdad406a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:50.332+0000 7fdacb7fe640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.178:3300/0 conn(0x7fdad406a580 0x7fdad406a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:50.332+0000 7fdacb7fe640 1 -- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 msgr2=0x7fdad40c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:44:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:50.332+0000 7fdacb7fe640 1 --2- 172.21.15.167:0/4241199301 >> v2:172.21.15.167:3300/0 conn(0x7fdad40c5c90 0x7fdad40c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:50.332+0000 7fdacb7fe640 1 -- 172.21.15.167:0/4241199301 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad4152340 con 0x7fdac0003680 2023-11-28T20:44:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:50.332+0000 7fdacb7fe640 1 -- 172.21.15.167:0/4241199301 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac000c090 con 0x7fdac0007310 2023-11-28T20:44:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455605236 0 0) 0x7fdad4152340 con 0x7fdac0003680 2023-11-28T20:44:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab8003530 con 0x7fdac0003680 2023-11-28T20:44:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 145747556 0 0) 0x7fdab8003530 con 0x7fdac0003680 2023-11-28T20:44:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 >> v1:172.21.15.178:6789/0 conn(0x7fdac0007310 legacy=0x7fdac00097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac000d290 con 0x7fdac0003680 2023-11-28T20:44:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fdad000e510 con 0x7fdac0003680 2023-11-28T20:44:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 >> v1:172.21.15.167:6789/0 conn(0x7fdac0003680 legacy=0x7fdac0005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdada6c7640 1 -- 172.21.15.167:0/4241199301 reap_dead start 2023-11-28T20:44:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8003a50 0x7fdab8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdab80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdab800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80056a0 con 0x7fdab8003a50 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab800bf00 con 0x7fdab8004f10 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab800c0c0 con 0x7fdad4151f60 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8003a50 0x7fdab8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdab80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdab800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 msgr2=0x7fdab80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdab80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 msgr2=0x7fdab800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdab800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.988+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4241199301 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8003530 con 0x7fdab8003a50 2023-11-28T20:44:51.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8003a50 0x7fdab8003e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdad000efb0 tx=0x7fdad001d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f498932347697fcb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:51.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad00ad660 con 0x7fdab8003a50 2023-11-28T20:44:51.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad000c040 con 0x7fdab8003a50 2023-11-28T20:44:51.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdad8ec4640 1 -- 172.21.15.167:0/4241199301 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad00ada20 con 0x7fdab8003a50 2023-11-28T20:44:51.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdadc12a640 1 -- 172.21.15.167:0/4241199301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8003a50 msgr2=0x7fdab8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:51.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8003a50 0x7fdab8003e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdad000efb0 tx=0x7fdad001d810 comp rx=0 tx=0).stop 2023-11-28T20:44:51.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdadc12a640 1 -- 172.21.15.167:0/4241199301 shutdown_connections 2023-11-28T20:44:51.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdab800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:51.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8003a50 0x7fdab8003e50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:51.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4241199301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad4151f60 0x7fdab80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:51.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdadc12a640 1 -- 172.21.15.167:0/4241199301 >> 172.21.15.167:0/4241199301 conn(0x7fdad40cb1e0 msgr2=0x7fdad40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:51.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdadc12a640 1 -- 172.21.15.167:0/4241199301 shutdown_connections 2023-11-28T20:44:51.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.992+0000 7fdadc12a640 1 -- 172.21.15.167:0/4241199301 wait complete. 2023-11-28T20:44:51.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 Processor -- start 2023-11-28T20:44:51.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 -- start start 2023-11-28T20:44:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8003a50 0x7fdad41ee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdad414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdad4151f60 0x7fdad414c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad414a100 con 0x7fdad4151f60 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad414a300 con 0x7fdab8004f10 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad414a5e0 con 0x7fdab8003a50 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdada6c7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdad4151f60 0x7fdad414c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdada6c7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdad4151f60 0x7fdad414c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34508/0 (socket says 172.21.15.167:34508) 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdada6c7640 1 -- 172.21.15.167:0/4276444984 learned_addr learned my addr 172.21.15.167:0/4276444984 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdad414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:52.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8003a50 0x7fdad41ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad96c5640 1 -- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 msgr2=0x7fdad414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:44:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad96c5640 1 -- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 msgr2=0x7fdad414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:44:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdad414b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad96c5640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdad414b680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8003a50 msgr2=0x7fdad41ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:44:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad9ec6640 1 -- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8003a50 msgr2=0x7fdad41ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:44:52.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8003a50 0x7fdad41ee480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:52.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8003a50 0x7fdad41ee480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:52.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdada6c7640 1 -- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8003a50 msgr2=0x7fdad41ee480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:52.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8003a50 0x7fdad41ee480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:52.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdada6c7640 1 -- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 msgr2=0x7fdad414b680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:52.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdad414b680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:52.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdada6c7640 1 -- 172.21.15.167:0/4276444984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad414a8c0 con 0x7fdad4151f60 2023-11-28T20:44:52.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdada6c7640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdad4151f60 0x7fdad414c220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdac0007280 tx=0x7fdacc014690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:52.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdaca7fc640 1 -- 172.21.15.167:0/4276444984 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc003ea0 con 0x7fdad4151f60 2023-11-28T20:44:52.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdaca7fc640 1 -- 172.21.15.167:0/4276444984 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00f040 con 0x7fdad4151f60 2023-11-28T20:44:52.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdaca7fc640 1 -- 172.21.15.167:0/4276444984 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc017440 con 0x7fdad4151f60 2023-11-28T20:44:52.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad414aba0 con 0x7fdad4151f60 2023-11-28T20:44:52.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:51.996+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad414b160 con 0x7fdad4151f60 2023-11-28T20:44:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.000+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad40682c0 con 0x7fdad4151f60 2023-11-28T20:44:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.000+0000 7fdaca7fc640 1 -- 172.21.15.167:0/4276444984 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdacc0175a0 con 0x7fdad4151f60 2023-11-28T20:44:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.000+0000 7fdaca7fc640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdac0066e80 0x7fdac0069340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.000+0000 7fdaca7fc640 1 -- 172.21.15.167:0/4276444984 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fdacc085860 con 0x7fdad4151f60 2023-11-28T20:44:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.000+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdac0066e80 0x7fdac0069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.004+0000 7fdad9ec6640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdac0066e80 0x7fdac0069340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdad00b1000 tx=0x7fdad0004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:52.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.004+0000 7fdaca7fc640 1 -- 172.21.15.167:0/4276444984 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdacc0528d0 con 0x7fdad4151f60 2023-11-28T20:44:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.208+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdad4075c90 con 0x7fdad4151f60 2023-11-28T20:44:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.208+0000 7fdaca7fc640 1 -- 172.21.15.167:0/4276444984 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7fdacc01b620 con 0x7fdad4151f60 2023-11-28T20:44:52.211 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":52,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdac0066e80 msgr2=0x7fdac0069340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdac0066e80 0x7fdac0069340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdad00b1000 tx=0x7fdad0004740 comp rx=0 tx=0).stop 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdad4151f60 msgr2=0x7fdad414c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdad4151f60 0x7fdad414c220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdac0007280 tx=0x7fdacc014690 comp rx=0 tx=0).stop 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 shutdown_connections 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdac0066e80 0x7fdac0069340 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdad4151f60 0x7fdad414c220 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004f10 0x7fdad414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 --2- 172.21.15.167:0/4276444984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8003a50 0x7fdad41ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 >> 172.21.15.167:0/4276444984 conn(0x7fdad40cb1e0 msgr2=0x7fdad41577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 shutdown_connections 2023-11-28T20:44:52.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:52.212+0000 7fdadc12a640 1 -- 172.21.15.167:0/4276444984 wait complete. 2023-11-28T20:44:55.232 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:44:55.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.372+0000 7fe03770f640 1 Processor -- start 2023-11-28T20:44:55.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.372+0000 7fe03770f640 1 -- start start 2023-11-28T20:44:55.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe03770f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe0300c75c0 0x7fe0300c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:55.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe03770f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe03006a580 0x7fe03006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:55.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe03770f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0300c7a50 con 0x7fe030151f60 2023-11-28T20:44:55.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe03770f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03006aed0 con 0x7fe03006a580 2023-11-28T20:44:55.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe03770f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0300c4da0 con 0x7fe0300c75c0 2023-11-28T20:44:55.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe035cac640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe03006a580 0x7fe03006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:55.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe035cac640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe03006a580 0x7fe03006a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43504/0 (socket says 172.21.15.167:43504) 2023-11-28T20:44:55.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe035cac640 1 -- 172.21.15.167:0/1042502872 learned_addr learned my addr 172.21.15.167:0/1042502872 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:55.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe034caa640 1 --2- 172.21.15.167:0/1042502872 >> v2:172.21.15.178:3300/0 conn(0x7fe0300c75c0 0x7fe0300c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:55.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe035cac640 1 -- 172.21.15.167:0/1042502872 >> v2:172.21.15.178:3300/0 conn(0x7fe0300c75c0 msgr2=0x7fe0300c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:55.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe035cac640 1 --2- 172.21.15.167:0/1042502872 >> v2:172.21.15.178:3300/0 conn(0x7fe0300c75c0 0x7fe0300c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:55.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe035cac640 1 -- 172.21.15.167:0/1042502872 >> v1:172.21.15.178:6789/0 conn(0x7fe030151f60 legacy=0x7fe0300c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:55.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe035cac640 1 -- 172.21.15.167:0/1042502872 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03015b220 con 0x7fe03006a580 2023-11-28T20:44:55.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.376+0000 7fe035cac640 1 --2- 172.21.15.167:0/1042502872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 0x7fe03006a990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0300c8d80 tx=0x7fe02801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ab8fddba39fc41 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:55.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe027fff640 1 -- 172.21.15.167:0/1042502872 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280a55c0 con 0x7fe03006a580 2023-11-28T20:44:55.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe027fff640 1 -- 172.21.15.167:0/1042502872 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0280a5720 con 0x7fe03006a580 2023-11-28T20:44:55.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe027fff640 1 -- 172.21.15.167:0/1042502872 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280a5ab0 con 0x7fe03006a580 2023-11-28T20:44:55.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 -- 172.21.15.167:0/1042502872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 msgr2=0x7fe03006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:55.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 --2- 172.21.15.167:0/1042502872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 0x7fe03006a990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0300c8d80 tx=0x7fe02801c900 comp rx=0 tx=0).stop 2023-11-28T20:44:55.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 -- 172.21.15.167:0/1042502872 shutdown_connections 2023-11-28T20:44:55.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 --2- 172.21.15.167:0/1042502872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 0x7fe03006a990 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:55.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 --2- 172.21.15.167:0/1042502872 >> v2:172.21.15.178:3300/0 conn(0x7fe0300c75c0 0x7fe0300c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:55.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 -- 172.21.15.167:0/1042502872 >> 172.21.15.167:0/1042502872 conn(0x7fe0300cb1e0 msgr2=0x7fe0300cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:55.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 -- 172.21.15.167:0/1042502872 shutdown_connections 2023-11-28T20:44:55.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 -- 172.21.15.167:0/1042502872 wait complete. 2023-11-28T20:44:55.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 Processor -- start 2023-11-28T20:44:55.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 -- start start 2023-11-28T20:44:55.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 0x7fe030071b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:55.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0300c75c0 0x7fe0300720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:55.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe030151f60 0x7fe0301f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:55.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0300c97b0 con 0x7fe03006a580 2023-11-28T20:44:55.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0301477e0 con 0x7fe030151f60 2023-11-28T20:44:55.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.380+0000 7fe03770f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe030147aa0 con 0x7fe0300c75c0 2023-11-28T20:44:55.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe0354ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 0x7fe030071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe0354ab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 0x7fe030071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43520/0 (socket says 172.21.15.167:43520) 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe0354ab640 1 -- 172.21.15.167:0/2648860648 learned_addr learned my addr 172.21.15.167:0/2648860648 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe034caa640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0300c75c0 0x7fe0300720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe035cac640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe030151f60 0x7fe0301f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe034caa640 1 -- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0300c75c0 msgr2=0x7fe0300720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe034caa640 1 -- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0300c75c0 msgr2=0x7fe0300720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe034caa640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0300c75c0 0x7fe0300720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe0354ab640 1 -- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0300c75c0 msgr2=0x7fe0300720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe034caa640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0300c75c0 0x7fe0300720d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe035cac640 1 -- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe030151f60 msgr2=0x7fe0301f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe035cac640 1 -- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe030151f60 msgr2=0x7fe0301f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:44:55.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe035cac640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe030151f60 0x7fe0301f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:44:55.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe0354ab640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0300c75c0 0x7fe0300720d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:55.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe035cac640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe030151f60 0x7fe0301f2a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:44:55.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe0354ab640 1 -- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe030151f60 msgr2=0x7fe0301f2a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:44:55.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe0354ab640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe030151f60 0x7fe0301f2a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:55.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe0354ab640 1 -- 172.21.15.167:0/2648860648 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028009b30 con 0x7fe03006a580 2023-11-28T20:44:55.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe0354ab640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 0x7fe030071b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c450 tx=0x7fe02c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:55.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe025ffb640 1 -- 172.21.15.167:0/2648860648 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c012830 con 0x7fe03006a580 2023-11-28T20:44:55.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe025ffb640 1 -- 172.21.15.167:0/2648860648 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c0129b0 con 0x7fe03006a580 2023-11-28T20:44:55.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe025ffb640 1 -- 172.21.15.167:0/2648860648 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c012d60 con 0x7fe03006a580 2023-11-28T20:44:55.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0300c9160 con 0x7fe03006a580 2023-11-28T20:44:55.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe030147150 con 0x7fe03006a580 2023-11-28T20:44:55.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0300682c0 con 0x7fe03006a580 2023-11-28T20:44:55.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.384+0000 7fe025ffb640 1 -- 172.21.15.167:0/2648860648 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe02c01c460 con 0x7fe03006a580 2023-11-28T20:44:55.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.388+0000 7fe025ffb640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe014066470 0x7fe014068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:55.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.388+0000 7fe025ffb640 1 -- 172.21.15.167:0/2648860648 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe02c084170 con 0x7fe03006a580 2023-11-28T20:44:55.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.388+0000 7fe034caa640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe014066470 0x7fe014068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:55.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.388+0000 7fe034caa640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe014066470 0x7fe014068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe0301f3840 tx=0x7fe020008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:55.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.392+0000 7fe025ffb640 1 -- 172.21.15.167:0/2648860648 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe02c051160 con 0x7fe03006a580 2023-11-28T20:44:55.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.608+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe030075c90 con 0x7fe03006a580 2023-11-28T20:44:55.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.608+0000 7fe025ffb640 1 -- 172.21.15.167:0/2648860648 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7fe02c054780 con 0x7fe03006a580 2023-11-28T20:44:55.611 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":52,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:44:55.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe014066470 msgr2=0x7fe014068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe014066470 0x7fe014068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe0301f3840 tx=0x7fe020008040 comp rx=0 tx=0).stop 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 msgr2=0x7fe030071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 0x7fe030071b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c450 tx=0x7fe02c00c910 comp rx=0 tx=0).stop 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 shutdown_connections 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe014066470 0x7fe014068930 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe030151f60 0x7fe0301f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0300c75c0 0x7fe0300720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 --2- 172.21.15.167:0/2648860648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe03006a580 0x7fe030071b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 >> 172.21.15.167:0/2648860648 conn(0x7fe0300cb1e0 msgr2=0x7fe0300c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:55.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 shutdown_connections 2023-11-28T20:44:55.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:55.612+0000 7fe03770f640 1 -- 172.21.15.167:0/2648860648 wait complete. 2023-11-28T20:44:58.641 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:44:58.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.788+0000 7fbc35617640 1 Processor -- start 2023-11-28T20:44:58.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.788+0000 7fbc35617640 1 -- start start 2023-11-28T20:44:58.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc35617640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc30153f40 0x7fbc30159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:58.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc35617640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300ca660 0x7fbc300cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:58.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc35617640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc300cb5c0 con 0x7fbc300caa60 2023-11-28T20:44:58.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc35617640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc300b2c60 con 0x7fbc30153f40 2023-11-28T20:44:58.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc35617640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300c4f00 con 0x7fbc300ca660 2023-11-28T20:44:58.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc2f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbc300caa60 0x7fbc300c5950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:49882/0 (socket says 172.21.15.167:49882) 2023-11-28T20:44:58.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc2f7fe640 1 -- 172.21.15.167:0/683044827 learned_addr learned my addr 172.21.15.167:0/683044827 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:44:58.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc2effd640 1 --2- 172.21.15.167:0/683044827 >> v2:172.21.15.178:3300/0 conn(0x7fbc30153f40 0x7fbc30159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:58.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc2e7fc640 1 --2- 172.21.15.167:0/683044827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300ca660 0x7fbc300cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:58.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc2effd640 1 -- 172.21.15.167:0/683044827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300ca660 msgr2=0x7fbc300cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:44:58.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc2effd640 1 --2- 172.21.15.167:0/683044827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300ca660 0x7fbc300cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:58.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc2effd640 1 -- 172.21.15.167:0/683044827 >> v1:172.21.15.167:6789/0 conn(0x7fbc300caa60 legacy=0x7fbc300c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:58.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.792+0000 7fbc2effd640 1 -- 172.21.15.167:0/683044827 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc300c54c0 con 0x7fbc30153f40 2023-11-28T20:44:58.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc2effd640 1 --2- 172.21.15.167:0/683044827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc30153f40 0x7fbc30159aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc200097c0 tx=0x7fbc2001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deef4f2066adf60f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:58.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc2dffb640 1 -- 172.21.15.167:0/683044827 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200ab600 con 0x7fbc30153f40 2023-11-28T20:44:58.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc2dffb640 1 -- 172.21.15.167:0/683044827 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc200a7050 con 0x7fbc30153f40 2023-11-28T20:44:58.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc2dffb640 1 -- 172.21.15.167:0/683044827 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200ab980 con 0x7fbc30153f40 2023-11-28T20:44:58.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc35617640 1 -- 172.21.15.167:0/683044827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc30153f40 msgr2=0x7fbc30159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:58.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc35617640 1 --2- 172.21.15.167:0/683044827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc30153f40 0x7fbc30159aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc200097c0 tx=0x7fbc2001c480 comp rx=0 tx=0).stop 2023-11-28T20:44:58.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc35617640 1 -- 172.21.15.167:0/683044827 shutdown_connections 2023-11-28T20:44:58.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc35617640 1 --2- 172.21.15.167:0/683044827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300ca660 0x7fbc300cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:58.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc35617640 1 --2- 172.21.15.167:0/683044827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc30153f40 0x7fbc30159aa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:58.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc35617640 1 -- 172.21.15.167:0/683044827 >> 172.21.15.167:0/683044827 conn(0x7fbc3006b800 msgr2=0x7fbc3006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:58.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc35617640 1 -- 172.21.15.167:0/683044827 shutdown_connections 2023-11-28T20:44:58.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.796+0000 7fbc35617640 1 -- 172.21.15.167:0/683044827 wait complete. 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 Processor -- start 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 -- start start 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300ca660 0x7fbc300b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc300caa60 0x7fbc300c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc30153f40 0x7fbc300c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301f6040 con 0x7fbc300caa60 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301f6250 con 0x7fbc300ca660 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301f6530 con 0x7fbc30153f40 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc300caa60 0x7fbc300c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc300caa60 0x7fbc300c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43522/0 (socket says 172.21.15.167:43522) 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2e7fc640 1 -- 172.21.15.167:0/1394609907 learned_addr learned my addr 172.21.15.167:0/1394609907 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:44:58.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2f7fe640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc30153f40 0x7fbc300c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2effd640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300ca660 0x7fbc300b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2e7fc640 1 -- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc30153f40 msgr2=0x7fbc300c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2e7fc640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc30153f40 0x7fbc300c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2e7fc640 1 -- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300ca660 msgr2=0x7fbc300b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2e7fc640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300ca660 0x7fbc300b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2e7fc640 1 -- 172.21.15.167:0/1394609907 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20009420 con 0x7fbc300caa60 2023-11-28T20:44:58.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc2e7fc640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc300caa60 0x7fbc300c7e80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400e930 tx=0x7fbc2400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:58.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc177fe640 1 -- 172.21.15.167:0/1394609907 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24009690 con 0x7fbc300caa60 2023-11-28T20:44:58.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc177fe640 1 -- 172.21.15.167:0/1394609907 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2400ca00 con 0x7fbc300caa60 2023-11-28T20:44:58.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc301f6810 con 0x7fbc300caa60 2023-11-28T20:44:58.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc177fe640 1 -- 172.21.15.167:0/1394609907 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400cd70 con 0x7fbc300caa60 2023-11-28T20:44:58.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.800+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc30159240 con 0x7fbc300caa60 2023-11-28T20:44:58.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.804+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3004e850 con 0x7fbc300caa60 2023-11-28T20:44:58.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.804+0000 7fbc177fe640 1 -- 172.21.15.167:0/1394609907 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbc24013470 con 0x7fbc300caa60 2023-11-28T20:44:58.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.804+0000 7fbc177fe640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc1c066470 0x7fbc1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:44:58.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.804+0000 7fbc177fe640 1 -- 172.21.15.167:0/1394609907 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fbc24084890 con 0x7fbc300caa60 2023-11-28T20:44:58.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.804+0000 7fbc2effd640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc1c066470 0x7fbc1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:44:58.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.808+0000 7fbc2effd640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc1c066470 0x7fbc1c068930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbc200ad000 tx=0x7fbc200a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:44:58.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:58.808+0000 7fbc177fe640 1 -- 172.21.15.167:0/1394609907 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc24051a00 con 0x7fbc300caa60 2023-11-28T20:44:59.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.060+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbc300caec0 con 0x7fbc300caa60 2023-11-28T20:44:59.064 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":52,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:44:59.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc177fe640 1 -- 172.21.15.167:0/1394609907 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7fbc24021620 con 0x7fbc300caa60 2023-11-28T20:44:59.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc1c066470 msgr2=0x7fbc1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc1c066470 0x7fbc1c068930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbc200ad000 tx=0x7fbc200a6000 comp rx=0 tx=0).stop 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc300caa60 msgr2=0x7fbc300c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc300caa60 0x7fbc300c7e80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400e930 tx=0x7fbc2400edf0 comp rx=0 tx=0).stop 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 shutdown_connections 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc1c066470 0x7fbc1c068930 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc30153f40 0x7fbc300c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc300caa60 0x7fbc300c7e80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 --2- 172.21.15.167:0/1394609907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300ca660 0x7fbc300b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 >> 172.21.15.167:0/1394609907 conn(0x7fbc3006b800 msgr2=0x7fbc300c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 shutdown_connections 2023-11-28T20:44:59.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:44:59.064+0000 7fbc35617640 1 -- 172.21.15.167:0/1394609907 wait complete. 2023-11-28T20:45:02.089 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:45:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.255+0000 7fda60291640 1 Processor -- start 2023-11-28T20:45:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda60291640 1 -- start start 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda60291640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda60291640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda60291640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda581571d0 con 0x7fda5806e410 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda60291640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda58071a90 con 0x7fda58070480 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda60291640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda580c70d0 con 0x7fda5806e030 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5d82c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5d82c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43536/0 (socket says 172.21.15.167:43536) 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5d82c640 1 -- 172.21.15.167:0/110075107 learned_addr learned my addr 172.21.15.167:0/110075107 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:02.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5d82c640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 msgr2=0x7fda581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:02.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5d82c640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 msgr2=0x7fda581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:02.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:02.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:02.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 msgr2=0x7fda581500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:45:02.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 msgr2=0x7fda581500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:02.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:02.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.259+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:02.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:02.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:02.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5d82c640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 msgr2=0x7fda581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:45:02.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5d82c640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 msgr2=0x7fda581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:02.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:02.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:45:02.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 msgr2=0x7fda581500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:02.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 msgr2=0x7fda581500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:02.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:02.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.463+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:45:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5d82c640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 msgr2=0x7fda581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5d82c640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 msgr2=0x7fda581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:45:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 msgr2=0x7fda581500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:45:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 msgr2=0x7fda581500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:02.867+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:45:03.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:03.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:03.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5d82c640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 msgr2=0x7fda581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:03.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5d82c640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 msgr2=0x7fda581505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:03.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:03.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 msgr2=0x7fda581500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:45:03.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 msgr2=0x7fda581500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:03.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:03.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:45:03.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:03.671+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:45:05.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda4ffff640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 msgr2=0x7fda581500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda4ffff640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda5806e030 0x7fda581500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda4ffff640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 msgr2=0x7fda581505f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda4ffff640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.167:3300/0 conn(0x7fda58070480 0x7fda581505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda4ffff640 1 -- 172.21.15.167:0/110075107 >> v1:172.21.15.178:6789/0 conn(0x7fda5806e410 legacy=0x7fda58071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda4ffff640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda4ffff640 1 -- 172.21.15.167:0/110075107 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda580c73b0 con 0x7fda3c006180 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda4ffff640 1 -- 172.21.15.167:0/110075107 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda58071a90 con 0x7fda3c0036d0 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 msgr2=0x7fda3c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 msgr2=0x7fda3c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:05.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.259+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:05.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.463+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:05.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.463+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 msgr2=0x7fda3c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:45:05.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.463+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 msgr2=0x7fda3c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:05.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.463+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:05.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.463+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:45:05.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.867+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:05.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.867+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 msgr2=0x7fda3c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:45:05.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.867+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 msgr2=0x7fda3c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:05.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.867+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:05.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:05.867+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:45:06.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:06.671+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:06.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:06.671+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 msgr2=0x7fda3c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:45:06.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:06.671+0000 7fda5e02d640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 msgr2=0x7fda3c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:06.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:06.671+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:06.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:06.671+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:45:07.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164657050 0 0) 0x7fda580c73b0 con 0x7fda3c006180 2023-11-28T20:45:07.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda44003530 con 0x7fda3c006180 2023-11-28T20:45:07.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333750258 0 0) 0x7fda44003530 con 0x7fda3c006180 2023-11-28T20:45:07.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 msgr2=0x7fda3c005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:07.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 --2- 172.21.15.167:0/110075107 >> v2:172.21.15.178:3300/0 conn(0x7fda3c0036d0 0x7fda3c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c00af20 con 0x7fda3c006180 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fda4800d680 con 0x7fda3c006180 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 >> v1:172.21.15.167:6789/0 conn(0x7fda3c006180 legacy=0x7fda3c008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5e82e640 1 -- 172.21.15.167:0/110075107 reap_dead start 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440039d0 0x7fda44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda440047d0 0x7fda44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda44005390 0x7fda4400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda58071a90 con 0x7fda44005390 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44005960 con 0x7fda440047d0 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44005b20 con 0x7fda440039d0 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5e82e640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda44005390 0x7fda4400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5d82c640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda440047d0 0x7fda44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:07.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5e02d640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440039d0 0x7fda44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5e82e640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440039d0 msgr2=0x7fda44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.003+0000 7fda5e82e640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440039d0 0x7fda44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.007+0000 7fda5e82e640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda440047d0 msgr2=0x7fda44004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.007+0000 7fda5e82e640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda440047d0 0x7fda44004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.007+0000 7fda5e82e640 1 -- 172.21.15.167:0/110075107 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44003530 con 0x7fda44005390 2023-11-28T20:45:07.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.007+0000 7fda5e82e640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda44005390 0x7fda4400dba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda58150b30 tx=0x7fda5001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b384e33ae797bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:07.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.007+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50005d50 con 0x7fda44005390 2023-11-28T20:45:07.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.007+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda500a7070 con 0x7fda44005390 2023-11-28T20:45:07.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.007+0000 7fda5d02b640 1 -- 172.21.15.167:0/110075107 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50003bc0 con 0x7fda44005390 2023-11-28T20:45:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 -- 172.21.15.167:0/110075107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda44005390 msgr2=0x7fda4400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda44005390 0x7fda4400dba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda58150b30 tx=0x7fda5001c300 comp rx=0 tx=0).stop 2023-11-28T20:45:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 -- 172.21.15.167:0/110075107 shutdown_connections 2023-11-28T20:45:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda44005390 0x7fda4400dba0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda440047d0 0x7fda44004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 --2- 172.21.15.167:0/110075107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440039d0 0x7fda44003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 -- 172.21.15.167:0/110075107 >> 172.21.15.167:0/110075107 conn(0x7fda580cb1e0 msgr2=0x7fda580cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:07.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 -- 172.21.15.167:0/110075107 shutdown_connections 2023-11-28T20:45:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 -- 172.21.15.167:0/110075107 wait complete. 2023-11-28T20:45:07.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 Processor -- start 2023-11-28T20:45:07.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 -- start start 2023-11-28T20:45:07.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440039d0 0x7fda581eb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:07.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440047d0 0x7fda58151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:07.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda44005390 0x7fda58147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:07.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda58151e80 con 0x7fda440039d0 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda581495e0 con 0x7fda44005390 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda60291640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda581498c0 con 0x7fda440047d0 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda5e02d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440039d0 0x7fda581eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda5e02d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440039d0 0x7fda581eb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54782/0 (socket says 172.21.15.167:54782) 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.011+0000 7fda5e02d640 1 -- 172.21.15.167:0/1959280645 learned_addr learned my addr 172.21.15.167:0/1959280645 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda5e82e640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda44005390 0x7fda58147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda5d82c640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440047d0 0x7fda58151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda5e02d640 1 -- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440047d0 msgr2=0x7fda58151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda5e02d640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440047d0 0x7fda58151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda5e02d640 1 -- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda44005390 msgr2=0x7fda58147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:07.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda5e02d640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda44005390 0x7fda58147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda5e02d640 1 -- 172.21.15.167:0/1959280645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda58149ba0 con 0x7fda440039d0 2023-11-28T20:45:07.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda5e02d640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440039d0 0x7fda581eb540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda54006f10 tx=0x7fda54019b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:07.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda4effd640 1 -- 172.21.15.167:0/1959280645 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5401e040 con 0x7fda440039d0 2023-11-28T20:45:07.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda4effd640 1 -- 172.21.15.167:0/1959280645 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5400c040 con 0x7fda440039d0 2023-11-28T20:45:07.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda4effd640 1 -- 172.21.15.167:0/1959280645 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54016d10 con 0x7fda440039d0 2023-11-28T20:45:07.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda58149e80 con 0x7fda440039d0 2023-11-28T20:45:07.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda58147200 con 0x7fda440039d0 2023-11-28T20:45:07.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda580682c0 con 0x7fda440039d0 2023-11-28T20:45:07.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda4effd640 1 -- 172.21.15.167:0/1959280645 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fda54023480 con 0x7fda440039d0 2023-11-28T20:45:07.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda4effd640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda3c066cc0 0x7fda3c069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:07.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.015+0000 7fda4effd640 1 -- 172.21.15.167:0/1959280645 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fda54085430 con 0x7fda440039d0 2023-11-28T20:45:07.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.019+0000 7fda5d82c640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda3c066cc0 0x7fda3c069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:07.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.019+0000 7fda5d82c640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda3c066cc0 0x7fda3c069180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda48008010 tx=0x7fda48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:07.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.023+0000 7fda4effd640 1 -- 172.21.15.167:0/1959280645 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fda540524a0 con 0x7fda440039d0 2023-11-28T20:45:07.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.243+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fda58075c90 con 0x7fda440039d0 2023-11-28T20:45:07.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.243+0000 7fda4effd640 1 -- 172.21.15.167:0/1959280645 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7fda54028620 con 0x7fda440039d0 2023-11-28T20:45:07.247 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":58,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:45:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda3c066cc0 msgr2=0x7fda3c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda3c066cc0 0x7fda3c069180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda48008010 tx=0x7fda48008040 comp rx=0 tx=0).stop 2023-11-28T20:45:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440039d0 msgr2=0x7fda581eb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440039d0 0x7fda581eb540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda54006f10 tx=0x7fda54019b10 comp rx=0 tx=0).stop 2023-11-28T20:45:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 shutdown_connections 2023-11-28T20:45:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda3c066cc0 0x7fda3c069180 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda44005390 0x7fda58147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda440047d0 0x7fda58151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 --2- 172.21.15.167:0/1959280645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440039d0 0x7fda581eb540 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:07.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 >> 172.21.15.167:0/1959280645 conn(0x7fda580cb1e0 msgr2=0x7fda580c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:07.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 shutdown_connections 2023-11-28T20:45:07.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:07.247+0000 7fda60291640 1 -- 172.21.15.167:0/1959280645 wait complete. 2023-11-28T20:45:10.272 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:45:10.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.435+0000 7f559d2c9640 1 Processor -- start 2023-11-28T20:45:10.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.435+0000 7f559d2c9640 1 -- start start 2023-11-28T20:45:10.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f559d2c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f55980ce290 0x7f559806df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f559d2c9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5598150640 0x7f559815d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f559d2c9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559815de70 con 0x7f55980cbae0 2023-11-28T20:45:10.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f559d2c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55980cd6c0 con 0x7f55980ce290 2023-11-28T20:45:10.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f559d2c9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559806e500 con 0x7f5598150640 2023-11-28T20:45:10.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f5596ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f55980ce290 0x7f559806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f5596ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f55980ce290 0x7f559806df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54790/0 (socket says 172.21.15.167:54790) 2023-11-28T20:45:10.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f5596ffd640 1 -- 172.21.15.167:0/1206409951 learned_addr learned my addr 172.21.15.167:0/1206409951 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:10.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f5597fff640 1 --2- 172.21.15.167:0/1206409951 >> v2:172.21.15.178:3300/0 conn(0x7f5598150640 0x7f559815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f5596ffd640 1 -- 172.21.15.167:0/1206409951 >> v2:172.21.15.178:3300/0 conn(0x7f5598150640 msgr2=0x7f559815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:10.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f5596ffd640 1 --2- 172.21.15.167:0/1206409951 >> v2:172.21.15.178:3300/0 conn(0x7f5598150640 0x7f559815d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f5596ffd640 1 -- 172.21.15.167:0/1206409951 >> v1:172.21.15.178:6789/0 conn(0x7f55980cbae0 legacy=0x7f559814ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.439+0000 7f5596ffd640 1 -- 172.21.15.167:0/1206409951 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55980ccab0 con 0x7f55980ce290 2023-11-28T20:45:10.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f5596ffd640 1 --2- 172.21.15.167:0/1206409951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980ce290 0x7f559806df20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f559815aaa0 tx=0x7f558801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e33529efe23024 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:10.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f5595ffb640 1 -- 172.21.15.167:0/1206409951 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55880a89f0 con 0x7f55980ce290 2023-11-28T20:45:10.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f5595ffb640 1 -- 172.21.15.167:0/1206409951 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55880a8b50 con 0x7f55980ce290 2023-11-28T20:45:10.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f5595ffb640 1 -- 172.21.15.167:0/1206409951 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55880b0440 con 0x7f55980ce290 2023-11-28T20:45:10.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f559d2c9640 1 -- 172.21.15.167:0/1206409951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980ce290 msgr2=0x7f559806df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f559d2c9640 1 --2- 172.21.15.167:0/1206409951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980ce290 0x7f559806df20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f559815aaa0 tx=0x7f558801ecf0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f559d2c9640 1 -- 172.21.15.167:0/1206409951 shutdown_connections 2023-11-28T20:45:10.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f559d2c9640 1 --2- 172.21.15.167:0/1206409951 >> v2:172.21.15.178:3300/0 conn(0x7f5598150640 0x7f559815d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f559d2c9640 1 --2- 172.21.15.167:0/1206409951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980ce290 0x7f559806df20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f559d2c9640 1 -- 172.21.15.167:0/1206409951 >> 172.21.15.167:0/1206409951 conn(0x7f559806fa30 msgr2=0x7f559806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:10.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f559d2c9640 1 -- 172.21.15.167:0/1206409951 shutdown_connections 2023-11-28T20:45:10.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.443+0000 7f559d2c9640 1 -- 172.21.15.167:0/1206409951 wait complete. 2023-11-28T20:45:10.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f559d2c9640 1 Processor -- start 2023-11-28T20:45:10.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f559d2c9640 1 -- start start 2023-11-28T20:45:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f559d2c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980cbae0 0x7f55980caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f559d2c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55980ce290 0x7f55980d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f559d2c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5598150640 0x7f559806b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f559d2c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55980c9c00 con 0x7f55980cbae0 2023-11-28T20:45:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f559d2c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55981ef700 con 0x7f5598150640 2023-11-28T20:45:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f559d2c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55981ef9e0 con 0x7f55980ce290 2023-11-28T20:45:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5596ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980cbae0 0x7f55980caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5596ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980cbae0 0x7f55980caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54800/0 (socket says 172.21.15.167:54800) 2023-11-28T20:45:10.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5596ffd640 1 -- 172.21.15.167:0/313907871 learned_addr learned my addr 172.21.15.167:0/313907871 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:10.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5597fff640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5598150640 0x7f559806b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f55967fc640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55980ce290 0x7f55980d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5596ffd640 1 -- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55980ce290 msgr2=0x7f55980d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5596ffd640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55980ce290 0x7f55980d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5596ffd640 1 -- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5598150640 msgr2=0x7f559806b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5596ffd640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5598150640 0x7f559806b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5596ffd640 1 -- 172.21.15.167:0/313907871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880094d0 con 0x7f55980cbae0 2023-11-28T20:45:10.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.447+0000 7f5596ffd640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980cbae0 0x7f55980caa70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f558801b900 tx=0x7f558801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:10.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.451+0000 7f557f7fe640 1 -- 172.21.15.167:0/313907871 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55880ba600 con 0x7f55980cbae0 2023-11-28T20:45:10.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.451+0000 7f557f7fe640 1 -- 172.21.15.167:0/313907871 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55880ba760 con 0x7f55980cbae0 2023-11-28T20:45:10.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.451+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55981efcc0 con 0x7f55980cbae0 2023-11-28T20:45:10.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.451+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55980cb340 con 0x7f55980cbae0 2023-11-28T20:45:10.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.451+0000 7f557f7fe640 1 -- 172.21.15.167:0/313907871 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55880bab10 con 0x7f55980cbae0 2023-11-28T20:45:10.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.451+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5578005260 con 0x7f55980cbae0 2023-11-28T20:45:10.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.451+0000 7f557f7fe640 1 -- 172.21.15.167:0/313907871 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f55880bac70 con 0x7f55980cbae0 2023-11-28T20:45:10.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.455+0000 7f557f7fe640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5584066470 0x7f5584068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.455+0000 7f557f7fe640 1 -- 172.21.15.167:0/313907871 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5588122800 con 0x7f55980cbae0 2023-11-28T20:45:10.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.455+0000 7f55967fc640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5584066470 0x7f5584068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.455+0000 7f55967fc640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5584066470 0x7f5584068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f559815d370 tx=0x7f558c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:10.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.463+0000 7f557f7fe640 1 -- 172.21.15.167:0/313907871 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55880ef810 con 0x7f55980cbae0 2023-11-28T20:45:10.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.743+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5578005a90 con 0x7f55980cbae0 2023-11-28T20:45:10.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.743+0000 7f557f7fe640 1 -- 172.21.15.167:0/313907871 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7f55880b5620 con 0x7f55980cbae0 2023-11-28T20:45:10.747 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:45:10.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5584066470 msgr2=0x7f5584068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5584066470 0x7f5584068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f559815d370 tx=0x7f558c009040 comp rx=0 tx=0).stop 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980cbae0 msgr2=0x7f55980caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980cbae0 0x7f55980caa70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f558801b900 tx=0x7f558801ba90 comp rx=0 tx=0).stop 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 shutdown_connections 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5584066470 0x7f5584068930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5598150640 0x7f559806b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55980ce290 0x7f55980d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 --2- 172.21.15.167:0/313907871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55980cbae0 0x7f55980caa70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 >> 172.21.15.167:0/313907871 conn(0x7f559806fa30 msgr2=0x7f5598159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 shutdown_connections 2023-11-28T20:45:10.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.747+0000 7f559d2c9640 1 -- 172.21.15.167:0/313907871 wait complete. 2023-11-28T20:45:10.771 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:45:10.772 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:45:10.772 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:45:10.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594b891640 1 Processor -- start 2023-11-28T20:45:10.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594b891640 1 -- start start 2023-11-28T20:45:10.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594b891640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5944151f60 0x7f59440c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594b891640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f59440c5c90 0x7f59440c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594b891640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59440c6120 con 0x7f594406a580 2023-11-28T20:45:10.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594b891640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59440c4da0 con 0x7f5944151f60 2023-11-28T20:45:10.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594b891640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594415b220 con 0x7f59440c5c90 2023-11-28T20:45:10.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594962d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5944151f60 0x7f59440c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594962d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5944151f60 0x7f59440c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54804/0 (socket says 172.21.15.167:54804) 2023-11-28T20:45:10.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594962d640 1 -- 172.21.15.167:0/1159499778 learned_addr learned my addr 172.21.15.167:0/1159499778 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:10.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f5948e2c640 1 --2- 172.21.15.167:0/1159499778 >> v2:172.21.15.178:3300/0 conn(0x7f59440c5c90 0x7f59440c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594962d640 1 -- 172.21.15.167:0/1159499778 >> v2:172.21.15.178:3300/0 conn(0x7f59440c5c90 msgr2=0x7f59440c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594962d640 1 --2- 172.21.15.167:0/1159499778 >> v2:172.21.15.178:3300/0 conn(0x7f59440c5c90 0x7f59440c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594962d640 1 -- 172.21.15.167:0/1159499778 >> v1:172.21.15.167:6789/0 conn(0x7f594406a580 legacy=0x7f594406ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f594962d640 1 -- 172.21.15.167:0/1159499778 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944152340 con 0x7f5944151f60 2023-11-28T20:45:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.943+0000 7f593bfff640 1 -- 172.21.15.167:0/1159499778 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855630929 0 0) 0x7f593c0014a0 con 0x7f594406a580 2023-11-28T20:45:10.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f594962d640 1 --2- 172.21.15.167:0/1159499778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5944151f60 0x7f59440c75c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59440c8d80 tx=0x7f594001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27efdf4e4a9c22cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:10.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f593bfff640 1 -- 172.21.15.167:0/1159499778 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400ad660 con 0x7f5944151f60 2023-11-28T20:45:10.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f593bfff640 1 -- 172.21.15.167:0/1159499778 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59400ad7c0 con 0x7f5944151f60 2023-11-28T20:45:10.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f593bfff640 1 -- 172.21.15.167:0/1159499778 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400adb50 con 0x7f5944151f60 2023-11-28T20:45:10.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f594b891640 1 -- 172.21.15.167:0/1159499778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5944151f60 msgr2=0x7f59440c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f594b891640 1 --2- 172.21.15.167:0/1159499778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5944151f60 0x7f59440c75c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59440c8d80 tx=0x7f594001c470 comp rx=0 tx=0).stop 2023-11-28T20:45:10.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f594b891640 1 -- 172.21.15.167:0/1159499778 shutdown_connections 2023-11-28T20:45:10.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f594b891640 1 --2- 172.21.15.167:0/1159499778 >> v2:172.21.15.178:3300/0 conn(0x7f59440c5c90 0x7f59440c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f594b891640 1 --2- 172.21.15.167:0/1159499778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5944151f60 0x7f59440c75c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f594b891640 1 -- 172.21.15.167:0/1159499778 >> 172.21.15.167:0/1159499778 conn(0x7f59440cb1e0 msgr2=0x7f59440cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:10.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f594b891640 1 -- 172.21.15.167:0/1159499778 shutdown_connections 2023-11-28T20:45:10.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.951+0000 7f594b891640 1 -- 172.21.15.167:0/1159499778 wait complete. 2023-11-28T20:45:10.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 Processor -- start 2023-11-28T20:45:10.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 -- start start 2023-11-28T20:45:10.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f594406a580 0x7f5944158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59440c5c90 0x7f594414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5944151f60 0x7f59440c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944159330 con 0x7f594406a580 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944156e40 con 0x7f59440c5c90 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59440c8fe0 con 0x7f5944151f60 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594962d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f594406a580 0x7f5944158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594962d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f594406a580 0x7f5944158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54816/0 (socket says 172.21.15.167:54816) 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594962d640 1 -- 172.21.15.167:0/1525096436 learned_addr learned my addr 172.21.15.167:0/1525096436 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f5949e2e640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5944151f60 0x7f59440c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f5948e2c640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59440c5c90 0x7f594414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594962d640 1 -- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5944151f60 msgr2=0x7f59440c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594962d640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5944151f60 0x7f59440c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594962d640 1 -- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59440c5c90 msgr2=0x7f594414cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594962d640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59440c5c90 0x7f594414cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594962d640 1 -- 172.21.15.167:0/1525096436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59400094d0 con 0x7f594406a580 2023-11-28T20:45:10.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594962d640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f594406a580 0x7f5944158df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59400b0040 tx=0x7f5940019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:10.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400b6640 con 0x7f594406a580 2023-11-28T20:45:10.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59400b67a0 con 0x7f594406a580 2023-11-28T20:45:10.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59440ca4d0 con 0x7f594406a580 2023-11-28T20:45:10.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59400b6b10 con 0x7f594406a580 2023-11-28T20:45:10.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.955+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59440caa70 con 0x7f594406a580 2023-11-28T20:45:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f594b891640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440cac60 0x7f59440c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944074770 con 0x7f59440cac60 2023-11-28T20:45:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5948e2c640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440cac60 0x7f59440c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5948e2c640 1 -- 172.21.15.167:0/1525096436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f594406ada0 con 0x7f59440cac60 2023-11-28T20:45:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5948e2c640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440cac60 0x7f59440c9c90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5934009a60 tx=0x7f5934009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400bcc0 con 0x7f59440cac60 2023-11-28T20:45:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f59400b4070 con 0x7f594406a580 2023-11-28T20:45:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5939ffb640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5928066510 0x7f59280689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f594011e570 con 0x7f594406a580 2023-11-28T20:45:10.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f593400be20 con 0x7f59440cac60 2023-11-28T20:45:10.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440cac60 msgr2=0x7f59440c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5939ffb640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440cac60 0x7f59440c9c90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5934009a60 tx=0x7f5934009f20 comp rx=0 tx=0).stop 2023-11-28T20:45:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440cac60 msgr2=0x7f59440c9c90 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5939ffb640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440cac60 0x7f59440c9c90 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5934009a60 tx=0x7f5934009f20 comp rx=0 tx=0).stop 2023-11-28T20:45:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.959+0000 7f5949e2e640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5928066510 0x7f59280689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.963+0000 7f5949e2e640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5928066510 0x7f59280689d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f593c0012f0 tx=0x7f593c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:10.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.971+0000 7f594b891640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440c9150 0x7f594413cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:10.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.971+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594415ba30 con 0x7f59440c9150 2023-11-28T20:45:10.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.971+0000 7f5948e2c640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440c9150 0x7f594413cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:10.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.971+0000 7f5948e2c640 1 -- 172.21.15.167:0/1525096436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f594415bf50 con 0x7f59440c9150 2023-11-28T20:45:10.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f5948e2c640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440c9150 0x7f594413cf80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5934009a60 tx=0x7f59340046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934028070 con 0x7f59440c9150 2023-11-28T20:45:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7f59340059a0 con 0x7f59440c9150 2023-11-28T20:45:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440c9150 msgr2=0x7f594413cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f5939ffb640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440c9150 0x7f594413cf80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5934009a60 tx=0x7f59340046d0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f5939ffb640 1 -- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440c9150 msgr2=0x7f594413cf80 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:10.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f5939ffb640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59440c9150 0x7f594413cf80 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5934009a60 tx=0x7f59340046d0 comp rx=0 tx=0).stop 2023-11-28T20:45:10.977 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 60, 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:10.980 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:45:10.981 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:45:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:45:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:45:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:45:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:45:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:45:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:45:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:45:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:45:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:45:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:45:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:45:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:45:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:45:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:45:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:45:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:45:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:45:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:10.997 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:10.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.997 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:10.997 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:10.997 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:10.997 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:10.997 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:10.998 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:45:10.999 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:45:11.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.000 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.000 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.000 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:11.000 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.000 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.000 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:45:11.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.001 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.001 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.001 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:45:11.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.001 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.001 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:45:11.001 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:45:11.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5928066510 msgr2=0x7f59280689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f594b891640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5928066510 0x7f59280689d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f593c0012f0 tx=0x7f593c009040 comp rx=0 tx=0).stop 2023-11-28T20:45:11.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f594406a580 msgr2=0x7f5944158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f594b891640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f594406a580 0x7f5944158df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59400b0040 tx=0x7f5940019210 comp rx=0 tx=0).stop 2023-11-28T20:45:11.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f5949e2e640 1 -- 172.21.15.167:0/1525096436 reap_dead start 2023-11-28T20:45:11.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 shutdown_connections 2023-11-28T20:45:11.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f594b891640 1 --2- 172.21.15.167:0/1525096436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f594406a580 0x7f5944158df0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 >> 172.21.15.167:0/1525096436 conn(0x7f59440cb1e0 msgr2=0x7f5944142620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:11.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 shutdown_connections 2023-11-28T20:45:11.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:10.975+0000 7f594b891640 1 -- 172.21.15.167:0/1525096436 wait complete. 2023-11-28T20:45:11.005 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:45:11.005 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:45:11.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:45:11.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.163+0000 7fdc7bcd6640 1 Processor -- start 2023-11-28T20:45:11.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.163+0000 7fdc7bcd6640 1 -- start start 2023-11-28T20:45:11.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc7bcd6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc740c6ff0 0x7fdc74157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc7bcd6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc740c4510 0x7fdc7406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc7bcd6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc740c4920 con 0x7fdc74150b40 2023-11-28T20:45:11.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc7bcd6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc740c62f0 con 0x7fdc740c6ff0 2023-11-28T20:45:11.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc7bcd6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc740c6ac0 con 0x7fdc740c4510 2023-11-28T20:45:11.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc79271640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc740c6ff0 0x7fdc74157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc79a72640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fdc74150b40 0x7fdc740c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:37076/0 (socket says 172.21.15.167:37076) 2023-11-28T20:45:11.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc79a72640 1 -- 172.21.15.167:0/3077997189 learned_addr learned my addr 172.21.15.167:0/3077997189 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:45:11.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc7a273640 1 --2- 172.21.15.167:0/3077997189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc740c4510 0x7fdc7406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc78a70640 1 -- 172.21.15.167:0/3077997189 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740682050 0 0) 0x7fdc740c4920 con 0x7fdc74150b40 2023-11-28T20:45:11.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc79271640 1 -- 172.21.15.167:0/3077997189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc740c4510 msgr2=0x7fdc7406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:11.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc79271640 1 --2- 172.21.15.167:0/3077997189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc740c4510 0x7fdc7406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc79271640 1 -- 172.21.15.167:0/3077997189 >> v1:172.21.15.178:6789/0 conn(0x7fdc74150b40 legacy=0x7fdc740c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.167+0000 7fdc79271640 1 -- 172.21.15.167:0/3077997189 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc740c6500 con 0x7fdc740c6ff0 2023-11-28T20:45:11.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc79271640 1 --2- 172.21.15.167:0/3077997189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c6ff0 0x7fdc74157560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdc640097c0 tx=0x7fdc6401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2e318832b39af4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc78a70640 1 -- 172.21.15.167:0/3077997189 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640ad660 con 0x7fdc740c6ff0 2023-11-28T20:45:11.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc78a70640 1 -- 172.21.15.167:0/3077997189 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc640ad7c0 con 0x7fdc740c6ff0 2023-11-28T20:45:11.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc78a70640 1 -- 172.21.15.167:0/3077997189 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640adb50 con 0x7fdc740c6ff0 2023-11-28T20:45:11.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/3077997189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c6ff0 msgr2=0x7fdc74157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc7bcd6640 1 --2- 172.21.15.167:0/3077997189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c6ff0 0x7fdc74157560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdc640097c0 tx=0x7fdc6401c450 comp rx=0 tx=0).stop 2023-11-28T20:45:11.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/3077997189 shutdown_connections 2023-11-28T20:45:11.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc7bcd6640 1 --2- 172.21.15.167:0/3077997189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc740c4510 0x7fdc7406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc7bcd6640 1 --2- 172.21.15.167:0/3077997189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c6ff0 0x7fdc74157560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/3077997189 >> 172.21.15.167:0/3077997189 conn(0x7fdc740cb1e0 msgr2=0x7fdc740cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:11.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/3077997189 shutdown_connections 2023-11-28T20:45:11.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.171+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/3077997189 wait complete. 2023-11-28T20:45:11.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc7bcd6640 1 Processor -- start 2023-11-28T20:45:11.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc7bcd6640 1 -- start start 2023-11-28T20:45:11.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc7bcd6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c4510 0x7fdc741592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc7bcd6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc740c6ff0 0x7fdc7415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc7bcd6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc74150b40 0x7fdc74157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc7bcd6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc740cae50 con 0x7fdc740c4510 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc7bcd6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74158860 con 0x7fdc740c6ff0 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc7bcd6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc740ca2a0 con 0x7fdc74150b40 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc79a72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c4510 0x7fdc741592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc79a72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c4510 0x7fdc741592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54856/0 (socket says 172.21.15.167:54856) 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc79a72640 1 -- 172.21.15.167:0/903047652 learned_addr learned my addr 172.21.15.167:0/903047652 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc79271640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc740c6ff0 0x7fdc7415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc7a273640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc74150b40 0x7fdc74157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc79a72640 1 -- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc74150b40 msgr2=0x7fdc74157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc79a72640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc74150b40 0x7fdc74157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc79a72640 1 -- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc740c6ff0 msgr2=0x7fdc7415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc79a72640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc740c6ff0 0x7fdc7415a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.175+0000 7fdc79a72640 1 -- 172.21.15.167:0/903047652 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc64009420 con 0x7fdc740c4510 2023-11-28T20:45:11.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc79a72640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c4510 0x7fdc741592e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc70007fd0 tx=0x7fdc7000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70005cf0 con 0x7fdc740c4510 2023-11-28T20:45:11.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70005e70 con 0x7fdc740c4510 2023-11-28T20:45:11.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc700072f0 con 0x7fdc740c4510 2023-11-28T20:45:11.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc74158580 con 0x7fdc740c4510 2023-11-28T20:45:11.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc740ca790 con 0x7fdc740c4510 2023-11-28T20:45:11.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc7bcd6640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc74158070 0x7fdc7415f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74074770 con 0x7fdc74158070 2023-11-28T20:45:11.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc79271640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc74158070 0x7fdc7415f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc79271640 1 -- 172.21.15.167:0/903047652 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc740c4d40 con 0x7fdc74158070 2023-11-28T20:45:11.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdc70007450 con 0x7fdc740c4510 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.179+0000 7fdc79271640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc74158070 0x7fdc7415f510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc740cc090 tx=0x7fdc6401ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc6a7fc640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc58066470 0x7fdc58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fdc700837a0 con 0x7fdc740c4510 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc7a273640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc58066470 0x7fdc58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640b7610 con 0x7fdc74158070 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fdc640b7770 con 0x7fdc74158070 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc74158070 msgr2=0x7fdc7415f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc6a7fc640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc74158070 0x7fdc7415f510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc740cc090 tx=0x7fdc6401ac90 comp rx=0 tx=0).stop 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc74158070 msgr2=0x7fdc7415f510 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:11.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc6a7fc640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc74158070 0x7fdc7415f510 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.183+0000 7fdc7a273640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc58066470 0x7fdc58068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdc74159240 tx=0x7fdc6c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7415fa50 0x7fdc74143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74071e90 con 0x7fdc7415fa50 2023-11-28T20:45:11.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc79271640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7415fa50 0x7fdc74143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc79271640 1 -- 172.21.15.167:0/903047652 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdc74157040 con 0x7fdc7415fa50 2023-11-28T20:45:11.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc79271640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7415fa50 0x7fdc74143210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdc6401c490 tx=0x7fdc640191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640c2e30 con 0x7fdc7415fa50 2023-11-28T20:45:11.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4979 (secure 0 0 0) 0x7fdc640044c0 con 0x7fdc7415fa50 2023-11-28T20:45:11.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7415fa50 msgr2=0x7fdc74143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc6a7fc640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7415fa50 0x7fdc74143210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdc6401c490 tx=0x7fdc640191f0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc6a7fc640 1 -- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7415fa50 msgr2=0x7fdc74143210 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:11.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc6a7fc640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc7415fa50 0x7fdc74143210 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdc6401c490 tx=0x7fdc640191f0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 60, 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:45:11.200 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:11.201 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:11.202 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:45:11.203 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:45:11.204 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:11.205 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:11.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:11.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.209 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:11.210 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.211 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.212 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.213 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:45:11.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.215 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.216 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:45:11.216 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:45:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc58066470 msgr2=0x7fdc58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc58066470 0x7fdc58068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdc74159240 tx=0x7fdc6c00b040 comp rx=0 tx=0).stop 2023-11-28T20:45:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c4510 msgr2=0x7fdc741592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 --2- 172.21.15.167:0/903047652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc740c4510 0x7fdc741592e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc70007fd0 tx=0x7fdc7000c8e0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7a273640 1 -- 172.21.15.167:0/903047652 reap_dead start 2023-11-28T20:45:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7a273640 1 -- 172.21.15.167:0/903047652 reap_dead start 2023-11-28T20:45:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 shutdown_connections 2023-11-28T20:45:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 >> 172.21.15.167:0/903047652 conn(0x7fdc740cb1e0 msgr2=0x7fdc7406e770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:11.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 shutdown_connections 2023-11-28T20:45:11.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.195+0000 7fdc7bcd6640 1 -- 172.21.15.167:0/903047652 wait complete. 2023-11-28T20:45:11.219 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:45:11.219 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:45:11.219 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:45:11.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.359+0000 7feec97b8640 1 Processor -- start 2023-11-28T20:45:11.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feec97b8640 1 -- start start 2023-11-28T20:45:11.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feec97b8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feec4140180 0x7feec40c3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feec97b8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feec406ea60 0x7feec40c3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feec97b8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec40c5660 con 0x7feec4140e90 2023-11-28T20:45:11.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feec97b8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40c5380 con 0x7feec406ea60 2023-11-28T20:45:11.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feec97b8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec4158530 con 0x7feec4140180 2023-11-28T20:45:11.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feebbfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feec406ea60 0x7feec40c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feec2ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feec4140180 0x7feec40c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feebbfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feec406ea60 0x7feec40c3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54864/0 (socket says 172.21.15.167:54864) 2023-11-28T20:45:11.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feebbfff640 1 -- 172.21.15.167:0/1639369956 learned_addr learned my addr 172.21.15.167:0/1639369956 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:11.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feebbfff640 1 -- 172.21.15.167:0/1639369956 >> v2:172.21.15.178:3300/0 conn(0x7feec4140180 msgr2=0x7feec40c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:11.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feebbfff640 1 --2- 172.21.15.167:0/1639369956 >> v2:172.21.15.178:3300/0 conn(0x7feec4140180 0x7feec40c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feebbfff640 1 -- 172.21.15.167:0/1639369956 >> v1:172.21.15.167:6789/0 conn(0x7feec4140e90 legacy=0x7feec406dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.363+0000 7feebbfff640 1 -- 172.21.15.167:0/1639369956 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4158810 con 0x7feec406ea60 2023-11-28T20:45:11.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feebbfff640 1 --2- 172.21.15.167:0/1639369956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec406ea60 0x7feec40c3580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feec4074300 tx=0x7feeac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298ad1640b4760d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec27fc640 1 -- 172.21.15.167:0/1639369956 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0ab660 con 0x7feec406ea60 2023-11-28T20:45:11.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec27fc640 1 -- 172.21.15.167:0/1639369956 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac0ab7c0 con 0x7feec406ea60 2023-11-28T20:45:11.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec27fc640 1 -- 172.21.15.167:0/1639369956 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0abb50 con 0x7feec406ea60 2023-11-28T20:45:11.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec97b8640 1 -- 172.21.15.167:0/1639369956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec406ea60 msgr2=0x7feec40c3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec97b8640 1 --2- 172.21.15.167:0/1639369956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec406ea60 0x7feec40c3580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feec4074300 tx=0x7feeac01c440 comp rx=0 tx=0).stop 2023-11-28T20:45:11.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec97b8640 1 -- 172.21.15.167:0/1639369956 shutdown_connections 2023-11-28T20:45:11.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec97b8640 1 --2- 172.21.15.167:0/1639369956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec406ea60 0x7feec40c3580 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec97b8640 1 --2- 172.21.15.167:0/1639369956 >> v2:172.21.15.178:3300/0 conn(0x7feec4140180 0x7feec40c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec97b8640 1 -- 172.21.15.167:0/1639369956 >> 172.21.15.167:0/1639369956 conn(0x7feec40c7c50 msgr2=0x7feec40c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:11.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec97b8640 1 -- 172.21.15.167:0/1639369956 shutdown_connections 2023-11-28T20:45:11.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.367+0000 7feec97b8640 1 -- 172.21.15.167:0/1639369956 wait complete. 2023-11-28T20:45:11.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 Processor -- start 2023-11-28T20:45:11.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 -- start start 2023-11-28T20:45:11.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feec406ea60 0x7feec4072040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4140180 0x7feec4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec4140e90 0x7feec40708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec41524c0 con 0x7feec4140e90 2023-11-28T20:45:11.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec41f26e0 con 0x7feec406ea60 2023-11-28T20:45:11.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40728b0 con 0x7feec4140180 2023-11-28T20:45:11.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec4140e90 0x7feec40708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec4140e90 0x7feec40708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54872/0 (socket says 172.21.15.167:54872) 2023-11-28T20:45:11.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec37fe640 1 -- 172.21.15.167:0/3148549503 learned_addr learned my addr 172.21.15.167:0/3148549503 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:11.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec2ffd640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feec406ea60 0x7feec4072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feebbfff640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4140180 0x7feec4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec37fe640 1 -- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4140180 msgr2=0x7feec4156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec37fe640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4140180 0x7feec4156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec37fe640 1 -- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feec406ea60 msgr2=0x7feec4072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec37fe640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feec406ea60 0x7feec4072040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec37fe640 1 -- 172.21.15.167:0/3148549503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0094d0 con 0x7feec4140e90 2023-11-28T20:45:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec37fe640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec4140e90 0x7feec40708b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feebc00c760 tx=0x7feebc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc003b80 con 0x7feec4140e90 2023-11-28T20:45:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc003ce0 con 0x7feec4140e90 2023-11-28T20:45:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec4070420 con 0x7feec4140e90 2023-11-28T20:45:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00aa30 con 0x7feec4140e90 2023-11-28T20:45:11.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.371+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec41f2bd0 con 0x7feec4140e90 2023-11-28T20:45:11.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.375+0000 7feec97b8640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4071a60 0x7feec4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.375+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec4074730 con 0x7feec4071a60 2023-11-28T20:45:11.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.375+0000 7feec2ffd640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4071a60 0x7feec4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.375+0000 7feec2ffd640 1 -- 172.21.15.167:0/3148549503 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feec4164a40 con 0x7feec4071a60 2023-11-28T20:45:11.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.375+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feebc00ab90 con 0x7feec4140e90 2023-11-28T20:45:11.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.375+0000 7feec2ffd640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4071a60 0x7feec4070df0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feeb40119d0 tx=0x7feeb4011e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.375+0000 7feebb7fe640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feea40664a0 0x7feea4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.375+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7feebc083ed0 con 0x7feec4140e90 2023-11-28T20:45:11.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.379+0000 7feebbfff640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feea40664a0 0x7feea4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.379+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4004300 con 0x7feec4071a60 2023-11-28T20:45:11.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.379+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7feeb4004460 con 0x7feec4071a60 2023-11-28T20:45:11.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.379+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4071a60 msgr2=0x7feec4070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.379+0000 7feebb7fe640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4071a60 0x7feec4070df0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feeb40119d0 tx=0x7feeb4011e90 comp rx=0 tx=0).stop 2023-11-28T20:45:11.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.379+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4071a60 msgr2=0x7feec4070df0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:11.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.379+0000 7feebb7fe640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec4071a60 0x7feec4070df0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feeb40119d0 tx=0x7feeb4011e90 comp rx=0 tx=0).stop 2023-11-28T20:45:11.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.379+0000 7feebbfff640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feea40664a0 0x7feea4068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7feeac0af000 tx=0x7feeac0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.387+0000 7feec97b8640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec41f2eb0 0x7feec413b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.387+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40705b0 con 0x7feec41f2eb0 2023-11-28T20:45:11.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feec2ffd640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec41f2eb0 0x7feec413b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feec2ffd640 1 -- 172.21.15.167:0/3148549503 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7feec404e850 con 0x7feec41f2eb0 2023-11-28T20:45:11.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feec2ffd640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec41f2eb0 0x7feec413b6d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feeb40119d0 tx=0x7feeb40046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400fee0 con 0x7feec41f2eb0 2023-11-28T20:45:11.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5122 (secure 0 0 0) 0x7feeb40283a0 con 0x7feec41f2eb0 2023-11-28T20:45:11.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec41f2eb0 msgr2=0x7feec413b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feebb7fe640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec41f2eb0 0x7feec413b6d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feeb40119d0 tx=0x7feeb40046d0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feebb7fe640 1 -- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec41f2eb0 msgr2=0x7feec413b6d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:11.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feebb7fe640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec41f2eb0 0x7feec413b6d0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feeb40119d0 tx=0x7feeb40046d0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.396 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:45:11.396 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:11.396 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:11.396 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:45:11.396 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 60, 2023-11-28T20:45:11.396 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:45:11.396 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:45:11.396 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:11.397 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:11.398 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:45:11.399 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:45:11.400 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:11.401 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:45:11.402 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:11.403 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:11.404 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:11.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.404 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:11.404 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:11.404 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:11.404 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:11.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.405 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:11.405 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:45:11.405 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.405 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.405 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:11.405 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:45:11.405 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.405 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:11.406 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:11.407 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.408 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.409 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:45:11.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.410 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.410 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.410 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:45:11.410 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.410 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.410 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:45:11.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.411 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.411 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.411 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:45:11.411 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.411 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.411 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:45:11.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.411 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:11.412 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:11.413 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:11.413 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:11.413 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:11.413 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:11.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:11.413 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:45:11.413 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:45:11.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feea40664a0 msgr2=0x7feea4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feec97b8640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feea40664a0 0x7feea4068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7feeac0af000 tx=0x7feeac0b6040 comp rx=0 tx=0).stop 2023-11-28T20:45:11.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec4140e90 msgr2=0x7feec40708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feec97b8640 1 --2- 172.21.15.167:0/3148549503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feec4140e90 0x7feec40708b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feebc00c760 tx=0x7feebc00cc20 comp rx=0 tx=0).stop 2023-11-28T20:45:11.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feec37fe640 1 -- 172.21.15.167:0/3148549503 reap_dead start 2023-11-28T20:45:11.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.391+0000 7feec37fe640 1 -- 172.21.15.167:0/3148549503 reap_dead start 2023-11-28T20:45:11.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.395+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 shutdown_connections 2023-11-28T20:45:11.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.395+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 >> 172.21.15.167:0/3148549503 conn(0x7feec40c7c50 msgr2=0x7feec4157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:11.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.395+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 shutdown_connections 2023-11-28T20:45:11.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.395+0000 7feec97b8640 1 -- 172.21.15.167:0/3148549503 wait complete. 2023-11-28T20:45:11.421 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:45:11.421 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:45:11.421 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:45:11.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.571+0000 7eff058bb640 1 Processor -- start 2023-11-28T20:45:11.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.571+0000 7eff058bb640 1 -- start start 2023-11-28T20:45:11.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7eff058bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 0x7eff00157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7eff058bb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff000c6ff0 0x7eff000c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7eff058bb640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff000c6ac0 con 0x7eff000c5be0 2023-11-28T20:45:11.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7eff058bb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000c6500 con 0x7eff000c6ff0 2023-11-28T20:45:11.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7eff058bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff000c67e0 con 0x7eff00150b40 2023-11-28T20:45:11.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7efef7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff000c6ff0 0x7eff000c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7efef7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff000c6ff0 0x7eff000c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54876/0 (socket says 172.21.15.167:54876) 2023-11-28T20:45:11.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7efefeffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 0x7eff00157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7efef7fff640 1 -- 172.21.15.167:0/2579906423 learned_addr learned my addr 172.21.15.167:0/2579906423 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:11.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7efef7fff640 1 -- 172.21.15.167:0/2579906423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 msgr2=0x7eff00157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:11.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7efef7fff640 1 --2- 172.21.15.167:0/2579906423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 0x7eff00157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7efef7fff640 1 -- 172.21.15.167:0/2579906423 >> v1:172.21.15.178:6789/0 conn(0x7eff000c5be0 legacy=0x7eff0006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.575+0000 7efef7fff640 1 -- 172.21.15.167:0/2579906423 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00156a80 con 0x7eff000c6ff0 2023-11-28T20:45:11.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.579+0000 7efef7fff640 1 --2- 172.21.15.167:0/2579906423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c6ff0 0x7eff000c4510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efee8009870 tx=0x7efee801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebc340371059729 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.579+0000 7efefe7fc640 1 -- 172.21.15.167:0/2579906423 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee80aa670 con 0x7eff000c6ff0 2023-11-28T20:45:11.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.579+0000 7efefe7fc640 1 -- 172.21.15.167:0/2579906423 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee80aa7d0 con 0x7eff000c6ff0 2023-11-28T20:45:11.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.579+0000 7efefe7fc640 1 -- 172.21.15.167:0/2579906423 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee80aab60 con 0x7eff000c6ff0 2023-11-28T20:45:11.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 -- 172.21.15.167:0/2579906423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c6ff0 msgr2=0x7eff000c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 --2- 172.21.15.167:0/2579906423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c6ff0 0x7eff000c4510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efee8009870 tx=0x7efee801c510 comp rx=0 tx=0).stop 2023-11-28T20:45:11.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 -- 172.21.15.167:0/2579906423 shutdown_connections 2023-11-28T20:45:11.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 --2- 172.21.15.167:0/2579906423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c6ff0 0x7eff000c4510 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 --2- 172.21.15.167:0/2579906423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 0x7eff00157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 -- 172.21.15.167:0/2579906423 >> 172.21.15.167:0/2579906423 conn(0x7eff000cb1e0 msgr2=0x7eff000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:11.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 -- 172.21.15.167:0/2579906423 shutdown_connections 2023-11-28T20:45:11.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 -- 172.21.15.167:0/2579906423 wait complete. 2023-11-28T20:45:11.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 Processor -- start 2023-11-28T20:45:11.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.583+0000 7eff058bb640 1 -- start start 2023-11-28T20:45:11.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7eff058bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c5be0 0x7eff001605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7eff058bb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff000c6ff0 0x7eff0015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7eff058bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 0x7eff001f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7eff058bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff001f65f0 con 0x7eff000c5be0 2023-11-28T20:45:11.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7eff058bb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff001f6a80 con 0x7eff000c6ff0 2023-11-28T20:45:11.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7eff058bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff00160c90 con 0x7eff00150b40 2023-11-28T20:45:11.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c5be0 0x7eff001605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c5be0 0x7eff001605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54890/0 (socket says 172.21.15.167:54890) 2023-11-28T20:45:11.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefeffd640 1 -- 172.21.15.167:0/967052163 learned_addr learned my addr 172.21.15.167:0/967052163 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:11.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efef7fff640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff000c6ff0 0x7eff0015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efeff7fe640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 0x7eff001f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefeffd640 1 -- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 msgr2=0x7eff001f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefeffd640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 0x7eff001f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefeffd640 1 -- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff000c6ff0 msgr2=0x7eff0015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefeffd640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff000c6ff0 0x7eff0015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefeffd640 1 -- 172.21.15.167:0/967052163 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee80094d0 con 0x7eff000c5be0 2023-11-28T20:45:11.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefeffd640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c5be0 0x7eff001605e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efef000e870 tx=0x7efef000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefcff9640 1 -- 172.21.15.167:0/967052163 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0009510 con 0x7eff000c5be0 2023-11-28T20:45:11.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefcff9640 1 -- 172.21.15.167:0/967052163 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef000eec0 con 0x7eff000c5be0 2023-11-28T20:45:11.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.587+0000 7efefcff9640 1 -- 172.21.15.167:0/967052163 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef000cb40 con 0x7eff000c5be0 2023-11-28T20:45:11.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.591+0000 7eff058bb640 1 -- 172.21.15.167:0/967052163 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff001f5cc0 con 0x7eff000c5be0 2023-11-28T20:45:11.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.591+0000 7eff058bb640 1 -- 172.21.15.167:0/967052163 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff001f6280 con 0x7eff000c5be0 2023-11-28T20:45:11.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.591+0000 7efef5ffb640 1 -- 172.21.15.167:0/967052163 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff000682c0 con 0x7eff000c5be0 2023-11-28T20:45:11.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.591+0000 7efefcff9640 1 -- 172.21.15.167:0/967052163 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efef000cca0 con 0x7eff000c5be0 2023-11-28T20:45:11.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.591+0000 7efefcff9640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efee0066470 0x7efee0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:11.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.591+0000 7efefcff9640 1 -- 172.21.15.167:0/967052163 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7efef00843d0 con 0x7eff000c5be0 2023-11-28T20:45:11.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.591+0000 7efef7fff640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efee0066470 0x7efee0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:11.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.595+0000 7efef7fff640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efee0066470 0x7efee0068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efee80ae000 tx=0x7efee80b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:11.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.599+0000 7efefcff9640 1 -- 172.21.15.167:0/967052163 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efef0051480 con 0x7eff000c5be0 2023-11-28T20:45:11.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.827+0000 7efef5ffb640 1 -- 172.21.15.167:0/967052163 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7eff00075c90 con 0x7eff000c5be0 2023-11-28T20:45:11.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efefcff9640 1 -- 172.21.15.167:0/967052163 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7efef0054aa0 con 0x7eff000c5be0 2023-11-28T20:45:11.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 -- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efee0066470 msgr2=0x7efee0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efee0066470 0x7efee0068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efee80ae000 tx=0x7efee80b5040 comp rx=0 tx=0).stop 2023-11-28T20:45:11.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 -- 172.21.15.167:0/967052163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c5be0 msgr2=0x7eff001605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:11.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c5be0 0x7eff001605e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efef000e870 tx=0x7efef000ec70 comp rx=0 tx=0).stop 2023-11-28T20:45:11.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 -- 172.21.15.167:0/967052163 shutdown_connections 2023-11-28T20:45:11.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efee0066470 0x7efee0068930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff00150b40 0x7eff001f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff000c6ff0 0x7eff0015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 --2- 172.21.15.167:0/967052163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff000c5be0 0x7eff001605e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:11.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 -- 172.21.15.167:0/967052163 >> 172.21.15.167:0/967052163 conn(0x7eff000cb1e0 msgr2=0x7eff001562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:11.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 -- 172.21.15.167:0/967052163 shutdown_connections 2023-11-28T20:45:11.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:11.835+0000 7efef5ffb640 1 -- 172.21.15.167:0/967052163 wait complete. 2023-11-28T20:45:11.871 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:45:17.205 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:17.210 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:21.871 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:45:21.872 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:45:22.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.099+0000 7f660e9f8640 1 Processor -- start 2023-11-28T20:45:22.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.099+0000 7f660e9f8640 1 -- start start 2023-11-28T20:45:22.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660e9f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f660815a540 0x7f66080ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660e9f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66080cfef0 con 0x7f66080ccb70 2023-11-28T20:45:22.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660e9f8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66080cc6e0 con 0x7f6608153db0 2023-11-28T20:45:22.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660e9f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660815a9d0 con 0x7f660815a540 2023-11-28T20:45:22.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660d1f5640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f66080ccb70 0x7f66080cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:33030/0 (socket says 172.21.15.167:33030) 2023-11-28T20:45:22.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660d1f5640 1 -- 172.21.15.167:0/1133192617 learned_addr learned my addr 172.21.15.167:0/1133192617 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:45:22.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660e1f7640 1 --2- 172.21.15.167:0/1133192617 >> v2:172.21.15.178:3300/0 conn(0x7f660815a540 0x7f66080ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660c9f4640 1 -- 172.21.15.167:0/1133192617 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270126632 0 0) 0x7f66080cfef0 con 0x7f66080ccb70 2023-11-28T20:45:22.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660c9f4640 1 -- 172.21.15.167:0/1133192617 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f4003530 con 0x7f66080ccb70 2023-11-28T20:45:22.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660e1f7640 1 -- 172.21.15.167:0/1133192617 >> v1:172.21.15.178:6789/0 conn(0x7f6608153db0 legacy=0x7f66080c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660e1f7640 1 -- 172.21.15.167:0/1133192617 >> v1:172.21.15.167:6789/0 conn(0x7f66080ccb70 legacy=0x7f66080cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.103+0000 7f660e1f7640 1 -- 172.21.15.167:0/1133192617 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6608154190 con 0x7f660815a540 2023-11-28T20:45:22.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.107+0000 7f660e1f7640 1 --2- 172.21.15.167:0/1133192617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f660815a540 0x7f66080ca350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6600009d90 tx=0x7f660001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b57f31b18d34f92b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.107+0000 7f660c9f4640 1 -- 172.21.15.167:0/1133192617 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66000a58f0 con 0x7f660815a540 2023-11-28T20:45:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.111+0000 7f660c9f4640 1 -- 172.21.15.167:0/1133192617 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66000a5a50 con 0x7f660815a540 2023-11-28T20:45:22.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.111+0000 7f660c9f4640 1 -- 172.21.15.167:0/1133192617 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66000a5dc0 con 0x7f660815a540 2023-11-28T20:45:22.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.111+0000 7f660e9f8640 1 -- 172.21.15.167:0/1133192617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f660815a540 msgr2=0x7f66080ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.111+0000 7f660e9f8640 1 --2- 172.21.15.167:0/1133192617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f660815a540 0x7f66080ca350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6600009d90 tx=0x7f660001c920 comp rx=0 tx=0).stop 2023-11-28T20:45:22.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.111+0000 7f660e9f8640 1 -- 172.21.15.167:0/1133192617 shutdown_connections 2023-11-28T20:45:22.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.111+0000 7f660e9f8640 1 --2- 172.21.15.167:0/1133192617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f660815a540 0x7f66080ca350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.111+0000 7f660e9f8640 1 -- 172.21.15.167:0/1133192617 >> 172.21.15.167:0/1133192617 conn(0x7f660806b800 msgr2=0x7f660806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:22.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.111+0000 7f660e9f8640 1 -- 172.21.15.167:0/1133192617 shutdown_connections 2023-11-28T20:45:22.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.111+0000 7f660e9f8640 1 -- 172.21.15.167:0/1133192617 wait complete. 2023-11-28T20:45:22.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660e9f8640 1 Processor -- start 2023-11-28T20:45:22.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660e9f8640 1 -- start start 2023-11-28T20:45:22.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660e9f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66080ccb70 0x7f66080c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660e9f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6608153db0 0x7f66080c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660e9f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f660815a540 0x7f6608152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660e9f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6608154ad0 con 0x7f66080ccb70 2023-11-28T20:45:22.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660e9f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080c8580 con 0x7f660815a540 2023-11-28T20:45:22.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660e9f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66080c94e0 con 0x7f6608153db0 2023-11-28T20:45:22.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d9f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66080ccb70 0x7f66080c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d1f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6608153db0 0x7f66080c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d1f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6608153db0 0x7f66080c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:45120/0 (socket says 172.21.15.167:45120) 2023-11-28T20:45:22.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d1f5640 1 -- 172.21.15.167:0/1501716583 learned_addr learned my addr 172.21.15.167:0/1501716583 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:22.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660e1f7640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f660815a540 0x7f6608152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d1f5640 1 -- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f660815a540 msgr2=0x7f6608152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d1f5640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f660815a540 0x7f6608152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d1f5640 1 -- 172.21.15.167:0/1501716583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66080ccb70 msgr2=0x7f66080c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d1f5640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66080ccb70 0x7f66080c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d1f5640 1 -- 172.21.15.167:0/1501716583 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600009a70 con 0x7f6608153db0 2023-11-28T20:45:22.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f660d1f5640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6608153db0 0x7f66080c8c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c420 tx=0x7f65f800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f65fe7fc640 1 -- 172.21.15.167:0/1501716583 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8005cf0 con 0x7f6608153db0 2023-11-28T20:45:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f65fe7fc640 1 -- 172.21.15.167:0/1501716583 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f8005e50 con 0x7f6608153db0 2023-11-28T20:45:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.115+0000 7f65fe7fc640 1 -- 172.21.15.167:0/1501716583 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f80072d0 con 0x7f6608153db0 2023-11-28T20:45:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.119+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6608154d20 con 0x7f6608153db0 2023-11-28T20:45:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.119+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66081552e0 con 0x7f6608153db0 2023-11-28T20:45:22.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.119+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660804e850 con 0x7f6608153db0 2023-11-28T20:45:22.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.119+0000 7f65fe7fc640 1 -- 172.21.15.167:0/1501716583 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65f8007430 con 0x7f6608153db0 2023-11-28T20:45:22.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.123+0000 7f65fe7fc640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65ec0664a0 0x7f65ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.123+0000 7f65fe7fc640 1 -- 172.21.15.167:0/1501716583 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f65f8083dd0 con 0x7f6608153db0 2023-11-28T20:45:22.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.123+0000 7f660d9f6640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65ec0664a0 0x7f65ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.123+0000 7f660d9f6640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65ec0664a0 0x7f65ec068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6604007fd0 tx=0x7f6604009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:22.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.131+0000 7f65fe7fc640 1 -- 172.21.15.167:0/1501716583 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65f8050de0 con 0x7f6608153db0 2023-11-28T20:45:22.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.555+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f66080cae70 con 0x7f6608153db0 2023-11-28T20:45:22.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f65fe7fc640 1 -- 172.21.15.167:0/1501716583 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f65f8017020 con 0x7f6608153db0 2023-11-28T20:45:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:45:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65ec0664a0 msgr2=0x7f65ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65ec0664a0 0x7f65ec068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6604007fd0 tx=0x7f6604009040 comp rx=0 tx=0).stop 2023-11-28T20:45:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6608153db0 msgr2=0x7f66080c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6608153db0 0x7f66080c8c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c420 tx=0x7f65f800c8e0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 shutdown_connections 2023-11-28T20:45:22.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f65ec0664a0 0x7f65ec068960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f660815a540 0x7f6608152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6608153db0 0x7f66080c8c80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 --2- 172.21.15.167:0/1501716583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66080ccb70 0x7f66080c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 >> 172.21.15.167:0/1501716583 conn(0x7f660806b800 msgr2=0x7f660814e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:22.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 shutdown_connections 2023-11-28T20:45:22.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.559+0000 7f660e9f8640 1 -- 172.21.15.167:0/1501716583 wait complete. 2023-11-28T20:45:22.592 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:45:22.592 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:45:22.592 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:45:22.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:45:22.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.831+0000 7fb38f557640 1 Processor -- start 2023-11-28T20:45:22.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.831+0000 7fb38f557640 1 -- start start 2023-11-28T20:45:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.831+0000 7fb38f557640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb388150b40 0x7fb388157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.831+0000 7fb38f557640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb3880c4510 0x7fb38806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.831+0000 7fb38f557640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3880c48f0 con 0x7fb3880c6ff0 2023-11-28T20:45:22.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.831+0000 7fb38f557640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880c62f0 con 0x7fb388150b40 2023-11-28T20:45:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.831+0000 7fb38f557640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3880c6ac0 con 0x7fb3880c4510 2023-11-28T20:45:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.831+0000 7fb38d2f3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb388150b40 0x7fb388157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.835+0000 7fb38d2f3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb388150b40 0x7fb388157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:55220/0 (socket says 172.21.15.167:55220) 2023-11-28T20:45:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.835+0000 7fb38caf2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb3880c6ff0 0x7fb3880c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:49982/0 (socket says 172.21.15.167:49982) 2023-11-28T20:45:22.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.835+0000 7fb38d2f3640 1 -- 172.21.15.167:0/2896601916 learned_addr learned my addr 172.21.15.167:0/2896601916 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:22.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.835+0000 7fb38daf4640 1 --2- 172.21.15.167:0/2896601916 >> v2:172.21.15.178:3300/0 conn(0x7fb3880c4510 0x7fb38806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.835+0000 7fb38d2f3640 1 -- 172.21.15.167:0/2896601916 >> v2:172.21.15.178:3300/0 conn(0x7fb3880c4510 msgr2=0x7fb38806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:22.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.835+0000 7fb38d2f3640 1 --2- 172.21.15.167:0/2896601916 >> v2:172.21.15.178:3300/0 conn(0x7fb3880c4510 0x7fb38806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.835+0000 7fb38d2f3640 1 -- 172.21.15.167:0/2896601916 >> v1:172.21.15.167:6789/0 conn(0x7fb3880c6ff0 legacy=0x7fb3880c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.835+0000 7fb38d2f3640 1 -- 172.21.15.167:0/2896601916 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880c6500 con 0x7fb388150b40 2023-11-28T20:45:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb38d2f3640 1 --2- 172.21.15.167:0/2896601916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb388150b40 0x7fb388157560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3880cc270 tx=0x7fb38401ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88284ea57be7c38c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:22.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb37ffff640 1 -- 172.21.15.167:0/2896601916 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840a7a80 con 0x7fb388150b40 2023-11-28T20:45:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb37ffff640 1 -- 172.21.15.167:0/2896601916 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3840a7be0 con 0x7fb388150b40 2023-11-28T20:45:22.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb37ffff640 1 -- 172.21.15.167:0/2896601916 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840af440 con 0x7fb388150b40 2023-11-28T20:45:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb38f557640 1 -- 172.21.15.167:0/2896601916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb388150b40 msgr2=0x7fb388157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb38f557640 1 --2- 172.21.15.167:0/2896601916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb388150b40 0x7fb388157560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3880cc270 tx=0x7fb38401ebc0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb38f557640 1 -- 172.21.15.167:0/2896601916 shutdown_connections 2023-11-28T20:45:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb38f557640 1 --2- 172.21.15.167:0/2896601916 >> v2:172.21.15.178:3300/0 conn(0x7fb3880c4510 0x7fb38806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb38f557640 1 --2- 172.21.15.167:0/2896601916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb388150b40 0x7fb388157560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb38f557640 1 -- 172.21.15.167:0/2896601916 >> 172.21.15.167:0/2896601916 conn(0x7fb3880cb1e0 msgr2=0x7fb3880cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb38f557640 1 -- 172.21.15.167:0/2896601916 shutdown_connections 2023-11-28T20:45:22.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.839+0000 7fb38f557640 1 -- 172.21.15.167:0/2896601916 wait complete. 2023-11-28T20:45:22.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.843+0000 7fb38f557640 1 Processor -- start 2023-11-28T20:45:22.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.843+0000 7fb38f557640 1 -- start start 2023-11-28T20:45:22.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.843+0000 7fb38f557640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3880c4510 0x7fb388139e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.843+0000 7fb38f557640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3880c6ff0 0x7fb3880c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.843+0000 7fb38f557640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb388150b40 0x7fb3880ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.843+0000 7fb38f557640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38813a360 con 0x7fb388150b40 2023-11-28T20:45:22.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.843+0000 7fb38f557640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3881f15e0 con 0x7fb3880c6ff0 2023-11-28T20:45:22.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.843+0000 7fb38f557640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38813db40 con 0x7fb3880c4510 2023-11-28T20:45:22.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38caf2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3880c6ff0 0x7fb3880c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38daf4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb388150b40 0x7fb3880ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38caf2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3880c6ff0 0x7fb3880c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:37566/0 (socket says 172.21.15.167:37566) 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38caf2640 1 -- 172.21.15.167:0/2589830803 learned_addr learned my addr 172.21.15.167:0/2589830803 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38d2f3640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3880c4510 0x7fb388139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38daf4640 1 -- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3880c4510 msgr2=0x7fb388139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38daf4640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3880c4510 0x7fb388139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38daf4640 1 -- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3880c6ff0 msgr2=0x7fb3880c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38daf4640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3880c6ff0 0x7fb3880c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38daf4640 1 -- 172.21.15.167:0/2589830803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38400b770 con 0x7fb388150b40 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38daf4640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb388150b40 0x7fb3880ca510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb38000efc0 tx=0x7fb38000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb380009c00 con 0x7fb388150b40 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38000f040 con 0x7fb388150b40 2023-11-28T20:45:22.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3800146c0 con 0x7fb388150b40 2023-11-28T20:45:22.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3881f17f0 con 0x7fb388150b40 2023-11-28T20:45:22.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38813e0e0 con 0x7fb388150b40 2023-11-28T20:45:22.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38f557640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e300 0x7fb388146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb388074770 con 0x7fb38813e300 2023-11-28T20:45:22.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.847+0000 7fb38d2f3640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e300 0x7fb388146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb38d2f3640 1 -- 172.21.15.167:0/2589830803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb388157040 con 0x7fb38813e300 2023-11-28T20:45:22.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb38d2f3640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e300 0x7fb388146fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb38806bba0 tx=0x7fb38401d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:22.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840ba620 con 0x7fb38813e300 2023-11-28T20:45:22.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb380014820 con 0x7fb388150b40 2023-11-28T20:45:22.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb37dffb640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb36c066560 0x7fb36c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb380085060 con 0x7fb388150b40 2023-11-28T20:45:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb3840ba780 con 0x7fb38813e300 2023-11-28T20:45:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e300 msgr2=0x7fb388146fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb37dffb640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e300 0x7fb388146fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb38806bba0 tx=0x7fb38401d400 comp rx=0 tx=0).stop 2023-11-28T20:45:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e300 msgr2=0x7fb388146fd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb37dffb640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e300 0x7fb388146fd0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb38806bba0 tx=0x7fb38401d400 comp rx=0 tx=0).stop 2023-11-28T20:45:22.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.851+0000 7fb38caf2640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb36c066560 0x7fb36c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.855+0000 7fb38caf2640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb36c066560 0x7fb36c068a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb3880c8d20 tx=0x7fb378007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:22.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.859+0000 7fb38f557640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e8e0 0x7fb38813ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:22.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.859+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38813dcb0 con 0x7fb38813e8e0 2023-11-28T20:45:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.859+0000 7fb38d2f3640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e8e0 0x7fb38813ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:22.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.859+0000 7fb38d2f3640 1 -- 172.21.15.167:0/2589830803 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb3880682c0 con 0x7fb38813e8e0 2023-11-28T20:45:22.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.859+0000 7fb38d2f3640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e8e0 0x7fb38813ecf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb38401b7d0 tx=0x7fb38401b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:22.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840ba620 con 0x7fb38813e8e0 2023-11-28T20:45:22.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4472 (secure 0 0 0) 0x7fb3840c7070 con 0x7fb38813e8e0 2023-11-28T20:45:22.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e8e0 msgr2=0x7fb38813ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb37dffb640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e8e0 0x7fb38813ecf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb38401b7d0 tx=0x7fb38401b960 comp rx=0 tx=0).stop 2023-11-28T20:45:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb37dffb640 1 -- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e8e0 msgr2=0x7fb38813ecf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:22.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb37dffb640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb38813e8e0 0x7fb38813ecf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.865 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:45:22.865 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:22.865 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:22.865 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:45:22.865 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 60, 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:22.866 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:22.867 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:45:22.868 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:45:22.869 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:45:22.870 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:45:22.870 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:45:22.870 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:45:22.870 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:22.870 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:45:22.870 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:22.870 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:22.870 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:22.870 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:22.871 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:22.871 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:22.871 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:22.871 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:22.871 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:22.871 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:22.871 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:22.871 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:45:22.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:22.873 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:22.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.874 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:22.874 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:22.874 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:22.874 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:22.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.874 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:45:22.875 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:45:22.876 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:22.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.877 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:22.877 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:45:22.877 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:22.877 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:22.877 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:22.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.877 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:45:22.878 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:45:22.878 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:22.878 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:22.878 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:22.878 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:22.878 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:22.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.878 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:45:22.879 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:45:22.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.879 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:22.879 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:22.879 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:22.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:22.879 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:22.880 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:45:22.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:22.880 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:22.880 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:22.880 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:45:22.880 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:22.880 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:22.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:22.881 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:45:22.881 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb36c066560 msgr2=0x7fb36c068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38f557640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb36c066560 0x7fb36c068a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb3880c8d20 tx=0x7fb378007ea0 comp rx=0 tx=0).stop 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb388150b40 msgr2=0x7fb3880ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38f557640 1 --2- 172.21.15.167:0/2589830803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb388150b40 0x7fb3880ca510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb38000efc0 tx=0x7fb38000c490 comp rx=0 tx=0).stop 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38daf4640 1 -- 172.21.15.167:0/2589830803 reap_dead start 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38daf4640 1 -- 172.21.15.167:0/2589830803 reap_dead start 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 shutdown_connections 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 >> 172.21.15.167:0/2589830803 conn(0x7fb3880cb1e0 msgr2=0x7fb3880cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 shutdown_connections 2023-11-28T20:45:22.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:22.863+0000 7fb38f557640 1 -- 172.21.15.167:0/2589830803 wait complete. 2023-11-28T20:45:22.886 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:45:22.886 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:45:22.886 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:45:23.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ec60fd640 1 Processor -- start 2023-11-28T20:45:23.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ec60fd640 1 -- start start 2023-11-28T20:45:23.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ec60fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9ec00c8010 0x7f9ec015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ec60fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec006bda0 0x7f9ec0066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ec60fd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec006a8d0 con 0x7f9ec00b0110 2023-11-28T20:45:23.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ec60fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00ca230 con 0x7f9ec00c8010 2023-11-28T20:45:23.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ec60fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c8990 con 0x7f9ec006bda0 2023-11-28T20:45:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ebeffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9ec00c8010 0x7f9ec015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ebf7fe640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9ec00b0110 0x7f9ec006b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:40124/0 (socket says 172.21.15.167:40124) 2023-11-28T20:45:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.031+0000 7f9ebf7fe640 1 -- 172.21.15.167:0/1540988551 learned_addr learned my addr 172.21.15.167:0/1540988551 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:45:23.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.035+0000 7f9ebffff640 1 --2- 172.21.15.167:0/1540988551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec006bda0 0x7f9ec0066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.035+0000 7f9ebeffd640 1 -- 172.21.15.167:0/1540988551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec006bda0 msgr2=0x7f9ec0066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:23.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.035+0000 7f9ebeffd640 1 --2- 172.21.15.167:0/1540988551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec006bda0 0x7f9ec0066730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.035+0000 7f9ebeffd640 1 -- 172.21.15.167:0/1540988551 >> v1:172.21.15.178:6789/0 conn(0x7f9ec00b0110 legacy=0x7f9ec006b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.035+0000 7f9ebeffd640 1 -- 172.21.15.167:0/1540988551 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00ca480 con 0x7f9ec00c8010 2023-11-28T20:45:23.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.035+0000 7f9ebeffd640 1 --2- 172.21.15.167:0/1540988551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec00c8010 0x7f9ec015d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40097c0 tx=0x7f9eb401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a490028544418a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.035+0000 7f9ebe7fc640 1 -- 172.21.15.167:0/1540988551 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40a8970 con 0x7f9ec00c8010 2023-11-28T20:45:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ebe7fc640 1 -- 172.21.15.167:0/1540988551 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb40a8ad0 con 0x7f9ec00c8010 2023-11-28T20:45:23.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ebe7fc640 1 -- 172.21.15.167:0/1540988551 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40a8e60 con 0x7f9ec00c8010 2023-11-28T20:45:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ec60fd640 1 -- 172.21.15.167:0/1540988551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec00c8010 msgr2=0x7f9ec015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ec60fd640 1 --2- 172.21.15.167:0/1540988551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec00c8010 0x7f9ec015d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40097c0 tx=0x7f9eb401ec70 comp rx=0 tx=0).stop 2023-11-28T20:45:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ec60fd640 1 -- 172.21.15.167:0/1540988551 shutdown_connections 2023-11-28T20:45:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ec60fd640 1 --2- 172.21.15.167:0/1540988551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec006bda0 0x7f9ec0066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ec60fd640 1 --2- 172.21.15.167:0/1540988551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec00c8010 0x7f9ec015d3b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ec60fd640 1 -- 172.21.15.167:0/1540988551 >> 172.21.15.167:0/1540988551 conn(0x7f9ec006ee30 msgr2=0x7f9ec006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:23.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ec60fd640 1 -- 172.21.15.167:0/1540988551 shutdown_connections 2023-11-28T20:45:23.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ec60fd640 1 -- 172.21.15.167:0/1540988551 wait complete. 2023-11-28T20:45:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.039+0000 7f9ec60fd640 1 Processor -- start 2023-11-28T20:45:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ec60fd640 1 -- start start 2023-11-28T20:45:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ec60fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec006bda0 0x7f9ec01f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ec60fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec00b0110 0x7f9ec00b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ec60fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec00c8010 0x7f9ec01f3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ec60fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01f3c60 con 0x7f9ec00c8010 2023-11-28T20:45:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ec60fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec015acb0 con 0x7f9ec00b0110 2023-11-28T20:45:23.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ec60fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0157cb0 con 0x7f9ec006bda0 2023-11-28T20:45:23.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec00c8010 0x7f9ec01f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec00b0110 0x7f9ec00b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec00c8010 0x7f9ec01f3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:55268/0 (socket says 172.21.15.167:55268) 2023-11-28T20:45:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebffff640 1 -- 172.21.15.167:0/2241071973 learned_addr learned my addr 172.21.15.167:0/2241071973 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebf7fe640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec006bda0 0x7f9ec01f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebffff640 1 -- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec006bda0 msgr2=0x7f9ec01f03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebffff640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec006bda0 0x7f9ec01f03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebffff640 1 -- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec00b0110 msgr2=0x7f9ec00b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebffff640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec00b0110 0x7f9ec00b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebffff640 1 -- 172.21.15.167:0/2241071973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4009420 con 0x7f9ec00c8010 2023-11-28T20:45:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ebffff640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec00c8010 0x7f9ec01f3720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800efc0 tx=0x7f9eb800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8009ca0 con 0x7f9ec00c8010 2023-11-28T20:45:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb800f040 con 0x7f9ec00c8010 2023-11-28T20:45:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec0157f50 con 0x7f9ec00c8010 2023-11-28T20:45:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80146c0 con 0x7f9ec00c8010 2023-11-28T20:45:23.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.043+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec01efbd0 con 0x7f9ec00c8010 2023-11-28T20:45:23.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.047+0000 7f9ec60fd640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01591f0 0x7f9ec01efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.047+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec006b130 con 0x7f9ec01591f0 2023-11-28T20:45:23.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.047+0000 7f9ebf7fe640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01591f0 0x7f9ec01efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.047+0000 7f9ebf7fe640 1 -- 172.21.15.167:0/2241071973 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ec00ca760 con 0x7f9ec01591f0 2023-11-28T20:45:23.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.047+0000 7f9ebf7fe640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01591f0 0x7f9ec01efdf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0000f70 tx=0x7f9eb000fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.047+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00058c0 con 0x7f9ec01591f0 2023-11-28T20:45:23.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.047+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9eb8014820 con 0x7f9ec00c8010 2023-11-28T20:45:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.051+0000 7f9ea7fff640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9eac066540 0x7f9eac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.051+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9eb8085210 con 0x7f9ec00c8010 2023-11-28T20:45:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.051+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9eb0005a20 con 0x7f9ec01591f0 2023-11-28T20:45:23.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.051+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01591f0 msgr2=0x7f9ec01efdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.051+0000 7f9ea7fff640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01591f0 0x7f9ec01efdf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0000f70 tx=0x7f9eb000fc00 comp rx=0 tx=0).stop 2023-11-28T20:45:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.051+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01591f0 msgr2=0x7f9ec01efdf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.051+0000 7f9ea7fff640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01591f0 0x7f9ec01efdf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.051+0000 7f9ebeffd640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9eac066540 0x7f9eac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.055+0000 7f9ebeffd640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9eac066540 0x7f9eac068a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40b2000 tx=0x7f9eb40aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ec60fd640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01e3410 0x7f9ec01e3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c8f10 con 0x7f9ec01e3410 2023-11-28T20:45:23.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ebf7fe640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01e3410 0x7f9ec01e3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ebf7fe640 1 -- 172.21.15.167:0/2241071973 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9ec006d530 con 0x7f9ec01e3410 2023-11-28T20:45:23.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ebf7fe640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01e3410 0x7f9ec01e3820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0000f70 tx=0x7f9eb0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0023070 con 0x7f9ec01e3410 2023-11-28T20:45:23.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4980 (secure 0 0 0) 0x7f9eb00075b0 con 0x7f9ec01e3410 2023-11-28T20:45:23.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01e3410 msgr2=0x7f9ec01e3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ea7fff640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01e3410 0x7f9ec01e3820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0000f70 tx=0x7f9eb0005800 comp rx=0 tx=0).stop 2023-11-28T20:45:23.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ea7fff640 1 -- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01e3410 msgr2=0x7f9ec01e3820 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:23.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ea7fff640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec01e3410 0x7f9ec01e3820 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0000f70 tx=0x7f9eb0005800 comp rx=0 tx=0).stop 2023-11-28T20:45:23.071 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:45:23.071 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:23.071 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:23.071 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:45:23.071 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 60, 2023-11-28T20:45:23.071 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:45:23.071 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:45:23.071 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:23.072 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:23.073 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:23.074 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:23.074 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:23.074 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:23.074 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:23.074 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:23.074 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:23.074 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:23.074 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:23.074 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:23.075 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:45:23.076 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:45:23.076 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:45:23.076 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:45:23.076 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:45:23.076 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:45:23.076 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:45:23.076 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:23.076 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:45:23.076 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:23.077 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:23.077 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:23.077 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:23.077 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:23.077 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:23.077 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:23.077 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:23.077 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:23.078 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:23.078 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.078 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:45:23.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.078 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:45:23.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.079 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:23.080 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:45:23.080 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.080 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.080 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.081 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:45:23.081 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:45:23.081 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:23.081 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:23.081 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:23.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.082 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:23.082 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:23.082 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:23.082 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:23.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.082 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:23.082 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:45:23.082 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.083 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:23.083 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:45:23.083 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.083 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:23.084 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.085 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.086 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.086 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:45:23.086 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:45:23.086 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:23.086 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:23.086 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:23.086 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.086 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.087 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:45:23.087 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:45:23.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.087 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.087 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.087 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:23.087 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.088 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:45:23.089 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.090 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.090 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.090 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:23.090 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.090 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.090 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.090 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:45:23.090 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9eac066540 msgr2=0x7f9eac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ec60fd640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9eac066540 0x7f9eac068a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40b2000 tx=0x7f9eb40aa070 comp rx=0 tx=0).stop 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec00c8010 msgr2=0x7f9ec01f3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.063+0000 7f9ec60fd640 1 --2- 172.21.15.167:0/2241071973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec00c8010 0x7f9ec01f3720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800efc0 tx=0x7f9eb800c490 comp rx=0 tx=0).stop 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.067+0000 7f9ebffff640 1 -- 172.21.15.167:0/2241071973 reap_dead start 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.067+0000 7f9ebffff640 1 -- 172.21.15.167:0/2241071973 reap_dead start 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.067+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 shutdown_connections 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.067+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 >> 172.21.15.167:0/2241071973 conn(0x7f9ec006ee30 msgr2=0x7f9ec006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.067+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 shutdown_connections 2023-11-28T20:45:23.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.067+0000 7f9ec60fd640 1 -- 172.21.15.167:0/2241071973 wait complete. 2023-11-28T20:45:23.093 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:45:23.093 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:45:23.093 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:45:23.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.235+0000 7fba8b59e640 1 Processor -- start 2023-11-28T20:45:23.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.235+0000 7fba8b59e640 1 -- start start 2023-11-28T20:45:23.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8b59e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba8c0c4d60 0x7fba8c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8b59e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c7a50 0x7fba8c151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8b59e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c0c5df0 con 0x7fba8c0c5140 2023-11-28T20:45:23.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8b59e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c06e460 con 0x7fba8c0c4d60 2023-11-28T20:45:23.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8b59e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c06ed40 con 0x7fba8c0c7a50 2023-11-28T20:45:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8a59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba8c0c4d60 0x7fba8c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8a59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba8c0c4d60 0x7fba8c06e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:55274/0 (socket says 172.21.15.167:55274) 2023-11-28T20:45:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8a59c640 1 -- 172.21.15.167:0/1455001486 learned_addr learned my addr 172.21.15.167:0/1455001486 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba89d9b640 1 --2- 172.21.15.167:0/1455001486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c7a50 0x7fba8c151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8a59c640 1 -- 172.21.15.167:0/1455001486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c7a50 msgr2=0x7fba8c151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8a59c640 1 --2- 172.21.15.167:0/1455001486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c7a50 0x7fba8c151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8a59c640 1 -- 172.21.15.167:0/1455001486 >> v1:172.21.15.178:6789/0 conn(0x7fba8c0c5140 legacy=0x7fba8c15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.239+0000 7fba8a59c640 1 -- 172.21.15.167:0/1455001486 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c06d970 con 0x7fba8c0c4d60 2023-11-28T20:45:23.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8a59c640 1 --2- 172.21.15.167:0/1455001486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 0x7fba8c06e800 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0098a0 tx=0x7fba7c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d15392ce4653f8d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8959a640 1 -- 172.21.15.167:0/1455001486 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0ab600 con 0x7fba8c0c4d60 2023-11-28T20:45:23.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8959a640 1 -- 172.21.15.167:0/1455001486 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0a7050 con 0x7fba8c0c4d60 2023-11-28T20:45:23.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8959a640 1 -- 172.21.15.167:0/1455001486 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0ab980 con 0x7fba8c0c4d60 2023-11-28T20:45:23.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8b59e640 1 -- 172.21.15.167:0/1455001486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 msgr2=0x7fba8c06e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8b59e640 1 --2- 172.21.15.167:0/1455001486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 0x7fba8c06e800 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0098a0 tx=0x7fba7c01c520 comp rx=0 tx=0).stop 2023-11-28T20:45:23.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8b59e640 1 -- 172.21.15.167:0/1455001486 shutdown_connections 2023-11-28T20:45:23.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8b59e640 1 --2- 172.21.15.167:0/1455001486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c7a50 0x7fba8c151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8b59e640 1 --2- 172.21.15.167:0/1455001486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 0x7fba8c06e800 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8b59e640 1 -- 172.21.15.167:0/1455001486 >> 172.21.15.167:0/1455001486 conn(0x7fba8c0cb3f0 msgr2=0x7fba8c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8b59e640 1 -- 172.21.15.167:0/1455001486 shutdown_connections 2023-11-28T20:45:23.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.243+0000 7fba8b59e640 1 -- 172.21.15.167:0/1455001486 wait complete. 2023-11-28T20:45:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8b59e640 1 Processor -- start 2023-11-28T20:45:23.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8b59e640 1 -- start start 2023-11-28T20:45:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8b59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 0x7fba8c0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8b59e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba8c0c5140 0x7fba8c14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8b59e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c7a50 0x7fba8c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8b59e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c154320 con 0x7fba8c0c4d60 2023-11-28T20:45:23.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8b59e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c1f7780 con 0x7fba8c0c5140 2023-11-28T20:45:23.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8b59e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c1f69e0 con 0x7fba8c0c7a50 2023-11-28T20:45:23.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 0x7fba8c0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 0x7fba8c0c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:55282/0 (socket says 172.21.15.167:55282) 2023-11-28T20:45:23.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8a59c640 1 -- 172.21.15.167:0/2340005988 learned_addr learned my addr 172.21.15.167:0/2340005988 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:23.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba89d9b640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba8c0c5140 0x7fba8c14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8ad9d640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c7a50 0x7fba8c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8a59c640 1 -- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c7a50 msgr2=0x7fba8c0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8a59c640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c7a50 0x7fba8c0c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8a59c640 1 -- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba8c0c5140 msgr2=0x7fba8c14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8a59c640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba8c0c5140 0x7fba8c14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8a59c640 1 -- 172.21.15.167:0/2340005988 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0094d0 con 0x7fba8c0c4d60 2023-11-28T20:45:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba89d9b640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba8c0c5140 0x7fba8c14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:45:23.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.247+0000 7fba8a59c640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 0x7fba8c0c31d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0ae040 tx=0x7fba7c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b4640 con 0x7fba8c0c4d60 2023-11-28T20:45:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0b47a0 con 0x7fba8c0c4d60 2023-11-28T20:45:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c14e270 con 0x7fba8c0c4d60 2023-11-28T20:45:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0b4b50 con 0x7fba8c0c4d60 2023-11-28T20:45:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c1f6ca0 con 0x7fba8c0c4d60 2023-11-28T20:45:23.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba8b59e640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c3e60 0x7fba8c1f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c074740 con 0x7fba8c0c3e60 2023-11-28T20:45:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba89d9b640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c3e60 0x7fba8c1f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba89d9b640 1 -- 172.21.15.167:0/2340005988 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba8c15b3b0 con 0x7fba8c0c3e60 2023-11-28T20:45:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba89d9b640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c3e60 0x7fba8c1f6e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba8c06b410 tx=0x7fba8000f9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80004020 con 0x7fba8c0c3e60 2023-11-28T20:45:23.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.251+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba7c0b2070 con 0x7fba8c0c4d60 2023-11-28T20:45:23.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.255+0000 7fba7affd640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba6c066510 0x7fba6c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.255+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fba7c11e090 con 0x7fba8c0c4d60 2023-11-28T20:45:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.255+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fba80004180 con 0x7fba8c0c3e60 2023-11-28T20:45:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.255+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c3e60 msgr2=0x7fba8c1f6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.255+0000 7fba7affd640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c3e60 0x7fba8c1f6e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba8c06b410 tx=0x7fba8000f9e0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.255+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c3e60 msgr2=0x7fba8c1f6e90 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.255+0000 7fba7affd640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c0c3e60 0x7fba8c1f6e90 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba8c06b410 tx=0x7fba8000f9e0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.255+0000 7fba8ad9d640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba6c066510 0x7fba6c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.255+0000 7fba8ad9d640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba6c066510 0x7fba6c0689d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fba840012f0 tx=0x7fba84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.259+0000 7fba8b59e640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c151d60 0x7fba8c141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.259+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c1f6b50 con 0x7fba8c151d60 2023-11-28T20:45:23.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.259+0000 7fba89d9b640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c151d60 0x7fba8c141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba89d9b640 1 -- 172.21.15.167:0/2340005988 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fba8c06b4e0 con 0x7fba8c151d60 2023-11-28T20:45:23.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba89d9b640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c151d60 0x7fba8c141e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0714f0 tx=0x7fba800046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80014c40 con 0x7fba8c151d60 2023-11-28T20:45:23.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7fba80014da0 con 0x7fba8c151d60 2023-11-28T20:45:23.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c151d60 msgr2=0x7fba8c141e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba7affd640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c151d60 0x7fba8c141e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0714f0 tx=0x7fba800046d0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba7affd640 1 -- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c151d60 msgr2=0x7fba8c141e50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:23.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba7affd640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba8c151d60 0x7fba8c141e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.270 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:45:23.271 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:23.271 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:23.271 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:45:23.272 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 60, 2023-11-28T20:45:23.272 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:45:23.272 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:45:23.272 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:45:23.272 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:45:23.272 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.273 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:45:23.273 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:23.273 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:45:23.273 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:45:23.273 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:23.273 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:23.273 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:23.273 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:23.273 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:23.274 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.275 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:45:23.276 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:45:23.277 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:45:23.277 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:45:23.277 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:45:23.277 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:23.277 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:45:23.277 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:23.277 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:23.277 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:23.277 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:45:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.279 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:23.280 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:45:23.280 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.280 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.280 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.280 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:45:23.280 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:45:23.281 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:23.281 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:23.281 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:23.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.281 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.281 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:23.282 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:23.282 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:23.283 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:23.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.283 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:23.283 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:45:23.284 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.284 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:23.284 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:45:23.284 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:45:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:45:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:23.285 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:23.286 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:23.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.286 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:23.286 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:23.286 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:23.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:23.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.287 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:23.287 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:45:23.287 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.287 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:23.288 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:45:23.288 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:23.288 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.288 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.289 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:45:23.289 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:45:23.289 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:23.289 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:23.289 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:23.289 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.289 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.290 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:45:23.290 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:45:23.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.290 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.290 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.290 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:23.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.291 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.291 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:45:23.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.291 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.292 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.292 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:45:23.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.292 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.292 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:23.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:23.294 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:23.295 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:23.295 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:23.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:23.295 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:45:23.295 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:45:23.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba6c066510 msgr2=0x7fba6c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8b59e640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba6c066510 0x7fba6c0689d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fba840012f0 tx=0x7fba84009040 comp rx=0 tx=0).stop 2023-11-28T20:45:23.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 msgr2=0x7fba8c0c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8b59e640 1 --2- 172.21.15.167:0/2340005988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba8c0c4d60 0x7fba8c0c31d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0ae040 tx=0x7fba7c0192c0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8ad9d640 1 -- 172.21.15.167:0/2340005988 reap_dead start 2023-11-28T20:45:23.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8ad9d640 1 -- 172.21.15.167:0/2340005988 reap_dead start 2023-11-28T20:45:23.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 shutdown_connections 2023-11-28T20:45:23.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 >> 172.21.15.167:0/2340005988 conn(0x7fba8c0cb3f0 msgr2=0x7fba8c150880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:23.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 shutdown_connections 2023-11-28T20:45:23.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.263+0000 7fba8b59e640 1 -- 172.21.15.167:0/2340005988 wait complete. 2023-11-28T20:45:23.297 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:45:23.297 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2023-11-28T20:45:23.298 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:45:23.298 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2023-11-28T20:45:23.298 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:45:23.298 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:45:23.298 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:45:23.320 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:45:23.320 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:45:23.320 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:45:23.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a7f0ad640 1 Processor -- start 2023-11-28T20:45:23.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a7f0ad640 1 -- start start 2023-11-28T20:45:23.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a7f0ad640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 0x7f4a780c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a7f0ad640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7815a090 con 0x7f4a78154120 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a7f0ad640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7815a370 con 0x7f4a780c87c0 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a7f0ad640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780c7820 con 0x7f4a780c6f00 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a7ce49640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 msgr2=0x7f4a780c72e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a7ce49640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 0x7f4a780c72e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a77fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4a78154120 0x7f4a780c7c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:49990/0 (socket says 172.21.15.167:49990) 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a77fff640 1 -- 172.21.15.167:0/863983855 learned_addr learned my addr 172.21.15.167:0/863983855 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611113842 0 0) 0x7f4a7815a090 con 0x7f4a78154120 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a68003530 con 0x7f4a78154120 2023-11-28T20:45:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305860550 0 0) 0x7f4a7815a370 con 0x7f4a780c87c0 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a7815a090 con 0x7f4a780c87c0 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2542335398 0 0) 0x7f4a68003530 con 0x7f4a78154120 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 msgr2=0x7f4a780c72e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 0x7f4a780c72e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 >> v1:172.21.15.178:6789/0 conn(0x7f4a780c87c0 legacy=0x7f4a7815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7815a650 con 0x7f4a78154120 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f4a64001680 con 0x7f4a78154120 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 >> v1:172.21.15.167:6789/0 conn(0x7f4a78154120 legacy=0x7f4a780c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a68004ba0 0x7f4a68004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 0x7f4a68003770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a68003dd0 0x7f4a6800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780c7820 con 0x7f4a68004ba0 2023-11-28T20:45:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68004450 con 0x7f4a68003dd0 2023-11-28T20:45:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68004610 con 0x7f4a780c6f00 2023-11-28T20:45:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a7ce49640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a68004ba0 0x7f4a68004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a77fff640 1 -- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 msgr2=0x7f4a68003770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.467+0000 7f4a77fff640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 0x7f4a68003770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a7d64a640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a68003dd0 0x7f4a6800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a7ce49640 1 -- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 msgr2=0x7f4a68003770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a7ce49640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a780c6f00 0x7f4a68003770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a7ce49640 1 -- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a68003dd0 msgr2=0x7f4a6800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a7ce49640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a68003dd0 0x7f4a6800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a7ce49640 1 -- 172.21.15.167:0/863983855 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7815a650 con 0x7f4a68004ba0 2023-11-28T20:45:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a7ce49640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a68004ba0 0x7f4a68004fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c003940 tx=0x7f4a6c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bc706eea050ced server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c003bc0 con 0x7f4a68004ba0 2023-11-28T20:45:23.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c0a7070 con 0x7f4a68004ba0 2023-11-28T20:45:23.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.471+0000 7f4a777fe640 1 -- 172.21.15.167:0/863983855 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c005070 con 0x7f4a68004ba0 2023-11-28T20:45:23.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.475+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/863983855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a68004ba0 msgr2=0x7f4a68004fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.475+0000 7f4a7f0ad640 1 --2- 172.21.15.167:0/863983855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a68004ba0 0x7f4a68004fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c003940 tx=0x7f4a6c01c420 comp rx=0 tx=0).stop 2023-11-28T20:45:23.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.475+0000 7f4a7d64a640 1 -- 172.21.15.167:0/863983855 reap_dead start 2023-11-28T20:45:23.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.475+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/863983855 shutdown_connections 2023-11-28T20:45:23.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.475+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/863983855 >> 172.21.15.167:0/863983855 conn(0x7f4a780cc300 msgr2=0x7f4a780cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:23.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.475+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/863983855 shutdown_connections 2023-11-28T20:45:23.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.475+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/863983855 wait complete. 2023-11-28T20:45:23.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.475+0000 7f4a7f0ad640 1 Processor -- start 2023-11-28T20:45:23.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.475+0000 7f4a7f0ad640 1 -- start start 2023-11-28T20:45:23.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7f0ad640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a68004ba0 0x7f4a7815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7f0ad640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a78152f70 0x7f4a78153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7f0ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a781f6410 0x7f4a781f6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7f0ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a781538b0 con 0x7f4a781f6410 2023-11-28T20:45:23.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7f0ad640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78144ff0 con 0x7f4a78152f70 2023-11-28T20:45:23.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7f0ad640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78145570 con 0x7f4a68004ba0 2023-11-28T20:45:23.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7ce49640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a68004ba0 msgr2=0x7f4a7815c5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7ce49640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a68004ba0 0x7f4a7815c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a78152f70 0x7f4a78153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a78152f70 0x7f4a78153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:37634/0 (socket says 172.21.15.167:37634) 2023-11-28T20:45:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a77fff640 1 -- 172.21.15.167:0/704662340 learned_addr learned my addr 172.21.15.167:0/704662340 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7d64a640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a781f6410 0x7f4a781f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7d64a640 1 -- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a68004ba0 msgr2=0x7f4a7815c5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:45:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7d64a640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a68004ba0 0x7f4a7815c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7d64a640 1 -- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a78152f70 msgr2=0x7f4a78153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7d64a640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a78152f70 0x7f4a78153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7d64a640 1 -- 172.21.15.167:0/704662340 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a78151840 con 0x7f4a781f6410 2023-11-28T20:45:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7d64a640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a781f6410 0x7f4a781f6890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a780cd2e0 tx=0x7f4a7000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a757fa640 1 -- 172.21.15.167:0/704662340 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70003980 con 0x7f4a781f6410 2023-11-28T20:45:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a757fa640 1 -- 172.21.15.167:0/704662340 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70003ae0 con 0x7f4a781f6410 2023-11-28T20:45:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a78145220 con 0x7f4a781f6410 2023-11-28T20:45:23.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a757fa640 1 -- 172.21.15.167:0/704662340 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70003e90 con 0x7f4a781f6410 2023-11-28T20:45:23.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.479+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a78152770 con 0x7f4a781f6410 2023-11-28T20:45:23.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.483+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a780682c0 con 0x7f4a781f6410 2023-11-28T20:45:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.483+0000 7f4a757fa640 1 -- 172.21.15.167:0/704662340 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4a700050d0 con 0x7f4a781f6410 2023-11-28T20:45:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.483+0000 7f4a757fa640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a5c066450 0x7f4a5c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.483+0000 7f4a757fa640 1 -- 172.21.15.167:0/704662340 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4a700840b0 con 0x7f4a781f6410 2023-11-28T20:45:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.487+0000 7f4a7ce49640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a5c066450 0x7f4a5c068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:23.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.487+0000 7f4a7ce49640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a5c066450 0x7f4a5c068910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0aa000 tx=0x7f4a6c005a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:23.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.495+0000 7f4a757fa640 1 -- 172.21.15.167:0/704662340 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a70051010 con 0x7f4a781f6410 2023-11-28T20:45:23.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.711+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4a78075c90 con 0x7f4a781f6410 2023-11-28T20:45:23.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.711+0000 7f4a757fa640 1 -- 172.21.15.167:0/704662340 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f4a70054630 con 0x7f4a781f6410 2023-11-28T20:45:23.714 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:45:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a5c066450 msgr2=0x7f4a5c068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a5c066450 0x7f4a5c068910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0aa000 tx=0x7f4a6c005a90 comp rx=0 tx=0).stop 2023-11-28T20:45:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a781f6410 msgr2=0x7f4a781f6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a781f6410 0x7f4a781f6890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a780cd2e0 tx=0x7f4a7000eb90 comp rx=0 tx=0).stop 2023-11-28T20:45:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 shutdown_connections 2023-11-28T20:45:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a5c066450 0x7f4a5c068910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a781f6410 0x7f4a781f6890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a78152f70 0x7f4a78153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 --2- 172.21.15.167:0/704662340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a68004ba0 0x7f4a7815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:23.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 >> 172.21.15.167:0/704662340 conn(0x7f4a780cc300 msgr2=0x7f4a780cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:23.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 shutdown_connections 2023-11-28T20:45:23.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:23.715+0000 7f4a7f0ad640 1 -- 172.21.15.167:0/704662340 wait complete. 2023-11-28T20:45:26.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:45:26.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5daff5640 1 Processor -- start 2023-11-28T20:45:26.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5daff5640 1 -- start start 2023-11-28T20:45:26.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5daff5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5d40c6f00 0x7fb5d40c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:26.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5daff5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 0x7fb5d415d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:26.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5daff5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d415a090 con 0x7fb5d4154120 2023-11-28T20:45:26.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5daff5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d40c7820 con 0x7fb5d40c6f00 2023-11-28T20:45:26.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5daff5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40c8390 con 0x7fb5d40c87c0 2023-11-28T20:45:26.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5d9592640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 msgr2=0x7fb5d415d610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:26.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5d9592640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 0x7fb5d415d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:26.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5d8d91640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5d40c6f00 0x7fb5d40c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:26.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5d3fff640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb5d4154120 0x7fb5d40c7c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:40142/0 (socket says 172.21.15.167:40142) 2023-11-28T20:45:26.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5d8d91640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5d40c6f00 0x7fb5d40c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:37636/0 (socket says 172.21.15.167:37636) 2023-11-28T20:45:26.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.975+0000 7fb5d3fff640 1 -- 172.21.15.167:0/3322280452 learned_addr learned my addr 172.21.15.167:0/3322280452 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:45:26.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.979+0000 7fb5d8d91640 1 -- 172.21.15.167:0/3322280452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 msgr2=0x7fb5d415d610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:26.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.979+0000 7fb5d8d91640 1 --2- 172.21.15.167:0/3322280452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 0x7fb5d415d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:26.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.979+0000 7fb5d8d91640 1 -- 172.21.15.167:0/3322280452 >> v1:172.21.15.178:6789/0 conn(0x7fb5d4154120 legacy=0x7fb5d40c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:26.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.979+0000 7fb5d8d91640 1 -- 172.21.15.167:0/3322280452 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d415a370 con 0x7fb5d40c6f00 2023-11-28T20:45:26.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5d8d91640 1 --2- 172.21.15.167:0/3322280452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 0x7fb5d40c72e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80097c0 tx=0x7fb5c801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b921a8a13d082e46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:26.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5d37fe640 1 -- 172.21.15.167:0/3322280452 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80ab670 con 0x7fb5d40c6f00 2023-11-28T20:45:26.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5d37fe640 1 -- 172.21.15.167:0/3322280452 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c80ab7d0 con 0x7fb5d40c6f00 2023-11-28T20:45:26.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5d37fe640 1 -- 172.21.15.167:0/3322280452 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80abb60 con 0x7fb5d40c6f00 2023-11-28T20:45:26.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5daff5640 1 -- 172.21.15.167:0/3322280452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 msgr2=0x7fb5d40c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:26.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5daff5640 1 --2- 172.21.15.167:0/3322280452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 0x7fb5d40c72e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80097c0 tx=0x7fb5c801c470 comp rx=0 tx=0).stop 2023-11-28T20:45:26.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5daff5640 1 -- 172.21.15.167:0/3322280452 shutdown_connections 2023-11-28T20:45:26.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5daff5640 1 --2- 172.21.15.167:0/3322280452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 0x7fb5d415d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:26.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5daff5640 1 --2- 172.21.15.167:0/3322280452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 0x7fb5d40c72e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:26.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5daff5640 1 -- 172.21.15.167:0/3322280452 >> 172.21.15.167:0/3322280452 conn(0x7fb5d40cc300 msgr2=0x7fb5d40cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:26.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5daff5640 1 -- 172.21.15.167:0/3322280452 shutdown_connections 2023-11-28T20:45:26.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.983+0000 7fb5daff5640 1 -- 172.21.15.167:0/3322280452 wait complete. 2023-11-28T20:45:26.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.987+0000 7fb5daff5640 1 Processor -- start 2023-11-28T20:45:26.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.987+0000 7fb5daff5640 1 -- start start 2023-11-28T20:45:26.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.987+0000 7fb5daff5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 0x7fb5d4151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:26.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.987+0000 7fb5daff5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 0x7fb5d4152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:26.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.987+0000 7fb5daff5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4154120 0x7fb5d40c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:26.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.987+0000 7fb5daff5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40c5310 con 0x7fb5d4154120 2023-11-28T20:45:26.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.987+0000 7fb5daff5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40c4bb0 con 0x7fb5d40c6f00 2023-11-28T20:45:26.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.987+0000 7fb5daff5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d40c4e90 con 0x7fb5d40c87c0 2023-11-28T20:45:26.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d3fff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 msgr2=0x7fb5d4152a70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:26.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d3fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 0x7fb5d4152a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:26.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d8d91640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 0x7fb5d4151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:26.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d9592640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4154120 0x7fb5d40c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:26.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d8d91640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 0x7fb5d4151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:37638/0 (socket says 172.21.15.167:37638) 2023-11-28T20:45:26.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d8d91640 1 -- 172.21.15.167:0/3416908923 learned_addr learned my addr 172.21.15.167:0/3416908923 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:26.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d9592640 1 -- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 msgr2=0x7fb5d4152a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:45:26.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d9592640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 0x7fb5d4152a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:26.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d9592640 1 -- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 msgr2=0x7fb5d4151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:26.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d9592640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 0x7fb5d4151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:26.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d9592640 1 -- 172.21.15.167:0/3416908923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8009420 con 0x7fb5d4154120 2023-11-28T20:45:26.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d9592640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4154120 0x7fb5d40c57a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00ba60 tx=0x7fb5cc00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:26.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d17fa640 1 -- 172.21.15.167:0/3416908923 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00cbe0 con 0x7fb5d4154120 2023-11-28T20:45:26.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d17fa640 1 -- 172.21.15.167:0/3416908923 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc00cd40 con 0x7fb5d4154120 2023-11-28T20:45:26.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d415ca30 con 0x7fb5d4154120 2023-11-28T20:45:26.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5d17fa640 1 -- 172.21.15.167:0/3416908923 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc0156b0 con 0x7fb5d4154120 2023-11-28T20:45:26.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d415c720 con 0x7fb5d4154120 2023-11-28T20:45:26.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.991+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d40682c0 con 0x7fb5d4154120 2023-11-28T20:45:26.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.995+0000 7fb5d17fa640 1 -- 172.21.15.167:0/3416908923 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5cc012070 con 0x7fb5d4154120 2023-11-28T20:45:26.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.995+0000 7fb5d17fa640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5b8066420 0x7fb5b80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:26.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.995+0000 7fb5d17fa640 1 -- 172.21.15.167:0/3416908923 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb5cc084240 con 0x7fb5d4154120 2023-11-28T20:45:26.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.995+0000 7fb5d8d91640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5b8066420 0x7fb5b80688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:27.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:26.999+0000 7fb5d8d91640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5b8066420 0x7fb5b80688e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb5c801c4b0 tx=0x7fb5c80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:27.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.003+0000 7fb5d17fa640 1 -- 172.21.15.167:0/3416908923 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5cc051230 con 0x7fb5d4154120 2023-11-28T20:45:27.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.431+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb5d4067c40 con 0x7fb5d4154120 2023-11-28T20:45:27.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5d17fa640 1 -- 172.21.15.167:0/3416908923 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fb5cc01a620 con 0x7fb5d4154120 2023-11-28T20:45:27.437 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:45:27.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5b8066420 msgr2=0x7fb5b80688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:27.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5b8066420 0x7fb5b80688e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb5c801c4b0 tx=0x7fb5c80a7000 comp rx=0 tx=0).stop 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4154120 msgr2=0x7fb5d40c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4154120 0x7fb5d40c57a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00ba60 tx=0x7fb5cc00bf20 comp rx=0 tx=0).stop 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 shutdown_connections 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb5b8066420 0x7fb5b80688e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d4154120 0x7fb5d40c57a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d40c87c0 0x7fb5d4152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 --2- 172.21.15.167:0/3416908923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d40c6f00 0x7fb5d4151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 >> 172.21.15.167:0/3416908923 conn(0x7fb5d40cc300 msgr2=0x7fb5d4158420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 shutdown_connections 2023-11-28T20:45:27.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:27.435+0000 7fb5daff5640 1 -- 172.21.15.167:0/3416908923 wait complete. 2023-11-28T20:45:30.469 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:45:30.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.699+0000 7f32ecdf8640 1 Processor -- start 2023-11-28T20:45:30.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.699+0000 7f32ecdf8640 1 -- start start 2023-11-28T20:45:30.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32ecdf8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f32e80ccb70 0x7f32e815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:30.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32ecdf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 0x7f32e80cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:30.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32ecdf8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e80cfef0 con 0x7f32e8153db0 2023-11-28T20:45:30.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32ecdf8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e80cc6e0 con 0x7f32e80ccb70 2023-11-28T20:45:30.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32ecdf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e8154190 con 0x7f32e80cf440 2023-11-28T20:45:30.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32e6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f32e80ccb70 0x7f32e815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:30.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32e7fff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 msgr2=0x7f32e80cf8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:30.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32e6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f32e80ccb70 0x7f32e815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:55342/0 (socket says 172.21.15.167:55342) 2023-11-28T20:45:30.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32e6ffd640 1 -- 172.21.15.167:0/723832295 learned_addr learned my addr 172.21.15.167:0/723832295 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:30.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32e7fff640 1 --2- 172.21.15.167:0/723832295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 0x7f32e80cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:30.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32e6ffd640 1 -- 172.21.15.167:0/723832295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 msgr2=0x7f32e80cf8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:30.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32e6ffd640 1 --2- 172.21.15.167:0/723832295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 0x7f32e80cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:30.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32e6ffd640 1 -- 172.21.15.167:0/723832295 >> v1:172.21.15.178:6789/0 conn(0x7f32e8153db0 legacy=0x7f32e80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:30.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.703+0000 7f32e6ffd640 1 -- 172.21.15.167:0/723832295 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80cbad0 con 0x7f32e80ccb70 2023-11-28T20:45:30.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.707+0000 7f32e6ffd640 1 --2- 172.21.15.167:0/723832295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e80ccb70 0x7f32e815a540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009870 tx=0x7f32dc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac0db152bdc1448 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:30.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.707+0000 7f32e67fc640 1 -- 172.21.15.167:0/723832295 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0ab650 con 0x7f32e80ccb70 2023-11-28T20:45:30.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.707+0000 7f32e67fc640 1 -- 172.21.15.167:0/723832295 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc0ab7b0 con 0x7f32e80ccb70 2023-11-28T20:45:30.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.707+0000 7f32e67fc640 1 -- 172.21.15.167:0/723832295 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0abb40 con 0x7f32e80ccb70 2023-11-28T20:45:30.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.707+0000 7f32ecdf8640 1 -- 172.21.15.167:0/723832295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e80ccb70 msgr2=0x7f32e815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:30.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.707+0000 7f32ecdf8640 1 --2- 172.21.15.167:0/723832295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e80ccb70 0x7f32e815a540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009870 tx=0x7f32dc01c560 comp rx=0 tx=0).stop 2023-11-28T20:45:30.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.711+0000 7f32ecdf8640 1 -- 172.21.15.167:0/723832295 shutdown_connections 2023-11-28T20:45:30.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.711+0000 7f32ecdf8640 1 --2- 172.21.15.167:0/723832295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 0x7f32e80cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:30.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.711+0000 7f32ecdf8640 1 --2- 172.21.15.167:0/723832295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e80ccb70 0x7f32e815a540 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:30.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.711+0000 7f32ecdf8640 1 -- 172.21.15.167:0/723832295 >> 172.21.15.167:0/723832295 conn(0x7f32e806b800 msgr2=0x7f32e806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:30.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.711+0000 7f32ecdf8640 1 -- 172.21.15.167:0/723832295 shutdown_connections 2023-11-28T20:45:30.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.711+0000 7f32ecdf8640 1 -- 172.21.15.167:0/723832295 wait complete. 2023-11-28T20:45:30.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.711+0000 7f32ecdf8640 1 Processor -- start 2023-11-28T20:45:30.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.711+0000 7f32ecdf8640 1 -- start start 2023-11-28T20:45:30.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32ecdf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 0x7f32e8157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:30.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32ecdf8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e8153db0 0x7f32e80cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:30.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32ecdf8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32e80cd370 0x7f32e8158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:30.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32ecdf8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80b3cf0 con 0x7f32e8153db0 2023-11-28T20:45:30.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32ecdf8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e81598f0 con 0x7f32e80cd370 2023-11-28T20:45:30.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32ecdf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e81f29d0 con 0x7f32e80cf440 2023-11-28T20:45:30.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e77fe640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 msgr2=0x7f32e8157670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:30.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e77fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 0x7f32e8157670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:30.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e8153db0 0x7f32e80cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:30.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e8153db0 0x7f32e80cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:55348/0 (socket says 172.21.15.167:55348) 2023-11-28T20:45:30.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e6ffd640 1 -- 172.21.15.167:0/3646682752 learned_addr learned my addr 172.21.15.167:0/3646682752 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:30.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e7fff640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32e80cd370 0x7f32e8158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:30.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e6ffd640 1 -- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 msgr2=0x7f32e8157670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:45:30.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e6ffd640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 0x7f32e8157670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:30.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e6ffd640 1 -- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32e80cd370 msgr2=0x7f32e8158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:30.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e6ffd640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32e80cd370 0x7f32e8158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:30.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e6ffd640 1 -- 172.21.15.167:0/3646682752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc0094d0 con 0x7f32e8153db0 2023-11-28T20:45:30.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e7fff640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32e80cd370 0x7f32e8158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:45:30.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32e6ffd640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e8153db0 0x7f32e80cdce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32dc097f20 tx=0x7f32dc01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:30.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32cffff640 1 -- 172.21.15.167:0/3646682752 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc004230 con 0x7f32e8153db0 2023-11-28T20:45:30.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32cffff640 1 -- 172.21.15.167:0/3646682752 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc004390 con 0x7f32e8153db0 2023-11-28T20:45:30.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e81f2cb0 con 0x7f32e8153db0 2023-11-28T20:45:30.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32cffff640 1 -- 172.21.15.167:0/3646682752 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc003840 con 0x7f32e8153db0 2023-11-28T20:45:30.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.715+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e81f3270 con 0x7f32e8153db0 2023-11-28T20:45:30.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.719+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e804e850 con 0x7f32e8153db0 2023-11-28T20:45:30.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.719+0000 7f32cffff640 1 -- 172.21.15.167:0/3646682752 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f32dc0059a0 con 0x7f32e8153db0 2023-11-28T20:45:30.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.723+0000 7f32cffff640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f32d4066470 0x7f32d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:30.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.723+0000 7f32cffff640 1 -- 172.21.15.167:0/3646682752 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f32dc11edc0 con 0x7f32e8153db0 2023-11-28T20:45:30.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.723+0000 7f32e77fe640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f32d4066470 0x7f32d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:30.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.723+0000 7f32e77fe640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f32d4066470 0x7f32d4068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32d8001040 tx=0x7f32d8007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:30.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:30.727+0000 7f32cffff640 1 -- 172.21.15.167:0/3646682752 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32dc0ebe50 con 0x7f32e8153db0 2023-11-28T20:45:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.151+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f32e80cae70 con 0x7f32e8153db0 2023-11-28T20:45:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.151+0000 7f32cffff640 1 -- 172.21.15.167:0/3646682752 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f32dc0ef470 con 0x7f32e8153db0 2023-11-28T20:45:31.156 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:45:31.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f32d4066470 msgr2=0x7f32d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:31.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f32d4066470 0x7f32d4068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32d8001040 tx=0x7f32d8007a40 comp rx=0 tx=0).stop 2023-11-28T20:45:31.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e8153db0 msgr2=0x7f32e80cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:31.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e8153db0 0x7f32e80cdce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32dc097f20 tx=0x7f32dc01ada0 comp rx=0 tx=0).stop 2023-11-28T20:45:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 shutdown_connections 2023-11-28T20:45:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f32d4066470 0x7f32d4068930 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32e80cd370 0x7f32e8158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e8153db0 0x7f32e80cdce0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 --2- 172.21.15.167:0/3646682752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32e80cf440 0x7f32e8157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 >> 172.21.15.167:0/3646682752 conn(0x7f32e806b800 msgr2=0x7f32e8150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:31.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 shutdown_connections 2023-11-28T20:45:31.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:31.155+0000 7f32ecdf8640 1 -- 172.21.15.167:0/3646682752 wait complete. 2023-11-28T20:45:34.190 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:45:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.331+0000 7f8a70eaa640 1 Processor -- start 2023-11-28T20:45:34.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.331+0000 7f8a70eaa640 1 -- start start 2023-11-28T20:45:34.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a70eaa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:34.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a70eaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 0x7f8a6c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:34.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a70eaa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c15ac00 con 0x7f8a6c0cf860 2023-11-28T20:45:34.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a70eaa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0cbd60 con 0x7f8a6c0cfc40 2023-11-28T20:45:34.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a70eaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c159ff0 con 0x7f8a6c153ae0 2023-11-28T20:45:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a61d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a6ad9d640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 msgr2=0x7f8a6c153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a6ad9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 0x7f8a6c153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a61d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53304/0 (socket says 172.21.15.167:53304) 2023-11-28T20:45:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 learned_addr learned my addr 172.21.15.167:0/4282842878 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 msgr2=0x7f8a6c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 msgr2=0x7f8a6c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.335+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:34.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.539+0000 7f8a6ad9d640 1 -- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 msgr2=0x7f8a6c153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:34.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.539+0000 7f8a6ad9d640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 0x7f8a6c153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:45:34.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.539+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:34.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.539+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 msgr2=0x7f8a6c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:34.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.539+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 msgr2=0x7f8a6c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:34.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.539+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.539+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:45:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.943+0000 7f8a6ad9d640 1 -- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 msgr2=0x7f8a6c153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.943+0000 7f8a6ad9d640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 0x7f8a6c153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:45:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.943+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.943+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 msgr2=0x7f8a6c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.943+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 msgr2=0x7f8a6c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.943+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:34.943+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:45:35.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:35.747+0000 7f8a6ad9d640 1 -- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 msgr2=0x7f8a6c153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:35.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:35.747+0000 7f8a6ad9d640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 0x7f8a6c153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:45:35.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:35.747+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:35.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:35.747+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 msgr2=0x7f8a6c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:35.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:35.747+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 msgr2=0x7f8a6c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:35.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:35.747+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:35.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:35.747+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:45:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a68d99640 1 -- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 msgr2=0x7f8a6c153f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a68d99640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a6c153ae0 0x7f8a6c153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a68d99640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 msgr2=0x7f8a6c0cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:37.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a68d99640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.167:3300/0 conn(0x7f8a6c0cfc40 0x7f8a6c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a68d99640 1 -- 172.21.15.167:0/4282842878 >> v1:172.21.15.178:6789/0 conn(0x7f8a6c0cf860 legacy=0x7f8a6c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:37.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a68d99640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 0x7f8a4c005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:37.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a68d99640 1 -- 172.21.15.167:0/4282842878 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c15a2d0 con 0x7f8a4c0061a0 2023-11-28T20:45:37.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a68d99640 1 -- 172.21.15.167:0/4282842878 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0cbd60 con 0x7f8a4c0036d0 2023-11-28T20:45:37.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 0x7f8a4c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:37.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a6a59c640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 msgr2=0x7f8a4c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:37.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a6a59c640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 msgr2=0x7f8a4c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:37.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 0x7f8a4c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:37.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.335+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 0x7f8a4c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:37.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.539+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 0x7f8a4c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:37.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.539+0000 7f8a6a59c640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 msgr2=0x7f8a4c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:45:37.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.539+0000 7f8a6a59c640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 msgr2=0x7f8a4c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:37.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.539+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 0x7f8a4c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:37.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.539+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 0x7f8a4c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:45:37.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318606126 0 0) 0x7f8a6c15a2d0 con 0x7f8a4c0061a0 2023-11-28T20:45:37.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a58003530 con 0x7f8a4c0061a0 2023-11-28T20:45:37.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3958692155 0 0) 0x7f8a58003530 con 0x7f8a4c0061a0 2023-11-28T20:45:37.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 msgr2=0x7f8a4c005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:37.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 --2- 172.21.15.167:0/4282842878 >> v2:172.21.15.178:3300/0 conn(0x7f8a4c0036d0 0x7f8a4c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c00afa0 con 0x7f8a4c0061a0 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f8a5400c570 con 0x7f8a4c0061a0 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 >> v1:172.21.15.167:6789/0 conn(0x7f8a4c0061a0 legacy=0x7f8a4c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a6ad9d640 1 -- 172.21.15.167:0/4282842878 reap_dead start 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a58003980 0x7f8a58003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 0x7f8a58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a580051e0 0x7f8a5800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0cbd60 con 0x7f8a58003980 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5800c110 con 0x7f8a580051e0 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5800c2d0 con 0x7f8a580047d0 2023-11-28T20:45:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a61d9b640 1 -- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 msgr2=0x7f8a58004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a61d9b640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 0x7f8a58004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a58003980 0x7f8a58003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a6ad9d640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a580051e0 0x7f8a5800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a6a59c640 1 -- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 msgr2=0x7f8a58004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 0x7f8a58004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a6a59c640 1 -- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a580051e0 msgr2=0x7f8a5800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a580051e0 0x7f8a5800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a6a59c640 1 -- 172.21.15.167:0/4282842878 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58003530 con 0x7f8a58003980 2023-11-28T20:45:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.683+0000 7f8a6ad9d640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a580051e0 0x7f8a5800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:45:37.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a58003980 0x7f8a58003d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c001660 tx=0x7f8a5c01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf61b2c670bca617 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:37.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c006d60 con 0x7f8a58003980 2023-11-28T20:45:37.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0a9070 con 0x7f8a58003980 2023-11-28T20:45:37.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a69d9b640 1 -- 172.21.15.167:0/4282842878 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0a5ae0 con 0x7f8a58003980 2023-11-28T20:45:37.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a70eaa640 1 -- 172.21.15.167:0/4282842878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a58003980 msgr2=0x7f8a58003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:37.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a58003980 0x7f8a58003d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c001660 tx=0x7f8a5c01cba0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a70eaa640 1 -- 172.21.15.167:0/4282842878 shutdown_connections 2023-11-28T20:45:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a580051e0 0x7f8a5800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 0x7f8a58004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/4282842878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a58003980 0x7f8a58003d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a70eaa640 1 -- 172.21.15.167:0/4282842878 >> 172.21.15.167:0/4282842878 conn(0x7f8a6c06c1f0 msgr2=0x7f8a6c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a70eaa640 1 -- 172.21.15.167:0/4282842878 shutdown_connections 2023-11-28T20:45:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.687+0000 7f8a70eaa640 1 -- 172.21.15.167:0/4282842878 wait complete. 2023-11-28T20:45:37.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a70eaa640 1 Processor -- start 2023-11-28T20:45:37.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a70eaa640 1 -- start start 2023-11-28T20:45:37.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a70eaa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a58003980 0x7f8a6c15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:37.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a70eaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 0x7f8a6c0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:37.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a70eaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a580051e0 0x7f8a6c0ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:37.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a70eaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c14dec0 con 0x7f8a580051e0 2023-11-28T20:45:37.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a70eaa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c15ae60 con 0x7f8a58003980 2023-11-28T20:45:37.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a70eaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c1478e0 con 0x7f8a580047d0 2023-11-28T20:45:37.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a61d9b640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 msgr2=0x7f8a6c0b4030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:37.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a61d9b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 0x7f8a6c0b4030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:37.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a580051e0 0x7f8a6c0ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:37.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a580051e0 0x7f8a6c0ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53332/0 (socket says 172.21.15.167:53332) 2023-11-28T20:45:37.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6a59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a58003980 0x7f8a6c15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:37.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6ad9d640 1 -- 172.21.15.167:0/1402464528 learned_addr learned my addr 172.21.15.167:0/1402464528 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:37.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6ad9d640 1 -- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 msgr2=0x7f8a6c0b4030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:45:37.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6ad9d640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 0x7f8a6c0b4030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6ad9d640 1 -- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a58003980 msgr2=0x7f8a6c15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:37.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6ad9d640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a58003980 0x7f8a6c15b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6ad9d640 1 -- 172.21.15.167:0/1402464528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c15cd00 con 0x7f8a580051e0 2023-11-28T20:45:37.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a6ad9d640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a580051e0 0x7f8a6c0ce590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c006110 tx=0x7f8a64005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:37.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a637fe640 1 -- 172.21.15.167:0/1402464528 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400b9a0 con 0x7f8a580051e0 2023-11-28T20:45:37.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a637fe640 1 -- 172.21.15.167:0/1402464528 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6400bb40 con 0x7f8a580051e0 2023-11-28T20:45:37.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.691+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c15cfe0 con 0x7f8a580051e0 2023-11-28T20:45:37.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.695+0000 7f8a637fe640 1 -- 172.21.15.167:0/1402464528 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64016440 con 0x7f8a580051e0 2023-11-28T20:45:37.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.695+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c14e3b0 con 0x7f8a580051e0 2023-11-28T20:45:37.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.695+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c15b010 con 0x7f8a580051e0 2023-11-28T20:45:37.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.695+0000 7f8a637fe640 1 -- 172.21.15.167:0/1402464528 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8a640165a0 con 0x7f8a580051e0 2023-11-28T20:45:37.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.695+0000 7f8a637fe640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8a4c069a80 0x7f8a4c06bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:37.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.695+0000 7f8a637fe640 1 -- 172.21.15.167:0/1402464528 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8a640841e0 con 0x7f8a580051e0 2023-11-28T20:45:37.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.695+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8a4c069a80 0x7f8a4c06bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:37.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.699+0000 7f8a6a59c640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8a4c069a80 0x7f8a4c06bf40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0af000 tx=0x7f8a5c001520 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:37.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.703+0000 7f8a637fe640 1 -- 172.21.15.167:0/1402464528 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a6c15b010 con 0x7f8a580051e0 2023-11-28T20:45:37.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.911+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8a6c15b010 con 0x7f8a580051e0 2023-11-28T20:45:37.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.911+0000 7f8a637fe640 1 -- 172.21.15.167:0/1402464528 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f8a6401b620 con 0x7f8a580051e0 2023-11-28T20:45:37.914 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":64,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:45:37.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8a4c069a80 msgr2=0x7f8a4c06bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:37.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8a4c069a80 0x7f8a4c06bf40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0af000 tx=0x7f8a5c001520 comp rx=0 tx=0).stop 2023-11-28T20:45:37.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a580051e0 msgr2=0x7f8a6c0ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:37.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a580051e0 0x7f8a6c0ce590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c006110 tx=0x7f8a64005790 comp rx=0 tx=0).stop 2023-11-28T20:45:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 shutdown_connections 2023-11-28T20:45:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8a4c069a80 0x7f8a4c06bf40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a580051e0 0x7f8a6c0ce590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a580047d0 0x7f8a6c0b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 --2- 172.21.15.167:0/1402464528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a58003980 0x7f8a6c15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 >> 172.21.15.167:0/1402464528 conn(0x7f8a6c06c1f0 msgr2=0x7f8a6c0c5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 shutdown_connections 2023-11-28T20:45:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:37.915+0000 7f8a70eaa640 1 -- 172.21.15.167:0/1402464528 wait complete. 2023-11-28T20:45:37.936 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:45:37.936 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:45:37.936 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:45:38.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.071+0000 7f60058c9640 1 Processor -- start 2023-11-28T20:45:38.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.071+0000 7f60058c9640 1 -- start start 2023-11-28T20:45:38.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.071+0000 7f60058c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6000157560 0x7f60000c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.071+0000 7f60058c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6000157940 con 0x7f60000c6ff0 2023-11-28T20:45:38.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.071+0000 7f60058c9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60000c6ac0 con 0x7f6000150b40 2023-11-28T20:45:38.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.071+0000 7f60058c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000c62f0 con 0x7f6000157560 2023-11-28T20:45:38.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.071+0000 7f5ff67fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f60000c6ff0 0x7f600006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46974/0 (socket says 172.21.15.167:46974) 2023-11-28T20:45:38.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.071+0000 7f5ff67fc640 1 -- 172.21.15.167:0/209480327 learned_addr learned my addr 172.21.15.167:0/209480327 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:45:38.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.071+0000 7f5fff7fe640 1 --2- 172.21.15.167:0/209480327 >> v2:172.21.15.167:3300/0 conn(0x7f6000157560 0x7f60000c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.075+0000 7f5fff7fe640 1 -- 172.21.15.167:0/209480327 >> v1:172.21.15.178:6789/0 conn(0x7f6000150b40 legacy=0x7f60000c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.075+0000 7f5fff7fe640 1 -- 172.21.15.167:0/209480327 >> v1:172.21.15.167:6789/0 conn(0x7f60000c6ff0 legacy=0x7f600006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.075+0000 7f5fff7fe640 1 -- 172.21.15.167:0/209480327 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000c6500 con 0x7f6000157560 2023-11-28T20:45:38.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.075+0000 7f5fff7fe640 1 --2- 172.21.15.167:0/209480327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6000157560 0x7f60000c4510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80097c0 tx=0x7f5ff8020e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935c40fd4deee47a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.075+0000 7f5ffe7fc640 1 -- 172.21.15.167:0/209480327 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80aab80 con 0x7f6000157560 2023-11-28T20:45:38.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.075+0000 7f5ffe7fc640 1 -- 172.21.15.167:0/209480327 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff80aace0 con 0x7f6000157560 2023-11-28T20:45:38.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.075+0000 7f5ffe7fc640 1 -- 172.21.15.167:0/209480327 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80b2660 con 0x7f6000157560 2023-11-28T20:45:38.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.075+0000 7f60058c9640 1 -- 172.21.15.167:0/209480327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6000157560 msgr2=0x7f60000c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.075+0000 7f60058c9640 1 --2- 172.21.15.167:0/209480327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6000157560 0x7f60000c4510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80097c0 tx=0x7f5ff8020e80 comp rx=0 tx=0).stop 2023-11-28T20:45:38.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 -- 172.21.15.167:0/209480327 shutdown_connections 2023-11-28T20:45:38.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 --2- 172.21.15.167:0/209480327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6000157560 0x7f60000c4510 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 -- 172.21.15.167:0/209480327 >> 172.21.15.167:0/209480327 conn(0x7f60000cb1e0 msgr2=0x7f60000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:38.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 -- 172.21.15.167:0/209480327 shutdown_connections 2023-11-28T20:45:38.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 -- 172.21.15.167:0/209480327 wait complete. 2023-11-28T20:45:38.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 Processor -- start 2023-11-28T20:45:38.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 -- start start 2023-11-28T20:45:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60000c6ff0 0x7f6000152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6000150b40 0x7f60001f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6000157560 0x7f60001f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6000151d90 con 0x7f60000c6ff0 2023-11-28T20:45:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6000152070 con 0x7f6000157560 2023-11-28T20:45:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6000152350 con 0x7f6000150b40 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60000c6ff0 0x7f6000152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60000c6ff0 0x7f6000152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53340/0 (socket says 172.21.15.167:53340) 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffeffd640 1 -- 172.21.15.167:0/474058297 learned_addr learned my addr 172.21.15.167:0/474058297 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ff67fc640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6000150b40 msgr2=0x7f60001f2fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ff67fc640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6000150b40 0x7f60001f2fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5fff7fe640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6000157560 0x7f60001f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffeffd640 1 -- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6000150b40 msgr2=0x7f60001f2fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffeffd640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6000150b40 0x7f60001f2fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffeffd640 1 -- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6000157560 msgr2=0x7f60001f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffeffd640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6000157560 0x7f60001f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffeffd640 1 -- 172.21.15.167:0/474058297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8009420 con 0x7f60000c6ff0 2023-11-28T20:45:38.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffeffd640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60000c6ff0 0x7f6000152e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c500 tx=0x7f5ff000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0005220 con 0x7f60000c6ff0 2023-11-28T20:45:38.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0005380 con 0x7f60000c6ff0 2023-11-28T20:45:38.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.079+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6000152630 con 0x7f60000c6ff0 2023-11-28T20:45:38.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0007270 con 0x7f60000c6ff0 2023-11-28T20:45:38.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60000723d0 con 0x7f60000c6ff0 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f60058c9640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60001511d0 0x7f600014bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6000074770 con 0x7f60001511d0 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ff67fc640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60001511d0 0x7f600014bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ff67fc640 1 -- 172.21.15.167:0/474058297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6000156d60 con 0x7f60001511d0 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ff00073d0 con 0x7f60000c6ff0 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ff67fc640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60001511d0 0x7f600014bbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6000156990 tx=0x7f5fe80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5fe0066420 0x7f5fe00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5ff0083b20 con 0x7f60000c6ff0 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800ac10 con 0x7f60001511d0 2023-11-28T20:45:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f5fe800ad70 con 0x7f60001511d0 2023-11-28T20:45:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60001511d0 msgr2=0x7f600014bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60001511d0 0x7f600014bbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6000156990 tx=0x7f5fe80021d0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60001511d0 msgr2=0x7f600014bbe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5ffcff9640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60001511d0 0x7f600014bbe0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6000156990 tx=0x7f5fe80021d0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.083+0000 7f5fff7fe640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5fe0066420 0x7f5fe00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.087+0000 7f5fff7fe640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5fe0066420 0x7f5fe00688e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80b4000 tx=0x7f5ff8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600014c120 0x7f60001ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60001524c0 con 0x7f600014c120 2023-11-28T20:45:38.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5ff67fc640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600014c120 0x7f60001ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5ff67fc640 1 -- 172.21.15.167:0/474058297 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6000157040 con 0x7f600014c120 2023-11-28T20:45:38.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5ff67fc640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600014c120 0x7f60001ef7d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f600014e8b0 tx=0x7f5fe8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8020070 con 0x7f600014c120 2023-11-28T20:45:38.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4970 (secure 0 0 0) 0x7f5fe801a310 con 0x7f600014c120 2023-11-28T20:45:38.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600014c120 msgr2=0x7f60001ef7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5ffcff9640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600014c120 0x7f60001ef7d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f600014e8b0 tx=0x7f5fe8001260 comp rx=0 tx=0).stop 2023-11-28T20:45:38.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5ffcff9640 1 -- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600014c120 msgr2=0x7f60001ef7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:38.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5ffcff9640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600014c120 0x7f60001ef7d0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f600014e8b0 tx=0x7f5fe8001260 comp rx=0 tx=0).stop 2023-11-28T20:45:38.095 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:45:38.095 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:38.095 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 64, 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:38.096 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:45:38.097 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:45:38.099 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:38.100 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:38.101 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.103 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:45:38.103 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:45:38.104 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:38.105 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.106 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:38.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.108 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.109 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:45:38.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.111 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:45:38.112 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:45:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5fe0066420 msgr2=0x7f5fe00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5fe0066420 0x7f5fe00688e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80b4000 tx=0x7f5ff8008040 comp rx=0 tx=0).stop 2023-11-28T20:45:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60000c6ff0 msgr2=0x7f6000152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 --2- 172.21.15.167:0/474058297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60000c6ff0 0x7f6000152e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c500 tx=0x7f5ff000c9c0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5fff7fe640 1 -- 172.21.15.167:0/474058297 reap_dead start 2023-11-28T20:45:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f5fff7fe640 1 -- 172.21.15.167:0/474058297 reap_dead start 2023-11-28T20:45:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 shutdown_connections 2023-11-28T20:45:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 >> 172.21.15.167:0/474058297 conn(0x7f60000cb1e0 msgr2=0x7f60000c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:38.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 shutdown_connections 2023-11-28T20:45:38.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.091+0000 7f60058c9640 1 -- 172.21.15.167:0/474058297 wait complete. 2023-11-28T20:45:38.115 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:45:38.115 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:45:38.115 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:45:38.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.251+0000 7f0d21cdd640 1 Processor -- start 2023-11-28T20:45:38.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.251+0000 7f0d21cdd640 1 -- start start 2023-11-28T20:45:38.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.251+0000 7f0d21cdd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d1c070480 0x7f0d1c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.251+0000 7f0d21cdd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c1571d0 con 0x7f0d1c06e030 2023-11-28T20:45:38.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.251+0000 7f0d21cdd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c071a90 con 0x7f0d1c06e410 2023-11-28T20:45:38.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.251+0000 7f0d21cdd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1c0c70d0 con 0x7f0d1c070480 2023-11-28T20:45:38.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0d1c06e030 0x7f0d1c1500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46984/0 (socket says 172.21.15.167:46984) 2023-11-28T20:45:38.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1b7fe640 1 -- 172.21.15.167:0/51425369 learned_addr learned my addr 172.21.15.167:0/51425369 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:45:38.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d13fff640 1 --2- 172.21.15.167:0/51425369 >> v2:172.21.15.178:3300/0 conn(0x7f0d1c070480 0x7f0d1c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582938337 0 0) 0x7f0d1c1571d0 con 0x7f0d1c06e030 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d08003530 con 0x7f0d1c06e030 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4265942467 0 0) 0x7f0d08003530 con 0x7f0d1c06e030 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 >> v2:172.21.15.178:3300/0 conn(0x7f0d1c070480 msgr2=0x7f0d1c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 --2- 172.21.15.167:0/51425369 >> v2:172.21.15.178:3300/0 conn(0x7f0d1c070480 0x7f0d1c071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 >> v1:172.21.15.178:6789/0 conn(0x7f0d1c06e410 legacy=0x7f0d1c160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c0c73b0 con 0x7f0d1c06e030 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f0d0c001680 con 0x7f0d1c06e030 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 >> v1:172.21.15.167:6789/0 conn(0x7f0d1c06e030 legacy=0x7f0d1c1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003980 0x7f0d08003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d08004380 0x7f0d08004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d08005050 0x7f0d0800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c0c70d0 con 0x7f0d08003980 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0800bfb0 con 0x7f0d08004380 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0800c170 con 0x7f0d08005050 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1bfff640 1 -- 172.21.15.167:0/51425369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d08005050 msgr2=0x7f0d0800b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1b7fe640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003980 0x7f0d08003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1bfff640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d08005050 0x7f0d0800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d13fff640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d08004380 0x7f0d08004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1b7fe640 1 -- 172.21.15.167:0/51425369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d08005050 msgr2=0x7f0d0800b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1b7fe640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d08005050 0x7f0d0800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1b7fe640 1 -- 172.21.15.167:0/51425369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d08004380 msgr2=0x7f0d08004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:45:38.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1b7fe640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d08004380 0x7f0d08004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1bfff640 1 -- 172.21.15.167:0/51425369 reap_dead start 2023-11-28T20:45:38.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.255+0000 7f0d1b7fe640 1 -- 172.21.15.167:0/51425369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08003530 con 0x7f0d08003980 2023-11-28T20:45:38.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d1b7fe640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003980 0x7f0d08003d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00c210 tx=0x7f0d0c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a6e267761b2acf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0a5b10 con 0x7f0d08003980 2023-11-28T20:45:38.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c0a5c90 con 0x7f0d08003980 2023-11-28T20:45:38.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d1affd640 1 -- 172.21.15.167:0/51425369 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0058e0 con 0x7f0d08003980 2023-11-28T20:45:38.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d21cdd640 1 -- 172.21.15.167:0/51425369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003980 msgr2=0x7f0d08003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d21cdd640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003980 0x7f0d08003d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00c210 tx=0x7f0d0c01cc30 comp rx=0 tx=0).stop 2023-11-28T20:45:38.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d21cdd640 1 -- 172.21.15.167:0/51425369 shutdown_connections 2023-11-28T20:45:38.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d21cdd640 1 --2- 172.21.15.167:0/51425369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08003980 0x7f0d08003d60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d21cdd640 1 -- 172.21.15.167:0/51425369 >> 172.21.15.167:0/51425369 conn(0x7f0d1c0cb1e0 msgr2=0x7f0d1c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:38.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d21cdd640 1 -- 172.21.15.167:0/51425369 shutdown_connections 2023-11-28T20:45:38.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d21cdd640 1 -- 172.21.15.167:0/51425369 wait complete. 2023-11-28T20:45:38.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d21cdd640 1 Processor -- start 2023-11-28T20:45:38.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.259+0000 7f0d21cdd640 1 -- start start 2023-11-28T20:45:38.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d08003980 0x7f0d1c1f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1c0cab40 0x7f0d1c0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c150b60 0x7f0d1c1497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c151a70 con 0x7f0d1c150b60 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c1f30f0 con 0x7f0d08003980 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c1e3cb0 con 0x7f0d1c0cab40 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d13fff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1c0cab40 msgr2=0x7f0d1c0c8fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d13fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1c0cab40 0x7f0d1c0c8fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c150b60 0x7f0d1c1497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c150b60 0x7f0d1c1497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53360/0 (socket says 172.21.15.167:53360) 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1bfff640 1 -- 172.21.15.167:0/2005253593 learned_addr learned my addr 172.21.15.167:0/2005253593 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:38.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1b7fe640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d08003980 0x7f0d1c1f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1bfff640 1 -- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1c0cab40 msgr2=0x7f0d1c0c8fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1bfff640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d1c0cab40 0x7f0d1c0c8fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1bfff640 1 -- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d08003980 msgr2=0x7f0d1c1f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1bfff640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d08003980 0x7f0d1c1f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1bfff640 1 -- 172.21.15.167:0/2005253593 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c1e1ae0 con 0x7f0d1c150b60 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1bfff640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c150b60 0x7f0d1c1497d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0c5870 tx=0x7f0d1400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14005d50 con 0x7f0d1c150b60 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400a610 con 0x7f0d1c150b60 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400a9c0 con 0x7f0d1c150b60 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c1e3f10 con 0x7f0d1c150b60 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c1e44d0 con 0x7f0d1c150b60 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c1500b0 0x7f0d1c1f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c074770 con 0x7f0d1c1500b0 2023-11-28T20:45:38.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1b7fe640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c1500b0 0x7f0d1c1f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1b7fe640 1 -- 172.21.15.167:0/2005253593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d1c0c6e30 con 0x7f0d1c1500b0 2023-11-28T20:45:38.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d1400ab20 con 0x7f0d1c150b60 2023-11-28T20:45:38.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.263+0000 7f0d1b7fe640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c1500b0 0x7f0d1c1f2a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c001ec0 tx=0x7f0d0c0199d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d18ff9640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cfc066450 0x7f0cfc068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0d14083590 con 0x7f0d1c150b60 2023-11-28T20:45:38.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0b3070 con 0x7f0d1c1500b0 2023-11-28T20:45:38.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d13fff640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cfc066450 0x7f0cfc068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0d0c0b4040 con 0x7f0d1c1500b0 2023-11-28T20:45:38.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c1500b0 msgr2=0x7f0d1c1f2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d18ff9640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c1500b0 0x7f0d1c1f2a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c001ec0 tx=0x7f0d0c0199d0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c1500b0 msgr2=0x7f0d1c1f2a30 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:38.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d18ff9640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c1500b0 0x7f0d1c1f2a30 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c001ec0 tx=0x7f0d0c0199d0 comp rx=0 tx=0).stop 2023-11-28T20:45:38.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.267+0000 7f0d13fff640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cfc066450 0x7f0cfc068910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0c4550 tx=0x7f0d04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.271+0000 7f0d21cdd640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c140b30 0x7f0d1c140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:38.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.271+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c1f2f70 con 0x7f0d1c140b30 2023-11-28T20:45:38.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.271+0000 7f0d1b7fe640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c140b30 0x7f0d1c140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:38.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.271+0000 7f0d1b7fe640 1 -- 172.21.15.167:0/2005253593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0d1c0682c0 con 0x7f0d1c140b30 2023-11-28T20:45:38.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d1b7fe640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c140b30 0x7f0d1c140f40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c000c10 tx=0x7f0d08005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:38.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0077a0 con 0x7f0d1c140b30 2023-11-28T20:45:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5111 (secure 0 0 0) 0x7f0d0c0c1310 con 0x7f0d1c140b30 2023-11-28T20:45:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c140b30 msgr2=0x7f0d1c140f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d18ff9640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c140b30 0x7f0d1c140f40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c000c10 tx=0x7f0d08005800 comp rx=0 tx=0).stop 2023-11-28T20:45:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d18ff9640 1 -- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c140b30 msgr2=0x7f0d1c140f40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:45:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d18ff9640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d1c140b30 0x7f0d1c140f40 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c000c10 tx=0x7f0d08005800 comp rx=0 tx=0).stop 2023-11-28T20:45:38.278 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:45:38.278 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:38.278 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:38.278 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:45:38.278 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 64, 2023-11-28T20:45:38.278 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:45:38.278 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:45:38.278 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:45:38.278 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:38.279 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:38.280 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:45:38.281 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:45:38.282 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.283 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:38.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.286 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:45:38.288 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.289 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.290 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:45:38.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:45:38.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:45:38.293 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:45:38.293 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:45:38.293 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:45:38.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:45:38.293 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:45:38.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:45:38.293 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:45:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:45:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cfc066450 msgr2=0x7f0cfc068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d21cdd640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0cfc066450 0x7f0cfc068910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0c4550 tx=0x7f0d04008040 comp rx=0 tx=0).stop 2023-11-28T20:45:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c150b60 msgr2=0x7f0d1c1497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d21cdd640 1 --2- 172.21.15.167:0/2005253593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1c150b60 0x7f0d1c1497d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0c5870 tx=0x7f0d1400cb90 comp rx=0 tx=0).stop 2023-11-28T20:45:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d1bfff640 1 -- 172.21.15.167:0/2005253593 reap_dead start 2023-11-28T20:45:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d1bfff640 1 -- 172.21.15.167:0/2005253593 reap_dead start 2023-11-28T20:45:38.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 shutdown_connections 2023-11-28T20:45:38.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 >> 172.21.15.167:0/2005253593 conn(0x7f0d1c0cb1e0 msgr2=0x7f0d1c14d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:38.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 shutdown_connections 2023-11-28T20:45:38.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:38.275+0000 7f0d21cdd640 1 -- 172.21.15.167:0/2005253593 wait complete. 2023-11-28T20:45:38.296 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:45:38.296 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:45:47.277 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:47.281 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:58.297 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:45:58.297 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2023-11-28T20:45:58.298 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:45:58.298 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:45:58.301 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:45:58.301 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:45:58.301 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:45:58.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd829e640 1 Processor -- start 2023-11-28T20:45:58.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd829e640 1 -- start start 2023-11-28T20:45:58.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd829e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 0x7f8bd0066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:58.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd829e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8bd006d530 0x7f8bd006b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:58.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd829e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd00c8280 con 0x7f8bd015d3b0 2023-11-28T20:45:58.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd829e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd00c8910 con 0x7f8bd006d530 2023-11-28T20:45:58.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd829e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0066bc0 con 0x7f8bd00aff70 2023-11-28T20:45:58.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd603a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 0x7f8bd0066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:58.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd5839640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8bd006d530 0x7f8bd006b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:58.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd603a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 0x7f8bd0066680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:46560/0 (socket says 172.21.15.167:46560) 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd603a640 1 -- 172.21.15.167:0/1339224844 learned_addr learned my addr 172.21.15.167:0/1339224844 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd603a640 1 -- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 msgr2=0x7f8bd0066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd603a640 1 -- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 msgr2=0x7f8bd0066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd603a640 1 --2- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 0x7f8bd0066680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.451+0000 7f8bd603a640 1 --2- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 0x7f8bd0066680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.455+0000 7f8bd5839640 1 -- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 msgr2=0x7f8bd0066680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.455+0000 7f8bd5839640 1 --2- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 0x7f8bd0066680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.455+0000 7f8bd5839640 1 -- 172.21.15.167:0/1339224844 >> v1:172.21.15.167:6789/0 conn(0x7f8bd015d3b0 legacy=0x7f8bd00cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.455+0000 7f8bd5839640 1 -- 172.21.15.167:0/1339224844 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd00ca3b0 con 0x7f8bd006d530 2023-11-28T20:45:58.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.455+0000 7f8bd5038640 1 -- 172.21.15.167:0/1339224844 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437734702 0 0) 0x7f8bd00c8280 con 0x7f8bd015d3b0 2023-11-28T20:45:58.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.455+0000 7f8bd5839640 1 --2- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd006d530 0x7f8bd006b690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097c0 tx=0x7f8bc001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd6d0d500f59e0dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:58.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.455+0000 7f8bd5038640 1 -- 172.21.15.167:0/1339224844 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00ab650 con 0x7f8bd006d530 2023-11-28T20:45:58.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.455+0000 7f8bd5038640 1 -- 172.21.15.167:0/1339224844 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc00ab7b0 con 0x7f8bd006d530 2023-11-28T20:45:58.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.455+0000 7f8bd5038640 1 -- 172.21.15.167:0/1339224844 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00abb40 con 0x7f8bd006d530 2023-11-28T20:45:58.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 -- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd006d530 msgr2=0x7f8bd006b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:58.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 --2- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd006d530 0x7f8bd006b690 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097c0 tx=0x7f8bc001c450 comp rx=0 tx=0).stop 2023-11-28T20:45:58.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 -- 172.21.15.167:0/1339224844 shutdown_connections 2023-11-28T20:45:58.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 --2- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd006d530 0x7f8bd006b690 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:58.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 --2- 172.21.15.167:0/1339224844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd00aff70 0x7f8bd0066680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:58.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 -- 172.21.15.167:0/1339224844 >> 172.21.15.167:0/1339224844 conn(0x7f8bd006ee00 msgr2=0x7f8bd006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:58.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 -- 172.21.15.167:0/1339224844 shutdown_connections 2023-11-28T20:45:58.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 -- 172.21.15.167:0/1339224844 wait complete. 2023-11-28T20:45:58.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 Processor -- start 2023-11-28T20:45:58.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 -- start start 2023-11-28T20:45:58.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006d530 0x7f8bd014c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:58.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00aff70 0x7f8bd01f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd015d3b0 0x7f8bd00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00cd840 con 0x7f8bd00aff70 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00b0f70 con 0x7f8bd015d3b0 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd829e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01f2ab0 con 0x7f8bd006d530 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd5839640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00aff70 0x7f8bd01f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd603a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006d530 0x7f8bd014c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd5839640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00aff70 0x7f8bd01f34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48500/0 (socket says 172.21.15.167:48500) 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd5839640 1 -- 172.21.15.167:0/2595408323 learned_addr learned my addr 172.21.15.167:0/2595408323 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd683b640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd015d3b0 0x7f8bd00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd603a640 1 -- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006d530 msgr2=0x7f8bd014c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd603a640 1 -- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006d530 msgr2=0x7f8bd014c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:45:58.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd603a640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006d530 0x7f8bd014c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd603a640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006d530 0x7f8bd014c990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd5839640 1 -- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006d530 msgr2=0x7f8bd014c990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd5839640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006d530 0x7f8bd014c990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd5839640 1 -- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd015d3b0 msgr2=0x7f8bd00b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd5839640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd015d3b0 0x7f8bd00b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd5839640 1 -- 172.21.15.167:0/2595408323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009420 con 0x7f8bd00aff70 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.459+0000 7f8bd5839640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00aff70 0x7f8bd01f34c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00ad040 tx=0x7f8bc001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bc6ffd640 1 -- 172.21.15.167:0/2595408323 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00b5810 con 0x7f8bd00aff70 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bc6ffd640 1 -- 172.21.15.167:0/2595408323 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc00b5970 con 0x7f8bd00aff70 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd014ced0 con 0x7f8bd00aff70 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bc6ffd640 1 -- 172.21.15.167:0/2595408323 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00b5d20 con 0x7f8bd00aff70 2023-11-28T20:45:58.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd01f6e00 con 0x7f8bd00aff70 2023-11-28T20:45:58.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd0075c90 con 0x7f8bd00aff70 2023-11-28T20:45:58.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bc6ffd640 1 -- 172.21.15.167:0/2595408323 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8bc00bf410 con 0x7f8bd00aff70 2023-11-28T20:45:58.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bc6ffd640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bb40664a0 0x7f8bb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:45:58.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bc6ffd640 1 -- 172.21.15.167:0/2595408323 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8bc011f130 con 0x7f8bd00aff70 2023-11-28T20:45:58.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.463+0000 7f8bd603a640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bb40664a0 0x7f8bb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:45:58.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.467+0000 7f8bd603a640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bb40664a0 0x7f8bb4068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009100 tx=0x7f8bcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:45:58.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.467+0000 7f8bc6ffd640 1 -- 172.21.15.167:0/2595408323 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bc00ec260 con 0x7f8bd00aff70 2023-11-28T20:45:58.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.671+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8bd00b1150 con 0x7f8bd00aff70 2023-11-28T20:45:58.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.671+0000 7f8bc6ffd640 1 -- 172.21.15.167:0/2595408323 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f8bc00ef880 con 0x7f8bd00aff70 2023-11-28T20:45:58.674 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":64,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:45:58.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bb40664a0 msgr2=0x7f8bb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:58.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bb40664a0 0x7f8bb4068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009100 tx=0x7f8bcc008040 comp rx=0 tx=0).stop 2023-11-28T20:45:58.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00aff70 msgr2=0x7f8bd01f34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:45:58.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00aff70 0x7f8bd01f34c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00ad040 tx=0x7f8bc001ac90 comp rx=0 tx=0).stop 2023-11-28T20:45:58.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 shutdown_connections 2023-11-28T20:45:58.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bb40664a0 0x7f8bb4068960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:58.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd015d3b0 0x7f8bd00b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:58.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00aff70 0x7f8bd01f34c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:58.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 --2- 172.21.15.167:0/2595408323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006d530 0x7f8bd014c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:45:58.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 >> 172.21.15.167:0/2595408323 conn(0x7f8bd006ee00 msgr2=0x7f8bd006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:45:58.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 shutdown_connections 2023-11-28T20:45:58.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:45:58.675+0000 7f8bd829e640 1 -- 172.21.15.167:0/2595408323 wait complete. 2023-11-28T20:46:01.698 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:46:01.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.843+0000 7fd987432640 1 Processor -- start 2023-11-28T20:46:01.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.843+0000 7fd987432640 1 -- start start 2023-11-28T20:46:01.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd987432640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd9800c75c0 0x7fd9800c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd987432640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd98006a580 0x7fd98006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd987432640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9800c7a50 con 0x7fd980151f60 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd987432640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98006aed0 con 0x7fd9800c75c0 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd987432640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9800c4da0 con 0x7fd98006a580 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd9849cd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd9800c75c0 0x7fd9800c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd9851ce640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd980151f60 0x7fd9800c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37194/0 (socket says 172.21.15.167:37194) 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd9851ce640 1 -- 172.21.15.167:0/2048171577 learned_addr learned my addr 172.21.15.167:0/2048171577 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd9859cf640 1 --2- 172.21.15.167:0/2048171577 >> v2:172.21.15.178:3300/0 conn(0x7fd98006a580 0x7fd98006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd9849cd640 1 -- 172.21.15.167:0/2048171577 >> v2:172.21.15.178:3300/0 conn(0x7fd98006a580 msgr2=0x7fd98006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd9849cd640 1 --2- 172.21.15.167:0/2048171577 >> v2:172.21.15.178:3300/0 conn(0x7fd98006a580 0x7fd98006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:01.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd9849cd640 1 -- 172.21.15.167:0/2048171577 >> v1:172.21.15.167:6789/0 conn(0x7fd980151f60 legacy=0x7fd9800c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:01.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd9849cd640 1 -- 172.21.15.167:0/2048171577 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98015b220 con 0x7fd9800c75c0 2023-11-28T20:46:01.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.847+0000 7fd9849cd640 1 --2- 172.21.15.167:0/2048171577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 0x7fd9800c5c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd9800c5580 tx=0x7fd97001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4ab2a9b1071007 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:01.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd977fff640 1 -- 172.21.15.167:0/2048171577 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700ab600 con 0x7fd9800c75c0 2023-11-28T20:46:01.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd977fff640 1 -- 172.21.15.167:0/2048171577 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9700a7050 con 0x7fd9800c75c0 2023-11-28T20:46:01.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd977fff640 1 -- 172.21.15.167:0/2048171577 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700ab980 con 0x7fd9800c75c0 2023-11-28T20:46:01.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 -- 172.21.15.167:0/2048171577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 msgr2=0x7fd9800c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:01.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 --2- 172.21.15.167:0/2048171577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 0x7fd9800c5c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd9800c5580 tx=0x7fd97001c3d0 comp rx=0 tx=0).stop 2023-11-28T20:46:01.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 -- 172.21.15.167:0/2048171577 shutdown_connections 2023-11-28T20:46:01.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 --2- 172.21.15.167:0/2048171577 >> v2:172.21.15.178:3300/0 conn(0x7fd98006a580 0x7fd98006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:01.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 --2- 172.21.15.167:0/2048171577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 0x7fd9800c5c90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:01.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 -- 172.21.15.167:0/2048171577 >> 172.21.15.167:0/2048171577 conn(0x7fd9800cb1e0 msgr2=0x7fd9800cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:01.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 -- 172.21.15.167:0/2048171577 shutdown_connections 2023-11-28T20:46:01.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 -- 172.21.15.167:0/2048171577 wait complete. 2023-11-28T20:46:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 Processor -- start 2023-11-28T20:46:01.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 -- start start 2023-11-28T20:46:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd98006a580 0x7fd980155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 0x7fd9801f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd980151f60 0x7fd9801f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd980143560 con 0x7fd9800c75c0 2023-11-28T20:46:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98013e820 con 0x7fd980151f60 2023-11-28T20:46:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd987432640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd980142f50 con 0x7fd98006a580 2023-11-28T20:46:01.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd9849cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 0x7fd9801f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd9849cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 0x7fd9801f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48522/0 (socket says 172.21.15.167:48522) 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.851+0000 7fd9849cd640 1 -- 172.21.15.167:0/3803880306 learned_addr learned my addr 172.21.15.167:0/3803880306 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd9859cf640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd980151f60 0x7fd9801f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd9851ce640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd98006a580 0x7fd980155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd9849cd640 1 -- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd98006a580 msgr2=0x7fd980155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd9849cd640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd98006a580 0x7fd980155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd9849cd640 1 -- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd980151f60 msgr2=0x7fd9801f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd9849cd640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd980151f60 0x7fd9801f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd9849cd640 1 -- 172.21.15.167:0/3803880306 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970009420 con 0x7fd9800c75c0 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd9849cd640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 0x7fd9801f40d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9700ae040 tx=0x7fd970019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:01.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd975ffb640 1 -- 172.21.15.167:0/3803880306 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700b4430 con 0x7fd9800c75c0 2023-11-28T20:46:01.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd975ffb640 1 -- 172.21.15.167:0/3803880306 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9700b45b0 con 0x7fd9800c75c0 2023-11-28T20:46:01.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9800ca240 con 0x7fd9800c75c0 2023-11-28T20:46:01.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd975ffb640 1 -- 172.21.15.167:0/3803880306 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700b4960 con 0x7fd9800c75c0 2023-11-28T20:46:01.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9801431f0 con 0x7fd9800c75c0 2023-11-28T20:46:01.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9800682c0 con 0x7fd9800c75c0 2023-11-28T20:46:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd975ffb640 1 -- 172.21.15.167:0/3803880306 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd9700b2040 con 0x7fd9800c75c0 2023-11-28T20:46:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.855+0000 7fd975ffb640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd964066470 0x7fd964068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.859+0000 7fd975ffb640 1 -- 172.21.15.167:0/3803880306 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd97011e170 con 0x7fd9800c75c0 2023-11-28T20:46:01.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.859+0000 7fd9851ce640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd964066470 0x7fd964068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:01.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.859+0000 7fd9851ce640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd964066470 0x7fd964068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd97c005890 tx=0x7fd97c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:01.863+0000 7fd975ffb640 1 -- 172.21.15.167:0/3803880306 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9700eb1f0 con 0x7fd9800c75c0 2023-11-28T20:46:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.063+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd980075c90 con 0x7fd9800c75c0 2023-11-28T20:46:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd975ffb640 1 -- 172.21.15.167:0/3803880306 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fd9700ee810 con 0x7fd9800c75c0 2023-11-28T20:46:02.068 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":64,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:46:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd964066470 msgr2=0x7fd964068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd964066470 0x7fd964068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd97c005890 tx=0x7fd97c009040 comp rx=0 tx=0).stop 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 msgr2=0x7fd9801f40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 0x7fd9801f40d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9700ae040 tx=0x7fd970019170 comp rx=0 tx=0).stop 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 shutdown_connections 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd964066470 0x7fd964068930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd980151f60 0x7fd9801f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9800c75c0 0x7fd9801f40d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 --2- 172.21.15.167:0/3803880306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd98006a580 0x7fd980155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 >> 172.21.15.167:0/3803880306 conn(0x7fd9800cb1e0 msgr2=0x7fd980157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 shutdown_connections 2023-11-28T20:46:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:02.067+0000 7fd987432640 1 -- 172.21.15.167:0/3803880306 wait complete. 2023-11-28T20:46:05.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:46:05.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff550f57640 1 Processor -- start 2023-11-28T20:46:05.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff550f57640 1 -- start start 2023-11-28T20:46:05.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff550f57640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff54c0cfc40 0x7ff54c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff550f57640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff54c153ae0 0x7ff54c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff550f57640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54c15ac00 con 0x7ff54c0cf860 2023-11-28T20:46:05.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff550f57640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c0cbd60 con 0x7ff54c153ae0 2023-11-28T20:46:05.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff550f57640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c159ff0 con 0x7ff54c0cfc40 2023-11-28T20:46:05.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff54ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff54c153ae0 0x7ff54c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff54ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff54c153ae0 0x7ff54c153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53434/0 (socket says 172.21.15.167:53434) 2023-11-28T20:46:05.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff54ad9d640 1 -- 172.21.15.167:0/2134389872 learned_addr learned my addr 172.21.15.167:0/2134389872 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:05.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff541d9b640 1 --2- 172.21.15.167:0/2134389872 >> v2:172.21.15.178:3300/0 conn(0x7ff54c0cfc40 0x7ff54c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff54ad9d640 1 -- 172.21.15.167:0/2134389872 >> v2:172.21.15.178:3300/0 conn(0x7ff54c0cfc40 msgr2=0x7ff54c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:05.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff54ad9d640 1 --2- 172.21.15.167:0/2134389872 >> v2:172.21.15.178:3300/0 conn(0x7ff54c0cfc40 0x7ff54c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff54ad9d640 1 -- 172.21.15.167:0/2134389872 >> v1:172.21.15.178:6789/0 conn(0x7ff54c0cf860 legacy=0x7ff54c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.227+0000 7ff54ad9d640 1 -- 172.21.15.167:0/2134389872 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c15a2d0 con 0x7ff54c153ae0 2023-11-28T20:46:05.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff54ad9d640 1 --2- 172.21.15.167:0/2134389872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 0x7ff54c153f50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0c9c50 tx=0x7ff54401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5723972866a79d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff549d9b640 1 -- 172.21.15.167:0/2134389872 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440aa660 con 0x7ff54c153ae0 2023-11-28T20:46:05.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff549d9b640 1 -- 172.21.15.167:0/2134389872 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5440aa7c0 con 0x7ff54c153ae0 2023-11-28T20:46:05.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff549d9b640 1 -- 172.21.15.167:0/2134389872 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440aab50 con 0x7ff54c153ae0 2023-11-28T20:46:05.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff550f57640 1 -- 172.21.15.167:0/2134389872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 msgr2=0x7ff54c153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff550f57640 1 --2- 172.21.15.167:0/2134389872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 0x7ff54c153f50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0c9c50 tx=0x7ff54401c500 comp rx=0 tx=0).stop 2023-11-28T20:46:05.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff550f57640 1 -- 172.21.15.167:0/2134389872 shutdown_connections 2023-11-28T20:46:05.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff550f57640 1 --2- 172.21.15.167:0/2134389872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 0x7ff54c153f50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff550f57640 1 --2- 172.21.15.167:0/2134389872 >> v2:172.21.15.178:3300/0 conn(0x7ff54c0cfc40 0x7ff54c0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff550f57640 1 -- 172.21.15.167:0/2134389872 >> 172.21.15.167:0/2134389872 conn(0x7ff54c06c1f0 msgr2=0x7ff54c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:05.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff550f57640 1 -- 172.21.15.167:0/2134389872 shutdown_connections 2023-11-28T20:46:05.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.231+0000 7ff550f57640 1 -- 172.21.15.167:0/2134389872 wait complete. 2023-11-28T20:46:05.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 Processor -- start 2023-11-28T20:46:05.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 -- start start 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff54c0cf860 0x7ff54c0ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff54c0cfc40 0x7ff54c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 0x7ff54c1f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c0b55e0 con 0x7ff54c153ae0 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c0b4a80 con 0x7ff54c0cfc40 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c0b4d40 con 0x7ff54c0cf860 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 0x7ff54c1f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 0x7ff54c1f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53440/0 (socket says 172.21.15.167:53440) 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54ad9d640 1 -- 172.21.15.167:0/834820953 learned_addr learned my addr 172.21.15.167:0/834820953 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:05.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff541d9b640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff54c0cfc40 0x7ff54c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54a59c640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff54c0cf860 0x7ff54c0ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54a59c640 1 -- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff54c0cf860 msgr2=0x7ff54c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54a59c640 1 -- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff54c0cf860 msgr2=0x7ff54c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54a59c640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff54c0cf860 0x7ff54c0ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54ad9d640 1 -- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff54c0cf860 msgr2=0x7ff54c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54a59c640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff54c0cf860 0x7ff54c0ced90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54ad9d640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff54c0cf860 0x7ff54c0ced90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54ad9d640 1 -- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff54c0cfc40 msgr2=0x7ff54c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54ad9d640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff54c0cfc40 0x7ff54c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54ad9d640 1 -- 172.21.15.167:0/834820953 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440094d0 con 0x7ff54c153ae0 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff54ad9d640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 0x7ff54c1f2ff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff5440ac040 tx=0x7ff54401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff5437fe640 1 -- 172.21.15.167:0/834820953 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440bd3f0 con 0x7ff54c153ae0 2023-11-28T20:46:05.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff5437fe640 1 -- 172.21.15.167:0/834820953 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5440bd550 con 0x7ff54c153ae0 2023-11-28T20:46:05.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff5437fe640 1 -- 172.21.15.167:0/834820953 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5440bd900 con 0x7ff54c153ae0 2023-11-28T20:46:05.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c0b5020 con 0x7ff54c153ae0 2023-11-28T20:46:05.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.235+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c1f2ad0 con 0x7ff54c153ae0 2023-11-28T20:46:05.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.239+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c1f2930 con 0x7ff54c153ae0 2023-11-28T20:46:05.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.239+0000 7ff5437fe640 1 -- 172.21.15.167:0/834820953 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5440b33f0 con 0x7ff54c153ae0 2023-11-28T20:46:05.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.239+0000 7ff5437fe640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff52c066470 0x7ff52c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.239+0000 7ff5437fe640 1 -- 172.21.15.167:0/834820953 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff5440a6040 con 0x7ff54c153ae0 2023-11-28T20:46:05.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.239+0000 7ff54a59c640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff52c066470 0x7ff52c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.239+0000 7ff54a59c640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff52c066470 0x7ff52c068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff53c000f70 tx=0x7ff53c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.243+0000 7ff5437fe640 1 -- 172.21.15.167:0/834820953 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff54c1f2930 con 0x7ff54c153ae0 2023-11-28T20:46:05.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff54c1f2930 con 0x7ff54c153ae0 2023-11-28T20:46:05.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff5437fe640 1 -- 172.21.15.167:0/834820953 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7ff54c1f2930 con 0x7ff54c153ae0 2023-11-28T20:46:05.449 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:46:05.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff52c066470 msgr2=0x7ff52c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff52c066470 0x7ff52c068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff53c000f70 tx=0x7ff53c009040 comp rx=0 tx=0).stop 2023-11-28T20:46:05.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 msgr2=0x7ff54c1f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 0x7ff54c1f2ff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff5440ac040 tx=0x7ff54401ad40 comp rx=0 tx=0).stop 2023-11-28T20:46:05.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 shutdown_connections 2023-11-28T20:46:05.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff52c066470 0x7ff52c068930 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c153ae0 0x7ff54c1f2ff0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff54c0cfc40 0x7ff54c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 --2- 172.21.15.167:0/834820953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff54c0cf860 0x7ff54c0ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 >> 172.21.15.167:0/834820953 conn(0x7ff54c06c1f0 msgr2=0x7ff54c152640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:05.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 shutdown_connections 2023-11-28T20:46:05.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.447+0000 7ff550f57640 1 -- 172.21.15.167:0/834820953 wait complete. 2023-11-28T20:46:05.469 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:46:05.470 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:46:05.470 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:46:05.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e852a640 1 Processor -- start 2023-11-28T20:46:05.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e852a640 1 -- start start 2023-11-28T20:46:05.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e852a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13e0151f60 0x7f13e00c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e852a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f13e00c5c90 0x7f13e00c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e852a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e006a580 0x7f13e006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e852a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e006aed0 con 0x7f13e00c5c90 2023-11-28T20:46:05.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e852a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e00c4da0 con 0x7f13e0151f60 2023-11-28T20:46:05.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e852a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00c6120 con 0x7f13e006a580 2023-11-28T20:46:05.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e5ac5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f13e00c5c90 0x7f13e00c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e5ac5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f13e00c5c90 0x7f13e00c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53450/0 (socket says 172.21.15.167:53450) 2023-11-28T20:46:05.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e5ac5640 1 -- 172.21.15.167:0/278665110 learned_addr learned my addr 172.21.15.167:0/278665110 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:05.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e62c6640 1 --2- 172.21.15.167:0/278665110 >> v2:172.21.15.178:3300/0 conn(0x7f13e0151f60 0x7f13e00c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.607+0000 7f13e6ac7640 1 --2- 172.21.15.167:0/278665110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e006a580 0x7f13e006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e5ac5640 1 -- 172.21.15.167:0/278665110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e006a580 msgr2=0x7f13e006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:05.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e5ac5640 1 --2- 172.21.15.167:0/278665110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e006a580 0x7f13e006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e5ac5640 1 -- 172.21.15.167:0/278665110 >> v2:172.21.15.178:3300/0 conn(0x7f13e0151f60 msgr2=0x7f13e00c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:05.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e5ac5640 1 --2- 172.21.15.167:0/278665110 >> v2:172.21.15.178:3300/0 conn(0x7f13e0151f60 0x7f13e00c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e5ac5640 1 -- 172.21.15.167:0/278665110 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e015b220 con 0x7f13e00c5c90 2023-11-28T20:46:05.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e62c6640 1 --2- 172.21.15.167:0/278665110 >> v2:172.21.15.178:3300/0 conn(0x7f13e0151f60 0x7f13e00c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:46:05.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e5ac5640 1 --2- 172.21.15.167:0/278665110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00c5c90 0x7f13e00c26e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f13e00c62c0 tx=0x7f13d001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534d1fb70b872bf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e52c4640 1 -- 172.21.15.167:0/278665110 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d00ab600 con 0x7f13e00c5c90 2023-11-28T20:46:05.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e52c4640 1 -- 172.21.15.167:0/278665110 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d00a7050 con 0x7f13e00c5c90 2023-11-28T20:46:05.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e52c4640 1 -- 172.21.15.167:0/278665110 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d00ab980 con 0x7f13e00c5c90 2023-11-28T20:46:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e852a640 1 -- 172.21.15.167:0/278665110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00c5c90 msgr2=0x7f13e00c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.611+0000 7f13e852a640 1 --2- 172.21.15.167:0/278665110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00c5c90 0x7f13e00c26e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f13e00c62c0 tx=0x7f13d001c470 comp rx=0 tx=0).stop 2023-11-28T20:46:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 -- 172.21.15.167:0/278665110 shutdown_connections 2023-11-28T20:46:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 --2- 172.21.15.167:0/278665110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e006a580 0x7f13e006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 --2- 172.21.15.167:0/278665110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00c5c90 0x7f13e00c26e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 --2- 172.21.15.167:0/278665110 >> v2:172.21.15.178:3300/0 conn(0x7f13e0151f60 0x7f13e00c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 -- 172.21.15.167:0/278665110 >> 172.21.15.167:0/278665110 conn(0x7f13e00cb1e0 msgr2=0x7f13e00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 -- 172.21.15.167:0/278665110 shutdown_connections 2023-11-28T20:46:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 -- 172.21.15.167:0/278665110 wait complete. 2023-11-28T20:46:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 Processor -- start 2023-11-28T20:46:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 -- start start 2023-11-28T20:46:05.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e006a580 0x7f13e0147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c5c90 0x7f13e0148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0151f60 0x7f13e01f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e015aa00 con 0x7f13e0151f60 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e015abe0 con 0x7f13e006a580 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e852a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e01f5d60 con 0x7f13e00c5c90 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e6ac7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0151f60 0x7f13e01f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e62c6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e006a580 0x7f13e0147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e6ac7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0151f60 0x7f13e01f6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53462/0 (socket says 172.21.15.167:53462) 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e6ac7640 1 -- 172.21.15.167:0/865855084 learned_addr learned my addr 172.21.15.167:0/865855084 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e62c6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e006a580 0x7f13e0147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:46668/0 (socket says 172.21.15.167:46668) 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e5ac5640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c5c90 0x7f13e0148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e5ac5640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c5c90 msgr2=0x7f13e0148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:46:05.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e5ac5640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c5c90 msgr2=0x7f13e0148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:46:05.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e5ac5640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c5c90 0x7f13e0148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:05.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e5ac5640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c5c90 0x7f13e0148280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:05.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e6ac7640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c5c90 msgr2=0x7f13e0148280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:46:05.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e6ac7640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c5c90 0x7f13e0148280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e6ac7640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e006a580 msgr2=0x7f13e0147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e6ac7640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e006a580 0x7f13e0147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e6ac7640 1 -- 172.21.15.167:0/865855084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00094d0 con 0x7f13e0151f60 2023-11-28T20:46:05.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13e6ac7640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0151f60 0x7f13e01f6240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007e60 tx=0x7f13d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.615+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8014620 con 0x7f13e0151f60 2023-11-28T20:46:05.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d800ee90 con 0x7f13e0151f60 2023-11-28T20:46:05.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d80149e0 con 0x7f13e0151f60 2023-11-28T20:46:05.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e015c0d0 con 0x7f13e0151f60 2023-11-28T20:46:05.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e0157840 con 0x7f13e0151f60 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13e852a640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0155a60 0x7f13e01f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0074770 con 0x7f13e0155a60 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13e62c6640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0155a60 0x7f13e01f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13e62c6640 1 -- 172.21.15.167:0/865855084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13e015bf50 con 0x7f13e0155a60 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13e62c6640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0155a60 0x7f13e01f6780 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00b760 tx=0x7f13dc00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0108a0 con 0x7f13e0155a60 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f13dc010a00 con 0x7f13e0155a60 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0155a60 msgr2=0x7f13e01f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0155a60 0x7f13e01f6780 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00b760 tx=0x7f13dc00bc20 comp rx=0 tx=0).stop 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0155a60 msgr2=0x7f13e01f6780 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:05.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0155a60 0x7f13e01f6780 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00b760 tx=0x7f13dc00bc20 comp rx=0 tx=0).stop 2023-11-28T20:46:05.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13d8014b40 con 0x7f13e0151f60 2023-11-28T20:46:05.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13c40661f0 0x7f13c40686b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f13d8084ba0 con 0x7f13e0151f60 2023-11-28T20:46:05.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.619+0000 7f13e62c6640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13c40661f0 0x7f13c40686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.623+0000 7f13e62c6640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13c40661f0 0x7f13c40686b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f13dc000c10 tx=0x7f13dc01f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0160f50 0x7f13e0161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e015ba30 con 0x7f13e0160f50 2023-11-28T20:46:05.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e5ac5640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0160f50 0x7f13e0161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e5ac5640 1 -- 172.21.15.167:0/865855084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f13e00682c0 con 0x7f13e0160f50 2023-11-28T20:46:05.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e5ac5640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0160f50 0x7f13e0161330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13e00c8d80 tx=0x7f13d0019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d00b4640 con 0x7f13e0160f50 2023-11-28T20:46:05.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4981 (secure 0 0 0) 0x7f13d00b47a0 con 0x7f13e0160f50 2023-11-28T20:46:05.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0160f50 msgr2=0x7f13e0161330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13d6ffd640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0160f50 0x7f13e0161330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13e00c8d80 tx=0x7f13d0019210 comp rx=0 tx=0).stop 2023-11-28T20:46:05.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13d6ffd640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0160f50 msgr2=0x7f13e0161330 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:05.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13d6ffd640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0160f50 0x7f13e0161330 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13e00c8d80 tx=0x7f13d0019210 comp rx=0 tx=0).stop 2023-11-28T20:46:05.631 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:46:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:05.631 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 66, 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:46:05.632 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:46:05.633 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:05.634 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:46:05.635 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:05.636 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:05.637 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:05.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.641 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:46:05.642 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.643 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.644 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.645 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:46:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.646 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:46:05.646 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:46:05.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13c40661f0 msgr2=0x7f13c40686b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13c40661f0 0x7f13c40686b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f13dc000c10 tx=0x7f13dc01f040 comp rx=0 tx=0).stop 2023-11-28T20:46:05.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0151f60 msgr2=0x7f13e01f6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 --2- 172.21.15.167:0/865855084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0151f60 0x7f13e01f6240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007e60 tx=0x7f13d800e4b0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e6ac7640 1 -- 172.21.15.167:0/865855084 reap_dead start 2023-11-28T20:46:05.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e6ac7640 1 -- 172.21.15.167:0/865855084 reap_dead start 2023-11-28T20:46:05.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 shutdown_connections 2023-11-28T20:46:05.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 >> 172.21.15.167:0/865855084 conn(0x7f13e00cb1e0 msgr2=0x7f13e00cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:05.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 shutdown_connections 2023-11-28T20:46:05.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.627+0000 7f13e852a640 1 -- 172.21.15.167:0/865855084 wait complete. 2023-11-28T20:46:05.651 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:46:05.651 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:46:05.652 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:46:05.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee88316640 1 Processor -- start 2023-11-28T20:46:05.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee88316640 1 -- start start 2023-11-28T20:46:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee88316640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fee80150b40 0x7fee80157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee88316640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee800c6ff0 0x7fee800c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee88316640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee800c5be0 0x7fee8006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee88316640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee800c6ac0 con 0x7fee80150b40 2023-11-28T20:46:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee88316640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee800c6500 con 0x7fee800c6ff0 2023-11-28T20:46:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee88316640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee800c67e0 con 0x7fee800c5be0 2023-11-28T20:46:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee860b2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fee80150b40 0x7fee80157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee860b2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fee80150b40 0x7fee80157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53486/0 (socket says 172.21.15.167:53486) 2023-11-28T20:46:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee858b1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee800c6ff0 0x7fee800c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee860b2640 1 -- 172.21.15.167:0/4069818869 learned_addr learned my addr 172.21.15.167:0/4069818869 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee868b3640 1 --2- 172.21.15.167:0/4069818869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee800c5be0 0x7fee8006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee860b2640 1 -- 172.21.15.167:0/4069818869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee800c5be0 msgr2=0x7fee8006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee860b2640 1 --2- 172.21.15.167:0/4069818869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee800c5be0 0x7fee8006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee860b2640 1 -- 172.21.15.167:0/4069818869 >> v2:172.21.15.178:3300/0 conn(0x7fee800c6ff0 msgr2=0x7fee800c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee860b2640 1 --2- 172.21.15.167:0/4069818869 >> v2:172.21.15.178:3300/0 conn(0x7fee800c6ff0 0x7fee800c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.815+0000 7fee860b2640 1 -- 172.21.15.167:0/4069818869 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80156a80 con 0x7fee80150b40 2023-11-28T20:46:05.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee860b2640 1 --2- 172.21.15.167:0/4069818869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee80150b40 0x7fee80157560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fee8006bba0 tx=0x7fee7c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad8fe160cbff76 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee850b0640 1 -- 172.21.15.167:0/4069818869 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0aa5f0 con 0x7fee80150b40 2023-11-28T20:46:05.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee850b0640 1 -- 172.21.15.167:0/4069818869 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c0aa750 con 0x7fee80150b40 2023-11-28T20:46:05.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee850b0640 1 -- 172.21.15.167:0/4069818869 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0aaae0 con 0x7fee80150b40 2023-11-28T20:46:05.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee88316640 1 -- 172.21.15.167:0/4069818869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee80150b40 msgr2=0x7fee80157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee88316640 1 --2- 172.21.15.167:0/4069818869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee80150b40 0x7fee80157560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fee8006bba0 tx=0x7fee7c01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee88316640 1 -- 172.21.15.167:0/4069818869 shutdown_connections 2023-11-28T20:46:05.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee88316640 1 --2- 172.21.15.167:0/4069818869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee800c5be0 0x7fee8006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee88316640 1 --2- 172.21.15.167:0/4069818869 >> v2:172.21.15.178:3300/0 conn(0x7fee800c6ff0 0x7fee800c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee88316640 1 --2- 172.21.15.167:0/4069818869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee80150b40 0x7fee80157560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee88316640 1 -- 172.21.15.167:0/4069818869 >> 172.21.15.167:0/4069818869 conn(0x7fee800cb1e0 msgr2=0x7fee800cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:05.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee88316640 1 -- 172.21.15.167:0/4069818869 shutdown_connections 2023-11-28T20:46:05.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.819+0000 7fee88316640 1 -- 172.21.15.167:0/4069818869 wait complete. 2023-11-28T20:46:05.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 Processor -- start 2023-11-28T20:46:05.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 -- start start 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee800c5be0 0x7fee800ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee800c6ff0 0x7fee80149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee80150b40 0x7fee80149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80163d10 con 0x7fee800c6ff0 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee801645b0 con 0x7fee800c5be0 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee800cbab0 con 0x7fee80150b40 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee858b1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee800c6ff0 0x7fee80149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee858b1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee800c6ff0 0x7fee80149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53500/0 (socket says 172.21.15.167:53500) 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee858b1640 1 -- 172.21.15.167:0/3787623085 learned_addr learned my addr 172.21.15.167:0/3787623085 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee860b2640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee800c5be0 0x7fee800ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee868b3640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee80150b40 0x7fee80149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee858b1640 1 -- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee80150b40 msgr2=0x7fee80149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee858b1640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee80150b40 0x7fee80149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee858b1640 1 -- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee800c5be0 msgr2=0x7fee800ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee858b1640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee800c5be0 0x7fee800ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee858b1640 1 -- 172.21.15.167:0/3787623085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0094d0 con 0x7fee800c6ff0 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee860b2640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee800c5be0 0x7fee800ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee858b1640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee800c6ff0 0x7fee80149650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fee7000e960 tx=0x7fee7000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70009690 con 0x7fee800c6ff0 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000c9a0 con 0x7fee800c6ff0 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee80160ea0 con 0x7fee800c6ff0 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000cd10 con 0x7fee800c6ff0 2023-11-28T20:46:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee80165140 con 0x7fee800c6ff0 2023-11-28T20:46:05.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80148b20 0x7fee80163ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.823+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80074770 con 0x7fee80148b20 2023-11-28T20:46:05.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee860b2640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80148b20 0x7fee80163ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee860b2640 1 -- 172.21.15.167:0/3787623085 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee8015a770 con 0x7fee80148b20 2023-11-28T20:46:05.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee70013470 con 0x7fee800c6ff0 2023-11-28T20:46:05.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee860b2640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80148b20 0x7fee80163ec0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fee800cc090 tx=0x7fee7c019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee76ffd640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fee640664a0 0x7fee64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fee700847a0 con 0x7fee800c6ff0 2023-11-28T20:46:05.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0aad90 con 0x7fee80148b20 2023-11-28T20:46:05.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee868b3640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fee640664a0 0x7fee64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fee7c0b33f0 con 0x7fee80148b20 2023-11-28T20:46:05.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80148b20 msgr2=0x7fee80163ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee76ffd640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80148b20 0x7fee80163ec0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fee800cc090 tx=0x7fee7c019270 comp rx=0 tx=0).stop 2023-11-28T20:46:05.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80148b20 msgr2=0x7fee80163ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:05.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee76ffd640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80148b20 0x7fee80163ec0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fee800cc090 tx=0x7fee7c019270 comp rx=0 tx=0).stop 2023-11-28T20:46:05.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.827+0000 7fee868b3640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fee640664a0 0x7fee64068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee78009f80 tx=0x7fee7800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.835+0000 7fee88316640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80156540 0x7fee801f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:05.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.835+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80148910 con 0x7fee80156540 2023-11-28T20:46:05.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.835+0000 7fee860b2640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80156540 0x7fee801f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:05.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.835+0000 7fee860b2640 1 -- 172.21.15.167:0/3787623085 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fee800682c0 con 0x7fee80156540 2023-11-28T20:46:05.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.835+0000 7fee860b2640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80156540 0x7fee801f5940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee7c01ab80 tx=0x7fee7c009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:05.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.835+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0c42b0 con 0x7fee80156540 2023-11-28T20:46:05.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5122 (secure 0 0 0) 0x7fee7c003db0 con 0x7fee80156540 2023-11-28T20:46:05.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80156540 msgr2=0x7fee801f5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee76ffd640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80156540 0x7fee801f5940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee7c01ab80 tx=0x7fee7c009240 comp rx=0 tx=0).stop 2023-11-28T20:46:05.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee76ffd640 1 -- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80156540 msgr2=0x7fee801f5940 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:05.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee76ffd640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee80156540 0x7fee801f5940 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fee7c01ab80 tx=0x7fee7c009240 comp rx=0 tx=0).stop 2023-11-28T20:46:05.840 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 66, 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:05.841 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:05.842 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:05.843 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:46:05.844 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:05.845 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:05.846 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.847 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:05.848 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.849 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:05.850 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:05.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.853 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.855 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:46:05.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.857 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:05.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:05.859 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:46:05.859 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:46:05.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fee640664a0 msgr2=0x7fee64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee88316640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fee640664a0 0x7fee64068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee78009f80 tx=0x7fee7800b040 comp rx=0 tx=0).stop 2023-11-28T20:46:05.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee800c6ff0 msgr2=0x7fee80149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:05.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee88316640 1 --2- 172.21.15.167:0/3787623085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee800c6ff0 0x7fee80149650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fee7000e960 tx=0x7fee7000ee20 comp rx=0 tx=0).stop 2023-11-28T20:46:05.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee868b3640 1 -- 172.21.15.167:0/3787623085 reap_dead start 2023-11-28T20:46:05.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee868b3640 1 -- 172.21.15.167:0/3787623085 reap_dead start 2023-11-28T20:46:05.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 shutdown_connections 2023-11-28T20:46:05.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 >> 172.21.15.167:0/3787623085 conn(0x7fee800cb1e0 msgr2=0x7fee800c7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:05.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 shutdown_connections 2023-11-28T20:46:05.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.839+0000 7fee88316640 1 -- 172.21.15.167:0/3787623085 wait complete. 2023-11-28T20:46:05.861 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:46:05.861 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:46:05.862 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:46:06.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.999+0000 7f907c4fd640 1 Processor -- start 2023-11-28T20:46:06.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.999+0000 7f907c4fd640 1 -- start start 2023-11-28T20:46:06.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.999+0000 7f907c4fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90740c6ff0 0x7f9074157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:06.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.999+0000 7f907c4fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f90740c4510 0x7f907406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:06.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.999+0000 7f907c4fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740c48f0 con 0x7f9074150b40 2023-11-28T20:46:06.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.999+0000 7f907c4fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90740c62f0 con 0x7f90740c4510 2023-11-28T20:46:06.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:05.999+0000 7f907c4fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90740c6ac0 con 0x7f90740c6ff0 2023-11-28T20:46:06.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f907a299640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9074150b40 0x7f90740c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55000/0 (socket says 172.21.15.167:55000) 2023-11-28T20:46:06.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f907a299640 1 -- 172.21.15.167:0/291827427 learned_addr learned my addr 172.21.15.167:0/291827427 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:06.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f907aa9a640 1 --2- 172.21.15.167:0/291827427 >> v2:172.21.15.167:3300/0 conn(0x7f90740c4510 0x7f907406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:06.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f9079a98640 1 --2- 172.21.15.167:0/291827427 >> v2:172.21.15.178:3300/0 conn(0x7f90740c6ff0 0x7f9074157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:06.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f9079297640 1 -- 172.21.15.167:0/291827427 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186172869 0 0) 0x7f90740c48f0 con 0x7f9074150b40 2023-11-28T20:46:06.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f9079297640 1 -- 172.21.15.167:0/291827427 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9060003530 con 0x7f9074150b40 2023-11-28T20:46:06.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f907aa9a640 1 -- 172.21.15.167:0/291827427 >> v2:172.21.15.178:3300/0 conn(0x7f90740c6ff0 msgr2=0x7f9074157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:06.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f907aa9a640 1 --2- 172.21.15.167:0/291827427 >> v2:172.21.15.178:3300/0 conn(0x7f90740c6ff0 0x7f9074157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:06.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f907aa9a640 1 -- 172.21.15.167:0/291827427 >> v1:172.21.15.167:6789/0 conn(0x7f9074150b40 legacy=0x7f90740c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:06.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f907aa9a640 1 -- 172.21.15.167:0/291827427 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740c6500 con 0x7f90740c4510 2023-11-28T20:46:06.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f907aa9a640 1 --2- 172.21.15.167:0/291827427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90740c4510 0x7f907406a580 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f907406bba0 tx=0x7f906c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aebf0d9a474a14a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:06.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f9079297640 1 -- 172.21.15.167:0/291827427 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0a58b0 con 0x7f90740c4510 2023-11-28T20:46:06.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f9079297640 1 -- 172.21.15.167:0/291827427 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c0a5a10 con 0x7f90740c4510 2023-11-28T20:46:06.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.003+0000 7f9079297640 1 -- 172.21.15.167:0/291827427 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0a5d80 con 0x7f90740c4510 2023-11-28T20:46:06.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 -- 172.21.15.167:0/291827427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90740c4510 msgr2=0x7f907406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:06.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 --2- 172.21.15.167:0/291827427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90740c4510 0x7f907406a580 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f907406bba0 tx=0x7f906c01c8e0 comp rx=0 tx=0).stop 2023-11-28T20:46:06.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 -- 172.21.15.167:0/291827427 shutdown_connections 2023-11-28T20:46:06.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 --2- 172.21.15.167:0/291827427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90740c4510 0x7f907406a580 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:06.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 --2- 172.21.15.167:0/291827427 >> v2:172.21.15.178:3300/0 conn(0x7f90740c6ff0 0x7f9074157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:06.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 -- 172.21.15.167:0/291827427 >> 172.21.15.167:0/291827427 conn(0x7f90740cb1e0 msgr2=0x7f90740cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:06.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 -- 172.21.15.167:0/291827427 shutdown_connections 2023-11-28T20:46:06.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 -- 172.21.15.167:0/291827427 wait complete. 2023-11-28T20:46:06.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 Processor -- start 2023-11-28T20:46:06.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 -- start start 2023-11-28T20:46:06.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c4510 0x7f90741f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:06.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90740c6ff0 0x7f9074158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:06.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9074150b40 0x7f9074142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:06.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90741504f0 con 0x7f9074150b40 2023-11-28T20:46:06.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740ca420 con 0x7f90740c6ff0 2023-11-28T20:46:06.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907c4fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90741594b0 con 0x7f90740c4510 2023-11-28T20:46:06.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907aa9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9074150b40 0x7f9074142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:06.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907aa9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9074150b40 0x7f9074142a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53520/0 (socket says 172.21.15.167:53520) 2023-11-28T20:46:06.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907aa9a640 1 -- 172.21.15.167:0/436443078 learned_addr learned my addr 172.21.15.167:0/436443078 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:06.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f9079a98640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90740c6ff0 0x7f9074158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:06.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.007+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c4510 0x7f90741f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:06.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907aa9a640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c4510 msgr2=0x7f90741f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:06.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c4510 msgr2=0x7f90741f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:46:06.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c4510 msgr2=0x7f90741f3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:46:06.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c4510 0x7f90741f3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:06.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c4510 0x7f90741f3360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:06.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907aa9a640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c4510 0x7f90741f3360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:06.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907aa9a640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90740c6ff0 msgr2=0x7f9074158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:06.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907aa9a640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90740c6ff0 0x7f9074158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:06.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907aa9a640 1 -- 172.21.15.167:0/436443078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c009a70 con 0x7f9074150b40 2023-11-28T20:46:06.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f9079a98640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90740c6ff0 0x7f9074158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:46:06.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907aa9a640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9074150b40 0x7f9074142a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f906c0194f0 tx=0x7f906c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:06.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0ad640 con 0x7f9074150b40 2023-11-28T20:46:06.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c0ad7a0 con 0x7f9074150b40 2023-11-28T20:46:06.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0adb10 con 0x7f9074150b40 2023-11-28T20:46:06.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90741f38a0 con 0x7f9074150b40 2023-11-28T20:46:06.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90741591d0 con 0x7f9074150b40 2023-11-28T20:46:06.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907c4fd640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:06.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9074074770 con 0x7f9074142f60 2023-11-28T20:46:06.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:06.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2023-11-28T20:46:06.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:46:06.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:06.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:06.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f906c0b4070 con 0x7f9074150b40 2023-11-28T20:46:06.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f906affd640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9058066470 0x7f9058068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:06.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.011+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f906c11ef40 con 0x7f9074150b40 2023-11-28T20:46:06.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.015+0000 7f9079a98640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9058066470 0x7f9058068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:06.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.015+0000 7f9079a98640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9058066470 0x7f9058068930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f907406aa90 tx=0x7f9064008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:06.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.215+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:06.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.215+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:46:06.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.215+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:46:06.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.215+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:06.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.215+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:46:06.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.619+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:06.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.619+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:46:06.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.619+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:46:06.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.619+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:06.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:06.619+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:46:07.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:07.423+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:07.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:07.423+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:46:07.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:07.423+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:46:07.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:07.423+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:07.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:07.423+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:46:09.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.027+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.027+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9074157040 con 0x7f9074142f60 2023-11-28T20:46:09.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.027+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9070000f70 tx=0x7f9070014a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:09.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.027+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070005a70 con 0x7f9074142f60 2023-11-28T20:46:09.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.027+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9070005bd0 con 0x7f9074142f60 2023-11-28T20:46:09.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.027+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.027+0000 7f906affd640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9070000f70 tx=0x7f9070014a90 comp rx=0 tx=0).stop 2023-11-28T20:46:09.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.027+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 msgr2=0x7f907414fe90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:09.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.027+0000 7f906affd640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074142f60 0x7f907414fe90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.035+0000 7f907c4fd640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c93c0 0x7f90740c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.035+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740682c0 con 0x7f90740c93c0 2023-11-28T20:46:09.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.035+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c93c0 0x7f90740c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.035+0000 7f907a299640 1 -- 172.21.15.167:0/436443078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9074075c90 con 0x7f90740c93c0 2023-11-28T20:46:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.035+0000 7f907a299640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c93c0 0x7f90740c97d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9070000f70 tx=0x7f90700010b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:09.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.035+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070012e20 con 0x7f90740c93c0 2023-11-28T20:46:09.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7f9070016420 con 0x7f90740c93c0 2023-11-28T20:46:09.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c93c0 msgr2=0x7f90740c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f906affd640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c93c0 0x7f90740c97d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9070000f70 tx=0x7f90700010b0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f906affd640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c93c0 msgr2=0x7f90740c97d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:09.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f906affd640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90740c93c0 0x7f90740c97d0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9070000f70 tx=0x7f90700010b0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.040 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:46:09.040 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 66, 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 4, 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:46:09.041 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:09.042 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:09.043 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:09.044 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:09.044 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:09.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.044 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:46:09.044 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:46:09.044 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:46:09.044 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:46:09.044 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:46:09.044 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:46:09.045 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:09.046 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:09.047 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:46:09.048 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.049 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.050 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:46:09.051 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:46:09.051 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:09.051 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:09.051 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:09.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.052 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:09.052 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:09.052 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:09.052 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:09.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.052 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:09.052 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:46:09.053 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:09.054 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:09.055 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:46:09.056 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:46:09.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9058066470 msgr2=0x7f9058068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907c4fd640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9058066470 0x7f9058068930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f907406aa90 tx=0x7f9064008040 comp rx=0 tx=0).stop 2023-11-28T20:46:09.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9074150b40 msgr2=0x7f9074142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907c4fd640 1 --2- 172.21.15.167:0/436443078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9074150b40 0x7f9074142a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f906c0194f0 tx=0x7f906c019680 comp rx=0 tx=0).stop 2023-11-28T20:46:09.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907aa9a640 1 -- 172.21.15.167:0/436443078 reap_dead start 2023-11-28T20:46:09.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907aa9a640 1 -- 172.21.15.167:0/436443078 reap_dead start 2023-11-28T20:46:09.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 shutdown_connections 2023-11-28T20:46:09.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 >> 172.21.15.167:0/436443078 conn(0x7f90740cb1e0 msgr2=0x7f9074143760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:09.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 shutdown_connections 2023-11-28T20:46:09.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.039+0000 7f907c4fd640 1 -- 172.21.15.167:0/436443078 wait complete. 2023-11-28T20:46:09.059 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:46:09.059 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:46:09.059 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:46:09.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bb265f640 1 Processor -- start 2023-11-28T20:46:09.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bb265f640 1 -- start start 2023-11-28T20:46:09.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bb265f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c6ff0 0x7f0bac157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bb265f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0bac0c4510 0x7f0bac06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bb265f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bac0c4940 con 0x7f0bac150b40 2023-11-28T20:46:09.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bb265f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac0c62f0 con 0x7f0bac0c4510 2023-11-28T20:46:09.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bb265f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c6ac0 con 0x7f0bac0c6ff0 2023-11-28T20:46:09.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0babfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0bac150b40 0x7f0bac0c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55010/0 (socket says 172.21.15.167:55010) 2023-11-28T20:46:09.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0babfff640 1 -- 172.21.15.167:0/3266470670 learned_addr learned my addr 172.21.15.167:0/3266470670 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:09.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bab7fe640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c6ff0 0x7f0bac157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bb0bfc640 1 --2- 172.21.15.167:0/3266470670 >> v2:172.21.15.178:3300/0 conn(0x7f0bac0c4510 0x7f0bac06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936831548 0 0) 0x7f0bac0c4940 con 0x7f0bac150b40 2023-11-28T20:46:09.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b94003530 con 0x7f0bac150b40 2023-11-28T20:46:09.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3967852616 0 0) 0x7f0b94003530 con 0x7f0bac150b40 2023-11-28T20:46:09.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c6ff0 msgr2=0x7f0bac157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:09.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c6ff0 0x7f0bac157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 >> v2:172.21.15.178:3300/0 conn(0x7f0bac0c4510 msgr2=0x7f0bac06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:09.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 --2- 172.21.15.167:0/3266470670 >> v2:172.21.15.178:3300/0 conn(0x7f0bac0c4510 0x7f0bac06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac0c6500 con 0x7f0bac150b40 2023-11-28T20:46:09.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f0b9c001680 con 0x7f0bac150b40 2023-11-28T20:46:09.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 >> v1:172.21.15.167:6789/0 conn(0x7f0bac150b40 legacy=0x7f0bac0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c6ff0 0x7f0b94003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b94003f00 0x7f0b940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b94004d10 0x7f0b94005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c62f0 con 0x7f0b94003f00 2023-11-28T20:46:09.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c6ac0 con 0x7f0b94004d10 2023-11-28T20:46:09.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9400b990 con 0x7f0bac0c6ff0 2023-11-28T20:46:09.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bab7fe640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b94003f00 0x7f0b940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0babfff640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c6ff0 0x7f0b94003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bb0bfc640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b94004d10 0x7f0b94005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bab7fe640 1 -- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c6ff0 msgr2=0x7f0b94003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:09.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bab7fe640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c6ff0 0x7f0b94003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bab7fe640 1 -- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b94004d10 msgr2=0x7f0b94005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:09.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bab7fe640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b94004d10 0x7f0b94005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.199+0000 7f0bab7fe640 1 -- 172.21.15.167:0/3266470670 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b94003530 con 0x7f0b94003f00 2023-11-28T20:46:09.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0bab7fe640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b94003f00 0x7f0b940047d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009ae0 tx=0x7f0ba001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcd59e0465a3eab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:09.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00a5640 con 0x7f0b94003f00 2023-11-28T20:46:09.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba00a57a0 con 0x7f0b94003f00 2023-11-28T20:46:09.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0baaffd640 1 -- 172.21.15.167:0/3266470670 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00a5b50 con 0x7f0b94003f00 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0bb265f640 1 -- 172.21.15.167:0/3266470670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b94003f00 msgr2=0x7f0b940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0bb265f640 1 --2- 172.21.15.167:0/3266470670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b94003f00 0x7f0b940047d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009ae0 tx=0x7f0ba001c9f0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0bb0bfc640 1 -- 172.21.15.167:0/3266470670 reap_dead start 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0bb265f640 1 -- 172.21.15.167:0/3266470670 shutdown_connections 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0bb265f640 1 -- 172.21.15.167:0/3266470670 >> 172.21.15.167:0/3266470670 conn(0x7f0bac0cb1e0 msgr2=0x7f0bac0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0bb265f640 1 -- 172.21.15.167:0/3266470670 shutdown_connections 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.203+0000 7f0bb265f640 1 -- 172.21.15.167:0/3266470670 wait complete. 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb265f640 1 Processor -- start 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb265f640 1 -- start start 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb265f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b94003f00 0x7f0bac06a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb265f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac151260 0x7f0bac1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb265f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac159a20 0x7f0bac1ef530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb265f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac1536f0 con 0x7f0bac159a20 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb265f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac152690 con 0x7f0b94003f00 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb265f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac1eee70 con 0x7f0bac151260 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb0bfc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac159a20 0x7f0bac1ef530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0babfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b94003f00 0x7f0bac06a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb0bfc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac159a20 0x7f0bac1ef530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53528/0 (socket says 172.21.15.167:53528) 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb0bfc640 1 -- 172.21.15.167:0/1673233554 learned_addr learned my addr 172.21.15.167:0/1673233554 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bab7fe640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac151260 0x7f0bac1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb0bfc640 1 -- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac151260 msgr2=0x7f0bac1594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb0bfc640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac151260 0x7f0bac1594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb0bfc640 1 -- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b94003f00 msgr2=0x7f0bac06a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb0bfc640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b94003f00 0x7f0bac06a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb0bfc640 1 -- 172.21.15.167:0/1673233554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac153aa0 con 0x7f0bac159a20 2023-11-28T20:46:09.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.207+0000 7f0bb0bfc640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac159a20 0x7f0bac1ef530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0bac06eee0 tx=0x7f0ba400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:09.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.211+0000 7f0ba8ff9640 1 -- 172.21.15.167:0/1673233554 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400e040 con 0x7f0bac159a20 2023-11-28T20:46:09.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.211+0000 7f0ba8ff9640 1 -- 172.21.15.167:0/1673233554 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba400f040 con 0x7f0bac159a20 2023-11-28T20:46:09.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.211+0000 7f0ba8ff9640 1 -- 172.21.15.167:0/1673233554 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4015430 con 0x7f0bac159a20 2023-11-28T20:46:09.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.211+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac156090 con 0x7f0bac159a20 2023-11-28T20:46:09.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.211+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac152b70 con 0x7f0bac159a20 2023-11-28T20:46:09.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.211+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac0682c0 con 0x7f0bac159a20 2023-11-28T20:46:09.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.211+0000 7f0ba8ff9640 1 -- 172.21.15.167:0/1673233554 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0ba4015590 con 0x7f0bac159a20 2023-11-28T20:46:09.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.211+0000 7f0ba8ff9640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b98066470 0x7f0b98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:09.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.211+0000 7f0ba8ff9640 1 -- 172.21.15.167:0/1673233554 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0ba4084980 con 0x7f0bac159a20 2023-11-28T20:46:09.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.215+0000 7f0babfff640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b98066470 0x7f0b98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:09.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.215+0000 7f0babfff640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b98066470 0x7f0b98068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0051a0 tx=0x7f0b9c007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:09.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.219+0000 7f0ba8ff9640 1 -- 172.21.15.167:0/1673233554 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ba4051970 con 0x7f0bac159a20 2023-11-28T20:46:09.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.423+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f0bac075c90 con 0x7f0bac159a20 2023-11-28T20:46:09.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.427+0000 7f0ba8ff9640 1 -- 172.21.15.167:0/1673233554 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f0ba4054f90 con 0x7f0bac159a20 2023-11-28T20:46:09.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b98066470 msgr2=0x7f0b98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b98066470 0x7f0b98068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0051a0 tx=0x7f0b9c007900 comp rx=0 tx=0).stop 2023-11-28T20:46:09.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac159a20 msgr2=0x7f0bac1ef530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:09.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac159a20 0x7f0bac1ef530 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0bac06eee0 tx=0x7f0ba400f1b0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 shutdown_connections 2023-11-28T20:46:09.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b98066470 0x7f0b98068930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac159a20 0x7f0bac1ef530 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac151260 0x7f0bac1594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 --2- 172.21.15.167:0/1673233554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b94003f00 0x7f0bac06a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:09.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 >> 172.21.15.167:0/1673233554 conn(0x7f0bac0cb1e0 msgr2=0x7f0bac06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:09.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 shutdown_connections 2023-11-28T20:46:09.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:09.431+0000 7f0bb265f640 1 -- 172.21.15.167:0/1673233554 wait complete. 2023-11-28T20:46:09.453 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:46:17.372 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:17.376 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:19.454 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:46:19.455 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:46:19.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a1de9c640 1 Processor -- start 2023-11-28T20:46:19.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a1de9c640 1 -- start start 2023-11-28T20:46:19.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a1de9c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a180cfc40 0x7f4a180cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:19.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a1de9c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4a18153ae0 0x7f4a18153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:19.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a1de9c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1815ac00 con 0x7f4a180cf860 2023-11-28T20:46:19.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a1de9c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a180cbd60 con 0x7f4a180cfc40 2023-11-28T20:46:19.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a1de9c640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a18159ff0 con 0x7f4a18153ae0 2023-11-28T20:46:19.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a177fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4a180cf860 0x7f4a180ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36078/0 (socket says 172.21.15.167:36078) 2023-11-28T20:46:19.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a177fe640 1 -- 172.21.15.167:0/1802286143 learned_addr learned my addr 172.21.15.167:0/1802286143 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:19.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a16ffd640 1 --2- 172.21.15.167:0/1802286143 >> v2:172.21.15.167:3300/0 conn(0x7f4a180cfc40 0x7f4a180cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:19.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a17fff640 1 --2- 172.21.15.167:0/1802286143 >> v2:172.21.15.178:3300/0 conn(0x7f4a18153ae0 0x7f4a18153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:19.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a167fc640 1 -- 172.21.15.167:0/1802286143 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999452638 0 0) 0x7f4a1815ac00 con 0x7f4a180cf860 2023-11-28T20:46:19.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a167fc640 1 -- 172.21.15.167:0/1802286143 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a00003530 con 0x7f4a180cf860 2023-11-28T20:46:19.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a16ffd640 1 -- 172.21.15.167:0/1802286143 >> v2:172.21.15.178:3300/0 conn(0x7f4a18153ae0 msgr2=0x7f4a18153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:19.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a16ffd640 1 --2- 172.21.15.167:0/1802286143 >> v2:172.21.15.178:3300/0 conn(0x7f4a18153ae0 0x7f4a18153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:19.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a16ffd640 1 -- 172.21.15.167:0/1802286143 >> v1:172.21.15.167:6789/0 conn(0x7f4a180cf860 legacy=0x7f4a180ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:19.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.607+0000 7f4a16ffd640 1 -- 172.21.15.167:0/1802286143 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1815a2d0 con 0x7f4a180cfc40 2023-11-28T20:46:19.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a16ffd640 1 --2- 172.21.15.167:0/1802286143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a180cfc40 0x7f4a180cb770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4a180b2240 tx=0x7f4a0c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80db2932e5710fd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:19.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a167fc640 1 -- 172.21.15.167:0/1802286143 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0ab660 con 0x7f4a180cfc40 2023-11-28T20:46:19.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a167fc640 1 -- 172.21.15.167:0/1802286143 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0ab7c0 con 0x7f4a180cfc40 2023-11-28T20:46:19.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a167fc640 1 -- 172.21.15.167:0/1802286143 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0abb50 con 0x7f4a180cfc40 2023-11-28T20:46:19.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a1de9c640 1 -- 172.21.15.167:0/1802286143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a180cfc40 msgr2=0x7f4a180cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:19.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a1de9c640 1 --2- 172.21.15.167:0/1802286143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a180cfc40 0x7f4a180cb770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4a180b2240 tx=0x7f4a0c01c460 comp rx=0 tx=0).stop 2023-11-28T20:46:19.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a1de9c640 1 -- 172.21.15.167:0/1802286143 shutdown_connections 2023-11-28T20:46:19.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a1de9c640 1 --2- 172.21.15.167:0/1802286143 >> v2:172.21.15.178:3300/0 conn(0x7f4a18153ae0 0x7f4a18153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:19.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a1de9c640 1 --2- 172.21.15.167:0/1802286143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a180cfc40 0x7f4a180cb770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:19.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a1de9c640 1 -- 172.21.15.167:0/1802286143 >> 172.21.15.167:0/1802286143 conn(0x7f4a1806c1f0 msgr2=0x7f4a18071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:19.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a1de9c640 1 -- 172.21.15.167:0/1802286143 shutdown_connections 2023-11-28T20:46:19.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.611+0000 7f4a1de9c640 1 -- 172.21.15.167:0/1802286143 wait complete. 2023-11-28T20:46:19.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 Processor -- start 2023-11-28T20:46:19.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 -- start start 2023-11-28T20:46:19.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a180cf860 0x7f4a180c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a180cfc40 0x7f4a180b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18153ae0 0x7f4a180b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a181f6450 con 0x7f4a18153ae0 2023-11-28T20:46:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a181f6980 con 0x7f4a180cfc40 2023-11-28T20:46:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a180b4000 con 0x7f4a180cf860 2023-11-28T20:46:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a17fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18153ae0 0x7f4a180b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a17fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18153ae0 0x7f4a180b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44884/0 (socket says 172.21.15.167:44884) 2023-11-28T20:46:19.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a17fff640 1 -- 172.21.15.167:0/3178107175 learned_addr learned my addr 172.21.15.167:0/3178107175 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:19.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a16ffd640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a180cfc40 0x7f4a180b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:19.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a177fe640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a180cf860 0x7f4a180c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:19.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a17fff640 1 -- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a180cf860 msgr2=0x7f4a180c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:19.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a17fff640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a180cf860 0x7f4a180c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:19.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a17fff640 1 -- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a180cfc40 msgr2=0x7f4a180b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:19.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a17fff640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a180cfc40 0x7f4a180b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:19.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a17fff640 1 -- 172.21.15.167:0/3178107175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c009420 con 0x7f4a18153ae0 2023-11-28T20:46:19.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a17fff640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18153ae0 0x7f4a180b49d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a10007ea0 tx=0x7f4a10007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:19.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f49fffff640 1 -- 172.21.15.167:0/3178107175 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10014620 con 0x7f4a18153ae0 2023-11-28T20:46:19.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f49fffff640 1 -- 172.21.15.167:0/3178107175 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a100147a0 con 0x7f4a18153ae0 2023-11-28T20:46:19.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f49fffff640 1 -- 172.21.15.167:0/3178107175 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10014b50 con 0x7f4a18153ae0 2023-11-28T20:46:19.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a180b3cb0 con 0x7f4a18153ae0 2023-11-28T20:46:19.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a181f66a0 con 0x7f4a18153ae0 2023-11-28T20:46:19.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.615+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a18075c90 con 0x7f4a18153ae0 2023-11-28T20:46:19.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.619+0000 7f49fffff640 1 -- 172.21.15.167:0/3178107175 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4a10014cb0 con 0x7f4a18153ae0 2023-11-28T20:46:19.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.619+0000 7f49fffff640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a04066470 0x7f4a04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:19.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.619+0000 7f49fffff640 1 -- 172.21.15.167:0/3178107175 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4a10084cb0 con 0x7f4a18153ae0 2023-11-28T20:46:19.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.619+0000 7f4a177fe640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a04066470 0x7f4a04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:19.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.619+0000 7f4a177fe640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a04066470 0x7f4a04068930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a080011f0 tx=0x7f4a08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:19.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.623+0000 7f49fffff640 1 -- 172.21.15.167:0/3178107175 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a10051ca0 con 0x7f4a18153ae0 2023-11-28T20:46:19.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4a180b4140 con 0x7f4a18153ae0 2023-11-28T20:46:19.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f49fffff640 1 -- 172.21.15.167:0/3178107175 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f4a10084020 con 0x7f4a18153ae0 2023-11-28T20:46:19.829 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:46:19.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a04066470 msgr2=0x7f4a04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a04066470 0x7f4a04068930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a080011f0 tx=0x7f4a08009040 comp rx=0 tx=0).stop 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18153ae0 msgr2=0x7f4a180b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18153ae0 0x7f4a180b49d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a10007ea0 tx=0x7f4a10007f90 comp rx=0 tx=0).stop 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 shutdown_connections 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4a04066470 0x7f4a04068930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18153ae0 0x7f4a180b49d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a180cfc40 0x7f4a180b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 --2- 172.21.15.167:0/3178107175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a180cf860 0x7f4a180c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 >> 172.21.15.167:0/3178107175 conn(0x7f4a1806c1f0 msgr2=0x7f4a181475d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 shutdown_connections 2023-11-28T20:46:19.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.831+0000 7f4a1de9c640 1 -- 172.21.15.167:0/3178107175 wait complete. 2023-11-28T20:46:19.851 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:46:19.851 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:46:19.851 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:46:19.851 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:46:19.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.995+0000 7fcdcf6fe640 1 Processor -- start 2023-11-28T20:46:19.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.995+0000 7fcdcf6fe640 1 -- start start 2023-11-28T20:46:19.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcf6fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc8157560 0x7fcdc80c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:19.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcf6fe640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc8157970 con 0x7fcdc8150b40 2023-11-28T20:46:19.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcf6fe640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc80c6ac0 con 0x7fcdc80c6ff0 2023-11-28T20:46:19.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcf6fe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80c62f0 con 0x7fcdc8157560 2023-11-28T20:46:19.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcd49a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcdc8150b40 0x7fcdc80c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36084/0 (socket says 172.21.15.167:36084) 2023-11-28T20:46:19.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcd49a640 1 -- 172.21.15.167:0/694733771 learned_addr learned my addr 172.21.15.167:0/694733771 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:19.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcdc9b640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc8157560 0x7fcdc80c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:19.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267733820 0 0) 0x7fcdc8157970 con 0x7fcdc8150b40 2023-11-28T20:46:19.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb4003530 con 0x7fcdc8150b40 2023-11-28T20:46:19.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2104297640 0 0) 0x7fcdb4003530 con 0x7fcdc8150b40 2023-11-28T20:46:19.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc8157560 msgr2=0x7fcdc80c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc8157560 0x7fcdc80c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 >> v1:172.21.15.178:6789/0 conn(0x7fcdc80c6ff0 legacy=0x7fcdc806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc80c6500 con 0x7fcdc8150b40 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fcdc40016a0 con 0x7fcdc8150b40 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 >> v1:172.21.15.167:6789/0 conn(0x7fcdc8150b40 legacy=0x7fcdc80c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 0x7fcdb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdb4004360 0x7fcdb4004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc8157560 0x7fcdb4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc80c62f0 con 0x7fcdb40039b0 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb400dba0 con 0x7fcdb4004360 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb400dd60 con 0x7fcdc8157560 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcd49a640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 0x7fcdb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdccc99640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdb4004360 0x7fcdb4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcdc9b640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc8157560 0x7fcdb4005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcd49a640 1 -- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc8157560 msgr2=0x7fcdb4005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:20.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcd49a640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc8157560 0x7fcdb4005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcd49a640 1 -- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdb4004360 msgr2=0x7fcdb4004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:20.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcd49a640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdb4004360 0x7fcdb4004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:19.999+0000 7fcdcd49a640 1 -- 172.21.15.167:0/694733771 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4003530 con 0x7fcdb40039b0 2023-11-28T20:46:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdcd49a640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 0x7fcdb4003d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80cc2a0 tx=0x7fcdc401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716ed16bff3489d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40a5b20 con 0x7fcdb40039b0 2023-11-28T20:46:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc40a5ca0 con 0x7fcdb40039b0 2023-11-28T20:46:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdbffff640 1 -- 172.21.15.167:0/694733771 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4005b20 con 0x7fcdb40039b0 2023-11-28T20:46:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/694733771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 msgr2=0x7fcdb4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdcf6fe640 1 --2- 172.21.15.167:0/694733771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 0x7fcdb4003d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80cc2a0 tx=0x7fcdc401cc20 comp rx=0 tx=0).stop 2023-11-28T20:46:20.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdcdc9b640 1 -- 172.21.15.167:0/694733771 reap_dead start 2023-11-28T20:46:20.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/694733771 shutdown_connections 2023-11-28T20:46:20.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/694733771 >> 172.21.15.167:0/694733771 conn(0x7fcdc80cb1e0 msgr2=0x7fcdc80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:20.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/694733771 shutdown_connections 2023-11-28T20:46:20.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/694733771 wait complete. 2023-11-28T20:46:20.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.003+0000 7fcdcf6fe640 1 Processor -- start 2023-11-28T20:46:20.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 -- start start 2023-11-28T20:46:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 0x7fcdc81ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc81ed250 0x7fcdc8149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc80c4b20 0x7fcdc814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc81f1ca0 con 0x7fcdb40039b0 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc81f20c0 con 0x7fcdc80c4b20 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc81f0d40 con 0x7fcdc81ed250 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcd49a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 0x7fcdc81ecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcd49a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 0x7fcdc81ecd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44902/0 (socket says 172.21.15.167:44902) 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcd49a640 1 -- 172.21.15.167:0/1164248813 learned_addr learned my addr 172.21.15.167:0/1164248813 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcdc9b640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc80c4b20 0x7fcdc814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdccc99640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc81ed250 0x7fcdc8149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcd49a640 1 -- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc81ed250 msgr2=0x7fcdc8149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcd49a640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdc81ed250 0x7fcdc8149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcd49a640 1 -- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc80c4b20 msgr2=0x7fcdc814a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcd49a640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc80c4b20 0x7fcdc814a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcd49a640 1 -- 172.21.15.167:0/1164248813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc81f1020 con 0x7fcdb40039b0 2023-11-28T20:46:20.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcd49a640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 0x7fcdc81ecd10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcdc401ca50 tx=0x7fcdb4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40b4070 con 0x7fcdb40039b0 2023-11-28T20:46:20.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc40a5b30 con 0x7fcdb40039b0 2023-11-28T20:46:20.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc81f1300 con 0x7fcdb40039b0 2023-11-28T20:46:20.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4001680 con 0x7fcdb40039b0 2023-11-28T20:46:20.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc81f18c0 con 0x7fcdb40039b0 2023-11-28T20:46:20.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc815aab0 0x7fcdc81f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc8074770 con 0x7fcdc815aab0 2023-11-28T20:46:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdccc99640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc815aab0 0x7fcdc81f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.007+0000 7fcdccc99640 1 -- 172.21.15.167:0/1164248813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdc8156d60 con 0x7fcdc815aab0 2023-11-28T20:46:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdccc99640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc815aab0 0x7fcdc81f25f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcdc814ddd0 tx=0x7fcdb8003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb80139b0 con 0x7fcdc815aab0 2023-11-28T20:46:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcdc40070d0 con 0x7fcdb40039b0 2023-11-28T20:46:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdbdffb640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcdac066540 0x7fcdac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fcdc411e2f0 con 0x7fcdb40039b0 2023-11-28T20:46:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fcdb8013b10 con 0x7fcdc815aab0 2023-11-28T20:46:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc815aab0 msgr2=0x7fcdc81f25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdbdffb640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc815aab0 0x7fcdc81f25f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcdc814ddd0 tx=0x7fcdb8003d90 comp rx=0 tx=0).stop 2023-11-28T20:46:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc815aab0 msgr2=0x7fcdc81f25f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdbdffb640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc815aab0 0x7fcdc81f25f0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcdc814ddd0 tx=0x7fcdb8003d90 comp rx=0 tx=0).stop 2023-11-28T20:46:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdcdc9b640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcdac066540 0x7fcdac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.011+0000 7fcdcdc9b640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcdac066540 0x7fcdac068a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcdc806ef70 tx=0x7fcdc000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.015+0000 7fcdcf6fe640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc81f2b30 0x7fcdc81eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.015+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc81f1490 con 0x7fcdc81f2b30 2023-11-28T20:46:20.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.015+0000 7fcdccc99640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc81f2b30 0x7fcdc81eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdccc99640 1 -- 172.21.15.167:0/1164248813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcdc8156a80 con 0x7fcdc81f2b30 2023-11-28T20:46:20.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdccc99640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc81f2b30 0x7fcdc81eeda0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80c4fb0 tx=0x7fcdb8007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8026070 con 0x7fcdc81f2b30 2023-11-28T20:46:20.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4982 (secure 0 0 0) 0x7fcdb8006bb0 con 0x7fcdc81f2b30 2023-11-28T20:46:20.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc81f2b30 msgr2=0x7fcdc81eeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdbdffb640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc81f2b30 0x7fcdc81eeda0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80c4fb0 tx=0x7fcdb8007cb0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdbdffb640 1 -- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc81f2b30 msgr2=0x7fcdc81eeda0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:20.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdbdffb640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc81f2b30 0x7fcdc81eeda0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80c4fb0 tx=0x7fcdb8007cb0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 66, 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 15, 2023-11-28T20:46:20.018 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:20.019 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.020 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:46:20.021 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:20.022 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:46:20.023 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:20.024 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:46:20.025 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:20.026 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.028 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.029 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.030 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.031 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.031 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:20.031 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.031 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.031 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:46:20.031 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcdac066540 msgr2=0x7fcdac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcf6fe640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcdac066540 0x7fcdac068a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcdc806ef70 tx=0x7fcdc000b040 comp rx=0 tx=0).stop 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 msgr2=0x7fcdc81ecd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcf6fe640 1 --2- 172.21.15.167:0/1164248813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb40039b0 0x7fcdc81ecd10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcdc401ca50 tx=0x7fcdb4005800 comp rx=0 tx=0).stop 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcdc9b640 1 -- 172.21.15.167:0/1164248813 reap_dead start 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcdc9b640 1 -- 172.21.15.167:0/1164248813 reap_dead start 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 shutdown_connections 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 >> 172.21.15.167:0/1164248813 conn(0x7fcdc80cb1e0 msgr2=0x7fcdc8156310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 shutdown_connections 2023-11-28T20:46:20.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.019+0000 7fcdcf6fe640 1 -- 172.21.15.167:0/1164248813 wait complete. 2023-11-28T20:46:20.035 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:46:20.035 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:46:20.035 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:46:20.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.175+0000 7f2eeb9f8640 1 Processor -- start 2023-11-28T20:46:20.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.175+0000 7f2eeb9f8640 1 -- start start 2023-11-28T20:46:20.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2eeb9f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ee4151f60 0x7f2ee40c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2eeb9f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40c6120 con 0x7f2ee406a580 2023-11-28T20:46:20.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2eeb9f8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee415b220 con 0x7f2ee40c5c90 2023-11-28T20:46:20.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2eeb9f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee40c4da0 con 0x7f2ee4151f60 2023-11-28T20:46:20.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee9f95640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2ee406a580 0x7f2ee41625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36096/0 (socket says 172.21.15.167:36096) 2023-11-28T20:46:20.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee9f95640 1 -- 172.21.15.167:0/618133304 learned_addr learned my addr 172.21.15.167:0/618133304 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:20.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee9794640 1 --2- 172.21.15.167:0/618133304 >> v2:172.21.15.178:3300/0 conn(0x7f2ee4151f60 0x7f2ee40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232983304 0 0) 0x7f2edc0014a0 con 0x7f2ee406a580 2023-11-28T20:46:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed0003530 con 0x7f2ee406a580 2023-11-28T20:46:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1691796572 0 0) 0x7f2ed0003530 con 0x7f2ee406a580 2023-11-28T20:46:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 >> v2:172.21.15.178:3300/0 conn(0x7f2ee4151f60 msgr2=0x7f2ee40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 --2- 172.21.15.167:0/618133304 >> v2:172.21.15.178:3300/0 conn(0x7f2ee4151f60 0x7f2ee40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 >> v1:172.21.15.178:6789/0 conn(0x7f2ee40c5c90 legacy=0x7f2ee40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee4152340 con 0x7f2ee406a580 2023-11-28T20:46:20.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f2edc001b90 con 0x7f2ee406a580 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 >> v1:172.21.15.167:6789/0 conn(0x7f2ee406a580 legacy=0x7f2ee41625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed0003980 0x7f2ed0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ed0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed0005190 0x7f2ed000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed000c100 con 0x7f2ed00047d0 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed000c270 con 0x7f2ed0003980 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed000c430 con 0x7f2ed0005190 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee9794640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed0003980 0x7f2ed0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee8f93640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ed0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee9f95640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed0005190 0x7f2ed000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee8f93640 1 -- 172.21.15.167:0/618133304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed0005190 msgr2=0x7f2ed000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee8f93640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed0005190 0x7f2ed000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee8f93640 1 -- 172.21.15.167:0/618133304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed0003980 msgr2=0x7f2ed0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:20.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee8f93640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed0003980 0x7f2ed0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee8f93640 1 -- 172.21.15.167:0/618133304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0003530 con 0x7f2ed00047d0 2023-11-28T20:46:20.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.179+0000 7f2ee9f95640 1 -- 172.21.15.167:0/618133304 reap_dead start 2023-11-28T20:46:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2ee8f93640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ed0004c50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4001780 tx=0x7f2ed401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3c822cb61bba22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40a4ea0 con 0x7f2ed00047d0 2023-11-28T20:46:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed40a7050 con 0x7f2ed00047d0 2023-11-28T20:46:20.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2edbfff640 1 -- 172.21.15.167:0/618133304 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4003600 con 0x7f2ed00047d0 2023-11-28T20:46:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/618133304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 msgr2=0x7f2ed0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2eeb9f8640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ed0004c50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4001780 tx=0x7f2ed401c3e0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/618133304 shutdown_connections 2023-11-28T20:46:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2eeb9f8640 1 --2- 172.21.15.167:0/618133304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ed0004c50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/618133304 >> 172.21.15.167:0/618133304 conn(0x7f2ee40cb1e0 msgr2=0x7f2ee40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/618133304 shutdown_connections 2023-11-28T20:46:20.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.183+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/618133304 wait complete. 2023-11-28T20:46:20.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 Processor -- start 2023-11-28T20:46:20.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 -- start start 2023-11-28T20:46:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ee4156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee414dee0 0x7f2ee414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4157810 0x7f2ee414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee41503d0 con 0x7f2ed00047d0 2023-11-28T20:46:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee41f3bc0 con 0x7f2ee414dee0 2023-11-28T20:46:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee41f3620 con 0x7f2ee4157810 2023-11-28T20:46:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9794640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ee4156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9794640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ee4156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44934/0 (socket says 172.21.15.167:44934) 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9794640 1 -- 172.21.15.167:0/3329402406 learned_addr learned my addr 172.21.15.167:0/3329402406 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee8f93640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee414dee0 0x7f2ee414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9f95640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4157810 0x7f2ee414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9794640 1 -- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4157810 msgr2=0x7f2ee414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9794640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4157810 0x7f2ee414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9794640 1 -- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee414dee0 msgr2=0x7f2ee414f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9794640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee414dee0 0x7f2ee414f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9794640 1 -- 172.21.15.167:0/3329402406 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee41f38e0 con 0x7f2ed00047d0 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ee9794640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ee4156270 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0011aa0 tx=0x7f2ee0011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000fb80 con 0x7f2ed00047d0 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee000fce0 con 0x7f2ed00047d0 2023-11-28T20:46:20.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee414e5d0 con 0x7f2ed00047d0 2023-11-28T20:46:20.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0014680 con 0x7f2ed00047d0 2023-11-28T20:46:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.187+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee414eb90 con 0x7f2ed00047d0 2023-11-28T20:46:20.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2eeb9f8640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4157350 0x7f2ee41408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4074770 con 0x7f2ee4157350 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ee8f93640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4157350 0x7f2ee41408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ee8f93640 1 -- 172.21.15.167:0/3329402406 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ee415ba30 con 0x7f2ee4157350 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ee00147e0 con 0x7f2ed00047d0 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ee8f93640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4157350 0x7f2ee41408e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4004000 tx=0x7f2ed0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ed9ffb640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec80664a0 0x7f2ec8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2ee0084c70 con 0x7f2ed00047d0 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4007450 con 0x7f2ee4157350 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ee9f95640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec80664a0 0x7f2ec8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2ed4007a40 con 0x7f2ee4157350 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4157350 msgr2=0x7f2ee41408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ed9ffb640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4157350 0x7f2ee41408e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4004000 tx=0x7f2ed0005800 comp rx=0 tx=0).stop 2023-11-28T20:46:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4157350 msgr2=0x7f2ee41408e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ed9ffb640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4157350 0x7f2ee41408e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.191+0000 7f2ee9f95640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec80664a0 0x7f2ec8068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40c6070 tx=0x7f2edc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2eeb9f8640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4140e20 0x7f2ee41f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee414ed80 con 0x7f2ee4140e20 2023-11-28T20:46:20.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2ee8f93640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4140e20 0x7f2ee41f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2ee8f93640 1 -- 172.21.15.167:0/3329402406 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2ee415b750 con 0x7f2ee4140e20 2023-11-28T20:46:20.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2ee8f93640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4140e20 0x7f2ee41f6110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ed401c210 tx=0x7f2ed40a6000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4004f00 con 0x7f2ee4140e20 2023-11-28T20:46:20.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7f2ed40be450 con 0x7f2ee4140e20 2023-11-28T20:46:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4140e20 msgr2=0x7f2ee41f6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2ed9ffb640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4140e20 0x7f2ee41f6110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ed401c210 tx=0x7f2ed40a6000 comp rx=0 tx=0).stop 2023-11-28T20:46:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2ed9ffb640 1 -- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4140e20 msgr2=0x7f2ee41f6110 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:20.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.199+0000 7f2ed9ffb640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee4140e20 0x7f2ee41f6110 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ed401c210 tx=0x7f2ed40a6000 comp rx=0 tx=0).stop 2023-11-28T20:46:20.200 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:46:20.200 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:20.200 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:20.200 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 66, 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 16, 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:20.201 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:20.202 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:46:20.203 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:46:20.204 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:20.205 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:20.206 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.207 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:20.208 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.209 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:20.210 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.212 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.213 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.214 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:46:20.215 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:46:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec80664a0 msgr2=0x7f2ec8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2eeb9f8640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec80664a0 0x7f2ec8068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40c6070 tx=0x7f2edc009040 comp rx=0 tx=0).stop 2023-11-28T20:46:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 msgr2=0x7f2ee4156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2eeb9f8640 1 --2- 172.21.15.167:0/3329402406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed00047d0 0x7f2ee4156270 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0011aa0 tx=0x7f2ee0011f60 comp rx=0 tx=0).stop 2023-11-28T20:46:20.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2ee9f95640 1 -- 172.21.15.167:0/3329402406 reap_dead start 2023-11-28T20:46:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2ee9f95640 1 -- 172.21.15.167:0/3329402406 reap_dead start 2023-11-28T20:46:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 shutdown_connections 2023-11-28T20:46:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 >> 172.21.15.167:0/3329402406 conn(0x7f2ee40cb1e0 msgr2=0x7f2ee40cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 shutdown_connections 2023-11-28T20:46:20.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.203+0000 7f2eeb9f8640 1 -- 172.21.15.167:0/3329402406 wait complete. 2023-11-28T20:46:20.218 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:46:20.218 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:46:20.219 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:46:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.359+0000 7f7718765640 1 Processor -- start 2023-11-28T20:46:20.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.359+0000 7f7718765640 1 -- start start 2023-11-28T20:46:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7718765640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f77100c6ff0 0x7f7710157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7718765640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77100c4510 0x7f771006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7718765640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77100c4920 con 0x7f7710150b40 2023-11-28T20:46:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7718765640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77100c62f0 con 0x7f77100c6ff0 2023-11-28T20:46:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7718765640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77100c6ac0 con 0x7f77100c4510 2023-11-28T20:46:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7716501640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7710150b40 0x7f77100c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36110/0 (socket says 172.21.15.167:36110) 2023-11-28T20:46:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7716501640 1 -- 172.21.15.167:0/4091169480 learned_addr learned my addr 172.21.15.167:0/4091169480 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7715d00640 1 --2- 172.21.15.167:0/4091169480 >> v2:172.21.15.167:3300/0 conn(0x7f77100c6ff0 0x7f7710157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7716d02640 1 --2- 172.21.15.167:0/4091169480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77100c4510 0x7f771006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7715d00640 1 -- 172.21.15.167:0/4091169480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77100c4510 msgr2=0x7f771006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:20.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7715d00640 1 --2- 172.21.15.167:0/4091169480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77100c4510 0x7f771006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7715d00640 1 -- 172.21.15.167:0/4091169480 >> v1:172.21.15.167:6789/0 conn(0x7f7710150b40 legacy=0x7f77100c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f7715d00640 1 -- 172.21.15.167:0/4091169480 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77100c6500 con 0x7f77100c6ff0 2023-11-28T20:46:20.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.363+0000 7f77154ff640 1 -- 172.21.15.167:0/4091169480 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163904201 0 0) 0x7f77100c4920 con 0x7f7710150b40 2023-11-28T20:46:20.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7715d00640 1 --2- 172.21.15.167:0/4091169480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c6ff0 0x7f7710157560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77000097c0 tx=0x7f770001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c1c08cdd8ce452 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f77154ff640 1 -- 172.21.15.167:0/4091169480 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000ad660 con 0x7f77100c6ff0 2023-11-28T20:46:20.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f77154ff640 1 -- 172.21.15.167:0/4091169480 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77000ad7c0 con 0x7f77100c6ff0 2023-11-28T20:46:20.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f77154ff640 1 -- 172.21.15.167:0/4091169480 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000adb50 con 0x7f77100c6ff0 2023-11-28T20:46:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 -- 172.21.15.167:0/4091169480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c6ff0 msgr2=0x7f7710157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 --2- 172.21.15.167:0/4091169480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c6ff0 0x7f7710157560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77000097c0 tx=0x7f770001c450 comp rx=0 tx=0).stop 2023-11-28T20:46:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 -- 172.21.15.167:0/4091169480 shutdown_connections 2023-11-28T20:46:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 --2- 172.21.15.167:0/4091169480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c6ff0 0x7f7710157560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 --2- 172.21.15.167:0/4091169480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77100c4510 0x7f771006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 -- 172.21.15.167:0/4091169480 >> 172.21.15.167:0/4091169480 conn(0x7f77100cb1e0 msgr2=0x7f77100cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 -- 172.21.15.167:0/4091169480 shutdown_connections 2023-11-28T20:46:20.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 -- 172.21.15.167:0/4091169480 wait complete. 2023-11-28T20:46:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 Processor -- start 2023-11-28T20:46:20.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.367+0000 7f7718765640 1 -- start start 2023-11-28T20:46:20.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c4510 0x7f77101592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77100c6ff0 0x7f771015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7710150b40 0x7f7710157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77100cae50 con 0x7f77100c4510 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7710158860 con 0x7f7710150b40 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77100ca2a0 con 0x7f77100c6ff0 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716501640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c4510 0x7f77101592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716501640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c4510 0x7f77101592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44962/0 (socket says 172.21.15.167:44962) 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716501640 1 -- 172.21.15.167:0/1719381265 learned_addr learned my addr 172.21.15.167:0/1719381265 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716d02640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7710150b40 0x7f7710157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7715d00640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77100c6ff0 0x7f771015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716501640 1 -- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77100c6ff0 msgr2=0x7f771015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716501640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77100c6ff0 0x7f771015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716501640 1 -- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7710150b40 msgr2=0x7f7710157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716501640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7710150b40 0x7f7710157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716501640 1 -- 172.21.15.167:0/1719381265 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700009420 con 0x7f77100c4510 2023-11-28T20:46:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7716501640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c4510 0x7f77101592e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f770c007fd0 tx=0x7f770c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c005cf0 con 0x7f77100c4510 2023-11-28T20:46:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c005e70 con 0x7f77100c4510 2023-11-28T20:46:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0072f0 con 0x7f77100c4510 2023-11-28T20:46:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7710158580 con 0x7f77100c4510 2023-11-28T20:46:20.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77100ca790 con 0x7f77100c4510 2023-11-28T20:46:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7710158070 0x7f771015f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7710074770 con 0x7f7710158070 2023-11-28T20:46:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.371+0000 7f7715d00640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7710158070 0x7f771015f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f770c007450 con 0x7f77100c4510 2023-11-28T20:46:20.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7715d00640 1 -- 172.21.15.167:0/1719381265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77100c4d40 con 0x7f7710158070 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7715d00640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7710158070 0x7f771015f510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f77100cc090 tx=0x7f770001ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7706ffd640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76f4066470 0x7f76f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f770c083890 con 0x7f77100c4510 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000b9450 con 0x7f7710158070 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7716d02640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76f4066470 0x7f76f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f77000b95b0 con 0x7f7710158070 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7710158070 msgr2=0x7f771015f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7706ffd640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7710158070 0x7f771015f510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f77100cc090 tx=0x7f770001ac90 comp rx=0 tx=0).stop 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7710158070 msgr2=0x7f771015f510 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:20.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7706ffd640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7710158070 0x7f771015f510 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f77100cc090 tx=0x7f770001ac90 comp rx=0 tx=0).stop 2023-11-28T20:46:20.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.375+0000 7f7716d02640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76f4066470 0x7f76f4068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7710159240 tx=0x7f770800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.379+0000 7f7718765640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f771015fa50 0x7f7710143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.379+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7710071e90 con 0x7f771015fa50 2023-11-28T20:46:20.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.379+0000 7f7715d00640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f771015fa50 0x7f7710143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7715d00640 1 -- 172.21.15.167:0/1719381265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7710157040 con 0x7f771015fa50 2023-11-28T20:46:20.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7715d00640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f771015fa50 0x7f7710143210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f770001c490 tx=0x7f77000191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000b9bf0 con 0x7f771015fa50 2023-11-28T20:46:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f77000b9d50 con 0x7f771015fa50 2023-11-28T20:46:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f771015fa50 msgr2=0x7f7710143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7706ffd640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f771015fa50 0x7f7710143210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f770001c490 tx=0x7f77000191f0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7706ffd640 1 -- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f771015fa50 msgr2=0x7f7710143210 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:20.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7706ffd640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f771015fa50 0x7f7710143210 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f770001c490 tx=0x7f77000191f0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.383 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:46:20.383 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:20.383 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:20.383 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:46:20.383 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 66, 2023-11-28T20:46:20.383 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:46:20.383 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:46:20.383 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:46:20.383 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 16, 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:20.384 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:20.385 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:20.385 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:20.385 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.385 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:46:20.385 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:46:20.385 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:20.385 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:20.385 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:20.386 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:20.386 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:20.386 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:20.386 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:20.386 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:20.387 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:20.387 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:20.387 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:46:20.388 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:20.389 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:20.390 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:20.390 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.390 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:46:20.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.390 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:46:20.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.393 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:20.393 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:20.393 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:20.393 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:20.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.393 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:20.393 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:46:20.394 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:46:20.395 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:20.396 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.397 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.398 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:20.399 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:20.400 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:20.400 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:20.400 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:20.400 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:20.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:20.400 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:46:20.400 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:46:20.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76f4066470 msgr2=0x7f76f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7718765640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76f4066470 0x7f76f4068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7710159240 tx=0x7f770800b040 comp rx=0 tx=0).stop 2023-11-28T20:46:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c4510 msgr2=0x7f77101592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7718765640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c4510 0x7f77101592e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f770c007fd0 tx=0x7f770c00c8e0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7716d02640 1 -- 172.21.15.167:0/1719381265 reap_dead start 2023-11-28T20:46:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 shutdown_connections 2023-11-28T20:46:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7718765640 1 --2- 172.21.15.167:0/1719381265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77100c4510 0x7f77101592e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 >> 172.21.15.167:0/1719381265 conn(0x7f77100cb1e0 msgr2=0x7f771006e770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 shutdown_connections 2023-11-28T20:46:20.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.383+0000 7f7718765640 1 -- 172.21.15.167:0/1719381265 wait complete. 2023-11-28T20:46:20.402 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:46:20.403 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2023-11-28T20:46:20.403 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:46:20.403 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2023-11-28T20:46:20.403 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:46:20.403 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T20:46:20.403 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:46:20.421 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T20:46:20.421 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:46:20.421 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:46:20.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.599+0000 7f758039d640 1 Processor -- start 2023-11-28T20:46:20.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.599+0000 7f758039d640 1 -- start start 2023-11-28T20:46:20.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f758039d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75780c8030 0x7f75780c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f758039d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75780c7360 con 0x7f7578150d50 2023-11-28T20:46:20.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f758039d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7578151130 con 0x7f75780c84e0 2023-11-28T20:46:20.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f758039d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75780c3c20 con 0x7f75780c8030 2023-11-28T20:46:20.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757e139640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f7578150d50 legacy=0x7f7578071a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:46:20.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d938640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f75780c8030 msgr2=0x7f75780c5700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:20.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d938640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75780c8030 0x7f75780c5700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:20.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757e93a640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f75780c84e0 0x7f7578161360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:39020/0 (socket says 172.21.15.167:39020) 2023-11-28T20:46:20.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757e93a640 1 -- 172.21.15.167:0/134894065 learned_addr learned my addr 172.21.15.167:0/134894065 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:20.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628519531 0 0) 0x7f7578151130 con 0x7f75780c84e0 2023-11-28T20:46:20.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7564005740 con 0x7f75780c84e0 2023-11-28T20:46:20.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 47731444 0 0) 0x7f7564005740 con 0x7f75780c84e0 2023-11-28T20:46:20.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 >> v2:172.21.15.167:3300/0 conn(0x7f75780c8030 msgr2=0x7f75780c5700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:20.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 --2- 172.21.15.167:0/134894065 >> v2:172.21.15.167:3300/0 conn(0x7f75780c8030 0x7f75780c5700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 >> v1:172.21.15.167:6789/0 conn(0x7f7578150d50 legacy=0x7f7578071a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:20.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75780c3ee0 con 0x7f75780c84e0 2023-11-28T20:46:20.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f7570001a00 con 0x7f75780c84e0 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 >> v1:172.21.15.178:6789/0 conn(0x7f75780c84e0 legacy=0x7f7578161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564005b90 0x7f7564005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75640069e0 0x7f7564006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f756400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75780c3c20 con 0x7f7564005b90 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756400e360 con 0x7f75640069e0 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756400e520 con 0x7f7564007410 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757e139640 1 -- 172.21.15.167:0/134894065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564005b90 msgr2=0x7f7564005f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757e139640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564005b90 0x7f7564005f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757d938640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75640069e0 0x7f7564006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.603+0000 7f757e93a640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f756400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757e93a640 1 -- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75640069e0 msgr2=0x7f7564006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:20.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757e93a640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75640069e0 0x7f7564006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757e93a640 1 -- 172.21.15.167:0/134894065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564005b90 msgr2=0x7f7564005f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:20.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757e93a640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7564005b90 0x7f7564005f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757e93a640 1 -- 172.21.15.167:0/134894065 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564005740 con 0x7f7564007410 2023-11-28T20:46:20.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757e93a640 1 -- 172.21.15.167:0/134894065 reap_dead start 2023-11-28T20:46:20.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757e93a640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f756400dba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f757000a730 tx=0x7f757001f980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339d5e2d72af39e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700b0070 con 0x7f7564007410 2023-11-28T20:46:20.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75700ac430 con 0x7f7564007410 2023-11-28T20:46:20.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.607+0000 7f757d137640 1 -- 172.21.15.167:0/134894065 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700ac7e0 con 0x7f7564007410 2023-11-28T20:46:20.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 -- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 msgr2=0x7f756400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f756400dba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f757000a730 tx=0x7f757001f980 comp rx=0 tx=0).stop 2023-11-28T20:46:20.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 -- 172.21.15.167:0/134894065 shutdown_connections 2023-11-28T20:46:20.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 --2- 172.21.15.167:0/134894065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f756400dba0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 -- 172.21.15.167:0/134894065 >> 172.21.15.167:0/134894065 conn(0x7f75780cc300 msgr2=0x7f75780cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:20.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 -- 172.21.15.167:0/134894065 shutdown_connections 2023-11-28T20:46:20.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 -- 172.21.15.167:0/134894065 wait complete. 2023-11-28T20:46:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 Processor -- start 2023-11-28T20:46:20.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 -- start start 2023-11-28T20:46:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f7578143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75781434b0 0x7f75781f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75781526c0 0x7f75780caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75781f3720 con 0x7f75781526c0 2023-11-28T20:46:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7578143c40 con 0x7f75781434b0 2023-11-28T20:46:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f758039d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7578143960 con 0x7f7564007410 2023-11-28T20:46:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f757e93a640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75781526c0 msgr2=0x7f75780caf50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f757e93a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75781526c0 0x7f75780caf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f757e139640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f7578143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f757e139640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f7578143f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:55992/0 (socket says 172.21.15.167:55992) 2023-11-28T20:46:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f757e139640 1 -- 172.21.15.167:0/3534918835 learned_addr learned my addr 172.21.15.167:0/3534918835 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:20.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.611+0000 7f757d938640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75781434b0 0x7f75781f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f757e139640 1 -- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75781434b0 msgr2=0x7f75781f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f757e139640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75781434b0 0x7f75781f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f757e139640 1 -- 172.21.15.167:0/3534918835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75781526c0 msgr2=0x7f75780caf50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:46:20.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f757e139640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75781526c0 0x7f75780caf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f757e139640 1 -- 172.21.15.167:0/3534918835 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7578152fa0 con 0x7f7564007410 2023-11-28T20:46:20.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f757e139640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f7578143f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f757400b550 tx=0x7f757400ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f756effd640 1 -- 172.21.15.167:0/3534918835 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574003e20 con 0x7f7564007410 2023-11-28T20:46:20.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f756effd640 1 -- 172.21.15.167:0/3534918835 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574005070 con 0x7f7564007410 2023-11-28T20:46:20.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7578153280 con 0x7f7564007410 2023-11-28T20:46:20.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f756effd640 1 -- 172.21.15.167:0/3534918835 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574005420 con 0x7f7564007410 2023-11-28T20:46:20.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7578153840 con 0x7f7564007410 2023-11-28T20:46:20.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75780682c0 con 0x7f7564007410 2023-11-28T20:46:20.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.615+0000 7f756effd640 1 -- 172.21.15.167:0/3534918835 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7574005580 con 0x7f7564007410 2023-11-28T20:46:20.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.619+0000 7f756effd640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f755c066420 0x7f755c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:20.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.619+0000 7f756effd640 1 -- 172.21.15.167:0/3534918835 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7574084630 con 0x7f7564007410 2023-11-28T20:46:20.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.619+0000 7f757d938640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f755c066420 0x7f755c0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:20.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.619+0000 7f757d938640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f755c066420 0x7f755c0688e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7578143890 tx=0x7f7568008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:20.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.631+0000 7f756effd640 1 -- 172.21.15.167:0/3534918835 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7574051730 con 0x7f7564007410 2023-11-28T20:46:20.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7578153a60 con 0x7f7564007410 2023-11-28T20:46:20.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f756effd640 1 -- 172.21.15.167:0/3534918835 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f7574054d50 con 0x7f7564007410 2023-11-28T20:46:20.833 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f755c066420 msgr2=0x7f755c0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f755c066420 0x7f755c0688e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7578143890 tx=0x7f7568008040 comp rx=0 tx=0).stop 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 msgr2=0x7f7578143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f7578143f50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f757400b550 tx=0x7f757400ba10 comp rx=0 tx=0).stop 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 shutdown_connections 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f755c066420 0x7f755c0688e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75781526c0 0x7f75780caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75781434b0 0x7f75781f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 --2- 172.21.15.167:0/3534918835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7564007410 0x7f7578143f50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:20.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 >> 172.21.15.167:0/3534918835 conn(0x7f75780cc300 msgr2=0x7f757814f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:20.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 shutdown_connections 2023-11-28T20:46:20.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:20.835+0000 7f758039d640 1 -- 172.21.15.167:0/3534918835 wait complete. 2023-11-28T20:46:23.854 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:46:24.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.003+0000 7fb1ffb80640 1 Processor -- start 2023-11-28T20:46:24.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1ffb80640 1 -- start start 2023-11-28T20:46:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1ffb80640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1f80cf860 0x7fb1f80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1ffb80640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb1f8153ae0 0x7fb1f8153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1ffb80640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f815ac00 con 0x7fb1f80cfc40 2023-11-28T20:46:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1ffb80640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f80cbd60 con 0x7fb1f80cf860 2023-11-28T20:46:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1ffb80640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f8159ff0 con 0x7fb1f8153ae0 2023-11-28T20:46:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1fd91c640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fb1f80cf860 msgr2=0x7fb1f80cb770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1fd91c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1f80cf860 0x7fb1f80cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1fe11d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb1f8153ae0 0x7fb1f8153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1fe11d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb1f8153ae0 0x7fb1f8153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:48726/0 (socket says 172.21.15.167:48726) 2023-11-28T20:46:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1fe11d640 1 -- 172.21.15.167:0/1695743777 learned_addr learned my addr 172.21.15.167:0/1695743777 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1fe11d640 1 -- 172.21.15.167:0/1695743777 >> v2:172.21.15.167:3300/0 conn(0x7fb1f80cf860 msgr2=0x7fb1f80cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1fe11d640 1 --2- 172.21.15.167:0/1695743777 >> v2:172.21.15.167:3300/0 conn(0x7fb1f80cf860 0x7fb1f80cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1fe11d640 1 -- 172.21.15.167:0/1695743777 >> v1:172.21.15.178:6789/0 conn(0x7fb1f80cfc40 legacy=0x7fb1f80ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.007+0000 7fb1fe11d640 1 -- 172.21.15.167:0/1695743777 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f815a2d0 con 0x7fb1f8153ae0 2023-11-28T20:46:24.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1fe11d640 1 --2- 172.21.15.167:0/1695743777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f8153ae0 0x7fb1f8153f50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80b2240 tx=0x7fb1f001c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7fade3d0e44175 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:24.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1fc91a640 1 -- 172.21.15.167:0/1695743777 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00a58b0 con 0x7fb1f8153ae0 2023-11-28T20:46:24.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1fc91a640 1 -- 172.21.15.167:0/1695743777 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f00a5a10 con 0x7fb1f8153ae0 2023-11-28T20:46:24.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1fc91a640 1 -- 172.21.15.167:0/1695743777 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00a5da0 con 0x7fb1f8153ae0 2023-11-28T20:46:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1ffb80640 1 -- 172.21.15.167:0/1695743777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f8153ae0 msgr2=0x7fb1f8153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1ffb80640 1 --2- 172.21.15.167:0/1695743777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f8153ae0 0x7fb1f8153f50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80b2240 tx=0x7fb1f001c9f0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1ffb80640 1 -- 172.21.15.167:0/1695743777 shutdown_connections 2023-11-28T20:46:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1ffb80640 1 --2- 172.21.15.167:0/1695743777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f8153ae0 0x7fb1f8153f50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1ffb80640 1 --2- 172.21.15.167:0/1695743777 >> v2:172.21.15.167:3300/0 conn(0x7fb1f80cf860 0x7fb1f80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1ffb80640 1 -- 172.21.15.167:0/1695743777 >> 172.21.15.167:0/1695743777 conn(0x7fb1f806c1f0 msgr2=0x7fb1f8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:24.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1ffb80640 1 -- 172.21.15.167:0/1695743777 shutdown_connections 2023-11-28T20:46:24.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.011+0000 7fb1ffb80640 1 -- 172.21.15.167:0/1695743777 wait complete. 2023-11-28T20:46:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 Processor -- start 2023-11-28T20:46:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 -- start start 2023-11-28T20:46:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f80cf860 0x7fb1f81530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1f80cfc40 0x7fb1f8158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1f8153ae0 0x7fb1f8159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f815cb00 con 0x7fb1f8153ae0 2023-11-28T20:46:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f8153600 con 0x7fb1f80cf860 2023-11-28T20:46:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f81517f0 con 0x7fb1f80cfc40 2023-11-28T20:46:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fe11d640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1f8153ae0 msgr2=0x7fb1f8159050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fe11d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1f8153ae0 0x7fb1f8159050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd91c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f80cf860 0x7fb1f81530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd11b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1f80cfc40 0x7fb1f8158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd11b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1f80cfc40 0x7fb1f8158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:49406/0 (socket says 172.21.15.167:49406) 2023-11-28T20:46:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd11b640 1 -- 172.21.15.167:0/386245717 learned_addr learned my addr 172.21.15.167:0/386245717 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd91c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f80cf860 0x7fb1f81530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:48736/0 (socket says 172.21.15.167:48736) 2023-11-28T20:46:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd11b640 1 -- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f80cf860 msgr2=0x7fb1f81530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd11b640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f80cf860 0x7fb1f81530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd11b640 1 -- 172.21.15.167:0/386245717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1f8153ae0 msgr2=0x7fb1f8159050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:46:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd11b640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1f8153ae0 0x7fb1f8159050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd11b640 1 -- 172.21.15.167:0/386245717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0009b30 con 0x7fb1f80cfc40 2023-11-28T20:46:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1fd11b640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1f80cfc40 0x7fb1f8158b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c530 tx=0x7fb1e800c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ee7fc640 1 -- 172.21.15.167:0/386245717 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8005220 con 0x7fb1f80cfc40 2023-11-28T20:46:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f80c5850 con 0x7fb1f80cfc40 2023-11-28T20:46:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ee7fc640 1 -- 172.21.15.167:0/386245717 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e8005380 con 0x7fb1f80cfc40 2023-11-28T20:46:24.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ee7fc640 1 -- 172.21.15.167:0/386245717 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8007270 con 0x7fb1f80cfc40 2023-11-28T20:46:24.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.015+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f815cd10 con 0x7fb1f80cfc40 2023-11-28T20:46:24.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.019+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f8151960 con 0x7fb1f80cfc40 2023-11-28T20:46:24.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.019+0000 7fb1ee7fc640 1 -- 172.21.15.167:0/386245717 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1e80073d0 con 0x7fb1f80cfc40 2023-11-28T20:46:24.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.019+0000 7fb1ee7fc640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1dc066450 0x7fb1dc068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:24.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.019+0000 7fb1ee7fc640 1 -- 172.21.15.167:0/386245717 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb1e8084930 con 0x7fb1f80cfc40 2023-11-28T20:46:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.019+0000 7fb1fd91c640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1dc066450 0x7fb1dc068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.023+0000 7fb1fd91c640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1dc066450 0x7fb1dc068910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40093d0 tx=0x7fb1f4009360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.031+0000 7fb1ee7fc640 1 -- 172.21.15.167:0/386245717 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1e80519b0 con 0x7fb1f80cfc40 2023-11-28T20:46:24.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.239+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb1f8075c90 con 0x7fb1f80cfc40 2023-11-28T20:46:24.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.239+0000 7fb1ee7fc640 1 -- 172.21.15.167:0/386245717 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fb1e8054fd0 con 0x7fb1f80cfc40 2023-11-28T20:46:24.238 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:46:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.239+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1dc066450 msgr2=0x7fb1dc068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.239+0000 7fb1ffb80640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1dc066450 0x7fb1dc068910 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40093d0 tx=0x7fb1f4009360 comp rx=0 tx=0).stop 2023-11-28T20:46:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.239+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1f80cfc40 msgr2=0x7fb1f8158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:24.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.239+0000 7fb1ffb80640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1f80cfc40 0x7fb1f8158b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c530 tx=0x7fb1e800c9f0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.243+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 shutdown_connections 2023-11-28T20:46:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.243+0000 7fb1ffb80640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb1dc066450 0x7fb1dc068910 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.243+0000 7fb1ffb80640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1f8153ae0 0x7fb1f8159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.243+0000 7fb1ffb80640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1f80cfc40 0x7fb1f8158b10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.243+0000 7fb1ffb80640 1 --2- 172.21.15.167:0/386245717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1f80cf860 0x7fb1f81530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.243+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 >> 172.21.15.167:0/386245717 conn(0x7fb1f806c1f0 msgr2=0x7fb1f8146620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.243+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 shutdown_connections 2023-11-28T20:46:24.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:24.243+0000 7fb1ffb80640 1 -- 172.21.15.167:0/386245717 wait complete. 2023-11-28T20:46:27.260 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:46:27.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.411+0000 7f306cdd0640 1 Processor -- start 2023-11-28T20:46:27.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.411+0000 7f306cdd0640 1 -- start start 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f306cdd0640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3068153db0 0x7f306815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f306cdd0640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f30680cf440 0x7f30680cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f306cdd0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680cfef0 con 0x7f30680ccb70 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f306cdd0640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30680cc6e0 con 0x7f30680cf440 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f306cdd0640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3068154190 con 0x7f3068153db0 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f3066ffd640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f30680ccb70 legacy=0x7f30680c43d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f30677fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3068153db0 0x7f306815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f3067fff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f30680cf440 0x7f30680cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f30677fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3068153db0 0x7f306815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:49422/0 (socket says 172.21.15.167:49422) 2023-11-28T20:46:27.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f30677fe640 1 -- 172.21.15.167:0/1895679748 learned_addr learned my addr 172.21.15.167:0/1895679748 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:27.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f3067fff640 1 -- 172.21.15.167:0/1895679748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3068153db0 msgr2=0x7f306815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:27.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f3067fff640 1 --2- 172.21.15.167:0/1895679748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3068153db0 0x7f306815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:27.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f3067fff640 1 -- 172.21.15.167:0/1895679748 >> v1:172.21.15.167:6789/0 conn(0x7f30680ccb70 legacy=0x7f30680c43d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:27.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.415+0000 7f3067fff640 1 -- 172.21.15.167:0/1895679748 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680cbad0 con 0x7f30680cf440 2023-11-28T20:46:27.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f3067fff640 1 --2- 172.21.15.167:0/1895679748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680cf440 0x7f30680cf8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3060009d90 tx=0x7f306001c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ff6a10b11b4e945 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:27.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f30667fc640 1 -- 172.21.15.167:0/1895679748 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600a5880 con 0x7f30680cf440 2023-11-28T20:46:27.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f30667fc640 1 -- 172.21.15.167:0/1895679748 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30600a59e0 con 0x7f30680cf440 2023-11-28T20:46:27.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f30667fc640 1 -- 172.21.15.167:0/1895679748 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600a5d70 con 0x7f30680cf440 2023-11-28T20:46:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f306cdd0640 1 -- 172.21.15.167:0/1895679748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680cf440 msgr2=0x7f30680cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f306cdd0640 1 --2- 172.21.15.167:0/1895679748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680cf440 0x7f30680cf8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3060009d90 tx=0x7f306001c910 comp rx=0 tx=0).stop 2023-11-28T20:46:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f306cdd0640 1 -- 172.21.15.167:0/1895679748 shutdown_connections 2023-11-28T20:46:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f306cdd0640 1 --2- 172.21.15.167:0/1895679748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680cf440 0x7f30680cf8f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f306cdd0640 1 --2- 172.21.15.167:0/1895679748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3068153db0 0x7f306815a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f306cdd0640 1 -- 172.21.15.167:0/1895679748 >> 172.21.15.167:0/1895679748 conn(0x7f306806b800 msgr2=0x7f306806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f306cdd0640 1 -- 172.21.15.167:0/1895679748 shutdown_connections 2023-11-28T20:46:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.419+0000 7f306cdd0640 1 -- 172.21.15.167:0/1895679748 wait complete. 2023-11-28T20:46:27.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 Processor -- start 2023-11-28T20:46:27.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 -- start start 2023-11-28T20:46:27.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680ccb70 0x7f3068158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:27.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30680cf440 0x7f306815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:27.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3068153db0 0x7f306815b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:27.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3068153090 con 0x7f3068153db0 2023-11-28T20:46:27.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30681f2730 con 0x7f30680ccb70 2023-11-28T20:46:27.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30681f29d0 con 0x7f30680cf440 2023-11-28T20:46:27.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f3067fff640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3068153db0 msgr2=0x7f306815b650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:27.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f3067fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3068153db0 0x7f306815b650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:27.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f30677fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680ccb70 0x7f3068158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:27.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f3066ffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30680cf440 0x7f306815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:27.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f30677fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680ccb70 0x7f3068158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:48756/0 (socket says 172.21.15.167:48756) 2023-11-28T20:46:27.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f30677fe640 1 -- 172.21.15.167:0/1073135192 learned_addr learned my addr 172.21.15.167:0/1073135192 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:27.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f30677fe640 1 -- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30680cf440 msgr2=0x7f306815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:27.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f30677fe640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30680cf440 0x7f306815b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:27.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f30677fe640 1 -- 172.21.15.167:0/1073135192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3068153db0 msgr2=0x7f306815b650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:46:27.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f30677fe640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3068153db0 0x7f306815b650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:27.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f30677fe640 1 -- 172.21.15.167:0/1073135192 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3060009a70 con 0x7f30680ccb70 2023-11-28T20:46:27.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f30677fe640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680ccb70 0x7f3068158880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f305800e890 tx=0x7f305800ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:27.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f304ffff640 1 -- 172.21.15.167:0/1073135192 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058009620 con 0x7f30680ccb70 2023-11-28T20:46:27.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f304ffff640 1 -- 172.21.15.167:0/1073135192 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800c940 con 0x7f30680ccb70 2023-11-28T20:46:27.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30681f2cb0 con 0x7f30680ccb70 2023-11-28T20:46:27.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f304ffff640 1 -- 172.21.15.167:0/1073135192 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800ccf0 con 0x7f30680ccb70 2023-11-28T20:46:27.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.423+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30681f3270 con 0x7f30680ccb70 2023-11-28T20:46:27.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.427+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306804e850 con 0x7f30680ccb70 2023-11-28T20:46:27.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.427+0000 7f304ffff640 1 -- 172.21.15.167:0/1073135192 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3058013470 con 0x7f30680ccb70 2023-11-28T20:46:27.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.427+0000 7f304ffff640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3054066420 0x7f30540688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:27.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.427+0000 7f304ffff640 1 -- 172.21.15.167:0/1073135192 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3058084ae0 con 0x7f30680ccb70 2023-11-28T20:46:27.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.427+0000 7f3066ffd640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3054066420 0x7f30540688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:27.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.431+0000 7f3066ffd640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3054066420 0x7f30540688e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f305c0093d0 tx=0x7f305c009360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:27.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.439+0000 7f304ffff640 1 -- 172.21.15.167:0/1073135192 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3058051cb0 con 0x7f30680ccb70 2023-11-28T20:46:27.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.643+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f30680cae70 con 0x7f30680ccb70 2023-11-28T20:46:27.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f304ffff640 1 -- 172.21.15.167:0/1073135192 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f3058021620 con 0x7f30680ccb70 2023-11-28T20:46:27.644 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:46:27.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3054066420 msgr2=0x7f30540688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:27.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3054066420 0x7f30540688e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f305c0093d0 tx=0x7f305c009360 comp rx=0 tx=0).stop 2023-11-28T20:46:27.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680ccb70 msgr2=0x7f3068158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:27.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680ccb70 0x7f3068158880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f305800e890 tx=0x7f305800ed50 comp rx=0 tx=0).stop 2023-11-28T20:46:27.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 shutdown_connections 2023-11-28T20:46:27.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3054066420 0x7f30540688e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:27.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3068153db0 0x7f306815b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:27.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30680cf440 0x7f306815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:27.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 --2- 172.21.15.167:0/1073135192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30680ccb70 0x7f3068158880 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:27.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 >> 172.21.15.167:0/1073135192 conn(0x7f306806b800 msgr2=0x7f30680b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:27.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 shutdown_connections 2023-11-28T20:46:27.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:27.647+0000 7f306cdd0640 1 -- 172.21.15.167:0/1073135192 wait complete. 2023-11-28T20:46:30.666 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:46:30.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff6702fe640 1 Processor -- start 2023-11-28T20:46:30.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff6702fe640 1 -- start start 2023-11-28T20:46:30.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff6702fe640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:30.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff6702fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 0x7ff668153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:30.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff6702fe640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66815ac00 con 0x7ff6680cfc40 2023-11-28T20:46:30.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff6702fe640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6680cbd60 con 0x7ff668153ae0 2023-11-28T20:46:30.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff6702fe640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff668159ff0 con 0x7ff6680cf860 2023-11-28T20:46:30.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66d899640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7ff6680cfc40 legacy=0x7ff6680ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:46:30.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66e89b640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 msgr2=0x7ff668153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:30.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66e89b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 0x7ff668153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:30.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66e09a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:30.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66e09a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:48770/0 (socket says 172.21.15.167:48770) 2023-11-28T20:46:30.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 learned_addr learned my addr 172.21.15.167:0/3748516385 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:30.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 msgr2=0x7ff6680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:46:30.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 msgr2=0x7ff6680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:46:30.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:30.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:30.831+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:31.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.035+0000 7ff66e89b640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 msgr2=0x7ff668153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:31.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.035+0000 7ff66d899640 1 -- 172.21.15.167:0/3748516385 >> v1:172.21.15.167:6789/0 conn(0x7ff6680cfc40 legacy=0x7ff6680ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:46:31.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.035+0000 7ff66e89b640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 0x7ff668153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:46:31.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.035+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:31.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.035+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 msgr2=0x7ff6680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:46:31.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.035+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 msgr2=0x7ff6680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:46:31.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.035+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:31.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.035+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:46:31.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.439+0000 7ff66d899640 1 -- 172.21.15.167:0/3748516385 >> v1:172.21.15.167:6789/0 conn(0x7ff6680cfc40 legacy=0x7ff6680ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:46:31.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.439+0000 7ff66e89b640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 msgr2=0x7ff668153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:31.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.439+0000 7ff66e89b640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 0x7ff668153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:46:31.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.439+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:31.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.439+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 msgr2=0x7ff6680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:46:31.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.439+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 msgr2=0x7ff6680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:46:31.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.439+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:31.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:31.439+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:46:32.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:32.243+0000 7ff66d899640 1 -- 172.21.15.167:0/3748516385 >> v1:172.21.15.167:6789/0 conn(0x7ff6680cfc40 legacy=0x7ff6680ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:46:32.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:32.243+0000 7ff66e89b640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 msgr2=0x7ff668153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:32.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:32.243+0000 7ff66e89b640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 0x7ff668153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:46:32.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:32.243+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:32.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:32.243+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 msgr2=0x7ff6680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:46:32.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:32.243+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 msgr2=0x7ff6680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:46:32.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:32.243+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:32.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:32.243+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:46:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff65ffff640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 msgr2=0x7ff6680cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff65ffff640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.178:3300/0 conn(0x7ff6680cf860 0x7ff6680cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff65ffff640 1 -- 172.21.15.167:0/3748516385 >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 msgr2=0x7ff668153f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff65ffff640 1 --2- 172.21.15.167:0/3748516385 >> v2:172.21.15.167:3300/0 conn(0x7ff668153ae0 0x7ff668153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff65ffff640 1 -- 172.21.15.167:0/3748516385 >> v1:172.21.15.167:6789/0 conn(0x7ff6680cfc40 legacy=0x7ff6680ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff65ffff640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:33.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff65ffff640 1 -- 172.21.15.167:0/3748516385 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66815a2d0 con 0x7ff64c006110 2023-11-28T20:46:33.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff65ffff640 1 -- 172.21.15.167:0/3748516385 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6680cbd60 con 0x7ff64c0036a0 2023-11-28T20:46:33.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:33.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 msgr2=0x7ff64c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:46:33.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 msgr2=0x7ff64c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:46:33.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:33.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:33.830+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:34.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.034+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:34.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.034+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 msgr2=0x7ff64c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:46:34.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.034+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 msgr2=0x7ff64c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:46:34.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.034+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:34.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.034+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:46:34.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.438+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:34.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.438+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 msgr2=0x7ff64c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:46:34.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.438+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 msgr2=0x7ff64c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:46:34.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.438+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:34.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:34.438+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:46:35.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.026+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223499418 0 0) 0x7ff66815a2d0 con 0x7ff64c006110 2023-11-28T20:46:35.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.026+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff654003530 con 0x7ff64c006110 2023-11-28T20:46:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.030+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 170353635 0 0) 0x7ff654003530 con 0x7ff64c006110 2023-11-28T20:46:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.030+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 msgr2=0x7ff64c005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.030+0000 7ff66d098640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff64c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.030+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66815ac00 con 0x7ff64c006110 2023-11-28T20:46:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.030+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7ff658004200 con 0x7ff64c006110 2023-11-28T20:46:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.030+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 >> v1:172.21.15.178:6789/0 conn(0x7ff64c006110 legacy=0x7ff64c0085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.030+0000 7ff66e89b640 1 -- 172.21.15.167:0/3748516385 reap_dead start 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.030+0000 7ff66d098640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 0x7ff654003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.030+0000 7ff66d098640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff6540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66d098640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff654004d10 0x7ff654005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6680cbd60 con 0x7ff654003980 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65400bb20 con 0x7ff654004d10 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65400bce0 con 0x7ff64c0036a0 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66e09a640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 msgr2=0x7ff654003d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66e09a640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 0x7ff654003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66d899640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff6540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66e89b640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff654004d10 0x7ff654005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66e89b640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 msgr2=0x7ff6540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66e89b640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff6540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66e89b640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 msgr2=0x7ff654003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66e89b640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 0x7ff654003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66e89b640 1 -- 172.21.15.167:0/3748516385 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654003530 con 0x7ff654004d10 2023-11-28T20:46:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.034+0000 7ff66d899640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff6540047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:46:35.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff66e89b640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff654004d10 0x7ff654005190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff668153ec0 tx=0x7ff66001c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2e0dc4f85bfc647 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600a66c0 con 0x7ff654004d10 2023-11-28T20:46:35.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6600a6820 con 0x7ff654004d10 2023-11-28T20:46:35.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff66d098640 1 -- 172.21.15.167:0/3748516385 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600a6bd0 con 0x7ff654004d10 2023-11-28T20:46:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff6702fe640 1 -- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff654004d10 msgr2=0x7ff654005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff6702fe640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff654004d10 0x7ff654005190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff668153ec0 tx=0x7ff66001c7b0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff6702fe640 1 -- 172.21.15.167:0/3748516385 shutdown_connections 2023-11-28T20:46:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff6702fe640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff654004d10 0x7ff654005190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff6702fe640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 0x7ff654003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff6702fe640 1 --2- 172.21.15.167:0/3748516385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff64c0036a0 0x7ff6540047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff6702fe640 1 -- 172.21.15.167:0/3748516385 >> 172.21.15.167:0/3748516385 conn(0x7ff66806c1f0 msgr2=0x7ff668071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff6702fe640 1 -- 172.21.15.167:0/3748516385 shutdown_connections 2023-11-28T20:46:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.038+0000 7ff6702fe640 1 -- 172.21.15.167:0/3748516385 wait complete. 2023-11-28T20:46:35.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff6702fe640 1 Processor -- start 2023-11-28T20:46:35.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff6702fe640 1 -- start start 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff6702fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c0036a0 0x7ff6681ef040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff6702fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 0x7ff6681493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff6702fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff654004d10 0x7ff6681e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff6702fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6681ef580 con 0x7ff654003980 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff6702fe640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6681f0000 con 0x7ff64c0036a0 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff6702fe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6681ef760 con 0x7ff654004d10 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66d899640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 msgr2=0x7ff6681493a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66d899640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 0x7ff6681493a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e09a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c0036a0 0x7ff6681ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e09a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c0036a0 0x7ff6681ef040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:38924/0 (socket says 172.21.15.167:38924) 2023-11-28T20:46:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e09a640 1 -- 172.21.15.167:0/1758499055 learned_addr learned my addr 172.21.15.167:0/1758499055 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:35.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e89b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff654004d10 0x7ff6681e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e09a640 1 -- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff654004d10 msgr2=0x7ff6681e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e09a640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff654004d10 0x7ff6681e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e09a640 1 -- 172.21.15.167:0/1758499055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 msgr2=0x7ff6681493a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:46:35.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e09a640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 0x7ff6681493a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e09a640 1 -- 172.21.15.167:0/1758499055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6681efa40 con 0x7ff64c0036a0 2023-11-28T20:46:35.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.042+0000 7ff66e09a640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c0036a0 0x7ff6681ef040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff664016a70 tx=0x7ff664016f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.046+0000 7ff65effd640 1 -- 172.21.15.167:0/1758499055 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66401d070 con 0x7ff64c0036a0 2023-11-28T20:46:35.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.046+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6681efd20 con 0x7ff64c0036a0 2023-11-28T20:46:35.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.046+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6681e2e40 con 0x7ff64c0036a0 2023-11-28T20:46:35.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.046+0000 7ff65effd640 1 -- 172.21.15.167:0/1758499055 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66400c040 con 0x7ff64c0036a0 2023-11-28T20:46:35.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.046+0000 7ff65effd640 1 -- 172.21.15.167:0/1758499055 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664015d70 con 0x7ff64c0036a0 2023-11-28T20:46:35.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.046+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6681e29c0 con 0x7ff64c0036a0 2023-11-28T20:46:35.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.050+0000 7ff65effd640 1 -- 172.21.15.167:0/1758499055 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff66402b440 con 0x7ff64c0036a0 2023-11-28T20:46:35.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.050+0000 7ff65effd640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff64c069870 0x7ff64c06bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.050+0000 7ff65effd640 1 -- 172.21.15.167:0/1758499055 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff664084d90 con 0x7ff64c0036a0 2023-11-28T20:46:35.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.050+0000 7ff66d899640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff64c069870 0x7ff64c06bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.050+0000 7ff66d899640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff64c069870 0x7ff64c06bd30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff6681ecc70 tx=0x7ff658003ae0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.062+0000 7ff65effd640 1 -- 172.21.15.167:0/1758499055 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff664051eb0 con 0x7ff64c0036a0 2023-11-28T20:46:35.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.262+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff6681e29c0 con 0x7ff64c0036a0 2023-11-28T20:46:35.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff65effd640 1 -- 172.21.15.167:0/1758499055 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7ff664026620 con 0x7ff64c0036a0 2023-11-28T20:46:35.265 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff64c069870 msgr2=0x7ff64c06bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff64c069870 0x7ff64c06bd30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff6681ecc70 tx=0x7ff658003ae0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c0036a0 msgr2=0x7ff6681ef040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c0036a0 0x7ff6681ef040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff664016a70 tx=0x7ff664016f30 comp rx=0 tx=0).stop 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 shutdown_connections 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff64c069870 0x7ff64c06bd30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff654004d10 0x7ff6681e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff654003980 0x7ff6681493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 --2- 172.21.15.167:0/1758499055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c0036a0 0x7ff6681ef040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 >> 172.21.15.167:0/1758499055 conn(0x7ff66806c1f0 msgr2=0x7ff6680c4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:35.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 shutdown_connections 2023-11-28T20:46:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.266+0000 7ff6702fe640 1 -- 172.21.15.167:0/1758499055 wait complete. 2023-11-28T20:46:35.286 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:46:35.286 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:46:35.286 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:46:35.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.426+0000 7fa5c43b8640 1 Processor -- start 2023-11-28T20:46:35.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c43b8640 1 -- start start 2023-11-28T20:46:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c43b8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa5bc151f60 0x7fa5bc0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c43b8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0c6120 con 0x7fa5bc06a580 2023-11-28T20:46:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c43b8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc15b220 con 0x7fa5bc0c5c90 2023-11-28T20:46:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c43b8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc0c4da0 con 0x7fa5bc151f60 2023-11-28T20:46:35.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c2154640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fa5bc151f60 msgr2=0x7fa5bc0c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:35.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c2955640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fa5bc06a580 legacy=0x7fa5bc1625b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:46:35.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c2154640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa5bc151f60 0x7fa5bc0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:35.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1953640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fa5bc0c5c90 0x7fa5bc0c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:35532/0 (socket says 172.21.15.167:35532) 2023-11-28T20:46:35.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1953640 1 -- 172.21.15.167:0/1526913763 learned_addr learned my addr 172.21.15.167:0/1526913763 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:35.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993079876 0 0) 0x7fa5bc15b220 con 0x7fa5bc0c5c90 2023-11-28T20:46:35.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a8003530 con 0x7fa5bc0c5c90 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1193813574 0 0) 0x7fa5a8003530 con 0x7fa5bc0c5c90 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 >> v2:172.21.15.167:3300/0 conn(0x7fa5bc151f60 msgr2=0x7fa5bc0c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 --2- 172.21.15.167:0/1526913763 >> v2:172.21.15.167:3300/0 conn(0x7fa5bc151f60 0x7fa5bc0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 >> v1:172.21.15.167:6789/0 conn(0x7fa5bc06a580 legacy=0x7fa5bc1625b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc152340 con 0x7fa5bc0c5c90 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fa5ac001680 con 0x7fa5bc0c5c90 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 >> v1:172.21.15.178:6789/0 conn(0x7fa5bc0c5c90 legacy=0x7fa5bc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5a8003980 0x7fa5a8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5a80047d0 0x7fa5a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a80052b0 0x7fa5a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a800c1d0 con 0x7fa5a80052b0 2023-11-28T20:46:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a800c340 con 0x7fa5a8003980 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a800c500 con 0x7fa5a80047d0 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c2955640 1 -- 172.21.15.167:0/1526913763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a80052b0 msgr2=0x7fa5a800b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c2955640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a80052b0 0x7fa5a800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c2154640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5a8003980 0x7fa5a8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.430+0000 7fa5c1953640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5a80047d0 0x7fa5a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c2154640 1 -- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5a80047d0 msgr2=0x7fa5a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c2154640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5a80047d0 0x7fa5a8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c2154640 1 -- 172.21.15.167:0/1526913763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a80052b0 msgr2=0x7fa5a800b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c2154640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a80052b0 0x7fa5a800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c2154640 1 -- 172.21.15.167:0/1526913763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8003530 con 0x7fa5a8003980 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c2955640 1 -- 172.21.15.167:0/1526913763 reap_dead start 2023-11-28T20:46:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c1953640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5a80047d0 0x7fa5a8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:46:35.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c2154640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5a8003980 0x7fa5a8003d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006fd0 tx=0x7fa5b801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d5c59879e849436 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8003bc0 con 0x7fa5a8003980 2023-11-28T20:46:35.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b80a7070 con 0x7fa5a8003980 2023-11-28T20:46:35.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.434+0000 7fa5c1152640 1 -- 172.21.15.167:0/1526913763 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8005070 con 0x7fa5a8003980 2023-11-28T20:46:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 -- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5a8003980 msgr2=0x7fa5a8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5a8003980 0x7fa5a8003d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006fd0 tx=0x7fa5b801c3a0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 -- 172.21.15.167:0/1526913763 shutdown_connections 2023-11-28T20:46:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 --2- 172.21.15.167:0/1526913763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5a8003980 0x7fa5a8003d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 -- 172.21.15.167:0/1526913763 >> 172.21.15.167:0/1526913763 conn(0x7fa5bc0cb1e0 msgr2=0x7fa5bc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:35.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 -- 172.21.15.167:0/1526913763 shutdown_connections 2023-11-28T20:46:35.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 -- 172.21.15.167:0/1526913763 wait complete. 2023-11-28T20:46:35.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 Processor -- start 2023-11-28T20:46:35.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 -- start start 2023-11-28T20:46:35.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5a8003980 0x7fa5bc1f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc152d20 0x7fa5bc15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14f790 0x7fa5bc141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1f19a0 con 0x7fa5bc152d20 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc15abe0 con 0x7fa5bc14f790 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c43b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1ee3b0 con 0x7fa5a8003980 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c1953640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc152d20 msgr2=0x7fa5bc15a2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c1953640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc152d20 0x7fa5bc15a2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c2154640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5a8003980 0x7fa5bc1f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c2955640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14f790 0x7fa5bc141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c2955640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14f790 0x7fa5bc141d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:38946/0 (socket says 172.21.15.167:38946) 2023-11-28T20:46:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.438+0000 7fa5c2955640 1 -- 172.21.15.167:0/3267537620 learned_addr learned my addr 172.21.15.167:0/3267537620 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:35.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c2955640 1 -- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5a8003980 msgr2=0x7fa5bc1f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c2955640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5a8003980 0x7fa5bc1f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c2955640 1 -- 172.21.15.167:0/3267537620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc152d20 msgr2=0x7fa5bc15a2b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:46:35.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c2955640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc152d20 0x7fa5bc15a2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c2955640 1 -- 172.21.15.167:0/3267537620 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc1534f0 con 0x7fa5bc14f790 2023-11-28T20:46:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c2955640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14f790 0x7fa5bc141d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc06fde0 tx=0x7fa5b4009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4015670 con 0x7fa5bc14f790 2023-11-28T20:46:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b4006e90 con 0x7fa5bc14f790 2023-11-28T20:46:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4015a30 con 0x7fa5bc14f790 2023-11-28T20:46:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc1ed5f0 con 0x7fa5bc14f790 2023-11-28T20:46:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc1edbb0 con 0x7fa5bc14f790 2023-11-28T20:46:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c43b8640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14fc10 0x7fa5bc142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc074770 con 0x7fa5bc14fc10 2023-11-28T20:46:35.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.442+0000 7fa5c2154640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14fc10 0x7fa5bc142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5c2154640 1 -- 172.21.15.167:0/3267537620 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5bc15b470 con 0x7fa5bc14fc10 2023-11-28T20:46:35.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5c2154640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14fc10 0x7fa5bc142280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80057b0 tx=0x7fa5b8019140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5b4012070 con 0x7fa5bc14f790 2023-11-28T20:46:35.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5b2ffd640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa5a0066420 0x7fa5a00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80bb070 con 0x7fa5bc14fc10 2023-11-28T20:46:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa5b4084320 con 0x7fa5bc14f790 2023-11-28T20:46:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa5b80b3040 con 0x7fa5bc14fc10 2023-11-28T20:46:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14fc10 msgr2=0x7fa5bc142280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5b2ffd640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14fc10 0x7fa5bc142280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80057b0 tx=0x7fa5b8019140 comp rx=0 tx=0).stop 2023-11-28T20:46:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14fc10 msgr2=0x7fa5bc142280 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5b2ffd640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14fc10 0x7fa5bc142280 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5c1953640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa5a0066420 0x7fa5a00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.446+0000 7fa5c1953640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa5a0066420 0x7fa5a00688e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001a80 tx=0x7fa5ac0019f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc1edd40 0x7fa5bc150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc158750 con 0x7fa5bc1edd40 2023-11-28T20:46:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c2154640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc1edd40 0x7fa5bc150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c2154640 1 -- 172.21.15.167:0/3267537620 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa5bc15b750 con 0x7fa5bc1edd40 2023-11-28T20:46:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c2154640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc1edd40 0x7fa5bc150ba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5b801c3e0 tx=0x7fa5a8005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80b2070 con 0x7fa5bc1edd40 2023-11-28T20:46:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5113 (secure 0 0 0) 0x7fa5b80bf720 con 0x7fa5bc1edd40 2023-11-28T20:46:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc1edd40 msgr2=0x7fa5bc150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5b2ffd640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc1edd40 0x7fa5bc150ba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5b801c3e0 tx=0x7fa5a8005800 comp rx=0 tx=0).stop 2023-11-28T20:46:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5b2ffd640 1 -- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc1edd40 msgr2=0x7fa5bc150ba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:35.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5b2ffd640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc1edd40 0x7fa5bc150ba0 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5b801c3e0 tx=0x7fa5a8005800 comp rx=0 tx=0).stop 2023-11-28T20:46:35.457 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:46:35.457 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:35.457 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:35.457 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:46:35.457 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 68, 2023-11-28T20:46:35.458 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:46:35.458 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:46:35.458 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:46:35.458 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.458 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:46:35.458 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:35.458 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:46:35.459 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:46:35.459 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:35.459 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:35.459 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:35.459 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:35.459 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:35.459 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:35.460 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:35.460 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:35.460 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:35.460 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:35.460 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.460 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:46:35.461 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:46:35.461 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:35.461 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:35.461 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:35.461 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:35.462 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:35.462 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:35.462 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:35.462 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:35.462 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:35.462 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:35.462 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.463 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:46:35.463 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:46:35.463 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:46:35.463 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:46:35.463 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:46:35.463 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:46:35.463 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:35.464 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:35.464 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:46:35.464 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:46:35.464 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:46:35.464 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:46:35.464 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:46:35.464 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:46:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:46:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:46:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:35.465 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:35.466 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.467 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:35.468 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:35.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:46:35.471 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.472 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 7 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.474 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.476 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:46:35.476 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:46:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa5a0066420 msgr2=0x7fa5a00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa5a0066420 0x7fa5a00688e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001a80 tx=0x7fa5ac0019f0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14f790 msgr2=0x7fa5bc141d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14f790 0x7fa5bc141d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc06fde0 tx=0x7fa5b4009e50 comp rx=0 tx=0).stop 2023-11-28T20:46:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c2955640 1 -- 172.21.15.167:0/3267537620 reap_dead start 2023-11-28T20:46:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 shutdown_connections 2023-11-28T20:46:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 --2- 172.21.15.167:0/3267537620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5bc14f790 0x7fa5bc141d40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 >> 172.21.15.167:0/3267537620 conn(0x7fa5bc0cb1e0 msgr2=0x7fa5bc0c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 shutdown_connections 2023-11-28T20:46:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.454+0000 7fa5c43b8640 1 -- 172.21.15.167:0/3267537620 wait complete. 2023-11-28T20:46:35.478 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:46:35.478 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:46:35.478 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:46:35.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.618+0000 7f398c85a640 1 Processor -- start 2023-11-28T20:46:35.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.618+0000 7f398c85a640 1 -- start start 2023-11-28T20:46:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398c85a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3988150b40 0x7f3988157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398c85a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39880c4510 0x7f398806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398c85a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39880c48f0 con 0x7f39880c6ff0 2023-11-28T20:46:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398c85a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880c62f0 con 0x7f39880c4510 2023-11-28T20:46:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398c85a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880c6ac0 con 0x7f3988150b40 2023-11-28T20:46:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f3986d9d640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f39880c4510 msgr2=0x7f398806a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f3985d9b640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f39880c6ff0 legacy=0x7f39880c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:46:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f3986d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39880c4510 0x7f398806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398659c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3988150b40 0x7f3988157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398659c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3988150b40 0x7f3988157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:38974/0 (socket says 172.21.15.167:38974) 2023-11-28T20:46:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398659c640 1 -- 172.21.15.167:0/1001645779 learned_addr learned my addr 172.21.15.167:0/1001645779 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398659c640 1 -- 172.21.15.167:0/1001645779 >> v2:172.21.15.167:3300/0 conn(0x7f39880c4510 msgr2=0x7f398806a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398659c640 1 --2- 172.21.15.167:0/1001645779 >> v2:172.21.15.167:3300/0 conn(0x7f39880c4510 0x7f398806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398659c640 1 -- 172.21.15.167:0/1001645779 >> v1:172.21.15.167:6789/0 conn(0x7f39880c6ff0 legacy=0x7f39880c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.622+0000 7f398659c640 1 -- 172.21.15.167:0/1001645779 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39880c6500 con 0x7f3988150b40 2023-11-28T20:46:35.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398659c640 1 --2- 172.21.15.167:0/1001645779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3988150b40 0x7f3988157560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f39880cc270 tx=0x7f397801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5cc46a3f5361542 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398559a640 1 -- 172.21.15.167:0/1001645779 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39780ac620 con 0x7f3988150b40 2023-11-28T20:46:35.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398559a640 1 -- 172.21.15.167:0/1001645779 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39780ac780 con 0x7f3988150b40 2023-11-28T20:46:35.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398559a640 1 -- 172.21.15.167:0/1001645779 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39780acb10 con 0x7f3988150b40 2023-11-28T20:46:35.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398c85a640 1 -- 172.21.15.167:0/1001645779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3988150b40 msgr2=0x7f3988157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398c85a640 1 --2- 172.21.15.167:0/1001645779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3988150b40 0x7f3988157560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f39880cc270 tx=0x7f397801c4b0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398c85a640 1 -- 172.21.15.167:0/1001645779 shutdown_connections 2023-11-28T20:46:35.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398c85a640 1 --2- 172.21.15.167:0/1001645779 >> v2:172.21.15.167:3300/0 conn(0x7f39880c4510 0x7f398806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398c85a640 1 --2- 172.21.15.167:0/1001645779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3988150b40 0x7f3988157560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398c85a640 1 -- 172.21.15.167:0/1001645779 >> 172.21.15.167:0/1001645779 conn(0x7f39880cb1e0 msgr2=0x7f39880cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:35.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398c85a640 1 -- 172.21.15.167:0/1001645779 shutdown_connections 2023-11-28T20:46:35.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.626+0000 7f398c85a640 1 -- 172.21.15.167:0/1001645779 wait complete. 2023-11-28T20:46:35.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 Processor -- start 2023-11-28T20:46:35.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 -- start start 2023-11-28T20:46:35.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39880c4510 0x7f3988141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39880c6ff0 0x7f398813ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988150b40 0x7f398813ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3988163950 con 0x7f39880c4510 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39881545c0 con 0x7f39880c6ff0 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3988162db0 con 0x7f3988150b40 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398659c640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39880c4510 msgr2=0x7f3988141440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39880c4510 0x7f3988141440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3985d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39880c6ff0 0x7f398813ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3986d9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988150b40 0x7f398813ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3985d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39880c6ff0 0x7f398813ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:38990/0 (socket says 172.21.15.167:38990) 2023-11-28T20:46:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3985d9b640 1 -- 172.21.15.167:0/3889060089 learned_addr learned my addr 172.21.15.167:0/3889060089 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:35.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3985d9b640 1 -- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988150b40 msgr2=0x7f398813ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3985d9b640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988150b40 0x7f398813ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3985d9b640 1 -- 172.21.15.167:0/3889060089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39880c4510 msgr2=0x7f3988141440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3985d9b640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39880c4510 0x7f3988141440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3985d9b640 1 -- 172.21.15.167:0/3889060089 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39780094d0 con 0x7f39880c6ff0 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3985d9b640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39880c6ff0 0x7f398813ea00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f397c00b550 tx=0x7f397c00ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c003d00 con 0x7f39880c6ff0 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c003e80 con 0x7f39880c6ff0 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3988163020 con 0x7f39880c6ff0 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c005330 con 0x7f39880c6ff0 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.630+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39881635e0 con 0x7f39880c6ff0 2023-11-28T20:46:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f398c85a640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988142d00 0x7f3988141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3988074770 con 0x7f3988142d00 2023-11-28T20:46:35.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f398659c640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988142d00 0x7f3988141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f398659c640 1 -- 172.21.15.167:0/3889060089 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39880c4080 con 0x7f3988142d00 2023-11-28T20:46:35.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f398659c640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988142d00 0x7f3988141d20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f398806bba0 tx=0x7f397801acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978006ea0 con 0x7f3988142d00 2023-11-28T20:46:35.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f397c005490 con 0x7f39880c6ff0 2023-11-28T20:46:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3976ffd640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3968066540 0x7f3968068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f397c083ff0 con 0x7f39880c6ff0 2023-11-28T20:46:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f39780aba20 con 0x7f3988142d00 2023-11-28T20:46:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988142d00 msgr2=0x7f3988141d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3976ffd640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988142d00 0x7f3988141d20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f398806bba0 tx=0x7f397801acf0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988142d00 msgr2=0x7f3988141d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3976ffd640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988142d00 0x7f3988141d20 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f398806bba0 tx=0x7f397801acf0 comp rx=0 tx=0).stop 2023-11-28T20:46:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.634+0000 7f3986d9d640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3968066540 0x7f3968068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.638+0000 7f3986d9d640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3968066540 0x7f3968068a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f398813e840 tx=0x7f398000d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f398c85a640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988147830 0x7f3988147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:35.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3988142260 con 0x7f3988147830 2023-11-28T20:46:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f398659c640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988147830 0x7f3988147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f398659c640 1 -- 172.21.15.167:0/3889060089 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3988157040 con 0x7f3988147830 2023-11-28T20:46:35.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f398659c640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988147830 0x7f3988147c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f397801ab60 tx=0x7f3978019250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:35.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39780c2a50 con 0x7f3988147830 2023-11-28T20:46:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4798 (secure 0 0 0) 0x7f39780c22c0 con 0x7f3988147830 2023-11-28T20:46:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988147830 msgr2=0x7f3988147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f3976ffd640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988147830 0x7f3988147c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f397801ab60 tx=0x7f3978019250 comp rx=0 tx=0).stop 2023-11-28T20:46:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f3976ffd640 1 -- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988147830 msgr2=0x7f3988147c40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:46:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.642+0000 7f3976ffd640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3988147830 0x7f3988147c40 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f397801ab60 tx=0x7f3978019250 comp rx=0 tx=0).stop 2023-11-28T20:46:35.644 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:46:35.644 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:35.644 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:35.644 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:46:35.644 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 68, 2023-11-28T20:46:35.644 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:46:35.644 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:46:35.644 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:46:35.644 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:35.646 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:46:35.647 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:46:35.648 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:46:35.649 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:35.650 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:46:35.651 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:46:35.652 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:35.653 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:46:35.654 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:46:35.655 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.656 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.657 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:46:35.658 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:46:35.659 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:46:35.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3968066540 msgr2=0x7f3968068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f398c85a640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3968066540 0x7f3968068a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f398813e840 tx=0x7f398000d040 comp rx=0 tx=0).stop 2023-11-28T20:46:35.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39880c6ff0 msgr2=0x7f398813ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f398c85a640 1 --2- 172.21.15.167:0/3889060089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39880c6ff0 0x7f398813ea00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f397c00b550 tx=0x7f397c00ba10 comp rx=0 tx=0).stop 2023-11-28T20:46:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f3986d9d640 1 -- 172.21.15.167:0/3889060089 reap_dead start 2023-11-28T20:46:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f3986d9d640 1 -- 172.21.15.167:0/3889060089 reap_dead start 2023-11-28T20:46:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 shutdown_connections 2023-11-28T20:46:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 >> 172.21.15.167:0/3889060089 conn(0x7f39880cb1e0 msgr2=0x7f3988071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 shutdown_connections 2023-11-28T20:46:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:35.646+0000 7f398c85a640 1 -- 172.21.15.167:0/3889060089 wait complete. 2023-11-28T20:46:35.662 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:46:35.662 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:46:47.545 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:47.549 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:55.662 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:46:55.663 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2023-11-28T20:46:55.663 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T20:46:55.663 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T20:46:55.667 INFO:tasks.ceph.mon.a:Started 2023-11-28T20:46:55.667 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:46:55.667 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:46:55.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda293aa640 1 Processor -- start 2023-11-28T20:46:55.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda293aa640 1 -- start start 2023-11-28T20:46:55.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda293aa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fda240c6f00 0x7fda240c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda293aa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 0x7fda240c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda293aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda2415d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda293aa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240c7820 con 0x7fda24154120 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda293aa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2415a090 con 0x7fda240c6f00 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda293aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2415a370 con 0x7fda240c87c0 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda227fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 0x7fda240c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda227fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 0x7fda240c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38004/0 (socket says 172.21.15.167:38004) 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda227fc640 1 -- 172.21.15.167:0/260131036 learned_addr learned my addr 172.21.15.167:0/260131036 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda237fe640 1 --2- 172.21.15.167:0/260131036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda2415d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:55.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda22ffd640 1 --2- 172.21.15.167:0/260131036 >> v2:172.21.15.178:3300/0 conn(0x7fda240c6f00 0x7fda240c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda227fc640 1 -- 172.21.15.167:0/260131036 >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 msgr2=0x7fda240c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda227fc640 1 -- 172.21.15.167:0/260131036 >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 msgr2=0x7fda240c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda227fc640 1 --2- 172.21.15.167:0/260131036 >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 0x7fda240c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda227fc640 1 --2- 172.21.15.167:0/260131036 >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 0x7fda240c7c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda237fe640 1 -- 172.21.15.167:0/260131036 >> v2:172.21.15.178:3300/0 conn(0x7fda240c6f00 msgr2=0x7fda240c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda237fe640 1 --2- 172.21.15.167:0/260131036 >> v2:172.21.15.178:3300/0 conn(0x7fda240c6f00 0x7fda240c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda237fe640 1 -- 172.21.15.167:0/260131036 >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 msgr2=0x7fda240c7c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda237fe640 1 --2- 172.21.15.167:0/260131036 >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 0x7fda240c7c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda237fe640 1 -- 172.21.15.167:0/260131036 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2415a650 con 0x7fda240c87c0 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.822+0000 7fda22ffd640 1 --2- 172.21.15.167:0/260131036 >> v2:172.21.15.178:3300/0 conn(0x7fda240c6f00 0x7fda240c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.826+0000 7fda237fe640 1 --2- 172.21.15.167:0/260131036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda2415d610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fda2406c8a0 tx=0x7fda1c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=202053645404eb28 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.826+0000 7fda21ffb640 1 -- 172.21.15.167:0/260131036 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0a5940 con 0x7fda240c87c0 2023-11-28T20:46:55.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.826+0000 7fda21ffb640 1 -- 172.21.15.167:0/260131036 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c0a5aa0 con 0x7fda240c87c0 2023-11-28T20:46:55.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.826+0000 7fda21ffb640 1 -- 172.21.15.167:0/260131036 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0a5e30 con 0x7fda240c87c0 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.826+0000 7fda293aa640 1 -- 172.21.15.167:0/260131036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 msgr2=0x7fda2415d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.826+0000 7fda293aa640 1 --2- 172.21.15.167:0/260131036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda2415d610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fda2406c8a0 tx=0x7fda1c01c8e0 comp rx=0 tx=0).stop 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 -- 172.21.15.167:0/260131036 shutdown_connections 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 --2- 172.21.15.167:0/260131036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda2415d610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 --2- 172.21.15.167:0/260131036 >> v2:172.21.15.167:3300/0 conn(0x7fda24154120 0x7fda240c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 --2- 172.21.15.167:0/260131036 >> v2:172.21.15.178:3300/0 conn(0x7fda240c6f00 0x7fda240c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 -- 172.21.15.167:0/260131036 >> 172.21.15.167:0/260131036 conn(0x7fda240cc300 msgr2=0x7fda240cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 -- 172.21.15.167:0/260131036 shutdown_connections 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 -- 172.21.15.167:0/260131036 wait complete. 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 Processor -- start 2023-11-28T20:46:55.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 -- start start 2023-11-28T20:46:55.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 0x7fda2415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda24147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda24154120 0x7fda2414a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24156130 con 0x7fda240c6f00 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda241f6110 con 0x7fda24154120 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda293aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda241f69b0 con 0x7fda240c87c0 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda22ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 0x7fda2415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda22ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 0x7fda2415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38020/0 (socket says 172.21.15.167:38020) 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda22ffd640 1 -- 172.21.15.167:0/3728194515 learned_addr learned my addr 172.21.15.167:0/3728194515 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda227fc640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda24147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda22ffd640 1 -- 172.21.15.167:0/3728194515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 msgr2=0x7fda2415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:46:55.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda22ffd640 1 -- 172.21.15.167:0/3728194515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 msgr2=0x7fda2415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda22ffd640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 0x7fda2415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda237fe640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda24154120 0x7fda2414a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda22ffd640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 0x7fda2415af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda227fc640 1 -- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda24154120 msgr2=0x7fda2414a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda227fc640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda24154120 0x7fda2414a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda227fc640 1 -- 172.21.15.167:0/3728194515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 msgr2=0x7fda2415af00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda227fc640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 0x7fda2415af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.830+0000 7fda227fc640 1 -- 172.21.15.167:0/3728194515 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda14009420 con 0x7fda240c87c0 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda227fc640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda24147b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fda1800e7e0 tx=0x7fda1800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:55.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda0b7fe640 1 -- 172.21.15.167:0/3728194515 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18004020 con 0x7fda240c87c0 2023-11-28T20:46:55.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c009a70 con 0x7fda240c87c0 2023-11-28T20:46:55.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda0b7fe640 1 -- 172.21.15.167:0/3728194515 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18004180 con 0x7fda240c87c0 2023-11-28T20:46:55.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda0b7fe640 1 -- 172.21.15.167:0/3728194515 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800c6d0 con 0x7fda240c87c0 2023-11-28T20:46:55.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2415d250 con 0x7fda240c87c0 2023-11-28T20:46:55.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda240682c0 con 0x7fda240c87c0 2023-11-28T20:46:55.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda0b7fe640 1 -- 172.21.15.167:0/3728194515 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fda1800c830 con 0x7fda240c87c0 2023-11-28T20:46:55.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda0b7fe640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda100664a0 0x7fda10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:55.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.834+0000 7fda0b7fe640 1 -- 172.21.15.167:0/3728194515 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fda18084080 con 0x7fda240c87c0 2023-11-28T20:46:55.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.838+0000 7fda22ffd640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda100664a0 0x7fda10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:55.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.838+0000 7fda22ffd640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda100664a0 0x7fda10068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fda14009650 tx=0x7fda14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:55.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:55.850+0000 7fda0b7fe640 1 -- 172.21.15.167:0/3728194515 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fda18051120 con 0x7fda240c87c0 2023-11-28T20:46:56.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fda24075c90 con 0x7fda240c87c0 2023-11-28T20:46:56.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda0b7fe640 1 -- 172.21.15.167:0/3728194515 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fda18020620 con 0x7fda240c87c0 2023-11-28T20:46:56.057 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:46:56.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda100664a0 msgr2=0x7fda10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:56.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda100664a0 0x7fda10068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fda14009650 tx=0x7fda14008040 comp rx=0 tx=0).stop 2023-11-28T20:46:56.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 msgr2=0x7fda24147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:56.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda24147b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fda1800e7e0 tx=0x7fda1800eca0 comp rx=0 tx=0).stop 2023-11-28T20:46:56.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 shutdown_connections 2023-11-28T20:46:56.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fda100664a0 0x7fda10068960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:56.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda24154120 0x7fda2414a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:56.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda240c87c0 0x7fda24147b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:56.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 --2- 172.21.15.167:0/3728194515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda240c6f00 0x7fda2415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:56.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 >> 172.21.15.167:0/3728194515 conn(0x7fda240cc300 msgr2=0x7fda240cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:56.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 shutdown_connections 2023-11-28T20:46:56.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:56.058+0000 7fda293aa640 1 -- 172.21.15.167:0/3728194515 wait complete. 2023-11-28T20:46:59.079 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:46:59.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.230+0000 7fa253879640 1 Processor -- start 2023-11-28T20:46:59.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.230+0000 7fa253879640 1 -- start start 2023-11-28T20:46:59.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa253879640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c15dd20 0x7fa24c0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:59.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa253879640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c15a090 con 0x7fa24c154120 2023-11-28T20:46:59.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa253879640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c15a370 con 0x7fa24c0c6f00 2023-11-28T20:46:59.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa253879640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0c8390 con 0x7fa24c15dd20 2023-11-28T20:46:59.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa250e14640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa24c154120 0x7fa24c15d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37198/0 (socket says 172.21.15.167:37198) 2023-11-28T20:46:59.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa250e14640 1 -- 172.21.15.167:0/1426063176 learned_addr learned my addr 172.21.15.167:0/1426063176 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:46:59.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa251e16640 1 --2- 172.21.15.167:0/1426063176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c15dd20 0x7fa24c0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa243fff640 1 -- 172.21.15.167:0/1426063176 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074535222 0 0) 0x7fa24c15a370 con 0x7fa24c0c6f00 2023-11-28T20:46:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa243fff640 1 -- 172.21.15.167:0/1426063176 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa238003530 con 0x7fa24c0c6f00 2023-11-28T20:46:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa251e16640 1 -- 172.21.15.167:0/1426063176 >> v1:172.21.15.178:6789/0 conn(0x7fa24c0c6f00 legacy=0x7fa24c0c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa251e16640 1 -- 172.21.15.167:0/1426063176 >> v1:172.21.15.167:6789/0 conn(0x7fa24c154120 legacy=0x7fa24c15d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.234+0000 7fa251e16640 1 -- 172.21.15.167:0/1426063176 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c15a650 con 0x7fa24c15dd20 2023-11-28T20:46:59.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa251e16640 1 --2- 172.21.15.167:0/1426063176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c15dd20 0x7fa24c0c72e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa244009dc0 tx=0x7fa24401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a56a298b2400a5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa243fff640 1 -- 172.21.15.167:0/1426063176 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440a5940 con 0x7fa24c15dd20 2023-11-28T20:46:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa243fff640 1 -- 172.21.15.167:0/1426063176 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2440a5aa0 con 0x7fa24c15dd20 2023-11-28T20:46:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa243fff640 1 -- 172.21.15.167:0/1426063176 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440a5e10 con 0x7fa24c15dd20 2023-11-28T20:46:59.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa253879640 1 -- 172.21.15.167:0/1426063176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c15dd20 msgr2=0x7fa24c0c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:59.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa253879640 1 --2- 172.21.15.167:0/1426063176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c15dd20 0x7fa24c0c72e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa244009dc0 tx=0x7fa24401c970 comp rx=0 tx=0).stop 2023-11-28T20:46:59.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa253879640 1 -- 172.21.15.167:0/1426063176 shutdown_connections 2023-11-28T20:46:59.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa253879640 1 --2- 172.21.15.167:0/1426063176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c15dd20 0x7fa24c0c72e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:59.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa253879640 1 -- 172.21.15.167:0/1426063176 >> 172.21.15.167:0/1426063176 conn(0x7fa24c0cc300 msgr2=0x7fa24c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:59.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa253879640 1 -- 172.21.15.167:0/1426063176 shutdown_connections 2023-11-28T20:46:59.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.238+0000 7fa253879640 1 -- 172.21.15.167:0/1426063176 wait complete. 2023-11-28T20:46:59.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa253879640 1 Processor -- start 2023-11-28T20:46:59.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa253879640 1 -- start start 2023-11-28T20:46:59.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa253879640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0c6f00 0x7fa24c141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:59.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa253879640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c154120 0x7fa24c144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:59.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa253879640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 0x7fa24c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa253879640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0c5e10 con 0x7fa24c15dd20 2023-11-28T20:46:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa253879640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c15af00 con 0x7fa24c154120 2023-11-28T20:46:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa253879640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0cb480 con 0x7fa24c0c6f00 2023-11-28T20:46:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa251e16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 0x7fa24c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa251e16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 0x7fa24c0ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38024/0 (socket says 172.21.15.167:38024) 2023-11-28T20:46:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa251e16640 1 -- 172.21.15.167:0/130441887 learned_addr learned my addr 172.21.15.167:0/130441887 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:46:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa251e16640 1 -- 172.21.15.167:0/130441887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 msgr2=0x7fa24c0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:46:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa251e16640 1 -- 172.21.15.167:0/130441887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 msgr2=0x7fa24c0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:46:59.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa250e14640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c154120 0x7fa24c144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:59.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa251e16640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 0x7fa24c0ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:46:59.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa251615640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0c6f00 0x7fa24c141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:59.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.242+0000 7fa251e16640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 0x7fa24c0ca200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:46:59.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa251615640 1 -- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c154120 msgr2=0x7fa24c144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:59.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa251615640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c154120 0x7fa24c144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:59.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa251615640 1 -- 172.21.15.167:0/130441887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 msgr2=0x7fa24c0ca200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:46:59.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa251615640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 0x7fa24c0ca200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:59.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa251615640 1 -- 172.21.15.167:0/130441887 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009a70 con 0x7fa24c0c6f00 2023-11-28T20:46:59.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa250e14640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c154120 0x7fa24c144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:46:59.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa251615640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0c6f00 0x7fa24c141470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa24800c3c0 tx=0x7fa24800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:59.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa241ffb640 1 -- 172.21.15.167:0/130441887 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480052d0 con 0x7fa24c0c6f00 2023-11-28T20:46:59.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa241ffb640 1 -- 172.21.15.167:0/130441887 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa248005450 con 0x7fa24c0c6f00 2023-11-28T20:46:59.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa241ffb640 1 -- 172.21.15.167:0/130441887 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248003840 con 0x7fa24c0c6f00 2023-11-28T20:46:59.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c0cb740 con 0x7fa24c0c6f00 2023-11-28T20:46:59.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c0c6470 con 0x7fa24c0c6f00 2023-11-28T20:46:59.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.246+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c0682c0 con 0x7fa24c0c6f00 2023-11-28T20:46:59.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.250+0000 7fa241ffb640 1 -- 172.21.15.167:0/130441887 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2480039a0 con 0x7fa24c0c6f00 2023-11-28T20:46:59.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.250+0000 7fa241ffb640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa230066470 0x7fa230068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:46:59.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.250+0000 7fa241ffb640 1 -- 172.21.15.167:0/130441887 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa248083af0 con 0x7fa24c0c6f00 2023-11-28T20:46:59.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.250+0000 7fa250e14640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa230066470 0x7fa230068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:46:59.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.250+0000 7fa250e14640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa230066470 0x7fa230068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0c8060 tx=0x7fa23c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:46:59.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.262+0000 7fa241ffb640 1 -- 172.21.15.167:0/130441887 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa248050d20 con 0x7fa24c0c6f00 2023-11-28T20:46:59.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.470+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa24c075c90 con 0x7fa24c0c6f00 2023-11-28T20:46:59.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.470+0000 7fa241ffb640 1 -- 172.21.15.167:0/130441887 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fa248017620 con 0x7fa24c0c6f00 2023-11-28T20:46:59.471 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:46:59.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa230066470 msgr2=0x7fa230068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:59.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa230066470 0x7fa230068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0c8060 tx=0x7fa23c009040 comp rx=0 tx=0).stop 2023-11-28T20:46:59.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0c6f00 msgr2=0x7fa24c141470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:46:59.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0c6f00 0x7fa24c141470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa24800c3c0 tx=0x7fa24800c880 comp rx=0 tx=0).stop 2023-11-28T20:46:59.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 shutdown_connections 2023-11-28T20:46:59.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa230066470 0x7fa230068930 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:59.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa24c15dd20 0x7fa24c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:59.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c154120 0x7fa24c144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:59.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 --2- 172.21.15.167:0/130441887 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0c6f00 0x7fa24c141470 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:46:59.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 >> 172.21.15.167:0/130441887 conn(0x7fa24c0cc300 msgr2=0x7fa24c150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:46:59.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 shutdown_connections 2023-11-28T20:46:59.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:46:59.474+0000 7fa253879640 1 -- 172.21.15.167:0/130441887 wait complete. 2023-11-28T20:47:02.493 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:47:02.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42cc903640 1 Processor -- start 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42cc903640 1 -- start start 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42cc903640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42c8167650 0x7f42c80c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42cc903640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c80c5260 0x7f42c80c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42cc903640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c80c6700 con 0x7f42c806ad40 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42cc903640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c80706f0 con 0x7f42c8167650 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42cc903640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c806b120 con 0x7f42c80c5260 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42c77fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f42c806ad40 0x7f42c806dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37212/0 (socket says 172.21.15.167:37212) 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42c77fe640 1 -- 172.21.15.167:0/3684554079 learned_addr learned my addr 172.21.15.167:0/3684554079 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42c6ffd640 1 --2- 172.21.15.167:0/3684554079 >> v2:172.21.15.178:3300/0 conn(0x7f42c8167650 0x7f42c80c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.642+0000 7f42c7fff640 1 --2- 172.21.15.167:0/3684554079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c80c5260 0x7f42c80c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.738+0000 7f42c6ffd640 1 -- 172.21.15.167:0/3684554079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c80c5260 msgr2=0x7f42c80c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:02.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.738+0000 7f42c6ffd640 1 --2- 172.21.15.167:0/3684554079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c80c5260 0x7f42c80c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:02.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.738+0000 7f42c6ffd640 1 -- 172.21.15.167:0/3684554079 >> v1:172.21.15.167:6789/0 conn(0x7f42c806ad40 legacy=0x7f42c806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:02.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.738+0000 7f42c6ffd640 1 -- 172.21.15.167:0/3684554079 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c80c6140 con 0x7f42c8167650 2023-11-28T20:47:02.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.738+0000 7f42c7fff640 1 --2- 172.21.15.167:0/3684554079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c80c5260 0x7f42c80c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:47:02.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42c6ffd640 1 --2- 172.21.15.167:0/3684554079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c8167650 0x7f42c80c7610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00a860 tx=0x7f42bc01ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b52a2f38f45e987f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:02.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42c67fc640 1 -- 172.21.15.167:0/3684554079 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0a8d20 con 0x7f42c8167650 2023-11-28T20:47:02.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42c67fc640 1 -- 172.21.15.167:0/3684554079 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0a8e80 con 0x7f42c8167650 2023-11-28T20:47:02.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42c67fc640 1 -- 172.21.15.167:0/3684554079 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0b0660 con 0x7f42c8167650 2023-11-28T20:47:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42cc903640 1 -- 172.21.15.167:0/3684554079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c8167650 msgr2=0x7f42c80c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42cc903640 1 --2- 172.21.15.167:0/3684554079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c8167650 0x7f42c80c7610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00a860 tx=0x7f42bc01ef10 comp rx=0 tx=0).stop 2023-11-28T20:47:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42cc903640 1 -- 172.21.15.167:0/3684554079 shutdown_connections 2023-11-28T20:47:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42cc903640 1 --2- 172.21.15.167:0/3684554079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c8167650 0x7f42c80c7610 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42cc903640 1 --2- 172.21.15.167:0/3684554079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c80c5260 0x7f42c80c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42cc903640 1 -- 172.21.15.167:0/3684554079 >> 172.21.15.167:0/3684554079 conn(0x7f42c80cb1e0 msgr2=0x7f42c80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42cc903640 1 -- 172.21.15.167:0/3684554079 shutdown_connections 2023-11-28T20:47:02.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.742+0000 7f42cc903640 1 -- 172.21.15.167:0/3684554079 wait complete. 2023-11-28T20:47:02.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42cc903640 1 Processor -- start 2023-11-28T20:47:02.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42cc903640 1 -- start start 2023-11-28T20:47:02.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42cc903640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c806ad40 0x7f42c8201660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:02.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42cc903640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c80c5260 0x7f42c80bd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:02.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42cc903640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 0x7f42c8203760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:02.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42cc903640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c808b940 con 0x7f42c8167650 2023-11-28T20:47:02.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42cc903640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8165a00 con 0x7f42c80c5260 2023-11-28T20:47:02.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42cc903640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c808b3f0 con 0x7f42c806ad40 2023-11-28T20:47:02.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 0x7f42c8203760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:02.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 0x7f42c8203760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38034/0 (socket says 172.21.15.167:38034) 2023-11-28T20:47:02.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c7fff640 1 -- 172.21.15.167:0/922010092 learned_addr learned my addr 172.21.15.167:0/922010092 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c77fe640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c806ad40 0x7f42c8201660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c6ffd640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c80c5260 0x7f42c80bd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c7fff640 1 -- 172.21.15.167:0/922010092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 msgr2=0x7f42c8203760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c7fff640 1 -- 172.21.15.167:0/922010092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 msgr2=0x7f42c8203760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c7fff640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 0x7f42c8203760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c7fff640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 0x7f42c8203760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c6ffd640 1 -- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c806ad40 msgr2=0x7f42c8201660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c6ffd640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c806ad40 0x7f42c8201660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c6ffd640 1 -- 172.21.15.167:0/922010092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 msgr2=0x7f42c8203760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c6ffd640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 0x7f42c8203760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c6ffd640 1 -- 172.21.15.167:0/922010092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00077c0 con 0x7f42c80c5260 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c77fe640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c806ad40 0x7f42c8201660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:47:02.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42c6ffd640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c80c5260 0x7f42c80bd530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f42c8066fb0 tx=0x7f42bc01bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:02.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.746+0000 7f42affff640 1 -- 172.21.15.167:0/922010092 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0a8d20 con 0x7f42c80c5260 2023-11-28T20:47:02.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.750+0000 7f42affff640 1 -- 172.21.15.167:0/922010092 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0ba400 con 0x7f42c80c5260 2023-11-28T20:47:02.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.750+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc00a4d0 con 0x7f42c80c5260 2023-11-28T20:47:02.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.750+0000 7f42affff640 1 -- 172.21.15.167:0/922010092 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0ba7d0 con 0x7f42c80c5260 2023-11-28T20:47:02.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.750+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c808b660 con 0x7f42c80c5260 2023-11-28T20:47:02.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.750+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c804e850 con 0x7f42c80c5260 2023-11-28T20:47:02.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.750+0000 7f42affff640 1 -- 172.21.15.167:0/922010092 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f42bc0ba930 con 0x7f42c80c5260 2023-11-28T20:47:02.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.750+0000 7f42affff640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42b4066470 0x7f42b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:02.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.754+0000 7f42affff640 1 -- 172.21.15.167:0/922010092 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f42bc121a30 con 0x7f42c80c5260 2023-11-28T20:47:02.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.754+0000 7f42c77fe640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42b4066470 0x7f42b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:02.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.754+0000 7f42c77fe640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42b4066470 0x7f42b4068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f42b8005890 tx=0x7f42b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:02.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:02.762+0000 7f42affff640 1 -- 172.21.15.167:0/922010092 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42bc0eebc0 con 0x7f42c80c5260 2023-11-28T20:47:03.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.018+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f42c8165b40 con 0x7f42c80c5260 2023-11-28T20:47:03.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.018+0000 7f42affff640 1 -- 172.21.15.167:0/922010092 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f42bc00b040 con 0x7f42c80c5260 2023-11-28T20:47:03.017 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:47:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42b4066470 msgr2=0x7f42b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42b4066470 0x7f42b4068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f42b8005890 tx=0x7f42b8009040 comp rx=0 tx=0).stop 2023-11-28T20:47:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c80c5260 msgr2=0x7f42c80bd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c80c5260 0x7f42c80bd530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f42c8066fb0 tx=0x7f42bc01bcb0 comp rx=0 tx=0).stop 2023-11-28T20:47:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 shutdown_connections 2023-11-28T20:47:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f42b4066470 0x7f42b4068930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42c8167650 0x7f42c8203760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c80c5260 0x7f42c80bd530 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 --2- 172.21.15.167:0/922010092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c806ad40 0x7f42c8201660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 >> 172.21.15.167:0/922010092 conn(0x7f42c80cb1e0 msgr2=0x7f42c80c9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 shutdown_connections 2023-11-28T20:47:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:03.022+0000 7f42cc903640 1 -- 172.21.15.167:0/922010092 wait complete. 2023-11-28T20:47:06.042 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:47:06.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.190+0000 7f36da6fd640 1 Processor -- start 2023-11-28T20:47:06.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.190+0000 7f36da6fd640 1 -- start start 2023-11-28T20:47:06.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36da6fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f36d41585d0 0x7f36d40c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:06.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36da6fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d415e130 0x7f36d4161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:06.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36da6fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 0x7f36d4162320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:06.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36da6fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d415f160 con 0x7f36d40c7720 2023-11-28T20:47:06.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36da6fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d415e5e0 con 0x7f36d41585d0 2023-11-28T20:47:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36da6fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d415e8c0 con 0x7f36d415e130 2023-11-28T20:47:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d8c9a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 0x7f36d4162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d8c9a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 0x7f36d4162320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50890/0 (socket says 172.21.15.167:50890) 2023-11-28T20:47:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d8c9a640 1 -- 172.21.15.167:0/3018792217 learned_addr learned my addr 172.21.15.167:0/3018792217 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d37fe640 1 --2- 172.21.15.167:0/3018792217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d415e130 0x7f36d4161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d3fff640 1 --2- 172.21.15.167:0/3018792217 >> v2:172.21.15.178:3300/0 conn(0x7f36d41585d0 0x7f36d40c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d8c9a640 1 -- 172.21.15.167:0/3018792217 >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 msgr2=0x7f36d4162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:47:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d8c9a640 1 -- 172.21.15.167:0/3018792217 >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 msgr2=0x7f36d4162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:06.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d8c9a640 1 --2- 172.21.15.167:0/3018792217 >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 0x7f36d4162320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:06.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d8c9a640 1 --2- 172.21.15.167:0/3018792217 >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 0x7f36d4162320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:06.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d37fe640 1 -- 172.21.15.167:0/3018792217 >> v2:172.21.15.178:3300/0 conn(0x7f36d41585d0 msgr2=0x7f36d40c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:06.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d37fe640 1 --2- 172.21.15.167:0/3018792217 >> v2:172.21.15.178:3300/0 conn(0x7f36d41585d0 0x7f36d40c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d37fe640 1 -- 172.21.15.167:0/3018792217 >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 msgr2=0x7f36d4162320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:06.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d37fe640 1 --2- 172.21.15.167:0/3018792217 >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 0x7f36d4162320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.194+0000 7f36d37fe640 1 -- 172.21.15.167:0/3018792217 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d415eba0 con 0x7f36d415e130 2023-11-28T20:47:06.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36d37fe640 1 --2- 172.21.15.167:0/3018792217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d415e130 0x7f36d4161de0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f36d40c5e20 tx=0x7f36c801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85729e9a3a4cfaf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:06.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36d2ffd640 1 -- 172.21.15.167:0/3018792217 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c80ab5f0 con 0x7f36d415e130 2023-11-28T20:47:06.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36d2ffd640 1 -- 172.21.15.167:0/3018792217 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c80ab750 con 0x7f36d415e130 2023-11-28T20:47:06.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36d2ffd640 1 -- 172.21.15.167:0/3018792217 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c80abae0 con 0x7f36d415e130 2023-11-28T20:47:06.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 -- 172.21.15.167:0/3018792217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d415e130 msgr2=0x7f36d4161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:06.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3018792217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d415e130 0x7f36d4161de0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f36d40c5e20 tx=0x7f36c801c430 comp rx=0 tx=0).stop 2023-11-28T20:47:06.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 -- 172.21.15.167:0/3018792217 shutdown_connections 2023-11-28T20:47:06.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3018792217 >> v2:172.21.15.167:3300/0 conn(0x7f36d40c7720 0x7f36d4162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3018792217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d415e130 0x7f36d4161de0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3018792217 >> v2:172.21.15.178:3300/0 conn(0x7f36d41585d0 0x7f36d40c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 -- 172.21.15.167:0/3018792217 >> 172.21.15.167:0/3018792217 conn(0x7f36d40cb1e0 msgr2=0x7f36d40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:06.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 -- 172.21.15.167:0/3018792217 shutdown_connections 2023-11-28T20:47:06.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 -- 172.21.15.167:0/3018792217 wait complete. 2023-11-28T20:47:06.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 Processor -- start 2023-11-28T20:47:06.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.198+0000 7f36da6fd640 1 -- start start 2023-11-28T20:47:06.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36da6fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36d40c7720 0x7f36d41f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:06.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36da6fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d41585d0 0x7f36d415fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36da6fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 0x7f36d40ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36da6fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d415fa50 con 0x7f36d415e130 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36da6fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4153ab0 con 0x7f36d40c7720 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36da6fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d41f7dd0 con 0x7f36d41585d0 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d8c9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 0x7f36d40ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d8c9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 0x7f36d40ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50906/0 (socket says 172.21.15.167:50906) 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d8c9a640 1 -- 172.21.15.167:0/3171632372 learned_addr learned my addr 172.21.15.167:0/3171632372 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d8c9a640 1 -- 172.21.15.167:0/3171632372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 msgr2=0x7f36d40ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d8c9a640 1 -- 172.21.15.167:0/3171632372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 msgr2=0x7f36d40ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d8c9a640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 0x7f36d40ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:06.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d37fe640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d41585d0 0x7f36d415fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:06.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d8c9a640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 0x7f36d40ca960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:06.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d3fff640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36d40c7720 0x7f36d41f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:06.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d37fe640 1 -- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36d40c7720 msgr2=0x7f36d41f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:06.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d37fe640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36d40c7720 0x7f36d41f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d37fe640 1 -- 172.21.15.167:0/3171632372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 msgr2=0x7f36d40ca960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:47:06.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d37fe640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 0x7f36d40ca960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d37fe640 1 -- 172.21.15.167:0/3171632372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c8009420 con 0x7f36d41585d0 2023-11-28T20:47:06.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d3fff640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36d40c7720 0x7f36d41f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:47:06.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d37fe640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d41585d0 0x7f36d415fe70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f36d415ea00 tx=0x7f36c801ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:06.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d0ff9640 1 -- 172.21.15.167:0/3171632372 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c80bf610 con 0x7f36d41585d0 2023-11-28T20:47:06.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d0ff9640 1 -- 172.21.15.167:0/3171632372 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c80bf770 con 0x7f36d41585d0 2023-11-28T20:47:06.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36d0ff9640 1 -- 172.21.15.167:0/3171632372 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c80bfb20 con 0x7f36d41585d0 2023-11-28T20:47:06.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d4160eb0 con 0x7f36d41585d0 2023-11-28T20:47:06.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d4161150 con 0x7f36d41585d0 2023-11-28T20:47:06.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.202+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d40682c0 con 0x7f36d41585d0 2023-11-28T20:47:06.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.206+0000 7f36d0ff9640 1 -- 172.21.15.167:0/3171632372 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f36c80b5400 con 0x7f36d41585d0 2023-11-28T20:47:06.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.206+0000 7f36d0ff9640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c0066470 0x7f36c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:06.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.206+0000 7f36d0ff9640 1 -- 172.21.15.167:0/3171632372 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f36c80a8050 con 0x7f36d41585d0 2023-11-28T20:47:06.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.206+0000 7f36d3fff640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c0066470 0x7f36c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:06.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.206+0000 7f36d3fff640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c0066470 0x7f36c0068930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009f50 tx=0x7f36c4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:06.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.218+0000 7f36d0ff9640 1 -- 172.21.15.167:0/3171632372 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36c80ec3e0 con 0x7f36d41585d0 2023-11-28T20:47:06.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.422+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f36d40c2f40 con 0x7f36d41585d0 2023-11-28T20:47:06.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.422+0000 7f36d0ff9640 1 -- 172.21.15.167:0/3171632372 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f36c80efa00 con 0x7f36d41585d0 2023-11-28T20:47:06.422 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:47:06.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c0066470 msgr2=0x7f36c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:06.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c0066470 0x7f36c0068930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009f50 tx=0x7f36c4009190 comp rx=0 tx=0).stop 2023-11-28T20:47:06.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d41585d0 msgr2=0x7f36d415fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:06.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d41585d0 0x7f36d415fe70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f36d415ea00 tx=0x7f36c801ac70 comp rx=0 tx=0).stop 2023-11-28T20:47:06.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 shutdown_connections 2023-11-28T20:47:06.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c0066470 0x7f36c0068930 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36d415e130 0x7f36d40ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36d41585d0 0x7f36d415fe70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 --2- 172.21.15.167:0/3171632372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36d40c7720 0x7f36d41f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:06.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 >> 172.21.15.167:0/3171632372 conn(0x7f36d40cb1e0 msgr2=0x7f36d40c33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:06.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 shutdown_connections 2023-11-28T20:47:06.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:06.426+0000 7f36da6fd640 1 -- 172.21.15.167:0/3171632372 wait complete. 2023-11-28T20:47:09.444 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:47:09.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e2557640 1 Processor -- start 2023-11-28T20:47:09.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e2557640 1 -- start start 2023-11-28T20:47:09.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e2557640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:09.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e2557640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:09.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e2557640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc15b220 con 0x7f18dc0c5c90 2023-11-28T20:47:09.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e2557640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc0c4da0 con 0x7f18dc06a580 2023-11-28T20:47:09.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e2557640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0c2df0 con 0x7f18dc151f60 2023-11-28T20:47:09.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e0af4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:09.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18dbfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:09.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e0af4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:35436/0 (socket says 172.21.15.167:35436) 2023-11-28T20:47:09.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 learned_addr learned my addr 172.21.15.167:0/3004881973 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:09.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 msgr2=0x7f18dc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:09.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 msgr2=0x7f18dc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:09.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:09.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 msgr2=0x7f18dc06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:47:09.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 msgr2=0x7f18dc06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:09.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:09.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:09.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.594+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:09.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:09.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:09.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 msgr2=0x7f18dc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:47:09.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 msgr2=0x7f18dc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:09.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:09.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:47:09.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 msgr2=0x7f18dc06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:09.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 msgr2=0x7f18dc06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:09.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:09.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:09.798+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:47:10.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:10.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:10.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 msgr2=0x7f18dc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:47:10.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 msgr2=0x7f18dc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:10.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:10.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 msgr2=0x7f18dc06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:10.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 msgr2=0x7f18dc06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:10.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:10.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:47:10.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:10.202+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:47:11.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:11.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:11.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 msgr2=0x7f18dc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:47:11.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 msgr2=0x7f18dc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:11.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:11.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 msgr2=0x7f18dc06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:11.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 msgr2=0x7f18dc06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:11.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:11.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:47:11.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:11.006+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:47:12.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18d9ffb640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 msgr2=0x7f18dc0c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:12.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18d9ffb640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc151f60 0x7f18dc0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:12.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18d9ffb640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 msgr2=0x7f18dc06a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:12.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18d9ffb640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.178:3300/0 conn(0x7f18dc06a580 0x7f18dc06a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:12.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18d9ffb640 1 -- 172.21.15.167:0/3004881973 >> v1:172.21.15.178:6789/0 conn(0x7f18dc0c5c90 legacy=0x7f18dc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:12.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18d9ffb640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:12.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18d9ffb640 1 -- 172.21.15.167:0/3004881973 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0c60f0 con 0x7f18c80036e0 2023-11-28T20:47:12.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18d9ffb640 1 -- 172.21.15.167:0/3004881973 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc0c2df0 con 0x7f18c8007390 2023-11-28T20:47:12.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:12.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18db7fe640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 msgr2=0x7f18c8009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:12.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18db7fe640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 msgr2=0x7f18c8009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:12.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:12.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.594+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:12.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.798+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:12.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.798+0000 7f18db7fe640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 msgr2=0x7f18c8009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:12.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.798+0000 7f18db7fe640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 msgr2=0x7f18c8009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:12.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.798+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:12.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:12.798+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:47:13.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.202+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:13.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.202+0000 7f18db7fe640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 msgr2=0x7f18c8009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:13.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.202+0000 7f18db7fe640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 msgr2=0x7f18c8009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:13.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.202+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:13.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.202+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:47:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276826304 0 0) 0x7f18dc0c60f0 con 0x7f18c80036e0 2023-11-28T20:47:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c4003530 con 0x7f18c80036e0 2023-11-28T20:47:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3275480088 0 0) 0x7f18c4003530 con 0x7f18c80036e0 2023-11-28T20:47:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 msgr2=0x7f18c8009850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:13.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 --2- 172.21.15.167:0/3004881973 >> v2:172.21.15.167:3300/0 conn(0x7f18c8007390 0x7f18c8009850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c800af80 con 0x7f18c80036e0 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f18cc00e510 con 0x7f18c80036e0 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 >> v1:172.21.15.167:6789/0 conn(0x7f18c80036e0 legacy=0x7f18c8005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18e0af4640 1 -- 172.21.15.167:0/3004881973 reap_dead start 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18c4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40047d0 0x7f18c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40052b0 0x7f18c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc0c2df0 con 0x7f18c4003980 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c400c200 con 0x7f18c40047d0 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c400c3c0 con 0x7f18c40052b0 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18c4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:13.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40047d0 0x7f18c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:13.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40052b0 0x7f18c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:13.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40052b0 msgr2=0x7f18c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:13.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40052b0 0x7f18c400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40047d0 msgr2=0x7f18c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:13.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40047d0 0x7f18c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18dbfff640 1 -- 172.21.15.167:0/3004881973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4003530 con 0x7f18c4003980 2023-11-28T20:47:13.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.478+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40047d0 0x7f18c4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:47:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18c4003d80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f18cc000ee0 tx=0x7f18cc01d8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c2acb29ea8add3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0ac660 con 0x7f18c4003980 2023-11-28T20:47:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc00c040 con 0x7f18c4003980 2023-11-28T20:47:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18daffd640 1 -- 172.21.15.167:0/3004881973 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0aca20 con 0x7f18c4003980 2023-11-28T20:47:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18e2557640 1 -- 172.21.15.167:0/3004881973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 msgr2=0x7f18c4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18e2557640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18c4003d80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f18cc000ee0 tx=0x7f18cc01d8b0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18e2557640 1 -- 172.21.15.167:0/3004881973 shutdown_connections 2023-11-28T20:47:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18e2557640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40052b0 0x7f18c400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18e2557640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40047d0 0x7f18c4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18e2557640 1 --2- 172.21.15.167:0/3004881973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18c4003d80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18e2557640 1 -- 172.21.15.167:0/3004881973 >> 172.21.15.167:0/3004881973 conn(0x7f18dc0cb1e0 msgr2=0x7f18dc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18e2557640 1 -- 172.21.15.167:0/3004881973 shutdown_connections 2023-11-28T20:47:13.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.482+0000 7f18e2557640 1 -- 172.21.15.167:0/3004881973 wait complete. 2023-11-28T20:47:13.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e2557640 1 Processor -- start 2023-11-28T20:47:13.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e2557640 1 -- start start 2023-11-28T20:47:13.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e2557640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18dc145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:13.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e2557640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40047d0 0x7f18dc143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:13.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e2557640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40052b0 0x7f18dc159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:13.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e2557640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc159200 con 0x7f18c4003980 2023-11-28T20:47:13.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e2557640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc15adf0 con 0x7f18c40052b0 2023-11-28T20:47:13.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e2557640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc15ab30 con 0x7f18c40047d0 2023-11-28T20:47:13.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18dc145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:13.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18dc145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57784/0 (socket says 172.21.15.167:57784) 2023-11-28T20:47:13.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18dbfff640 1 -- 172.21.15.167:0/3936509770 learned_addr learned my addr 172.21.15.167:0/3936509770 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:13.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40047d0 0x7f18dc143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:13.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e0af4640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40052b0 0x7f18dc159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:13.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18db7fe640 1 -- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40047d0 msgr2=0x7f18dc143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:47:13.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18db7fe640 1 -- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40047d0 msgr2=0x7f18dc143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:47:13.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40047d0 0x7f18dc143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:13.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18dbfff640 1 -- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40047d0 msgr2=0x7f18dc143fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:47:13.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40047d0 0x7f18dc143fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:13.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40047d0 0x7f18dc143fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18dbfff640 1 -- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40052b0 msgr2=0x7f18dc159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:13.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40052b0 0x7f18dc159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18dbfff640 1 -- 172.21.15.167:0/3936509770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc1eef80 con 0x7f18c4003980 2023-11-28T20:47:13.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18dbfff640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18dc145610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f18cc01d6e0 tx=0x7f18c4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:13.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18d8ff9640 1 -- 172.21.15.167:0/3936509770 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0ac660 con 0x7f18c4003980 2023-11-28T20:47:13.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18d8ff9640 1 -- 172.21.15.167:0/3936509770 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc0ac7c0 con 0x7f18c4003980 2023-11-28T20:47:13.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc1ef260 con 0x7f18c4003980 2023-11-28T20:47:13.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.486+0000 7f18d8ff9640 1 -- 172.21.15.167:0/3936509770 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0acb70 con 0x7f18c4003980 2023-11-28T20:47:13.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.490+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc144520 con 0x7f18c4003980 2023-11-28T20:47:13.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.490+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc0682c0 con 0x7f18c4003980 2023-11-28T20:47:13.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.490+0000 7f18d8ff9640 1 -- 172.21.15.167:0/3936509770 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18cc0accd0 con 0x7f18c4003980 2023-11-28T20:47:13.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.490+0000 7f18d8ff9640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18c8066c40 0x7f18c8069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:13.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.490+0000 7f18d8ff9640 1 -- 172.21.15.167:0/3936509770 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f18cc11f6b0 con 0x7f18c4003980 2023-11-28T20:47:13.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.490+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18c8066c40 0x7f18c8069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:13.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.494+0000 7f18db7fe640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18c8066c40 0x7f18c8069100 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18d0007fd0 tx=0x7f18d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:13.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.494+0000 7f18d8ff9640 1 -- 172.21.15.167:0/3936509770 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18cc0ec720 con 0x7f18c4003980 2023-11-28T20:47:13.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.726+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f18dc0682c0 con 0x7f18c4003980 2023-11-28T20:47:13.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18d8ff9640 1 -- 172.21.15.167:0/3936509770 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f18cc0efd40 con 0x7f18c4003980 2023-11-28T20:47:13.728 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":72,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:47:13.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18c8066c40 msgr2=0x7f18c8069100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:13.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18c8066c40 0x7f18c8069100 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18d0007fd0 tx=0x7f18d0009040 comp rx=0 tx=0).stop 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 msgr2=0x7f18dc145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18dc145610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f18cc01d6e0 tx=0x7f18c4005800 comp rx=0 tx=0).stop 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 shutdown_connections 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18c8066c40 0x7f18c8069100 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18c40052b0 0x7f18dc159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18c40047d0 0x7f18dc143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 --2- 172.21.15.167:0/3936509770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18c4003980 0x7f18dc145610 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 >> 172.21.15.167:0/3936509770 conn(0x7f18dc0cb1e0 msgr2=0x7f18dc0c2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 shutdown_connections 2023-11-28T20:47:13.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:13.730+0000 7f18e2557640 1 -- 172.21.15.167:0/3936509770 wait complete. 2023-11-28T20:47:16.749 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:47:16.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc37db8640 1 Processor -- start 2023-11-28T20:47:16.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc37db8640 1 -- start start 2023-11-28T20:47:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc37db8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc37db8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc301571d0 con 0x7fdc30070480 2023-11-28T20:47:16.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc37db8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc30071a90 con 0x7fdc30072630 2023-11-28T20:47:16.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc37db8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300c70d0 con 0x7fdc3006e030 2023-11-28T20:47:16.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc35353640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fdc30070480 0x7fdc30071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55898/0 (socket says 172.21.15.167:55898) 2023-11-28T20:47:16.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc35353640 1 -- 172.21.15.167:0/2501017411 learned_addr learned my addr 172.21.15.167:0/2501017411 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:47:16.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:16.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc301500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:16.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc301500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:16.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:16.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:16.894+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:17.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.098+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:17.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.098+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc301500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:17.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.098+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc301500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:17.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.098+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:17.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.098+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:47:17.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.502+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:17.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.502+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc301500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:17.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.502+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc301500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:17.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.502+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:17.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:17.502+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:47:17.684 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:17.688 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:18.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:18.306+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:18.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:18.306+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc301500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:18.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:18.306+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc301500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:18.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:18.306+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:18.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:18.306+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:47:19.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971976693 0 0) 0x7fdc301571d0 con 0x7fdc30070480 2023-11-28T20:47:19.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc1c003530 con 0x7fdc30070480 2023-11-28T20:47:19.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1959634750 0 0) 0x7fdc1c003530 con 0x7fdc30070480 2023-11-28T20:47:19.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc301500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:19.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc301500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:19.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 >> v1:172.21.15.178:6789/0 conn(0x7fdc30072630 legacy=0x7fdc30160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:19.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300c73b0 con 0x7fdc30070480 2023-11-28T20:47:19.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fdc20001680 con 0x7fdc30070480 2023-11-28T20:47:19.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 >> v1:172.21.15.167:6789/0 conn(0x7fdc30070480 legacy=0x7fdc30071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:19.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:19.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:19.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc1c004d10 0x7fdc1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:19.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300c70d0 con 0x7fdc1c0039b0 2023-11-28T20:47:19.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c00dd80 con 0x7fdc1c004d10 2023-11-28T20:47:19.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c00df40 con 0x7fdc3006e030 2023-11-28T20:47:19.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:19.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc36355640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc1c004d10 0x7fdc1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:19.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc35353640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:19.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 msgr2=0x7fdc1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:19.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3006e030 0x7fdc1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc1c004d10 msgr2=0x7fdc1c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc1c004d10 0x7fdc1c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.458+0000 7fdc35b54640 1 -- 172.21.15.167:0/2501017411 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c003530 con 0x7fdc1c0039b0 2023-11-28T20:47:19.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc35b54640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc1c003dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c012bd0 tx=0x7fdc2c01d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0309a2c6d1ae1a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0a6810 con 0x7fdc1c0039b0 2023-11-28T20:47:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c0a6990 con 0x7fdc1c0039b0 2023-11-28T20:47:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc34b52640 1 -- 172.21.15.167:0/2501017411 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0a6d40 con 0x7fdc1c0039b0 2023-11-28T20:47:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc37db8640 1 -- 172.21.15.167:0/2501017411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 msgr2=0x7fdc1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:19.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc37db8640 1 --2- 172.21.15.167:0/2501017411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc1c003dd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c012bd0 tx=0x7fdc2c01d840 comp rx=0 tx=0).stop 2023-11-28T20:47:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc36355640 1 -- 172.21.15.167:0/2501017411 reap_dead start 2023-11-28T20:47:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc37db8640 1 -- 172.21.15.167:0/2501017411 shutdown_connections 2023-11-28T20:47:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc37db8640 1 -- 172.21.15.167:0/2501017411 >> 172.21.15.167:0/2501017411 conn(0x7fdc300cb1e0 msgr2=0x7fdc300cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc37db8640 1 -- 172.21.15.167:0/2501017411 shutdown_connections 2023-11-28T20:47:19.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.462+0000 7fdc37db8640 1 -- 172.21.15.167:0/2501017411 wait complete. 2023-11-28T20:47:19.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc37db8640 1 Processor -- start 2023-11-28T20:47:19.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc37db8640 1 -- start start 2023-11-28T20:47:19.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc37db8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc3014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:19.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc37db8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc30157d50 0x7fdc30158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc37db8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc30158860 0x7fdc30150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc37db8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30152ed0 con 0x7fdc1c0039b0 2023-11-28T20:47:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc37db8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30153140 con 0x7fdc30157d50 2023-11-28T20:47:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc37db8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30153420 con 0x7fdc30158860 2023-11-28T20:47:19.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35b54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc3014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:19.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35b54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc3014efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57802/0 (socket says 172.21.15.167:57802) 2023-11-28T20:47:19.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35b54640 1 -- 172.21.15.167:0/3359432547 learned_addr learned my addr 172.21.15.167:0/3359432547 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:19.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35353640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc30157d50 0x7fdc30158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:19.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc36355640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc30158860 0x7fdc30150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:19.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35b54640 1 -- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc30158860 msgr2=0x7fdc30150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:19.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35b54640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc30158860 0x7fdc30150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:19.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35b54640 1 -- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc30157d50 msgr2=0x7fdc30158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:19.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35b54640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc30157d50 0x7fdc30158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:19.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35b54640 1 -- 172.21.15.167:0/3359432547 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc30153700 con 0x7fdc1c0039b0 2023-11-28T20:47:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc35b54640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc3014efe0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c01d670 tx=0x7fdc1c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.466+0000 7fdc267fc640 1 -- 172.21.15.167:0/3359432547 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0ae640 con 0x7fdc1c0039b0 2023-11-28T20:47:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.470+0000 7fdc267fc640 1 -- 172.21.15.167:0/3359432547 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c0ae7a0 con 0x7fdc1c0039b0 2023-11-28T20:47:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.470+0000 7fdc267fc640 1 -- 172.21.15.167:0/3359432547 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0aeb30 con 0x7fdc1c0039b0 2023-11-28T20:47:19.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.470+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc301539e0 con 0x7fdc1c0039b0 2023-11-28T20:47:19.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.470+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc30151480 con 0x7fdc1c0039b0 2023-11-28T20:47:19.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.470+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc300682c0 con 0x7fdc1c0039b0 2023-11-28T20:47:19.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.470+0000 7fdc267fc640 1 -- 172.21.15.167:0/3359432547 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdc2c0b5040 con 0x7fdc1c0039b0 2023-11-28T20:47:19.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.470+0000 7fdc267fc640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc140664a0 0x7fdc14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.470+0000 7fdc267fc640 1 -- 172.21.15.167:0/3359432547 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fdc2c11f0e0 con 0x7fdc1c0039b0 2023-11-28T20:47:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.470+0000 7fdc35353640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc140664a0 0x7fdc14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:19.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.474+0000 7fdc35353640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc140664a0 0x7fdc14068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdc20001ec0 tx=0x7fdc20009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:19.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.474+0000 7fdc267fc640 1 -- 172.21.15.167:0/3359432547 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc2c0ec160 con 0x7fdc1c0039b0 2023-11-28T20:47:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdc300682c0 con 0x7fdc1c0039b0 2023-11-28T20:47:19.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc267fc640 1 -- 172.21.15.167:0/3359432547 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7fdc2c00b040 con 0x7fdc1c0039b0 2023-11-28T20:47:19.717 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":76,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:47:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc140664a0 msgr2=0x7fdc14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc140664a0 0x7fdc14068960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdc20001ec0 tx=0x7fdc20009040 comp rx=0 tx=0).stop 2023-11-28T20:47:19.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 msgr2=0x7fdc3014efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc3014efe0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c01d670 tx=0x7fdc1c005800 comp rx=0 tx=0).stop 2023-11-28T20:47:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 shutdown_connections 2023-11-28T20:47:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdc140664a0 0x7fdc14068960 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc30158860 0x7fdc30150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc30157d50 0x7fdc30158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 --2- 172.21.15.167:0/3359432547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc1c0039b0 0x7fdc3014efe0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.718+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 >> 172.21.15.167:0/3359432547 conn(0x7fdc300cb1e0 msgr2=0x7fdc300c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:19.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.722+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 shutdown_connections 2023-11-28T20:47:19.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:19.722+0000 7fdc37db8640 1 -- 172.21.15.167:0/3359432547 wait complete. 2023-11-28T20:47:22.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:47:22.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.890+0000 7f03fadaa640 1 Processor -- start 2023-11-28T20:47:22.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.890+0000 7f03fadaa640 1 -- start start 2023-11-28T20:47:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03fadaa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f03f40c6ff0 0x7f03f4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03fadaa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f03f40c4510 0x7f03f406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03fadaa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f40c48f0 con 0x7f03f4150b40 2023-11-28T20:47:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03fadaa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f40c62f0 con 0x7f03f40c4510 2023-11-28T20:47:22.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03fadaa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f40c6ac0 con 0x7f03f40c6ff0 2023-11-28T20:47:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03f9347640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f03f40c4510 0x7f03f406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03f8b46640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f03f4150b40 0x7f03f40c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:54458/0 (socket says 172.21.15.167:54458) 2023-11-28T20:47:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03f8b46640 1 -- 172.21.15.167:0/534190295 learned_addr learned my addr 172.21.15.167:0/534190295 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:47:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03f3fff640 1 --2- 172.21.15.167:0/534190295 >> v2:172.21.15.178:3300/0 conn(0x7f03f40c6ff0 0x7f03f4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03f9347640 1 -- 172.21.15.167:0/534190295 >> v2:172.21.15.178:3300/0 conn(0x7f03f40c6ff0 msgr2=0x7f03f4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03f9347640 1 --2- 172.21.15.167:0/534190295 >> v2:172.21.15.178:3300/0 conn(0x7f03f40c6ff0 0x7f03f4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03f9347640 1 -- 172.21.15.167:0/534190295 >> v1:172.21.15.178:6789/0 conn(0x7f03f4150b40 legacy=0x7f03f40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:22.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.894+0000 7f03f9347640 1 -- 172.21.15.167:0/534190295 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40c6500 con 0x7f03f40c4510 2023-11-28T20:47:22.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03f9347640 1 --2- 172.21.15.167:0/534190295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 0x7f03f406a580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f03f406bba0 tx=0x7f03ec01eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6e954b18603df3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:22.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03f37fe640 1 -- 172.21.15.167:0/534190295 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0a79d0 con 0x7f03f40c4510 2023-11-28T20:47:22.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03f37fe640 1 -- 172.21.15.167:0/534190295 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec0a7b30 con 0x7f03f40c4510 2023-11-28T20:47:22.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03f37fe640 1 -- 172.21.15.167:0/534190295 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0af440 con 0x7f03f40c4510 2023-11-28T20:47:22.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 -- 172.21.15.167:0/534190295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 msgr2=0x7f03f406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:22.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 --2- 172.21.15.167:0/534190295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 0x7f03f406a580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f03f406bba0 tx=0x7f03ec01eaf0 comp rx=0 tx=0).stop 2023-11-28T20:47:22.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 -- 172.21.15.167:0/534190295 shutdown_connections 2023-11-28T20:47:22.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 --2- 172.21.15.167:0/534190295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 0x7f03f406a580 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:22.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 --2- 172.21.15.167:0/534190295 >> v2:172.21.15.178:3300/0 conn(0x7f03f40c6ff0 0x7f03f4157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:22.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 -- 172.21.15.167:0/534190295 >> 172.21.15.167:0/534190295 conn(0x7f03f40cb1e0 msgr2=0x7f03f40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:22.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 -- 172.21.15.167:0/534190295 shutdown_connections 2023-11-28T20:47:22.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 -- 172.21.15.167:0/534190295 wait complete. 2023-11-28T20:47:22.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 Processor -- start 2023-11-28T20:47:22.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.898+0000 7f03fadaa640 1 -- start start 2023-11-28T20:47:22.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03fadaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 0x7f03f414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:22.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03fadaa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40c6ff0 0x7f03f4151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:22.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03fadaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4150b40 0x7f03f414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:22.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03fadaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41f7160 con 0x7f03f40c4510 2023-11-28T20:47:22.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03fadaa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f414e640 con 0x7f03f40c6ff0 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03fadaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f414fec0 con 0x7f03f4150b40 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f8b46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 0x7f03f414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f8b46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 0x7f03f414f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46176/0 (socket says 172.21.15.167:46176) 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f8b46640 1 -- 172.21.15.167:0/2429900151 learned_addr learned my addr 172.21.15.167:0/2429900151 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f3fff640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40c6ff0 0x7f03f4151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f9347640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4150b40 0x7f03f414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f8b46640 1 -- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4150b40 msgr2=0x7f03f414ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f8b46640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4150b40 0x7f03f414ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f8b46640 1 -- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40c6ff0 msgr2=0x7f03f4151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:22.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f8b46640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40c6ff0 0x7f03f4151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:22.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f8b46640 1 -- 172.21.15.167:0/2429900151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec009a70 con 0x7f03f40c4510 2023-11-28T20:47:22.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f8b46640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 0x7f03f414f980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f03e8007fd0 tx=0x7f03e800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f17fa640 1 -- 172.21.15.167:0/2429900151 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8005cf0 con 0x7f03f40c4510 2023-11-28T20:47:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f17fa640 1 -- 172.21.15.167:0/2429900151 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8005e70 con 0x7f03f40c4510 2023-11-28T20:47:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f41f6c20 con 0x7f03f40c4510 2023-11-28T20:47:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03f17fa640 1 -- 172.21.15.167:0/2429900151 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80072f0 con 0x7f03f40c4510 2023-11-28T20:47:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f41f6f10 con 0x7f03f40c4510 2023-11-28T20:47:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.902+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f40682c0 con 0x7f03f40c4510 2023-11-28T20:47:22.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.906+0000 7f03f17fa640 1 -- 172.21.15.167:0/2429900151 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f03e8007450 con 0x7f03f40c4510 2023-11-28T20:47:22.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.906+0000 7f03f17fa640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03d8066470 0x7f03d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:22.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.906+0000 7f03f17fa640 1 -- 172.21.15.167:0/2429900151 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f03e80837c0 con 0x7f03f40c4510 2023-11-28T20:47:22.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.906+0000 7f03f3fff640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03d8066470 0x7f03d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:22.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.906+0000 7f03f3fff640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03d8066470 0x7f03d8068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f03f40caf30 tx=0x7f03e0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:22.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:22.910+0000 7f03f17fa640 1 -- 172.21.15.167:0/2429900151 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f03e8050870 con 0x7f03f40c4510 2023-11-28T20:47:23.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f03f4075c90 con 0x7f03f40c4510 2023-11-28T20:47:23.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03f17fa640 1 -- 172.21.15.167:0/2429900151 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7f03e8017620 con 0x7f03f40c4510 2023-11-28T20:47:23.113 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":80,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:47:23.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03d8066470 msgr2=0x7f03d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03d8066470 0x7f03d8068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f03f40caf30 tx=0x7f03e0009190 comp rx=0 tx=0).stop 2023-11-28T20:47:23.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 msgr2=0x7f03f414f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 0x7f03f414f980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f03e8007fd0 tx=0x7f03e800c890 comp rx=0 tx=0).stop 2023-11-28T20:47:23.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 shutdown_connections 2023-11-28T20:47:23.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f03d8066470 0x7f03d8068930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4150b40 0x7f03f414ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40c6ff0 0x7f03f4151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 --2- 172.21.15.167:0/2429900151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f40c4510 0x7f03f414f980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 >> 172.21.15.167:0/2429900151 conn(0x7f03f40cb1e0 msgr2=0x7f03f415f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:23.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 shutdown_connections 2023-11-28T20:47:23.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.114+0000 7f03fadaa640 1 -- 172.21.15.167:0/2429900151 wait complete. 2023-11-28T20:47:23.135 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:47:23.135 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:47:23.135 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:47:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.274+0000 7f992810f640 1 Processor -- start 2023-11-28T20:47:23.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.274+0000 7f992810f640 1 -- start start 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f992810f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992015d770 0x7f992015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f992810f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f992006a580 0x7f992006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f992810f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992015ada0 con 0x7f9920153fa0 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f992810f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992015e0f0 con 0x7f992006a580 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f992810f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9920159f40 con 0x7f992015d770 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f99266ac640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f992006a580 0x7f992006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f99256aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992015d770 0x7f992015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f99256aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992015d770 0x7f992015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:39518/0 (socket says 172.21.15.167:39518) 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f99266ac640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f992006a580 0x7f992006aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41992/0 (socket says 172.21.15.167:41992) 2023-11-28T20:47:23.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f99256aa640 1 -- 172.21.15.167:0/750416664 learned_addr learned my addr 172.21.15.167:0/750416664 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:23.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f99256aa640 1 -- 172.21.15.167:0/750416664 >> v2:172.21.15.178:3300/0 conn(0x7f992006a580 msgr2=0x7f992006aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:23.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f99256aa640 1 --2- 172.21.15.167:0/750416664 >> v2:172.21.15.178:3300/0 conn(0x7f992006a580 0x7f992006aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f99256aa640 1 -- 172.21.15.167:0/750416664 >> v1:172.21.15.178:6789/0 conn(0x7f9920153fa0 legacy=0x7f99200c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.278+0000 7f99256aa640 1 -- 172.21.15.167:0/750416664 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992015a220 con 0x7f992015d770 2023-11-28T20:47:23.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f99256aa640 1 --2- 172.21.15.167:0/750416664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992015d770 0x7f992015dbb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9910009870 tx=0x7f991001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90f4bdfda3fa0402 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f9924ea9640 1 -- 172.21.15.167:0/750416664 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100aa670 con 0x7f992015d770 2023-11-28T20:47:23.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f9924ea9640 1 -- 172.21.15.167:0/750416664 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99100aa7d0 con 0x7f992015d770 2023-11-28T20:47:23.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f9924ea9640 1 -- 172.21.15.167:0/750416664 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100aab60 con 0x7f992015d770 2023-11-28T20:47:23.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 -- 172.21.15.167:0/750416664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992015d770 msgr2=0x7f992015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 --2- 172.21.15.167:0/750416664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992015d770 0x7f992015dbb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9910009870 tx=0x7f991001c510 comp rx=0 tx=0).stop 2023-11-28T20:47:23.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 -- 172.21.15.167:0/750416664 shutdown_connections 2023-11-28T20:47:23.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 --2- 172.21.15.167:0/750416664 >> v2:172.21.15.178:3300/0 conn(0x7f992006a580 0x7f992006aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 --2- 172.21.15.167:0/750416664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992015d770 0x7f992015dbb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 -- 172.21.15.167:0/750416664 >> 172.21.15.167:0/750416664 conn(0x7f99200cb1e0 msgr2=0x7f99200cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:23.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 -- 172.21.15.167:0/750416664 shutdown_connections 2023-11-28T20:47:23.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 -- 172.21.15.167:0/750416664 wait complete. 2023-11-28T20:47:23.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 Processor -- start 2023-11-28T20:47:23.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.282+0000 7f992810f640 1 -- start start 2023-11-28T20:47:23.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992006a580 0x7f99200c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9920153fa0 0x7f99200ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992015d770 0x7f992013ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200c5350 con 0x7f992015d770 2023-11-28T20:47:23.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992014f260 con 0x7f9920153fa0 2023-11-28T20:47:23.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200ca1d0 con 0x7f992006a580 2023-11-28T20:47:23.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99266ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992015d770 0x7f992013ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99266ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992015d770 0x7f992013ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46178/0 (socket says 172.21.15.167:46178) 2023-11-28T20:47:23.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99266ac640 1 -- 172.21.15.167:0/1296580807 learned_addr learned my addr 172.21.15.167:0/1296580807 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:23.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99256aa640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9920153fa0 0x7f99200ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f9925eab640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992006a580 0x7f99200c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99266ac640 1 -- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992006a580 msgr2=0x7f99200c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99266ac640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f992006a580 0x7f99200c4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99266ac640 1 -- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9920153fa0 msgr2=0x7f99200ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99266ac640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9920153fa0 0x7f99200ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99266ac640 1 -- 172.21.15.167:0/1296580807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100094d0 con 0x7f992015d770 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99266ac640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992015d770 0x7f992013ea50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f991800efc0 tx=0x7f991800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991800ced0 con 0x7f992015d770 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991800f040 con 0x7f992015d770 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180146c0 con 0x7f992015d770 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99200c9180 con 0x7f992015d770 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9920142a70 con 0x7f992015d770 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200c9dc0 0x7f992013ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992013f4d0 con 0x7f99200c9dc0 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f9925eab640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200c9dc0 0x7f992013ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f9925eab640 1 -- 172.21.15.167:0/1296580807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99200c7920 con 0x7f99200c9dc0 2023-11-28T20:47:23.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f9925eab640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200c9dc0 0x7f992013ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f991c00f540 tx=0x7f991c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.286+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9918014820 con 0x7f992015d770 2023-11-28T20:47:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99167fc640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9904066470 0x7f9904068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c005320 con 0x7f99200c9dc0 2023-11-28T20:47:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9918085040 con 0x7f992015d770 2023-11-28T20:47:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f991c005480 con 0x7f99200c9dc0 2023-11-28T20:47:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200c9dc0 msgr2=0x7f992013ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99167fc640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200c9dc0 0x7f992013ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f991c00f540 tx=0x7f991c00fa00 comp rx=0 tx=0).stop 2023-11-28T20:47:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200c9dc0 msgr2=0x7f992013ef90 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:23.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99167fc640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200c9dc0 0x7f992013ef90 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f991c00f540 tx=0x7f991c00fa00 comp rx=0 tx=0).stop 2023-11-28T20:47:23.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99256aa640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9904066470 0x7f9904068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.290+0000 7f99256aa640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9904066470 0x7f9904068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99100ae000 tx=0x7f99100a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f992810f640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200caba0 0x7f992014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920074770 con 0x7f99200caba0 2023-11-28T20:47:23.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f9925eab640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200caba0 0x7f992014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f9925eab640 1 -- 172.21.15.167:0/1296580807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f99200682c0 con 0x7f99200caba0 2023-11-28T20:47:23.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f9925eab640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200caba0 0x7f992014f7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f991c016000 tx=0x7f991c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c023070 con 0x7f99200caba0 2023-11-28T20:47:23.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7f991c007550 con 0x7f99200caba0 2023-11-28T20:47:23.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200caba0 msgr2=0x7f992014f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f99167fc640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200caba0 0x7f992014f7a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f991c016000 tx=0x7f991c007f90 comp rx=0 tx=0).stop 2023-11-28T20:47:23.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f99167fc640 1 -- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200caba0 msgr2=0x7f992014f7a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:23.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.294+0000 7f99167fc640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99200caba0 0x7f992014f7a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.298 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:47:23.298 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:23.298 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 80, 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:23.299 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:47:23.300 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:47:23.302 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:23.303 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:23.304 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:23.306 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.307 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.308 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.309 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.310 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.312 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:47:23.312 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:47:23.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9904066470 msgr2=0x7f9904068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f992810f640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9904066470 0x7f9904068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99100ae000 tx=0x7f99100a7000 comp rx=0 tx=0).stop 2023-11-28T20:47:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992015d770 msgr2=0x7f992013ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f992810f640 1 --2- 172.21.15.167:0/1296580807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f992015d770 0x7f992013ea50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f991800efc0 tx=0x7f991800c490 comp rx=0 tx=0).stop 2023-11-28T20:47:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f99266ac640 1 -- 172.21.15.167:0/1296580807 reap_dead start 2023-11-28T20:47:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f99266ac640 1 -- 172.21.15.167:0/1296580807 reap_dead start 2023-11-28T20:47:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 shutdown_connections 2023-11-28T20:47:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 >> 172.21.15.167:0/1296580807 conn(0x7f99200cb1e0 msgr2=0x7f9920071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 shutdown_connections 2023-11-28T20:47:23.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.298+0000 7f992810f640 1 -- 172.21.15.167:0/1296580807 wait complete. 2023-11-28T20:47:23.314 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:47:23.315 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:47:23.315 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:47:23.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f568b92a640 1 Processor -- start 2023-11-28T20:47:23.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f568b92a640 1 -- start start 2023-11-28T20:47:23.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f568b92a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f56840cf860 0x7f56840cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f568b92a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568415ac00 con 0x7f56840cfc40 2023-11-28T20:47:23.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f568b92a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56840cbd60 con 0x7f5684153ae0 2023-11-28T20:47:23.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f568b92a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5684159ff0 con 0x7f56840cf860 2023-11-28T20:47:23.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f56896c6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f56840cf860 0x7f56840cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f56896c6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f56840cf860 0x7f56840cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46200/0 (socket says 172.21.15.167:46200) 2023-11-28T20:47:23.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f56896c6640 1 -- 172.21.15.167:0/1223611736 learned_addr learned my addr 172.21.15.167:0/1223611736 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:23.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f5688ec5640 1 --1- 172.21.15.167:0/1223611736 >> v1:172.21.15.167:6789/0 conn(0x7f56840cfc40 0x7f56840ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:41646/0 (socket says 172.21.15.167:41646) 2023-11-28T20:47:23.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f56896c6640 1 -- 172.21.15.167:0/1223611736 >> v1:172.21.15.178:6789/0 conn(0x7f5684153ae0 legacy=0x7f568415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:23.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f56896c6640 1 -- 172.21.15.167:0/1223611736 >> v1:172.21.15.167:6789/0 conn(0x7f56840cfc40 legacy=0x7f56840ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f56896c6640 1 -- 172.21.15.167:0/1223611736 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568415a2d0 con 0x7f56840cf860 2023-11-28T20:47:23.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.462+0000 7f567bfff640 1 -- 172.21.15.167:0/1223611736 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631090177 0 0) 0x7f568415ac00 con 0x7f56840cfc40 2023-11-28T20:47:23.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f56896c6640 1 --2- 172.21.15.167:0/1223611736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cf860 0x7f56840cb770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5680009870 tx=0x7f568001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151cbddacf76499d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f567bfff640 1 -- 172.21.15.167:0/1223611736 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800aa670 con 0x7f56840cf860 2023-11-28T20:47:23.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f567bfff640 1 -- 172.21.15.167:0/1223611736 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56800aa7d0 con 0x7f56840cf860 2023-11-28T20:47:23.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f567bfff640 1 -- 172.21.15.167:0/1223611736 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800aab60 con 0x7f56840cf860 2023-11-28T20:47:23.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f568b92a640 1 -- 172.21.15.167:0/1223611736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cf860 msgr2=0x7f56840cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f568b92a640 1 --2- 172.21.15.167:0/1223611736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cf860 0x7f56840cb770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5680009870 tx=0x7f568001c510 comp rx=0 tx=0).stop 2023-11-28T20:47:23.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f568b92a640 1 -- 172.21.15.167:0/1223611736 shutdown_connections 2023-11-28T20:47:23.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f568b92a640 1 --2- 172.21.15.167:0/1223611736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cf860 0x7f56840cb770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f568b92a640 1 -- 172.21.15.167:0/1223611736 >> 172.21.15.167:0/1223611736 conn(0x7f568406c1f0 msgr2=0x7f5684071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:23.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f568b92a640 1 -- 172.21.15.167:0/1223611736 shutdown_connections 2023-11-28T20:47:23.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f568b92a640 1 -- 172.21.15.167:0/1223611736 wait complete. 2023-11-28T20:47:23.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.466+0000 7f568b92a640 1 Processor -- start 2023-11-28T20:47:23.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 -- start start 2023-11-28T20:47:23.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56840cf860 0x7f568415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cfc40 0x7f56840c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5684153ae0 0x7f56840c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5684159550 con 0x7f56840cfc40 2023-11-28T20:47:23.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5684159320 con 0x7f5684153ae0 2023-11-28T20:47:23.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568414a130 con 0x7f56840cf860 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5688ec5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cfc40 0x7f56840c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5688ec5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cfc40 0x7f56840c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46202/0 (socket says 172.21.15.167:46202) 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5688ec5640 1 -- 172.21.15.167:0/1707436781 learned_addr learned my addr 172.21.15.167:0/1707436781 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f56896c6640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56840cf860 0x7f568415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5689ec7640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5684153ae0 0x7f56840c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5688ec5640 1 -- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56840cf860 msgr2=0x7f568415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5688ec5640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56840cf860 0x7f568415c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5688ec5640 1 -- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5684153ae0 msgr2=0x7f56840c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5688ec5640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5684153ae0 0x7f56840c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5688ec5640 1 -- 172.21.15.167:0/1707436781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56800094d0 con 0x7f56840cfc40 2023-11-28T20:47:23.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5688ec5640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cfc40 0x7f56840c8f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f567400c440 tx=0x7f567400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56740074e0 con 0x7f56840cfc40 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5674007640 con 0x7f56840cfc40 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5684154ba0 con 0x7f56840cfc40 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674004a10 con 0x7f56840cfc40 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568414a660 con 0x7f56840cfc40 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840c9470 0x7f56840c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5684072860 con 0x7f56840c9470 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.470+0000 7f56896c6640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840c9470 0x7f56840c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5674004b70 con 0x7f56840cfc40 2023-11-28T20:47:23.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f56896c6640 1 -- 172.21.15.167:0/1707436781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5684154300 con 0x7f56840c9470 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f56896c6640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840c9470 0x7f56840c7a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f56840c9c50 tx=0x7f568001ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5679ffb640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5668066470 0x7f5668068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f56740836c0 con 0x7f56840cfc40 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800aad80 con 0x7f56840c9470 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5689ec7640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5668066470 0x7f5668068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f56800bd410 con 0x7f56840c9470 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840c9470 msgr2=0x7f56840c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5679ffb640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840c9470 0x7f56840c7a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f56840c9c50 tx=0x7f568001ad50 comp rx=0 tx=0).stop 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840c9470 msgr2=0x7f56840c7a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5679ffb640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840c9470 0x7f56840c7a00 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f56840c9c50 tx=0x7f568001ad50 comp rx=0 tx=0).stop 2023-11-28T20:47:23.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.474+0000 7f5689ec7640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5668066470 0x7f5668068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56840c9a70 tx=0x7f567c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f568b92a640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840ce4a0 0x7f56840ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5684067c40 con 0x7f56840ce4a0 2023-11-28T20:47:23.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f56896c6640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840ce4a0 0x7f56840ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f56896c6640 1 -- 172.21.15.167:0/1707436781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f56840c7190 con 0x7f56840ce4a0 2023-11-28T20:47:23.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f56896c6640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840ce4a0 0x7f56840ce8b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5680019120 tx=0x7f5680009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680004240 con 0x7f56840ce4a0 2023-11-28T20:47:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5122 (secure 0 0 0) 0x7f56800043a0 con 0x7f56840ce4a0 2023-11-28T20:47:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840ce4a0 msgr2=0x7f56840ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f5679ffb640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840ce4a0 0x7f56840ce8b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5680019120 tx=0x7f5680009240 comp rx=0 tx=0).stop 2023-11-28T20:47:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f5679ffb640 1 -- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840ce4a0 msgr2=0x7f56840ce8b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:23.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f5679ffb640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56840ce4a0 0x7f56840ce8b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.484 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:47:23.484 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:23.484 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:23.484 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:47:23.484 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 80, 2023-11-28T20:47:23.484 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:23.485 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:47:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:47:23.486 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:23.487 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:47:23.488 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:23.489 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.490 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:47:23.491 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:23.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.495 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.496 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.497 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:47:23.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.497 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.497 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:47:23.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.498 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.503 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.503 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 7 2023-11-28T20:47:23.503 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.503 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.503 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.504 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.505 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.505 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:23.505 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.505 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.505 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:47:23.505 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:47:23.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5668066470 msgr2=0x7f5668068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f568b92a640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5668066470 0x7f5668068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56840c9a70 tx=0x7f567c009040 comp rx=0 tx=0).stop 2023-11-28T20:47:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cfc40 msgr2=0x7f56840c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f568b92a640 1 --2- 172.21.15.167:0/1707436781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56840cfc40 0x7f56840c8f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f567400c440 tx=0x7f567400c900 comp rx=0 tx=0).stop 2023-11-28T20:47:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f5689ec7640 1 -- 172.21.15.167:0/1707436781 reap_dead start 2023-11-28T20:47:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f5689ec7640 1 -- 172.21.15.167:0/1707436781 reap_dead start 2023-11-28T20:47:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 shutdown_connections 2023-11-28T20:47:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 >> 172.21.15.167:0/1707436781 conn(0x7f568406c1f0 msgr2=0x7f56841464f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.482+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 shutdown_connections 2023-11-28T20:47:23.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.486+0000 7f568b92a640 1 -- 172.21.15.167:0/1707436781 wait complete. 2023-11-28T20:47:23.507 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:47:23.507 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:47:23.508 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:47:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.646+0000 7f4de2165640 1 Processor -- start 2023-11-28T20:47:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.646+0000 7f4de2165640 1 -- start start 2023-11-28T20:47:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4de2165640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0c75c0 0x7f4ddc0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4de2165640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4ddc06a580 0x7f4ddc06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4de2165640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc15b220 con 0x7f4ddc151f60 2023-11-28T20:47:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4de2165640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c4da0 con 0x7f4ddc06a580 2023-11-28T20:47:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4de2165640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c2df0 con 0x7f4ddc0c75c0 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4ddb7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4ddc151f60 0x7f4ddc0c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:41650/0 (socket says 172.21.15.167:41650) 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4ddb7fe640 1 -- 172.21.15.167:0/510698146 learned_addr learned my addr 172.21.15.167:0/510698146 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4ddbfff640 1 --2- 172.21.15.167:0/510698146 >> v2:172.21.15.167:3300/0 conn(0x7f4ddc06a580 0x7f4ddc06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4ddaffd640 1 --2- 172.21.15.167:0/510698146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0c75c0 0x7f4ddc0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4dda7fc640 1 -- 172.21.15.167:0/510698146 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945613499 0 0) 0x7f4ddc15b220 con 0x7f4ddc151f60 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4dda7fc640 1 -- 172.21.15.167:0/510698146 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc4003530 con 0x7f4ddc151f60 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4ddbfff640 1 -- 172.21.15.167:0/510698146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0c75c0 msgr2=0x7f4ddc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4ddbfff640 1 --2- 172.21.15.167:0/510698146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0c75c0 0x7f4ddc0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4ddbfff640 1 -- 172.21.15.167:0/510698146 >> v1:172.21.15.167:6789/0 conn(0x7f4ddc151f60 legacy=0x7f4ddc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.650+0000 7f4ddbfff640 1 -- 172.21.15.167:0/510698146 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc0c7a20 con 0x7f4ddc06a580 2023-11-28T20:47:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4ddbfff640 1 --2- 172.21.15.167:0/510698146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 0x7f4ddc06a9b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009dc0 tx=0x7f4dd401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4a229cdb25b050 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4dda7fc640 1 -- 172.21.15.167:0/510698146 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40a5870 con 0x7f4ddc06a580 2023-11-28T20:47:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4dda7fc640 1 -- 172.21.15.167:0/510698146 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd40a59d0 con 0x7f4ddc06a580 2023-11-28T20:47:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4dda7fc640 1 -- 172.21.15.167:0/510698146 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40a5d60 con 0x7f4ddc06a580 2023-11-28T20:47:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 -- 172.21.15.167:0/510698146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 msgr2=0x7f4ddc06a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 --2- 172.21.15.167:0/510698146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 0x7f4ddc06a9b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009dc0 tx=0x7f4dd401c8a0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 -- 172.21.15.167:0/510698146 shutdown_connections 2023-11-28T20:47:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 --2- 172.21.15.167:0/510698146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 0x7f4ddc06a9b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 --2- 172.21.15.167:0/510698146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0c75c0 0x7f4ddc0c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 -- 172.21.15.167:0/510698146 >> 172.21.15.167:0/510698146 conn(0x7f4ddc0cb1e0 msgr2=0x7f4ddc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 -- 172.21.15.167:0/510698146 shutdown_connections 2023-11-28T20:47:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 -- 172.21.15.167:0/510698146 wait complete. 2023-11-28T20:47:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 Processor -- start 2023-11-28T20:47:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 -- start start 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 0x7f4ddc1f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0c75c0 0x7f4ddc0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc151f60 0x7f4ddc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1618d0 con 0x7f4ddc06a580 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1f37d0 con 0x7f4ddc151f60 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.654+0000 7f4de2165640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc161310 con 0x7f4ddc0c75c0 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 0x7f4ddc1f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 0x7f4ddc1f3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46214/0 (socket says 172.21.15.167:46214) 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddb7fe640 1 -- 172.21.15.167:0/3438189024 learned_addr learned my addr 172.21.15.167:0/3438189024 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddaffd640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0c75c0 0x7f4ddc0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddbfff640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc151f60 0x7f4ddc157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddb7fe640 1 -- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0c75c0 msgr2=0x7f4ddc0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddb7fe640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0c75c0 0x7f4ddc0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddb7fe640 1 -- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc151f60 msgr2=0x7f4ddc157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddb7fe640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc151f60 0x7f4ddc157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddb7fe640 1 -- 172.21.15.167:0/3438189024 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4009a70 con 0x7f4ddc06a580 2023-11-28T20:47:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddbfff640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc151f60 0x7f4ddc157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:47:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddb7fe640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 0x7f4ddc1f3290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c420 tx=0x7f4dcc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc005cf0 con 0x7f4ddc06a580 2023-11-28T20:47:23.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc005e50 con 0x7f4ddc06a580 2023-11-28T20:47:23.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0072d0 con 0x7f4ddc06a580 2023-11-28T20:47:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc1615f0 con 0x7f4ddc06a580 2023-11-28T20:47:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc156c20 con 0x7f4ddc06a580 2023-11-28T20:47:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4de2165640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc161c50 0x7f4ddc142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc074770 con 0x7f4ddc161c50 2023-11-28T20:47:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddaffd640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc161c50 0x7f4ddc142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4dcc007430 con 0x7f4ddc06a580 2023-11-28T20:47:23.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddaffd640 1 -- 172.21.15.167:0/3438189024 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ddc15ba30 con 0x7f4ddc161c50 2023-11-28T20:47:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.658+0000 7f4ddaffd640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc161c50 0x7f4ddc142a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc155540 tx=0x7f4dd0011e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4dc3fff640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4dc80664a0 0x7f4dc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4dcc083710 con 0x7f4ddc06a580 2023-11-28T20:47:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0004240 con 0x7f4ddc161c50 2023-11-28T20:47:23.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4ddbfff640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4dc80664a0 0x7f4dc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f4dd00043a0 con 0x7f4ddc161c50 2023-11-28T20:47:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc161c50 msgr2=0x7f4ddc142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4dc3fff640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc161c50 0x7f4ddc142a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc155540 tx=0x7f4dd0011e30 comp rx=0 tx=0).stop 2023-11-28T20:47:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc161c50 msgr2=0x7f4ddc142a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4dc3fff640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc161c50 0x7f4ddc142a20 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc155540 tx=0x7f4dd0011e30 comp rx=0 tx=0).stop 2023-11-28T20:47:23.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.662+0000 7f4ddbfff640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4dc80664a0 0x7f4dc8068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40af000 tx=0x7f4dd40a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.666+0000 7f4de2165640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc160ae0 0x7f4ddc142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.666+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1434a0 con 0x7f4ddc160ae0 2023-11-28T20:47:23.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.666+0000 7f4ddaffd640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc160ae0 0x7f4ddc142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.666+0000 7f4ddaffd640 1 -- 172.21.15.167:0/3438189024 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4ddc158750 con 0x7f4ddc160ae0 2023-11-28T20:47:23.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4ddaffd640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc160ae0 0x7f4ddc142f60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc157bd0 tx=0x7f4dd00046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd001e650 con 0x7f4ddc160ae0 2023-11-28T20:47:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4809 (secure 0 0 0) 0x7f4dd0003e80 con 0x7f4ddc160ae0 2023-11-28T20:47:23.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc160ae0 msgr2=0x7f4ddc142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4dc3fff640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc160ae0 0x7f4ddc142f60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc157bd0 tx=0x7f4dd00046d0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4dc3fff640 1 -- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc160ae0 msgr2=0x7f4ddc142f60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:23.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4dc3fff640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc160ae0 0x7f4ddc142f60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.669 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:47:23.669 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:23.669 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:23.669 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:47:23.669 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 80, 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:47:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.678 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:23.679 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:47:23.680 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.681 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.682 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:47:23.683 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:47:23.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4dc80664a0 msgr2=0x7f4dc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4de2165640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4dc80664a0 0x7f4dc8068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40af000 tx=0x7f4dd40a7070 comp rx=0 tx=0).stop 2023-11-28T20:47:23.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 msgr2=0x7f4ddc1f3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4de2165640 1 --2- 172.21.15.167:0/3438189024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ddc06a580 0x7f4ddc1f3290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c420 tx=0x7f4dcc00c8e0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4ddbfff640 1 -- 172.21.15.167:0/3438189024 reap_dead start 2023-11-28T20:47:23.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4ddbfff640 1 -- 172.21.15.167:0/3438189024 reap_dead start 2023-11-28T20:47:23.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 shutdown_connections 2023-11-28T20:47:23.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 >> 172.21.15.167:0/3438189024 conn(0x7f4ddc0cb1e0 msgr2=0x7f4ddc0c3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:23.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 shutdown_connections 2023-11-28T20:47:23.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.670+0000 7f4de2165640 1 -- 172.21.15.167:0/3438189024 wait complete. 2023-11-28T20:47:23.687 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:47:23.687 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:47:23.687 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:47:23.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.826+0000 7f7579180640 1 Processor -- start 2023-11-28T20:47:23.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.826+0000 7f7579180640 1 -- start start 2023-11-28T20:47:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.826+0000 7f7579180640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75740c75c0 0x7f75740c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.826+0000 7f7579180640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757406a580 0x7f757406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.826+0000 7f7579180640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75740c7a50 con 0x7f7574151f60 2023-11-28T20:47:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.826+0000 7f7579180640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757406aed0 con 0x7f75740c75c0 2023-11-28T20:47:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.826+0000 7f7579180640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75740c4da0 con 0x7f757406a580 2023-11-28T20:47:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.826+0000 7f757259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75740c75c0 0x7f75740c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f757259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75740c75c0 0x7f75740c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46216/0 (socket says 172.21.15.167:46216) 2023-11-28T20:47:23.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f757259c640 1 -- 172.21.15.167:0/3080487314 learned_addr learned my addr 172.21.15.167:0/3080487314 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:23.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f757359e640 1 --2- 172.21.15.167:0/3080487314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757406a580 0x7f757406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f757259c640 1 -- 172.21.15.167:0/3080487314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757406a580 msgr2=0x7f757406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:23.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f757259c640 1 --2- 172.21.15.167:0/3080487314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757406a580 0x7f757406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f757259c640 1 -- 172.21.15.167:0/3080487314 >> v1:172.21.15.178:6789/0 conn(0x7f7574151f60 legacy=0x7f75740c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f757259c640 1 -- 172.21.15.167:0/3080487314 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757415b220 con 0x7f75740c75c0 2023-11-28T20:47:23.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f757259c640 1 --2- 172.21.15.167:0/3080487314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 0x7f75740c5c90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7568009870 tx=0x7f756801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd60177b89ce5f5a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f7571d9b640 1 -- 172.21.15.167:0/3080487314 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75680ab600 con 0x7f75740c75c0 2023-11-28T20:47:23.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f7571d9b640 1 -- 172.21.15.167:0/3080487314 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75680a7050 con 0x7f75740c75c0 2023-11-28T20:47:23.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.830+0000 7f7571d9b640 1 -- 172.21.15.167:0/3080487314 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75680ab980 con 0x7f75740c75c0 2023-11-28T20:47:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 -- 172.21.15.167:0/3080487314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 msgr2=0x7f75740c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 --2- 172.21.15.167:0/3080487314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 0x7f75740c5c90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7568009870 tx=0x7f756801c4b0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 -- 172.21.15.167:0/3080487314 shutdown_connections 2023-11-28T20:47:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 --2- 172.21.15.167:0/3080487314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757406a580 0x7f757406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 --2- 172.21.15.167:0/3080487314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 0x7f75740c5c90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 -- 172.21.15.167:0/3080487314 >> 172.21.15.167:0/3080487314 conn(0x7f75740cb1e0 msgr2=0x7f75740cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 -- 172.21.15.167:0/3080487314 shutdown_connections 2023-11-28T20:47:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 -- 172.21.15.167:0/3080487314 wait complete. 2023-11-28T20:47:23.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 Processor -- start 2023-11-28T20:47:23.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 -- start start 2023-11-28T20:47:23.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757406a580 0x7f7574143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 0x7f75741f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7574151f60 0x7f757413fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741f08f0 con 0x7f75740c75c0 2023-11-28T20:47:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741474a0 con 0x7f757406a580 2023-11-28T20:47:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7579180640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7574145970 con 0x7f7574151f60 2023-11-28T20:47:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f757259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 0x7f75741f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f757259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 0x7f75741f0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46230/0 (socket says 172.21.15.167:46230) 2023-11-28T20:47:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f757259c640 1 -- 172.21.15.167:0/168797923 learned_addr learned my addr 172.21.15.167:0/168797923 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f757359e640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7574151f60 0x7f757413fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7572d9d640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757406a580 0x7f7574143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f757259c640 1 -- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7574151f60 msgr2=0x7f757413fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f757259c640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7574151f60 0x7f757413fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f757259c640 1 -- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757406a580 msgr2=0x7f7574143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f757259c640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757406a580 0x7f7574143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f757259c640 1 -- 172.21.15.167:0/168797923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75680094d0 con 0x7f75740c75c0 2023-11-28T20:47:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.834+0000 7f7572d9d640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757406a580 0x7f7574143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:47:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f757259c640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 0x7f75741f0d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75680ae040 tx=0x7f7568019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f755b7fe640 1 -- 172.21.15.167:0/168797923 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75680b4420 con 0x7f75740c75c0 2023-11-28T20:47:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f755b7fe640 1 -- 172.21.15.167:0/168797923 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75680b4580 con 0x7f75740c75c0 2023-11-28T20:47:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f755b7fe640 1 -- 172.21.15.167:0/168797923 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75680b4930 con 0x7f75740c75c0 2023-11-28T20:47:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574145c50 con 0x7f75740c75c0 2023-11-28T20:47:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75741f0510 con 0x7f75740c75c0 2023-11-28T20:47:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75740682c0 con 0x7f75740c75c0 2023-11-28T20:47:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f755b7fe640 1 -- 172.21.15.167:0/168797923 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75680b2070 con 0x7f75740c75c0 2023-11-28T20:47:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f755b7fe640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7560066470 0x7f7560068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.838+0000 7f755b7fe640 1 -- 172.21.15.167:0/168797923 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f756811dcc0 con 0x7f75740c75c0 2023-11-28T20:47:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.842+0000 7f7572d9d640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7560066470 0x7f7560068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.842+0000 7f7572d9d640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7560066470 0x7f7560068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7564000f70 tx=0x7f7564009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:23.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:23.846+0000 7f755b7fe640 1 -- 172.21.15.167:0/168797923 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75680eade0 con 0x7f75740c75c0 2023-11-28T20:47:24.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.046+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f75741f0a30 con 0x7f75740c75c0 2023-11-28T20:47:24.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.050+0000 7f755b7fe640 1 -- 172.21.15.167:0/168797923 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f75741f0a30 con 0x7f75740c75c0 2023-11-28T20:47:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.050+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7560066470 msgr2=0x7f7560068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:24.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.050+0000 7f7579180640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7560066470 0x7f7560068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7564000f70 tx=0x7f7564009040 comp rx=0 tx=0).stop 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.050+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 msgr2=0x7f75741f0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.050+0000 7f7579180640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 0x7f75741f0d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75680ae040 tx=0x7f7568019250 comp rx=0 tx=0).stop 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.054+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 shutdown_connections 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.054+0000 7f7579180640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7560066470 0x7f7560068930 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.054+0000 7f7579180640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7574151f60 0x7f757413fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.054+0000 7f7579180640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75740c75c0 0x7f75741f0d10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.054+0000 7f7579180640 1 --2- 172.21.15.167:0/168797923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757406a580 0x7f7574143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.054+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 >> 172.21.15.167:0/168797923 conn(0x7f75740cb1e0 msgr2=0x7f757414f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.054+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 shutdown_connections 2023-11-28T20:47:24.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:24.054+0000 7f7579180640 1 -- 172.21.15.167:0/168797923 wait complete. 2023-11-28T20:47:24.070 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:47:34.072 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:47:34.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:47:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.218+0000 7feefef01640 1 Processor -- start 2023-11-28T20:47:34.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.218+0000 7feefef01640 1 -- start start 2023-11-28T20:47:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.218+0000 7feefef01640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef80c6ff0 0x7feef8157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.218+0000 7feefef01640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feef80c4510 0x7feef806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.218+0000 7feefef01640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef80c4940 con 0x7feef8150b40 2023-11-28T20:47:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.218+0000 7feefef01640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef80c62f0 con 0x7feef80c4510 2023-11-28T20:47:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.218+0000 7feefef01640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef80c6ac0 con 0x7feef80c6ff0 2023-11-28T20:47:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.218+0000 7feefcc9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7feef8150b40 0x7feef80c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50718/0 (socket says 172.21.15.167:50718) 2023-11-28T20:47:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.218+0000 7feefcc9d640 1 -- 172.21.15.167:0/3344362525 learned_addr learned my addr 172.21.15.167:0/3344362525 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:47:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeeffff640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef80c6ff0 0x7feef8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feefd49e640 1 --2- 172.21.15.167:0/3344362525 >> v2:172.21.15.178:3300/0 conn(0x7feef80c4510 0x7feef806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257385779 0 0) 0x7feef80c4940 con 0x7feef8150b40 2023-11-28T20:47:34.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee0005740 con 0x7feef8150b40 2023-11-28T20:47:34.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3838875003 0 0) 0x7feee0005740 con 0x7feef8150b40 2023-11-28T20:47:34.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef80c6ff0 msgr2=0x7feef8157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef80c6ff0 0x7feef8157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 >> v2:172.21.15.178:3300/0 conn(0x7feef80c4510 msgr2=0x7feef806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 --2- 172.21.15.167:0/3344362525 >> v2:172.21.15.178:3300/0 conn(0x7feef80c4510 0x7feef806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef80c6500 con 0x7feef8150b40 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7feef4001680 con 0x7feef8150b40 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 >> v1:172.21.15.167:6789/0 conn(0x7feef8150b40 legacy=0x7feef80c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feee0005b90 0x7feee0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee00069e0 0x7feee0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef80c6ff0 0x7feee00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef80c62f0 con 0x7feee0005b90 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef80c6ac0 con 0x7feee00069e0 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee000dba0 con 0x7feef80c6ff0 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feefcc9d640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feee0005b90 0x7feee0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feeeffff640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee00069e0 0x7feee0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feefd49e640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef80c6ff0 0x7feee00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feefcc9d640 1 -- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef80c6ff0 msgr2=0x7feee00073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feefcc9d640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef80c6ff0 0x7feee00073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feefcc9d640 1 -- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee00069e0 msgr2=0x7feee0006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feefcc9d640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee00069e0 0x7feee0006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feefcc9d640 1 -- 172.21.15.167:0/3344362525 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0005740 con 0x7feee0005b90 2023-11-28T20:47:34.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.222+0000 7feefd49e640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef80c6ff0 0x7feee00073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:47:34.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefcc9d640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feee0005b90 0x7feee0005fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feef400c110 tx=0x7feef401cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977685616e85d997 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef40058e0 con 0x7feee0005b90 2023-11-28T20:47:34.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef4005a60 con 0x7feee0005b90 2023-11-28T20:47:34.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feeef7fe640 1 -- 172.21.15.167:0/3344362525 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4005e10 con 0x7feee0005b90 2023-11-28T20:47:34.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 -- 172.21.15.167:0/3344362525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feee0005b90 msgr2=0x7feee0005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 --2- 172.21.15.167:0/3344362525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feee0005b90 0x7feee0005fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feef400c110 tx=0x7feef401cb70 comp rx=0 tx=0).stop 2023-11-28T20:47:34.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefd49e640 1 -- 172.21.15.167:0/3344362525 reap_dead start 2023-11-28T20:47:34.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 -- 172.21.15.167:0/3344362525 shutdown_connections 2023-11-28T20:47:34.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 -- 172.21.15.167:0/3344362525 >> 172.21.15.167:0/3344362525 conn(0x7feef80cb1e0 msgr2=0x7feef80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:34.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 -- 172.21.15.167:0/3344362525 shutdown_connections 2023-11-28T20:47:34.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 -- 172.21.15.167:0/3344362525 wait complete. 2023-11-28T20:47:34.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 Processor -- start 2023-11-28T20:47:34.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 -- start start 2023-11-28T20:47:34.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee0005b90 0x7feef814ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feef814aba0 0x7feef8148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef814b350 0x7feef8141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef81481c0 con 0x7feef814aba0 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef81546c0 con 0x7feee0005b90 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.226+0000 7feefef01640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef81549a0 con 0x7feef814b350 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeeffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feef814aba0 0x7feef8148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeeffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feef814aba0 0x7feef8148650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33108/0 (socket says 172.21.15.167:33108) 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeeffff640 1 -- 172.21.15.167:0/327348012 learned_addr learned my addr 172.21.15.167:0/327348012 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feefcc9d640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee0005b90 0x7feef814ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feefd49e640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef814b350 0x7feef8141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeeffff640 1 -- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef814b350 msgr2=0x7feef8141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeeffff640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef814b350 0x7feef8141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeeffff640 1 -- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee0005b90 msgr2=0x7feef814ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeeffff640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee0005b90 0x7feef814ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeeffff640 1 -- 172.21.15.167:0/327348012 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8154c80 con 0x7feef814aba0 2023-11-28T20:47:34.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeeffff640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feef814aba0 0x7feef8148650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feee8011960 tx=0x7feee8011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeed7fa640 1 -- 172.21.15.167:0/327348012 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee800faf0 con 0x7feef814aba0 2023-11-28T20:47:34.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeed7fa640 1 -- 172.21.15.167:0/327348012 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee800fc50 con 0x7feef814aba0 2023-11-28T20:47:34.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef8154f60 con 0x7feef814aba0 2023-11-28T20:47:34.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeed7fa640 1 -- 172.21.15.167:0/327348012 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8014440 con 0x7feef814aba0 2023-11-28T20:47:34.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef8155bb0 con 0x7feef814aba0 2023-11-28T20:47:34.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef80682c0 con 0x7feef814aba0 2023-11-28T20:47:34.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.230+0000 7feeed7fa640 1 -- 172.21.15.167:0/327348012 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feee801d400 con 0x7feef814aba0 2023-11-28T20:47:34.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.234+0000 7feeed7fa640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feee40664a0 0x7feee4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.234+0000 7feeed7fa640 1 -- 172.21.15.167:0/327348012 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7feee8084a30 con 0x7feef814aba0 2023-11-28T20:47:34.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.234+0000 7feefcc9d640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feee40664a0 0x7feee4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.234+0000 7feefcc9d640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feee40664a0 0x7feee4068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feef40aa000 tx=0x7feef40019b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.238+0000 7feeed7fa640 1 -- 172.21.15.167:0/327348012 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feee8051ad0 con 0x7feef814aba0 2023-11-28T20:47:34.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7feef8067c40 con 0x7feef814aba0 2023-11-28T20:47:34.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feeed7fa640 1 -- 172.21.15.167:0/327348012 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7feee80550f0 con 0x7feef814aba0 2023-11-28T20:47:34.442 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":80,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:47:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feee40664a0 msgr2=0x7feee4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feee40664a0 0x7feee4068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feef40aa000 tx=0x7feef40019b0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feef814aba0 msgr2=0x7feef8148650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feef814aba0 0x7feef8148650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feee8011960 tx=0x7feee8011e20 comp rx=0 tx=0).stop 2023-11-28T20:47:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 shutdown_connections 2023-11-28T20:47:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feee40664a0 0x7feee4068960 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef814b350 0x7feef8141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feef814aba0 0x7feef8148650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 --2- 172.21.15.167:0/327348012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee0005b90 0x7feef814ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 >> 172.21.15.167:0/327348012 conn(0x7feef80cb1e0 msgr2=0x7feef80705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 shutdown_connections 2023-11-28T20:47:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.442+0000 7feefef01640 1 -- 172.21.15.167:0/327348012 wait complete. 2023-11-28T20:47:34.461 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:47:34.461 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:47:34.461 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:47:34.461 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:47:34.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b5b701640 1 Processor -- start 2023-11-28T20:47:34.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b5b701640 1 -- start start 2023-11-28T20:47:34.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b5b701640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b540cb770 0x7f1b5415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b5b701640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5415ac00 con 0x7f1b540cf860 2023-11-28T20:47:34.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b5b701640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b540cbd60 con 0x7f1b540cfc40 2023-11-28T20:47:34.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b5b701640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b54159ff0 con 0x7f1b540cb770 2023-11-28T20:47:34.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b5949d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1b540cf860 0x7f1b540ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50722/0 (socket says 172.21.15.167:50722) 2023-11-28T20:47:34.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b5949d640 1 -- 172.21.15.167:0/2981931581 learned_addr learned my addr 172.21.15.167:0/2981931581 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:47:34.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b59c9e640 1 --2- 172.21.15.167:0/2981931581 >> v2:172.21.15.178:3300/0 conn(0x7f1b540cb770 0x7f1b5415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b4bfff640 1 -- 172.21.15.167:0/2981931581 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114853970 0 0) 0x7f1b5415ac00 con 0x7f1b540cf860 2023-11-28T20:47:34.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b4bfff640 1 -- 172.21.15.167:0/2981931581 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b40003530 con 0x7f1b540cf860 2023-11-28T20:47:34.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b4bfff640 1 -- 172.21.15.167:0/2981931581 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4285164757 0 0) 0x7f1b40003530 con 0x7f1b540cf860 2023-11-28T20:47:34.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b59c9e640 1 -- 172.21.15.167:0/2981931581 >> v1:172.21.15.178:6789/0 conn(0x7f1b540cfc40 legacy=0x7f1b54153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b59c9e640 1 -- 172.21.15.167:0/2981931581 >> v1:172.21.15.167:6789/0 conn(0x7f1b540cf860 legacy=0x7f1b540ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.610+0000 7f1b59c9e640 1 -- 172.21.15.167:0/2981931581 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5415a2d0 con 0x7f1b540cb770 2023-11-28T20:47:34.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b59c9e640 1 --2- 172.21.15.167:0/2981931581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540cb770 0x7f1b5415d4d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009d90 tx=0x7f1b4c01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4a213ffc72b15a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b4bfff640 1 -- 172.21.15.167:0/2981931581 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50001680 con 0x7f1b540cb770 2023-11-28T20:47:34.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b4bfff640 1 -- 172.21.15.167:0/2981931581 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c0a5680 con 0x7f1b540cb770 2023-11-28T20:47:34.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b4bfff640 1 -- 172.21.15.167:0/2981931581 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0a5a10 con 0x7f1b540cb770 2023-11-28T20:47:34.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b5b701640 1 -- 172.21.15.167:0/2981931581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540cb770 msgr2=0x7f1b5415d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b5b701640 1 --2- 172.21.15.167:0/2981931581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540cb770 0x7f1b5415d4d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009d90 tx=0x7f1b4c01c840 comp rx=0 tx=0).stop 2023-11-28T20:47:34.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b5b701640 1 -- 172.21.15.167:0/2981931581 shutdown_connections 2023-11-28T20:47:34.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b5b701640 1 --2- 172.21.15.167:0/2981931581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540cb770 0x7f1b5415d4d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b5b701640 1 -- 172.21.15.167:0/2981931581 >> 172.21.15.167:0/2981931581 conn(0x7f1b5406c1f0 msgr2=0x7f1b54071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:34.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b5b701640 1 -- 172.21.15.167:0/2981931581 shutdown_connections 2023-11-28T20:47:34.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.614+0000 7f1b5b701640 1 -- 172.21.15.167:0/2981931581 wait complete. 2023-11-28T20:47:34.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 Processor -- start 2023-11-28T20:47:34.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 -- start start 2023-11-28T20:47:34.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540cb770 0x7f1b541f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540cf860 0x7f1b540b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b540cfc40 0x7f1b541f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54159720 con 0x7f1b540cfc40 2023-11-28T20:47:34.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b541f2bc0 con 0x7f1b540cf860 2023-11-28T20:47:34.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b541f3140 con 0x7f1b540cb770 2023-11-28T20:47:34.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b59c9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b540cfc40 0x7f1b541f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5949d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540cb770 0x7f1b541f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5949d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540cb770 0x7f1b541f35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:51556/0 (socket says 172.21.15.167:51556) 2023-11-28T20:47:34.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b59c9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b540cfc40 0x7f1b541f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33110/0 (socket says 172.21.15.167:33110) 2023-11-28T20:47:34.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5949d640 1 -- 172.21.15.167:0/1007162537 learned_addr learned my addr 172.21.15.167:0/1007162537 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:34.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b58c9c640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540cf860 0x7f1b540b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b59c9e640 1 -- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540cb770 msgr2=0x7f1b541f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b59c9e640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540cb770 0x7f1b541f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b59c9e640 1 -- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540cf860 msgr2=0x7f1b540b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b59c9e640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540cf860 0x7f1b540b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b59c9e640 1 -- 172.21.15.167:0/1007162537 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c009a70 con 0x7f1b540cfc40 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b59c9e640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b540cfc40 0x7f1b541f69b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0ac000 tx=0x7f1b4c0195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0be070 con 0x7f1b540cfc40 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c009450 con 0x7f1b540cfc40 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0b9860 con 0x7f1b540cfc40 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b541f3b10 con 0x7f1b540cfc40 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.618+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b54159160 con 0x7f1b540cfc40 2023-11-28T20:47:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b5b701640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54146bc0 0x7f1b540b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54072860 con 0x7f1b54146bc0 2023-11-28T20:47:34.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b5949d640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54146bc0 0x7f1b540b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b5949d640 1 -- 172.21.15.167:0/1007162537 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b54159cc0 con 0x7f1b54146bc0 2023-11-28T20:47:34.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b5949d640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54146bc0 0x7f1b540b36f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000f7c0 tx=0x7f1b5000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000fed0 con 0x7f1b54146bc0 2023-11-28T20:47:34.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b4c0b99c0 con 0x7f1b540cfc40 2023-11-28T20:47:34.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b49ffb640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b38066510 0x7f1b380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1b4c11ee40 con 0x7f1b540cfc40 2023-11-28T20:47:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1b5000d9b0 con 0x7f1b54146bc0 2023-11-28T20:47:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54146bc0 msgr2=0x7f1b540b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b49ffb640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54146bc0 0x7f1b540b36f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000f7c0 tx=0x7f1b5000fc80 comp rx=0 tx=0).stop 2023-11-28T20:47:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54146bc0 msgr2=0x7f1b540b36f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b49ffb640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54146bc0 0x7f1b540b36f0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000f7c0 tx=0x7f1b5000fc80 comp rx=0 tx=0).stop 2023-11-28T20:47:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.622+0000 7f1b58c9c640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b38066510 0x7f1b380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.626+0000 7f1b58c9c640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b38066510 0x7f1b380689d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1b54165600 tx=0x7f1b44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54147dc0 0x7f1b540b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54075c90 con 0x7f1b54147dc0 2023-11-28T20:47:34.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5949d640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54147dc0 0x7f1b540b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5949d640 1 -- 172.21.15.167:0/1007162537 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1b541f3280 con 0x7f1b54147dc0 2023-11-28T20:47:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5949d640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54147dc0 0x7f1b540b3c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000f7c0 tx=0x7f1b50005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50013950 con 0x7f1b54147dc0 2023-11-28T20:47:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4472 (secure 0 0 0) 0x7f1b50013ab0 con 0x7f1b54147dc0 2023-11-28T20:47:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54147dc0 msgr2=0x7f1b540b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b49ffb640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54147dc0 0x7f1b540b3c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000f7c0 tx=0x7f1b50005800 comp rx=0 tx=0).stop 2023-11-28T20:47:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b49ffb640 1 -- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54147dc0 msgr2=0x7f1b540b3c30 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b49ffb640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b54147dc0 0x7f1b540b3c30 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000f7c0 tx=0x7f1b50005800 comp rx=0 tx=0).stop 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 80, 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:47:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:47:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:47:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:47:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:47:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:47:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:47:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:47:34.644 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:47:34.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b38066510 msgr2=0x7f1b380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1b38066510 0x7f1b380689d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1b54165600 tx=0x7f1b44009040 comp rx=0 tx=0).stop 2023-11-28T20:47:34.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b540cfc40 msgr2=0x7f1b541f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 --2- 172.21.15.167:0/1007162537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b540cfc40 0x7f1b541f69b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0ac000 tx=0x7f1b4c0195e0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b59c9e640 1 -- 172.21.15.167:0/1007162537 reap_dead start 2023-11-28T20:47:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b59c9e640 1 -- 172.21.15.167:0/1007162537 reap_dead start 2023-11-28T20:47:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 shutdown_connections 2023-11-28T20:47:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 >> 172.21.15.167:0/1007162537 conn(0x7f1b5406c1f0 msgr2=0x7f1b540c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 shutdown_connections 2023-11-28T20:47:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.630+0000 7f1b5b701640 1 -- 172.21.15.167:0/1007162537 wait complete. 2023-11-28T20:47:34.649 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:47:34.649 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:47:34.649 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:47:34.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.790+0000 7fb10326b640 1 Processor -- start 2023-11-28T20:47:34.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.790+0000 7fb10326b640 1 -- start start 2023-11-28T20:47:34.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb10326b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb0fc151f60 0x7fb0fc0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb10326b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc0c5c90 0x7fb0fc0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb10326b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc15b220 con 0x7fb0fc06a580 2023-11-28T20:47:34.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb10326b640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc0c4da0 con 0x7fb0fc151f60 2023-11-28T20:47:34.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb10326b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0c60f0 con 0x7fb0fc0c5c90 2023-11-28T20:47:34.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb101808640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb0fc06a580 0x7fb0fc06ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50738/0 (socket says 172.21.15.167:50738) 2023-11-28T20:47:34.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb101808640 1 -- 172.21.15.167:0/1409924936 learned_addr learned my addr 172.21.15.167:0/1409924936 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:47:34.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb101007640 1 --2- 172.21.15.167:0/1409924936 >> v2:172.21.15.178:3300/0 conn(0x7fb0fc151f60 0x7fb0fc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb100806640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc0c5c90 0x7fb0fc0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193808875 0 0) 0x7fb0fc15b220 con 0x7fb0fc06a580 2023-11-28T20:47:34.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e8003530 con 0x7fb0fc06a580 2023-11-28T20:47:34.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198304826 0 0) 0x7fb0e8003530 con 0x7fb0fc06a580 2023-11-28T20:47:34.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc0c5c90 msgr2=0x7fb0fc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc0c5c90 0x7fb0fc0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 >> v2:172.21.15.178:3300/0 conn(0x7fb0fc151f60 msgr2=0x7fb0fc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 --2- 172.21.15.167:0/1409924936 >> v2:172.21.15.178:3300/0 conn(0x7fb0fc151f60 0x7fb0fc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc152340 con 0x7fb0fc06a580 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb100806640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc0c5c90 0x7fb0fc0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fb0f4001a00 con 0x7fb0fc06a580 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb101007640 1 --2- 172.21.15.167:0/1409924936 >> v2:172.21.15.178:3300/0 conn(0x7fb0fc151f60 0x7fb0fc0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 >> v1:172.21.15.167:6789/0 conn(0x7fb0fc06a580 legacy=0x7fb0fc06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc0c5c90 0x7fb0e8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e8003ec0 0x7fb0e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0e8004d10 0x7fb0e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0c60f0 con 0x7fb0e8003ec0 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e800b990 con 0x7fb0e8004d10 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e800bad0 con 0x7fb0fc0c5c90 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb100806640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e8003ec0 0x7fb0e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb101007640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc0c5c90 0x7fb0e8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb101808640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0e8004d10 0x7fb0e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb100806640 1 -- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc0c5c90 msgr2=0x7fb0e8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb100806640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc0c5c90 0x7fb0e8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb100806640 1 -- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0e8004d10 msgr2=0x7fb0e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb100806640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0e8004d10 0x7fb0e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.794+0000 7fb100806640 1 -- 172.21.15.167:0/1409924936 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec009420 con 0x7fb0e8003ec0 2023-11-28T20:47:34.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb100806640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e8003ec0 0x7fb0e80047d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009cb0 tx=0x7fb0ec01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6669c232b8f3ab64 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0a5700 con 0x7fb0e8003ec0 2023-11-28T20:47:34.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec0a5860 con 0x7fb0e8003ec0 2023-11-28T20:47:34.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb0f3fff640 1 -- 172.21.15.167:0/1409924936 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0a5c50 con 0x7fb0e8003ec0 2023-11-28T20:47:34.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb10326b640 1 -- 172.21.15.167:0/1409924936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e8003ec0 msgr2=0x7fb0e80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb10326b640 1 --2- 172.21.15.167:0/1409924936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e8003ec0 0x7fb0e80047d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009cb0 tx=0x7fb0ec01cbf0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb101808640 1 -- 172.21.15.167:0/1409924936 reap_dead start 2023-11-28T20:47:34.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb10326b640 1 -- 172.21.15.167:0/1409924936 shutdown_connections 2023-11-28T20:47:34.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb10326b640 1 -- 172.21.15.167:0/1409924936 >> 172.21.15.167:0/1409924936 conn(0x7fb0fc0cb1e0 msgr2=0x7fb0fc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:34.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb10326b640 1 -- 172.21.15.167:0/1409924936 shutdown_connections 2023-11-28T20:47:34.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.798+0000 7fb10326b640 1 -- 172.21.15.167:0/1409924936 wait complete. 2023-11-28T20:47:34.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 Processor -- start 2023-11-28T20:47:34.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 -- start start 2023-11-28T20:47:34.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0e8003ec0 0x7fb0fc15c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc158df0 0x7fb0fc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc155aa0 0x7fb0fc155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc070e90 con 0x7fb0fc158df0 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc156b50 con 0x7fb0e8003ec0 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc156e30 con 0x7fb0fc155aa0 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb100806640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc158df0 0x7fb0fc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb100806640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc158df0 0x7fb0fc0718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33128/0 (socket says 172.21.15.167:33128) 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb100806640 1 -- 172.21.15.167:0/2583448116 learned_addr learned my addr 172.21.15.167:0/2583448116 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb101007640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0e8003ec0 0x7fb0fc15c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb101808640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc155aa0 0x7fb0fc155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb100806640 1 -- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc155aa0 msgr2=0x7fb0fc155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb100806640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc155aa0 0x7fb0fc155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb100806640 1 -- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0e8003ec0 msgr2=0x7fb0fc15c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb100806640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0e8003ec0 0x7fb0fc15c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb100806640 1 -- 172.21.15.167:0/2583448116 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc157110 con 0x7fb0fc158df0 2023-11-28T20:47:34.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb101808640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0fc155aa0 0x7fb0fc155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:47:34.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb100806640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc158df0 0x7fb0fc0718c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009cb0 tx=0x7fb0e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0be070 con 0x7fb0fc158df0 2023-11-28T20:47:34.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec006e40 con 0x7fb0fc158df0 2023-11-28T20:47:34.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec004020 con 0x7fb0fc158df0 2023-11-28T20:47:34.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc0710e0 con 0x7fb0fc158df0 2023-11-28T20:47:34.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc0723e0 con 0x7fb0fc158df0 2023-11-28T20:47:34.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc156470 0x7fb0fc1f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc074770 con 0x7fb0fc156470 2023-11-28T20:47:34.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.802+0000 7fb101007640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc156470 0x7fb0fc1f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb101007640 1 -- 172.21.15.167:0/2583448116 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0fc06ada0 con 0x7fb0fc156470 2023-11-28T20:47:34.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb0ec0b4040 con 0x7fb0fc158df0 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb101007640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc156470 0x7fb0fc1f61b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8014c80 tx=0x7fb0f8012700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb0f1ffb640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb0e0066470 0x7fb0e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb0ec11e1e0 con 0x7fb0fc158df0 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb101808640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb0e0066470 0x7fb0e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8004030 con 0x7fb0fc156470 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb0f8004190 con 0x7fb0fc156470 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc156470 msgr2=0x7fb0fc1f61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb0f1ffb640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc156470 0x7fb0fc1f61b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8014c80 tx=0x7fb0f8012700 comp rx=0 tx=0).stop 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc156470 msgr2=0x7fb0fc1f61b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:34.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb0f1ffb640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc156470 0x7fb0fc1f61b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.806+0000 7fb101808640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb0e0066470 0x7fb0e0068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc06fbb0 tx=0x7fb0f4006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc1f66f0 0x7fb0fc1f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc071270 con 0x7fb0fc1f66f0 2023-11-28T20:47:34.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb101007640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc1f66f0 0x7fb0fc1f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb101007640 1 -- 172.21.15.167:0/2583448116 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb0fc15ba30 con 0x7fb0fc1f66f0 2023-11-28T20:47:34.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb101007640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc1f66f0 0x7fb0fc1f6b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8014c80 tx=0x7fb0f8004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8029070 con 0x7fb0fc1f66f0 2023-11-28T20:47:34.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7fb0f80038f0 con 0x7fb0fc1f66f0 2023-11-28T20:47:34.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc1f66f0 msgr2=0x7fb0fc1f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb0f1ffb640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc1f66f0 0x7fb0fc1f6b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8014c80 tx=0x7fb0f8004740 comp rx=0 tx=0).stop 2023-11-28T20:47:34.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb0f1ffb640 1 -- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc1f66f0 msgr2=0x7fb0fc1f6b00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:34.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb0f1ffb640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0fc1f66f0 0x7fb0fc1f6b00 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8014c80 tx=0x7fb0f8004740 comp rx=0 tx=0).stop 2023-11-28T20:47:34.814 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:47:34.814 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:34.814 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:34.814 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:47:34.814 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 80, 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:34.815 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:34.816 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:47:34.817 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:47:34.818 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:34.819 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:47:34.820 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:47:34.821 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:34.822 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:47:34.823 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.823 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.823 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:34.823 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:47:34.823 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.823 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.823 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:34.824 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:34.825 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:47:34.826 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:47:34.827 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 7 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:47:34.828 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:34.829 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:34.830 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:34.830 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:34.830 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:34.830 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:34.830 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:47:34.830 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:47:34.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb0e0066470 msgr2=0x7fb0e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb0e0066470 0x7fb0e0068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc06fbb0 tx=0x7fb0f4006040 comp rx=0 tx=0).stop 2023-11-28T20:47:34.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc158df0 msgr2=0x7fb0fc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 --2- 172.21.15.167:0/2583448116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc158df0 0x7fb0fc0718c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009cb0 tx=0x7fb0e8005800 comp rx=0 tx=0).stop 2023-11-28T20:47:34.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb101808640 1 -- 172.21.15.167:0/2583448116 reap_dead start 2023-11-28T20:47:34.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb101808640 1 -- 172.21.15.167:0/2583448116 reap_dead start 2023-11-28T20:47:34.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 shutdown_connections 2023-11-28T20:47:34.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 >> 172.21.15.167:0/2583448116 conn(0x7fb0fc0cb1e0 msgr2=0x7fb0fc0c3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:34.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 shutdown_connections 2023-11-28T20:47:34.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.814+0000 7fb10326b640 1 -- 172.21.15.167:0/2583448116 wait complete. 2023-11-28T20:47:34.833 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:47:34.833 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:47:34.833 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:47:34.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.974+0000 7f3febd65640 1 Processor -- start 2023-11-28T20:47:34.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.974+0000 7f3febd65640 1 -- start start 2023-11-28T20:47:34.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3febd65640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3fe41585d0 0x7f3fe40c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3febd65640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3fe415e130 0x7f3fe4161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3febd65640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe415e5e0 con 0x7f3fe40c7720 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3febd65640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe415f160 con 0x7f3fe415e130 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3febd65640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe415e8c0 con 0x7f3fe41585d0 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3fe9300640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3fe415e130 0x7f3fe4161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3fe9300640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3fe415e130 0x7f3fe4161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33136/0 (socket says 172.21.15.167:33136) 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3fe9300640 1 -- 172.21.15.167:0/1675863810 learned_addr learned my addr 172.21.15.167:0/1675863810 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3fe9b01640 1 --2- 172.21.15.167:0/1675863810 >> v2:172.21.15.178:3300/0 conn(0x7f3fe41585d0 0x7f3fe40c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3fe9300640 1 -- 172.21.15.167:0/1675863810 >> v2:172.21.15.178:3300/0 conn(0x7f3fe41585d0 msgr2=0x7f3fe40c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3fe9300640 1 --2- 172.21.15.167:0/1675863810 >> v2:172.21.15.178:3300/0 conn(0x7f3fe41585d0 0x7f3fe40c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3fe9300640 1 -- 172.21.15.167:0/1675863810 >> v1:172.21.15.178:6789/0 conn(0x7f3fe40c7720 legacy=0x7f3fe406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:34.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.978+0000 7f3fe9300640 1 -- 172.21.15.167:0/1675863810 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe415eba0 con 0x7f3fe415e130 2023-11-28T20:47:34.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3fe9300640 1 --2- 172.21.15.167:0/1675863810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 0x7f3fe4161de0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40c5e20 tx=0x7f3fd401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e3ee0de0b46397 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3fe8aff640 1 -- 172.21.15.167:0/1675863810 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40ac600 con 0x7f3fe415e130 2023-11-28T20:47:34.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3fe8aff640 1 -- 172.21.15.167:0/1675863810 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd40a8050 con 0x7f3fe415e130 2023-11-28T20:47:34.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3fe8aff640 1 -- 172.21.15.167:0/1675863810 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40ac980 con 0x7f3fe415e130 2023-11-28T20:47:34.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 -- 172.21.15.167:0/1675863810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 msgr2=0x7f3fe4161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 --2- 172.21.15.167:0/1675863810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 0x7f3fe4161de0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40c5e20 tx=0x7f3fd401c490 comp rx=0 tx=0).stop 2023-11-28T20:47:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 -- 172.21.15.167:0/1675863810 shutdown_connections 2023-11-28T20:47:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 --2- 172.21.15.167:0/1675863810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 0x7f3fe4161de0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 --2- 172.21.15.167:0/1675863810 >> v2:172.21.15.178:3300/0 conn(0x7f3fe41585d0 0x7f3fe40c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 -- 172.21.15.167:0/1675863810 >> 172.21.15.167:0/1675863810 conn(0x7f3fe40cb1e0 msgr2=0x7f3fe40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 -- 172.21.15.167:0/1675863810 shutdown_connections 2023-11-28T20:47:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 -- 172.21.15.167:0/1675863810 wait complete. 2023-11-28T20:47:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 Processor -- start 2023-11-28T20:47:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.982+0000 7f3febd65640 1 -- start start 2023-11-28T20:47:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe40c7720 0x7f3fe41faf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe41585d0 0x7f3fe415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 0x7f3fe41f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41f8590 con 0x7f3fe415e130 2023-11-28T20:47:34.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41516a0 con 0x7f3fe41585d0 2023-11-28T20:47:34.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4150b20 con 0x7f3fe40c7720 2023-11-28T20:47:34.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fea302640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 0x7f3fe41f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fe9b01640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe40c7720 0x7f3fe41faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fea302640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 0x7f3fe41f89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33140/0 (socket says 172.21.15.167:33140) 2023-11-28T20:47:34.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fea302640 1 -- 172.21.15.167:0/616707402 learned_addr learned my addr 172.21.15.167:0/616707402 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:34.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fe9300640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe41585d0 0x7f3fe415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fea302640 1 -- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe40c7720 msgr2=0x7f3fe41faf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fea302640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe40c7720 0x7f3fe41faf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fea302640 1 -- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe41585d0 msgr2=0x7f3fe415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fea302640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fe41585d0 0x7f3fe415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fea302640 1 -- 172.21.15.167:0/616707402 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd40094d0 con 0x7f3fe415e130 2023-11-28T20:47:34.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fea302640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 0x7f3fe41f89b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00b970 tx=0x7f3fdc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc00cb40 con 0x7f3fe415e130 2023-11-28T20:47:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc00cca0 con 0x7f3fe415e130 2023-11-28T20:47:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe4150e00 con 0x7f3fe415e130 2023-11-28T20:47:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc014680 con 0x7f3fe415e130 2023-11-28T20:47:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe41513c0 con 0x7f3fe415e130 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4151fc0 0x7f3fe41f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4074770 con 0x7f3fe4151fc0 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fe9b01640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4151fc0 0x7f3fe41f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fe9b01640 1 -- 172.21.15.167:0/616707402 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fe416b2d0 con 0x7f3fe4151fc0 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3fdc01d3b0 con 0x7f3fe415e130 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.986+0000 7f3fe9b01640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4151fc0 0x7f3fe41f8ef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0010820 tx=0x7f3fe0010ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fda7fc640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fc8066470 0x7f3fc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3fdc084040 con 0x7f3fe415e130 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0004240 con 0x7f3fe4151fc0 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3fe00043a0 con 0x7f3fe4151fc0 2023-11-28T20:47:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4151fc0 msgr2=0x7f3fe41f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fda7fc640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4151fc0 0x7f3fe41f8ef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0010820 tx=0x7f3fe0010ce0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4151fc0 msgr2=0x7f3fe41f8ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fda7fc640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4151fc0 0x7f3fe41f8ef0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fe9300640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fc8066470 0x7f3fc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.990+0000 7f3fe9300640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fc8066470 0x7f3fc8068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40ae000 tx=0x7f3fd40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.994+0000 7f3febd65640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4147e20 0x7f3fe4148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.994+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40682c0 con 0x7f3fe4147e20 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.994+0000 7f3fe9b01640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4147e20 0x7f3fe4148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.994+0000 7f3fe9b01640 1 -- 172.21.15.167:0/616707402 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3fe41f86d0 con 0x7f3fe4147e20 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3fe9b01640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4147e20 0x7f3fe4148230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0010820 tx=0x7f3fe00046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0024070 con 0x7f3fe4147e20 2023-11-28T20:47:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4810 (secure 0 0 0) 0x7f3fe001f0d0 con 0x7f3fe4147e20 2023-11-28T20:47:35.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4147e20 msgr2=0x7f3fe4148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:35.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3fda7fc640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4147e20 0x7f3fe4148230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0010820 tx=0x7f3fe00046d0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3fda7fc640 1 -- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4147e20 msgr2=0x7f3fe4148230 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:35.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3fda7fc640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fe4147e20 0x7f3fe4148230 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0010820 tx=0x7f3fe00046d0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.000 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:47:35.000 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:35.000 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 80, 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:47:35.001 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:35.002 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:35.003 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:47:35.004 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:35.005 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:35.006 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:35.007 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:35.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:35.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.011 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:35.012 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:35.013 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:35.015 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:47:35.015 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:47:35.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fc8066470 msgr2=0x7f3fc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:35.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3febd65640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fc8066470 0x7f3fc8068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40ae000 tx=0x7f3fd40a7000 comp rx=0 tx=0).stop 2023-11-28T20:47:35.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 msgr2=0x7f3fe41f89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:35.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3febd65640 1 --2- 172.21.15.167:0/616707402 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe415e130 0x7f3fe41f89b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00b970 tx=0x7f3fdc00be30 comp rx=0 tx=0).stop 2023-11-28T20:47:35.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3fea302640 1 -- 172.21.15.167:0/616707402 reap_dead start 2023-11-28T20:47:35.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3fea302640 1 -- 172.21.15.167:0/616707402 reap_dead start 2023-11-28T20:47:35.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 shutdown_connections 2023-11-28T20:47:35.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 >> 172.21.15.167:0/616707402 conn(0x7f3fe40cb1e0 msgr2=0x7f3fe40c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:35.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 shutdown_connections 2023-11-28T20:47:35.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:34.998+0000 7f3febd65640 1 -- 172.21.15.167:0/616707402 wait complete. 2023-11-28T20:47:35.017 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:47:35.018 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2023-11-28T20:47:35.018 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:47:35.018 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2023-11-28T20:47:35.018 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:47:35.018 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T20:47:35.019 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:47:35.035 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T20:47:35.036 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:47:35.036 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:47:35.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.174+0000 7f66db8c9640 1 Processor -- start 2023-11-28T20:47:35.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.174+0000 7f66db8c9640 1 -- start start 2023-11-28T20:47:35.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66db8c9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66d4151f60 0x7f66d40c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:35.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66db8c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f66d406a580 0x7f66d406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66db8c9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d40c6120 con 0x7f66d40c5c90 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66db8c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d406aed0 con 0x7f66d406a580 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66db8c9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d40c4da0 con 0x7f66d4151f60 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d8e64640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f66d40c5c90 legacy=0x7f66d40c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9665640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f66d4151f60 msgr2=0x7f66d40c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9e66640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f66d406a580 0x7f66d406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9665640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66d4151f60 0x7f66d40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9e66640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f66d406a580 0x7f66d406a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33200/0 (socket says 172.21.15.167:33200) 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9e66640 1 -- 172.21.15.167:0/4095876413 learned_addr learned my addr 172.21.15.167:0/4095876413 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:35.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9e66640 1 -- 172.21.15.167:0/4095876413 >> v2:172.21.15.178:3300/0 conn(0x7f66d4151f60 msgr2=0x7f66d40c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:35.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9e66640 1 --2- 172.21.15.167:0/4095876413 >> v2:172.21.15.178:3300/0 conn(0x7f66d4151f60 0x7f66d40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9e66640 1 -- 172.21.15.167:0/4095876413 >> v1:172.21.15.178:6789/0 conn(0x7f66d40c5c90 legacy=0x7f66d40c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:35.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9e66640 1 -- 172.21.15.167:0/4095876413 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d415b220 con 0x7f66d406a580 2023-11-28T20:47:35.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.178+0000 7f66d9e66640 1 --2- 172.21.15.167:0/4095876413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d406a580 0x7f66d406a990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f66d40c62c0 tx=0x7f66cc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cae84ccf87f724 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:35.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66cbfff640 1 -- 172.21.15.167:0/4095876413 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0a55e0 con 0x7f66d406a580 2023-11-28T20:47:35.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66cbfff640 1 -- 172.21.15.167:0/4095876413 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc0a5740 con 0x7f66d406a580 2023-11-28T20:47:35.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66cbfff640 1 -- 172.21.15.167:0/4095876413 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0a5ad0 con 0x7f66d406a580 2023-11-28T20:47:35.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 -- 172.21.15.167:0/4095876413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d406a580 msgr2=0x7f66d406a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:35.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 --2- 172.21.15.167:0/4095876413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d406a580 0x7f66d406a990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f66d40c62c0 tx=0x7f66cc01c920 comp rx=0 tx=0).stop 2023-11-28T20:47:35.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 -- 172.21.15.167:0/4095876413 shutdown_connections 2023-11-28T20:47:35.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 --2- 172.21.15.167:0/4095876413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d406a580 0x7f66d406a990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 --2- 172.21.15.167:0/4095876413 >> v2:172.21.15.178:3300/0 conn(0x7f66d4151f60 0x7f66d40c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 -- 172.21.15.167:0/4095876413 >> 172.21.15.167:0/4095876413 conn(0x7f66d40cb1e0 msgr2=0x7f66d40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 -- 172.21.15.167:0/4095876413 shutdown_connections 2023-11-28T20:47:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 -- 172.21.15.167:0/4095876413 wait complete. 2023-11-28T20:47:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 Processor -- start 2023-11-28T20:47:35.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 -- start start 2023-11-28T20:47:35.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d406a580 0x7f66d41f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:35.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d40c5c90 0x7f66d41401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:35.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4151f60 0x7f66d41f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d41f3ed0 con 0x7f66d4151f60 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d41f3300 con 0x7f66d40c5c90 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66db8c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d41f3850 con 0x7f66d406a580 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66d8e64640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d40c5c90 msgr2=0x7f66d41401c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66d9e66640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4151f60 0x7f66d41f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66d8e64640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d40c5c90 0x7f66d41401c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66d9e66640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4151f60 0x7f66d41f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33214/0 (socket says 172.21.15.167:33214) 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.182+0000 7f66d9e66640 1 -- 172.21.15.167:0/3588572757 learned_addr learned my addr 172.21.15.167:0/3588572757 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66d9665640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d406a580 0x7f66d41f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:35.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66d9e66640 1 -- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d406a580 msgr2=0x7f66d41f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:35.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66d9e66640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d406a580 0x7f66d41f2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66d9e66640 1 -- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d40c5c90 msgr2=0x7f66d41401c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:47:35.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66d9e66640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d40c5c90 0x7f66d41401c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66d9e66640 1 -- 172.21.15.167:0/3588572757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc009b30 con 0x7f66d4151f60 2023-11-28T20:47:35.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66d9e66640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4151f60 0x7f66d41f42f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f66cc01a550 tx=0x7f66cc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66c9ffb640 1 -- 172.21.15.167:0/3588572757 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0bd070 con 0x7f66d4151f60 2023-11-28T20:47:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66c9ffb640 1 -- 172.21.15.167:0/3588572757 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc0b8470 con 0x7f66d4151f60 2023-11-28T20:47:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d4156fd0 con 0x7f66d4151f60 2023-11-28T20:47:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66c9ffb640 1 -- 172.21.15.167:0/3588572757 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0b8820 con 0x7f66d4151f60 2023-11-28T20:47:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d41f3af0 con 0x7f66d4151f60 2023-11-28T20:47:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d41f3cb0 con 0x7f66d4151f60 2023-11-28T20:47:35.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66c9ffb640 1 -- 172.21.15.167:0/3588572757 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66cc0b8980 con 0x7f66d4151f60 2023-11-28T20:47:35.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66c9ffb640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66b8066420 0x7f66b80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:35.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.186+0000 7f66c9ffb640 1 -- 172.21.15.167:0/3588572757 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f66cc11f280 con 0x7f66d4151f60 2023-11-28T20:47:35.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.190+0000 7f66d9665640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66b8066420 0x7f66b80688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:35.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.190+0000 7f66d9665640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66b8066420 0x7f66b80688e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66d0006fd0 tx=0x7f66d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:35.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.194+0000 7f66c9ffb640 1 -- 172.21.15.167:0/3588572757 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f66cc0ec1e0 con 0x7f66d4151f60 2023-11-28T20:47:35.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f66d40682c0 con 0x7f66d4151f60 2023-11-28T20:47:35.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66c9ffb640 1 -- 172.21.15.167:0/3588572757 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f66cc0ef800 con 0x7f66d4151f60 2023-11-28T20:47:35.397 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":80,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:47:35.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66b8066420 msgr2=0x7f66b80688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:35.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66b8066420 0x7f66b80688e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66d0006fd0 tx=0x7f66d0008040 comp rx=0 tx=0).stop 2023-11-28T20:47:35.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4151f60 msgr2=0x7f66d41f42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:35.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4151f60 0x7f66d41f42f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f66cc01a550 tx=0x7f66cc0196c0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 shutdown_connections 2023-11-28T20:47:35.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f66b8066420 0x7f66b80688e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66d4151f60 0x7f66d41f42f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d40c5c90 0x7f66d41401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 --2- 172.21.15.167:0/3588572757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d406a580 0x7f66d41f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:35.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 >> 172.21.15.167:0/3588572757 conn(0x7f66d40cb1e0 msgr2=0x7f66d4161bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:35.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 shutdown_connections 2023-11-28T20:47:35.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:35.398+0000 7f66db8c9640 1 -- 172.21.15.167:0/3588572757 wait complete. 2023-11-28T20:47:37.776 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 0% (2/12117) Updating files: 0% (56/12117) Updating files: 1% (122/12117) Updating files: 1% (236/12117) Updating files: 2% (243/12117) Updating files: 2% (353/12117) Updating files: 3% (364/12117) Updating files: 4% (485/12117) Updating files: 4% (496/12117) Updating files: 4% (545/12117) Updating files: 4% (567/12117) Updating files: 5% (606/12117) Updating files: 6% (728/12117) Updating files: 6% (785/12117) Updating files: 7% (849/12117) Updating files: 8% (970/12117) Updating files: 9% (1091/12117) Updating files: 9% (1171/12117) Updating files: 10% (1212/12117) Updating files: 11% (1333/12117) Updating files: 11% (1340/12117) Updating files: 11% (1413/12117) Updating files: 12% (1455/12117) Updating files: 13% (1576/12117) Updating files: 13% (1578/12117) Updating files: 13% (1584/12117) Updating files: 13% (1623/12117) Updating files: 14% (1697/12117) Updating files: 14% (1713/12117) Updating files: 15% (1818/12117) Updating files: 15% (1865/12117) Updating files: 15% (1926/12117) Updating files: 16% (1939/12117) Updating files: 17% (2060/12117) Updating files: 17% (2078/12117) Updating files: 17% (2138/12117) Updating files: 18% (2182/12117) Updating files: 18% (2220/12117) Updating files: 18% (2264/12117) Updating files: 19% (2303/12117) Updating files: 19% (2372/12117) Updating files: 20% (2424/12117) Updating files: 20% (2451/12117) Updating files: 20% (2515/12117) Updating files: 20% (2522/12117) Updating files: 20% (2523/12117) Updating files: 20% (2524/12117) Updating files: 21% (2545/12117) Updating files: 22% (2666/12117) Updating files: 22% (2716/12117) Updating files: 23% (2787/12117) Updating files: 23% (2806/12117) Updating files: 24% (2909/12117) Updating files: 24% (2940/12117) Updating files: 25% (3030/12117) Updating files: 25% (3087/12117) Updating files: 26% (3151/12117) Updating files: 27% (3272/12117) Updating files: 27% (3297/12117) Updating files: 28% (3393/12117) Updating files: 28% (3436/12117) Updating files: 29% (3514/12117) Updating files: 29% (3622/12117) Updating files: 30% (3636/12117) Updating files: 30% (3726/12117) Updating files: 31% (3757/12117) Updating files: 31% (3806/12117) Updating files: 31% (3809/12117) Updating files: 32% (3878/12117) Updating files: 32% (3895/12117) Updating files: 32% (3985/12117) Updating files: 33% (3999/12117) Updating files: 33% (4013/12117) Updating files: 34% (4120/12117) Updating files: 34% (4148/12117) Updating files: 34% (4203/12117) Updating files: 35% (4241/12117) Updating files: 35% (4315/12117) Updating files: 36% (4363/12117) Updating files: 36% (4460/12117) Updating files: 37% (4484/12117) Updating files: 38% (4605/12117) Updating files: 38% (4651/12117) Updating files: 39% (4726/12117) Updating files: 39% (4730/12117) Updating files: 39% (4786/12117) Updating files: 39% (4804/12117) Updating files: 40% (4847/12117) Updating files: 40% (4890/12117) Updating files: 41% (4968/12117) Updating files: 41% (4984/12117) Updating files: 41% (4985/12117) Updating files: 41% (5007/12117) Updating files: 41% (5053/12117) Updating files: 42% (5090/12117) Updating files: 43% (5211/12117) Updating files: 43% (5225/12117) Updating files: 43% (5296/12117) Updating files: 43% (5314/12117) Updating files: 44% (5332/12117) Updating files: 45% (5453/12117) Updating files: 45% (5502/12117) Updating files: 46% (5574/12117) Updating files: 47% (5695/12117) Updating files: 47% (5706/12117) Updating files: 47% (5771/12117) Updating files: 48% (5817/12117) Updating files: 49% (5938/12117) Updating files: 49% (5957/12117) Updating files: 49% (6008/12117) Updating files: 50% (6059/12117) Updating files: 50% (6140/12117) Updating files: 51% (6180/12117) Updating files: 51% (6229/12117) Updating files: 51% (6264/12117) Updating files: 52% (6301/12117) Updating files: 52% (6397/12117) Updating files: 53% (6423/12117) Updating files: 53% (6541/12117) Updating files: 54% (6544/12117) Updating files: 55% (6665/12117) Updating files: 55% (6751/12117) Updating files: 56% (6786/12117) Updating files: 56% (6835/12117) Updating files: 57% (6907/12117) Updating files: 57% (6950/12117) Updating files: 57% (7012/12117) Updating files: 58% (7028/12117) Updating files: 58% (7105/12117) Updating files: 59% (7150/12117) Updating files: 59% (7228/12117) Updating files: 60% (7271/12117) Updating files: 61% (7392/12117) Updating files: 61% (7470/12117) Updating files: 62% (7513/12117) Updating files: 63% (7634/12117) Updating files: 64% (7755/12117) Updating files: 65% (7877/12117) Updating files: 65% (7887/12117) Updating files: 66% (7998/12117) Updating files: 66% (8079/12117) Updating files: 67% (8119/12117) Updating files: 67% (8152/12117) Updating files: 67% (8191/12117) Updating files: 68% (8240/12117) Updating files: 68% (8350/12117) Updating files: 69% (8361/12117) Updating files: 69% (8443/12117) Updating files: 70% (8482/12117) Updating files: 70% (8525/12117) Updating files: 70% (8552/12117) Updating files: 71% (8604/12117) Updating files: 71% (8641/12117) Updating files: 72% (8725/12117) Updating files: 73% (8846/12117) Updating files: 74% (8967/12117) Updating files: 75% (9088/12117) Updating files: 75% (9093/12117) Updating files: 75% (9168/12117) Updating files: 75% (9204/12117) Updating files: 76% (9209/12117) Updating files: 77% (9331/12117) Updating files: 77% (9346/12117) Updating files: 77% (9426/12117) Updating files: 78% (9452/12117) Updating files: 78% (9564/12117) Updating files: 79% (9573/12117) Updating files: 79% (9646/12117) Updating files: 80% (9694/12117) Updating files: 80% (9791/12117) Updating files: 81% (9815/12117) Updating files: 81% (9860/12117) Updating files: 82% (9936/12117) Updating files: 83% (10058/12117) Updating files: 84% (10179/12117) Updating files: 85% (10300/12117) Updating files: 85% (10385/12117) Updating files: 86% (10421/12117) Updating files: 86% (10496/12117) Updating files: 87% (10542/12117) Updating files: 87% (10564/12117) Updating files: 88% (10663/12117) Updating files: 89% (10785/12117) Updating files: 89% (10827/12117) Updating files: 90% (10906/12117) Updating files: 90% (10912/12117) Updating files: 91% (11027/12117) Updating files: 92% (11148/12117) Updating files: 92% (11175/12117) Updating files: 92% (11241/12117) Updating files: 93% (11269/12117) Updating files: 94% (11390/12117) Updating files: 94% (11445/12117) Updating files: 95% (11512/12117) Updating files: 96% (11633/12117) Updating files: 96% (11649/12117) Updating files: 96% (11678/12117) Updating files: 96% (11705/12117) Updating files: 96% (11750/12117) Updating files: 97% (11754/12117) Updating files: 98% (11875/12117) Updating files: 98% (11958/12117) Updating files: 99% (11996/12117) Updating files: 99% (12031/12117) Updating files: 100% (12117/12117) Updating files: 100% (12117/12117), done. 2023-11-28T20:47:38.182 INFO:tasks.workunit.client.0.smithi167.stderr:+ trap - EXIT 2023-11-28T20:47:38.182 INFO:tasks.workunit.client.0.smithi167.stderr:+ cd ceph 2023-11-28T20:47:38.182 INFO:tasks.workunit.client.0.smithi167.stderr:+ seq 1 90 2023-11-28T20:47:38.183 INFO:tasks.workunit.client.0.smithi167.stderr:+ versions=1 2023-11-28T20:47:38.183 INFO:tasks.workunit.client.0.smithi167.stderr:2 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:3 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:4 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:5 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:6 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:7 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:8 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:9 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:10 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:11 2023-11-28T20:47:38.184 INFO:tasks.workunit.client.0.smithi167.stderr:12 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:13 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:14 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:15 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:16 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:17 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:18 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:19 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:20 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:21 2023-11-28T20:47:38.185 INFO:tasks.workunit.client.0.smithi167.stderr:22 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:23 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:24 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:25 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:26 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:27 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:28 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:29 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:30 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:31 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:32 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:33 2023-11-28T20:47:38.186 INFO:tasks.workunit.client.0.smithi167.stderr:34 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:35 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:36 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:37 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:38 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:39 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:40 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:41 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:42 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:43 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:44 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:45 2023-11-28T20:47:38.187 INFO:tasks.workunit.client.0.smithi167.stderr:46 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:47 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:48 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:49 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:50 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:51 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:52 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:53 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:54 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:55 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:56 2023-11-28T20:47:38.188 INFO:tasks.workunit.client.0.smithi167.stderr:57 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:58 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:59 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:60 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:61 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:62 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:63 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:64 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:65 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:66 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:67 2023-11-28T20:47:38.189 INFO:tasks.workunit.client.0.smithi167.stderr:68 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:69 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:70 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:71 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:72 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:73 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:74 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:75 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:76 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:77 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:78 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:79 2023-11-28T20:47:38.190 INFO:tasks.workunit.client.0.smithi167.stderr:80 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:81 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:82 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:83 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:84 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:85 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:86 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:87 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:88 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:89 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:90 2023-11-28T20:47:38.191 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 1 -eq 48 ] 2023-11-28T20:47:38.192 INFO:tasks.workunit.client.0.smithi167.stdout:v0.1 2023-11-28T20:47:38.192 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.1 2023-11-28T20:47:38.192 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.1 2023-11-28T20:47:38.192 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.1 2023-11-28T20:47:38.419 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:47:38.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d443b8640 1 Processor -- start 2023-11-28T20:47:38.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d443b8640 1 -- start start 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d443b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c150b40 0x7f5d3c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d443b8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d3c0c6ff0 0x7f5d3c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d443b8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5d3c0c5be0 0x7f5d3c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d443b8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c0c6ac0 con 0x7f5d3c0c6ff0 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d443b8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c0c6500 con 0x7f5d3c0c5be0 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d443b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0c67e0 con 0x7f5d3c150b40 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d42955640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f5d3c0c5be0 msgr2=0x7f5d3c06a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d41953640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d3c0c6ff0 0x7f5d3c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d42955640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5d3c0c5be0 0x7f5d3c06a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d41953640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d3c0c6ff0 0x7f5d3c0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33228/0 (socket says 172.21.15.167:33228) 2023-11-28T20:47:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d41953640 1 -- 172.21.15.167:0/1348548085 learned_addr learned my addr 172.21.15.167:0/1348548085 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:38.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d42154640 1 --2- 172.21.15.167:0/1348548085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c150b40 0x7f5d3c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:38.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d41953640 1 -- 172.21.15.167:0/1348548085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c150b40 msgr2=0x7f5d3c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:38.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d41953640 1 --2- 172.21.15.167:0/1348548085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c150b40 0x7f5d3c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d41953640 1 -- 172.21.15.167:0/1348548085 >> v2:172.21.15.178:3300/0 conn(0x7f5d3c0c5be0 msgr2=0x7f5d3c06a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:38.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d41953640 1 --2- 172.21.15.167:0/1348548085 >> v2:172.21.15.178:3300/0 conn(0x7f5d3c0c5be0 0x7f5d3c06a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.562+0000 7f5d41953640 1 -- 172.21.15.167:0/1348548085 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c156a80 con 0x7f5d3c0c6ff0 2023-11-28T20:47:38.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d41953640 1 --2- 172.21.15.167:0/1348548085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c0c6ff0 0x7f5d3c0c4510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c070410 tx=0x7f5d2c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa68732eb539153 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:38.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d41152640 1 -- 172.21.15.167:0/1348548085 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0aa610 con 0x7f5d3c0c6ff0 2023-11-28T20:47:38.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d41152640 1 -- 172.21.15.167:0/1348548085 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c0a6040 con 0x7f5d3c0c6ff0 2023-11-28T20:47:38.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d41152640 1 -- 172.21.15.167:0/1348548085 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0aa990 con 0x7f5d3c0c6ff0 2023-11-28T20:47:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d443b8640 1 -- 172.21.15.167:0/1348548085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c0c6ff0 msgr2=0x7f5d3c0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1348548085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c0c6ff0 0x7f5d3c0c4510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c070410 tx=0x7f5d2c01c4f0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d443b8640 1 -- 172.21.15.167:0/1348548085 shutdown_connections 2023-11-28T20:47:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1348548085 >> v2:172.21.15.178:3300/0 conn(0x7f5d3c0c5be0 0x7f5d3c06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1348548085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c0c6ff0 0x7f5d3c0c4510 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1348548085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c150b40 0x7f5d3c157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d443b8640 1 -- 172.21.15.167:0/1348548085 >> 172.21.15.167:0/1348548085 conn(0x7f5d3c0cb1e0 msgr2=0x7f5d3c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d443b8640 1 -- 172.21.15.167:0/1348548085 shutdown_connections 2023-11-28T20:47:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.566+0000 7f5d443b8640 1 -- 172.21.15.167:0/1348548085 wait complete. 2023-11-28T20:47:38.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 Processor -- start 2023-11-28T20:47:38.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 -- start start 2023-11-28T20:47:38.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d3c0c5be0 0x7f5d3c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c0c6ff0 0x7f5d3c1f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c150b40 0x7f5d3c159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c1f6960 con 0x7f5d3c150b40 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c147460 con 0x7f5d3c0c5be0 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c147740 con 0x7f5d3c0c6ff0 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42154640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d3c0c5be0 msgr2=0x7f5d3c154a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42154640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d3c0c5be0 0x7f5d3c154a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42955640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c150b40 0x7f5d3c159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42955640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c150b40 0x7f5d3c159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33236/0 (socket says 172.21.15.167:33236) 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42955640 1 -- 172.21.15.167:0/1467688140 learned_addr learned my addr 172.21.15.167:0/1467688140 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d41953640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c0c6ff0 0x7f5d3c1f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42955640 1 -- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c0c6ff0 msgr2=0x7f5d3c1f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42955640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c0c6ff0 0x7f5d3c1f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42955640 1 -- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d3c0c5be0 msgr2=0x7f5d3c154a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42955640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d3c0c5be0 0x7f5d3c154a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42955640 1 -- 172.21.15.167:0/1467688140 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0094d0 con 0x7f5d3c150b40 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d41953640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c0c6ff0 0x7f5d3c1f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d42955640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c150b40 0x7f5d3c159080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b760 tx=0x7f5d3400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d32ffd640 1 -- 172.21.15.167:0/1467688140 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400c960 con 0x7f5d3c150b40 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d32ffd640 1 -- 172.21.15.167:0/1467688140 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3400cac0 con 0x7f5d3c150b40 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d32ffd640 1 -- 172.21.15.167:0/1467688140 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34015470 con 0x7f5d3c150b40 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3c1f6030 con 0x7f5d3c150b40 2023-11-28T20:47:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.570+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3c1f65f0 con 0x7f5d3c150b40 2023-11-28T20:47:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.574+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3c0682c0 con 0x7f5d3c150b40 2023-11-28T20:47:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.574+0000 7f5d32ffd640 1 -- 172.21.15.167:0/1467688140 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d34012070 con 0x7f5d3c150b40 2023-11-28T20:47:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.574+0000 7f5d32ffd640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d20066450 0x7f5d20068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.574+0000 7f5d32ffd640 1 -- 172.21.15.167:0/1467688140 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5d340841b0 con 0x7f5d3c150b40 2023-11-28T20:47:38.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.574+0000 7f5d42154640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d20066450 0x7f5d20068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:38.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.574+0000 7f5d42154640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d20066450 0x7f5d20068910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5d38006f40 tx=0x7f5d38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:38.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.578+0000 7f5d32ffd640 1 -- 172.21.15.167:0/1467688140 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5d34051230 con 0x7f5d3c150b40 2023-11-28T20:47:38.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.782+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5d3c1f6b10 con 0x7f5d3c150b40 2023-11-28T20:47:38.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d32ffd640 1 -- 172.21.15.167:0/1467688140 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f5d3401a620 con 0x7f5d3c150b40 2023-11-28T20:47:38.783 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":80,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:47:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d20066450 msgr2=0x7f5d20068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d20066450 0x7f5d20068910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5d38006f40 tx=0x7f5d38008040 comp rx=0 tx=0).stop 2023-11-28T20:47:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c150b40 msgr2=0x7f5d3c159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c150b40 0x7f5d3c159080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b760 tx=0x7f5d3400bc20 comp rx=0 tx=0).stop 2023-11-28T20:47:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 shutdown_connections 2023-11-28T20:47:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5d20066450 0x7f5d20068910 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d3c150b40 0x7f5d3c159080 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d3c0c6ff0 0x7f5d3c1f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 --2- 172.21.15.167:0/1467688140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d3c0c5be0 0x7f5d3c154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 >> 172.21.15.167:0/1467688140 conn(0x7f5d3c0cb1e0 msgr2=0x7f5d3c1481d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 shutdown_connections 2023-11-28T20:47:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:38.786+0000 7f5d443b8640 1 -- 172.21.15.167:0/1467688140 wait complete. 2023-11-28T20:47:41.805 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:47:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.950+0000 7f9b9e26b640 1 Processor -- start 2023-11-28T20:47:41.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.950+0000 7f9b9e26b640 1 -- start start 2023-11-28T20:47:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.954+0000 7f9b9e26b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 0x7f9b980c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.954+0000 7f9b9e26b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980c6120 con 0x7f9b9806a580 2023-11-28T20:47:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.954+0000 7f9b9e26b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9815b220 con 0x7f9b980c5c90 2023-11-28T20:47:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.954+0000 7f9b9e26b640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b980c4da0 con 0x7f9b98151f60 2023-11-28T20:47:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.954+0000 7f9b977fe640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f9b980c5c90 legacy=0x7f9b980c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:47:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.954+0000 7f9b97fff640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 msgr2=0x7f9b980c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.954+0000 7f9b97fff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 0x7f9b980c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.954+0000 7f9b9c808640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9b9806a580 0x7f9b981625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50750/0 (socket says 172.21.15.167:50750) 2023-11-28T20:47:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:41.954+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 learned_addr learned my addr 172.21.15.167:0/157478124 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:47:42.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:42.158+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v1:172.21.15.178:6789/0 conn(0x7f9b980c5c90 legacy=0x7f9b980c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:47:42.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:42.158+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 msgr2=0x7f9b980c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:42.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:42.158+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 0x7f9b980c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:47:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:42.562+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v1:172.21.15.178:6789/0 conn(0x7f9b980c5c90 legacy=0x7f9b980c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:47:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:42.562+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 msgr2=0x7f9b980c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:42.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:42.562+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 0x7f9b980c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:47:43.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:43.366+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v1:172.21.15.178:6789/0 conn(0x7f9b980c5c90 legacy=0x7f9b980c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:47:43.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:43.366+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 msgr2=0x7f9b980c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:43.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:43.366+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 0x7f9b980c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:47:44.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 msgr2=0x7f9b980c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:44.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b95ffb640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b98151f60 0x7f9b980c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:44.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 >> v1:172.21.15.178:6789/0 conn(0x7f9b980c5c90 legacy=0x7f9b980c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:44.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 >> v1:172.21.15.167:6789/0 conn(0x7f9b9806a580 legacy=0x7f9b981625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:44.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b95ffb640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:44.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b95ffb640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b84008ce0 con 0x7f9b840061b0 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84008e50 con 0x7f9b840036d0 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 msgr2=0x7f9b84008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 msgr2=0x7f9b84008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 msgr2=0x7f9b84005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 msgr2=0x7f9b84005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:44.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:44.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:44.954+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:45.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:45.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 msgr2=0x7f9b84008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:45.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 msgr2=0x7f9b84008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:45.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:45.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:47:45.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:45.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 msgr2=0x7f9b84005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:45.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 msgr2=0x7f9b84005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:45.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:45.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.158+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:47:45.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:45.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 msgr2=0x7f9b84008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:45.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:45.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 msgr2=0x7f9b84008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:45.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:45.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:47:45.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 msgr2=0x7f9b84005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:45.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 msgr2=0x7f9b84005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:45.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:45.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:45.562+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:47:46.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:46.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:46.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 msgr2=0x7f9b84008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:46.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 msgr2=0x7f9b84008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:46.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:46.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:47:46.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 msgr2=0x7f9b84005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:47:46.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 msgr2=0x7f9b84005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:46.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:46.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:46.366+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:47:47.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 msgr2=0x7f9b84005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:47.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b95ffb640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b840036d0 0x7f9b84005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:47.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 msgr2=0x7f9b84008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:47.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b95ffb640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b840061b0 0x7f9b84008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:47.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 reap_dead start 2023-11-28T20:47:47.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b95ffb640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 0x7f9b84008140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:47.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b95ffb640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:47.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b98152340 con 0x7f9b84003b10 2023-11-28T20:47:47.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b84008ce0 con 0x7f9b84008710 2023-11-28T20:47:47.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b95ffb640 1 -- 172.21.15.167:0/157478124 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b84008e50 con 0x7f9b84007cb0 2023-11-28T20:47:47.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 msgr2=0x7f9b84008140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:47.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:47.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 0x7f9b84008140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:47.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 msgr2=0x7f9b8400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:47:47.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 msgr2=0x7f9b8400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:47.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:47.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:47.954+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:48.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.158+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 msgr2=0x7f9b84008140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:48.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.158+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 0x7f9b84008140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:47:48.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.158+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:48.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.158+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 msgr2=0x7f9b8400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:48.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.158+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 msgr2=0x7f9b8400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:48.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.158+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:48.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.158+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:47:48.163 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:48.167 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:48.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.562+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 msgr2=0x7f9b84008140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:48.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.562+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 0x7f9b84008140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:47:48.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.562+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:48.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.562+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 msgr2=0x7f9b8400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:48.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.562+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 msgr2=0x7f9b8400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:48.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.562+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:48.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:48.562+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:47:49.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.366+0000 7f9b977fe640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 msgr2=0x7f9b84008140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:49.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.366+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 0x7f9b84008140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:47:49.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.366+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:49.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.366+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 msgr2=0x7f9b8400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:47:49.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.366+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 msgr2=0x7f9b8400d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:47:49.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.366+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:47:49.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.366+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:47:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107411626 0 0) 0x7f9b98152340 con 0x7f9b84003b10 2023-11-28T20:47:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b80003530 con 0x7f9b84003b10 2023-11-28T20:47:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 208261207 0 0) 0x7f9b80003530 con 0x7f9b84003b10 2023-11-28T20:47:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 msgr2=0x7f9b84008140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.178:3300/0 conn(0x7f9b84007cb0 0x7f9b84008140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 msgr2=0x7f9b8400d2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 --2- 172.21.15.167:0/157478124 >> v2:172.21.15.167:3300/0 conn(0x7f9b84008710 0x7f9b8400d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9815b220 con 0x7f9b84003b10 2023-11-28T20:47:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9b88009810 con 0x7f9b84003b10 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 >> v1:172.21.15.167:6789/0 conn(0x7f9b84003b10 legacy=0x7f9b84006590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b80003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b800047d0 0x7f9b80004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b800051e0 0x7f9b8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84008ce0 con 0x7f9b80003980 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84008e50 con 0x7f9b800051e0 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8000c1b0 con 0x7f9b800047d0 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b80003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b800051e0 msgr2=0x7f9b8000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b9c808640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b800051e0 0x7f9b8000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b977fe640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b800047d0 0x7f9b80004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:49.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b800047d0 msgr2=0x7f9b80004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b800047d0 0x7f9b80004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b800051e0 msgr2=0x7f9b8000b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b800051e0 0x7f9b8000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b97fff640 1 -- 172.21.15.167:0/157478124 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b80003530 con 0x7f9b80003980 2023-11-28T20:47:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.862+0000 7f9b9c808640 1 -- 172.21.15.167:0/157478124 reap_dead start 2023-11-28T20:47:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b97fff640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b80003da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b88007090 tx=0x7f9b8801ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f69a04481ae930 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:49.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880a69e0 con 0x7f9b80003980 2023-11-28T20:47:49.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b880aa070 con 0x7f9b80003980 2023-11-28T20:47:49.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b96ffd640 1 -- 172.21.15.167:0/157478124 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880a6d80 con 0x7f9b80003980 2023-11-28T20:47:49.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b9e26b640 1 -- 172.21.15.167:0/157478124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 msgr2=0x7f9b80003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:49.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b9e26b640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b80003da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9b88007090 tx=0x7f9b8801ddf0 comp rx=0 tx=0).stop 2023-11-28T20:47:49.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b9e26b640 1 -- 172.21.15.167:0/157478124 shutdown_connections 2023-11-28T20:47:49.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b9e26b640 1 --2- 172.21.15.167:0/157478124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b80003da0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:49.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b9e26b640 1 -- 172.21.15.167:0/157478124 >> 172.21.15.167:0/157478124 conn(0x7f9b980cb1e0 msgr2=0x7f9b980cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:49.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b9e26b640 1 -- 172.21.15.167:0/157478124 shutdown_connections 2023-11-28T20:47:49.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.866+0000 7f9b9e26b640 1 -- 172.21.15.167:0/157478124 wait complete. 2023-11-28T20:47:49.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 Processor -- start 2023-11-28T20:47:49.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 -- start start 2023-11-28T20:47:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b98156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b981e6970 0x7f9b981e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b981e7920 0x7f9b9815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980caf10 con 0x7f9b80003980 2023-11-28T20:47:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b98157740 con 0x7f9b981e6970 2023-11-28T20:47:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b98157990 con 0x7f9b981e7920 2023-11-28T20:47:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b97fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b98156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b977fe640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b981e6970 msgr2=0x7f9b981e73e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b977fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b981e6970 0x7f9b981e73e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b97fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b98156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47664/0 (socket says 172.21.15.167:47664) 2023-11-28T20:47:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b97fff640 1 -- 172.21.15.167:0/1889200636 learned_addr learned my addr 172.21.15.167:0/1889200636 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9c808640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b981e7920 0x7f9b9815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b97fff640 1 -- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b981e7920 msgr2=0x7f9b9815a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b97fff640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b981e7920 0x7f9b9815a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b97fff640 1 -- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b981e6970 msgr2=0x7f9b981e73e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b97fff640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b981e6970 0x7f9b981e73e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b97fff640 1 -- 172.21.15.167:0/1889200636 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b98155aa0 con 0x7f9b80003980 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b97fff640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b98156ec0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9b88003940 tx=0x7f9b80005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b94ff9640 1 -- 172.21.15.167:0/1889200636 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88009610 con 0x7f9b80003980 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b94ff9640 1 -- 172.21.15.167:0/1889200636 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b88009770 con 0x7f9b80003980 2023-11-28T20:47:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b94ff9640 1 -- 172.21.15.167:0/1889200636 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880bb690 con 0x7f9b80003980 2023-11-28T20:47:49.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b98155d40 con 0x7f9b80003980 2023-11-28T20:47:49.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.870+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b980ca9f0 con 0x7f9b80003980 2023-11-28T20:47:49.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.874+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b980682c0 con 0x7f9b80003980 2023-11-28T20:47:49.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.874+0000 7f9b94ff9640 1 -- 172.21.15.167:0/1889200636 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b880bb7f0 con 0x7f9b80003980 2023-11-28T20:47:49.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.874+0000 7f9b94ff9640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b84067a00 0x7f9b84069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:49.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.874+0000 7f9b94ff9640 1 -- 172.21.15.167:0/1889200636 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9b8811f470 con 0x7f9b80003980 2023-11-28T20:47:49.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.874+0000 7f9b977fe640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b84067a00 0x7f9b84069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:49.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.874+0000 7f9b977fe640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b84067a00 0x7f9b84069ec0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b98146d10 tx=0x7f9b8c00e040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:49.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:49.878+0000 7f9b94ff9640 1 -- 172.21.15.167:0/1889200636 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b880ec460 con 0x7f9b80003980 2023-11-28T20:47:50.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.110+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9b98075c90 con 0x7f9b80003980 2023-11-28T20:47:50.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.110+0000 7f9b94ff9640 1 -- 172.21.15.167:0/1889200636 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f9b880efa80 con 0x7f9b80003980 2023-11-28T20:47:50.111 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":84,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:47:50.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b84067a00 msgr2=0x7f9b84069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b84067a00 0x7f9b84069ec0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b98146d10 tx=0x7f9b8c00e040 comp rx=0 tx=0).stop 2023-11-28T20:47:50.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 msgr2=0x7f9b98156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b98156ec0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9b88003940 tx=0x7f9b80005800 comp rx=0 tx=0).stop 2023-11-28T20:47:50.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 shutdown_connections 2023-11-28T20:47:50.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b84067a00 0x7f9b84069ec0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b981e7920 0x7f9b9815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b981e6970 0x7f9b981e73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 --2- 172.21.15.167:0/1889200636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80003980 0x7f9b98156ec0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 >> 172.21.15.167:0/1889200636 conn(0x7f9b980cb1e0 msgr2=0x7f9b981505f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:50.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 shutdown_connections 2023-11-28T20:47:50.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.114+0000 7f9b9e26b640 1 -- 172.21.15.167:0/1889200636 wait complete. 2023-11-28T20:47:50.132 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:47:50.132 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:47:50.132 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:47:50.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.274+0000 7fa1e0a32640 1 Processor -- start 2023-11-28T20:47:50.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.274+0000 7fa1e0a32640 1 -- start start 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1e0a32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 0x7fa1dc157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1e0a32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa1dc0c6ff0 0x7fa1dc0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1e0a32640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa1dc0c5be0 0x7fa1dc06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1e0a32640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc0c6ac0 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1e0a32640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc0c6500 con 0x7fa1dc0c5be0 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1e0a32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0c67e0 con 0x7fa1dc150b40 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1dad9d640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7fa1dc0c5be0 msgr2=0x7fa1dc06a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1d9d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa1dc0c6ff0 0x7fa1dc0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1dad9d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa1dc0c5be0 0x7fa1dc06a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:50.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1d9d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa1dc0c6ff0 0x7fa1dc0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47674/0 (socket says 172.21.15.167:47674) 2023-11-28T20:47:50.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1d9d9b640 1 -- 172.21.15.167:0/29424239 learned_addr learned my addr 172.21.15.167:0/29424239 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:50.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1da59c640 1 --2- 172.21.15.167:0/29424239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 0x7fa1dc157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1d9d9b640 1 -- 172.21.15.167:0/29424239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 msgr2=0x7fa1dc157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:47:50.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1d9d9b640 1 --2- 172.21.15.167:0/29424239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 0x7fa1dc157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1d9d9b640 1 -- 172.21.15.167:0/29424239 >> v2:172.21.15.178:3300/0 conn(0x7fa1dc0c5be0 msgr2=0x7fa1dc06a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:50.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1d9d9b640 1 --2- 172.21.15.167:0/29424239 >> v2:172.21.15.178:3300/0 conn(0x7fa1dc0c5be0 0x7fa1dc06a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.278+0000 7fa1d9d9b640 1 -- 172.21.15.167:0/29424239 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc156a80 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1d9d9b640 1 --2- 172.21.15.167:0/29424239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 0x7fa1dc0c4510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc070410 tx=0x7fa1d001e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd6d810bcaefc60 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1d959a640 1 -- 172.21.15.167:0/29424239 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00a8690 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1d959a640 1 -- 172.21.15.167:0/29424239 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d00a87f0 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1d959a640 1 -- 172.21.15.167:0/29424239 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00a8b80 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 -- 172.21.15.167:0/29424239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 msgr2=0x7fa1dc0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 --2- 172.21.15.167:0/29424239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 0x7fa1dc0c4510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc070410 tx=0x7fa1d001e700 comp rx=0 tx=0).stop 2023-11-28T20:47:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 -- 172.21.15.167:0/29424239 shutdown_connections 2023-11-28T20:47:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 --2- 172.21.15.167:0/29424239 >> v2:172.21.15.178:3300/0 conn(0x7fa1dc0c5be0 0x7fa1dc06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 --2- 172.21.15.167:0/29424239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 0x7fa1dc0c4510 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 --2- 172.21.15.167:0/29424239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 0x7fa1dc157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 -- 172.21.15.167:0/29424239 >> 172.21.15.167:0/29424239 conn(0x7fa1dc0cb1e0 msgr2=0x7fa1dc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 -- 172.21.15.167:0/29424239 shutdown_connections 2023-11-28T20:47:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 -- 172.21.15.167:0/29424239 wait complete. 2023-11-28T20:47:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 Processor -- start 2023-11-28T20:47:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.282+0000 7fa1e0a32640 1 -- start start 2023-11-28T20:47:50.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0c5be0 0x7fa1dc149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 0x7fa1dc0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 0x7fa1dc14bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc1611b0 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc146ec0 con 0x7fa1dc0c5be0 2023-11-28T20:47:50.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc14a300 con 0x7fa1dc150b40 2023-11-28T20:47:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1da59c640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0c5be0 msgr2=0x7fa1dc149dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1d9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 0x7fa1dc0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1da59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0c5be0 0x7fa1dc149dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1d9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 0x7fa1dc0ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47686/0 (socket says 172.21.15.167:47686) 2023-11-28T20:47:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1d9d9b640 1 -- 172.21.15.167:0/800010005 learned_addr learned my addr 172.21.15.167:0/800010005 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1dad9d640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 0x7fa1dc14bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1d9d9b640 1 -- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 msgr2=0x7fa1dc14bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1d9d9b640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 0x7fa1dc14bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1d9d9b640 1 -- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0c5be0 msgr2=0x7fa1dc149dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:47:50.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1d9d9b640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0c5be0 0x7fa1dc149dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1d9d9b640 1 -- 172.21.15.167:0/800010005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d00094d0 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1dad9d640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc150b40 0x7fa1dc14bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:47:50.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1d9d9b640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 0x7fa1dc0ca290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa1d001efa0 tx=0x7fa1d001b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00a9670 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d00a97d0 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc147770 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00a9b40 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc15f620 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1609b0 0x7fa1dc143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc074770 con 0x7fa1dc1609b0 2023-11-28T20:47:50.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1da59c640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1609b0 0x7fa1dc143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1da59c640 1 -- 172.21.15.167:0/800010005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1dc15a770 con 0x7fa1dc1609b0 2023-11-28T20:47:50.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1da59c640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1609b0 0x7fa1dc143a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00d4d0 tx=0x7fa1cc00d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc018070 con 0x7fa1dc1609b0 2023-11-28T20:47:50.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.286+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa1d00a9ca0 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.290+0000 7fa1caffd640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa1bc066510 0x7fa1bc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.290+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa1d011e870 con 0x7fa1dc0c6ff0 2023-11-28T20:47:50.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.290+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa1cc004020 con 0x7fa1dc1609b0 2023-11-28T20:47:50.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.290+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1609b0 msgr2=0x7fa1dc143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.290+0000 7fa1caffd640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1609b0 0x7fa1dc143a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00d4d0 tx=0x7fa1cc00d990 comp rx=0 tx=0).stop 2023-11-28T20:47:50.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.290+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1609b0 msgr2=0x7fa1dc143a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:50.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.290+0000 7fa1caffd640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1609b0 0x7fa1dc143a10 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00d4d0 tx=0x7fa1cc00d990 comp rx=0 tx=0).stop 2023-11-28T20:47:50.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.290+0000 7fa1dad9d640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa1bc066510 0x7fa1bc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.290+0000 7fa1dad9d640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa1bc066510 0x7fa1bc0689d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4003bd0 tx=0x7fa1d4009510 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.294+0000 7fa1e0a32640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1603e0 0x7fa1dc143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.294+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc075c90 con 0x7fa1dc1603e0 2023-11-28T20:47:50.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.294+0000 7fa1da59c640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1603e0 0x7fa1dc143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.294+0000 7fa1da59c640 1 -- 172.21.15.167:0/800010005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa1dc0c2360 con 0x7fa1dc1603e0 2023-11-28T20:47:50.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.294+0000 7fa1da59c640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1603e0 0x7fa1dc143f50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00d4d0 tx=0x7fa1cc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc01eea0 con 0x7fa1dc1603e0 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4970 (secure 0 0 0) 0x7fa1cc003830 con 0x7fa1dc1603e0 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1603e0 msgr2=0x7fa1dc143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1caffd640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1603e0 0x7fa1dc143f50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00d4d0 tx=0x7fa1cc004740 comp rx=0 tx=0).stop 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1caffd640 1 -- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1603e0 msgr2=0x7fa1dc143f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1caffd640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc1603e0 0x7fa1dc143f50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:47:50.296 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 84, 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:50.297 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:50.298 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:47:50.299 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:47:50.300 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:50.301 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:50.301 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:50.301 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:50.301 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:50.301 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:50.301 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:50.301 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:50.301 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:50.302 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:50.302 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.302 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:47:50.302 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.302 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:47:50.302 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.302 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:50.302 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:50.303 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:50.303 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:50.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.305 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:50.305 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:47:50.305 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.305 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:50.306 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:47:50.306 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.306 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.306 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.306 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:47:50.306 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:47:50.306 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:50.307 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.309 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:47:50.309 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:47:50.309 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:50.309 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:50.309 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:50.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.310 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.311 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.312 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.313 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:47:50.314 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa1bc066510 msgr2=0x7fa1bc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1e0a32640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa1bc066510 0x7fa1bc0689d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4003bd0 tx=0x7fa1d4009510 comp rx=0 tx=0).stop 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 msgr2=0x7fa1dc0ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1e0a32640 1 --2- 172.21.15.167:0/800010005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1dc0c6ff0 0x7fa1dc0ca290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa1d001efa0 tx=0x7fa1d001b4a0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1dad9d640 1 -- 172.21.15.167:0/800010005 reap_dead start 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1dad9d640 1 -- 172.21.15.167:0/800010005 reap_dead start 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 shutdown_connections 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 >> 172.21.15.167:0/800010005 conn(0x7fa1dc0cb1e0 msgr2=0x7fa1dc0c8450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 shutdown_connections 2023-11-28T20:47:50.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.298+0000 7fa1e0a32640 1 -- 172.21.15.167:0/800010005 wait complete. 2023-11-28T20:47:50.317 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:47:50.317 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:47:50.317 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:47:50.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd752046640 1 Processor -- start 2023-11-28T20:47:50.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd752046640 1 -- start start 2023-11-28T20:47:50.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd752046640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd74c0cf860 0x7fd74c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd752046640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74c15ac00 con 0x7fd74c0cfc40 2023-11-28T20:47:50.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd752046640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74c0cbd60 con 0x7fd74c153ae0 2023-11-28T20:47:50.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd752046640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74c159ff0 con 0x7fd74c0cf860 2023-11-28T20:47:50.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd74bfff640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7fd74c153ae0 legacy=0x7fd74c15d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:47:50.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd74b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd74c0cf860 0x7fd74c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd74b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd74c0cf860 0x7fd74c0cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47716/0 (socket says 172.21.15.167:47716) 2023-11-28T20:47:50.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd74b7fe640 1 -- 172.21.15.167:0/611945085 learned_addr learned my addr 172.21.15.167:0/611945085 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:50.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd74b7fe640 1 -- 172.21.15.167:0/611945085 >> v1:172.21.15.178:6789/0 conn(0x7fd74c153ae0 legacy=0x7fd74c15d4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:47:50.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd74b7fe640 1 -- 172.21.15.167:0/611945085 >> v1:172.21.15.167:6789/0 conn(0x7fd74c0cfc40 legacy=0x7fd74c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.458+0000 7fd74b7fe640 1 -- 172.21.15.167:0/611945085 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c15a2d0 con 0x7fd74c0cf860 2023-11-28T20:47:50.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd74b7fe640 1 --2- 172.21.15.167:0/611945085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cf860 0x7fd74c0cb770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009870 tx=0x7fd73c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db00702e8795271 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd74affd640 1 -- 172.21.15.167:0/611945085 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0aa430 con 0x7fd74c0cf860 2023-11-28T20:47:50.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd74affd640 1 -- 172.21.15.167:0/611945085 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c0aa590 con 0x7fd74c0cf860 2023-11-28T20:47:50.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd74affd640 1 -- 172.21.15.167:0/611945085 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0aa920 con 0x7fd74c0cf860 2023-11-28T20:47:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd752046640 1 -- 172.21.15.167:0/611945085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cf860 msgr2=0x7fd74c0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd752046640 1 --2- 172.21.15.167:0/611945085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cf860 0x7fd74c0cb770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009870 tx=0x7fd73c01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd752046640 1 -- 172.21.15.167:0/611945085 shutdown_connections 2023-11-28T20:47:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd752046640 1 --2- 172.21.15.167:0/611945085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cf860 0x7fd74c0cb770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd752046640 1 -- 172.21.15.167:0/611945085 >> 172.21.15.167:0/611945085 conn(0x7fd74c06c1f0 msgr2=0x7fd74c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd752046640 1 -- 172.21.15.167:0/611945085 shutdown_connections 2023-11-28T20:47:50.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.462+0000 7fd752046640 1 -- 172.21.15.167:0/611945085 wait complete. 2023-11-28T20:47:50.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 Processor -- start 2023-11-28T20:47:50.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 -- start start 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd74c0cf860 0x7fd74c15c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cfc40 0x7fd74c13f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c153ae0 0x7fd74c13f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c157e20 con 0x7fd74c0cfc40 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c158240 con 0x7fd74c0cf860 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c157b10 con 0x7fd74c153ae0 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd74b7fe640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd74c0cf860 msgr2=0x7fd74c15c9f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd74b7fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd74c0cf860 0x7fd74c15c9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd743fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cfc40 0x7fd74c13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd743fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cfc40 0x7fd74c13f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47722/0 (socket says 172.21.15.167:47722) 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd743fff640 1 -- 172.21.15.167:0/1301120295 learned_addr learned my addr 172.21.15.167:0/1301120295 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:47:50.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd74bfff640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c153ae0 0x7fd74c13f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd743fff640 1 -- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c153ae0 msgr2=0x7fd74c13f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd743fff640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c153ae0 0x7fd74c13f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd743fff640 1 -- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd74c0cf860 msgr2=0x7fd74c15c9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd743fff640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd74c0cf860 0x7fd74c15c9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd743fff640 1 -- 172.21.15.167:0/1301120295 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c0094d0 con 0x7fd74c0cfc40 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd743fff640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cfc40 0x7fd74c13f170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd73400c3c0 tx=0x7fd73400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340052d0 con 0x7fd74c0cfc40 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd734005430 con 0x7fd74c0cfc40 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74c13aa70 con 0x7fd74c0cfc40 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734003840 con 0x7fd74c0cfc40 2023-11-28T20:47:50.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74c0b3820 con 0x7fd74c0cfc40 2023-11-28T20:47:50.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c0b5210 0x7fd74c13dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c072860 con 0x7fd74c0b5210 2023-11-28T20:47:50.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.466+0000 7fd74b7fe640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c0b5210 0x7fd74c13dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd74b7fe640 1 -- 172.21.15.167:0/1301120295 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd74c159cc0 con 0x7fd74c0b5210 2023-11-28T20:47:50.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd74b7fe640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c0b5210 0x7fd74c13dff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0c9c50 tx=0x7fd73c01ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd7340039a0 con 0x7fd74c0cfc40 2023-11-28T20:47:50.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd748ff9640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd72c066420 0x7fd72c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd734083720 con 0x7fd74c0cfc40 2023-11-28T20:47:50.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c004020 con 0x7fd74c0b5210 2023-11-28T20:47:50.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd73c0b7070 con 0x7fd74c0b5210 2023-11-28T20:47:50.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c0b5210 msgr2=0x7fd74c13dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd748ff9640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c0b5210 0x7fd74c13dff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0c9c50 tx=0x7fd73c01ad10 comp rx=0 tx=0).stop 2023-11-28T20:47:50.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c0b5210 msgr2=0x7fd74c13dff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:50.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd748ff9640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c0b5210 0x7fd74c13dff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd74bfff640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd72c066420 0x7fd72c0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.470+0000 7fd74bfff640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd72c066420 0x7fd72c0688e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd744003bd0 tx=0x7fd744009450 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c13e530 0x7fd74c13e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:47:50.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c067c40 con 0x7fd74c13e530 2023-11-28T20:47:50.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd74b7fe640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c13e530 0x7fd74c13e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:47:50.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd74b7fe640 1 -- 172.21.15.167:0/1301120295 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd74c075c90 con 0x7fd74c13e530 2023-11-28T20:47:50.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd74b7fe640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c13e530 0x7fd74c13e940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009870 tx=0x7fd73c019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:47:50.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c003c20 con 0x7fd74c13e530 2023-11-28T20:47:50.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5111 (secure 0 0 0) 0x7fd73c0c7070 con 0x7fd74c13e530 2023-11-28T20:47:50.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c13e530 msgr2=0x7fd74c13e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd748ff9640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c13e530 0x7fd74c13e940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009870 tx=0x7fd73c019270 comp rx=0 tx=0).stop 2023-11-28T20:47:50.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd748ff9640 1 -- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c13e530 msgr2=0x7fd74c13e940 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:47:50.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd748ff9640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd74c13e530 0x7fd74c13e940 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.480 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:47:50.480 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:50.480 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:50.480 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 84, 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:47:50.481 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.482 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:50.483 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:47:50.484 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:47:50.485 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:47:50.486 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:47:50.486 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:47:50.486 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:47:50.486 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:50.487 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:50.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.488 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:50.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:47:50.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.488 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:50.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:47:50.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:47:50.489 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.490 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:47:50.491 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.492 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.493 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.494 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.495 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.496 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:47:50.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.496 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:47:50.496 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.496 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:50.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.496 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:47:50.497 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:47:50.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:47:50.498 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:47:50.498 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:47:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd72c066420 msgr2=0x7fd72c0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd72c066420 0x7fd72c0688e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd744003bd0 tx=0x7fd744009450 comp rx=0 tx=0).stop 2023-11-28T20:47:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cfc40 msgr2=0x7fd74c13f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:47:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cfc40 0x7fd74c13f170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd73400c3c0 tx=0x7fd73400c880 comp rx=0 tx=0).stop 2023-11-28T20:47:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd74bfff640 1 -- 172.21.15.167:0/1301120295 reap_dead start 2023-11-28T20:47:50.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 shutdown_connections 2023-11-28T20:47:50.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 --2- 172.21.15.167:0/1301120295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c0cfc40 0x7fd74c13f170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:47:50.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 >> 172.21.15.167:0/1301120295 conn(0x7fd74c06c1f0 msgr2=0x7fd74c1521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:47:50.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 shutdown_connections 2023-11-28T20:47:50.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:47:50.478+0000 7fd752046640 1 -- 172.21.15.167:0/1301120295 wait complete. 2023-11-28T20:47:50.500 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:47:50.500 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:48:10.501 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:48:10.502 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2023-11-28T20:48:10.502 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T20:48:10.502 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T20:48:10.505 INFO:tasks.ceph.mon.b:Started 2023-11-28T20:48:10.505 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:48:10.506 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:48:10.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.649+0000 7f6d4bf65640 1 Processor -- start 2023-11-28T20:48:10.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.649+0000 7f6d4bf65640 1 -- start start 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4bf65640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6d44151f60 0x7f6d440c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4bf65640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6d4406a580 0x7f6d4406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4bf65640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d440c6120 con 0x7f6d440c5c90 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4bf65640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4406aed0 con 0x7f6d44151f60 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4bf65640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d440c4da0 con 0x7f6d4406a580 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d49d01640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6d44151f60 0x7f6d440c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d49d01640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6d44151f60 0x7f6d440c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42052/0 (socket says 172.21.15.167:42052) 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d49d01640 1 -- 172.21.15.167:0/1871579580 learned_addr learned my addr 172.21.15.167:0/1871579580 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4a502640 1 --2- 172.21.15.167:0/1871579580 >> v2:172.21.15.178:3300/0 conn(0x7f6d4406a580 0x7f6d4406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:10.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4a502640 1 -- 172.21.15.167:0/1871579580 >> v2:172.21.15.178:3300/0 conn(0x7f6d4406a580 msgr2=0x7f6d4406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:48:10.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4a502640 1 -- 172.21.15.167:0/1871579580 >> v2:172.21.15.178:3300/0 conn(0x7f6d4406a580 msgr2=0x7f6d4406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:10.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4a502640 1 --2- 172.21.15.167:0/1871579580 >> v2:172.21.15.178:3300/0 conn(0x7f6d4406a580 0x7f6d4406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:10.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d4a502640 1 --2- 172.21.15.167:0/1871579580 >> v2:172.21.15.178:3300/0 conn(0x7f6d4406a580 0x7f6d4406a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:10.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d49d01640 1 -- 172.21.15.167:0/1871579580 >> v2:172.21.15.178:3300/0 conn(0x7f6d4406a580 msgr2=0x7f6d4406a990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:10.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d49d01640 1 --2- 172.21.15.167:0/1871579580 >> v2:172.21.15.178:3300/0 conn(0x7f6d4406a580 0x7f6d4406a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d49d01640 1 -- 172.21.15.167:0/1871579580 >> v1:172.21.15.178:6789/0 conn(0x7f6d440c5c90 legacy=0x7f6d440c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:10.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d49d01640 1 -- 172.21.15.167:0/1871579580 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4415b220 con 0x7f6d44151f60 2023-11-28T20:48:10.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d49d01640 1 --2- 172.21.15.167:0/1871579580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 0x7f6d440c75c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d440c5580 tx=0x7f6d4001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ccc8d983fcc51d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:10.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.653+0000 7f6d48cff640 1 -- 172.21.15.167:0/1871579580 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d400ab600 con 0x7f6d44151f60 2023-11-28T20:48:10.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d48cff640 1 -- 172.21.15.167:0/1871579580 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d400a7050 con 0x7f6d44151f60 2023-11-28T20:48:10.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d48cff640 1 -- 172.21.15.167:0/1871579580 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d400ab980 con 0x7f6d44151f60 2023-11-28T20:48:10.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 -- 172.21.15.167:0/1871579580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 msgr2=0x7f6d440c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:10.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 --2- 172.21.15.167:0/1871579580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 0x7f6d440c75c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d440c5580 tx=0x7f6d4001c470 comp rx=0 tx=0).stop 2023-11-28T20:48:10.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 -- 172.21.15.167:0/1871579580 shutdown_connections 2023-11-28T20:48:10.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 --2- 172.21.15.167:0/1871579580 >> v2:172.21.15.178:3300/0 conn(0x7f6d4406a580 0x7f6d4406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 --2- 172.21.15.167:0/1871579580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 0x7f6d440c75c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 -- 172.21.15.167:0/1871579580 >> 172.21.15.167:0/1871579580 conn(0x7f6d440cb1e0 msgr2=0x7f6d440cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:10.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 -- 172.21.15.167:0/1871579580 shutdown_connections 2023-11-28T20:48:10.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 -- 172.21.15.167:0/1871579580 wait complete. 2023-11-28T20:48:10.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 Processor -- start 2023-11-28T20:48:10.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 -- start start 2023-11-28T20:48:10.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4406a580 0x7f6d4413e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:10.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d440c5c90 0x7f6d440ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:10.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 0x7f6d441f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:10.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44161e10 con 0x7f6d44151f60 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44162000 con 0x7f6d4406a580 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4bf65640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440c94b0 con 0x7f6d440c5c90 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4a502640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 0x7f6d441f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d49d01640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4406a580 0x7f6d4413e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d49500640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d440c5c90 0x7f6d440ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4a502640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 0x7f6d441f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42058/0 (socket says 172.21.15.167:42058) 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d4a502640 1 -- 172.21.15.167:0/2251280813 learned_addr learned my addr 172.21.15.167:0/2251280813 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d49d01640 1 -- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4406a580 msgr2=0x7f6d4413e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d49d01640 1 -- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4406a580 msgr2=0x7f6d4413e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d49d01640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4406a580 0x7f6d4413e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.657+0000 7f6d49d01640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4406a580 0x7f6d4413e8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d4a502640 1 -- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d440c5c90 msgr2=0x7f6d440ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d4a502640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d440c5c90 0x7f6d440ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d4a502640 1 -- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4406a580 msgr2=0x7f6d4413e8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d4a502640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4406a580 0x7f6d4413e8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d4a502640 1 -- 172.21.15.167:0/2251280813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d400094d0 con 0x7f6d44151f60 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d4a502640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 0x7f6d441f6150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c007e30 tx=0x7f6d3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d3a7fc640 1 -- 172.21.15.167:0/2251280813 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c014420 con 0x7f6d44151f60 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d3a7fc640 1 -- 172.21.15.167:0/2251280813 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0145a0 con 0x7f6d44151f60 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d3a7fc640 1 -- 172.21.15.167:0/2251280813 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c014950 con 0x7f6d44151f60 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d440c9790 con 0x7f6d44151f60 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d440ca3f0 con 0x7f6d44151f60 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d440682c0 con 0x7f6d44151f60 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d3a7fc640 1 -- 172.21.15.167:0/2251280813 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d3c014ab0 con 0x7f6d44151f60 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d3a7fc640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d280664a0 0x7f6d28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:10.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d3a7fc640 1 -- 172.21.15.167:0/2251280813 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6d3c084b30 con 0x7f6d44151f60 2023-11-28T20:48:10.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.661+0000 7f6d49d01640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d280664a0 0x7f6d28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:10.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.665+0000 7f6d49d01640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d280664a0 0x7f6d28068960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d400ad000 tx=0x7f6d400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:10.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.665+0000 7f6d3a7fc640 1 -- 172.21.15.167:0/2251280813 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d3c051ba0 con 0x7f6d44151f60 2023-11-28T20:48:10.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6d440ca610 con 0x7f6d44151f60 2023-11-28T20:48:10.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d3a7fc640 1 -- 172.21.15.167:0/2251280813 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f6d3c0551c0 con 0x7f6d44151f60 2023-11-28T20:48:10.892 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":84,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d280664a0 msgr2=0x7f6d28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d280664a0 0x7f6d28068960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d400ad000 tx=0x7f6d400a6000 comp rx=0 tx=0).stop 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 msgr2=0x7f6d441f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 0x7f6d441f6150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c007e30 tx=0x7f6d3c00e4b0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 shutdown_connections 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d280664a0 0x7f6d28068960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d44151f60 0x7f6d441f6150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d440c5c90 0x7f6d440ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 --2- 172.21.15.167:0/2251280813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4406a580 0x7f6d4413e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 >> 172.21.15.167:0/2251280813 conn(0x7f6d440cb1e0 msgr2=0x7f6d440c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:10.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 shutdown_connections 2023-11-28T20:48:10.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:10.893+0000 7f6d4bf65640 1 -- 172.21.15.167:0/2251280813 wait complete. 2023-11-28T20:48:13.916 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:48:14.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbe206b640 1 Processor -- start 2023-11-28T20:48:14.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbe206b640 1 -- start start 2023-11-28T20:48:14.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbe206b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdbdc0cf860 0x7fdbdc0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:14.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbe206b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdbdc0cfc40 0x7fdbdc0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:14.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbe206b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc15ac00 con 0x7fdbdc153ae0 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbe206b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc0cbd60 con 0x7fdbdc0cfc40 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbe206b640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc159ff0 con 0x7fdbdc0cf860 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbdaffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdbdc0cfc40 0x7fdbdc0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbdaffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdbdc0cfc40 0x7fdbdc0ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56488/0 (socket says 172.21.15.167:56488) 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbdaffd640 1 -- 172.21.15.167:0/4274868220 learned_addr learned my addr 172.21.15.167:0/4274868220 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbdb7fe640 1 --2- 172.21.15.167:0/4274868220 >> v2:172.21.15.178:3300/0 conn(0x7fdbdc0cf860 0x7fdbdc0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbdaffd640 1 -- 172.21.15.167:0/4274868220 >> v2:172.21.15.178:3300/0 conn(0x7fdbdc0cf860 msgr2=0x7fdbdc0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbdaffd640 1 --2- 172.21.15.167:0/4274868220 >> v2:172.21.15.178:3300/0 conn(0x7fdbdc0cf860 0x7fdbdc0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbdaffd640 1 -- 172.21.15.167:0/4274868220 >> v1:172.21.15.178:6789/0 conn(0x7fdbdc153ae0 legacy=0x7fdbdc15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:14.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.061+0000 7fdbdaffd640 1 -- 172.21.15.167:0/4274868220 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc15a2d0 con 0x7fdbdc0cfc40 2023-11-28T20:48:14.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbdaffd640 1 --2- 172.21.15.167:0/4274868220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cfc40 0x7fdbdc0ca510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0d03b0 tx=0x7fdbd001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d01edb2df31ae26 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:14.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbda7fc640 1 -- 172.21.15.167:0/4274868220 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00aa5f0 con 0x7fdbdc0cfc40 2023-11-28T20:48:14.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbda7fc640 1 -- 172.21.15.167:0/4274868220 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd00aa750 con 0x7fdbdc0cfc40 2023-11-28T20:48:14.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbda7fc640 1 -- 172.21.15.167:0/4274868220 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00aaae0 con 0x7fdbdc0cfc40 2023-11-28T20:48:14.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbe206b640 1 -- 172.21.15.167:0/4274868220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cfc40 msgr2=0x7fdbdc0ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:14.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbe206b640 1 --2- 172.21.15.167:0/4274868220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cfc40 0x7fdbdc0ca510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0d03b0 tx=0x7fdbd001c490 comp rx=0 tx=0).stop 2023-11-28T20:48:14.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbe206b640 1 -- 172.21.15.167:0/4274868220 shutdown_connections 2023-11-28T20:48:14.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbe206b640 1 --2- 172.21.15.167:0/4274868220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cfc40 0x7fdbdc0ca510 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbe206b640 1 --2- 172.21.15.167:0/4274868220 >> v2:172.21.15.178:3300/0 conn(0x7fdbdc0cf860 0x7fdbdc0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbe206b640 1 -- 172.21.15.167:0/4274868220 >> 172.21.15.167:0/4274868220 conn(0x7fdbdc06c1f0 msgr2=0x7fdbdc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:14.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbe206b640 1 -- 172.21.15.167:0/4274868220 shutdown_connections 2023-11-28T20:48:14.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.065+0000 7fdbe206b640 1 -- 172.21.15.167:0/4274868220 wait complete. 2023-11-28T20:48:14.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 Processor -- start 2023-11-28T20:48:14.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 -- start start 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cf860 0x7fdbdc1f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbdc0cfc40 0x7fdbdc13f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbdc153ae0 0x7fdbdc0b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc13f1f0 con 0x7fdbdc0cf860 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0b5610 con 0x7fdbdc0cfc40 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc13d120 con 0x7fdbdc153ae0 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cf860 0x7fdbdc1f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cf860 0x7fdbdc1f42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56490/0 (socket says 172.21.15.167:56490) 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdb7fe640 1 -- 172.21.15.167:0/3060531273 learned_addr learned my addr 172.21.15.167:0/3060531273 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdaffd640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbdc0cfc40 0x7fdbdc13f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:14.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdbfff640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbdc153ae0 0x7fdbdc0b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdaffd640 1 -- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbdc0cfc40 msgr2=0x7fdbdc13f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdaffd640 1 -- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbdc0cfc40 msgr2=0x7fdbdc13f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdaffd640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbdc0cfc40 0x7fdbdc13f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdaffd640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbdc0cfc40 0x7fdbdc13f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdb7fe640 1 -- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbdc153ae0 msgr2=0x7fdbdc0b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdb7fe640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbdc153ae0 0x7fdbdc0b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdb7fe640 1 -- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbdc0cfc40 msgr2=0x7fdbdc13f610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdb7fe640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbdc0cfc40 0x7fdbdc13f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdb7fe640 1 -- 172.21.15.167:0/3060531273 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd00094d0 con 0x7fdbdc0cf860 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbdb7fe640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cf860 0x7fdbdc1f42b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00d5f0 tx=0x7fdbcc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbc3fff640 1 -- 172.21.15.167:0/3060531273 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0125f0 con 0x7fdbdc0cf860 2023-11-28T20:48:14.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbc3fff640 1 -- 172.21.15.167:0/3060531273 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc012750 con 0x7fdbdc0cf860 2023-11-28T20:48:14.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc13e570 con 0x7fdbdc0cf860 2023-11-28T20:48:14.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbc3fff640 1 -- 172.21.15.167:0/3060531273 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc012ae0 con 0x7fdbdc0cf860 2023-11-28T20:48:14.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc13eb30 con 0x7fdbdc0cf860 2023-11-28T20:48:14.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.069+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc159c80 con 0x7fdbdc0cf860 2023-11-28T20:48:14.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.073+0000 7fdbc3fff640 1 -- 172.21.15.167:0/3060531273 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdbcc012c40 con 0x7fdbdc0cf860 2023-11-28T20:48:14.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.073+0000 7fdbc3fff640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdbc80664a0 0x7fdbc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:14.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.073+0000 7fdbc3fff640 1 -- 172.21.15.167:0/3060531273 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fdbcc0846b0 con 0x7fdbdc0cf860 2023-11-28T20:48:14.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.073+0000 7fdbdaffd640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdbc80664a0 0x7fdbc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:14.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.073+0000 7fdbdaffd640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdbc80664a0 0x7fdbc8068960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00ae000 tx=0x7fdbd00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:14.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.077+0000 7fdbc3fff640 1 -- 172.21.15.167:0/3060531273 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbcc0517b0 con 0x7fdbdc0cf860 2023-11-28T20:48:14.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdbdc075c90 con 0x7fdbdc0cf860 2023-11-28T20:48:14.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbc3fff640 1 -- 172.21.15.167:0/3060531273 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fdbcc054dd0 con 0x7fdbdc0cf860 2023-11-28T20:48:14.340 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":84,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:48:14.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdbc80664a0 msgr2=0x7fdbc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:14.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdbc80664a0 0x7fdbc8068960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00ae000 tx=0x7fdbd00a7000 comp rx=0 tx=0).stop 2023-11-28T20:48:14.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cf860 msgr2=0x7fdbdc1f42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:14.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cf860 0x7fdbdc1f42b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00d5f0 tx=0x7fdbcc00dab0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 shutdown_connections 2023-11-28T20:48:14.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdbc80664a0 0x7fdbc8068960 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbdc153ae0 0x7fdbdc0b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbdc0cfc40 0x7fdbdc13f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 --2- 172.21.15.167:0/3060531273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbdc0cf860 0x7fdbdc1f42b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:14.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 >> 172.21.15.167:0/3060531273 conn(0x7fdbdc06c1f0 msgr2=0x7fdbdc0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:14.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 shutdown_connections 2023-11-28T20:48:14.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:14.341+0000 7fdbe206b640 1 -- 172.21.15.167:0/3060531273 wait complete. 2023-11-28T20:48:17.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:48:17.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c449c640 1 Processor -- start 2023-11-28T20:48:17.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c449c640 1 -- start start 2023-11-28T20:48:17.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c449c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151f60 0x7ff4bc0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c449c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff4bc0c5c90 0x7ff4bc0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c449c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc15b220 con 0x7ff4bc06a580 2023-11-28T20:48:17.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c449c640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0c4da0 con 0x7ff4bc0c5c90 2023-11-28T20:48:17.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c449c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0c60f0 con 0x7ff4bc151f60 2023-11-28T20:48:17.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c2a39640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff4bc06a580 0x7ff4bc06ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51802/0 (socket says 172.21.15.167:51802) 2023-11-28T20:48:17.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c2a39640 1 -- 172.21.15.167:0/2710363507 learned_addr learned my addr 172.21.15.167:0/2710363507 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:48:17.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1a37640 1 --2- 172.21.15.167:0/2710363507 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc0c5c90 0x7ff4bc0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c2238640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151f60 0x7ff4bc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1a37640 1 -- 172.21.15.167:0/2710363507 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc0c5c90 msgr2=0x7ff4bc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1a37640 1 -- 172.21.15.167:0/2710363507 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc0c5c90 msgr2=0x7ff4bc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1a37640 1 --2- 172.21.15.167:0/2710363507 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc0c5c90 0x7ff4bc0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797059526 0 0) 0x7ff4bc15b220 con 0x7ff4bc06a580 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a8003530 con 0x7ff4bc06a580 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1a37640 1 --2- 172.21.15.167:0/2710363507 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc0c5c90 0x7ff4bc0c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 403056383 0 0) 0x7ff4a8003530 con 0x7ff4bc06a580 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151f60 msgr2=0x7ff4bc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151f60 0x7ff4bc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc0c5c90 msgr2=0x7ff4bc0c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 --2- 172.21.15.167:0/2710363507 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc0c5c90 0x7ff4bc0c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc152340 con 0x7ff4bc06a580 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7ff4b4001a00 con 0x7ff4bc06a580 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 >> v1:172.21.15.167:6789/0 conn(0x7ff4bc06a580 legacy=0x7ff4bc06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151f60 0x7ff4a8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a8003f00 0x7ff4a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4a8004d10 0x7ff4a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0c60f0 con 0x7ff4a8003f00 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a800ba40 con 0x7ff4a8004d10 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a800bbd0 con 0x7ff4bc151f60 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c1a37640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a8003f00 0x7ff4a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c2a39640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4a8004d10 0x7ff4a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.513+0000 7ff4c2238640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151f60 0x7ff4a8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c1a37640 1 -- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151f60 msgr2=0x7ff4a8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:17.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c1a37640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151f60 0x7ff4a8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c1a37640 1 -- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4a8004d10 msgr2=0x7ff4a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:17.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c1a37640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4a8004d10 0x7ff4a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c1a37640 1 -- 172.21.15.167:0/2710363507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8003530 con 0x7ff4a8003f00 2023-11-28T20:48:17.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c2238640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151f60 0x7ff4a8003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:17.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c2a39640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4a8004d10 0x7ff4a8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:17.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c1a37640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a8003f00 0x7ff4a80047d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c850 tx=0x7ff4ac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80690639dc8d8861 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:17.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0ab650 con 0x7ff4a8003f00 2023-11-28T20:48:17.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0ab7b0 con 0x7ff4a8003f00 2023-11-28T20:48:17.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c1236640 1 -- 172.21.15.167:0/2710363507 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0abb60 con 0x7ff4a8003f00 2023-11-28T20:48:17.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c449c640 1 -- 172.21.15.167:0/2710363507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a8003f00 msgr2=0x7ff4a80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c449c640 1 --2- 172.21.15.167:0/2710363507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a8003f00 0x7ff4a80047d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c850 tx=0x7ff4ac01c510 comp rx=0 tx=0).stop 2023-11-28T20:48:17.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.517+0000 7ff4c2a39640 1 -- 172.21.15.167:0/2710363507 reap_dead start 2023-11-28T20:48:17.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 -- 172.21.15.167:0/2710363507 shutdown_connections 2023-11-28T20:48:17.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 -- 172.21.15.167:0/2710363507 >> 172.21.15.167:0/2710363507 conn(0x7ff4bc0cb1e0 msgr2=0x7ff4bc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:17.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 -- 172.21.15.167:0/2710363507 shutdown_connections 2023-11-28T20:48:17.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 -- 172.21.15.167:0/2710363507 wait complete. 2023-11-28T20:48:17.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 Processor -- start 2023-11-28T20:48:17.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 -- start start 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4a8003f00 0x7ff4bc0c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc14bcf0 0x7ff4bc1f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc1e7bd0 0x7ff4bc1f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc156f50 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0708a0 con 0x7ff4bc14bcf0 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c449c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc070b80 con 0x7ff4a8003f00 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2a39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc1e7bd0 0x7ff4bc1f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2a39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc1e7bd0 0x7ff4bc1f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56514/0 (socket says 172.21.15.167:56514) 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2a39640 1 -- 172.21.15.167:0/2040053437 learned_addr learned my addr 172.21.15.167:0/2040053437 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:17.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2238640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4a8003f00 0x7ff4bc0c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c1a37640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc14bcf0 0x7ff4bc1f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2a39640 1 -- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4a8003f00 msgr2=0x7ff4bc0c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2a39640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4a8003f00 0x7ff4bc0c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2a39640 1 -- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc14bcf0 msgr2=0x7ff4bc1f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2a39640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc14bcf0 0x7ff4bc1f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2a39640 1 -- 172.21.15.167:0/2040053437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc071130 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.521+0000 7ff4c2238640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4a8003f00 0x7ff4bc0c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4c2a39640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc1e7bd0 0x7ff4bc1f6740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4000f90 tx=0x7ff4b400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4b2ffd640 1 -- 172.21.15.167:0/2040053437 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400eb90 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4b2ffd640 1 -- 172.21.15.167:0/2040053437 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b400ed10 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4b2ffd640 1 -- 172.21.15.167:0/2040053437 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4013660 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc071410 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc158040 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc0682c0 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4b2ffd640 1 -- 172.21.15.167:0/2040053437 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4b40137c0 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4b2ffd640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4a0066470 0x7ff4a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4b2ffd640 1 -- 172.21.15.167:0/2040053437 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff4b40846a0 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.525+0000 7ff4c2238640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4a0066470 0x7ff4a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.529+0000 7ff4c2238640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4a0066470 0x7ff4a0068930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009a90 tx=0x7ff4b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:17.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.529+0000 7ff4b2ffd640 1 -- 172.21.15.167:0/2040053437 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4b4051730 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff4bc070f90 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4b2ffd640 1 -- 172.21.15.167:0/2040053437 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7ff4bc070f90 con 0x7ff4bc1e7bd0 2023-11-28T20:48:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":86,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:48:17.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4a0066470 msgr2=0x7ff4a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4a0066470 0x7ff4a0068930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009a90 tx=0x7ff4b8008040 comp rx=0 tx=0).stop 2023-11-28T20:48:17.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc1e7bd0 msgr2=0x7ff4bc1f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc1e7bd0 0x7ff4bc1f6740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4000f90 tx=0x7ff4b400e530 comp rx=0 tx=0).stop 2023-11-28T20:48:17.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 shutdown_connections 2023-11-28T20:48:17.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4a0066470 0x7ff4a0068930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc1e7bd0 0x7ff4bc1f6740 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc14bcf0 0x7ff4bc1f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 --2- 172.21.15.167:0/2040053437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4a8003f00 0x7ff4bc0c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 >> 172.21.15.167:0/2040053437 conn(0x7ff4bc0cb1e0 msgr2=0x7ff4bc0c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:17.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 shutdown_connections 2023-11-28T20:48:17.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.733+0000 7ff4c449c640 1 -- 172.21.15.167:0/2040053437 wait complete. 2023-11-28T20:48:17.753 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:48:17.753 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:48:17.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:48:17.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc60a357640 1 Processor -- start 2023-11-28T20:48:17.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc60a357640 1 -- start start 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc60a357640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc604150b40 0x7fc604157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc60a357640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc6040c4510 0x7fc60406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc60a357640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040c48f0 con 0x7fc6040c6ff0 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc60a357640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040c62f0 con 0x7fc604150b40 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc60a357640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040c6ac0 con 0x7fc6040c4510 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc603fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc604150b40 0x7fc604157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc603fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc604150b40 0x7fc604157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56524/0 (socket says 172.21.15.167:56524) 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.893+0000 7fc603fff640 1 -- 172.21.15.167:0/1667332670 learned_addr learned my addr 172.21.15.167:0/1667332670 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc6088f4640 1 --2- 172.21.15.167:0/1667332670 >> v2:172.21.15.178:3300/0 conn(0x7fc6040c4510 0x7fc60406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc603fff640 1 -- 172.21.15.167:0/1667332670 >> v2:172.21.15.178:3300/0 conn(0x7fc6040c4510 msgr2=0x7fc60406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:17.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc603fff640 1 --2- 172.21.15.167:0/1667332670 >> v2:172.21.15.178:3300/0 conn(0x7fc6040c4510 0x7fc60406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc603fff640 1 -- 172.21.15.167:0/1667332670 >> v1:172.21.15.178:6789/0 conn(0x7fc6040c6ff0 legacy=0x7fc6040c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:17.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc603fff640 1 -- 172.21.15.167:0/1667332670 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040c6500 con 0x7fc604150b40 2023-11-28T20:48:17.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc603fff640 1 --2- 172.21.15.167:0/1667332670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc604150b40 0x7fc604157560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6040cc090 tx=0x7fc5f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc34cc3f6bee7f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:17.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc602ffd640 1 -- 172.21.15.167:0/1667332670 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40ad680 con 0x7fc604150b40 2023-11-28T20:48:17.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc602ffd640 1 -- 172.21.15.167:0/1667332670 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f40ad7e0 con 0x7fc604150b40 2023-11-28T20:48:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc602ffd640 1 -- 172.21.15.167:0/1667332670 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40adb70 con 0x7fc604150b40 2023-11-28T20:48:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc60a357640 1 -- 172.21.15.167:0/1667332670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc604150b40 msgr2=0x7fc604157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.897+0000 7fc60a357640 1 --2- 172.21.15.167:0/1667332670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc604150b40 0x7fc604157560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6040cc090 tx=0x7fc5f401c470 comp rx=0 tx=0).stop 2023-11-28T20:48:17.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 -- 172.21.15.167:0/1667332670 shutdown_connections 2023-11-28T20:48:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 --2- 172.21.15.167:0/1667332670 >> v2:172.21.15.178:3300/0 conn(0x7fc6040c4510 0x7fc60406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 --2- 172.21.15.167:0/1667332670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc604150b40 0x7fc604157560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 -- 172.21.15.167:0/1667332670 >> 172.21.15.167:0/1667332670 conn(0x7fc6040cb1e0 msgr2=0x7fc6040cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 -- 172.21.15.167:0/1667332670 shutdown_connections 2023-11-28T20:48:17.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 -- 172.21.15.167:0/1667332670 wait complete. 2023-11-28T20:48:17.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 Processor -- start 2023-11-28T20:48:17.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 -- start start 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6040c4510 0x7fc60413ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6040c6ff0 0x7fc6040c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc604150b40 0x7fc6040ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc604151c00 con 0x7fc6040c4510 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc604162300 con 0x7fc6040c6ff0 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc60a357640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60413b2e0 con 0x7fc604150b40 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc603fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6040c4510 0x7fc60413ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc603fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6040c4510 0x7fc60413ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56540/0 (socket says 172.21.15.167:56540) 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc603fff640 1 -- 172.21.15.167:0/2168950911 learned_addr learned my addr 172.21.15.167:0/2168950911 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc6037fe640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6040c6ff0 0x7fc6040c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc6088f4640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc604150b40 0x7fc6040ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc603fff640 1 -- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc604150b40 msgr2=0x7fc6040ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc603fff640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc604150b40 0x7fc6040ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc603fff640 1 -- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6040c6ff0 msgr2=0x7fc6040c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc603fff640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6040c6ff0 0x7fc6040c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc603fff640 1 -- 172.21.15.167:0/2168950911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f40094d0 con 0x7fc6040c4510 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc6088f4640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc604150b40 0x7fc6040ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc6037fe640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6040c6ff0 0x7fc6040c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc603fff640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6040c4510 0x7fc60413ada0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc5f401a0a0 tx=0x7fc5f401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.901+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40ade20 con 0x7fc6040c4510 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f40b8450 con 0x7fc6040c4510 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6041f5e80 con 0x7fc6040c4510 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40b87c0 con 0x7fc6040c4510 2023-11-28T20:48:17.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6041f6440 con 0x7fc6040c4510 2023-11-28T20:48:17.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc60a357640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041f6630 0x7fc604140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc604074770 con 0x7fc6041f6630 2023-11-28T20:48:17.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc6037fe640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041f6630 0x7fc604140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc6037fe640 1 -- 172.21.15.167:0/2168950911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc604157040 con 0x7fc6041f6630 2023-11-28T20:48:17.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc6037fe640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041f6630 0x7fc604140b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc604150720 tx=0x7fc5f800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:17.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8012800 con 0x7fc6041f6630 2023-11-28T20:48:17.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5f40b4070 con 0x7fc6040c4510 2023-11-28T20:48:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5f0066540 0x7fc5f0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc5f411e830 con 0x7fc6040c4510 2023-11-28T20:48:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc5f8012960 con 0x7fc6041f6630 2023-11-28T20:48:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041f6630 msgr2=0x7fc604140b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041f6630 0x7fc604140b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc604150720 tx=0x7fc5f800d950 comp rx=0 tx=0).stop 2023-11-28T20:48:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041f6630 msgr2=0x7fc604140b70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc600ff9640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041f6630 0x7fc604140b70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.905+0000 7fc6088f4640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5f0066540 0x7fc5f0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.909+0000 7fc6088f4640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5f0066540 0x7fc5f0068a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009f70 tx=0x7fc5fc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:17.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041410b0 0x7fc604162770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:17.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc604162440 con 0x7fc6041410b0 2023-11-28T20:48:17.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc6037fe640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041410b0 0x7fc604162770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:17.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc6037fe640 1 -- 172.21.15.167:0/2168950911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc6040682c0 con 0x7fc6041410b0 2023-11-28T20:48:17.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc6037fe640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041410b0 0x7fc604162770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8015000 tx=0x7fc5f8003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:17.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8021070 con 0x7fc6041410b0 2023-11-28T20:48:17.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4981 (secure 0 0 0) 0x7fc5f8007520 con 0x7fc6041410b0 2023-11-28T20:48:17.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041410b0 msgr2=0x7fc604162770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc600ff9640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041410b0 0x7fc604162770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8015000 tx=0x7fc5f8003770 comp rx=0 tx=0).stop 2023-11-28T20:48:17.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc600ff9640 1 -- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041410b0 msgr2=0x7fc604162770 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:17.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc600ff9640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6041410b0 0x7fc604162770 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8015000 tx=0x7fc5f8003770 comp rx=0 tx=0).stop 2023-11-28T20:48:17.914 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 86, 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:48:17.915 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:17.916 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:17.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:48:17.918 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:48:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:48:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:48:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:48:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:17.919 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:17.920 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:48:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:17.921 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.922 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:17.923 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:17.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:48:17.925 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:17.926 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:48:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:48:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:17.927 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:17.928 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:48:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:17.929 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:48:17.930 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:48:17.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5f0066540 msgr2=0x7fc5f0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5f0066540 0x7fc5f0068a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009f70 tx=0x7fc5fc00b040 comp rx=0 tx=0).stop 2023-11-28T20:48:17.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6040c4510 msgr2=0x7fc60413ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:17.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6040c4510 0x7fc60413ada0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc5f401a0a0 tx=0x7fc5f401acb0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc6088f4640 1 -- 172.21.15.167:0/2168950911 reap_dead start 2023-11-28T20:48:17.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 shutdown_connections 2023-11-28T20:48:17.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 --2- 172.21.15.167:0/2168950911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6040c4510 0x7fc60413ada0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:17.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 >> 172.21.15.167:0/2168950911 conn(0x7fc6040cb1e0 msgr2=0x7fc604073b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:17.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 shutdown_connections 2023-11-28T20:48:17.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:17.913+0000 7fc60a357640 1 -- 172.21.15.167:0/2168950911 wait complete. 2023-11-28T20:48:17.932 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:48:17.933 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:48:17.933 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:48:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8d62bb640 1 Processor -- start 2023-11-28T20:48:18.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8d62bb640 1 -- start start 2023-11-28T20:48:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8d62bb640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd8d00c6ff0 0x7fd8d0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8d62bb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d00c48f0 con 0x7fd8d00c4510 2023-11-28T20:48:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8d62bb640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d00c6ac0 con 0x7fd8d0150b40 2023-11-28T20:48:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8d62bb640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d00c62f0 con 0x7fd8d00c6ff0 2023-11-28T20:48:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8d4858640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd8d00c4510 0x7fd8d006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51804/0 (socket says 172.21.15.167:51804) 2023-11-28T20:48:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8d4858640 1 -- 172.21.15.167:0/2050589707 learned_addr learned my addr 172.21.15.167:0/2050589707 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:48:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8cf7fe640 1 --2- 172.21.15.167:0/2050589707 >> v2:172.21.15.178:3300/0 conn(0x7fd8d00c6ff0 0x7fd8d0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8cf7fe640 1 -- 172.21.15.167:0/2050589707 >> v2:172.21.15.178:3300/0 conn(0x7fd8d00c6ff0 msgr2=0x7fd8d0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:48:18.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638493919 0 0) 0x7fd8d00c48f0 con 0x7fd8d00c4510 2023-11-28T20:48:18.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8cf7fe640 1 -- 172.21.15.167:0/2050589707 >> v2:172.21.15.178:3300/0 conn(0x7fd8d00c6ff0 msgr2=0x7fd8d0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:18.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8cf7fe640 1 --2- 172.21.15.167:0/2050589707 >> v2:172.21.15.178:3300/0 conn(0x7fd8d00c6ff0 0x7fd8d0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:18.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b8003530 con 0x7fd8d00c4510 2023-11-28T20:48:18.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8cf7fe640 1 --2- 172.21.15.167:0/2050589707 >> v2:172.21.15.178:3300/0 conn(0x7fd8d00c6ff0 0x7fd8d0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:18.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2583294837 0 0) 0x7fd8b8003530 con 0x7fd8d00c4510 2023-11-28T20:48:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 >> v2:172.21.15.178:3300/0 conn(0x7fd8d00c6ff0 msgr2=0x7fd8d0157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 --2- 172.21.15.167:0/2050589707 >> v2:172.21.15.178:3300/0 conn(0x7fd8d00c6ff0 0x7fd8d0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 >> v1:172.21.15.178:6789/0 conn(0x7fd8d0150b40 legacy=0x7fd8d00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d00c6500 con 0x7fd8d00c4510 2023-11-28T20:48:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fd8c8001a20 con 0x7fd8d00c4510 2023-11-28T20:48:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 >> v1:172.21.15.167:6789/0 conn(0x7fd8d00c4510 legacy=0x7fd8d006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8b8003980 0x7fd8b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8b80047d0 0x7fd8b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b8005190 0x7fd8b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00c62f0 con 0x7fd8b8005190 2023-11-28T20:48:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b800c0e0 con 0x7fd8b80047d0 2023-11-28T20:48:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b800c2a0 con 0x7fd8b8003980 2023-11-28T20:48:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8d4858640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b8005190 0x7fd8b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8cffff640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8b8003980 0x7fd8b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.073+0000 7fd8cf7fe640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8b80047d0 0x7fd8b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.077+0000 7fd8d4858640 1 -- 172.21.15.167:0/2050589707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8b8003980 msgr2=0x7fd8b8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:18.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.077+0000 7fd8d4858640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8b8003980 0x7fd8b8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.077+0000 7fd8d4858640 1 -- 172.21.15.167:0/2050589707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8b80047d0 msgr2=0x7fd8b8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:18.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.077+0000 7fd8d4858640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8b80047d0 0x7fd8b8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.077+0000 7fd8d4858640 1 -- 172.21.15.167:0/2050589707 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8003530 con 0x7fd8b8005190 2023-11-28T20:48:18.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.077+0000 7fd8cf7fe640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8b80047d0 0x7fd8b8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.077+0000 7fd8d4858640 1 -- 172.21.15.167:0/2050589707 reap_dead start 2023-11-28T20:48:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.077+0000 7fd8d4858640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b8005190 0x7fd8b800b990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00c25b0 tx=0x7fd8c801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a7fbb4005f9fd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.077+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80ad630 con 0x7fd8b8005190 2023-11-28T20:48:18.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c80a8070 con 0x7fd8b8005190 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8ceffd640 1 -- 172.21.15.167:0/2050589707 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80ad9b0 con 0x7fd8b8005190 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 -- 172.21.15.167:0/2050589707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b8005190 msgr2=0x7fd8b800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b8005190 0x7fd8b800b990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00c25b0 tx=0x7fd8c801d300 comp rx=0 tx=0).stop 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 -- 172.21.15.167:0/2050589707 shutdown_connections 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 --2- 172.21.15.167:0/2050589707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8b8005190 0x7fd8b800b990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 -- 172.21.15.167:0/2050589707 >> 172.21.15.167:0/2050589707 conn(0x7fd8d00cb1e0 msgr2=0x7fd8d00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 -- 172.21.15.167:0/2050589707 shutdown_connections 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 -- 172.21.15.167:0/2050589707 wait complete. 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 Processor -- start 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 -- start start 2023-11-28T20:48:18.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8b8005190 0x7fd8d01ef460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d0071a20 0x7fd8d0070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8d0157e10 0x7fd8d0158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d015a580 con 0x7fd8d0157e10 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d015ade0 con 0x7fd8d0071a20 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.081+0000 7fd8d62bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d01587d0 con 0x7fd8b8005190 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d4858640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8d0157e10 0x7fd8d0158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d4858640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8d0157e10 0x7fd8d0158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56576/0 (socket says 172.21.15.167:56576) 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d4858640 1 -- 172.21.15.167:0/1961670383 learned_addr learned my addr 172.21.15.167:0/1961670383 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8cf7fe640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d0071a20 0x7fd8d0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8cffff640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8b8005190 0x7fd8d01ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d4858640 1 -- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8b8005190 msgr2=0x7fd8d01ef460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d4858640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8b8005190 0x7fd8d01ef460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d4858640 1 -- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d0071a20 msgr2=0x7fd8d0070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d4858640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d0071a20 0x7fd8d0070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d4858640 1 -- 172.21.15.167:0/1961670383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d0153af0 con 0x7fd8d0157e10 2023-11-28T20:48:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8cffff640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8b8005190 0x7fd8d01ef460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d4858640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8d0157e10 0x7fd8d0158290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8c801dba0 tx=0x7fd8b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80b9470 con 0x7fd8d0157e10 2023-11-28T20:48:18.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c80b95f0 con 0x7fd8d0157e10 2023-11-28T20:48:18.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80b99a0 con 0x7fd8d0157e10 2023-11-28T20:48:18.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d0153db0 con 0x7fd8d0157e10 2023-11-28T20:48:18.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d015a790 con 0x7fd8d0157e10 2023-11-28T20:48:18.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d62bb640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d015a980 0x7fd8d00c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d015a580 con 0x7fd8d015a980 2023-11-28T20:48:18.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8cffff640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d015a980 0x7fd8d00c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8cffff640 1 -- 172.21.15.167:0/1961670383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8d0156d60 con 0x7fd8d015a980 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8c80b6070 con 0x7fd8d0157e10 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8cffff640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d015a980 0x7fd8d00c17b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00117a0 tx=0x7fd8c0011c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8ccff9640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd8bc0664a0 0x7fd8bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.085+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd8c811e110 con 0x7fd8d0157e10 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.089+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000c070 con 0x7fd8d015a980 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.089+0000 7fd8cf7fe640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd8bc0664a0 0x7fd8bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.089+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd8c0011eb0 con 0x7fd8d015a980 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.089+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d015a980 msgr2=0x7fd8d00c17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.089+0000 7fd8ccff9640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d015a980 0x7fd8d00c17b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00117a0 tx=0x7fd8c0011c60 comp rx=0 tx=0).stop 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.089+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d015a980 msgr2=0x7fd8d00c17b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:18.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.089+0000 7fd8ccff9640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d015a980 0x7fd8d00c17b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.089+0000 7fd8cf7fe640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd8bc0664a0 0x7fd8bc068960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd8d014f9b0 tx=0x7fd8c4006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.093+0000 7fd8d62bb640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d00c1cf0 0x7fd8d01f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.093+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d0074770 con 0x7fd8d00c1cf0 2023-11-28T20:48:18.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.093+0000 7fd8cffff640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d00c1cf0 0x7fd8d01f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8cffff640 1 -- 172.21.15.167:0/1961670383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd8d0156a80 con 0x7fd8d00c1cf0 2023-11-28T20:48:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8cffff640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d00c1cf0 0x7fd8d01f1ee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0019000 tx=0x7fd8c0001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0012650 con 0x7fd8d00c1cf0 2023-11-28T20:48:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7fd8c0003e10 con 0x7fd8d00c1cf0 2023-11-28T20:48:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d00c1cf0 msgr2=0x7fd8d01f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8ccff9640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d00c1cf0 0x7fd8d01f1ee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0019000 tx=0x7fd8c0001130 comp rx=0 tx=0).stop 2023-11-28T20:48:18.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8ccff9640 1 -- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d00c1cf0 msgr2=0x7fd8d01f1ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:18.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8ccff9640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d00c1cf0 0x7fd8d01f1ee0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0019000 tx=0x7fd8c0001130 comp rx=0 tx=0).stop 2023-11-28T20:48:18.097 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:48:18.097 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:18.097 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:18.097 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:48:18.097 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 86, 2023-11-28T20:48:18.097 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:48:18.097 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:18.098 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:18.099 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:48:18.100 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:48:18.101 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:48:18.101 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:48:18.101 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:48:18.101 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:48:18.101 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:18.101 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:18.101 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:18.102 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.103 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:48:18.104 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:18.105 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.106 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:18.107 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.108 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:18.109 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:48:18.110 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:48:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd8bc0664a0 msgr2=0x7fd8bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d62bb640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd8bc0664a0 0x7fd8bc068960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd8d014f9b0 tx=0x7fd8c4006f90 comp rx=0 tx=0).stop 2023-11-28T20:48:18.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8d0157e10 msgr2=0x7fd8d0158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d62bb640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8d0157e10 0x7fd8d0158290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8c801dba0 tx=0x7fd8b8005800 comp rx=0 tx=0).stop 2023-11-28T20:48:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d4858640 1 -- 172.21.15.167:0/1961670383 reap_dead start 2023-11-28T20:48:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 shutdown_connections 2023-11-28T20:48:18.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d62bb640 1 --2- 172.21.15.167:0/1961670383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8d0157e10 0x7fd8d0158290 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 >> 172.21.15.167:0/1961670383 conn(0x7fd8d00cb1e0 msgr2=0x7fd8d0155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 shutdown_connections 2023-11-28T20:48:18.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.097+0000 7fd8d62bb640 1 -- 172.21.15.167:0/1961670383 wait complete. 2023-11-28T20:48:18.115 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:48:18.116 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:48:18.116 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:48:18.211 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:48:18.217 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:48:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.257+0000 7f9cf4f55640 1 Processor -- start 2023-11-28T20:48:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.257+0000 7f9cf4f55640 1 -- start start 2023-11-28T20:48:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.257+0000 7f9cf4f55640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9cf00ca560 0x7f9cf00c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.257+0000 7f9cf4f55640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf00c6d00 0x7f9cf00c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.257+0000 7f9cf4f55640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf00c76d0 con 0x7f9cf00ca940 2023-11-28T20:48:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.257+0000 7f9cf4f55640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf00c32f0 con 0x7f9cf00ca560 2023-11-28T20:48:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.257+0000 7f9cf4f55640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0159e60 con 0x7f9cf00c6d00 2023-11-28T20:48:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9cee59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9cf00ca560 0x7f9cf00c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9ceed9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf00c6d00 0x7f9cf00c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9cee59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9cf00ca560 0x7f9cf00c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:46522/0 (socket says 172.21.15.167:46522) 2023-11-28T20:48:18.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9cee59c640 1 -- 172.21.15.167:0/3263478796 learned_addr learned my addr 172.21.15.167:0/3263478796 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:18.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9cedd9b640 1 --1- 172.21.15.167:0/3263478796 >> v1:172.21.15.178:6789/0 conn(0x7f9cf00ca940 0x7f9cf00cb0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:40100/0 (socket says 172.21.15.167:40100) 2023-11-28T20:48:18.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9cee59c640 1 -- 172.21.15.167:0/3263478796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf00c6d00 msgr2=0x7f9cf00c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:18.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9cee59c640 1 --2- 172.21.15.167:0/3263478796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf00c6d00 0x7f9cf00c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9cee59c640 1 -- 172.21.15.167:0/3263478796 >> v1:172.21.15.178:6789/0 conn(0x7f9cf00ca940 legacy=0x7f9cf00cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9cee59c640 1 -- 172.21.15.167:0/3263478796 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0154410 con 0x7f9cf00ca560 2023-11-28T20:48:18.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9cee59c640 1 --2- 172.21.15.167:0/3263478796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cf00ca560 0x7f9cf00c97c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009870 tx=0x7f9ce001c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90fb1d67e8a51852 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9ced59a640 1 -- 172.21.15.167:0/3263478796 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00ac640 con 0x7f9cf00ca560 2023-11-28T20:48:18.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9ced59a640 1 -- 172.21.15.167:0/3263478796 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce00ac7a0 con 0x7f9cf00ca560 2023-11-28T20:48:18.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.261+0000 7f9ced59a640 1 -- 172.21.15.167:0/3263478796 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00acb30 con 0x7f9cf00ca560 2023-11-28T20:48:18.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 -- 172.21.15.167:0/3263478796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cf00ca560 msgr2=0x7f9cf00c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 --2- 172.21.15.167:0/3263478796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cf00ca560 0x7f9cf00c97c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009870 tx=0x7f9ce001c420 comp rx=0 tx=0).stop 2023-11-28T20:48:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 -- 172.21.15.167:0/3263478796 shutdown_connections 2023-11-28T20:48:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 --2- 172.21.15.167:0/3263478796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf00c6d00 0x7f9cf00c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 --2- 172.21.15.167:0/3263478796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cf00ca560 0x7f9cf00c97c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 -- 172.21.15.167:0/3263478796 >> 172.21.15.167:0/3263478796 conn(0x7f9cf006a580 msgr2=0x7f9cf006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 -- 172.21.15.167:0/3263478796 shutdown_connections 2023-11-28T20:48:18.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 -- 172.21.15.167:0/3263478796 wait complete. 2023-11-28T20:48:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 Processor -- start 2023-11-28T20:48:18.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 -- start start 2023-11-28T20:48:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf00c6d00 0x7f9cf01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cf00ca560 0x7f9cf01f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cf00ca940 0x7f9cf015b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf01f5a20 con 0x7f9cf00ca560 2023-11-28T20:48:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0159a10 con 0x7f9cf00ca940 2023-11-28T20:48:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cf4f55640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf015d770 con 0x7f9cf00c6d00 2023-11-28T20:48:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.265+0000 7f9cedd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cf00ca560 0x7f9cf01f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cee59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf00c6d00 0x7f9cf01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cedd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cf00ca560 0x7f9cf01f6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56592/0 (socket says 172.21.15.167:56592) 2023-11-28T20:48:18.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cedd9b640 1 -- 172.21.15.167:0/2326576347 learned_addr learned my addr 172.21.15.167:0/2326576347 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:18.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9ceed9d640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cf00ca940 0x7f9cf015b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cedd9b640 1 -- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf00c6d00 msgr2=0x7f9cf01594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cedd9b640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf00c6d00 0x7f9cf01594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cedd9b640 1 -- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cf00ca940 msgr2=0x7f9cf015b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cedd9b640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cf00ca940 0x7f9cf015b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cedd9b640 1 -- 172.21.15.167:0/2326576347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce00094d0 con 0x7f9cf00ca560 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cedd9b640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cf00ca560 0x7f9cf01f6190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c420 tx=0x7f9ce400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40074e0 con 0x7f9cf00ca560 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4007640 con 0x7f9cf00ca560 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf015da50 con 0x7f9cf00ca560 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4004a30 con 0x7f9cf00ca560 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf015e010 con 0x7f9cf00ca560 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cf4f55640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf01f66d0 0x7f9cf0070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0074700 con 0x7f9cf01f66d0 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cee59c640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf01f66d0 0x7f9cf0070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cee59c640 1 -- 172.21.15.167:0/2326576347 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9cf00c9e50 con 0x7f9cf01f66d0 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cee59c640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf01f66d0 0x7f9cf0070cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cf006f850 tx=0x7f9ce00191c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.269+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ce4004b90 con 0x7f9cf00ca560 2023-11-28T20:48:18.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9cdeffd640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9cd0066470 0x7f9cd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9ce4083c30 con 0x7f9cf00ca560 2023-11-28T20:48:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9ceed9d640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9cd0066470 0x7f9cd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00c0640 con 0x7f9cf01f66d0 2023-11-28T20:48:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9ce00c07a0 con 0x7f9cf01f66d0 2023-11-28T20:48:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf01f66d0 msgr2=0x7f9cf0070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9cdeffd640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf01f66d0 0x7f9cf0070cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cf006f850 tx=0x7f9ce00191c0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf01f66d0 msgr2=0x7f9cf0070cf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9cdeffd640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf01f66d0 0x7f9cf0070cf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.273+0000 7f9ceed9d640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9cd0066470 0x7f9cd0068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8011340 tx=0x7f9ce800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.277+0000 7f9cf4f55640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf015bb30 0x7f9cf0071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.277+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf015a9a0 con 0x7f9cf015bb30 2023-11-28T20:48:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.277+0000 7f9cee59c640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf015bb30 0x7f9cf0071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cee59c640 1 -- 172.21.15.167:0/2326576347 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9cf00cad50 con 0x7f9cf015bb30 2023-11-28T20:48:18.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cee59c640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf015bb30 0x7f9cf0071230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ce001a050 tx=0x7f9ce00a6000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00c4040 con 0x7f9cf015bb30 2023-11-28T20:48:18.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5122 (secure 0 0 0) 0x7f9ce0003a50 con 0x7f9cf015bb30 2023-11-28T20:48:18.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf015bb30 msgr2=0x7f9cf0071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cdeffd640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf015bb30 0x7f9cf0071230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ce001a050 tx=0x7f9ce00a6000 comp rx=0 tx=0).stop 2023-11-28T20:48:18.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cdeffd640 1 -- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf015bb30 msgr2=0x7f9cf0071230 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:18.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cdeffd640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cf015bb30 0x7f9cf0071230 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ce001a050 tx=0x7f9ce00a6000 comp rx=0 tx=0).stop 2023-11-28T20:48:18.281 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:48:18.281 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:18.281 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:18.281 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:48:18.281 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 86, 2023-11-28T20:48:18.281 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:48:18.281 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:48:18.281 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:48:18.281 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:48:18.282 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.282 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:48:18.282 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:18.282 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:48:18.282 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:48:18.282 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:18.283 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:18.283 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:18.283 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:18.283 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:18.283 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:18.283 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:18.283 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:18.283 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:18.283 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:18.284 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:18.285 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:18.285 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:18.285 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:18.285 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.285 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:48:18.285 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:48:18.285 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:48:18.285 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:48:18.286 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:48:18.287 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:48:18.287 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:18.287 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:48:18.287 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:18.287 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:18.287 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:18.287 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:18.287 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:18.287 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:18.288 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:18.288 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:18.288 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:18.288 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:18.288 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.288 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:48:18.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.288 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:48:18.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.289 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:18.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.292 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:18.292 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:48:18.292 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.292 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.292 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:48:18.292 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:48:18.292 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:18.293 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:18.293 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:18.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.293 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:18.294 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:18.294 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:18.294 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:18.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.294 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:18.294 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:48:18.294 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:48:18.295 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:18.296 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:18.296 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:18.296 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.296 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.296 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:48:18.296 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:48:18.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.297 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:18.297 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:18.297 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:48:18.298 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:18.299 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:18.300 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:18.301 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:18.301 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:18.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:18.301 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:48:18.301 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:48:18.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9cd0066470 msgr2=0x7f9cd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cf4f55640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9cd0066470 0x7f9cd0068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8011340 tx=0x7f9ce800b040 comp rx=0 tx=0).stop 2023-11-28T20:48:18.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cf00ca560 msgr2=0x7f9cf01f6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cf4f55640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cf00ca560 0x7f9cf01f6190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c420 tx=0x7f9ce400c8e0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9ceed9d640 1 -- 172.21.15.167:0/2326576347 reap_dead start 2023-11-28T20:48:18.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 shutdown_connections 2023-11-28T20:48:18.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cf4f55640 1 --2- 172.21.15.167:0/2326576347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cf00ca560 0x7f9cf01f6190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 >> 172.21.15.167:0/2326576347 conn(0x7f9cf006a580 msgr2=0x7f9cf006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:18.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 shutdown_connections 2023-11-28T20:48:18.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.281+0000 7f9cf4f55640 1 -- 172.21.15.167:0/2326576347 wait complete. 2023-11-28T20:48:18.304 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:48:18.304 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:48:18.304 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:48:18.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff50569e640 1 Processor -- start 2023-11-28T20:48:18.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff50569e640 1 -- start start 2023-11-28T20:48:18.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff50569e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff5000cf860 0x7ff5000cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff50569e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 0x7ff5000ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff50569e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff500153ae0 0x7ff500153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff50569e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff500154470 con 0x7ff5000cf860 2023-11-28T20:48:18.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff50569e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50015ac00 con 0x7ff500153ae0 2023-11-28T20:48:18.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff50569e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000cbd60 con 0x7ff5000cfc40 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4feffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff5000cf860 0x7ff5000cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4feffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff5000cf860 0x7ff5000cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56608/0 (socket says 172.21.15.167:56608) 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4feffd640 1 -- 172.21.15.167:0/2105191771 learned_addr learned my addr 172.21.15.167:0/2105191771 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4ff7fe640 1 --2- 172.21.15.167:0/2105191771 >> v2:172.21.15.178:3300/0 conn(0x7ff500153ae0 0x7ff500153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4f67fc640 1 --2- 172.21.15.167:0/2105191771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 0x7ff5000ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4feffd640 1 -- 172.21.15.167:0/2105191771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 msgr2=0x7ff5000ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4feffd640 1 --2- 172.21.15.167:0/2105191771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 0x7ff5000ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4feffd640 1 -- 172.21.15.167:0/2105191771 >> v2:172.21.15.178:3300/0 conn(0x7ff500153ae0 msgr2=0x7ff500153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4feffd640 1 --2- 172.21.15.167:0/2105191771 >> v2:172.21.15.178:3300/0 conn(0x7ff500153ae0 0x7ff500153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4feffd640 1 -- 172.21.15.167:0/2105191771 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff500159ff0 con 0x7ff5000cf860 2023-11-28T20:48:18.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.489+0000 7ff4ff7fe640 1 --2- 172.21.15.167:0/2105191771 >> v2:172.21.15.178:3300/0 conn(0x7ff500153ae0 0x7ff500153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:18.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff4feffd640 1 --2- 172.21.15.167:0/2105191771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5000cf860 0x7ff5000cb770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5000c9c50 tx=0x7ff4f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1feddb4bf5eac1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff4fe7fc640 1 -- 172.21.15.167:0/2105191771 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00aa5f0 con 0x7ff5000cf860 2023-11-28T20:48:18.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff4fe7fc640 1 -- 172.21.15.167:0/2105191771 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f00aa750 con 0x7ff5000cf860 2023-11-28T20:48:18.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff4fe7fc640 1 -- 172.21.15.167:0/2105191771 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00aaae0 con 0x7ff5000cf860 2023-11-28T20:48:18.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff50569e640 1 -- 172.21.15.167:0/2105191771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5000cf860 msgr2=0x7ff5000cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff50569e640 1 --2- 172.21.15.167:0/2105191771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5000cf860 0x7ff5000cb770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5000c9c50 tx=0x7ff4f001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff50569e640 1 -- 172.21.15.167:0/2105191771 shutdown_connections 2023-11-28T20:48:18.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff50569e640 1 --2- 172.21.15.167:0/2105191771 >> v2:172.21.15.178:3300/0 conn(0x7ff500153ae0 0x7ff500153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff50569e640 1 --2- 172.21.15.167:0/2105191771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 0x7ff5000ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff50569e640 1 --2- 172.21.15.167:0/2105191771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5000cf860 0x7ff5000cb770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff50569e640 1 -- 172.21.15.167:0/2105191771 >> 172.21.15.167:0/2105191771 conn(0x7ff50006c1f0 msgr2=0x7ff500071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:18.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff50569e640 1 -- 172.21.15.167:0/2105191771 shutdown_connections 2023-11-28T20:48:18.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.493+0000 7ff50569e640 1 -- 172.21.15.167:0/2105191771 wait complete. 2023-11-28T20:48:18.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 Processor -- start 2023-11-28T20:48:18.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 -- start start 2023-11-28T20:48:18.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5000cf860 0x7ff5001505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 0x7ff5001f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff500153ae0 0x7ff50014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001f26c0 con 0x7ff500153ae0 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001f6b80 con 0x7ff5000cf860 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff500150c20 con 0x7ff5000cfc40 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4ff7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff500153ae0 0x7ff50014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4ff7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff500153ae0 0x7ff50014dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56612/0 (socket says 172.21.15.167:56612) 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4ff7fe640 1 -- 172.21.15.167:0/208583087 learned_addr learned my addr 172.21.15.167:0/208583087 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4f67fc640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 0x7ff5001f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4feffd640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5000cf860 0x7ff5001505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4ff7fe640 1 -- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 msgr2=0x7ff5001f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4ff7fe640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 0x7ff5001f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4ff7fe640 1 -- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5000cf860 msgr2=0x7ff5001505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4ff7fe640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5000cf860 0x7ff5001505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4ff7fe640 1 -- 172.21.15.167:0/208583087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00094d0 con 0x7ff500153ae0 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4ff7fe640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff500153ae0 0x7ff50014dff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800d800 tx=0x7ff4f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4f7fff640 1 -- 172.21.15.167:0/208583087 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80096a0 con 0x7ff500153ae0 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4f7fff640 1 -- 172.21.15.167:0/208583087 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8009800 con 0x7ff500153ae0 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff500150f00 con 0x7ff500153ae0 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff4f7fff640 1 -- 172.21.15.167:0/208583087 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8009bb0 con 0x7ff500153ae0 2023-11-28T20:48:18.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.497+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5001f2bb0 con 0x7ff500153ae0 2023-11-28T20:48:18.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.501+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5000cc000 con 0x7ff500153ae0 2023-11-28T20:48:18.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.501+0000 7ff4f7fff640 1 -- 172.21.15.167:0/208583087 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4f8009d10 con 0x7ff500153ae0 2023-11-28T20:48:18.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.501+0000 7ff4f7fff640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4e0066470 0x7ff4e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:18.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.501+0000 7ff4f7fff640 1 -- 172.21.15.167:0/208583087 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff4f8084680 con 0x7ff500153ae0 2023-11-28T20:48:18.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.501+0000 7ff4feffd640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4e0066470 0x7ff4e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:18.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.501+0000 7ff4feffd640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4e0066470 0x7ff4e0068930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00ae000 tx=0x7ff4f00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:18.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.505+0000 7ff4f7fff640 1 -- 172.21.15.167:0/208583087 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4f8051720 con 0x7ff500153ae0 2023-11-28T20:48:18.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.709+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7ff500075c90 con 0x7ff500153ae0 2023-11-28T20:48:18.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff4f7fff640 1 -- 172.21.15.167:0/208583087 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7ff4f8054d40 con 0x7ff500153ae0 2023-11-28T20:48:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4e0066470 msgr2=0x7ff4e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4e0066470 0x7ff4e0068930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00ae000 tx=0x7ff4f00b5040 comp rx=0 tx=0).stop 2023-11-28T20:48:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff500153ae0 msgr2=0x7ff50014dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff500153ae0 0x7ff50014dff0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800d800 tx=0x7ff4f800dcc0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 shutdown_connections 2023-11-28T20:48:18.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4e0066470 0x7ff4e0068930 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff500153ae0 0x7ff50014dff0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5000cfc40 0x7ff5001f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 --2- 172.21.15.167:0/208583087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5000cf860 0x7ff5001505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:18.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 >> 172.21.15.167:0/208583087 conn(0x7ff50006c1f0 msgr2=0x7ff5000cc490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:18.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 shutdown_connections 2023-11-28T20:48:18.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:18.713+0000 7ff50569e640 1 -- 172.21.15.167:0/208583087 wait complete. 2023-11-28T20:48:18.733 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:48:28.734 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:48:28.734 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:48:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee985f640 1 Processor -- start 2023-11-28T20:48:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee985f640 1 -- start start 2023-11-28T20:48:28.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee985f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee4150b40 0x7f7ee4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:28.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee985f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7ee40c4510 0x7f7ee406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:28.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee985f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee40c4940 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee985f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee40c62f0 con 0x7f7ee40c4510 2023-11-28T20:48:28.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee985f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40c6ac0 con 0x7f7ee4150b40 2023-11-28T20:48:28.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7ee40c4510 0x7f7ee406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:28.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7ee40c4510 0x7f7ee406a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44004/0 (socket says 172.21.15.167:44004) 2023-11-28T20:48:28.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee37fe640 1 -- 172.21.15.167:0/2671051826 learned_addr learned my addr 172.21.15.167:0/2671051826 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:28.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee2ffd640 1 --2- 172.21.15.167:0/2671051826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee4150b40 0x7f7ee4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:28.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee37fe640 1 -- 172.21.15.167:0/2671051826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee4150b40 msgr2=0x7f7ee4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:28.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee37fe640 1 --2- 172.21.15.167:0/2671051826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee4150b40 0x7f7ee4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:28.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee37fe640 1 -- 172.21.15.167:0/2671051826 >> v1:172.21.15.178:6789/0 conn(0x7f7ee40c6ff0 legacy=0x7f7ee40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:28.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.885+0000 7f7ee37fe640 1 -- 172.21.15.167:0/2671051826 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40c6500 con 0x7f7ee40c4510 2023-11-28T20:48:28.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee37fe640 1 --2- 172.21.15.167:0/2671051826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c4510 0x7f7ee406a580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009870 tx=0x7f7edc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdf5bef64a1813 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:28.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee27fc640 1 -- 172.21.15.167:0/2671051826 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0ab620 con 0x7f7ee40c4510 2023-11-28T20:48:28.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee27fc640 1 -- 172.21.15.167:0/2671051826 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc0ab780 con 0x7f7ee40c4510 2023-11-28T20:48:28.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee27fc640 1 -- 172.21.15.167:0/2671051826 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0abb10 con 0x7f7ee40c4510 2023-11-28T20:48:28.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee985f640 1 -- 172.21.15.167:0/2671051826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c4510 msgr2=0x7f7ee406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:28.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee985f640 1 --2- 172.21.15.167:0/2671051826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c4510 0x7f7ee406a580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009870 tx=0x7f7edc01c510 comp rx=0 tx=0).stop 2023-11-28T20:48:28.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee985f640 1 -- 172.21.15.167:0/2671051826 shutdown_connections 2023-11-28T20:48:28.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee985f640 1 --2- 172.21.15.167:0/2671051826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c4510 0x7f7ee406a580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:28.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee985f640 1 --2- 172.21.15.167:0/2671051826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee4150b40 0x7f7ee4157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:28.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee985f640 1 -- 172.21.15.167:0/2671051826 >> 172.21.15.167:0/2671051826 conn(0x7f7ee40cb1e0 msgr2=0x7f7ee40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:28.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee985f640 1 -- 172.21.15.167:0/2671051826 shutdown_connections 2023-11-28T20:48:28.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee985f640 1 -- 172.21.15.167:0/2671051826 wait complete. 2023-11-28T20:48:28.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.889+0000 7f7ee985f640 1 Processor -- start 2023-11-28T20:48:28.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 -- start start 2023-11-28T20:48:28.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee40c4510 0x7f7ee41469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:28.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c6ff0 0x7f7ee40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:28.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee4150b40 0x7f7ee414be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:28.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee41f2620 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee414ae00 con 0x7f7ee4150b40 2023-11-28T20:48:28.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee414b9a0 con 0x7f7ee40c4510 2023-11-28T20:48:28.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7eda7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c6ff0 0x7f7ee40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:28.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7eda7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c6ff0 0x7f7ee40ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44012/0 (socket says 172.21.15.167:44012) 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7eda7fc640 1 -- 172.21.15.167:0/2781258860 learned_addr learned my addr 172.21.15.167:0/2781258860 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee37fe640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee4150b40 0x7f7ee414be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee2ffd640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee40c4510 0x7f7ee41469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7eda7fc640 1 -- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee40c4510 msgr2=0x7f7ee41469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7eda7fc640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee40c4510 0x7f7ee41469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7eda7fc640 1 -- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee4150b40 msgr2=0x7f7ee414be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7eda7fc640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee4150b40 0x7f7ee414be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7eda7fc640 1 -- 172.21.15.167:0/2781258860 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0094d0 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee37fe640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee4150b40 0x7f7ee414be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7eda7fc640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c6ff0 0x7f7ee40ca880 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00c530 tx=0x7f7ecc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee0ff9640 1 -- 172.21.15.167:0/2781258860 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc005220 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee0ff9640 1 -- 172.21.15.167:0/2781258860 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc005380 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee41f2830 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee0ff9640 1 -- 172.21.15.167:0/2781258860 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc007270 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee41f2df0 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.893+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee40682c0 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.897+0000 7f7ee0ff9640 1 -- 172.21.15.167:0/2781258860 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ecc0073d0 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.897+0000 7f7ee0ff9640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ec40664a0 0x7f7ec4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:28.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.897+0000 7f7ee0ff9640 1 -- 172.21.15.167:0/2781258860 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7ecc083b80 con 0x7f7ee40c6ff0 2023-11-28T20:48:28.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.897+0000 7f7ee2ffd640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ec40664a0 0x7f7ec4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:28.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.897+0000 7f7ee2ffd640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ec40664a0 0x7f7ec4068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4003fd0 tx=0x7f7ed40039a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:28.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:28.901+0000 7f7ee0ff9640 1 -- 172.21.15.167:0/2781258860 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ecc050c00 con 0x7f7ee40c6ff0 2023-11-28T20:48:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.105+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7ee414bb70 con 0x7f7ee40c6ff0 2023-11-28T20:48:29.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.105+0000 7f7ee0ff9640 1 -- 172.21.15.167:0/2781258860 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f7ecc083e60 con 0x7f7ee40c6ff0 2023-11-28T20:48:29.105 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":86,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:48:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ec40664a0 msgr2=0x7f7ec4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ec40664a0 0x7f7ec4068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4003fd0 tx=0x7f7ed40039a0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c6ff0 msgr2=0x7f7ee40ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c6ff0 0x7f7ee40ca880 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00c530 tx=0x7f7ecc00c9f0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 shutdown_connections 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ec40664a0 0x7f7ec4068960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee4150b40 0x7f7ee414be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ee40c6ff0 0x7f7ee40ca880 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 --2- 172.21.15.167:0/2781258860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee40c4510 0x7f7ee41469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 >> 172.21.15.167:0/2781258860 conn(0x7f7ee40cb1e0 msgr2=0x7f7ee4073b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 shutdown_connections 2023-11-28T20:48:29.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.109+0000 7f7ee985f640 1 -- 172.21.15.167:0/2781258860 wait complete. 2023-11-28T20:48:29.126 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:48:29.127 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:48:29.127 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:48:29.127 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:48:29.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.285+0000 7f64716ad640 1 Processor -- start 2023-11-28T20:48:29.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.285+0000 7f64716ad640 1 -- start start 2023-11-28T20:48:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f64716ad640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f646c0cb500 0x7f646c0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f64716ad640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f646c0cb940 0x7f646c0c4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f64716ad640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c06b450 con 0x7f646c153d00 2023-11-28T20:48:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f64716ad640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646c06c320 con 0x7f646c0cb940 2023-11-28T20:48:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f64716ad640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c06b6a0 con 0x7f646c0cb500 2023-11-28T20:48:29.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f646bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f646c153d00 0x7f646c15da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40904/0 (socket says 172.21.15.167:40904) 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f646bfff640 1 -- 172.21.15.167:0/3944788318 learned_addr learned my addr 172.21.15.167:0/3944788318 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f646b7fe640 1 --2- 172.21.15.167:0/3944788318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f646c0cb500 0x7f646c0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f6470eac640 1 --2- 172.21.15.167:0/3944788318 >> v2:172.21.15.178:3300/0 conn(0x7f646c0cb940 0x7f646c0c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f646affd640 1 -- 172.21.15.167:0/3944788318 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055062943 0 0) 0x7f646c06b450 con 0x7f646c153d00 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f646affd640 1 -- 172.21.15.167:0/3944788318 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6454003530 con 0x7f646c153d00 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f6470eac640 1 -- 172.21.15.167:0/3944788318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f646c0cb500 msgr2=0x7f646c0c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f6470eac640 1 --2- 172.21.15.167:0/3944788318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f646c0cb500 0x7f646c0c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f6470eac640 1 -- 172.21.15.167:0/3944788318 >> v1:172.21.15.167:6789/0 conn(0x7f646c153d00 legacy=0x7f646c15da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f646affd640 1 -- 172.21.15.167:0/3944788318 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3500930308 0 0) 0x7f6454003530 con 0x7f646c153d00 2023-11-28T20:48:29.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.289+0000 7f6470eac640 1 -- 172.21.15.167:0/3944788318 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c06b980 con 0x7f646c0cb940 2023-11-28T20:48:29.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f6470eac640 1 --2- 172.21.15.167:0/3944788318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646c0cb940 0x7f646c0c4900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6464009d90 tx=0x7f646401f060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a67b0e6097f0415a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f646affd640 1 -- 172.21.15.167:0/3944788318 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c001680 con 0x7f646c0cb940 2023-11-28T20:48:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f646affd640 1 -- 172.21.15.167:0/3944788318 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64640a8bb0 con 0x7f646c0cb940 2023-11-28T20:48:29.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f646affd640 1 -- 172.21.15.167:0/3944788318 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640b0440 con 0x7f646c0cb940 2023-11-28T20:48:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f64716ad640 1 -- 172.21.15.167:0/3944788318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646c0cb940 msgr2=0x7f646c0c4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f64716ad640 1 --2- 172.21.15.167:0/3944788318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646c0cb940 0x7f646c0c4900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6464009d90 tx=0x7f646401f060 comp rx=0 tx=0).stop 2023-11-28T20:48:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f64716ad640 1 -- 172.21.15.167:0/3944788318 shutdown_connections 2023-11-28T20:48:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f64716ad640 1 --2- 172.21.15.167:0/3944788318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646c0cb940 0x7f646c0c4900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f64716ad640 1 --2- 172.21.15.167:0/3944788318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f646c0cb500 0x7f646c0c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f64716ad640 1 -- 172.21.15.167:0/3944788318 >> 172.21.15.167:0/3944788318 conn(0x7f646c0668a0 msgr2=0x7f646c0cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f64716ad640 1 -- 172.21.15.167:0/3944788318 shutdown_connections 2023-11-28T20:48:29.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.293+0000 7f64716ad640 1 -- 172.21.15.167:0/3944788318 wait complete. 2023-11-28T20:48:29.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 Processor -- start 2023-11-28T20:48:29.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 -- start start 2023-11-28T20:48:29.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f646c0cb500 0x7f646c14d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646c0cb940 0x7f646c155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c153d00 0x7f646c0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c14e730 con 0x7f646c153d00 2023-11-28T20:48:29.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1f3150 con 0x7f646c0cb940 2023-11-28T20:48:29.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1f3430 con 0x7f646c0cb500 2023-11-28T20:48:29.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6470eac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c153d00 0x7f646c0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6470eac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c153d00 0x7f646c0c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44016/0 (socket says 172.21.15.167:44016) 2023-11-28T20:48:29.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6470eac640 1 -- 172.21.15.167:0/2080376110 learned_addr learned my addr 172.21.15.167:0/2080376110 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f646b7fe640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646c0cb940 0x7f646c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f646bfff640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f646c0cb500 0x7f646c14d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6470eac640 1 -- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f646c0cb500 msgr2=0x7f646c14d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6470eac640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f646c0cb500 0x7f646c14d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6470eac640 1 -- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646c0cb940 msgr2=0x7f646c155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6470eac640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f646c0cb940 0x7f646c155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6470eac640 1 -- 172.21.15.167:0/2080376110 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464009a70 con 0x7f646c153d00 2023-11-28T20:48:29.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6470eac640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c153d00 0x7f646c0c7ee0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64640b3040 tx=0x7f646401be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464004450 con 0x7f646c153d00 2023-11-28T20:48:29.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64640045b0 con 0x7f646c153d00 2023-11-28T20:48:29.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c1f3710 con 0x7f646c153d00 2023-11-28T20:48:29.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640b0440 con 0x7f646c153d00 2023-11-28T20:48:29.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.297+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c0c76e0 con 0x7f646c153d00 2023-11-28T20:48:29.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f64716ad640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c1f2c10 0x7f646c0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c0727f0 con 0x7f646c1f2c10 2023-11-28T20:48:29.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f646bfff640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c1f2c10 0x7f646c0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f646bfff640 1 -- 172.21.15.167:0/2080376110 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f646c06bf40 con 0x7f646c1f2c10 2023-11-28T20:48:29.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f646bfff640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c1f2c10 0x7f646c0c8420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f645c0011f0 tx=0x7f645c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00d880 con 0x7f646c1f2c10 2023-11-28T20:48:29.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64640b05a0 con 0x7f646c153d00 2023-11-28T20:48:29.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f6468ff9640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6458066510 0x7f64580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6464122860 con 0x7f646c153d00 2023-11-28T20:48:29.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f645c00d9e0 con 0x7f646c1f2c10 2023-11-28T20:48:29.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c1f2c10 msgr2=0x7f646c0c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f6468ff9640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c1f2c10 0x7f646c0c8420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f645c0011f0 tx=0x7f645c00ff70 comp rx=0 tx=0).stop 2023-11-28T20:48:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c1f2c10 msgr2=0x7f646c0c8420 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f6468ff9640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c1f2c10 0x7f646c0c8420 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f645c0011f0 tx=0x7f645c00ff70 comp rx=0 tx=0).stop 2023-11-28T20:48:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.301+0000 7f646b7fe640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6458066510 0x7f64580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.305+0000 7f646b7fe640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6458066510 0x7f64580689d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f646c0b2af0 tx=0x7f6460009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c0c78d0 0x7f646c149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c14ca00 con 0x7f646c0c78d0 2023-11-28T20:48:29.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f646bfff640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c0c78d0 0x7f646c149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f646bfff640 1 -- 172.21.15.167:0/2080376110 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f646c04e850 con 0x7f646c0c78d0 2023-11-28T20:48:29.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f646bfff640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c0c78d0 0x7f646c149bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f645c000fc0 tx=0x7f645c001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c013790 con 0x7f646c0c78d0 2023-11-28T20:48:29.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4982 (secure 0 0 0) 0x7f645c0138f0 con 0x7f646c0c78d0 2023-11-28T20:48:29.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c0c78d0 msgr2=0x7f646c149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f6468ff9640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c0c78d0 0x7f646c149bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f645c000fc0 tx=0x7f645c001700 comp rx=0 tx=0).stop 2023-11-28T20:48:29.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f6468ff9640 1 -- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c0c78d0 msgr2=0x7f646c149bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:29.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f6468ff9640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c0c78d0 0x7f646c149bb0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f645c000fc0 tx=0x7f645c001700 comp rx=0 tx=0).stop 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 86, 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:48:29.311 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:29.312 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:29.313 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:29.314 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:48:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:48:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:48:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:48:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:48:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:48:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:48:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:29.315 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.316 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.318 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:29.318 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:48:29.318 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.318 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.318 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.318 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:29.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.320 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:48:29.321 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:48:29.321 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:29.321 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:29.321 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:48:29.322 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:48:29.323 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.324 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.325 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:48:29.326 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.327 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.327 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.327 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:29.327 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.327 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.327 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.327 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:48:29.327 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:48:29.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6458066510 msgr2=0x7f64580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6458066510 0x7f64580689d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f646c0b2af0 tx=0x7f6460009190 comp rx=0 tx=0).stop 2023-11-28T20:48:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c153d00 msgr2=0x7f646c0c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c153d00 0x7f646c0c7ee0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64640b3040 tx=0x7f646401be00 comp rx=0 tx=0).stop 2023-11-28T20:48:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f6470eac640 1 -- 172.21.15.167:0/2080376110 reap_dead start 2023-11-28T20:48:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 shutdown_connections 2023-11-28T20:48:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 --2- 172.21.15.167:0/2080376110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f646c153d00 0x7f646c0c7ee0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 >> 172.21.15.167:0/2080376110 conn(0x7f646c0668a0 msgr2=0x7f646c0c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 shutdown_connections 2023-11-28T20:48:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.309+0000 7f64716ad640 1 -- 172.21.15.167:0/2080376110 wait complete. 2023-11-28T20:48:29.330 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:48:29.330 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:48:29.330 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:48:29.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838ef16640 1 Processor -- start 2023-11-28T20:48:29.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838ef16640 1 -- start start 2023-11-28T20:48:29.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838ef16640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83880c8010 0x7f838815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838ef16640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f838806bda0 0x7f8388066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838ef16640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838806a8d0 con 0x7f83880b0110 2023-11-28T20:48:29.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838ef16640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83880ca230 con 0x7f838806bda0 2023-11-28T20:48:29.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838ef16640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83880c8990 con 0x7f83880c8010 2023-11-28T20:48:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838d4b3640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f838806bda0 0x7f8388066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f837ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83880c8010 0x7f838815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838d4b3640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f838806bda0 0x7f8388066730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41160/0 (socket says 172.21.15.167:41160) 2023-11-28T20:48:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838d4b3640 1 -- 172.21.15.167:0/2023245951 learned_addr learned my addr 172.21.15.167:0/2023245951 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838d4b3640 1 -- 172.21.15.167:0/2023245951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83880c8010 msgr2=0x7f838815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838d4b3640 1 --2- 172.21.15.167:0/2023245951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83880c8010 0x7f838815d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838d4b3640 1 -- 172.21.15.167:0/2023245951 >> v1:172.21.15.178:6789/0 conn(0x7f83880b0110 legacy=0x7f838806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f838d4b3640 1 -- 172.21.15.167:0/2023245951 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880ca480 con 0x7f838806bda0 2023-11-28T20:48:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.477+0000 7f837ffff640 1 --2- 172.21.15.167:0/2023245951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83880c8010 0x7f838815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:48:29.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.481+0000 7f838d4b3640 1 --2- 172.21.15.167:0/2023245951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838806bda0 0x7f8388066730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8380009e50 tx=0x7f838001f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9eb11f5a8273112 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.481+0000 7f837f7fe640 1 -- 172.21.15.167:0/2023245951 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800af400 con 0x7f838806bda0 2023-11-28T20:48:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.481+0000 7f837f7fe640 1 -- 172.21.15.167:0/2023245951 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83800ab050 con 0x7f838806bda0 2023-11-28T20:48:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.481+0000 7f837f7fe640 1 -- 172.21.15.167:0/2023245951 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800af780 con 0x7f838806bda0 2023-11-28T20:48:29.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.481+0000 7f838ef16640 1 -- 172.21.15.167:0/2023245951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838806bda0 msgr2=0x7f8388066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 --2- 172.21.15.167:0/2023245951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838806bda0 0x7f8388066730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8380009e50 tx=0x7f838001f1f0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 -- 172.21.15.167:0/2023245951 shutdown_connections 2023-11-28T20:48:29.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 --2- 172.21.15.167:0/2023245951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838806bda0 0x7f8388066730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 --2- 172.21.15.167:0/2023245951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83880c8010 0x7f838815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 -- 172.21.15.167:0/2023245951 >> 172.21.15.167:0/2023245951 conn(0x7f838806ee30 msgr2=0x7f838806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:29.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 -- 172.21.15.167:0/2023245951 shutdown_connections 2023-11-28T20:48:29.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 -- 172.21.15.167:0/2023245951 wait complete. 2023-11-28T20:48:29.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 Processor -- start 2023-11-28T20:48:29.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 -- start start 2023-11-28T20:48:29.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f838806bda0 0x7f838815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880b0110 0x7f83881f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83880c8010 0x7f83881f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8388154080 con 0x7f83880c8010 2023-11-28T20:48:29.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83881f3880 con 0x7f83880b0110 2023-11-28T20:48:29.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ef16640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83881f3b40 con 0x7f838806bda0 2023-11-28T20:48:29.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838d4b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83880c8010 0x7f83881f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f837ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880b0110 0x7f83881f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838d4b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83880c8010 0x7f83881f31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44044/0 (socket says 172.21.15.167:44044) 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838d4b3640 1 -- 172.21.15.167:0/2521018597 learned_addr learned my addr 172.21.15.167:0/2521018597 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838ccb2640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f838806bda0 0x7f838815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838d4b3640 1 -- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f838806bda0 msgr2=0x7f838815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838d4b3640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f838806bda0 0x7f838815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838d4b3640 1 -- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880b0110 msgr2=0x7f83881f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838d4b3640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880b0110 0x7f83881f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.485+0000 7f838d4b3640 1 -- 172.21.15.167:0/2521018597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378009420 con 0x7f83880c8010 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f838d4b3640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83880c8010 0x7f83881f31b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f838001d8a0 tx=0x7f838001bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380007000 con 0x7f83880c8010 2023-11-28T20:48:29.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83800afdb0 con 0x7f83880c8010 2023-11-28T20:48:29.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800b9630 con 0x7f83880c8010 2023-11-28T20:48:29.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8380009b30 con 0x7f83880c8010 2023-11-28T20:48:29.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83880c5740 con 0x7f83880c8010 2023-11-28T20:48:29.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f838ef16640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880c6df0 0x7f83880c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838806b130 con 0x7f83880c6df0 2023-11-28T20:48:29.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f838ccb2640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880c6df0 0x7f83880c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f838ccb2640 1 -- 172.21.15.167:0/2521018597 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83880c5e70 con 0x7f83880c6df0 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83800b6070 con 0x7f83880c8010 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f838ccb2640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880c6df0 0x7f83880c5930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f838400f540 tx=0x7f838400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066470 0x7f8374068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8380122280 con 0x7f83880c8010 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384005320 con 0x7f83880c6df0 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8384005480 con 0x7f83880c6df0 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880c6df0 msgr2=0x7f83880c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880c6df0 0x7f83880c5930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f838400f540 tx=0x7f838400fa00 comp rx=0 tx=0).stop 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880c6df0 msgr2=0x7f83880c5930 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:29.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837d7fa640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83880c6df0 0x7f83880c5930 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f838400f540 tx=0x7f838400fa00 comp rx=0 tx=0).stop 2023-11-28T20:48:29.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.489+0000 7f837ffff640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066470 0x7f8374068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.493+0000 7f837ffff640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066470 0x7f8374068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f83880c7910 tx=0x7f8378009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.497+0000 7f838ef16640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838815a6e0 0x7f83880b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.497+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880ca760 con 0x7f838815a6e0 2023-11-28T20:48:29.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.497+0000 7f838ccb2640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838815a6e0 0x7f83880b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.497+0000 7f838ccb2640 1 -- 172.21.15.167:0/2521018597 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f83880c8f10 con 0x7f838815a6e0 2023-11-28T20:48:29.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.497+0000 7f838ccb2640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838815a6e0 0x7f83880b15b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8384016000 tx=0x7f8384007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.497+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384023070 con 0x7f838815a6e0 2023-11-28T20:48:29.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f83840074e0 con 0x7f838815a6e0 2023-11-28T20:48:29.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838815a6e0 msgr2=0x7f83880b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f837d7fa640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838815a6e0 0x7f83880b15b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8384016000 tx=0x7f8384007f90 comp rx=0 tx=0).stop 2023-11-28T20:48:29.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f837d7fa640 1 -- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838815a6e0 msgr2=0x7f83880b15b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:29.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f837d7fa640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838815a6e0 0x7f83880b15b0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8384016000 tx=0x7f8384007f90 comp rx=0 tx=0).stop 2023-11-28T20:48:29.499 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:48:29.499 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 86, 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:29.500 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:29.501 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:29.502 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:29.503 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:29.504 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:29.505 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:29.505 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:29.505 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:29.505 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:29.505 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:29.505 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:29.505 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:29.505 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:29.505 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:48:29.506 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:29.507 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:29.509 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:29.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.510 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:29.510 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:29.510 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:29.510 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:29.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.510 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.511 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.512 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.513 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.513 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:29.513 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.513 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.513 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:48:29.513 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.513 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.513 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.513 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:29.514 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.514 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.514 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.514 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:48:29.514 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066470 msgr2=0x7f8374068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838ef16640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066470 0x7f8374068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f83880c7910 tx=0x7f8378009190 comp rx=0 tx=0).stop 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83880c8010 msgr2=0x7f83881f31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838ef16640 1 --2- 172.21.15.167:0/2521018597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83880c8010 0x7f83881f31b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f838001d8a0 tx=0x7f838001bf90 comp rx=0 tx=0).stop 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838d4b3640 1 -- 172.21.15.167:0/2521018597 reap_dead start 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838d4b3640 1 -- 172.21.15.167:0/2521018597 reap_dead start 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 shutdown_connections 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 >> 172.21.15.167:0/2521018597 conn(0x7f838806ee30 msgr2=0x7f838806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 shutdown_connections 2023-11-28T20:48:29.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.501+0000 7f838ef16640 1 -- 172.21.15.167:0/2521018597 wait complete. 2023-11-28T20:48:29.517 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:48:29.517 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:48:29.518 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:48:29.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ecabb8640 1 Processor -- start 2023-11-28T20:48:29.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ecabb8640 1 -- start start 2023-11-28T20:48:29.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ecabb8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec40c86f0 0x7f9ec40c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ecabb8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9ec40c74b0 0x7f9ec415d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ecabb8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec415ad50 con 0x7f9ec4154120 2023-11-28T20:48:29.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ecabb8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec4154500 con 0x7f9ec40c74b0 2023-11-28T20:48:29.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ecabb8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec4159ef0 con 0x7f9ec40c86f0 2023-11-28T20:48:29.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ec9155640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9ec40c74b0 0x7f9ec415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ec9155640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9ec40c74b0 0x7f9ec415d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44056/0 (socket says 172.21.15.167:44056) 2023-11-28T20:48:29.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ec9155640 1 -- 172.21.15.167:0/2644796851 learned_addr learned my addr 172.21.15.167:0/2644796851 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:29.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ec3fff640 1 --2- 172.21.15.167:0/2644796851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec40c86f0 0x7f9ec40c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ec9155640 1 -- 172.21.15.167:0/2644796851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec40c86f0 msgr2=0x7f9ec40c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:29.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ec9155640 1 --2- 172.21.15.167:0/2644796851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec40c86f0 0x7f9ec40c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ec9155640 1 -- 172.21.15.167:0/2644796851 >> v1:172.21.15.167:6789/0 conn(0x7f9ec4154120 legacy=0x7f9ec40c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.673+0000 7f9ec9155640 1 -- 172.21.15.167:0/2644796851 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec415a1d0 con 0x7f9ec40c74b0 2023-11-28T20:48:29.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ec9155640 1 --2- 172.21.15.167:0/2644796851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec40c74b0 0x7f9ec415d700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009e50 tx=0x7f9ebc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7833f38154dadcc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ec37fe640 1 -- 172.21.15.167:0/2644796851 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0a57c0 con 0x7f9ec40c74b0 2023-11-28T20:48:29.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ec37fe640 1 -- 172.21.15.167:0/2644796851 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc0a5920 con 0x7f9ec40c74b0 2023-11-28T20:48:29.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ec37fe640 1 -- 172.21.15.167:0/2644796851 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0a5cb0 con 0x7f9ec40c74b0 2023-11-28T20:48:29.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ecabb8640 1 -- 172.21.15.167:0/2644796851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec40c74b0 msgr2=0x7f9ec415d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ecabb8640 1 --2- 172.21.15.167:0/2644796851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec40c74b0 0x7f9ec415d700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009e50 tx=0x7f9ebc01c9e0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ecabb8640 1 -- 172.21.15.167:0/2644796851 shutdown_connections 2023-11-28T20:48:29.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ecabb8640 1 --2- 172.21.15.167:0/2644796851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec40c74b0 0x7f9ec415d700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ecabb8640 1 --2- 172.21.15.167:0/2644796851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec40c86f0 0x7f9ec40c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ecabb8640 1 -- 172.21.15.167:0/2644796851 >> 172.21.15.167:0/2644796851 conn(0x7f9ec40cc300 msgr2=0x7f9ec40cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:29.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ecabb8640 1 -- 172.21.15.167:0/2644796851 shutdown_connections 2023-11-28T20:48:29.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.677+0000 7f9ecabb8640 1 -- 172.21.15.167:0/2644796851 wait complete. 2023-11-28T20:48:29.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 Processor -- start 2023-11-28T20:48:29.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 -- start start 2023-11-28T20:48:29.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec40c74b0 0x7f9ec415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec40c86f0 0x7f9ec40c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec4154120 0x7f9ec414fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415bdf0 con 0x7f9ec4154120 2023-11-28T20:48:29.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415c090 con 0x7f9ec40c74b0 2023-11-28T20:48:29.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415c780 con 0x7f9ec40c86f0 2023-11-28T20:48:29.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec9155640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec4154120 0x7f9ec414fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec9155640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec4154120 0x7f9ec414fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44060/0 (socket says 172.21.15.167:44060) 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec9155640 1 -- 172.21.15.167:0/3116056829 learned_addr learned my addr 172.21.15.167:0/3116056829 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec3fff640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec40c86f0 0x7f9ec40c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec8954640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec40c74b0 0x7f9ec415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec9155640 1 -- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec40c86f0 msgr2=0x7f9ec40c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec9155640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec40c86f0 0x7f9ec40c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec9155640 1 -- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec40c74b0 msgr2=0x7f9ec415b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec9155640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ec40c74b0 0x7f9ec415b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec9155640 1 -- 172.21.15.167:0/3116056829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc009b30 con 0x7f9ec4154120 2023-11-28T20:48:29.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec9155640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec4154120 0x7f9ec414fb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc01a610 tx=0x7f9ebc019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0b8670 con 0x7f9ec4154120 2023-11-28T20:48:29.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc0b87d0 con 0x7f9ec4154120 2023-11-28T20:48:29.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0b8b60 con 0x7f9ec4154120 2023-11-28T20:48:29.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec415ca60 con 0x7f9ec4154120 2023-11-28T20:48:29.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.681+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec415d020 con 0x7f9ec4154120 2023-11-28T20:48:29.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ecabb8640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec41500a0 0x7f9ec4141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec4074770 con 0x7f9ec41500a0 2023-11-28T20:48:29.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec8954640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec41500a0 0x7f9ec4141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec8954640 1 -- 172.21.15.167:0/3116056829 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ec415e050 con 0x7f9ec41500a0 2023-11-28T20:48:29.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ebc0b8cc0 con 0x7f9ec4154120 2023-11-28T20:48:29.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec8954640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec41500a0 0x7f9ec4141dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e4d0 tx=0x7f9eb800e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec17fa640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ea8066470 0x7f9ea8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9ebc11f830 con 0x7f9ec4154120 2023-11-28T20:48:29.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80052e0 con 0x7f9ec41500a0 2023-11-28T20:48:29.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec3fff640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ea8066470 0x7f9ea8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9eb8005440 con 0x7f9ec41500a0 2023-11-28T20:48:29.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec41500a0 msgr2=0x7f9ec4141dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec17fa640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec41500a0 0x7f9ec4141dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e4d0 tx=0x7f9eb800e990 comp rx=0 tx=0).stop 2023-11-28T20:48:29.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec41500a0 msgr2=0x7f9ec4141dc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:29.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec17fa640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec41500a0 0x7f9ec4141dc0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e4d0 tx=0x7f9eb800e990 comp rx=0 tx=0).stop 2023-11-28T20:48:29.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.685+0000 7f9ec3fff640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ea8066470 0x7f9ea8068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40c6bd0 tx=0x7f9eb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ecabb8640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec4157ad0 0x7f9ec41f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415d210 con 0x7f9ec4157ad0 2023-11-28T20:48:29.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ec8954640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec4157ad0 0x7f9ec41f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ec8954640 1 -- 172.21.15.167:0/3116056829 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9ec40682c0 con 0x7f9ec4157ad0 2023-11-28T20:48:29.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ec8954640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec4157ad0 0x7f9ec41f5e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e4d0 tx=0x7f9eb8001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8021070 con 0x7f9ec4157ad0 2023-11-28T20:48:29.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7f9eb80069f0 con 0x7f9ec4157ad0 2023-11-28T20:48:29.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec4157ad0 msgr2=0x7f9ec41f5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ec17fa640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec4157ad0 0x7f9ec41f5e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e4d0 tx=0x7f9eb8001130 comp rx=0 tx=0).stop 2023-11-28T20:48:29.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ec17fa640 1 -- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec4157ad0 msgr2=0x7f9ec41f5e60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:29.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.693+0000 7f9ec17fa640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ec4157ad0 0x7f9ec41f5e60 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e4d0 tx=0x7f9eb8001130 comp rx=0 tx=0).stop 2023-11-28T20:48:29.696 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:48:29.696 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:29.696 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:29.696 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 86, 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:48:29.697 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:48:29.698 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:29.698 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:29.698 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:29.698 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:48:29.699 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:29.700 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:29.700 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:29.700 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:29.700 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:29.700 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:29.700 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:29.700 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:29.700 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:29.700 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:29.701 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:48:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:48:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:48:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:48:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:48:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:48:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:48:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:48:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:48:29.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:29.705 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:29.706 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:29.706 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.706 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:29.706 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:29.706 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:29.706 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:29.706 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.707 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.708 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:48:29.708 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:48:29.708 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:29.708 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:29.708 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:29.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.709 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.710 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:29.710 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:48:29.710 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.711 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:48:29.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.713 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.714 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:29.715 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:29.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:29.716 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:48:29.716 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:48:29.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ea8066470 msgr2=0x7f9ea8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ecabb8640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9ea8066470 0x7f9ea8068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40c6bd0 tx=0x7f9eb0008040 comp rx=0 tx=0).stop 2023-11-28T20:48:29.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec4154120 msgr2=0x7f9ec414fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ecabb8640 1 --2- 172.21.15.167:0/3116056829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ec4154120 0x7f9ec414fb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc01a610 tx=0x7f9ebc019780 comp rx=0 tx=0).stop 2023-11-28T20:48:29.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ec9155640 1 -- 172.21.15.167:0/3116056829 reap_dead start 2023-11-28T20:48:29.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ec9155640 1 -- 172.21.15.167:0/3116056829 reap_dead start 2023-11-28T20:48:29.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 shutdown_connections 2023-11-28T20:48:29.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 >> 172.21.15.167:0/3116056829 conn(0x7f9ec40cc300 msgr2=0x7f9ec4143860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:29.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 shutdown_connections 2023-11-28T20:48:29.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.697+0000 7f9ecabb8640 1 -- 172.21.15.167:0/3116056829 wait complete. 2023-11-28T20:48:29.719 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:48:29.719 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2023-11-28T20:48:29.719 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:48:29.720 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2023-11-28T20:48:29.720 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:48:29.720 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:48:29.720 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:48:29.739 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:48:29.739 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:48:29.739 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:48:29.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30f101640 1 Processor -- start 2023-11-28T20:48:29.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30f101640 1 -- start start 2023-11-28T20:48:29.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30f101640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3080cfc40 0x7fe3080cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30f101640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30815ac00 con 0x7fe308153ae0 2023-11-28T20:48:29.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30f101640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3080cbd60 con 0x7fe3080cf860 2023-11-28T20:48:29.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30f101640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe308159ff0 con 0x7fe3080cfc40 2023-11-28T20:48:29.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30d69e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe308153ae0 0x7fe30815d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40916/0 (socket says 172.21.15.167:40916) 2023-11-28T20:48:29.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30d69e640 1 -- 172.21.15.167:0/1233117383 learned_addr learned my addr 172.21.15.167:0/1233117383 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:48:29.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe307fff640 1 --2- 172.21.15.167:0/1233117383 >> v2:172.21.15.178:3300/0 conn(0x7fe3080cfc40 0x7fe3080cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335786563 0 0) 0x7fe30815ac00 con 0x7fe308153ae0 2023-11-28T20:48:29.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f8003530 con 0x7fe308153ae0 2023-11-28T20:48:29.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2157457666 0 0) 0x7fe2f8003530 con 0x7fe308153ae0 2023-11-28T20:48:29.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 >> v2:172.21.15.178:3300/0 conn(0x7fe3080cfc40 msgr2=0x7fe3080cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:29.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 --2- 172.21.15.167:0/1233117383 >> v2:172.21.15.178:3300/0 conn(0x7fe3080cfc40 0x7fe3080cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 >> v1:172.21.15.178:6789/0 conn(0x7fe3080cf860 legacy=0x7fe3080ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30815a2d0 con 0x7fe308153ae0 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fe300001a00 con 0x7fe308153ae0 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 >> v1:172.21.15.167:6789/0 conn(0x7fe308153ae0 legacy=0x7fe30815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2f8003980 0x7fe2f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f80047d0 0x7fe2f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8005190 0x7fe2f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe308159ff0 con 0x7fe2f8003980 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f800c030 con 0x7fe2f80047d0 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f800c1f0 con 0x7fe2f8005190 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30d69e640 1 -- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8005190 msgr2=0x7fe2f800b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30ce9d640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2f8003980 0x7fe2f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30d69e640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8005190 0x7fe2f800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:29.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe307fff640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f80047d0 0x7fe2f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30ce9d640 1 -- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8005190 msgr2=0x7fe2f800b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:29.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30ce9d640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8005190 0x7fe2f800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30ce9d640 1 -- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f80047d0 msgr2=0x7fe2f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:29.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30ce9d640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f80047d0 0x7fe2f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30d69e640 1 -- 172.21.15.167:0/1233117383 reap_dead start 2023-11-28T20:48:29.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe30ce9d640 1 -- 172.21.15.167:0/1233117383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f8003530 con 0x7fe2f8003980 2023-11-28T20:48:29.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.881+0000 7fe307fff640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f80047d0 0x7fe2f8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:29.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe30ce9d640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2f8003980 0x7fe2f8003da0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001780 tx=0x7fe2fc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa39061f82a1b668 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0052d0 con 0x7fe2f8003980 2023-11-28T20:48:29.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0a7050 con 0x7fe2f8003980 2023-11-28T20:48:29.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe3077fe640 1 -- 172.21.15.167:0/1233117383 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc003600 con 0x7fe2f8003980 2023-11-28T20:48:29.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe30f101640 1 -- 172.21.15.167:0/1233117383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2f8003980 msgr2=0x7fe2f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe30f101640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2f8003980 0x7fe2f8003da0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001780 tx=0x7fe2fc01c3b0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe30f101640 1 -- 172.21.15.167:0/1233117383 shutdown_connections 2023-11-28T20:48:29.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe30f101640 1 --2- 172.21.15.167:0/1233117383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2f8003980 0x7fe2f8003da0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe30f101640 1 -- 172.21.15.167:0/1233117383 >> 172.21.15.167:0/1233117383 conn(0x7fe30806c1f0 msgr2=0x7fe308071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:29.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe30f101640 1 -- 172.21.15.167:0/1233117383 shutdown_connections 2023-11-28T20:48:29.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.885+0000 7fe30f101640 1 -- 172.21.15.167:0/1233117383 wait complete. 2023-11-28T20:48:29.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 Processor -- start 2023-11-28T20:48:29.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 -- start start 2023-11-28T20:48:29.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8003980 0x7fe3080cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308150e50 0x7fe3081f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30815c9f0 0x7fe308143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080c7c30 con 0x7fe308150e50 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080c8980 con 0x7fe30815c9f0 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080c8c60 con 0x7fe2f8003980 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30ce9d640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8003980 msgr2=0x7fe3080cec10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe307fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308150e50 0x7fe3081f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30ce9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8003980 0x7fe3080cec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe307fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308150e50 0x7fe3081f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44122/0 (socket says 172.21.15.167:44122) 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe307fff640 1 -- 172.21.15.167:0/326270103 learned_addr learned my addr 172.21.15.167:0/326270103 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:29.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30d69e640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30815c9f0 0x7fe308143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe307fff640 1 -- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8003980 msgr2=0x7fe3080cec10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:48:29.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe307fff640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8003980 0x7fe3080cec10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe307fff640 1 -- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30815c9f0 msgr2=0x7fe308143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:29.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe307fff640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30815c9f0 0x7fe308143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:29.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe307fff640 1 -- 172.21.15.167:0/326270103 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3080c8f40 con 0x7fe308150e50 2023-11-28T20:48:29.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe307fff640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308150e50 0x7fe3081f2e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4011510 tx=0x7fe2f40119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe3057fa640 1 -- 172.21.15.167:0/326270103 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4004220 con 0x7fe308150e50 2023-11-28T20:48:29.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe3057fa640 1 -- 172.21.15.167:0/326270103 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f4004380 con 0x7fe308150e50 2023-11-28T20:48:29.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe308159130 con 0x7fe308150e50 2023-11-28T20:48:29.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe3057fa640 1 -- 172.21.15.167:0/326270103 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4015890 con 0x7fe308150e50 2023-11-28T20:48:29.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.889+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3080cf150 con 0x7fe308150e50 2023-11-28T20:48:29.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.893+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe308067c40 con 0x7fe308150e50 2023-11-28T20:48:29.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.893+0000 7fe3057fa640 1 -- 172.21.15.167:0/326270103 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe2f40159f0 con 0x7fe308150e50 2023-11-28T20:48:29.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.893+0000 7fe3057fa640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe2ec066450 0x7fe2ec068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:29.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.893+0000 7fe3057fa640 1 -- 172.21.15.167:0/326270103 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe2f4084600 con 0x7fe308150e50 2023-11-28T20:48:29.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.893+0000 7fe30ce9d640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe2ec066450 0x7fe2ec068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:29.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.893+0000 7fe30ce9d640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe2ec066450 0x7fe2ec068910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001750 tx=0x7fe2fc0011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:29.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:29.897+0000 7fe3057fa640 1 -- 172.21.15.167:0/326270103 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2f4051680 con 0x7fe308150e50 2023-11-28T20:48:30.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.101+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe308158f90 con 0x7fe308150e50 2023-11-28T20:48:30.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.101+0000 7fe3057fa640 1 -- 172.21.15.167:0/326270103 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fe2f4022620 con 0x7fe308150e50 2023-11-28T20:48:30.101 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":86,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:48:30.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe2ec066450 msgr2=0x7fe2ec068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:30.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe2ec066450 0x7fe2ec068910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001750 tx=0x7fe2fc0011a0 comp rx=0 tx=0).stop 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308150e50 msgr2=0x7fe3081f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308150e50 0x7fe3081f2e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4011510 tx=0x7fe2f40119d0 comp rx=0 tx=0).stop 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 shutdown_connections 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe2ec066450 0x7fe2ec068910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30815c9f0 0x7fe308143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308150e50 0x7fe3081f2e20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 --2- 172.21.15.167:0/326270103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f8003980 0x7fe3080cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 >> 172.21.15.167:0/326270103 conn(0x7fe30806c1f0 msgr2=0x7fe3081491b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 shutdown_connections 2023-11-28T20:48:30.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:30.105+0000 7fe30f101640 1 -- 172.21.15.167:0/326270103 wait complete. 2023-11-28T20:48:33.123 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:48:33.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.269+0000 7f0fc97d1640 1 Processor -- start 2023-11-28T20:48:33.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc97d1640 1 -- start start 2023-11-28T20:48:33.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc97d1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0fc40c75c0 0x7f0fc40c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:33.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc97d1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc40c7a50 con 0x7f0fc406a580 2023-11-28T20:48:33.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc97d1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc415b220 con 0x7f0fc4151f60 2023-11-28T20:48:33.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc97d1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc40c4da0 con 0x7f0fc40c75c0 2023-11-28T20:48:33.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc37fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0fc406a580 0x7f0fc41625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53352/0 (socket says 172.21.15.167:53352) 2023-11-28T20:48:33.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc37fe640 1 -- 172.21.15.167:0/4076245749 learned_addr learned my addr 172.21.15.167:0/4076245749 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:48:33.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fba7fc640 1 --2- 172.21.15.167:0/4076245749 >> v2:172.21.15.178:3300/0 conn(0x7f0fc40c75c0 0x7f0fc40c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:33.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964955241 0 0) 0x7f0fbc001120 con 0x7f0fc406a580 2023-11-28T20:48:33.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fb0003530 con 0x7f0fc406a580 2023-11-28T20:48:33.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 102788088 0 0) 0x7f0fb0003530 con 0x7f0fc406a580 2023-11-28T20:48:33.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 >> v2:172.21.15.178:3300/0 conn(0x7f0fc40c75c0 msgr2=0x7f0fc40c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:33.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 --2- 172.21.15.167:0/4076245749 >> v2:172.21.15.178:3300/0 conn(0x7f0fc40c75c0 0x7f0fc40c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 >> v1:172.21.15.178:6789/0 conn(0x7f0fc4151f60 legacy=0x7f0fc40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:33.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4152340 con 0x7f0fc406a580 2023-11-28T20:48:33.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f0fbc001810 con 0x7f0fc406a580 2023-11-28T20:48:33.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 >> v1:172.21.15.167:6789/0 conn(0x7f0fc406a580 legacy=0x7f0fc41625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:33.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fb0003980 0x7f0fb0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:33.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb00047d0 0x7f0fb0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:33.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fb0005190 0x7f0fb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:33.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb000c100 con 0x7f0fb0005190 2023-11-28T20:48:33.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb000c270 con 0x7f0fb0003980 2023-11-28T20:48:33.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb000c430 con 0x7f0fb00047d0 2023-11-28T20:48:33.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fba7fc640 1 -- 172.21.15.167:0/4076245749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb00047d0 msgr2=0x7f0fb0004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:33.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fba7fc640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb00047d0 0x7f0fb0004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:33.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc37fe640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fb0005190 0x7f0fb000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc2ffd640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fb0003980 0x7f0fb0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc37fe640 1 -- 172.21.15.167:0/4076245749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb00047d0 msgr2=0x7f0fb0004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc37fe640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb00047d0 0x7f0fb0004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc37fe640 1 -- 172.21.15.167:0/4076245749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fb0003980 msgr2=0x7f0fb0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc37fe640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fb0003980 0x7f0fb0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.273+0000 7f0fc37fe640 1 -- 172.21.15.167:0/4076245749 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb0003530 con 0x7f0fb0005190 2023-11-28T20:48:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc37fe640 1 -- 172.21.15.167:0/4076245749 reap_dead start 2023-11-28T20:48:33.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc37fe640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fb0005190 0x7f0fb000b990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c190 tx=0x7f0fbc01f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50677e4fb38e8a8d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:33.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc005ae0 con 0x7f0fb0005190 2023-11-28T20:48:33.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc0ab070 con 0x7f0fb0005190 2023-11-28T20:48:33.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc27fc640 1 -- 172.21.15.167:0/4076245749 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc005ea0 con 0x7f0fb0005190 2023-11-28T20:48:33.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc97d1640 1 -- 172.21.15.167:0/4076245749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fb0005190 msgr2=0x7f0fb000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:33.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc97d1640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fb0005190 0x7f0fb000b990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c190 tx=0x7f0fbc01f370 comp rx=0 tx=0).stop 2023-11-28T20:48:33.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc97d1640 1 -- 172.21.15.167:0/4076245749 shutdown_connections 2023-11-28T20:48:33.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc97d1640 1 --2- 172.21.15.167:0/4076245749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fb0005190 0x7f0fb000b990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc97d1640 1 -- 172.21.15.167:0/4076245749 >> 172.21.15.167:0/4076245749 conn(0x7f0fc40cb1e0 msgr2=0x7f0fc40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:33.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc97d1640 1 -- 172.21.15.167:0/4076245749 shutdown_connections 2023-11-28T20:48:33.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.277+0000 7f0fc97d1640 1 -- 172.21.15.167:0/4076245749 wait complete. 2023-11-28T20:48:33.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 Processor -- start 2023-11-28T20:48:33.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 -- start start 2023-11-28T20:48:33.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb0005190 0x7f0fc41eff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:33.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc40c9ff0 0x7f0fc4071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:33.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fc414e2d0 0x7f0fc41477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:33.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc4070640 con 0x7f0fc414e2d0 2023-11-28T20:48:33.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc4070c00 con 0x7f0fc40c9ff0 2023-11-28T20:48:33.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c8fe0 con 0x7f0fb0005190 2023-11-28T20:48:33.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc2ffd640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb0005190 msgr2=0x7f0fc41eff50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:33.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fc414e2d0 0x7f0fc41477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:33.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc2ffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb0005190 0x7f0fc41eff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:33.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fc414e2d0 0x7f0fc41477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:39730/0 (socket says 172.21.15.167:39730) 2023-11-28T20:48:33.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc37fe640 1 -- 172.21.15.167:0/445862702 learned_addr learned my addr 172.21.15.167:0/445862702 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:33.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fba7fc640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc40c9ff0 0x7f0fc4071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:33.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc37fe640 1 -- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb0005190 msgr2=0x7f0fc41eff50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:48:33.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc37fe640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb0005190 0x7f0fc41eff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc37fe640 1 -- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc40c9ff0 msgr2=0x7f0fc4071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:33.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc37fe640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc40c9ff0 0x7f0fc4071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc37fe640 1 -- 172.21.15.167:0/445862702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40c92c0 con 0x7f0fc414e2d0 2023-11-28T20:48:33.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc37fe640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fc414e2d0 0x7f0fc41477f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc01fc10 tx=0x7f0fb0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:33.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fbbfff640 1 -- 172.21.15.167:0/445862702 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc001750 con 0x7f0fc414e2d0 2023-11-28T20:48:33.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fbbfff640 1 -- 172.21.15.167:0/445862702 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc0b6040 con 0x7f0fc414e2d0 2023-11-28T20:48:33.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fbbfff640 1 -- 172.21.15.167:0/445862702 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc0049f0 con 0x7f0fc414e2d0 2023-11-28T20:48:33.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc40c95a0 con 0x7f0fc414e2d0 2023-11-28T20:48:33.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.281+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc40c8790 con 0x7f0fc414e2d0 2023-11-28T20:48:33.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.285+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc40682c0 con 0x7f0fc414e2d0 2023-11-28T20:48:33.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.285+0000 7f0fbbfff640 1 -- 172.21.15.167:0/445862702 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0fbc0ad030 con 0x7f0fc414e2d0 2023-11-28T20:48:33.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.285+0000 7f0fbbfff640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0fa4066420 0x7f0fa40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:33.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.285+0000 7f0fbbfff640 1 -- 172.21.15.167:0/445862702 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0fbc120680 con 0x7f0fc414e2d0 2023-11-28T20:48:33.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.285+0000 7f0fc2ffd640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0fa4066420 0x7f0fa40688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:33.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.285+0000 7f0fc2ffd640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0fa4066420 0x7f0fa40688e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4007fd0 tx=0x7f0fb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:33.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.289+0000 7f0fbbfff640 1 -- 172.21.15.167:0/445862702 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0fbc0ed720 con 0x7f0fc414e2d0 2023-11-28T20:48:33.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.489+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0fc4075c90 con 0x7f0fc414e2d0 2023-11-28T20:48:33.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fbbfff640 1 -- 172.21.15.167:0/445862702 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f0fbc0c0080 con 0x7f0fc414e2d0 2023-11-28T20:48:33.491 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":86,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:48:33.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0fa4066420 msgr2=0x7f0fa40688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:33.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0fa4066420 0x7f0fa40688e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4007fd0 tx=0x7f0fb4009040 comp rx=0 tx=0).stop 2023-11-28T20:48:33.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fc414e2d0 msgr2=0x7f0fc41477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:33.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fc414e2d0 0x7f0fc41477f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc01fc10 tx=0x7f0fb0005800 comp rx=0 tx=0).stop 2023-11-28T20:48:33.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 shutdown_connections 2023-11-28T20:48:33.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0fa4066420 0x7f0fa40688e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fc414e2d0 0x7f0fc41477f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fc40c9ff0 0x7f0fc4071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 --2- 172.21.15.167:0/445862702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fb0005190 0x7f0fc41eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:33.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 >> 172.21.15.167:0/445862702 conn(0x7f0fc40cb1e0 msgr2=0x7f0fc414f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:33.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 shutdown_connections 2023-11-28T20:48:33.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:33.493+0000 7f0fc97d1640 1 -- 172.21.15.167:0/445862702 wait complete. 2023-11-28T20:48:36.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:48:36.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7796eea640 1 Processor -- start 2023-11-28T20:48:36.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7796eea640 1 -- start start 2023-11-28T20:48:36.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7796eea640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f77900cf860 0x7f77900cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:36.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7796eea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cfc40 0x7f77900ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:36.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7796eea640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779015ac00 con 0x7f7790153ae0 2023-11-28T20:48:36.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7796eea640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900cbd60 con 0x7f77900cf860 2023-11-28T20:48:36.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7796eea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7790159ff0 con 0x7f77900cfc40 2023-11-28T20:48:36.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f778ffff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cfc40 msgr2=0x7f77900ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:36.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f778ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cfc40 0x7f77900ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:36.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7794c86640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f77900cf860 0x7f77900cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:36.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7794c86640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f77900cf860 0x7f77900cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:39738/0 (socket says 172.21.15.167:39738) 2023-11-28T20:48:36.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7794c86640 1 -- 172.21.15.167:0/2695327056 learned_addr learned my addr 172.21.15.167:0/2695327056 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:36.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7794c86640 1 -- 172.21.15.167:0/2695327056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cfc40 msgr2=0x7f77900ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:36.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7794c86640 1 --2- 172.21.15.167:0/2695327056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cfc40 0x7f77900ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:36.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7794c86640 1 -- 172.21.15.167:0/2695327056 >> v1:172.21.15.178:6789/0 conn(0x7f7790153ae0 legacy=0x7f779015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:36.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.669+0000 7f7794c86640 1 -- 172.21.15.167:0/2695327056 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779015a2d0 con 0x7f77900cf860 2023-11-28T20:48:36.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.673+0000 7f7794c86640 1 --2- 172.21.15.167:0/2695327056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77900cf860 0x7f77900cb770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7784009870 tx=0x7f778401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf212da1da15d22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:36.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.673+0000 7f778f7fe640 1 -- 172.21.15.167:0/2695327056 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77840a95f0 con 0x7f77900cf860 2023-11-28T20:48:36.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.673+0000 7f778f7fe640 1 -- 172.21.15.167:0/2695327056 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77840a9750 con 0x7f77900cf860 2023-11-28T20:48:36.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.673+0000 7f778f7fe640 1 -- 172.21.15.167:0/2695327056 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77840a9ae0 con 0x7f77900cf860 2023-11-28T20:48:36.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.673+0000 7f7796eea640 1 -- 172.21.15.167:0/2695327056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77900cf860 msgr2=0x7f77900cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:36.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.673+0000 7f7796eea640 1 --2- 172.21.15.167:0/2695327056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77900cf860 0x7f77900cb770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7784009870 tx=0x7f778401c530 comp rx=0 tx=0).stop 2023-11-28T20:48:36.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 -- 172.21.15.167:0/2695327056 shutdown_connections 2023-11-28T20:48:36.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 --2- 172.21.15.167:0/2695327056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cfc40 0x7f77900ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:36.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 --2- 172.21.15.167:0/2695327056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77900cf860 0x7f77900cb770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:36.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 -- 172.21.15.167:0/2695327056 >> 172.21.15.167:0/2695327056 conn(0x7f779006c1f0 msgr2=0x7f7790071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:36.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 -- 172.21.15.167:0/2695327056 shutdown_connections 2023-11-28T20:48:36.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 -- 172.21.15.167:0/2695327056 wait complete. 2023-11-28T20:48:36.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 Processor -- start 2023-11-28T20:48:36.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 -- start start 2023-11-28T20:48:36.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cf860 0x7f779015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:36.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77900cfc40 0x7f77900cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:36.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7790153ae0 0x7f77900b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:36.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900c8fc0 con 0x7f7790153ae0 2023-11-28T20:48:36.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77900c85c0 con 0x7f77900cfc40 2023-11-28T20:48:36.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7796eea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77900c8940 con 0x7f77900cf860 2023-11-28T20:48:36.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7794c86640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cf860 msgr2=0x7f779015cb60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:36.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7794c86640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cf860 0x7f779015cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:36.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7795487640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7790153ae0 0x7f77900b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:36.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7795487640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7790153ae0 0x7f77900b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:39746/0 (socket says 172.21.15.167:39746) 2023-11-28T20:48:36.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7795487640 1 -- 172.21.15.167:0/2760068887 learned_addr learned my addr 172.21.15.167:0/2760068887 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:36.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f778ffff640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77900cfc40 0x7f77900cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:36.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7795487640 1 -- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cf860 msgr2=0x7f779015cb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:48:36.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7795487640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cf860 0x7f779015cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:36.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7795487640 1 -- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77900cfc40 msgr2=0x7f77900cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:36.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7795487640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77900cfc40 0x7f77900cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:36.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.677+0000 7f7795487640 1 -- 172.21.15.167:0/2760068887 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840094d0 con 0x7f7790153ae0 2023-11-28T20:48:36.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f7795487640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7790153ae0 0x7f77900b49a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f778800c7a0 tx=0x7f778800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:36.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f778d7fa640 1 -- 172.21.15.167:0/2760068887 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788003b80 con 0x7f7790153ae0 2023-11-28T20:48:36.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f778d7fa640 1 -- 172.21.15.167:0/2760068887 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7788003ce0 con 0x7f7790153ae0 2023-11-28T20:48:36.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f778d7fa640 1 -- 172.21.15.167:0/2760068887 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800aa30 con 0x7f7790153ae0 2023-11-28T20:48:36.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779015d0a0 con 0x7f7790153ae0 2023-11-28T20:48:36.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77900cf0a0 con 0x7f7790153ae0 2023-11-28T20:48:36.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7790067c40 con 0x7f7790153ae0 2023-11-28T20:48:36.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f778d7fa640 1 -- 172.21.15.167:0/2760068887 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f778800ab90 con 0x7f7790153ae0 2023-11-28T20:48:36.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f778d7fa640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7774066420 0x7f77740688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:36.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f778d7fa640 1 -- 172.21.15.167:0/2760068887 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7788083fb0 con 0x7f7790153ae0 2023-11-28T20:48:36.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.681+0000 7f7794c86640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7774066420 0x7f77740688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:36.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.685+0000 7f7794c86640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7774066420 0x7f77740688e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f77840ae000 tx=0x7f77840a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:36.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.685+0000 7f778d7fa640 1 -- 172.21.15.167:0/2760068887 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7788051030 con 0x7f7790153ae0 2023-11-28T20:48:36.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7790075c90 con 0x7f7790153ae0 2023-11-28T20:48:36.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f778d7fa640 1 -- 172.21.15.167:0/2760068887 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f7788054650 con 0x7f7790153ae0 2023-11-28T20:48:36.908 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":86,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:48:36.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7774066420 msgr2=0x7f77740688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:36.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7774066420 0x7f77740688e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f77840ae000 tx=0x7f77840a7000 comp rx=0 tx=0).stop 2023-11-28T20:48:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7790153ae0 msgr2=0x7f77900b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7790153ae0 0x7f77900b49a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f778800c7a0 tx=0x7f778800cc60 comp rx=0 tx=0).stop 2023-11-28T20:48:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 shutdown_connections 2023-11-28T20:48:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7774066420 0x7f77740688e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7790153ae0 0x7f77900b49a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:36.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77900cfc40 0x7f77900cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:36.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 --2- 172.21.15.167:0/2760068887 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77900cf860 0x7f779015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:36.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 >> 172.21.15.167:0/2760068887 conn(0x7f779006c1f0 msgr2=0x7f7790147100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:36.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 shutdown_connections 2023-11-28T20:48:36.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:36.909+0000 7f7796eea640 1 -- 172.21.15.167:0/2760068887 wait complete. 2023-11-28T20:48:39.929 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:48:40.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.065+0000 7f51bb05a640 1 Processor -- start 2023-11-28T20:48:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.065+0000 7f51bb05a640 1 -- start start 2023-11-28T20:48:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.065+0000 7f51bb05a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.065+0000 7f51bb05a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51bb05a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b40c48f0 con 0x7f51b4150b40 2023-11-28T20:48:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51bb05a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b40c62f0 con 0x7f51b40c4510 2023-11-28T20:48:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51bb05a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b40c6ac0 con 0x7f51b40c6ff0 2023-11-28T20:48:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51b95f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51b95f7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:39752/0 (socket says 172.21.15.167:39752) 2023-11-28T20:48:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 learned_addr learned my addr 172.21.15.167:0/2866393388 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 msgr2=0x7f51b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:48:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 msgr2=0x7f51b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51abfff640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 msgr2=0x7f51b4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:48:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51abfff640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 msgr2=0x7f51b4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.069+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:40.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 msgr2=0x7f51b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:48:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 msgr2=0x7f51b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:48:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51abfff640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 msgr2=0x7f51b4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:48:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51abfff640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 msgr2=0x7f51b4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.273+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 msgr2=0x7f51b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 msgr2=0x7f51b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51abfff640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 msgr2=0x7f51b4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51abfff640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 msgr2=0x7f51b4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:40.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:40.677+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:48:41.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:41.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:41.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 msgr2=0x7f51b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:48:41.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 msgr2=0x7f51b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:41.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:41.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:48:41.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51abfff640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 msgr2=0x7f51b4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:48:41.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51abfff640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 msgr2=0x7f51b4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:48:41.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:48:41.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:41.481+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:48:43.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51aa7fc640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 msgr2=0x7f51b4157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:43.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51aa7fc640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.178:3300/0 conn(0x7f51b40c6ff0 0x7f51b4157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51aa7fc640 1 -- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 msgr2=0x7f51b406a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51aa7fc640 1 --2- 172.21.15.167:0/2866393388 >> v2:172.21.15.167:3300/0 conn(0x7f51b40c4510 0x7f51b406a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51aa7fc640 1 -- 172.21.15.167:0/2866393388 >> v1:172.21.15.178:6789/0 conn(0x7f51b4150b40 legacy=0x7f51b40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51aa7fc640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0003680 0x7f51a0005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51aa7fc640 1 -- 172.21.15.167:0/2866393388 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b40c6500 con 0x7f51a0006160 2023-11-28T20:48:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51aa7fc640 1 -- 172.21.15.167:0/2866393388 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40c62f0 con 0x7f51a0003680 2023-11-28T20:48:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51b8df6640 1 -- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0003680 msgr2=0x7f51a0005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.069+0000 7f51b8df6640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0003680 0x7f51a0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:43.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.273+0000 7f51b8df6640 1 -- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0003680 msgr2=0x7f51a0005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:43.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.273+0000 7f51b8df6640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0003680 0x7f51a0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:48:43.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.677+0000 7f51b8df6640 1 -- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0003680 msgr2=0x7f51a0005ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:43.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.677+0000 7f51b8df6640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0003680 0x7f51a0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:48:43.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974492126 0 0) 0x7f51b40c6500 con 0x7f51a0006160 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f519c005740 con 0x7f51a0006160 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3165648793 0 0) 0x7f519c005740 con 0x7f51a0006160 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0003680 msgr2=0x7f51a0005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0003680 0x7f51a0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a000af50 con 0x7f51a0006160 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f51a400e510 con 0x7f51a0006160 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 >> v1:172.21.15.167:6789/0 conn(0x7f51a0006160 legacy=0x7f51a0008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 reap_dead start 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f519c005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 0x7f519c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 0x7f519c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:43.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40c62f0 con 0x7f519c005b90 2023-11-28T20:48:43.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c00e410 con 0x7f519c0069e0 2023-11-28T20:48:43.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c00e5d0 con 0x7f519c0074c0 2023-11-28T20:48:43.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51b95f7640 1 -- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 msgr2=0x7f519c00dba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:43.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51b8df6640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f519c005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:43.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51b95f7640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 0x7f519c00dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:43.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51abfff640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 0x7f519c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:43.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51b8df6640 1 -- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 msgr2=0x7f519c00dba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:43.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51b8df6640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 0x7f519c00dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51b8df6640 1 -- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 msgr2=0x7f519c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:43.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51b8df6640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 0x7f519c006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.765+0000 7f51b8df6640 1 -- 172.21.15.167:0/2866393388 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c005740 con 0x7f519c005b90 2023-11-28T20:48:43.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51b8df6640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f519c005f90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f51b40c25b0 tx=0x7f51b001c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38c85aeef0a4903 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:43.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0004220 con 0x7f519c005b90 2023-11-28T20:48:43.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0004380 con 0x7f519c005b90 2023-11-28T20:48:43.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51ab7fe640 1 -- 172.21.15.167:0/2866393388 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00044f0 con 0x7f519c005b90 2023-11-28T20:48:43.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51bb05a640 1 -- 172.21.15.167:0/2866393388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 msgr2=0x7f519c005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:43.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51bb05a640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f519c005f90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f51b40c25b0 tx=0x7f51b001c600 comp rx=0 tx=0).stop 2023-11-28T20:48:43.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51bb05a640 1 -- 172.21.15.167:0/2866393388 shutdown_connections 2023-11-28T20:48:43.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51bb05a640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 0x7f519c00dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51bb05a640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 0x7f519c006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51bb05a640 1 --2- 172.21.15.167:0/2866393388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f519c005f90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51bb05a640 1 -- 172.21.15.167:0/2866393388 >> 172.21.15.167:0/2866393388 conn(0x7f51b40cb1e0 msgr2=0x7f51b40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:43.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51bb05a640 1 -- 172.21.15.167:0/2866393388 shutdown_connections 2023-11-28T20:48:43.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.769+0000 7f51bb05a640 1 -- 172.21.15.167:0/2866393388 wait complete. 2023-11-28T20:48:43.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51bb05a640 1 Processor -- start 2023-11-28T20:48:43.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51bb05a640 1 -- start start 2023-11-28T20:48:43.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51bb05a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f51b41f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:43.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51bb05a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 0x7f51b4151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:43.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51bb05a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 0x7f51b41515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:43.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51bb05a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b415aad0 con 0x7f519c005b90 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51bb05a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b41f2df0 con 0x7f519c0069e0 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51bb05a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40c2390 con 0x7f519c0074c0 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b95f7640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 msgr2=0x7f51b41515a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b8df6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f51b41f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b95f7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 0x7f51b41515a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b8df6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f51b41f2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37986/0 (socket says 172.21.15.167:37986) 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b8df6640 1 -- 172.21.15.167:0/977172930 learned_addr learned my addr 172.21.15.167:0/977172930 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51abfff640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 0x7f51b4151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b8df6640 1 -- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 msgr2=0x7f51b41515a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b8df6640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 0x7f51b41515a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b8df6640 1 -- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 msgr2=0x7f51b4151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:43.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b8df6640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 0x7f51b4151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51b8df6640 1 -- 172.21.15.167:0/977172930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b415a710 con 0x7f519c005b90 2023-11-28T20:48:43.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.773+0000 7f51abfff640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 0x7f51b4151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:43.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51b8df6640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f51b41f2140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f51b0097f30 tx=0x7f51b00193a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:43.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51a97fa640 1 -- 172.21.15.167:0/977172930 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00b2040 con 0x7f519c005b90 2023-11-28T20:48:43.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51a97fa640 1 -- 172.21.15.167:0/977172930 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0007240 con 0x7f519c005b90 2023-11-28T20:48:43.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51a97fa640 1 -- 172.21.15.167:0/977172930 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00075b0 con 0x7f519c005b90 2023-11-28T20:48:43.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b41f2b10 con 0x7f519c005b90 2023-11-28T20:48:43.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b4155950 con 0x7f519c005b90 2023-11-28T20:48:43.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b40682c0 con 0x7f519c005b90 2023-11-28T20:48:43.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51a97fa640 1 -- 172.21.15.167:0/977172930 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f51b00057d0 con 0x7f519c005b90 2023-11-28T20:48:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51a97fa640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51a0069a10 0x7f51a006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.777+0000 7f51a97fa640 1 -- 172.21.15.167:0/977172930 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f51b011d720 con 0x7f519c005b90 2023-11-28T20:48:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.781+0000 7f51abfff640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51a0069a10 0x7f51a006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.781+0000 7f51abfff640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51a0069a10 0x7f51a006bed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f51a400a010 tx=0x7f51a400e8c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:43.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.781+0000 7f51a97fa640 1 -- 172.21.15.167:0/977172930 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51b00ea7a0 con 0x7f519c005b90 2023-11-28T20:48:43.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.993+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f51b40682c0 con 0x7f519c005b90 2023-11-28T20:48:43.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.993+0000 7f51a97fa640 1 -- 172.21.15.167:0/977172930 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f51b00eddc0 con 0x7f519c005b90 2023-11-28T20:48:43.996 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":90,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:48:43.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51a0069a10 msgr2=0x7f51a006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:43.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51a0069a10 0x7f51a006bed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f51a400a010 tx=0x7f51a400e8c0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 msgr2=0x7f51b41f2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:43.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f51b41f2140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f51b0097f30 tx=0x7f51b00193a0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 shutdown_connections 2023-11-28T20:48:43.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51a0069a10 0x7f51a006bed0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f519c0074c0 0x7f51b41515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519c0069e0 0x7f51b4151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 --2- 172.21.15.167:0/977172930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f519c005b90 0x7f51b41f2140 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:43.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 >> 172.21.15.167:0/977172930 conn(0x7f51b40cb1e0 msgr2=0x7f51b40cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:43.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 shutdown_connections 2023-11-28T20:48:43.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:43.997+0000 7f51bb05a640 1 -- 172.21.15.167:0/977172930 wait complete. 2023-11-28T20:48:44.016 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:48:44.016 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:48:44.016 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:48:44.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbff617640 1 Processor -- start 2023-11-28T20:48:44.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbff617640 1 -- start start 2023-11-28T20:48:44.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbff617640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbf81585d0 0x7fcbf80c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbff617640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcbf815e130 0x7fcbf8161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbff617640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf80c7720 0x7fcbf8162320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbff617640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf815f160 con 0x7fcbf815e130 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbff617640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf815e5e0 con 0x7fcbf81585d0 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbff617640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf815e8c0 con 0x7fcbf80c7720 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfcbb2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcbf815e130 0x7fcbf8161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfdbb4640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf80c7720 msgr2=0x7fcbf8162320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfdbb4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf80c7720 0x7fcbf8162320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfcbb2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcbf815e130 0x7fcbf8161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37992/0 (socket says 172.21.15.167:37992) 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfcbb2640 1 -- 172.21.15.167:0/4093931644 learned_addr learned my addr 172.21.15.167:0/4093931644 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfd3b3640 1 --2- 172.21.15.167:0/4093931644 >> v2:172.21.15.178:3300/0 conn(0x7fcbf81585d0 0x7fcbf80c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfcbb2640 1 -- 172.21.15.167:0/4093931644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf80c7720 msgr2=0x7fcbf8162320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfcbb2640 1 --2- 172.21.15.167:0/4093931644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf80c7720 0x7fcbf8162320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfcbb2640 1 -- 172.21.15.167:0/4093931644 >> v2:172.21.15.178:3300/0 conn(0x7fcbf81585d0 msgr2=0x7fcbf80c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:48:44.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfcbb2640 1 --2- 172.21.15.167:0/4093931644 >> v2:172.21.15.178:3300/0 conn(0x7fcbf81585d0 0x7fcbf80c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.157+0000 7fcbfcbb2640 1 -- 172.21.15.167:0/4093931644 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf815eba0 con 0x7fcbf815e130 2023-11-28T20:48:44.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbfcbb2640 1 --2- 172.21.15.167:0/4093931644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 0x7fcbf8161de0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80c5e20 tx=0x7fcbe801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3704f3b972c7c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbeffff640 1 -- 172.21.15.167:0/4093931644 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe80aa610 con 0x7fcbf815e130 2023-11-28T20:48:44.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbeffff640 1 -- 172.21.15.167:0/4093931644 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe80a6040 con 0x7fcbf815e130 2023-11-28T20:48:44.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbeffff640 1 -- 172.21.15.167:0/4093931644 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe80aa990 con 0x7fcbf815e130 2023-11-28T20:48:44.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbff617640 1 -- 172.21.15.167:0/4093931644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 msgr2=0x7fcbf8161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbff617640 1 --2- 172.21.15.167:0/4093931644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 0x7fcbf8161de0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80c5e20 tx=0x7fcbe801c4f0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbff617640 1 -- 172.21.15.167:0/4093931644 shutdown_connections 2023-11-28T20:48:44.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbff617640 1 --2- 172.21.15.167:0/4093931644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf80c7720 0x7fcbf8162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbff617640 1 --2- 172.21.15.167:0/4093931644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 0x7fcbf8161de0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbff617640 1 --2- 172.21.15.167:0/4093931644 >> v2:172.21.15.178:3300/0 conn(0x7fcbf81585d0 0x7fcbf80c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbff617640 1 -- 172.21.15.167:0/4093931644 >> 172.21.15.167:0/4093931644 conn(0x7fcbf80cb1e0 msgr2=0x7fcbf80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:44.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbff617640 1 -- 172.21.15.167:0/4093931644 shutdown_connections 2023-11-28T20:48:44.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.161+0000 7fcbff617640 1 -- 172.21.15.167:0/4093931644 wait complete. 2023-11-28T20:48:44.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbff617640 1 Processor -- start 2023-11-28T20:48:44.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbff617640 1 -- start start 2023-11-28T20:48:44.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbff617640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbf80c7720 0x7fcbf8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbff617640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf81585d0 0x7fcbf8159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbff617640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 0x7fcbf814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbff617640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf81f71c0 con 0x7fcbf815e130 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbff617640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf81f68b0 con 0x7fcbf80c7720 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbff617640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf81fa8d0 con 0x7fcbf81585d0 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfcbb2640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf81585d0 msgr2=0x7fcbf8159aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfcbb2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf81585d0 0x7fcbf8159aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfdbb4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 0x7fcbf814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfd3b3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbf80c7720 0x7fcbf8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfdbb4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 0x7fcbf814ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38008/0 (socket says 172.21.15.167:38008) 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfdbb4640 1 -- 172.21.15.167:0/709931384 learned_addr learned my addr 172.21.15.167:0/709931384 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfdbb4640 1 -- 172.21.15.167:0/709931384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf81585d0 msgr2=0x7fcbf8159aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfdbb4640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbf81585d0 0x7fcbf8159aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfdbb4640 1 -- 172.21.15.167:0/709931384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbf80c7720 msgr2=0x7fcbf8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfdbb4640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbf80c7720 0x7fcbf8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfdbb4640 1 -- 172.21.15.167:0/709931384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe80094d0 con 0x7fcbf815e130 2023-11-28T20:48:44.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbfdbb4640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 0x7fcbf814ee00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b760 tx=0x7fcbf000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000c960 con 0x7fcbf815e130 2023-11-28T20:48:44.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf000cac0 con 0x7fcbf815e130 2023-11-28T20:48:44.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf81fabb0 con 0x7fcbf815e130 2023-11-28T20:48:44.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.165+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0015470 con 0x7fcbf815e130 2023-11-28T20:48:44.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf81f6e50 con 0x7fcbf815e130 2023-11-28T20:48:44.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbff617640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf81f7630 0x7fcbf814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8074770 con 0x7fcbf81f7630 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbfd3b3640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf81f7630 0x7fcbf814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbfd3b3640 1 -- 172.21.15.167:0/709931384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcbf80c2f40 con 0x7fcbf81f7630 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbfd3b3640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf81f7630 0x7fcbf814f340 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4010820 tx=0x7fcbf4010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4004240 con 0x7fcbf81f7630 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbf0012070 con 0x7fcbf815e130 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbedffb640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbdc066540 0x7fcbdc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fcbf0083f40 con 0x7fcbf815e130 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fcbf40043a0 con 0x7fcbf81f7630 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf81f7630 msgr2=0x7fcbf814f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbedffb640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf81f7630 0x7fcbf814f340 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4010820 tx=0x7fcbf4010ce0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf81f7630 msgr2=0x7fcbf814f340 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:44.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbedffb640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf81f7630 0x7fcbf814f340 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.169+0000 7fcbfcbb2640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbdc066540 0x7fcbdc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.173+0000 7fcbfcbb2640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbdc066540 0x7fcbdc068a00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80ae000 tx=0x7fcbe80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf8153030 0x7fcbf8158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf81f7040 con 0x7fcbf8153030 2023-11-28T20:48:44.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbfd3b3640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf8153030 0x7fcbf8158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbfd3b3640 1 -- 172.21.15.167:0/709931384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcbf80682c0 con 0x7fcbf8153030 2023-11-28T20:48:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbfd3b3640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf8153030 0x7fcbf8158a40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4010820 tx=0x7fcbf40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4024070 con 0x7fcbf8153030 2023-11-28T20:48:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5113 (secure 0 0 0) 0x7fcbf401f0d0 con 0x7fcbf8153030 2023-11-28T20:48:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf8153030 msgr2=0x7fcbf8158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbedffb640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf8153030 0x7fcbf8158a40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4010820 tx=0x7fcbf40046d0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbedffb640 1 -- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf8153030 msgr2=0x7fcbf8158a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbedffb640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf8153030 0x7fcbf8158a40 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4010820 tx=0x7fcbf40046d0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.178 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:48:44.178 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:44.178 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:44.178 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:48:44.178 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 90, 2023-11-28T20:48:44.178 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:48:44.178 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:48:44.178 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:44.179 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:44.180 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:48:44.181 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:48:44.182 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:48:44.182 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:48:44.182 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:48:44.182 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:48:44.182 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:44.182 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:44.182 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:48:44.182 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:48:44.183 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:48:44.183 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:48:44.183 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:48:44.183 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:48:44.183 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:48:44.183 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:44.183 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:48:44.183 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:44.183 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:48:44.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:48:44.185 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:48:44.186 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:44.187 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:48:44.188 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.189 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.190 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.191 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.192 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:48:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:48:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:48:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:48:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:48:44.195 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:48:44.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbdc066540 msgr2=0x7fcbdc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcbdc066540 0x7fcbdc068a00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80ae000 tx=0x7fcbe80a7000 comp rx=0 tx=0).stop 2023-11-28T20:48:44.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 msgr2=0x7fcbf814ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 --2- 172.21.15.167:0/709931384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf815e130 0x7fcbf814ee00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000b760 tx=0x7fcbf000bc20 comp rx=0 tx=0).stop 2023-11-28T20:48:44.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbfdbb4640 1 -- 172.21.15.167:0/709931384 reap_dead start 2023-11-28T20:48:44.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbfdbb4640 1 -- 172.21.15.167:0/709931384 reap_dead start 2023-11-28T20:48:44.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 shutdown_connections 2023-11-28T20:48:44.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 >> 172.21.15.167:0/709931384 conn(0x7fcbf80cb1e0 msgr2=0x7fcbf815d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:44.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 shutdown_connections 2023-11-28T20:48:44.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.177+0000 7fcbff617640 1 -- 172.21.15.167:0/709931384 wait complete. 2023-11-28T20:48:44.198 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:48:44.198 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:48:44.198 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:48:44.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.337+0000 7f543c596640 1 Processor -- start 2023-11-28T20:48:44.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.337+0000 7f543c596640 1 -- start start 2023-11-28T20:48:44.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f543c596640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5434070480 0x7f5434071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f543c596640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 0x7f5434072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f543c596640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54341571d0 con 0x7f543406e030 2023-11-28T20:48:44.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f543c596640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5434071a90 con 0x7f5434070480 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f543c596640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54340c70d0 con 0x7f543406e410 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439b31640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5434070480 0x7f5434071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f543ab33640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 msgr2=0x7f5434072460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439b31640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5434070480 0x7f5434071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38054/0 (socket says 172.21.15.167:38054) 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439b31640 1 -- 172.21.15.167:0/141079814 learned_addr learned my addr 172.21.15.167:0/141079814 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f543ab33640 1 --2- 172.21.15.167:0/141079814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 0x7f5434072460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439b31640 1 -- 172.21.15.167:0/141079814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 msgr2=0x7f5434072460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439b31640 1 --2- 172.21.15.167:0/141079814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 0x7f5434072460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439b31640 1 -- 172.21.15.167:0/141079814 >> v1:172.21.15.167:6789/0 conn(0x7f543406e030 legacy=0x7f54341500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439b31640 1 -- 172.21.15.167:0/141079814 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54340c73b0 con 0x7f5434070480 2023-11-28T20:48:44.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439b31640 1 --2- 172.21.15.167:0/141079814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 0x7f5434071f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f542400bb10 tx=0x7f542401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c434e4d9cae277 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439330640 1 -- 172.21.15.167:0/141079814 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240a7cd0 con 0x7f5434070480 2023-11-28T20:48:44.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439330640 1 -- 172.21.15.167:0/141079814 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54240a7e30 con 0x7f5434070480 2023-11-28T20:48:44.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.341+0000 7f5439330640 1 -- 172.21.15.167:0/141079814 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54240af660 con 0x7f5434070480 2023-11-28T20:48:44.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 -- 172.21.15.167:0/141079814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 msgr2=0x7f5434071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 --2- 172.21.15.167:0/141079814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 0x7f5434071f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f542400bb10 tx=0x7f542401ec00 comp rx=0 tx=0).stop 2023-11-28T20:48:44.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 -- 172.21.15.167:0/141079814 shutdown_connections 2023-11-28T20:48:44.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 --2- 172.21.15.167:0/141079814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 0x7f5434071f20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 --2- 172.21.15.167:0/141079814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 0x7f5434072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 -- 172.21.15.167:0/141079814 >> 172.21.15.167:0/141079814 conn(0x7f54340cb1e0 msgr2=0x7f54340cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:44.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 -- 172.21.15.167:0/141079814 shutdown_connections 2023-11-28T20:48:44.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 -- 172.21.15.167:0/141079814 wait complete. 2023-11-28T20:48:44.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 Processor -- start 2023-11-28T20:48:44.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 -- start start 2023-11-28T20:48:44.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543406e030 0x7f543414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 0x7f5434159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 0x7f54341e9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54341495b0 con 0x7f5434070480 2023-11-28T20:48:44.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5434148d10 con 0x7f543406e030 2023-11-28T20:48:44.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543c596640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5434148ff0 con 0x7f543406e410 2023-11-28T20:48:44.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f5439b31640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 msgr2=0x7f5434159fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:48:44.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f5439b31640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 0x7f5434159fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:48:44.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543ab33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 0x7f54341e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543ab33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 0x7f54341e9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38070/0 (socket says 172.21.15.167:38070) 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543ab33640 1 -- 172.21.15.167:0/1051872226 learned_addr learned my addr 172.21.15.167:0/1051872226 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.345+0000 7f543a332640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543406e030 0x7f543414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543ab33640 1 -- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 msgr2=0x7f5434159fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543ab33640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f543406e410 0x7f5434159fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543ab33640 1 -- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543406e030 msgr2=0x7f543414e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543ab33640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543406e030 0x7f543414e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543ab33640 1 -- 172.21.15.167:0/1051872226 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542400b770 con 0x7f5434070480 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543a332640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543406e030 0x7f543414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:48:44.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543ab33640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 0x7f54341e9390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f542c00bbe0 tx=0x7f542c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c00ccb0 con 0x7f5434070480 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c00ce10 con 0x7f5434070480 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54341492d0 con 0x7f5434070480 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c015690 con 0x7f5434070480 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54341e8e70 con 0x7f5434070480 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543c596640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341e98d0 0x7f54341f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5434074770 con 0x7f54341e98d0 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543a332640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341e98d0 0x7f54341f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543a332640 1 -- 172.21.15.167:0/1051872226 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5434162b80 con 0x7f54341e98d0 2023-11-28T20:48:44.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f542c012070 con 0x7f5434070480 2023-11-28T20:48:44.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f543a332640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341e98d0 0x7f54341f60f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f543000e4d0 tx=0x7f543000e990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f542affd640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5418066420 0x7f54180688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.349+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f542c0844f0 con 0x7f5434070480 2023-11-28T20:48:44.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.353+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300052e0 con 0x7f54341e98d0 2023-11-28T20:48:44.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.353+0000 7f5439b31640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5418066420 0x7f54180688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.353+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f5430005440 con 0x7f54341e98d0 2023-11-28T20:48:44.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.353+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341e98d0 msgr2=0x7f54341f60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.353+0000 7f542affd640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341e98d0 0x7f54341f60f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f543000e4d0 tx=0x7f543000e990 comp rx=0 tx=0).stop 2023-11-28T20:48:44.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.353+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341e98d0 msgr2=0x7f54341f60f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:44.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.353+0000 7f542affd640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341e98d0 0x7f54341f60f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.353+0000 7f5439b31640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5418066420 0x7f54180688e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f54240b1000 tx=0x7f5424008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.357+0000 7f543c596640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341f6630 0x7f54341f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:48:44.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.357+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54341f6f80 con 0x7f54341f6630 2023-11-28T20:48:44.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.357+0000 7f543a332640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341f6630 0x7f54341f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:48:44.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.357+0000 7f543a332640 1 -- 172.21.15.167:0/1051872226 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f54340682c0 con 0x7f54341f6630 2023-11-28T20:48:44.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.357+0000 7f543a332640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341f6630 0x7f54341f6a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f543000e4d0 tx=0x7f5430001090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:48:44.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430003d50 con 0x7f54341f6630 2023-11-28T20:48:44.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4798 (secure 0 0 0) 0x7f5430013420 con 0x7f54341f6630 2023-11-28T20:48:44.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341f6630 msgr2=0x7f54341f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f542affd640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341f6630 0x7f54341f6a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f543000e4d0 tx=0x7f5430001090 comp rx=0 tx=0).stop 2023-11-28T20:48:44.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f542affd640 1 -- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341f6630 msgr2=0x7f54341f6a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:48:44.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f542affd640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54341f6630 0x7f54341f6a40 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f543000e4d0 tx=0x7f5430001090 comp rx=0 tx=0).stop 2023-11-28T20:48:44.360 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:48:44.360 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 90, 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:48:44.361 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:48:44.362 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:48:44.365 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:48:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:48:44.367 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.368 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:44.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.370 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:48:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:48:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:48:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:48:44.371 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.372 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:48:44.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.374 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:48:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:48:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:48:44.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:48:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:48:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:48:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:48:44.377 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:48:44.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5418066420 msgr2=0x7f54180688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543c596640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5418066420 0x7f54180688e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f54240b1000 tx=0x7f5424008040 comp rx=0 tx=0).stop 2023-11-28T20:48:44.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 msgr2=0x7f54341e9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:48:44.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543c596640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 0x7f54341e9390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f542c00bbe0 tx=0x7f542c009f70 comp rx=0 tx=0).stop 2023-11-28T20:48:44.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543ab33640 1 -- 172.21.15.167:0/1051872226 reap_dead start 2023-11-28T20:48:44.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 shutdown_connections 2023-11-28T20:48:44.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543c596640 1 --2- 172.21.15.167:0/1051872226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5434070480 0x7f54341e9390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:48:44.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 >> 172.21.15.167:0/1051872226 conn(0x7f54340cb1e0 msgr2=0x7f54341603d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:48:44.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 shutdown_connections 2023-11-28T20:48:44.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:48:44.361+0000 7f543c596640 1 -- 172.21.15.167:0/1051872226 wait complete. 2023-11-28T20:48:44.379 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:48:44.379 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:48:48.373 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:48:48.377 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:04.380 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:49:04.380 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2023-11-28T20:49:04.380 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:49:04.381 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:49:04.383 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:49:04.384 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:49:04.384 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:49:04.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c4432640 1 Processor -- start 2023-11-28T20:49:04.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c4432640 1 -- start start 2023-11-28T20:49:04.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c4432640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:04.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c4432640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe6bc0c6ff0 0x7fe6bc0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:04.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c4432640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6bc0c5be0 0x7fe6bc06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:04.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c4432640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc0c6ac0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c4432640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc0c6500 con 0x7fe6bc0c5be0 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c4432640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0c67e0 con 0x7fe6bc150b40 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c19cd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe6bc0c6ff0 0x7fe6bc0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c19cd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe6bc0c6ff0 0x7fe6bc0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44154/0 (socket says 172.21.15.167:44154) 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c19cd640 1 -- 172.21.15.167:0/2079085543 learned_addr learned my addr 172.21.15.167:0/2079085543 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c21ce640 1 --2- 172.21.15.167:0/2079085543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c29cf640 1 --2- 172.21.15.167:0/2079085543 >> v2:172.21.15.178:3300/0 conn(0x7fe6bc0c5be0 0x7fe6bc06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c21ce640 1 -- 172.21.15.167:0/2079085543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 msgr2=0x7fe6bc157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c21ce640 1 -- 172.21.15.167:0/2079085543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 msgr2=0x7fe6bc157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c21ce640 1 --2- 172.21.15.167:0/2079085543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:04.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c21ce640 1 --2- 172.21.15.167:0/2079085543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:04.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c19cd640 1 -- 172.21.15.167:0/2079085543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 msgr2=0x7fe6bc157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:49:04.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c19cd640 1 --2- 172.21.15.167:0/2079085543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c19cd640 1 -- 172.21.15.167:0/2079085543 >> v2:172.21.15.178:3300/0 conn(0x7fe6bc0c5be0 msgr2=0x7fe6bc06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:04.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c19cd640 1 --2- 172.21.15.167:0/2079085543 >> v2:172.21.15.178:3300/0 conn(0x7fe6bc0c5be0 0x7fe6bc06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c19cd640 1 -- 172.21.15.167:0/2079085543 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc156a80 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.525+0000 7fe6c29cf640 1 --2- 172.21.15.167:0/2079085543 >> v2:172.21.15.178:3300/0 conn(0x7fe6bc0c5be0 0x7fe6bc06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:49:04.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c19cd640 1 --2- 172.21.15.167:0/2079085543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 0x7fe6bc0c4510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc070410 tx=0x7fe6ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb176ba6511354d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:04.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c11cc640 1 -- 172.21.15.167:0/2079085543 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0aa5f0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c11cc640 1 -- 172.21.15.167:0/2079085543 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac0aa750 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c11cc640 1 -- 172.21.15.167:0/2079085543 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0aaae0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c4432640 1 -- 172.21.15.167:0/2079085543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 msgr2=0x7fe6bc0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:04.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2079085543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 0x7fe6bc0c4510 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc070410 tx=0x7fe6ac01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c4432640 1 -- 172.21.15.167:0/2079085543 shutdown_connections 2023-11-28T20:49:04.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2079085543 >> v2:172.21.15.178:3300/0 conn(0x7fe6bc0c5be0 0x7fe6bc06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2079085543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 0x7fe6bc0c4510 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2079085543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c4432640 1 -- 172.21.15.167:0/2079085543 >> 172.21.15.167:0/2079085543 conn(0x7fe6bc0cb1e0 msgr2=0x7fe6bc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:04.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c4432640 1 -- 172.21.15.167:0/2079085543 shutdown_connections 2023-11-28T20:49:04.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.529+0000 7fe6c4432640 1 -- 172.21.15.167:0/2079085543 wait complete. 2023-11-28T20:49:04.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 Processor -- start 2023-11-28T20:49:04.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 -- start start 2023-11-28T20:49:04.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6bc0c5be0 0x7fe6bc144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:04.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 0x7fe6bc1f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:04.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc1f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:04.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc140ec0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc13f750 con 0x7fe6bc0c5be0 2023-11-28T20:49:04.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc13fda0 con 0x7fe6bc150b40 2023-11-28T20:49:04.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c19cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 0x7fe6bc1f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:04.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c19cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 0x7fe6bc1f5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44156/0 (socket says 172.21.15.167:44156) 2023-11-28T20:49:04.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c19cd640 1 -- 172.21.15.167:0/2219418748 learned_addr learned my addr 172.21.15.167:0/2219418748 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:04.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c21ce640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6bc0c5be0 0x7fe6bc144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:04.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c29cf640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc1f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:04.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c19cd640 1 -- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 msgr2=0x7fe6bc1f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:04.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c19cd640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc1f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c19cd640 1 -- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6bc0c5be0 msgr2=0x7fe6bc144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:04.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c19cd640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6bc0c5be0 0x7fe6bc144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c19cd640 1 -- 172.21.15.167:0/2219418748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac0094d0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c21ce640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6bc0c5be0 0x7fe6bc144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:49:04.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c19cd640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 0x7fe6bc1f5e00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac01ab80 tx=0x7fe6ac01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:04.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6b2ffd640 1 -- 172.21.15.167:0/2219418748 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0aa5f0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6b2ffd640 1 -- 172.21.15.167:0/2219418748 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac0b3800 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc140140 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6b2ffd640 1 -- 172.21.15.167:0/2219418748 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0b3bb0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc1403e0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.533+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc0682c0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.537+0000 7fe6b2ffd640 1 -- 172.21.15.167:0/2219418748 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6ac0b3d10 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.537+0000 7fe6b2ffd640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6a0066470 0x7fe6a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:04.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.537+0000 7fe6b2ffd640 1 -- 172.21.15.167:0/2219418748 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe6ac0a7070 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.537+0000 7fe6c21ce640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6a0066470 0x7fe6a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:04.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.537+0000 7fe6c21ce640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6a0066470 0x7fe6a0068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8006f10 tx=0x7fe6b8006e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:04.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.541+0000 7fe6b2ffd640 1 -- 172.21.15.167:0/2219418748 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6ac0eb8d0 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.785+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe6bc075c90 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.785+0000 7fe6b2ffd640 1 -- 172.21.15.167:0/2219418748 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fe6ac0c3080 con 0x7fe6bc0c6ff0 2023-11-28T20:49:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":90,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6a0066470 msgr2=0x7fe6a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6a0066470 0x7fe6a0068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8006f10 tx=0x7fe6b8006e80 comp rx=0 tx=0).stop 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 msgr2=0x7fe6bc1f5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 0x7fe6bc1f5e00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac01ab80 tx=0x7fe6ac01ad10 comp rx=0 tx=0).stop 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 shutdown_connections 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6a0066470 0x7fe6a0068930 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6bc150b40 0x7fe6bc1f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6bc0c6ff0 0x7fe6bc1f5e00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 --2- 172.21.15.167:0/2219418748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6bc0c5be0 0x7fe6bc144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:04.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 >> 172.21.15.167:0/2219418748 conn(0x7fe6bc0cb1e0 msgr2=0x7fe6bc0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:04.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 shutdown_connections 2023-11-28T20:49:04.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:04.789+0000 7fe6c4432640 1 -- 172.21.15.167:0/2219418748 wait complete. 2023-11-28T20:49:07.807 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:49:07.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.945+0000 7f12a39b8640 1 Processor -- start 2023-11-28T20:49:07.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.945+0000 7f12a39b8640 1 -- start start 2023-11-28T20:49:07.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a39b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:07.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a39b8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0c4940 con 0x7f129c0c4510 2023-11-28T20:49:07.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a39b8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0c6ac0 con 0x7f129c150b40 2023-11-28T20:49:07.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a39b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0c62f0 con 0x7f129c0c6ff0 2023-11-28T20:49:07.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a1f55640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f129c0c4510 0x7f129c06a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:35974/0 (socket says 172.21.15.167:35974) 2023-11-28T20:49:07.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a1f55640 1 -- 172.21.15.167:0/1346390210 learned_addr learned my addr 172.21.15.167:0/1346390210 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:49:07.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:07.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 msgr2=0x7f129c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:49:07.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 msgr2=0x7f129c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:07.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:07.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:07.949+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:08.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.153+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:08.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.153+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 msgr2=0x7f129c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:49:08.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.153+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 msgr2=0x7f129c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:08.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.153+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:08.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.153+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:49:08.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.557+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:08.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.557+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 msgr2=0x7f129c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:49:08.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.557+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 msgr2=0x7f129c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:08.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.557+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:08.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:08.557+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:49:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:09.361+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:09.361+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 msgr2=0x7f129c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:49:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:09.361+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 msgr2=0x7f129c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:09.361+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:09.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:09.361+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:49:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f1292ffd640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 msgr2=0x7f129c157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:49:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f1292ffd640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c0c6ff0 0x7f129c157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f1292ffd640 1 -- 172.21.15.167:0/1346390210 >> v1:172.21.15.178:6789/0 conn(0x7f129c150b40 legacy=0x7f129c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f1292ffd640 1 -- 172.21.15.167:0/1346390210 >> v1:172.21.15.167:6789/0 conn(0x7f129c0c4510 legacy=0x7f129c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f1292ffd640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.167:3300/0 conn(0x7f1280003720 0x7f1280005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:10.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f1292ffd640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 0x7f1280008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:10.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f1292ffd640 1 -- 172.21.15.167:0/1346390210 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c0c62f0 con 0x7f1280003720 2023-11-28T20:49:10.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f1292ffd640 1 -- 172.21.15.167:0/1346390210 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1280008d40 con 0x7f12800061d0 2023-11-28T20:49:10.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a1754640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.167:3300/0 conn(0x7f1280003720 0x7f1280005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:10.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 0x7f1280008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:10.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a1754640 1 -- 172.21.15.167:0/1346390210 >> v2:172.21.15.167:3300/0 conn(0x7f1280003720 msgr2=0x7f1280005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:49:10.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a1754640 1 -- 172.21.15.167:0/1346390210 >> v2:172.21.15.167:3300/0 conn(0x7f1280003720 msgr2=0x7f1280005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:10.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a1754640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.167:3300/0 conn(0x7f1280003720 0x7f1280005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:10.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a1754640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.167:3300/0 conn(0x7f1280003720 0x7f1280005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:10.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 msgr2=0x7f1280008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:49:10.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a0f53640 1 -- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 msgr2=0x7f1280008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:10.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 0x7f1280008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:10.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:10.949+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 0x7f1280008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:11.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.153+0000 7f12a1754640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.167:3300/0 conn(0x7f1280003720 0x7f1280005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:11.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.153+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 0x7f1280008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:11.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.153+0000 7f12a1754640 1 -- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 msgr2=0x7f1280008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:11.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.153+0000 7f12a1754640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 0x7f1280008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:11.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.153+0000 7f12a1754640 1 -- 172.21.15.167:0/1346390210 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0c6500 con 0x7f1280003720 2023-11-28T20:49:11.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.153+0000 7f12a0f53640 1 --2- 172.21.15.167:0/1346390210 >> v2:172.21.15.178:3300/0 conn(0x7f12800061d0 0x7f1280008690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:49:11.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.153+0000 7f12a1754640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1280003720 0x7f1280005ba0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12800061a0 tx=0x7f129801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2f2f8fc8fd3083 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:11.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f1293fff640 1 -- 172.21.15.167:0/1346390210 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298005390 con 0x7f1280003720 2023-11-28T20:49:11.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f1293fff640 1 -- 172.21.15.167:0/1346390210 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12980a7050 con 0x7f1280003720 2023-11-28T20:49:11.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f1293fff640 1 -- 172.21.15.167:0/1346390210 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298003840 con 0x7f1280003720 2023-11-28T20:49:11.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a39b8640 1 -- 172.21.15.167:0/1346390210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1280003720 msgr2=0x7f1280005ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:11.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a39b8640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1280003720 0x7f1280005ba0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12800061a0 tx=0x7f129801c380 comp rx=0 tx=0).stop 2023-11-28T20:49:11.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a1f55640 1 -- 172.21.15.167:0/1346390210 reap_dead start 2023-11-28T20:49:11.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a39b8640 1 -- 172.21.15.167:0/1346390210 shutdown_connections 2023-11-28T20:49:11.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a39b8640 1 --2- 172.21.15.167:0/1346390210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1280003720 0x7f1280005ba0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:11.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a39b8640 1 -- 172.21.15.167:0/1346390210 >> 172.21.15.167:0/1346390210 conn(0x7f129c0cb1e0 msgr2=0x7f129c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:11.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a39b8640 1 -- 172.21.15.167:0/1346390210 shutdown_connections 2023-11-28T20:49:11.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a39b8640 1 -- 172.21.15.167:0/1346390210 wait complete. 2023-11-28T20:49:11.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a39b8640 1 Processor -- start 2023-11-28T20:49:11.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.157+0000 7f12a39b8640 1 -- start start 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a39b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f129c161740 0x7f129c1f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a39b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c152ef0 0x7f129c1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a39b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c151260 0x7f129c1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a39b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1542f0 con 0x7f129c152ef0 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a39b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1f2790 con 0x7f129c161740 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a39b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1f2d10 con 0x7f129c151260 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a0f53640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c152ef0 0x7f129c1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a0f53640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c152ef0 0x7f129c1f31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44182/0 (socket says 172.21.15.167:44182) 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a0f53640 1 -- 172.21.15.167:0/2649877188 learned_addr learned my addr 172.21.15.167:0/2649877188 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a1754640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f129c161740 0x7f129c1f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:11.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a1f55640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c151260 0x7f129c1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:11.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a0f53640 1 -- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c151260 msgr2=0x7f129c1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:11.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a1f55640 1 -- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c151260 msgr2=0x7f129c1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:49:11.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a1f55640 1 -- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c151260 msgr2=0x7f129c1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:49:11.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a1f55640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c151260 0x7f129c1495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:11.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a1f55640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c151260 0x7f129c1495b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:11.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a0f53640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c151260 0x7f129c1495b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:11.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a0f53640 1 -- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f129c161740 msgr2=0x7f129c1f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:11.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a0f53640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f129c161740 0x7f129c1f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:11.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a0f53640 1 -- 172.21.15.167:0/2649877188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129800f040 con 0x7f129c152ef0 2023-11-28T20:49:11.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a1754640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f129c161740 0x7f129c1f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:49:11.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a0f53640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c152ef0 0x7f129c1f31a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f128c0116a0 tx=0x7f128c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:11.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f1291ffb640 1 -- 172.21.15.167:0/2649877188 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c011ea0 con 0x7f129c152ef0 2023-11-28T20:49:11.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f1291ffb640 1 -- 172.21.15.167:0/2649877188 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c0109c0 con 0x7f129c152ef0 2023-11-28T20:49:11.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f1291ffb640 1 -- 172.21.15.167:0/2649877188 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c019070 con 0x7f129c152ef0 2023-11-28T20:49:11.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c1f6c50 con 0x7f129c152ef0 2023-11-28T20:49:11.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.161+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c1f36e0 con 0x7f129c152ef0 2023-11-28T20:49:11.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.165+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c0682c0 con 0x7f129c152ef0 2023-11-28T20:49:11.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.169+0000 7f1291ffb640 1 -- 172.21.15.167:0/2649877188 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f128c01d400 con 0x7f129c152ef0 2023-11-28T20:49:11.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.169+0000 7f1291ffb640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1280067180 0x7f1280069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:11.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.169+0000 7f1291ffb640 1 -- 172.21.15.167:0/2649877188 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f128c084c80 con 0x7f129c152ef0 2023-11-28T20:49:11.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.169+0000 7f12a1754640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1280067180 0x7f1280069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:11.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.169+0000 7f12a1754640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1280067180 0x7f1280069640 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f12980ad000 tx=0x7f12980a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:11.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.173+0000 7f1291ffb640 1 -- 172.21.15.167:0/2649877188 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f128c051d80 con 0x7f129c152ef0 2023-11-28T20:49:11.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.377+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f129c067c40 con 0x7f129c152ef0 2023-11-28T20:49:11.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.377+0000 7f1291ffb640 1 -- 172.21.15.167:0/2649877188 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1545 (secure 0 0 0) 0x7f128c02b620 con 0x7f129c152ef0 2023-11-28T20:49:11.377 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":94,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.377+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1280067180 msgr2=0x7f1280069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.377+0000 7f12a39b8640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1280067180 0x7f1280069640 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f12980ad000 tx=0x7f12980a6000 comp rx=0 tx=0).stop 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.377+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c152ef0 msgr2=0x7f129c1f31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.377+0000 7f12a39b8640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c152ef0 0x7f129c1f31a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f128c0116a0 tx=0x7f128c011b60 comp rx=0 tx=0).stop 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.377+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 shutdown_connections 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.377+0000 7f12a39b8640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1280067180 0x7f1280069640 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.377+0000 7f12a39b8640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f129c151260 0x7f129c1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.381+0000 7f12a39b8640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129c152ef0 0x7f129c1f31a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.381+0000 7f12a39b8640 1 --2- 172.21.15.167:0/2649877188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f129c161740 0x7f129c1f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:11.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.381+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 >> 172.21.15.167:0/2649877188 conn(0x7f129c0cb1e0 msgr2=0x7f129c155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:11.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.381+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 shutdown_connections 2023-11-28T20:49:11.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:11.381+0000 7f12a39b8640 1 -- 172.21.15.167:0/2649877188 wait complete. 2023-11-28T20:49:14.398 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:49:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.544+0000 7f35f829c640 1 Processor -- start 2023-11-28T20:49:14.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.544+0000 7f35f829c640 1 -- start start 2023-11-28T20:49:14.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.544+0000 7f35f829c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35f00c6ff0 0x7f35f0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.544+0000 7f35f829c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f00c48f0 con 0x7f35f00c4510 2023-11-28T20:49:14.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.544+0000 7f35f829c640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f00c6ac0 con 0x7f35f0150b40 2023-11-28T20:49:14.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.544+0000 7f35f829c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f00c62f0 con 0x7f35f00c6ff0 2023-11-28T20:49:14.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.544+0000 7f35f5837640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35f00c6ff0 0x7f35f0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.544+0000 7f35f5837640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35f00c6ff0 0x7f35f0157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51454/0 (socket says 172.21.15.167:51454) 2023-11-28T20:49:14.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.544+0000 7f35f5837640 1 -- 172.21.15.167:0/3637419406 learned_addr learned my addr 172.21.15.167:0/3637419406 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:14.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.548+0000 7f35f5837640 1 -- 172.21.15.167:0/3637419406 >> v1:172.21.15.178:6789/0 conn(0x7f35f0150b40 legacy=0x7f35f00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.548+0000 7f35f5837640 1 -- 172.21.15.167:0/3637419406 >> v1:172.21.15.167:6789/0 conn(0x7f35f00c4510 legacy=0x7f35f006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.548+0000 7f35f5837640 1 -- 172.21.15.167:0/3637419406 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f00c6500 con 0x7f35f00c6ff0 2023-11-28T20:49:14.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.548+0000 7f35f5837640 1 --2- 172.21.15.167:0/3637419406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f00c6ff0 0x7f35f0157560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009870 tx=0x7f35e001e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35b47f88e39bc7f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.548+0000 7f35f5036640 1 -- 172.21.15.167:0/3637419406 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00aa650 con 0x7f35f00c6ff0 2023-11-28T20:49:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.548+0000 7f35f5036640 1 -- 172.21.15.167:0/3637419406 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e00aa7b0 con 0x7f35f00c6ff0 2023-11-28T20:49:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.548+0000 7f35f5036640 1 -- 172.21.15.167:0/3637419406 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00aab40 con 0x7f35f00c6ff0 2023-11-28T20:49:14.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.548+0000 7f35f829c640 1 -- 172.21.15.167:0/3637419406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f00c6ff0 msgr2=0x7f35f0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.548+0000 7f35f829c640 1 --2- 172.21.15.167:0/3637419406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f00c6ff0 0x7f35f0157560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009870 tx=0x7f35e001e720 comp rx=0 tx=0).stop 2023-11-28T20:49:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 -- 172.21.15.167:0/3637419406 shutdown_connections 2023-11-28T20:49:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 --2- 172.21.15.167:0/3637419406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f00c6ff0 0x7f35f0157560 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 -- 172.21.15.167:0/3637419406 >> 172.21.15.167:0/3637419406 conn(0x7f35f00cb1e0 msgr2=0x7f35f00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 -- 172.21.15.167:0/3637419406 shutdown_connections 2023-11-28T20:49:14.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 -- 172.21.15.167:0/3637419406 wait complete. 2023-11-28T20:49:14.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 Processor -- start 2023-11-28T20:49:14.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 -- start start 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35f00c4510 0x7f35f014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35f00c6ff0 0x7f35f01f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f0150b40 0x7f35f0151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f014d950 con 0x7f35f0150b40 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0154da0 con 0x7f35f00c6ff0 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f829c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f01f68a0 con 0x7f35f00c4510 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f6839640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f0150b40 0x7f35f0151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f6839640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f0150b40 0x7f35f0151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51462/0 (socket says 172.21.15.167:51462) 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f6839640 1 -- 172.21.15.167:0/395682031 learned_addr learned my addr 172.21.15.167:0/395682031 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f6038640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35f00c4510 0x7f35f014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f5837640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35f00c6ff0 0x7f35f01f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f6839640 1 -- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35f00c4510 msgr2=0x7f35f014d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f6839640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35f00c4510 0x7f35f014d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f6839640 1 -- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35f00c6ff0 msgr2=0x7f35f01f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f6839640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35f00c6ff0 0x7f35f01f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.552+0000 7f35f6839640 1 -- 172.21.15.167:0/395682031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e00094d0 con 0x7f35f0150b40 2023-11-28T20:49:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35f6839640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f0150b40 0x7f35f0151ef0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c760 tx=0x7f35e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35e6ffd640 1 -- 172.21.15.167:0/395682031 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8003ba0 con 0x7f35f0150b40 2023-11-28T20:49:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35e6ffd640 1 -- 172.21.15.167:0/395682031 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e8003d00 con 0x7f35f0150b40 2023-11-28T20:49:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35e6ffd640 1 -- 172.21.15.167:0/395682031 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e800aa90 con 0x7f35f0150b40 2023-11-28T20:49:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f014db50 con 0x7f35f0150b40 2023-11-28T20:49:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f01f2a60 con 0x7f35f0150b40 2023-11-28T20:49:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f00682c0 con 0x7f35f0150b40 2023-11-28T20:49:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35e6ffd640 1 -- 172.21.15.167:0/395682031 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f35e800abf0 con 0x7f35f0150b40 2023-11-28T20:49:14.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35e6ffd640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35d40664a0 0x7f35d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.556+0000 7f35e6ffd640 1 -- 172.21.15.167:0/395682031 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f35e8084060 con 0x7f35f0150b40 2023-11-28T20:49:14.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.560+0000 7f35f6038640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35d40664a0 0x7f35d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.560+0000 7f35f6038640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35d40664a0 0x7f35d4068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f35ec000f70 tx=0x7f35ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:14.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.560+0000 7f35e6ffd640 1 -- 172.21.15.167:0/395682031 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f35e80b5280 con 0x7f35f0150b40 2023-11-28T20:49:14.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f35f00680b0 con 0x7f35f0150b40 2023-11-28T20:49:14.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35e6ffd640 1 -- 172.21.15.167:0/395682031 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1551 (secure 0 0 0) 0x7f35e8051050 con 0x7f35f0150b40 2023-11-28T20:49:14.773 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:49:14.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35d40664a0 msgr2=0x7f35d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35d40664a0 0x7f35d4068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f35ec000f70 tx=0x7f35ec009040 comp rx=0 tx=0).stop 2023-11-28T20:49:14.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f0150b40 msgr2=0x7f35f0151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f0150b40 0x7f35f0151ef0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c760 tx=0x7f35e800cc20 comp rx=0 tx=0).stop 2023-11-28T20:49:14.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 shutdown_connections 2023-11-28T20:49:14.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f35d40664a0 0x7f35d4068960 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35f0150b40 0x7f35f0151ef0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35f00c6ff0 0x7f35f01f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 --2- 172.21.15.167:0/395682031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35f00c4510 0x7f35f014d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 >> 172.21.15.167:0/395682031 conn(0x7f35f00cb1e0 msgr2=0x7f35f006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:14.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.772+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 shutdown_connections 2023-11-28T20:49:14.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.776+0000 7f35f829c640 1 -- 172.21.15.167:0/395682031 wait complete. 2023-11-28T20:49:14.794 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:49:14.794 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:49:14.794 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:49:14.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.940+0000 7f3c913e6640 1 Processor -- start 2023-11-28T20:49:14.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.940+0000 7f3c913e6640 1 -- start start 2023-11-28T20:49:14.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c913e6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3c8c150b40 0x7f3c8c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c913e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c6ff0 0x7f3c8c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c913e6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c0c6ac0 con 0x7f3c8c0c5be0 2023-11-28T20:49:14.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c913e6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0c6500 con 0x7f3c8c150b40 2023-11-28T20:49:14.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c913e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0c67e0 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c8affd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3c8c150b40 0x7f3c8c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c83fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c6ff0 0x7f3c8c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c8affd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3c8c150b40 0x7f3c8c157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41350/0 (socket says 172.21.15.167:41350) 2023-11-28T20:49:14.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c83fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c6ff0 0x7f3c8c0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:60026/0 (socket says 172.21.15.167:60026) 2023-11-28T20:49:14.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c8affd640 1 -- 172.21.15.167:0/620139721 learned_addr learned my addr 172.21.15.167:0/620139721 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:14.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c8b7fe640 1 --1- 172.21.15.167:0/620139721 >> v1:172.21.15.178:6789/0 conn(0x7f3c8c0c5be0 0x7f3c8c06a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:39488/0 (socket says 172.21.15.167:39488) 2023-11-28T20:49:14.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c8affd640 1 -- 172.21.15.167:0/620139721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c6ff0 msgr2=0x7f3c8c0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:14.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c8affd640 1 --2- 172.21.15.167:0/620139721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c6ff0 0x7f3c8c0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c8affd640 1 -- 172.21.15.167:0/620139721 >> v1:172.21.15.178:6789/0 conn(0x7f3c8c0c5be0 legacy=0x7f3c8c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c8affd640 1 -- 172.21.15.167:0/620139721 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c156a80 con 0x7f3c8c150b40 2023-11-28T20:49:14.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.944+0000 7f3c83fff640 1 --2- 172.21.15.167:0/620139721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c6ff0 0x7f3c8c0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:49:14.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c8affd640 1 --2- 172.21.15.167:0/620139721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c8c150b40 0x7f3c8c157560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009870 tx=0x7f3c7c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bca7182209bfbfa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:14.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c8a7fc640 1 -- 172.21.15.167:0/620139721 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0aa670 con 0x7f3c8c150b40 2023-11-28T20:49:14.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c8a7fc640 1 -- 172.21.15.167:0/620139721 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c0aa7d0 con 0x7f3c8c150b40 2023-11-28T20:49:14.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c8a7fc640 1 -- 172.21.15.167:0/620139721 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0aab60 con 0x7f3c8c150b40 2023-11-28T20:49:14.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c913e6640 1 -- 172.21.15.167:0/620139721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c8c150b40 msgr2=0x7f3c8c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c913e6640 1 --2- 172.21.15.167:0/620139721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c8c150b40 0x7f3c8c157560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009870 tx=0x7f3c7c01c510 comp rx=0 tx=0).stop 2023-11-28T20:49:14.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c913e6640 1 -- 172.21.15.167:0/620139721 shutdown_connections 2023-11-28T20:49:14.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c913e6640 1 --2- 172.21.15.167:0/620139721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c6ff0 0x7f3c8c0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c913e6640 1 --2- 172.21.15.167:0/620139721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c8c150b40 0x7f3c8c157560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c913e6640 1 -- 172.21.15.167:0/620139721 >> 172.21.15.167:0/620139721 conn(0x7f3c8c0cb1e0 msgr2=0x7f3c8c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:14.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c913e6640 1 -- 172.21.15.167:0/620139721 shutdown_connections 2023-11-28T20:49:14.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.948+0000 7f3c913e6640 1 -- 172.21.15.167:0/620139721 wait complete. 2023-11-28T20:49:14.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 Processor -- start 2023-11-28T20:49:14.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 -- start start 2023-11-28T20:49:14.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c5be0 0x7f3c8c143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c0c6ff0 0x7f3c8c14bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c8c150b40 0x7f3c8c14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c14c810 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c159650 con 0x7f3c8c150b40 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c158db0 con 0x7f3c8c0c5be0 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c83fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c0c6ff0 0x7f3c8c14bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c83fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c0c6ff0 0x7f3c8c14bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51478/0 (socket says 172.21.15.167:51478) 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c83fff640 1 -- 172.21.15.167:0/2011199390 learned_addr learned my addr 172.21.15.167:0/2011199390 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c8affd640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c5be0 0x7f3c8c143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c8b7fe640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c8c150b40 0x7f3c8c14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c83fff640 1 -- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c5be0 msgr2=0x7f3c8c143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c83fff640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c8c0c5be0 0x7f3c8c143550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c83fff640 1 -- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c8c150b40 msgr2=0x7f3c8c14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c83fff640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c8c150b40 0x7f3c8c14c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c83fff640 1 -- 172.21.15.167:0/2011199390 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c74009420 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c83fff640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c0c6ff0 0x7f3c8c14bd90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400ebe0 tx=0x7f3c7400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:14.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400eee0 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7400cc30 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74013470 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7c0094d0 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c159370 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c14b510 0x7f3c8c1f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c074770 con 0x7f3c8c14b510 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.952+0000 7f3c8affd640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c14b510 0x7f3c8c1f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c8affd640 1 -- 172.21.15.167:0/2011199390 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c8c0c6ce0 con 0x7f3c8c14b510 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c8affd640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c14b510 0x7f3c8c1f5ea0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c070410 tx=0x7f3c7c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0aac50 con 0x7f3c8c14b510 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3c740135d0 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c837fe640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3c6c066510 0x7f3c6c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3c740845b0 con 0x7f3c8c0c6ff0 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3c7c0aadb0 con 0x7f3c8c14b510 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c14b510 msgr2=0x7f3c8c1f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c837fe640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c14b510 0x7f3c8c1f5ea0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c070410 tx=0x7f3c7c01ad50 comp rx=0 tx=0).stop 2023-11-28T20:49:14.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c14b510 msgr2=0x7f3c8c1f5ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:14.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c837fe640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c14b510 0x7f3c8c1f5ea0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c070410 tx=0x7f3c7c01ad50 comp rx=0 tx=0).stop 2023-11-28T20:49:14.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c8b7fe640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3c6c066510 0x7f3c6c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.956+0000 7f3c8b7fe640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3c6c066510 0x7f3c6c0689d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3c840012f0 tx=0x7f3c84007f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:14.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c1f63e0 0x7f3c8c1f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:14.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0cb6f0 con 0x7f3c8c1f63e0 2023-11-28T20:49:14.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c8affd640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c1f63e0 0x7f3c8c1f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:14.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c8affd640 1 -- 172.21.15.167:0/2011199390 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3c8c06ac90 con 0x7f3c8c1f63e0 2023-11-28T20:49:14.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c8affd640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c1f63e0 0x7f3c8c1f67f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c01abc0 tx=0x7f3c7c0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:14.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0c56c0 con 0x7f3c8c1f63e0 2023-11-28T20:49:14.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5124 (secure 0 0 0) 0x7f3c7c0c5820 con 0x7f3c8c1f63e0 2023-11-28T20:49:14.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c1f63e0 msgr2=0x7f3c8c1f67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c837fe640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c1f63e0 0x7f3c8c1f67f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c01abc0 tx=0x7f3c7c0192b0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c837fe640 1 -- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c1f63e0 msgr2=0x7f3c8c1f67f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:14.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c837fe640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c1f63e0 0x7f3c8c1f67f0 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c01abc0 tx=0x7f3c7c0192b0 comp rx=0 tx=0).stop 2023-11-28T20:49:14.965 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:49:14.965 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:14.965 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:14.965 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:49:14.965 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 96, 2023-11-28T20:49:14.965 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:49:14.966 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:49:14.966 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:49:14.966 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:49:14.966 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:14.966 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:49:14.966 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:14.966 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:14.967 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:14.968 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:14.969 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:14.970 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.971 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.972 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:14.974 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.976 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:14.977 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.978 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:14.979 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:14.980 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:49:14.981 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:49:14.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3c6c066510 msgr2=0x7f3c6c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3c6c066510 0x7f3c6c0689d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3c840012f0 tx=0x7f3c84007f90 comp rx=0 tx=0).stop 2023-11-28T20:49:14.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c0c6ff0 msgr2=0x7f3c8c14bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:14.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 --2- 172.21.15.167:0/2011199390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c8c0c6ff0 0x7f3c8c14bd90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400ebe0 tx=0x7f3c7400c520 comp rx=0 tx=0).stop 2023-11-28T20:49:14.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c8b7fe640 1 -- 172.21.15.167:0/2011199390 reap_dead start 2023-11-28T20:49:14.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c8b7fe640 1 -- 172.21.15.167:0/2011199390 reap_dead start 2023-11-28T20:49:14.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 shutdown_connections 2023-11-28T20:49:14.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 >> 172.21.15.167:0/2011199390 conn(0x7f3c8c0cb1e0 msgr2=0x7f3c8c06ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:14.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 shutdown_connections 2023-11-28T20:49:14.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:14.964+0000 7f3c913e6640 1 -- 172.21.15.167:0/2011199390 wait complete. 2023-11-28T20:49:14.984 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:49:14.984 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:49:14.984 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:49:15.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba84632640 1 Processor -- start 2023-11-28T20:49:15.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba84632640 1 -- start start 2023-11-28T20:49:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba84632640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba7c072630 0x7fba7c161b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba84632640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c1571d0 con 0x7fba7c06e030 2023-11-28T20:49:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba84632640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c071a90 con 0x7fba7c070480 2023-11-28T20:49:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba84632640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0c70d0 con 0x7fba7c072630 2023-11-28T20:49:15.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba823ce640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fba7c06e030 0x7fba7c1500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:41276/0 (socket says 172.21.15.167:41276) 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba823ce640 1 -- 172.21.15.167:0/2247881159 learned_addr learned my addr 172.21.15.167:0/2247881159 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba82bcf640 1 --2- 172.21.15.167:0/2247881159 >> v2:172.21.15.167:3300/0 conn(0x7fba7c072630 0x7fba7c161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba82bcf640 1 -- 172.21.15.167:0/2247881159 >> v1:172.21.15.178:6789/0 conn(0x7fba7c070480 legacy=0x7fba7c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba82bcf640 1 -- 172.21.15.167:0/2247881159 >> v1:172.21.15.167:6789/0 conn(0x7fba7c06e030 legacy=0x7fba7c1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.124+0000 7fba82bcf640 1 -- 172.21.15.167:0/2247881159 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0c73b0 con 0x7fba7c072630 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba82bcf640 1 --2- 172.21.15.167:0/2247881159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c072630 0x7fba7c161b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba7400aea0 tx=0x7fba7401da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb259850d5d24792 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba813cc640 1 -- 172.21.15.167:0/2247881159 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400a2d0 con 0x7fba7c072630 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba813cc640 1 -- 172.21.15.167:0/2247881159 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba740a68e0 con 0x7fba7c072630 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba813cc640 1 -- 172.21.15.167:0/2247881159 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba740a6c70 con 0x7fba7c072630 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba84632640 1 -- 172.21.15.167:0/2247881159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c072630 msgr2=0x7fba7c161b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba84632640 1 --2- 172.21.15.167:0/2247881159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c072630 0x7fba7c161b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba7400aea0 tx=0x7fba7401da20 comp rx=0 tx=0).stop 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba84632640 1 -- 172.21.15.167:0/2247881159 shutdown_connections 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba84632640 1 --2- 172.21.15.167:0/2247881159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c072630 0x7fba7c161b80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba84632640 1 -- 172.21.15.167:0/2247881159 >> 172.21.15.167:0/2247881159 conn(0x7fba7c0cb1e0 msgr2=0x7fba7c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba84632640 1 -- 172.21.15.167:0/2247881159 shutdown_connections 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.128+0000 7fba84632640 1 -- 172.21.15.167:0/2247881159 wait complete. 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 Processor -- start 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 -- start start 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c06e030 0x7fba7c0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba7c070480 0x7fba7c142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c072630 0x7fba7c140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1f16d0 con 0x7fba7c06e030 2023-11-28T20:49:15.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c9110 con 0x7fba7c072630 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1f0b50 con 0x7fba7c070480 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba823ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c06e030 0x7fba7c0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba823ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c06e030 0x7fba7c0cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51522/0 (socket says 172.21.15.167:51522) 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba823ce640 1 -- 172.21.15.167:0/194736337 learned_addr learned my addr 172.21.15.167:0/194736337 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba82bcf640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c072630 0x7fba7c140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba81bcd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba7c070480 0x7fba7c142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba823ce640 1 -- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba7c070480 msgr2=0x7fba7c142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba823ce640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba7c070480 0x7fba7c142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba823ce640 1 -- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c072630 msgr2=0x7fba7c140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba823ce640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c072630 0x7fba7c140a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba823ce640 1 -- 172.21.15.167:0/194736337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7400ab80 con 0x7fba7c06e030 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba82bcf640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c072630 0x7fba7c140a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba823ce640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c06e030 0x7fba7c0cac00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba7800c530 tx=0x7fba7800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78005cf0 con 0x7fba7c06e030 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba78005e50 con 0x7fba7c06e030 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78007270 con 0x7fba7c06e030 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c1f0e30 con 0x7fba7c06e030 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.132+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c1f13f0 con 0x7fba7c06e030 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba84632640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c153930 0x7fba7c140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c074770 con 0x7fba7c153930 2023-11-28T20:49:15.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba81bcd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c153930 0x7fba7c140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba81bcd640 1 -- 172.21.15.167:0/194736337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba7c0680b0 con 0x7fba7c153930 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba780073d0 con 0x7fba7c06e030 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba81bcd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c153930 0x7fba7c140f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba7c1418c0 tx=0x7fba6c00e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba72ffd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba60066470 0x7fba60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fba78083760 con 0x7fba7c06e030 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0052e0 con 0x7fba7c153930 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba82bcf640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba60066470 0x7fba60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fba6c005440 con 0x7fba7c153930 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c153930 msgr2=0x7fba7c140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba72ffd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c153930 0x7fba7c140f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba7c1418c0 tx=0x7fba6c00e960 comp rx=0 tx=0).stop 2023-11-28T20:49:15.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c153930 msgr2=0x7fba7c140f90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba72ffd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c153930 0x7fba7c140f90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.136+0000 7fba82bcf640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba60066470 0x7fba60068930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fba740af000 tx=0x7fba740a8070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba84632640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c0c9580 0x7fba7c0c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c156c40 con 0x7fba7c0c9580 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba81bcd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c0c9580 0x7fba7c0c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba81bcd640 1 -- 172.21.15.167:0/194736337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fba7c0c9250 con 0x7fba7c0c9580 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba81bcd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c0c9580 0x7fba7c0c9990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0670c0 tx=0x7fba6c001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c007240 con 0x7fba7c0c9580 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4809 (secure 0 0 0) 0x7fba6c0073a0 con 0x7fba7c0c9580 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c0c9580 msgr2=0x7fba7c0c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba72ffd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c0c9580 0x7fba7c0c9990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0670c0 tx=0x7fba6c001130 comp rx=0 tx=0).stop 2023-11-28T20:49:15.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba72ffd640 1 -- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c0c9580 msgr2=0x7fba7c0c9990 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:15.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba72ffd640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba7c0c9580 0x7fba7c0c9990 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0670c0 tx=0x7fba6c001130 comp rx=0 tx=0).stop 2023-11-28T20:49:15.153 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:49:15.153 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:15.153 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:15.153 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:49:15.153 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 96, 2023-11-28T20:49:15.153 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:15.154 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:15.155 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.156 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:49:15.157 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:15.158 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:15.159 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.160 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:15.161 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:15.162 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.163 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:15.164 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:49:15.165 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.165 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.165 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.165 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.165 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:49:15.165 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:49:15.165 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:15.165 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:15.165 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:15.166 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.167 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.168 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.169 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:49:15.169 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:49:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba60066470 msgr2=0x7fba60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba84632640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba60066470 0x7fba60068930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fba740af000 tx=0x7fba740a8070 comp rx=0 tx=0).stop 2023-11-28T20:49:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c06e030 msgr2=0x7fba7c0cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba84632640 1 --2- 172.21.15.167:0/194736337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba7c06e030 0x7fba7c0cac00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba7800c530 tx=0x7fba7800c9f0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba82bcf640 1 -- 172.21.15.167:0/194736337 reap_dead start 2023-11-28T20:49:15.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba82bcf640 1 -- 172.21.15.167:0/194736337 reap_dead start 2023-11-28T20:49:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 shutdown_connections 2023-11-28T20:49:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.144+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 >> 172.21.15.167:0/194736337 conn(0x7fba7c0cb1e0 msgr2=0x7fba7c0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.148+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 shutdown_connections 2023-11-28T20:49:15.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.148+0000 7fba84632640 1 -- 172.21.15.167:0/194736337 wait complete. 2023-11-28T20:49:15.171 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:49:15.171 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:49:15.171 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:49:15.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f3105f2a640 1 Processor -- start 2023-11-28T20:49:15.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f3105f2a640 1 -- start start 2023-11-28T20:49:15.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f3105f2a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3100151f60 0x7f31000c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f3105f2a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f31000c5c90 0x7f31000c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f3105f2a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31000c6120 con 0x7f310006a580 2023-11-28T20:49:15.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f3105f2a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31000c4da0 con 0x7f3100151f60 2023-11-28T20:49:15.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f3105f2a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310015b220 con 0x7f31000c5c90 2023-11-28T20:49:15.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f30ff7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3100151f60 0x7f31000c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f30ff7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3100151f60 0x7f31000c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51526/0 (socket says 172.21.15.167:51526) 2023-11-28T20:49:15.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f30ff7fe640 1 -- 172.21.15.167:0/68320017 learned_addr learned my addr 172.21.15.167:0/68320017 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:15.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f30feffd640 1 --2- 172.21.15.167:0/68320017 >> v2:172.21.15.178:3300/0 conn(0x7f31000c5c90 0x7f31000c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f30ff7fe640 1 -- 172.21.15.167:0/68320017 >> v2:172.21.15.178:3300/0 conn(0x7f31000c5c90 msgr2=0x7f31000c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:15.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f30ff7fe640 1 --2- 172.21.15.167:0/68320017 >> v2:172.21.15.178:3300/0 conn(0x7f31000c5c90 0x7f31000c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f30ff7fe640 1 -- 172.21.15.167:0/68320017 >> v1:172.21.15.178:6789/0 conn(0x7f310006a580 legacy=0x7f310006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:15.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f30ff7fe640 1 -- 172.21.15.167:0/68320017 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100152340 con 0x7f3100151f60 2023-11-28T20:49:15.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.316+0000 7f30feffd640 1 --2- 172.21.15.167:0/68320017 >> v2:172.21.15.178:3300/0 conn(0x7f31000c5c90 0x7f31000c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:49:15.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f30ff7fe640 1 --2- 172.21.15.167:0/68320017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3100151f60 0x7f31000c75c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f31000c8d80 tx=0x7f30f001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779ca173b9e6ca78 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f30fe7fc640 1 -- 172.21.15.167:0/68320017 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00ab600 con 0x7f3100151f60 2023-11-28T20:49:15.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f30fe7fc640 1 -- 172.21.15.167:0/68320017 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f00a7050 con 0x7f3100151f60 2023-11-28T20:49:15.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f30fe7fc640 1 -- 172.21.15.167:0/68320017 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00ab980 con 0x7f3100151f60 2023-11-28T20:49:15.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f3105f2a640 1 -- 172.21.15.167:0/68320017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3100151f60 msgr2=0x7f31000c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f3105f2a640 1 --2- 172.21.15.167:0/68320017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3100151f60 0x7f31000c75c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f31000c8d80 tx=0x7f30f001c430 comp rx=0 tx=0).stop 2023-11-28T20:49:15.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f3105f2a640 1 -- 172.21.15.167:0/68320017 shutdown_connections 2023-11-28T20:49:15.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f3105f2a640 1 --2- 172.21.15.167:0/68320017 >> v2:172.21.15.178:3300/0 conn(0x7f31000c5c90 0x7f31000c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f3105f2a640 1 --2- 172.21.15.167:0/68320017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3100151f60 0x7f31000c75c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f3105f2a640 1 -- 172.21.15.167:0/68320017 >> 172.21.15.167:0/68320017 conn(0x7f31000cb1e0 msgr2=0x7f31000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:15.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f3105f2a640 1 -- 172.21.15.167:0/68320017 shutdown_connections 2023-11-28T20:49:15.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.320+0000 7f3105f2a640 1 -- 172.21.15.167:0/68320017 wait complete. 2023-11-28T20:49:15.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 Processor -- start 2023-11-28T20:49:15.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 -- start start 2023-11-28T20:49:15.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f310006a580 0x7f310013d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31000c5c90 0x7f3100158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3100151f60 0x7f310015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31001f0880 con 0x7f310006a580 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31001f4b60 con 0x7f3100151f60 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31001f0b40 con 0x7f31000c5c90 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f310006a580 0x7f310013d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f310006a580 0x7f310013d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51542/0 (socket says 172.21.15.167:51542) 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30ff7fe640 1 -- 172.21.15.167:0/1459491175 learned_addr learned my addr 172.21.15.167:0/1459491175 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30feffd640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31000c5c90 0x7f3100158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30fffff640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3100151f60 0x7f310015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30ff7fe640 1 -- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31000c5c90 msgr2=0x7f3100158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30ff7fe640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31000c5c90 0x7f3100158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30ff7fe640 1 -- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3100151f60 msgr2=0x7f310015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30ff7fe640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3100151f60 0x7f310015a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30ff7fe640 1 -- 172.21.15.167:0/1459491175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f00094d0 con 0x7f310006a580 2023-11-28T20:49:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30ff7fe640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f310006a580 0x7f310013d700 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f30f00ae040 tx=0x7f30f00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00ba070 con 0x7f310006a580 2023-11-28T20:49:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f00abe70 con 0x7f310006a580 2023-11-28T20:49:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31001f0e20 con 0x7f310006a580 2023-11-28T20:49:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00b66b0 con 0x7f310006a580 2023-11-28T20:49:15.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31001f13e0 con 0x7f310006a580 2023-11-28T20:49:15.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3100140070 0x7f3100140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3100074770 con 0x7f3100140070 2023-11-28T20:49:15.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.324+0000 7f30feffd640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3100140070 0x7f3100140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30f00b2070 con 0x7f310006a580 2023-11-28T20:49:15.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30feffd640 1 -- 172.21.15.167:0/1459491175 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f310006ada0 con 0x7f3100140070 2023-11-28T20:49:15.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30feffd640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3100140070 0x7f3100140450 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31001ee4b0 tx=0x7f30f400f8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30e7fff640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30ec066470 0x7f30ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f30f011de20 con 0x7f310006a580 2023-11-28T20:49:15.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4004230 con 0x7f3100140070 2023-11-28T20:49:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30fffff640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30ec066470 0x7f30ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f30f400c030 con 0x7f3100140070 2023-11-28T20:49:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3100140070 msgr2=0x7f3100140450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30e7fff640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3100140070 0x7f3100140450 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31001ee4b0 tx=0x7f30f400f8f0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3100140070 msgr2=0x7f3100140450 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30e7fff640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3100140070 0x7f3100140450 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31001ee4b0 tx=0x7f30f400f8f0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.328+0000 7f30fffff640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30ec066470 0x7f30ec068930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f30f80054b0 tx=0x7f30f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f3105f2a640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f310013bcc0 0x7f310013c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31001f0fb0 con 0x7f310013bcc0 2023-11-28T20:49:15.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30feffd640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f310013bcc0 0x7f310013c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30feffd640 1 -- 172.21.15.167:0/1459491175 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f310015ba30 con 0x7f310013bcc0 2023-11-28T20:49:15.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30feffd640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f310013bcc0 0x7f310013c0d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f31000c2530 tx=0x7f30f40046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f402a070 con 0x7f310013bcc0 2023-11-28T20:49:15.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7f30f4022040 con 0x7f310013bcc0 2023-11-28T20:49:15.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f310013bcc0 msgr2=0x7f310013c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30e7fff640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f310013bcc0 0x7f310013c0d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f31000c2530 tx=0x7f30f40046d0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30e7fff640 1 -- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f310013bcc0 msgr2=0x7f310013c0d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:15.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30e7fff640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f310013bcc0 0x7f310013c0d0 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f31000c2530 tx=0x7f30f40046d0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.339 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:49:15.339 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:15.339 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:15.339 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:49:15.339 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 96, 2023-11-28T20:49:15.339 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:49:15.339 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:49:15.339 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:49:15.339 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 3, 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:15.340 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:15.341 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:15.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:15.341 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:15.341 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:49:15.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:49:15.341 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:15.341 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:49:15.342 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:49:15.343 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:15.344 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:15.345 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:49:15.346 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.347 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:49:15.348 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:15.349 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:49:15.350 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:15.351 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:15.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.352 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:15.352 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:49:15.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:15.352 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:15.352 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:15.352 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:15.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:15.352 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:15.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:15.353 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:49:15.353 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30ec066470 msgr2=0x7f30ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f3105f2a640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f30ec066470 0x7f30ec068930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f30f80054b0 tx=0x7f30f8009040 comp rx=0 tx=0).stop 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f310006a580 msgr2=0x7f310013d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f3105f2a640 1 --2- 172.21.15.167:0/1459491175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f310006a580 0x7f310013d700 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f30f00ae040 tx=0x7f30f00191d0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30fffff640 1 -- 172.21.15.167:0/1459491175 reap_dead start 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f30fffff640 1 -- 172.21.15.167:0/1459491175 reap_dead start 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 shutdown_connections 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.336+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 >> 172.21.15.167:0/1459491175 conn(0x7f31000cb1e0 msgr2=0x7f3100142290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.340+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 shutdown_connections 2023-11-28T20:49:15.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.340+0000 7f3105f2a640 1 -- 172.21.15.167:0/1459491175 wait complete. 2023-11-28T20:49:15.356 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:49:15.356 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:49:15.356 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:49:15.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe521c79640 1 Processor -- start 2023-11-28T20:49:15.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe521c79640 1 -- start start 2023-11-28T20:49:15.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe521c79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 0x7fe51c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe521c79640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe51c0c4510 0x7fe51c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe521c79640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51c0c4940 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe521c79640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51c0c62f0 con 0x7fe51c0c4510 2023-11-28T20:49:15.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe521c79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c0c6ac0 con 0x7fe51c150b40 2023-11-28T20:49:15.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51bfff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe51c0c4510 0x7fe51c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51b7fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 0x7fe51c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51affd640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe51c0c6ff0 0x7fe51c0c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:39526/0 (socket says 172.21.15.167:39526) 2023-11-28T20:49:15.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51bfff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe51c0c4510 0x7fe51c06a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41418/0 (socket says 172.21.15.167:41418) 2023-11-28T20:49:15.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51affd640 1 -- 172.21.15.167:0/449456 learned_addr learned my addr 172.21.15.167:0/449456 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:49:15.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51bfff640 1 -- 172.21.15.167:0/449456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 msgr2=0x7fe51c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:15.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51bfff640 1 --2- 172.21.15.167:0/449456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 0x7fe51c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51bfff640 1 -- 172.21.15.167:0/449456 >> v1:172.21.15.178:6789/0 conn(0x7fe51c0c6ff0 legacy=0x7fe51c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51bfff640 1 -- 172.21.15.167:0/449456 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c0c6500 con 0x7fe51c0c4510 2023-11-28T20:49:15.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.540+0000 7fe51b7fe640 1 --2- 172.21.15.167:0/449456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 0x7fe51c157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:49:15.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe51bfff640 1 --2- 172.21.15.167:0/449456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c0c4510 0x7fe51c06a580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe514009d90 tx=0x7fe51401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c5932bc56f286d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe51a7fc640 1 -- 172.21.15.167:0/449456 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140a58f0 con 0x7fe51c0c4510 2023-11-28T20:49:15.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe51a7fc640 1 -- 172.21.15.167:0/449456 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5140a5a50 con 0x7fe51c0c4510 2023-11-28T20:49:15.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe51a7fc640 1 -- 172.21.15.167:0/449456 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140a5de0 con 0x7fe51c0c4510 2023-11-28T20:49:15.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe521c79640 1 -- 172.21.15.167:0/449456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c0c4510 msgr2=0x7fe51c06a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe521c79640 1 --2- 172.21.15.167:0/449456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c0c4510 0x7fe51c06a580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe514009d90 tx=0x7fe51401c920 comp rx=0 tx=0).stop 2023-11-28T20:49:15.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe521c79640 1 -- 172.21.15.167:0/449456 shutdown_connections 2023-11-28T20:49:15.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe521c79640 1 --2- 172.21.15.167:0/449456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c0c4510 0x7fe51c06a580 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe521c79640 1 --2- 172.21.15.167:0/449456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 0x7fe51c157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe521c79640 1 -- 172.21.15.167:0/449456 >> 172.21.15.167:0/449456 conn(0x7fe51c0cb1e0 msgr2=0x7fe51c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:15.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe521c79640 1 -- 172.21.15.167:0/449456 shutdown_connections 2023-11-28T20:49:15.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.544+0000 7fe521c79640 1 -- 172.21.15.167:0/449456 wait complete. 2023-11-28T20:49:15.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 Processor -- start 2023-11-28T20:49:15.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 -- start start 2023-11-28T20:49:15.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c0c4510 0x7fe51c13ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51c0c6ff0 0x7fe51c1f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 0x7fe51c1f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c146ef0 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c1475a0 con 0x7fe51c0c4510 2023-11-28T20:49:15.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c146950 con 0x7fe51c150b40 2023-11-28T20:49:15.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51c0c6ff0 0x7fe51c1f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51b7fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c0c4510 0x7fe51c13ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51bfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 0x7fe51c1f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51c0c6ff0 0x7fe51c1f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51552/0 (socket says 172.21.15.167:51552) 2023-11-28T20:49:15.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51affd640 1 -- 172.21.15.167:0/1647588081 learned_addr learned my addr 172.21.15.167:0/1647588081 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:15.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51affd640 1 -- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 msgr2=0x7fe51c1f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51affd640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 0x7fe51c1f3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51affd640 1 -- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c0c4510 msgr2=0x7fe51c13ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51affd640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c0c4510 0x7fe51c13ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51affd640 1 -- 172.21.15.167:0/1647588081 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c009420 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe51affd640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51c0c6ff0 0x7fe51c1f3000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe51000c420 tx=0x7fe51000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe503fff640 1 -- 172.21.15.167:0/1647588081 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510005cf0 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe503fff640 1 -- 172.21.15.167:0/1647588081 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe510005e50 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe514009a70 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe503fff640 1 -- 172.21.15.167:0/1647588081 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5100072f0 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.548+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c147840 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.552+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe51c0682c0 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.552+0000 7fe503fff640 1 -- 172.21.15.167:0/1647588081 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe510007450 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.552+0000 7fe503fff640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe508066470 0x7fe508068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:15.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.552+0000 7fe503fff640 1 -- 172.21.15.167:0/1647588081 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe510083810 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.552+0000 7fe51b7fe640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe508066470 0x7fe508068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:15.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.552+0000 7fe51b7fe640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe508066470 0x7fe508068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009c50 tx=0x7fe50c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:15.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.556+0000 7fe503fff640 1 -- 172.21.15.167:0/1647588081 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5100508b0 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.760+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fe51c1f2d00 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe503fff640 1 -- 172.21.15.167:0/1647588081 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fe510017080 con 0x7fe51c0c6ff0 2023-11-28T20:49:15.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe508066470 msgr2=0x7fe508068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe508066470 0x7fe508068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009c50 tx=0x7fe50c009190 comp rx=0 tx=0).stop 2023-11-28T20:49:15.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51c0c6ff0 msgr2=0x7fe51c1f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:15.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51c0c6ff0 0x7fe51c1f3000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe51000c420 tx=0x7fe51000c8e0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 shutdown_connections 2023-11-28T20:49:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe508066470 0x7fe508068930 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c150b40 0x7fe51c1f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe51c0c6ff0 0x7fe51c1f3000 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 --2- 172.21.15.167:0/1647588081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c0c4510 0x7fe51c13ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 >> 172.21.15.167:0/1647588081 conn(0x7fe51c0cb1e0 msgr2=0x7fe51c147c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 shutdown_connections 2023-11-28T20:49:15.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:15.764+0000 7fe521c79640 1 -- 172.21.15.167:0/1647588081 wait complete. 2023-11-28T20:49:15.785 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:49:18.434 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:18.439 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:25.786 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:49:25.786 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:49:25.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.928+0000 7f25e789e640 1 Processor -- start 2023-11-28T20:49:25.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.928+0000 7f25e789e640 1 -- start start 2023-11-28T20:49:25.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.928+0000 7f25e789e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f25e0151f60 0x7f25e00c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:25.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.928+0000 7f25e789e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f25e006a580 0x7f25e006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:25.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.928+0000 7f25e789e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e00c6120 con 0x7f25e00c5c90 2023-11-28T20:49:25.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.928+0000 7f25e789e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e006aed0 con 0x7f25e0151f60 2023-11-28T20:49:25.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.928+0000 7f25e789e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e00c4da0 con 0x7f25e006a580 2023-11-28T20:49:25.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25e563a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f25e0151f60 0x7f25e00c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:25.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25e563a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f25e0151f60 0x7f25e00c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54818/0 (socket says 172.21.15.167:54818) 2023-11-28T20:49:25.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25e563a640 1 -- 172.21.15.167:0/2866950483 learned_addr learned my addr 172.21.15.167:0/2866950483 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:25.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25e5e3b640 1 --2- 172.21.15.167:0/2866950483 >> v2:172.21.15.178:3300/0 conn(0x7f25e006a580 0x7f25e006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:25.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25e563a640 1 -- 172.21.15.167:0/2866950483 >> v2:172.21.15.178:3300/0 conn(0x7f25e006a580 msgr2=0x7f25e006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:25.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25e563a640 1 --2- 172.21.15.167:0/2866950483 >> v2:172.21.15.178:3300/0 conn(0x7f25e006a580 0x7f25e006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:25.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25e563a640 1 -- 172.21.15.167:0/2866950483 >> v1:172.21.15.178:6789/0 conn(0x7f25e00c5c90 legacy=0x7f25e00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:25.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25e563a640 1 -- 172.21.15.167:0/2866950483 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e015b220 con 0x7f25e0151f60 2023-11-28T20:49:25.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25e563a640 1 --2- 172.21.15.167:0/2866950483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e0151f60 0x7f25e00c75c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25e00c5580 tx=0x7f25dc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a098ed48adab558 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:25.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25d7fff640 1 -- 172.21.15.167:0/2866950483 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0ab600 con 0x7f25e0151f60 2023-11-28T20:49:25.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25d7fff640 1 -- 172.21.15.167:0/2866950483 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc0a7050 con 0x7f25e0151f60 2023-11-28T20:49:25.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.932+0000 7f25d7fff640 1 -- 172.21.15.167:0/2866950483 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0ab980 con 0x7f25e0151f60 2023-11-28T20:49:25.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 -- 172.21.15.167:0/2866950483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e0151f60 msgr2=0x7f25e00c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:25.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 --2- 172.21.15.167:0/2866950483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e0151f60 0x7f25e00c75c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25e00c5580 tx=0x7f25dc01c470 comp rx=0 tx=0).stop 2023-11-28T20:49:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 -- 172.21.15.167:0/2866950483 shutdown_connections 2023-11-28T20:49:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 --2- 172.21.15.167:0/2866950483 >> v2:172.21.15.178:3300/0 conn(0x7f25e006a580 0x7f25e006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 --2- 172.21.15.167:0/2866950483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e0151f60 0x7f25e00c75c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 -- 172.21.15.167:0/2866950483 >> 172.21.15.167:0/2866950483 conn(0x7f25e00cb1e0 msgr2=0x7f25e00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 -- 172.21.15.167:0/2866950483 shutdown_connections 2023-11-28T20:49:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 -- 172.21.15.167:0/2866950483 wait complete. 2023-11-28T20:49:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 Processor -- start 2023-11-28T20:49:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 -- start start 2023-11-28T20:49:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e006a580 0x7f25e015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e00c5c90 0x7f25e0155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25e0151f60 0x7f25e0142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f2ef0 con 0x7f25e006a580 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f3ea0 con 0x7f25e00c5c90 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e789e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f3a10 con 0x7f25e0151f60 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e563a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e006a580 0x7f25e015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e563a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e006a580 0x7f25e015a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54832/0 (socket says 172.21.15.167:54832) 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e563a640 1 -- 172.21.15.167:0/290305164 learned_addr learned my addr 172.21.15.167:0/290305164 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e4e39640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e00c5c90 0x7f25e0155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e5e3b640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25e0151f60 0x7f25e0142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e563a640 1 -- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25e0151f60 msgr2=0x7f25e0142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e563a640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25e0151f60 0x7f25e0142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e563a640 1 -- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e00c5c90 msgr2=0x7f25e0155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e563a640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e00c5c90 0x7f25e0155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.936+0000 7f25e563a640 1 -- 172.21.15.167:0/290305164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc0094d0 con 0x7f25e006a580 2023-11-28T20:49:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25e563a640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e006a580 0x7f25e015a3e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0ae040 tx=0x7f25dc019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25d5ffb640 1 -- 172.21.15.167:0/290305164 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0b37d0 con 0x7f25e006a580 2023-11-28T20:49:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25d5ffb640 1 -- 172.21.15.167:0/290305164 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc0b3930 con 0x7f25e006a580 2023-11-28T20:49:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25d5ffb640 1 -- 172.21.15.167:0/290305164 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0b3ca0 con 0x7f25e006a580 2023-11-28T20:49:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e0157430 con 0x7f25e006a580 2023-11-28T20:49:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e01f30e0 con 0x7f25e006a580 2023-11-28T20:49:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e00682c0 con 0x7f25e006a580 2023-11-28T20:49:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25d5ffb640 1 -- 172.21.15.167:0/290305164 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25dc0b2070 con 0x7f25e006a580 2023-11-28T20:49:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25d5ffb640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25c4066470 0x7f25c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.940+0000 7f25d5ffb640 1 -- 172.21.15.167:0/290305164 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f25dc11e6a0 con 0x7f25e006a580 2023-11-28T20:49:25.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.944+0000 7f25e4e39640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25c4066470 0x7f25c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:25.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.944+0000 7f25e4e39640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25c4066470 0x7f25c4068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f25e00c8580 tx=0x7f25d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:25.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:25.948+0000 7f25d5ffb640 1 -- 172.21.15.167:0/290305164 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25dc0eb600 con 0x7f25e006a580 2023-11-28T20:49:26.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.156+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f25e0075c90 con 0x7f25e006a580 2023-11-28T20:49:26.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.156+0000 7f25d5ffb640 1 -- 172.21.15.167:0/290305164 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f25dc0b0620 con 0x7f25e006a580 2023-11-28T20:49:26.157 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:49:26.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25c4066470 msgr2=0x7f25c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25c4066470 0x7f25c4068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f25e00c8580 tx=0x7f25d0009040 comp rx=0 tx=0).stop 2023-11-28T20:49:26.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e006a580 msgr2=0x7f25e015a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e006a580 0x7f25e015a3e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0ae040 tx=0x7f25dc019210 comp rx=0 tx=0).stop 2023-11-28T20:49:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 shutdown_connections 2023-11-28T20:49:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25c4066470 0x7f25c4068930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25e0151f60 0x7f25e0142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25e00c5c90 0x7f25e0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 --2- 172.21.15.167:0/290305164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25e006a580 0x7f25e015a3e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 >> 172.21.15.167:0/290305164 conn(0x7f25e00cb1e0 msgr2=0x7f25e0143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 shutdown_connections 2023-11-28T20:49:26.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.160+0000 7f25e789e640 1 -- 172.21.15.167:0/290305164 wait complete. 2023-11-28T20:49:26.178 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:49:26.178 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:49:26.178 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:49:26.178 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:49:26.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3cd5c9c640 1 Processor -- start 2023-11-28T20:49:26.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3cd5c9c640 1 -- start start 2023-11-28T20:49:26.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3cd5c9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd00c75c0 0x7f3cd00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3cd5c9c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3cd006a580 0x7f3cd006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3cd5c9c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd015b220 con 0x7f3cd0151f60 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3cd5c9c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00c4da0 con 0x7f3cd006a580 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3cd5c9c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00c2df0 con 0x7f3cd00c75c0 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3ccffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3cd006a580 0x7f3cd006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3ccffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3cd006a580 0x7f3cd006a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54838/0 (socket says 172.21.15.167:54838) 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3ccffff640 1 -- 172.21.15.167:0/217609619 learned_addr learned my addr 172.21.15.167:0/217609619 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3cceffd640 1 --2- 172.21.15.167:0/217609619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd00c75c0 0x7f3cd00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3ccffff640 1 -- 172.21.15.167:0/217609619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd00c75c0 msgr2=0x7f3cd00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3ccffff640 1 --2- 172.21.15.167:0/217609619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd00c75c0 0x7f3cd00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3ccffff640 1 -- 172.21.15.167:0/217609619 >> v1:172.21.15.167:6789/0 conn(0x7f3cd0151f60 legacy=0x7f3cd00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.316+0000 7f3ccffff640 1 -- 172.21.15.167:0/217609619 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00c7a20 con 0x7f3cd006a580 2023-11-28T20:49:26.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3ccffff640 1 --2- 172.21.15.167:0/217609619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd006a580 0x7f3cd006a9b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009e80 tx=0x7f3cc801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7930d6b509f73c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cce7fc640 1 -- 172.21.15.167:0/217609619 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80a5730 con 0x7f3cd006a580 2023-11-28T20:49:26.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cce7fc640 1 -- 172.21.15.167:0/217609619 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80a5890 con 0x7f3cd006a580 2023-11-28T20:49:26.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cce7fc640 1 -- 172.21.15.167:0/217609619 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80a5c20 con 0x7f3cd006a580 2023-11-28T20:49:26.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/217609619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd006a580 msgr2=0x7f3cd006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cd5c9c640 1 --2- 172.21.15.167:0/217609619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd006a580 0x7f3cd006a9b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009e80 tx=0x7f3cc801c960 comp rx=0 tx=0).stop 2023-11-28T20:49:26.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/217609619 shutdown_connections 2023-11-28T20:49:26.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cd5c9c640 1 --2- 172.21.15.167:0/217609619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd006a580 0x7f3cd006a9b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cd5c9c640 1 --2- 172.21.15.167:0/217609619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd00c75c0 0x7f3cd00c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/217609619 >> 172.21.15.167:0/217609619 conn(0x7f3cd00cb1e0 msgr2=0x7f3cd00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:26.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/217609619 shutdown_connections 2023-11-28T20:49:26.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.320+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/217609619 wait complete. 2023-11-28T20:49:26.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cd5c9c640 1 Processor -- start 2023-11-28T20:49:26.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cd5c9c640 1 -- start start 2023-11-28T20:49:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cd5c9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd006a580 0x7f3cd013c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cd5c9c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd00c75c0 0x7f3cd013cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cd5c9c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0151f60 0x7f3cd01427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cd5c9c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0159520 con 0x7f3cd0151f60 2023-11-28T20:49:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cd5c9c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0160fb0 con 0x7f3cd00c75c0 2023-11-28T20:49:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cd5c9c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd01606c0 con 0x7f3cd006a580 2023-11-28T20:49:26.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0151f60 0x7f3cd01427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0151f60 0x7f3cd01427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54850/0 (socket says 172.21.15.167:54850) 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccffff640 1 -- 172.21.15.167:0/1596872044 learned_addr learned my addr 172.21.15.167:0/1596872044 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccf7fe640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd006a580 0x7f3cd013c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cceffd640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd00c75c0 0x7f3cd013cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccffff640 1 -- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd006a580 msgr2=0x7f3cd013c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccffff640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd006a580 0x7f3cd013c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccffff640 1 -- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd00c75c0 msgr2=0x7f3cd013cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccffff640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd00c75c0 0x7f3cd013cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccffff640 1 -- 172.21.15.167:0/1596872044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8009b30 con 0x7f3cd0151f60 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccf7fe640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd006a580 0x7f3cd013c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3cceffd640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd00c75c0 0x7f3cd013cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:49:26.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.324+0000 7f3ccffff640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0151f60 0x7f3cd01427a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80af040 tx=0x7f3cc8019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80b8670 con 0x7f3cd0151f60 2023-11-28T20:49:26.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80b87d0 con 0x7f3cd0151f60 2023-11-28T20:49:26.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80b8b80 con 0x7f3cd0151f60 2023-11-28T20:49:26.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd0141d30 con 0x7f3cd0151f60 2023-11-28T20:49:26.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd0160c40 con 0x7f3cd0151f60 2023-11-28T20:49:26.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cd5c9c640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd015a210 0x7f3cd0142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0074770 con 0x7f3cd015a210 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3ccf7fe640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd015a210 0x7f3cd0142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3ccf7fe640 1 -- 172.21.15.167:0/1596872044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3cd015ba30 con 0x7f3cd015a210 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3ccf7fe640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd015a210 0x7f3cd0142ce0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000e4d0 tx=0x7f3cc000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00052e0 con 0x7f3cd015a210 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3cc80b8ce0 con 0x7f3cd0151f60 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cbc066510 0x7f3cbc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3cc811f700 con 0x7f3cd0151f60 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f3cc0005440 con 0x7f3cd015a210 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd015a210 msgr2=0x7f3cd0142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd015a210 0x7f3cd0142ce0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000e4d0 tx=0x7f3cc000e990 comp rx=0 tx=0).stop 2023-11-28T20:49:26.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd015a210 msgr2=0x7f3cd0142ce0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:26.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cb7fff640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd015a210 0x7f3cd0142ce0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.328+0000 7f3cceffd640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cbc066510 0x7f3cbc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.332+0000 7f3cceffd640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cbc066510 0x7f3cbc0689d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3cd014fda0 tx=0x7f3cc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0161f10 0x7f3cd01f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0160e30 con 0x7f3cd0161f10 2023-11-28T20:49:26.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3ccf7fe640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0161f10 0x7f3cd01f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3ccf7fe640 1 -- 172.21.15.167:0/1596872044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3cd0158750 con 0x7f3cd0161f10 2023-11-28T20:49:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3ccf7fe640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0161f10 0x7f3cd01f5d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000e4d0 tx=0x7f3cc0001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0003e20 con 0x7f3cd0161f10 2023-11-28T20:49:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5125 (secure 0 0 0) 0x7f3cc0013420 con 0x7f3cd0161f10 2023-11-28T20:49:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0161f10 msgr2=0x7f3cd01f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cb7fff640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0161f10 0x7f3cd01f5d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000e4d0 tx=0x7f3cc0001090 comp rx=0 tx=0).stop 2023-11-28T20:49:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cb7fff640 1 -- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0161f10 msgr2=0x7f3cd01f5d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:26.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cb7fff640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0161f10 0x7f3cd01f5d10 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000e4d0 tx=0x7f3cc0001090 comp rx=0 tx=0).stop 2023-11-28T20:49:26.339 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:49:26.339 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:26.339 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:26.339 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:49:26.339 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 96, 2023-11-28T20:49:26.339 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:49:26.339 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:26.340 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:26.341 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.342 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:49:26.343 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:26.344 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:26.345 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.346 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:26.347 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:49:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:49:26.348 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.349 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.350 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:26.351 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.352 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.353 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.354 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.355 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.356 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:49:26.356 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:49:26.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cbc066510 msgr2=0x7f3cbc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cbc066510 0x7f3cbc0689d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3cd014fda0 tx=0x7f3cc4008040 comp rx=0 tx=0).stop 2023-11-28T20:49:26.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0151f60 msgr2=0x7f3cd01427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3ccffff640 1 -- 172.21.15.167:0/1596872044 reap_dead start 2023-11-28T20:49:26.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0151f60 0x7f3cd01427a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80af040 tx=0x7f3cc8019700 comp rx=0 tx=0).stop 2023-11-28T20:49:26.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 shutdown_connections 2023-11-28T20:49:26.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 --2- 172.21.15.167:0/1596872044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cd0151f60 0x7f3cd01427a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 >> 172.21.15.167:0/1596872044 conn(0x7f3cd00cb1e0 msgr2=0x7f3cd00c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:26.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 shutdown_connections 2023-11-28T20:49:26.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.336+0000 7f3cd5c9c640 1 -- 172.21.15.167:0/1596872044 wait complete. 2023-11-28T20:49:26.359 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:49:26.359 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:49:26.359 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:49:26.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.496+0000 7fe047de6640 1 Processor -- start 2023-11-28T20:49:26.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.496+0000 7fe047de6640 1 -- start start 2023-11-28T20:49:26.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe047de6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0400c6ff0 0x7fe040157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe047de6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe0400c4510 0x7fe04006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe047de6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0400c4940 con 0x7fe040150b40 2023-11-28T20:49:26.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe047de6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0400c62f0 con 0x7fe0400c4510 2023-11-28T20:49:26.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe047de6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0400c6ac0 con 0x7fe0400c6ff0 2023-11-28T20:49:26.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe046383640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe0400c4510 0x7fe04006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe046383640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe0400c4510 0x7fe04006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54870/0 (socket says 172.21.15.167:54870) 2023-11-28T20:49:26.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe046383640 1 -- 172.21.15.167:0/260075290 learned_addr learned my addr 172.21.15.167:0/260075290 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:26.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe045381640 1 --2- 172.21.15.167:0/260075290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0400c6ff0 0x7fe040157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe046383640 1 -- 172.21.15.167:0/260075290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0400c6ff0 msgr2=0x7fe040157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:26.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe046383640 1 --2- 172.21.15.167:0/260075290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0400c6ff0 0x7fe040157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe046383640 1 -- 172.21.15.167:0/260075290 >> v1:172.21.15.178:6789/0 conn(0x7fe040150b40 legacy=0x7fe0400c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.500+0000 7fe046383640 1 -- 172.21.15.167:0/260075290 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0400c6500 con 0x7fe0400c4510 2023-11-28T20:49:26.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe046383640 1 --2- 172.21.15.167:0/260075290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c4510 0x7fe04006a580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe038009e50 tx=0x7fe03801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5282841ca3f8f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe044b80640 1 -- 172.21.15.167:0/260075290 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0380a57c0 con 0x7fe0400c4510 2023-11-28T20:49:26.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe044b80640 1 -- 172.21.15.167:0/260075290 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0380a5920 con 0x7fe0400c4510 2023-11-28T20:49:26.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe044b80640 1 -- 172.21.15.167:0/260075290 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0380a5cb0 con 0x7fe0400c4510 2023-11-28T20:49:26.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 -- 172.21.15.167:0/260075290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c4510 msgr2=0x7fe04006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 --2- 172.21.15.167:0/260075290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c4510 0x7fe04006a580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe038009e50 tx=0x7fe03801c9e0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 -- 172.21.15.167:0/260075290 shutdown_connections 2023-11-28T20:49:26.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 --2- 172.21.15.167:0/260075290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c4510 0x7fe04006a580 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 --2- 172.21.15.167:0/260075290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0400c6ff0 0x7fe040157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 -- 172.21.15.167:0/260075290 >> 172.21.15.167:0/260075290 conn(0x7fe0400cb1e0 msgr2=0x7fe0400cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:26.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 -- 172.21.15.167:0/260075290 shutdown_connections 2023-11-28T20:49:26.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 -- 172.21.15.167:0/260075290 wait complete. 2023-11-28T20:49:26.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 Processor -- start 2023-11-28T20:49:26.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.504+0000 7fe047de6640 1 -- start start 2023-11-28T20:49:26.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0400c4510 0x7fe040141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c6ff0 0x7fe0401f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe040150b40 0x7fe040141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe040165ba0 con 0x7fe0400c6ff0 2023-11-28T20:49:26.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0401f6c50 con 0x7fe0400c4510 2023-11-28T20:49:26.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0401f6f30 con 0x7fe040150b40 2023-11-28T20:49:26.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045381640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c6ff0 0x7fe0401f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045381640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c6ff0 0x7fe0401f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54880/0 (socket says 172.21.15.167:54880) 2023-11-28T20:49:26.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045381640 1 -- 172.21.15.167:0/3162271709 learned_addr learned my addr 172.21.15.167:0/3162271709 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:26.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe046383640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe040150b40 0x7fe040141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045b82640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0400c4510 0x7fe040141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045381640 1 -- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe040150b40 msgr2=0x7fe040141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045381640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe040150b40 0x7fe040141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045381640 1 -- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0400c4510 msgr2=0x7fe040141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045381640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0400c4510 0x7fe040141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045381640 1 -- 172.21.15.167:0/3162271709 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe038009b30 con 0x7fe0400c6ff0 2023-11-28T20:49:26.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045381640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c6ff0 0x7fe0401f6380 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe03000e870 tx=0x7fe03000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030009510 con 0x7fe0400c6ff0 2023-11-28T20:49:26.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03000eec0 con 0x7fe0400c6ff0 2023-11-28T20:49:26.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03000cb40 con 0x7fe0400c6ff0 2023-11-28T20:49:26.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe040160b80 con 0x7fe0400c6ff0 2023-11-28T20:49:26.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0400c9a90 con 0x7fe0400c6ff0 2023-11-28T20:49:26.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04014b410 0x7fe0401420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe040074770 con 0x7fe04014b410 2023-11-28T20:49:26.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045b82640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04014b410 0x7fe0401420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045b82640 1 -- 172.21.15.167:0/3162271709 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe040157040 con 0x7fe04014b410 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe03000cca0 con 0x7fe0400c6ff0 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.508+0000 7fe045b82640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04014b410 0x7fe0401420e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00e4d0 tx=0x7fe03c00e990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe0367fc640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe024066470 0x7fe024068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe0300843c0 con 0x7fe0400c6ff0 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0052e0 con 0x7fe04014b410 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fe03c005440 con 0x7fe04014b410 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04014b410 msgr2=0x7fe0401420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe046383640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe024066470 0x7fe024068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe0367fc640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04014b410 0x7fe0401420e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00e4d0 tx=0x7fe03c00e990 comp rx=0 tx=0).stop 2023-11-28T20:49:26.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04014b410 msgr2=0x7fe0401420e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:26.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe0367fc640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04014b410 0x7fe0401420e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.512+0000 7fe046383640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe024066470 0x7fe024068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe0380ae000 tx=0x7fe0380a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.516+0000 7fe047de6640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04015f830 0x7fe0401f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.516+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0400c9c80 con 0x7fe04015f830 2023-11-28T20:49:26.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.516+0000 7fe045b82640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04015f830 0x7fe0401f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.516+0000 7fe045b82640 1 -- 172.21.15.167:0/3162271709 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe0400682c0 con 0x7fe04015f830 2023-11-28T20:49:26.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe045b82640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04015f830 0x7fe0401f2bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00e4d0 tx=0x7fe03c001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c021070 con 0x7fe04015f830 2023-11-28T20:49:26.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4810 (secure 0 0 0) 0x7fe03c006cc0 con 0x7fe04015f830 2023-11-28T20:49:26.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04015f830 msgr2=0x7fe0401f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe0367fc640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04015f830 0x7fe0401f2bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00e4d0 tx=0x7fe03c001130 comp rx=0 tx=0).stop 2023-11-28T20:49:26.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe0367fc640 1 -- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04015f830 msgr2=0x7fe0401f2bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:26.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe0367fc640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe04015f830 0x7fe0401f2bb0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00e4d0 tx=0x7fe03c001130 comp rx=0 tx=0).stop 2023-11-28T20:49:26.520 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:49:26.520 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 96, 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:26.521 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:26.522 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:26.523 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:49:26.524 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:49:26.525 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:49:26.525 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:49:26.525 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:49:26.525 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:49:26.525 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:26.525 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:49:26.525 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:26.525 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:26.525 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:49:26.526 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.527 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.529 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:26.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:26.531 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.532 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.533 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:26.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.535 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.535 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:49:26.535 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe024066470 msgr2=0x7fe024068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe047de6640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe024066470 0x7fe024068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe0380ae000 tx=0x7fe0380a7070 comp rx=0 tx=0).stop 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c6ff0 msgr2=0x7fe0401f6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe047de6640 1 --2- 172.21.15.167:0/3162271709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0400c6ff0 0x7fe0401f6380 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe03000e870 tx=0x7fe03000ec70 comp rx=0 tx=0).stop 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe046383640 1 -- 172.21.15.167:0/3162271709 reap_dead start 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe046383640 1 -- 172.21.15.167:0/3162271709 reap_dead start 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 shutdown_connections 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 >> 172.21.15.167:0/3162271709 conn(0x7fe0400cb1e0 msgr2=0x7fe040070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 shutdown_connections 2023-11-28T20:49:26.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.520+0000 7fe047de6640 1 -- 172.21.15.167:0/3162271709 wait complete. 2023-11-28T20:49:26.538 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:49:26.538 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:49:26.538 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:49:26.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00da93b640 1 Processor -- start 2023-11-28T20:49:26.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00da93b640 1 -- start start 2023-11-28T20:49:26.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00da93b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00d40cf440 0x7f00d40cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00da93b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d4159f70 con 0x7f00d4159b20 2023-11-28T20:49:26.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00da93b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d415a1b0 con 0x7f00d4153d20 2023-11-28T20:49:26.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00da93b640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d40cfd90 con 0x7f00d40cf440 2023-11-28T20:49:26.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00d9138640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f00d4159b20 0x7f00d40c5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36948/0 (socket says 172.21.15.167:36948) 2023-11-28T20:49:26.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00d9138640 1 -- 172.21.15.167:0/3410960609 learned_addr learned my addr 172.21.15.167:0/3410960609 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:49:26.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00da13a640 1 --2- 172.21.15.167:0/3410960609 >> v2:172.21.15.178:3300/0 conn(0x7f00d40cf440 0x7f00d40cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498210780 0 0) 0x7f00c4001120 con 0x7f00d4159b20 2023-11-28T20:49:26.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c0003530 con 0x7f00d4159b20 2023-11-28T20:49:26.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139550357 0 0) 0x7f00d415a1b0 con 0x7f00d4153d20 2023-11-28T20:49:26.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c4001120 con 0x7f00d4153d20 2023-11-28T20:49:26.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.680+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1429457895 0 0) 0x7f00c0003530 con 0x7f00d4159b20 2023-11-28T20:49:26.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 >> v2:172.21.15.178:3300/0 conn(0x7f00d40cf440 msgr2=0x7f00d40cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:26.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 --2- 172.21.15.167:0/3410960609 >> v2:172.21.15.178:3300/0 conn(0x7f00d40cf440 0x7f00d40cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 >> v1:172.21.15.178:6789/0 conn(0x7f00d4153d20 legacy=0x7f00d40ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d415a450 con 0x7f00d4159b20 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f00c4001810 con 0x7f00d4159b20 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 >> v1:172.21.15.167:6789/0 conn(0x7f00d4159b20 legacy=0x7f00d40c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00c0003b60 0x7f00c0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00c0005190 0x7f00c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40cfd90 con 0x7f00c00047d0 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c000bfe0 con 0x7f00c0003b60 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c000c1a0 con 0x7f00c0005190 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d9138640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d9939640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00c0003b60 0x7f00c0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00da13a640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00c0005190 0x7f00c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d9138640 1 -- 172.21.15.167:0/3410960609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00c0005190 msgr2=0x7f00c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:26.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d9138640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00c0005190 0x7f00c000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d9138640 1 -- 172.21.15.167:0/3410960609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00c0003b60 msgr2=0x7f00c0003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:26.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d9138640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00c0003b60 0x7f00c0003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d9138640 1 -- 172.21.15.167:0/3410960609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0003530 con 0x7f00c00047d0 2023-11-28T20:49:26.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00da13a640 1 -- 172.21.15.167:0/3410960609 reap_dead start 2023-11-28T20:49:26.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.684+0000 7f00d9138640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00c0004c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00c4007f80 tx=0x7f00c401f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c930af1011adba0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c40a8e10 con 0x7f00c00047d0 2023-11-28T20:49:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c40058e0 con 0x7f00c00047d0 2023-11-28T20:49:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00d8937640 1 -- 172.21.15.167:0/3410960609 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4005cd0 con 0x7f00c00047d0 2023-11-28T20:49:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 -- 172.21.15.167:0/3410960609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 msgr2=0x7f00c0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00c0004c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00c4007f80 tx=0x7f00c401f1f0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 -- 172.21.15.167:0/3410960609 shutdown_connections 2023-11-28T20:49:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 --2- 172.21.15.167:0/3410960609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00c0004c50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 -- 172.21.15.167:0/3410960609 >> 172.21.15.167:0/3410960609 conn(0x7f00d406b800 msgr2=0x7f00d406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 -- 172.21.15.167:0/3410960609 shutdown_connections 2023-11-28T20:49:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 -- 172.21.15.167:0/3410960609 wait complete. 2023-11-28T20:49:26.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 Processor -- start 2023-11-28T20:49:26.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 -- start start 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00d414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4b20 0x7f00d414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00d414fef0 0x7f00d40c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40c9660 con 0x7f00c00047d0 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d4151020 con 0x7f00d414fef0 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da93b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40c90c0 con 0x7f00d40b4b20 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00d9939640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00d414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00d9939640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00d414ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54894/0 (socket says 172.21.15.167:54894) 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00d9939640 1 -- 172.21.15.167:0/2009165238 learned_addr learned my addr 172.21.15.167:0/2009165238 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.688+0000 7f00da13a640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00d414fef0 0x7f00d40c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9138640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4b20 0x7f00d414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9939640 1 -- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4b20 msgr2=0x7f00d414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9939640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4b20 0x7f00d414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9939640 1 -- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00d414fef0 msgr2=0x7f00d40c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9939640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00d414fef0 0x7f00d40c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9939640 1 -- 172.21.15.167:0/2009165238 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40c9380 con 0x7f00c00047d0 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00da13a640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00d414fef0 0x7f00d40c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9939640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00d414ee10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00d000f6f0 tx=0x7f00d000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0005110 con 0x7f00c00047d0 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d0005270 con 0x7f00c00047d0 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d41509d0 con 0x7f00c00047d0 2023-11-28T20:49:26.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d00067e0 con 0x7f00c00047d0 2023-11-28T20:49:26.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d4150510 con 0x7f00c00047d0 2023-11-28T20:49:26.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00da93b640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4f00 0x7f00d40c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d4072740 con 0x7f00d40b4f00 2023-11-28T20:49:26.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9138640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4f00 0x7f00d40c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9138640 1 -- 172.21.15.167:0/2009165238 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00d40b57c0 con 0x7f00d40b4f00 2023-11-28T20:49:26.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00d9138640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4f00 0x7f00d40c7b60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00c4007f50 tx=0x7f00c0005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00d000d6b0 con 0x7f00c00047d0 2023-11-28T20:49:26.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00ca7fc640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f00b8066470 0x7f00b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.692+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f00d0083b40 con 0x7f00c00047d0 2023-11-28T20:49:26.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.696+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4001810 con 0x7f00d40b4f00 2023-11-28T20:49:26.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.696+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f00c40b8040 con 0x7f00d40b4f00 2023-11-28T20:49:26.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.696+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4f00 msgr2=0x7f00d40c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.696+0000 7f00ca7fc640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4f00 0x7f00d40c7b60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00c4007f50 tx=0x7f00c0005800 comp rx=0 tx=0).stop 2023-11-28T20:49:26.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.696+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4f00 msgr2=0x7f00d40c7b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:26.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.696+0000 7f00ca7fc640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d40b4f00 0x7f00d40c7b60 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00c4007f50 tx=0x7f00c0005800 comp rx=0 tx=0).stop 2023-11-28T20:49:26.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.696+0000 7f00da13a640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f00b8066470 0x7f00b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.696+0000 7f00da13a640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f00b8066470 0x7f00b8068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f00d40cd030 tx=0x7f00cc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.700+0000 7f00da93b640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d41525a0 0x7f00d41529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.700+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40c4f90 con 0x7f00d41525a0 2023-11-28T20:49:26.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.700+0000 7f00d9138640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d41525a0 0x7f00d41529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.700+0000 7f00d9138640 1 -- 172.21.15.167:0/2009165238 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f00d415a9f0 con 0x7f00d41525a0 2023-11-28T20:49:26.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.700+0000 7f00d9138640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d41525a0 0x7f00d41529d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00c401f230 tx=0x7f00c40aa000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4004c00 con 0x7f00d41525a0 2023-11-28T20:49:26.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f00c40070d0 con 0x7f00d41525a0 2023-11-28T20:49:26.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d41525a0 msgr2=0x7f00d41529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00ca7fc640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d41525a0 0x7f00d41529d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00c401f230 tx=0x7f00c40aa000 comp rx=0 tx=0).stop 2023-11-28T20:49:26.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00ca7fc640 1 -- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d41525a0 msgr2=0x7f00d41529d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:26.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00ca7fc640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00d41525a0 0x7f00d41529d0 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00c401f230 tx=0x7f00c40aa000 comp rx=0 tx=0).stop 2023-11-28T20:49:26.704 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:49:26.704 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:26.704 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 96, 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:26.705 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:49:26.706 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:49:26.707 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:49:26.708 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:26.709 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:26.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:49:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:49:26.712 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:26.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.714 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:26.714 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:26.714 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:26.714 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.715 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.716 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:26.717 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:49:26.718 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:49:26.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f00b8066470 msgr2=0x7f00b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da93b640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f00b8066470 0x7f00b8068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f00d40cd030 tx=0x7f00cc00b040 comp rx=0 tx=0).stop 2023-11-28T20:49:26.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 msgr2=0x7f00d414ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da93b640 1 --2- 172.21.15.167:0/2009165238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00c00047d0 0x7f00d414ee10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00d000f6f0 tx=0x7f00d000fbb0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da13a640 1 -- 172.21.15.167:0/2009165238 reap_dead start 2023-11-28T20:49:26.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da13a640 1 -- 172.21.15.167:0/2009165238 reap_dead start 2023-11-28T20:49:26.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 shutdown_connections 2023-11-28T20:49:26.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 >> 172.21.15.167:0/2009165238 conn(0x7f00d406b800 msgr2=0x7f00d40c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:26.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 shutdown_connections 2023-11-28T20:49:26.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.704+0000 7f00da93b640 1 -- 172.21.15.167:0/2009165238 wait complete. 2023-11-28T20:49:26.723 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:49:26.724 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2023-11-28T20:49:26.724 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:49:26.724 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2023-11-28T20:49:26.724 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:49:26.724 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T20:49:26.724 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:49:26.753 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T20:49:26.753 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:49:26.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:49:26.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d87aa640 1 Processor -- start 2023-11-28T20:49:26.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d87aa640 1 -- start start 2023-11-28T20:49:26.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d87aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c6ff0 0x7f87d0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d87aa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87d00c4510 0x7f87d006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d87aa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d00c4940 con 0x7f87d0150b40 2023-11-28T20:49:26.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d87aa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d00c62f0 con 0x7f87d00c4510 2023-11-28T20:49:26.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d87aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00c6ac0 con 0x7f87d00c6ff0 2023-11-28T20:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d6d47640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87d00c4510 0x7f87d006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d6d47640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87d00c4510 0x7f87d006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54910/0 (socket says 172.21.15.167:54910) 2023-11-28T20:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d6d47640 1 -- 172.21.15.167:0/2222035065 learned_addr learned my addr 172.21.15.167:0/2222035065 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d5d45640 1 --2- 172.21.15.167:0/2222035065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c6ff0 0x7f87d0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d6d47640 1 -- 172.21.15.167:0/2222035065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c6ff0 msgr2=0x7f87d0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d6d47640 1 --2- 172.21.15.167:0/2222035065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c6ff0 0x7f87d0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d6d47640 1 -- 172.21.15.167:0/2222035065 >> v1:172.21.15.167:6789/0 conn(0x7f87d0150b40 legacy=0x7f87d00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.896+0000 7f87d6d47640 1 -- 172.21.15.167:0/2222035065 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d00c6500 con 0x7f87d00c4510 2023-11-28T20:49:26.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d6d47640 1 --2- 172.21.15.167:0/2222035065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c4510 0x7f87d006a580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009e50 tx=0x7f87c801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0450e510a4cfc89 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d5544640 1 -- 172.21.15.167:0/2222035065 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c80a57c0 con 0x7f87d00c4510 2023-11-28T20:49:26.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d5544640 1 -- 172.21.15.167:0/2222035065 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c80a5920 con 0x7f87d00c4510 2023-11-28T20:49:26.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d5544640 1 -- 172.21.15.167:0/2222035065 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c80a5cb0 con 0x7f87d00c4510 2023-11-28T20:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d87aa640 1 -- 172.21.15.167:0/2222035065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c4510 msgr2=0x7f87d006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d87aa640 1 --2- 172.21.15.167:0/2222035065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c4510 0x7f87d006a580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009e50 tx=0x7f87c801c9e0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d87aa640 1 -- 172.21.15.167:0/2222035065 shutdown_connections 2023-11-28T20:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d87aa640 1 --2- 172.21.15.167:0/2222035065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c4510 0x7f87d006a580 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d87aa640 1 --2- 172.21.15.167:0/2222035065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c6ff0 0x7f87d0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d87aa640 1 -- 172.21.15.167:0/2222035065 >> 172.21.15.167:0/2222035065 conn(0x7f87d00cb1e0 msgr2=0x7f87d00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d87aa640 1 -- 172.21.15.167:0/2222035065 shutdown_connections 2023-11-28T20:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.900+0000 7f87d87aa640 1 -- 172.21.15.167:0/2222035065 wait complete. 2023-11-28T20:49:26.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 Processor -- start 2023-11-28T20:49:26.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 -- start start 2023-11-28T20:49:26.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c4510 0x7f87d01f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c6ff0 0x7f87d00ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87d0150b40 0x7f87d014d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d0159720 con 0x7f87d00c6ff0 2023-11-28T20:49:26.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00ca990 con 0x7f87d0150b40 2023-11-28T20:49:26.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d00cac70 con 0x7f87d00c4510 2023-11-28T20:49:26.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d6d47640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87d0150b40 msgr2=0x7f87d014d800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:26.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d6d47640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87d0150b40 0x7f87d014d800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:26.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d5d45640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c6ff0 0x7f87d00ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d5d45640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c6ff0 0x7f87d00ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54916/0 (socket says 172.21.15.167:54916) 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d5d45640 1 -- 172.21.15.167:0/3665273461 learned_addr learned my addr 172.21.15.167:0/3665273461 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d6546640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c4510 0x7f87d01f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d5d45640 1 -- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c4510 msgr2=0x7f87d01f65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d5d45640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c4510 0x7f87d01f65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d5d45640 1 -- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87d0150b40 msgr2=0x7f87d014d800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d5d45640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87d0150b40 0x7f87d014d800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d5d45640 1 -- 172.21.15.167:0/3665273461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c8009b30 con 0x7f87d00c6ff0 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d5d45640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c6ff0 0x7f87d00ca2e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f87c000d5f0 tx=0x7f87c000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87c6ffd640 1 -- 172.21.15.167:0/3665273461 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c00125f0 con 0x7f87d00c6ff0 2023-11-28T20:49:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87c6ffd640 1 -- 172.21.15.167:0/3665273461 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c0012750 con 0x7f87d00c6ff0 2023-11-28T20:49:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87c6ffd640 1 -- 172.21.15.167:0/3665273461 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0012ae0 con 0x7f87d00c6ff0 2023-11-28T20:49:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d01f5b00 con 0x7f87d00c6ff0 2023-11-28T20:49:26.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.904+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d01f60c0 con 0x7f87d00c6ff0 2023-11-28T20:49:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.908+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d01f6280 con 0x7f87d00c6ff0 2023-11-28T20:49:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.908+0000 7f87c6ffd640 1 -- 172.21.15.167:0/3665273461 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87c0012c40 con 0x7f87d00c6ff0 2023-11-28T20:49:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.908+0000 7f87c6ffd640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87b4066450 0x7f87b4068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.908+0000 7f87c6ffd640 1 -- 172.21.15.167:0/3665273461 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f87c0084720 con 0x7f87d00c6ff0 2023-11-28T20:49:26.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.908+0000 7f87d6546640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87b4066450 0x7f87b4068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:26.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.908+0000 7f87d6546640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87b4066450 0x7f87b4068910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f87cc007fd0 tx=0x7f87cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:26.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:26.912+0000 7f87c6ffd640 1 -- 172.21.15.167:0/3665273461 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87c0051680 con 0x7f87d00c6ff0 2023-11-28T20:49:27.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.172+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f87d00682c0 con 0x7f87d00c6ff0 2023-11-28T20:49:27.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.172+0000 7f87c6ffd640 1 -- 172.21.15.167:0/3665273461 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f87c0054ca0 con 0x7f87d00c6ff0 2023-11-28T20:49:27.175 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:49:27.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87b4066450 msgr2=0x7f87b4068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87b4066450 0x7f87b4068910 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f87cc007fd0 tx=0x7f87cc009040 comp rx=0 tx=0).stop 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c6ff0 msgr2=0x7f87d00ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c6ff0 0x7f87d00ca2e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f87c000d5f0 tx=0x7f87c000dab0 comp rx=0 tx=0).stop 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 shutdown_connections 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87b4066450 0x7f87b4068910 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87d0150b40 0x7f87d014d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d00c6ff0 0x7f87d00ca2e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 --2- 172.21.15.167:0/3665273461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87d00c4510 0x7f87d01f65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 >> 172.21.15.167:0/3665273461 conn(0x7f87d00cb1e0 msgr2=0x7f87d00c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 shutdown_connections 2023-11-28T20:49:27.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:27.176+0000 7f87d87aa640 1 -- 172.21.15.167:0/3665273461 wait complete. 2023-11-28T20:49:30.196 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:49:30.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f119d89c640 1 Processor -- start 2023-11-28T20:49:30.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f119d89c640 1 -- start start 2023-11-28T20:49:30.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f119d89c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1198153f90 0x7f119806f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:30.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f119d89c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11980c8750 0x7f119806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:30.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f119d89c640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119815ad20 con 0x7f11980c6e90 2023-11-28T20:49:30.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f119d89c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1198159e70 con 0x7f1198153f90 2023-11-28T20:49:30.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f119d89c640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119815a110 con 0x7f11980c8750 2023-11-28T20:49:30.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f11977fe640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f11980c6e90 legacy=0x7f11980c72e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:49:30.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f118e7fc640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f11980c8750 msgr2=0x7f119806f550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:30.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f1196ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1198153f90 0x7f119806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:30.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f118e7fc640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11980c8750 0x7f119806f550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:30.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f1196ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1198153f90 0x7f119806f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54932/0 (socket says 172.21.15.167:54932) 2023-11-28T20:49:30.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.344+0000 7f1196ffd640 1 -- 172.21.15.167:0/2528979483 learned_addr learned my addr 172.21.15.167:0/2528979483 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:30.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f1196ffd640 1 -- 172.21.15.167:0/2528979483 >> v2:172.21.15.178:3300/0 conn(0x7f11980c8750 msgr2=0x7f119806f550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:49:30.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f1196ffd640 1 --2- 172.21.15.167:0/2528979483 >> v2:172.21.15.178:3300/0 conn(0x7f11980c8750 0x7f119806f550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f1196ffd640 1 -- 172.21.15.167:0/2528979483 >> v1:172.21.15.178:6789/0 conn(0x7f11980c6e90 legacy=0x7f11980c72e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:49:30.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f1196ffd640 1 -- 172.21.15.167:0/2528979483 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119815a3f0 con 0x7f1198153f90 2023-11-28T20:49:30.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f1196ffd640 1 --2- 172.21.15.167:0/2528979483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 0x7f119806f010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f119815e470 tx=0x7f118801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f216dce5ada9154c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:30.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f11967fc640 1 -- 172.21.15.167:0/2528979483 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880a89d0 con 0x7f1198153f90 2023-11-28T20:49:30.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f11967fc640 1 -- 172.21.15.167:0/2528979483 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11880a8b30 con 0x7f1198153f90 2023-11-28T20:49:30.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f11967fc640 1 -- 172.21.15.167:0/2528979483 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880b0440 con 0x7f1198153f90 2023-11-28T20:49:30.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f119d89c640 1 -- 172.21.15.167:0/2528979483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 msgr2=0x7f119806f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:30.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f119d89c640 1 --2- 172.21.15.167:0/2528979483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 0x7f119806f010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f119815e470 tx=0x7f118801ecd0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f119d89c640 1 -- 172.21.15.167:0/2528979483 shutdown_connections 2023-11-28T20:49:30.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f119d89c640 1 --2- 172.21.15.167:0/2528979483 >> v2:172.21.15.178:3300/0 conn(0x7f11980c8750 0x7f119806f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f119d89c640 1 --2- 172.21.15.167:0/2528979483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 0x7f119806f010 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f119d89c640 1 -- 172.21.15.167:0/2528979483 >> 172.21.15.167:0/2528979483 conn(0x7f11980cc300 msgr2=0x7f11980cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:30.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f119d89c640 1 -- 172.21.15.167:0/2528979483 shutdown_connections 2023-11-28T20:49:30.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.348+0000 7f119d89c640 1 -- 172.21.15.167:0/2528979483 wait complete. 2023-11-28T20:49:30.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f119d89c640 1 Processor -- start 2023-11-28T20:49:30.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f119d89c640 1 -- start start 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f119d89c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980c6e90 0x7f11981ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f119d89c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980c8750 0x7f119814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f119d89c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 0x7f11981496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f119d89c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119814e480 con 0x7f1198153f90 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f119d89c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11981e5f40 con 0x7f11980c8750 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f119d89c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119814e6d0 con 0x7f11980c6e90 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f118e7fc640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980c8750 msgr2=0x7f119814fc80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f118e7fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980c8750 0x7f119814fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f11977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 0x7f11981496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:30.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f11977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 0x7f11981496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54946/0 (socket says 172.21.15.167:54946) 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f11977fe640 1 -- 172.21.15.167:0/1118388737 learned_addr learned my addr 172.21.15.167:0/1118388737 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f1196ffd640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980c6e90 0x7f11981ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f11977fe640 1 -- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980c6e90 msgr2=0x7f11981ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f11977fe640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980c6e90 0x7f11981ef850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f11977fe640 1 -- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980c8750 msgr2=0x7f119814fc80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f11977fe640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980c8750 0x7f119814fc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f11977fe640 1 -- 172.21.15.167:0/1118388737 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11880094d0 con 0x7f1198153f90 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f11977fe640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 0x7f11981496c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f119000b760 tx=0x7f119000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f1194ff9640 1 -- 172.21.15.167:0/1118388737 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119000c960 con 0x7f1198153f90 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f1194ff9640 1 -- 172.21.15.167:0/1118388737 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119000cac0 con 0x7f1198153f90 2023-11-28T20:49:30.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f1194ff9640 1 -- 172.21.15.167:0/1118388737 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190015470 con 0x7f1198153f90 2023-11-28T20:49:30.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.352+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119814e9b0 con 0x7f1198153f90 2023-11-28T20:49:30.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.356+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119814ef70 con 0x7f1198153f90 2023-11-28T20:49:30.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.356+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11980682c0 con 0x7f1198153f90 2023-11-28T20:49:30.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.356+0000 7f1194ff9640 1 -- 172.21.15.167:0/1118388737 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1190012070 con 0x7f1198153f90 2023-11-28T20:49:30.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.356+0000 7f1194ff9640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1178066420 0x7f11780688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:30.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.356+0000 7f1194ff9640 1 -- 172.21.15.167:0/1118388737 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1190083fb0 con 0x7f1198153f90 2023-11-28T20:49:30.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.356+0000 7f1196ffd640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1178066420 0x7f11780688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:30.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.360+0000 7f1196ffd640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1178066420 0x7f11780688e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f11880b2000 tx=0x7f1188008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:30.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.360+0000 7f1194ff9640 1 -- 172.21.15.167:0/1118388737 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11900b5280 con 0x7f1198153f90 2023-11-28T20:49:30.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.564+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1198067c40 con 0x7f1198153f90 2023-11-28T20:49:30.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.564+0000 7f1194ff9640 1 -- 172.21.15.167:0/1118388737 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f119001a020 con 0x7f1198153f90 2023-11-28T20:49:30.565 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:49:30.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1178066420 msgr2=0x7f11780688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:30.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1178066420 0x7f11780688e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f11880b2000 tx=0x7f1188008040 comp rx=0 tx=0).stop 2023-11-28T20:49:30.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 msgr2=0x7f11981496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:30.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 0x7f11981496c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f119000b760 tx=0x7f119000bc20 comp rx=0 tx=0).stop 2023-11-28T20:49:30.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 shutdown_connections 2023-11-28T20:49:30.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1178066420 0x7f11780688e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198153f90 0x7f11981496c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980c8750 0x7f119814fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 --2- 172.21.15.167:0/1118388737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980c6e90 0x7f11981ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:30.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 >> 172.21.15.167:0/1118388737 conn(0x7f11980cc300 msgr2=0x7f11981e6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:30.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 shutdown_connections 2023-11-28T20:49:30.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:30.568+0000 7f119d89c640 1 -- 172.21.15.167:0/1118388737 wait complete. 2023-11-28T20:49:33.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:49:33.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ead8c9640 1 Processor -- start 2023-11-28T20:49:33.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ead8c9640 1 -- start start 2023-11-28T20:49:33.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ead8c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8153f40 0x7f5ea8159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:33.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ead8c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ea80caa60 0x7f5ea80c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:33.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ead8c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea80cb5c0 con 0x7f5ea80ca660 2023-11-28T20:49:33.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ead8c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea80b2c60 con 0x7f5ea80caa60 2023-11-28T20:49:33.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ead8c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80c4f00 con 0x7f5ea8153f40 2023-11-28T20:49:33.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ea77fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ea80caa60 0x7f5ea80c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ea77fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ea80caa60 0x7f5ea80c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46252/0 (socket says 172.21.15.167:46252) 2023-11-28T20:49:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ea77fe640 1 -- 172.21.15.167:0/1478226121 learned_addr learned my addr 172.21.15.167:0/1478226121 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ea6ffd640 1 --2- 172.21.15.167:0/1478226121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8153f40 0x7f5ea8159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ea77fe640 1 -- 172.21.15.167:0/1478226121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8153f40 msgr2=0x7f5ea8159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:33.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ea77fe640 1 --2- 172.21.15.167:0/1478226121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8153f40 0x7f5ea8159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:33.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ea77fe640 1 -- 172.21.15.167:0/1478226121 >> v1:172.21.15.167:6789/0 conn(0x7f5ea80ca660 legacy=0x7f5ea80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:33.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.732+0000 7f5ea77fe640 1 -- 172.21.15.167:0/1478226121 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80c54c0 con 0x7f5ea80caa60 2023-11-28T20:49:33.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ea77fe640 1 --2- 172.21.15.167:0/1478226121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80caa60 0x7f5ea80c5950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009e50 tx=0x7f5ea001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36fe1e73ef3dabb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:33.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ea67fc640 1 -- 172.21.15.167:0/1478226121 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00a56e0 con 0x7f5ea80caa60 2023-11-28T20:49:33.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ea67fc640 1 -- 172.21.15.167:0/1478226121 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea00a5840 con 0x7f5ea80caa60 2023-11-28T20:49:33.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ea67fc640 1 -- 172.21.15.167:0/1478226121 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00a5bd0 con 0x7f5ea80caa60 2023-11-28T20:49:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ead8c9640 1 -- 172.21.15.167:0/1478226121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80caa60 msgr2=0x7f5ea80c5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ead8c9640 1 --2- 172.21.15.167:0/1478226121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80caa60 0x7f5ea80c5950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009e50 tx=0x7f5ea001ca10 comp rx=0 tx=0).stop 2023-11-28T20:49:33.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ead8c9640 1 -- 172.21.15.167:0/1478226121 shutdown_connections 2023-11-28T20:49:33.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ead8c9640 1 --2- 172.21.15.167:0/1478226121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea80caa60 0x7f5ea80c5950 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:33.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ead8c9640 1 --2- 172.21.15.167:0/1478226121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8153f40 0x7f5ea8159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:33.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ead8c9640 1 -- 172.21.15.167:0/1478226121 >> 172.21.15.167:0/1478226121 conn(0x7f5ea806b800 msgr2=0x7f5ea806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:33.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ead8c9640 1 -- 172.21.15.167:0/1478226121 shutdown_connections 2023-11-28T20:49:33.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.736+0000 7f5ead8c9640 1 -- 172.21.15.167:0/1478226121 wait complete. 2023-11-28T20:49:33.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ead8c9640 1 Processor -- start 2023-11-28T20:49:33.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ead8c9640 1 -- start start 2023-11-28T20:49:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ead8c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea80ca660 0x7f5ea815d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ead8c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80caa60 0x7f5ea80cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ead8c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8153f40 0x7f5ea80cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ead8c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea815c360 con 0x7f5ea8153f40 2023-11-28T20:49:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ead8c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea815bfe0 con 0x7f5ea80ca660 2023-11-28T20:49:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ead8c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80ce560 con 0x7f5ea80caa60 2023-11-28T20:49:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea6ffd640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea80ca660 msgr2=0x7f5ea815d730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea6ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea80ca660 0x7f5ea815d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8153f40 0x7f5ea80cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8153f40 0x7f5ea80cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46264/0 (socket says 172.21.15.167:46264) 2023-11-28T20:49:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea77fe640 1 -- 172.21.15.167:0/554922310 learned_addr learned my addr 172.21.15.167:0/554922310 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5e9ffff640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80caa60 0x7f5ea80cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:33.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea77fe640 1 -- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80caa60 msgr2=0x7f5ea80cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:33.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea77fe640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80caa60 0x7f5ea80cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea77fe640 1 -- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea80ca660 msgr2=0x7f5ea815d730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:49:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea77fe640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea80ca660 0x7f5ea815d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.740+0000 7f5ea77fe640 1 -- 172.21.15.167:0/554922310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea0009b30 con 0x7f5ea8153f40 2023-11-28T20:49:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.744+0000 7f5ea77fe640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8153f40 0x7f5ea80cf4b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5ea001a640 tx=0x7f5ea00197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.744+0000 7f5ea4ff9640 1 -- 172.21.15.167:0/554922310 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00b8670 con 0x7f5ea8153f40 2023-11-28T20:49:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.744+0000 7f5ea4ff9640 1 -- 172.21.15.167:0/554922310 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea00b87d0 con 0x7f5ea8153f40 2023-11-28T20:49:33.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.744+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea80cd3b0 con 0x7f5ea8153f40 2023-11-28T20:49:33.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.744+0000 7f5ea4ff9640 1 -- 172.21.15.167:0/554922310 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00b8b40 con 0x7f5ea8153f40 2023-11-28T20:49:33.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.744+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea815ba20 con 0x7f5ea8153f40 2023-11-28T20:49:33.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.744+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea8141de0 con 0x7f5ea8153f40 2023-11-28T20:49:33.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.744+0000 7f5ea4ff9640 1 -- 172.21.15.167:0/554922310 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ea00b8ca0 con 0x7f5ea8153f40 2023-11-28T20:49:33.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.748+0000 7f5ea4ff9640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e88066450 0x7f5e88068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:33.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.748+0000 7f5ea4ff9640 1 -- 172.21.15.167:0/554922310 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5ea011f270 con 0x7f5ea8153f40 2023-11-28T20:49:33.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.748+0000 7f5ea6ffd640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e88066450 0x7f5e88068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:33.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.752+0000 7f5ea6ffd640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e88066450 0x7f5e88068910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009420 tx=0x7f5e98009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:33.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:33.756+0000 7f5ea4ff9640 1 -- 172.21.15.167:0/554922310 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ea00ec3b0 con 0x7f5ea8153f40 2023-11-28T20:49:34.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.052+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5ea804e850 con 0x7f5ea8153f40 2023-11-28T20:49:34.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.052+0000 7f5ea4ff9640 1 -- 172.21.15.167:0/554922310 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f5ea0009510 con 0x7f5ea8153f40 2023-11-28T20:49:34.053 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":96,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:49:34.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.052+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e88066450 msgr2=0x7f5e88068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:34.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.052+0000 7f5ead8c9640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e88066450 0x7f5e88068910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009420 tx=0x7f5e98009190 comp rx=0 tx=0).stop 2023-11-28T20:49:34.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.052+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8153f40 msgr2=0x7f5ea80cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:34.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.052+0000 7f5ead8c9640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8153f40 0x7f5ea80cf4b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5ea001a640 tx=0x7f5ea00197b0 comp rx=0 tx=0).stop 2023-11-28T20:49:34.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.056+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 shutdown_connections 2023-11-28T20:49:34.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.056+0000 7f5ead8c9640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5e88066450 0x7f5e88068910 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:34.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.056+0000 7f5ead8c9640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea8153f40 0x7f5ea80cf4b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:34.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.056+0000 7f5ead8c9640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea80caa60 0x7f5ea80cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:34.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.056+0000 7f5ead8c9640 1 --2- 172.21.15.167:0/554922310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea80ca660 0x7f5ea815d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:34.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.056+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 >> 172.21.15.167:0/554922310 conn(0x7f5ea806b800 msgr2=0x7f5ea8158060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:34.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.056+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 shutdown_connections 2023-11-28T20:49:34.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:34.056+0000 7f5ead8c9640 1 -- 172.21.15.167:0/554922310 wait complete. 2023-11-28T20:49:37.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:49:37.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a3417640 1 Processor -- start 2023-11-28T20:49:37.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a3417640 1 -- start start 2023-11-28T20:49:37.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a3417640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 0x7f939c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:37.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a3417640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:37.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a3417640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939c0c6120 con 0x7f939c0c5c90 2023-11-28T20:49:37.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a3417640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c06aed0 con 0x7f939c06a580 2023-11-28T20:49:37.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a3417640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c0c4da0 con 0x7f939c151f60 2023-11-28T20:49:37.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a19b4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:37.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a11b3640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 msgr2=0x7f939c0c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:37.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a11b3640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 0x7f939c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:37.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a19b4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46280/0 (socket says 172.21.15.167:46280) 2023-11-28T20:49:37.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 learned_addr learned my addr 172.21.15.167:0/1353097409 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:37.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 msgr2=0x7f939c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:49:37.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 msgr2=0x7f939c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:37.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:37.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.224+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:37.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.428+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 msgr2=0x7f939c0c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:37.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.428+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:37.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.428+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 0x7f939c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:49:37.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.428+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 msgr2=0x7f939c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:49:37.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.428+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 msgr2=0x7f939c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:37.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.428+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:37.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.428+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:49:37.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.832+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 msgr2=0x7f939c0c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:37.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.832+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 0x7f939c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:49:37.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.832+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:37.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.832+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 msgr2=0x7f939c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:49:37.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.832+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 msgr2=0x7f939c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:37.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.832+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:37.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:37.832+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:49:38.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:38.636+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 msgr2=0x7f939c0c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:38.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:38.636+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 0x7f939c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:49:38.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:38.636+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:38.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:38.636+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 msgr2=0x7f939c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:49:38.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:38.636+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 msgr2=0x7f939c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:38.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:38.636+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:38.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:38.636+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:49:40.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f9392ffd640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 msgr2=0x7f939c0c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:49:40.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f9392ffd640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.178:3300/0 conn(0x7f939c151f60 0x7f939c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:40.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f9392ffd640 1 -- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 msgr2=0x7f939c06a990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f9392ffd640 1 --2- 172.21.15.167:0/1353097409 >> v2:172.21.15.167:3300/0 conn(0x7f939c06a580 0x7f939c06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f9392ffd640 1 -- 172.21.15.167:0/1353097409 >> v1:172.21.15.167:6789/0 conn(0x7f939c0c5c90 legacy=0x7f939c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f9392ffd640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f9392ffd640 1 -- 172.21.15.167:0/1353097409 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939c15b220 con 0x7f9380006180 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f9392ffd640 1 -- 172.21.15.167:0/1353097409 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c06aed0 con 0x7f93800036c0 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f93a09b2640 1 -- 172.21.15.167:0/1353097409 >> v1:172.21.15.178:6789/0 conn(0x7f9380006180 legacy=0x7f9380008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 msgr2=0x7f9380005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 msgr2=0x7f9380005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.224+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.428+0000 7f93a09b2640 1 -- 172.21.15.167:0/1353097409 >> v1:172.21.15.178:6789/0 conn(0x7f9380006180 legacy=0x7f9380008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:49:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.428+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.428+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 msgr2=0x7f9380005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:49:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.428+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 msgr2=0x7f9380005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.428+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:40.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.428+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:49:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.832+0000 7f93a09b2640 1 -- 172.21.15.167:0/1353097409 >> v1:172.21.15.178:6789/0 conn(0x7f9380006180 legacy=0x7f9380008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:49:40.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.832+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.832+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 msgr2=0x7f9380005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:49:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.832+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 msgr2=0x7f9380005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:49:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.832+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:49:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:40.832+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:49:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.636+0000 7f93a09b2640 1 -- 172.21.15.167:0/1353097409 >> v1:172.21.15.178:6789/0 conn(0x7f9380006180 legacy=0x7f9380008620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:49:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.636+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.636+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 >> v1:172.21.15.178:6789/0 conn(0x7f9380006180 legacy=0x7f9380008620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:49:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.636+0000 7f93a11b3640 1 -- 172.21.15.167:0/1353097409 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938000af60 con 0x7f93800036c0 2023-11-28T20:49:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9398009d60 tx=0x7f939801d1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd1a3a739582174a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f9393fff640 1 -- 172.21.15.167:0/1353097409 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398006ea0 con 0x7f93800036c0 2023-11-28T20:49:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f9393fff640 1 -- 172.21.15.167:0/1353097409 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93980a8030 con 0x7f93800036c0 2023-11-28T20:49:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f9393fff640 1 -- 172.21.15.167:0/1353097409 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980ae650 con 0x7f93800036c0 2023-11-28T20:49:41.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a3417640 1 -- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 msgr2=0x7f9380005af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:41.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a3417640 1 --2- 172.21.15.167:0/1353097409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93800036c0 0x7f9380005af0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9398009d60 tx=0x7f939801d1c0 comp rx=0 tx=0).stop 2023-11-28T20:49:41.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a19b4640 1 -- 172.21.15.167:0/1353097409 reap_dead start 2023-11-28T20:49:41.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a3417640 1 -- 172.21.15.167:0/1353097409 shutdown_connections 2023-11-28T20:49:41.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a3417640 1 -- 172.21.15.167:0/1353097409 >> 172.21.15.167:0/1353097409 conn(0x7f939c0cb1e0 msgr2=0x7f939c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:41.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a3417640 1 -- 172.21.15.167:0/1353097409 shutdown_connections 2023-11-28T20:49:41.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a3417640 1 -- 172.21.15.167:0/1353097409 wait complete. 2023-11-28T20:49:41.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a3417640 1 Processor -- start 2023-11-28T20:49:41.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.640+0000 7f93a3417640 1 -- start start 2023-11-28T20:49:41.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a3417640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f939c141b10 0x7f939c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:41.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a3417640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f939c0cae00 0x7f939c0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a3417640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0c3da0 0x7f939c0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a3417640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c071f80 con 0x7f939c0c3da0 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a3417640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c160f70 con 0x7f939c0cae00 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a3417640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c1517c0 con 0x7f939c141b10 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a09b2640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f939c0cae00 msgr2=0x7f939c0c8fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a09b2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f939c0cae00 0x7f939c0c8fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a19b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0c3da0 0x7f939c0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a19b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0c3da0 0x7f939c0c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46318/0 (socket says 172.21.15.167:46318) 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a19b4640 1 -- 172.21.15.167:0/1024262863 learned_addr learned my addr 172.21.15.167:0/1024262863 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f939c141b10 0x7f939c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a19b4640 1 -- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f939c141b10 msgr2=0x7f939c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f939c141b10 0x7f939c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a19b4640 1 -- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f939c0cae00 msgr2=0x7f939c0c8fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:49:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f939c0cae00 0x7f939c0c8fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a19b4640 1 -- 172.21.15.167:0/1024262863 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398009a40 con 0x7f939c0c3da0 2023-11-28T20:49:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a19b4640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0c3da0 0x7f939c0c9520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9380009e60 tx=0x7f9394007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f9391ffb640 1 -- 172.21.15.167:0/1024262863 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9394013b90 con 0x7f939c0c3da0 2023-11-28T20:49:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f9391ffb640 1 -- 172.21.15.167:0/1024262863 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939400f040 con 0x7f939c0c3da0 2023-11-28T20:49:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f9391ffb640 1 -- 172.21.15.167:0/1024262863 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9394017430 con 0x7f939c0c3da0 2023-11-28T20:49:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939c150ef0 con 0x7f939c0c3da0 2023-11-28T20:49:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939c151190 con 0x7f939c0c3da0 2023-11-28T20:49:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939c0682c0 con 0x7f939c0c3da0 2023-11-28T20:49:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.644+0000 7f9391ffb640 1 -- 172.21.15.167:0/1024262863 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9394017590 con 0x7f939c0c3da0 2023-11-28T20:49:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.648+0000 7f9391ffb640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93800671b0 0x7f9380069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.648+0000 7f9391ffb640 1 -- 172.21.15.167:0/1024262863 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9394084830 con 0x7f939c0c3da0 2023-11-28T20:49:41.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.648+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93800671b0 0x7f9380069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.648+0000 7f93a11b3640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93800671b0 0x7f9380069670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f93980b0000 tx=0x7f93980a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:41.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.652+0000 7f9391ffb640 1 -- 172.21.15.167:0/1024262863 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9394051820 con 0x7f939c0c3da0 2023-11-28T20:49:41.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f939c0720f0 con 0x7f939c0c3da0 2023-11-28T20:49:41.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f9391ffb640 1 -- 172.21.15.167:0/1024262863 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f939c0720f0 con 0x7f939c0c3da0 2023-11-28T20:49:41.860 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":100,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:49:41.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93800671b0 msgr2=0x7f9380069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:41.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93800671b0 0x7f9380069670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f93980b0000 tx=0x7f93980a7000 comp rx=0 tx=0).stop 2023-11-28T20:49:41.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0c3da0 msgr2=0x7f939c0c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:41.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0c3da0 0x7f939c0c9520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9380009e60 tx=0x7f9394007df0 comp rx=0 tx=0).stop 2023-11-28T20:49:41.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 shutdown_connections 2023-11-28T20:49:41.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f93800671b0 0x7f9380069670 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:41.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0c3da0 0x7f939c0c9520 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:41.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f939c0cae00 0x7f939c0c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:41.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 --2- 172.21.15.167:0/1024262863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f939c141b10 0x7f939c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:41.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 >> 172.21.15.167:0/1024262863 conn(0x7f939c0cb1e0 msgr2=0x7f939c142ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:41.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 shutdown_connections 2023-11-28T20:49:41.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:41.860+0000 7f93a3417640 1 -- 172.21.15.167:0/1024262863 wait complete. 2023-11-28T20:49:41.881 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:49:41.881 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:49:41.881 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:49:42.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.040+0000 7f8398017640 1 Processor -- start 2023-11-28T20:49:42.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.040+0000 7f8398017640 1 -- start start 2023-11-28T20:49:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f8398017640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83900c6ff0 0x7f8390157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f8398017640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f83900c4510 0x7f839006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f8398017640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83900c48f0 con 0x7f8390150b40 2023-11-28T20:49:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f8398017640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900c62f0 con 0x7f83900c4510 2023-11-28T20:49:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f8398017640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900c6ac0 con 0x7f83900c6ff0 2023-11-28T20:49:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f83955b2640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f83900c6ff0 msgr2=0x7f8390157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f8395db3640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f8390150b40 legacy=0x7f83900c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:49:42.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f83955b2640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83900c6ff0 0x7f8390157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:42.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f83965b4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f83900c4510 0x7f839006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f83965b4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f83900c4510 0x7f839006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46328/0 (socket says 172.21.15.167:46328) 2023-11-28T20:49:42.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f83965b4640 1 -- 172.21.15.167:0/2916047888 learned_addr learned my addr 172.21.15.167:0/2916047888 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:42.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f83965b4640 1 -- 172.21.15.167:0/2916047888 >> v2:172.21.15.178:3300/0 conn(0x7f83900c6ff0 msgr2=0x7f8390157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:49:42.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f83965b4640 1 --2- 172.21.15.167:0/2916047888 >> v2:172.21.15.178:3300/0 conn(0x7f83900c6ff0 0x7f8390157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f83965b4640 1 -- 172.21.15.167:0/2916047888 >> v1:172.21.15.178:6789/0 conn(0x7f8390150b40 legacy=0x7f83900c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:49:42.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.044+0000 7f83965b4640 1 -- 172.21.15.167:0/2916047888 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83900c6500 con 0x7f83900c4510 2023-11-28T20:49:42.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f83965b4640 1 --2- 172.21.15.167:0/2916047888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 0x7f839006a580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f83900cc270 tx=0x7f838801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e79e79c50c2bbb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8394db1640 1 -- 172.21.15.167:0/2916047888 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880a5750 con 0x7f83900c4510 2023-11-28T20:49:42.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8394db1640 1 -- 172.21.15.167:0/2916047888 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83880a58b0 con 0x7f83900c4510 2023-11-28T20:49:42.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8394db1640 1 -- 172.21.15.167:0/2916047888 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880a5c40 con 0x7f83900c4510 2023-11-28T20:49:42.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 -- 172.21.15.167:0/2916047888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 msgr2=0x7f839006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 --2- 172.21.15.167:0/2916047888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 0x7f839006a580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f83900cc270 tx=0x7f838801c980 comp rx=0 tx=0).stop 2023-11-28T20:49:42.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 -- 172.21.15.167:0/2916047888 shutdown_connections 2023-11-28T20:49:42.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 --2- 172.21.15.167:0/2916047888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 0x7f839006a580 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 --2- 172.21.15.167:0/2916047888 >> v2:172.21.15.178:3300/0 conn(0x7f83900c6ff0 0x7f8390157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 -- 172.21.15.167:0/2916047888 >> 172.21.15.167:0/2916047888 conn(0x7f83900cb1e0 msgr2=0x7f83900cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 -- 172.21.15.167:0/2916047888 shutdown_connections 2023-11-28T20:49:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 -- 172.21.15.167:0/2916047888 wait complete. 2023-11-28T20:49:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 Processor -- start 2023-11-28T20:49:42.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 -- start start 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 0x7f8390147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83900c6ff0 0x7f839006e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8390150b40 0x7f83901f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8390160520 con 0x7f83900c4510 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8390160a60 con 0x7f8390150b40 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.048+0000 7f8398017640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8390160d40 con 0x7f83900c6ff0 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83965b4640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8390150b40 msgr2=0x7f83901f2560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83965b4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8390150b40 0x7f83901f2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8395db3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 0x7f8390147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8395db3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 0x7f8390147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46330/0 (socket says 172.21.15.167:46330) 2023-11-28T20:49:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8395db3640 1 -- 172.21.15.167:0/3416455426 learned_addr learned my addr 172.21.15.167:0/3416455426 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83955b2640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83900c6ff0 0x7f839006e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8395db3640 1 -- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83900c6ff0 msgr2=0x7f839006e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8395db3640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83900c6ff0 0x7f839006e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8395db3640 1 -- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8390150b40 msgr2=0x7f83901f2560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:49:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8395db3640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8390150b40 0x7f83901f2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8395db3640 1 -- 172.21.15.167:0/3416455426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388009b30 con 0x7f83900c4510 2023-11-28T20:49:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8395db3640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 0x7f8390147fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f838c00b550 tx=0x7f838c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c003d00 con 0x7f83900c4510 2023-11-28T20:49:42.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c003e80 con 0x7f83900c4510 2023-11-28T20:49:42.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8390161020 con 0x7f83900c4510 2023-11-28T20:49:42.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c005330 con 0x7f83900c4510 2023-11-28T20:49:42.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839015fd20 con 0x7f83900c4510 2023-11-28T20:49:42.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8398017640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8390148a90 0x7f839015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8390074770 con 0x7f8390148a90 2023-11-28T20:49:42.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83955b2640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8390148a90 0x7f839015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83955b2640 1 -- 172.21.15.167:0/3416455426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83900c3520 con 0x7f8390148a90 2023-11-28T20:49:42.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83955b2640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8390148a90 0x7f839015feb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83901f3690 tx=0x7f838000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838000ded0 con 0x7f8390148a90 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f838c005490 con 0x7f83900c4510 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.052+0000 7f83867fc640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066510 0x7f83740689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.056+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f838c084120 con 0x7f83900c4510 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.056+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f83800039c0 con 0x7f8390148a90 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.056+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8390148a90 msgr2=0x7f839015feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.056+0000 7f83867fc640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8390148a90 0x7f839015feb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83901f3690 tx=0x7f838000db90 comp rx=0 tx=0).stop 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.056+0000 7f83965b4640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066510 0x7f83740689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.056+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8390148a90 msgr2=0x7f839015feb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:42.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.056+0000 7f83867fc640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8390148a90 0x7f839015feb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.056+0000 7f83965b4640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066510 0x7f83740689d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f83880ae000 tx=0x7f83880a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f8398017640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83901f2aa0 0x7f8390143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900c40b0 con 0x7f83901f2aa0 2023-11-28T20:49:42.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f83955b2640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83901f2aa0 0x7f8390143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f83955b2640 1 -- 172.21.15.167:0/3416455426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8390157040 con 0x7f83901f2aa0 2023-11-28T20:49:42.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f83955b2640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83901f2aa0 0x7f8390143980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8380016000 tx=0x7f83800059e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380021070 con 0x7f83901f2aa0 2023-11-28T20:49:42.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5114 (secure 0 0 0) 0x7f838000b910 con 0x7f83901f2aa0 2023-11-28T20:49:42.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83901f2aa0 msgr2=0x7f8390143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f83867fc640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83901f2aa0 0x7f8390143980 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8380016000 tx=0x7f83800059e0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f83867fc640 1 -- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83901f2aa0 msgr2=0x7f8390143980 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:42.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.060+0000 7f83867fc640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83901f2aa0 0x7f8390143980 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8380016000 tx=0x7f83800059e0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.063 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 100, 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:42.064 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:42.065 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:42.066 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:49:42.067 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:42.068 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:42.069 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.070 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:42.071 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:49:42.072 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:42.073 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:49:42.074 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.075 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:49:42.076 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:49:42.077 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.078 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:42.079 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.079 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.079 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:49:42.079 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066510 msgr2=0x7f83740689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f8398017640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8374066510 0x7f83740689d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f83880ae000 tx=0x7f83880a7070 comp rx=0 tx=0).stop 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 msgr2=0x7f8390147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f8398017640 1 --2- 172.21.15.167:0/3416455426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83900c4510 0x7f8390147fa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f838c00b550 tx=0x7f838c00ba10 comp rx=0 tx=0).stop 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f83965b4640 1 -- 172.21.15.167:0/3416455426 reap_dead start 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f83965b4640 1 -- 172.21.15.167:0/3416455426 reap_dead start 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 shutdown_connections 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 >> 172.21.15.167:0/3416455426 conn(0x7f83900cb1e0 msgr2=0x7f8390071970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 shutdown_connections 2023-11-28T20:49:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.064+0000 7f8398017640 1 -- 172.21.15.167:0/3416455426 wait complete. 2023-11-28T20:49:42.082 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:49:42.082 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:49:42.083 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:49:42.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d9716640 1 Processor -- start 2023-11-28T20:49:42.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d9716640 1 -- start start 2023-11-28T20:49:42.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d9716640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d4154110 0x7fc2d40c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d9716640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc2d40c6750 0x7fc2d40c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d9716640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d40715e0 con 0x7fc2d40c6330 2023-11-28T20:49:42.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d9716640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d4159bc0 con 0x7fc2d40c6750 2023-11-28T20:49:42.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d9716640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4072390 con 0x7fc2d4154110 2023-11-28T20:49:42.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc2d40c6750 0x7fc2d40c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc2d40c6750 0x7fc2d40c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46358/0 (socket says 172.21.15.167:46358) 2023-11-28T20:49:42.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d37fe640 1 -- 172.21.15.167:0/29963225 learned_addr learned my addr 172.21.15.167:0/29963225 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:42.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d2ffd640 1 --2- 172.21.15.167:0/29963225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d4154110 0x7fc2d40c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d37fe640 1 -- 172.21.15.167:0/29963225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d4154110 msgr2=0x7fc2d40c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:49:42.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d37fe640 1 --2- 172.21.15.167:0/29963225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d4154110 0x7fc2d40c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d37fe640 1 -- 172.21.15.167:0/29963225 >> v1:172.21.15.167:6789/0 conn(0x7fc2d40c6330 legacy=0x7fc2d415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.228+0000 7fc2d37fe640 1 -- 172.21.15.167:0/29963225 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d415d3e0 con 0x7fc2d40c6750 2023-11-28T20:49:42.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d37fe640 1 --2- 172.21.15.167:0/29963225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 0x7fc2d40c6e70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009e50 tx=0x7fc2cc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3351fbad497d4098 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d1ffb640 1 -- 172.21.15.167:0/29963225 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0a5720 con 0x7fc2d40c6750 2023-11-28T20:49:42.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d1ffb640 1 -- 172.21.15.167:0/29963225 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0a5880 con 0x7fc2d40c6750 2023-11-28T20:49:42.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d1ffb640 1 -- 172.21.15.167:0/29963225 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0a5c10 con 0x7fc2d40c6750 2023-11-28T20:49:42.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d9716640 1 -- 172.21.15.167:0/29963225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 msgr2=0x7fc2d40c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d9716640 1 --2- 172.21.15.167:0/29963225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 0x7fc2d40c6e70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009e50 tx=0x7fc2cc01c950 comp rx=0 tx=0).stop 2023-11-28T20:49:42.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d9716640 1 -- 172.21.15.167:0/29963225 shutdown_connections 2023-11-28T20:49:42.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d9716640 1 --2- 172.21.15.167:0/29963225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 0x7fc2d40c6e70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d9716640 1 --2- 172.21.15.167:0/29963225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d4154110 0x7fc2d40c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d9716640 1 -- 172.21.15.167:0/29963225 >> 172.21.15.167:0/29963225 conn(0x7fc2d406a580 msgr2=0x7fc2d406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:42.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d9716640 1 -- 172.21.15.167:0/29963225 shutdown_connections 2023-11-28T20:49:42.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d9716640 1 -- 172.21.15.167:0/29963225 wait complete. 2023-11-28T20:49:42.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.232+0000 7fc2d9716640 1 Processor -- start 2023-11-28T20:49:42.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 -- start start 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2d40c6330 0x7fc2d40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 0x7fc2d414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d4154110 0x7fc2d414edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d414e930 con 0x7fc2d40c6750 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40c5b10 con 0x7fc2d40c6330 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40c4360 con 0x7fc2d4154110 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d2ffd640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2d40c6330 msgr2=0x7fc2d40cbae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d2ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2d40c6330 0x7fc2d40cbae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 0x7fc2d414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 0x7fc2d414d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46364/0 (socket says 172.21.15.167:46364) 2023-11-28T20:49:42.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d27fc640 1 -- 172.21.15.167:0/3129437920 learned_addr learned my addr 172.21.15.167:0/3129437920 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d37fe640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d4154110 0x7fc2d414edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d27fc640 1 -- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d4154110 msgr2=0x7fc2d414edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d27fc640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d4154110 0x7fc2d414edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d27fc640 1 -- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2d40c6330 msgr2=0x7fc2d40cbae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d27fc640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2d40c6330 0x7fc2d40cbae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d27fc640 1 -- 172.21.15.167:0/3129437920 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc009b30 con 0x7fc2d40c6750 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d27fc640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 0x7fc2d414d7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c3c0 tx=0x7fc2c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80052d0 con 0x7fc2d40c6750 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8005430 con 0x7fc2d40c6750 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8003840 con 0x7fc2d40c6750 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d40c4640 con 0x7fc2d40c6750 2023-11-28T20:49:42.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d40cc020 con 0x7fc2d40c6750 2023-11-28T20:49:42.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d41544f0 0x7fc2d414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4074690 con 0x7fc2d41544f0 2023-11-28T20:49:42.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d2ffd640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d41544f0 0x7fc2d414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.236+0000 7fc2d2ffd640 1 -- 172.21.15.167:0/3129437920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2d406df60 con 0x7fc2d41544f0 2023-11-28T20:49:42.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2c80039a0 con 0x7fc2d40c6750 2023-11-28T20:49:42.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2d2ffd640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d41544f0 0x7fc2d414f300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4000ee0 tx=0x7fc2c400eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2bb7fe640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc2c0066420 0x7fc2c00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc2c8083890 con 0x7fc2d40c6750 2023-11-28T20:49:42.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c400c740 con 0x7fc2d41544f0 2023-11-28T20:49:42.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc2c400eed0 con 0x7fc2d41544f0 2023-11-28T20:49:42.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2d37fe640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc2c0066420 0x7fc2c00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d41544f0 msgr2=0x7fc2d414f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2bb7fe640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d41544f0 0x7fc2d414f300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4000ee0 tx=0x7fc2c400eba0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d41544f0 msgr2=0x7fc2d414f300 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:42.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2bb7fe640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d41544f0 0x7fc2d414f300 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4000ee0 tx=0x7fc2c400eba0 comp rx=0 tx=0).stop 2023-11-28T20:49:42.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.240+0000 7fc2d37fe640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc2c0066420 0x7fc2c00688e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0ae000 tx=0x7fc2cc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.244+0000 7fc2d9716640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d414dce0 0x7fc2d41f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:49:42.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.244+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40720b0 con 0x7fc2d414dce0 2023-11-28T20:49:42.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.244+0000 7fc2d2ffd640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d414dce0 0x7fc2d41f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:49:42.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d2ffd640 1 -- 172.21.15.167:0/3129437920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc2d414e420 con 0x7fc2d414dce0 2023-11-28T20:49:42.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d2ffd640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d414dce0 0x7fc2d41f5f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4000ee0 tx=0x7fc2c4004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:49:42.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4023070 con 0x7fc2d414dce0 2023-11-28T20:49:42.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4799 (secure 0 0 0) 0x7fc2c401e0d0 con 0x7fc2d414dce0 2023-11-28T20:49:42.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d414dce0 msgr2=0x7fc2d41f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2bb7fe640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d414dce0 0x7fc2d41f5f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4000ee0 tx=0x7fc2c4004740 comp rx=0 tx=0).stop 2023-11-28T20:49:42.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2bb7fe640 1 -- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d414dce0 msgr2=0x7fc2d41f5f70 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:49:42.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2bb7fe640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2d414dce0 0x7fc2d41f5f70 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4000ee0 tx=0x7fc2c4004740 comp rx=0 tx=0).stop 2023-11-28T20:49:42.249 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:49:42.249 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:42.249 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:42.249 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 100, 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:42.250 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:42.251 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:49:42.252 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:49:42.253 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:49:42.254 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:49:42.254 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:49:42.254 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:49:42.254 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:49:42.254 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:49:42.254 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:49:42.254 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:49:42.254 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:49:42.254 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:42.255 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:42.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.258 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:42.258 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:49:42.258 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.258 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.258 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:42.258 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:49:42.258 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:49:42.259 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.260 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.261 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.262 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:49:42.263 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:49:42.264 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:49:42.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:49:42.264 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:49:42.264 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:49:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc2c0066420 msgr2=0x7fc2c00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d9716640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc2c0066420 0x7fc2c00688e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0ae000 tx=0x7fc2cc0a7070 comp rx=0 tx=0).stop 2023-11-28T20:49:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 msgr2=0x7fc2d414d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:49:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d9716640 1 --2- 172.21.15.167:0/3129437920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2d40c6750 0x7fc2d414d7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c3c0 tx=0x7fc2c800c880 comp rx=0 tx=0).stop 2023-11-28T20:49:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d37fe640 1 -- 172.21.15.167:0/3129437920 reap_dead start 2023-11-28T20:49:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d37fe640 1 -- 172.21.15.167:0/3129437920 reap_dead start 2023-11-28T20:49:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 shutdown_connections 2023-11-28T20:49:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 >> 172.21.15.167:0/3129437920 conn(0x7fc2d406a580 msgr2=0x7fc2d406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:49:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 shutdown_connections 2023-11-28T20:49:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:49:42.248+0000 7fc2d9716640 1 -- 172.21.15.167:0/3129437920 wait complete. 2023-11-28T20:49:42.267 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:49:42.267 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:49:48.542 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:48.546 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:02.268 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:50:02.268 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2023-11-28T20:50:02.268 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T20:50:02.268 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T20:50:02.272 INFO:tasks.ceph.mon.b:Started 2023-11-28T20:50:02.272 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:50:02.272 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:50:02.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.420+0000 7f8758116640 1 Processor -- start 2023-11-28T20:50:02.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.420+0000 7f8758116640 1 -- start start 2023-11-28T20:50:02.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.420+0000 7f8758116640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 0x7f87500c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:02.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.420+0000 7f8758116640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87500c8010 0x7f87500c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:02.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.420+0000 7f8758116640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875006a8c0 con 0x7f8750157bb0 2023-11-28T20:50:02.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.420+0000 7f8758116640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87500c2f50 con 0x7f87500c8010 2023-11-28T20:50:02.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f8758116640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87500c94d0 con 0x7f87500c2630 2023-11-28T20:50:02.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f87556b1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87500c8010 0x7f87500c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:02.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f87556b1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87500c8010 0x7f87500c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53282/0 (socket says 172.21.15.167:53282) 2023-11-28T20:50:02.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f87556b1640 1 -- 172.21.15.167:0/2880158860 learned_addr learned my addr 172.21.15.167:0/2880158860 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:02.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f8755eb2640 1 --2- 172.21.15.167:0/2880158860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 0x7f87500c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:02.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f87556b1640 1 -- 172.21.15.167:0/2880158860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 msgr2=0x7f87500c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:02.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f87556b1640 1 --2- 172.21.15.167:0/2880158860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 0x7f87500c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:02.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f87556b1640 1 -- 172.21.15.167:0/2880158860 >> v1:172.21.15.178:6789/0 conn(0x7f8750157bb0 legacy=0x7f8750158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:02.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f87556b1640 1 -- 172.21.15.167:0/2880158860 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500ca850 con 0x7f87500c8010 2023-11-28T20:50:02.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f87556b1640 1 --2- 172.21.15.167:0/2880158860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 0x7f87500c2a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8740009870 tx=0x7f874001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8afd7087de0e04d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:02.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f8754eb0640 1 -- 172.21.15.167:0/2880158860 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400aa670 con 0x7f87500c8010 2023-11-28T20:50:02.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f8754eb0640 1 -- 172.21.15.167:0/2880158860 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87400aa7d0 con 0x7f87500c8010 2023-11-28T20:50:02.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.424+0000 7f8754eb0640 1 -- 172.21.15.167:0/2880158860 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400aab60 con 0x7f87500c8010 2023-11-28T20:50:02.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 -- 172.21.15.167:0/2880158860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 msgr2=0x7f87500c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:02.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 --2- 172.21.15.167:0/2880158860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 0x7f87500c2a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8740009870 tx=0x7f874001c510 comp rx=0 tx=0).stop 2023-11-28T20:50:02.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 -- 172.21.15.167:0/2880158860 shutdown_connections 2023-11-28T20:50:02.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 --2- 172.21.15.167:0/2880158860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 0x7f87500c2a10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:02.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 --2- 172.21.15.167:0/2880158860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 0x7f87500c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:02.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 -- 172.21.15.167:0/2880158860 >> 172.21.15.167:0/2880158860 conn(0x7f875006ee00 msgr2=0x7f875006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:02.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 -- 172.21.15.167:0/2880158860 shutdown_connections 2023-11-28T20:50:02.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 -- 172.21.15.167:0/2880158860 wait complete. 2023-11-28T20:50:02.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 Processor -- start 2023-11-28T20:50:02.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 -- start start 2023-11-28T20:50:02.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 0x7f87501562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:02.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 0x7f8750140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:02.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8750157bb0 0x7f8750143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:02.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87501f72c0 con 0x7f87500c8010 2023-11-28T20:50:02.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87501f6430 con 0x7f8750157bb0 2023-11-28T20:50:02.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8758116640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8750140bb0 con 0x7f87500c2630 2023-11-28T20:50:02.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f87556b1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 0x7f8750140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:02.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8755eb2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 0x7f87501562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f87556b1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 0x7f8750140670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53296/0 (socket says 172.21.15.167:53296) 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f87556b1640 1 -- 172.21.15.167:0/4020022730 learned_addr learned my addr 172.21.15.167:0/4020022730 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f87566b3640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8750157bb0 0x7f8750143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f87556b1640 1 -- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 msgr2=0x7f87501562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f87556b1640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 0x7f87501562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f87556b1640 1 -- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8750157bb0 msgr2=0x7f8750143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f87556b1640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8750157bb0 0x7f8750143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f87556b1640 1 -- 172.21.15.167:0/4020022730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87400094d0 con 0x7f87500c8010 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.428+0000 7f8755eb2640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 0x7f87501562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f87556b1640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 0x7f8750140670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f87400ac040 tx=0x7f874001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f87467fc640 1 -- 172.21.15.167:0/4020022730 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400b3800 con 0x7f87500c8010 2023-11-28T20:50:02.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f87467fc640 1 -- 172.21.15.167:0/4020022730 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87400b3960 con 0x7f87500c8010 2023-11-28T20:50:02.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87501f6640 con 0x7f87500c8010 2023-11-28T20:50:02.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f87467fc640 1 -- 172.21.15.167:0/4020022730 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400b3d10 con 0x7f87500c8010 2023-11-28T20:50:02.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87501f6c00 con 0x7f87500c8010 2023-11-28T20:50:02.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8750075c90 con 0x7f87500c8010 2023-11-28T20:50:02.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f87467fc640 1 -- 172.21.15.167:0/4020022730 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87400c6390 con 0x7f87500c8010 2023-11-28T20:50:02.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f87467fc640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87340664a0 0x7f8734068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:02.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f87467fc640 1 -- 172.21.15.167:0/4020022730 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f874011eff0 con 0x7f87500c8010 2023-11-28T20:50:02.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.432+0000 7f8755eb2640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87340664a0 0x7f8734068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:02.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.436+0000 7f8755eb2640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87340664a0 0x7f8734068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f874c007a70 tx=0x7f874c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:02.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.436+0000 7f87467fc640 1 -- 172.21.15.167:0/4020022730 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87400ebf90 con 0x7f87500c8010 2023-11-28T20:50:02.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.644+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f87500c3a80 con 0x7f87500c8010 2023-11-28T20:50:02.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.644+0000 7f87467fc640 1 -- 172.21.15.167:0/4020022730 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f87400ef5b0 con 0x7f87500c8010 2023-11-28T20:50:02.645 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":100,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:50:02.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87340664a0 msgr2=0x7f8734068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:02.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87340664a0 0x7f8734068960 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f874c007a70 tx=0x7f874c008040 comp rx=0 tx=0).stop 2023-11-28T20:50:02.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 msgr2=0x7f8750140670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:02.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 0x7f8750140670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f87400ac040 tx=0x7f874001ad50 comp rx=0 tx=0).stop 2023-11-28T20:50:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 shutdown_connections 2023-11-28T20:50:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f87340664a0 0x7f8734068960 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8750157bb0 0x7f8750143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87500c8010 0x7f8750140670 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 --2- 172.21.15.167:0/4020022730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87500c2630 0x7f87501562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 >> 172.21.15.167:0/4020022730 conn(0x7f875006ee00 msgr2=0x7f87500c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 shutdown_connections 2023-11-28T20:50:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:02.648+0000 7f8758116640 1 -- 172.21.15.167:0/4020022730 wait complete. 2023-11-28T20:50:05.667 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:50:05.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e5ab1d640 1 Processor -- start 2023-11-28T20:50:05.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e5ab1d640 1 -- start start 2023-11-28T20:50:05.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e5ab1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e541582c0 0x7f4e540c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:05.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e5ab1d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5406a8c0 con 0x7f4e540c8010 2023-11-28T20:50:05.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e5ab1d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540c84c0 con 0x7f4e540c2630 2023-11-28T20:50:05.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e5ab1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540c94d0 con 0x7f4e541582c0 2023-11-28T20:50:05.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e590ba640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4e540c8010 0x7f4e54162430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:33670/0 (socket says 172.21.15.167:33670) 2023-11-28T20:50:05.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e590ba640 1 -- 172.21.15.167:0/3809077484 learned_addr learned my addr 172.21.15.167:0/3809077484 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:50:05.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e4bfff640 1 --2- 172.21.15.167:0/3809077484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e541582c0 0x7f4e540c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:05.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e4b7fe640 1 -- 172.21.15.167:0/3809077484 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318258361 0 0) 0x7f4e5406a8c0 con 0x7f4e540c8010 2023-11-28T20:50:05.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.812+0000 7f4e4b7fe640 1 -- 172.21.15.167:0/3809077484 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e3c003530 con 0x7f4e540c8010 2023-11-28T20:50:05.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.816+0000 7f4e4bfff640 1 -- 172.21.15.167:0/3809077484 >> v1:172.21.15.178:6789/0 conn(0x7f4e540c2630 legacy=0x7f4e54157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:05.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.816+0000 7f4e4bfff640 1 -- 172.21.15.167:0/3809077484 >> v1:172.21.15.167:6789/0 conn(0x7f4e540c8010 legacy=0x7f4e54162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:05.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.816+0000 7f4e4bfff640 1 -- 172.21.15.167:0/3809077484 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540ca850 con 0x7f4e541582c0 2023-11-28T20:50:05.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.816+0000 7f4e4bfff640 1 --2- 172.21.15.167:0/3809077484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e541582c0 0x7f4e540c44d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4e440097f0 tx=0x7f4e4401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8b9e4ce05d55ed0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e4b7fe640 1 -- 172.21.15.167:0/3809077484 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e440ab650 con 0x7f4e541582c0 2023-11-28T20:50:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e4b7fe640 1 -- 172.21.15.167:0/3809077484 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e440ab7b0 con 0x7f4e541582c0 2023-11-28T20:50:05.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e4b7fe640 1 -- 172.21.15.167:0/3809077484 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e440abb20 con 0x7f4e541582c0 2023-11-28T20:50:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/3809077484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e541582c0 msgr2=0x7f4e540c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e5ab1d640 1 --2- 172.21.15.167:0/3809077484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e541582c0 0x7f4e540c44d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4e440097f0 tx=0x7f4e4401c450 comp rx=0 tx=0).stop 2023-11-28T20:50:05.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/3809077484 shutdown_connections 2023-11-28T20:50:05.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e5ab1d640 1 --2- 172.21.15.167:0/3809077484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e541582c0 0x7f4e540c44d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:05.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/3809077484 >> 172.21.15.167:0/3809077484 conn(0x7f4e5406ee00 msgr2=0x7f4e5406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:05.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/3809077484 shutdown_connections 2023-11-28T20:50:05.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/3809077484 wait complete. 2023-11-28T20:50:05.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.820+0000 7f4e5ab1d640 1 Processor -- start 2023-11-28T20:50:05.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e5ab1d640 1 -- start start 2023-11-28T20:50:05.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e5ab1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540c2630 0x7f4e541f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:05.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e5ab1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e540c8010 0x7f4e541f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:05.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e5ab1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e541582c0 0x7f4e541f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:05.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e5ab1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e541f40e0 con 0x7f4e540c2630 2023-11-28T20:50:05.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e5ab1d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5406ae50 con 0x7f4e541582c0 2023-11-28T20:50:05.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e5ab1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54144ca0 con 0x7f4e540c8010 2023-11-28T20:50:05.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e588b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540c2630 0x7f4e541f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:05.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e588b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540c2630 0x7f4e541f53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58138/0 (socket says 172.21.15.167:58138) 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e588b9640 1 -- 172.21.15.167:0/112648141 learned_addr learned my addr 172.21.15.167:0/112648141 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e4bfff640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e540c8010 0x7f4e541f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e590ba640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e541582c0 0x7f4e541f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e590ba640 1 -- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e541582c0 msgr2=0x7f4e541f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e590ba640 1 -- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e541582c0 msgr2=0x7f4e541f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e590ba640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e541582c0 0x7f4e541f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e590ba640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e541582c0 0x7f4e541f6440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e588b9640 1 -- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e540c8010 msgr2=0x7f4e541f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e588b9640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e540c8010 0x7f4e541f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e588b9640 1 -- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e541582c0 msgr2=0x7f4e541f6440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e588b9640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e541582c0 0x7f4e541f6440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:05.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e588b9640 1 -- 172.21.15.167:0/112648141 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44009420 con 0x7f4e540c2630 2023-11-28T20:50:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e588b9640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540c2630 0x7f4e541f53d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000c420 tx=0x7f4e5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e497fa640 1 -- 172.21.15.167:0/112648141 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500052d0 con 0x7f4e540c2630 2023-11-28T20:50:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e497fa640 1 -- 172.21.15.167:0/112648141 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e50005430 con 0x7f4e540c2630 2023-11-28T20:50:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e541f4330 con 0x7f4e540c2630 2023-11-28T20:50:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e497fa640 1 -- 172.21.15.167:0/112648141 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50007260 con 0x7f4e540c2630 2023-11-28T20:50:05.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.824+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e541f48f0 con 0x7f4e540c2630 2023-11-28T20:50:05.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.828+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e54075c90 con 0x7f4e540c2630 2023-11-28T20:50:05.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.828+0000 7f4e497fa640 1 -- 172.21.15.167:0/112648141 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e500073c0 con 0x7f4e540c2630 2023-11-28T20:50:05.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.828+0000 7f4e497fa640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e40066470 0x7f4e40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:05.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.828+0000 7f4e497fa640 1 -- 172.21.15.167:0/112648141 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4e50083670 con 0x7f4e540c2630 2023-11-28T20:50:05.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.828+0000 7f4e4bfff640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e40066470 0x7f4e40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:05.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.828+0000 7f4e4bfff640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e40066470 0x7f4e40068930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4e440af000 tx=0x7f4e44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:05.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:05.832+0000 7f4e497fa640 1 -- 172.21.15.167:0/112648141 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e50050710 con 0x7f4e540c2630 2023-11-28T20:50:06.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.076+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4e540cafb0 con 0x7f4e540c2630 2023-11-28T20:50:06.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.076+0000 7f4e497fa640 1 -- 172.21.15.167:0/112648141 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f4e50053d30 con 0x7f4e540c2630 2023-11-28T20:50:06.078 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":100,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:50:06.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e40066470 msgr2=0x7f4e40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:06.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e40066470 0x7f4e40068930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4e440af000 tx=0x7f4e44008040 comp rx=0 tx=0).stop 2023-11-28T20:50:06.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540c2630 msgr2=0x7f4e541f53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:06.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540c2630 0x7f4e541f53d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000c420 tx=0x7f4e5000c8e0 comp rx=0 tx=0).stop 2023-11-28T20:50:06.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 shutdown_connections 2023-11-28T20:50:06.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4e40066470 0x7f4e40068930 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:06.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e541582c0 0x7f4e541f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:06.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e540c8010 0x7f4e541f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:06.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 --2- 172.21.15.167:0/112648141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e540c2630 0x7f4e541f53d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:06.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 >> 172.21.15.167:0/112648141 conn(0x7f4e5406ee00 msgr2=0x7f4e54070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:06.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 shutdown_connections 2023-11-28T20:50:06.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:06.080+0000 7f4e5ab1d640 1 -- 172.21.15.167:0/112648141 wait complete. 2023-11-28T20:50:09.100 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:50:09.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.239+0000 7f16f0809640 1 Processor -- start 2023-11-28T20:50:09.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.239+0000 7f16f0809640 1 -- start start 2023-11-28T20:50:09.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16f0809640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16ec06e030 0x7f16ec1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16f0809640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec1571d0 con 0x7f16ec070480 2023-11-28T20:50:09.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16f0809640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec071a90 con 0x7f16ec072630 2023-11-28T20:50:09.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16f0809640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec0c70d0 con 0x7f16ec06e030 2023-11-28T20:50:09.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16e259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16ec06e030 0x7f16ec1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16ea59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f16ec070480 0x7f16ec071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:33672/0 (socket says 172.21.15.167:33672) 2023-11-28T20:50:09.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16ea59c640 1 -- 172.21.15.167:0/3873472508 learned_addr learned my addr 172.21.15.167:0/3873472508 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:50:09.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16e259c640 1 -- 172.21.15.167:0/3873472508 >> v1:172.21.15.178:6789/0 conn(0x7f16ec072630 legacy=0x7f16ec160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16e259c640 1 -- 172.21.15.167:0/3873472508 >> v1:172.21.15.167:6789/0 conn(0x7f16ec070480 legacy=0x7f16ec071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16e259c640 1 -- 172.21.15.167:0/3873472508 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0c73b0 con 0x7f16ec06e030 2023-11-28T20:50:09.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.243+0000 7f16e259c640 1 --2- 172.21.15.167:0/3873472508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec06e030 0x7f16ec1500b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00a960 tx=0x7f16dc01d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a585cf6ed1d6386a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16e9d9b640 1 -- 172.21.15.167:0/3873472508 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0a68d0 con 0x7f16ec06e030 2023-11-28T20:50:09.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16e9d9b640 1 -- 172.21.15.167:0/3873472508 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc0a6a30 con 0x7f16ec06e030 2023-11-28T20:50:09.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16e9d9b640 1 -- 172.21.15.167:0/3873472508 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0a6dc0 con 0x7f16ec06e030 2023-11-28T20:50:09.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 -- 172.21.15.167:0/3873472508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec06e030 msgr2=0x7f16ec1500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 --2- 172.21.15.167:0/3873472508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec06e030 0x7f16ec1500b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00a960 tx=0x7f16dc01d820 comp rx=0 tx=0).stop 2023-11-28T20:50:09.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 -- 172.21.15.167:0/3873472508 shutdown_connections 2023-11-28T20:50:09.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 --2- 172.21.15.167:0/3873472508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec06e030 0x7f16ec1500b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 -- 172.21.15.167:0/3873472508 >> 172.21.15.167:0/3873472508 conn(0x7f16ec0cb1e0 msgr2=0x7f16ec0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:09.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 -- 172.21.15.167:0/3873472508 shutdown_connections 2023-11-28T20:50:09.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 -- 172.21.15.167:0/3873472508 wait complete. 2023-11-28T20:50:09.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 Processor -- start 2023-11-28T20:50:09.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 -- start start 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16ec06e030 0x7f16ec150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec070480 0x7f16ec0ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16ec072630 0x7f16ec14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec157b20 con 0x7f16ec070480 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec14bbf0 con 0x7f16ec072630 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16f0809640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec151040 con 0x7f16ec06e030 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16ea59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec070480 0x7f16ec0ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16ea59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec070480 0x7f16ec0ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58170/0 (socket says 172.21.15.167:58170) 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.247+0000 7f16ea59c640 1 -- 172.21.15.167:0/2955154062 learned_addr learned my addr 172.21.15.167:0/2955154062 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16e259c640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16ec06e030 0x7f16ec150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16ead9d640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16ec072630 0x7f16ec14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16ea59c640 1 -- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16ec06e030 msgr2=0x7f16ec150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16ea59c640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16ec06e030 0x7f16ec150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16ea59c640 1 -- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16ec072630 msgr2=0x7f16ec14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16ea59c640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16ec072630 0x7f16ec14c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16ea59c640 1 -- 172.21.15.167:0/2955154062 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc00a5c0 con 0x7f16ec070480 2023-11-28T20:50:09.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16ea59c640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec070480 0x7f16ec0ca370 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001ec0 tx=0x7f16d400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16e37fe640 1 -- 172.21.15.167:0/2955154062 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4005cf0 con 0x7f16ec070480 2023-11-28T20:50:09.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16e37fe640 1 -- 172.21.15.167:0/2955154062 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d4005e50 con 0x7f16ec070480 2023-11-28T20:50:09.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec157d50 con 0x7f16ec070480 2023-11-28T20:50:09.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16e37fe640 1 -- 172.21.15.167:0/2955154062 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d40072d0 con 0x7f16ec070480 2023-11-28T20:50:09.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec158310 con 0x7f16ec070480 2023-11-28T20:50:09.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec0682c0 con 0x7f16ec070480 2023-11-28T20:50:09.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16e37fe640 1 -- 172.21.15.167:0/2955154062 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16d4007430 con 0x7f16ec070480 2023-11-28T20:50:09.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16e37fe640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16cc0664a0 0x7f16cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.251+0000 7f16e37fe640 1 -- 172.21.15.167:0/2955154062 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f16d40837f0 con 0x7f16ec070480 2023-11-28T20:50:09.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.255+0000 7f16e259c640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16cc0664a0 0x7f16cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.255+0000 7f16e259c640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16cc0664a0 0x7f16cc068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0b0000 tx=0x7f16dc0a8070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.255+0000 7f16e37fe640 1 -- 172.21.15.167:0/2955154062 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16d4050800 con 0x7f16ec070480 2023-11-28T20:50:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f16ec14bd60 con 0x7f16ec070480 2023-11-28T20:50:09.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16e37fe640 1 -- 172.21.15.167:0/2955154062 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f16d4017620 con 0x7f16ec070480 2023-11-28T20:50:09.461 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16cc0664a0 msgr2=0x7f16cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16cc0664a0 0x7f16cc068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0b0000 tx=0x7f16dc0a8070 comp rx=0 tx=0).stop 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec070480 msgr2=0x7f16ec0ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec070480 0x7f16ec0ca370 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f16d4001ec0 tx=0x7f16d400c890 comp rx=0 tx=0).stop 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 shutdown_connections 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16cc0664a0 0x7f16cc068960 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16ec072630 0x7f16ec14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16ec070480 0x7f16ec0ca370 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 --2- 172.21.15.167:0/2955154062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16ec06e030 0x7f16ec150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 >> 172.21.15.167:0/2955154062 conn(0x7f16ec0cb1e0 msgr2=0x7f16ec14e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.459+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 shutdown_connections 2023-11-28T20:50:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.463+0000 7f16f0809640 1 -- 172.21.15.167:0/2955154062 wait complete. 2023-11-28T20:50:09.481 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:50:09.481 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:50:09.482 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:50:09.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.623+0000 7f80f4f2a640 1 Processor -- start 2023-11-28T20:50:09.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80f4f2a640 1 -- start start 2023-11-28T20:50:09.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80f4f2a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80f0150b40 0x7f80f0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80f4f2a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f80f00c4510 0x7f80f006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80f4f2a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f00c48f0 con 0x7f80f00c6ff0 2023-11-28T20:50:09.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80f4f2a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00c62f0 con 0x7f80f0150b40 2023-11-28T20:50:09.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80f4f2a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00c6ac0 con 0x7f80f00c4510 2023-11-28T20:50:09.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80ee59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80f0150b40 0x7f80f0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80ee59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80f0150b40 0x7f80f0157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58184/0 (socket says 172.21.15.167:58184) 2023-11-28T20:50:09.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80ee59c640 1 -- 172.21.15.167:0/2417581757 learned_addr learned my addr 172.21.15.167:0/2417581757 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:09.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80edd9b640 1 --1- 172.21.15.167:0/2417581757 >> v1:172.21.15.167:6789/0 conn(0x7f80f00c6ff0 0x7f80f00c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:33674/0 (socket says 172.21.15.167:33674) 2023-11-28T20:50:09.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80eed9d640 1 --2- 172.21.15.167:0/2417581757 >> v2:172.21.15.178:3300/0 conn(0x7f80f00c4510 0x7f80f006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80ee59c640 1 -- 172.21.15.167:0/2417581757 >> v2:172.21.15.178:3300/0 conn(0x7f80f00c4510 msgr2=0x7f80f006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:09.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80ee59c640 1 --2- 172.21.15.167:0/2417581757 >> v2:172.21.15.178:3300/0 conn(0x7f80f00c4510 0x7f80f006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80ee59c640 1 -- 172.21.15.167:0/2417581757 >> v1:172.21.15.167:6789/0 conn(0x7f80f00c6ff0 legacy=0x7f80f00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.627+0000 7f80ee59c640 1 -- 172.21.15.167:0/2417581757 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00c6500 con 0x7f80f0150b40 2023-11-28T20:50:09.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80ee59c640 1 --2- 172.21.15.167:0/2417581757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 0x7f80f0157560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f80f00cc270 tx=0x7f80e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc4fd2afe7f84c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80ed59a640 1 -- 172.21.15.167:0/2417581757 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00ab600 con 0x7f80f0150b40 2023-11-28T20:50:09.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80ed59a640 1 -- 172.21.15.167:0/2417581757 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e00a7050 con 0x7f80f0150b40 2023-11-28T20:50:09.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80ed59a640 1 -- 172.21.15.167:0/2417581757 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00ab980 con 0x7f80f0150b40 2023-11-28T20:50:09.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80f4f2a640 1 -- 172.21.15.167:0/2417581757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 msgr2=0x7f80f0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80f4f2a640 1 --2- 172.21.15.167:0/2417581757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 0x7f80f0157560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f80f00cc270 tx=0x7f80e001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80f4f2a640 1 -- 172.21.15.167:0/2417581757 shutdown_connections 2023-11-28T20:50:09.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80f4f2a640 1 --2- 172.21.15.167:0/2417581757 >> v2:172.21.15.178:3300/0 conn(0x7f80f00c4510 0x7f80f006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80f4f2a640 1 --2- 172.21.15.167:0/2417581757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 0x7f80f0157560 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80f4f2a640 1 -- 172.21.15.167:0/2417581757 >> 172.21.15.167:0/2417581757 conn(0x7f80f00cb1e0 msgr2=0x7f80f00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:09.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80f4f2a640 1 -- 172.21.15.167:0/2417581757 shutdown_connections 2023-11-28T20:50:09.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80f4f2a640 1 -- 172.21.15.167:0/2417581757 wait complete. 2023-11-28T20:50:09.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.631+0000 7f80f4f2a640 1 Processor -- start 2023-11-28T20:50:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 -- start start 2023-11-28T20:50:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80f00c4510 0x7f80f0144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80f00c6ff0 0x7f80f0139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 0x7f80f0139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00ca1a0 con 0x7f80f0150b40 2023-11-28T20:50:09.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f01429c0 con 0x7f80f00c4510 2023-11-28T20:50:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00ca940 con 0x7f80f00c6ff0 2023-11-28T20:50:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80eed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 0x7f80f0139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80eed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 0x7f80f0139db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58188/0 (socket says 172.21.15.167:58188) 2023-11-28T20:50:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80eed9d640 1 -- 172.21.15.167:0/4026029984 learned_addr learned my addr 172.21.15.167:0/4026029984 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80ee59c640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80f00c4510 0x7f80f0144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80edd9b640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80f00c6ff0 0x7f80f0139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80eed9d640 1 -- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80f00c6ff0 msgr2=0x7f80f0139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80eed9d640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80f00c6ff0 0x7f80f0139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80eed9d640 1 -- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80f00c4510 msgr2=0x7f80f0144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80eed9d640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80f00c4510 0x7f80f0144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80eed9d640 1 -- 172.21.15.167:0/4026029984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e00094d0 con 0x7f80f0150b40 2023-11-28T20:50:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80ee59c640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80f00c4510 0x7f80f0144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:50:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80eed9d640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 0x7f80f0139db0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f80e8007e70 tx=0x7f80e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8014620 con 0x7f80f0150b40 2023-11-28T20:50:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e80147a0 con 0x7f80f0150b40 2023-11-28T20:50:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f013a2f0 con 0x7f80f0150b40 2023-11-28T20:50:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8014b50 con 0x7f80f0150b40 2023-11-28T20:50:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f0142e90 con 0x7f80f0150b40 2023-11-28T20:50:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013dbe0 0x7f80f013ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f0074770 con 0x7f80f013dbe0 2023-11-28T20:50:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80ee59c640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013dbe0 0x7f80f013ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80ee59c640 1 -- 172.21.15.167:0/4026029984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80f0157040 con 0x7f80f013dbe0 2023-11-28T20:50:09.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.635+0000 7f80ee59c640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013dbe0 0x7f80f013ef70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80f006bba0 tx=0x7f80e001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80e8014cb0 con 0x7f80f0150b40 2023-11-28T20:50:09.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80deffd640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f80d0066470 0x7f80d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00b6420 con 0x7f80f013dbe0 2023-11-28T20:50:09.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f80e8084d10 con 0x7f80f0150b40 2023-11-28T20:50:09.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f80e00b6580 con 0x7f80f013dbe0 2023-11-28T20:50:09.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013dbe0 msgr2=0x7f80f013ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80deffd640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013dbe0 0x7f80f013ef70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80f006bba0 tx=0x7f80e001ad10 comp rx=0 tx=0).stop 2023-11-28T20:50:09.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80edd9b640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f80d0066470 0x7f80d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013dbe0 msgr2=0x7f80f013ef70 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:09.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80deffd640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013dbe0 0x7f80f013ef70 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80f006bba0 tx=0x7f80e001ad10 comp rx=0 tx=0).stop 2023-11-28T20:50:09.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.639+0000 7f80edd9b640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f80d0066470 0x7f80d0068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009fd0 tx=0x7f80e4009e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.643+0000 7f80f4f2a640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013f4b0 0x7f80f01f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.643+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00682c0 con 0x7f80f013f4b0 2023-11-28T20:50:09.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.643+0000 7f80ee59c640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013f4b0 0x7f80f01f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80ee59c640 1 -- 172.21.15.167:0/4026029984 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f80f0075c90 con 0x7f80f013f4b0 2023-11-28T20:50:09.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80ee59c640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013f4b0 0x7f80f01f1490 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f80e00190e0 tx=0x7f80e0019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00c3070 con 0x7f80f013f4b0 2023-11-28T20:50:09.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5125 (secure 0 0 0) 0x7f80e0003620 con 0x7f80f013f4b0 2023-11-28T20:50:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013f4b0 msgr2=0x7f80f01f1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80deffd640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013f4b0 0x7f80f01f1490 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f80e00190e0 tx=0x7f80e0019270 comp rx=0 tx=0).stop 2023-11-28T20:50:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80deffd640 1 -- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013f4b0 msgr2=0x7f80f01f1490 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:09.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80deffd640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f013f4b0 0x7f80f01f1490 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f80e00190e0 tx=0x7f80e0019270 comp rx=0 tx=0).stop 2023-11-28T20:50:09.652 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:50:09.653 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:09.653 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:09.653 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:50:09.653 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 102, 2023-11-28T20:50:09.653 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:50:09.653 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:50:09.654 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:50:09.654 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:50:09.654 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.654 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:50:09.654 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:09.654 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:50:09.655 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:50:09.655 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:09.655 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:09.655 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:09.655 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:09.655 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:09.656 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:09.656 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:09.656 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:09.656 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:09.656 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:09.657 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.657 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:50:09.657 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:50:09.657 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:09.658 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:09.658 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:09.658 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:09.658 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:09.658 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:09.658 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:09.659 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:09.659 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:09.659 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:09.659 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.659 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:50:09.660 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:50:09.660 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:50:09.660 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:50:09.660 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:50:09.660 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:50:09.660 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:09.660 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:09.661 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:50:09.661 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:50:09.661 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:50:09.662 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:50:09.662 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:50:09.662 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:50:09.662 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:50:09.662 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:09.662 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:50:09.662 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:09.662 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:09.663 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:09.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:09.663 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:09.663 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:09.663 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:09.663 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:09.664 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:09.664 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:09.664 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.664 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:50:09.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.664 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:50:09.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.665 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:09.665 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:09.665 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:09.665 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:09.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.665 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:09.665 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.666 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:50:09.667 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:50:09.667 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:09.667 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:09.667 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:09.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:09.670 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.672 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:50:09.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:50:09.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.675 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:09.675 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:09.675 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:09.675 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.675 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.675 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:50:09.675 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:50:09.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f80d0066470 msgr2=0x7f80d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80f4f2a640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f80d0066470 0x7f80d0068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009fd0 tx=0x7f80e4009e40 comp rx=0 tx=0).stop 2023-11-28T20:50:09.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 msgr2=0x7f80f0139db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80f4f2a640 1 --2- 172.21.15.167:0/4026029984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f0150b40 0x7f80f0139db0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f80e8007e70 tx=0x7f80e800e4b0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80eed9d640 1 -- 172.21.15.167:0/4026029984 reap_dead start 2023-11-28T20:50:09.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80eed9d640 1 -- 172.21.15.167:0/4026029984 reap_dead start 2023-11-28T20:50:09.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 shutdown_connections 2023-11-28T20:50:09.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 >> 172.21.15.167:0/4026029984 conn(0x7f80f00cb1e0 msgr2=0x7f80f0148840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:09.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 shutdown_connections 2023-11-28T20:50:09.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.647+0000 7f80f4f2a640 1 -- 172.21.15.167:0/4026029984 wait complete. 2023-11-28T20:50:09.677 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:50:09.678 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:50:09.678 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:50:09.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.815+0000 7f40144bb640 1 Processor -- start 2023-11-28T20:50:09.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.815+0000 7f40144bb640 1 -- start start 2023-11-28T20:50:09.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f40144bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f400c151f60 0x7f400c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f40144bb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f400c06a580 0x7f400c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f40144bb640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400c15b220 con 0x7f400c0c5c90 2023-11-28T20:50:09.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f40144bb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c0c4da0 con 0x7f400c06a580 2023-11-28T20:50:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f40144bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0c2df0 con 0x7f400c151f60 2023-11-28T20:50:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f4012a58640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f400c06a580 0x7f400c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f4012a58640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f400c06a580 0x7f400c06a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58220/0 (socket says 172.21.15.167:58220) 2023-11-28T20:50:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f4012a58640 1 -- 172.21.15.167:0/1367622011 learned_addr learned my addr 172.21.15.167:0/1367622011 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f4012a58640 1 -- 172.21.15.167:0/1367622011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f400c151f60 msgr2=0x7f400c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f4012a58640 1 --2- 172.21.15.167:0/1367622011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f400c151f60 0x7f400c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f4012a58640 1 -- 172.21.15.167:0/1367622011 >> v1:172.21.15.178:6789/0 conn(0x7f400c0c5c90 legacy=0x7f400c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:09.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.819+0000 7f4012a58640 1 -- 172.21.15.167:0/1367622011 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0c60f0 con 0x7f400c06a580 2023-11-28T20:50:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f4012a58640 1 --2- 172.21.15.167:0/1367622011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c06a580 0x7f400c06a9b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4004009e80 tx=0x7f400401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4427d3091481e81c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f4011255640 1 -- 172.21.15.167:0/1367622011 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040a5730 con 0x7f400c06a580 2023-11-28T20:50:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f4011255640 1 -- 172.21.15.167:0/1367622011 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40040a5890 con 0x7f400c06a580 2023-11-28T20:50:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f4011255640 1 -- 172.21.15.167:0/1367622011 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40040a5c20 con 0x7f400c06a580 2023-11-28T20:50:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 -- 172.21.15.167:0/1367622011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c06a580 msgr2=0x7f400c06a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 --2- 172.21.15.167:0/1367622011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c06a580 0x7f400c06a9b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4004009e80 tx=0x7f400401c960 comp rx=0 tx=0).stop 2023-11-28T20:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 -- 172.21.15.167:0/1367622011 shutdown_connections 2023-11-28T20:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 --2- 172.21.15.167:0/1367622011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c06a580 0x7f400c06a9b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 --2- 172.21.15.167:0/1367622011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f400c151f60 0x7f400c0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 -- 172.21.15.167:0/1367622011 >> 172.21.15.167:0/1367622011 conn(0x7f400c0cb1e0 msgr2=0x7f400c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 -- 172.21.15.167:0/1367622011 shutdown_connections 2023-11-28T20:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 -- 172.21.15.167:0/1367622011 wait complete. 2023-11-28T20:50:09.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 Processor -- start 2023-11-28T20:50:09.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.823+0000 7f40144bb640 1 -- start start 2023-11-28T20:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c06a580 0x7f400c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c0c5c90 0x7f400c1f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f400c151f60 0x7f400c1f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0cabf0 con 0x7f400c0c5c90 2023-11-28T20:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c148e10 con 0x7f400c06a580 2023-11-28T20:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0cade0 con 0x7f400c151f60 2023-11-28T20:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4011a56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c0c5c90 0x7f400c1f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4011a56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c0c5c90 0x7f400c1f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58230/0 (socket says 172.21.15.167:58230) 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4011a56640 1 -- 172.21.15.167:0/1994141397 learned_addr learned my addr 172.21.15.167:0/1994141397 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4012257640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c06a580 0x7f400c14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4012a58640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f400c151f60 0x7f400c1f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4011a56640 1 -- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f400c151f60 msgr2=0x7f400c1f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4011a56640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f400c151f60 0x7f400c1f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4011a56640 1 -- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c06a580 msgr2=0x7f400c14ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4011a56640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c06a580 0x7f400c14ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4011a56640 1 -- 172.21.15.167:0/1994141397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4004009b30 con 0x7f400c0c5c90 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4011a56640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c0c5c90 0x7f400c1f5df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00c500 tx=0x7f3ffc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc005220 con 0x7f400c0c5c90 2023-11-28T20:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc005380 con 0x7f400c0c5c90 2023-11-28T20:50:09.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc007270 con 0x7f400c0c5c90 2023-11-28T20:50:09.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c1490d0 con 0x7f400c0c5c90 2023-11-28T20:50:09.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c149690 con 0x7f400c0c5c90 2023-11-28T20:50:09.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c1591d0 0x7f400c1479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c148f80 con 0x7f400c1591d0 2023-11-28T20:50:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4012257640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c1591d0 0x7f400c1479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4012257640 1 -- 172.21.15.167:0/1994141397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f400c15ba30 con 0x7f400c1591d0 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4012257640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c1591d0 0x7f400c1479e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f400800d490 tx=0x7f400800d950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.827+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ffc0073d0 con 0x7f400c0c5c90 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4002ffd640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ff0066470 0x7f3ff0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3ffc083b50 con 0x7f400c0c5c90 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008014620 con 0x7f400c1591d0 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4012a58640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ff0066470 0x7f3ff0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f4008014780 con 0x7f400c1591d0 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c1591d0 msgr2=0x7f400c1479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4002ffd640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c1591d0 0x7f400c1479e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f400800d490 tx=0x7f400800d950 comp rx=0 tx=0).stop 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c1591d0 msgr2=0x7f400c1479e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4002ffd640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c1591d0 0x7f400c1479e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.831+0000 7f4012a58640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ff0066470 0x7f3ff0068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f40040ae000 tx=0x7f40040a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.835+0000 7f40144bb640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c14bae0 0x7f400c147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.835+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c074770 con 0x7f400c14bae0 2023-11-28T20:50:09.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.835+0000 7f4012257640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c14bae0 0x7f400c147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4012257640 1 -- 172.21.15.167:0/1994141397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f400c158750 con 0x7f400c14bae0 2023-11-28T20:50:09.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4012257640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c14bae0 0x7f400c147f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f400800d490 tx=0x7f40080046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:09.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400801f860 con 0x7f400c14bae0 2023-11-28T20:50:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f4008029410 con 0x7f400c14bae0 2023-11-28T20:50:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c14bae0 msgr2=0x7f400c147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4002ffd640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c14bae0 0x7f400c147f20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f400800d490 tx=0x7f40080046d0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4002ffd640 1 -- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c14bae0 msgr2=0x7f400c147f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4002ffd640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f400c14bae0 0x7f400c147f20 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f400800d490 tx=0x7f40080046d0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.841 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 102, 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.842 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:09.843 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:09.844 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:09.845 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:09.846 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:50:09.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:09.848 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.849 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.850 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:09.851 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:50:09.852 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.853 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:50:09.854 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:50:09.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.854 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:09.854 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:09.854 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:09.854 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.854 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:09.854 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:50:09.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:09.855 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:09.855 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:09.855 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:09.855 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:09.855 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:09.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:09.855 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:50:09.855 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:50:09.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ff0066470 msgr2=0x7f3ff0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f40144bb640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3ff0066470 0x7f3ff0068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f40040ae000 tx=0x7f40040a7070 comp rx=0 tx=0).stop 2023-11-28T20:50:09.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c0c5c90 msgr2=0x7f400c1f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:09.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f40144bb640 1 --2- 172.21.15.167:0/1994141397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f400c0c5c90 0x7f400c1f5df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00c500 tx=0x7f3ffc00c9c0 comp rx=0 tx=0).stop 2023-11-28T20:50:09.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4012a58640 1 -- 172.21.15.167:0/1994141397 reap_dead start 2023-11-28T20:50:09.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f4012a58640 1 -- 172.21.15.167:0/1994141397 reap_dead start 2023-11-28T20:50:09.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 shutdown_connections 2023-11-28T20:50:09.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 >> 172.21.15.167:0/1994141397 conn(0x7f400c0cb1e0 msgr2=0x7f400c1503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:09.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 shutdown_connections 2023-11-28T20:50:09.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.839+0000 7f40144bb640 1 -- 172.21.15.167:0/1994141397 wait complete. 2023-11-28T20:50:09.858 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:50:09.858 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:50:09.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:50:09.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb710165640 1 Processor -- start 2023-11-28T20:50:09.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb710165640 1 -- start start 2023-11-28T20:50:09.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb710165640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb7080c75c0 0x7fb7080c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb710165640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb70806a580 0x7fb70806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb710165640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7080c7a50 con 0x7fb708151f60 2023-11-28T20:50:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb710165640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb70806aed0 con 0x7fb7080c75c0 2023-11-28T20:50:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb710165640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7080c4da0 con 0x7fb70806a580 2023-11-28T20:50:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb70d700640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb7080c75c0 0x7fb7080c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb70d700640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb7080c75c0 0x7fb7080c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58244/0 (socket says 172.21.15.167:58244) 2023-11-28T20:50:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb70d700640 1 -- 172.21.15.167:0/2809478510 learned_addr learned my addr 172.21.15.167:0/2809478510 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb70df01640 1 --1- 172.21.15.167:0/2809478510 >> v1:172.21.15.178:6789/0 conn(0x7fb708151f60 0x7fb7080c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:42218/0 (socket says 172.21.15.167:42218) 2023-11-28T20:50:09.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.995+0000 7fb70e702640 1 --2- 172.21.15.167:0/2809478510 >> v2:172.21.15.178:3300/0 conn(0x7fb70806a580 0x7fb70806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb70d700640 1 -- 172.21.15.167:0/2809478510 >> v2:172.21.15.178:3300/0 conn(0x7fb70806a580 msgr2=0x7fb70806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb70d700640 1 --2- 172.21.15.167:0/2809478510 >> v2:172.21.15.178:3300/0 conn(0x7fb70806a580 0x7fb70806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb70d700640 1 -- 172.21.15.167:0/2809478510 >> v1:172.21.15.178:6789/0 conn(0x7fb708151f60 legacy=0x7fb7080c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb70d700640 1 -- 172.21.15.167:0/2809478510 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70815b220 con 0x7fb7080c75c0 2023-11-28T20:50:10.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb70d700640 1 --2- 172.21.15.167:0/2809478510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7080c75c0 0x7fb7080c5c90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb7080c5580 tx=0x7fb6f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1841d58133495678 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:10.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb70ceff640 1 -- 172.21.15.167:0/2809478510 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80ab600 con 0x7fb7080c75c0 2023-11-28T20:50:10.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb70ceff640 1 -- 172.21.15.167:0/2809478510 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80a7050 con 0x7fb7080c75c0 2023-11-28T20:50:10.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb70ceff640 1 -- 172.21.15.167:0/2809478510 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80ab980 con 0x7fb7080c75c0 2023-11-28T20:50:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb710165640 1 -- 172.21.15.167:0/2809478510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7080c75c0 msgr2=0x7fb7080c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb710165640 1 --2- 172.21.15.167:0/2809478510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7080c75c0 0x7fb7080c5c90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb7080c5580 tx=0x7fb6f801c470 comp rx=0 tx=0).stop 2023-11-28T20:50:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb710165640 1 -- 172.21.15.167:0/2809478510 shutdown_connections 2023-11-28T20:50:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb710165640 1 --2- 172.21.15.167:0/2809478510 >> v2:172.21.15.178:3300/0 conn(0x7fb70806a580 0x7fb70806a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb710165640 1 --2- 172.21.15.167:0/2809478510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7080c75c0 0x7fb7080c5c90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:09.999+0000 7fb710165640 1 -- 172.21.15.167:0/2809478510 >> 172.21.15.167:0/2809478510 conn(0x7fb7080cb1e0 msgr2=0x7fb7080cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:10.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 -- 172.21.15.167:0/2809478510 shutdown_connections 2023-11-28T20:50:10.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 -- 172.21.15.167:0/2809478510 wait complete. 2023-11-28T20:50:10.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 Processor -- start 2023-11-28T20:50:10.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 -- start start 2023-11-28T20:50:10.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70806a580 0x7fb70806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080c75c0 0x7fb70814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708151f60 0x7fb708142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7081416e0 con 0x7fb70806a580 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c3200 con 0x7fb7080c75c0 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080c9440 con 0x7fb708151f60 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70df01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70806a580 0x7fb70806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70df01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70806a580 0x7fb70806a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58250/0 (socket says 172.21.15.167:58250) 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70df01640 1 -- 172.21.15.167:0/3133897246 learned_addr learned my addr 172.21.15.167:0/3133897246 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70d700640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080c75c0 0x7fb70814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70e702640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708151f60 0x7fb708142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70df01640 1 -- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708151f60 msgr2=0x7fb708142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70df01640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708151f60 0x7fb708142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70df01640 1 -- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080c75c0 msgr2=0x7fb70814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70df01640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080c75c0 0x7fb70814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70df01640 1 -- 172.21.15.167:0/3133897246 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80094d0 con 0x7fb70806a580 2023-11-28T20:50:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70d700640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080c75c0 0x7fb70814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:50:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb70df01640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70806a580 0x7fb70806a960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb70400c490 tx=0x7fb70400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704007480 con 0x7fb70806a580 2023-11-28T20:50:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7040075e0 con 0x7fb70806a580 2023-11-28T20:50:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70814e0d0 con 0x7fb70806a580 2023-11-28T20:50:10.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704004a10 con 0x7fb70806a580 2023-11-28T20:50:10.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.003+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7080c9160 con 0x7fb70806a580 2023-11-28T20:50:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb710165640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708157ca0 0x7fb708142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb708074770 con 0x7fb708157ca0 2023-11-28T20:50:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb70d700640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708157ca0 0x7fb708142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb704004b70 con 0x7fb70806a580 2023-11-28T20:50:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb70d700640 1 -- 172.21.15.167:0/3133897246 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb70815ba30 con 0x7fb708157ca0 2023-11-28T20:50:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb70d700640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708157ca0 0x7fb708142750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7080c62c0 tx=0x7fb6f801acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:10.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb6fe7fc640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066470 0x7fb6ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb704083310 con 0x7fb70806a580 2023-11-28T20:50:10.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80b6420 con 0x7fb708157ca0 2023-11-28T20:50:10.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb70e702640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066470 0x7fb6ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb6f80b6580 con 0x7fb708157ca0 2023-11-28T20:50:10.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708157ca0 msgr2=0x7fb708142750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb6fe7fc640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708157ca0 0x7fb708142750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7080c62c0 tx=0x7fb6f801acb0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708157ca0 msgr2=0x7fb708142750 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:10.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.007+0000 7fb6fe7fc640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708157ca0 0x7fb708142750 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7080c62c0 tx=0x7fb6f801acb0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.011+0000 7fb70e702640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066470 0x7fb6ec068930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb7000073f0 tx=0x7fb70000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:10.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb710165640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708143490 0x7fb70815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb708158750 con 0x7fb708143490 2023-11-28T20:50:10.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb70d700640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708143490 0x7fb70815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb70d700640 1 -- 172.21.15.167:0/3133897246 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb70815bf50 con 0x7fb708143490 2023-11-28T20:50:10.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb70d700640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708143490 0x7fb70815a050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8019080 tx=0x7fb6f8019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:10.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80c3070 con 0x7fb708143490 2023-11-28T20:50:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4810 (secure 0 0 0) 0x7fb6f80b6db0 con 0x7fb708143490 2023-11-28T20:50:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708143490 msgr2=0x7fb70815a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb6fe7fc640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708143490 0x7fb70815a050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8019080 tx=0x7fb6f8019210 comp rx=0 tx=0).stop 2023-11-28T20:50:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb6fe7fc640 1 -- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708143490 msgr2=0x7fb70815a050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:10.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.015+0000 7fb6fe7fc640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb708143490 0x7fb70815a050 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.019 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 102, 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:10.020 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:50:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:50:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:50:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:10.021 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:10.022 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:50:10.023 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:50:10.024 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:10.025 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:10.026 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:10.027 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:10.028 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:10.029 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:10.030 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:10.031 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:50:10.032 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:10.033 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:10.034 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:10.035 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:10.035 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:10.035 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:10.035 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:10.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:10.035 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:50:10.035 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:50:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066470 msgr2=0x7fb6ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb710165640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6ec066470 0x7fb6ec068930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb7000073f0 tx=0x7fb70000b040 comp rx=0 tx=0).stop 2023-11-28T20:50:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70806a580 msgr2=0x7fb70806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb710165640 1 --2- 172.21.15.167:0/3133897246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb70806a580 0x7fb70806a960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb70400c490 tx=0x7fb70400c950 comp rx=0 tx=0).stop 2023-11-28T20:50:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb70e702640 1 -- 172.21.15.167:0/3133897246 reap_dead start 2023-11-28T20:50:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb70e702640 1 -- 172.21.15.167:0/3133897246 reap_dead start 2023-11-28T20:50:10.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 shutdown_connections 2023-11-28T20:50:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 >> 172.21.15.167:0/3133897246 conn(0x7fb7080cb1e0 msgr2=0x7fb708147f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 shutdown_connections 2023-11-28T20:50:10.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.019+0000 7fb710165640 1 -- 172.21.15.167:0/3133897246 wait complete. 2023-11-28T20:50:10.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:50:10.038 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:50:10.039 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:50:10.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.247+0000 7f56c29aa640 1 Processor -- start 2023-11-28T20:50:10.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56c29aa640 1 -- start start 2023-11-28T20:50:10.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56c29aa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f56bc06ec00 0x7f56bc15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56c29aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc0d0c10 0x7f56bc071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56c29aa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56bc15f0c0 con 0x7f56bc1584c0 2023-11-28T20:50:10.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56c29aa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc070e00 con 0x7f56bc06ec00 2023-11-28T20:50:10.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56c29aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1588a0 con 0x7f56bc0d0c10 2023-11-28T20:50:10.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56bbfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f56bc1584c0 0x7f56bc0d0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:33680/0 (socket says 172.21.15.167:33680) 2023-11-28T20:50:10.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56bbfff640 1 -- 172.21.15.167:0/2632886090 learned_addr learned my addr 172.21.15.167:0/2632886090 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:50:10.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56c0f47640 1 --2- 172.21.15.167:0/2632886090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc0d0c10 0x7f56bc071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.251+0000 7f56bb7fe640 1 --2- 172.21.15.167:0/2632886090 >> v2:172.21.15.178:3300/0 conn(0x7f56bc06ec00 0x7f56bc15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.255+0000 7f56c0f47640 1 -- 172.21.15.167:0/2632886090 >> v2:172.21.15.178:3300/0 conn(0x7f56bc06ec00 msgr2=0x7f56bc15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:10.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.255+0000 7f56c0f47640 1 --2- 172.21.15.167:0/2632886090 >> v2:172.21.15.178:3300/0 conn(0x7f56bc06ec00 0x7f56bc15eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.255+0000 7f56c0f47640 1 -- 172.21.15.167:0/2632886090 >> v1:172.21.15.167:6789/0 conn(0x7f56bc1584c0 legacy=0x7f56bc0d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:10.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.255+0000 7f56c0f47640 1 -- 172.21.15.167:0/2632886090 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc0cda50 con 0x7f56bc0d0c10 2023-11-28T20:50:10.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56c0f47640 1 --2- 172.21.15.167:0/2632886090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc0d0c10 0x7f56bc071290 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0097c0 tx=0x7f56ac01ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=164e768c19584100 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:10.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56baffd640 1 -- 172.21.15.167:0/2632886090 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0a88f0 con 0x7f56bc0d0c10 2023-11-28T20:50:10.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56baffd640 1 -- 172.21.15.167:0/2632886090 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac0a8a50 con 0x7f56bc0d0c10 2023-11-28T20:50:10.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56baffd640 1 -- 172.21.15.167:0/2632886090 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0a8de0 con 0x7f56bc0d0c10 2023-11-28T20:50:10.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56c29aa640 1 -- 172.21.15.167:0/2632886090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc0d0c10 msgr2=0x7f56bc071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56c29aa640 1 --2- 172.21.15.167:0/2632886090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc0d0c10 0x7f56bc071290 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0097c0 tx=0x7f56ac01ec30 comp rx=0 tx=0).stop 2023-11-28T20:50:10.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56c29aa640 1 -- 172.21.15.167:0/2632886090 shutdown_connections 2023-11-28T20:50:10.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56c29aa640 1 --2- 172.21.15.167:0/2632886090 >> v2:172.21.15.178:3300/0 conn(0x7f56bc06ec00 0x7f56bc15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56c29aa640 1 --2- 172.21.15.167:0/2632886090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc0d0c10 0x7f56bc071290 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56c29aa640 1 -- 172.21.15.167:0/2632886090 >> 172.21.15.167:0/2632886090 conn(0x7f56bc0d3c00 msgr2=0x7f56bc0d4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:10.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56c29aa640 1 -- 172.21.15.167:0/2632886090 shutdown_connections 2023-11-28T20:50:10.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.259+0000 7f56c29aa640 1 -- 172.21.15.167:0/2632886090 wait complete. 2023-11-28T20:50:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.263+0000 7f56c29aa640 1 Processor -- start 2023-11-28T20:50:10.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.263+0000 7f56c29aa640 1 -- start start 2023-11-28T20:50:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.263+0000 7f56c29aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56bc06ec00 0x7f56bc1f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.263+0000 7f56c29aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56bc0d0c10 0x7f56bc15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.263+0000 7f56c29aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc1584c0 0x7f56bc160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.263+0000 7f56c29aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1f7750 con 0x7f56bc06ec00 2023-11-28T20:50:10.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.263+0000 7f56c29aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1f3b80 con 0x7f56bc0d0c10 2023-11-28T20:50:10.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.263+0000 7f56c29aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1f3270 con 0x7f56bc1584c0 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56bbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56bc06ec00 0x7f56bc1f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56bbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56bc06ec00 0x7f56bc1f7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58264/0 (socket says 172.21.15.167:58264) 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56bbfff640 1 -- 172.21.15.167:0/1773951659 learned_addr learned my addr 172.21.15.167:0/1773951659 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56c0f47640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc1584c0 0x7f56bc160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56bbfff640 1 -- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc1584c0 msgr2=0x7f56bc160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56bbfff640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc1584c0 0x7f56bc160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56bbfff640 1 -- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56bc0d0c10 msgr2=0x7f56bc15a570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56bbfff640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56bc0d0c10 0x7f56bc15a570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56bbfff640 1 -- 172.21.15.167:0/1773951659 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac009420 con 0x7f56bc06ec00 2023-11-28T20:50:10.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56bbfff640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56bc06ec00 0x7f56bc1f7210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f56b400ba50 tx=0x7f56b400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:10.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56b8ff9640 1 -- 172.21.15.167:0/1773951659 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b400cbe0 con 0x7f56bc06ec00 2023-11-28T20:50:10.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56b8ff9640 1 -- 172.21.15.167:0/1773951659 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b400cd60 con 0x7f56bc06ec00 2023-11-28T20:50:10.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56b8ff9640 1 -- 172.21.15.167:0/1773951659 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b4014680 con 0x7f56bc06ec00 2023-11-28T20:50:10.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc0d1df0 con 0x7f56bc06ec00 2023-11-28T20:50:10.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc15e510 con 0x7f56bc06ec00 2023-11-28T20:50:10.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.267+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56bc04e850 con 0x7f56bc06ec00 2023-11-28T20:50:10.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.271+0000 7f56b8ff9640 1 -- 172.21.15.167:0/1773951659 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56b401d3b0 con 0x7f56bc06ec00 2023-11-28T20:50:10.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.271+0000 7f56b8ff9640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f56a8066540 0x7f56a8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:10.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.271+0000 7f56b8ff9640 1 -- 172.21.15.167:0/1773951659 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f56b4084230 con 0x7f56bc06ec00 2023-11-28T20:50:10.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.275+0000 7f56bb7fe640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f56a8066540 0x7f56a8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:10.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.279+0000 7f56bb7fe640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f56a8066540 0x7f56a8068a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0d37e0 tx=0x7f56b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:10.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.279+0000 7f56b8ff9640 1 -- 172.21.15.167:0/1773951659 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56b40512c0 con 0x7f56bc06ec00 2023-11-28T20:50:10.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.515+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f56bc0d2f70 con 0x7f56bc06ec00 2023-11-28T20:50:10.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56b8ff9640 1 -- 172.21.15.167:0/1773951659 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f56b4019080 con 0x7f56bc06ec00 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f56a8066540 msgr2=0x7f56a8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f56a8066540 0x7f56a8068a00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0d37e0 tx=0x7f56b0008040 comp rx=0 tx=0).stop 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56bc06ec00 msgr2=0x7f56bc1f7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56bc06ec00 0x7f56bc1f7210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f56b400ba50 tx=0x7f56b400bf10 comp rx=0 tx=0).stop 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 shutdown_connections 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f56a8066540 0x7f56a8068a00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56bc1584c0 0x7f56bc160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56bc0d0c10 0x7f56bc15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 --2- 172.21.15.167:0/1773951659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56bc06ec00 0x7f56bc1f7210 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:10.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.519+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 >> 172.21.15.167:0/1773951659 conn(0x7f56bc0d3c00 msgr2=0x7f56bc06d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.523+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 shutdown_connections 2023-11-28T20:50:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:10.523+0000 7f56c29aa640 1 -- 172.21.15.167:0/1773951659 wait complete. 2023-11-28T20:50:10.545 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:50:18.965 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:18.969 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:20.547 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:50:20.547 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:50:20.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f12485f8640 1 Processor -- start 2023-11-28T20:50:20.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f12485f8640 1 -- start start 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f12485f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1240151f60 0x7f12400c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f12485f8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f124006a580 0x7f124006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f12485f8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124015b220 con 0x7f12400c5c90 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f12485f8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12400c4da0 con 0x7f124006a580 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f12485f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c2df0 con 0x7f1240151f60 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f1246b95640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f124006a580 0x7f124006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f1246394640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1240151f60 0x7f12400c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f1246394640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1240151f60 0x7f12400c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:35060/0 (socket says 172.21.15.167:35060) 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f1246394640 1 -- 172.21.15.167:0/2088967165 learned_addr learned my addr 172.21.15.167:0/2088967165 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:20.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f1245b93640 1 --1- 172.21.15.167:0/2088967165 >> v1:172.21.15.178:6789/0 conn(0x7f12400c5c90 0x7f12400c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:45296/0 (socket says 172.21.15.167:45296) 2023-11-28T20:50:20.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f1246b95640 1 -- 172.21.15.167:0/2088967165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1240151f60 msgr2=0x7f12400c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:20.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f1246b95640 1 --2- 172.21.15.167:0/2088967165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1240151f60 0x7f12400c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f1246b95640 1 -- 172.21.15.167:0/2088967165 >> v1:172.21.15.178:6789/0 conn(0x7f12400c5c90 legacy=0x7f12400c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:20.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.699+0000 7f1246b95640 1 -- 172.21.15.167:0/2088967165 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400c60f0 con 0x7f124006a580 2023-11-28T20:50:20.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f1246b95640 1 --2- 172.21.15.167:0/2088967165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f124006a580 0x7f124006a9b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1238009dc0 tx=0x7f123801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c7c59125db0627 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:20.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f1245392640 1 -- 172.21.15.167:0/2088967165 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380a5870 con 0x7f124006a580 2023-11-28T20:50:20.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f1245392640 1 -- 172.21.15.167:0/2088967165 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380a59d0 con 0x7f124006a580 2023-11-28T20:50:20.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f1245392640 1 -- 172.21.15.167:0/2088967165 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380a5d60 con 0x7f124006a580 2023-11-28T20:50:20.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f12485f8640 1 -- 172.21.15.167:0/2088967165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f124006a580 msgr2=0x7f124006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:20.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f12485f8640 1 --2- 172.21.15.167:0/2088967165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f124006a580 0x7f124006a9b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1238009dc0 tx=0x7f123801c8a0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f12485f8640 1 -- 172.21.15.167:0/2088967165 shutdown_connections 2023-11-28T20:50:20.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f12485f8640 1 --2- 172.21.15.167:0/2088967165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f124006a580 0x7f124006a9b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f12485f8640 1 --2- 172.21.15.167:0/2088967165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1240151f60 0x7f12400c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f12485f8640 1 -- 172.21.15.167:0/2088967165 >> 172.21.15.167:0/2088967165 conn(0x7f12400cb1e0 msgr2=0x7f12400cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:20.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f12485f8640 1 -- 172.21.15.167:0/2088967165 shutdown_connections 2023-11-28T20:50:20.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.703+0000 7f12485f8640 1 -- 172.21.15.167:0/2088967165 wait complete. 2023-11-28T20:50:20.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f12485f8640 1 Processor -- start 2023-11-28T20:50:20.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f12485f8640 1 -- start start 2023-11-28T20:50:20.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f12485f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f124006a580 0x7f124013ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:20.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f12485f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12400c5c90 0x7f124014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:20.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f12485f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240151f60 0x7f124014ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:20.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f12485f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240157c10 con 0x7f1240151f60 2023-11-28T20:50:20.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f12485f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124014d960 con 0x7f12400c5c90 2023-11-28T20:50:20.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f12485f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124013d350 con 0x7f124006a580 2023-11-28T20:50:20.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f1246b95640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240151f60 0x7f124014ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:20.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f1246b95640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240151f60 0x7f124014ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35056/0 (socket says 172.21.15.167:35056) 2023-11-28T20:50:20.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f1246b95640 1 -- 172.21.15.167:0/399852078 learned_addr learned my addr 172.21.15.167:0/399852078 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:20.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f1245b93640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12400c5c90 0x7f124014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:20.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f1246b95640 1 -- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f124006a580 msgr2=0x7f124013ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:20.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f1246b95640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f124006a580 0x7f124013ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f1246b95640 1 -- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12400c5c90 msgr2=0x7f124014e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:20.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f1246b95640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12400c5c90 0x7f124014e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.707+0000 7f1246b95640 1 -- 172.21.15.167:0/399852078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1238009a70 con 0x7f1240151f60 2023-11-28T20:50:20.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.711+0000 7f1246b95640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240151f60 0x7f124014ed20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f12380b0040 tx=0x7f1238019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:20.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.711+0000 7f1236ffd640 1 -- 172.21.15.167:0/399852078 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380b9860 con 0x7f1240151f60 2023-11-28T20:50:20.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.711+0000 7f1236ffd640 1 -- 172.21.15.167:0/399852078 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380b99c0 con 0x7f1240151f60 2023-11-28T20:50:20.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.711+0000 7f1236ffd640 1 -- 172.21.15.167:0/399852078 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380b9d70 con 0x7f1240151f60 2023-11-28T20:50:20.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.711+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12401e9c10 con 0x7f1240151f60 2023-11-28T20:50:20.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.711+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12401ea1d0 con 0x7f1240151f60 2023-11-28T20:50:20.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.711+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12400682c0 con 0x7f1240151f60 2023-11-28T20:50:20.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.715+0000 7f1236ffd640 1 -- 172.21.15.167:0/399852078 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12380ad440 con 0x7f1240151f60 2023-11-28T20:50:20.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.719+0000 7f1236ffd640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f12240664c0 0x7f1224068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:20.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.719+0000 7f1236ffd640 1 -- 172.21.15.167:0/399852078 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f123811f870 con 0x7f1240151f60 2023-11-28T20:50:20.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.719+0000 7f1246394640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f12240664c0 0x7f1224068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:20.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.723+0000 7f1246394640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f12240664c0 0x7f1224068980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f123c006f50 tx=0x7f123c006ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:20.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.723+0000 7f1236ffd640 1 -- 172.21.15.167:0/399852078 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12380ec970 con 0x7f1240151f60 2023-11-28T20:50:20.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.939+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f124014e4f0 con 0x7f1240151f60 2023-11-28T20:50:20.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f1236ffd640 1 -- 172.21.15.167:0/399852078 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f12380eff90 con 0x7f1240151f60 2023-11-28T20:50:20.943 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:50:20.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f12240664c0 msgr2=0x7f1224068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:20.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f12240664c0 0x7f1224068980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f123c006f50 tx=0x7f123c006ea0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240151f60 msgr2=0x7f124014ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:20.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240151f60 0x7f124014ed20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f12380b0040 tx=0x7f1238019640 comp rx=0 tx=0).stop 2023-11-28T20:50:20.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 shutdown_connections 2023-11-28T20:50:20.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f12240664c0 0x7f1224068980 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1240151f60 0x7f124014ed20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12400c5c90 0x7f124014e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 --2- 172.21.15.167:0/399852078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f124006a580 0x7f124013ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:20.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 >> 172.21.15.167:0/399852078 conn(0x7f12400cb1e0 msgr2=0x7f124014f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:20.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 shutdown_connections 2023-11-28T20:50:20.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:20.943+0000 7f12485f8640 1 -- 172.21.15.167:0/399852078 wait complete. 2023-11-28T20:50:20.964 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:50:20.964 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:50:20.964 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:50:20.964 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:50:21.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.099+0000 7f6513cea640 1 Processor -- start 2023-11-28T20:50:21.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.099+0000 7f6513cea640 1 -- start start 2023-11-28T20:50:21.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6513cea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c150b40 0x7f650c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6513cea640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f650c0c6ff0 0x7f650c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6513cea640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f650c0c5be0 0x7f650c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6513cea640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c0c6ac0 con 0x7f650c0c5be0 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6513cea640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c0c6500 con 0x7f650c0c6ff0 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6513cea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0c67e0 con 0x7f650c150b40 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6512287640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f650c0c5be0 0x7f650c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6512287640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f650c0c5be0 0x7f650c06a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35062/0 (socket says 172.21.15.167:35062) 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6512287640 1 -- 172.21.15.167:0/1947581631 learned_addr learned my addr 172.21.15.167:0/1947581631 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6511285640 1 --2- 172.21.15.167:0/1947581631 >> v2:172.21.15.178:3300/0 conn(0x7f650c0c6ff0 0x7f650c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6511a86640 1 --2- 172.21.15.167:0/1947581631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c150b40 0x7f650c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6512287640 1 -- 172.21.15.167:0/1947581631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c150b40 msgr2=0x7f650c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:21.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6512287640 1 --2- 172.21.15.167:0/1947581631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c150b40 0x7f650c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6512287640 1 -- 172.21.15.167:0/1947581631 >> v2:172.21.15.178:3300/0 conn(0x7f650c0c6ff0 msgr2=0x7f650c0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:21.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6512287640 1 --2- 172.21.15.167:0/1947581631 >> v2:172.21.15.178:3300/0 conn(0x7f650c0c6ff0 0x7f650c0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.103+0000 7f6512287640 1 -- 172.21.15.167:0/1947581631 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c156a80 con 0x7f650c0c5be0 2023-11-28T20:50:21.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6512287640 1 --2- 172.21.15.167:0/1947581631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c0c5be0 0x7f650c06a580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f650c06ef70 tx=0x7f650401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca72445cfe1b3df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6510a84640 1 -- 172.21.15.167:0/1947581631 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040a5820 con 0x7f650c0c5be0 2023-11-28T20:50:21.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6510a84640 1 -- 172.21.15.167:0/1947581631 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65040a5980 con 0x7f650c0c5be0 2023-11-28T20:50:21.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6510a84640 1 -- 172.21.15.167:0/1947581631 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040a5d10 con 0x7f650c0c5be0 2023-11-28T20:50:21.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 -- 172.21.15.167:0/1947581631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c0c5be0 msgr2=0x7f650c06a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 --2- 172.21.15.167:0/1947581631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c0c5be0 0x7f650c06a580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f650c06ef70 tx=0x7f650401c9a0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 -- 172.21.15.167:0/1947581631 shutdown_connections 2023-11-28T20:50:21.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 --2- 172.21.15.167:0/1947581631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c0c5be0 0x7f650c06a580 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 --2- 172.21.15.167:0/1947581631 >> v2:172.21.15.178:3300/0 conn(0x7f650c0c6ff0 0x7f650c0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 --2- 172.21.15.167:0/1947581631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c150b40 0x7f650c157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 -- 172.21.15.167:0/1947581631 >> 172.21.15.167:0/1947581631 conn(0x7f650c0cb1e0 msgr2=0x7f650c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:21.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 -- 172.21.15.167:0/1947581631 shutdown_connections 2023-11-28T20:50:21.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 -- 172.21.15.167:0/1947581631 wait complete. 2023-11-28T20:50:21.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 Processor -- start 2023-11-28T20:50:21.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.107+0000 7f6513cea640 1 -- start start 2023-11-28T20:50:21.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c0c5be0 0x7f650c148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c6ff0 0x7f650c1f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c150b40 0x7f650c141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c147b10 con 0x7f650c150b40 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c14d650 con 0x7f650c0c5be0 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c147d60 con 0x7f650c0c6ff0 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6512287640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c150b40 0x7f650c141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6512287640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c150b40 0x7f650c141600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35068/0 (socket says 172.21.15.167:35068) 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6512287640 1 -- 172.21.15.167:0/3983333880 learned_addr learned my addr 172.21.15.167:0/3983333880 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6511285640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c6ff0 0x7f650c1f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6511a86640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c0c5be0 0x7f650c148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6512287640 1 -- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c6ff0 msgr2=0x7f650c1f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6512287640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c6ff0 0x7f650c1f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6512287640 1 -- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c0c5be0 msgr2=0x7f650c148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6512287640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c0c5be0 0x7f650c148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6512287640 1 -- 172.21.15.167:0/3983333880 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504009b30 con 0x7f650c150b40 2023-11-28T20:50:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6511a86640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c0c5be0 0x7f650c148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:50:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6511285640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c6ff0 0x7f650c1f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:50:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6512287640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c150b40 0x7f650c141600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f65040af040 tx=0x7f6504019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040b8670 con 0x7f650c150b40 2023-11-28T20:50:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65040b87d0 con 0x7f650c150b40 2023-11-28T20:50:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650c148040 con 0x7f650c150b40 2023-11-28T20:50:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040b8b60 con 0x7f650c150b40 2023-11-28T20:50:21.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c148600 con 0x7f650c150b40 2023-11-28T20:50:21.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c14cdd0 0x7f650c159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c074770 con 0x7f650c14cdd0 2023-11-28T20:50:21.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6511a86640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c14cdd0 0x7f650c159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6511a86640 1 -- 172.21.15.167:0/3983333880 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f650c147ed0 con 0x7f650c14cdd0 2023-11-28T20:50:21.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.111+0000 7f6511a86640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c14cdd0 0x7f650c159360 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f650800bfd0 tx=0x7f650800f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508014870 con 0x7f650c14cdd0 2023-11-28T20:50:21.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f65080149d0 con 0x7f650c14cdd0 2023-11-28T20:50:21.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c14cdd0 msgr2=0x7f650c159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f65027fc640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c14cdd0 0x7f650c159360 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f650800bfd0 tx=0x7f650800f910 comp rx=0 tx=0).stop 2023-11-28T20:50:21.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c14cdd0 msgr2=0x7f650c159360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:21.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f65027fc640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c14cdd0 0x7f650c159360 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65040b8cc0 con 0x7f650c150b40 2023-11-28T20:50:21.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f65027fc640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64f0066180 0x7f64f0068640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f650411f850 con 0x7f650c150b40 2023-11-28T20:50:21.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f6511a86640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64f0066180 0x7f64f0068640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.115+0000 7f6511a86640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64f0066180 0x7f64f0068640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f650800feb0 tx=0x7f6508014000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f6513cea640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c157b30 0x7f650c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c1481d0 con 0x7f650c157b30 2023-11-28T20:50:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f6511285640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c157b30 0x7f650c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f6511285640 1 -- 172.21.15.167:0/3983333880 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f650c15a770 con 0x7f650c157b30 2023-11-28T20:50:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f6511285640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c157b30 0x7f650c1598a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f650c14cca0 tx=0x7f64fc011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00fa30 con 0x7f650c157b30 2023-11-28T20:50:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5126 (secure 0 0 0) 0x7f64fc00fb90 con 0x7f650c157b30 2023-11-28T20:50:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c157b30 msgr2=0x7f650c1598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f65027fc640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c157b30 0x7f650c1598a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f650c14cca0 tx=0x7f64fc011c90 comp rx=0 tx=0).stop 2023-11-28T20:50:21.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f65027fc640 1 -- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c157b30 msgr2=0x7f650c1598a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:21.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f65027fc640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c157b30 0x7f650c1598a0 secure :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f650c14cca0 tx=0x7f64fc011c90 comp rx=0 tx=0).stop 2023-11-28T20:50:21.125 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 102, 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:50:21.126 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:50:21.127 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:50:21.128 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:50:21.129 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:21.130 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:50:21.131 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:21.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:21.133 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:21.134 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.135 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:50:21.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.137 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.140 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:50:21.140 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:50:21.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64f0066180 msgr2=0x7f64f0068640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.119+0000 7f6513cea640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64f0066180 0x7f64f0068640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f650800feb0 tx=0x7f6508014000 comp rx=0 tx=0).stop 2023-11-28T20:50:21.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.123+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c150b40 msgr2=0x7f650c141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.123+0000 7f6513cea640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c150b40 0x7f650c141600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f65040af040 tx=0x7f6504019740 comp rx=0 tx=0).stop 2023-11-28T20:50:21.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.123+0000 7f6512287640 1 -- 172.21.15.167:0/3983333880 reap_dead start 2023-11-28T20:50:21.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.123+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 shutdown_connections 2023-11-28T20:50:21.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.123+0000 7f6513cea640 1 --2- 172.21.15.167:0/3983333880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f650c150b40 0x7f650c141600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.123+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 >> 172.21.15.167:0/3983333880 conn(0x7f650c0cb1e0 msgr2=0x7f650c06ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:21.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.123+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 shutdown_connections 2023-11-28T20:50:21.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.123+0000 7f6513cea640 1 -- 172.21.15.167:0/3983333880 wait complete. 2023-11-28T20:50:21.142 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:50:21.142 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:50:21.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:50:21.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f144871d640 1 Processor -- start 2023-11-28T20:50:21.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f144871d640 1 -- start start 2023-11-28T20:50:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f144871d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14400c75c0 0x7f14400c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f144871d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f144006a580 0x7f144006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f144871d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144015b220 con 0x7f1440151f60 2023-11-28T20:50:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f144871d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400c4da0 con 0x7f144006a580 2023-11-28T20:50:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f144871d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c2df0 con 0x7f14400c75c0 2023-11-28T20:50:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f1446cba640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f144006a580 0x7f144006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f14464b9640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f1440151f60 0x7f14400c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:45302/0 (socket says 172.21.15.167:45302) 2023-11-28T20:50:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f14464b9640 1 -- 172.21.15.167:0/3628118275 learned_addr learned my addr 172.21.15.167:0/3628118275 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:50:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f1446cba640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f144006a580 0x7f144006a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35100/0 (socket says 172.21.15.167:35100) 2023-11-28T20:50:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f1445cb8640 1 --2- 172.21.15.167:0/3628118275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14400c75c0 0x7f14400c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f1446cba640 1 -- 172.21.15.167:0/3628118275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14400c75c0 msgr2=0x7f14400c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f1446cba640 1 --2- 172.21.15.167:0/3628118275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14400c75c0 0x7f14400c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f1446cba640 1 -- 172.21.15.167:0/3628118275 >> v1:172.21.15.178:6789/0 conn(0x7f1440151f60 legacy=0x7f14400c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.283+0000 7f1446cba640 1 -- 172.21.15.167:0/3628118275 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400c7a20 con 0x7f144006a580 2023-11-28T20:50:21.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f1446cba640 1 --2- 172.21.15.167:0/3628118275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f144006a580 0x7f144006a9b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1438009dc0 tx=0x7f143801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5be3e3622d999e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f14454b7640 1 -- 172.21.15.167:0/3628118275 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380a5870 con 0x7f144006a580 2023-11-28T20:50:21.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f14454b7640 1 -- 172.21.15.167:0/3628118275 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14380a59d0 con 0x7f144006a580 2023-11-28T20:50:21.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f14454b7640 1 -- 172.21.15.167:0/3628118275 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380a5d60 con 0x7f144006a580 2023-11-28T20:50:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f144871d640 1 -- 172.21.15.167:0/3628118275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f144006a580 msgr2=0x7f144006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f144871d640 1 --2- 172.21.15.167:0/3628118275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f144006a580 0x7f144006a9b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1438009dc0 tx=0x7f143801c8a0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f144871d640 1 -- 172.21.15.167:0/3628118275 shutdown_connections 2023-11-28T20:50:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f144871d640 1 --2- 172.21.15.167:0/3628118275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f144006a580 0x7f144006a9b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f144871d640 1 --2- 172.21.15.167:0/3628118275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14400c75c0 0x7f14400c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f144871d640 1 -- 172.21.15.167:0/3628118275 >> 172.21.15.167:0/3628118275 conn(0x7f14400cb1e0 msgr2=0x7f14400cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:21.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f144871d640 1 -- 172.21.15.167:0/3628118275 shutdown_connections 2023-11-28T20:50:21.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.287+0000 7f144871d640 1 -- 172.21.15.167:0/3628118275 wait complete. 2023-11-28T20:50:21.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 Processor -- start 2023-11-28T20:50:21.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 -- start start 2023-11-28T20:50:21.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144006a580 0x7f14400ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14400c75c0 0x7f14401568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1440151f60 0x7f1440070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144006ac00 con 0x7f1440151f60 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14401573a0 con 0x7f144006a580 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1440071ca0 con 0x7f14400c75c0 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1446cba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1440151f60 0x7f1440070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1446cba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1440151f60 0x7f1440070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35102/0 (socket says 172.21.15.167:35102) 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1446cba640 1 -- 172.21.15.167:0/3884762135 learned_addr learned my addr 172.21.15.167:0/3884762135 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1445cb8640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14400c75c0 0x7f14401568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f14464b9640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144006a580 0x7f14400ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1446cba640 1 -- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14400c75c0 msgr2=0x7f14401568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1446cba640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14400c75c0 0x7f14401568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1446cba640 1 -- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144006a580 msgr2=0x7f14400ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1446cba640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144006a580 0x7f14400ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1446cba640 1 -- 172.21.15.167:0/3884762135 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438009a70 con 0x7f1440151f60 2023-11-28T20:50:21.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f14464b9640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144006a580 0x7f14400ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:50:21.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1446cba640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1440151f60 0x7f1440070b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f143801a4d0 tx=0x7f1438019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380b9650 con 0x7f1440151f60 2023-11-28T20:50:21.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14380b97f0 con 0x7f1440151f60 2023-11-28T20:50:21.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1440071f80 con 0x7f1440151f60 2023-11-28T20:50:21.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380b9ba0 con 0x7f1440151f60 2023-11-28T20:50:21.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1440157680 con 0x7f1440151f60 2023-11-28T20:50:21.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1440156e30 0x7f1440071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440074770 con 0x7f1440156e30 2023-11-28T20:50:21.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.291+0000 7f14464b9640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1440156e30 0x7f1440071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f14464b9640 1 -- 172.21.15.167:0/3884762135 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1440072bd0 con 0x7f1440156e30 2023-11-28T20:50:21.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f14380b9d00 con 0x7f1440151f60 2023-11-28T20:50:21.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f14464b9640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1440156e30 0x7f1440071040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f143c000f70 tx=0x7f143c00e980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1436ffd640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f14240664a0 0x7f1424068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f143811f530 con 0x7f1440151f60 2023-11-28T20:50:21.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1445cb8640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f14240664a0 0x7f1424068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c005ad0 con 0x7f1440156e30 2023-11-28T20:50:21.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f143c005c30 con 0x7f1440156e30 2023-11-28T20:50:21.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1440156e30 msgr2=0x7f1440071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1436ffd640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1440156e30 0x7f1440071040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f143c000f70 tx=0x7f143c00e980 comp rx=0 tx=0).stop 2023-11-28T20:50:21.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1440156e30 msgr2=0x7f1440071040 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:21.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1436ffd640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1440156e30 0x7f1440071040 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.295+0000 7f1445cb8640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f14240664a0 0x7f1424068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1440068260 tx=0x7f1430008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.299+0000 7f144871d640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144015ac00 0x7f14401557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.299+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144015ba30 con 0x7f144015ac00 2023-11-28T20:50:21.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.299+0000 7f14464b9640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144015ac00 0x7f14401557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f14464b9640 1 -- 172.21.15.167:0/3884762135 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1440158750 con 0x7f144015ac00 2023-11-28T20:50:21.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f14464b9640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144015ac00 0x7f14401557c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f143c000f70 tx=0x7f143c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c0075a0 con 0x7f144015ac00 2023-11-28T20:50:21.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7f143c007700 con 0x7f144015ac00 2023-11-28T20:50:21.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144015ac00 msgr2=0x7f14401557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f1436ffd640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144015ac00 0x7f14401557c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f143c000f70 tx=0x7f143c005800 comp rx=0 tx=0).stop 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f1436ffd640 1 -- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144015ac00 msgr2=0x7f14401557c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f1436ffd640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f144015ac00 0x7f14401557c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 102, 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:50:21.305 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:21.306 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:21.307 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:21.308 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:21.309 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:21.310 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:21.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:21.313 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.314 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:21.316 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.317 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.317 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:50:21.317 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:50:21.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f14240664a0 msgr2=0x7f1424068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f144871d640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f14240664a0 0x7f1424068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1440068260 tx=0x7f1430008040 comp rx=0 tx=0).stop 2023-11-28T20:50:21.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1440151f60 msgr2=0x7f1440070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f144871d640 1 --2- 172.21.15.167:0/3884762135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1440151f60 0x7f1440070b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f143801a4d0 tx=0x7f1438019640 comp rx=0 tx=0).stop 2023-11-28T20:50:21.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f1446cba640 1 -- 172.21.15.167:0/3884762135 reap_dead start 2023-11-28T20:50:21.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f1446cba640 1 -- 172.21.15.167:0/3884762135 reap_dead start 2023-11-28T20:50:21.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 shutdown_connections 2023-11-28T20:50:21.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 >> 172.21.15.167:0/3884762135 conn(0x7f14400cb1e0 msgr2=0x7f14401480b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:21.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 shutdown_connections 2023-11-28T20:50:21.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.303+0000 7f144871d640 1 -- 172.21.15.167:0/3884762135 wait complete. 2023-11-28T20:50:21.323 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:50:21.323 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:50:21.323 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:50:21.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c595f5640 1 Processor -- start 2023-11-28T20:50:21.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c595f5640 1 -- start start 2023-11-28T20:50:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c595f5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7c5406ea60 0x7f7c5406dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c595f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c54140e90 0x7f7c5406e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c595f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540c5660 con 0x7f7c54140180 2023-11-28T20:50:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c595f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540c5380 con 0x7f7c54140e90 2023-11-28T20:50:21.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c595f5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c54158530 con 0x7f7c5406ea60 2023-11-28T20:50:21.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c537fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c54140e90 0x7f7c5406e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c537fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c54140e90 0x7f7c5406e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35114/0 (socket says 172.21.15.167:35114) 2023-11-28T20:50:21.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c52ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7c54140180 0x7f7c540c3040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36932/0 (socket says 172.21.15.167:36932) 2023-11-28T20:50:21.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c537fe640 1 -- 172.21.15.167:0/518891474 learned_addr learned my addr 172.21.15.167:0/518891474 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:21.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c4a7fc640 1 --2- 172.21.15.167:0/518891474 >> v2:172.21.15.178:3300/0 conn(0x7f7c5406ea60 0x7f7c5406dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c537fe640 1 -- 172.21.15.167:0/518891474 >> v2:172.21.15.178:3300/0 conn(0x7f7c5406ea60 msgr2=0x7f7c5406dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:21.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c537fe640 1 --2- 172.21.15.167:0/518891474 >> v2:172.21.15.178:3300/0 conn(0x7f7c5406ea60 0x7f7c5406dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c537fe640 1 -- 172.21.15.167:0/518891474 >> v1:172.21.15.167:6789/0 conn(0x7f7c54140180 legacy=0x7f7c540c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c537fe640 1 -- 172.21.15.167:0/518891474 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54158810 con 0x7f7c54140e90 2023-11-28T20:50:21.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.463+0000 7f7c4a7fc640 1 --2- 172.21.15.167:0/518891474 >> v2:172.21.15.178:3300/0 conn(0x7f7c5406ea60 0x7f7c5406dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:50:21.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c537fe640 1 --2- 172.21.15.167:0/518891474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c54140e90 0x7f7c5406e100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7c540c7bb0 tx=0x7f7c4c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3249528e0e98bbd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c527fc640 1 -- 172.21.15.167:0/518891474 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c0a5820 con 0x7f7c54140e90 2023-11-28T20:50:21.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c527fc640 1 -- 172.21.15.167:0/518891474 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c0a5980 con 0x7f7c54140e90 2023-11-28T20:50:21.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c527fc640 1 -- 172.21.15.167:0/518891474 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c0a5d10 con 0x7f7c54140e90 2023-11-28T20:50:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c595f5640 1 -- 172.21.15.167:0/518891474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c54140e90 msgr2=0x7f7c5406e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c595f5640 1 --2- 172.21.15.167:0/518891474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c54140e90 0x7f7c5406e100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7c540c7bb0 tx=0x7f7c4c01c940 comp rx=0 tx=0).stop 2023-11-28T20:50:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c595f5640 1 -- 172.21.15.167:0/518891474 shutdown_connections 2023-11-28T20:50:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c595f5640 1 --2- 172.21.15.167:0/518891474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c54140e90 0x7f7c5406e100 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c595f5640 1 --2- 172.21.15.167:0/518891474 >> v2:172.21.15.178:3300/0 conn(0x7f7c5406ea60 0x7f7c5406dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c595f5640 1 -- 172.21.15.167:0/518891474 >> 172.21.15.167:0/518891474 conn(0x7f7c540c7c50 msgr2=0x7f7c540c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c595f5640 1 -- 172.21.15.167:0/518891474 shutdown_connections 2023-11-28T20:50:21.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.467+0000 7f7c595f5640 1 -- 172.21.15.167:0/518891474 wait complete. 2023-11-28T20:50:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 Processor -- start 2023-11-28T20:50:21.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 -- start start 2023-11-28T20:50:21.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5406ea60 0x7f7c5413b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c54140180 0x7f7c541546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c54140e90 0x7f7c54137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5413bd70 con 0x7f7c5406ea60 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54156450 con 0x7f7c54140180 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54156730 con 0x7f7c54140e90 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c52ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5406ea60 0x7f7c5413b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c52ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5406ea60 0x7f7c5413b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35130/0 (socket says 172.21.15.167:35130) 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c52ffd640 1 -- 172.21.15.167:0/1700884488 learned_addr learned my addr 172.21.15.167:0/1700884488 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c4a7fc640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c54140180 0x7f7c541546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c537fe640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c54140e90 0x7f7c54137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c52ffd640 1 -- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c54140e90 msgr2=0x7f7c54137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c52ffd640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c54140e90 0x7f7c54137880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c52ffd640 1 -- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c54140180 msgr2=0x7f7c541546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c52ffd640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c54140180 0x7f7c541546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c52ffd640 1 -- 172.21.15.167:0/1700884488 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c009b30 con 0x7f7c5406ea60 2023-11-28T20:50:21.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c52ffd640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5406ea60 0x7f7c5413b830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00c490 tx=0x7f7c3c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c007480 con 0x7f7c5406ea60 2023-11-28T20:50:21.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0075e0 con 0x7f7c5406ea60 2023-11-28T20:50:21.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c54155890 con 0x7f7c5406ea60 2023-11-28T20:50:21.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c004a10 con 0x7f7c5406ea60 2023-11-28T20:50:21.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c54155e50 con 0x7f7c5406ea60 2023-11-28T20:50:21.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5406acb0 0x7f7c54137dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.471+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54074730 con 0x7f7c5406acb0 2023-11-28T20:50:21.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4a7fc640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5406acb0 0x7f7c54137dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4a7fc640 1 -- 172.21.15.167:0/1700884488 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c54140560 con 0x7f7c5406acb0 2023-11-28T20:50:21.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4a7fc640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5406acb0 0x7f7c54137dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7c540c7930 tx=0x7f7c4400f8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c3c004b70 con 0x7f7c5406ea60 2023-11-28T20:50:21.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4bfff640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c34066470 0x7f7c34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7c3c0836b0 con 0x7f7c5406ea60 2023-11-28T20:50:21.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44004020 con 0x7f7c5406acb0 2023-11-28T20:50:21.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7c44004180 con 0x7f7c5406acb0 2023-11-28T20:50:21.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5406acb0 msgr2=0x7f7c54137dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4bfff640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5406acb0 0x7f7c54137dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7c540c7930 tx=0x7f7c4400f8a0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5406acb0 msgr2=0x7f7c54137dc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:21.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c4bfff640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5406acb0 0x7f7c54137dc0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7c540c7930 tx=0x7f7c4400f8a0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c537fe640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c34066470 0x7f7c34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.475+0000 7f7c537fe640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c34066470 0x7f7c34068930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0ae000 tx=0x7f7c4c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5413a850 0x7f7c541f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c541556e0 con 0x7f7c5413a850 2023-11-28T20:50:21.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c4a7fc640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5413a850 0x7f7c541f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c4a7fc640 1 -- 172.21.15.167:0/1700884488 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7c5404e850 con 0x7f7c5413a850 2023-11-28T20:50:21.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c4a7fc640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5413a850 0x7f7c541f5c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c540c7930 tx=0x7f7c440046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44023070 con 0x7f7c5413a850 2023-11-28T20:50:21.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4811 (secure 0 0 0) 0x7f7c44014990 con 0x7f7c5413a850 2023-11-28T20:50:21.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5413a850 msgr2=0x7f7c541f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c4bfff640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5413a850 0x7f7c541f5c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c540c7930 tx=0x7f7c440046d0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c4bfff640 1 -- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5413a850 msgr2=0x7f7c541f5c40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:21.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c4bfff640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c5413a850 0x7f7c541f5c40 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c540c7930 tx=0x7f7c440046d0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.486 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:50:21.486 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 102, 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:50:21.487 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:50:21.488 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:50:21.490 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:21.491 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.492 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:50:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:50:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.493 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:21.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.496 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:50:21.497 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.498 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.499 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:50:21.500 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:50:21.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c34066470 msgr2=0x7f7c34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7c34066470 0x7f7c34068930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0ae000 tx=0x7f7c4c0a7070 comp rx=0 tx=0).stop 2023-11-28T20:50:21.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5406ea60 msgr2=0x7f7c5413b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 --2- 172.21.15.167:0/1700884488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5406ea60 0x7f7c5413b830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00c490 tx=0x7f7c3c00c950 comp rx=0 tx=0).stop 2023-11-28T20:50:21.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c537fe640 1 -- 172.21.15.167:0/1700884488 reap_dead start 2023-11-28T20:50:21.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c537fe640 1 -- 172.21.15.167:0/1700884488 reap_dead start 2023-11-28T20:50:21.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 shutdown_connections 2023-11-28T20:50:21.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 >> 172.21.15.167:0/1700884488 conn(0x7f7c540c7c50 msgr2=0x7f7c54138b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:21.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 shutdown_connections 2023-11-28T20:50:21.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.483+0000 7f7c595f5640 1 -- 172.21.15.167:0/1700884488 wait complete. 2023-11-28T20:50:21.504 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:50:21.504 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2023-11-28T20:50:21.505 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:50:21.505 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2023-11-28T20:50:21.505 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:50:21.505 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T20:50:21.505 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:50:21.525 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T20:50:21.525 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:50:21.525 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:50:21.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6c531d640 1 Processor -- start 2023-11-28T20:50:21.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6c531d640 1 -- start start 2023-11-28T20:50:21.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6c531d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c0153f40 0x7ff6c0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6c531d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff6c00caa60 0x7ff6c00c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6c531d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c00cb5c0 con 0x7ff6c00ca660 2023-11-28T20:50:21.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6c531d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c00b2c60 con 0x7ff6c00caa60 2023-11-28T20:50:21.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6c531d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00c4f00 con 0x7ff6c0153f40 2023-11-28T20:50:21.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6b67fc640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7ff6c00ca660 legacy=0x7ff6c00cf440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:50:21.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6bf7fe640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7ff6c00caa60 msgr2=0x7ff6c00c5950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:21.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6bf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff6c00caa60 0x7ff6c00c5950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:21.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6beffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c0153f40 0x7ff6c0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6beffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c0153f40 0x7ff6c0159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:35198/0 (socket says 172.21.15.167:35198) 2023-11-28T20:50:21.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.711+0000 7ff6beffd640 1 -- 172.21.15.167:0/935213535 learned_addr learned my addr 172.21.15.167:0/935213535 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:21.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.715+0000 7ff6beffd640 1 -- 172.21.15.167:0/935213535 >> v2:172.21.15.167:3300/0 conn(0x7ff6c00caa60 msgr2=0x7ff6c00c5950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:21.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.715+0000 7ff6beffd640 1 --2- 172.21.15.167:0/935213535 >> v2:172.21.15.167:3300/0 conn(0x7ff6c00caa60 0x7ff6c00c5950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.715+0000 7ff6beffd640 1 -- 172.21.15.167:0/935213535 >> v1:172.21.15.167:6789/0 conn(0x7ff6c00ca660 legacy=0x7ff6c00cf440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:21.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.715+0000 7ff6beffd640 1 -- 172.21.15.167:0/935213535 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c00c54c0 con 0x7ff6c0153f40 2023-11-28T20:50:21.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.715+0000 7ff6beffd640 1 --2- 172.21.15.167:0/935213535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c0153f40 0x7ff6c0159aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009e50 tx=0x7ff6b001c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=666c2639f2d46c12 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.715+0000 7ff6be7fc640 1 -- 172.21.15.167:0/935213535 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a5670 con 0x7ff6c0153f40 2023-11-28T20:50:21.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6be7fc640 1 -- 172.21.15.167:0/935213535 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b00a57d0 con 0x7ff6c0153f40 2023-11-28T20:50:21.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6be7fc640 1 -- 172.21.15.167:0/935213535 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a5b60 con 0x7ff6c0153f40 2023-11-28T20:50:21.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 -- 172.21.15.167:0/935213535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c0153f40 msgr2=0x7ff6c0159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 --2- 172.21.15.167:0/935213535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c0153f40 0x7ff6c0159aa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009e50 tx=0x7ff6b001c9f0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 -- 172.21.15.167:0/935213535 shutdown_connections 2023-11-28T20:50:21.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 --2- 172.21.15.167:0/935213535 >> v2:172.21.15.167:3300/0 conn(0x7ff6c00caa60 0x7ff6c00c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 --2- 172.21.15.167:0/935213535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c0153f40 0x7ff6c0159aa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 -- 172.21.15.167:0/935213535 >> 172.21.15.167:0/935213535 conn(0x7ff6c006b800 msgr2=0x7ff6c006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:21.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 -- 172.21.15.167:0/935213535 shutdown_connections 2023-11-28T20:50:21.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 -- 172.21.15.167:0/935213535 wait complete. 2023-11-28T20:50:21.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 Processor -- start 2023-11-28T20:50:21.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 -- start start 2023-11-28T20:50:21.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6c00ca660 0x7ff6c015ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c00caa60 0x7ff6c01f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c0153f40 0x7ff6c0150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01f3080 con 0x7ff6c0153f40 2023-11-28T20:50:21.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c015daf0 con 0x7ff6c00ca660 2023-11-28T20:50:21.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6c531d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c015ddd0 con 0x7ff6c00caa60 2023-11-28T20:50:21.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6bf7fe640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c0153f40 msgr2=0x7ff6c0150e50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:21.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6bf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c0153f40 0x7ff6c0150e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:21.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.719+0000 7ff6beffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6c00ca660 0x7ff6c015ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6beffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6c00ca660 0x7ff6c015ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:44106/0 (socket says 172.21.15.167:44106) 2023-11-28T20:50:21.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6beffd640 1 -- 172.21.15.167:0/1887160876 learned_addr learned my addr 172.21.15.167:0/1887160876 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6b67fc640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c00caa60 0x7ff6c01f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6beffd640 1 -- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c00caa60 msgr2=0x7ff6c01f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6beffd640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c00caa60 0x7ff6c01f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6beffd640 1 -- 172.21.15.167:0/1887160876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c0153f40 msgr2=0x7ff6c0150e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6beffd640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c0153f40 0x7ff6c0150e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6beffd640 1 -- 172.21.15.167:0/1887160876 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0009b30 con 0x7ff6c00ca660 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6beffd640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6c00ca660 0x7ff6c015ac60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00af040 tx=0x7ff6b0019790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6b7fff640 1 -- 172.21.15.167:0/1887160876 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00be070 con 0x7ff6c00ca660 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c01f3340 con 0x7ff6c00ca660 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6b7fff640 1 -- 172.21.15.167:0/1887160876 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b00b8440 con 0x7ff6c00ca660 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6b7fff640 1 -- 172.21.15.167:0/1887160876 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00b8810 con 0x7ff6c00ca660 2023-11-28T20:50:21.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c015c160 con 0x7ff6c00ca660 2023-11-28T20:50:21.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.723+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c015df60 con 0x7ff6c00ca660 2023-11-28T20:50:21.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.727+0000 7ff6b7fff640 1 -- 172.21.15.167:0/1887160876 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6b00c9080 con 0x7ff6c00ca660 2023-11-28T20:50:21.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.727+0000 7ff6b7fff640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff6a0066420 0x7ff6a00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:21.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.727+0000 7ff6b7fff640 1 -- 172.21.15.167:0/1887160876 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff6b011ea70 con 0x7ff6c00ca660 2023-11-28T20:50:21.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.727+0000 7ff6b67fc640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff6a0066420 0x7ff6a00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:21.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.727+0000 7ff6b67fc640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff6a0066420 0x7ff6a00688e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80093d0 tx=0x7ff6a8009360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:21.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.739+0000 7ff6b7fff640 1 -- 172.21.15.167:0/1887160876 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6b00ebb00 con 0x7ff6c00ca660 2023-11-28T20:50:21.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.943+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff6c015c410 con 0x7ff6c00ca660 2023-11-28T20:50:21.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6b7fff640 1 -- 172.21.15.167:0/1887160876 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7ff6b00ef120 con 0x7ff6c00ca660 2023-11-28T20:50:21.947 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:50:21.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff6a0066420 msgr2=0x7ff6a00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff6a0066420 0x7ff6a00688e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80093d0 tx=0x7ff6a8009360 comp rx=0 tx=0).stop 2023-11-28T20:50:21.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6c00ca660 msgr2=0x7ff6c015ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:21.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6c00ca660 0x7ff6c015ac60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00af040 tx=0x7ff6b0019790 comp rx=0 tx=0).stop 2023-11-28T20:50:21.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 shutdown_connections 2023-11-28T20:50:21.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff6a0066420 0x7ff6a00688e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6c0153f40 0x7ff6c0150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6c00caa60 0x7ff6c01f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 --2- 172.21.15.167:0/1887160876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6c00ca660 0x7ff6c015ac60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:21.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 >> 172.21.15.167:0/1887160876 conn(0x7ff6c006b800 msgr2=0x7ff6c00cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:21.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 shutdown_connections 2023-11-28T20:50:21.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:21.947+0000 7ff6c531d640 1 -- 172.21.15.167:0/1887160876 wait complete. 2023-11-28T20:50:24.969 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:50:25.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.135+0000 7fe9b0780640 1 Processor -- start 2023-11-28T20:50:25.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.135+0000 7fe9b0780640 1 -- start start 2023-11-28T20:50:25.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9b0780640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9a80cf860 0x7fe9a80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:25.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9b0780640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a815ac00 con 0x7fe9a8153ae0 2023-11-28T20:50:25.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9b0780640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a80cbd60 con 0x7fe9a80cfc40 2023-11-28T20:50:25.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9b0780640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a8159ff0 con 0x7fe9a80cf860 2023-11-28T20:50:25.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9ae51c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9a80cf860 0x7fe9a80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:25.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9ae51c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9a80cf860 0x7fe9a80cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:33894/0 (socket says 172.21.15.167:33894) 2023-11-28T20:50:25.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9ae51c640 1 -- 172.21.15.167:0/1714506759 learned_addr learned my addr 172.21.15.167:0/1714506759 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:25.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9aed1d640 1 -- 172.21.15.167:0/1714506759 >> v1:172.21.15.167:6789/0 conn(0x7fe9a8153ae0 legacy=0x7fe9a815d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:50:25.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9ae51c640 1 -- 172.21.15.167:0/1714506759 >> v1:172.21.15.178:6789/0 conn(0x7fe9a80cfc40 legacy=0x7fe9a80ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:25.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9ae51c640 1 -- 172.21.15.167:0/1714506759 >> v1:172.21.15.167:6789/0 conn(0x7fe9a8153ae0 legacy=0x7fe9a815d4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:25.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.139+0000 7fe9ae51c640 1 -- 172.21.15.167:0/1714506759 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a815a2d0 con 0x7fe9a80cf860 2023-11-28T20:50:25.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.147+0000 7fe9ae51c640 1 --2- 172.21.15.167:0/1714506759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a80cf860 0x7fe9a80cb770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009e50 tx=0x7fe9a001c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff78ea71b8eff324 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:25.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.147+0000 7fe9ad51a640 1 -- 172.21.15.167:0/1714506759 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a00a5880 con 0x7fe9a80cf860 2023-11-28T20:50:25.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.147+0000 7fe9ad51a640 1 -- 172.21.15.167:0/1714506759 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a00a59e0 con 0x7fe9a80cf860 2023-11-28T20:50:25.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.147+0000 7fe9ad51a640 1 -- 172.21.15.167:0/1714506759 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a00a5db0 con 0x7fe9a80cf860 2023-11-28T20:50:25.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.151+0000 7fe9b0780640 1 -- 172.21.15.167:0/1714506759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a80cf860 msgr2=0x7fe9a80cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:25.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.151+0000 7fe9b0780640 1 --2- 172.21.15.167:0/1714506759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a80cf860 0x7fe9a80cb770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009e50 tx=0x7fe9a001c9c0 comp rx=0 tx=0).stop 2023-11-28T20:50:25.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.151+0000 7fe9b0780640 1 -- 172.21.15.167:0/1714506759 shutdown_connections 2023-11-28T20:50:25.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.151+0000 7fe9b0780640 1 --2- 172.21.15.167:0/1714506759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a80cf860 0x7fe9a80cb770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:25.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.151+0000 7fe9b0780640 1 -- 172.21.15.167:0/1714506759 >> 172.21.15.167:0/1714506759 conn(0x7fe9a806c1f0 msgr2=0x7fe9a8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:25.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.151+0000 7fe9b0780640 1 -- 172.21.15.167:0/1714506759 shutdown_connections 2023-11-28T20:50:25.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.151+0000 7fe9b0780640 1 -- 172.21.15.167:0/1714506759 wait complete. 2023-11-28T20:50:25.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9b0780640 1 Processor -- start 2023-11-28T20:50:25.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9b0780640 1 -- start start 2023-11-28T20:50:25.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9b0780640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a80cf860 0x7fe9a813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:25.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9b0780640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cfc40 0x7fe9a813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9ae51c640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a80cf860 msgr2=0x7fe9a813c2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9ae51c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a80cf860 0x7fe9a813c2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9b0780640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8153ae0 0x7fe9a81584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9b0780640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8158090 con 0x7fe9a80cf860 2023-11-28T20:50:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9b0780640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80ce1e0 con 0x7fe9a8153ae0 2023-11-28T20:50:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9b0780640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80cd9d0 con 0x7fe9a80cfc40 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9aed1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8153ae0 0x7fe9a81584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9add1b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cfc40 0x7fe9a813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9aed1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8153ae0 0x7fe9a81584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:33900/0 (socket says 172.21.15.167:33900) 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9aed1d640 1 -- 172.21.15.167:0/3234379357 learned_addr learned my addr 172.21.15.167:0/3234379357 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9aed1d640 1 -- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cfc40 msgr2=0x7fe9a813c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.155+0000 7fe9aed1d640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cfc40 0x7fe9a813c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe9aed1d640 1 -- 172.21.15.167:0/3234379357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a80cf860 msgr2=0x7fe9a813c2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe9aed1d640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a80cf860 0x7fe9a813c2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe9aed1d640 1 -- 172.21.15.167:0/3234379357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a0009b30 con 0x7fe9a8153ae0 2023-11-28T20:50:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe9aed1d640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8153ae0 0x7fe9a81584b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400b440 tx=0x7fe9a400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe99affd640 1 -- 172.21.15.167:0/3234379357 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4003dd0 con 0x7fe9a8153ae0 2023-11-28T20:50:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe99affd640 1 -- 172.21.15.167:0/3234379357 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a40060d0 con 0x7fe9a8153ae0 2023-11-28T20:50:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a813a9c0 con 0x7fe9a8153ae0 2023-11-28T20:50:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe99affd640 1 -- 172.21.15.167:0/3234379357 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4006480 con 0x7fe9a8153ae0 2023-11-28T20:50:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a80cdc20 con 0x7fe9a8153ae0 2023-11-28T20:50:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.159+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a81581d0 con 0x7fe9a8153ae0 2023-11-28T20:50:25.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.163+0000 7fe99affd640 1 -- 172.21.15.167:0/3234379357 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe9a40065e0 con 0x7fe9a8153ae0 2023-11-28T20:50:25.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.163+0000 7fe99affd640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe98c066420 0x7fe98c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:25.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.163+0000 7fe99affd640 1 -- 172.21.15.167:0/3234379357 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe9a40835b0 con 0x7fe9a8153ae0 2023-11-28T20:50:25.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.163+0000 7fe9ae51c640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe98c066420 0x7fe98c0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:25.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.163+0000 7fe9ae51c640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe98c066420 0x7fe98c0688e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00ae000 tx=0x7fe9a00a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:25.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.179+0000 7fe99affd640 1 -- 172.21.15.167:0/3234379357 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9a81581d0 con 0x7fe9a8153ae0 2023-11-28T20:50:25.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe9a81581d0 con 0x7fe9a8153ae0 2023-11-28T20:50:25.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe99affd640 1 -- 172.21.15.167:0/3234379357 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fe9a4017630 con 0x7fe9a8153ae0 2023-11-28T20:50:25.468 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe98c066420 msgr2=0x7fe98c0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe98c066420 0x7fe98c0688e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00ae000 tx=0x7fe9a00a7070 comp rx=0 tx=0).stop 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8153ae0 msgr2=0x7fe9a81584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8153ae0 0x7fe9a81584b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400b440 tx=0x7fe9a400b900 comp rx=0 tx=0).stop 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 shutdown_connections 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe98c066420 0x7fe98c0688e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8153ae0 0x7fe9a81584b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cfc40 0x7fe9a813c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 --2- 172.21.15.167:0/3234379357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9a80cf860 0x7fe9a813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.467+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 >> 172.21.15.167:0/3234379357 conn(0x7fe9a806c1f0 msgr2=0x7fe9a8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.471+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 shutdown_connections 2023-11-28T20:50:25.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:25.471+0000 7fe9b0780640 1 -- 172.21.15.167:0/3234379357 wait complete. 2023-11-28T20:50:28.490 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:50:28.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb06e6c9640 1 Processor -- start 2023-11-28T20:50:28.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb06e6c9640 1 -- start start 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb06e6c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb06e6c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0680c4510 0x7fb06806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb06e6c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680c4940 con 0x7fb0680c6ff0 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb06e6c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680c62f0 con 0x7fb0680c4510 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb06e6c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c6ac0 con 0x7fb068150b40 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb05ffff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fb0680c6ff0 legacy=0x7fb0680c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb06cc66640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fb0680c4510 msgr2=0x7fb06806a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb06cc66640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0680c4510 0x7fb06806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb067fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb067fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:46336/0 (socket says 172.21.15.167:46336) 2023-11-28T20:50:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb067fff640 1 -- 172.21.15.167:0/2931022246 learned_addr learned my addr 172.21.15.167:0/2931022246 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb067fff640 1 -- 172.21.15.167:0/2931022246 >> v2:172.21.15.167:3300/0 conn(0x7fb0680c4510 msgr2=0x7fb06806a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb067fff640 1 --2- 172.21.15.167:0/2931022246 >> v2:172.21.15.167:3300/0 conn(0x7fb0680c4510 0x7fb06806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb067fff640 1 -- 172.21.15.167:0/2931022246 >> v1:172.21.15.167:6789/0 conn(0x7fb0680c6ff0 legacy=0x7fb0680c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.627+0000 7fb067fff640 1 -- 172.21.15.167:0/2931022246 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680c6500 con 0x7fb068150b40 2023-11-28T20:50:28.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb067fff640 1 --2- 172.21.15.167:0/2931022246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068157560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb058009870 tx=0x7fb05801c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a0a5020ae20c2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:28.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb0677fe640 1 -- 172.21.15.167:0/2931022246 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580ac620 con 0x7fb068150b40 2023-11-28T20:50:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb0677fe640 1 -- 172.21.15.167:0/2931022246 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0580ac780 con 0x7fb068150b40 2023-11-28T20:50:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb0677fe640 1 -- 172.21.15.167:0/2931022246 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580acb10 con 0x7fb068150b40 2023-11-28T20:50:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb06e6c9640 1 -- 172.21.15.167:0/2931022246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 msgr2=0x7fb068157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb06e6c9640 1 --2- 172.21.15.167:0/2931022246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068157560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb058009870 tx=0x7fb05801c4f0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb06e6c9640 1 -- 172.21.15.167:0/2931022246 shutdown_connections 2023-11-28T20:50:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb06e6c9640 1 --2- 172.21.15.167:0/2931022246 >> v2:172.21.15.167:3300/0 conn(0x7fb0680c4510 0x7fb06806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb06e6c9640 1 --2- 172.21.15.167:0/2931022246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068157560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb06e6c9640 1 -- 172.21.15.167:0/2931022246 >> 172.21.15.167:0/2931022246 conn(0x7fb0680cb1e0 msgr2=0x7fb0680cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb06e6c9640 1 -- 172.21.15.167:0/2931022246 shutdown_connections 2023-11-28T20:50:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.631+0000 7fb06e6c9640 1 -- 172.21.15.167:0/2931022246 wait complete. 2023-11-28T20:50:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06e6c9640 1 Processor -- start 2023-11-28T20:50:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06e6c9640 1 -- start start 2023-11-28T20:50:28.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06e6c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0680c4510 0x7fb0681f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06e6c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0680c6ff0 0x7fb0680705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06e6c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06e6c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0681f6ab0 con 0x7fb0680c6ff0 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06e6c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0681f6d70 con 0x7fb0680c4510 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06e6c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06814e210 con 0x7fb068150b40 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb05ffff640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0680c6ff0 msgr2=0x7fb0680705a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb05ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0680c6ff0 0x7fb0680705a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06cc66640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb067fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0680c4510 0x7fb0681f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06cc66640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068070ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:46338/0 (socket says 172.21.15.167:46338) 2023-11-28T20:50:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06cc66640 1 -- 172.21.15.167:0/3010395432 learned_addr learned my addr 172.21.15.167:0/3010395432 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06cc66640 1 -- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0680c4510 msgr2=0x7fb0681f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06cc66640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0680c4510 0x7fb0681f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06cc66640 1 -- 172.21.15.167:0/3010395432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0680c6ff0 msgr2=0x7fb0680705a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06cc66640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0680c6ff0 0x7fb0680705a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06cc66640 1 -- 172.21.15.167:0/3010395432 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0580094d0 con 0x7fb068150b40 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.635+0000 7fb06cc66640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068070ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb06000be60 tx=0x7fb06000bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.639+0000 7fb0657fa640 1 -- 172.21.15.167:0/3010395432 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060016430 con 0x7fb068150b40 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.639+0000 7fb0657fa640 1 -- 172.21.15.167:0/3010395432 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb060016590 con 0x7fb068150b40 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.639+0000 7fb0657fa640 1 -- 172.21.15.167:0/3010395432 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb060016980 con 0x7fb068150b40 2023-11-28T20:50:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.639+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06814e4f0 con 0x7fb068150b40 2023-11-28T20:50:28.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.639+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06814eab0 con 0x7fb068150b40 2023-11-28T20:50:28.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.639+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0680682c0 con 0x7fb068150b40 2023-11-28T20:50:28.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.639+0000 7fb0657fa640 1 -- 172.21.15.167:0/3010395432 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb060012020 con 0x7fb068150b40 2023-11-28T20:50:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.643+0000 7fb0657fa640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb048066420 0x7fb0480688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.643+0000 7fb0657fa640 1 -- 172.21.15.167:0/3010395432 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb060084a10 con 0x7fb068150b40 2023-11-28T20:50:28.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.643+0000 7fb067fff640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb048066420 0x7fb0480688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:28.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.643+0000 7fb067fff640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb048066420 0x7fb0480688e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb0580ae000 tx=0x7fb0580a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:28.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.655+0000 7fb0657fa640 1 -- 172.21.15.167:0/3010395432 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb060051ba0 con 0x7fb068150b40 2023-11-28T20:50:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.855+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb068067c40 con 0x7fb068150b40 2023-11-28T20:50:28.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb0657fa640 1 -- 172.21.15.167:0/3010395432 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fb06001b020 con 0x7fb068150b40 2023-11-28T20:50:28.859 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:50:28.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb048066420 msgr2=0x7fb0480688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:28.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb048066420 0x7fb0480688e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb0580ae000 tx=0x7fb0580a7000 comp rx=0 tx=0).stop 2023-11-28T20:50:28.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 msgr2=0x7fb068070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:28.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068070ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb06000be60 tx=0x7fb06000bf50 comp rx=0 tx=0).stop 2023-11-28T20:50:28.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 shutdown_connections 2023-11-28T20:50:28.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb048066420 0x7fb0480688e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb068150b40 0x7fb068070ae0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0680c6ff0 0x7fb0680705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 --2- 172.21.15.167:0/3010395432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0680c4510 0x7fb0681f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:28.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 >> 172.21.15.167:0/3010395432 conn(0x7fb0680cb1e0 msgr2=0x7fb068160b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:28.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 shutdown_connections 2023-11-28T20:50:28.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:28.859+0000 7fb06e6c9640 1 -- 172.21.15.167:0/3010395432 wait complete. 2023-11-28T20:50:31.881 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:50:32.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26f1df640 1 Processor -- start 2023-11-28T20:50:32.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26f1df640 1 -- start start 2023-11-28T20:50:32.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26f1df640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:32.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26f1df640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:32.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26f1df640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680c6ac0 con 0x7fa2680c5be0 2023-11-28T20:50:32.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26f1df640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680c6500 con 0x7fa268150b40 2023-11-28T20:50:32.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26f1df640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680c67e0 con 0x7fa2680c6ff0 2023-11-28T20:50:32.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa267fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:32.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26cf7b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:32.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa267fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:46342/0 (socket says 172.21.15.167:46342) 2023-11-28T20:50:32.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 learned_addr learned my addr 172.21.15.167:0/3209726919 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:32.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 msgr2=0x7fa2680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:50:32.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 msgr2=0x7fa2680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:50:32.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:50:32.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 msgr2=0x7fa268157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:50:32.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:32.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 msgr2=0x7fa268157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:50:32.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:50:32.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.027+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:32.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 msgr2=0x7fa2680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:50:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 msgr2=0x7fa2680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:50:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:50:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 msgr2=0x7fa268157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:50:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 msgr2=0x7fa268157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:50:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:50:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:50:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.231+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:50:32.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:32.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 msgr2=0x7fa2680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:50:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 msgr2=0x7fa2680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:50:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:50:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 msgr2=0x7fa268157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:50:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 msgr2=0x7fa268157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:50:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:50:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:50:32.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:32.635+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 msgr2=0x7fa268157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 msgr2=0x7fa268157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 msgr2=0x7fa2680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 msgr2=0x7fa2680c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:33.439+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:50:35.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 msgr2=0x7fa2680c4510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:35.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa2667fc640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2680c6ff0 0x7fa2680c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:35.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 msgr2=0x7fa268157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:35.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa2667fc640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.178:3300/0 conn(0x7fa268150b40 0x7fa268157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:35.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 >> v1:172.21.15.178:6789/0 conn(0x7fa2680c5be0 legacy=0x7fa26806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa2667fc640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 0x7fa24c005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa268156a80 con 0x7fa24c006180 2023-11-28T20:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680c6500 con 0x7fa24c0036d0 2023-11-28T20:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 msgr2=0x7fa24c005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 0x7fa24c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.031+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> v1:172.21.15.167:6789/0 conn(0x7fa24c006180 legacy=0x7fa24c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:50:35.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.235+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 msgr2=0x7fa24c005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:35.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.235+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 0x7fa24c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:50:35.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.235+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> v1:172.21.15.167:6789/0 conn(0x7fa24c006180 legacy=0x7fa24c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.639+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 msgr2=0x7fa24c005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.639+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> v1:172.21.15.167:6789/0 conn(0x7fa24c006180 legacy=0x7fa24c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:35.639+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 0x7fa24c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:50:36.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:36.443+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 msgr2=0x7fa24c005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:36.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:36.443+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> v1:172.21.15.167:6789/0 conn(0x7fa24c006180 legacy=0x7fa24c008640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:50:36.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:36.443+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 0x7fa24c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:50:38.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 msgr2=0x7fa24c005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:38.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa2667fc640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c0036d0 0x7fa24c005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 >> v1:172.21.15.167:6789/0 conn(0x7fa24c006180 legacy=0x7fa24c008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:38.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa26d77c640 1 -- 172.21.15.167:0/3209726919 reap_dead start 2023-11-28T20:50:38.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa2667fc640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c00aa80 0x7fa24c0065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c00af00 con 0x7fa24c009e80 2023-11-28T20:50:38.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa268156a80 con 0x7fa24c005c90 2023-11-28T20:50:38.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa2667fc640 1 -- 172.21.15.167:0/3209726919 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680c6500 con 0x7fa24c00aa80 2023-11-28T20:50:38.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c00aa80 msgr2=0x7fa24c0065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:38.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa26cf7b640 1 -- 172.21.15.167:0/3209726919 >> v1:172.21.15.167:6789/0 conn(0x7fa24c009e80 legacy=0x7fa24c00a280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:50:38.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.027+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c00aa80 0x7fa24c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:38.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726641100 0 0) 0x7fa268156a80 con 0x7fa24c005c90 2023-11-28T20:50:38.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa258003530 con 0x7fa24c005c90 2023-11-28T20:50:38.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 925294036 0 0) 0x7fa258003530 con 0x7fa24c005c90 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c00aa80 msgr2=0x7fa24c0065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 --2- 172.21.15.167:0/3209726919 >> v2:172.21.15.167:3300/0 conn(0x7fa24c00aa80 0x7fa24c0065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 >> v1:172.21.15.167:6789/0 conn(0x7fa24c009e80 legacy=0x7fa24c00a280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c009540 con 0x7fa24c005c90 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fa2600018b0 con 0x7fa24c005c90 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 >> v1:172.21.15.178:6789/0 conn(0x7fa24c005c90 legacy=0x7fa24c008bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa258003980 0x7fa258003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2580047d0 0x7fa258004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2580052b0 0x7fa25800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680c6500 con 0x7fa2580052b0 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25800c200 con 0x7fa2580047d0 2023-11-28T20:50:38.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25800c3c0 con 0x7fa258003980 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa26d77c640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2580052b0 msgr2=0x7fa25800b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa26d77c640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2580052b0 0x7fa25800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2580047d0 0x7fa258004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa258003980 0x7fa258003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa258003980 msgr2=0x7fa258003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa258003980 0x7fa258003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2580052b0 msgr2=0x7fa25800b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2580052b0 0x7fa25800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa267fff640 1 -- 172.21.15.167:0/3209726919 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258003530 con 0x7fa2580047d0 2023-11-28T20:50:38.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.031+0000 7fa26d77c640 1 -- 172.21.15.167:0/3209726919 reap_dead start 2023-11-28T20:50:38.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa267fff640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2580047d0 0x7fa258004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00ae60 tx=0x7fa25401f980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=745b8fd17d1186a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540a8880 con 0x7fa2580047d0 2023-11-28T20:50:38.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2540ac070 con 0x7fa2580047d0 2023-11-28T20:50:38.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa2677fe640 1 -- 172.21.15.167:0/3209726919 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540a8c40 con 0x7fa2580047d0 2023-11-28T20:50:38.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa26f1df640 1 -- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2580047d0 msgr2=0x7fa258004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa26f1df640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2580047d0 0x7fa258004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00ae60 tx=0x7fa25401f980 comp rx=0 tx=0).stop 2023-11-28T20:50:38.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa26f1df640 1 -- 172.21.15.167:0/3209726919 shutdown_connections 2023-11-28T20:50:38.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa26f1df640 1 --2- 172.21.15.167:0/3209726919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2580047d0 0x7fa258004c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa26f1df640 1 -- 172.21.15.167:0/3209726919 >> 172.21.15.167:0/3209726919 conn(0x7fa2680cb1e0 msgr2=0x7fa2680cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:38.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa26f1df640 1 -- 172.21.15.167:0/3209726919 shutdown_connections 2023-11-28T20:50:38.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.035+0000 7fa26f1df640 1 -- 172.21.15.167:0/3209726919 wait complete. 2023-11-28T20:50:38.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26f1df640 1 Processor -- start 2023-11-28T20:50:38.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26f1df640 1 -- start start 2023-11-28T20:50:38.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26f1df640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2580047d0 0x7fa2681582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26f1df640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa26814b500 0x7fa2681f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26f1df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2681f29a0 0x7fa2681489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26f1df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268158d20 con 0x7fa2681f29a0 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26f1df640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2681f68c0 con 0x7fa26814b500 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26f1df640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2681517f0 con 0x7fa2580047d0 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26d77c640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2681f29a0 msgr2=0x7fa2681489f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26d77c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2681f29a0 0x7fa2681489f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa267fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa26814b500 0x7fa2681f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa26cf7b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2580047d0 0x7fa2681582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa267fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa26814b500 0x7fa2681f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:50642/0 (socket says 172.21.15.167:50642) 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa267fff640 1 -- 172.21.15.167:0/1058977024 learned_addr learned my addr 172.21.15.167:0/1058977024 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa267fff640 1 -- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2580047d0 msgr2=0x7fa2681582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa267fff640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2580047d0 0x7fa2681582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa267fff640 1 -- 172.21.15.167:0/1058977024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2681f29a0 msgr2=0x7fa2681489f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:50:38.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa267fff640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2681f29a0 0x7fa2681489f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.039+0000 7fa267fff640 1 -- 172.21.15.167:0/1058977024 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2681f5b00 con 0x7fa26814b500 2023-11-28T20:50:38.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.043+0000 7fa267fff640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa26814b500 0x7fa2681f2460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa254016090 tx=0x7fa25401c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.043+0000 7fa2657fa640 1 -- 172.21.15.167:0/1058977024 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540a8880 con 0x7fa26814b500 2023-11-28T20:50:38.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.043+0000 7fa2657fa640 1 -- 172.21.15.167:0/1058977024 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254000e90 con 0x7fa26814b500 2023-11-28T20:50:38.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.043+0000 7fa2657fa640 1 -- 172.21.15.167:0/1058977024 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540a8c00 con 0x7fa26814b500 2023-11-28T20:50:38.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.043+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2681f5de0 con 0x7fa26814b500 2023-11-28T20:50:38.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.043+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2681f63a0 con 0x7fa26814b500 2023-11-28T20:50:38.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.043+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2680682c0 con 0x7fa26814b500 2023-11-28T20:50:38.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.043+0000 7fa2657fa640 1 -- 172.21.15.167:0/1058977024 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2540c5430 con 0x7fa26814b500 2023-11-28T20:50:38.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.047+0000 7fa2657fa640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa24c067f00 0x7fa24c06a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.047+0000 7fa2657fa640 1 -- 172.21.15.167:0/1058977024 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa25411e9b0 con 0x7fa26814b500 2023-11-28T20:50:38.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.047+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa24c067f00 0x7fa24c06a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.047+0000 7fa26cf7b640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa24c067f00 0x7fa24c06a3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00a010 tx=0x7fa25c019040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.055+0000 7fa2657fa640 1 -- 172.21.15.167:0/1058977024 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2540eba20 con 0x7fa26814b500 2023-11-28T20:50:38.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.271+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa268075c90 con 0x7fa26814b500 2023-11-28T20:50:38.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.271+0000 7fa2657fa640 1 -- 172.21.15.167:0/1058977024 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fa2540ae620 con 0x7fa26814b500 2023-11-28T20:50:38.273 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.271+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa24c067f00 msgr2=0x7fa24c06a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.271+0000 7fa26f1df640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa24c067f00 0x7fa24c06a3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00a010 tx=0x7fa25c019040 comp rx=0 tx=0).stop 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.271+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa26814b500 msgr2=0x7fa2681f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.271+0000 7fa26f1df640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa26814b500 0x7fa2681f2460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa254016090 tx=0x7fa25401c720 comp rx=0 tx=0).stop 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.275+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 shutdown_connections 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.275+0000 7fa26f1df640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa24c067f00 0x7fa24c06a3c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.275+0000 7fa26f1df640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2681f29a0 0x7fa2681489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.275+0000 7fa26f1df640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa26814b500 0x7fa2681f2460 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.275+0000 7fa26f1df640 1 --2- 172.21.15.167:0/1058977024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2580047d0 0x7fa2681582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.275+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 >> 172.21.15.167:0/1058977024 conn(0x7fa2680cb1e0 msgr2=0x7fa2680cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:38.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.275+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 shutdown_connections 2023-11-28T20:50:38.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.275+0000 7fa26f1df640 1 -- 172.21.15.167:0/1058977024 wait complete. 2023-11-28T20:50:38.294 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:50:38.294 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:50:38.294 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:50:38.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07b152a640 1 Processor -- start 2023-11-28T20:50:38.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07b152a640 1 -- start start 2023-11-28T20:50:38.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07b152a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac153f40 0x7f07ac159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07b152a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ac0cb5c0 con 0x7f07ac0ca660 2023-11-28T20:50:38.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07b152a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ac0c4f00 con 0x7f07ac0caa60 2023-11-28T20:50:38.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07b152a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0b2c60 con 0x7f07ac153f40 2023-11-28T20:50:38.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07aa7fc640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f07ac0ca660 legacy=0x7f07ac0cf440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:50:38.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07ab7fe640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f07ac0caa60 0x7f07ac0c5950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:33208/0 (socket says 172.21.15.167:33208) 2023-11-28T20:50:38.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07ab7fe640 1 -- 172.21.15.167:0/2217132800 learned_addr learned my addr 172.21.15.167:0/2217132800 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:50:38.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07aaffd640 1 --2- 172.21.15.167:0/2217132800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac153f40 0x7f07ac159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07a9ffb640 1 -- 172.21.15.167:0/2217132800 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580689998 0 0) 0x7f07ac0c4f00 con 0x7f07ac0caa60 2023-11-28T20:50:38.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07a9ffb640 1 -- 172.21.15.167:0/2217132800 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0794003530 con 0x7f07ac0caa60 2023-11-28T20:50:38.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07aaffd640 1 -- 172.21.15.167:0/2217132800 >> v1:172.21.15.178:6789/0 conn(0x7f07ac0caa60 legacy=0x7f07ac0c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07aaffd640 1 -- 172.21.15.167:0/2217132800 >> v1:172.21.15.167:6789/0 conn(0x7f07ac0ca660 legacy=0x7f07ac0cf440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:38.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.435+0000 7f07aaffd640 1 -- 172.21.15.167:0/2217132800 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac0c54c0 con 0x7f07ac153f40 2023-11-28T20:50:38.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07aaffd640 1 --2- 172.21.15.167:0/2217132800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac153f40 0x7f07ac159aa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f079c0097f0 tx=0x7f079c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37e4b1052eb1b8b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07a9ffb640 1 -- 172.21.15.167:0/2217132800 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0ab600 con 0x7f07ac153f40 2023-11-28T20:50:38.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07a9ffb640 1 -- 172.21.15.167:0/2217132800 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c0a7050 con 0x7f07ac153f40 2023-11-28T20:50:38.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07a9ffb640 1 -- 172.21.15.167:0/2217132800 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0ab980 con 0x7f07ac153f40 2023-11-28T20:50:38.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07b152a640 1 -- 172.21.15.167:0/2217132800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac153f40 msgr2=0x7f07ac159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07b152a640 1 --2- 172.21.15.167:0/2217132800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac153f40 0x7f07ac159aa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f079c0097f0 tx=0x7f079c01c480 comp rx=0 tx=0).stop 2023-11-28T20:50:38.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07b152a640 1 -- 172.21.15.167:0/2217132800 shutdown_connections 2023-11-28T20:50:38.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07b152a640 1 --2- 172.21.15.167:0/2217132800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac153f40 0x7f07ac159aa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07b152a640 1 -- 172.21.15.167:0/2217132800 >> 172.21.15.167:0/2217132800 conn(0x7f07ac06b800 msgr2=0x7f07ac06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:38.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07b152a640 1 -- 172.21.15.167:0/2217132800 shutdown_connections 2023-11-28T20:50:38.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.439+0000 7f07b152a640 1 -- 172.21.15.167:0/2217132800 wait complete. 2023-11-28T20:50:38.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07b152a640 1 Processor -- start 2023-11-28T20:50:38.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07b152a640 1 -- start start 2023-11-28T20:50:38.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07b152a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac0ca660 0x7f07ac1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07b152a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac0caa60 0x7f07ac143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07b152a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07ac153f40 0x7f07ac140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07b152a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac154b60 con 0x7f07ac153f40 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07b152a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac1448b0 con 0x7f07ac0caa60 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07b152a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac154600 con 0x7f07ac0ca660 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07ab7fe640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07ac153f40 msgr2=0x7f07ac140d60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07ab7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07ac153f40 0x7f07ac140d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07aa7fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac0caa60 0x7f07ac143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac0ca660 0x7f07ac1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07aa7fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac0caa60 0x7f07ac143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:50644/0 (socket says 172.21.15.167:50644) 2023-11-28T20:50:38.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07aa7fc640 1 -- 172.21.15.167:0/2490102282 learned_addr learned my addr 172.21.15.167:0/2490102282 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07aa7fc640 1 -- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac0ca660 msgr2=0x7f07ac1570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07aa7fc640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07ac0ca660 0x7f07ac1570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07aa7fc640 1 -- 172.21.15.167:0/2490102282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07ac153f40 msgr2=0x7f07ac140d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07aa7fc640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07ac153f40 0x7f07ac140d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.443+0000 7f07aa7fc640 1 -- 172.21.15.167:0/2490102282 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c009420 con 0x7f07ac0caa60 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07aa7fc640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac0caa60 0x7f07ac143ef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f07a000b530 tx=0x7f07a000b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0003dd0 con 0x7f07ac0caa60 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a0005070 con 0x7f07ac0caa60 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac1569b0 con 0x7f07ac0caa60 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0005420 con 0x7f07ac0caa60 2023-11-28T20:50:38.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac1563f0 con 0x7f07ac0caa60 2023-11-28T20:50:38.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07b152a640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac153450 0x7f07ac141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac072740 con 0x7f07ac153450 2023-11-28T20:50:38.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07aaffd640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac153450 0x7f07ac141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07aaffd640 1 -- 172.21.15.167:0/2490102282 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07ac159280 con 0x7f07ac153450 2023-11-28T20:50:38.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07a0005580 con 0x7f07ac0caa60 2023-11-28T20:50:38.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07aaffd640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac153450 0x7f07ac141be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0cd030 tx=0x7f079c019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.447+0000 7f07937fe640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0798066420 0x7f07980688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.451+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f07a0084000 con 0x7f07ac0caa60 2023-11-28T20:50:38.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.451+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c004220 con 0x7f07ac153450 2023-11-28T20:50:38.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.451+0000 7f07ab7fe640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0798066420 0x7f07980688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.451+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f079c0ba070 con 0x7f07ac153450 2023-11-28T20:50:38.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.451+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac153450 msgr2=0x7f07ac141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.451+0000 7f07937fe640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac153450 0x7f07ac141be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0cd030 tx=0x7f079c019220 comp rx=0 tx=0).stop 2023-11-28T20:50:38.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.451+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac153450 msgr2=0x7f07ac141be0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:38.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.451+0000 7f07937fe640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac153450 0x7f07ac141be0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.451+0000 7f07ab7fe640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0798066420 0x7f07980688e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0cae90 tx=0x7f07a4001660 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.455+0000 7f07b152a640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac1412a0 0x7f07ac1422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.455+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac15a8e0 con 0x7f07ac1412a0 2023-11-28T20:50:38.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.455+0000 7f07aaffd640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac1412a0 0x7f07ac1422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.455+0000 7f07aaffd640 1 -- 172.21.15.167:0/2490102282 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f07ac04e850 con 0x7f07ac1412a0 2023-11-28T20:50:38.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.455+0000 7f07aaffd640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac1412a0 0x7f07ac1422a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f079c01a0b0 tx=0x7f079c0a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c0c5070 con 0x7f07ac1412a0 2023-11-28T20:50:38.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4801 (secure 0 0 0) 0x7f079c003db0 con 0x7f07ac1412a0 2023-11-28T20:50:38.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac1412a0 msgr2=0x7f07ac1422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07937fe640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac1412a0 0x7f07ac1422a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f079c01a0b0 tx=0x7f079c0a8000 comp rx=0 tx=0).stop 2023-11-28T20:50:38.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07937fe640 1 -- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac1412a0 msgr2=0x7f07ac1422a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:38.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07937fe640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac1412a0 0x7f07ac1422a0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f079c01a0b0 tx=0x7f079c0a8000 comp rx=0 tx=0).stop 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 104, 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:50:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:50:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:50:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:50:38.474 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0798066420 msgr2=0x7f07980688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07b152a640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0798066420 0x7f07980688e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0cae90 tx=0x7f07a4001660 comp rx=0 tx=0).stop 2023-11-28T20:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac0caa60 msgr2=0x7f07ac143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07b152a640 1 --2- 172.21.15.167:0/2490102282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07ac0caa60 0x7f07ac143ef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f07a000b530 tx=0x7f07a000b9f0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07ab7fe640 1 -- 172.21.15.167:0/2490102282 reap_dead start 2023-11-28T20:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07ab7fe640 1 -- 172.21.15.167:0/2490102282 reap_dead start 2023-11-28T20:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 shutdown_connections 2023-11-28T20:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 >> 172.21.15.167:0/2490102282 conn(0x7f07ac06b800 msgr2=0x7f07ac1579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 shutdown_connections 2023-11-28T20:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.459+0000 7f07b152a640 1 -- 172.21.15.167:0/2490102282 wait complete. 2023-11-28T20:50:38.478 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:50:38.478 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:50:38.478 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:50:38.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef47501640 1 Processor -- start 2023-11-28T20:50:38.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef47501640 1 -- start start 2023-11-28T20:50:38.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef47501640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef40151f60 0x7fef400c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef47501640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 0x7fef400c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef47501640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fef4006a580 0x7fef4006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef47501640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400c4da0 con 0x7fef4006a580 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef47501640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4015b220 con 0x7fef40151f60 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef47501640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef400c60f0 con 0x7fef400c5c90 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef45a9e640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fef4006a580 msgr2=0x7fef4006a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef45a9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fef4006a580 0x7fef4006a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef4529d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef40151f60 0x7fef400c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef44a9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 0x7fef400c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef44a9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 0x7fef400c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:55650/0 (socket says 172.21.15.167:55650) 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef4529d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef40151f60 0x7fef400c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:50664/0 (socket says 172.21.15.167:50664) 2023-11-28T20:50:38.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef44a9c640 1 -- 172.21.15.167:0/286771466 learned_addr learned my addr 172.21.15.167:0/286771466 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:38.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef4529d640 1 -- 172.21.15.167:0/286771466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 msgr2=0x7fef400c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:50:38.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef4529d640 1 --2- 172.21.15.167:0/286771466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 0x7fef400c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef4529d640 1 -- 172.21.15.167:0/286771466 >> v2:172.21.15.167:3300/0 conn(0x7fef4006a580 msgr2=0x7fef4006a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:50:38.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef4529d640 1 --2- 172.21.15.167:0/286771466 >> v2:172.21.15.167:3300/0 conn(0x7fef4006a580 0x7fef4006a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.615+0000 7fef4529d640 1 -- 172.21.15.167:0/286771466 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40152340 con 0x7fef40151f60 2023-11-28T20:50:38.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef4529d640 1 --2- 172.21.15.167:0/286771466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef40151f60 0x7fef400c75c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef400c62c0 tx=0x7fef3c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25f9089669622941 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef37fff640 1 -- 172.21.15.167:0/286771466 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0ab600 con 0x7fef40151f60 2023-11-28T20:50:38.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef37fff640 1 -- 172.21.15.167:0/286771466 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c0a7050 con 0x7fef40151f60 2023-11-28T20:50:38.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef37fff640 1 -- 172.21.15.167:0/286771466 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0ab980 con 0x7fef40151f60 2023-11-28T20:50:38.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef47501640 1 -- 172.21.15.167:0/286771466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef40151f60 msgr2=0x7fef400c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef47501640 1 --2- 172.21.15.167:0/286771466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef40151f60 0x7fef400c75c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef400c62c0 tx=0x7fef3c01c3f0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef47501640 1 -- 172.21.15.167:0/286771466 shutdown_connections 2023-11-28T20:50:38.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef47501640 1 --2- 172.21.15.167:0/286771466 >> v2:172.21.15.167:3300/0 conn(0x7fef4006a580 0x7fef4006a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef47501640 1 --2- 172.21.15.167:0/286771466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 0x7fef400c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef47501640 1 --2- 172.21.15.167:0/286771466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef40151f60 0x7fef400c75c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef47501640 1 -- 172.21.15.167:0/286771466 >> 172.21.15.167:0/286771466 conn(0x7fef400cb1e0 msgr2=0x7fef400cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:38.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef47501640 1 -- 172.21.15.167:0/286771466 shutdown_connections 2023-11-28T20:50:38.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.619+0000 7fef47501640 1 -- 172.21.15.167:0/286771466 wait complete. 2023-11-28T20:50:38.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef47501640 1 Processor -- start 2023-11-28T20:50:38.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef47501640 1 -- start start 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef47501640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4006a580 0x7fef40156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef47501640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 0x7fef4014d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef47501640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef40151f60 0x7fef401f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef47501640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef40156f30 con 0x7fef40151f60 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef47501640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef40157800 con 0x7fef4006a580 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef47501640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef401f6740 con 0x7fef400c5c90 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef45a9e640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef40151f60 msgr2=0x7fef401f6bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef45a9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef40151f60 0x7fef401f6bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef4529d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4006a580 0x7fef40156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef44a9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 0x7fef4014d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef4529d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4006a580 0x7fef40156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:50670/0 (socket says 172.21.15.167:50670) 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef4529d640 1 -- 172.21.15.167:0/2497145790 learned_addr learned my addr 172.21.15.167:0/2497145790 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef4529d640 1 -- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 msgr2=0x7fef4014d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef4529d640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400c5c90 0x7fef4014d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef4529d640 1 -- 172.21.15.167:0/2497145790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef40151f60 msgr2=0x7fef401f6bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef4529d640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef40151f60 0x7fef401f6bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef4529d640 1 -- 172.21.15.167:0/2497145790 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c009420 con 0x7fef4006a580 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.623+0000 7fef4529d640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4006a580 0x7fef40156180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0ae040 tx=0x7fef3c01ac30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0b7450 con 0x7fef4006a580 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c0b75d0 con 0x7fef4006a580 2023-11-28T20:50:38.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4015c0d0 con 0x7fef4006a580 2023-11-28T20:50:38.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c0b7980 con 0x7fef4006a580 2023-11-28T20:50:38.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef40161d90 con 0x7fef4006a580 2023-11-28T20:50:38.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef47501640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40162070 0x7fef40146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef401f65e0 con 0x7fef40162070 2023-11-28T20:50:38.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef44a9c640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40162070 0x7fef40146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef44a9c640 1 -- 172.21.15.167:0/2497145790 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef4015a010 con 0x7fef40162070 2023-11-28T20:50:38.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef44a9c640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40162070 0x7fef40146a40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef400cb870 tx=0x7fef30011d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000fb30 con 0x7fef40162070 2023-11-28T20:50:38.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef3c0b7ae0 con 0x7fef4006a580 2023-11-28T20:50:38.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef35ffb640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef24066510 0x7fef240689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.627+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fef3c11e7b0 con 0x7fef4006a580 2023-11-28T20:50:38.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.631+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fef3000fc90 con 0x7fef40162070 2023-11-28T20:50:38.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.631+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40162070 msgr2=0x7fef40146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.631+0000 7fef35ffb640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40162070 0x7fef40146a40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef400cb870 tx=0x7fef30011d60 comp rx=0 tx=0).stop 2023-11-28T20:50:38.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.631+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40162070 msgr2=0x7fef40146a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:38.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.631+0000 7fef35ffb640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40162070 0x7fef40146a40 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fef400cb870 tx=0x7fef30011d60 comp rx=0 tx=0).stop 2023-11-28T20:50:38.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.631+0000 7fef45a9e640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef24066510 0x7fef240689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.631+0000 7fef45a9e640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef24066510 0x7fef240689d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fef38003cc0 tx=0x7fef380091f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.635+0000 7fef47501640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40146f80 0x7fef40160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:50:38.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.635+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef40074770 con 0x7fef40146f80 2023-11-28T20:50:38.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.635+0000 7fef44a9c640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40146f80 0x7fef40160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:50:38.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.635+0000 7fef44a9c640 1 -- 172.21.15.167:0/2497145790 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fef4015bf50 con 0x7fef40146f80 2023-11-28T20:50:38.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.635+0000 7fef44a9c640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40146f80 0x7fef40160670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef40161ba0 tx=0x7fef300046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:50:38.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.635+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30014640 con 0x7fef40146f80 2023-11-28T20:50:38.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5112 (secure 0 0 0) 0x7fef30003e80 con 0x7fef40146f80 2023-11-28T20:50:38.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40146f80 msgr2=0x7fef40160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef35ffb640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40146f80 0x7fef40160670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef40161ba0 tx=0x7fef300046d0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef35ffb640 1 -- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40146f80 msgr2=0x7fef40160670 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:50:38.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef35ffb640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef40146f80 0x7fef40160670 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef40161ba0 tx=0x7fef300046d0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.640 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:50:38.640 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:38.640 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:38.640 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:50:38.640 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 104, 2023-11-28T20:50:38.640 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:50:38.640 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:50:38.640 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:50:38.640 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:38.641 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:38.642 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:50:38.643 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:50:38.644 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.645 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.646 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.647 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:38.648 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:50:38.649 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.650 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:38.651 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:50:38.652 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:50:38.654 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:50:38.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:50:38.655 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:50:38.655 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:50:38.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef24066510 msgr2=0x7fef240689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef47501640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef24066510 0x7fef240689d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fef38003cc0 tx=0x7fef380091f0 comp rx=0 tx=0).stop 2023-11-28T20:50:38.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4006a580 msgr2=0x7fef40156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:50:38.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef47501640 1 --2- 172.21.15.167:0/2497145790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4006a580 0x7fef40156180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0ae040 tx=0x7fef3c01ac30 comp rx=0 tx=0).stop 2023-11-28T20:50:38.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef45a9e640 1 -- 172.21.15.167:0/2497145790 reap_dead start 2023-11-28T20:50:38.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef45a9e640 1 -- 172.21.15.167:0/2497145790 reap_dead start 2023-11-28T20:50:38.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 shutdown_connections 2023-11-28T20:50:38.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 >> 172.21.15.167:0/2497145790 conn(0x7fef400cb1e0 msgr2=0x7fef4014fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:50:38.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 shutdown_connections 2023-11-28T20:50:38.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:50:38.639+0000 7fef47501640 1 -- 172.21.15.167:0/2497145790 wait complete. 2023-11-28T20:50:38.657 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:50:38.657 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:50:49.048 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:49.052 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:58.658 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:51:03.334 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2023-11-28T20:51:03.335 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T20:51:03.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T20:51:03.339 INFO:tasks.ceph.mon.a:Started 2023-11-28T20:51:03.339 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:51:03.340 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:03.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24bd09c640 1 Processor -- start 2023-11-28T20:51:03.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24bd09c640 1 -- start start 2023-11-28T20:51:03.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24bd09c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f24b8153db0 0x7f24b815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:03.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24bd09c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 0x7f24b80c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:03.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24bd09c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b80cfef0 con 0x7f24b80cf440 2023-11-28T20:51:03.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24bd09c640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b80cc6e0 con 0x7f24b8153db0 2023-11-28T20:51:03.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24bd09c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8154190 con 0x7f24b80ccb70 2023-11-28T20:51:03.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24bc89b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f24b80cf440 0x7f24b80ca350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44618/0 (socket says 172.21.15.167:44618) 2023-11-28T20:51:03.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24bc89b640 1 -- 172.21.15.167:0/1843757279 learned_addr learned my addr 172.21.15.167:0/1843757279 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:03.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24b77fe640 1 --2- 172.21.15.167:0/1843757279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 0x7f24b80c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:03.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24b7fff640 1 --2- 172.21.15.167:0/1843757279 >> v2:172.21.15.178:3300/0 conn(0x7f24b8153db0 0x7f24b815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:03.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24b7fff640 1 -- 172.21.15.167:0/1843757279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 msgr2=0x7f24b80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:03.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24b7fff640 1 --2- 172.21.15.167:0/1843757279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 0x7f24b80c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:03.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24b7fff640 1 -- 172.21.15.167:0/1843757279 >> v1:172.21.15.167:6789/0 conn(0x7f24b80cf440 legacy=0x7f24b80ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:03.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.494+0000 7f24b7fff640 1 -- 172.21.15.167:0/1843757279 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80c4910 con 0x7f24b8153db0 2023-11-28T20:51:03.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24b7fff640 1 --2- 172.21.15.167:0/1843757279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8153db0 0x7f24b815a540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f24a80097c0 tx=0x7f24a801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3f88f74b7608d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:03.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24b6ffd640 1 -- 172.21.15.167:0/1843757279 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a80ab600 con 0x7f24b8153db0 2023-11-28T20:51:03.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24b6ffd640 1 -- 172.21.15.167:0/1843757279 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a80a7050 con 0x7f24b8153db0 2023-11-28T20:51:03.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24b6ffd640 1 -- 172.21.15.167:0/1843757279 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a80ab980 con 0x7f24b8153db0 2023-11-28T20:51:03.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24bd09c640 1 -- 172.21.15.167:0/1843757279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8153db0 msgr2=0x7f24b815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:03.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24bd09c640 1 --2- 172.21.15.167:0/1843757279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8153db0 0x7f24b815a540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f24a80097c0 tx=0x7f24a801c480 comp rx=0 tx=0).stop 2023-11-28T20:51:03.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24bd09c640 1 -- 172.21.15.167:0/1843757279 shutdown_connections 2023-11-28T20:51:03.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24bd09c640 1 --2- 172.21.15.167:0/1843757279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 0x7f24b80c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:03.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24bd09c640 1 --2- 172.21.15.167:0/1843757279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8153db0 0x7f24b815a540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:03.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24bd09c640 1 -- 172.21.15.167:0/1843757279 >> 172.21.15.167:0/1843757279 conn(0x7f24b806b800 msgr2=0x7f24b806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:03.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24bd09c640 1 -- 172.21.15.167:0/1843757279 shutdown_connections 2023-11-28T20:51:03.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.498+0000 7f24bd09c640 1 -- 172.21.15.167:0/1843757279 wait complete. 2023-11-28T20:51:03.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bd09c640 1 Processor -- start 2023-11-28T20:51:03.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bd09c640 1 -- start start 2023-11-28T20:51:03.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bd09c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 0x7f24b80ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:03.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bd09c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b80cf440 0x7f24b813ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:03.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bd09c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 0x7f24b813f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:03.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bd09c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8159c10 con 0x7f24b8153db0 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bd09c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8159020 con 0x7f24b80cf440 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bd09c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80b55a0 con 0x7f24b80ccb70 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bc89b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 0x7f24b813f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bc89b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 0x7f24b813f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52512/0 (socket says 172.21.15.167:52512) 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bc89b640 1 -- 172.21.15.167:0/579301461 learned_addr learned my addr 172.21.15.167:0/579301461 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b7fff640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 0x7f24b80ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b77fe640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b80cf440 0x7f24b813ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bc89b640 1 -- 172.21.15.167:0/579301461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 msgr2=0x7f24b813f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bc89b640 1 -- 172.21.15.167:0/579301461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 msgr2=0x7f24b813f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:51:03.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bc89b640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 0x7f24b813f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:03.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24bc89b640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 0x7f24b813f280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:03.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b7fff640 1 -- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b80cf440 msgr2=0x7f24b813ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:03.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b7fff640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b80cf440 0x7f24b813ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:03.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b7fff640 1 -- 172.21.15.167:0/579301461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 msgr2=0x7f24b813f280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:03.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b7fff640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 0x7f24b813f280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:03.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b7fff640 1 -- 172.21.15.167:0/579301461 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8009420 con 0x7f24b80ccb70 2023-11-28T20:51:03.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b7fff640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 0x7f24b80ce670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24a80ab000 tx=0x7f24a8019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:03.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b4ff9640 1 -- 172.21.15.167:0/579301461 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a80b4840 con 0x7f24b80ccb70 2023-11-28T20:51:03.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b4ff9640 1 -- 172.21.15.167:0/579301461 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a80b49e0 con 0x7f24b80ccb70 2023-11-28T20:51:03.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.502+0000 7f24b4ff9640 1 -- 172.21.15.167:0/579301461 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a80b4d90 con 0x7f24b80ccb70 2023-11-28T20:51:03.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.506+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b81592e0 con 0x7f24b80ccb70 2023-11-28T20:51:03.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.506+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b81598a0 con 0x7f24b80ccb70 2023-11-28T20:51:03.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.506+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b804e850 con 0x7f24b80ccb70 2023-11-28T20:51:03.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.506+0000 7f24b4ff9640 1 -- 172.21.15.167:0/579301461 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f24a80b2040 con 0x7f24b80ccb70 2023-11-28T20:51:03.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.506+0000 7f24b4ff9640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24a4066470 0x7f24a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:03.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.506+0000 7f24b4ff9640 1 -- 172.21.15.167:0/579301461 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f24a811e960 con 0x7f24b80ccb70 2023-11-28T20:51:03.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.506+0000 7f24b77fe640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24a4066470 0x7f24a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:03.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.510+0000 7f24b77fe640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24a4066470 0x7f24a4068930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f24b814ddf0 tx=0x7f24ac009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:03.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.518+0000 7f24b4ff9640 1 -- 172.21.15.167:0/579301461 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f24a80ebba0 con 0x7f24b80ccb70 2023-11-28T20:51:03.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f24b814de40 con 0x7f24b80ccb70 2023-11-28T20:51:03.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24b4ff9640 1 -- 172.21.15.167:0/579301461 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f24a80ef1c0 con 0x7f24b80ccb70 2023-11-28T20:51:03.725 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":27,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:03.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24a4066470 msgr2=0x7f24a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:03.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24a4066470 0x7f24a4068930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f24b814ddf0 tx=0x7f24ac009190 comp rx=0 tx=0).stop 2023-11-28T20:51:03.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 msgr2=0x7f24b80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:03.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 0x7f24b80ce670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24a80ab000 tx=0x7f24a8019220 comp rx=0 tx=0).stop 2023-11-28T20:51:03.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 shutdown_connections 2023-11-28T20:51:03.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f24a4066470 0x7f24a4068930 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:03.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24b8153db0 0x7f24b813f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:03.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b80cf440 0x7f24b813ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:03.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 --2- 172.21.15.167:0/579301461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b80ccb70 0x7f24b80ce670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:03.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 >> 172.21.15.167:0/579301461 conn(0x7f24b806b800 msgr2=0x7f24b8152e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:03.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 shutdown_connections 2023-11-28T20:51:03.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:03.726+0000 7f24bd09c640 1 -- 172.21.15.167:0/579301461 wait complete. 2023-11-28T20:51:06.747 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:06.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.886+0000 7fd0ea82f640 1 Processor -- start 2023-11-28T20:51:06.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.886+0000 7fd0ea82f640 1 -- start start 2023-11-28T20:51:06.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea82f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd0e4153db0 0x7fd0e415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:06.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea82f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 0x7fd0e40cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:06.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea82f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e40cfef0 con 0x7fd0e40ccb70 2023-11-28T20:51:06.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea82f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e40cc6e0 con 0x7fd0e40cf440 2023-11-28T20:51:06.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea82f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e4154190 con 0x7fd0e4153db0 2023-11-28T20:51:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea02e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 0x7fd0e40cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea02e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 0x7fd0e40cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52524/0 (socket says 172.21.15.167:52524) 2023-11-28T20:51:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea02e640 1 -- 172.21.15.167:0/4247958116 learned_addr learned my addr 172.21.15.167:0/4247958116 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0e902c640 1 --1- 172.21.15.167:0/4247958116 >> v1:172.21.15.167:6789/0 conn(0x7fd0e40ccb70 0x7fd0e40c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44620/0 (socket says 172.21.15.167:44620) 2023-11-28T20:51:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0e982d640 1 --2- 172.21.15.167:0/4247958116 >> v2:172.21.15.178:3300/0 conn(0x7fd0e4153db0 0x7fd0e415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea02e640 1 -- 172.21.15.167:0/4247958116 >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 msgr2=0x7fd0e40cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:51:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea02e640 1 -- 172.21.15.167:0/4247958116 >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 msgr2=0x7fd0e40cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:51:06.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea02e640 1 --2- 172.21.15.167:0/4247958116 >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 0x7fd0e40cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:06.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0ea02e640 1 --2- 172.21.15.167:0/4247958116 >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 0x7fd0e40cf8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:06.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0e982d640 1 -- 172.21.15.167:0/4247958116 >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 msgr2=0x7fd0e40cf8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:06.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0e982d640 1 --2- 172.21.15.167:0/4247958116 >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 0x7fd0e40cf8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:06.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0e982d640 1 -- 172.21.15.167:0/4247958116 >> v1:172.21.15.167:6789/0 conn(0x7fd0e40ccb70 legacy=0x7fd0e40c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:06.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.890+0000 7fd0e982d640 1 -- 172.21.15.167:0/4247958116 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e40cbad0 con 0x7fd0e4153db0 2023-11-28T20:51:06.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0e982d640 1 --2- 172.21.15.167:0/4247958116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e4153db0 0x7fd0e415a540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40ccfb0 tx=0x7fd0e001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c66aa77c6e8c7b81 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:06.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0e882b640 1 -- 172.21.15.167:0/4247958116 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0004230 con 0x7fd0e4153db0 2023-11-28T20:51:06.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0e882b640 1 -- 172.21.15.167:0/4247958116 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e00a7050 con 0x7fd0e4153db0 2023-11-28T20:51:06.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0e882b640 1 -- 172.21.15.167:0/4247958116 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0003620 con 0x7fd0e4153db0 2023-11-28T20:51:06.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 -- 172.21.15.167:0/4247958116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e4153db0 msgr2=0x7fd0e415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:06.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 --2- 172.21.15.167:0/4247958116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e4153db0 0x7fd0e415a540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40ccfb0 tx=0x7fd0e001c460 comp rx=0 tx=0).stop 2023-11-28T20:51:06.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 -- 172.21.15.167:0/4247958116 shutdown_connections 2023-11-28T20:51:06.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 --2- 172.21.15.167:0/4247958116 >> v2:172.21.15.167:3300/0 conn(0x7fd0e40cf440 0x7fd0e40cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:06.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 --2- 172.21.15.167:0/4247958116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e4153db0 0x7fd0e415a540 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:06.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 -- 172.21.15.167:0/4247958116 >> 172.21.15.167:0/4247958116 conn(0x7fd0e406b800 msgr2=0x7fd0e406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:06.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 -- 172.21.15.167:0/4247958116 shutdown_connections 2023-11-28T20:51:06.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 -- 172.21.15.167:0/4247958116 wait complete. 2023-11-28T20:51:06.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 Processor -- start 2023-11-28T20:51:06.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.894+0000 7fd0ea82f640 1 -- start start 2023-11-28T20:51:06.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea82f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e40ccb70 0x7fd0e40b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:06.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea82f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 0x7fd0e40c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:06.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea82f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e4153db0 0x7fd0e41f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:06.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea82f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e40b42d0 con 0x7fd0e40cf440 2023-11-28T20:51:06.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea82f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e40b39e0 con 0x7fd0e40ccb70 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea82f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e41f3440 con 0x7fd0e4153db0 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e902c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 0x7fd0e40c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e902c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 0x7fd0e40c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52540/0 (socket says 172.21.15.167:52540) 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e902c640 1 -- 172.21.15.167:0/1812309702 learned_addr learned my addr 172.21.15.167:0/1812309702 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e982d640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e40ccb70 0x7fd0e40b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e902c640 1 -- 172.21.15.167:0/1812309702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 msgr2=0x7fd0e40c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e902c640 1 -- 172.21.15.167:0/1812309702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 msgr2=0x7fd0e40c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e902c640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 0x7fd0e40c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea02e640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e4153db0 0x7fd0e41f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e902c640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 0x7fd0e40c4b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:06.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e982d640 1 -- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e4153db0 msgr2=0x7fd0e41f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e982d640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e4153db0 0x7fd0e41f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e982d640 1 -- 172.21.15.167:0/1812309702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 msgr2=0x7fd0e40c4b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e982d640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 0x7fd0e40c4b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e982d640 1 -- 172.21.15.167:0/1812309702 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e0009420 con 0x7fd0e40ccb70 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0e982d640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e40ccb70 0x7fd0e40b4760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0004000 tx=0x7fd0e0019200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0da7fc640 1 -- 172.21.15.167:0/1812309702 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0003b70 con 0x7fd0e40ccb70 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e40b3c80 con 0x7fd0e40ccb70 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0da7fc640 1 -- 172.21.15.167:0/1812309702 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0003cf0 con 0x7fd0e40ccb70 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0da7fc640 1 -- 172.21.15.167:0/1812309702 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00ab680 con 0x7fd0e40ccb70 2023-11-28T20:51:06.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e41f3720 con 0x7fd0e40ccb70 2023-11-28T20:51:06.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.898+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e404e850 con 0x7fd0e40ccb70 2023-11-28T20:51:06.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.902+0000 7fd0da7fc640 1 -- 172.21.15.167:0/1812309702 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0e00b2040 con 0x7fd0e40ccb70 2023-11-28T20:51:06.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.902+0000 7fd0da7fc640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0c8066470 0x7fd0c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:06.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.902+0000 7fd0da7fc640 1 -- 172.21.15.167:0/1812309702 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd0e011e640 con 0x7fd0e40ccb70 2023-11-28T20:51:06.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.902+0000 7fd0e902c640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0c8066470 0x7fd0c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:06.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.902+0000 7fd0e902c640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0c8066470 0x7fd0c8068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd0e415e030 tx=0x7fd0d4007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:06.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:06.914+0000 7fd0da7fc640 1 -- 172.21.15.167:0/1812309702 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0e00eb780 con 0x7fd0e40ccb70 2023-11-28T20:51:07.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.122+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd0e414de40 con 0x7fd0e40ccb70 2023-11-28T20:51:07.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0da7fc640 1 -- 172.21.15.167:0/1812309702 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fd0e00b0620 con 0x7fd0e40ccb70 2023-11-28T20:51:07.123 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:07.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0c8066470 msgr2=0x7fd0c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:07.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0c8066470 0x7fd0c8068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd0e415e030 tx=0x7fd0d4007d30 comp rx=0 tx=0).stop 2023-11-28T20:51:07.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e40ccb70 msgr2=0x7fd0e40b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:07.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e40ccb70 0x7fd0e40b4760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0004000 tx=0x7fd0e0019200 comp rx=0 tx=0).stop 2023-11-28T20:51:07.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 shutdown_connections 2023-11-28T20:51:07.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0c8066470 0x7fd0c8068930 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:07.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e4153db0 0x7fd0e41f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:07.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e40cf440 0x7fd0e40c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:07.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 --2- 172.21.15.167:0/1812309702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e40ccb70 0x7fd0e40b4760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:07.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 >> 172.21.15.167:0/1812309702 conn(0x7fd0e406b800 msgr2=0x7fd0e4150210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:07.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 shutdown_connections 2023-11-28T20:51:07.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:07.126+0000 7fd0ea82f640 1 -- 172.21.15.167:0/1812309702 wait complete. 2023-11-28T20:51:10.144 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:10.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb594765640 1 Processor -- start 2023-11-28T20:51:10.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb594765640 1 -- start start 2023-11-28T20:51:10.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb594765640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb58c151f60 0x7fb58c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:10.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb594765640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c0c5c90 0x7fb58c0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:10.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb594765640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 0x7fb58c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:10.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb594765640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c0c4da0 con 0x7fb58c06a580 2023-11-28T20:51:10.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb594765640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c15b220 con 0x7fb58c151f60 2023-11-28T20:51:10.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb594765640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c0c60f0 con 0x7fb58c0c5c90 2023-11-28T20:51:10.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb592d02640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 0x7fb58c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:10.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb592d02640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 0x7fb58c06a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52544/0 (socket says 172.21.15.167:52544) 2023-11-28T20:51:10.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb592d02640 1 -- 172.21.15.167:0/982447371 learned_addr learned my addr 172.21.15.167:0/982447371 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:10.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb592501640 1 --2- 172.21.15.167:0/982447371 >> v2:172.21.15.178:3300/0 conn(0x7fb58c151f60 0x7fb58c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:10.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb592d02640 1 -- 172.21.15.167:0/982447371 >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 msgr2=0x7fb58c06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:51:10.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb592d02640 1 -- 172.21.15.167:0/982447371 >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 msgr2=0x7fb58c06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:51:10.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb592d02640 1 --2- 172.21.15.167:0/982447371 >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 0x7fb58c06a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:10.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb591d00640 1 --2- 172.21.15.167:0/982447371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c0c5c90 0x7fb58c0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:10.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.294+0000 7fb592d02640 1 --2- 172.21.15.167:0/982447371 >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 0x7fb58c06a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:10.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.298+0000 7fb591d00640 1 -- 172.21.15.167:0/982447371 >> v2:172.21.15.178:3300/0 conn(0x7fb58c151f60 msgr2=0x7fb58c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:10.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.298+0000 7fb591d00640 1 --2- 172.21.15.167:0/982447371 >> v2:172.21.15.178:3300/0 conn(0x7fb58c151f60 0x7fb58c0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.298+0000 7fb591d00640 1 -- 172.21.15.167:0/982447371 >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 msgr2=0x7fb58c06a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:10.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.298+0000 7fb591d00640 1 --2- 172.21.15.167:0/982447371 >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 0x7fb58c06a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.298+0000 7fb591d00640 1 -- 172.21.15.167:0/982447371 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c152340 con 0x7fb58c0c5c90 2023-11-28T20:51:10.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.298+0000 7fb591d00640 1 --2- 172.21.15.167:0/982447371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c0c5c90 0x7fb58c0c26e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0c62c0 tx=0x7fb57c01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89ba7650ba73bd96 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:10.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.298+0000 7fb5914ff640 1 -- 172.21.15.167:0/982447371 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0ab600 con 0x7fb58c0c5c90 2023-11-28T20:51:10.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.298+0000 7fb5914ff640 1 -- 172.21.15.167:0/982447371 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c0a7050 con 0x7fb58c0c5c90 2023-11-28T20:51:10.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.298+0000 7fb5914ff640 1 -- 172.21.15.167:0/982447371 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0ab980 con 0x7fb58c0c5c90 2023-11-28T20:51:10.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 -- 172.21.15.167:0/982447371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c0c5c90 msgr2=0x7fb58c0c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:10.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 --2- 172.21.15.167:0/982447371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c0c5c90 0x7fb58c0c26e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0c62c0 tx=0x7fb57c01c3d0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 -- 172.21.15.167:0/982447371 shutdown_connections 2023-11-28T20:51:10.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 --2- 172.21.15.167:0/982447371 >> v2:172.21.15.167:3300/0 conn(0x7fb58c06a580 0x7fb58c06a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 --2- 172.21.15.167:0/982447371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c0c5c90 0x7fb58c0c26e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 --2- 172.21.15.167:0/982447371 >> v2:172.21.15.178:3300/0 conn(0x7fb58c151f60 0x7fb58c0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 -- 172.21.15.167:0/982447371 >> 172.21.15.167:0/982447371 conn(0x7fb58c0cb1e0 msgr2=0x7fb58c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:10.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 -- 172.21.15.167:0/982447371 shutdown_connections 2023-11-28T20:51:10.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 -- 172.21.15.167:0/982447371 wait complete. 2023-11-28T20:51:10.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 Processor -- start 2023-11-28T20:51:10.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 -- start start 2023-11-28T20:51:10.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c06a580 0x7fb58c1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:10.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 0x7fb58c157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:10.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb58c151f60 0x7fb58c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:10.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c0723b0 con 0x7fb58c0c5c90 2023-11-28T20:51:10.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c156b30 con 0x7fb58c151f60 2023-11-28T20:51:10.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb594765640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c1f2650 con 0x7fb58c06a580 2023-11-28T20:51:10.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb591d00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 0x7fb58c157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:10.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb591d00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 0x7fb58c157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52550/0 (socket says 172.21.15.167:52550) 2023-11-28T20:51:10.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb591d00640 1 -- 172.21.15.167:0/2179440554 learned_addr learned my addr 172.21.15.167:0/2179440554 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:10.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb592d02640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb58c151f60 0x7fb58c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:10.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb592501640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c06a580 0x7fb58c1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:10.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb591d00640 1 -- 172.21.15.167:0/2179440554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 msgr2=0x7fb58c157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:51:10.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb591d00640 1 -- 172.21.15.167:0/2179440554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 msgr2=0x7fb58c157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:51:10.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb591d00640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 0x7fb58c157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:10.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.302+0000 7fb591d00640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 0x7fb58c157120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:10.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb592501640 1 -- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb58c151f60 msgr2=0x7fb58c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:10.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb592501640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb58c151f60 0x7fb58c070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb592501640 1 -- 172.21.15.167:0/2179440554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 msgr2=0x7fb58c157120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:10.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb592501640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 0x7fb58c157120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb592501640 1 -- 172.21.15.167:0/2179440554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c009420 con 0x7fb58c06a580 2023-11-28T20:51:10.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb592501640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c06a580 0x7fb58c1565f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb58800e870 tx=0x7fb58800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:10.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb582ffd640 1 -- 172.21.15.167:0/2179440554 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800ee60 con 0x7fb58c06a580 2023-11-28T20:51:10.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb582ffd640 1 -- 172.21.15.167:0/2179440554 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58800c940 con 0x7fb58c06a580 2023-11-28T20:51:10.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb582ffd640 1 -- 172.21.15.167:0/2179440554 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800ccd0 con 0x7fb58c06a580 2023-11-28T20:51:10.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c15c0d0 con 0x7fb58c06a580 2023-11-28T20:51:10.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c1f2860 con 0x7fb58c06a580 2023-11-28T20:51:10.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c0682c0 con 0x7fb58c06a580 2023-11-28T20:51:10.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.306+0000 7fb582ffd640 1 -- 172.21.15.167:0/2179440554 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb588013470 con 0x7fb58c06a580 2023-11-28T20:51:10.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.310+0000 7fb582ffd640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb570066470 0x7fb570068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:10.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.310+0000 7fb582ffd640 1 -- 172.21.15.167:0/2179440554 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb588084a10 con 0x7fb58c06a580 2023-11-28T20:51:10.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.310+0000 7fb591d00640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb570066470 0x7fb570068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:10.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.310+0000 7fb591d00640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb570066470 0x7fb570068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb57c000c10 tx=0x7fb57c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:10.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.322+0000 7fb582ffd640 1 -- 172.21.15.167:0/2179440554 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb588051b30 con 0x7fb58c06a580 2023-11-28T20:51:10.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.522+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb58c0c7400 con 0x7fb58c06a580 2023-11-28T20:51:10.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.522+0000 7fb582ffd640 1 -- 172.21.15.167:0/2179440554 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fb588021620 con 0x7fb58c06a580 2023-11-28T20:51:10.522 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":34,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb570066470 msgr2=0x7fb570068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb570066470 0x7fb570068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb57c000c10 tx=0x7fb57c0a6000 comp rx=0 tx=0).stop 2023-11-28T20:51:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c06a580 msgr2=0x7fb58c1565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c06a580 0x7fb58c1565f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb58800e870 tx=0x7fb58800ed30 comp rx=0 tx=0).stop 2023-11-28T20:51:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 shutdown_connections 2023-11-28T20:51:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb570066470 0x7fb570068930 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb58c151f60 0x7fb58c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58c0c5c90 0x7fb58c157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 --2- 172.21.15.167:0/2179440554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb58c06a580 0x7fb58c1565f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:10.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 >> 172.21.15.167:0/2179440554 conn(0x7fb58c0cb1e0 msgr2=0x7fb58c160900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:10.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 shutdown_connections 2023-11-28T20:51:10.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:10.526+0000 7fb594765640 1 -- 172.21.15.167:0/2179440554 wait complete. 2023-11-28T20:51:13.544 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:13.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.694+0000 7f2aa9cfd640 1 Processor -- start 2023-11-28T20:51:13.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.694+0000 7f2aa9cfd640 1 -- start start 2023-11-28T20:51:13.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa9cfd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2aa40cf860 0x7f2aa40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:13.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa9cfd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa415ac00 con 0x7f2aa4153ae0 2023-11-28T20:51:13.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa9cfd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa40cbd60 con 0x7f2aa40cfc40 2023-11-28T20:51:13.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa9cfd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa4159ff0 con 0x7f2aa40cf860 2023-11-28T20:51:13.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa3fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2aa4153ae0 0x7f2aa415d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55964/0 (socket says 172.21.15.167:55964) 2023-11-28T20:51:13.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa3fff640 1 -- 172.21.15.167:0/936935577 learned_addr learned my addr 172.21.15.167:0/936935577 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:13.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa37fe640 1 --2- 172.21.15.167:0/936935577 >> v2:172.21.15.178:3300/0 conn(0x7f2aa40cf860 0x7f2aa40cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:13.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa37fe640 1 -- 172.21.15.167:0/936935577 >> v1:172.21.15.178:6789/0 conn(0x7f2aa40cfc40 legacy=0x7f2aa40ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:13.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa37fe640 1 -- 172.21.15.167:0/936935577 >> v1:172.21.15.167:6789/0 conn(0x7f2aa4153ae0 legacy=0x7f2aa415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:13.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.698+0000 7f2aa37fe640 1 -- 172.21.15.167:0/936935577 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa415a2d0 con 0x7f2aa40cf860 2023-11-28T20:51:13.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa37fe640 1 --2- 172.21.15.167:0/936935577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 0x7f2aa40cb770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2a940097c0 tx=0x7f2a9401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7127d97999cfc5ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:13.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa2ffd640 1 -- 172.21.15.167:0/936935577 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940ab650 con 0x7f2aa40cf860 2023-11-28T20:51:13.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa2ffd640 1 -- 172.21.15.167:0/936935577 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a940ab7b0 con 0x7f2aa40cf860 2023-11-28T20:51:13.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa2ffd640 1 -- 172.21.15.167:0/936935577 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940abb40 con 0x7f2aa40cf860 2023-11-28T20:51:13.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/936935577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 msgr2=0x7f2aa40cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:13.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa9cfd640 1 --2- 172.21.15.167:0/936935577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 0x7f2aa40cb770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2a940097c0 tx=0x7f2a9401c450 comp rx=0 tx=0).stop 2023-11-28T20:51:13.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/936935577 shutdown_connections 2023-11-28T20:51:13.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa9cfd640 1 --2- 172.21.15.167:0/936935577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 0x7f2aa40cb770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:13.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/936935577 >> 172.21.15.167:0/936935577 conn(0x7f2aa406c1f0 msgr2=0x7f2aa4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:13.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/936935577 shutdown_connections 2023-11-28T20:51:13.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/936935577 wait complete. 2023-11-28T20:51:13.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa9cfd640 1 Processor -- start 2023-11-28T20:51:13.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.702+0000 7f2aa9cfd640 1 -- start start 2023-11-28T20:51:13.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa9cfd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 0x7f2aa40b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:13.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa9cfd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40cfc40 0x7f2aa4158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:13.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa9cfd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 0x7f2aa4148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa9cfd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa414a2d0 con 0x7f2aa4153ae0 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa9cfd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40b4b60 con 0x7f2aa40cf860 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa9cfd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40b4db0 con 0x7f2aa40cfc40 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 0x7f2aa4148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 0x7f2aa4148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38120/0 (socket says 172.21.15.167:38120) 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa3fff640 1 -- 172.21.15.167:0/2675414827 learned_addr learned my addr 172.21.15.167:0/2675414827 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa37fe640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 0x7f2aa40b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa3fff640 1 -- 172.21.15.167:0/2675414827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 msgr2=0x7f2aa4148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa3fff640 1 -- 172.21.15.167:0/2675414827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 msgr2=0x7f2aa4148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa3fff640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 0x7f2aa4148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:13.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2a9bfff640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40cfc40 0x7f2aa4158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:13.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa3fff640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 0x7f2aa4148d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:13.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa37fe640 1 -- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40cfc40 msgr2=0x7f2aa4158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:13.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa37fe640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40cfc40 0x7f2aa4158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:13.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa37fe640 1 -- 172.21.15.167:0/2675414827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 msgr2=0x7f2aa4148d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:13.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa37fe640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 0x7f2aa4148d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:13.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa37fe640 1 -- 172.21.15.167:0/2675414827 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94009420 con 0x7f2aa40cf860 2023-11-28T20:51:13.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa37fe640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 0x7f2aa40b4100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ac000 tx=0x7f2a9401ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:13.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa0ff9640 1 -- 172.21.15.167:0/2675414827 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940b5810 con 0x7f2aa40cf860 2023-11-28T20:51:13.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa0ff9640 1 -- 172.21.15.167:0/2675414827 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a940b59b0 con 0x7f2aa40cf860 2023-11-28T20:51:13.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa40b5090 con 0x7f2aa40cf860 2023-11-28T20:51:13.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa0ff9640 1 -- 172.21.15.167:0/2675414827 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940b5d60 con 0x7f2aa40cf860 2023-11-28T20:51:13.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa40b5650 con 0x7f2aa40cf860 2023-11-28T20:51:13.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.706+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa4067c40 con 0x7f2aa40cf860 2023-11-28T20:51:13.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.710+0000 7f2aa0ff9640 1 -- 172.21.15.167:0/2675414827 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2a940ca3e0 con 0x7f2aa40cf860 2023-11-28T20:51:13.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.710+0000 7f2aa0ff9640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2a84066470 0x7f2a84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:13.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.710+0000 7f2aa0ff9640 1 -- 172.21.15.167:0/2675414827 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2a9411f5e0 con 0x7f2aa40cf860 2023-11-28T20:51:13.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.710+0000 7f2a9bfff640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2a84066470 0x7f2a84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:13.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.710+0000 7f2a9bfff640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2a84066470 0x7f2a84068930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4165600 tx=0x7f2a8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:13.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.722+0000 7f2aa0ff9640 1 -- 172.21.15.167:0/2675414827 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a940ec8d0 con 0x7f2aa40cf860 2023-11-28T20:51:13.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.926+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2aa4075c90 con 0x7f2aa40cf860 2023-11-28T20:51:13.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.926+0000 7f2aa0ff9640 1 -- 172.21.15.167:0/2675414827 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f2a940efef0 con 0x7f2aa40cf860 2023-11-28T20:51:13.925 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":104,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":38,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:13.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2a84066470 msgr2=0x7f2a84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:13.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2a84066470 0x7f2a84068930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4165600 tx=0x7f2a8c009040 comp rx=0 tx=0).stop 2023-11-28T20:51:13.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 msgr2=0x7f2aa40b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:13.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 0x7f2aa40b4100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ac000 tx=0x7f2a9401ac90 comp rx=0 tx=0).stop 2023-11-28T20:51:13.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 shutdown_connections 2023-11-28T20:51:13.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2a84066470 0x7f2a84068930 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:13.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2aa4153ae0 0x7f2aa4148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:13.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40cfc40 0x7f2aa4158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:13.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 --2- 172.21.15.167:0/2675414827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa40cf860 0x7f2aa40b4100 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:13.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 >> 172.21.15.167:0/2675414827 conn(0x7f2aa406c1f0 msgr2=0x7f2aa415d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:13.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 shutdown_connections 2023-11-28T20:51:13.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:13.930+0000 7f2aa9cfd640 1 -- 172.21.15.167:0/2675414827 wait complete. 2023-11-28T20:51:16.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:17.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff7877d1640 1 Processor -- start 2023-11-28T20:51:17.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff7877d1640 1 -- start start 2023-11-28T20:51:17.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff7877d1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff7800c75c0 0x7ff7800c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff7877d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78006a580 0x7ff78006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff7877d1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7800c7a50 con 0x7ff780151f60 2023-11-28T20:51:17.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff7877d1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78006aed0 con 0x7ff7800c75c0 2023-11-28T20:51:17.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff7877d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800c4da0 con 0x7ff78006a580 2023-11-28T20:51:17.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff784d6c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff7800c75c0 0x7ff7800c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff785d6e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78006a580 0x7ff78006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.094+0000 7ff78556d640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff780151f60 0x7ff7800c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:54004/0 (socket says 172.21.15.167:54004) 2023-11-28T20:51:17.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff784d6c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff7800c75c0 0x7ff7800c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:57556/0 (socket says 172.21.15.167:57556) 2023-11-28T20:51:17.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff78556d640 1 -- 172.21.15.167:0/3398722905 learned_addr learned my addr 172.21.15.167:0/3398722905 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:17.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff785d6e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78006a580 0x7ff78006a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:47020/0 (socket says 172.21.15.167:47020) 2023-11-28T20:51:17.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff785d6e640 1 -- 172.21.15.167:0/3398722905 >> v2:172.21.15.178:3300/0 conn(0x7ff7800c75c0 msgr2=0x7ff7800c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:17.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff785d6e640 1 --2- 172.21.15.167:0/3398722905 >> v2:172.21.15.178:3300/0 conn(0x7ff7800c75c0 0x7ff7800c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff785d6e640 1 -- 172.21.15.167:0/3398722905 >> v1:172.21.15.178:6789/0 conn(0x7ff780151f60 legacy=0x7ff7800c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff785d6e640 1 -- 172.21.15.167:0/3398722905 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78015b220 con 0x7ff78006a580 2023-11-28T20:51:17.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff777fff640 1 -- 172.21.15.167:0/3398722905 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366160780 0 0) 0x7ff77c001120 con 0x7ff780151f60 2023-11-28T20:51:17.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff784d6c640 1 --2- 172.21.15.167:0/3398722905 >> v2:172.21.15.178:3300/0 conn(0x7ff7800c75c0 0x7ff7800c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:51:17.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.098+0000 7ff785d6e640 1 --2- 172.21.15.167:0/3398722905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78006a580 0x7ff78006a990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff778009d90 tx=0x7ff77801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1aac7635f68a2c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff777fff640 1 -- 172.21.15.167:0/3398722905 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7780a5780 con 0x7ff78006a580 2023-11-28T20:51:17.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff777fff640 1 -- 172.21.15.167:0/3398722905 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7780a58e0 con 0x7ff78006a580 2023-11-28T20:51:17.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff777fff640 1 -- 172.21.15.167:0/3398722905 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7780a5c70 con 0x7ff78006a580 2023-11-28T20:51:17.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 -- 172.21.15.167:0/3398722905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78006a580 msgr2=0x7ff78006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 --2- 172.21.15.167:0/3398722905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78006a580 0x7ff78006a990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff778009d90 tx=0x7ff77801c8c0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 -- 172.21.15.167:0/3398722905 shutdown_connections 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 --2- 172.21.15.167:0/3398722905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78006a580 0x7ff78006a990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 --2- 172.21.15.167:0/3398722905 >> v2:172.21.15.178:3300/0 conn(0x7ff7800c75c0 0x7ff7800c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 -- 172.21.15.167:0/3398722905 >> 172.21.15.167:0/3398722905 conn(0x7ff7800cb1e0 msgr2=0x7ff7800cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 -- 172.21.15.167:0/3398722905 shutdown_connections 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 -- 172.21.15.167:0/3398722905 wait complete. 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 Processor -- start 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 -- start start 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78006a580 0x7ff7800c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7800c75c0 0x7ff7800c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff780151f60 0x7ff7801f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78013ef40 con 0x7ff78006a580 2023-11-28T20:51:17.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7800c9f60 con 0x7ff780151f60 2023-11-28T20:51:17.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.102+0000 7ff7877d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78013e860 con 0x7ff7800c75c0 2023-11-28T20:51:17.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff78556d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78006a580 0x7ff7800c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff78556d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78006a580 0x7ff7800c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38126/0 (socket says 172.21.15.167:38126) 2023-11-28T20:51:17.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff78556d640 1 -- 172.21.15.167:0/2899284345 learned_addr learned my addr 172.21.15.167:0/2899284345 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:17.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff785d6e640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff780151f60 0x7ff7801f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff784d6c640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7800c75c0 0x7ff7800c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff78556d640 1 -- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7800c75c0 msgr2=0x7ff7800c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff78556d640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7800c75c0 0x7ff7800c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff78556d640 1 -- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff780151f60 msgr2=0x7ff7801f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff78556d640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff780151f60 0x7ff7801f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff78556d640 1 -- 172.21.15.167:0/2899284345 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff770009420 con 0x7ff78006a580 2023-11-28T20:51:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff78556d640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78006a580 0x7ff7800c9a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c480 tx=0x7ff77c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff775ffb640 1 -- 172.21.15.167:0/2899284345 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0074e0 con 0x7ff78006a580 2023-11-28T20:51:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff775ffb640 1 -- 172.21.15.167:0/2899284345 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c007660 con 0x7ff78006a580 2023-11-28T20:51:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff775ffb640 1 -- 172.21.15.167:0/2899284345 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c004a30 con 0x7ff78006a580 2023-11-28T20:51:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff778009a70 con 0x7ff78006a580 2023-11-28T20:51:17.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78013f430 con 0x7ff78006a580 2023-11-28T20:51:17.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.106+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7800682c0 con 0x7ff78006a580 2023-11-28T20:51:17.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.110+0000 7ff775ffb640 1 -- 172.21.15.167:0/2899284345 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff77c01b360 con 0x7ff78006a580 2023-11-28T20:51:17.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.110+0000 7ff775ffb640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff764066470 0x7ff764068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.110+0000 7ff775ffb640 1 -- 172.21.15.167:0/2899284345 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff77c083500 con 0x7ff78006a580 2023-11-28T20:51:17.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.110+0000 7ff784d6c640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff764066470 0x7ff764068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.110+0000 7ff784d6c640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff764066470 0x7ff764068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff780154bb0 tx=0x7ff770009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.114+0000 7ff775ffb640 1 -- 172.21.15.167:0/2899284345 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff77c0506b0 con 0x7ff78006a580 2023-11-28T20:51:17.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.314+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff780075c90 con 0x7ff78006a580 2023-11-28T20:51:17.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.314+0000 7ff775ffb640 1 -- 172.21.15.167:0/2899284345 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7ff77c018080 con 0x7ff78006a580 2023-11-28T20:51:17.314 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:17.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff764066470 msgr2=0x7ff764068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff764066470 0x7ff764068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff780154bb0 tx=0x7ff770009190 comp rx=0 tx=0).stop 2023-11-28T20:51:17.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78006a580 msgr2=0x7ff7800c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78006a580 0x7ff7800c9a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c480 tx=0x7ff77c00c940 comp rx=0 tx=0).stop 2023-11-28T20:51:17.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 shutdown_connections 2023-11-28T20:51:17.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff764066470 0x7ff764068930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff780151f60 0x7ff7801f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7800c75c0 0x7ff7800c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 --2- 172.21.15.167:0/2899284345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff78006a580 0x7ff7800c9a20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 >> 172.21.15.167:0/2899284345 conn(0x7ff7800cb1e0 msgr2=0x7ff7800cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:17.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 shutdown_connections 2023-11-28T20:51:17.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.318+0000 7ff7877d1640 1 -- 172.21.15.167:0/2899284345 wait complete. 2023-11-28T20:51:17.335 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:51:17.335 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:51:17.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:51:17.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.474+0000 7f191c89c640 1 Processor -- start 2023-11-28T20:51:17.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.474+0000 7f191c89c640 1 -- start start 2023-11-28T20:51:17.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f191c89c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f191806e030 0x7f19181500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f191c89c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1918070480 0x7f19181505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f191c89c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19181571d0 con 0x7f191806e410 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f191c89c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1918071a90 con 0x7f1918070480 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f191c89c640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19180c70d0 con 0x7f191806e030 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f190dd9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1918070480 0x7f19181505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f1916d9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f191806e410 0x7f1918071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55976/0 (socket says 172.21.15.167:55976) 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f1916d9d640 1 -- 172.21.15.167:0/3849543301 learned_addr learned my addr 172.21.15.167:0/3849543301 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f190dd9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1918070480 0x7f19181505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38136/0 (socket says 172.21.15.167:38136) 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f191659c640 1 --2- 172.21.15.167:0/3849543301 >> v2:172.21.15.178:3300/0 conn(0x7f191806e030 0x7f19181500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f190dd9b640 1 -- 172.21.15.167:0/3849543301 >> v2:172.21.15.178:3300/0 conn(0x7f191806e030 msgr2=0x7f19181500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:17.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f190dd9b640 1 --2- 172.21.15.167:0/3849543301 >> v2:172.21.15.178:3300/0 conn(0x7f191806e030 0x7f19181500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f190dd9b640 1 -- 172.21.15.167:0/3849543301 >> v1:172.21.15.167:6789/0 conn(0x7f191806e410 legacy=0x7f1918071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f1915d9b640 1 -- 172.21.15.167:0/3849543301 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174108064 0 0) 0x7f19181571d0 con 0x7f191806e410 2023-11-28T20:51:17.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f190dd9b640 1 -- 172.21.15.167:0/3849543301 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180c73b0 con 0x7f1918070480 2023-11-28T20:51:17.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.478+0000 7f191659c640 1 --2- 172.21.15.167:0/3849543301 >> v2:172.21.15.178:3300/0 conn(0x7f191806e030 0x7f19181500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:51:17.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f190dd9b640 1 --2- 172.21.15.167:0/3849543301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918070480 0x7f19181505f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f19180cbff0 tx=0x7f190001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714543d22fbbcd22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f1915d9b640 1 -- 172.21.15.167:0/3849543301 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000a7070 con 0x7f1918070480 2023-11-28T20:51:17.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f1915d9b640 1 -- 172.21.15.167:0/3849543301 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19000ab430 con 0x7f1918070480 2023-11-28T20:51:17.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f1915d9b640 1 -- 172.21.15.167:0/3849543301 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000ab7c0 con 0x7f1918070480 2023-11-28T20:51:17.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 -- 172.21.15.167:0/3849543301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918070480 msgr2=0x7f19181505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 --2- 172.21.15.167:0/3849543301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918070480 0x7f19181505f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f19180cbff0 tx=0x7f190001c430 comp rx=0 tx=0).stop 2023-11-28T20:51:17.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 -- 172.21.15.167:0/3849543301 shutdown_connections 2023-11-28T20:51:17.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 --2- 172.21.15.167:0/3849543301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918070480 0x7f19181505f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 --2- 172.21.15.167:0/3849543301 >> v2:172.21.15.178:3300/0 conn(0x7f191806e030 0x7f19181500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 -- 172.21.15.167:0/3849543301 >> 172.21.15.167:0/3849543301 conn(0x7f19180cb1e0 msgr2=0x7f19180cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:17.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 -- 172.21.15.167:0/3849543301 shutdown_connections 2023-11-28T20:51:17.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 -- 172.21.15.167:0/3849543301 wait complete. 2023-11-28T20:51:17.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 Processor -- start 2023-11-28T20:51:17.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.482+0000 7f191c89c640 1 -- start start 2023-11-28T20:51:17.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191806e030 0x7f1918151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f191806e410 0x7f19181f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1918070480 0x7f19181f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19181538c0 con 0x7f191806e030 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191814d880 con 0x7f191806e410 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19181463b0 con 0x7f1918070480 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191806e030 0x7f1918151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191806e030 0x7f1918151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38152/0 (socket says 172.21.15.167:38152) 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191659c640 1 -- 172.21.15.167:0/4175090973 learned_addr learned my addr 172.21.15.167:0/4175090973 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f190dd9b640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f191806e410 0x7f19181f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f1916d9d640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1918070480 0x7f19181f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191659c640 1 -- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1918070480 msgr2=0x7f19181f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191659c640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1918070480 0x7f19181f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191659c640 1 -- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f191806e410 msgr2=0x7f19181f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191659c640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f191806e410 0x7f19181f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191659c640 1 -- 172.21.15.167:0/4175090973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900009420 con 0x7f191806e030 2023-11-28T20:51:17.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191659c640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191806e030 0x7f1918151440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f190800da10 tx=0x7f190800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908009030 con 0x7f191806e030 2023-11-28T20:51:17.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190800aa60 con 0x7f191806e030 2023-11-28T20:51:17.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190800adf0 con 0x7f191806e030 2023-11-28T20:51:17.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1918146690 con 0x7f191806e030 2023-11-28T20:51:17.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1918146c50 con 0x7f191806e030 2023-11-28T20:51:17.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918146e40 0x7f1918143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918074770 con 0x7f1918146e40 2023-11-28T20:51:17.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f190dd9b640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918146e40 0x7f1918143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f190dd9b640 1 -- 172.21.15.167:0/4175090973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19180682c0 con 0x7f1918146e40 2023-11-28T20:51:17.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.486+0000 7f190dd9b640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918146e40 0x7f1918143910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f19180c9070 tx=0x7f19000191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900003820 con 0x7f1918146e40 2023-11-28T20:51:17.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1908004030 con 0x7f191806e030 2023-11-28T20:51:17.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f190f7fe640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18f8066510 0x7f18f80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1908083b20 con 0x7f191806e030 2023-11-28T20:51:17.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1900003980 con 0x7f1918146e40 2023-11-28T20:51:17.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918146e40 msgr2=0x7f1918143910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f190f7fe640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918146e40 0x7f1918143910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f19180c9070 tx=0x7f19000191d0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918146e40 msgr2=0x7f1918143910 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:17.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f190f7fe640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1918146e40 0x7f1918143910 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f19180c9070 tx=0x7f19000191d0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f1916d9d640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18f8066510 0x7f18f80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.490+0000 7f1916d9d640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18f8066510 0x7f18f80689d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f19100012f0 tx=0x7f1910005b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.494+0000 7f191c89c640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191814d390 0x7f1918143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.494+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191815a770 con 0x7f191814d390 2023-11-28T20:51:17.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.494+0000 7f190dd9b640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191814d390 0x7f1918143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.494+0000 7f190dd9b640 1 -- 172.21.15.167:0/4175090973 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1918075c90 con 0x7f191814d390 2023-11-28T20:51:17.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.494+0000 7f190dd9b640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191814d390 0x7f1918143e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f190001a060 tx=0x7f1900009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000abb40 con 0x7f191814d390 2023-11-28T20:51:17.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4472 (secure 0 0 0) 0x7f19000c9070 con 0x7f191814d390 2023-11-28T20:51:17.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191814d390 msgr2=0x7f1918143e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f190f7fe640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191814d390 0x7f1918143e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f190001a060 tx=0x7f1900009190 comp rx=0 tx=0).stop 2023-11-28T20:51:17.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f190f7fe640 1 -- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191814d390 msgr2=0x7f1918143e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:17.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f190f7fe640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191814d390 0x7f1918143e50 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f190001a060 tx=0x7f1900009190 comp rx=0 tx=0).stop 2023-11-28T20:51:17.496 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:51:17.496 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 108, 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:51:17.497 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.498 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:51:17.500 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:17.501 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:17.502 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:17.502 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:17.502 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.505 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:51:17.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.505 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:51:17.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.505 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:17.505 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:17.505 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:17.506 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:17.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.506 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:17.506 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:51:17.506 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.506 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.506 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:17.506 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.507 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:51:17.508 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:17.509 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.510 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:51:17.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.512 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.513 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.513 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:51:17.513 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:51:17.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18f8066510 msgr2=0x7f18f80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f191c89c640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f18f8066510 0x7f18f80689d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f19100012f0 tx=0x7f1910005b80 comp rx=0 tx=0).stop 2023-11-28T20:51:17.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191806e030 msgr2=0x7f1918151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f191c89c640 1 --2- 172.21.15.167:0/4175090973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f191806e030 0x7f1918151440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f190800da10 tx=0x7f190800ded0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f1916d9d640 1 -- 172.21.15.167:0/4175090973 reap_dead start 2023-11-28T20:51:17.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f1916d9d640 1 -- 172.21.15.167:0/4175090973 reap_dead start 2023-11-28T20:51:17.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 shutdown_connections 2023-11-28T20:51:17.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 >> 172.21.15.167:0/4175090973 conn(0x7f19180cb1e0 msgr2=0x7f191814e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:17.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 shutdown_connections 2023-11-28T20:51:17.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.498+0000 7f191c89c640 1 -- 172.21.15.167:0/4175090973 wait complete. 2023-11-28T20:51:17.515 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:51:17.515 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:51:17.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:51:17.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fd152a640 1 Processor -- start 2023-11-28T20:51:17.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fd152a640 1 -- start start 2023-11-28T20:51:17.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fd152a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fcc0c7410 0x7f6fcc0ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fd152a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0cae80 con 0x7f6fcc0c97c0 2023-11-28T20:51:17.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fd152a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0c9bf0 con 0x7f6fcc0ca560 2023-11-28T20:51:17.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fd152a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c32f0 con 0x7f6fcc0c7410 2023-11-28T20:51:17.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fca7fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6fcc0c97c0 0x7f6fcc0c6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55992/0 (socket says 172.21.15.167:55992) 2023-11-28T20:51:17.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fca7fc640 1 -- 172.21.15.167:0/25779708 learned_addr learned my addr 172.21.15.167:0/25779708 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:17.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fcb7fe640 1 --2- 172.21.15.167:0/25779708 >> v2:172.21.15.178:3300/0 conn(0x7f6fcc0c7410 0x7f6fcc0ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612992898 0 0) 0x7f6fc0001120 con 0x7f6fcc0c97c0 2023-11-28T20:51:17.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb4003530 con 0x7f6fcc0c97c0 2023-11-28T20:51:17.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173812518 0 0) 0x7f6fcc0c9bf0 con 0x7f6fcc0ca560 2023-11-28T20:51:17.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc0001120 con 0x7f6fcc0ca560 2023-11-28T20:51:17.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 235732537 0 0) 0x7f6fb4003530 con 0x7f6fcc0c97c0 2023-11-28T20:51:17.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 >> v2:172.21.15.178:3300/0 conn(0x7f6fcc0c7410 msgr2=0x7f6fcc0ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:17.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 --2- 172.21.15.167:0/25779708 >> v2:172.21.15.178:3300/0 conn(0x7f6fcc0c7410 0x7f6fcc0ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 >> v1:172.21.15.178:6789/0 conn(0x7f6fcc0ca560 legacy=0x7f6fcc0cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc159e60 con 0x7f6fcc0c97c0 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f6fc0001790 con 0x7f6fcc0c97c0 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 >> v1:172.21.15.167:6789/0 conn(0x7f6fcc0c97c0 legacy=0x7f6fcc0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fb4003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fb40047d0 0x7f6fb4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fb4005250 0x7f6fb400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb400c160 con 0x7f6fb4003b60 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb400c2d0 con 0x7f6fb4005250 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb400c490 con 0x7f6fb40047d0 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fcaffd640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fb4003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fcb7fe640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fb4005250 0x7f6fb400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fca7fc640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fb40047d0 0x7f6fb4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fcaffd640 1 -- 172.21.15.167:0/25779708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fb40047d0 msgr2=0x7f6fb4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:17.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fcaffd640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fb40047d0 0x7f6fb4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fcaffd640 1 -- 172.21.15.167:0/25779708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fb4005250 msgr2=0x7f6fb400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:17.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fcaffd640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fb4005250 0x7f6fb400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fcaffd640 1 -- 172.21.15.167:0/25779708 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4003530 con 0x7f6fb4003b60 2023-11-28T20:51:17.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.658+0000 7f6fcb7fe640 1 -- 172.21.15.167:0/25779708 reap_dead start 2023-11-28T20:51:17.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fcaffd640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fb4003f60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0018d0 tx=0x7f6fbc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa2a104dd6b9054 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0052d0 con 0x7f6fb4003b60 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc0a7050 con 0x7f6fb4003b60 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fc9ffb640 1 -- 172.21.15.167:0/25779708 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc003600 con 0x7f6fb4003b60 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fd152a640 1 -- 172.21.15.167:0/25779708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 msgr2=0x7f6fb4003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fd152a640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fb4003f60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0018d0 tx=0x7f6fbc01c500 comp rx=0 tx=0).stop 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fd152a640 1 -- 172.21.15.167:0/25779708 shutdown_connections 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fd152a640 1 --2- 172.21.15.167:0/25779708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fb4003f60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fd152a640 1 -- 172.21.15.167:0/25779708 >> 172.21.15.167:0/25779708 conn(0x7f6fcc06a580 msgr2=0x7f6fcc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fd152a640 1 -- 172.21.15.167:0/25779708 shutdown_connections 2023-11-28T20:51:17.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.662+0000 7f6fd152a640 1 -- 172.21.15.167:0/25779708 wait complete. 2023-11-28T20:51:17.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 Processor -- start 2023-11-28T20:51:17.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 -- start start 2023-11-28T20:51:17.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fcc1f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc1e73e0 0x7f6fcc1f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14fb20 0x7f6fcc14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc15b060 con 0x7f6fb4003b60 2023-11-28T20:51:17.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc1f6aa0 con 0x7f6fcc14fb20 2023-11-28T20:51:17.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc1f7060 con 0x7f6fcc1e73e0 2023-11-28T20:51:17.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcaffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fcc1f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcaffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fcc1f74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38198/0 (socket says 172.21.15.167:38198) 2023-11-28T20:51:17.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcaffd640 1 -- 172.21.15.167:0/2224367747 learned_addr learned my addr 172.21.15.167:0/2224367747 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:17.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcb7fe640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14fb20 0x7f6fcc14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fca7fc640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc1e73e0 0x7f6fcc1f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcaffd640 1 -- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc1e73e0 msgr2=0x7f6fcc1f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcaffd640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc1e73e0 0x7f6fcc1f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcaffd640 1 -- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14fb20 msgr2=0x7f6fcc14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcaffd640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14fb20 0x7f6fcc14e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcaffd640 1 -- 172.21.15.167:0/2224367747 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc1f7a30 con 0x7f6fb4003b60 2023-11-28T20:51:17.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fca7fc640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc1e73e0 0x7f6fcc1f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:51:17.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fcaffd640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fcc1f74f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc005040 tx=0x7f6fb4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0ba070 con 0x7f6fb4003b60 2023-11-28T20:51:17.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc007020 con 0x7f6fb4003b60 2023-11-28T20:51:17.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0073d0 con 0x7f6fb4003b60 2023-11-28T20:51:17.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc1f3a50 con 0x7f6fb4003b60 2023-11-28T20:51:17.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.666+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc1f3fc0 con 0x7f6fb4003b60 2023-11-28T20:51:17.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fd152a640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14d3a0 0x7f6fcc14d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc074700 con 0x7f6fcc14d3a0 2023-11-28T20:51:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fca7fc640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14d3a0 0x7f6fcc14d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6fbc007530 con 0x7f6fb4003b60 2023-11-28T20:51:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fca7fc640 1 -- 172.21.15.167:0/2224367747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fcc072830 con 0x7f6fcc14d3a0 2023-11-28T20:51:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fca7fc640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14d3a0 0x7f6fcc14d780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc02cef0 tx=0x7f6fc0010c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fb37fe640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb80664a0 0x7f6fb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6fbc11dc20 con 0x7f6fb4003b60 2023-11-28T20:51:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000e6e0 con 0x7f6fcc14d3a0 2023-11-28T20:51:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fcb7fe640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb80664a0 0x7f6fb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6fc000e840 con 0x7f6fcc14d3a0 2023-11-28T20:51:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14d3a0 msgr2=0x7f6fcc14d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fb37fe640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14d3a0 0x7f6fcc14d780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc02cef0 tx=0x7f6fc0010c10 comp rx=0 tx=0).stop 2023-11-28T20:51:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14d3a0 msgr2=0x7f6fcc14d780 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:17.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fb37fe640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc14d3a0 0x7f6fcc14d780 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc02cef0 tx=0x7f6fc0010c10 comp rx=0 tx=0).stop 2023-11-28T20:51:17.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.670+0000 7f6fcb7fe640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb80664a0 0x7f6fb8068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0c9ba0 tx=0x7f6fc400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fd152a640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc158180 0x7f6fcc158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc14dcc0 con 0x7f6fcc158180 2023-11-28T20:51:17.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fca7fc640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc158180 0x7f6fcc158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fca7fc640 1 -- 172.21.15.167:0/2224367747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6fcc15a9a0 con 0x7f6fcc158180 2023-11-28T20:51:17.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fca7fc640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc158180 0x7f6fcc158590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0019000 tx=0x7f6fc0000bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc001f220 con 0x7f6fcc158180 2023-11-28T20:51:17.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4810 (secure 0 0 0) 0x7f6fc00149e0 con 0x7f6fcc158180 2023-11-28T20:51:17.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc158180 msgr2=0x7f6fcc158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fb37fe640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc158180 0x7f6fcc158590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0019000 tx=0x7f6fc0000bd0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fb37fe640 1 -- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc158180 msgr2=0x7f6fcc158590 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:17.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.678+0000 7f6fb37fe640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc158180 0x7f6fcc158590 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0019000 tx=0x7f6fc0000bd0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:51:17.680 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 108, 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:51:17.681 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:51:17.682 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:17.682 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:17.682 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:17.682 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:17.682 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:17.682 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:17.682 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:17.683 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:17.683 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:17.683 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:17.683 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.683 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:51:17.683 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:51:17.684 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:17.684 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:17.684 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:17.684 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:17.684 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:17.684 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:17.685 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:17.685 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:17.685 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:17.685 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:17.685 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.685 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:51:17.685 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:51:17.686 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:51:17.686 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:51:17.686 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:51:17.686 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:51:17.686 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:17.686 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:17.686 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:51:17.686 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:51:17.686 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:17.687 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:17.688 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:17.689 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:17.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.691 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.693 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:17.694 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.695 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.695 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:51:17.695 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:51:17.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.695 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.695 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.695 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:17.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.696 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.696 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:51:17.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.696 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.696 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.696 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.697 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.698 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.698 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:17.698 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.698 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.698 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.698 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:51:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:51:17.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb80664a0 msgr2=0x7f6fb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fd152a640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6fb80664a0 0x7f6fb8068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0c9ba0 tx=0x7f6fc400b040 comp rx=0 tx=0).stop 2023-11-28T20:51:17.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 msgr2=0x7f6fcc1f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fd152a640 1 --2- 172.21.15.167:0/2224367747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6fb4003b60 0x7f6fcc1f74f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc005040 tx=0x7f6fb4005800 comp rx=0 tx=0).stop 2023-11-28T20:51:17.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fcb7fe640 1 -- 172.21.15.167:0/2224367747 reap_dead start 2023-11-28T20:51:17.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fcb7fe640 1 -- 172.21.15.167:0/2224367747 reap_dead start 2023-11-28T20:51:17.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 shutdown_connections 2023-11-28T20:51:17.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 >> 172.21.15.167:0/2224367747 conn(0x7f6fcc06a580 msgr2=0x7f6fcc0cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:17.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 shutdown_connections 2023-11-28T20:51:17.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.682+0000 7f6fd152a640 1 -- 172.21.15.167:0/2224367747 wait complete. 2023-11-28T20:51:17.701 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:51:17.701 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:51:17.701 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:51:17.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fccaa3f8640 1 Processor -- start 2023-11-28T20:51:17.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fccaa3f8640 1 -- start start 2023-11-28T20:51:17.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fccaa3f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcca4151f60 0x7fcca40c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fccaa3f8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcca406a580 0x7fcca406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fccaa3f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca40c6120 con 0x7fcca40c5c90 2023-11-28T20:51:17.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fccaa3f8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca406aed0 con 0x7fcca406a580 2023-11-28T20:51:17.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fccaa3f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca40c4da0 con 0x7fcca4151f60 2023-11-28T20:51:17.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fcca8995640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcca406a580 0x7fcca406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fcca37fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcca40c5c90 0x7fcca40c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56006/0 (socket says 172.21.15.167:56006) 2023-11-28T20:51:17.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fcca37fe640 1 -- 172.21.15.167:0/612205872 learned_addr learned my addr 172.21.15.167:0/612205872 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:17.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fcca3fff640 1 --2- 172.21.15.167:0/612205872 >> v2:172.21.15.178:3300/0 conn(0x7fcca4151f60 0x7fcca40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fcca8995640 1 -- 172.21.15.167:0/612205872 >> v2:172.21.15.178:3300/0 conn(0x7fcca4151f60 msgr2=0x7fcca40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:17.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fcca8995640 1 --2- 172.21.15.167:0/612205872 >> v2:172.21.15.178:3300/0 conn(0x7fcca4151f60 0x7fcca40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fcca8995640 1 -- 172.21.15.167:0/612205872 >> v1:172.21.15.167:6789/0 conn(0x7fcca40c5c90 legacy=0x7fcca40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.846+0000 7fcca8995640 1 -- 172.21.15.167:0/612205872 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca415b220 con 0x7fcca406a580 2023-11-28T20:51:17.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fcca8995640 1 --2- 172.21.15.167:0/612205872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 0x7fcca406a990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcca40c62c0 tx=0x7fcc9c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32cd406db77f611 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fcca2ffd640 1 -- 172.21.15.167:0/612205872 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0a5740 con 0x7fcca406a580 2023-11-28T20:51:17.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fcca2ffd640 1 -- 172.21.15.167:0/612205872 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c0a58a0 con 0x7fcca406a580 2023-11-28T20:51:17.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fcca2ffd640 1 -- 172.21.15.167:0/612205872 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0a5c30 con 0x7fcca406a580 2023-11-28T20:51:17.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fccaa3f8640 1 -- 172.21.15.167:0/612205872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 msgr2=0x7fcca406a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fccaa3f8640 1 --2- 172.21.15.167:0/612205872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 0x7fcca406a990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcca40c62c0 tx=0x7fcc9c01c880 comp rx=0 tx=0).stop 2023-11-28T20:51:17.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fccaa3f8640 1 -- 172.21.15.167:0/612205872 shutdown_connections 2023-11-28T20:51:17.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fccaa3f8640 1 --2- 172.21.15.167:0/612205872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 0x7fcca406a990 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fccaa3f8640 1 --2- 172.21.15.167:0/612205872 >> v2:172.21.15.178:3300/0 conn(0x7fcca4151f60 0x7fcca40c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fccaa3f8640 1 -- 172.21.15.167:0/612205872 >> 172.21.15.167:0/612205872 conn(0x7fcca40cb1e0 msgr2=0x7fcca40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:17.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fccaa3f8640 1 -- 172.21.15.167:0/612205872 shutdown_connections 2023-11-28T20:51:17.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.850+0000 7fccaa3f8640 1 -- 172.21.15.167:0/612205872 wait complete. 2023-11-28T20:51:17.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fccaa3f8640 1 Processor -- start 2023-11-28T20:51:17.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fccaa3f8640 1 -- start start 2023-11-28T20:51:17.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fccaa3f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 0x7fcca414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fccaa3f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcca40c5c90 0x7fcca414a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fccaa3f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4151f60 0x7fcca40c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fccaa3f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca4070ed0 con 0x7fcca406a580 2023-11-28T20:51:17.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fccaa3f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40c9170 con 0x7fcca40c5c90 2023-11-28T20:51:17.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fccaa3f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40c9730 con 0x7fcca4151f60 2023-11-28T20:51:17.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 0x7fcca414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 0x7fcca414a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38214/0 (socket says 172.21.15.167:38214) 2023-11-28T20:51:17.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca3fff640 1 -- 172.21.15.167:0/768891374 learned_addr learned my addr 172.21.15.167:0/768891374 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:17.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca37fe640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcca40c5c90 0x7fcca414a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca8995640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4151f60 0x7fcca40c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca3fff640 1 -- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4151f60 msgr2=0x7fcca40c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca3fff640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4151f60 0x7fcca40c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca3fff640 1 -- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcca40c5c90 msgr2=0x7fcca414a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca3fff640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcca40c5c90 0x7fcca414a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca3fff640 1 -- 172.21.15.167:0/768891374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c009a70 con 0x7fcca406a580 2023-11-28T20:51:17.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca8995640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4151f60 0x7fcca40c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:51:17.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca3fff640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 0x7fcca414a2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400d800 tx=0x7fcc9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400b6c0 con 0x7fcca406a580 2023-11-28T20:51:17.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9400b820 con 0x7fcca406a580 2023-11-28T20:51:17.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400bb90 con 0x7fcca406a580 2023-11-28T20:51:17.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.854+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca414ae50 con 0x7fcca406a580 2023-11-28T20:51:17.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca414b3d0 con 0x7fcca406a580 2023-11-28T20:51:17.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fccaa3f8640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca41437c0 0x7fcca40ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca4074770 con 0x7fcca41437c0 2023-11-28T20:51:17.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca37fe640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca41437c0 0x7fcca40ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc9400bcf0 con 0x7fcca406a580 2023-11-28T20:51:17.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca37fe640 1 -- 172.21.15.167:0/768891374 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcca40c6520 con 0x7fcca41437c0 2023-11-28T20:51:17.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca37fe640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca41437c0 0x7fcca40ca100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcca4142390 tx=0x7fcc9800e960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca0ff9640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc90066470 0x7fcc90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fcc94084820 con 0x7fcca406a580 2023-11-28T20:51:17.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98005ad0 con 0x7fcca41437c0 2023-11-28T20:51:17.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca8995640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc90066470 0x7fcc90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fcc98005c30 con 0x7fcca41437c0 2023-11-28T20:51:17.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca41437c0 msgr2=0x7fcca40ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca0ff9640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca41437c0 0x7fcca40ca100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcca4142390 tx=0x7fcc9800e960 comp rx=0 tx=0).stop 2023-11-28T20:51:17.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca41437c0 msgr2=0x7fcca40ca100 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:17.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.858+0000 7fcca0ff9640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca41437c0 0x7fcca40ca100 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcca4142390 tx=0x7fcc9800e960 comp rx=0 tx=0).stop 2023-11-28T20:51:17.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.862+0000 7fcca8995640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc90066470 0x7fcc90068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0af000 tx=0x7fcc9c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fccaa3f8640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4072110 0x7fcca413e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40c98a0 con 0x7fcca4072110 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fcca37fe640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4072110 0x7fcca413e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fcca37fe640 1 -- 172.21.15.167:0/768891374 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcca415ba30 con 0x7fcca4072110 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fcca37fe640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4072110 0x7fcca413e9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcca4067a70 tx=0x7fcc98005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980074e0 con 0x7fcca4072110 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7fcc98007640 con 0x7fcca4072110 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4072110 msgr2=0x7fcca413e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fcca0ff9640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4072110 0x7fcca413e9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcca4067a70 tx=0x7fcc98005800 comp rx=0 tx=0).stop 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fcca0ff9640 1 -- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4072110 msgr2=0x7fcca413e9c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:17.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.866+0000 7fcca0ff9640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcca4072110 0x7fcca413e9c0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcca4067a70 tx=0x7fcc98005800 comp rx=0 tx=0).stop 2023-11-28T20:51:17.869 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:51:17.869 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:17.869 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:17.869 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:51:17.869 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 108, 2023-11-28T20:51:17.869 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:51:17.869 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:51:17.870 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:51:17.870 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:51:17.870 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.870 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:51:17.870 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:17.870 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:51:17.870 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:51:17.870 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:17.870 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:17.871 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:17.871 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:17.871 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:17.871 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:17.871 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:17.871 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:17.872 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:51:17.873 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:51:17.874 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:17.874 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:17.874 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:51:17.874 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:51:17.874 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:51:17.874 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:51:17.874 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:51:17.874 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:51:17.874 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:51:17.875 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:17.875 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:51:17.875 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:17.875 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:17.876 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:17.876 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:17.876 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:17.876 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:17.876 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:17.876 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:17.876 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:17.877 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:17.877 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.877 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:51:17.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.877 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:51:17.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.878 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.879 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:51:17.880 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.881 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.882 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:17.883 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.884 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.885 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.886 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:17.886 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.886 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.886 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:51:17.886 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.886 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:51:17.886 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.886 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:17.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.887 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.887 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.887 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.887 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:17.887 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.887 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:17.887 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:51:17.888 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:17.888 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:17.888 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:17.888 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:17.888 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:17.888 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:17.888 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:17.888 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:51:17.889 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:51:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc90066470 msgr2=0x7fcc90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fccaa3f8640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcc90066470 0x7fcc90068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0af000 tx=0x7fcc9c0a7070 comp rx=0 tx=0).stop 2023-11-28T20:51:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 msgr2=0x7fcca414a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fccaa3f8640 1 --2- 172.21.15.167:0/768891374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcca406a580 0x7fcca414a2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400d800 tx=0x7fcc9400dcc0 comp rx=0 tx=0).stop 2023-11-28T20:51:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fcca8995640 1 -- 172.21.15.167:0/768891374 reap_dead start 2023-11-28T20:51:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fcca8995640 1 -- 172.21.15.167:0/768891374 reap_dead start 2023-11-28T20:51:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 shutdown_connections 2023-11-28T20:51:17.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 >> 172.21.15.167:0/768891374 conn(0x7fcca40cb1e0 msgr2=0x7fcca40cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:17.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 shutdown_connections 2023-11-28T20:51:17.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:17.870+0000 7fccaa3f8640 1 -- 172.21.15.167:0/768891374 wait complete. 2023-11-28T20:51:17.891 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:51:17.891 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:51:17.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:51:18.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.030+0000 7f81f4b55640 1 Processor -- start 2023-11-28T20:51:18.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.030+0000 7f81f4b55640 1 -- start start 2023-11-28T20:51:18.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81f4b55640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f00cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:18.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81f4b55640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f81f00cfc40 0x7f81f00ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:18.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81f4b55640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f015ac00 con 0x7f81f0153ae0 2023-11-28T20:51:18.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81f4b55640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00cbd60 con 0x7f81f00cfc40 2023-11-28T20:51:18.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81f4b55640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f0159ff0 con 0x7f81f00cf860 2023-11-28T20:51:18.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81ee59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:18.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81ee59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f00cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:47072/0 (socket says 172.21.15.167:47072) 2023-11-28T20:51:18.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81ee59c640 1 -- 172.21.15.167:0/3305556891 learned_addr learned my addr 172.21.15.167:0/3305556891 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:18.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81e7fff640 1 --2- 172.21.15.167:0/3305556891 >> v2:172.21.15.178:3300/0 conn(0x7f81f00cfc40 0x7f81f00ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:18.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81ee59c640 1 -- 172.21.15.167:0/3305556891 >> v2:172.21.15.178:3300/0 conn(0x7f81f00cfc40 msgr2=0x7f81f00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:18.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81ee59c640 1 --2- 172.21.15.167:0/3305556891 >> v2:172.21.15.178:3300/0 conn(0x7f81f00cfc40 0x7f81f00ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81ee59c640 1 -- 172.21.15.167:0/3305556891 >> v1:172.21.15.178:6789/0 conn(0x7f81f0153ae0 legacy=0x7f81f015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:18.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.034+0000 7f81ee59c640 1 -- 172.21.15.167:0/3305556891 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f015a2d0 con 0x7f81f00cf860 2023-11-28T20:51:18.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81ee59c640 1 --2- 172.21.15.167:0/3305556891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f00cb770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009870 tx=0x7f81e001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=254a5949532ed3a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:18.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81edd9b640 1 -- 172.21.15.167:0/3305556891 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00aa670 con 0x7f81f00cf860 2023-11-28T20:51:18.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81edd9b640 1 -- 172.21.15.167:0/3305556891 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e00aa7d0 con 0x7f81f00cf860 2023-11-28T20:51:18.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81edd9b640 1 -- 172.21.15.167:0/3305556891 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00aab60 con 0x7f81f00cf860 2023-11-28T20:51:18.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81f4b55640 1 -- 172.21.15.167:0/3305556891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 msgr2=0x7f81f00cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:18.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81f4b55640 1 --2- 172.21.15.167:0/3305556891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f00cb770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009870 tx=0x7f81e001c510 comp rx=0 tx=0).stop 2023-11-28T20:51:18.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81f4b55640 1 -- 172.21.15.167:0/3305556891 shutdown_connections 2023-11-28T20:51:18.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81f4b55640 1 --2- 172.21.15.167:0/3305556891 >> v2:172.21.15.178:3300/0 conn(0x7f81f00cfc40 0x7f81f00ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81f4b55640 1 --2- 172.21.15.167:0/3305556891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f00cb770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81f4b55640 1 -- 172.21.15.167:0/3305556891 >> 172.21.15.167:0/3305556891 conn(0x7f81f006c1f0 msgr2=0x7f81f0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:18.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81f4b55640 1 -- 172.21.15.167:0/3305556891 shutdown_connections 2023-11-28T20:51:18.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.038+0000 7f81f4b55640 1 -- 172.21.15.167:0/3305556891 wait complete. 2023-11-28T20:51:18.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 Processor -- start 2023-11-28T20:51:18.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 -- start start 2023-11-28T20:51:18.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f0140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:18.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f00cfc40 0x7f81f013cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:18.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f0153ae0 0x7f81f013d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:18.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00b4100 con 0x7f81f00cfc40 2023-11-28T20:51:18.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00b50d0 con 0x7f81f0153ae0 2023-11-28T20:51:18.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01512f0 con 0x7f81f00cf860 2023-11-28T20:51:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f00cfc40 0x7f81f013cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f00cfc40 0x7f81f013cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38228/0 (socket says 172.21.15.167:38228) 2023-11-28T20:51:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e7fff640 1 -- 172.21.15.167:0/3368075076 learned_addr learned my addr 172.21.15.167:0/3368075076 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81ee59c640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f0140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81eed9d640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f0153ae0 0x7f81f013d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e7fff640 1 -- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 msgr2=0x7f81f0140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e7fff640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f0140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e7fff640 1 -- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f0153ae0 msgr2=0x7f81f013d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:18.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e7fff640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f0153ae0 0x7f81f013d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e7fff640 1 -- 172.21.15.167:0/3368075076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00094d0 con 0x7f81f00cfc40 2023-11-28T20:51:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81eed9d640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f0153ae0 0x7f81f013d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:51:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e7fff640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f00cfc40 0x7f81f013cf20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81d800e930 tx=0x7f81d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e6ffd640 1 -- 172.21.15.167:0/3368075076 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8009690 con 0x7f81f00cfc40 2023-11-28T20:51:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e6ffd640 1 -- 172.21.15.167:0/3368075076 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d800ca00 con 0x7f81f00cfc40 2023-11-28T20:51:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81e6ffd640 1 -- 172.21.15.167:0/3368075076 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d800cd70 con 0x7f81f00cfc40 2023-11-28T20:51:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f013e0f0 con 0x7f81f00cfc40 2023-11-28T20:51:18.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f00b45f0 con 0x7f81f00cfc40 2023-11-28T20:51:18.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.042+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f0075c90 con 0x7f81f00cfc40 2023-11-28T20:51:18.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.046+0000 7f81e6ffd640 1 -- 172.21.15.167:0/3368075076 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81d8013470 con 0x7f81f00cfc40 2023-11-28T20:51:18.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.046+0000 7f81e6ffd640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f81d0066470 0x7f81d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:18.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.046+0000 7f81e6ffd640 1 -- 172.21.15.167:0/3368075076 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f81d8084530 con 0x7f81f00cfc40 2023-11-28T20:51:18.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.046+0000 7f81ee59c640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f81d0066470 0x7f81d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:18.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.046+0000 7f81ee59c640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f81d0066470 0x7f81d0068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f81e00ae000 tx=0x7f81e00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:18.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.050+0000 7f81e6ffd640 1 -- 172.21.15.167:0/3368075076 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81d8051620 con 0x7f81f00cfc40 2023-11-28T20:51:18.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.254+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f81f00b1e70 con 0x7f81f00cfc40 2023-11-28T20:51:18.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81e6ffd640 1 -- 172.21.15.167:0/3368075076 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f81d8054c40 con 0x7f81f00cfc40 2023-11-28T20:51:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f81d0066470 msgr2=0x7f81d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f81d0066470 0x7f81d0068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f81e00ae000 tx=0x7f81e00b5040 comp rx=0 tx=0).stop 2023-11-28T20:51:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f00cfc40 msgr2=0x7f81f013cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:18.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f00cfc40 0x7f81f013cf20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f81d800e930 tx=0x7f81d800edf0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 shutdown_connections 2023-11-28T20:51:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f81d0066470 0x7f81d0068930 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f0153ae0 0x7f81f013d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81f00cfc40 0x7f81f013cf20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 --2- 172.21.15.167:0/3368075076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf860 0x7f81f0140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 >> 172.21.15.167:0/3368075076 conn(0x7f81f006c1f0 msgr2=0x7f81f00662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 shutdown_connections 2023-11-28T20:51:18.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:18.258+0000 7f81f4b55640 1 -- 172.21.15.167:0/3368075076 wait complete. 2023-11-28T20:51:18.278 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:51:19.106 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:51:19.110 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:51:28.278 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:51:28.279 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:28.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c958d6640 1 Processor -- start 2023-11-28T20:51:28.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c958d6640 1 -- start start 2023-11-28T20:51:28.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c958d6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c900aff70 0x7f8c90066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c958d6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8c9006d530 0x7f8c9006b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c958d6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c900c8280 con 0x7f8c9015d3b0 2023-11-28T20:51:28.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c958d6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c900c8910 con 0x7f8c9006d530 2023-11-28T20:51:28.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c958d6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c90066bc0 con 0x7f8c900aff70 2023-11-28T20:51:28.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c87fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8c9006d530 0x7f8c9006b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c87fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8c9006d530 0x7f8c9006b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33110/0 (socket says 172.21.15.167:33110) 2023-11-28T20:51:28.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c87fff640 1 -- 172.21.15.167:0/2690447318 learned_addr learned my addr 172.21.15.167:0/2690447318 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:28.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c8effd640 1 --2- 172.21.15.167:0/2690447318 >> v2:172.21.15.178:3300/0 conn(0x7f8c900aff70 0x7f8c90066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c87fff640 1 -- 172.21.15.167:0/2690447318 >> v2:172.21.15.178:3300/0 conn(0x7f8c900aff70 msgr2=0x7f8c90066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:28.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c87fff640 1 --2- 172.21.15.167:0/2690447318 >> v2:172.21.15.178:3300/0 conn(0x7f8c900aff70 0x7f8c90066680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c87fff640 1 -- 172.21.15.167:0/2690447318 >> v1:172.21.15.178:6789/0 conn(0x7f8c9015d3b0 legacy=0x7f8c900cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.418+0000 7f8c87fff640 1 -- 172.21.15.167:0/2690447318 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c900ca3b0 con 0x7f8c9006d530 2023-11-28T20:51:28.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c87fff640 1 --2- 172.21.15.167:0/2690447318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9006d530 0x7f8c9006b690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c900ce6b0 tx=0x7f8c7801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456c9b7ba4f67202 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:28.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c8e7fc640 1 -- 172.21.15.167:0/2690447318 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c780aa430 con 0x7f8c9006d530 2023-11-28T20:51:28.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c8e7fc640 1 -- 172.21.15.167:0/2690447318 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c780aa590 con 0x7f8c9006d530 2023-11-28T20:51:28.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c8e7fc640 1 -- 172.21.15.167:0/2690447318 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c780aa920 con 0x7f8c9006d530 2023-11-28T20:51:28.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c958d6640 1 -- 172.21.15.167:0/2690447318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9006d530 msgr2=0x7f8c9006b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c958d6640 1 --2- 172.21.15.167:0/2690447318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9006d530 0x7f8c9006b690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c900ce6b0 tx=0x7f8c7801c4d0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c958d6640 1 -- 172.21.15.167:0/2690447318 shutdown_connections 2023-11-28T20:51:28.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c958d6640 1 --2- 172.21.15.167:0/2690447318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9006d530 0x7f8c9006b690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c958d6640 1 --2- 172.21.15.167:0/2690447318 >> v2:172.21.15.178:3300/0 conn(0x7f8c900aff70 0x7f8c90066680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c958d6640 1 -- 172.21.15.167:0/2690447318 >> 172.21.15.167:0/2690447318 conn(0x7f8c9006ee00 msgr2=0x7f8c9006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:28.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c958d6640 1 -- 172.21.15.167:0/2690447318 shutdown_connections 2023-11-28T20:51:28.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.422+0000 7f8c958d6640 1 -- 172.21.15.167:0/2690447318 wait complete. 2023-11-28T20:51:28.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 Processor -- start 2023-11-28T20:51:28.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 -- start start 2023-11-28T20:51:28.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c9006d530 0x7f8c901f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900aff70 0x7f8c90157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9015d3b0 0x7f8c900b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c901f3900 con 0x7f8c9015d3b0 2023-11-28T20:51:28.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900b1520 con 0x7f8c9006d530 2023-11-28T20:51:28.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900cc960 con 0x7f8c900aff70 2023-11-28T20:51:28.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9015d3b0 0x7f8c900b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9015d3b0 0x7f8c900b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33112/0 (socket says 172.21.15.167:33112) 2023-11-28T20:51:28.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c9006d530 0x7f8c901f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8f7fe640 1 -- 172.21.15.167:0/1192065212 learned_addr learned my addr 172.21.15.167:0/1192065212 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:28.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c87fff640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900aff70 0x7f8c90157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8f7fe640 1 -- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900aff70 msgr2=0x7f8c90157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8f7fe640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900aff70 0x7f8c90157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8f7fe640 1 -- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c9006d530 msgr2=0x7f8c901f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8f7fe640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c9006d530 0x7f8c901f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8f7fe640 1 -- 172.21.15.167:0/1192065212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780094d0 con 0x7f8c9015d3b0 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8f7fe640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9015d3b0 0x7f8c900b1fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c730 tx=0x7f8c8800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8cff9640 1 -- 172.21.15.167:0/1192065212 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88003b80 con 0x7f8c9015d3b0 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8cff9640 1 -- 172.21.15.167:0/1192065212 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88003ce0 con 0x7f8c9015d3b0 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c900ccc40 con 0x7f8c9015d3b0 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c8cff9640 1 -- 172.21.15.167:0/1192065212 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88005310 con 0x7f8c9015d3b0 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.426+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c900b17e0 con 0x7f8c9015d3b0 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.430+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c90075c90 con 0x7f8c9015d3b0 2023-11-28T20:51:28.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.430+0000 7f8c8cff9640 1 -- 172.21.15.167:0/1192065212 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8c88005680 con 0x7f8c9015d3b0 2023-11-28T20:51:28.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.430+0000 7f8c8cff9640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c70066470 0x7f8c70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.430+0000 7f8c8cff9640 1 -- 172.21.15.167:0/1192065212 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8c88083fe0 con 0x7f8c9015d3b0 2023-11-28T20:51:28.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.430+0000 7f8c8effd640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c70066470 0x7f8c70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.434+0000 7f8c8effd640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c70066470 0x7f8c70068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8c80007a60 tx=0x7f8c80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:28.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.434+0000 7f8c8cff9640 1 -- 172.21.15.167:0/1192065212 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c88051150 con 0x7f8c9015d3b0 2023-11-28T20:51:28.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8c900cafb0 con 0x7f8c9015d3b0 2023-11-28T20:51:28.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c8cff9640 1 -- 172.21.15.167:0/1192065212 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f8c88054770 con 0x7f8c9015d3b0 2023-11-28T20:51:28.684 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:28.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c70066470 msgr2=0x7f8c70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c70066470 0x7f8c70068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8c80007a60 tx=0x7f8c80008040 comp rx=0 tx=0).stop 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9015d3b0 msgr2=0x7f8c900b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9015d3b0 0x7f8c900b1fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c730 tx=0x7f8c8800cbf0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 shutdown_connections 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c70066470 0x7f8c70068930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9015d3b0 0x7f8c900b1fe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c900aff70 0x7f8c90157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 --2- 172.21.15.167:0/1192065212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c9006d530 0x7f8c901f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 >> 172.21.15.167:0/1192065212 conn(0x7f8c9006ee00 msgr2=0x7f8c90158830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 shutdown_connections 2023-11-28T20:51:28.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.686+0000 7f8c958d6640 1 -- 172.21.15.167:0/1192065212 wait complete. 2023-11-28T20:51:28.706 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:51:28.706 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:51:28.706 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:51:28.706 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:51:28.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e9f2a640 1 Processor -- start 2023-11-28T20:51:28.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e9f2a640 1 -- start start 2023-11-28T20:51:28.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e9f2a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0e4151f60 0x7fd0e40c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e9f2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e40c5c90 0x7fd0e40c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e9f2a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e415b220 con 0x7fd0e406a580 2023-11-28T20:51:28.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e9f2a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e40c4da0 con 0x7fd0e4151f60 2023-11-28T20:51:28.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e9f2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e40c60f0 con 0x7fd0e40c5c90 2023-11-28T20:51:28.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0e4151f60 0x7fd0e40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0e4151f60 0x7fd0e40c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33114/0 (socket says 172.21.15.167:33114) 2023-11-28T20:51:28.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e37fe640 1 -- 172.21.15.167:0/3903982633 learned_addr learned my addr 172.21.15.167:0/3903982633 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:28.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e3fff640 1 --1- 172.21.15.167:0/3903982633 >> v1:172.21.15.167:6789/0 conn(0x7fd0e406a580 0x7fd0e406ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36236/0 (socket says 172.21.15.167:36236) 2023-11-28T20:51:28.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e2ffd640 1 --2- 172.21.15.167:0/3903982633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e40c5c90 0x7fd0e40c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e37fe640 1 -- 172.21.15.167:0/3903982633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e40c5c90 msgr2=0x7fd0e40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:28.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e37fe640 1 --2- 172.21.15.167:0/3903982633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e40c5c90 0x7fd0e40c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e37fe640 1 -- 172.21.15.167:0/3903982633 >> v1:172.21.15.167:6789/0 conn(0x7fd0e406a580 legacy=0x7fd0e406ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.846+0000 7fd0e37fe640 1 -- 172.21.15.167:0/3903982633 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4152340 con 0x7fd0e4151f60 2023-11-28T20:51:28.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e37fe640 1 --2- 172.21.15.167:0/3903982633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 0x7fd0e40c75c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009870 tx=0x7fd0d401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5b47fd1e3cf946 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e27fc640 1 -- 172.21.15.167:0/3903982633 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40ac600 con 0x7fd0e4151f60 2023-11-28T20:51:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e27fc640 1 -- 172.21.15.167:0/3903982633 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d40a8050 con 0x7fd0e4151f60 2023-11-28T20:51:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e27fc640 1 -- 172.21.15.167:0/3903982633 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40ac980 con 0x7fd0e4151f60 2023-11-28T20:51:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/3903982633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 msgr2=0x7fd0e40c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e9f2a640 1 --2- 172.21.15.167:0/3903982633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 0x7fd0e40c75c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009870 tx=0x7fd0d401c4b0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/3903982633 shutdown_connections 2023-11-28T20:51:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e9f2a640 1 --2- 172.21.15.167:0/3903982633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e40c5c90 0x7fd0e40c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e9f2a640 1 --2- 172.21.15.167:0/3903982633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 0x7fd0e40c75c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/3903982633 >> 172.21.15.167:0/3903982633 conn(0x7fd0e40cb1e0 msgr2=0x7fd0e40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/3903982633 shutdown_connections 2023-11-28T20:51:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.850+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/3903982633 wait complete. 2023-11-28T20:51:28.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e9f2a640 1 Processor -- start 2023-11-28T20:51:28.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e9f2a640 1 -- start start 2023-11-28T20:51:28.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e9f2a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e406a580 0x7fd0e4157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e9f2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e40c5c90 0x7fd0e41568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e9f2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 0x7fd0e41f9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e9f2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4162800 con 0x7fd0e4151f60 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e9f2a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4072330 con 0x7fd0e406a580 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e9f2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4157960 con 0x7fd0e40c5c90 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 0x7fd0e41f9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 0x7fd0e41f9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33124/0 (socket says 172.21.15.167:33124) 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e3fff640 1 -- 172.21.15.167:0/492542274 learned_addr learned my addr 172.21.15.167:0/492542274 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e37fe640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e406a580 0x7fd0e4157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e2ffd640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e40c5c90 0x7fd0e41568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e3fff640 1 -- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e40c5c90 msgr2=0x7fd0e41568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e3fff640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0e40c5c90 0x7fd0e41568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e3fff640 1 -- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e406a580 msgr2=0x7fd0e4157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e3fff640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0e406a580 0x7fd0e4157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e3fff640 1 -- 172.21.15.167:0/492542274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d40094d0 con 0x7fd0e4151f60 2023-11-28T20:51:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0e3fff640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 0x7fd0e41f9e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00c7d0 tx=0x7fd0dc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00a640 con 0x7fd0e4151f60 2023-11-28T20:51:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc00a7a0 con 0x7fd0e4151f60 2023-11-28T20:51:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.854+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00ab10 con 0x7fd0e4151f60 2023-11-28T20:51:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e40c2340 con 0x7fd0e4151f60 2023-11-28T20:51:28.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e4071570 con 0x7fd0e4151f60 2023-11-28T20:51:28.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0e9f2a640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41fa3d0 0x7fd0e4071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4074770 con 0x7fd0e41fa3d0 2023-11-28T20:51:28.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0e37fe640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41fa3d0 0x7fd0e4071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0e37fe640 1 -- 172.21.15.167:0/492542274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0e406ada0 con 0x7fd0e41fa3d0 2023-11-28T20:51:28.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0e37fe640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41fa3d0 0x7fd0e4071760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4158660 tx=0x7fd0d4019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:28.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40b6670 con 0x7fd0e41fa3d0 2023-11-28T20:51:28.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0dc00ac70 con 0x7fd0e4151f60 2023-11-28T20:51:28.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0cbfff640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0d0066540 0x7fd0d0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd0dc083aa0 con 0x7fd0e4151f60 2023-11-28T20:51:28.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd0d40b67d0 con 0x7fd0e41fa3d0 2023-11-28T20:51:28.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41fa3d0 msgr2=0x7fd0e4071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0cbfff640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41fa3d0 0x7fd0e4071760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4158660 tx=0x7fd0d4019250 comp rx=0 tx=0).stop 2023-11-28T20:51:28.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41fa3d0 msgr2=0x7fd0e4071760 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:28.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0cbfff640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41fa3d0 0x7fd0e4071760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.858+0000 7fd0e2ffd640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0d0066540 0x7fd0d0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.862+0000 7fd0e2ffd640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0d0066540 0x7fd0d0068a00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd0e406de20 tx=0x7fd0d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:28.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41465f0 0x7fd0e4146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:28.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e41fa7b0 con 0x7fd0e41465f0 2023-11-28T20:51:28.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e37fe640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41465f0 0x7fd0e4146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:28.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e37fe640 1 -- 172.21.15.167:0/492542274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd0e415ba30 con 0x7fd0e41465f0 2023-11-28T20:51:28.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e37fe640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41465f0 0x7fd0e4146a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd0d401ab60 tx=0x7fd0d4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:28.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4003ae0 con 0x7fd0e41465f0 2023-11-28T20:51:28.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4473 (secure 0 0 0) 0x7fd0d4003c40 con 0x7fd0e41465f0 2023-11-28T20:51:28.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41465f0 msgr2=0x7fd0e4146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0cbfff640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41465f0 0x7fd0e4146a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd0d401ab60 tx=0x7fd0d4009240 comp rx=0 tx=0).stop 2023-11-28T20:51:28.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0cbfff640 1 -- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41465f0 msgr2=0x7fd0e4146a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:28.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0cbfff640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e41465f0 0x7fd0e4146a00 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd0d401ab60 tx=0x7fd0d4009240 comp rx=0 tx=0).stop 2023-11-28T20:51:28.867 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:51:28.867 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:28.867 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:28.867 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:51:28.867 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 108, 2023-11-28T20:51:28.867 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:28.868 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:28.869 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:28.869 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:28.869 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:28.869 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:28.869 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:28.869 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:28.869 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:28.869 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:28.870 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:51:28.871 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:28.872 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:51:28.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.874 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:28.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:28.877 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:28.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:28.879 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:28.880 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:51:28.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:28.881 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:28.881 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:28.881 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:28.881 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:28.881 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:28.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:28.881 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:51:28.881 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:51:28.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0d0066540 msgr2=0x7fd0d0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd0d0066540 0x7fd0d0068a00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd0e406de20 tx=0x7fd0d8008040 comp rx=0 tx=0).stop 2023-11-28T20:51:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 msgr2=0x7fd0e41f9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 0x7fd0e41f9e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00c7d0 tx=0x7fd0dc00cc90 comp rx=0 tx=0).stop 2023-11-28T20:51:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e3fff640 1 -- 172.21.15.167:0/492542274 reap_dead start 2023-11-28T20:51:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 shutdown_connections 2023-11-28T20:51:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 --2- 172.21.15.167:0/492542274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0e4151f60 0x7fd0e41f9e90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 >> 172.21.15.167:0/492542274 conn(0x7fd0e40cb1e0 msgr2=0x7fd0e414fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 shutdown_connections 2023-11-28T20:51:28.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:28.866+0000 7fd0e9f2a640 1 -- 172.21.15.167:0/492542274 wait complete. 2023-11-28T20:51:28.885 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:51:28.885 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:51:28.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:51:29.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.030+0000 7ff3cd7a7640 1 Processor -- start 2023-11-28T20:51:29.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.030+0000 7ff3cd7a7640 1 -- start start 2023-11-28T20:51:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3cd7a7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c806b2a0 0x7ff3c80c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3cd7a7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c8070b70 con 0x7ff3c8150f30 2023-11-28T20:51:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3cd7a7640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c8156b10 con 0x7ff3c80c4b60 2023-11-28T20:51:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3cd7a7640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80c3a80 con 0x7ff3c806b2a0 2023-11-28T20:51:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c7fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff3c8150f30 0x7ff3c8070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36246/0 (socket says 172.21.15.167:36246) 2023-11-28T20:51:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c7fff640 1 -- 172.21.15.167:0/2122487426 learned_addr learned my addr 172.21.15.167:0/2122487426 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c77fe640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c806b2a0 0x7ff3c80c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184883104 0 0) 0x7ff3c8070b70 con 0x7ff3c8150f30 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b0003530 con 0x7ff3c8150f30 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4046349982 0 0) 0x7ff3b0003530 con 0x7ff3c8150f30 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c806b2a0 msgr2=0x7ff3c80c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c806b2a0 0x7ff3c80c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 >> v1:172.21.15.178:6789/0 conn(0x7ff3c80c4b60 legacy=0x7ff3c81612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80c2cc0 con 0x7ff3c8150f30 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7ff3b8001680 con 0x7ff3c8150f30 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 >> v1:172.21.15.167:6789/0 conn(0x7ff3c8150f30 legacy=0x7ff3c8070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00039b0 0x7ff3b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c806b2a0 0x7ff3b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3b0004d10 0x7ff3b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b000dc50 con 0x7ff3b00039b0 2023-11-28T20:51:29.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b000dd90 con 0x7ff3b0004d10 2023-11-28T20:51:29.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b000df50 con 0x7ff3c806b2a0 2023-11-28T20:51:29.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c7fff640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00039b0 0x7ff3b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c77fe640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c806b2a0 0x7ff3b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3ccfa6640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3b0004d10 0x7ff3b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c7fff640 1 -- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c806b2a0 msgr2=0x7ff3b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:29.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c7fff640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c806b2a0 0x7ff3b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c7fff640 1 -- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3b0004d10 msgr2=0x7ff3b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:29.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c7fff640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3b0004d10 0x7ff3b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c7fff640 1 -- 172.21.15.167:0/2122487426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0003530 con 0x7ff3b00039b0 2023-11-28T20:51:29.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3ccfa6640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3b0004d10 0x7ff3b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:51:29.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.034+0000 7ff3c77fe640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c806b2a0 0x7ff3b00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:51:29.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3c7fff640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00039b0 0x7ff3b0003dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800c210 tx=0x7ff3b801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31756da3634b626 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8005ae0 con 0x7ff3b00039b0 2023-11-28T20:51:29.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8005c40 con 0x7ff3b00039b0 2023-11-28T20:51:29.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3c6ffd640 1 -- 172.21.15.167:0/2122487426 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80072b0 con 0x7ff3b00039b0 2023-11-28T20:51:29.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/2122487426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00039b0 msgr2=0x7ff3b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3cd7a7640 1 --2- 172.21.15.167:0/2122487426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3b00039b0 0x7ff3b0003dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800c210 tx=0x7ff3b801cc20 comp rx=0 tx=0).stop 2023-11-28T20:51:29.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3ccfa6640 1 -- 172.21.15.167:0/2122487426 reap_dead start 2023-11-28T20:51:29.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/2122487426 shutdown_connections 2023-11-28T20:51:29.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/2122487426 >> 172.21.15.167:0/2122487426 conn(0x7ff3c80cb3f0 msgr2=0x7ff3c80cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:29.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/2122487426 shutdown_connections 2023-11-28T20:51:29.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.038+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/2122487426 wait complete. 2023-11-28T20:51:29.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 Processor -- start 2023-11-28T20:51:29.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 -- start start 2023-11-28T20:51:29.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3b00039b0 0x7ff3c81f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e3fa0 0x7ff3c8156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3c81e43f0 0x7ff3c81e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81e61d0 con 0x7ff3c81e43f0 2023-11-28T20:51:29.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81568c0 con 0x7ff3c81e3fa0 2023-11-28T20:51:29.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81546d0 con 0x7ff3b00039b0 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3ccfa6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3c81e43f0 0x7ff3c81e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3ccfa6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3c81e43f0 0x7ff3c81e4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33158/0 (socket says 172.21.15.167:33158) 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3ccfa6640 1 -- 172.21.15.167:0/3863671487 learned_addr learned my addr 172.21.15.167:0/3863671487 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3c77fe640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e3fa0 0x7ff3c8156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3c7fff640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3b00039b0 0x7ff3c81f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3ccfa6640 1 -- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3b00039b0 msgr2=0x7ff3c81f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3ccfa6640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3b00039b0 0x7ff3c81f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3ccfa6640 1 -- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e3fa0 msgr2=0x7ff3c8156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3ccfa6640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e3fa0 0x7ff3c8156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3ccfa6640 1 -- 172.21.15.167:0/3863671487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c81558c0 con 0x7ff3c81e43f0 2023-11-28T20:51:29.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3ccfa6640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3c81e43f0 0x7ff3c81e4ba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3c806bb80 tx=0x7ff3c000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0017070 con 0x7ff3c81e43f0 2023-11-28T20:51:29.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0006b60 con 0x7ff3c81e43f0 2023-11-28T20:51:29.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c815a600 con 0x7ff3c81e43f0 2023-11-28T20:51:29.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0006d10 con 0x7ff3c81e43f0 2023-11-28T20:51:29.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c815a8c0 con 0x7ff3c81e43f0 2023-11-28T20:51:29.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c8154860 0x7ff3c81e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.042+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8074740 con 0x7ff3c8154860 2023-11-28T20:51:29.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c7fff640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c8154860 0x7ff3c81e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c7fff640 1 -- 172.21.15.167:0/3863671487 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3c8157890 con 0x7ff3c8154860 2023-11-28T20:51:29.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff3c0003980 con 0x7ff3c81e43f0 2023-11-28T20:51:29.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c7fff640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c8154860 0x7ff3c81e7fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00057b0 tx=0x7ff3b0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c4ff9640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3b40664a0 0x7ff3b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff3c0083610 con 0x7ff3c81e43f0 2023-11-28T20:51:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8001440 con 0x7ff3c8154860 2023-11-28T20:51:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c77fe640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3b40664a0 0x7ff3b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff3b80b5040 con 0x7ff3c8154860 2023-11-28T20:51:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c8154860 msgr2=0x7ff3c81e7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c4ff9640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c8154860 0x7ff3c81e7fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00057b0 tx=0x7ff3b0005800 comp rx=0 tx=0).stop 2023-11-28T20:51:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c8154860 msgr2=0x7ff3c81e7fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c4ff9640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c8154860 0x7ff3c81e7fe0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00057b0 tx=0x7ff3b0005800 comp rx=0 tx=0).stop 2023-11-28T20:51:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.046+0000 7ff3c77fe640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3b40664a0 0x7ff3b4068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff3c806d450 tx=0x7ff3bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e6a80 0x7ff3c81e8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c8067c40 con 0x7ff3c81e6a80 2023-11-28T20:51:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3c7fff640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e6a80 0x7ff3c81e8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3c7fff640 1 -- 172.21.15.167:0/3863671487 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff3c804e850 con 0x7ff3c81e6a80 2023-11-28T20:51:29.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3c7fff640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e6a80 0x7ff3c81e8520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff3b801cc60 tx=0x7ff3b80a7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80a5b20 con 0x7ff3c81e6a80 2023-11-28T20:51:29.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4811 (secure 0 0 0) 0x7ff3b80c8390 con 0x7ff3c81e6a80 2023-11-28T20:51:29.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e6a80 msgr2=0x7ff3c81e8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3c4ff9640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e6a80 0x7ff3c81e8520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff3b801cc60 tx=0x7ff3b80a7000 comp rx=0 tx=0).stop 2023-11-28T20:51:29.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3c4ff9640 1 -- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e6a80 msgr2=0x7ff3c81e8520 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:29.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3c4ff9640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c81e6a80 0x7ff3c81e8520 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff3b801cc60 tx=0x7ff3b80a7000 comp rx=0 tx=0).stop 2023-11-28T20:51:29.054 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:51:29.054 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:29.054 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:29.054 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 108, 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:29.055 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:29.056 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:29.056 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:29.056 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:29.056 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:29.056 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:29.056 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:29.056 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:29.056 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:29.056 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.057 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:51:29.057 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:51:29.057 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:29.057 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:29.057 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:29.057 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:29.057 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:29.057 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:29.057 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:51:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:51:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:51:29.058 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:51:29.059 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:51:29.059 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:51:29.059 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:29.059 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:29.059 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:51:29.059 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:51:29.059 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:51:29.059 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:51:29.060 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:51:29.060 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:51:29.060 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:51:29.060 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:29.060 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:51:29.060 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:29.060 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:29.060 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:51:29.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:29.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.064 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:29.065 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:51:29.065 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.065 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.065 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:51:29.065 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:51:29.065 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:29.065 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:29.066 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:29.067 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:51:29.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.069 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:51:29.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.070 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:29.070 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.070 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:29.070 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.070 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.070 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:51:29.070 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:51:29.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3b40664a0 msgr2=0x7ff3b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff3b40664a0 0x7ff3b4068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff3c806d450 tx=0x7ff3bc008040 comp rx=0 tx=0).stop 2023-11-28T20:51:29.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3c81e43f0 msgr2=0x7ff3c81e4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 --2- 172.21.15.167:0/3863671487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3c81e43f0 0x7ff3c81e4ba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3c806bb80 tx=0x7ff3c000eb90 comp rx=0 tx=0).stop 2023-11-28T20:51:29.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3ccfa6640 1 -- 172.21.15.167:0/3863671487 reap_dead start 2023-11-28T20:51:29.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3ccfa6640 1 -- 172.21.15.167:0/3863671487 reap_dead start 2023-11-28T20:51:29.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 shutdown_connections 2023-11-28T20:51:29.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 >> 172.21.15.167:0/3863671487 conn(0x7ff3c80cb3f0 msgr2=0x7ff3c814bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:29.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 shutdown_connections 2023-11-28T20:51:29.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.054+0000 7ff3cd7a7640 1 -- 172.21.15.167:0/3863671487 wait complete. 2023-11-28T20:51:29.073 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:51:29.073 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:51:29.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:51:29.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589e1d0640 1 Processor -- start 2023-11-28T20:51:29.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589e1d0640 1 -- start start 2023-11-28T20:51:29.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589e1d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5898159b20 0x7f58980c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589e1d0640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f58980c5fb0 0x7f58980cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589e1d0640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5898159f70 con 0x7f5898153d20 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589e1d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589815a1b0 con 0x7f5898159b20 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589e1d0640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589815a450 con 0x7f58980c5fb0 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589c9cd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5898159b20 0x7f58980c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589c9cd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5898159b20 0x7f58980c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33160/0 (socket says 172.21.15.167:33160) 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589c9cd640 1 -- 172.21.15.167:0/1054714490 learned_addr learned my addr 172.21.15.167:0/1054714490 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589d9cf640 1 --2- 172.21.15.167:0/1054714490 >> v2:172.21.15.178:3300/0 conn(0x7f58980c5fb0 0x7f58980cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589c9cd640 1 -- 172.21.15.167:0/1054714490 >> v2:172.21.15.178:3300/0 conn(0x7f58980c5fb0 msgr2=0x7f58980cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589c9cd640 1 --2- 172.21.15.167:0/1054714490 >> v2:172.21.15.178:3300/0 conn(0x7f58980c5fb0 0x7f58980cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589c9cd640 1 -- 172.21.15.167:0/1054714490 >> v1:172.21.15.178:6789/0 conn(0x7f5898153d20 legacy=0x7f58980ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.258+0000 7f589c9cd640 1 -- 172.21.15.167:0/1054714490 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589815a710 con 0x7f5898159b20 2023-11-28T20:51:29.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f589c9cd640 1 --2- 172.21.15.167:0/1054714490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5898159b20 0x7f58980c5a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58980c4f20 tx=0x7f588801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ce998dd24d178d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f588ffff640 1 -- 172.21.15.167:0/1054714490 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880a89f0 con 0x7f5898159b20 2023-11-28T20:51:29.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f588ffff640 1 -- 172.21.15.167:0/1054714490 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58880a8b50 con 0x7f5898159b20 2023-11-28T20:51:29.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f588ffff640 1 -- 172.21.15.167:0/1054714490 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880b0440 con 0x7f5898159b20 2023-11-28T20:51:29.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f589e1d0640 1 -- 172.21.15.167:0/1054714490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5898159b20 msgr2=0x7f58980c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f589e1d0640 1 --2- 172.21.15.167:0/1054714490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5898159b20 0x7f58980c5a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58980c4f20 tx=0x7f588801ecf0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f589e1d0640 1 -- 172.21.15.167:0/1054714490 shutdown_connections 2023-11-28T20:51:29.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f589e1d0640 1 --2- 172.21.15.167:0/1054714490 >> v2:172.21.15.178:3300/0 conn(0x7f58980c5fb0 0x7f58980cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f589e1d0640 1 --2- 172.21.15.167:0/1054714490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5898159b20 0x7f58980c5a70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f589e1d0640 1 -- 172.21.15.167:0/1054714490 >> 172.21.15.167:0/1054714490 conn(0x7f589806b800 msgr2=0x7f589806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:29.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f589e1d0640 1 -- 172.21.15.167:0/1054714490 shutdown_connections 2023-11-28T20:51:29.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.262+0000 7f589e1d0640 1 -- 172.21.15.167:0/1054714490 wait complete. 2023-11-28T20:51:29.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 Processor -- start 2023-11-28T20:51:29.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 -- start start 2023-11-28T20:51:29.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5fb0 0x7f5898150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898153d20 0x7f58981f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898159b20 0x7f5898152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981535d0 con 0x7f58980c5fb0 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981f0980 con 0x7f5898159b20 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58981efd70 con 0x7f5898153d20 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d1ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5fb0 0x7f5898150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d1ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5fb0 0x7f5898150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33166/0 (socket says 172.21.15.167:33166) 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d1ce640 1 -- 172.21.15.167:0/2710539989 learned_addr learned my addr 172.21.15.167:0/2710539989 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589c9cd640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898153d20 0x7f58981f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d9cf640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898159b20 0x7f5898152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d1ce640 1 -- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898153d20 msgr2=0x7f58981f39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d1ce640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898153d20 0x7f58981f39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d1ce640 1 -- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898159b20 msgr2=0x7f5898152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d1ce640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5898159b20 0x7f5898152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d1ce640 1 -- 172.21.15.167:0/2710539989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880094d0 con 0x7f58980c5fb0 2023-11-28T20:51:29.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589c9cd640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898153d20 0x7f58981f39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:51:29.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589d1ce640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5fb0 0x7f5898150cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f589400c500 tx=0x7f589400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894005220 con 0x7f58980c5fb0 2023-11-28T20:51:29.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894005380 con 0x7f58980c5fb0 2023-11-28T20:51:29.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58981f0050 con 0x7f58980c5fb0 2023-11-28T20:51:29.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894007270 con 0x7f58980c5fb0 2023-11-28T20:51:29.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.266+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58981f0610 con 0x7f58980c5fb0 2023-11-28T20:51:29.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f589e1d0640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f589814fd10 0x7f58981500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5898072740 con 0x7f589814fd10 2023-11-28T20:51:29.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f589c9cd640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f589814fd10 0x7f58981500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58940073d0 con 0x7f58980c5fb0 2023-11-28T20:51:29.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f589c9cd640 1 -- 172.21.15.167:0/2710539989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58980ca1e0 con 0x7f589814fd10 2023-11-28T20:51:29.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f589c9cd640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f589814fd10 0x7f58981500f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f58980c6780 tx=0x7f588801d530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f588dffb640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f587c066470 0x7f587c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5894083990 con 0x7f58980c5fb0 2023-11-28T20:51:29.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880b0d40 con 0x7f589814fd10 2023-11-28T20:51:29.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f589d9cf640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f587c066470 0x7f587c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f58880bb420 con 0x7f589814fd10 2023-11-28T20:51:29.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f589814fd10 msgr2=0x7f58981500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f588dffb640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f589814fd10 0x7f58981500f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f58980c6780 tx=0x7f588801d530 comp rx=0 tx=0).stop 2023-11-28T20:51:29.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f589814fd10 msgr2=0x7f58981500f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:29.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f588dffb640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f589814fd10 0x7f58981500f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.270+0000 7f589d9cf640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f587c066470 0x7f587c068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5890003ab0 tx=0x7f5890009820 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143a40 0x7f5898143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58981f01e0 con 0x7f5898143a40 2023-11-28T20:51:29.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589c9cd640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143a40 0x7f5898143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589c9cd640 1 -- 172.21.15.167:0/2710539989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f589814a8b0 con 0x7f5898143a40 2023-11-28T20:51:29.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589c9cd640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143a40 0x7f5898143e20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f588801b900 tx=0x7f588801ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880c8070 con 0x7f5898143a40 2023-11-28T20:51:29.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5124 (secure 0 0 0) 0x7f5888003e50 con 0x7f5898143a40 2023-11-28T20:51:29.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143a40 msgr2=0x7f5898143e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f588dffb640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143a40 0x7f5898143e20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f588801b900 tx=0x7f588801ba90 comp rx=0 tx=0).stop 2023-11-28T20:51:29.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f588dffb640 1 -- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143a40 msgr2=0x7f5898143e20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:29.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f588dffb640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5898143a40 0x7f5898143e20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 108, 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:51:29.279 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:29.280 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:29.281 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:51:29.282 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:29.283 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:29.284 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:29.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:51:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:29.288 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:29.288 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:29.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.288 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:29.288 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:29.288 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:29.288 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:29.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.290 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:29.290 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:51:29.290 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:29.291 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.292 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.293 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.294 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:51:29.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.294 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:51:29.294 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.294 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:29.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.294 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:29.294 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.295 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:29.295 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.295 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:51:29.296 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:51:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f587c066470 msgr2=0x7f587c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f587c066470 0x7f587c068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5890003ab0 tx=0x7f5890009820 comp rx=0 tx=0).stop 2023-11-28T20:51:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5fb0 msgr2=0x7f5898150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 --2- 172.21.15.167:0/2710539989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58980c5fb0 0x7f5898150cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f589400c500 tx=0x7f589400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589d9cf640 1 -- 172.21.15.167:0/2710539989 reap_dead start 2023-11-28T20:51:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589d9cf640 1 -- 172.21.15.167:0/2710539989 reap_dead start 2023-11-28T20:51:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 shutdown_connections 2023-11-28T20:51:29.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 >> 172.21.15.167:0/2710539989 conn(0x7f589806b800 msgr2=0x7f58980cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:29.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 shutdown_connections 2023-11-28T20:51:29.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.278+0000 7f589e1d0640 1 -- 172.21.15.167:0/2710539989 wait complete. 2023-11-28T20:51:29.299 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:51:29.300 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2023-11-28T20:51:29.302 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:51:29.302 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2023-11-28T20:51:29.302 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:51:29.303 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T20:51:29.303 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:51:29.321 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T20:51:29.321 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:51:29.321 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:29.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff1868bb640 1 Processor -- start 2023-11-28T20:51:29.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff1868bb640 1 -- start start 2023-11-28T20:51:29.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff1868bb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff180072630 0x7ff180161b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff1868bb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1801571d0 con 0x7ff180070480 2023-11-28T20:51:29.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff1868bb640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff180071a90 con 0x7ff18006e030 2023-11-28T20:51:29.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff1868bb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1800c70d0 con 0x7ff180072630 2023-11-28T20:51:29.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff17ffff640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7ff18006e030 legacy=0x7ff1801500b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:51:29.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff184e58640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff180072630 0x7ff180161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff184e58640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff180072630 0x7ff180161b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33208/0 (socket says 172.21.15.167:33208) 2023-11-28T20:51:29.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff184e58640 1 -- 172.21.15.167:0/3954908323 learned_addr learned my addr 172.21.15.167:0/3954908323 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:29.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff184e58640 1 -- 172.21.15.167:0/3954908323 >> v1:172.21.15.178:6789/0 conn(0x7ff18006e030 legacy=0x7ff1801500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:29.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff184e58640 1 -- 172.21.15.167:0/3954908323 >> v1:172.21.15.167:6789/0 conn(0x7ff180070480 legacy=0x7ff180071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.470+0000 7ff184e58640 1 -- 172.21.15.167:0/3954908323 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1800c73b0 con 0x7ff180072630 2023-11-28T20:51:29.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff184e58640 1 --2- 172.21.15.167:0/3954908323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 0x7ff180161b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff178009e50 tx=0x7ff17801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6969242f45ed8c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff17effd640 1 -- 172.21.15.167:0/3954908323 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780a5860 con 0x7ff180072630 2023-11-28T20:51:29.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff17effd640 1 -- 172.21.15.167:0/3954908323 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1780a59c0 con 0x7ff180072630 2023-11-28T20:51:29.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff17effd640 1 -- 172.21.15.167:0/3954908323 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780a5d50 con 0x7ff180072630 2023-11-28T20:51:29.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff1868bb640 1 -- 172.21.15.167:0/3954908323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 msgr2=0x7ff180161b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff1868bb640 1 --2- 172.21.15.167:0/3954908323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 0x7ff180161b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff178009e50 tx=0x7ff17801c9a0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff1868bb640 1 -- 172.21.15.167:0/3954908323 shutdown_connections 2023-11-28T20:51:29.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff1868bb640 1 --2- 172.21.15.167:0/3954908323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 0x7ff180161b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff1868bb640 1 -- 172.21.15.167:0/3954908323 >> 172.21.15.167:0/3954908323 conn(0x7ff1800cb1e0 msgr2=0x7ff1800cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:29.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff1868bb640 1 -- 172.21.15.167:0/3954908323 shutdown_connections 2023-11-28T20:51:29.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.474+0000 7ff1868bb640 1 -- 172.21.15.167:0/3954908323 wait complete. 2023-11-28T20:51:29.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff1868bb640 1 Processor -- start 2023-11-28T20:51:29.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff1868bb640 1 -- start start 2023-11-28T20:51:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff1868bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff18006e030 0x7ff1801614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff1868bb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff180070480 0x7ff18013fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff1868bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 0x7ff18013ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff1868bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18015faa0 con 0x7ff180072630 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff1868bb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff180142700 con 0x7ff180070480 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff1868bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff180154300 con 0x7ff18006e030 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff17f7fe640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff180070480 msgr2=0x7ff18013fa60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff17f7fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff180070480 0x7ff18013fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff184e58640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 0x7ff18013ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff184e58640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 0x7ff18013ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33222/0 (socket says 172.21.15.167:33222) 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.478+0000 7ff184e58640 1 -- 172.21.15.167:0/1208063465 learned_addr learned my addr 172.21.15.167:0/1208063465 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff17ffff640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff18006e030 0x7ff1801614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff184e58640 1 -- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff18006e030 msgr2=0x7ff1801614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff184e58640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff18006e030 0x7ff1801614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff184e58640 1 -- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff180070480 msgr2=0x7ff18013fa60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:29.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff184e58640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff180070480 0x7ff18013fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff184e58640 1 -- 172.21.15.167:0/1208063465 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff178009b30 con 0x7ff180072630 2023-11-28T20:51:29.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff184e58640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 0x7ff18013ffa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1780af040 tx=0x7ff178019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff17cff9640 1 -- 172.21.15.167:0/1208063465 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780b8670 con 0x7ff180072630 2023-11-28T20:51:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff17cff9640 1 -- 172.21.15.167:0/1208063465 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1780b8810 con 0x7ff180072630 2023-11-28T20:51:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1801606f0 con 0x7ff180072630 2023-11-28T20:51:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff17cff9640 1 -- 172.21.15.167:0/1208063465 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780b8bc0 con 0x7ff180072630 2023-11-28T20:51:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff180160cb0 con 0x7ff180072630 2023-11-28T20:51:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1800682c0 con 0x7ff180072630 2023-11-28T20:51:29.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.482+0000 7ff17cff9640 1 -- 172.21.15.167:0/1208063465 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1780b8d20 con 0x7ff180072630 2023-11-28T20:51:29.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.486+0000 7ff17cff9640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff16c066450 0x7ff16c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:29.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.486+0000 7ff17cff9640 1 -- 172.21.15.167:0/1208063465 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff17811f5a0 con 0x7ff180072630 2023-11-28T20:51:29.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.486+0000 7ff17ffff640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff16c066450 0x7ff16c068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:29.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.486+0000 7ff17ffff640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff16c066450 0x7ff16c068910 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff1700093d0 tx=0x7ff170009360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:29.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.490+0000 7ff17cff9640 1 -- 172.21.15.167:0/1208063465 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1780ec6c0 con 0x7ff180072630 2023-11-28T20:51:29.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff1800682c0 con 0x7ff180072630 2023-11-28T20:51:29.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff17cff9640 1 -- 172.21.15.167:0/1208063465 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7ff1780efce0 con 0x7ff180072630 2023-11-28T20:51:29.749 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:29.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff16c066450 msgr2=0x7ff16c068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff16c066450 0x7ff16c068910 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff1700093d0 tx=0x7ff170009360 comp rx=0 tx=0).stop 2023-11-28T20:51:29.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 msgr2=0x7ff18013ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:29.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 0x7ff18013ffa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff1780af040 tx=0x7ff178019740 comp rx=0 tx=0).stop 2023-11-28T20:51:29.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 shutdown_connections 2023-11-28T20:51:29.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff16c066450 0x7ff16c068910 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff180072630 0x7ff18013ffa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff180070480 0x7ff18013fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 --2- 172.21.15.167:0/1208063465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff18006e030 0x7ff1801614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:29.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 >> 172.21.15.167:0/1208063465 conn(0x7ff1800cb1e0 msgr2=0x7ff18014fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:29.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 shutdown_connections 2023-11-28T20:51:29.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:29.750+0000 7ff1868bb640 1 -- 172.21.15.167:0/1208063465 wait complete. 2023-11-28T20:51:32.771 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:32.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.910+0000 7f9b42cd6640 1 Processor -- start 2023-11-28T20:51:32.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.910+0000 7f9b42cd6640 1 -- start start 2023-11-28T20:51:32.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b42cd6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b3c150b40 0x7f9b3c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:32.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b42cd6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c0c48f0 con 0x7f9b3c0c4510 2023-11-28T20:51:32.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b42cd6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c0c6ac0 con 0x7f9b3c0c6ff0 2023-11-28T20:51:32.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b42cd6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c62f0 con 0x7f9b3c150b40 2023-11-28T20:51:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3bfff640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f9b3c0c6ff0 legacy=0x7f9b3c0c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:51:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b40a72640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f9b3c150b40 msgr2=0x7f9b3c157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b40a72640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b3c150b40 0x7f9b3c157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b41273640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9b3c0c4510 0x7f9b3c06a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34214/0 (socket says 172.21.15.167:34214) 2023-11-28T20:51:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b41273640 1 -- 172.21.15.167:0/585752203 learned_addr learned my addr 172.21.15.167:0/585752203 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550592313 0 0) 0x7f9b3c0c48f0 con 0x7f9b3c0c4510 2023-11-28T20:51:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b2c005740 con 0x7f9b3c0c4510 2023-11-28T20:51:32.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569985734 0 0) 0x7f9b2c005740 con 0x7f9b3c0c4510 2023-11-28T20:51:32.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 >> v2:172.21.15.178:3300/0 conn(0x7f9b3c150b40 msgr2=0x7f9b3c157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:32.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 --2- 172.21.15.167:0/585752203 >> v2:172.21.15.178:3300/0 conn(0x7f9b3c150b40 0x7f9b3c157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:32.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 >> v1:172.21.15.178:6789/0 conn(0x7f9b3c0c6ff0 legacy=0x7f9b3c0c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:32.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c0c6500 con 0x7f9b3c0c4510 2023-11-28T20:51:32.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9b34001a20 con 0x7f9b3c0c4510 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 >> v1:172.21.15.167:6789/0 conn(0x7f9b3c0c4510 legacy=0x7f9b3c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b2c005b90 0x7f9b2c005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b2c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b2c0074c0 0x7f9b2c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0c62f0 con 0x7f9b2c0069e0 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c00e3c0 con 0x7f9b2c005b90 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c00e580 con 0x7f9b2c0074c0 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b40a72640 1 -- 172.21.15.167:0/585752203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b2c005b90 msgr2=0x7f9b2c005f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b40a72640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b2c005b90 0x7f9b2c005f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3bfff640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b2c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b41273640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b2c0074c0 0x7f9b2c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3bfff640 1 -- 172.21.15.167:0/585752203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b2c0074c0 msgr2=0x7f9b2c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:32.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3bfff640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b2c0074c0 0x7f9b2c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:32.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3bfff640 1 -- 172.21.15.167:0/585752203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b2c005b90 msgr2=0x7f9b2c005f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:32.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3bfff640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b2c005b90 0x7f9b2c005f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:32.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b3bfff640 1 -- 172.21.15.167:0/585752203 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c005740 con 0x7f9b2c0069e0 2023-11-28T20:51:32.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.914+0000 7f9b41273640 1 -- 172.21.15.167:0/585752203 reap_dead start 2023-11-28T20:51:32.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b3bfff640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b2c006e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b28006fd0 tx=0x7f9b2801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a743ddd814286e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:32.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28003bc0 con 0x7f9b2c0069e0 2023-11-28T20:51:32.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b280a7070 con 0x7f9b2c0069e0 2023-11-28T20:51:32.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b3b7fe640 1 -- 172.21.15.167:0/585752203 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b280050d0 con 0x7f9b2c0069e0 2023-11-28T20:51:32.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b42cd6640 1 -- 172.21.15.167:0/585752203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 msgr2=0x7f9b2c006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:32.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b42cd6640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b2c006e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b28006fd0 tx=0x7f9b2801c380 comp rx=0 tx=0).stop 2023-11-28T20:51:32.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b42cd6640 1 -- 172.21.15.167:0/585752203 shutdown_connections 2023-11-28T20:51:32.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b42cd6640 1 --2- 172.21.15.167:0/585752203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b2c006e60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:32.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b42cd6640 1 -- 172.21.15.167:0/585752203 >> 172.21.15.167:0/585752203 conn(0x7f9b3c0cb1e0 msgr2=0x7f9b3c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:32.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b42cd6640 1 -- 172.21.15.167:0/585752203 shutdown_connections 2023-11-28T20:51:32.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.918+0000 7f9b42cd6640 1 -- 172.21.15.167:0/585752203 wait complete. 2023-11-28T20:51:32.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 Processor -- start 2023-11-28T20:51:32.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 -- start start 2023-11-28T20:51:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b3c14c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3c14e3d0 0x7f9b3c14bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3c072140 0x7f9b3c14d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c1eba70 con 0x7f9b2c0069e0 2023-11-28T20:51:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c14b620 con 0x7f9b3c14e3d0 2023-11-28T20:51:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c1eb1b0 con 0x7f9b3c072140 2023-11-28T20:51:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b40a72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b3c14c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b3bfff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3c14e3d0 msgr2=0x7f9b3c14bc60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b3bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3c14e3d0 0x7f9b3c14bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b40a72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b3c14c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34192/0 (socket says 172.21.15.167:34192) 2023-11-28T20:51:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b40a72640 1 -- 172.21.15.167:0/2735502486 learned_addr learned my addr 172.21.15.167:0/2735502486 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b41273640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3c072140 0x7f9b3c14d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b40a72640 1 -- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3c072140 msgr2=0x7f9b3c14d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b40a72640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3c072140 0x7f9b3c14d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b40a72640 1 -- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3c14e3d0 msgr2=0x7f9b3c14bc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b40a72640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3c14e3d0 0x7f9b3c14bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b40a72640 1 -- 172.21.15.167:0/2735502486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c14f270 con 0x7f9b2c0069e0 2023-11-28T20:51:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b40a72640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b3c14c5b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000b570 tx=0x7f9b3000ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b397fa640 1 -- 172.21.15.167:0/2735502486 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30003d90 con 0x7f9b2c0069e0 2023-11-28T20:51:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b397fa640 1 -- 172.21.15.167:0/2735502486 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b300050f0 con 0x7f9b2c0069e0 2023-11-28T20:51:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c14f530 con 0x7f9b2c0069e0 2023-11-28T20:51:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b397fa640 1 -- 172.21.15.167:0/2735502486 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b300054a0 con 0x7f9b2c0069e0 2023-11-28T20:51:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c14cc30 con 0x7f9b2c0069e0 2023-11-28T20:51:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.922+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c0682c0 con 0x7f9b2c0069e0 2023-11-28T20:51:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.926+0000 7f9b397fa640 1 -- 172.21.15.167:0/2735502486 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b30005600 con 0x7f9b2c0069e0 2023-11-28T20:51:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.926+0000 7f9b397fa640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b20066420 0x7f9b200688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.926+0000 7f9b397fa640 1 -- 172.21.15.167:0/2735502486 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9b30084250 con 0x7f9b2c0069e0 2023-11-28T20:51:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.926+0000 7f9b3bfff640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b20066420 0x7f9b200688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.926+0000 7f9b3bfff640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b20066420 0x7f9b200688e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b280a9000 tx=0x7f9b28005a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:32.930+0000 7f9b397fa640 1 -- 172.21.15.167:0/2735502486 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b300512d0 con 0x7f9b2c0069e0 2023-11-28T20:51:33.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.142+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9b3c067c40 con 0x7f9b2c0069e0 2023-11-28T20:51:33.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.142+0000 7f9b397fa640 1 -- 172.21.15.167:0/2735502486 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f9b30013630 con 0x7f9b2c0069e0 2023-11-28T20:51:33.144 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:33.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b20066420 msgr2=0x7f9b200688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b20066420 0x7f9b200688e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b280a9000 tx=0x7f9b28005a90 comp rx=0 tx=0).stop 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 msgr2=0x7f9b3c14c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b3c14c5b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000b570 tx=0x7f9b3000ba30 comp rx=0 tx=0).stop 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 shutdown_connections 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9b20066420 0x7f9b200688e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3c072140 0x7f9b3c14d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3c14e3d0 0x7f9b3c14bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 --2- 172.21.15.167:0/2735502486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b2c0069e0 0x7f9b3c14c5b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 >> 172.21.15.167:0/2735502486 conn(0x7f9b3c0cb1e0 msgr2=0x7f9b3c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 shutdown_connections 2023-11-28T20:51:33.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:33.146+0000 7f9b42cd6640 1 -- 172.21.15.167:0/2735502486 wait complete. 2023-11-28T20:51:36.167 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:36.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.321+0000 7f78fdfa7640 1 Processor -- start 2023-11-28T20:51:36.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.321+0000 7f78fdfa7640 1 -- start start 2023-11-28T20:51:36.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fdfa7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f8153db0 0x7f78f815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:36.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fdfa7640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f78f80cf440 0x7f78f80cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:36.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fdfa7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f80cfef0 con 0x7f78f80ccb70 2023-11-28T20:51:36.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fdfa7640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f80cc6e0 con 0x7f78f80cf440 2023-11-28T20:51:36.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fdfa7640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8154190 con 0x7f78f8153db0 2023-11-28T20:51:36.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fd7a6640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f78f80cf440 msgr2=0x7f78f80cf8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:36.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fd7a6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f78f80cf440 0x7f78f80cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:36.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78f7fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f78f80ccb70 0x7f78f80c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34220/0 (socket says 172.21.15.167:34220) 2023-11-28T20:51:36.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78f7fff640 1 -- 172.21.15.167:0/1690213543 learned_addr learned my addr 172.21.15.167:0/1690213543 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:36.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fcfa5640 1 --2- 172.21.15.167:0/1690213543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f8153db0 0x7f78f815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:36.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fcfa5640 1 -- 172.21.15.167:0/1690213543 >> v2:172.21.15.178:3300/0 conn(0x7f78f80cf440 msgr2=0x7f78f80cf8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:36.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fcfa5640 1 --2- 172.21.15.167:0/1690213543 >> v2:172.21.15.178:3300/0 conn(0x7f78f80cf440 0x7f78f80cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fcfa5640 1 -- 172.21.15.167:0/1690213543 >> v1:172.21.15.167:6789/0 conn(0x7f78f80ccb70 legacy=0x7f78f80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:36.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.325+0000 7f78fcfa5640 1 -- 172.21.15.167:0/1690213543 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80cbad0 con 0x7f78f8153db0 2023-11-28T20:51:36.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fcfa5640 1 --2- 172.21.15.167:0/1690213543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f8153db0 0x7f78f815a540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0097c0 tx=0x7f78ec01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d5a525894406d06 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:36.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78f77fe640 1 -- 172.21.15.167:0/1690213543 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0ad640 con 0x7f78f8153db0 2023-11-28T20:51:36.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78f77fe640 1 -- 172.21.15.167:0/1690213543 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec0ad7a0 con 0x7f78f8153db0 2023-11-28T20:51:36.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78f77fe640 1 -- 172.21.15.167:0/1690213543 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0adb30 con 0x7f78f8153db0 2023-11-28T20:51:36.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fdfa7640 1 -- 172.21.15.167:0/1690213543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f8153db0 msgr2=0x7f78f815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:36.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fdfa7640 1 --2- 172.21.15.167:0/1690213543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f8153db0 0x7f78f815a540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0097c0 tx=0x7f78ec01c4a0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fdfa7640 1 -- 172.21.15.167:0/1690213543 shutdown_connections 2023-11-28T20:51:36.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fdfa7640 1 --2- 172.21.15.167:0/1690213543 >> v2:172.21.15.178:3300/0 conn(0x7f78f80cf440 0x7f78f80cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fdfa7640 1 --2- 172.21.15.167:0/1690213543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f8153db0 0x7f78f815a540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fdfa7640 1 -- 172.21.15.167:0/1690213543 >> 172.21.15.167:0/1690213543 conn(0x7f78f806b800 msgr2=0x7f78f806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:36.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fdfa7640 1 -- 172.21.15.167:0/1690213543 shutdown_connections 2023-11-28T20:51:36.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fdfa7640 1 -- 172.21.15.167:0/1690213543 wait complete. 2023-11-28T20:51:36.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.329+0000 7f78fdfa7640 1 Processor -- start 2023-11-28T20:51:36.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 -- start start 2023-11-28T20:51:36.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f80ccb70 0x7f78f8154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:36.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78f80cf440 0x7f78f81589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:36.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78f8153db0 0x7f78f815b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:36.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8155ec0 con 0x7f78f8153db0 2023-11-28T20:51:36.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8155620 con 0x7f78f80cf440 2023-11-28T20:51:36.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8155900 con 0x7f78f80ccb70 2023-11-28T20:51:36.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78f7fff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78f80cf440 msgr2=0x7f78f81589f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:36.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78f7fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78f80cf440 0x7f78f81589f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:36.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fd7a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78f8153db0 0x7f78f815b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:36.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fd7a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78f8153db0 0x7f78f815b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34200/0 (socket says 172.21.15.167:34200) 2023-11-28T20:51:36.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fd7a6640 1 -- 172.21.15.167:0/388416284 learned_addr learned my addr 172.21.15.167:0/388416284 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:36.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fcfa5640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f80ccb70 0x7f78f8154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:36.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fd7a6640 1 -- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f80ccb70 msgr2=0x7f78f8154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:36.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fd7a6640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f80ccb70 0x7f78f8154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fd7a6640 1 -- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78f80cf440 msgr2=0x7f78f81589f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:36.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fd7a6640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78f80cf440 0x7f78f81589f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fd7a6640 1 -- 172.21.15.167:0/388416284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec009420 con 0x7f78f8153db0 2023-11-28T20:51:36.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fd7a6640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78f8153db0 0x7f78f815b590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f78f000b760 tx=0x7f78f000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:36.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78f57fa640 1 -- 172.21.15.167:0/388416284 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f000c960 con 0x7f78f8153db0 2023-11-28T20:51:36.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78f57fa640 1 -- 172.21.15.167:0/388416284 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f000cac0 con 0x7f78f8153db0 2023-11-28T20:51:36.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f8155be0 con 0x7f78f8153db0 2023-11-28T20:51:36.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78f57fa640 1 -- 172.21.15.167:0/388416284 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0015470 con 0x7f78f8153db0 2023-11-28T20:51:36.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f815b070 con 0x7f78f8153db0 2023-11-28T20:51:36.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.333+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f815abf0 con 0x7f78f8153db0 2023-11-28T20:51:36.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.337+0000 7f78f57fa640 1 -- 172.21.15.167:0/388416284 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78f0012070 con 0x7f78f8153db0 2023-11-28T20:51:36.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.337+0000 7f78f57fa640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f78dc066420 0x7f78dc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:36.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.337+0000 7f78f57fa640 1 -- 172.21.15.167:0/388416284 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f78f0083fc0 con 0x7f78f8153db0 2023-11-28T20:51:36.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.337+0000 7f78fcfa5640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f78dc066420 0x7f78dc0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:36.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.337+0000 7f78fcfa5640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f78dc066420 0x7f78dc0688e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0af000 tx=0x7f78ec0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:36.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.341+0000 7f78f57fa640 1 -- 172.21.15.167:0/388416284 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78f815abf0 con 0x7f78f8153db0 2023-11-28T20:51:36.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.577+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f78f815abf0 con 0x7f78f8153db0 2023-11-28T20:51:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.577+0000 7f78f57fa640 1 -- 172.21.15.167:0/388416284 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f78f815abf0 con 0x7f78f8153db0 2023-11-28T20:51:36.578 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f78dc066420 msgr2=0x7f78dc0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f78dc066420 0x7f78dc0688e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0af000 tx=0x7f78ec0a7070 comp rx=0 tx=0).stop 2023-11-28T20:51:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78f8153db0 msgr2=0x7f78f815b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78f8153db0 0x7f78f815b590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f78f000b760 tx=0x7f78f000bc20 comp rx=0 tx=0).stop 2023-11-28T20:51:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 shutdown_connections 2023-11-28T20:51:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f78dc066420 0x7f78dc0688e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78f8153db0 0x7f78f815b590 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78f80cf440 0x7f78f81589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 --2- 172.21.15.167:0/388416284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78f80ccb70 0x7f78f8154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 >> 172.21.15.167:0/388416284 conn(0x7f78f806b800 msgr2=0x7f78f80b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 shutdown_connections 2023-11-28T20:51:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:36.581+0000 7f78fdfa7640 1 -- 172.21.15.167:0/388416284 wait complete. 2023-11-28T20:51:39.620 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:51:39.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.853+0000 7fcb408fd640 1 Processor -- start 2023-11-28T20:51:39.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.853+0000 7fcb408fd640 1 -- start start 2023-11-28T20:51:39.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.857+0000 7fcb408fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 0x7fcb3c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:39.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.857+0000 7fcb408fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3c15ac00 con 0x7fcb3c153ae0 2023-11-28T20:51:39.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.857+0000 7fcb408fd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3c0cbd60 con 0x7fcb3c0cf860 2023-11-28T20:51:39.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.857+0000 7fcb408fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3c159ff0 con 0x7fcb3c0cfc40 2023-11-28T20:51:39.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.857+0000 7fcb3a59c640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7fcb3c0cf860 legacy=0x7fcb3c0ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:51:39.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.857+0000 7fcb3ad9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcb3c153ae0 0x7fcb3c15d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:34230/0 (socket says 172.21.15.167:34230) 2023-11-28T20:51:39.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.857+0000 7fcb3ad9d640 1 -- 172.21.15.167:0/2643794342 learned_addr learned my addr 172.21.15.167:0/2643794342 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:51:39.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.857+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 msgr2=0x7fcb3c0cb770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:39.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:39.857+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 0x7fcb3c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:40.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:40.061+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 msgr2=0x7fcb3c0cb770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:40.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:40.061+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> v1:172.21.15.178:6789/0 conn(0x7fcb3c0cf860 legacy=0x7fcb3c0ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:51:40.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:40.061+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 0x7fcb3c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:51:40.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:40.465+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> v1:172.21.15.178:6789/0 conn(0x7fcb3c0cf860 legacy=0x7fcb3c0ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:51:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:40.465+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 msgr2=0x7fcb3c0cb770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:40.465+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 0x7fcb3c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:51:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:41.269+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 msgr2=0x7fcb3c0cb770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:41.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:41.269+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> v1:172.21.15.178:6789/0 conn(0x7fcb3c0cf860 legacy=0x7fcb3c0ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:51:41.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:41.269+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 0x7fcb3c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:51:42.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb38d99640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 msgr2=0x7fcb3c0cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:42.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb38d99640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.178:3300/0 conn(0x7fcb3c0cfc40 0x7fcb3c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:42.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb38d99640 1 -- 172.21.15.167:0/2643794342 >> v1:172.21.15.178:6789/0 conn(0x7fcb3c0cf860 legacy=0x7fcb3c0ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb38d99640 1 -- 172.21.15.167:0/2643794342 >> v1:172.21.15.167:6789/0 conn(0x7fcb3c153ae0 legacy=0x7fcb3c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb38d99640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb38d99640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb38d99640 1 -- 172.21.15.167:0/2643794342 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3c159ff0 con 0x7fcb1c0036d0 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb38d99640 1 -- 172.21.15.167:0/2643794342 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c008d20 con 0x7fcb1c006140 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 msgr2=0x7fcb1c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 msgr2=0x7fcb1c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 msgr2=0x7fcb1c008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:51:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 msgr2=0x7fcb1c008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:51:42.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:42.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:42.857+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 msgr2=0x7fcb1c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:51:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 msgr2=0x7fcb1c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:51:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:51:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 msgr2=0x7fcb1c008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:51:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 msgr2=0x7fcb1c008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:51:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.061+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:51:43.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 msgr2=0x7fcb1c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:51:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 msgr2=0x7fcb1c005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:51:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:51:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 msgr2=0x7fcb1c008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:51:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb33fff640 1 -- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 msgr2=0x7fcb1c008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:51:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:51:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:43.465+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:51:44.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.269+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> v2:172.21.15.167:3300/0 conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.269+0000 7fcb33fff640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.269+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 msgr2=0x7fcb1c008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:44.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.269+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb1c006140 0x7fcb1c008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.269+0000 7fcb3a59c640 1 -- 172.21.15.167:0/2643794342 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c15a2d0 con 0x7fcb1c0036d0 2023-11-28T20:51:44.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.269+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb1c0036d0 0x7fcb1c005b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c003940 tx=0x7fcb2c01d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc261fa48539b4f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.269+0000 7fcb39d9b640 1 -- 172.21.15.167:0/2643794342 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0ac600 con 0x7fcb1c0036d0 2023-11-28T20:51:44.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.269+0000 7fcb39d9b640 1 -- 172.21.15.167:0/2643794342 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2c0a8050 con 0x7fcb1c0036d0 2023-11-28T20:51:44.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.269+0000 7fcb39d9b640 1 -- 172.21.15.167:0/2643794342 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c0ac980 con 0x7fcb1c0036d0 2023-11-28T20:51:44.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 -- 172.21.15.167:0/2643794342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb1c0036d0 msgr2=0x7fcb1c005b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb1c0036d0 0x7fcb1c005b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c003940 tx=0x7fcb2c01d2b0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb3ad9d640 1 -- 172.21.15.167:0/2643794342 reap_dead start 2023-11-28T20:51:44.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 -- 172.21.15.167:0/2643794342 shutdown_connections 2023-11-28T20:51:44.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 --2- 172.21.15.167:0/2643794342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb1c0036d0 0x7fcb1c005b50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 -- 172.21.15.167:0/2643794342 >> 172.21.15.167:0/2643794342 conn(0x7fcb3c06c1f0 msgr2=0x7fcb3c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:44.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 -- 172.21.15.167:0/2643794342 shutdown_connections 2023-11-28T20:51:44.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 -- 172.21.15.167:0/2643794342 wait complete. 2023-11-28T20:51:44.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 Processor -- start 2023-11-28T20:51:44.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 -- start start 2023-11-28T20:51:44.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb1c0036d0 0x7fcb3c0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb3c1507d0 0x7fcb3c147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb3c158b60 0x7fcb3c158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c151130 con 0x7fcb3c1507d0 2023-11-28T20:51:44.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c147280 con 0x7fcb1c0036d0 2023-11-28T20:51:44.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb408fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0b4a50 con 0x7fcb3c158b60 2023-11-28T20:51:44.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb3a59c640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb1c0036d0 msgr2=0x7fcb3c0ce830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:44.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.273+0000 7fcb3a59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb1c0036d0 0x7fcb3c0ce830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:44.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb33fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb3c1507d0 0x7fcb3c147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb33fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb3c1507d0 0x7fcb3c147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43202/0 (socket says 172.21.15.167:43202) 2023-11-28T20:51:44.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb33fff640 1 -- 172.21.15.167:0/3037663703 learned_addr learned my addr 172.21.15.167:0/3037663703 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:44.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb3ad9d640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb3c158b60 0x7fcb3c158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb33fff640 1 -- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb3c158b60 msgr2=0x7fcb3c158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb33fff640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb3c158b60 0x7fcb3c158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb33fff640 1 -- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb1c0036d0 msgr2=0x7fcb3c0ce830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:44.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb33fff640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb1c0036d0 0x7fcb3c0ce830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb33fff640 1 -- 172.21.15.167:0/3037663703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c005170 con 0x7fcb3c1507d0 2023-11-28T20:51:44.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb3ad9d640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb3c158b60 0x7fcb3c158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:51:44.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb33fff640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb3c1507d0 0x7fcb3c147ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb24003b60 tx=0x7fcb2400a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb32ffd640 1 -- 172.21.15.167:0/3037663703 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400b650 con 0x7fcb3c1507d0 2023-11-28T20:51:44.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb32ffd640 1 -- 172.21.15.167:0/3037663703 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb24011040 con 0x7fcb3c1507d0 2023-11-28T20:51:44.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c150e50 con 0x7fcb3c1507d0 2023-11-28T20:51:44.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb32ffd640 1 -- 172.21.15.167:0/3037663703 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400b9d0 con 0x7fcb3c1507d0 2023-11-28T20:51:44.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c0b4570 con 0x7fcb3c1507d0 2023-11-28T20:51:44.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c0b40f0 con 0x7fcb3c1507d0 2023-11-28T20:51:44.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb32ffd640 1 -- 172.21.15.167:0/3037663703 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb2400bb30 con 0x7fcb3c1507d0 2023-11-28T20:51:44.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb32ffd640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb1c067290 0x7fcb1c069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.277+0000 7fcb32ffd640 1 -- 172.21.15.167:0/3037663703 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fcb24084da0 con 0x7fcb3c1507d0 2023-11-28T20:51:44.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.281+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb1c067290 0x7fcb1c069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.281+0000 7fcb3a59c640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb1c067290 0x7fcb1c069750 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0ae000 tx=0x7fcb2c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.285+0000 7fcb32ffd640 1 -- 172.21.15.167:0/3037663703 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb3c0b40f0 con 0x7fcb3c1507d0 2023-11-28T20:51:44.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcb3c0b40f0 con 0x7fcb3c1507d0 2023-11-28T20:51:44.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb32ffd640 1 -- 172.21.15.167:0/3037663703 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fcb3c0b40f0 con 0x7fcb3c1507d0 2023-11-28T20:51:44.512 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":112,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb1c067290 msgr2=0x7fcb1c069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb1c067290 0x7fcb1c069750 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0ae000 tx=0x7fcb2c0a7000 comp rx=0 tx=0).stop 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb3c1507d0 msgr2=0x7fcb3c147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb3c1507d0 0x7fcb3c147ea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb24003b60 tx=0x7fcb2400a7b0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 shutdown_connections 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb1c067290 0x7fcb1c069750 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb3c158b60 0x7fcb3c158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb3c1507d0 0x7fcb3c147ea0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 --2- 172.21.15.167:0/3037663703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb1c0036d0 0x7fcb3c0ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 >> 172.21.15.167:0/3037663703 conn(0x7fcb3c06c1f0 msgr2=0x7fcb3c1512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:44.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 shutdown_connections 2023-11-28T20:51:44.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.513+0000 7fcb408fd640 1 -- 172.21.15.167:0/3037663703 wait complete. 2023-11-28T20:51:44.534 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:51:44.534 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:51:44.534 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:51:44.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.685+0000 7f2dfec09640 1 Processor -- start 2023-11-28T20:51:44.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2dfec09640 1 -- start start 2023-11-28T20:51:44.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2dfec09640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df80cf860 0x7f2df80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2dfec09640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2df80cfc40 0x7f2df80ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2dfec09640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df815ac00 con 0x7f2df8153ae0 2023-11-28T20:51:44.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2dfec09640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df80cbd60 con 0x7f2df80cfc40 2023-11-28T20:51:44.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2dfec09640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8159ff0 con 0x7f2df80cf860 2023-11-28T20:51:44.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2dfd1a6640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f2df8153ae0 legacy=0x7f2df815d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:51:44.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2df7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2df80cfc40 0x7f2df80ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2df7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2df80cfc40 0x7f2df80ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43204/0 (socket says 172.21.15.167:43204) 2023-11-28T20:51:44.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2df7fff640 1 -- 172.21.15.167:0/1155736902 learned_addr learned my addr 172.21.15.167:0/1155736902 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:44.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2dfc9a5640 1 --2- 172.21.15.167:0/1155736902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df80cf860 0x7f2df80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2df7fff640 1 -- 172.21.15.167:0/1155736902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df80cf860 msgr2=0x7f2df80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:51:44.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2df7fff640 1 --2- 172.21.15.167:0/1155736902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df80cf860 0x7f2df80cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2df7fff640 1 -- 172.21.15.167:0/1155736902 >> v1:172.21.15.178:6789/0 conn(0x7f2df8153ae0 legacy=0x7f2df815d4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:44.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.689+0000 7f2df7fff640 1 -- 172.21.15.167:0/1155736902 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df815a2d0 con 0x7f2df80cfc40 2023-11-28T20:51:44.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2df7fff640 1 --2- 172.21.15.167:0/1155736902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 0x7f2df80ca510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009870 tx=0x7f2de401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b4a6cf4d967880 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2df77fe640 1 -- 172.21.15.167:0/1155736902 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40aa5f0 con 0x7f2df80cfc40 2023-11-28T20:51:44.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2df77fe640 1 -- 172.21.15.167:0/1155736902 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40aa750 con 0x7f2df80cfc40 2023-11-28T20:51:44.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2df77fe640 1 -- 172.21.15.167:0/1155736902 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40aaae0 con 0x7f2df80cfc40 2023-11-28T20:51:44.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2dfec09640 1 -- 172.21.15.167:0/1155736902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 msgr2=0x7f2df80ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2dfec09640 1 --2- 172.21.15.167:0/1155736902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 0x7f2df80ca510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009870 tx=0x7f2de401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2dfec09640 1 -- 172.21.15.167:0/1155736902 shutdown_connections 2023-11-28T20:51:44.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2dfec09640 1 --2- 172.21.15.167:0/1155736902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 0x7f2df80ca510 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2dfec09640 1 --2- 172.21.15.167:0/1155736902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df80cf860 0x7f2df80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2dfec09640 1 -- 172.21.15.167:0/1155736902 >> 172.21.15.167:0/1155736902 conn(0x7f2df806c1f0 msgr2=0x7f2df8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:44.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2dfec09640 1 -- 172.21.15.167:0/1155736902 shutdown_connections 2023-11-28T20:51:44.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2dfec09640 1 -- 172.21.15.167:0/1155736902 wait complete. 2023-11-28T20:51:44.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.693+0000 7f2dfec09640 1 Processor -- start 2023-11-28T20:51:44.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfec09640 1 -- start start 2023-11-28T20:51:44.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfec09640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df80cf860 0x7f2df81f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfec09640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 0x7f2df8154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfec09640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df8153ae0 0x7f2df81493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfec09640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80c7210 con 0x7f2df80cfc40 2023-11-28T20:51:44.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfec09640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81f6f40 con 0x7f2df8153ae0 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfec09640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df815b000 con 0x7f2df80cf860 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfd1a6640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df8153ae0 msgr2=0x7f2df81493c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfd1a6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df8153ae0 0x7f2df81493c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 0x7f2df8154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfc9a5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df80cf860 0x7f2df81f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 0x7f2df8154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43212/0 (socket says 172.21.15.167:43212) 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df7fff640 1 -- 172.21.15.167:0/876069490 learned_addr learned my addr 172.21.15.167:0/876069490 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df7fff640 1 -- 172.21.15.167:0/876069490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df80cf860 msgr2=0x7f2df81f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df7fff640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df80cf860 0x7f2df81f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df7fff640 1 -- 172.21.15.167:0/876069490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df8153ae0 msgr2=0x7f2df81493c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df7fff640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df8153ae0 0x7f2df81493c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df7fff640 1 -- 172.21.15.167:0/876069490 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40094d0 con 0x7f2df80cfc40 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df7fff640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 0x7f2df8154620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2de40ac040 tx=0x7f2de401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40bd5f0 con 0x7f2df80cfc40 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40bd750 con 0x7f2df80cfc40 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40bdb00 con 0x7f2df80cfc40 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df80c6f30 con 0x7f2df80cfc40 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.697+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df815b580 con 0x7f2df80cfc40 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2dfec09640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815b770 0x7f2df80c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8072860 con 0x7f2df815b770 2023-11-28T20:51:44.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2dfc9a5640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815b770 0x7f2df80c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2dfc9a5640 1 -- 172.21.15.167:0/876069490 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2df80caa50 con 0x7f2df815b770 2023-11-28T20:51:44.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2dfc9a5640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815b770 0x7f2df80c7f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2dec011900 tx=0x7f2dec011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec004300 con 0x7f2df815b770 2023-11-28T20:51:44.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2de40b33f0 con 0x7f2df80cfc40 2023-11-28T20:51:44.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2df57fa640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ddc066540 0x7f2ddc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2de40a7070 con 0x7f2df80cfc40 2023-11-28T20:51:44.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2dec004460 con 0x7f2df815b770 2023-11-28T20:51:44.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815b770 msgr2=0x7f2df80c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2df57fa640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815b770 0x7f2df80c7f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2dec011900 tx=0x7f2dec011dc0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815b770 msgr2=0x7f2df80c7f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:44.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2df57fa640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815b770 0x7f2df80c7f50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2dfd1a6640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ddc066540 0x7f2ddc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.701+0000 7f2dfd1a6640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ddc066540 0x7f2ddc068a00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2df0003cc0 tx=0x7f2df0009270 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815c130 0x7f2df815c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8159cc0 con 0x7f2df815c130 2023-11-28T20:51:44.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfc9a5640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815c130 0x7f2df815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfc9a5640 1 -- 172.21.15.167:0/876069490 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2df8166e40 con 0x7f2df815c130 2023-11-28T20:51:44.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfc9a5640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815c130 0x7f2df815c540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2dec011900 tx=0x7f2dec0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec01e650 con 0x7f2df815c130 2023-11-28T20:51:44.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4801 (secure 0 0 0) 0x7f2dec003e80 con 0x7f2df815c130 2023-11-28T20:51:44.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815c130 msgr2=0x7f2df815c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2df57fa640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815c130 0x7f2df815c540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2dec011900 tx=0x7f2dec0046d0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2df57fa640 1 -- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815c130 msgr2=0x7f2df815c540 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:44.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2df57fa640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df815c130 0x7f2df815c540 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2dec011900 tx=0x7f2dec0046d0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 112, 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.711 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:44.712 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:44.713 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:44.714 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:44.715 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.716 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:44.717 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:51:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.718 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.719 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:44.720 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.721 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:44.722 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.723 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:44.724 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:44.725 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:51:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.726 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:51:44.726 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:51:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ddc066540 msgr2=0x7f2ddc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ddc066540 0x7f2ddc068a00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2df0003cc0 tx=0x7f2df0009270 comp rx=0 tx=0).stop 2023-11-28T20:51:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 msgr2=0x7f2df8154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 0x7f2df8154620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2de40ac040 tx=0x7f2de401ad10 comp rx=0 tx=0).stop 2023-11-28T20:51:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfd1a6640 1 -- 172.21.15.167:0/876069490 reap_dead start 2023-11-28T20:51:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 shutdown_connections 2023-11-28T20:51:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 --2- 172.21.15.167:0/876069490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df80cfc40 0x7f2df8154620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 >> 172.21.15.167:0/876069490 conn(0x7f2df806c1f0 msgr2=0x7f2df80cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:44.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 shutdown_connections 2023-11-28T20:51:44.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.709+0000 7f2dfec09640 1 -- 172.21.15.167:0/876069490 wait complete. 2023-11-28T20:51:44.729 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:51:44.729 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:51:44.729 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:51:44.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.877+0000 7f7b4cf0f640 1 Processor -- start 2023-11-28T20:51:44.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.877+0000 7f7b4cf0f640 1 -- start start 2023-11-28T20:51:44.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.877+0000 7f7b4cf0f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7b480cfc40 0x7f7b480cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.877+0000 7f7b4cf0f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7b48153ae0 0x7f7b48153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.877+0000 7f7b4cf0f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4815ac00 con 0x7f7b480cf860 2023-11-28T20:51:44.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.877+0000 7f7b4cf0f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b480cbd60 con 0x7f7b480cfc40 2023-11-28T20:51:44.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.877+0000 7f7b4cf0f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b48159ff0 con 0x7f7b48153ae0 2023-11-28T20:51:44.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.877+0000 7f7b4659c640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f7b480cf860 legacy=0x7f7b480ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:51:44.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b46d9d640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f7b48153ae0 msgr2=0x7f7b48153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:44.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b3ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7b480cfc40 0x7f7b480cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b46d9d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7b48153ae0 0x7f7b48153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:44.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b3ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7b480cfc40 0x7f7b480cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43242/0 (socket says 172.21.15.167:43242) 2023-11-28T20:51:44.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b3ffff640 1 -- 172.21.15.167:0/2065084884 learned_addr learned my addr 172.21.15.167:0/2065084884 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:44.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b3ffff640 1 -- 172.21.15.167:0/2065084884 >> v2:172.21.15.178:3300/0 conn(0x7f7b48153ae0 msgr2=0x7f7b48153f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:44.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b3ffff640 1 --2- 172.21.15.167:0/2065084884 >> v2:172.21.15.178:3300/0 conn(0x7f7b48153ae0 0x7f7b48153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b3ffff640 1 -- 172.21.15.167:0/2065084884 >> v1:172.21.15.178:6789/0 conn(0x7f7b480cf860 legacy=0x7f7b480ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:51:44.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b3ffff640 1 -- 172.21.15.167:0/2065084884 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4815a2d0 con 0x7f7b480cfc40 2023-11-28T20:51:44.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b3ffff640 1 --2- 172.21.15.167:0/2065084884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b480cfc40 0x7f7b480cb770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b480b2240 tx=0x7f7b3001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d92ec2e9b91aa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b45d9b640 1 -- 172.21.15.167:0/2065084884 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300aa640 con 0x7f7b480cfc40 2023-11-28T20:51:44.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b45d9b640 1 -- 172.21.15.167:0/2065084884 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300aa7a0 con 0x7f7b480cfc40 2023-11-28T20:51:44.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.881+0000 7f7b45d9b640 1 -- 172.21.15.167:0/2065084884 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300aab30 con 0x7f7b480cfc40 2023-11-28T20:51:44.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/2065084884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b480cfc40 msgr2=0x7f7b480cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 --2- 172.21.15.167:0/2065084884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b480cfc40 0x7f7b480cb770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b480b2240 tx=0x7f7b3001c4e0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/2065084884 shutdown_connections 2023-11-28T20:51:44.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 --2- 172.21.15.167:0/2065084884 >> v2:172.21.15.178:3300/0 conn(0x7f7b48153ae0 0x7f7b48153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 --2- 172.21.15.167:0/2065084884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b480cfc40 0x7f7b480cb770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/2065084884 >> 172.21.15.167:0/2065084884 conn(0x7f7b4806c1f0 msgr2=0x7f7b48071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:44.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/2065084884 shutdown_connections 2023-11-28T20:51:44.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/2065084884 wait complete. 2023-11-28T20:51:44.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 Processor -- start 2023-11-28T20:51:44.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 -- start start 2023-11-28T20:51:44.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480cf860 0x7f7b48146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b480cfc40 0x7f7b481442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b48153ae0 0x7f7b48144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b481465d0 con 0x7f7b48153ae0 2023-11-28T20:51:44.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48146970 con 0x7f7b480cfc40 2023-11-28T20:51:44.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4cf0f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4814f040 con 0x7f7b480cf860 2023-11-28T20:51:44.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b46d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b48153ae0 0x7f7b48144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b3ffff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b480cfc40 msgr2=0x7f7b481442e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b3ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b480cfc40 0x7f7b481442e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b46d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b48153ae0 0x7f7b48144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43246/0 (socket says 172.21.15.167:43246) 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b46d9d640 1 -- 172.21.15.167:0/1719775739 learned_addr learned my addr 172.21.15.167:0/1719775739 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b4659c640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480cf860 0x7f7b48146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b46d9d640 1 -- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480cf860 msgr2=0x7f7b48146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b46d9d640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480cf860 0x7f7b48146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b46d9d640 1 -- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b480cfc40 msgr2=0x7f7b481442e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b46d9d640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b480cfc40 0x7f7b481442e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.885+0000 7f7b46d9d640 1 -- 172.21.15.167:0/1719775739 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300094d0 con 0x7f7b48153ae0 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b46d9d640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b48153ae0 0x7f7b48144c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000b760 tx=0x7f7b4000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4000c960 con 0x7f7b48153ae0 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4000cac0 con 0x7f7b48153ae0 2023-11-28T20:51:44.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40015470 con 0x7f7b48153ae0 2023-11-28T20:51:44.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4814f8e0 con 0x7f7b48153ae0 2023-11-28T20:51:44.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b481591c0 con 0x7f7b48153ae0 2023-11-28T20:51:44.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b4cf0f640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b48166630 0x7f7b48145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b48072860 con 0x7f7b48166630 2023-11-28T20:51:44.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b4659c640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b48166630 0x7f7b48145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b40012070 con 0x7f7b48153ae0 2023-11-28T20:51:44.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b4659c640 1 -- 172.21.15.167:0/1719775739 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b4814fa70 con 0x7f7b48166630 2023-11-28T20:51:44.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b4659c640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b48166630 0x7f7b48145180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800d700 tx=0x7f7b3800dbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b3effd640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7b28066420 0x7f7b280688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7b400840a0 con 0x7f7b48153ae0 2023-11-28T20:51:44.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b380039c0 con 0x7f7b48166630 2023-11-28T20:51:44.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.889+0000 7f7b3ffff640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7b28066420 0x7f7b280688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.893+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7b38003b20 con 0x7f7b48166630 2023-11-28T20:51:44.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.893+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b48166630 msgr2=0x7f7b48145180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.893+0000 7f7b3effd640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b48166630 0x7f7b48145180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800d700 tx=0x7f7b3800dbc0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.893+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b48166630 msgr2=0x7f7b48145180 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:44.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.893+0000 7f7b3effd640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b48166630 0x7f7b48145180 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800d700 tx=0x7f7b3800dbc0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.893+0000 7f7b3ffff640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7b28066420 0x7f7b280688e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b300ae000 tx=0x7f7b30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.897+0000 7f7b4cf0f640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480b52d0 0x7f7b4814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:51:44.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.897+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4814f730 con 0x7f7b480b52d0 2023-11-28T20:51:44.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.897+0000 7f7b4659c640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480b52d0 0x7f7b4814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:51:44.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.897+0000 7f7b4659c640 1 -- 172.21.15.167:0/1719775739 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7b48075c90 con 0x7f7b480b52d0 2023-11-28T20:51:44.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.897+0000 7f7b4659c640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480b52d0 0x7f7b4814f1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b38016000 tx=0x7f7b380059e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:51:44.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38021070 con 0x7f7b480b52d0 2023-11-28T20:51:44.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5112 (secure 0 0 0) 0x7f7b3800b730 con 0x7f7b480b52d0 2023-11-28T20:51:44.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480b52d0 msgr2=0x7f7b4814f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b3effd640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480b52d0 0x7f7b4814f1f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b38016000 tx=0x7f7b380059e0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b3effd640 1 -- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480b52d0 msgr2=0x7f7b4814f1f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:51:44.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b3effd640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b480b52d0 0x7f7b4814f1f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:51:44.901 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:51:44.902 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:44.902 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:44.902 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:51:44.902 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 112, 2023-11-28T20:51:44.902 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:51:44.902 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:51:44.902 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:51:44.902 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:44.903 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:44.904 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:44.905 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:51:44.906 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.907 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:51:44.908 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:51:44.909 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.910 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:51:44.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.912 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:51:44.912 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:51:44.912 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.912 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.912 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:51:44.912 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:51:44.912 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:51:44.912 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:51:44.913 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:44.914 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:51:44.915 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:51:44.916 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:51:44.917 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:51:44.917 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:51:44.917 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:51:44.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:51:44.917 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:51:44.917 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:51:44.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7b28066420 msgr2=0x7f7b280688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b4cf0f640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7b28066420 0x7f7b280688e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b300ae000 tx=0x7f7b30008040 comp rx=0 tx=0).stop 2023-11-28T20:51:44.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b48153ae0 msgr2=0x7f7b48144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:51:44.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b4cf0f640 1 --2- 172.21.15.167:0/1719775739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b48153ae0 0x7f7b48144c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000b760 tx=0x7f7b4000bc20 comp rx=0 tx=0).stop 2023-11-28T20:51:44.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b46d9d640 1 -- 172.21.15.167:0/1719775739 reap_dead start 2023-11-28T20:51:44.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b46d9d640 1 -- 172.21.15.167:0/1719775739 reap_dead start 2023-11-28T20:51:44.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 shutdown_connections 2023-11-28T20:51:44.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 >> 172.21.15.167:0/1719775739 conn(0x7f7b4806c1f0 msgr2=0x7f7b480c5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:51:44.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 shutdown_connections 2023-11-28T20:51:44.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:51:44.901+0000 7f7b4cf0f640 1 -- 172.21.15.167:0/1719775739 wait complete. 2023-11-28T20:51:44.919 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:51:44.920 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:51:49.161 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:51:49.166 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:04.920 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:52:04.920 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2023-11-28T20:52:04.920 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T20:52:04.920 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T20:52:04.923 INFO:tasks.ceph.mon.b:Started 2023-11-28T20:52:04.923 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:52:04.924 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:52:05.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.069+0000 7fa6aca5a640 1 Processor -- start 2023-11-28T20:52:05.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.069+0000 7fa6aca5a640 1 -- start start 2023-11-28T20:52:05.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6aca5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a8150b40 0x7fa6a8157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6aca5a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa6a80c6ff0 0x7fa6a80c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6aca5a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a80c6ac0 con 0x7fa6a80c5be0 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6aca5a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a80c6500 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6aca5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80c67e0 con 0x7fa6a8150b40 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6a659c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a8150b40 0x7fa6a8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa69dd9b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa6a80c6ff0 0x7fa6a80c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6a6d9d640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fa6a80c5be0 0x7fa6a806a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:57004/0 (socket says 172.21.15.167:57004) 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6a6d9d640 1 -- 172.21.15.167:0/426766008 learned_addr learned my addr 172.21.15.167:0/426766008 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa69dd9b640 1 -- 172.21.15.167:0/426766008 >> v2:172.21.15.178:3300/0 conn(0x7fa6a80c6ff0 msgr2=0x7fa6a80c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:52:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa69dd9b640 1 -- 172.21.15.167:0/426766008 >> v2:172.21.15.178:3300/0 conn(0x7fa6a80c6ff0 msgr2=0x7fa6a80c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:52:05.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa69dd9b640 1 --2- 172.21.15.167:0/426766008 >> v2:172.21.15.178:3300/0 conn(0x7fa6a80c6ff0 0x7fa6a80c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:05.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa69dd9b640 1 --2- 172.21.15.167:0/426766008 >> v2:172.21.15.178:3300/0 conn(0x7fa6a80c6ff0 0x7fa6a80c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:05.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6a659c640 1 -- 172.21.15.167:0/426766008 >> v2:172.21.15.178:3300/0 conn(0x7fa6a80c6ff0 msgr2=0x7fa6a80c4510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:05.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6a659c640 1 --2- 172.21.15.167:0/426766008 >> v2:172.21.15.178:3300/0 conn(0x7fa6a80c6ff0 0x7fa6a80c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6a659c640 1 -- 172.21.15.167:0/426766008 >> v1:172.21.15.178:6789/0 conn(0x7fa6a80c5be0 legacy=0x7fa6a806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:05.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.073+0000 7fa6a659c640 1 -- 172.21.15.167:0/426766008 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8156a80 con 0x7fa6a8150b40 2023-11-28T20:52:05.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6a659c640 1 --2- 172.21.15.167:0/426766008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a8150b40 0x7fa6a8157560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa6900097c0 tx=0x7fa69001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df08c56df593d110 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6a5d9b640 1 -- 172.21.15.167:0/426766008 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900ab650 con 0x7fa6a8150b40 2023-11-28T20:52:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6a5d9b640 1 -- 172.21.15.167:0/426766008 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6900ab7b0 con 0x7fa6a8150b40 2023-11-28T20:52:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6a5d9b640 1 -- 172.21.15.167:0/426766008 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900abb40 con 0x7fa6a8150b40 2023-11-28T20:52:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 -- 172.21.15.167:0/426766008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a8150b40 msgr2=0x7fa6a8157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 --2- 172.21.15.167:0/426766008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a8150b40 0x7fa6a8157560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa6900097c0 tx=0x7fa69001c450 comp rx=0 tx=0).stop 2023-11-28T20:52:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 -- 172.21.15.167:0/426766008 shutdown_connections 2023-11-28T20:52:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 --2- 172.21.15.167:0/426766008 >> v2:172.21.15.178:3300/0 conn(0x7fa6a80c6ff0 0x7fa6a80c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 --2- 172.21.15.167:0/426766008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a8150b40 0x7fa6a8157560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 -- 172.21.15.167:0/426766008 >> 172.21.15.167:0/426766008 conn(0x7fa6a80cb1e0 msgr2=0x7fa6a80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 -- 172.21.15.167:0/426766008 shutdown_connections 2023-11-28T20:52:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 -- 172.21.15.167:0/426766008 wait complete. 2023-11-28T20:52:05.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 Processor -- start 2023-11-28T20:52:05.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.077+0000 7fa6aca5a640 1 -- start start 2023-11-28T20:52:05.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6aca5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 0x7fa6a81f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:05.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6aca5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a80c6ff0 0x7fa6a8144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6aca5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a8150b40 0x7fa6a8145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6aca5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8142d50 con 0x7fa6a8150b40 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6aca5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8149960 con 0x7fa6a80c5be0 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6aca5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8160a90 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6a659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 0x7fa6a81f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69dd9b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a80c6ff0 0x7fa6a8144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6a659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 0x7fa6a81f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:52526/0 (socket says 172.21.15.167:52526) 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6a659c640 1 -- 172.21.15.167:0/903392495 learned_addr learned my addr 172.21.15.167:0/903392495 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6a6d9d640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a8150b40 0x7fa6a8145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:05.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6a659c640 1 -- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 msgr2=0x7fa6a81f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6a659c640 1 -- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 msgr2=0x7fa6a81f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6a659c640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 0x7fa6a81f2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6a659c640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 0x7fa6a81f2d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69dd9b640 1 -- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 msgr2=0x7fa6a81f2d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69dd9b640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 0x7fa6a81f2d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69dd9b640 1 -- 172.21.15.167:0/903392495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a8150b40 msgr2=0x7fa6a8145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69dd9b640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a8150b40 0x7fa6a8145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69dd9b640 1 -- 172.21.15.167:0/903392495 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa690009420 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6a6d9d640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a8150b40 0x7fa6a8145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69dd9b640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a80c6ff0 0x7fa6a8144e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa69800e7e0 tx=0x7fa69800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69f7fe640 1 -- 172.21.15.167:0/903392495 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69800edd0 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69f7fe640 1 -- 172.21.15.167:0/903392495 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa698004020 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa69f7fe640 1 -- 172.21.15.167:0/903392495 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980043d0 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a8160d70 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a81495f0 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.081+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a80682c0 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.085+0000 7fa69f7fe640 1 -- 172.21.15.167:0/903392495 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa69800c6d0 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.085+0000 7fa69f7fe640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa6880664a0 0x7fa688068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.085+0000 7fa69f7fe640 1 -- 172.21.15.167:0/903392495 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa698084560 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.085+0000 7fa6a659c640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa6880664a0 0x7fa688068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.085+0000 7fa6a659c640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa6880664a0 0x7fa688068960 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa6900097c0 tx=0x7fa6900a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.089+0000 7fa69f7fe640 1 -- 172.21.15.167:0/903392495 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6980515d0 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.301+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa6a8075c90 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa69f7fe640 1 -- 172.21.15.167:0/903392495 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fa698054bf0 con 0x7fa6a80c6ff0 2023-11-28T20:52:05.304 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":112,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:52:05.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa6880664a0 msgr2=0x7fa688068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:05.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa6880664a0 0x7fa688068960 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa6900097c0 tx=0x7fa6900a7000 comp rx=0 tx=0).stop 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a80c6ff0 msgr2=0x7fa6a8144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a80c6ff0 0x7fa6a8144e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa69800e7e0 tx=0x7fa69800eca0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 shutdown_connections 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa6880664a0 0x7fa688068960 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6a8150b40 0x7fa6a8145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6a80c6ff0 0x7fa6a8144e10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 --2- 172.21.15.167:0/903392495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80c5be0 0x7fa6a81f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 >> 172.21.15.167:0/903392495 conn(0x7fa6a80cb1e0 msgr2=0x7fa6a814be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 shutdown_connections 2023-11-28T20:52:05.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:05.305+0000 7fa6aca5a640 1 -- 172.21.15.167:0/903392495 wait complete. 2023-11-28T20:52:08.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:52:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d6c5a640 1 Processor -- start 2023-11-28T20:52:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d6c5a640 1 -- start start 2023-11-28T20:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d6c5a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79d00c6ff0 0x7f79d0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d6c5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79d00c4510 0x7f79d006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d6c5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d00c4920 con 0x7f79d0150b40 2023-11-28T20:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d6c5a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d00c62f0 con 0x7f79d00c6ff0 2023-11-28T20:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d6c5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c6ac0 con 0x7f79d00c4510 2023-11-28T20:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d49f6640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f79d0150b40 0x7f79d00c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37228/0 (socket says 172.21.15.167:37228) 2023-11-28T20:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d49f6640 1 -- 172.21.15.167:0/1905514173 learned_addr learned my addr 172.21.15.167:0/1905514173 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:52:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cffff640 1 --2- 172.21.15.167:0/1905514173 >> v2:172.21.15.178:3300/0 conn(0x7f79d00c6ff0 0x7f79d0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d51f7640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79d00c4510 0x7f79d006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444680580 0 0) 0x7f79d00c4920 con 0x7f79d0150b40 2023-11-28T20:52:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c0003530 con 0x7f79d0150b40 2023-11-28T20:52:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cffff640 1 -- 172.21.15.167:0/1905514173 >> v2:172.21.15.178:3300/0 conn(0x7f79d00c6ff0 msgr2=0x7f79d0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:52:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cffff640 1 -- 172.21.15.167:0/1905514173 >> v2:172.21.15.178:3300/0 conn(0x7f79d00c6ff0 msgr2=0x7f79d0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:52:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cffff640 1 --2- 172.21.15.167:0/1905514173 >> v2:172.21.15.178:3300/0 conn(0x7f79d00c6ff0 0x7f79d0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cffff640 1 --2- 172.21.15.167:0/1905514173 >> v2:172.21.15.178:3300/0 conn(0x7f79d00c6ff0 0x7f79d0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924672902 0 0) 0x7f79c0003530 con 0x7f79d0150b40 2023-11-28T20:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79d00c4510 msgr2=0x7f79d006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79d00c4510 0x7f79d006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 >> v2:172.21.15.178:3300/0 conn(0x7f79d00c6ff0 msgr2=0x7f79d0157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 --2- 172.21.15.167:0/1905514173 >> v2:172.21.15.178:3300/0 conn(0x7f79d00c6ff0 0x7f79d0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00c6500 con 0x7f79d0150b40 2023-11-28T20:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f79c40016a0 con 0x7f79d0150b40 2023-11-28T20:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 >> v1:172.21.15.167:6789/0 conn(0x7f79d0150b40 legacy=0x7f79d00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c0003980 0x7f79c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79d00c4510 0x7f79c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c0004d10 0x7f79c0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c62f0 con 0x7f79c0004d10 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00c6ac0 con 0x7f79c0003980 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c000b990 con 0x7f79d00c4510 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d51f7640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c0004d10 0x7f79c0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79cffff640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79d00c4510 0x7f79c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d49f6640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c0003980 0x7f79c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d51f7640 1 -- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79d00c4510 msgr2=0x7f79c00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d51f7640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79d00c4510 0x7f79c00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d51f7640 1 -- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c0003980 msgr2=0x7f79c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d51f7640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79c0003980 0x7f79c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.465+0000 7f79d51f7640 1 -- 172.21.15.167:0/1905514173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c0003530 con 0x7f79c0004d10 2023-11-28T20:52:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79d51f7640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c0004d10 0x7f79c0005190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79c800e170 tx=0x7f79c801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d827b434ce4ad8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80a5c50 con 0x7f79c0004d10 2023-11-28T20:52:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c800f040 con 0x7f79c0004d10 2023-11-28T20:52:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79cf7fe640 1 -- 172.21.15.167:0/1905514173 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80ad440 con 0x7f79c0004d10 2023-11-28T20:52:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79d6c5a640 1 -- 172.21.15.167:0/1905514173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c0004d10 msgr2=0x7f79c0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79d6c5a640 1 --2- 172.21.15.167:0/1905514173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c0004d10 0x7f79c0005190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79c800e170 tx=0x7f79c801cc40 comp rx=0 tx=0).stop 2023-11-28T20:52:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79d51f7640 1 -- 172.21.15.167:0/1905514173 reap_dead start 2023-11-28T20:52:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79d6c5a640 1 -- 172.21.15.167:0/1905514173 shutdown_connections 2023-11-28T20:52:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79d6c5a640 1 -- 172.21.15.167:0/1905514173 >> 172.21.15.167:0/1905514173 conn(0x7f79d00cb1e0 msgr2=0x7f79d00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79d6c5a640 1 -- 172.21.15.167:0/1905514173 shutdown_connections 2023-11-28T20:52:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.469+0000 7f79d6c5a640 1 -- 172.21.15.167:0/1905514173 wait complete. 2023-11-28T20:52:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 Processor -- start 2023-11-28T20:52:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 -- start start 2023-11-28T20:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c0004d10 0x7f79d0143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d015a9b0 0x7f79d01411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79d01544a0 0x7f79d01ef750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d0159140 con 0x7f79d015a9b0 2023-11-28T20:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d0143d20 con 0x7f79d01544a0 2023-11-28T20:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d01f2d60 con 0x7f79c0004d10 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d015a9b0 0x7f79d01411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d015a9b0 0x7f79d01411e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49348/0 (socket says 172.21.15.167:49348) 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cffff640 1 -- 172.21.15.167:0/650231111 learned_addr learned my addr 172.21.15.167:0/650231111 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d49f6640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c0004d10 0x7f79d0143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d51f7640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79d01544a0 0x7f79d01ef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d51f7640 1 -- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79d01544a0 msgr2=0x7f79d01ef750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d51f7640 1 -- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79d01544a0 msgr2=0x7f79d01ef750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d51f7640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79d01544a0 0x7f79d01ef750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cffff640 1 -- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c0004d10 msgr2=0x7f79d0143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cffff640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c0004d10 0x7f79d0143470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d51f7640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79d01544a0 0x7f79d01ef750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cffff640 1 -- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79d01544a0 msgr2=0x7f79d01ef750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:52:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cffff640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79d01544a0 0x7f79d01ef750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cffff640 1 -- 172.21.15.167:0/650231111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d01f3040 con 0x7f79d015a9b0 2023-11-28T20:52:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cffff640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d015a9b0 0x7f79d01411e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79bc010890 tx=0x7f79bc010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cd7fa640 1 -- 172.21.15.167:0/650231111 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00eb60 con 0x7f79d015a9b0 2023-11-28T20:52:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cd7fa640 1 -- 172.21.15.167:0/650231111 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00c050 con 0x7f79d015a9b0 2023-11-28T20:52:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d01f3320 con 0x7f79d015a9b0 2023-11-28T20:52:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79cd7fa640 1 -- 172.21.15.167:0/650231111 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc00ae60 con 0x7f79d015a9b0 2023-11-28T20:52:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.473+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d01f38e0 con 0x7f79d015a9b0 2023-11-28T20:52:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.477+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d00682c0 con 0x7f79d015a9b0 2023-11-28T20:52:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.477+0000 7f79cd7fa640 1 -- 172.21.15.167:0/650231111 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f79bc015470 con 0x7f79d015a9b0 2023-11-28T20:52:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.477+0000 7f79cd7fa640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79b4066470 0x7f79b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.477+0000 7f79cd7fa640 1 -- 172.21.15.167:0/650231111 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f79bc084780 con 0x7f79d015a9b0 2023-11-28T20:52:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.477+0000 7f79d49f6640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79b4066470 0x7f79b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.477+0000 7f79d49f6640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79b4066470 0x7f79b4068930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f79c4001ec0 tx=0x7f79c4007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:08.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.481+0000 7f79cd7fa640 1 -- 172.21.15.167:0/650231111 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79bc051770 con 0x7f79d015a9b0 2023-11-28T20:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.685+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f79d0075c90 con 0x7f79d015a9b0 2023-11-28T20:52:08.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.685+0000 7f79cd7fa640 1 -- 172.21.15.167:0/650231111 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f79bc054d90 con 0x7f79d015a9b0 2023-11-28T20:52:08.686 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":112,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79b4066470 msgr2=0x7f79b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79b4066470 0x7f79b4068930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f79c4001ec0 tx=0x7f79c4007040 comp rx=0 tx=0).stop 2023-11-28T20:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d015a9b0 msgr2=0x7f79d01411e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:08.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d015a9b0 0x7f79d01411e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79bc010890 tx=0x7f79bc010d50 comp rx=0 tx=0).stop 2023-11-28T20:52:08.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 shutdown_connections 2023-11-28T20:52:08.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f79b4066470 0x7f79b4068930 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79d01544a0 0x7f79d01ef750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d015a9b0 0x7f79d01411e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 --2- 172.21.15.167:0/650231111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79c0004d10 0x7f79d0143470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:08.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 >> 172.21.15.167:0/650231111 conn(0x7f79d00cb1e0 msgr2=0x7f79d00c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:08.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 shutdown_connections 2023-11-28T20:52:08.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:08.689+0000 7f79d6c5a640 1 -- 172.21.15.167:0/650231111 wait complete. 2023-11-28T20:52:11.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:52:11.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.857+0000 7fc83fd2a640 1 Processor -- start 2023-11-28T20:52:11.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.857+0000 7fc83fd2a640 1 -- start start 2023-11-28T20:52:11.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83fd2a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8380cfc40 0x7fc8380cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:11.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83fd2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc838153ae0 0x7fc838153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:11.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83fd2a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83815ac00 con 0x7fc8380cf860 2023-11-28T20:52:11.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83fd2a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8380cbd60 con 0x7fc8380cfc40 2023-11-28T20:52:11.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83fd2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc838159ff0 con 0x7fc838153ae0 2023-11-28T20:52:11.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83dac6640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc8380cf860 0x7fc8380ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37232/0 (socket says 172.21.15.167:37232) 2023-11-28T20:52:11.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83dac6640 1 -- 172.21.15.167:0/2530904323 learned_addr learned my addr 172.21.15.167:0/2530904323 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:52:11.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83e2c7640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc838153ae0 0x7fc838153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:11.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83d2c5640 1 --2- 172.21.15.167:0/2530904323 >> v2:172.21.15.178:3300/0 conn(0x7fc8380cfc40 0x7fc8380cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:11.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094015604 0 0) 0x7fc83815ac00 con 0x7fc8380cf860 2023-11-28T20:52:11.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc824003530 con 0x7fc8380cf860 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1201835251 0 0) 0x7fc824003530 con 0x7fc8380cf860 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc838153ae0 msgr2=0x7fc838153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc838153ae0 0x7fc838153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 >> v2:172.21.15.178:3300/0 conn(0x7fc8380cfc40 msgr2=0x7fc8380cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 --2- 172.21.15.167:0/2530904323 >> v2:172.21.15.178:3300/0 conn(0x7fc8380cfc40 0x7fc8380cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83815a2d0 con 0x7fc8380cf860 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fc834001680 con 0x7fc8380cf860 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 >> v1:172.21.15.167:6789/0 conn(0x7fc8380cf860 legacy=0x7fc8380ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc838153ae0 0x7fc824003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:11.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc824003f50 0x7fc8240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824004d10 0x7fc824005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380cbd60 con 0x7fc824004d10 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc838159ff0 con 0x7fc824003f50 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82400b990 con 0x7fc838153ae0 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83e2c7640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824004d10 0x7fc824005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83d2c5640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc824003f50 0x7fc8240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83dac6640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc838153ae0 0x7fc824003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83e2c7640 1 -- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc838153ae0 msgr2=0x7fc824003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83e2c7640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc838153ae0 0x7fc824003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83e2c7640 1 -- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc824003f50 msgr2=0x7fc8240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:11.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83e2c7640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc824003f50 0x7fc8240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:11.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.861+0000 7fc83e2c7640 1 -- 172.21.15.167:0/2530904323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824003530 con 0x7fc824004d10 2023-11-28T20:52:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83e2c7640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824004d10 0x7fc824005190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc83000e170 tx=0x7fc83001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa69fe2c9fcb8eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300a5c50 con 0x7fc824004d10 2023-11-28T20:52:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000f040 con 0x7fc824004d10 2023-11-28T20:52:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83cac4640 1 -- 172.21.15.167:0/2530904323 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300ad440 con 0x7fc824004d10 2023-11-28T20:52:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83fd2a640 1 -- 172.21.15.167:0/2530904323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824004d10 msgr2=0x7fc824005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83fd2a640 1 --2- 172.21.15.167:0/2530904323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824004d10 0x7fc824005190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc83000e170 tx=0x7fc83001cc40 comp rx=0 tx=0).stop 2023-11-28T20:52:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83e2c7640 1 -- 172.21.15.167:0/2530904323 reap_dead start 2023-11-28T20:52:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83fd2a640 1 -- 172.21.15.167:0/2530904323 shutdown_connections 2023-11-28T20:52:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83fd2a640 1 -- 172.21.15.167:0/2530904323 >> 172.21.15.167:0/2530904323 conn(0x7fc83806c1f0 msgr2=0x7fc838071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:11.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83fd2a640 1 -- 172.21.15.167:0/2530904323 shutdown_connections 2023-11-28T20:52:11.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83fd2a640 1 -- 172.21.15.167:0/2530904323 wait complete. 2023-11-28T20:52:11.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83fd2a640 1 Processor -- start 2023-11-28T20:52:11.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.865+0000 7fc83fd2a640 1 -- start start 2023-11-28T20:52:11.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83fd2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc824004d10 0x7fc838158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:11.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83fd2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8381f2bf0 0x7fc838151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:11.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83fd2a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83814fee0 0x7fc838151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:11.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83fd2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc838153020 con 0x7fc8381f2bf0 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83fd2a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8381ef990 con 0x7fc83814fee0 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83fd2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8381efc70 con 0x7fc824004d10 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83d2c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8381f2bf0 0x7fc838151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83d2c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8381f2bf0 0x7fc838151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49364/0 (socket says 172.21.15.167:49364) 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83d2c5640 1 -- 172.21.15.167:0/4062148958 learned_addr learned my addr 172.21.15.167:0/4062148958 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83dac6640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc824004d10 0x7fc838158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83e2c7640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83814fee0 0x7fc838151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83d2c5640 1 -- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc824004d10 msgr2=0x7fc838158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83d2c5640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc824004d10 0x7fc838158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83d2c5640 1 -- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83814fee0 msgr2=0x7fc838151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83d2c5640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83814fee0 0x7fc838151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83d2c5640 1 -- 172.21.15.167:0/4062148958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8381eff50 con 0x7fc8381f2bf0 2023-11-28T20:52:11.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83d2c5640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8381f2bf0 0x7fc838151340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc828011aa0 tx=0x7fc828011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:11.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc82e7fc640 1 -- 172.21.15.167:0/4062148958 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800fb80 con 0x7fc8381f2bf0 2023-11-28T20:52:11.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc82e7fc640 1 -- 172.21.15.167:0/4062148958 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82800fce0 con 0x7fc8381f2bf0 2023-11-28T20:52:11.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc82e7fc640 1 -- 172.21.15.167:0/4062148958 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828014680 con 0x7fc8381f2bf0 2023-11-28T20:52:11.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8381f0230 con 0x7fc8381f2bf0 2023-11-28T20:52:11.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8381ef680 con 0x7fc8381f2bf0 2023-11-28T20:52:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc838075c90 con 0x7fc8381f2bf0 2023-11-28T20:52:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.869+0000 7fc82e7fc640 1 -- 172.21.15.167:0/4062148958 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc8280147e0 con 0x7fc8381f2bf0 2023-11-28T20:52:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.873+0000 7fc82e7fc640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc81c0664a0 0x7fc81c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.873+0000 7fc82e7fc640 1 -- 172.21.15.167:0/4062148958 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc828084c40 con 0x7fc8381f2bf0 2023-11-28T20:52:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.873+0000 7fc83dac6640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc81c0664a0 0x7fc81c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:11.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.873+0000 7fc83dac6640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc81c0664a0 0x7fc81c068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc834001060 tx=0x7fc834009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:11.877+0000 7fc82e7fc640 1 -- 172.21.15.167:0/4062148958 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc828051c30 con 0x7fc8381f2bf0 2023-11-28T20:52:12.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.077+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc8380cb070 con 0x7fc8381f2bf0 2023-11-28T20:52:12.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc82e7fc640 1 -- 172.21.15.167:0/4062148958 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fc828022020 con 0x7fc8381f2bf0 2023-11-28T20:52:12.080 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc81c0664a0 msgr2=0x7fc81c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc81c0664a0 0x7fc81c068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc834001060 tx=0x7fc834009040 comp rx=0 tx=0).stop 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8381f2bf0 msgr2=0x7fc838151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8381f2bf0 0x7fc838151340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc828011aa0 tx=0x7fc828011f60 comp rx=0 tx=0).stop 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 shutdown_connections 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc81c0664a0 0x7fc81c068960 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83814fee0 0x7fc838151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8381f2bf0 0x7fc838151340 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 --2- 172.21.15.167:0/4062148958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc824004d10 0x7fc838158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 >> 172.21.15.167:0/4062148958 conn(0x7fc83806c1f0 msgr2=0x7fc8380cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:12.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 shutdown_connections 2023-11-28T20:52:12.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.081+0000 7fc83fd2a640 1 -- 172.21.15.167:0/4062148958 wait complete. 2023-11-28T20:52:12.100 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:52:12.100 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:52:12.100 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:52:12.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.237+0000 7f1024054640 1 Processor -- start 2023-11-28T20:52:12.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1024054640 1 -- start start 2023-11-28T20:52:12.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1024054640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f101c0cf860 0x7f101c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1024054640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f101c0cfc40 0x7f101c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1024054640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101c15ac00 con 0x7f101c153ae0 2023-11-28T20:52:12.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1024054640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c0cbd60 con 0x7f101c0cf860 2023-11-28T20:52:12.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1024054640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c159ff0 con 0x7f101c0cfc40 2023-11-28T20:52:12.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1021df0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f101c0cf860 0x7f101c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1021df0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f101c0cf860 0x7f101c0cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49370/0 (socket says 172.21.15.167:49370) 2023-11-28T20:52:12.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1021df0640 1 -- 172.21.15.167:0/1105522553 learned_addr learned my addr 172.21.15.167:0/1105522553 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:12.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f10215ef640 1 --2- 172.21.15.167:0/1105522553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f101c0cfc40 0x7f101c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1021df0640 1 -- 172.21.15.167:0/1105522553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f101c0cfc40 msgr2=0x7f101c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:12.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1021df0640 1 --2- 172.21.15.167:0/1105522553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f101c0cfc40 0x7f101c0ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1021df0640 1 -- 172.21.15.167:0/1105522553 >> v1:172.21.15.167:6789/0 conn(0x7f101c153ae0 legacy=0x7f101c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.241+0000 7f1021df0640 1 -- 172.21.15.167:0/1105522553 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c15a2d0 con 0x7f101c0cf860 2023-11-28T20:52:12.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1021df0640 1 --2- 172.21.15.167:0/1105522553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cf860 0x7f101c0cb770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1018009870 tx=0x7f101801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dfa4b6aff26a12 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1020dee640 1 -- 172.21.15.167:0/1105522553 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10180aa670 con 0x7f101c0cf860 2023-11-28T20:52:12.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1020dee640 1 -- 172.21.15.167:0/1105522553 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10180aa7d0 con 0x7f101c0cf860 2023-11-28T20:52:12.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1020dee640 1 -- 172.21.15.167:0/1105522553 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10180aab60 con 0x7f101c0cf860 2023-11-28T20:52:12.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 -- 172.21.15.167:0/1105522553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cf860 msgr2=0x7f101c0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 --2- 172.21.15.167:0/1105522553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cf860 0x7f101c0cb770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1018009870 tx=0x7f101801c510 comp rx=0 tx=0).stop 2023-11-28T20:52:12.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 -- 172.21.15.167:0/1105522553 shutdown_connections 2023-11-28T20:52:12.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 --2- 172.21.15.167:0/1105522553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f101c0cfc40 0x7f101c0ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 --2- 172.21.15.167:0/1105522553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cf860 0x7f101c0cb770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 -- 172.21.15.167:0/1105522553 >> 172.21.15.167:0/1105522553 conn(0x7f101c06c1f0 msgr2=0x7f101c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:12.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 -- 172.21.15.167:0/1105522553 shutdown_connections 2023-11-28T20:52:12.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 -- 172.21.15.167:0/1105522553 wait complete. 2023-11-28T20:52:12.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 Processor -- start 2023-11-28T20:52:12.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.245+0000 7f1024054640 1 -- start start 2023-11-28T20:52:12.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f101c0cf860 0x7f101c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cfc40 0x7f101c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f101c153ae0 0x7f101c0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0c7ab0 con 0x7f101c0cfc40 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0cf420 con 0x7f101c0cf860 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0cde60 con 0x7f101c153ae0 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10215ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cfc40 0x7f101c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10215ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cfc40 0x7f101c0b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49382/0 (socket says 172.21.15.167:49382) 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10215ef640 1 -- 172.21.15.167:0/2834267744 learned_addr learned my addr 172.21.15.167:0/2834267744 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1021df0640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f101c0cf860 0x7f101c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10225f1640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f101c153ae0 0x7f101c0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10215ef640 1 -- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f101c153ae0 msgr2=0x7f101c0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10215ef640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f101c153ae0 0x7f101c0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10215ef640 1 -- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f101c0cf860 msgr2=0x7f101c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10215ef640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f101c0cf860 0x7f101c0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10215ef640 1 -- 172.21.15.167:0/2834267744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10180094d0 con 0x7f101c0cfc40 2023-11-28T20:52:12.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10215ef640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cfc40 0x7f101c0b4ee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f100c00d800 tx=0x7f100c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00b6c0 con 0x7f101c0cfc40 2023-11-28T20:52:12.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00b820 con 0x7f101c0cfc40 2023-11-28T20:52:12.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c0ce100 con 0x7f101c0cfc40 2023-11-28T20:52:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00bb90 con 0x7f101c0cfc40 2023-11-28T20:52:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c0cf140 con 0x7f101c0cfc40 2023-11-28T20:52:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0c7d90 0x7f101c0c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c072860 con 0x7f101c0c7d90 2023-11-28T20:52:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1021df0640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0c7d90 0x7f101c0c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1021df0640 1 -- 172.21.15.167:0/2834267744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f101c154300 con 0x7f101c0c7d90 2023-11-28T20:52:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f1021df0640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0c7d90 0x7f101c0c8890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f101c0c9c50 tx=0x7f10180192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.249+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10180bd3f0 con 0x7f101c0c7d90 2023-11-28T20:52:12.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f100c00bcf0 con 0x7f101c0cfc40 2023-11-28T20:52:12.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10127fc640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1000066510 0x7f10000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f10180b33f0 con 0x7f101c0c7d90 2023-11-28T20:52:12.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0c7d90 msgr2=0x7f101c0c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10127fc640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0c7d90 0x7f101c0c8890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f101c0c9c50 tx=0x7f10180192b0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0c7d90 msgr2=0x7f101c0c8890 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:12.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10127fc640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0c7d90 0x7f101c0c8890 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f101c0c9c50 tx=0x7f10180192b0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f100c084820 con 0x7f101c0cfc40 2023-11-28T20:52:12.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10225f1640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1000066510 0x7f10000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.253+0000 7f10225f1640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1000066510 0x7f10000689d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f10140012f0 tx=0x7f1014009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.257+0000 7f1024054640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c1f6920 0x7f101c143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.257+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0caa50 con 0x7f101c1f6920 2023-11-28T20:52:12.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.257+0000 7f1021df0640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c1f6920 0x7f101c143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.257+0000 7f1021df0640 1 -- 172.21.15.167:0/2834267744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f101c166e40 con 0x7f101c1f6920 2023-11-28T20:52:12.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f1021df0640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c1f6920 0x7f101c143040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f101801c550 tx=0x7f1018009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10180c4670 con 0x7f101c1f6920 2023-11-28T20:52:12.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4812 (secure 0 0 0) 0x7f10180c47d0 con 0x7f101c1f6920 2023-11-28T20:52:12.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c1f6920 msgr2=0x7f101c143040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f10127fc640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c1f6920 0x7f101c143040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f101801c550 tx=0x7f1018009240 comp rx=0 tx=0).stop 2023-11-28T20:52:12.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f10127fc640 1 -- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c1f6920 msgr2=0x7f101c143040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:12.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f10127fc640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c1f6920 0x7f101c143040 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.261 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:52:12.261 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:12.261 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:12.261 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:52:12.261 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 114, 2023-11-28T20:52:12.261 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:52:12.261 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:52:12.261 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:12.262 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:12.263 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:52:12.264 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:52:12.265 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:12.266 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:12.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.268 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:12.269 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:52:12.270 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:52:12.271 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:12.272 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.273 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:52:12.274 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:52:12.275 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:52:12.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1000066510 msgr2=0x7f10000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f1024054640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1000066510 0x7f10000689d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f10140012f0 tx=0x7f1014009040 comp rx=0 tx=0).stop 2023-11-28T20:52:12.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cfc40 msgr2=0x7f101c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f1024054640 1 --2- 172.21.15.167:0/2834267744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f101c0cfc40 0x7f101c0b4ee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f100c00d800 tx=0x7f100c00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f10225f1640 1 -- 172.21.15.167:0/2834267744 reap_dead start 2023-11-28T20:52:12.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f10225f1640 1 -- 172.21.15.167:0/2834267744 reap_dead start 2023-11-28T20:52:12.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 shutdown_connections 2023-11-28T20:52:12.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 >> 172.21.15.167:0/2834267744 conn(0x7f101c06c1f0 msgr2=0x7f101c0662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:12.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 shutdown_connections 2023-11-28T20:52:12.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.261+0000 7f1024054640 1 -- 172.21.15.167:0/2834267744 wait complete. 2023-11-28T20:52:12.278 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:52:12.279 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:52:12.279 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:52:12.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.417+0000 7f786d2fd640 1 Processor -- start 2023-11-28T20:52:12.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.417+0000 7f786d2fd640 1 -- start start 2023-11-28T20:52:12.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.417+0000 7f786d2fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 0x7f786815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.417+0000 7f786d2fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f786806bda0 0x7f7868066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.417+0000 7f786d2fd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786806a8d0 con 0x7f78680b0110 2023-11-28T20:52:12.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.417+0000 7f786d2fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78680ca230 con 0x7f786806bda0 2023-11-28T20:52:12.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.417+0000 7f786d2fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680c8990 con 0x7f78680c8010 2023-11-28T20:52:12.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78667fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 0x7f786815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78677fe640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f786806bda0 0x7f7868066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78667fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 0x7f786815d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:38548/0 (socket says 172.21.15.167:38548) 2023-11-28T20:52:12.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78667fc640 1 -- 172.21.15.167:0/2068928152 learned_addr learned my addr 172.21.15.167:0/2068928152 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:12.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78667fc640 1 -- 172.21.15.167:0/2068928152 >> v2:172.21.15.178:3300/0 conn(0x7f786806bda0 msgr2=0x7f7868066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:12.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78667fc640 1 --2- 172.21.15.167:0/2068928152 >> v2:172.21.15.178:3300/0 conn(0x7f786806bda0 0x7f7868066730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78667fc640 1 -- 172.21.15.167:0/2068928152 >> v1:172.21.15.178:6789/0 conn(0x7f78680b0110 legacy=0x7f786806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78667fc640 1 -- 172.21.15.167:0/2068928152 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680ca480 con 0x7f78680c8010 2023-11-28T20:52:12.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78677fe640 1 --2- 172.21.15.167:0/2068928152 >> v2:172.21.15.178:3300/0 conn(0x7f786806bda0 0x7f7868066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:52:12.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.421+0000 7f78667fc640 1 --2- 172.21.15.167:0/2068928152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 0x7f786815d3b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f785c009870 tx=0x7f785c01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce647d61155a1ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f7865ffb640 1 -- 172.21.15.167:0/2068928152 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0a8a30 con 0x7f78680c8010 2023-11-28T20:52:12.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f7865ffb640 1 -- 172.21.15.167:0/2068928152 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0a8b90 con 0x7f78680c8010 2023-11-28T20:52:12.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f7865ffb640 1 -- 172.21.15.167:0/2068928152 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0b0440 con 0x7f78680c8010 2023-11-28T20:52:12.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 -- 172.21.15.167:0/2068928152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 msgr2=0x7f786815d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 --2- 172.21.15.167:0/2068928152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 0x7f786815d3b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f785c009870 tx=0x7f785c01ed30 comp rx=0 tx=0).stop 2023-11-28T20:52:12.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 -- 172.21.15.167:0/2068928152 shutdown_connections 2023-11-28T20:52:12.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 --2- 172.21.15.167:0/2068928152 >> v2:172.21.15.178:3300/0 conn(0x7f786806bda0 0x7f7868066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 --2- 172.21.15.167:0/2068928152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 0x7f786815d3b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 -- 172.21.15.167:0/2068928152 >> 172.21.15.167:0/2068928152 conn(0x7f786806ee30 msgr2=0x7f786806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:12.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 -- 172.21.15.167:0/2068928152 shutdown_connections 2023-11-28T20:52:12.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 -- 172.21.15.167:0/2068928152 wait complete. 2023-11-28T20:52:12.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 Processor -- start 2023-11-28T20:52:12.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 -- start start 2023-11-28T20:52:12.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f786806bda0 0x7f7868159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78680b0110 0x7f78680af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 0x7f78681ef710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786815aa30 con 0x7f78680b0110 2023-11-28T20:52:12.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7868157cd0 con 0x7f786806bda0 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f786d2fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786815a750 con 0x7f78680c8010 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f78667fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78680b0110 0x7f78680af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f78667fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78680b0110 0x7f78680af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49406/0 (socket says 172.21.15.167:49406) 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f78667fc640 1 -- 172.21.15.167:0/814162668 learned_addr learned my addr 172.21.15.167:0/814162668 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f78677fe640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 0x7f78681ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.425+0000 7f7866ffd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f786806bda0 0x7f7868159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f78667fc640 1 -- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 msgr2=0x7f78681ef710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f78667fc640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78680c8010 0x7f78681ef710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f78667fc640 1 -- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f786806bda0 msgr2=0x7f7868159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f78667fc640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f786806bda0 0x7f7868159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f78667fc640 1 -- 172.21.15.167:0/814162668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7860009a70 con 0x7f78680b0110 2023-11-28T20:52:12.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f78667fc640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78680b0110 0x7f78680af040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f785c01c960 tx=0x7f785c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0b1de0 con 0x7f78680b0110 2023-11-28T20:52:12.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0bb440 con 0x7f78680b0110 2023-11-28T20:52:12.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0094d0 con 0x7f78680b0110 2023-11-28T20:52:12.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0bb7b0 con 0x7f78680b0110 2023-11-28T20:52:12.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7868158250 con 0x7f78680b0110 2023-11-28T20:52:12.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f786d2fd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78681e4080 0x7f78681efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786806b130 con 0x7f78681e4080 2023-11-28T20:52:12.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f7866ffd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78681e4080 0x7f78681efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f785c0b7040 con 0x7f78680b0110 2023-11-28T20:52:12.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f7866ffd640 1 -- 172.21.15.167:0/814162668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78680ca760 con 0x7f78681e4080 2023-11-28T20:52:12.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f7866ffd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78681e4080 0x7f78681efc50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f785800e400 tx=0x7f785800e8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f784f7fe640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7854066470 0x7f7854068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f785c122210 con 0x7f78680b0110 2023-11-28T20:52:12.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580052e0 con 0x7f78681e4080 2023-11-28T20:52:12.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.429+0000 7f78677fe640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7854066470 0x7f7854068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.433+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7858005440 con 0x7f78681e4080 2023-11-28T20:52:12.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.433+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78681e4080 msgr2=0x7f78681efc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.433+0000 7f784f7fe640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78681e4080 0x7f78681efc50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f785800e400 tx=0x7f785800e8c0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.433+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78681e4080 msgr2=0x7f78681efc50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:12.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.433+0000 7f784f7fe640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78681e4080 0x7f78681efc50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.433+0000 7f78677fe640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7854066470 0x7f7854068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f78680b27b0 tx=0x7f786000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.437+0000 7f786d2fd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7868158470 0x7f7868156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.437+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78680c8f10 con 0x7f7868158470 2023-11-28T20:52:12.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.437+0000 7f7866ffd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7868158470 0x7f7868156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.437+0000 7f7866ffd640 1 -- 172.21.15.167:0/814162668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f786806d530 con 0x7f7868158470 2023-11-28T20:52:12.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f7866ffd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7868158470 0x7f7868156a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f785800e400 tx=0x7f7858000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858021070 con 0x7f7868158470 2023-11-28T20:52:12.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f78580069f0 con 0x7f7868158470 2023-11-28T20:52:12.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7868158470 msgr2=0x7f7868156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f784f7fe640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7868158470 0x7f7868156a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f785800e400 tx=0x7f7858000ee0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f784f7fe640 1 -- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7868158470 msgr2=0x7f7868156a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:12.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f784f7fe640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7868158470 0x7f7868156a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.441 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:52:12.441 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:12.441 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 114, 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:52:12.442 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:52:12.443 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:12.444 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:52:12.445 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:52:12.446 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:52:12.446 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:52:12.446 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:52:12.446 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:12.447 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:52:12.448 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:12.449 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:12.450 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.450 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:12.450 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:12.450 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:12.450 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:12.450 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.450 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:12.450 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:52:12.451 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:12.453 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.454 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:52:12.455 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.455 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.455 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.455 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:12.455 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.455 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.456 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:52:12.456 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:52:12.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7854066470 msgr2=0x7f7854068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f786d2fd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7854066470 0x7f7854068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f78680b27b0 tx=0x7f786000b040 comp rx=0 tx=0).stop 2023-11-28T20:52:12.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78680b0110 msgr2=0x7f78680af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f786d2fd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78680b0110 0x7f78680af040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f785c01c960 tx=0x7f785c01bad0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f78677fe640 1 -- 172.21.15.167:0/814162668 reap_dead start 2023-11-28T20:52:12.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 shutdown_connections 2023-11-28T20:52:12.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f786d2fd640 1 --2- 172.21.15.167:0/814162668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78680b0110 0x7f78680af040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 >> 172.21.15.167:0/814162668 conn(0x7f786806ee30 msgr2=0x7f786806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:12.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 shutdown_connections 2023-11-28T20:52:12.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.441+0000 7f786d2fd640 1 -- 172.21.15.167:0/814162668 wait complete. 2023-11-28T20:52:12.459 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:52:12.459 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:52:12.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:52:12.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.597+0000 7fa8ff1d8640 1 Processor -- start 2023-11-28T20:52:12.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.597+0000 7fa8ff1d8640 1 -- start start 2023-11-28T20:52:12.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ff1d8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa8f806a580 0x7fa8f806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ff1d8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f815ada0 con 0x7fa8f815d770 2023-11-28T20:52:12.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ff1d8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f8159f40 con 0x7fa8f8153fa0 2023-11-28T20:52:12.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ff1d8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f815a220 con 0x7fa8f806a580 2023-11-28T20:52:12.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8effff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa8f815d770 0x7fa8f815dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37246/0 (socket says 172.21.15.167:37246) 2023-11-28T20:52:12.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8effff640 1 -- 172.21.15.167:0/404514562 learned_addr learned my addr 172.21.15.167:0/404514562 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:52:12.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8fd775640 1 --2- 172.21.15.167:0/404514562 >> v2:172.21.15.178:3300/0 conn(0x7fa8f806a580 0x7fa8f806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827426136 0 0) 0x7fa8e8001120 con 0x7fa8f815d770 2023-11-28T20:52:12.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e0003530 con 0x7fa8f815d770 2023-11-28T20:52:12.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3749302716 0 0) 0x7fa8e0003530 con 0x7fa8f815d770 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 >> v2:172.21.15.178:3300/0 conn(0x7fa8f806a580 msgr2=0x7fa8f806a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 --2- 172.21.15.167:0/404514562 >> v2:172.21.15.178:3300/0 conn(0x7fa8f806a580 0x7fa8f806a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 >> v1:172.21.15.178:6789/0 conn(0x7fa8f8153fa0 legacy=0x7fa8f80c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f815a500 con 0x7fa8f815d770 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fa8e8001810 con 0x7fa8f815d770 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 >> v1:172.21.15.167:6789/0 conn(0x7fa8f815d770 legacy=0x7fa8f815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e0003980 0x7fa8e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8e00047d0 0x7fa8e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8e0005190 0x7fa8e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f815a220 con 0x7fa8e0003980 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e000c030 con 0x7fa8e0005190 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e000c1f0 con 0x7fa8e00047d0 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8fcf74640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e0003980 0x7fa8e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8fd775640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8e0005190 0x7fa8e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8effff640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8e00047d0 0x7fa8e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8fcf74640 1 -- 172.21.15.167:0/404514562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8e00047d0 msgr2=0x7fa8e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8fcf74640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8e00047d0 0x7fa8e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8fcf74640 1 -- 172.21.15.167:0/404514562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8e0005190 msgr2=0x7fa8e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8fcf74640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8e0005190 0x7fa8e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8fcf74640 1 -- 172.21.15.167:0/404514562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0003530 con 0x7fa8e0003980 2023-11-28T20:52:12.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.601+0000 7fa8fd775640 1 -- 172.21.15.167:0/404514562 reap_dead start 2023-11-28T20:52:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8fcf74640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e0003980 0x7fa8e0003da0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4001780 tx=0x7fa8f401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4371096cd6808aa3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40052d0 con 0x7fa8e0003980 2023-11-28T20:52:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f40a7050 con 0x7fa8e0003980 2023-11-28T20:52:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ef7fe640 1 -- 172.21.15.167:0/404514562 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4003600 con 0x7fa8e0003980 2023-11-28T20:52:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/404514562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e0003980 msgr2=0x7fa8e0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ff1d8640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e0003980 0x7fa8e0003da0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4001780 tx=0x7fa8f401c3b0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/404514562 shutdown_connections 2023-11-28T20:52:12.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ff1d8640 1 --2- 172.21.15.167:0/404514562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8e0003980 0x7fa8e0003da0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/404514562 >> 172.21.15.167:0/404514562 conn(0x7fa8f80cb1e0 msgr2=0x7fa8f80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:12.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/404514562 shutdown_connections 2023-11-28T20:52:12.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/404514562 wait complete. 2023-11-28T20:52:12.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ff1d8640 1 Processor -- start 2023-11-28T20:52:12.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.605+0000 7fa8ff1d8640 1 -- start start 2023-11-28T20:52:12.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8e0003980 0x7fa8f81589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c5040 0x7fa8f814e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f80ca8a0 0x7fa8f8143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f8159170 con 0x7fa8f80ca8a0 2023-11-28T20:52:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f80c3220 con 0x7fa8e0003980 2023-11-28T20:52:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f80c3ac0 con 0x7fa8f80c5040 2023-11-28T20:52:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fd775640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f80ca8a0 0x7fa8f8143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8effff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c5040 0x7fa8f814e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fcf74640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8e0003980 0x7fa8f81589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fd775640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f80ca8a0 0x7fa8f8143660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49414/0 (socket says 172.21.15.167:49414) 2023-11-28T20:52:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fd775640 1 -- 172.21.15.167:0/326728568 learned_addr learned my addr 172.21.15.167:0/326728568 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fd775640 1 -- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c5040 msgr2=0x7fa8f814e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fd775640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c5040 0x7fa8f814e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fd775640 1 -- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8e0003980 msgr2=0x7fa8f81589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fd775640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8e0003980 0x7fa8f81589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fd775640 1 -- 172.21.15.167:0/326728568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f81579c0 con 0x7fa8f80ca8a0 2023-11-28T20:52:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fd775640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f80ca8a0 0x7fa8f8143660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8157970 tx=0x7fa8f00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000e070 con 0x7fa8f80ca8a0 2023-11-28T20:52:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f0007ec0 con 0x7fa8f80ca8a0 2023-11-28T20:52:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0011de0 con 0x7fa8f80ca8a0 2023-11-28T20:52:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f8157c20 con 0x7fa8f80ca8a0 2023-11-28T20:52:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f80c46a0 con 0x7fa8f80ca8a0 2023-11-28T20:52:12.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c3360 0x7fa8f8143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f8074770 con 0x7fa8f80c3360 2023-11-28T20:52:12.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.609+0000 7fa8fcf74640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c3360 0x7fa8f8143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8fcf74640 1 -- 172.21.15.167:0/326728568 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8f80c5e90 con 0x7fa8f80c3360 2023-11-28T20:52:12.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8f00039a0 con 0x7fa8f80ca8a0 2023-11-28T20:52:12.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8fcf74640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c3360 0x7fa8f8143ba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4004000 tx=0x7fa8e0005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8ed7fa640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa8e4066470 0x7fa8e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa8f0084950 con 0x7fa8f80ca8a0 2023-11-28T20:52:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8effff640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa8e4066470 0x7fa8e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4007040 con 0x7fa8f80c3360 2023-11-28T20:52:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8effff640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa8e4066470 0x7fa8e4068930 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806b770 tx=0x7fa8e8007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa8f40071a0 con 0x7fa8f80c3360 2023-11-28T20:52:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c3360 msgr2=0x7fa8f8143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8ed7fa640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c3360 0x7fa8f8143ba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4004000 tx=0x7fa8e0005800 comp rx=0 tx=0).stop 2023-11-28T20:52:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c3360 msgr2=0x7fa8f8143ba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:12.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.613+0000 7fa8ed7fa640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f80c3360 0x7fa8f8143ba0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4004000 tx=0x7fa8e0005800 comp rx=0 tx=0).stop 2023-11-28T20:52:12.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8ff1d8640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f81f60c0 0x7fa8f81f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f8150330 con 0x7fa8f81f60c0 2023-11-28T20:52:12.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8fcf74640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f81f60c0 0x7fa8f81f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8fcf74640 1 -- 172.21.15.167:0/326728568 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa8f80682c0 con 0x7fa8f81f60c0 2023-11-28T20:52:12.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8fcf74640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f81f60c0 0x7fa8f81f64d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4000c10 tx=0x7fa8f40a6000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40c5070 con 0x7fa8f81f60c0 2023-11-28T20:52:12.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7fa8f4006e70 con 0x7fa8f81f60c0 2023-11-28T20:52:12.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f81f60c0 msgr2=0x7fa8f81f64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8ed7fa640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f81f60c0 0x7fa8f81f64d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4000c10 tx=0x7fa8f40a6000 comp rx=0 tx=0).stop 2023-11-28T20:52:12.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8ed7fa640 1 -- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f81f60c0 msgr2=0x7fa8f81f64d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:12.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.621+0000 7fa8ed7fa640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8f81f60c0 0x7fa8f81f64d0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4000c10 tx=0x7fa8f40a6000 comp rx=0 tx=0).stop 2023-11-28T20:52:12.624 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:52:12.624 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:12.624 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:12.624 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:52:12.624 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 114, 2023-11-28T20:52:12.624 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:12.625 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:12.626 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:12.626 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:12.626 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:12.626 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:12.626 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:12.626 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:12.626 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:12.626 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:12.626 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:12.627 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:52:12.628 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:12.629 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:52:12.630 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:12.630 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:12.630 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:12.630 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:12.630 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:12.630 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:12.630 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:12.630 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:12.630 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:12.631 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.632 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.633 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.633 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:52:12.633 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:52:12.633 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:12.633 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:12.633 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:52:12.634 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:52:12.635 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:12.636 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.637 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.638 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.639 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:52:12.640 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.641 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:12.642 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:12.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:12.643 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:52:12.643 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:52:12.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa8e4066470 msgr2=0x7fa8e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8ff1d8640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa8e4066470 0x7fa8e4068930 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806b770 tx=0x7fa8e8007040 comp rx=0 tx=0).stop 2023-11-28T20:52:12.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f80ca8a0 msgr2=0x7fa8f8143660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8ff1d8640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f80ca8a0 0x7fa8f8143660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8157970 tx=0x7fa8f00115a0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8fd775640 1 -- 172.21.15.167:0/326728568 reap_dead start 2023-11-28T20:52:12.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 shutdown_connections 2023-11-28T20:52:12.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8ff1d8640 1 --2- 172.21.15.167:0/326728568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8f80ca8a0 0x7fa8f8143660 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 >> 172.21.15.167:0/326728568 conn(0x7fa8f80cb1e0 msgr2=0x7fa8f80c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:12.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 shutdown_connections 2023-11-28T20:52:12.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.625+0000 7fa8ff1d8640 1 -- 172.21.15.167:0/326728568 wait complete. 2023-11-28T20:52:12.645 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:52:12.646 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:52:12.646 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:52:12.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe65b29c640 1 Processor -- start 2023-11-28T20:52:12.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe65b29c640 1 -- start start 2023-11-28T20:52:12.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe65b29c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6540cf860 0x7fe6540cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe65b29c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65415ac00 con 0x7fe654153ae0 2023-11-28T20:52:12.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe65b29c640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6540cbd60 con 0x7fe6540cfc40 2023-11-28T20:52:12.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe65b29c640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe654159ff0 con 0x7fe6540cf860 2023-11-28T20:52:12.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe659839640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe654153ae0 0x7fe65415d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:37260/0 (socket says 172.21.15.167:37260) 2023-11-28T20:52:12.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe659839640 1 -- 172.21.15.167:0/1049925577 learned_addr learned my addr 172.21.15.167:0/1049925577 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:52:12.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe659038640 1 --2- 172.21.15.167:0/1049925577 >> v2:172.21.15.178:3300/0 conn(0x7fe6540cf860 0x7fe6540cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712882363 0 0) 0x7fe65415ac00 con 0x7fe654153ae0 2023-11-28T20:52:12.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe640003530 con 0x7fe654153ae0 2023-11-28T20:52:12.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2062696772 0 0) 0x7fe640003530 con 0x7fe654153ae0 2023-11-28T20:52:12.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 >> v2:172.21.15.178:3300/0 conn(0x7fe6540cf860 msgr2=0x7fe6540cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:12.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 --2- 172.21.15.167:0/1049925577 >> v2:172.21.15.178:3300/0 conn(0x7fe6540cf860 0x7fe6540cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 >> v1:172.21.15.178:6789/0 conn(0x7fe6540cfc40 legacy=0x7fe6540ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65415a2d0 con 0x7fe654153ae0 2023-11-28T20:52:12.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fe64c001a00 con 0x7fe654153ae0 2023-11-28T20:52:12.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 >> v1:172.21.15.167:6789/0 conn(0x7fe654153ae0 legacy=0x7fe65415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe640003980 0x7fe640003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe640004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe640005190 0x7fe64000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe654159ff0 con 0x7fe6400047d0 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64000c030 con 0x7fe640005190 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64000c1f0 con 0x7fe640003980 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe658837640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe640004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe659038640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe640003980 0x7fe640003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe659839640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe640005190 0x7fe64000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe658837640 1 -- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe640003980 msgr2=0x7fe640003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe658837640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe640003980 0x7fe640003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe658837640 1 -- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe640005190 msgr2=0x7fe64000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:12.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe658837640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe640005190 0x7fe64000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe658837640 1 -- 172.21.15.167:0/1049925577 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640003530 con 0x7fe6400047d0 2023-11-28T20:52:12.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe659038640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe640003980 0x7fe640003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:52:12.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe659839640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe640005190 0x7fe64000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:52:12.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.785+0000 7fe659839640 1 -- 172.21.15.167:0/1049925577 reap_dead start 2023-11-28T20:52:12.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe658837640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe640004c50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe644001780 tx=0x7fe64401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca0a2a4b9abbe2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440a4ea0 con 0x7fe6400047d0 2023-11-28T20:52:12.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6440a7050 con 0x7fe6400047d0 2023-11-28T20:52:12.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe64bfff640 1 -- 172.21.15.167:0/1049925577 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644003600 con 0x7fe6400047d0 2023-11-28T20:52:12.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe65b29c640 1 -- 172.21.15.167:0/1049925577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 msgr2=0x7fe640004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe65b29c640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe640004c50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe644001780 tx=0x7fe64401c3e0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe65b29c640 1 -- 172.21.15.167:0/1049925577 shutdown_connections 2023-11-28T20:52:12.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe65b29c640 1 --2- 172.21.15.167:0/1049925577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe640004c50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe65b29c640 1 -- 172.21.15.167:0/1049925577 >> 172.21.15.167:0/1049925577 conn(0x7fe65406c1f0 msgr2=0x7fe654071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:12.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe65b29c640 1 -- 172.21.15.167:0/1049925577 shutdown_connections 2023-11-28T20:52:12.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.789+0000 7fe65b29c640 1 -- 172.21.15.167:0/1049925577 wait complete. 2023-11-28T20:52:12.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 Processor -- start 2023-11-28T20:52:12.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 -- start start 2023-11-28T20:52:12.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe65415c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe65415ae60 0x7fe6541f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6540b3660 0x7fe6541f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe654148980 con 0x7fe6400047d0 2023-11-28T20:52:12.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541f3730 con 0x7fe6540b3660 2023-11-28T20:52:12.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65415c9f0 con 0x7fe65415ae60 2023-11-28T20:52:12.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659038640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe65415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659038640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe65415c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49432/0 (socket says 172.21.15.167:49432) 2023-11-28T20:52:12.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659038640 1 -- 172.21.15.167:0/614670269 learned_addr learned my addr 172.21.15.167:0/614670269 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659839640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6540b3660 0x7fe6541f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe658837640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe65415ae60 0x7fe6541f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659038640 1 -- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe65415ae60 msgr2=0x7fe6541f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659038640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe65415ae60 0x7fe6541f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659038640 1 -- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6540b3660 msgr2=0x7fe6541f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659038640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6540b3660 0x7fe6541f4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:12.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659038640 1 -- 172.21.15.167:0/614670269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65415ccd0 con 0x7fe6400047d0 2023-11-28T20:52:12.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe659038640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe65415c390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe650011510 tx=0x7fe6500119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe649ffb640 1 -- 172.21.15.167:0/614670269 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650004220 con 0x7fe6400047d0 2023-11-28T20:52:12.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe649ffb640 1 -- 172.21.15.167:0/614670269 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650004380 con 0x7fe6400047d0 2023-11-28T20:52:12.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65415cfb0 con 0x7fe6400047d0 2023-11-28T20:52:12.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe649ffb640 1 -- 172.21.15.167:0/614670269 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650015890 con 0x7fe6400047d0 2023-11-28T20:52:12.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.793+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6541f3c60 con 0x7fe6400047d0 2023-11-28T20:52:12.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.797+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe654067c40 con 0x7fe6400047d0 2023-11-28T20:52:12.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.797+0000 7fe649ffb640 1 -- 172.21.15.167:0/614670269 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe6500159f0 con 0x7fe6400047d0 2023-11-28T20:52:12.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.797+0000 7fe649ffb640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6380664a0 0x7fe638068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:12.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.797+0000 7fe649ffb640 1 -- 172.21.15.167:0/614670269 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe6500847e0 con 0x7fe6400047d0 2023-11-28T20:52:12.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.797+0000 7fe658837640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6380664a0 0x7fe638068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:12.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.797+0000 7fe658837640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6380664a0 0x7fe638068960 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe644001750 tx=0x7fe6440011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:12.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:12.801+0000 7fe649ffb640 1 -- 172.21.15.167:0/614670269 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe6500517d0 con 0x7fe6400047d0 2023-11-28T20:52:13.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.005+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fe654075c90 con 0x7fe6400047d0 2023-11-28T20:52:13.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.005+0000 7fe649ffb640 1 -- 172.21.15.167:0/614670269 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fe650054df0 con 0x7fe6400047d0 2023-11-28T20:52:13.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6380664a0 msgr2=0x7fe638068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:13.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6380664a0 0x7fe638068960 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe644001750 tx=0x7fe6440011a0 comp rx=0 tx=0).stop 2023-11-28T20:52:13.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 msgr2=0x7fe65415c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:13.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe65415c390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe650011510 tx=0x7fe6500119d0 comp rx=0 tx=0).stop 2023-11-28T20:52:13.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 shutdown_connections 2023-11-28T20:52:13.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe6380664a0 0x7fe638068960 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:13.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6540b3660 0x7fe6541f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:13.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe65415ae60 0x7fe6541f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:13.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 --2- 172.21.15.167:0/614670269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6400047d0 0x7fe65415c390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:13.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 >> 172.21.15.167:0/614670269 conn(0x7fe65406c1f0 msgr2=0x7fe654071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:13.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 shutdown_connections 2023-11-28T20:52:13.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:13.009+0000 7fe65b29c640 1 -- 172.21.15.167:0/614670269 wait complete. 2023-11-28T20:52:13.028 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:52:17.700 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 0% (18/12907) Updating files: 0% (119/12907) Updating files: 1% (130/12907) Updating files: 1% (144/12907) Updating files: 1% (220/12907) Updating files: 1% (245/12907) Updating files: 2% (259/12907) Updating files: 2% (264/12907) Updating files: 2% (345/12907) Updating files: 2% (363/12907) Updating files: 3% (388/12907) Updating files: 3% (392/12907) Updating files: 4% (517/12907) Updating files: 4% (538/12907) Updating files: 4% (561/12907) Updating files: 4% (572/12907) Updating files: 4% (600/12907) Updating files: 4% (626/12907) Updating files: 5% (646/12907) Updating files: 6% (775/12907) Updating files: 6% (786/12907) Updating files: 6% (842/12907) Updating files: 6% (897/12907) Updating files: 7% (904/12907) Updating files: 7% (929/12907) Updating files: 7% (969/12907) Updating files: 7% (986/12907) Updating files: 7% (1025/12907) Updating files: 8% (1033/12907) Updating files: 8% (1144/12907) Updating files: 8% (1151/12907) Updating files: 8% (1156/12907) Updating files: 9% (1162/12907) Updating files: 9% (1172/12907) Updating files: 9% (1235/12907) Updating files: 9% (1270/12907) Updating files: 9% (1285/12907) Updating files: 10% (1291/12907) Updating files: 10% (1322/12907) Updating files: 10% (1324/12907) Updating files: 10% (1334/12907) Updating files: 10% (1340/12907) Updating files: 10% (1404/12907) Updating files: 10% (1409/12907) Updating files: 11% (1420/12907) Updating files: 11% (1487/12907) Updating files: 11% (1503/12907) Updating files: 11% (1534/12907) Updating files: 12% (1549/12907) Updating files: 12% (1558/12907) Updating files: 12% (1565/12907) Updating files: 12% (1573/12907) Updating files: 12% (1603/12907) Updating files: 12% (1624/12907) Updating files: 12% (1675/12907) Updating files: 13% (1678/12907) Updating files: 13% (1701/12907) Updating files: 13% (1742/12907) Updating files: 13% (1748/12907) Updating files: 13% (1798/12907) Updating files: 14% (1807/12907) Updating files: 14% (1882/12907) Updating files: 15% (1937/12907) Updating files: 15% (1956/12907) Updating files: 15% (1974/12907) Updating files: 15% (1996/12907) Updating files: 16% (2066/12907) Updating files: 16% (2086/12907) Updating files: 16% (2107/12907) Updating files: 16% (2139/12907) Updating files: 16% (2141/12907) Updating files: 16% (2163/12907) Updating files: 17% (2195/12907) Updating files: 17% (2197/12907) Updating files: 17% (2211/12907) Updating files: 17% (2301/12907) Updating files: 17% (2306/12907) Updating files: 18% (2324/12907) Updating files: 18% (2368/12907) Updating files: 19% (2453/12907) Updating files: 19% (2513/12907) Updating files: 20% (2582/12907) Updating files: 20% (2655/12907) Updating files: 20% (2683/12907) Updating files: 20% (2692/12907) Updating files: 20% (2709/12907) Updating files: 21% (2711/12907) Updating files: 21% (2740/12907) Updating files: 21% (2753/12907) Updating files: 22% (2840/12907) Updating files: 22% (2889/12907) Updating files: 22% (2915/12907) Updating files: 22% (2931/12907) Updating files: 22% (2964/12907) Updating files: 23% (2969/12907) Updating files: 24% (3098/12907) Updating files: 24% (3113/12907) Updating files: 24% (3159/12907) Updating files: 25% (3227/12907) Updating files: 25% (3239/12907) Updating files: 25% (3252/12907) Updating files: 25% (3323/12907) Updating files: 25% (3334/12907) Updating files: 26% (3356/12907) Updating files: 26% (3413/12907) Updating files: 26% (3469/12907) Updating files: 27% (3485/12907) Updating files: 27% (3508/12907) Updating files: 27% (3576/12907) Updating files: 27% (3585/12907) Updating files: 27% (3593/12907) Updating files: 28% (3614/12907) Updating files: 28% (3647/12907) Updating files: 28% (3682/12907) Updating files: 29% (3744/12907) Updating files: 29% (3841/12907) Updating files: 30% (3873/12907) Updating files: 30% (3886/12907) Updating files: 30% (3901/12907) Updating files: 31% (4002/12907) Updating files: 31% (4004/12907) Updating files: 31% (4032/12907) Updating files: 31% (4086/12907) Updating files: 32% (4131/12907) Updating files: 32% (4136/12907) Updating files: 32% (4232/12907) Updating files: 32% (4254/12907) Updating files: 33% (4260/12907) Updating files: 33% (4328/12907) Updating files: 34% (4389/12907) Updating files: 34% (4430/12907) Updating files: 35% (4518/12907) Updating files: 36% (4647/12907) Updating files: 36% (4676/12907) Updating files: 36% (4690/12907) Updating files: 36% (4722/12907) Updating files: 36% (4744/12907) Updating files: 36% (4773/12907) Updating files: 37% (4776/12907) Updating files: 37% (4797/12907) Updating files: 37% (4898/12907) Updating files: 38% (4905/12907) Updating files: 38% (4937/12907) Updating files: 38% (4975/12907) Updating files: 38% (5030/12907) Updating files: 39% (5034/12907) Updating files: 39% (5049/12907) Updating files: 39% (5067/12907) Updating files: 39% (5073/12907) Updating files: 39% (5102/12907) Updating files: 39% (5103/12907) Updating files: 39% (5119/12907) Updating files: 40% (5163/12907) Updating files: 40% (5179/12907) Updating files: 40% (5191/12907) Updating files: 40% (5194/12907) Updating files: 40% (5222/12907) Updating files: 40% (5223/12907) Updating files: 40% (5243/12907) Updating files: 40% (5274/12907) Updating files: 41% (5292/12907) Updating files: 41% (5336/12907) Updating files: 41% (5373/12907) Updating files: 41% (5404/12907) Updating files: 41% (5408/12907) Updating files: 42% (5421/12907) Updating files: 42% (5441/12907) Updating files: 42% (5464/12907) Updating files: 42% (5491/12907) Updating files: 42% (5506/12907) Updating files: 43% (5551/12907) Updating files: 43% (5610/12907) Updating files: 44% (5680/12907) Updating files: 45% (5809/12907) Updating files: 45% (5886/12907) Updating files: 46% (5938/12907) Updating files: 46% (6030/12907) Updating files: 47% (6067/12907) Updating files: 47% (6121/12907) Updating files: 48% (6196/12907) Updating files: 48% (6202/12907) Updating files: 48% (6233/12907) Updating files: 49% (6325/12907) Updating files: 49% (6327/12907) Updating files: 49% (6363/12907) Updating files: 49% (6378/12907) Updating files: 49% (6401/12907) Updating files: 49% (6412/12907) Updating files: 49% (6453/12907) Updating files: 50% (6454/12907) Updating files: 50% (6473/12907) Updating files: 50% (6483/12907) Updating files: 50% (6548/12907) Updating files: 50% (6579/12907) Updating files: 51% (6583/12907) Updating files: 51% (6646/12907) Updating files: 51% (6649/12907) Updating files: 52% (6712/12907) Updating files: 52% (6718/12907) Updating files: 53% (6841/12907) Updating files: 53% (6842/12907) Updating files: 53% (6887/12907) Updating files: 53% (6917/12907) Updating files: 54% (6970/12907) Updating files: 54% (7014/12907) Updating files: 55% (7099/12907) Updating files: 55% (7118/12907) Updating files: 55% (7185/12907) Updating files: 55% (7188/12907) Updating files: 56% (7228/12907) Updating files: 56% (7279/12907) Updating files: 56% (7280/12907) Updating files: 56% (7328/12907) Updating files: 56% (7346/12907) Updating files: 57% (7357/12907) Updating files: 57% (7426/12907) Updating files: 58% (7487/12907) Updating files: 58% (7549/12907) Updating files: 59% (7616/12907) Updating files: 59% (7673/12907) Updating files: 60% (7745/12907) Updating files: 60% (7810/12907) Updating files: 61% (7874/12907) Updating files: 61% (7980/12907) Updating files: 62% (8003/12907) Updating files: 62% (8012/12907) Updating files: 62% (8027/12907) Updating files: 62% (8114/12907) Updating files: 63% (8132/12907) Updating files: 63% (8150/12907) Updating files: 63% (8181/12907) Updating files: 63% (8217/12907) Updating files: 63% (8226/12907) Updating files: 63% (8256/12907) Updating files: 64% (8261/12907) Updating files: 64% (8288/12907) Updating files: 64% (8296/12907) Updating files: 64% (8318/12907) Updating files: 64% (8361/12907) Updating files: 64% (8366/12907) Updating files: 64% (8384/12907) Updating files: 65% (8390/12907) Updating files: 65% (8409/12907) Updating files: 65% (8464/12907) Updating files: 65% (8472/12907) Updating files: 65% (8492/12907) Updating files: 66% (8519/12907) Updating files: 66% (8544/12907) Updating files: 66% (8546/12907) Updating files: 66% (8582/12907) Updating files: 66% (8642/12907) Updating files: 67% (8648/12907) Updating files: 67% (8757/12907) Updating files: 68% (8777/12907) Updating files: 68% (8804/12907) Updating files: 68% (8823/12907) Updating files: 68% (8851/12907) Updating files: 68% (8855/12907) Updating files: 68% (8878/12907) Updating files: 68% (8899/12907) Updating files: 68% (8902/12907) Updating files: 69% (8906/12907) Updating files: 69% (8944/12907) Updating files: 69% (8977/12907) Updating files: 69% (8987/12907) Updating files: 69% (9005/12907) Updating files: 69% (9009/12907) Updating files: 69% (9031/12907) Updating files: 70% (9035/12907) Updating files: 70% (9083/12907) Updating files: 70% (9155/12907) Updating files: 71% (9164/12907) Updating files: 71% (9227/12907) Updating files: 71% (9266/12907) Updating files: 72% (9294/12907) Updating files: 72% (9300/12907) Updating files: 72% (9331/12907) Updating files: 73% (9423/12907) Updating files: 73% (9486/12907) Updating files: 73% (9487/12907) Updating files: 73% (9494/12907) Updating files: 74% (9552/12907) Updating files: 74% (9561/12907) Updating files: 74% (9594/12907) Updating files: 75% (9681/12907) Updating files: 75% (9715/12907) Updating files: 76% (9810/12907) Updating files: 76% (9905/12907) Updating files: 77% (9939/12907) Updating files: 77% (10043/12907) Updating files: 78% (10068/12907) Updating files: 78% (10075/12907) Updating files: 79% (10197/12907) Updating files: 79% (10301/12907) Updating files: 80% (10326/12907) Updating files: 80% (10449/12907) Updating files: 81% (10455/12907) Updating files: 81% (10503/12907) Updating files: 82% (10584/12907) Updating files: 82% (10601/12907) Updating files: 83% (10713/12907) Updating files: 83% (10767/12907) Updating files: 83% (10830/12907) Updating files: 84% (10842/12907) Updating files: 84% (10906/12907) Updating files: 85% (10971/12907) Updating files: 85% (10973/12907) Updating files: 85% (11003/12907) Updating files: 86% (11101/12907) Updating files: 86% (11146/12907) Updating files: 86% (11165/12907) Updating files: 86% (11222/12907) Updating files: 87% (11230/12907) Updating files: 87% (11279/12907) Updating files: 87% (11308/12907) Updating files: 88% (11359/12907) Updating files: 88% (11404/12907) Updating files: 88% (11480/12907) Updating files: 89% (11488/12907) Updating files: 89% (11605/12907) Updating files: 90% (11617/12907) Updating files: 90% (11695/12907) Updating files: 90% (11736/12907) Updating files: 91% (11746/12907) Updating files: 91% (11822/12907) Updating files: 91% (11829/12907) Updating files: 91% (11862/12907) Updating files: 92% (11875/12907) Updating files: 92% (11919/12907) Updating files: 93% (12004/12907) Updating files: 94% (12133/12907) Updating files: 94% (12252/12907) Updating files: 94% (12260/12907) Updating files: 95% (12262/12907) Updating files: 96% (12391/12907) Updating files: 96% (12477/12907) Updating files: 97% (12520/12907) Updating files: 97% (12575/12907) Updating files: 97% (12588/12907) Updating files: 98% (12649/12907) Updating files: 98% (12674/12907) Updating files: 98% (12747/12907) Updating files: 98% (12771/12907) Updating files: 99% (12778/12907) Updating files: 99% (12832/12907) Updating files: 99% (12893/12907) Updating files: 100% (12907/12907) Updating files: 100% (12907/12907), done. 2023-11-28T20:52:18.154 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 204c175eea3 msg: blobhash on entity_name_t causes strange badness... should look into that, but avoid for now 2023-11-28T20:52:18.163 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.1 2023-11-28T20:52:18.225 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 2 -eq 48 ] 2023-11-28T20:52:18.225 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.2 2023-11-28T20:52:18.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.2 2023-11-28T20:52:18.226 INFO:tasks.workunit.client.0.smithi167.stdout:v0.2 2023-11-28T20:52:18.227 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.2 2023-11-28T20:52:20.419 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:20.424 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:22.998 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 33% (75/222) Updating files: 34% (76/222) Updating files: 35% (78/222) Updating files: 36% (80/222) Updating files: 37% (83/222) Updating files: 38% (85/222) Updating files: 39% (87/222) Updating files: 40% (89/222) Updating files: 41% (92/222) Updating files: 42% (94/222) Updating files: 43% (96/222) Updating files: 44% (98/222) Updating files: 45% (100/222) Updating files: 46% (103/222) Updating files: 46% (104/222) Updating files: 47% (105/222) Updating files: 48% (107/222) Updating files: 49% (109/222) Updating files: 50% (111/222) Updating files: 51% (114/222) Updating files: 52% (116/222) Updating files: 53% (118/222) Updating files: 54% (120/222) Updating files: 55% (123/222) Updating files: 56% (125/222) Updating files: 57% (127/222) Updating files: 58% (129/222) Updating files: 59% (131/222) Updating files: 60% (134/222) Updating files: 61% (136/222) Updating files: 62% (138/222) Updating files: 63% (140/222) Updating files: 64% (143/222) Updating files: 65% (145/222) Updating files: 66% (147/222) Updating files: 67% (149/222) Updating files: 68% (151/222) Updating files: 69% (154/222) Updating files: 70% (156/222) Updating files: 71% (158/222) Updating files: 72% (160/222) Updating files: 73% (163/222) Updating files: 74% (165/222) Updating files: 75% (167/222) Updating files: 76% (169/222) Updating files: 77% (171/222) Updating files: 78% (174/222) Updating files: 79% (176/222) Updating files: 80% (178/222) Updating files: 81% (180/222) Updating files: 82% (183/222) Updating files: 83% (185/222) Updating files: 84% (187/222) Updating files: 85% (189/222) Updating files: 86% (191/222) Updating files: 87% (194/222) Updating files: 88% (196/222) Updating files: 89% (198/222) Updating files: 90% (200/222) Updating files: 91% (203/222) Updating files: 92% (205/222) Updating files: 93% (207/222) Updating files: 94% (209/222) Updating files: 95% (211/222) Updating files: 96% (214/222) Updating files: 97% (216/222) Updating files: 98% (218/222) Updating files: 99% (220/222) Updating files: 100% (222/222) Updating files: 100% (222/222), done. 2023-11-28T20:52:23.029 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:52:23.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:52:23.039 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 2b5f76f48e9 readme 2023-11-28T20:52:23.051 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.2 2023-11-28T20:52:23.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb61d96640 1 Processor -- start 2023-11-28T20:52:23.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb61d96640 1 -- start start 2023-11-28T20:52:23.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb61d96640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb5c150b40 0x7fcb5c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb61d96640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcb5c0c6ff0 0x7fcb5c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb61d96640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5c0c6ac0 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb61d96640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5c0c6500 con 0x7fcb5c0c6ff0 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb61d96640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0c67e0 con 0x7fcb5c150b40 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb53fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcb5c0c6ff0 0x7fcb5c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb53fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcb5c0c6ff0 0x7fcb5c0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57874/0 (socket says 172.21.15.167:57874) 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb53fff640 1 -- 172.21.15.167:0/3626318338 learned_addr learned my addr 172.21.15.167:0/3626318338 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb5b7fe640 1 --2- 172.21.15.167:0/3626318338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb5c150b40 0x7fcb5c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb53fff640 1 -- 172.21.15.167:0/3626318338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb5c150b40 msgr2=0x7fcb5c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb53fff640 1 --2- 172.21.15.167:0/3626318338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb5c150b40 0x7fcb5c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb53fff640 1 -- 172.21.15.167:0/3626318338 >> v1:172.21.15.178:6789/0 conn(0x7fcb5c0c5be0 legacy=0x7fcb5c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.188+0000 7fcb53fff640 1 -- 172.21.15.167:0/3626318338 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c156a80 con 0x7fcb5c0c6ff0 2023-11-28T20:52:23.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb53fff640 1 --2- 172.21.15.167:0/3626318338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c6ff0 0x7fcb5c0c4510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009870 tx=0x7fcb4401e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943a1ff09727b09b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb5affd640 1 -- 172.21.15.167:0/3626318338 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb440aa650 con 0x7fcb5c0c6ff0 2023-11-28T20:52:23.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb5affd640 1 -- 172.21.15.167:0/3626318338 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb440aa7b0 con 0x7fcb5c0c6ff0 2023-11-28T20:52:23.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb5affd640 1 -- 172.21.15.167:0/3626318338 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb440aab40 con 0x7fcb5c0c6ff0 2023-11-28T20:52:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb61d96640 1 -- 172.21.15.167:0/3626318338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c6ff0 msgr2=0x7fcb5c0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb61d96640 1 --2- 172.21.15.167:0/3626318338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c6ff0 0x7fcb5c0c4510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009870 tx=0x7fcb4401e720 comp rx=0 tx=0).stop 2023-11-28T20:52:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb61d96640 1 -- 172.21.15.167:0/3626318338 shutdown_connections 2023-11-28T20:52:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb61d96640 1 --2- 172.21.15.167:0/3626318338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c6ff0 0x7fcb5c0c4510 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb61d96640 1 --2- 172.21.15.167:0/3626318338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb5c150b40 0x7fcb5c157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb61d96640 1 -- 172.21.15.167:0/3626318338 >> 172.21.15.167:0/3626318338 conn(0x7fcb5c0cb1e0 msgr2=0x7fcb5c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb61d96640 1 -- 172.21.15.167:0/3626318338 shutdown_connections 2023-11-28T20:52:23.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.192+0000 7fcb61d96640 1 -- 172.21.15.167:0/3626318338 wait complete. 2023-11-28T20:52:23.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb61d96640 1 Processor -- start 2023-11-28T20:52:23.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb61d96640 1 -- start start 2023-11-28T20:52:23.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb61d96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c5be0 0x7fcb5c15f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb61d96640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb5c0c6ff0 0x7fcb5c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb61d96640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb5c150b40 0x7fcb5c140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb61d96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c13f090 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb61d96640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0ca5c0 con 0x7fcb5c0c6ff0 2023-11-28T20:52:23.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb61d96640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0ca2c0 con 0x7fcb5c150b40 2023-11-28T20:52:23.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb5b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c5be0 0x7fcb5c15f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb5b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c5be0 0x7fcb5c15f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57890/0 (socket says 172.21.15.167:57890) 2023-11-28T20:52:23.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb5b7fe640 1 -- 172.21.15.167:0/1979637082 learned_addr learned my addr 172.21.15.167:0/1979637082 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:23.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb53fff640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb5c0c6ff0 0x7fcb5c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb5b7fe640 1 -- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb5c150b40 msgr2=0x7fcb5c140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb5b7fe640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb5c150b40 0x7fcb5c140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb5b7fe640 1 -- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb5c0c6ff0 msgr2=0x7fcb5c0caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb5b7fe640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb5c0c6ff0 0x7fcb5c0caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb5b7fe640 1 -- 172.21.15.167:0/1979637082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb440094d0 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb5b7fe640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c5be0 0x7fcb5c15f8d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00e960 tx=0x7fcb4c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.200 INFO:tasks.workunit.client.0.smithi167.stdout:v0.3 2023-11-28T20:52:23.201 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 3 -eq 48 ] 2023-11-28T20:52:23.201 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.3 2023-11-28T20:52:23.201 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.3 2023-11-28T20:52:23.201 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.3 2023-11-28T20:52:23.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb58ff9640 1 -- 172.21.15.167:0/1979637082 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c009690 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb58ff9640 1 -- 172.21.15.167:0/1979637082 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00ca00 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.196+0000 7fcb58ff9640 1 -- 172.21.15.167:0/1979637082 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00cd70 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.200+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c13da50 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.200+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c14c7c0 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.200+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb40005260 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.200+0000 7fcb58ff9640 1 -- 172.21.15.167:0/1979637082 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb4c013470 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.204+0000 7fcb58ff9640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb3c066470 0x7fcb3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.204+0000 7fcb58ff9640 1 -- 172.21.15.167:0/1979637082 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fcb4c084730 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.208+0000 7fcb53fff640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb3c066470 0x7fcb3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.212+0000 7fcb53fff640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb3c066470 0x7fcb3c068930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcb440b1000 tx=0x7fcb44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.212+0000 7fcb58ff9640 1 -- 172.21.15.167:0/1979637082 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb4c051910 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcb40005a90 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb58ff9640 1 -- 172.21.15.167:0/1979637082 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fcb4c054f30 con 0x7fcb5c0c5be0 2023-11-28T20:52:23.425 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:52:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb3c066470 msgr2=0x7fcb3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb3c066470 0x7fcb3c068930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcb440b1000 tx=0x7fcb44009040 comp rx=0 tx=0).stop 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c5be0 msgr2=0x7fcb5c15f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c5be0 0x7fcb5c15f8d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00e960 tx=0x7fcb4c00ee20 comp rx=0 tx=0).stop 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 shutdown_connections 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fcb3c066470 0x7fcb3c068930 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb5c150b40 0x7fcb5c140070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb5c0c6ff0 0x7fcb5c0caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 --2- 172.21.15.167:0/1979637082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb5c0c5be0 0x7fcb5c15f8d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 >> 172.21.15.167:0/1979637082 conn(0x7fcb5c0cb1e0 msgr2=0x7fcb5c148940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 shutdown_connections 2023-11-28T20:52:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.424+0000 7fcb61d96640 1 -- 172.21.15.167:0/1979637082 wait complete. 2023-11-28T20:52:23.446 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:52:23.446 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:52:23.446 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:52:23.446 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:52:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.624+0000 7ff214e3a640 1 Processor -- start 2023-11-28T20:52:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.624+0000 7ff214e3a640 1 -- start start 2023-11-28T20:52:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff214e3a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff210150f30 0x7ff210070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff214e3a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21006b2a0 0x7ff2100c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff214e3a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210156b10 con 0x7ff2100c4b60 2023-11-28T20:52:23.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff214e3a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100c3a80 con 0x7ff210150f30 2023-11-28T20:52:23.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff214e3a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100c2cc0 con 0x7ff21006b2a0 2023-11-28T20:52:23.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff2100c4b60 0x7ff210159f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48884/0 (socket says 172.21.15.167:48884) 2023-11-28T20:52:23.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20ffff640 1 -- 172.21.15.167:0/1035059050 learned_addr learned my addr 172.21.15.167:0/1035059050 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:52:23.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20f7fe640 1 --2- 172.21.15.167:0/1035059050 >> v2:172.21.15.178:3300/0 conn(0x7ff210150f30 0x7ff210070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20effd640 1 --2- 172.21.15.167:0/1035059050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21006b2a0 0x7ff2100c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20e7fc640 1 -- 172.21.15.167:0/1035059050 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247167133 0 0) 0x7ff210156b10 con 0x7ff2100c4b60 2023-11-28T20:52:23.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20e7fc640 1 -- 172.21.15.167:0/1035059050 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f8005740 con 0x7ff2100c4b60 2023-11-28T20:52:23.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20effd640 1 -- 172.21.15.167:0/1035059050 >> v2:172.21.15.178:3300/0 conn(0x7ff210150f30 msgr2=0x7ff210070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:23.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20effd640 1 --2- 172.21.15.167:0/1035059050 >> v2:172.21.15.178:3300/0 conn(0x7ff210150f30 0x7ff210070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20effd640 1 -- 172.21.15.167:0/1035059050 >> v1:172.21.15.167:6789/0 conn(0x7ff2100c4b60 legacy=0x7ff210159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20effd640 1 -- 172.21.15.167:0/1035059050 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210156db0 con 0x7ff21006b2a0 2023-11-28T20:52:23.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.628+0000 7ff20f7fe640 1 --2- 172.21.15.167:0/1035059050 >> v2:172.21.15.178:3300/0 conn(0x7ff210150f30 0x7ff210070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:52:23.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff20effd640 1 --2- 172.21.15.167:0/1035059050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21006b2a0 0x7ff2100c4620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097c0 tx=0x7ff20401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=783b71742c3f2cc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff20e7fc640 1 -- 172.21.15.167:0/1035059050 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040ac600 con 0x7ff21006b2a0 2023-11-28T20:52:23.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff20e7fc640 1 -- 172.21.15.167:0/1035059050 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2040a8050 con 0x7ff21006b2a0 2023-11-28T20:52:23.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff20e7fc640 1 -- 172.21.15.167:0/1035059050 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040ac960 con 0x7ff21006b2a0 2023-11-28T20:52:23.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 -- 172.21.15.167:0/1035059050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21006b2a0 msgr2=0x7ff2100c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 --2- 172.21.15.167:0/1035059050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21006b2a0 0x7ff2100c4620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097c0 tx=0x7ff20401c480 comp rx=0 tx=0).stop 2023-11-28T20:52:23.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 -- 172.21.15.167:0/1035059050 shutdown_connections 2023-11-28T20:52:23.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 --2- 172.21.15.167:0/1035059050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21006b2a0 0x7ff2100c4620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 --2- 172.21.15.167:0/1035059050 >> v2:172.21.15.178:3300/0 conn(0x7ff210150f30 0x7ff210070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 -- 172.21.15.167:0/1035059050 >> 172.21.15.167:0/1035059050 conn(0x7ff2100cb3f0 msgr2=0x7ff2100cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:23.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 -- 172.21.15.167:0/1035059050 shutdown_connections 2023-11-28T20:52:23.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 -- 172.21.15.167:0/1035059050 wait complete. 2023-11-28T20:52:23.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 Processor -- start 2023-11-28T20:52:23.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.632+0000 7ff214e3a640 1 -- start start 2023-11-28T20:52:23.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff21006b2a0 0x7ff210159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c4b60 0x7ff2101f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210150f30 0x7ff2101559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2101f2920 con 0x7ff21006b2a0 2023-11-28T20:52:23.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210154060 con 0x7ff210150f30 2023-11-28T20:52:23.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff210154340 con 0x7ff2100c4b60 2023-11-28T20:52:23.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff21006b2a0 0x7ff210159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff21006b2a0 0x7ff210159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57892/0 (socket says 172.21.15.167:57892) 2023-11-28T20:52:23.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20f7fe640 1 -- 172.21.15.167:0/3076276928 learned_addr learned my addr 172.21.15.167:0/3076276928 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:23.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20ffff640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210150f30 0x7ff2101559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20effd640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c4b60 0x7ff2101f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20f7fe640 1 -- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c4b60 msgr2=0x7ff2101f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20f7fe640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c4b60 0x7ff2101f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20f7fe640 1 -- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210150f30 msgr2=0x7ff2101559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20f7fe640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210150f30 0x7ff2101559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20f7fe640 1 -- 172.21.15.167:0/3076276928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200009420 con 0x7ff21006b2a0 2023-11-28T20:52:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20ffff640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210150f30 0x7ff2101559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:52:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20f7fe640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff21006b2a0 0x7ff210159db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff20000e980 tx=0x7ff20000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20000ca00 con 0x7ff21006b2a0 2023-11-28T20:52:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20000cb60 con 0x7ff21006b2a0 2023-11-28T20:52:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200013470 con 0x7ff21006b2a0 2023-11-28T20:52:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff204009420 con 0x7ff21006b2a0 2023-11-28T20:52:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2101f2ec0 con 0x7ff21006b2a0 2023-11-28T20:52:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2101f30b0 0x7ff210151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210074740 con 0x7ff2101f30b0 2023-11-28T20:52:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20effd640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2101f30b0 0x7ff210151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20effd640 1 -- 172.21.15.167:0/3076276928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2100c3880 con 0x7ff2101f30b0 2023-11-28T20:52:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.636+0000 7ff20effd640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2101f30b0 0x7ff210151b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2100c9280 tx=0x7ff204019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040acdd0 con 0x7ff2101f30b0 2023-11-28T20:52:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2000135d0 con 0x7ff21006b2a0 2023-11-28T20:52:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff1f7fff640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1fc066540 0x7ff1fc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff200084620 con 0x7ff21006b2a0 2023-11-28T20:52:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff2040b7480 con 0x7ff2101f30b0 2023-11-28T20:52:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2101f30b0 msgr2=0x7ff210151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff1f7fff640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2101f30b0 0x7ff210151b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2100c9280 tx=0x7ff204019220 comp rx=0 tx=0).stop 2023-11-28T20:52:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2101f30b0 msgr2=0x7ff210151b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff1f7fff640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2101f30b0 0x7ff210151b60 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2100c9280 tx=0x7ff204019220 comp rx=0 tx=0).stop 2023-11-28T20:52:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff20ffff640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1fc066540 0x7ff1fc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.640+0000 7ff20ffff640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1fc066540 0x7ff1fc068a00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff208001570 tx=0x7ff208009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.644+0000 7ff214e3a640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff210156730 0x7ff2101520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.644+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100c28f0 con 0x7ff210156730 2023-11-28T20:52:23.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.644+0000 7ff20effd640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff210156730 0x7ff2101520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.644+0000 7ff20effd640 1 -- 172.21.15.167:0/3076276928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff2101f2a60 con 0x7ff210156730 2023-11-28T20:52:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff20effd640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff210156730 0x7ff2101520a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097c0 tx=0x7ff204009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204003dc0 con 0x7ff210156730 2023-11-28T20:52:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4813 (secure 0 0 0) 0x7ff2040c3850 con 0x7ff210156730 2023-11-28T20:52:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff210156730 msgr2=0x7ff2101520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff1f7fff640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff210156730 0x7ff2101520a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097c0 tx=0x7ff204009190 comp rx=0 tx=0).stop 2023-11-28T20:52:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff1f7fff640 1 -- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff210156730 msgr2=0x7ff2101520a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff1f7fff640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff210156730 0x7ff2101520a0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097c0 tx=0x7ff204009190 comp rx=0 tx=0).stop 2023-11-28T20:52:23.652 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:52:23.652 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:23.653 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:23.653 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:52:23.653 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 114, 2023-11-28T20:52:23.653 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:52:23.653 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:52:23.653 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:52:23.653 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:52:23.654 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.654 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:52:23.654 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:23.654 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:52:23.654 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:52:23.654 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:23.655 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:23.655 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:23.655 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:23.655 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:23.655 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:23.655 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:23.655 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:23.656 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:23.656 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:23.656 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.656 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:52:23.656 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:52:23.656 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:23.657 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:23.657 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:23.657 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:23.657 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:23.657 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:23.657 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:23.657 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:23.658 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:23.658 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:23.658 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.658 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:52:23.658 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:52:23.658 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:52:23.659 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:52:23.659 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:52:23.659 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:52:23.659 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:23.659 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:23.659 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:52:23.659 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:52:23.660 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:52:23.660 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:52:23.660 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:52:23.660 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:52:23.660 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:52:23.660 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:23.660 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:52:23.661 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:23.661 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:23.661 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:23.661 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:23.661 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:23.661 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:23.661 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:23.661 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:23.662 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:23.662 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:23.662 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.662 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:52:23.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.662 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:52:23.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.662 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.663 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.664 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:23.665 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:23.665 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:23.665 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:23.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.665 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:23.665 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:52:23.666 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.666 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:23.666 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:52:23.667 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.667 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.667 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.667 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:52:23.668 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:52:23.668 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:23.668 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:23.668 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:23.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.669 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:23.669 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:23.669 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:23.669 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:23.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:52:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:52:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.671 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:52:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:52:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:23.672 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:52:23.673 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:52:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:23.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:52:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:23.675 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:52:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:52:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:23.676 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:52:23.677 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:52:23.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1fc066540 msgr2=0x7ff1fc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff214e3a640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1fc066540 0x7ff1fc068a00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff208001570 tx=0x7ff208009040 comp rx=0 tx=0).stop 2023-11-28T20:52:23.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff21006b2a0 msgr2=0x7ff210159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff214e3a640 1 --2- 172.21.15.167:0/3076276928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff21006b2a0 0x7ff210159db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff20000e980 tx=0x7ff20000ee40 comp rx=0 tx=0).stop 2023-11-28T20:52:23.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff20ffff640 1 -- 172.21.15.167:0/3076276928 reap_dead start 2023-11-28T20:52:23.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff20ffff640 1 -- 172.21.15.167:0/3076276928 reap_dead start 2023-11-28T20:52:23.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 shutdown_connections 2023-11-28T20:52:23.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 >> 172.21.15.167:0/3076276928 conn(0x7ff2100cb3f0 msgr2=0x7ff21006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:23.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 shutdown_connections 2023-11-28T20:52:23.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.648+0000 7ff214e3a640 1 -- 172.21.15.167:0/3076276928 wait complete. 2023-11-28T20:52:23.680 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:52:23.680 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:52:23.680 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:52:23.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8ae1be6640 1 Processor -- start 2023-11-28T20:52:23.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8ae1be6640 1 -- start start 2023-11-28T20:52:23.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8ae1be6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 0x7f8adc157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8ae1be6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8adc0c4510 0x7f8adc06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8ae1be6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8adc0c4940 con 0x7f8adc150b40 2023-11-28T20:52:23.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8ae1be6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8adc0c62f0 con 0x7f8adc0c4510 2023-11-28T20:52:23.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8ae1be6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc0c6ac0 con 0x7f8adc0c6ff0 2023-11-28T20:52:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8adaffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 0x7f8adc157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8adbfff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8adc0c4510 0x7f8adc06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8adbfff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8adc0c4510 0x7f8adc06a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:50008/0 (socket says 172.21.15.167:50008) 2023-11-28T20:52:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8adbfff640 1 -- 172.21.15.167:0/1051130906 learned_addr learned my addr 172.21.15.167:0/1051130906 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8adaffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 0x7f8adc157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33542/0 (socket says 172.21.15.167:33542) 2023-11-28T20:52:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8adaffd640 1 -- 172.21.15.167:0/1051130906 >> v2:172.21.15.178:3300/0 conn(0x7f8adc0c4510 msgr2=0x7f8adc06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8adaffd640 1 --2- 172.21.15.167:0/1051130906 >> v2:172.21.15.178:3300/0 conn(0x7f8adc0c4510 0x7f8adc06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8adaffd640 1 -- 172.21.15.167:0/1051130906 >> v1:172.21.15.178:6789/0 conn(0x7f8adc150b40 legacy=0x7f8adc0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.824+0000 7f8adaffd640 1 -- 172.21.15.167:0/1051130906 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc0c6500 con 0x7f8adc0c6ff0 2023-11-28T20:52:23.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8adaffd640 1 --2- 172.21.15.167:0/1051130906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 0x7f8adc157560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097c0 tx=0x7f8ad001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bd879a752d64c52 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ada7fc640 1 -- 172.21.15.167:0/1051130906 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00ab600 con 0x7f8adc0c6ff0 2023-11-28T20:52:23.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ada7fc640 1 -- 172.21.15.167:0/1051130906 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad00a7050 con 0x7f8adc0c6ff0 2023-11-28T20:52:23.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ada7fc640 1 -- 172.21.15.167:0/1051130906 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00ab980 con 0x7f8adc0c6ff0 2023-11-28T20:52:23.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ae1be6640 1 -- 172.21.15.167:0/1051130906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 msgr2=0x7f8adc157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ae1be6640 1 --2- 172.21.15.167:0/1051130906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 0x7f8adc157560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097c0 tx=0x7f8ad001c450 comp rx=0 tx=0).stop 2023-11-28T20:52:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ae1be6640 1 -- 172.21.15.167:0/1051130906 shutdown_connections 2023-11-28T20:52:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ae1be6640 1 --2- 172.21.15.167:0/1051130906 >> v2:172.21.15.178:3300/0 conn(0x7f8adc0c4510 0x7f8adc06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ae1be6640 1 --2- 172.21.15.167:0/1051130906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 0x7f8adc157560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ae1be6640 1 -- 172.21.15.167:0/1051130906 >> 172.21.15.167:0/1051130906 conn(0x7f8adc0cb1e0 msgr2=0x7f8adc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.828+0000 7f8ae1be6640 1 -- 172.21.15.167:0/1051130906 shutdown_connections 2023-11-28T20:52:23.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8ae1be6640 1 -- 172.21.15.167:0/1051130906 wait complete. 2023-11-28T20:52:23.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8ae1be6640 1 Processor -- start 2023-11-28T20:52:23.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8ae1be6640 1 -- start start 2023-11-28T20:52:23.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8ae1be6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8adc0c4510 0x7f8adc148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8ae1be6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 0x7f8adc0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8ae1be6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc150b40 0x7f8adc071730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8ae1be6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc1f6ce0 con 0x7f8adc0c4510 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8ae1be6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc14f1d0 con 0x7f8adc150b40 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8ae1be6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc1f6060 con 0x7f8adc0c6ff0 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8adc0c4510 0x7f8adc148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8adc0c4510 0x7f8adc148df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57906/0 (socket says 172.21.15.167:57906) 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adb7fe640 1 -- 172.21.15.167:0/2880278009 learned_addr learned my addr 172.21.15.167:0/2880278009 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adbfff640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc150b40 0x7f8adc071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adaffd640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 0x7f8adc0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adb7fe640 1 -- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 msgr2=0x7f8adc0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adb7fe640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8adc0c6ff0 0x7f8adc0711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adb7fe640 1 -- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc150b40 msgr2=0x7f8adc071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adb7fe640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc150b40 0x7f8adc071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adb7fe640 1 -- 172.21.15.167:0/2880278009 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0009420 con 0x7f8adc0c4510 2023-11-28T20:52:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.832+0000 7f8adb7fe640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8adc0c4510 0x7f8adc148df0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00c500 tx=0x7f8acc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc005220 con 0x7f8adc0c4510 2023-11-28T20:52:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc005380 con 0x7f8adc0c4510 2023-11-28T20:52:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8adc1f6340 con 0x7f8adc0c4510 2023-11-28T20:52:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc007270 con 0x7f8adc0c4510 2023-11-28T20:52:23.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8adc1f6900 con 0x7f8adc0c4510 2023-11-28T20:52:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ae1be6640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14fc70 0x7f8adc14e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc14f360 con 0x7f8adc14fc70 2023-11-28T20:52:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8adaffd640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14fc70 0x7f8adc14e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8adaffd640 1 -- 172.21.15.167:0/2880278009 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8adc157040 con 0x7f8adc14fc70 2023-11-28T20:52:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8acc0073d0 con 0x7f8adc0c4510 2023-11-28T20:52:23.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8adaffd640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14fc70 0x7f8adc14e590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0cc090 tx=0x7f8ad001ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ac8066470 0x7f8ac8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8acc083a60 con 0x7f8adc0c4510 2023-11-28T20:52:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00b5410 con 0x7f8adc14fc70 2023-11-28T20:52:23.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8adbfff640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ac8066470 0x7f8ac8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8ad00b5570 con 0x7f8adc14fc70 2023-11-28T20:52:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14fc70 msgr2=0x7f8adc14e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14fc70 0x7f8adc14e590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0cc090 tx=0x7f8ad001ac90 comp rx=0 tx=0).stop 2023-11-28T20:52:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14fc70 msgr2=0x7f8adc14e590 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.836+0000 7f8ac3fff640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14fc70 0x7f8adc14e590 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0cc090 tx=0x7f8ad001ac90 comp rx=0 tx=0).stop 2023-11-28T20:52:23.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.840+0000 7f8adbfff640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ac8066470 0x7f8ac8068930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40084b0 tx=0x7f8ad400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8ae1be6640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14ead0 0x7f8adc1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:23.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc074770 con 0x7f8adc14ead0 2023-11-28T20:52:23.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8adaffd640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14ead0 0x7f8adc1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:23.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8adaffd640 1 -- 172.21.15.167:0/2880278009 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8adc0682c0 con 0x7f8adc14ead0 2023-11-28T20:52:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8adaffd640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14ead0 0x7f8adc1585b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ad001ab00 tx=0x7f8ad00191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00c5070 con 0x7f8adc14ead0 2023-11-28T20:52:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7f8ad00b5e70 con 0x7f8adc14ead0 2023-11-28T20:52:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14ead0 msgr2=0x7f8adc1585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8ac3fff640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14ead0 0x7f8adc1585b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ad001ab00 tx=0x7f8ad00191f0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8ac3fff640 1 -- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14ead0 msgr2=0x7f8adc1585b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.844+0000 7f8ac3fff640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8adc14ead0 0x7f8adc1585b0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ad001ab00 tx=0x7f8ad00191f0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.849 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:52:23.849 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:23.849 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:23.849 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:52:23.849 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 114, 2023-11-28T20:52:23.849 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:52:23.849 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:23.850 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:23.851 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:23.851 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:23.851 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:23.851 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:23.851 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:23.851 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:23.851 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:23.851 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.852 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:52:23.852 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:52:23.852 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:23.852 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:23.852 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:23.852 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:23.852 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:23.852 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:23.852 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:23.853 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:23.853 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:23.853 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:23.853 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.853 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.853 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:52:23.853 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:52:23.853 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:52:23.853 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:52:23.854 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:52:23.854 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:52:23.854 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:23.854 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:23.854 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:52:23.854 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:52:23.854 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:23.855 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:23.856 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:23.856 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:23.856 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:23.856 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:23.856 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.856 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:52:23.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.857 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:52:23.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.857 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:23.857 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:23.857 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:23.857 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:23.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.858 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.860 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:52:23.860 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:52:23.860 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:23.860 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:52:23.861 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.862 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.862 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.862 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:23.862 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:52:23.862 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.863 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.863 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.863 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.863 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:52:23.863 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:52:23.863 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:23.864 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:23.864 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:23.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.865 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:23.865 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:23.865 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:23.865 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:23.866 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.866 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:23.866 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:52:23.866 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:52:23.867 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.868 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:52:23.869 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:52:23.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ac8066470 msgr2=0x7f8ac8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8ae1be6640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ac8066470 0x7f8ac8068930 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40084b0 tx=0x7f8ad400d040 comp rx=0 tx=0).stop 2023-11-28T20:52:23.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8adc0c4510 msgr2=0x7f8adc148df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:23.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8ae1be6640 1 --2- 172.21.15.167:0/2880278009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8adc0c4510 0x7f8adc148df0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00c500 tx=0x7f8acc00c9c0 comp rx=0 tx=0).stop 2023-11-28T20:52:23.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8adbfff640 1 -- 172.21.15.167:0/2880278009 reap_dead start 2023-11-28T20:52:23.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8adbfff640 1 -- 172.21.15.167:0/2880278009 reap_dead start 2023-11-28T20:52:23.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 shutdown_connections 2023-11-28T20:52:23.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 >> 172.21.15.167:0/2880278009 conn(0x7f8adc0cb1e0 msgr2=0x7f8adc0705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:23.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 shutdown_connections 2023-11-28T20:52:23.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:23.848+0000 7f8ae1be6640 1 -- 172.21.15.167:0/2880278009 wait complete. 2023-11-28T20:52:23.872 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:52:23.872 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:52:23.873 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:52:24.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.012+0000 7f897dbdf640 1 Processor -- start 2023-11-28T20:52:24.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.012+0000 7f897dbdf640 1 -- start start 2023-11-28T20:52:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.012+0000 7f897dbdf640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8978070480 0x7f8978071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.012+0000 7f897dbdf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89781571d0 con 0x7f897806e030 2023-11-28T20:52:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.012+0000 7f897dbdf640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8978071a90 con 0x7f897806e410 2023-11-28T20:52:24.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.012+0000 7f897dbdf640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780c70d0 con 0x7f8978070480 2023-11-28T20:52:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.012+0000 7f89777fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f897806e030 0x7f89781500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48898/0 (socket says 172.21.15.167:48898) 2023-11-28T20:52:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.012+0000 7f89777fe640 1 -- 172.21.15.167:0/2268486746 learned_addr learned my addr 172.21.15.167:0/2268486746 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:52:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f8976ffd640 1 --2- 172.21.15.167:0/2268486746 >> v2:172.21.15.178:3300/0 conn(0x7f8978070480 0x7f8978071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789359136 0 0) 0x7f89781571d0 con 0x7f897806e030 2023-11-28T20:52:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8960003530 con 0x7f897806e030 2023-11-28T20:52:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1768352078 0 0) 0x7f8960003530 con 0x7f897806e030 2023-11-28T20:52:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 >> v2:172.21.15.178:3300/0 conn(0x7f8978070480 msgr2=0x7f8978071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 --2- 172.21.15.167:0/2268486746 >> v2:172.21.15.178:3300/0 conn(0x7f8978070480 0x7f8978071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 >> v1:172.21.15.178:6789/0 conn(0x7f897806e410 legacy=0x7f8978160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780c73b0 con 0x7f897806e030 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f8968001680 con 0x7f897806e030 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 >> v1:172.21.15.167:6789/0 conn(0x7f897806e030 legacy=0x7f89781500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8960003980 0x7f8960003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89600047d0 0x7f8960004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8960005190 0x7f896000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89780c70d0 con 0x7f89600047d0 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896000e240 con 0x7f8960005190 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896000e400 con 0x7f8960003980 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f8976ffd640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89600047d0 0x7f8960004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f8977fff640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8960005190 0x7f896000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f89777fe640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8960003980 0x7f8960003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f8976ffd640 1 -- 172.21.15.167:0/2268486746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8960003980 msgr2=0x7f8960003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f8976ffd640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8960003980 0x7f8960003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f8976ffd640 1 -- 172.21.15.167:0/2268486746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8960005190 msgr2=0x7f896000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f8976ffd640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8960005190 0x7f896000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f8976ffd640 1 -- 172.21.15.167:0/2268486746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960003530 con 0x7f89600047d0 2023-11-28T20:52:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.016+0000 7f8977fff640 1 -- 172.21.15.167:0/2268486746 reap_dead start 2023-11-28T20:52:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f8976ffd640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89600047d0 0x7f8960004c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f896c009ab0 tx=0x7f896c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b7c9b9735ae61c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0a5510 con 0x7f89600047d0 2023-11-28T20:52:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c0a5670 con 0x7f89600047d0 2023-11-28T20:52:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f89767fc640 1 -- 172.21.15.167:0/2268486746 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0a5a20 con 0x7f89600047d0 2023-11-28T20:52:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f897dbdf640 1 -- 172.21.15.167:0/2268486746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89600047d0 msgr2=0x7f8960004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f897dbdf640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89600047d0 0x7f8960004c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f896c009ab0 tx=0x7f896c01ca30 comp rx=0 tx=0).stop 2023-11-28T20:52:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f897dbdf640 1 -- 172.21.15.167:0/2268486746 shutdown_connections 2023-11-28T20:52:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f897dbdf640 1 --2- 172.21.15.167:0/2268486746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89600047d0 0x7f8960004c50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f897dbdf640 1 -- 172.21.15.167:0/2268486746 >> 172.21.15.167:0/2268486746 conn(0x7f89780cb1e0 msgr2=0x7f89780cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f897dbdf640 1 -- 172.21.15.167:0/2268486746 shutdown_connections 2023-11-28T20:52:24.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f897dbdf640 1 -- 172.21.15.167:0/2268486746 wait complete. 2023-11-28T20:52:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f897dbdf640 1 Processor -- start 2023-11-28T20:52:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.020+0000 7f897dbdf640 1 -- start start 2023-11-28T20:52:24.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89600047d0 0x7f89781eee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89781555f0 0x7f89780c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978153150 0x7f8978145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897814ddf0 con 0x7f89781555f0 2023-11-28T20:52:24.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89781ef370 con 0x7f89600047d0 2023-11-28T20:52:24.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897814d550 con 0x7f8978153150 2023-11-28T20:52:24.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8976ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89781555f0 0x7f89780c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8976ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89781555f0 0x7f89780c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57930/0 (socket says 172.21.15.167:57930) 2023-11-28T20:52:24.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8976ffd640 1 -- 172.21.15.167:0/673880151 learned_addr learned my addr 172.21.15.167:0/673880151 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f89777fe640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89600047d0 0x7f89781eee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8977fff640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978153150 0x7f8978145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8976ffd640 1 -- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978153150 msgr2=0x7f8978145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8976ffd640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978153150 0x7f8978145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8976ffd640 1 -- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89600047d0 msgr2=0x7f89781eee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8976ffd640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89600047d0 0x7f89781eee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8976ffd640 1 -- 172.21.15.167:0/673880151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897814d830 con 0x7f89781555f0 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f89777fe640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89600047d0 0x7f89781eee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f8976ffd640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89781555f0 0x7f89780c43f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f896c01c860 tx=0x7f896c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:24.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0bd070 con 0x7f89781555f0 2023-11-28T20:52:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c004020 con 0x7f89781555f0 2023-11-28T20:52:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c0043d0 con 0x7f89781555f0 2023-11-28T20:52:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897814db10 con 0x7f89781555f0 2023-11-28T20:52:24.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89781ee910 con 0x7f89781555f0 2023-11-28T20:52:24.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89781eaf20 0x7f897814cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8978074770 con 0x7f89781eaf20 2023-11-28T20:52:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f89777fe640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89781eaf20 0x7f897814cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f896c0b4070 con 0x7f89781555f0 2023-11-28T20:52:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f89777fe640 1 -- 172.21.15.167:0/673880151 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f897806b4b0 con 0x7f89781eaf20 2023-11-28T20:52:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.024+0000 7f89777fe640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89781eaf20 0x7f897814cf50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8978050190 tx=0x7f8968013c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f895ffff640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8964066470 0x7f8964068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f896c11e4f0 con 0x7f89781555f0 2023-11-28T20:52:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8968011b80 con 0x7f89781eaf20 2023-11-28T20:52:24.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f8977fff640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8964066470 0x7f8964068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8968013ed0 con 0x7f89781eaf20 2023-11-28T20:52:24.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89781eaf20 msgr2=0x7f897814cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f895ffff640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89781eaf20 0x7f897814cf50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8978050190 tx=0x7f8968013c80 comp rx=0 tx=0).stop 2023-11-28T20:52:24.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89781eaf20 msgr2=0x7f897814cf50 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:24.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f895ffff640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89781eaf20 0x7f897814cf50 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8978050190 tx=0x7f8968013c80 comp rx=0 tx=0).stop 2023-11-28T20:52:24.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.028+0000 7f8977fff640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8964066470 0x7f8964068930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f89780c7c90 tx=0x7f8970009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:24.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.036+0000 7f897dbdf640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978146000 0x7f89780ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.036+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89781eeb00 con 0x7f8978146000 2023-11-28T20:52:24.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.036+0000 7f89777fe640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978146000 0x7f89780ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.036+0000 7f89777fe640 1 -- 172.21.15.167:0/673880151 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8978146410 con 0x7f8978146000 2023-11-28T20:52:24.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f89777fe640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978146000 0x7f89780ca0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8978050190 tx=0x7f8968001a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8968026070 con 0x7f8978146000 2023-11-28T20:52:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5124 (secure 0 0 0) 0x7f89680212e0 con 0x7f8978146000 2023-11-28T20:52:24.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978146000 msgr2=0x7f89780ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f895ffff640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978146000 0x7f89780ca0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8978050190 tx=0x7f8968001a10 comp rx=0 tx=0).stop 2023-11-28T20:52:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f895ffff640 1 -- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978146000 msgr2=0x7f89780ca0f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:24.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f895ffff640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8978146000 0x7f89780ca0f0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8978050190 tx=0x7f8968001a10 comp rx=0 tx=0).stop 2023-11-28T20:52:24.041 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:52:24.041 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:24.041 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:24.041 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:52:24.042 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 114, 2023-11-28T20:52:24.042 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:52:24.042 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:52:24.042 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:52:24.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:52:24.042 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:24.042 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:52:24.042 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:24.042 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:24.043 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:24.044 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:52:24.045 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:52:24.046 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:52:24.047 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:24.047 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:52:24.047 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:24.047 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:24.047 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:24.047 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:24.048 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:24.048 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:24.048 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:24.048 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:24.048 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:24.048 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:24.049 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.050 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:24.050 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:52:24.050 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:24.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.050 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.050 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:24.050 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:24.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.052 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:24.052 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:24.052 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:24.052 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:24.052 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.052 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:24.053 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:52:24.053 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:24.053 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.053 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.053 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:24.054 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:52:24.054 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:24.054 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:24.054 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:24.054 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.054 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:52:24.054 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:52:24.054 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:24.054 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:52:24.055 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:52:24.056 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:24.057 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:24.058 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:24.058 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:24.058 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:52:24.058 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.059 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:24.059 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:24.059 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:52:24.059 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:24.059 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:24.059 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:52:24.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:24.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:24.061 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:24.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:24.062 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:52:24.062 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:52:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8964066470 msgr2=0x7f8964068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f897dbdf640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8964066470 0x7f8964068930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f89780c7c90 tx=0x7f8970009040 comp rx=0 tx=0).stop 2023-11-28T20:52:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89781555f0 msgr2=0x7f89780c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f897dbdf640 1 --2- 172.21.15.167:0/673880151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89781555f0 0x7f89780c43f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f896c01c860 tx=0x7f896c0197d0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f8977fff640 1 -- 172.21.15.167:0/673880151 reap_dead start 2023-11-28T20:52:24.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f8977fff640 1 -- 172.21.15.167:0/673880151 reap_dead start 2023-11-28T20:52:24.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 shutdown_connections 2023-11-28T20:52:24.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 >> 172.21.15.167:0/673880151 conn(0x7f89780cb1e0 msgr2=0x7f89780cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:24.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 shutdown_connections 2023-11-28T20:52:24.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.040+0000 7f897dbdf640 1 -- 172.21.15.167:0/673880151 wait complete. 2023-11-28T20:52:24.064 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:52:24.064 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2023-11-28T20:52:24.064 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:52:24.065 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2023-11-28T20:52:24.065 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:52:24.065 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T20:52:24.065 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:52:24.083 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T20:52:24.083 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:52:24.083 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:52:24.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.272+0000 7fdb54df8640 1 Processor -- start 2023-11-28T20:52:24.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.272+0000 7fdb54df8640 1 -- start start 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb54df8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb500cf860 0x7fdb500cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb54df8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdb50153ae0 0x7fdb50153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb54df8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5015ac00 con 0x7fdb500cfc40 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb54df8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb500cbd60 con 0x7fdb50153ae0 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb54df8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb50159ff0 con 0x7fdb500cf860 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb4ed9d640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fdb50153ae0 msgr2=0x7fdb50153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb4ed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdb50153ae0 0x7fdb50153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb4e59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb500cf860 0x7fdb500cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb4dd9b640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fdb500cfc40 0x7fdb500ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:52462/0 (socket says 172.21.15.167:52462) 2023-11-28T20:52:24.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb4dd9b640 1 -- 172.21.15.167:0/71470943 learned_addr learned my addr 172.21.15.167:0/71470943 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:52:24.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb4e59c640 1 -- 172.21.15.167:0/71470943 >> v2:172.21.15.167:3300/0 conn(0x7fdb50153ae0 msgr2=0x7fdb50153f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:24.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb4e59c640 1 --2- 172.21.15.167:0/71470943 >> v2:172.21.15.167:3300/0 conn(0x7fdb50153ae0 0x7fdb50153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb4e59c640 1 -- 172.21.15.167:0/71470943 >> v1:172.21.15.178:6789/0 conn(0x7fdb500cfc40 legacy=0x7fdb500ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.276+0000 7fdb4e59c640 1 -- 172.21.15.167:0/71470943 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5015a2d0 con 0x7fdb500cf860 2023-11-28T20:52:24.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb4e59c640 1 --2- 172.21.15.167:0/71470943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 0x7fdb500cb770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb500d03b0 tx=0x7fdb4001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47807675e7c1f00d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:24.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb4d59a640 1 -- 172.21.15.167:0/71470943 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400ab680 con 0x7fdb500cf860 2023-11-28T20:52:24.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb4d59a640 1 -- 172.21.15.167:0/71470943 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400ab7e0 con 0x7fdb500cf860 2023-11-28T20:52:24.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb4d59a640 1 -- 172.21.15.167:0/71470943 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400abb70 con 0x7fdb500cf860 2023-11-28T20:52:24.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb54df8640 1 -- 172.21.15.167:0/71470943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 msgr2=0x7fdb500cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb54df8640 1 --2- 172.21.15.167:0/71470943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 0x7fdb500cb770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb500d03b0 tx=0x7fdb4001c480 comp rx=0 tx=0).stop 2023-11-28T20:52:24.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb54df8640 1 -- 172.21.15.167:0/71470943 shutdown_connections 2023-11-28T20:52:24.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb54df8640 1 --2- 172.21.15.167:0/71470943 >> v2:172.21.15.167:3300/0 conn(0x7fdb50153ae0 0x7fdb50153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb54df8640 1 --2- 172.21.15.167:0/71470943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 0x7fdb500cb770 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb54df8640 1 -- 172.21.15.167:0/71470943 >> 172.21.15.167:0/71470943 conn(0x7fdb5006c1f0 msgr2=0x7fdb50071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:24.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb54df8640 1 -- 172.21.15.167:0/71470943 shutdown_connections 2023-11-28T20:52:24.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.280+0000 7fdb54df8640 1 -- 172.21.15.167:0/71470943 wait complete. 2023-11-28T20:52:24.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb54df8640 1 Processor -- start 2023-11-28T20:52:24.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb54df8640 1 -- start start 2023-11-28T20:52:24.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb54df8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 0x7fdb500c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb54df8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb500cfc40 0x7fdb500ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb54df8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb50153ae0 0x7fdb500ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb54df8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb501474e0 con 0x7fdb50153ae0 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb54df8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb501469d0 con 0x7fdb500cf860 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb54df8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb501478f0 con 0x7fdb500cfc40 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4ed9d640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb50153ae0 msgr2=0x7fdb500ced70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb50153ae0 0x7fdb500ced70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4dd9b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb500cfc40 0x7fdb500ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4dd9b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb500cfc40 0x7fdb500ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33662/0 (socket says 172.21.15.167:33662) 2023-11-28T20:52:24.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4dd9b640 1 -- 172.21.15.167:0/2485696288 learned_addr learned my addr 172.21.15.167:0/2485696288 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:24.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4e59c640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 0x7fdb500c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4dd9b640 1 -- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 msgr2=0x7fdb500c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4dd9b640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 0x7fdb500c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4dd9b640 1 -- 172.21.15.167:0/2485696288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb50153ae0 msgr2=0x7fdb500ced70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:52:24.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4dd9b640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb50153ae0 0x7fdb500ced70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4dd9b640 1 -- 172.21.15.167:0/2485696288 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb40009420 con 0x7fdb500cfc40 2023-11-28T20:52:24.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.284+0000 7fdb4e59c640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 0x7fdb500c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:52:24.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.288+0000 7fdb4dd9b640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb500cfc40 0x7fdb500ce830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c500 tx=0x7fdb4400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:24.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.288+0000 7fdb3effd640 1 -- 172.21.15.167:0/2485696288 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44005cf0 con 0x7fdb500cfc40 2023-11-28T20:52:24.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.288+0000 7fdb3effd640 1 -- 172.21.15.167:0/2485696288 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb44005e50 con 0x7fdb500cfc40 2023-11-28T20:52:24.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.288+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb501594a0 con 0x7fdb500cfc40 2023-11-28T20:52:24.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.288+0000 7fdb3effd640 1 -- 172.21.15.167:0/2485696288 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440072f0 con 0x7fdb500cfc40 2023-11-28T20:52:24.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.288+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb50159760 con 0x7fdb500cfc40 2023-11-28T20:52:24.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.288+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb50067c40 con 0x7fdb500cfc40 2023-11-28T20:52:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.292+0000 7fdb3effd640 1 -- 172.21.15.167:0/2485696288 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb44007450 con 0x7fdb500cfc40 2023-11-28T20:52:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.292+0000 7fdb3effd640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb30066420 0x7fdb300688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.292+0000 7fdb3effd640 1 -- 172.21.15.167:0/2485696288 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fdb44083bd0 con 0x7fdb500cfc40 2023-11-28T20:52:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.292+0000 7fdb4e59c640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb30066420 0x7fdb300688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:24.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.292+0000 7fdb4e59c640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb30066420 0x7fdb300688e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdb400af000 tx=0x7fdb400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:24.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.304+0000 7fdb3effd640 1 -- 172.21.15.167:0/2485696288 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb44050da0 con 0x7fdb500cfc40 2023-11-28T20:52:24.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdb50075c90 con 0x7fdb500cfc40 2023-11-28T20:52:24.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb3effd640 1 -- 172.21.15.167:0/2485696288 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fdb44021630 con 0x7fdb500cfc40 2023-11-28T20:52:24.521 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:52:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb30066420 msgr2=0x7fdb300688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb30066420 0x7fdb300688e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdb400af000 tx=0x7fdb400a7000 comp rx=0 tx=0).stop 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb500cfc40 msgr2=0x7fdb500ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb500cfc40 0x7fdb500ce830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c500 tx=0x7fdb4400c9c0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 shutdown_connections 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdb30066420 0x7fdb300688e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb50153ae0 0x7fdb500ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb500cfc40 0x7fdb500ce830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 --2- 172.21.15.167:0/2485696288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb500cf860 0x7fdb500c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.520+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 >> 172.21.15.167:0/2485696288 conn(0x7fdb5006c1f0 msgr2=0x7fdb50152360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.524+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 shutdown_connections 2023-11-28T20:52:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:24.524+0000 7fdb54df8640 1 -- 172.21.15.167:0/2485696288 wait complete. 2023-11-28T20:52:27.547 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:52:27.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff01038d640 1 Processor -- start 2023-11-28T20:52:27.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff01038d640 1 -- start start 2023-11-28T20:52:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff01038d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cf860 0x7ff0080cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff01038d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0080cfc40 0x7ff0080ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff01038d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00815ac00 con 0x7ff008153ae0 2023-11-28T20:52:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff01038d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0080cbd60 con 0x7ff0080cfc40 2023-11-28T20:52:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff01038d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff008159ff0 con 0x7ff0080cf860 2023-11-28T20:52:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff00d928640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0080cfc40 0x7ff0080ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff00e129640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cf860 0x7ff0080cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff00e92a640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff008153ae0 0x7ff00815d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:52468/0 (socket says 172.21.15.167:52468) 2023-11-28T20:52:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff00e92a640 1 -- 172.21.15.167:0/1184356418 learned_addr learned my addr 172.21.15.167:0/1184356418 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:52:27.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff00d928640 1 -- 172.21.15.167:0/1184356418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cf860 msgr2=0x7ff0080cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:27.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff00d928640 1 --2- 172.21.15.167:0/1184356418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cf860 0x7ff0080cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:27.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff00d928640 1 -- 172.21.15.167:0/1184356418 >> v1:172.21.15.178:6789/0 conn(0x7ff008153ae0 legacy=0x7ff00815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:27.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.684+0000 7ff00d928640 1 -- 172.21.15.167:0/1184356418 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00815a2d0 con 0x7ff0080cfc40 2023-11-28T20:52:27.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff00d928640 1 --2- 172.21.15.167:0/1184356418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0080cfc40 0x7ff0080ca510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feff80097c0 tx=0x7feff801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11825345c04937d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:27.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff00d127640 1 -- 172.21.15.167:0/1184356418 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80ab650 con 0x7ff0080cfc40 2023-11-28T20:52:27.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff00d127640 1 -- 172.21.15.167:0/1184356418 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff80ab7b0 con 0x7ff0080cfc40 2023-11-28T20:52:27.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff00d127640 1 -- 172.21.15.167:0/1184356418 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80abb40 con 0x7ff0080cfc40 2023-11-28T20:52:27.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff01038d640 1 -- 172.21.15.167:0/1184356418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0080cfc40 msgr2=0x7ff0080ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:27.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff01038d640 1 --2- 172.21.15.167:0/1184356418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0080cfc40 0x7ff0080ca510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feff80097c0 tx=0x7feff801c450 comp rx=0 tx=0).stop 2023-11-28T20:52:27.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff01038d640 1 -- 172.21.15.167:0/1184356418 shutdown_connections 2023-11-28T20:52:27.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff01038d640 1 --2- 172.21.15.167:0/1184356418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0080cfc40 0x7ff0080ca510 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:27.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff01038d640 1 --2- 172.21.15.167:0/1184356418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cf860 0x7ff0080cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:27.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff01038d640 1 -- 172.21.15.167:0/1184356418 >> 172.21.15.167:0/1184356418 conn(0x7ff00806c1f0 msgr2=0x7ff008071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:27.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff01038d640 1 -- 172.21.15.167:0/1184356418 shutdown_connections 2023-11-28T20:52:27.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.688+0000 7ff01038d640 1 -- 172.21.15.167:0/1184356418 wait complete. 2023-11-28T20:52:27.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 Processor -- start 2023-11-28T20:52:27.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 -- start start 2023-11-28T20:52:27.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0080cf860 0x7ff0080b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:27.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cfc40 0x7ff008152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:27.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff008153ae0 0x7ff008143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00815d1a0 con 0x7ff0080cf860 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c6870 con 0x7ff008153ae0 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c6b10 con 0x7ff0080cfc40 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e129640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0080cf860 msgr2=0x7ff0080b3ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e129640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0080cf860 0x7ff0080b3ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e92a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff008153ae0 0x7ff008143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e92a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff008153ae0 0x7ff008143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:50132/0 (socket says 172.21.15.167:50132) 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00d928640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cfc40 0x7ff008152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e92a640 1 -- 172.21.15.167:0/1036301787 learned_addr learned my addr 172.21.15.167:0/1036301787 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e92a640 1 -- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cfc40 msgr2=0x7ff008152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e92a640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cfc40 0x7ff008152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e92a640 1 -- 172.21.15.167:0/1036301787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0080cf860 msgr2=0x7ff0080b3ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:52:27.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e92a640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0080cf860 0x7ff0080b3ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:27.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e92a640 1 -- 172.21.15.167:0/1036301787 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8009420 con 0x7ff008153ae0 2023-11-28T20:52:27.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff00e92a640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff008153ae0 0x7ff008143d50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff00000cbc0 tx=0x7ff00000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7feffeffd640 1 -- 172.21.15.167:0/1036301787 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000ad40 con 0x7ff008153ae0 2023-11-28T20:52:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7feffeffd640 1 -- 172.21.15.167:0/1036301787 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000012400 con 0x7ff008153ae0 2023-11-28T20:52:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0080b4220 con 0x7ff008153ae0 2023-11-28T20:52:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7feffeffd640 1 -- 172.21.15.167:0/1036301787 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000aea0 con 0x7ff008153ae0 2023-11-28T20:52:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.692+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00815cec0 con 0x7ff008153ae0 2023-11-28T20:52:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.696+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0080b3640 con 0x7ff008153ae0 2023-11-28T20:52:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.696+0000 7feffeffd640 1 -- 172.21.15.167:0/1036301787 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff000007070 con 0x7ff008153ae0 2023-11-28T20:52:27.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.696+0000 7feffeffd640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefec066420 0x7fefec0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:27.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.696+0000 7feffeffd640 1 -- 172.21.15.167:0/1036301787 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff000084530 con 0x7ff008153ae0 2023-11-28T20:52:27.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.696+0000 7ff00e129640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefec066420 0x7fefec0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:27.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.700+0000 7ff00e129640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefec066420 0x7fefec0688e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff004009470 tx=0x7ff004009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:27.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.708+0000 7feffeffd640 1 -- 172.21.15.167:0/1036301787 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0000516e0 con 0x7ff008153ae0 2023-11-28T20:52:27.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff008075c90 con 0x7ff008153ae0 2023-11-28T20:52:27.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7feffeffd640 1 -- 172.21.15.167:0/1036301787 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7ff000021630 con 0x7ff008153ae0 2023-11-28T20:52:27.917 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:52:27.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefec066420 msgr2=0x7fefec0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:27.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefec066420 0x7fefec0688e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff004009470 tx=0x7ff004009190 comp rx=0 tx=0).stop 2023-11-28T20:52:27.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff008153ae0 msgr2=0x7ff008143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:27.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff008153ae0 0x7ff008143d50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff00000cbc0 tx=0x7ff00000a430 comp rx=0 tx=0).stop 2023-11-28T20:52:27.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 shutdown_connections 2023-11-28T20:52:27.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefec066420 0x7fefec0688e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:27.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff008153ae0 0x7ff008143d50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:27.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0080cfc40 0x7ff008152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:27.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 --2- 172.21.15.167:0/1036301787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0080cf860 0x7ff0080b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:27.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 >> 172.21.15.167:0/1036301787 conn(0x7ff00806c1f0 msgr2=0x7ff0080662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:27.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 shutdown_connections 2023-11-28T20:52:27.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:27.916+0000 7ff01038d640 1 -- 172.21.15.167:0/1036301787 wait complete. 2023-11-28T20:52:30.940 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:52:31.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.084+0000 7fb031cd6640 1 Processor -- start 2023-11-28T20:52:31.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.084+0000 7fb031cd6640 1 -- start start 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb031cd6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb02c06d530 0x7fb02c066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb031cd6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb02c15d3b0 0x7fb02c1646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb031cd6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0c8280 con 0x7fb02c0aff70 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb031cd6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c0c8910 con 0x7fb02c15d3b0 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb031cd6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c066bc0 con 0x7fb02c06d530 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02bfff640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fb02c15d3b0 msgr2=0x7fb02c1646e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02b7fe640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fb02c0aff70 legacy=0x7fb02c06b690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb02c15d3b0 0x7fb02c1646e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02affd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb02c06d530 0x7fb02c066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:31.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02affd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb02c06d530 0x7fb02c066680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:50148/0 (socket says 172.21.15.167:50148) 2023-11-28T20:52:31.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02affd640 1 -- 172.21.15.167:0/4262134244 learned_addr learned my addr 172.21.15.167:0/4262134244 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:31.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02affd640 1 -- 172.21.15.167:0/4262134244 >> v2:172.21.15.167:3300/0 conn(0x7fb02c15d3b0 msgr2=0x7fb02c1646e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:31.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02affd640 1 --2- 172.21.15.167:0/4262134244 >> v2:172.21.15.167:3300/0 conn(0x7fb02c15d3b0 0x7fb02c1646e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02affd640 1 -- 172.21.15.167:0/4262134244 >> v1:172.21.15.167:6789/0 conn(0x7fb02c0aff70 legacy=0x7fb02c06b690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:31.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.088+0000 7fb02affd640 1 -- 172.21.15.167:0/4262134244 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0ca3b0 con 0x7fb02c06d530 2023-11-28T20:52:31.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb02affd640 1 --2- 172.21.15.167:0/4262134244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c06d530 0x7fb02c066680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0ca1a0 tx=0x7fb02001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc7cf67cee4405aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:31.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb02a7fc640 1 -- 172.21.15.167:0/4262134244 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200aa610 con 0x7fb02c06d530 2023-11-28T20:52:31.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb02a7fc640 1 -- 172.21.15.167:0/4262134244 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0200a6040 con 0x7fb02c06d530 2023-11-28T20:52:31.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb02a7fc640 1 -- 172.21.15.167:0/4262134244 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0200aa990 con 0x7fb02c06d530 2023-11-28T20:52:31.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 -- 172.21.15.167:0/4262134244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c06d530 msgr2=0x7fb02c066680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:31.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 --2- 172.21.15.167:0/4262134244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c06d530 0x7fb02c066680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0ca1a0 tx=0x7fb02001c4b0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 -- 172.21.15.167:0/4262134244 shutdown_connections 2023-11-28T20:52:31.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 --2- 172.21.15.167:0/4262134244 >> v2:172.21.15.167:3300/0 conn(0x7fb02c15d3b0 0x7fb02c1646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 --2- 172.21.15.167:0/4262134244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c06d530 0x7fb02c066680 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 -- 172.21.15.167:0/4262134244 >> 172.21.15.167:0/4262134244 conn(0x7fb02c06ee00 msgr2=0x7fb02c06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:31.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 -- 172.21.15.167:0/4262134244 shutdown_connections 2023-11-28T20:52:31.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 -- 172.21.15.167:0/4262134244 wait complete. 2023-11-28T20:52:31.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 Processor -- start 2023-11-28T20:52:31.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.092+0000 7fb031cd6640 1 -- start start 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb031cd6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb02c06d530 0x7fb02c159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb031cd6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb02c0aff70 0x7fb02c151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb031cd6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c15d3b0 0x7fb02c150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb031cd6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0b0700 con 0x7fb02c0aff70 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb031cd6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c159c80 con 0x7fb02c15d3b0 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb031cd6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0aecf0 con 0x7fb02c06d530 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02affd640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb02c0aff70 msgr2=0x7fb02c151f50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb02c0aff70 0x7fb02c151f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02b7fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb02c06d530 0x7fb02c159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:31.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c15d3b0 0x7fb02c150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:31.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c15d3b0 0x7fb02c150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:50154/0 (socket says 172.21.15.167:50154) 2023-11-28T20:52:31.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02bfff640 1 -- 172.21.15.167:0/3026423790 learned_addr learned my addr 172.21.15.167:0/3026423790 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:31.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02b7fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb02c06d530 0x7fb02c159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33684/0 (socket says 172.21.15.167:33684) 2023-11-28T20:52:31.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02bfff640 1 -- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb02c06d530 msgr2=0x7fb02c159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:31.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02bfff640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb02c06d530 0x7fb02c159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02bfff640 1 -- 172.21.15.167:0/3026423790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb02c0aff70 msgr2=0x7fb02c151f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:52:31.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02bfff640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb02c0aff70 0x7fb02c151f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02bfff640 1 -- 172.21.15.167:0/3026423790 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200094d0 con 0x7fb02c15d3b0 2023-11-28T20:52:31.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb02bfff640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c15d3b0 0x7fb02c150620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb02400be50 tx=0x7fb02400bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:31.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb013fff640 1 -- 172.21.15.167:0/3026423790 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400ce70 con 0x7fb02c15d3b0 2023-11-28T20:52:31.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb013fff640 1 -- 172.21.15.167:0/3026423790 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024016430 con 0x7fb02c15d3b0 2023-11-28T20:52:31.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c0ae450 con 0x7fb02c15d3b0 2023-11-28T20:52:31.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb013fff640 1 -- 172.21.15.167:0/3026423790 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024016820 con 0x7fb02c15d3b0 2023-11-28T20:52:31.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c0aea10 con 0x7fb02c15d3b0 2023-11-28T20:52:31.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.096+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c067c40 con 0x7fb02c15d3b0 2023-11-28T20:52:31.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.100+0000 7fb013fff640 1 -- 172.21.15.167:0/3026423790 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb024012030 con 0x7fb02c15d3b0 2023-11-28T20:52:31.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.100+0000 7fb013fff640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb018066420 0x7fb0180688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:31.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.100+0000 7fb013fff640 1 -- 172.21.15.167:0/3026423790 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb024084a50 con 0x7fb02c15d3b0 2023-11-28T20:52:31.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.100+0000 7fb02b7fe640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb018066420 0x7fb0180688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:31.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.100+0000 7fb02b7fe640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb018066420 0x7fb0180688e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0093d0 tx=0x7fb01c009360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.112+0000 7fb013fff640 1 -- 172.21.15.167:0/3026423790 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb024051af0 con 0x7fb02c15d3b0 2023-11-28T20:52:31.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.312+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb02c0b0840 con 0x7fb02c15d3b0 2023-11-28T20:52:31.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.312+0000 7fb013fff640 1 -- 172.21.15.167:0/3026423790 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fb02c0b0840 con 0x7fb02c15d3b0 2023-11-28T20:52:31.315 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":114,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:52:31.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb018066420 msgr2=0x7fb0180688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:31.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb018066420 0x7fb0180688e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0093d0 tx=0x7fb01c009360 comp rx=0 tx=0).stop 2023-11-28T20:52:31.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c15d3b0 msgr2=0x7fb02c150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:31.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c15d3b0 0x7fb02c150620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb02400be50 tx=0x7fb02400bf40 comp rx=0 tx=0).stop 2023-11-28T20:52:31.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 shutdown_connections 2023-11-28T20:52:31.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb018066420 0x7fb0180688e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb02c15d3b0 0x7fb02c150620 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb02c0aff70 0x7fb02c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 --2- 172.21.15.167:0/3026423790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb02c06d530 0x7fb02c159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:31.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 >> 172.21.15.167:0/3026423790 conn(0x7fb02c06ee00 msgr2=0x7fb02c06b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:31.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 shutdown_connections 2023-11-28T20:52:31.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:31.316+0000 7fb031cd6640 1 -- 172.21.15.167:0/3026423790 wait complete. 2023-11-28T20:52:32.896 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 12% (36/295) Updating files: 13% (39/295) Updating files: 14% (42/295) Updating files: 15% (45/295) Updating files: 16% (48/295) Updating files: 17% (51/295) Updating files: 18% (54/295) Updating files: 19% (57/295) Updating files: 20% (59/295) Updating files: 21% (62/295) Updating files: 22% (65/295) Updating files: 23% (68/295) Updating files: 24% (71/295) Updating files: 25% (74/295) Updating files: 26% (77/295) Updating files: 27% (80/295) Updating files: 28% (83/295) Updating files: 29% (86/295) Updating files: 30% (89/295) Updating files: 31% (92/295) Updating files: 32% (95/295) Updating files: 33% (98/295) Updating files: 34% (101/295) Updating files: 35% (104/295) Updating files: 36% (107/295) Updating files: 37% (110/295) Updating files: 38% (113/295) Updating files: 39% (116/295) Updating files: 40% (118/295) Updating files: 41% (121/295) Updating files: 42% (124/295) Updating files: 43% (127/295) Updating files: 44% (130/295) Updating files: 45% (133/295) Updating files: 46% (136/295) Updating files: 47% (139/295) Updating files: 48% (142/295) Updating files: 49% (145/295) Updating files: 50% (148/295) Updating files: 51% (151/295) Updating files: 52% (154/295) Updating files: 53% (157/295) Updating files: 54% (160/295) Updating files: 55% (163/295) Updating files: 56% (166/295) Updating files: 57% (169/295) Updating files: 58% (172/295) Updating files: 58% (174/295) Updating files: 59% (175/295) Updating files: 60% (177/295) Updating files: 61% (180/295) Updating files: 62% (183/295) Updating files: 63% (186/295) Updating files: 64% (189/295) Updating files: 65% (192/295) Updating files: 66% (195/295) Updating files: 67% (198/295) Updating files: 68% (201/295) Updating files: 69% (204/295) Updating files: 70% (207/295) Updating files: 71% (210/295) Updating files: 72% (213/295) Updating files: 73% (216/295) Updating files: 74% (219/295) Updating files: 75% (222/295) Updating files: 76% (225/295) Updating files: 77% (228/295) Updating files: 78% (231/295) Updating files: 79% (234/295) Updating files: 80% (236/295) Updating files: 81% (239/295) Updating files: 82% (242/295) Updating files: 82% (243/295) Updating files: 83% (245/295) Updating files: 84% (248/295) Updating files: 84% (249/295) Updating files: 85% (251/295) Updating files: 86% (254/295) Updating files: 87% (257/295) Updating files: 88% (260/295) Updating files: 89% (263/295) Updating files: 90% (266/295) Updating files: 91% (269/295) Updating files: 92% (272/295) Updating files: 93% (275/295) Updating files: 94% (278/295) Updating files: 95% (281/295) Updating files: 96% (284/295) Updating files: 97% (287/295) Updating files: 98% (290/295) Updating files: 99% (293/295) Updating files: 100% (295/295) Updating files: 100% (295/295), done. 2023-11-28T20:52:32.922 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 2e986fe9ddf include ceph.spec in configure.ac 2023-11-28T20:52:32.931 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.3 2023-11-28T20:52:32.996 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 4 -eq 48 ] 2023-11-28T20:52:32.996 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.4 2023-11-28T20:52:32.996 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.4 2023-11-28T20:52:32.997 INFO:tasks.workunit.client.0.smithi167.stdout:v0.4 2023-11-28T20:52:32.997 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.4 2023-11-28T20:52:34.337 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:52:34.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.472+0000 7f679569e640 1 Processor -- start 2023-11-28T20:52:34.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.472+0000 7f679569e640 1 -- start start 2023-11-28T20:52:34.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f679569e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f679569e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 0x7f67901505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f679569e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67901571d0 con 0x7f679006e410 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f679569e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6790071a90 con 0x7f6790070480 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f679569e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67900c70d0 con 0x7f679006e030 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f67867fc640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 msgr2=0x7f67901505f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f67867fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 0x7f67901505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f678f7fe640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f679006e410 legacy=0x7f6790071f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f678effd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f678effd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:39554/0 (socket says 172.21.15.167:39554) 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f678effd640 1 -- 172.21.15.167:0/570491694 learned_addr learned my addr 172.21.15.167:0/570491694 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f678effd640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 msgr2=0x7f67901500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f678effd640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 msgr2=0x7f67901500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:52:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:34.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.476+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:34.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.680+0000 7f678f7fe640 1 -- 172.21.15.167:0/570491694 >> v1:172.21.15.167:6789/0 conn(0x7f679006e410 legacy=0x7f6790071f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:52:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.680+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 msgr2=0x7f67901505f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.680+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 0x7f67901505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:52:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.680+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.680+0000 7f678effd640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 msgr2=0x7f67901500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:52:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.680+0000 7f678effd640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 msgr2=0x7f67901500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:52:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.680+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:34.680+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:52:35.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.084+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 msgr2=0x7f67901505f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:35.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.084+0000 7f678f7fe640 1 -- 172.21.15.167:0/570491694 >> v1:172.21.15.167:6789/0 conn(0x7f679006e410 legacy=0x7f6790071f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:52:35.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.084+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 0x7f67901505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:52:35.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.084+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:35.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.084+0000 7f678effd640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 msgr2=0x7f67901500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:52:35.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.084+0000 7f678effd640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 msgr2=0x7f67901500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:52:35.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.084+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:35.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.084+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:52:35.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.888+0000 7f678f7fe640 1 -- 172.21.15.167:0/570491694 >> v1:172.21.15.167:6789/0 conn(0x7f679006e410 legacy=0x7f6790071f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:52:35.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.888+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 msgr2=0x7f67901505f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:35.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.888+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 0x7f67901505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:52:35.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.888+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:35.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.888+0000 7f678effd640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 msgr2=0x7f67901500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:52:35.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.888+0000 7f678effd640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 msgr2=0x7f67901500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:52:35.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.888+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:35.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:35.888+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:52:37.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f678d7fa640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 msgr2=0x7f67901500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f678d7fa640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f679006e030 0x7f67901500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f678d7fa640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 msgr2=0x7f67901505f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f678d7fa640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.167:3300/0 conn(0x7f6790070480 0x7f67901505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f678d7fa640 1 -- 172.21.15.167:0/570491694 >> v1:172.21.15.167:6789/0 conn(0x7f679006e410 legacy=0x7f6790071f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f678d7fa640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f678d7fa640 1 -- 172.21.15.167:0/570491694 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67900c73b0 con 0x7f67700058c0 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f678d7fa640 1 -- 172.21.15.167:0/570491694 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6790071a90 con 0x7f6770009570 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 msgr2=0x7f677000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 msgr2=0x7f677000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:52:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:37.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.476+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:37.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.680+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:37.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.680+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 msgr2=0x7f677000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:52:37.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.680+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 msgr2=0x7f677000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:52:37.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.680+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:37.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:37.680+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:52:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.084+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.084+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 msgr2=0x7f677000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:52:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.084+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 msgr2=0x7f677000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:52:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.084+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:52:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.084+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:52:38.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.528+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477534218 0 0) 0x7f67900c73b0 con 0x7f67700058c0 2023-11-28T20:52:38.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.528+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f677c003530 con 0x7f67700058c0 2023-11-28T20:52:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719525448 0 0) 0x7f677c003530 con 0x7f67700058c0 2023-11-28T20:52:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 msgr2=0x7f677000ba30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 --2- 172.21.15.167:0/570491694 >> v2:172.21.15.178:3300/0 conn(0x7f6770009570 0x7f677000ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67901571d0 con 0x7f67700058c0 2023-11-28T20:52:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f678000c4f0 con 0x7f67700058c0 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 >> v1:172.21.15.178:6789/0 conn(0x7f67700058c0 legacy=0x7f6770007d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678f7fe640 1 -- 172.21.15.167:0/570491694 reap_dead start 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c003980 0x7f677c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c0047d0 0x7f677c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 0x7f677c00fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6790071a90 con 0x7f677c0051e0 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c010520 con 0x7f677c003980 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0106e0 con 0x7f677c0047d0 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678f7fe640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 msgr2=0x7f677c00fda0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678f7fe640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 0x7f677c00fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c0047d0 0x7f677c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f678effd640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c003980 0x7f677c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c003980 msgr2=0x7f677c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c003980 0x7f677c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 msgr2=0x7f677c00fda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 0x7f677c00fda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.532+0000 7f67867fc640 1 -- 172.21.15.167:0/570491694 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c003530 con 0x7f677c0047d0 2023-11-28T20:52:38.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.536+0000 7f67867fc640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c0047d0 0x7f677c004c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6778003d10 tx=0x7f677801d5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ef987398454daba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:38.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.540+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780ae420 con 0x7f677c0047d0 2023-11-28T20:52:38.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.540+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67780ae580 con 0x7f677c0047d0 2023-11-28T20:52:38.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.540+0000 7f678e7fc640 1 -- 172.21.15.167:0/570491694 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780ae930 con 0x7f677c0047d0 2023-11-28T20:52:38.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 -- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c0047d0 msgr2=0x7f677c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c0047d0 0x7f677c004c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6778003d10 tx=0x7f677801d5d0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 -- 172.21.15.167:0/570491694 shutdown_connections 2023-11-28T20:52:38.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 0x7f677c00fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c0047d0 0x7f677c004c50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 --2- 172.21.15.167:0/570491694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c003980 0x7f677c003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 -- 172.21.15.167:0/570491694 >> 172.21.15.167:0/570491694 conn(0x7f67900cb1e0 msgr2=0x7f67900cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:38.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 -- 172.21.15.167:0/570491694 shutdown_connections 2023-11-28T20:52:38.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 -- 172.21.15.167:0/570491694 wait complete. 2023-11-28T20:52:38.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 Processor -- start 2023-11-28T20:52:38.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.544+0000 7f679569e640 1 -- start start 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f679569e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c003980 0x7f67901f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f679569e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c0047d0 0x7f6790155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f679569e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 0x7f679014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f679569e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67901470b0 con 0x7f677c0051e0 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f679569e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900c41f0 con 0x7f677c0047d0 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f679569e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6790146270 con 0x7f677c003980 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f678f7fe640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 msgr2=0x7f679014e070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f678f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 0x7f679014e070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f67867fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c0047d0 0x7f6790155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f67867fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c0047d0 0x7f6790155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41986/0 (socket says 172.21.15.167:41986) 2023-11-28T20:52:38.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f67867fc640 1 -- 172.21.15.167:0/1547967153 learned_addr learned my addr 172.21.15.167:0/1547967153 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:38.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f678effd640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c003980 0x7f67901f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f678effd640 1 -- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c0047d0 msgr2=0x7f6790155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f678effd640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c0047d0 0x7f6790155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f678effd640 1 -- 172.21.15.167:0/1547967153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 msgr2=0x7f679014e070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:52:38.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f678effd640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 0x7f679014e070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f678effd640 1 -- 172.21.15.167:0/1547967153 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6790146530 con 0x7f677c003980 2023-11-28T20:52:38.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f67867fc640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c0047d0 0x7f6790155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:52:38.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f678effd640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c003980 0x7f67901f3620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f678000c700 tx=0x7f6780019bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f6787fff640 1 -- 172.21.15.167:0/1547967153 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780017dc0 con 0x7f677c003980 2023-11-28T20:52:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f6787fff640 1 -- 172.21.15.167:0/1547967153 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678000c040 con 0x7f677c003980 2023-11-28T20:52:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6790146810 con 0x7f677c003980 2023-11-28T20:52:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f6787fff640 1 -- 172.21.15.167:0/1547967153 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780022680 con 0x7f677c003980 2023-11-28T20:52:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.548+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6790146dd0 con 0x7f677c003980 2023-11-28T20:52:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.552+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67900682c0 con 0x7f677c003980 2023-11-28T20:52:38.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.552+0000 7f6787fff640 1 -- 172.21.15.167:0/1547967153 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f67800227e0 con 0x7f677c003980 2023-11-28T20:52:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.552+0000 7f6787fff640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6770066ab0 0x7f6770068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.552+0000 7f6787fff640 1 -- 172.21.15.167:0/1547967153 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6780019e40 con 0x7f677c003980 2023-11-28T20:52:38.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.552+0000 7f67867fc640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6770066ab0 0x7f6770068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.556+0000 7f67867fc640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6770066ab0 0x7f6770068f70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f677801d610 tx=0x7f6778005ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.564+0000 7f6787fff640 1 -- 172.21.15.167:0/1547967153 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6780055420 con 0x7f677c003980 2023-11-28T20:52:38.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6790075c90 con 0x7f677c003980 2023-11-28T20:52:38.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f6787fff640 1 -- 172.21.15.167:0/1547967153 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f6780058a40 con 0x7f677c003980 2023-11-28T20:52:38.773 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":116,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:52:38.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6770066ab0 msgr2=0x7f6770068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6770066ab0 0x7f6770068f70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f677801d610 tx=0x7f6778005ef0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c003980 msgr2=0x7f67901f3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c003980 0x7f67901f3620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f678000c700 tx=0x7f6780019bf0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 shutdown_connections 2023-11-28T20:52:38.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6770066ab0 0x7f6770068f70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f677c0051e0 0x7f679014e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677c0047d0 0x7f6790155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 --2- 172.21.15.167:0/1547967153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677c003980 0x7f67901f3620 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 >> 172.21.15.167:0/1547967153 conn(0x7f67900cb1e0 msgr2=0x7f67900c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:38.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 shutdown_connections 2023-11-28T20:52:38.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.772+0000 7f679569e640 1 -- 172.21.15.167:0/1547967153 wait complete. 2023-11-28T20:52:38.795 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:52:38.795 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:52:38.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:52:38.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9c7aa640 1 Processor -- start 2023-11-28T20:52:38.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9c7aa640 1 -- start start 2023-11-28T20:52:38.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9c7aa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d94150b40 0x7f1d94157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9c7aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d940c4510 0x7f1d9406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9c7aa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d940c4920 con 0x7f1d940c6ff0 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9c7aa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940c62f0 con 0x7f1d94150b40 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9c7aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c6ac0 con 0x7f1d940c4510 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d99d45640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f1d940c6ff0 legacy=0x7f1d940c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9a546640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d94150b40 0x7f1d94157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9ad47640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d940c4510 0x7f1d9406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9a546640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d94150b40 0x7f1d94157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41992/0 (socket says 172.21.15.167:41992) 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.932+0000 7f1d9a546640 1 -- 172.21.15.167:0/3040587417 learned_addr learned my addr 172.21.15.167:0/3040587417 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.936+0000 7f1d9a546640 1 -- 172.21.15.167:0/3040587417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d940c4510 msgr2=0x7f1d9406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.936+0000 7f1d9a546640 1 --2- 172.21.15.167:0/3040587417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d940c4510 0x7f1d9406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.936+0000 7f1d9a546640 1 -- 172.21.15.167:0/3040587417 >> v1:172.21.15.167:6789/0 conn(0x7f1d940c6ff0 legacy=0x7f1d940c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:38.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.936+0000 7f1d9a546640 1 -- 172.21.15.167:0/3040587417 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940c6500 con 0x7f1d94150b40 2023-11-28T20:52:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.936+0000 7f1d9a546640 1 --2- 172.21.15.167:0/3040587417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 0x7f1d94157560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1d940cc090 tx=0x7f1d9001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2a0e4a7778799ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.936+0000 7f1d99544640 1 -- 172.21.15.167:0/3040587417 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900ad680 con 0x7f1d94150b40 2023-11-28T20:52:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.936+0000 7f1d99544640 1 -- 172.21.15.167:0/3040587417 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d900ad7e0 con 0x7f1d94150b40 2023-11-28T20:52:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.936+0000 7f1d99544640 1 -- 172.21.15.167:0/3040587417 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900adb70 con 0x7f1d94150b40 2023-11-28T20:52:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3040587417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 msgr2=0x7f1d94157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 --2- 172.21.15.167:0/3040587417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 0x7f1d94157560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1d940cc090 tx=0x7f1d9001c4b0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3040587417 shutdown_connections 2023-11-28T20:52:38.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 --2- 172.21.15.167:0/3040587417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d940c4510 0x7f1d9406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 --2- 172.21.15.167:0/3040587417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 0x7f1d94157560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3040587417 >> 172.21.15.167:0/3040587417 conn(0x7f1d940cb1e0 msgr2=0x7f1d940cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:38.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3040587417 shutdown_connections 2023-11-28T20:52:38.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3040587417 wait complete. 2023-11-28T20:52:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 Processor -- start 2023-11-28T20:52:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 -- start start 2023-11-28T20:52:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d940c4510 0x7f1d941405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d940c6ff0 0x7f1d940c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 0x7f1d940c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94163f70 con 0x7f1d940c4510 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94148470 con 0x7f1d94150b40 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9c7aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94148140 con 0x7f1d940c6ff0 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9a546640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d940c4510 msgr2=0x7f1d941405e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9a546640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d940c4510 0x7f1d941405e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9ad47640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 0x7f1d940c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9ad47640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 0x7f1d940c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:41996/0 (socket says 172.21.15.167:41996) 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9ad47640 1 -- 172.21.15.167:0/3329392128 learned_addr learned my addr 172.21.15.167:0/3329392128 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d99d45640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d940c6ff0 0x7f1d940c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9ad47640 1 -- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d940c6ff0 msgr2=0x7f1d940c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9ad47640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d940c6ff0 0x7f1d940c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9ad47640 1 -- 172.21.15.167:0/3329392128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d940c4510 msgr2=0x7f1d941405e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:52:38.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9ad47640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d940c4510 0x7f1d941405e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.940+0000 7f1d9ad47640 1 -- 172.21.15.167:0/3329392128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900094d0 con 0x7f1d94150b40 2023-11-28T20:52:38.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d9ad47640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 0x7f1d940c9640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00efc0 tx=0x7f1d8c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:38.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c014480 con 0x7f1d94150b40 2023-11-28T20:52:38.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c00f040 con 0x7f1d94150b40 2023-11-28T20:52:38.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d940ca470 con 0x7f1d94150b40 2023-11-28T20:52:38.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c014820 con 0x7f1d94150b40 2023-11-28T20:52:38.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d941f6b70 con 0x7f1d94150b40 2023-11-28T20:52:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d9c7aa640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941626c0 0x7f1d940c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d94074770 con 0x7f1d941626c0 2023-11-28T20:52:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d9a546640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941626c0 0x7f1d940c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d9a546640 1 -- 172.21.15.167:0/3329392128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d94157040 con 0x7f1d941626c0 2023-11-28T20:52:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d8c014980 con 0x7f1d94150b40 2023-11-28T20:52:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d9a546640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941626c0 0x7f1d940c9cb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d9406bba0 tx=0x7f1d9001acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.944+0000 7f1d8affd640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d78066420 0x7f1d780688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.948+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1d8c0850c0 con 0x7f1d94150b40 2023-11-28T20:52:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.948+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900adb50 con 0x7f1d941626c0 2023-11-28T20:52:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.948+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1d900b8420 con 0x7f1d941626c0 2023-11-28T20:52:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.948+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941626c0 msgr2=0x7f1d940c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.948+0000 7f1d8affd640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941626c0 0x7f1d940c9cb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d9406bba0 tx=0x7f1d9001acf0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.948+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941626c0 msgr2=0x7f1d940c9cb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.948+0000 7f1d8affd640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941626c0 0x7f1d940c9cb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.948+0000 7f1d99d45640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d78066420 0x7f1d780688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.948+0000 7f1d99d45640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d78066420 0x7f1d780688e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1d840093d0 tx=0x7f1d84009360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.952+0000 7f1d9c7aa640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941f2970 0x7f1d941f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.952+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940682c0 con 0x7f1d941f2970 2023-11-28T20:52:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.952+0000 7f1d9a546640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941f2970 0x7f1d941f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.952+0000 7f1d9a546640 1 -- 172.21.15.167:0/3329392128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1d941482b0 con 0x7f1d941f2970 2023-11-28T20:52:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9a546640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941f2970 0x7f1d941f2d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1d9001ab60 tx=0x7f1d90009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:38.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900b87a0 con 0x7f1d941f2970 2023-11-28T20:52:38.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4631 (secure 0 0 0) 0x7f1d900b8900 con 0x7f1d941f2970 2023-11-28T20:52:38.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941f2970 msgr2=0x7f1d941f2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d8affd640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941f2970 0x7f1d941f2d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1d9001ab60 tx=0x7f1d90009240 comp rx=0 tx=0).stop 2023-11-28T20:52:38.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d8affd640 1 -- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941f2970 msgr2=0x7f1d941f2d80 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d8affd640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d941f2970 0x7f1d941f2d80 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1d9001ab60 tx=0x7f1d90009240 comp rx=0 tx=0).stop 2023-11-28T20:52:38.958 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:52:38.958 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:38.958 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:38.958 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:52:38.958 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 116, 2023-11-28T20:52:38.958 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:52:38.958 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:38.959 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:38.960 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:38.960 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:38.960 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:38.960 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:38.960 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:38.960 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:52:38.960 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:52:38.960 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:38.960 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:38.961 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:38.961 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:38.961 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:38.961 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:38.961 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:38.961 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:38.962 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:38.962 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:38.962 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:38.962 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.962 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:52:38.962 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:52:38.963 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:52:38.963 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:52:38.963 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:52:38.963 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:52:38.963 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:38.964 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:38.964 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:52:38.964 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:52:38.964 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:52:38.964 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:52:38.964 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:52:38.965 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:52:38.965 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:52:38.965 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:38.965 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:52:38.965 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:38.965 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:38.966 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:38.966 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:38.966 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:38.966 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:38.966 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:38.966 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:38.966 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:38.967 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:38.967 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:38.967 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:52:38.967 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.967 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:52:38.967 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.968 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:38.968 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:38.968 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:38.968 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:38.968 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.968 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:38.969 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:52:38.969 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:38.969 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.969 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.969 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:38.970 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:52:38.970 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:38.970 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:38.970 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:38.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.970 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:52:38.970 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:52:38.970 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:38.970 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:38.971 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:52:38.972 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:52:38.973 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:38.974 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:38.975 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:52:38.977 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:38.977 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:38.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:38.977 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:52:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:52:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d78066420 msgr2=0x7f1d780688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9c7aa640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d78066420 0x7f1d780688e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1d840093d0 tx=0x7f1d84009360 comp rx=0 tx=0).stop 2023-11-28T20:52:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 msgr2=0x7f1d940c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9c7aa640 1 --2- 172.21.15.167:0/3329392128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d94150b40 0x7f1d940c9640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00efc0 tx=0x7f1d8c00c490 comp rx=0 tx=0).stop 2023-11-28T20:52:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9ad47640 1 -- 172.21.15.167:0/3329392128 reap_dead start 2023-11-28T20:52:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9ad47640 1 -- 172.21.15.167:0/3329392128 reap_dead start 2023-11-28T20:52:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 shutdown_connections 2023-11-28T20:52:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 >> 172.21.15.167:0/3329392128 conn(0x7f1d940cb1e0 msgr2=0x7f1d94154520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 shutdown_connections 2023-11-28T20:52:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:38.956+0000 7f1d9c7aa640 1 -- 172.21.15.167:0/3329392128 wait complete. 2023-11-28T20:52:38.979 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:52:38.980 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:52:38.980 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:52:39.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.116+0000 7fed2c809640 1 Processor -- start 2023-11-28T20:52:39.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.116+0000 7fed2c809640 1 -- start start 2023-11-28T20:52:39.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2c809640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed28151f60 0x7fed280c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2c809640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed280c5c90 0x7fed280c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2c809640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed2806a580 0x7fed2806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2c809640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed280c4da0 con 0x7fed2806a580 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2c809640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2815b220 con 0x7fed28151f60 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2c809640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280c60f0 con 0x7fed280c5c90 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed26d9d640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fed2806a580 msgr2=0x7fed2806a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed26d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed2806a580 0x7fed2806a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2659c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed28151f60 0x7fed280c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2659c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed28151f60 0x7fed280c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:42040/0 (socket says 172.21.15.167:42040) 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2659c640 1 -- 172.21.15.167:0/720812956 learned_addr learned my addr 172.21.15.167:0/720812956 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed25d9b640 1 --2- 172.21.15.167:0/720812956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed280c5c90 0x7fed280c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:39.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2659c640 1 -- 172.21.15.167:0/720812956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed280c5c90 msgr2=0x7fed280c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:52:39.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2659c640 1 --2- 172.21.15.167:0/720812956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed280c5c90 0x7fed280c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2659c640 1 -- 172.21.15.167:0/720812956 >> v2:172.21.15.167:3300/0 conn(0x7fed2806a580 msgr2=0x7fed2806a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:52:39.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2659c640 1 --2- 172.21.15.167:0/720812956 >> v2:172.21.15.167:3300/0 conn(0x7fed2806a580 0x7fed2806a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.120+0000 7fed2659c640 1 -- 172.21.15.167:0/720812956 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed28152340 con 0x7fed28151f60 2023-11-28T20:52:39.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2659c640 1 --2- 172.21.15.167:0/720812956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed28151f60 0x7fed280c75c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed280c62c0 tx=0x7fed1801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9adef40f5b58e562 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:39.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2559a640 1 -- 172.21.15.167:0/720812956 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180ad660 con 0x7fed28151f60 2023-11-28T20:52:39.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2559a640 1 -- 172.21.15.167:0/720812956 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed180ad7c0 con 0x7fed28151f60 2023-11-28T20:52:39.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2559a640 1 -- 172.21.15.167:0/720812956 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180adb50 con 0x7fed28151f60 2023-11-28T20:52:39.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2c809640 1 -- 172.21.15.167:0/720812956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed28151f60 msgr2=0x7fed280c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:39.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2c809640 1 --2- 172.21.15.167:0/720812956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed28151f60 0x7fed280c75c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed280c62c0 tx=0x7fed1801c490 comp rx=0 tx=0).stop 2023-11-28T20:52:39.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2c809640 1 -- 172.21.15.167:0/720812956 shutdown_connections 2023-11-28T20:52:39.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2c809640 1 --2- 172.21.15.167:0/720812956 >> v2:172.21.15.167:3300/0 conn(0x7fed2806a580 0x7fed2806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2c809640 1 --2- 172.21.15.167:0/720812956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed280c5c90 0x7fed280c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2c809640 1 --2- 172.21.15.167:0/720812956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed28151f60 0x7fed280c75c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2c809640 1 -- 172.21.15.167:0/720812956 >> 172.21.15.167:0/720812956 conn(0x7fed280cb1e0 msgr2=0x7fed280cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2c809640 1 -- 172.21.15.167:0/720812956 shutdown_connections 2023-11-28T20:52:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.124+0000 7fed2c809640 1 -- 172.21.15.167:0/720812956 wait complete. 2023-11-28T20:52:39.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 Processor -- start 2023-11-28T20:52:39.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 -- start start 2023-11-28T20:52:39.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2806a580 0x7fed28149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed280c5c90 0x7fed28154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28151f60 0x7fed28071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28154bb0 con 0x7fed2806a580 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed281525e0 con 0x7fed280c5c90 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed28153120 con 0x7fed28151f60 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2659c640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2806a580 msgr2=0x7fed28149a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2806a580 0x7fed28149a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed25d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed280c5c90 0x7fed28154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed26d9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28151f60 0x7fed28071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:39.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed25d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed280c5c90 0x7fed28154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:42048/0 (socket says 172.21.15.167:42048) 2023-11-28T20:52:39.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed25d9b640 1 -- 172.21.15.167:0/129464088 learned_addr learned my addr 172.21.15.167:0/129464088 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:52:39.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed25d9b640 1 -- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28151f60 msgr2=0x7fed28071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed25d9b640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28151f60 0x7fed28071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed25d9b640 1 -- 172.21.15.167:0/129464088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2806a580 msgr2=0x7fed28149a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed25d9b640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed2806a580 0x7fed28149a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed25d9b640 1 -- 172.21.15.167:0/129464088 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180094d0 con 0x7fed280c5c90 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed25d9b640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed280c5c90 0x7fed28154fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00e960 tx=0x7fed1c00ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c009690 con 0x7fed280c5c90 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c00ca00 con 0x7fed280c5c90 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00cd70 con 0x7fed280c5c90 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2815c0d0 con 0x7fed280c5c90 2023-11-28T20:52:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.128+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed28152b60 con 0x7fed280c5c90 2023-11-28T20:52:39.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed2c809640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28157c80 0x7fed280720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:39.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed28074770 con 0x7fed28157c80 2023-11-28T20:52:39.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed2659c640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28157c80 0x7fed280720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:39.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed2659c640 1 -- 172.21.15.167:0/129464088 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed2815bf50 con 0x7fed28157c80 2023-11-28T20:52:39.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed2659c640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28157c80 0x7fed280720e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fed28158660 tx=0x7fed1801acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:39.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed1c013470 con 0x7fed280c5c90 2023-11-28T20:52:39.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed16ffd640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed08066420 0x7fed080688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:39.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed18006ea0 con 0x7fed28157c80 2023-11-28T20:52:39.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fed1c0846d0 con 0x7fed280c5c90 2023-11-28T20:52:39.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fed180ad930 con 0x7fed28157c80 2023-11-28T20:52:39.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28157c80 msgr2=0x7fed280720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:39.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed16ffd640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28157c80 0x7fed280720e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fed28158660 tx=0x7fed1801acd0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28157c80 msgr2=0x7fed280720e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:39.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed16ffd640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28157c80 0x7fed280720e0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fed28158660 tx=0x7fed1801acd0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.132+0000 7fed26d9d640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed08066420 0x7fed080688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:39.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.136+0000 7fed26d9d640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed08066420 0x7fed080688e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fed20003d10 tx=0x7fed200095f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:39.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed2c809640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28148c90 0x7fed281477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:52:39.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2815ba30 con 0x7fed28148c90 2023-11-28T20:52:39.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed2659c640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28148c90 0x7fed281477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:52:39.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed2659c640 1 -- 172.21.15.167:0/129464088 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fed28154e20 con 0x7fed28148c90 2023-11-28T20:52:39.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed2659c640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28148c90 0x7fed281477c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed1801cd30 tx=0x7fed18019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:52:39.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180c08b0 con 0x7fed28148c90 2023-11-28T20:52:39.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5112 (secure 0 0 0) 0x7fed180c02f0 con 0x7fed28148c90 2023-11-28T20:52:39.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28148c90 msgr2=0x7fed281477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:39.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed16ffd640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28148c90 0x7fed281477c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed1801cd30 tx=0x7fed18019230 comp rx=0 tx=0).stop 2023-11-28T20:52:39.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed16ffd640 1 -- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28148c90 msgr2=0x7fed281477c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:52:39.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.140+0000 7fed16ffd640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed28148c90 0x7fed281477c0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed1801cd30 tx=0x7fed18019230 comp rx=0 tx=0).stop 2023-11-28T20:52:39.146 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:52:39.146 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:39.146 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:39.146 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:52:39.147 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 116, 2023-11-28T20:52:39.147 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:52:39.147 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:52:39.147 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:52:39.148 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:39.148 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:52:39.148 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:39.148 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:52:39.148 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:52:39.148 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:39.148 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:39.148 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:52:39.149 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:39.150 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:39.151 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:52:39.152 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:52:39.153 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.154 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:39.155 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:52:39.155 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:39.155 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.155 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.155 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:39.155 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:52:39.155 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:39.155 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:39.155 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:52:39.156 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:52:39.157 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:39.157 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:39.157 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.157 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:39.157 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:52:39.157 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:39.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.158 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.158 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:39.158 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:52:39.158 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:39.158 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:39.158 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:39.158 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.158 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:52:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:52:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.161 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:52:39.162 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:52:39.162 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.162 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:39.162 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:39.162 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:39.162 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:39.162 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:39.162 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:39.163 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:39.164 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:52:39.164 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:39.164 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:39.164 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:52:39.164 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.164 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:52:39.164 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:39.164 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:52:39.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.165 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:39.165 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:39.165 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:52:39.165 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:39.165 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:52:39.165 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:52:39.165 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:52:39.166 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:52:39.166 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:52:39.166 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:52:39.166 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:52:39.166 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:52:39.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:52:39.166 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:52:39.166 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:52:39.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed08066420 msgr2=0x7fed080688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed2c809640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fed08066420 0x7fed080688e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fed20003d10 tx=0x7fed200095f0 comp rx=0 tx=0).stop 2023-11-28T20:52:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed280c5c90 msgr2=0x7fed28154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:52:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed2c809640 1 --2- 172.21.15.167:0/129464088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed280c5c90 0x7fed28154fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00e960 tx=0x7fed1c00ee20 comp rx=0 tx=0).stop 2023-11-28T20:52:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed26d9d640 1 -- 172.21.15.167:0/129464088 reap_dead start 2023-11-28T20:52:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed26d9d640 1 -- 172.21.15.167:0/129464088 reap_dead start 2023-11-28T20:52:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 shutdown_connections 2023-11-28T20:52:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 >> 172.21.15.167:0/129464088 conn(0x7fed280cb1e0 msgr2=0x7fed280c2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:52:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 shutdown_connections 2023-11-28T20:52:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:52:39.144+0000 7fed2c809640 1 -- 172.21.15.167:0/129464088 wait complete. 2023-11-28T20:52:39.170 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:52:39.170 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:52:41.832 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 6% (16/247) Updating files: 7% (18/247) Updating files: 8% (20/247) Updating files: 9% (23/247) Updating files: 10% (25/247) Updating files: 11% (28/247) Updating files: 12% (30/247) Updating files: 13% (33/247) Updating files: 14% (35/247) Updating files: 14% (37/247) Updating files: 15% (38/247) Updating files: 16% (40/247) Updating files: 17% (42/247) Updating files: 18% (45/247) Updating files: 19% (47/247) Updating files: 20% (50/247) Updating files: 21% (52/247) Updating files: 22% (55/247) Updating files: 23% (57/247) Updating files: 24% (60/247) Updating files: 25% (62/247) Updating files: 26% (65/247) Updating files: 27% (67/247) Updating files: 28% (70/247) Updating files: 29% (72/247) Updating files: 30% (75/247) Updating files: 31% (77/247) Updating files: 32% (80/247) Updating files: 33% (82/247) Updating files: 34% (84/247) Updating files: 35% (87/247) Updating files: 36% (89/247) Updating files: 37% (92/247) Updating files: 38% (94/247) Updating files: 39% (97/247) Updating files: 40% (99/247) Updating files: 41% (102/247) Updating files: 42% (104/247) Updating files: 43% (107/247) Updating files: 44% (109/247) Updating files: 45% (112/247) Updating files: 46% (114/247) Updating files: 47% (117/247) Updating files: 48% (119/247) Updating files: 49% (122/247) Updating files: 50% (124/247) Updating files: 51% (126/247) Updating files: 52% (129/247) Updating files: 53% (131/247) Updating files: 54% (134/247) Updating files: 55% (136/247) Updating files: 56% (139/247) Updating files: 57% (141/247) Updating files: 58% (144/247) Updating files: 59% (146/247) Updating files: 60% (149/247) Updating files: 61% (151/247) Updating files: 62% (154/247) Updating files: 63% (156/247) Updating files: 64% (159/247) Updating files: 65% (161/247) Updating files: 66% (164/247) Updating files: 67% (166/247) Updating files: 68% (168/247) Updating files: 69% (171/247) Updating files: 70% (173/247) Updating files: 71% (176/247) Updating files: 72% (178/247) Updating files: 73% (181/247) Updating files: 73% (182/247) Updating files: 74% (183/247) Updating files: 75% (186/247) Updating files: 76% (188/247) Updating files: 77% (191/247) Updating files: 78% (193/247) Updating files: 79% (196/247) Updating files: 80% (198/247) Updating files: 81% (201/247) Updating files: 82% (203/247) Updating files: 83% (206/247) Updating files: 84% (208/247) Updating files: 85% (210/247) Updating files: 86% (213/247) Updating files: 87% (215/247) Updating files: 88% (218/247) Updating files: 89% (220/247) Updating files: 90% (223/247) Updating files: 91% (225/247) Updating files: 92% (228/247) Updating files: 93% (230/247) Updating files: 94% (233/247) Updating files: 95% (235/247) Updating files: 96% (238/247) Updating files: 97% (240/247) Updating files: 98% (243/247) Updating files: 99% (245/247) Updating files: 100% (247/247) Updating files: 100% (247/247), done. 2023-11-28T20:52:41.878 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 13b1bf7c492 kclient: initializing kaddr (merge fix) 2023-11-28T20:52:41.884 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.4 2023-11-28T20:52:41.916 INFO:tasks.workunit.client.0.smithi167.stdout:v0.5 2023-11-28T20:52:41.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 5 -eq 48 ] 2023-11-28T20:52:41.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.5 2023-11-28T20:52:41.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.5 2023-11-28T20:52:41.917 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.5 2023-11-28T20:52:48.658 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 8% (22/245) Updating files: 9% (23/245) Updating files: 10% (25/245) Updating files: 10% (26/245) Updating files: 11% (27/245) Updating files: 12% (30/245) Updating files: 13% (32/245) Updating files: 14% (35/245) Updating files: 15% (37/245) Updating files: 16% (40/245) Updating files: 17% (42/245) Updating files: 18% (45/245) Updating files: 19% (47/245) Updating files: 20% (49/245) Updating files: 21% (52/245) Updating files: 22% (54/245) Updating files: 23% (57/245) Updating files: 24% (59/245) Updating files: 25% (62/245) Updating files: 26% (64/245) Updating files: 27% (67/245) Updating files: 28% (69/245) Updating files: 28% (71/245) Updating files: 29% (72/245) Updating files: 30% (74/245) Updating files: 31% (76/245) Updating files: 32% (79/245) Updating files: 33% (81/245) Updating files: 34% (84/245) Updating files: 35% (86/245) Updating files: 36% (89/245) Updating files: 37% (91/245) Updating files: 38% (94/245) Updating files: 39% (96/245) Updating files: 40% (98/245) Updating files: 41% (101/245) Updating files: 42% (103/245) Updating files: 43% (106/245) Updating files: 44% (108/245) Updating files: 45% (111/245) Updating files: 46% (113/245) Updating files: 47% (116/245) Updating files: 48% (118/245) Updating files: 49% (121/245) Updating files: 50% (123/245) Updating files: 51% (125/245) Updating files: 52% (128/245) Updating files: 53% (130/245) Updating files: 54% (133/245) Updating files: 55% (135/245) Updating files: 56% (138/245) Updating files: 57% (140/245) Updating files: 58% (143/245) Updating files: 59% (145/245) Updating files: 60% (147/245) Updating files: 61% (150/245) Updating files: 61% (151/245) Updating files: 62% (152/245) Updating files: 63% (155/245) Updating files: 64% (157/245) Updating files: 65% (160/245) Updating files: 66% (162/245) Updating files: 67% (165/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 73% (181/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 76% (187/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 88% (216/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2023-11-28T20:52:48.697 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 1dd420957f9 journal: detect size of raw block devices properly 2023-11-28T20:52:48.703 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.5 2023-11-28T20:52:49.476 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 6 -eq 48 ] 2023-11-28T20:52:49.476 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.6 2023-11-28T20:52:49.476 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.6 2023-11-28T20:52:49.476 INFO:tasks.workunit.client.0.smithi167.stdout:v0.6 2023-11-28T20:52:49.476 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.6 2023-11-28T20:52:50.637 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:50.641 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:52.308 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 3% (9/227) Updating files: 4% (10/227) Updating files: 5% (12/227) Updating files: 6% (14/227) Updating files: 7% (16/227) Updating files: 8% (19/227) Updating files: 9% (21/227) Updating files: 10% (23/227) Updating files: 11% (25/227) Updating files: 12% (28/227) Updating files: 13% (30/227) Updating files: 14% (32/227) Updating files: 15% (35/227) Updating files: 16% (37/227) Updating files: 17% (39/227) Updating files: 18% (41/227) Updating files: 19% (44/227) Updating files: 20% (46/227) Updating files: 21% (48/227) Updating files: 22% (50/227) Updating files: 23% (53/227) Updating files: 24% (55/227) Updating files: 25% (57/227) Updating files: 26% (60/227) Updating files: 27% (62/227) Updating files: 28% (64/227) Updating files: 29% (66/227) Updating files: 30% (69/227) Updating files: 31% (71/227) Updating files: 32% (73/227) Updating files: 33% (75/227) Updating files: 34% (78/227) Updating files: 35% (80/227) Updating files: 36% (82/227) Updating files: 37% (84/227) Updating files: 38% (87/227) Updating files: 39% (89/227) Updating files: 40% (91/227) Updating files: 41% (94/227) Updating files: 42% (96/227) Updating files: 43% (98/227) Updating files: 44% (100/227) Updating files: 45% (103/227) Updating files: 46% (105/227) Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 59% (135/227) Updating files: 60% (137/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2023-11-28T20:52:52.411 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at a4c752df713 v0.6 2023-11-28T20:52:52.419 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.6 2023-11-28T20:52:52.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 7 -eq 48 ] 2023-11-28T20:53:01.470 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.7 2023-11-28T20:53:01.470 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.7 2023-11-28T20:53:01.471 INFO:tasks.workunit.client.0.smithi167.stdout:v0.7 2023-11-28T20:53:01.473 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:53:01.473 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2023-11-28T20:53:01.473 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T20:53:01.473 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T20:53:01.479 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.7 2023-11-28T20:53:01.515 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 18% (37/201) Updating files: 19% (39/201) Updating files: 20% (41/201) Updating files: 21% (43/201) Updating files: 22% (45/201) Updating files: 23% (47/201) Updating files: 24% (49/201) Updating files: 25% (51/201) Updating files: 26% (53/201) Updating files: 27% (55/201) Updating files: 28% (57/201) Updating files: 29% (59/201) Updating files: 30% (61/201) Updating files: 31% (63/201) Updating files: 32% (65/201) Updating files: 33% (67/201) Updating files: 34% (69/201) Updating files: 35% (71/201) Updating files: 36% (73/201) Updating files: 37% (75/201) Updating files: 38% (77/201) Updating files: 39% (79/201) Updating files: 40% (81/201) Updating files: 41% (83/201) Updating files: 42% (85/201) Updating files: 43% (87/201) Updating files: 44% (89/201) Updating files: 45% (91/201) Updating files: 46% (93/201) Updating files: 47% (95/201) Updating files: 48% (97/201) Updating files: 49% (99/201) Updating files: 50% (101/201) Updating files: 51% (103/201) Updating files: 52% (105/201) Updating files: 53% (107/201) Updating files: 54% (109/201) Updating files: 55% (111/201) Updating files: 56% (113/201) Updating files: 57% (115/201) Updating files: 58% (117/201) Updating files: 59% (119/201) Updating files: 60% (121/201) Updating files: 61% (123/201) Updating files: 62% (125/201) Updating files: 63% (127/201) Updating files: 64% (129/201) Updating files: 65% (131/201) Updating files: 66% (133/201) Updating files: 67% (135/201) Updating files: 68% (137/201) Updating files: 69% (139/201) Updating files: 70% (141/201) Updating files: 71% (143/201) Updating files: 72% (145/201) Updating files: 73% (147/201) Updating files: 74% (149/201) Updating files: 75% (151/201) Updating files: 76% (153/201) Updating files: 77% (155/201) Updating files: 78% (157/201) Updating files: 79% (159/201) Updating files: 80% (161/201) Updating files: 81% (163/201) Updating files: 82% (165/201) Updating files: 83% (167/201) Updating files: 84% (169/201) Updating files: 85% (171/201) Updating files: 86% (173/201) Updating files: 87% (175/201) Updating files: 88% (177/201) Updating files: 89% (179/201) Updating files: 90% (181/201) Updating files: 91% (183/201) Updating files: 92% (185/201) Updating files: 93% (187/201) Updating files: 94% (189/201) Updating files: 95% (191/201) Updating files: 96% (193/201) Updating files: 97% (195/201) Updating files: 98% (197/201) Updating files: 99% (199/201) Updating files: 100% (201/201) Updating files: 100% (201/201), done. 2023-11-28T20:53:01.516 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at c46e1b320c6 mkcephfs: btrfsctl -a between mkfs and mount 2023-11-28T20:53:01.516 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.7 2023-11-28T20:53:01.517 INFO:tasks.workunit.client.0.smithi167.stdout:v0.8 2023-11-28T20:53:01.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 8 -eq 48 ] 2023-11-28T20:53:01.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.8 2023-11-28T20:53:01.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.8 2023-11-28T20:53:01.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.8 2023-11-28T20:53:01.523 INFO:tasks.ceph.mon.a:Started 2023-11-28T20:53:01.523 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:53:01.523 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:01.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f99592c8640 1 Processor -- start 2023-11-28T20:53:01.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f99592c8640 1 -- start start 2023-11-28T20:53:01.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f99592c8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f99540ccb70 0x7f995415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:01.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f99592c8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99540cfef0 con 0x7f9954153db0 2023-11-28T20:53:01.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f99592c8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99540cc6e0 con 0x7f99540cf440 2023-11-28T20:53:01.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f99592c8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9954154190 con 0x7f99540ccb70 2023-11-28T20:53:01.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f9953fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9954153db0 0x7f99540c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:41494/0 (socket says 172.21.15.167:41494) 2023-11-28T20:53:01.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f9953fff640 1 -- 172.21.15.167:0/1340787878 learned_addr learned my addr 172.21.15.167:0/1340787878 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:53:01.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f994bfff640 1 --2- 172.21.15.167:0/1340787878 >> v2:172.21.15.178:3300/0 conn(0x7f99540ccb70 0x7f995415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:01.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f99537fe640 1 -- 172.21.15.167:0/1340787878 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435883091 0 0) 0x7f99540cc6e0 con 0x7f99540cf440 2023-11-28T20:53:01.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f99537fe640 1 -- 172.21.15.167:0/1340787878 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9940003530 con 0x7f99540cf440 2023-11-28T20:53:01.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f994bfff640 1 -- 172.21.15.167:0/1340787878 >> v1:172.21.15.178:6789/0 conn(0x7f99540cf440 legacy=0x7f99540ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:01.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f994bfff640 1 -- 172.21.15.167:0/1340787878 >> v1:172.21.15.167:6789/0 conn(0x7f9954153db0 legacy=0x7f99540c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:01.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.679+0000 7f994bfff640 1 -- 172.21.15.167:0/1340787878 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540cbad0 con 0x7f99540ccb70 2023-11-28T20:53:01.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.683+0000 7f994bfff640 1 --2- 172.21.15.167:0/1340787878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99540ccb70 0x7f995415a540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f993c0097c0 tx=0x7f993c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f981f6a7a0cf658 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:01.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.683+0000 7f99537fe640 1 -- 172.21.15.167:0/1340787878 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c0ab600 con 0x7f99540ccb70 2023-11-28T20:53:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.683+0000 7f99537fe640 1 -- 172.21.15.167:0/1340787878 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c0a7050 con 0x7f99540ccb70 2023-11-28T20:53:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.683+0000 7f99537fe640 1 -- 172.21.15.167:0/1340787878 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c0ab980 con 0x7f99540ccb70 2023-11-28T20:53:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 -- 172.21.15.167:0/1340787878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99540ccb70 msgr2=0x7f995415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 --2- 172.21.15.167:0/1340787878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99540ccb70 0x7f995415a540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f993c0097c0 tx=0x7f993c01c480 comp rx=0 tx=0).stop 2023-11-28T20:53:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 -- 172.21.15.167:0/1340787878 shutdown_connections 2023-11-28T20:53:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 --2- 172.21.15.167:0/1340787878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99540ccb70 0x7f995415a540 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 -- 172.21.15.167:0/1340787878 >> 172.21.15.167:0/1340787878 conn(0x7f995406b800 msgr2=0x7f995406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 -- 172.21.15.167:0/1340787878 shutdown_connections 2023-11-28T20:53:01.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 -- 172.21.15.167:0/1340787878 wait complete. 2023-11-28T20:53:01.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 Processor -- start 2023-11-28T20:53:01.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 -- start start 2023-11-28T20:53:01.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 0x7f99541589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:01.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540cf440 0x7f9954155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:01.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9954153db0 0x7f995415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:01.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995415d6d0 con 0x7f99540ccb70 2023-11-28T20:53:01.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9954154380 con 0x7f9954153db0 2023-11-28T20:53:01.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f99592c8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9954155390 con 0x7f99540cf440 2023-11-28T20:53:01.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f9953fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 0x7f99541589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:01.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f9953fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 0x7f99541589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50860/0 (socket says 172.21.15.167:50860) 2023-11-28T20:53:01.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f9953fff640 1 -- 172.21.15.167:0/2185607873 learned_addr learned my addr 172.21.15.167:0/2185607873 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:01.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f9958ac7640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9954153db0 0x7f995415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:01.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f994bfff640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540cf440 0x7f9954155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f9953fff640 1 -- 172.21.15.167:0/2185607873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 msgr2=0x7f99541589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f9953fff640 1 -- 172.21.15.167:0/2185607873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 msgr2=0x7f99541589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f9953fff640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 0x7f99541589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.687+0000 7f9953fff640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 0x7f99541589c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f994bfff640 1 -- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9954153db0 msgr2=0x7f995415c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f994bfff640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9954153db0 0x7f995415c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f994bfff640 1 -- 172.21.15.167:0/2185607873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 msgr2=0x7f99541589c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f994bfff640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 0x7f99541589c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f994bfff640 1 -- 172.21.15.167:0/2185607873 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c009420 con 0x7f99540cf440 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f994bfff640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540cf440 0x7f9954155640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f993c0ab000 tx=0x7f993c019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:01.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f99517fa640 1 -- 172.21.15.167:0/2185607873 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c0b4610 con 0x7f99540cf440 2023-11-28T20:53:01.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f99517fa640 1 -- 172.21.15.167:0/2185607873 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c0b4770 con 0x7f99540cf440 2023-11-28T20:53:01.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99541f7010 con 0x7f99540cf440 2023-11-28T20:53:01.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f99517fa640 1 -- 172.21.15.167:0/2185607873 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c0b4b20 con 0x7f99540cf440 2023-11-28T20:53:01.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99541548b0 con 0x7f99540cf440 2023-11-28T20:53:01.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.691+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995404e850 con 0x7f99540cf440 2023-11-28T20:53:01.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.695+0000 7f99517fa640 1 -- 172.21.15.167:0/2185607873 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f993c0b2040 con 0x7f99540cf440 2023-11-28T20:53:01.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.695+0000 7f99517fa640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9934066470 0x7f9934068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:01.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.695+0000 7f99517fa640 1 -- 172.21.15.167:0/2185607873 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f993c11e520 con 0x7f99540cf440 2023-11-28T20:53:01.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.695+0000 7f9953fff640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9934066470 0x7f9934068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:01.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.695+0000 7f9953fff640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9934066470 0x7f9934068930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9944005890 tx=0x7f9944009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:01.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.707+0000 7f99517fa640 1 -- 172.21.15.167:0/2185607873 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f993c0eb6f0 con 0x7f99540cf440 2023-11-28T20:53:01.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.907+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f995414de40 con 0x7f99540cf440 2023-11-28T20:53:01.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99517fa640 1 -- 172.21.15.167:0/2185607873 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f993c0c2620 con 0x7f99540cf440 2023-11-28T20:53:01.912 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":116,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:01.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9934066470 msgr2=0x7f9934068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:01.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9934066470 0x7f9934068930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9944005890 tx=0x7f9944009040 comp rx=0 tx=0).stop 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540cf440 msgr2=0x7f9954155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540cf440 0x7f9954155640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f993c0ab000 tx=0x7f993c019220 comp rx=0 tx=0).stop 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 shutdown_connections 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9934066470 0x7f9934068930 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9954153db0 0x7f995415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540cf440 0x7f9954155640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 --2- 172.21.15.167:0/2185607873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99540ccb70 0x7f99541589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 >> 172.21.15.167:0/2185607873 conn(0x7f995406b800 msgr2=0x7f99540cb090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 shutdown_connections 2023-11-28T20:53:01.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:01.911+0000 7f99592c8640 1 -- 172.21.15.167:0/2185607873 wait complete. 2023-11-28T20:53:04.934 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:05.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.071+0000 7f9147780640 1 Processor -- start 2023-11-28T20:53:05.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.071+0000 7f9147780640 1 -- start start 2023-11-28T20:53:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9147780640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9140150b40 0x7f9140157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9147780640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 0x7f914006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9147780640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91400c48f0 con 0x7f91400c6ff0 2023-11-28T20:53:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9147780640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400c62f0 con 0x7f91400c4510 2023-11-28T20:53:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9147780640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400c6ac0 con 0x7f9140150b40 2023-11-28T20:53:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9145d1d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 0x7f914006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9145d1d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 0x7f914006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50032/0 (socket says 172.21.15.167:50032) 2023-11-28T20:53:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9145d1d640 1 -- 172.21.15.167:0/70988186 learned_addr learned my addr 172.21.15.167:0/70988186 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9145d1d640 1 -- 172.21.15.167:0/70988186 >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 msgr2=0x7f914006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:53:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9145d1d640 1 -- 172.21.15.167:0/70988186 >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 msgr2=0x7f914006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:53:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9145d1d640 1 --2- 172.21.15.167:0/70988186 >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 0x7f914006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f914551c640 1 --2- 172.21.15.167:0/70988186 >> v2:172.21.15.178:3300/0 conn(0x7f9140150b40 0x7f9140157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:05.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f9145d1d640 1 --2- 172.21.15.167:0/70988186 >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 0x7f914006a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:05.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f914551c640 1 -- 172.21.15.167:0/70988186 >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 msgr2=0x7f914006a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:05.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f914551c640 1 --2- 172.21.15.167:0/70988186 >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 0x7f914006a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:05.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f914551c640 1 -- 172.21.15.167:0/70988186 >> v1:172.21.15.178:6789/0 conn(0x7f91400c6ff0 legacy=0x7f91400c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:05.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.075+0000 7f914551c640 1 -- 172.21.15.167:0/70988186 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91400c6500 con 0x7f9140150b40 2023-11-28T20:53:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f914551c640 1 --2- 172.21.15.167:0/70988186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9140150b40 0x7f9140157560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91400cc090 tx=0x7f913c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4be56a7955ce4812 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9137fff640 1 -- 172.21.15.167:0/70988186 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0ab600 con 0x7f9140150b40 2023-11-28T20:53:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9137fff640 1 -- 172.21.15.167:0/70988186 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c0a7050 con 0x7f9140150b40 2023-11-28T20:53:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9137fff640 1 -- 172.21.15.167:0/70988186 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0ab980 con 0x7f9140150b40 2023-11-28T20:53:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 -- 172.21.15.167:0/70988186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9140150b40 msgr2=0x7f9140157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 --2- 172.21.15.167:0/70988186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9140150b40 0x7f9140157560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91400cc090 tx=0x7f913c01c430 comp rx=0 tx=0).stop 2023-11-28T20:53:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 -- 172.21.15.167:0/70988186 shutdown_connections 2023-11-28T20:53:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 --2- 172.21.15.167:0/70988186 >> v2:172.21.15.167:3300/0 conn(0x7f91400c4510 0x7f914006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 --2- 172.21.15.167:0/70988186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9140150b40 0x7f9140157560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 -- 172.21.15.167:0/70988186 >> 172.21.15.167:0/70988186 conn(0x7f91400cb1e0 msgr2=0x7f91400cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 -- 172.21.15.167:0/70988186 shutdown_connections 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 -- 172.21.15.167:0/70988186 wait complete. 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 Processor -- start 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 -- start start 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 0x7f9140158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91400c6ff0 0x7f9140157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9140150b40 0x7f9140159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.079+0000 7f9147780640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401f2570 con 0x7f91400c4510 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9147780640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401f27e0 con 0x7f91400c6ff0 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9147780640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91401f2ac0 con 0x7f9140150b40 2023-11-28T20:53:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f914551c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 0x7f9140158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:05.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f914551c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 0x7f9140158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50040/0 (socket says 172.21.15.167:50040) 2023-11-28T20:53:05.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f914551c640 1 -- 172.21.15.167:0/712324108 learned_addr learned my addr 172.21.15.167:0/712324108 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:05.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f914551c640 1 -- 172.21.15.167:0/712324108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 msgr2=0x7f9140158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:53:05.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f914551c640 1 -- 172.21.15.167:0/712324108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 msgr2=0x7f9140158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:53:05.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f914551c640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 0x7f9140158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:05.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9144d1b640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91400c6ff0 0x7f9140157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:05.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9145d1d640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9140150b40 0x7f9140159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:05.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f914551c640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 0x7f9140158b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:05.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9144d1b640 1 -- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9140150b40 msgr2=0x7f9140159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9144d1b640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9140150b40 0x7f9140159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9144d1b640 1 -- 172.21.15.167:0/712324108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 msgr2=0x7f9140158b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9144d1b640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 0x7f9140158b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9144d1b640 1 -- 172.21.15.167:0/712324108 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c009420 con 0x7f91400c6ff0 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9144d1b640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91400c6ff0 0x7f9140157f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f913000c390 tx=0x7f913000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9135ffb640 1 -- 172.21.15.167:0/712324108 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91300052d0 con 0x7f91400c6ff0 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91401f2da0 con 0x7f91400c6ff0 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9135ffb640 1 -- 172.21.15.167:0/712324108 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130005430 con 0x7f91400c6ff0 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9135ffb640 1 -- 172.21.15.167:0/712324108 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130003860 con 0x7f91400c6ff0 2023-11-28T20:53:05.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91401f3360 con 0x7f91400c6ff0 2023-11-28T20:53:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.083+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91400682c0 con 0x7f91400c6ff0 2023-11-28T20:53:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.087+0000 7f9135ffb640 1 -- 172.21.15.167:0/712324108 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91300039c0 con 0x7f91400c6ff0 2023-11-28T20:53:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.087+0000 7f9135ffb640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9124066470 0x7f9124068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.087+0000 7f9135ffb640 1 -- 172.21.15.167:0/712324108 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9130083c60 con 0x7f91400c6ff0 2023-11-28T20:53:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.087+0000 7f914551c640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9124066470 0x7f9124068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:05.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.087+0000 7f914551c640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9124066470 0x7f9124068930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f913c01c470 tx=0x7f913c0ad040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:05.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.095+0000 7f9135ffb640 1 -- 172.21.15.167:0/712324108 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9130050d10 con 0x7f91400c6ff0 2023-11-28T20:53:05.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.299+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9140075c90 con 0x7f91400c6ff0 2023-11-28T20:53:05.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.299+0000 7f9135ffb640 1 -- 172.21.15.167:0/712324108 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f9130017020 con 0x7f91400c6ff0 2023-11-28T20:53:05.302 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":116,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":26,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:05.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9124066470 msgr2=0x7f9124068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:05.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9124066470 0x7f9124068930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f913c01c470 tx=0x7f913c0ad040 comp rx=0 tx=0).stop 2023-11-28T20:53:05.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91400c6ff0 msgr2=0x7f9140157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:05.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91400c6ff0 0x7f9140157f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f913000c390 tx=0x7f913000c850 comp rx=0 tx=0).stop 2023-11-28T20:53:05.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 shutdown_connections 2023-11-28T20:53:05.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9124066470 0x7f9124068930 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:05.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9140150b40 0x7f9140159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:05.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91400c6ff0 0x7f9140157f50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:05.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 --2- 172.21.15.167:0/712324108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91400c4510 0x7f9140158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:05.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 >> 172.21.15.167:0/712324108 conn(0x7f91400cb1e0 msgr2=0x7f91400cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:05.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 shutdown_connections 2023-11-28T20:53:05.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:05.303+0000 7f9147780640 1 -- 172.21.15.167:0/712324108 wait complete. 2023-11-28T20:53:08.324 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f5625032640 1 Processor -- start 2023-11-28T20:53:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f5625032640 1 -- start start 2023-11-28T20:53:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f5625032640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 0x7f56201500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f5625032640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5620072630 0x7f56201505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f5625032640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56201571d0 con 0x7f5620070480 2023-11-28T20:53:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f5625032640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5620071a90 con 0x7f562006e030 2023-11-28T20:53:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f5625032640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56200c70d0 con 0x7f5620072630 2023-11-28T20:53:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561ed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 0x7f56201500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561ed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 0x7f56201500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50052/0 (socket says 172.21.15.167:50052) 2023-11-28T20:53:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561ed9d640 1 -- 172.21.15.167:0/1655868865 learned_addr learned my addr 172.21.15.167:0/1655868865 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561e59c640 1 --1- 172.21.15.167:0/1655868865 >> v1:172.21.15.167:6789/0 conn(0x7f5620070480 0x7f5620071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53986/0 (socket says 172.21.15.167:53986) 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561ed9d640 1 -- 172.21.15.167:0/1655868865 >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 msgr2=0x7f56201500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561ed9d640 1 -- 172.21.15.167:0/1655868865 >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 msgr2=0x7f56201500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561f59e640 1 --2- 172.21.15.167:0/1655868865 >> v2:172.21.15.178:3300/0 conn(0x7f5620072630 0x7f56201505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561ed9d640 1 --2- 172.21.15.167:0/1655868865 >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 0x7f56201500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561ed9d640 1 --2- 172.21.15.167:0/1655868865 >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 0x7f56201500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561f59e640 1 -- 172.21.15.167:0/1655868865 >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 msgr2=0x7f56201500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561f59e640 1 --2- 172.21.15.167:0/1655868865 >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 0x7f56201500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561f59e640 1 -- 172.21.15.167:0/1655868865 >> v1:172.21.15.167:6789/0 conn(0x7f5620070480 legacy=0x7f5620071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.471+0000 7f561f59e640 1 -- 172.21.15.167:0/1655868865 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56200c73b0 con 0x7f5620072630 2023-11-28T20:53:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f561f59e640 1 --2- 172.21.15.167:0/1655868865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620072630 0x7f56201505f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f562006c280 tx=0x7f561801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a89a888350893900 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f561dd9b640 1 -- 172.21.15.167:0/1655868865 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56180a59a0 con 0x7f5620072630 2023-11-28T20:53:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f561dd9b640 1 -- 172.21.15.167:0/1655868865 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56180a5b00 con 0x7f5620072630 2023-11-28T20:53:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f561dd9b640 1 -- 172.21.15.167:0/1655868865 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56180a5e90 con 0x7f5620072630 2023-11-28T20:53:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f5625032640 1 -- 172.21.15.167:0/1655868865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620072630 msgr2=0x7f56201505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f5625032640 1 --2- 172.21.15.167:0/1655868865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620072630 0x7f56201505f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f562006c280 tx=0x7f561801c8e0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f5625032640 1 -- 172.21.15.167:0/1655868865 shutdown_connections 2023-11-28T20:53:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f5625032640 1 --2- 172.21.15.167:0/1655868865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620072630 0x7f56201505f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f5625032640 1 --2- 172.21.15.167:0/1655868865 >> v2:172.21.15.167:3300/0 conn(0x7f562006e030 0x7f56201500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f5625032640 1 -- 172.21.15.167:0/1655868865 >> 172.21.15.167:0/1655868865 conn(0x7f56200cb1e0 msgr2=0x7f56200cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:08.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f5625032640 1 -- 172.21.15.167:0/1655868865 shutdown_connections 2023-11-28T20:53:08.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.475+0000 7f5625032640 1 -- 172.21.15.167:0/1655868865 wait complete. 2023-11-28T20:53:08.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 Processor -- start 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 -- start start 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006e030 0x7f562013f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620070480 0x7f56201f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 0x7f56201f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56201548c0 con 0x7f5620072630 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5620155400 con 0x7f5620070480 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5620155890 con 0x7f562006e030 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 0x7f56201f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 0x7f56201f2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50068/0 (socket says 172.21.15.167:50068) 2023-11-28T20:53:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561f59e640 1 -- 172.21.15.167:0/4164809250 learned_addr learned my addr 172.21.15.167:0/4164809250 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561e59c640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620070480 0x7f56201f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561f59e640 1 -- 172.21.15.167:0/4164809250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 msgr2=0x7f56201f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:53:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561f59e640 1 -- 172.21.15.167:0/4164809250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 msgr2=0x7f56201f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:53:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561f59e640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 0x7f56201f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561ed9d640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006e030 0x7f562013f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561f59e640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 0x7f56201f2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561e59c640 1 -- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006e030 msgr2=0x7f562013f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561e59c640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006e030 0x7f562013f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561e59c640 1 -- 172.21.15.167:0/4164809250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 msgr2=0x7f56201f2350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561e59c640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 0x7f56201f2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561e59c640 1 -- 172.21.15.167:0/4164809250 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5618009a70 con 0x7f5620070480 2023-11-28T20:53:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f561e59c640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620070480 0x7f56201f1e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f561400c3c0 tx=0x7f561400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f56077fe640 1 -- 172.21.15.167:0/4164809250 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56140074e0 con 0x7f5620070480 2023-11-28T20:53:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562014d490 con 0x7f5620070480 2023-11-28T20:53:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f56077fe640 1 -- 172.21.15.167:0/4164809250 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5614007640 con 0x7f5620070480 2023-11-28T20:53:08.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f56077fe640 1 -- 172.21.15.167:0/4164809250 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5614004a10 con 0x7f5620070480 2023-11-28T20:53:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.479+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5620154db0 con 0x7f5620070480 2023-11-28T20:53:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.483+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56200682c0 con 0x7f5620070480 2023-11-28T20:53:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.483+0000 7f56077fe640 1 -- 172.21.15.167:0/4164809250 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5614004b70 con 0x7f5620070480 2023-11-28T20:53:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.483+0000 7f56077fe640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f560c0664a0 0x7f560c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.483+0000 7f56077fe640 1 -- 172.21.15.167:0/4164809250 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5614084410 con 0x7f5620070480 2023-11-28T20:53:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.483+0000 7f561ed9d640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f560c0664a0 0x7f560c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.487+0000 7f561ed9d640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f560c0664a0 0x7f560c068960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f561000a140 tx=0x7f561000f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:08.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.495+0000 7f56077fe640 1 -- 172.21.15.167:0/4164809250 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5614051370 con 0x7f5620070480 2023-11-28T20:53:08.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.695+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f56201555b0 con 0x7f5620070480 2023-11-28T20:53:08.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f56077fe640 1 -- 172.21.15.167:0/4164809250 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f56201555b0 con 0x7f5620070480 2023-11-28T20:53:08.701 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":116,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":30,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f560c0664a0 msgr2=0x7f560c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f560c0664a0 0x7f560c068960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f561000a140 tx=0x7f561000f040 comp rx=0 tx=0).stop 2023-11-28T20:53:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620070480 msgr2=0x7f56201f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620070480 0x7f56201f1e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f561400c3c0 tx=0x7f561400c880 comp rx=0 tx=0).stop 2023-11-28T20:53:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 shutdown_connections 2023-11-28T20:53:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f560c0664a0 0x7f560c068960 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5620072630 0x7f56201f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5620070480 0x7f56201f1e10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 --2- 172.21.15.167:0/4164809250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006e030 0x7f562013f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 >> 172.21.15.167:0/4164809250 conn(0x7f56200cb1e0 msgr2=0x7f56200cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 shutdown_connections 2023-11-28T20:53:08.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:08.699+0000 7f5625032640 1 -- 172.21.15.167:0/4164809250 wait complete. 2023-11-28T20:53:11.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d929d1640 1 Processor -- start 2023-11-28T20:53:11.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d929d1640 1 -- start start 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d929d1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 0x7f7d8c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d929d1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7d8c072630 0x7f7d8c1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d929d1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c1571d0 con 0x7f7d8c070480 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d929d1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c071a90 con 0x7f7d8c06e030 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d929d1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c70d0 con 0x7f7d8c072630 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d8bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 0x7f7d8c1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d8bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 0x7f7d8c1500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50082/0 (socket says 172.21.15.167:50082) 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d8bfff640 1 -- 172.21.15.167:0/1076908224 learned_addr learned my addr 172.21.15.167:0/1076908224 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d90f6e640 1 --2- 172.21.15.167:0/1076908224 >> v2:172.21.15.178:3300/0 conn(0x7f7d8c072630 0x7f7d8c1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:11.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d8bfff640 1 -- 172.21.15.167:0/1076908224 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 msgr2=0x7f7d8c1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:53:11.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d8bfff640 1 -- 172.21.15.167:0/1076908224 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 msgr2=0x7f7d8c1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:53:11.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d8bfff640 1 --2- 172.21.15.167:0/1076908224 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 0x7f7d8c1500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:11.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.863+0000 7f7d8bfff640 1 --2- 172.21.15.167:0/1076908224 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 0x7f7d8c1500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:11.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.867+0000 7f7d90f6e640 1 -- 172.21.15.167:0/1076908224 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 msgr2=0x7f7d8c1500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:11.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.867+0000 7f7d90f6e640 1 --2- 172.21.15.167:0/1076908224 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 0x7f7d8c1500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.867+0000 7f7d90f6e640 1 -- 172.21.15.167:0/1076908224 >> v1:172.21.15.178:6789/0 conn(0x7f7d8c070480 legacy=0x7f7d8c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.867+0000 7f7d8affd640 1 -- 172.21.15.167:0/1076908224 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462717810 0 0) 0x7f7d8c1571d0 con 0x7f7d8c070480 2023-11-28T20:53:11.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.867+0000 7f7d90f6e640 1 -- 172.21.15.167:0/1076908224 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c0c73b0 con 0x7f7d8c072630 2023-11-28T20:53:11.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.867+0000 7f7d90f6e640 1 --2- 172.21.15.167:0/1076908224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d8c072630 0x7f7d8c1505f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c06c280 tx=0x7f7d8401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1dff478e4d90790 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:11.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.867+0000 7f7d8affd640 1 -- 172.21.15.167:0/1076908224 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a5890 con 0x7f7d8c072630 2023-11-28T20:53:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.867+0000 7f7d8affd640 1 -- 172.21.15.167:0/1076908224 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840a59f0 con 0x7f7d8c072630 2023-11-28T20:53:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.867+0000 7f7d8affd640 1 -- 172.21.15.167:0/1076908224 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a5d80 con 0x7f7d8c072630 2023-11-28T20:53:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 -- 172.21.15.167:0/1076908224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d8c072630 msgr2=0x7f7d8c1505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 --2- 172.21.15.167:0/1076908224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d8c072630 0x7f7d8c1505f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c06c280 tx=0x7f7d8401c8e0 comp rx=0 tx=0).stop 2023-11-28T20:53:11.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 -- 172.21.15.167:0/1076908224 shutdown_connections 2023-11-28T20:53:11.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 --2- 172.21.15.167:0/1076908224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d8c072630 0x7f7d8c1505f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:11.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 --2- 172.21.15.167:0/1076908224 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c06e030 0x7f7d8c1500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:11.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 -- 172.21.15.167:0/1076908224 >> 172.21.15.167:0/1076908224 conn(0x7f7d8c0cb1e0 msgr2=0x7f7d8c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:11.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 -- 172.21.15.167:0/1076908224 shutdown_connections 2023-11-28T20:53:11.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 -- 172.21.15.167:0/1076908224 wait complete. 2023-11-28T20:53:11.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 Processor -- start 2023-11-28T20:53:11.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 -- start start 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 0x7f7d8c162c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d8c070480 0x7f7d8c0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d8c072630 0x7f7d8c145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c14d990 con 0x7f7d8c06e030 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c1631d0 con 0x7f7d8c070480 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d929d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c146f70 con 0x7f7d8c072630 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 0x7f7d8c162c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 0x7f7d8c162c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50084/0 (socket says 172.21.15.167:50084) 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d8bfff640 1 -- 172.21.15.167:0/1748901445 learned_addr learned my addr 172.21.15.167:0/1748901445 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d8b7fe640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d8c070480 0x7f7d8c0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d8bfff640 1 -- 172.21.15.167:0/1748901445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 msgr2=0x7f7d8c162c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:53:11.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d8bfff640 1 -- 172.21.15.167:0/1748901445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 msgr2=0x7f7d8c162c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:53:11.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d8bfff640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 0x7f7d8c162c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:11.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.871+0000 7f7d90f6e640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d8c072630 0x7f7d8c145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:11.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d8bfff640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 0x7f7d8c162c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:11.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d90f6e640 1 -- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d8c070480 msgr2=0x7f7d8c0c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:11.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d90f6e640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d8c070480 0x7f7d8c0c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:11.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d90f6e640 1 -- 172.21.15.167:0/1748901445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 msgr2=0x7f7d8c162c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:11.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d90f6e640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 0x7f7d8c162c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:11.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d90f6e640 1 -- 172.21.15.167:0/1748901445 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84009a70 con 0x7f7d8c072630 2023-11-28T20:53:11.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d90f6e640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d8c072630 0x7f7d8c145240 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d840ac000 tx=0x7f7d84019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:11.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d88ff9640 1 -- 172.21.15.167:0/1748901445 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840ad850 con 0x7f7d8c072630 2023-11-28T20:53:11.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d88ff9640 1 -- 172.21.15.167:0/1748901445 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840ad9b0 con 0x7f7d8c072630 2023-11-28T20:53:11.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c147850 con 0x7f7d8c072630 2023-11-28T20:53:11.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d88ff9640 1 -- 172.21.15.167:0/1748901445 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840adda0 con 0x7f7d8c072630 2023-11-28T20:53:11.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c0c9880 con 0x7f7d8c072630 2023-11-28T20:53:11.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c0682c0 con 0x7f7d8c072630 2023-11-28T20:53:11.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.875+0000 7f7d88ff9640 1 -- 172.21.15.167:0/1748901445 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d840b4070 con 0x7f7d8c072630 2023-11-28T20:53:11.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.879+0000 7f7d88ff9640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7d78066470 0x7f7d78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:11.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.879+0000 7f7d88ff9640 1 -- 172.21.15.167:0/1748901445 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7d8411e7d0 con 0x7f7d8c072630 2023-11-28T20:53:11.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.879+0000 7f7d8bfff640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7d78066470 0x7f7d78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:11.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.879+0000 7f7d8bfff640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7d78066470 0x7f7d78068930 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0091d0 tx=0x7f7d7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:11.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:11.891+0000 7f7d88ff9640 1 -- 172.21.15.167:0/1748901445 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d840eb910 con 0x7f7d8c072630 2023-11-28T20:53:12.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.103+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7d8c147850 con 0x7f7d8c072630 2023-11-28T20:53:12.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d88ff9640 1 -- 172.21.15.167:0/1748901445 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f7d840c7620 con 0x7f7d8c072630 2023-11-28T20:53:12.108 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":116,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":33,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:12.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7d78066470 msgr2=0x7f7d78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:12.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7d78066470 0x7f7d78068930 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0091d0 tx=0x7f7d7c008040 comp rx=0 tx=0).stop 2023-11-28T20:53:12.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d8c072630 msgr2=0x7f7d8c145240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:12.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d8c072630 0x7f7d8c145240 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d840ac000 tx=0x7f7d84019680 comp rx=0 tx=0).stop 2023-11-28T20:53:12.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 shutdown_connections 2023-11-28T20:53:12.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7d78066470 0x7f7d78068930 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:12.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d8c072630 0x7f7d8c145240 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:12.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d8c070480 0x7f7d8c0c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:12.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 --2- 172.21.15.167:0/1748901445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c06e030 0x7f7d8c162c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:12.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 >> 172.21.15.167:0/1748901445 conn(0x7f7d8c0cb1e0 msgr2=0x7f7d8c071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:12.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 shutdown_connections 2023-11-28T20:53:12.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:12.107+0000 7f7d929d1640 1 -- 172.21.15.167:0/1748901445 wait complete. 2023-11-28T20:53:13.810 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 4% (10/225) Updating files: 5% (12/225) Updating files: 6% (14/225) Updating files: 7% (16/225) Updating files: 8% (18/225) Updating files: 9% (21/225) Updating files: 10% (23/225) Updating files: 11% (25/225) Updating files: 12% (27/225) Updating files: 13% (30/225) Updating files: 14% (32/225) Updating files: 15% (34/225) Updating files: 16% (36/225) Updating files: 17% (39/225) Updating files: 18% (41/225) Updating files: 19% (43/225) Updating files: 20% (45/225) Updating files: 21% (48/225) Updating files: 22% (50/225) Updating files: 23% (52/225) Updating files: 24% (54/225) Updating files: 25% (57/225) Updating files: 26% (59/225) Updating files: 27% (61/225) Updating files: 28% (63/225) Updating files: 29% (66/225) Updating files: 30% (68/225) Updating files: 31% (70/225) Updating files: 32% (72/225) Updating files: 33% (75/225) Updating files: 34% (77/225) Updating files: 35% (79/225) Updating files: 35% (80/225) Updating files: 36% (81/225) Updating files: 37% (84/225) Updating files: 38% (86/225) Updating files: 39% (88/225) Updating files: 40% (90/225) Updating files: 41% (93/225) Updating files: 42% (95/225) Updating files: 43% (97/225) Updating files: 44% (99/225) Updating files: 45% (102/225) Updating files: 46% (104/225) Updating files: 47% (106/225) Updating files: 48% (108/225) Updating files: 49% (111/225) Updating files: 50% (113/225) Updating files: 51% (115/225) Updating files: 52% (117/225) Updating files: 53% (120/225) Updating files: 54% (122/225) Updating files: 55% (124/225) Updating files: 56% (126/225) Updating files: 57% (129/225) Updating files: 58% (131/225) Updating files: 59% (133/225) Updating files: 60% (135/225) Updating files: 61% (138/225) Updating files: 62% (140/225) Updating files: 63% (142/225) Updating files: 64% (144/225) Updating files: 65% (147/225) Updating files: 66% (149/225) Updating files: 67% (151/225) Updating files: 68% (153/225) Updating files: 69% (156/225) Updating files: 70% (158/225) Updating files: 71% (160/225) Updating files: 72% (162/225) Updating files: 73% (165/225) Updating files: 74% (167/225) Updating files: 74% (168/225) Updating files: 75% (169/225) Updating files: 76% (171/225) Updating files: 77% (174/225) Updating files: 78% (176/225) Updating files: 79% (178/225) Updating files: 80% (180/225) Updating files: 81% (183/225) Updating files: 82% (185/225) Updating files: 83% (187/225) Updating files: 84% (189/225) Updating files: 85% (192/225) Updating files: 86% (194/225) Updating files: 87% (196/225) Updating files: 88% (198/225) Updating files: 89% (201/225) Updating files: 90% (203/225) Updating files: 91% (205/225) Updating files: 92% (207/225) Updating files: 93% (210/225) Updating files: 94% (212/225) Updating files: 95% (214/225) Updating files: 96% (216/225) Updating files: 97% (219/225) Updating files: 98% (221/225) Updating files: 99% (223/225) Updating files: 100% (225/225) Updating files: 100% (225/225), done. 2023-11-28T20:53:13.854 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 284161c00ab kclient: kill dput/d_drop debug cruft 2023-11-28T20:53:13.860 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.8 2023-11-28T20:53:14.028 INFO:tasks.workunit.client.0.smithi167.stdout:v0.9 2023-11-28T20:53:14.028 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 9 -eq 48 ] 2023-11-28T20:53:14.028 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.9 2023-11-28T20:53:14.028 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.9 2023-11-28T20:53:14.028 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.9 2023-11-28T20:53:15.129 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:15.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.267+0000 7efc75617640 1 Processor -- start 2023-11-28T20:53:15.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.267+0000 7efc75617640 1 -- start start 2023-11-28T20:53:15.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc75617640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc70153db0 0x7efc7015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc75617640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efc700ccb70 0x7efc700c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc75617640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc700cfef0 con 0x7efc700cf440 2023-11-28T20:53:15.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc75617640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc700cc6e0 con 0x7efc700ccb70 2023-11-28T20:53:15.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc75617640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc70154190 con 0x7efc70153db0 2023-11-28T20:53:15.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6f7fe640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efc700ccb70 0x7efc700c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc70153db0 0x7efc7015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6f7fe640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efc700ccb70 0x7efc700c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:56570/0 (socket says 172.21.15.167:56570) 2023-11-28T20:53:15.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc70153db0 0x7efc7015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:42576/0 (socket says 172.21.15.167:42576) 2023-11-28T20:53:15.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6f7fe640 1 -- 172.21.15.167:0/3014918607 learned_addr learned my addr 172.21.15.167:0/3014918607 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:15.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6ffff640 1 -- 172.21.15.167:0/3014918607 >> v2:172.21.15.178:3300/0 conn(0x7efc700ccb70 msgr2=0x7efc700c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:53:15.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6ffff640 1 --2- 172.21.15.167:0/3014918607 >> v2:172.21.15.178:3300/0 conn(0x7efc700ccb70 0x7efc700c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6ffff640 1 -- 172.21.15.167:0/3014918607 >> v1:172.21.15.178:6789/0 conn(0x7efc700cf440 legacy=0x7efc700ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6ffff640 1 -- 172.21.15.167:0/3014918607 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700c4910 con 0x7efc70153db0 2023-11-28T20:53:15.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.271+0000 7efc6f7fe640 1 --2- 172.21.15.167:0/3014918607 >> v2:172.21.15.178:3300/0 conn(0x7efc700ccb70 0x7efc700c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:53:15.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc6ffff640 1 --2- 172.21.15.167:0/3014918607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc70153db0 0x7efc7015a540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc600097c0 tx=0x7efc6001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e777a09c9fc8424d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc6effd640 1 -- 172.21.15.167:0/3014918607 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600ab600 con 0x7efc70153db0 2023-11-28T20:53:15.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc6effd640 1 -- 172.21.15.167:0/3014918607 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc600a7050 con 0x7efc70153db0 2023-11-28T20:53:15.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc6effd640 1 -- 172.21.15.167:0/3014918607 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc600ab980 con 0x7efc70153db0 2023-11-28T20:53:15.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 -- 172.21.15.167:0/3014918607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc70153db0 msgr2=0x7efc7015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 --2- 172.21.15.167:0/3014918607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc70153db0 0x7efc7015a540 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efc600097c0 tx=0x7efc6001c480 comp rx=0 tx=0).stop 2023-11-28T20:53:15.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 -- 172.21.15.167:0/3014918607 shutdown_connections 2023-11-28T20:53:15.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 --2- 172.21.15.167:0/3014918607 >> v2:172.21.15.178:3300/0 conn(0x7efc700ccb70 0x7efc700c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 --2- 172.21.15.167:0/3014918607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc70153db0 0x7efc7015a540 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 -- 172.21.15.167:0/3014918607 >> 172.21.15.167:0/3014918607 conn(0x7efc7006b800 msgr2=0x7efc7006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:15.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 -- 172.21.15.167:0/3014918607 shutdown_connections 2023-11-28T20:53:15.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 -- 172.21.15.167:0/3014918607 wait complete. 2023-11-28T20:53:15.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 Processor -- start 2023-11-28T20:53:15.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.275+0000 7efc75617640 1 -- start start 2023-11-28T20:53:15.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc75617640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc700ccb70 0x7efc700ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc75617640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc700cf440 0x7efc7014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc75617640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc70153db0 0x7efc7014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc75617640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70154ff0 con 0x7efc700cf440 2023-11-28T20:53:15.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc75617640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70154420 con 0x7efc70153db0 2023-11-28T20:53:15.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc75617640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc701546c0 con 0x7efc700ccb70 2023-11-28T20:53:15.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc700cf440 0x7efc7014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc700cf440 0x7efc7014da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36420/0 (socket says 172.21.15.167:36420) 2023-11-28T20:53:15.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6f7fe640 1 -- 172.21.15.167:0/2362137375 learned_addr learned my addr 172.21.15.167:0/2362137375 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:15.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6ffff640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc700ccb70 0x7efc700ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc74e16640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc70153db0 0x7efc7014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6f7fe640 1 -- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc700ccb70 msgr2=0x7efc700ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6f7fe640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc700ccb70 0x7efc700ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6f7fe640 1 -- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc70153db0 msgr2=0x7efc7014df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6f7fe640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc70153db0 0x7efc7014df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6f7fe640 1 -- 172.21.15.167:0/2362137375 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc640094d0 con 0x7efc700cf440 2023-11-28T20:53:15.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6f7fe640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc700cf440 0x7efc7014da40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc6400e930 tx=0x7efc6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6cff9640 1 -- 172.21.15.167:0/2362137375 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400ca00 con 0x7efc700cf440 2023-11-28T20:53:15.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6cff9640 1 -- 172.21.15.167:0/2362137375 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400cb60 con 0x7efc700cf440 2023-11-28T20:53:15.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6cff9640 1 -- 172.21.15.167:0/2362137375 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64013470 con 0x7efc700cf440 2023-11-28T20:53:15.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc60009420 con 0x7efc700cf440 2023-11-28T20:53:15.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc70154c80 con 0x7efc700cf440 2023-11-28T20:53:15.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7004e850 con 0x7efc700cf440 2023-11-28T20:53:15.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.279+0000 7efc6cff9640 1 -- 172.21.15.167:0/2362137375 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc640135d0 con 0x7efc700cf440 2023-11-28T20:53:15.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.283+0000 7efc6cff9640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efc5c066470 0x7efc5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.283+0000 7efc6cff9640 1 -- 172.21.15.167:0/2362137375 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7efc64084970 con 0x7efc700cf440 2023-11-28T20:53:15.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.283+0000 7efc6ffff640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efc5c066470 0x7efc5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.283+0000 7efc6ffff640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efc5c066470 0x7efc5c068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc600ad000 tx=0x7efc60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.287+0000 7efc6cff9640 1 -- 172.21.15.167:0/2362137375 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc640518d0 con 0x7efc700cf440 2023-11-28T20:53:15.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7efc700d00a0 con 0x7efc700cf440 2023-11-28T20:53:15.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc6cff9640 1 -- 172.21.15.167:0/2362137375 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7efc64021620 con 0x7efc700cf440 2023-11-28T20:53:15.501 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:15.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efc5c066470 msgr2=0x7efc5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efc5c066470 0x7efc5c068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc600ad000 tx=0x7efc60008040 comp rx=0 tx=0).stop 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc700cf440 msgr2=0x7efc7014da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc700cf440 0x7efc7014da40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efc6400e930 tx=0x7efc6400edf0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 shutdown_connections 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efc5c066470 0x7efc5c068930 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc70153db0 0x7efc7014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc700cf440 0x7efc7014da40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 --2- 172.21.15.167:0/2362137375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc700ccb70 0x7efc700ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.499+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 >> 172.21.15.167:0/2362137375 conn(0x7efc7006b800 msgr2=0x7efc7014ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.503+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 shutdown_connections 2023-11-28T20:53:15.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.503+0000 7efc75617640 1 -- 172.21.15.167:0/2362137375 wait complete. 2023-11-28T20:53:15.524 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:53:15.524 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:53:15.524 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:53:15.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.659+0000 7f1169d80640 1 Processor -- start 2023-11-28T20:53:15.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.659+0000 7f1169d80640 1 -- start start 2023-11-28T20:53:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1169d80640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1164157560 0x7f11640c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1169d80640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1164157940 con 0x7f11640c6ff0 2023-11-28T20:53:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1169d80640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11640c6ac0 con 0x7f1164150b40 2023-11-28T20:53:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1169d80640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11640c62f0 con 0x7f1164157560 2023-11-28T20:53:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1163fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1164157560 0x7f11640c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1163fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1164157560 0x7f11640c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36434/0 (socket says 172.21.15.167:36434) 2023-11-28T20:53:15.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1163fff640 1 -- 172.21.15.167:0/1682391099 learned_addr learned my addr 172.21.15.167:0/1682391099 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:15.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f115bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f11640c6ff0 0x7f116406a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38340/0 (socket says 172.21.15.167:38340) 2023-11-28T20:53:15.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1163fff640 1 -- 172.21.15.167:0/1682391099 >> v1:172.21.15.178:6789/0 conn(0x7f1164150b40 legacy=0x7f11640c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1163fff640 1 -- 172.21.15.167:0/1682391099 >> v1:172.21.15.167:6789/0 conn(0x7f11640c6ff0 legacy=0x7f116406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.663+0000 7f1163fff640 1 -- 172.21.15.167:0/1682391099 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640c6500 con 0x7f1164157560 2023-11-28T20:53:15.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1163fff640 1 --2- 172.21.15.167:0/1682391099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164157560 0x7f11640c4510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f115c009e50 tx=0x7f115c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee180ff223213850 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1162ffd640 1 -- 172.21.15.167:0/1682391099 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0af400 con 0x7f1164157560 2023-11-28T20:53:15.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1162ffd640 1 -- 172.21.15.167:0/1682391099 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c0ab050 con 0x7f1164157560 2023-11-28T20:53:15.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1162ffd640 1 -- 172.21.15.167:0/1682391099 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0af780 con 0x7f1164157560 2023-11-28T20:53:15.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1169d80640 1 -- 172.21.15.167:0/1682391099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164157560 msgr2=0x7f11640c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1169d80640 1 --2- 172.21.15.167:0/1682391099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164157560 0x7f11640c4510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f115c009e50 tx=0x7f115c01f1f0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1169d80640 1 -- 172.21.15.167:0/1682391099 shutdown_connections 2023-11-28T20:53:15.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1169d80640 1 --2- 172.21.15.167:0/1682391099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164157560 0x7f11640c4510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1169d80640 1 -- 172.21.15.167:0/1682391099 >> 172.21.15.167:0/1682391099 conn(0x7f11640cb1e0 msgr2=0x7f11640cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:15.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1169d80640 1 -- 172.21.15.167:0/1682391099 shutdown_connections 2023-11-28T20:53:15.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1169d80640 1 -- 172.21.15.167:0/1682391099 wait complete. 2023-11-28T20:53:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1169d80640 1 Processor -- start 2023-11-28T20:53:15.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.667+0000 7f1169d80640 1 -- start start 2023-11-28T20:53:15.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11640c6ff0 0x7f11641410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164150b40 0x7f11641efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1164157560 0x7f116414a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116415a630 con 0x7f1164150b40 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116415ae40 con 0x7f11640c6ff0 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11641ef890 con 0x7f1164157560 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f115bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164150b40 0x7f11641efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f115bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164150b40 0x7f11641efd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36448/0 (socket says 172.21.15.167:36448) 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f115bfff640 1 -- 172.21.15.167:0/1293455101 learned_addr learned my addr 172.21.15.167:0/1293455101 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f11637fe640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11640c6ff0 0x7f11641410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1163fff640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1164157560 0x7f116414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f115bfff640 1 -- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1164157560 msgr2=0x7f116414a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f115bfff640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1164157560 0x7f116414a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f115bfff640 1 -- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11640c6ff0 msgr2=0x7f11641410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f115bfff640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11640c6ff0 0x7f11641410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f115bfff640 1 -- 172.21.15.167:0/1293455101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c009b30 con 0x7f1164150b40 2023-11-28T20:53:15.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1163fff640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1164157560 0x7f116414a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:53:15.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f115bfff640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164150b40 0x7f11641efd20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c490 tx=0x7f114c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c0074e0 con 0x7f1164150b40 2023-11-28T20:53:15.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c007660 con 0x7f1164150b40 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11641415f0 con 0x7f1164150b40 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c004a30 con 0x7f1164150b40 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116415ab60 con 0x7f1164150b40 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164156720 0x7f116414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1164074770 con 0x7f1164156720 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f11637fe640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164156720 0x7f116414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f11637fe640 1 -- 172.21.15.167:0/1293455101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11641546c0 con 0x7f1164156720 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f11637fe640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164156720 0x7f116414a570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1154000f70 tx=0x7f115400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11540050d0 con 0x7f1164156720 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1154005230 con 0x7f1164156720 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164156720 msgr2=0x7f116414a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1160ff9640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164156720 0x7f116414a570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1154000f70 tx=0x7f115400fc00 comp rx=0 tx=0).stop 2023-11-28T20:53:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164156720 msgr2=0x7f116414a570 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.671+0000 7f1160ff9640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164156720 0x7f116414a570 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1154000f70 tx=0x7f115400fc00 comp rx=0 tx=0).stop 2023-11-28T20:53:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.675+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f114c004b90 con 0x7f1164150b40 2023-11-28T20:53:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.675+0000 7f1160ff9640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f11440661e0 0x7f11440686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.675+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f114c083c50 con 0x7f1164150b40 2023-11-28T20:53:15.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.675+0000 7f11637fe640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f11440661e0 0x7f11440686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.675+0000 7f11637fe640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f11440661e0 0x7f11440686a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1154001ec0 tx=0x7f1154005000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.679+0000 7f1169d80640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11641ef380 0x7f11641f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.679+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116415a2c0 con 0x7f11641ef380 2023-11-28T20:53:15.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.679+0000 7f1163fff640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11641ef380 0x7f11641f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.679+0000 7f1163fff640 1 -- 172.21.15.167:0/1293455101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f116406a610 con 0x7f11641ef380 2023-11-28T20:53:15.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.679+0000 7f1163fff640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11641ef380 0x7f11641f28f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f116406bba0 tx=0x7f115c01bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.679+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0afd80 con 0x7f11641ef380 2023-11-28T20:53:15.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4472 (secure 0 0 0) 0x7f115c0b83d0 con 0x7f11641ef380 2023-11-28T20:53:15.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11641ef380 msgr2=0x7f11641f28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1160ff9640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11641ef380 0x7f11641f28f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f116406bba0 tx=0x7f115c01bf90 comp rx=0 tx=0).stop 2023-11-28T20:53:15.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1160ff9640 1 -- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11641ef380 msgr2=0x7f11641f28f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:15.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1160ff9640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11641ef380 0x7f11641f28f0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f116406bba0 tx=0x7f115c01bf90 comp rx=0 tx=0).stop 2023-11-28T20:53:15.685 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:53:15.685 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:15.685 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:15.685 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:53:15.685 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 120, 2023-11-28T20:53:15.685 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:53:15.685 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:53:15.685 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:53:15.685 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:15.686 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:15.687 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:15.688 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:15.689 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:53:15.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:53:15.691 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:15.692 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:15.694 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:53:15.695 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:15.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:53:15.697 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:53:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f11440661e0 msgr2=0x7f11440686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1169d80640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f11440661e0 0x7f11440686a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1154001ec0 tx=0x7f1154005000 comp rx=0 tx=0).stop 2023-11-28T20:53:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164150b40 msgr2=0x7f11641efd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1169d80640 1 --2- 172.21.15.167:0/1293455101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1164150b40 0x7f11641efd20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f114c00c490 tx=0x7f114c00c950 comp rx=0 tx=0).stop 2023-11-28T20:53:15.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1163fff640 1 -- 172.21.15.167:0/1293455101 reap_dead start 2023-11-28T20:53:15.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 shutdown_connections 2023-11-28T20:53:15.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 >> 172.21.15.167:0/1293455101 conn(0x7f11640cb1e0 msgr2=0x7f116406a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:15.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 shutdown_connections 2023-11-28T20:53:15.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.683+0000 7f1169d80640 1 -- 172.21.15.167:0/1293455101 wait complete. 2023-11-28T20:53:15.702 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:53:15.702 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:53:15.702 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:53:15.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b89aa640 1 Processor -- start 2023-11-28T20:53:15.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b89aa640 1 -- start start 2023-11-28T20:53:15.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b89aa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48b40cf860 0x7f48b40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b89aa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b415ac00 con 0x7f48b40cfc40 2023-11-28T20:53:15.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b89aa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b40cbd60 con 0x7f48b4153ae0 2023-11-28T20:53:15.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b89aa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b4159ff0 con 0x7f48b40cf860 2023-11-28T20:53:15.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48b40cf860 0x7f48b40cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48b40cf860 0x7f48b40cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36472/0 (socket says 172.21.15.167:36472) 2023-11-28T20:53:15.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b259c640 1 -- 172.21.15.167:0/1271515384 learned_addr learned my addr 172.21.15.167:0/1271515384 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:15.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b1d9b640 1 --1- 172.21.15.167:0/1271515384 >> v1:172.21.15.167:6789/0 conn(0x7f48b40cfc40 0x7f48b40ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38344/0 (socket says 172.21.15.167:38344) 2023-11-28T20:53:15.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b259c640 1 -- 172.21.15.167:0/1271515384 >> v1:172.21.15.178:6789/0 conn(0x7f48b4153ae0 legacy=0x7f48b415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b259c640 1 -- 172.21.15.167:0/1271515384 >> v1:172.21.15.167:6789/0 conn(0x7f48b40cfc40 legacy=0x7f48b40ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b259c640 1 -- 172.21.15.167:0/1271515384 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b415a2d0 con 0x7f48b40cf860 2023-11-28T20:53:15.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.847+0000 7f48b159a640 1 -- 172.21.15.167:0/1271515384 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798230151 0 0) 0x7f48b415ac00 con 0x7f48b40cfc40 2023-11-28T20:53:15.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b259c640 1 --2- 172.21.15.167:0/1271515384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b40cf860 0x7f48b40cb770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009870 tx=0x7f48a401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc4f5a004a29faf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b159a640 1 -- 172.21.15.167:0/1271515384 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40aa670 con 0x7f48b40cf860 2023-11-28T20:53:15.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b159a640 1 -- 172.21.15.167:0/1271515384 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a40aa7d0 con 0x7f48b40cf860 2023-11-28T20:53:15.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b159a640 1 -- 172.21.15.167:0/1271515384 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40aab60 con 0x7f48b40cf860 2023-11-28T20:53:15.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b89aa640 1 -- 172.21.15.167:0/1271515384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b40cf860 msgr2=0x7f48b40cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b89aa640 1 --2- 172.21.15.167:0/1271515384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b40cf860 0x7f48b40cb770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009870 tx=0x7f48a401c510 comp rx=0 tx=0).stop 2023-11-28T20:53:15.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b89aa640 1 -- 172.21.15.167:0/1271515384 shutdown_connections 2023-11-28T20:53:15.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b89aa640 1 --2- 172.21.15.167:0/1271515384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b40cf860 0x7f48b40cb770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b89aa640 1 -- 172.21.15.167:0/1271515384 >> 172.21.15.167:0/1271515384 conn(0x7f48b406c1f0 msgr2=0x7f48b4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:15.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b89aa640 1 -- 172.21.15.167:0/1271515384 shutdown_connections 2023-11-28T20:53:15.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.851+0000 7f48b89aa640 1 -- 172.21.15.167:0/1271515384 wait complete. 2023-11-28T20:53:15.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 Processor -- start 2023-11-28T20:53:15.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 -- start start 2023-11-28T20:53:15.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48b40cf860 0x7f48b415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40cfc40 0x7f48b40c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b4153ae0 0x7f48b40c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4159550 con 0x7f48b4153ae0 2023-11-28T20:53:15.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4159320 con 0x7f48b40cfc40 2023-11-28T20:53:15.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b414a130 con 0x7f48b40cf860 2023-11-28T20:53:15.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b2d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b4153ae0 0x7f48b40c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b2d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b4153ae0 0x7f48b40c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36484/0 (socket says 172.21.15.167:36484) 2023-11-28T20:53:15.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b2d9d640 1 -- 172.21.15.167:0/3393866437 learned_addr learned my addr 172.21.15.167:0/3393866437 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:15.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b259c640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48b40cf860 0x7f48b415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b1d9b640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40cfc40 0x7f48b40c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b2d9d640 1 -- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48b40cf860 msgr2=0x7f48b415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b2d9d640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48b40cf860 0x7f48b415c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b2d9d640 1 -- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40cfc40 msgr2=0x7f48b40c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b2d9d640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40cfc40 0x7f48b40c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b2d9d640 1 -- 172.21.15.167:0/3393866437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40094d0 con 0x7f48b4153ae0 2023-11-28T20:53:15.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b2d9d640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b4153ae0 0x7f48b40c74c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00c7a0 tx=0x7f48ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac003b80 con 0x7f48b4153ae0 2023-11-28T20:53:15.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac003ce0 con 0x7f48b4153ae0 2023-11-28T20:53:15.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00aa90 con 0x7f48b4153ae0 2023-11-28T20:53:15.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b4154ba0 con 0x7f48b4153ae0 2023-11-28T20:53:15.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b414a660 con 0x7f48b4153ae0 2023-11-28T20:53:15.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40c9470 0x7f48b40c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.855+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41573f0 con 0x7f48b40c9470 2023-11-28T20:53:15.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48b259c640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40c9470 0x7f48b40c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48b259c640 1 -- 172.21.15.167:0/3393866437 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48b4154300 con 0x7f48b40c9470 2023-11-28T20:53:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48ac00abf0 con 0x7f48b4153ae0 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48b259c640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40c9470 0x7f48b40c7a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c9c50 tx=0x7f48a401ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48a2ffd640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4894066470 0x7f4894068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f48ac083ee0 con 0x7f48b4153ae0 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40aad80 con 0x7f48b40c9470 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48b1d9b640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4894066470 0x7f4894068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f48a40bd410 con 0x7f48b40c9470 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40c9470 msgr2=0x7f48b40c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48a2ffd640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40c9470 0x7f48b40c7a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f48b40c9c50 tx=0x7f48a401ad50 comp rx=0 tx=0).stop 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40c9470 msgr2=0x7f48b40c7a00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48a2ffd640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40c9470 0x7f48b40c7a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.859+0000 7f48b1d9b640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4894066470 0x7f4894068930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f48b41588a0 tx=0x7f48a8007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40ce4a0 0x7f48b40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4072860 con 0x7f48b40ce4a0 2023-11-28T20:53:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b259c640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40ce4a0 0x7f48b40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b259c640 1 -- 172.21.15.167:0/3393866437 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f48b4067c40 con 0x7f48b40ce4a0 2023-11-28T20:53:15.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b259c640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40ce4a0 0x7f48b40ce8b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48a4019120 tx=0x7f48a4009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:15.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4003ea0 con 0x7f48b40ce4a0 2023-11-28T20:53:15.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4640 (secure 0 0 0) 0x7f48a40a93d0 con 0x7f48b40ce4a0 2023-11-28T20:53:15.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40ce4a0 msgr2=0x7f48b40ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48a2ffd640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40ce4a0 0x7f48b40ce8b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48a4019120 tx=0x7f48a4009240 comp rx=0 tx=0).stop 2023-11-28T20:53:15.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48a2ffd640 1 -- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40ce4a0 msgr2=0x7f48b40ce8b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:15.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48a2ffd640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48b40ce4a0 0x7f48b40ce8b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:15.871 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:53:15.871 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:15.871 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 120, 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:53:15.872 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:53:15.873 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:53:15.875 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:15.876 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:15.877 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.879 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.880 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:53:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:53:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:53:15.885 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:53:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4894066470 msgr2=0x7f4894068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4894066470 0x7f4894068930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f48b41588a0 tx=0x7f48a8007240 comp rx=0 tx=0).stop 2023-11-28T20:53:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b4153ae0 msgr2=0x7f48b40c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 --2- 172.21.15.167:0/3393866437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48b4153ae0 0x7f48b40c74c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00c7a0 tx=0x7f48ac00cc60 comp rx=0 tx=0).stop 2023-11-28T20:53:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b2d9d640 1 -- 172.21.15.167:0/3393866437 reap_dead start 2023-11-28T20:53:15.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b2d9d640 1 -- 172.21.15.167:0/3393866437 reap_dead start 2023-11-28T20:53:15.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 shutdown_connections 2023-11-28T20:53:15.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 >> 172.21.15.167:0/3393866437 conn(0x7f48b406c1f0 msgr2=0x7f48b41464f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:15.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 shutdown_connections 2023-11-28T20:53:15.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:15.867+0000 7f48b89aa640 1 -- 172.21.15.167:0/3393866437 wait complete. 2023-11-28T20:53:15.891 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:53:15.891 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:53:15.892 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:53:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.027+0000 7f51e2c17640 1 Processor -- start 2023-11-28T20:53:16.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.027+0000 7f51e2c17640 1 -- start start 2023-11-28T20:53:16.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51e2c17640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51dc0cfc40 0x7f51dc0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51e2c17640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc15ac00 con 0x7f51dc153ae0 2023-11-28T20:53:16.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51e2c17640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc0cbd60 con 0x7f51dc0cf860 2023-11-28T20:53:16.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51e2c17640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc159ff0 con 0x7f51dc0cfc40 2023-11-28T20:53:16.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51d3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f51dc0cfc40 0x7f51dc0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51e11b4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f51dc153ae0 0x7f51dc15d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38350/0 (socket says 172.21.15.167:38350) 2023-11-28T20:53:16.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51e11b4640 1 -- 172.21.15.167:0/2882664935 learned_addr learned my addr 172.21.15.167:0/2882664935 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:53:16.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51d3fff640 1 -- 172.21.15.167:0/2882664935 >> v1:172.21.15.178:6789/0 conn(0x7f51dc0cf860 legacy=0x7f51dc0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51d3fff640 1 -- 172.21.15.167:0/2882664935 >> v1:172.21.15.167:6789/0 conn(0x7f51dc153ae0 legacy=0x7f51dc15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51d37fe640 1 -- 172.21.15.167:0/2882664935 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174484638 0 0) 0x7f51dc15ac00 con 0x7f51dc153ae0 2023-11-28T20:53:16.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.031+0000 7f51d3fff640 1 -- 172.21.15.167:0/2882664935 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc15a2d0 con 0x7f51dc0cfc40 2023-11-28T20:53:16.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51d3fff640 1 --2- 172.21.15.167:0/2882664935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc0cfc40 0x7f51dc0cb770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0097c0 tx=0x7f51cc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66420340d6c0a347 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:16.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51d37fe640 1 -- 172.21.15.167:0/2882664935 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc0ab650 con 0x7f51dc0cfc40 2023-11-28T20:53:16.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51d37fe640 1 -- 172.21.15.167:0/2882664935 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc0ab7b0 con 0x7f51dc0cfc40 2023-11-28T20:53:16.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51d37fe640 1 -- 172.21.15.167:0/2882664935 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc0abb40 con 0x7f51dc0cfc40 2023-11-28T20:53:16.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51e2c17640 1 -- 172.21.15.167:0/2882664935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc0cfc40 msgr2=0x7f51dc0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51e2c17640 1 --2- 172.21.15.167:0/2882664935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc0cfc40 0x7f51dc0cb770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0097c0 tx=0x7f51cc01c450 comp rx=0 tx=0).stop 2023-11-28T20:53:16.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51e2c17640 1 -- 172.21.15.167:0/2882664935 shutdown_connections 2023-11-28T20:53:16.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51e2c17640 1 --2- 172.21.15.167:0/2882664935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc0cfc40 0x7f51dc0cb770 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51e2c17640 1 -- 172.21.15.167:0/2882664935 >> 172.21.15.167:0/2882664935 conn(0x7f51dc06c1f0 msgr2=0x7f51dc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:16.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51e2c17640 1 -- 172.21.15.167:0/2882664935 shutdown_connections 2023-11-28T20:53:16.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51e2c17640 1 -- 172.21.15.167:0/2882664935 wait complete. 2023-11-28T20:53:16.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51e2c17640 1 Processor -- start 2023-11-28T20:53:16.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.035+0000 7f51e2c17640 1 -- start start 2023-11-28T20:53:16.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51dc0cf860 0x7f51dc0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc0cfc40 0x7f51dc1f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc153ae0 0x7f51dc1f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc1f4e00 con 0x7f51dc153ae0 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0c7ff0 con 0x7f51dc0cf860 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc1f41f0 con 0x7f51dc0cfc40 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e11b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc153ae0 0x7f51dc1f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e11b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc153ae0 0x7f51dc1f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36490/0 (socket says 172.21.15.167:36490) 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e11b4640 1 -- 172.21.15.167:0/1555172339 learned_addr learned my addr 172.21.15.167:0/1555172339 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51d3fff640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc0cfc40 0x7f51dc1f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e09b3640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51dc0cf860 0x7f51dc0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e11b4640 1 -- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc0cfc40 msgr2=0x7f51dc1f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e11b4640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc0cfc40 0x7f51dc1f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e11b4640 1 -- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51dc0cf860 msgr2=0x7f51dc0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e11b4640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51dc0cf860 0x7f51dc0b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e11b4640 1 -- 172.21.15.167:0/1555172339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc009420 con 0x7f51dc153ae0 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51d3fff640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc0cfc40 0x7f51dc1f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e11b4640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc153ae0 0x7f51dc1f57d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f51d4001570 tx=0x7f51d400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400a640 con 0x7f51dc153ae0 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400a7c0 con 0x7f51dc153ae0 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc1f44d0 con 0x7f51dc153ae0 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400ab70 con 0x7f51dc153ae0 2023-11-28T20:53:16.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc1f4a90 con 0x7f51dc153ae0 2023-11-28T20:53:16.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc144ed0 0x7f51dc1452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc072860 con 0x7f51dc144ed0 2023-11-28T20:53:16.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e09b3640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc144ed0 0x7f51dc1452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51e09b3640 1 -- 172.21.15.167:0/1555172339 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51dc154320 con 0x7f51dc144ed0 2023-11-28T20:53:16.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.039+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f51d400acd0 con 0x7f51dc153ae0 2023-11-28T20:53:16.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51e09b3640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc144ed0 0x7f51dc1452b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001ec0 tx=0x7f51d800e890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:16.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d17fa640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51c8066470 0x7f51c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f51d4083a70 con 0x7f51dc153ae0 2023-11-28T20:53:16.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80052e0 con 0x7f51dc144ed0 2023-11-28T20:53:16.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d3fff640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51c8066470 0x7f51c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f51d8005440 con 0x7f51dc144ed0 2023-11-28T20:53:16.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc144ed0 msgr2=0x7f51dc1452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d17fa640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc144ed0 0x7f51dc1452b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001ec0 tx=0x7f51d800e890 comp rx=0 tx=0).stop 2023-11-28T20:53:16.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc144ed0 msgr2=0x7f51dc1452b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:16.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d17fa640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc144ed0 0x7f51dc1452b0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001ec0 tx=0x7f51d800e890 comp rx=0 tx=0).stop 2023-11-28T20:53:16.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.043+0000 7f51d3fff640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51c8066470 0x7f51c8068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0af000 tx=0x7f51cc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:16.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.047+0000 7f51e2c17640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc1f61e0 0x7f51dc1f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.047+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc1f4c80 con 0x7f51dc1f61e0 2023-11-28T20:53:16.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.047+0000 7f51e09b3640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc1f61e0 0x7f51dc1f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e09b3640 1 -- 172.21.15.167:0/1555172339 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f51dc067c40 con 0x7f51dc1f61e0 2023-11-28T20:53:16.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e09b3640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc1f61e0 0x7f51dc1f65f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001ec0 tx=0x7f51d8001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:16.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8021070 con 0x7f51dc1f61e0 2023-11-28T20:53:16.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7f51d80067e0 con 0x7f51dc1f61e0 2023-11-28T20:53:16.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc1f61e0 msgr2=0x7f51dc1f65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51d17fa640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc1f61e0 0x7f51dc1f65f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001ec0 tx=0x7f51d8001090 comp rx=0 tx=0).stop 2023-11-28T20:53:16.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51d17fa640 1 -- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc1f61e0 msgr2=0x7f51dc1f65f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:16.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51d17fa640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51dc1f61e0 0x7f51dc1f65f0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001ec0 tx=0x7f51d8001090 comp rx=0 tx=0).stop 2023-11-28T20:53:16.054 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:53:16.054 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:16.054 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:16.054 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:53:16.054 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 120, 2023-11-28T20:53:16.054 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:53:16.054 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:16.055 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:16.056 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:53:16.057 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:53:16.058 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:16.059 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:16.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.061 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.061 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:16.061 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.062 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:53:16.063 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:53:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:53:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:53:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:53:16.070 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:53:16.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51c8066470 msgr2=0x7f51c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e2c17640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51c8066470 0x7f51c8068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0af000 tx=0x7f51cc0a7000 comp rx=0 tx=0).stop 2023-11-28T20:53:16.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc153ae0 msgr2=0x7f51dc1f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e2c17640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc153ae0 0x7f51dc1f57d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f51d4001570 tx=0x7f51d400cca0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e11b4640 1 -- 172.21.15.167:0/1555172339 reap_dead start 2023-11-28T20:53:16.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 shutdown_connections 2023-11-28T20:53:16.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e2c17640 1 --2- 172.21.15.167:0/1555172339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51dc153ae0 0x7f51dc1f57d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 >> 172.21.15.167:0/1555172339 conn(0x7f51dc06c1f0 msgr2=0x7f51dc0c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:16.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 shutdown_connections 2023-11-28T20:53:16.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.051+0000 7f51e2c17640 1 -- 172.21.15.167:0/1555172339 wait complete. 2023-11-28T20:53:16.073 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:53:16.073 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:53:16.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:53:16.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bff7c4640 1 Processor -- start 2023-11-28T20:53:16.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bff7c4640 1 -- start start 2023-11-28T20:53:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bff7c4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6bf80cfc40 0x7f6bf80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bff7c4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 0x7f6bf8153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bff7c4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf815ac00 con 0x7f6bf80cf860 2023-11-28T20:53:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bff7c4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf80cbd60 con 0x7f6bf80cfc40 2023-11-28T20:53:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bff7c4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8159ff0 con 0x7f6bf8153ae0 2023-11-28T20:53:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bfd560640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6bf80cf860 0x7f6bf80ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38354/0 (socket says 172.21.15.167:38354) 2023-11-28T20:53:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bfd560640 1 -- 172.21.15.167:0/1875731256 learned_addr learned my addr 172.21.15.167:0/1875731256 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:53:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bfcd5f640 1 --2- 172.21.15.167:0/1875731256 >> v2:172.21.15.167:3300/0 conn(0x7f6bf80cfc40 0x7f6bf80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bfdd61640 1 --2- 172.21.15.167:0/1875731256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 0x7f6bf8153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6beffff640 1 -- 172.21.15.167:0/1875731256 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763905715 0 0) 0x7f6bf815ac00 con 0x7f6bf80cf860 2023-11-28T20:53:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6beffff640 1 -- 172.21.15.167:0/1875731256 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be4003530 con 0x7f6bf80cf860 2023-11-28T20:53:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bfcd5f640 1 -- 172.21.15.167:0/1875731256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 msgr2=0x7f6bf8153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:53:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bfcd5f640 1 --2- 172.21.15.167:0/1875731256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 0x7f6bf8153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bfcd5f640 1 -- 172.21.15.167:0/1875731256 >> v1:172.21.15.167:6789/0 conn(0x7f6bf80cf860 legacy=0x7f6bf80ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.211+0000 7f6bfcd5f640 1 -- 172.21.15.167:0/1875731256 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf815a2d0 con 0x7f6bf80cfc40 2023-11-28T20:53:16.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6bfcd5f640 1 --2- 172.21.15.167:0/1875731256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cfc40 0x7f6bf80cb770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6be80097c0 tx=0x7f6be801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f868bd37671de97c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:16.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6beffff640 1 -- 172.21.15.167:0/1875731256 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80ab680 con 0x7f6bf80cfc40 2023-11-28T20:53:16.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6beffff640 1 -- 172.21.15.167:0/1875731256 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be80ab7e0 con 0x7f6bf80cfc40 2023-11-28T20:53:16.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6beffff640 1 -- 172.21.15.167:0/1875731256 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80abb50 con 0x7f6bf80cfc40 2023-11-28T20:53:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6bff7c4640 1 -- 172.21.15.167:0/1875731256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cfc40 msgr2=0x7f6bf80cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6bff7c4640 1 --2- 172.21.15.167:0/1875731256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cfc40 0x7f6bf80cb770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6be80097c0 tx=0x7f6be801c480 comp rx=0 tx=0).stop 2023-11-28T20:53:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6bff7c4640 1 -- 172.21.15.167:0/1875731256 shutdown_connections 2023-11-28T20:53:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6bff7c4640 1 --2- 172.21.15.167:0/1875731256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cfc40 0x7f6bf80cb770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6bff7c4640 1 --2- 172.21.15.167:0/1875731256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 0x7f6bf8153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6bff7c4640 1 -- 172.21.15.167:0/1875731256 >> 172.21.15.167:0/1875731256 conn(0x7f6bf806c1f0 msgr2=0x7f6bf8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6bff7c4640 1 -- 172.21.15.167:0/1875731256 shutdown_connections 2023-11-28T20:53:16.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.215+0000 7f6bff7c4640 1 -- 172.21.15.167:0/1875731256 wait complete. 2023-11-28T20:53:16.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bff7c4640 1 Processor -- start 2023-11-28T20:53:16.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bff7c4640 1 -- start start 2023-11-28T20:53:16.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bff7c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cf860 0x7f6bf8158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bff7c4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bf80cfc40 0x7f6bf815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bff7c4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 0x7f6bf81f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bff7c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf81f6310 con 0x7f6bf80cf860 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bff7c4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf81f6580 con 0x7f6bf80cfc40 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bff7c4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf81f6860 con 0x7f6bf8153ae0 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfd560640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cf860 0x7f6bf8158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfd560640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cf860 0x7f6bf8158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36512/0 (socket says 172.21.15.167:36512) 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfd560640 1 -- 172.21.15.167:0/3514645799 learned_addr learned my addr 172.21.15.167:0/3514645799 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfdd61640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 0x7f6bf81f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfcd5f640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bf80cfc40 0x7f6bf815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfd560640 1 -- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 msgr2=0x7f6bf81f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfd560640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 0x7f6bf81f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfd560640 1 -- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bf80cfc40 msgr2=0x7f6bf815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfd560640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bf80cfc40 0x7f6bf815ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfd560640 1 -- 172.21.15.167:0/3514645799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8009420 con 0x7f6bf80cf860 2023-11-28T20:53:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bfd560640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cf860 0x7f6bf8158ef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400c3c0 tx=0x7f6bf400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bedffb640 1 -- 172.21.15.167:0/3514645799 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4005cf0 con 0x7f6bf80cf860 2023-11-28T20:53:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bedffb640 1 -- 172.21.15.167:0/3514645799 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf4005e50 con 0x7f6bf80cf860 2023-11-28T20:53:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bedffb640 1 -- 172.21.15.167:0/3514645799 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf40072f0 con 0x7f6bf80cf860 2023-11-28T20:53:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.219+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf81f6b40 con 0x7f6bf80cf860 2023-11-28T20:53:16.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.223+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf81455e0 con 0x7f6bf80cf860 2023-11-28T20:53:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.223+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf80ce2a0 con 0x7f6bf80cf860 2023-11-28T20:53:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.223+0000 7f6bedffb640 1 -- 172.21.15.167:0/3514645799 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6bf4007450 con 0x7f6bf80cf860 2023-11-28T20:53:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.223+0000 7f6bedffb640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6bdc0664a0 0x7f6bdc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.223+0000 7f6bedffb640 1 -- 172.21.15.167:0/3514645799 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6bf4083980 con 0x7f6bf80cf860 2023-11-28T20:53:16.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.223+0000 7f6bfcd5f640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6bdc0664a0 0x7f6bdc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:16.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.223+0000 7f6bfcd5f640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6bdc0664a0 0x7f6bdc068960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6be80af000 tx=0x7f6be80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:16.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.227+0000 7f6bedffb640 1 -- 172.21.15.167:0/3514645799 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6bf40508e0 con 0x7f6bf80cf860 2023-11-28T20:53:16.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.435+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f6bf8075c90 con 0x7f6bf80cf860 2023-11-28T20:53:16.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.435+0000 7f6bedffb640 1 -- 172.21.15.167:0/3514645799 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f6bf4017070 con 0x7f6bf80cf860 2023-11-28T20:53:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6bdc0664a0 msgr2=0x7f6bdc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6bdc0664a0 0x7f6bdc068960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6be80af000 tx=0x7f6be80a7000 comp rx=0 tx=0).stop 2023-11-28T20:53:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cf860 msgr2=0x7f6bf8158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cf860 0x7f6bf8158ef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400c3c0 tx=0x7f6bf400c880 comp rx=0 tx=0).stop 2023-11-28T20:53:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 shutdown_connections 2023-11-28T20:53:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6bdc0664a0 0x7f6bdc068960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bf8153ae0 0x7f6bf81f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bf80cfc40 0x7f6bf815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 --2- 172.21.15.167:0/3514645799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bf80cf860 0x7f6bf8158ef0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 >> 172.21.15.167:0/3514645799 conn(0x7f6bf806c1f0 msgr2=0x7f6bf80cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 shutdown_connections 2023-11-28T20:53:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:16.439+0000 7f6bff7c4640 1 -- 172.21.15.167:0/3514645799 wait complete. 2023-11-28T20:53:16.462 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:53:18.815 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 4% (9/193) Updating files: 5% (10/193) Updating files: 6% (12/193) Updating files: 7% (14/193) Updating files: 8% (16/193) Updating files: 9% (18/193) Updating files: 10% (20/193) Updating files: 11% (22/193) Updating files: 12% (24/193) Updating files: 13% (26/193) Updating files: 14% (28/193) Updating files: 15% (29/193) Updating files: 16% (31/193) Updating files: 17% (33/193) Updating files: 18% (35/193) Updating files: 19% (37/193) Updating files: 20% (39/193) Updating files: 21% (41/193) Updating files: 22% (43/193) Updating files: 23% (45/193) Updating files: 24% (47/193) Updating files: 25% (49/193) Updating files: 26% (51/193) Updating files: 27% (53/193) Updating files: 28% (55/193) Updating files: 29% (56/193) Updating files: 30% (58/193) Updating files: 31% (60/193) Updating files: 32% (62/193) Updating files: 33% (64/193) Updating files: 34% (66/193) Updating files: 35% (68/193) Updating files: 36% (70/193) Updating files: 37% (72/193) Updating files: 38% (74/193) Updating files: 39% (76/193) Updating files: 40% (78/193) Updating files: 41% (80/193) Updating files: 42% (82/193) Updating files: 43% (83/193) Updating files: 44% (85/193) Updating files: 45% (87/193) Updating files: 46% (89/193) Updating files: 47% (91/193) Updating files: 48% (93/193) Updating files: 49% (95/193) Updating files: 50% (97/193) Updating files: 51% (99/193) Updating files: 52% (101/193) Updating files: 53% (103/193) Updating files: 54% (105/193) Updating files: 55% (107/193) Updating files: 56% (109/193) Updating files: 57% (111/193) Updating files: 58% (112/193) Updating files: 59% (114/193) Updating files: 60% (116/193) Updating files: 61% (118/193) Updating files: 62% (120/193) Updating files: 63% (122/193) Updating files: 64% (124/193) Updating files: 65% (126/193) Updating files: 66% (128/193) Updating files: 67% (130/193) Updating files: 68% (132/193) Updating files: 69% (134/193) Updating files: 70% (136/193) Updating files: 71% (138/193) Updating files: 72% (139/193) Updating files: 73% (141/193) Updating files: 74% (143/193) Updating files: 75% (145/193) Updating files: 76% (147/193) Updating files: 77% (149/193) Updating files: 78% (151/193) Updating files: 79% (153/193) Updating files: 80% (155/193) Updating files: 81% (157/193) Updating files: 82% (159/193) Updating files: 83% (161/193) Updating files: 84% (163/193) Updating files: 85% (165/193) Updating files: 86% (166/193) Updating files: 87% (168/193) Updating files: 88% (170/193) Updating files: 89% (172/193) Updating files: 90% (174/193) Updating files: 91% (176/193) Updating files: 92% (178/193) Updating files: 93% (180/193) Updating files: 94% (182/193) Updating files: 95% (184/193) Updating files: 96% (186/193) Updating files: 97% (188/193) Updating files: 98% (190/193) Updating files: 99% (192/193) Updating files: 100% (193/193) Updating files: 100% (193/193), done. 2023-11-28T20:53:19.373 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 41481853924 kclient: strip out kernel version compatibility cruft 2023-11-28T20:53:19.373 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.9 2023-11-28T20:53:19.373 INFO:tasks.workunit.client.0.smithi167.stdout:v0.10 2023-11-28T20:53:19.374 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 10 -eq 48 ] 2023-11-28T20:53:19.374 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.10 2023-11-28T20:53:19.374 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.10 2023-11-28T20:53:19.374 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.10 2023-11-28T20:53:20.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:53:20.696 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:53:23.325 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 31% (51/164) Updating files: 32% (53/164) Updating files: 33% (55/164) Updating files: 34% (56/164) Updating files: 35% (58/164) Updating files: 36% (60/164) Updating files: 37% (61/164) Updating files: 38% (63/164) Updating files: 39% (64/164) Updating files: 40% (66/164) Updating files: 41% (68/164) Updating files: 42% (69/164) Updating files: 43% (71/164) Updating files: 44% (73/164) Updating files: 45% (74/164) Updating files: 46% (76/164) Updating files: 47% (78/164) Updating files: 48% (79/164) Updating files: 49% (81/164) Updating files: 50% (82/164) Updating files: 51% (84/164) Updating files: 52% (86/164) Updating files: 53% (87/164) Updating files: 54% (89/164) Updating files: 55% (91/164) Updating files: 56% (92/164) Updating files: 57% (94/164) Updating files: 58% (96/164) Updating files: 59% (97/164) Updating files: 60% (99/164) Updating files: 61% (101/164) Updating files: 62% (102/164) Updating files: 63% (104/164) Updating files: 64% (105/164) Updating files: 65% (107/164) Updating files: 66% (109/164) Updating files: 67% (110/164) Updating files: 68% (112/164) Updating files: 69% (114/164) Updating files: 70% (115/164) Updating files: 71% (117/164) Updating files: 72% (119/164) Updating files: 73% (120/164) Updating files: 74% (122/164) Updating files: 75% (123/164) Updating files: 76% (125/164) Updating files: 77% (127/164) Updating files: 78% (128/164) Updating files: 79% (130/164) Updating files: 80% (132/164) Updating files: 81% (133/164) Updating files: 82% (135/164) Updating files: 83% (137/164) Updating files: 84% (138/164) Updating files: 85% (140/164) Updating files: 86% (142/164) Updating files: 87% (143/164) Updating files: 88% (145/164) Updating files: 89% (146/164) Updating files: 90% (148/164) Updating files: 91% (150/164) Updating files: 92% (151/164) Updating files: 93% (153/164) Updating files: 94% (155/164) Updating files: 95% (156/164) Updating files: 96% (158/164) Updating files: 97% (160/164) Updating files: 98% (161/164) Updating files: 99% (163/164) Updating files: 100% (164/164) Updating files: 100% (164/164), done. 2023-11-28T20:53:23.357 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 007313fe844 v0.10 2023-11-28T20:53:23.363 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.10 2023-11-28T20:53:24.283 INFO:tasks.workunit.client.0.smithi167.stdout:v0.11 2023-11-28T20:53:24.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 11 -eq 48 ] 2023-11-28T20:53:24.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.11 2023-11-28T20:53:24.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.11 2023-11-28T20:53:24.284 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.11 2023-11-28T20:53:25.850 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 24% (17/69) Updating files: 26% (18/69) Updating files: 27% (19/69) Updating files: 28% (20/69) Updating files: 30% (21/69) Updating files: 31% (22/69) Updating files: 33% (23/69) Updating files: 34% (24/69) Updating files: 36% (25/69) Updating files: 37% (26/69) Updating files: 39% (27/69) Updating files: 40% (28/69) Updating files: 42% (29/69) Updating files: 43% (30/69) Updating files: 44% (31/69) Updating files: 46% (32/69) Updating files: 47% (33/69) Updating files: 49% (34/69) Updating files: 50% (35/69) Updating files: 52% (36/69) Updating files: 53% (37/69) Updating files: 55% (38/69) Updating files: 56% (39/69) Updating files: 57% (40/69) Updating files: 59% (41/69) Updating files: 60% (42/69) Updating files: 62% (43/69) Updating files: 63% (44/69) Updating files: 65% (45/69) Updating files: 66% (46/69) Updating files: 68% (47/69) Updating files: 69% (48/69) Updating files: 71% (49/69) Updating files: 72% (50/69) Updating files: 73% (51/69) Updating files: 75% (52/69) Updating files: 76% (53/69) Updating files: 78% (54/69) Updating files: 79% (55/69) Updating files: 81% (56/69) Updating files: 82% (57/69) Updating files: 84% (58/69) Updating files: 85% (59/69) Updating files: 86% (60/69) Updating files: 88% (61/69) Updating files: 89% (62/69) Updating files: 91% (63/69) Updating files: 92% (64/69) Updating files: 94% (65/69) Updating files: 95% (66/69) Updating files: 97% (67/69) Updating files: 98% (68/69) Updating files: 100% (69/69) Updating files: 100% (69/69), done. 2023-11-28T20:53:25.894 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 9fa6f5e7d09 v0.11 2023-11-28T20:53:25.897 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.11 2023-11-28T20:53:26.231 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 12 -eq 48 ] 2023-11-28T20:53:26.234 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.12 2023-11-28T20:53:26.234 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.12 2023-11-28T20:53:26.234 INFO:tasks.workunit.client.0.smithi167.stdout:v0.12 2023-11-28T20:53:26.235 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.12 2023-11-28T20:53:26.463 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:53:26.463 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:26.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.623+0000 7fc1492c9640 1 Processor -- start 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1492c9640 1 -- start start 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1492c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 0x7fc1440c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1492c9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc1440c5c90 0x7fc1440c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1492c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc14406a580 0x7fc14406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1492c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1440c4da0 con 0x7fc14406a580 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1492c9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14415b220 con 0x7fc1440c5c90 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1492c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440c60f0 con 0x7fc144151f60 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1437fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc14406a580 0x7fc14406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1437fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc14406a580 0x7fc14406a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37924/0 (socket says 172.21.15.167:37924) 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1437fe640 1 -- 172.21.15.167:0/2981722035 learned_addr learned my addr 172.21.15.167:0/2981722035 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:26.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc142ffd640 1 --2- 172.21.15.167:0/2981722035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 0x7fc1440c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:26.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1427fc640 1 --2- 172.21.15.167:0/2981722035 >> v2:172.21.15.178:3300/0 conn(0x7fc1440c5c90 0x7fc1440c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:26.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1437fe640 1 -- 172.21.15.167:0/2981722035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 msgr2=0x7fc1440c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:53:26.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1437fe640 1 --2- 172.21.15.167:0/2981722035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 0x7fc1440c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1437fe640 1 -- 172.21.15.167:0/2981722035 >> v2:172.21.15.178:3300/0 conn(0x7fc1440c5c90 msgr2=0x7fc1440c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:53:26.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1437fe640 1 --2- 172.21.15.167:0/2981722035 >> v2:172.21.15.178:3300/0 conn(0x7fc1440c5c90 0x7fc1440c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.627+0000 7fc1437fe640 1 -- 172.21.15.167:0/2981722035 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144152340 con 0x7fc14406a580 2023-11-28T20:53:26.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1437fe640 1 --2- 172.21.15.167:0/2981722035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc14406a580 0x7fc14406a9b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc14406fe60 tx=0x7fc13c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9642a36b891d8ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:26.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc141ffb640 1 -- 172.21.15.167:0/2981722035 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0a56d0 con 0x7fc14406a580 2023-11-28T20:53:26.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc141ffb640 1 -- 172.21.15.167:0/2981722035 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c0a5830 con 0x7fc14406a580 2023-11-28T20:53:26.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc141ffb640 1 -- 172.21.15.167:0/2981722035 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0a5bc0 con 0x7fc14406a580 2023-11-28T20:53:26.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1492c9640 1 -- 172.21.15.167:0/2981722035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc14406a580 msgr2=0x7fc14406a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:26.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1492c9640 1 --2- 172.21.15.167:0/2981722035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc14406a580 0x7fc14406a9b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc14406fe60 tx=0x7fc13c01c940 comp rx=0 tx=0).stop 2023-11-28T20:53:26.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1492c9640 1 -- 172.21.15.167:0/2981722035 shutdown_connections 2023-11-28T20:53:26.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1492c9640 1 --2- 172.21.15.167:0/2981722035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc14406a580 0x7fc14406a9b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1492c9640 1 --2- 172.21.15.167:0/2981722035 >> v2:172.21.15.178:3300/0 conn(0x7fc1440c5c90 0x7fc1440c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1492c9640 1 --2- 172.21.15.167:0/2981722035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 0x7fc1440c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1492c9640 1 -- 172.21.15.167:0/2981722035 >> 172.21.15.167:0/2981722035 conn(0x7fc1440cb1e0 msgr2=0x7fc1440cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:26.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1492c9640 1 -- 172.21.15.167:0/2981722035 shutdown_connections 2023-11-28T20:53:26.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.631+0000 7fc1492c9640 1 -- 172.21.15.167:0/2981722035 wait complete. 2023-11-28T20:53:26.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1492c9640 1 Processor -- start 2023-11-28T20:53:26.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1492c9640 1 -- start start 2023-11-28T20:53:26.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1492c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc14406a580 0x7fc1441f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:26.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1492c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1440c5c90 0x7fc1441f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:26.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1492c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 0x7fc144156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:26.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1492c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14414da20 con 0x7fc1440c5c90 2023-11-28T20:53:26.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1492c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc144141520 con 0x7fc14406a580 2023-11-28T20:53:26.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1492c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1441f1e90 con 0x7fc144151f60 2023-11-28T20:53:26.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1427fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1440c5c90 0x7fc1441f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:26.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc142ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc14406a580 0x7fc1441f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:26.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1427fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1440c5c90 0x7fc1441f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37930/0 (socket says 172.21.15.167:37930) 2023-11-28T20:53:26.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1427fc640 1 -- 172.21.15.167:0/1327414001 learned_addr learned my addr 172.21.15.167:0/1327414001 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:26.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1437fe640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 0x7fc144156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:26.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1427fc640 1 -- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 msgr2=0x7fc144156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:26.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1427fc640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 0x7fc144156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1427fc640 1 -- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc14406a580 msgr2=0x7fc1441f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:26.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1427fc640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc14406a580 0x7fc1441f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1427fc640 1 -- 172.21.15.167:0/1327414001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c009b30 con 0x7fc1440c5c90 2023-11-28T20:53:26.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.635+0000 7fc1427fc640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1440c5c90 0x7fc1441f6080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc13800e8b0 tx=0x7fc13800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:26.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc12b7fe640 1 -- 172.21.15.167:0/1327414001 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13800c940 con 0x7fc1440c5c90 2023-11-28T20:53:26.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc12b7fe640 1 -- 172.21.15.167:0/1327414001 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13800caa0 con 0x7fc1440c5c90 2023-11-28T20:53:26.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14415c0d0 con 0x7fc1440c5c90 2023-11-28T20:53:26.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc12b7fe640 1 -- 172.21.15.167:0/1327414001 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13800ce30 con 0x7fc1440c5c90 2023-11-28T20:53:26.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1441f56b0 con 0x7fc1440c5c90 2023-11-28T20:53:26.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1440682c0 con 0x7fc1440c5c90 2023-11-28T20:53:26.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc12b7fe640 1 -- 172.21.15.167:0/1327414001 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc138013470 con 0x7fc1440c5c90 2023-11-28T20:53:26.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc12b7fe640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc130066470 0x7fc130068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:26.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc12b7fe640 1 -- 172.21.15.167:0/1327414001 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc138084740 con 0x7fc1440c5c90 2023-11-28T20:53:26.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.639+0000 7fc142ffd640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc130066470 0x7fc130068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:26.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.643+0000 7fc142ffd640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc130066470 0x7fc130068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc134009ac0 tx=0x7fc134009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:26.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.647+0000 7fc12b7fe640 1 -- 172.21.15.167:0/1327414001 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1380517e0 con 0x7fc1440c5c90 2023-11-28T20:53:26.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.867+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc144075c90 con 0x7fc1440c5c90 2023-11-28T20:53:26.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.867+0000 7fc12b7fe640 1 -- 172.21.15.167:0/1327414001 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fc138054e00 con 0x7fc1440c5c90 2023-11-28T20:53:26.871 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc130066470 msgr2=0x7fc130068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc130066470 0x7fc130068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc134009ac0 tx=0x7fc134009190 comp rx=0 tx=0).stop 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1440c5c90 msgr2=0x7fc1441f6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1440c5c90 0x7fc1441f6080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc13800e8b0 tx=0x7fc13800ed70 comp rx=0 tx=0).stop 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 shutdown_connections 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc130066470 0x7fc130068930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc144151f60 0x7fc144156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1440c5c90 0x7fc1441f6080 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 --2- 172.21.15.167:0/1327414001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc14406a580 0x7fc1441f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:26.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 >> 172.21.15.167:0/1327414001 conn(0x7fc1440cb1e0 msgr2=0x7fc144150680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:26.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 shutdown_connections 2023-11-28T20:53:26.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:26.871+0000 7fc1492c9640 1 -- 172.21.15.167:0/1327414001 wait complete. 2023-11-28T20:53:26.892 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:53:26.893 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:53:26.893 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:53:26.893 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:53:27.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.031+0000 7f5123417640 1 Processor -- start 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.031+0000 7f5123417640 1 -- start start 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5123417640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c153d20 0x7f511c159b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5123417640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f511c0cf440 0x7f511c0cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5123417640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c15a1b0 con 0x7f511c0ca3c0 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5123417640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c15a450 con 0x7f511c0cf440 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5123417640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c15a710 con 0x7f511c153d20 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5122c16640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f511c0cf440 0x7f511c0cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5121c14640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f511c0ca3c0 0x7f511c0c5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39296/0 (socket says 172.21.15.167:39296) 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5121c14640 1 -- 172.21.15.167:0/2841595520 learned_addr learned my addr 172.21.15.167:0/2841595520 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:53:27.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5122415640 1 --2- 172.21.15.167:0/2841595520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c153d20 0x7f511c159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5122c16640 1 -- 172.21.15.167:0/2841595520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c153d20 msgr2=0x7f511c159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:53:27.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5122c16640 1 --2- 172.21.15.167:0/2841595520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c153d20 0x7f511c159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5122c16640 1 -- 172.21.15.167:0/2841595520 >> v1:172.21.15.167:6789/0 conn(0x7f511c0ca3c0 legacy=0x7f511c0c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5122c16640 1 -- 172.21.15.167:0/2841595520 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c15a9f0 con 0x7f511c0cf440 2023-11-28T20:53:27.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5121413640 1 -- 172.21.15.167:0/2841595520 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230862896 0 0) 0x7f511c15a1b0 con 0x7f511c0ca3c0 2023-11-28T20:53:27.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.035+0000 7f5122415640 1 --2- 172.21.15.167:0/2841595520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c153d20 0x7f511c159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:53:27.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5122c16640 1 --2- 172.21.15.167:0/2841595520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c0cf440 0x7f511c0cf890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5114009d90 tx=0x7f511401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e732aa17c1cc122 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5121413640 1 -- 172.21.15.167:0/2841595520 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140af600 con 0x7f511c0cf440 2023-11-28T20:53:27.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5121413640 1 -- 172.21.15.167:0/2841595520 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51140ab050 con 0x7f511c0cf440 2023-11-28T20:53:27.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5121413640 1 -- 172.21.15.167:0/2841595520 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140af980 con 0x7f511c0cf440 2023-11-28T20:53:27.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 -- 172.21.15.167:0/2841595520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c0cf440 msgr2=0x7f511c0cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 --2- 172.21.15.167:0/2841595520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c0cf440 0x7f511c0cf890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5114009d90 tx=0x7f511401f130 comp rx=0 tx=0).stop 2023-11-28T20:53:27.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 -- 172.21.15.167:0/2841595520 shutdown_connections 2023-11-28T20:53:27.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 --2- 172.21.15.167:0/2841595520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c0cf440 0x7f511c0cf890 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 --2- 172.21.15.167:0/2841595520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c153d20 0x7f511c159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 -- 172.21.15.167:0/2841595520 >> 172.21.15.167:0/2841595520 conn(0x7f511c06b800 msgr2=0x7f511c06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:27.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 -- 172.21.15.167:0/2841595520 shutdown_connections 2023-11-28T20:53:27.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 -- 172.21.15.167:0/2841595520 wait complete. 2023-11-28T20:53:27.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 Processor -- start 2023-11-28T20:53:27.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.039+0000 7f5123417640 1 -- start start 2023-11-28T20:53:27.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f511c0ca3c0 0x7f511c1efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c0cf440 0x7f511c14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c153d20 0x7f511c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c150ea0 con 0x7f511c153d20 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c150bc0 con 0x7f511c0ca3c0 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c14e170 con 0x7f511c0cf440 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122c16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c153d20 0x7f511c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122c16640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c153d20 0x7f511c14f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37950/0 (socket says 172.21.15.167:37950) 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122c16640 1 -- 172.21.15.167:0/1893027802 learned_addr learned my addr 172.21.15.167:0/1893027802 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122415640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f511c0ca3c0 0x7f511c1efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5121c14640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c0cf440 0x7f511c14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122c16640 1 -- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c0cf440 msgr2=0x7f511c14ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122c16640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f511c0cf440 0x7f511c14ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122c16640 1 -- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f511c0ca3c0 msgr2=0x7f511c1efd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122c16640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f511c0ca3c0 0x7f511c1efd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122c16640 1 -- 172.21.15.167:0/1893027802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5114009a70 con 0x7f511c153d20 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122415640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f511c0ca3c0 0x7f511c1efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122c16640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c153d20 0x7f511c14f3b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f51140b2040 tx=0x7f511401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140b9610 con 0x7f511c153d20 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51140b9770 con 0x7f511c153d20 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140b9b20 con 0x7f511c153d20 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c14e450 con 0x7f511c153d20 2023-11-28T20:53:27.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c1ef4a0 con 0x7f511c153d20 2023-11-28T20:53:27.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c144db0 0x7f511c14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c072740 con 0x7f511c144db0 2023-11-28T20:53:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122415640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c144db0 0x7f511c14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122415640 1 -- 172.21.15.167:0/1893027802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f511c0ca1e0 con 0x7f511c144db0 2023-11-28T20:53:27.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.043+0000 7f5122415640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c144db0 0x7f511c14fd90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f511800f4b0 tx=0x7f511800f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118014870 con 0x7f511c144db0 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f51180149d0 con 0x7f511c144db0 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c144db0 msgr2=0x7f511c14fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5112ffd640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c144db0 0x7f511c14fd90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f511800f4b0 tx=0x7f511800f970 comp rx=0 tx=0).stop 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c144db0 msgr2=0x7f511c14fd90 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5112ffd640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c144db0 0x7f511c14fd90 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f511800f4b0 tx=0x7f511800f970 comp rx=0 tx=0).stop 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f51140b6050 con 0x7f511c153d20 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5112ffd640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51000661f0 0x7f51000686b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f51141227f0 con 0x7f511c153d20 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5122415640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51000661f0 0x7f51000686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.047+0000 7f5122415640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51000661f0 0x7f51000686b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5118000c10 tx=0x7f5118020040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.051+0000 7f5123417640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c1502d0 0x7f511c1f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.051+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c1ef690 con 0x7f511c1502d0 2023-11-28T20:53:27.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.051+0000 7f5121c14640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c1502d0 0x7f511c1f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.051+0000 7f5121c14640 1 -- 172.21.15.167:0/1893027802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f511c0c5550 con 0x7f511c1502d0 2023-11-28T20:53:27.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.051+0000 7f5121c14640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c1502d0 0x7f511c1f2a10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f511c1516a0 tx=0x7f510c0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.051+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c017070 con 0x7f511c1502d0 2023-11-28T20:53:27.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4473 (secure 0 0 0) 0x7f510c00f660 con 0x7f511c1502d0 2023-11-28T20:53:27.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c1502d0 msgr2=0x7f511c1f2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5112ffd640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c1502d0 0x7f511c1f2a10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f511c1516a0 tx=0x7f510c0019c0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5112ffd640 1 -- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c1502d0 msgr2=0x7f511c1f2a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:27.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5112ffd640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c1502d0 0x7f511c1f2a10 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f511c1516a0 tx=0x7f510c0019c0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.057 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:53:27.057 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:27.057 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:27.057 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:53:27.057 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 120, 2023-11-28T20:53:27.057 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:53:27.057 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:53:27.057 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:27.058 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:27.059 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:27.060 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:27.060 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:27.060 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:27.060 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:27.060 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:27.061 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:27.062 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.063 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:53:27.065 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:27.066 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:27.066 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:27.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.066 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:27.066 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:27.066 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:27.066 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:27.068 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.069 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.070 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:53:27.070 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:53:27.070 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:27.070 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:27.070 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:27.070 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.070 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.071 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.072 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.072 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:53:27.072 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.072 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.072 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:53:27.072 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:53:27.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51000661f0 msgr2=0x7f51000686b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5123417640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f51000661f0 0x7f51000686b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5118000c10 tx=0x7f5118020040 comp rx=0 tx=0).stop 2023-11-28T20:53:27.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c153d20 msgr2=0x7f511c14f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5123417640 1 --2- 172.21.15.167:0/1893027802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f511c153d20 0x7f511c14f3b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f51140b2040 tx=0x7f511401bed0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5122c16640 1 -- 172.21.15.167:0/1893027802 reap_dead start 2023-11-28T20:53:27.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5122c16640 1 -- 172.21.15.167:0/1893027802 reap_dead start 2023-11-28T20:53:27.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 shutdown_connections 2023-11-28T20:53:27.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 >> 172.21.15.167:0/1893027802 conn(0x7f511c06b800 msgr2=0x7f511c1519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:27.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 shutdown_connections 2023-11-28T20:53:27.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.055+0000 7f5123417640 1 -- 172.21.15.167:0/1893027802 wait complete. 2023-11-28T20:53:27.076 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at f524150822a v0.12 2023-11-28T20:53:27.077 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:53:27.078 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:53:27.078 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:53:27.082 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.12 2023-11-28T20:53:27.233 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 13 -eq 48 ] 2023-11-28T20:53:27.233 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.13 2023-11-28T20:53:27.233 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.13 2023-11-28T20:53:27.233 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.13 2023-11-28T20:53:27.233 INFO:tasks.workunit.client.0.smithi167.stdout:v0.13 2023-11-28T20:53:27.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.239+0000 7f52543f5640 1 Processor -- start 2023-11-28T20:53:27.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.239+0000 7f52543f5640 1 -- start start 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f52543f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52440d9340 0x7f524404b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f52543f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f524404bf10 0x7f524404ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f52543f5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440dfab0 con 0x7f524404f3b0 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f52543f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440d9720 con 0x7f52440d9340 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f52543f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440def00 con 0x7f524404bf10 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f5252191640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52440d9340 0x7f524404b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f5252191640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52440d9340 0x7f524404b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37976/0 (socket says 172.21.15.167:37976) 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f5252191640 1 -- 172.21.15.167:0/3958613615 learned_addr learned my addr 172.21.15.167:0/3958613615 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f5251990640 1 --2- 172.21.15.167:0/3958613615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f524404bf10 0x7f524404ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f5252191640 1 -- 172.21.15.167:0/3958613615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f524404bf10 msgr2=0x7f524404ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:53:27.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f5252191640 1 --2- 172.21.15.167:0/3958613615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f524404bf10 0x7f524404ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f5252191640 1 -- 172.21.15.167:0/3958613615 >> v1:172.21.15.178:6789/0 conn(0x7f524404f3b0 legacy=0x7f5244007190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.243+0000 7f5252191640 1 -- 172.21.15.167:0/3958613615 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524400efa0 con 0x7f52440d9340 2023-11-28T20:53:27.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.247+0000 7f5252191640 1 --2- 172.21.15.167:0/3958613615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52440d9340 0x7f524404b9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5248009870 tx=0x7f524801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33570b58e1f88ab0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.247+0000 7f525118f640 1 -- 172.21.15.167:0/3958613615 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480a8a30 con 0x7f52440d9340 2023-11-28T20:53:27.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.247+0000 7f525118f640 1 -- 172.21.15.167:0/3958613615 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52480a8b90 con 0x7f52440d9340 2023-11-28T20:53:27.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.247+0000 7f525118f640 1 -- 172.21.15.167:0/3958613615 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480b0440 con 0x7f52440d9340 2023-11-28T20:53:27.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.247+0000 7f52543f5640 1 -- 172.21.15.167:0/3958613615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52440d9340 msgr2=0x7f524404b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.247+0000 7f52543f5640 1 --2- 172.21.15.167:0/3958613615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52440d9340 0x7f524404b9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5248009870 tx=0x7f524801ed30 comp rx=0 tx=0).stop 2023-11-28T20:53:27.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.251+0000 7f52543f5640 1 -- 172.21.15.167:0/3958613615 shutdown_connections 2023-11-28T20:53:27.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.251+0000 7f52543f5640 1 --2- 172.21.15.167:0/3958613615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f524404bf10 0x7f524404ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.251+0000 7f52543f5640 1 --2- 172.21.15.167:0/3958613615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52440d9340 0x7f524404b9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.251+0000 7f52543f5640 1 -- 172.21.15.167:0/3958613615 >> 172.21.15.167:0/3958613615 conn(0x7f524400e140 msgr2=0x7f524400e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:27.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.251+0000 7f52543f5640 1 -- 172.21.15.167:0/3958613615 shutdown_connections 2023-11-28T20:53:27.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.251+0000 7f52543f5640 1 -- 172.21.15.167:0/3958613615 wait complete. 2023-11-28T20:53:27.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.251+0000 7f52543f5640 1 Processor -- start 2023-11-28T20:53:27.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.251+0000 7f52543f5640 1 -- start start 2023-11-28T20:53:27.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f52543f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f524404bf10 0x7f5244053550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f52543f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f524404f3b0 0x7f52440397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f52543f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52440d9340 0x7f524417cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f52543f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524400de00 con 0x7f52440d9340 2023-11-28T20:53:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f52543f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5244005b70 con 0x7f524404bf10 2023-11-28T20:53:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f52543f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440d4aa0 con 0x7f524404f3b0 2023-11-28T20:53:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252191640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f524404bf10 0x7f5244053550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252992640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52440d9340 0x7f524417cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252191640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f524404bf10 0x7f5244053550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:45986/0 (socket says 172.21.15.167:45986) 2023-11-28T20:53:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252191640 1 -- 172.21.15.167:0/3738563419 learned_addr learned my addr 172.21.15.167:0/3738563419 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5251990640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f524404f3b0 0x7f52440397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252992640 1 -- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f524404f3b0 msgr2=0x7f52440397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252992640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f524404f3b0 0x7f52440397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252992640 1 -- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f524404bf10 msgr2=0x7f5244053550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252992640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f524404bf10 0x7f5244053550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252992640 1 -- 172.21.15.167:0/3738563419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480094d0 con 0x7f52440d9340 2023-11-28T20:53:27.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252191640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f524404bf10 0x7f5244053550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:53:27.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5252992640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52440d9340 0x7f524417cdc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f524c04fb60 tx=0x7f524c067af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c06bb10 con 0x7f52440d9340 2023-11-28T20:53:27.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c06bc90 con 0x7f52440d9340 2023-11-28T20:53:27.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5244006e70 con 0x7f52440d9340 2023-11-28T20:53:27.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c072150 con 0x7f52440d9340 2023-11-28T20:53:27.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.255+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440d44e0 con 0x7f52440d9340 2023-11-28T20:53:27.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.259+0000 7f52543f5640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244007150 0x7f5244007530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.259+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5244008910 con 0x7f5244007150 2023-11-28T20:53:27.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.259+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f524c091020 con 0x7f52440d9340 2023-11-28T20:53:27.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.259+0000 7f5252191640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244007150 0x7f5244007530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.259+0000 7f5252191640 1 -- 172.21.15.167:0/3738563419 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5244007a70 con 0x7f5244007150 2023-11-28T20:53:27.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5252191640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244007150 0x7f5244007530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f524801d3e0 tx=0x7f524801d570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5242ffd640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5230066570 0x7f5230068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f524c0fe2f0 con 0x7f52440d9340 2023-11-28T20:53:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480ba610 con 0x7f5244007150 2023-11-28T20:53:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f52480ba770 con 0x7f5244007150 2023-11-28T20:53:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244007150 msgr2=0x7f5244007530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5242ffd640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244007150 0x7f5244007530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f524801d3e0 tx=0x7f524801d570 comp rx=0 tx=0).stop 2023-11-28T20:53:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244007150 msgr2=0x7f5244007530 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5242ffd640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244007150 0x7f5244007530 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f524801d3e0 tx=0x7f524801d570 comp rx=0 tx=0).stop 2023-11-28T20:53:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5251990640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5230066570 0x7f5230068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.263+0000 7f5251990640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5230066570 0x7f5230068a30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f524404bee0 tx=0x7f523c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.271+0000 7f52543f5640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244005e80 0x7f5244006260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.271+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440df740 con 0x7f5244005e80 2023-11-28T20:53:27.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.271+0000 7f5252191640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244005e80 0x7f5244006260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.271+0000 7f5252191640 1 -- 172.21.15.167:0/3738563419 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f52440df460 con 0x7f5244005e80 2023-11-28T20:53:27.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.271+0000 7f5252191640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244005e80 0x7f5244006260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5244039dd0 tx=0x7f524801bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480ca070 con 0x7f5244005e80 2023-11-28T20:53:27.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4641 (secure 0 0 0) 0x7f5248003830 con 0x7f5244005e80 2023-11-28T20:53:27.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244005e80 msgr2=0x7f5244006260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f5242ffd640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244005e80 0x7f5244006260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5244039dd0 tx=0x7f524801bad0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f5242ffd640 1 -- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244005e80 msgr2=0x7f5244006260 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f5242ffd640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5244005e80 0x7f5244006260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 120, 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:53:27.277 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:27.278 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:27.279 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:53:27.280 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:53:27.281 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:53:27.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.283 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.284 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:27.285 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:27.285 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:27.285 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:27.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.285 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:27.285 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:53:27.285 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.286 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:27.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:53:27.286 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.286 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.286 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:53:27.287 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:53:27.287 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:27.287 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:27.287 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:27.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.287 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:27.287 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:27.287 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.289 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:53:27.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.291 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.291 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.291 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:53:27.291 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.291 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.291 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:53:27.291 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:53:27.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5230066570 msgr2=0x7f5230068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f52543f5640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5230066570 0x7f5230068a30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f524404bee0 tx=0x7f523c008040 comp rx=0 tx=0).stop 2023-11-28T20:53:27.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52440d9340 msgr2=0x7f524417cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f52543f5640 1 --2- 172.21.15.167:0/3738563419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52440d9340 0x7f524417cdc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f524c04fb60 tx=0x7f524c067af0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f5252992640 1 -- 172.21.15.167:0/3738563419 reap_dead start 2023-11-28T20:53:27.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f5252992640 1 -- 172.21.15.167:0/3738563419 reap_dead start 2023-11-28T20:53:27.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 shutdown_connections 2023-11-28T20:53:27.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 >> 172.21.15.167:0/3738563419 conn(0x7f524400e140 msgr2=0x7f52440d7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:27.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 shutdown_connections 2023-11-28T20:53:27.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.275+0000 7f52543f5640 1 -- 172.21.15.167:0/3738563419 wait complete. 2023-11-28T20:53:27.295 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:53:27.295 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:53:27.295 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:53:27.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f504be32640 1 Processor -- start 2023-11-28T20:53:27.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f504be32640 1 -- start start 2023-11-28T20:53:27.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f504be32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f50440cf860 0x7f50440cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f504be32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440cfc40 0x7f50440ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f504be32640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504415ac00 con 0x7f5044153ae0 2023-11-28T20:53:27.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f504be32640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50440cbd60 con 0x7f50440cf860 2023-11-28T20:53:27.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f504be32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5044159ff0 con 0x7f50440cfc40 2023-11-28T20:53:27.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f5049bce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f50440cf860 0x7f50440cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f5049bce640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f50440cf860 0x7f50440cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37994/0 (socket says 172.21.15.167:37994) 2023-11-28T20:53:27.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f5049bce640 1 -- 172.21.15.167:0/4281564879 learned_addr learned my addr 172.21.15.167:0/4281564879 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:27.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f50493cd640 1 --2- 172.21.15.167:0/4281564879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440cfc40 0x7f50440ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f5049bce640 1 -- 172.21.15.167:0/4281564879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440cfc40 msgr2=0x7f50440ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:53:27.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f5049bce640 1 --2- 172.21.15.167:0/4281564879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440cfc40 0x7f50440ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f5049bce640 1 -- 172.21.15.167:0/4281564879 >> v1:172.21.15.178:6789/0 conn(0x7f5044153ae0 legacy=0x7f504415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.451+0000 7f5049bce640 1 -- 172.21.15.167:0/4281564879 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504415a2d0 con 0x7f50440cf860 2023-11-28T20:53:27.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f5049bce640 1 --2- 172.21.15.167:0/4281564879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50440cf860 0x7f50440cb770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5040009870 tx=0x7f504001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717059ab485e6aae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f5048bcc640 1 -- 172.21.15.167:0/4281564879 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400aa670 con 0x7f50440cf860 2023-11-28T20:53:27.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f5048bcc640 1 -- 172.21.15.167:0/4281564879 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50400aa7d0 con 0x7f50440cf860 2023-11-28T20:53:27.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f5048bcc640 1 -- 172.21.15.167:0/4281564879 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400aab60 con 0x7f50440cf860 2023-11-28T20:53:27.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f504be32640 1 -- 172.21.15.167:0/4281564879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50440cf860 msgr2=0x7f50440cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f504be32640 1 --2- 172.21.15.167:0/4281564879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50440cf860 0x7f50440cb770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5040009870 tx=0x7f504001c510 comp rx=0 tx=0).stop 2023-11-28T20:53:27.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f504be32640 1 -- 172.21.15.167:0/4281564879 shutdown_connections 2023-11-28T20:53:27.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f504be32640 1 --2- 172.21.15.167:0/4281564879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440cfc40 0x7f50440ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f504be32640 1 --2- 172.21.15.167:0/4281564879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50440cf860 0x7f50440cb770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f504be32640 1 -- 172.21.15.167:0/4281564879 >> 172.21.15.167:0/4281564879 conn(0x7f504406c1f0 msgr2=0x7f5044071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:27.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f504be32640 1 -- 172.21.15.167:0/4281564879 shutdown_connections 2023-11-28T20:53:27.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.455+0000 7f504be32640 1 -- 172.21.15.167:0/4281564879 wait complete. 2023-11-28T20:53:27.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 Processor -- start 2023-11-28T20:53:27.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 -- start start 2023-11-28T20:53:27.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440cf860 0x7f50440cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50440cfc40 0x7f50441581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5044153ae0 0x7f5044158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044148110 con 0x7f5044153ae0 2023-11-28T20:53:27.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044148bc0 con 0x7f50440cfc40 2023-11-28T20:53:27.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5044148320 con 0x7f50440cf860 2023-11-28T20:53:27.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504a3cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5044153ae0 0x7f5044158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504a3cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5044153ae0 0x7f5044158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38006/0 (socket says 172.21.15.167:38006) 2023-11-28T20:53:27.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504a3cf640 1 -- 172.21.15.167:0/2131574522 learned_addr learned my addr 172.21.15.167:0/2131574522 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:27.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f5049bce640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440cf860 0x7f50440cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f50493cd640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50440cfc40 0x7f50441581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504a3cf640 1 -- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440cf860 msgr2=0x7f50440cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504a3cf640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440cf860 0x7f50440cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504a3cf640 1 -- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50440cfc40 msgr2=0x7f50441581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504a3cf640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50440cfc40 0x7f50441581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504a3cf640 1 -- 172.21.15.167:0/2131574522 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400094d0 con 0x7f5044153ae0 2023-11-28T20:53:27.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f50493cd640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50440cfc40 0x7f50441581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:53:27.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504a3cf640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5044153ae0 0x7f5044158710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c770 tx=0x7f503c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c003b80 con 0x7f5044153ae0 2023-11-28T20:53:27.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c003ce0 con 0x7f5044153ae0 2023-11-28T20:53:27.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00aa90 con 0x7f5044153ae0 2023-11-28T20:53:27.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5044148600 con 0x7f5044153ae0 2023-11-28T20:53:27.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.459+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5044157cb0 con 0x7f5044153ae0 2023-11-28T20:53:27.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f504be32640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5044144610 0x7f50441f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5044072860 con 0x7f5044144610 2023-11-28T20:53:27.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f5049bce640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5044144610 0x7f50441f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f503c00abf0 con 0x7f5044153ae0 2023-11-28T20:53:27.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f5049bce640 1 -- 172.21.15.167:0/2131574522 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50440c9cc0 con 0x7f5044144610 2023-11-28T20:53:27.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f5049bce640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5044144610 0x7f50441f6160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f50440c9c50 tx=0x7f504001ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f503a7fc640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f50280664a0 0x7f5028068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f503c083fe0 con 0x7f5044153ae0 2023-11-28T20:53:27.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400aad80 con 0x7f5044144610 2023-11-28T20:53:27.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f50493cd640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f50280664a0 0x7f5028068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f50400bd410 con 0x7f5044144610 2023-11-28T20:53:27.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5044144610 msgr2=0x7f50441f6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f503a7fc640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5044144610 0x7f50441f6160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f50440c9c50 tx=0x7f504001ad50 comp rx=0 tx=0).stop 2023-11-28T20:53:27.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5044144610 msgr2=0x7f50441f6160 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:27.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f503a7fc640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5044144610 0x7f50441f6160 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f50440c9c50 tx=0x7f504001ad50 comp rx=0 tx=0).stop 2023-11-28T20:53:27.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.463+0000 7f50493cd640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f50280664a0 0x7f5028068960 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f50440cf570 tx=0x7f5034008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504be32640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440c9530 0x7f50441f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5044071e40 con 0x7f50440c9530 2023-11-28T20:53:27.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f5049bce640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440c9530 0x7f50441f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f5049bce640 1 -- 172.21.15.167:0/2131574522 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5044154300 con 0x7f50440c9530 2023-11-28T20:53:27.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f5049bce640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440c9530 0x7f50441f66a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f504001a140 tx=0x7f50400192b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400c5300 con 0x7f50440c9530 2023-11-28T20:53:27.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5124 (secure 0 0 0) 0x7f50400c56c0 con 0x7f50440c9530 2023-11-28T20:53:27.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440c9530 msgr2=0x7f50441f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f503a7fc640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440c9530 0x7f50441f66a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f504001a140 tx=0x7f50400192b0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f503a7fc640 1 -- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440c9530 msgr2=0x7f50441f66a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:27.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f503a7fc640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50440c9530 0x7f50441f66a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.476 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:53:27.476 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:27.476 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:27.476 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:53:27.476 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 120, 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:27.477 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:53:27.478 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:27.479 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:27.480 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:53:27.481 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:53:27.481 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:53:27.481 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:53:27.481 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:53:27.481 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:53:27.481 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:53:27.481 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:27.481 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:53:27.482 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:27.482 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:27.482 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:27.482 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:27.482 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:27.482 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:27.482 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:27.482 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:27.483 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.484 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.485 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:27.487 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:27.488 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.489 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.490 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:53:27.491 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.492 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:27.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:27.494 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:53:27.494 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:53:27.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f50280664a0 msgr2=0x7f5028068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504be32640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f50280664a0 0x7f5028068960 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f50440cf570 tx=0x7f5034008040 comp rx=0 tx=0).stop 2023-11-28T20:53:27.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5044153ae0 msgr2=0x7f5044158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504be32640 1 --2- 172.21.15.167:0/2131574522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5044153ae0 0x7f5044158710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c770 tx=0x7f503c00cc30 comp rx=0 tx=0).stop 2023-11-28T20:53:27.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504a3cf640 1 -- 172.21.15.167:0/2131574522 reap_dead start 2023-11-28T20:53:27.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504a3cf640 1 -- 172.21.15.167:0/2131574522 reap_dead start 2023-11-28T20:53:27.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 shutdown_connections 2023-11-28T20:53:27.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 >> 172.21.15.167:0/2131574522 conn(0x7f504406c1f0 msgr2=0x7f50440c5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:27.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.471+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 shutdown_connections 2023-11-28T20:53:27.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.475+0000 7f504be32640 1 -- 172.21.15.167:0/2131574522 wait complete. 2023-11-28T20:53:27.496 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:53:27.497 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2023-11-28T20:53:27.497 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:53:27.497 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2023-11-28T20:53:27.497 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:53:27.497 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T20:53:27.498 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:53:27.519 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T20:53:27.519 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:53:27.519 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:27.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a7fd1640 1 Processor -- start 2023-11-28T20:53:27.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a7fd1640 1 -- start start 2023-11-28T20:53:27.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a7fd1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cf860 0x7f80a00cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a7fd1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f80a00cfc40 0x7f80a00ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a7fd1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a015ac00 con 0x7f80a0153ae0 2023-11-28T20:53:27.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a7fd1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00cbd60 con 0x7f80a00cfc40 2023-11-28T20:53:27.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a7fd1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0159ff0 con 0x7f80a00cf860 2023-11-28T20:53:27.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a556c640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f80a00cfc40 msgr2=0x7f80a00ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:27.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a556c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f80a00cfc40 0x7f80a00ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:27.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a5d6d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cf860 0x7f80a00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a656e640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f80a0153ae0 legacy=0x7f80a015d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:53:27.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a5d6d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cf860 0x7f80a00cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:44060/0 (socket says 172.21.15.167:44060) 2023-11-28T20:53:27.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.663+0000 7f80a5d6d640 1 -- 172.21.15.167:0/1874487172 learned_addr learned my addr 172.21.15.167:0/1874487172 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:27.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.667+0000 7f80a5d6d640 1 -- 172.21.15.167:0/1874487172 >> v2:172.21.15.178:3300/0 conn(0x7f80a00cfc40 msgr2=0x7f80a00ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:27.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.667+0000 7f80a5d6d640 1 --2- 172.21.15.167:0/1874487172 >> v2:172.21.15.178:3300/0 conn(0x7f80a00cfc40 0x7f80a00ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.667+0000 7f80a5d6d640 1 -- 172.21.15.167:0/1874487172 >> v1:172.21.15.178:6789/0 conn(0x7f80a0153ae0 legacy=0x7f80a015d4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:27.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.667+0000 7f80a5d6d640 1 -- 172.21.15.167:0/1874487172 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a015a2d0 con 0x7f80a00cf860 2023-11-28T20:53:27.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.671+0000 7f80a5d6d640 1 --2- 172.21.15.167:0/1874487172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cf860 0x7f80a00cb770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f809c009870 tx=0x7f809c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46455237c94ceb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.671+0000 7f80a4d6b640 1 -- 172.21.15.167:0/1874487172 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c0aa610 con 0x7f80a00cf860 2023-11-28T20:53:27.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.671+0000 7f80a4d6b640 1 -- 172.21.15.167:0/1874487172 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c0a6040 con 0x7f80a00cf860 2023-11-28T20:53:27.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.671+0000 7f80a4d6b640 1 -- 172.21.15.167:0/1874487172 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c0aa990 con 0x7f80a00cf860 2023-11-28T20:53:27.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 -- 172.21.15.167:0/1874487172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cf860 msgr2=0x7f80a00cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 --2- 172.21.15.167:0/1874487172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cf860 0x7f80a00cb770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f809c009870 tx=0x7f809c01c4f0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 -- 172.21.15.167:0/1874487172 shutdown_connections 2023-11-28T20:53:27.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 --2- 172.21.15.167:0/1874487172 >> v2:172.21.15.178:3300/0 conn(0x7f80a00cfc40 0x7f80a00ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 --2- 172.21.15.167:0/1874487172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cf860 0x7f80a00cb770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 -- 172.21.15.167:0/1874487172 >> 172.21.15.167:0/1874487172 conn(0x7f80a006c1f0 msgr2=0x7f80a0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:27.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 -- 172.21.15.167:0/1874487172 shutdown_connections 2023-11-28T20:53:27.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 -- 172.21.15.167:0/1874487172 wait complete. 2023-11-28T20:53:27.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 Processor -- start 2023-11-28T20:53:27.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.675+0000 7f80a7fd1640 1 -- start start 2023-11-28T20:53:27.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a7fd1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a00cf860 0x7f80a0148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a7fd1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cfc40 0x7f80a00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a7fd1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a0153ae0 0x7f80a01f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a7fd1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0159710 con 0x7f80a0153ae0 2023-11-28T20:53:27.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a7fd1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01fa6a0 con 0x7f80a00cf860 2023-11-28T20:53:27.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a7fd1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01fa980 con 0x7f80a00cfc40 2023-11-28T20:53:27.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a5d6d640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a00cf860 msgr2=0x7f80a0148b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:27.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a5d6d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a00cf860 0x7f80a0148b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:27.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a656e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a0153ae0 0x7f80a01f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a656e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a0153ae0 0x7f80a01f7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38028/0 (socket says 172.21.15.167:38028) 2023-11-28T20:53:27.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a656e640 1 -- 172.21.15.167:0/558945784 learned_addr learned my addr 172.21.15.167:0/558945784 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:27.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a556c640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cfc40 0x7f80a00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a656e640 1 -- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cfc40 msgr2=0x7f80a00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a656e640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cfc40 0x7f80a00b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a656e640 1 -- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a00cf860 msgr2=0x7f80a0148b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:27.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a656e640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a00cf860 0x7f80a0148b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a656e640 1 -- 172.21.15.167:0/558945784 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0094d0 con 0x7f80a0153ae0 2023-11-28T20:53:27.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a556c640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cfc40 0x7f80a00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:53:27.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a656e640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a0153ae0 0x7f80a01f7090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f809800b760 tx=0x7f809800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80967fc640 1 -- 172.21.15.167:0/558945784 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800c960 con 0x7f80a0153ae0 2023-11-28T20:53:27.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80967fc640 1 -- 172.21.15.167:0/558945784 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800cac0 con 0x7f80a0153ae0 2023-11-28T20:53:27.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80967fc640 1 -- 172.21.15.167:0/558945784 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098015470 con 0x7f80a0153ae0 2023-11-28T20:53:27.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a01fac60 con 0x7f80a0153ae0 2023-11-28T20:53:27.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.679+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a014a050 con 0x7f80a0153ae0 2023-11-28T20:53:27.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.683+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a0075c90 con 0x7f80a0153ae0 2023-11-28T20:53:27.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.683+0000 7f80967fc640 1 -- 172.21.15.167:0/558945784 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8098012070 con 0x7f80a0153ae0 2023-11-28T20:53:27.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.687+0000 7f80967fc640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8084066470 0x7f8084068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:27.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.687+0000 7f80967fc640 1 -- 172.21.15.167:0/558945784 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8098083fe0 con 0x7f80a0153ae0 2023-11-28T20:53:27.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.687+0000 7f80a5d6d640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8084066470 0x7f8084068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:27.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.687+0000 7f80a5d6d640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8084066470 0x7f8084068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f809c0ae000 tx=0x7f809c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:27.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.691+0000 7f80967fc640 1 -- 172.21.15.167:0/558945784 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8098051040 con 0x7f80a0153ae0 2023-11-28T20:53:27.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.931+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f80a01fb110 con 0x7f80a0153ae0 2023-11-28T20:53:27.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.931+0000 7f80967fc640 1 -- 172.21.15.167:0/558945784 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f8098054660 con 0x7f80a0153ae0 2023-11-28T20:53:27.936 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:27.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8084066470 msgr2=0x7f8084068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8084066470 0x7f8084068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f809c0ae000 tx=0x7f809c008040 comp rx=0 tx=0).stop 2023-11-28T20:53:27.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a0153ae0 msgr2=0x7f80a01f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:27.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a0153ae0 0x7f80a01f7090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f809800b760 tx=0x7f809800bc20 comp rx=0 tx=0).stop 2023-11-28T20:53:27.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 shutdown_connections 2023-11-28T20:53:27.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8084066470 0x7f8084068930 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a0153ae0 0x7f80a01f7090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a00cfc40 0x7f80a00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 --2- 172.21.15.167:0/558945784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a00cf860 0x7f80a0148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:27.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 >> 172.21.15.167:0/558945784 conn(0x7f80a006c1f0 msgr2=0x7f80a00662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:27.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 shutdown_connections 2023-11-28T20:53:27.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:27.935+0000 7f80a7fd1640 1 -- 172.21.15.167:0/558945784 wait complete. 2023-11-28T20:53:30.957 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:31.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2eddf34640 1 Processor -- start 2023-11-28T20:53:31.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2eddf34640 1 -- start start 2023-11-28T20:53:31.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2eddf34640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ed8153db0 0x7f2ed815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:31.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2eddf34640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ed80cf440 0x7f2ed80cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:31.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2eddf34640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80cfef0 con 0x7f2ed80ccb70 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2eddf34640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed80cc6e0 con 0x7f2ed8153db0 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2eddf34640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed8154190 con 0x7f2ed80cf440 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2edd733640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f2ed80cf440 msgr2=0x7f2ed80cf8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2edcf32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ed8153db0 0x7f2ed815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2ed7fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2ed80ccb70 0x7f2ed80c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39310/0 (socket says 172.21.15.167:39310) 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2ed7fff640 1 -- 172.21.15.167:0/3991042148 learned_addr learned my addr 172.21.15.167:0/3991042148 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2edd733640 1 --2- 172.21.15.167:0/3991042148 >> v2:172.21.15.178:3300/0 conn(0x7f2ed80cf440 0x7f2ed80cf8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2edcf32640 1 -- 172.21.15.167:0/3991042148 >> v2:172.21.15.178:3300/0 conn(0x7f2ed80cf440 msgr2=0x7f2ed80cf8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2edcf32640 1 --2- 172.21.15.167:0/3991042148 >> v2:172.21.15.178:3300/0 conn(0x7f2ed80cf440 0x7f2ed80cf8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2edcf32640 1 -- 172.21.15.167:0/3991042148 >> v1:172.21.15.167:6789/0 conn(0x7f2ed80ccb70 legacy=0x7f2ed80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:31.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2edcf32640 1 -- 172.21.15.167:0/3991042148 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed80cbad0 con 0x7f2ed8153db0 2023-11-28T20:53:31.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.099+0000 7f2ed77fe640 1 -- 172.21.15.167:0/3991042148 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854705805 0 0) 0x7f2ed80cfef0 con 0x7f2ed80ccb70 2023-11-28T20:53:31.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.103+0000 7f2edcf32640 1 --2- 172.21.15.167:0/3991042148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed8153db0 0x7f2ed815a540 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80cd320 tx=0x7f2ecc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a797cdcb204403a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:31.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.103+0000 7f2ed77fe640 1 -- 172.21.15.167:0/3991042148 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0ab600 con 0x7f2ed8153db0 2023-11-28T20:53:31.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.103+0000 7f2ed77fe640 1 -- 172.21.15.167:0/3991042148 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc0a7050 con 0x7f2ed8153db0 2023-11-28T20:53:31.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.103+0000 7f2ed77fe640 1 -- 172.21.15.167:0/3991042148 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0ab980 con 0x7f2ed8153db0 2023-11-28T20:53:31.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 -- 172.21.15.167:0/3991042148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed8153db0 msgr2=0x7f2ed815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:31.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 --2- 172.21.15.167:0/3991042148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed8153db0 0x7f2ed815a540 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80cd320 tx=0x7f2ecc01c480 comp rx=0 tx=0).stop 2023-11-28T20:53:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 -- 172.21.15.167:0/3991042148 shutdown_connections 2023-11-28T20:53:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 --2- 172.21.15.167:0/3991042148 >> v2:172.21.15.178:3300/0 conn(0x7f2ed80cf440 0x7f2ed80cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 --2- 172.21.15.167:0/3991042148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed8153db0 0x7f2ed815a540 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 -- 172.21.15.167:0/3991042148 >> 172.21.15.167:0/3991042148 conn(0x7f2ed806b800 msgr2=0x7f2ed806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 -- 172.21.15.167:0/3991042148 shutdown_connections 2023-11-28T20:53:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 -- 172.21.15.167:0/3991042148 wait complete. 2023-11-28T20:53:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 Processor -- start 2023-11-28T20:53:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 -- start start 2023-11-28T20:53:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed80ccb70 0x7f2ed80c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed80cf440 0x7f2ed80c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:31.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed8153db0 0x7f2ed81f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:31.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80c8830 con 0x7f2ed80cf440 2023-11-28T20:53:31.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed815c4f0 con 0x7f2ed80ccb70 2023-11-28T20:53:31.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2eddf34640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed815dd60 con 0x7f2ed8153db0 2023-11-28T20:53:31.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2edcf32640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed80ccb70 msgr2=0x7f2ed80c9360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:31.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2edcf32640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed80ccb70 0x7f2ed80c9360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:31.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2ed7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed80cf440 0x7f2ed80c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:31.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2ed7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed80cf440 0x7f2ed80c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38046/0 (socket says 172.21.15.167:38046) 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2ed7fff640 1 -- 172.21.15.167:0/1861184397 learned_addr learned my addr 172.21.15.167:0/1861184397 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.107+0000 7f2edd733640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed8153db0 0x7f2ed81f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed7fff640 1 -- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed8153db0 msgr2=0x7f2ed81f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed7fff640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed8153db0 0x7f2ed81f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed7fff640 1 -- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed80ccb70 msgr2=0x7f2ed80c9360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed7fff640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed80ccb70 0x7f2ed80c9360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed7fff640 1 -- 172.21.15.167:0/1861184397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc009420 con 0x7f2ed80cf440 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2edd733640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed8153db0 0x7f2ed81f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed7fff640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed80cf440 0x7f2ed80c6780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400c480 tx=0x7f2ec400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed57fa640 1 -- 172.21.15.167:0/1861184397 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40074e0 con 0x7f2ed80cf440 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed57fa640 1 -- 172.21.15.167:0/1861184397 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec4007660 con 0x7f2ed80cf440 2023-11-28T20:53:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed815c700 con 0x7f2ed80cf440 2023-11-28T20:53:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed57fa640 1 -- 172.21.15.167:0/1861184397 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4004a30 con 0x7f2ed80cf440 2023-11-28T20:53:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed815ccc0 con 0x7f2ed80cf440 2023-11-28T20:53:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed804e850 con 0x7f2ed80cf440 2023-11-28T20:53:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.111+0000 7f2ed57fa640 1 -- 172.21.15.167:0/1861184397 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ec4004b90 con 0x7f2ed80cf440 2023-11-28T20:53:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.115+0000 7f2ed57fa640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ebc066420 0x7f2ebc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:31.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.115+0000 7f2ed57fa640 1 -- 172.21.15.167:0/1861184397 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2ec40837b0 con 0x7f2ed80cf440 2023-11-28T20:53:31.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.115+0000 7f2edcf32640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ebc066420 0x7f2ebc0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:31.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.115+0000 7f2edcf32640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ebc066420 0x7f2ebc0688e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0ad000 tx=0x7f2ecc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.119+0000 7f2ed57fa640 1 -- 172.21.15.167:0/1861184397 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ec40507a0 con 0x7f2ed80cf440 2023-11-28T20:53:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.323+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2ed814de40 con 0x7f2ed80cf440 2023-11-28T20:53:31.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2ed57fa640 1 -- 172.21.15.167:0/1861184397 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f2ec4018630 con 0x7f2ed80cf440 2023-11-28T20:53:31.328 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:31.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ebc066420 msgr2=0x7f2ebc0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ebc066420 0x7f2ebc0688e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0ad000 tx=0x7f2ecc008040 comp rx=0 tx=0).stop 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed80cf440 msgr2=0x7f2ed80c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed80cf440 0x7f2ed80c6780 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400c480 tx=0x7f2ec400c940 comp rx=0 tx=0).stop 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 shutdown_connections 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ebc066420 0x7f2ebc0688e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ed8153db0 0x7f2ed81f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed80cf440 0x7f2ed80c6780 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 --2- 172.21.15.167:0/1861184397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed80ccb70 0x7f2ed80c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 >> 172.21.15.167:0/1861184397 conn(0x7f2ed806b800 msgr2=0x7f2ed80b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 shutdown_connections 2023-11-28T20:53:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:31.327+0000 7f2eddf34640 1 -- 172.21.15.167:0/1861184397 wait complete. 2023-11-28T20:53:34.350 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:34.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78bbfaa640 1 Processor -- start 2023-11-28T20:53:34.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78bbfaa640 1 -- start start 2023-11-28T20:53:34.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78bbfaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b40c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:34.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78bbfaa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b415b220 con 0x7f78b4151f60 2023-11-28T20:53:34.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78bbfaa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b40c7a20 con 0x7f78b406a580 2023-11-28T20:53:34.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78bbfaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40c4da0 con 0x7f78b40c75c0 2023-11-28T20:53:34.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78ba547640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f78b406a580 legacy=0x7f78b41625b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:53:34.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78b9d46640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f78b4151f60 0x7f78b40c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53770/0 (socket says 172.21.15.167:53770) 2023-11-28T20:53:34.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78b9d46640 1 -- 172.21.15.167:0/3266320483 learned_addr learned my addr 172.21.15.167:0/3266320483 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:53:34.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78b9545640 1 --2- 172.21.15.167:0/3266320483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b40c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:34.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78b9545640 1 -- 172.21.15.167:0/3266320483 >> v1:172.21.15.178:6789/0 conn(0x7f78b406a580 legacy=0x7f78b41625b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:34.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78b9545640 1 -- 172.21.15.167:0/3266320483 >> v1:172.21.15.167:6789/0 conn(0x7f78b4151f60 legacy=0x7f78b40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:34.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.495+0000 7f78b9545640 1 -- 172.21.15.167:0/3266320483 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4152340 con 0x7f78b40c75c0 2023-11-28T20:53:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.499+0000 7f78b9545640 1 --2- 172.21.15.167:0/3266320483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b40c5c90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78a40097f0 tx=0x7f78a401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ebb5a99c1855fb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.499+0000 7f78b8d44640 1 -- 172.21.15.167:0/3266320483 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40ab600 con 0x7f78b40c75c0 2023-11-28T20:53:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.499+0000 7f78b8d44640 1 -- 172.21.15.167:0/3266320483 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a40a7050 con 0x7f78b40c75c0 2023-11-28T20:53:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.499+0000 7f78b8d44640 1 -- 172.21.15.167:0/3266320483 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a40ab980 con 0x7f78b40c75c0 2023-11-28T20:53:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.499+0000 7f78bbfaa640 1 -- 172.21.15.167:0/3266320483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 msgr2=0x7f78b40c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.499+0000 7f78bbfaa640 1 --2- 172.21.15.167:0/3266320483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b40c5c90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78a40097f0 tx=0x7f78a401c3f0 comp rx=0 tx=0).stop 2023-11-28T20:53:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.499+0000 7f78bbfaa640 1 -- 172.21.15.167:0/3266320483 shutdown_connections 2023-11-28T20:53:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.499+0000 7f78bbfaa640 1 --2- 172.21.15.167:0/3266320483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b40c5c90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.499+0000 7f78bbfaa640 1 -- 172.21.15.167:0/3266320483 >> 172.21.15.167:0/3266320483 conn(0x7f78b40cb1e0 msgr2=0x7f78b40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 -- 172.21.15.167:0/3266320483 shutdown_connections 2023-11-28T20:53:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 -- 172.21.15.167:0/3266320483 wait complete. 2023-11-28T20:53:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 Processor -- start 2023-11-28T20:53:34.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 -- start start 2023-11-28T20:53:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78b406a580 0x7f78b4157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b4144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78b4151f60 0x7f78b41430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4142990 con 0x7f78b4151f60 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b41577d0 con 0x7f78b406a580 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78bbfaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b41565e0 con 0x7f78b40c75c0 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78b9d46640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78b406a580 msgr2=0x7f78b4157a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78b9d46640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78b406a580 0x7f78b4157a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78ba547640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78b4151f60 0x7f78b41430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78ba547640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78b4151f60 0x7f78b41430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45710/0 (socket says 172.21.15.167:45710) 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78ba547640 1 -- 172.21.15.167:0/1631353852 learned_addr learned my addr 172.21.15.167:0/1631353852 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78b9545640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b4144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78ba547640 1 -- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 msgr2=0x7f78b4144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78ba547640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b4144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78ba547640 1 -- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78b406a580 msgr2=0x7f78b4157a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78ba547640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78b406a580 0x7f78b4157a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78ba547640 1 -- 172.21.15.167:0/1631353852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4009420 con 0x7f78b4151f60 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78b9545640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b4144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78ba547640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78b4151f60 0x7f78b41430c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00b760 tx=0x7f78ac00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.503+0000 7f78aa7fc640 1 -- 172.21.15.167:0/1631353852 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00c960 con 0x7f78b4151f60 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.507+0000 7f78aa7fc640 1 -- 172.21.15.167:0/1631353852 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac00cac0 con 0x7f78b4151f60 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.507+0000 7f78aa7fc640 1 -- 172.21.15.167:0/1631353852 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac015470 con 0x7f78b4151f60 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.507+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b4155aa0 con 0x7f78b4151f60 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.507+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b4156020 con 0x7f78b4151f60 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.507+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b40682c0 con 0x7f78b4151f60 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.507+0000 7f78aa7fc640 1 -- 172.21.15.167:0/1631353852 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78ac012070 con 0x7f78b4151f60 2023-11-28T20:53:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.507+0000 7f78aa7fc640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7898066420 0x7f78980688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:34.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.507+0000 7f78aa7fc640 1 -- 172.21.15.167:0/1631353852 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f78ac084020 con 0x7f78b4151f60 2023-11-28T20:53:34.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.507+0000 7f78b9d46640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7898066420 0x7f78980688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:34.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.511+0000 7f78b9d46640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7898066420 0x7f78980688e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f78b0004820 tx=0x7f78b0007af0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:34.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.511+0000 7f78aa7fc640 1 -- 172.21.15.167:0/1631353852 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78ac0510a0 con 0x7f78b4151f60 2023-11-28T20:53:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.727+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f78b4075c90 con 0x7f78b4151f60 2023-11-28T20:53:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.727+0000 7f78aa7fc640 1 -- 172.21.15.167:0/1631353852 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f78ac01a020 con 0x7f78b4151f60 2023-11-28T20:53:34.731 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":120,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:34.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7898066420 msgr2=0x7f78980688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7898066420 0x7f78980688e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f78b0004820 tx=0x7f78b0007af0 comp rx=0 tx=0).stop 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78b4151f60 msgr2=0x7f78b41430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78b4151f60 0x7f78b41430c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00b760 tx=0x7f78ac00bc20 comp rx=0 tx=0).stop 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 shutdown_connections 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7898066420 0x7f78980688e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78b4151f60 0x7f78b41430c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78b40c75c0 0x7f78b4144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 --2- 172.21.15.167:0/1631353852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78b406a580 0x7f78b4157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 >> 172.21.15.167:0/1631353852 conn(0x7f78b40cb1e0 msgr2=0x7f78b41503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 shutdown_connections 2023-11-28T20:53:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:34.731+0000 7f78bbfaa640 1 -- 172.21.15.167:0/1631353852 wait complete. 2023-11-28T20:53:37.752 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:53:37.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9cb5b8640 1 Processor -- start 2023-11-28T20:53:37.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9cb5b8640 1 -- start start 2023-11-28T20:53:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9cb5b8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 0x7fc9c41635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9cb5b8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c40c7a50 con 0x7fc9c4151f60 2023-11-28T20:53:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9cb5b8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c415b220 con 0x7fc9c40c75c0 2023-11-28T20:53:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9cb5b8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c40c4da0 con 0x7fc9c40c5c90 2023-11-28T20:53:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9c9354640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc9c4151f60 0x7fc9c40c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:53774/0 (socket says 172.21.15.167:53774) 2023-11-28T20:53:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9c8b53640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7fc9c40c75c0 legacy=0x7fc9c406a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:53:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9c9354640 1 -- 172.21.15.167:0/1803903716 learned_addr learned my addr 172.21.15.167:0/1803903716 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:53:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9c9b55640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 msgr2=0x7fc9c41635c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:37.903+0000 7fc9c9b55640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 0x7fc9c41635c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:38.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:38.107+0000 7fc9c9b55640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 msgr2=0x7fc9c41635c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:38.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:38.107+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> v1:172.21.15.178:6789/0 conn(0x7fc9c40c75c0 legacy=0x7fc9c406a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:53:38.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:38.107+0000 7fc9c9b55640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 0x7fc9c41635c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:53:38.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:38.511+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> v1:172.21.15.178:6789/0 conn(0x7fc9c40c75c0 legacy=0x7fc9c406a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:53:38.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:38.511+0000 7fc9c9b55640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 msgr2=0x7fc9c41635c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:38.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:38.511+0000 7fc9c9b55640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 0x7fc9c41635c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:53:39.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:39.315+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> v1:172.21.15.178:6789/0 conn(0x7fc9c40c75c0 legacy=0x7fc9c406a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:53:39.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:39.315+0000 7fc9c9b55640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 msgr2=0x7fc9c41635c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:39.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:39.315+0000 7fc9c9b55640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 0x7fc9c41635c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9baffd640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 msgr2=0x7fc9c41635c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9baffd640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.178:3300/0 conn(0x7fc9c40c5c90 0x7fc9c41635c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9baffd640 1 -- 172.21.15.167:0/1803903716 >> v1:172.21.15.178:6789/0 conn(0x7fc9c40c75c0 legacy=0x7fc9c406a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9baffd640 1 -- 172.21.15.167:0/1803903716 >> v1:172.21.15.167:6789/0 conn(0x7fc9c4151f60 legacy=0x7fc9c40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9baffd640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9baffd640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9baffd640 1 -- 172.21.15.167:0/1803903716 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a8008d00 con 0x7fc9a80061b0 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9baffd640 1 -- 172.21.15.167:0/1803903716 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8008e70 con 0x7fc9a80036d0 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 msgr2=0x7fc9a8008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:53:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 msgr2=0x7fc9a8008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:53:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c9354640 1 -- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 msgr2=0x7fc9a8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:53:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c9354640 1 -- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 msgr2=0x7fc9a8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:53:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:40.903+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 msgr2=0x7fc9a8008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:53:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 msgr2=0x7fc9a8008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:53:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:53:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c9354640 1 -- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 msgr2=0x7fc9a8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:53:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c9354640 1 -- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 msgr2=0x7fc9a8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:53:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:41.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.107+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:53:41.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:41.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 msgr2=0x7fc9a8008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:53:41.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 msgr2=0x7fc9a8008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:53:41.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:41.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:41.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:53:41.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c9354640 1 -- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 msgr2=0x7fc9a8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:53:41.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c9354640 1 -- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 msgr2=0x7fc9a8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:53:41.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:53:41.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:41.511+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:53:42.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.315+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> v2:172.21.15.167:3300/0 conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.315+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.315+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 msgr2=0x7fc9a8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:53:42.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.315+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.315+0000 7fc9c8b53640 1 -- 172.21.15.167:0/1803903716 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4152340 con 0x7fc9a80061b0 2023-11-28T20:53:42.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.315+0000 7fc9c9354640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9a80036d0 0x7fc9a8005b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:53:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.315+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 0x7fc9a8008670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4003940 tx=0x7fc9b401d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48afdec181d4b997 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9bbfff640 1 -- 172.21.15.167:0/1803903716 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40ab640 con 0x7fc9a80061b0 2023-11-28T20:53:42.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9bbfff640 1 -- 172.21.15.167:0/1803903716 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b40ab7a0 con 0x7fc9a80061b0 2023-11-28T20:53:42.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9bbfff640 1 -- 172.21.15.167:0/1803903716 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40abb30 con 0x7fc9a80061b0 2023-11-28T20:53:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/1803903716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 msgr2=0x7fc9a8008670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9cb5b8640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 0x7fc9a8008670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4003940 tx=0x7fc9b401d6c0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9c9b55640 1 -- 172.21.15.167:0/1803903716 reap_dead start 2023-11-28T20:53:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/1803903716 shutdown_connections 2023-11-28T20:53:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9cb5b8640 1 --2- 172.21.15.167:0/1803903716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 0x7fc9a8008670 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/1803903716 >> 172.21.15.167:0/1803903716 conn(0x7fc9c40cb1e0 msgr2=0x7fc9c40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/1803903716 shutdown_connections 2023-11-28T20:53:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/1803903716 wait complete. 2023-11-28T20:53:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9cb5b8640 1 Processor -- start 2023-11-28T20:53:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.319+0000 7fc9cb5b8640 1 -- start start 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9cb5b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 0x7fc9c4140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9cb5b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9c4156110 0x7fc9c41ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9cb5b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9c41f29a0 0x7fc9c415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9cb5b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40c9640 con 0x7fc9a80061b0 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9cb5b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c41f1f00 con 0x7fc9c4156110 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9cb5b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c41eed30 con 0x7fc9c41f29a0 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c8b53640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9c4156110 msgr2=0x7fc9c41ee7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9354640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 0x7fc9c4140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c8b53640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9c4156110 0x7fc9c41ee7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9354640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 0x7fc9c4140770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45750/0 (socket says 172.21.15.167:45750) 2023-11-28T20:53:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9354640 1 -- 172.21.15.167:0/986026955 learned_addr learned my addr 172.21.15.167:0/986026955 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9b55640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9c41f29a0 0x7fc9c415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9354640 1 -- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9c41f29a0 msgr2=0x7fc9c415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9354640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9c41f29a0 0x7fc9c415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9354640 1 -- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9c4156110 msgr2=0x7fc9c41ee7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9354640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9c4156110 0x7fc9c41ee7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9354640 1 -- 172.21.15.167:0/986026955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4009aa0 con 0x7fc9a80061b0 2023-11-28T20:53:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9b55640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9c41f29a0 0x7fc9c415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:53:42.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9c9354640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 0x7fc9c4140770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0007880 tx=0x7fc9c0001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9b9ffb640 1 -- 172.21.15.167:0/986026955 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0016660 con 0x7fc9a80061b0 2023-11-28T20:53:42.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9b9ffb640 1 -- 172.21.15.167:0/986026955 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c00167c0 con 0x7fc9a80061b0 2023-11-28T20:53:42.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9b9ffb640 1 -- 172.21.15.167:0/986026955 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0016970 con 0x7fc9a80061b0 2023-11-28T20:53:42.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c40c9080 con 0x7fc9a80061b0 2023-11-28T20:53:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c41f21a0 con 0x7fc9a80061b0 2023-11-28T20:53:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c40682c0 con 0x7fc9a80061b0 2023-11-28T20:53:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.323+0000 7fc9b9ffb640 1 -- 172.21.15.167:0/986026955 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc9c0016ad0 con 0x7fc9a80061b0 2023-11-28T20:53:42.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.327+0000 7fc9b9ffb640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9a8067440 0x7fc9a8069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.327+0000 7fc9b9ffb640 1 -- 172.21.15.167:0/986026955 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc9c0084ab0 con 0x7fc9a80061b0 2023-11-28T20:53:42.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.327+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9a8067440 0x7fc9a8069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.327+0000 7fc9c8b53640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9a8067440 0x7fc9a8069900 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40af000 tx=0x7fc9b40a8000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.331+0000 7fc9b9ffb640 1 -- 172.21.15.167:0/986026955 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9c0051a10 con 0x7fc9a80061b0 2023-11-28T20:53:42.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc9c41f1d60 con 0x7fc9a80061b0 2023-11-28T20:53:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9b9ffb640 1 -- 172.21.15.167:0/986026955 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fc9c41f1d60 con 0x7fc9a80061b0 2023-11-28T20:53:42.534 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":124,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:53:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9a8067440 msgr2=0x7fc9a8069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9a8067440 0x7fc9a8069900 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40af000 tx=0x7fc9b40a8000 comp rx=0 tx=0).stop 2023-11-28T20:53:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 msgr2=0x7fc9c4140770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 0x7fc9c4140770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0007880 tx=0x7fc9c0001700 comp rx=0 tx=0).stop 2023-11-28T20:53:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 shutdown_connections 2023-11-28T20:53:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9a8067440 0x7fc9a8069900 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9c41f29a0 0x7fc9c415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9c4156110 0x7fc9c41ee7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 --2- 172.21.15.167:0/986026955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a80061b0 0x7fc9c4140770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 >> 172.21.15.167:0/986026955 conn(0x7fc9c40cb1e0 msgr2=0x7fc9c40c2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 shutdown_connections 2023-11-28T20:53:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.535+0000 7fc9cb5b8640 1 -- 172.21.15.167:0/986026955 wait complete. 2023-11-28T20:53:42.554 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:53:42.554 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:53:42.554 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:53:42.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e146ea640 1 Processor -- start 2023-11-28T20:53:42.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e146ea640 1 -- start start 2023-11-28T20:53:42.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e146ea640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e0c0cf860 0x7f2e0c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e146ea640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e0c0cfc40 0x7f2e0c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e146ea640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0c15ac00 con 0x7f2e0c153ae0 2023-11-28T20:53:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e146ea640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c0cbd60 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e146ea640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c159ff0 con 0x7f2e0c0cf860 2023-11-28T20:53:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e12c87640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f2e0c153ae0 legacy=0x7f2e0c15d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T20:53:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e12486640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f2e0c0cf860 msgr2=0x7f2e0c0cb770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e12486640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e0c0cf860 0x7f2e0c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e11c85640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e0c0cfc40 0x7f2e0c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e11c85640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e0c0cfc40 0x7f2e0c0ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45766/0 (socket says 172.21.15.167:45766) 2023-11-28T20:53:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e11c85640 1 -- 172.21.15.167:0/3149116481 learned_addr learned my addr 172.21.15.167:0/3149116481 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:42.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e11c85640 1 -- 172.21.15.167:0/3149116481 >> v2:172.21.15.178:3300/0 conn(0x7f2e0c0cf860 msgr2=0x7f2e0c0cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:42.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e11c85640 1 --2- 172.21.15.167:0/3149116481 >> v2:172.21.15.178:3300/0 conn(0x7f2e0c0cf860 0x7f2e0c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e11c85640 1 -- 172.21.15.167:0/3149116481 >> v1:172.21.15.178:6789/0 conn(0x7f2e0c153ae0 legacy=0x7f2e0c15d4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:42.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.695+0000 7f2e11c85640 1 -- 172.21.15.167:0/3149116481 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c15a2d0 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e11c85640 1 --2- 172.21.15.167:0/3149116481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 0x7f2e0c0ca510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0d03b0 tx=0x7f2dfc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d68e7932ed3caf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e11484640 1 -- 172.21.15.167:0/3149116481 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0aa610 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e11484640 1 -- 172.21.15.167:0/3149116481 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0a6040 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e11484640 1 -- 172.21.15.167:0/3149116481 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0aa990 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e146ea640 1 -- 172.21.15.167:0/3149116481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 msgr2=0x7f2e0c0ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e146ea640 1 --2- 172.21.15.167:0/3149116481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 0x7f2e0c0ca510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0d03b0 tx=0x7f2dfc01c4b0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e146ea640 1 -- 172.21.15.167:0/3149116481 shutdown_connections 2023-11-28T20:53:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e146ea640 1 --2- 172.21.15.167:0/3149116481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 0x7f2e0c0ca510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e146ea640 1 --2- 172.21.15.167:0/3149116481 >> v2:172.21.15.178:3300/0 conn(0x7f2e0c0cf860 0x7f2e0c0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e146ea640 1 -- 172.21.15.167:0/3149116481 >> 172.21.15.167:0/3149116481 conn(0x7f2e0c06c1f0 msgr2=0x7f2e0c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e146ea640 1 -- 172.21.15.167:0/3149116481 shutdown_connections 2023-11-28T20:53:42.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.699+0000 7f2e146ea640 1 -- 172.21.15.167:0/3149116481 wait complete. 2023-11-28T20:53:42.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 Processor -- start 2023-11-28T20:53:42.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 -- start start 2023-11-28T20:53:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e0c0cf860 0x7f2e0c13c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 0x7f2e0c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e0c153ae0 0x7f2e0c15c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c13c810 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c15bbf0 con 0x7f2e0c0cf860 2023-11-28T20:53:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c1585c0 con 0x7f2e0c153ae0 2023-11-28T20:53:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e12486640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e0c0cf860 msgr2=0x7f2e0c13c2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e11c85640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 0x7f2e0c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e12486640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e0c0cf860 0x7f2e0c13c2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e11c85640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 0x7f2e0c15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45772/0 (socket says 172.21.15.167:45772) 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e11c85640 1 -- 172.21.15.167:0/4126635502 learned_addr learned my addr 172.21.15.167:0/4126635502 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e12c87640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e0c153ae0 0x7f2e0c15c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e11c85640 1 -- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e0c153ae0 msgr2=0x7f2e0c15c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e11c85640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e0c153ae0 0x7f2e0c15c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e11c85640 1 -- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e0c0cf860 msgr2=0x7f2e0c13c2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e11c85640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e0c0cf860 0x7f2e0c13c2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e11c85640 1 -- 172.21.15.167:0/4126635502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc0094d0 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e11c85640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 0x7f2e0c15c080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc01ab60 tx=0x7f2dfc01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0b3800 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0b3960 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0b3d10 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c158830 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.703+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c15b880 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.707+0000 7f2e146ea640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c147190 0x7f2e0c1f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.707+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c072860 con 0x7f2e0c147190 2023-11-28T20:53:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.707+0000 7f2e12486640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c147190 0x7f2e0c1f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.707+0000 7f2e12486640 1 -- 172.21.15.167:0/4126635502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e0c0caa50 con 0x7f2e0c147190 2023-11-28T20:53:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.707+0000 7f2e12486640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c147190 0x7f2e0c1f5ff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b450 tx=0x7f2e0800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.707+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2dfc0b2380 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.707+0000 7f2e02ffd640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2df0066420 0x7f2df00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.707+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2dfc11e7b0 con 0x7f2e0c0cfc40 2023-11-28T20:53:42.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.707+0000 7f2e12c87640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2df0066420 0x7f2df00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.711+0000 7f2e12c87640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2df0066420 0x7f2df00688e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2e04003bd0 tx=0x7f2e04009450 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.711+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08003e20 con 0x7f2e0c147190 2023-11-28T20:53:42.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.711+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2e08005070 con 0x7f2e0c147190 2023-11-28T20:53:42.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.711+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c147190 msgr2=0x7f2e0c1f5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.711+0000 7f2e02ffd640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c147190 0x7f2e0c1f5ff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b450 tx=0x7f2e0800b910 comp rx=0 tx=0).stop 2023-11-28T20:53:42.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.711+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c147190 msgr2=0x7f2e0c1f5ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:42.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.711+0000 7f2e02ffd640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c147190 0x7f2e0c1f5ff0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b450 tx=0x7f2e0800b910 comp rx=0 tx=0).stop 2023-11-28T20:53:42.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.715+0000 7f2e146ea640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c15adb0 0x7f2e0c1f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.715+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c15ba70 con 0x7f2e0c15adb0 2023-11-28T20:53:42.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.715+0000 7f2e12486640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c15adb0 0x7f2e0c1f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e12486640 1 -- 172.21.15.167:0/4126635502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2e0c159cc0 con 0x7f2e0c15adb0 2023-11-28T20:53:42.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e12486640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c15adb0 0x7f2e0c1f6530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b450 tx=0x7f2e08005a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0801f070 con 0x7f2e0c15adb0 2023-11-28T20:53:42.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4631 (secure 0 0 0) 0x7f2e08010480 con 0x7f2e0c15adb0 2023-11-28T20:53:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c15adb0 msgr2=0x7f2e0c1f6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e02ffd640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c15adb0 0x7f2e0c1f6530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b450 tx=0x7f2e08005a30 comp rx=0 tx=0).stop 2023-11-28T20:53:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e02ffd640 1 -- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c15adb0 msgr2=0x7f2e0c1f6530 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e02ffd640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c15adb0 0x7f2e0c1f6530 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b450 tx=0x7f2e08005a30 comp rx=0 tx=0).stop 2023-11-28T20:53:42.721 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:53:42.721 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:42.721 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:42.721 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:53:42.721 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 124, 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:42.722 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:53:42.723 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.724 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:53:42.725 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:42.726 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:42.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.728 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.729 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:53:42.730 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:53:42.731 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:42.732 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:42.733 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:42.733 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.733 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.733 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.733 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:53:42.733 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:53:42.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.734 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:42.734 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:42.734 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:42.734 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.734 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.734 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:53:42.734 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:53:42.735 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.736 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.736 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.736 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:53:42.736 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:53:42.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2df0066420 msgr2=0x7f2df00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e146ea640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2df0066420 0x7f2df00688e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2e04003bd0 tx=0x7f2e04009450 comp rx=0 tx=0).stop 2023-11-28T20:53:42.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 msgr2=0x7f2e0c15c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e146ea640 1 --2- 172.21.15.167:0/4126635502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0cfc40 0x7f2e0c15c080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc01ab60 tx=0x7f2dfc01acf0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e12c87640 1 -- 172.21.15.167:0/4126635502 reap_dead start 2023-11-28T20:53:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e12c87640 1 -- 172.21.15.167:0/4126635502 reap_dead start 2023-11-28T20:53:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 shutdown_connections 2023-11-28T20:53:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 >> 172.21.15.167:0/4126635502 conn(0x7f2e0c06c1f0 msgr2=0x7f2e0c0cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 shutdown_connections 2023-11-28T20:53:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.719+0000 7f2e146ea640 1 -- 172.21.15.167:0/4126635502 wait complete. 2023-11-28T20:53:42.738 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:53:42.738 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:53:42.739 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:53:42.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe450e17640 1 Processor -- start 2023-11-28T20:53:42.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe450e17640 1 -- start start 2023-11-28T20:53:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe450e17640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe44c06e030 0x7fe44c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe450e17640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe44c070480 0x7fe44c1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe450e17640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44c1571d0 con 0x7fe44c06e410 2023-11-28T20:53:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe450e17640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c071a90 con 0x7fe44c070480 2023-11-28T20:53:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe450e17640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44c0c70d0 con 0x7fe44c06e030 2023-11-28T20:53:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe44a59c640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7fe44c06e030 msgr2=0x7fe44c1500b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe44a59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe44c06e030 0x7fe44c1500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:42.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe44ad9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe44c06e410 0x7fe44c071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45718/0 (socket says 172.21.15.167:45718) 2023-11-28T20:53:42.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe44ad9d640 1 -- 172.21.15.167:0/153324923 learned_addr learned my addr 172.21.15.167:0/153324923 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:53:42.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe441d9b640 1 --2- 172.21.15.167:0/153324923 >> v2:172.21.15.167:3300/0 conn(0x7fe44c070480 0x7fe44c1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe441d9b640 1 -- 172.21.15.167:0/153324923 >> v2:172.21.15.178:3300/0 conn(0x7fe44c06e030 msgr2=0x7fe44c1500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:53:42.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe441d9b640 1 --2- 172.21.15.167:0/153324923 >> v2:172.21.15.178:3300/0 conn(0x7fe44c06e030 0x7fe44c1500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe441d9b640 1 -- 172.21.15.167:0/153324923 >> v1:172.21.15.167:6789/0 conn(0x7fe44c06e410 legacy=0x7fe44c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.879+0000 7fe441d9b640 1 -- 172.21.15.167:0/153324923 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c0c73b0 con 0x7fe44c070480 2023-11-28T20:53:42.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe441d9b640 1 --2- 172.21.15.167:0/153324923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 0x7fe44c1505f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0cbff0 tx=0x7fe43401d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e571a0317b15c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe449d9b640 1 -- 172.21.15.167:0/153324923 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340a68d0 con 0x7fe44c070480 2023-11-28T20:53:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe449d9b640 1 -- 172.21.15.167:0/153324923 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4340a6a30 con 0x7fe44c070480 2023-11-28T20:53:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe449d9b640 1 -- 172.21.15.167:0/153324923 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340a6dc0 con 0x7fe44c070480 2023-11-28T20:53:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe450e17640 1 -- 172.21.15.167:0/153324923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 msgr2=0x7fe44c1505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe450e17640 1 --2- 172.21.15.167:0/153324923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 0x7fe44c1505f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0cbff0 tx=0x7fe43401d820 comp rx=0 tx=0).stop 2023-11-28T20:53:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe450e17640 1 -- 172.21.15.167:0/153324923 shutdown_connections 2023-11-28T20:53:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe450e17640 1 --2- 172.21.15.167:0/153324923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 0x7fe44c1505f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe450e17640 1 --2- 172.21.15.167:0/153324923 >> v2:172.21.15.178:3300/0 conn(0x7fe44c06e030 0x7fe44c1500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe450e17640 1 -- 172.21.15.167:0/153324923 >> 172.21.15.167:0/153324923 conn(0x7fe44c0cb1e0 msgr2=0x7fe44c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:42.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe450e17640 1 -- 172.21.15.167:0/153324923 shutdown_connections 2023-11-28T20:53:42.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.883+0000 7fe450e17640 1 -- 172.21.15.167:0/153324923 wait complete. 2023-11-28T20:53:42.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 Processor -- start 2023-11-28T20:53:42.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 -- start start 2023-11-28T20:53:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c06e030 0x7fe44c1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe44c06e410 0x7fe44c1f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 0x7fe44c146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c13f3c0 con 0x7fe44c070480 2023-11-28T20:53:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c13f6a0 con 0x7fe44c06e410 2023-11-28T20:53:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c13f980 con 0x7fe44c06e030 2023-11-28T20:53:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe441d9b640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe44c06e410 msgr2=0x7fe44c1f0a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T20:53:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe441d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe44c06e410 0x7fe44c1f0a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:53:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 0x7fe44c146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 0x7fe44c146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49262/0 (socket says 172.21.15.167:49262) 2023-11-28T20:53:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44ad9d640 1 -- 172.21.15.167:0/714538717 learned_addr learned my addr 172.21.15.167:0/714538717 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:53:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44a59c640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c06e030 0x7fe44c1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44ad9d640 1 -- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c06e030 msgr2=0x7fe44c1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44ad9d640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c06e030 0x7fe44c1f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44ad9d640 1 -- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe44c06e410 msgr2=0x7fe44c1f0a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:53:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44ad9d640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe44c06e410 0x7fe44c1f0a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44ad9d640 1 -- 172.21.15.167:0/714538717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43400a5c0 con 0x7fe44c070480 2023-11-28T20:53:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe44ad9d640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 0x7fe44c146c70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe44400c3c0 tx=0x7fe44400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe444005cf0 con 0x7fe44c070480 2023-11-28T20:53:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe444005e50 con 0x7fe44c070480 2023-11-28T20:53:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c1f3f90 con 0x7fe44c070480 2023-11-28T20:53:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440072f0 con 0x7fe44c070480 2023-11-28T20:53:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.887+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c1f4550 con 0x7fe44c070480 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe450e17640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c156c40 0x7fe44c0ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c074770 con 0x7fe44c156c40 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe44a59c640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c156c40 0x7fe44c0ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe44a59c640 1 -- 172.21.15.167:0/714538717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe44c0682c0 con 0x7fe44c156c40 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe444007450 con 0x7fe44c070480 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe44a59c640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c156c40 0x7fe44c0ca900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009f40 tx=0x7fe43c007720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe4437fe640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe42c066450 0x7fe42c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe4440837e0 con 0x7fe44c070480 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c010040 con 0x7fe44c156c40 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fe43c0054e0 con 0x7fe44c156c40 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c156c40 msgr2=0x7fe44c0ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe4437fe640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c156c40 0x7fe44c0ca900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009f40 tx=0x7fe43c007720 comp rx=0 tx=0).stop 2023-11-28T20:53:42.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe441d9b640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe42c066450 0x7fe42c068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c156c40 msgr2=0x7fe44c0ca900 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:42.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.891+0000 7fe4437fe640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c156c40 0x7fe44c0ca900 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:53:42.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.895+0000 7fe441d9b640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe42c066450 0x7fe42c068910 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe4340b0000 tx=0x7fe434008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe450e17640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c13ea90 0x7fe44c14d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:53:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c147c30 con 0x7fe44c13ea90 2023-11-28T20:53:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe44a59c640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c13ea90 0x7fe44c14d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:53:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe44a59c640 1 -- 172.21.15.167:0/714538717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe44c1f4740 con 0x7fe44c13ea90 2023-11-28T20:53:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe44a59c640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c13ea90 0x7fe44c14d430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009fd0 tx=0x7fe43c005d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:53:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c01dd00 con 0x7fe44c13ea90 2023-11-28T20:53:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5112 (secure 0 0 0) 0x7fe43c01d310 con 0x7fe44c13ea90 2023-11-28T20:53:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c13ea90 msgr2=0x7fe44c14d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe4437fe640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c13ea90 0x7fe44c14d430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009fd0 tx=0x7fe43c005d60 comp rx=0 tx=0).stop 2023-11-28T20:53:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe4437fe640 1 -- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c13ea90 msgr2=0x7fe44c14d430 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:53:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.899+0000 7fe4437fe640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe44c13ea90 0x7fe44c14d430 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009fd0 tx=0x7fe43c005d60 comp rx=0 tx=0).stop 2023-11-28T20:53:42.900 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:53:42.900 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:42.900 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:42.901 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:53:42.901 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 124, 2023-11-28T20:53:42.901 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:53:42.901 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:53:42.901 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:53:42.901 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.901 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:53:42.901 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:42.902 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:42.903 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:42.904 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:42.904 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:42.904 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:42.904 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.904 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.904 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:53:42.904 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:53:42.904 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:53:42.904 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:53:42.905 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:53:42.905 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:53:42.905 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:42.905 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:53:42.905 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:53:42.905 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:53:42.905 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:53:42.905 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:53:42.905 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:53:42.906 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:53:42.907 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:53:42.907 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:53:42.907 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:53:42.907 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.907 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:53:42.907 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.907 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:53:42.907 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.907 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:53:42.908 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:53:42.908 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:42.908 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:42.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.908 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:42.908 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:53:42.908 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.908 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.908 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:42.909 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.910 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.911 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.911 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:42.911 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:53:42.911 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.911 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.911 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.911 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.911 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:53:42.911 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:53:42.912 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.913 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:53:42.913 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:53:42.913 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.913 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.913 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.913 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:53:42.913 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:53:42.913 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:53:42.913 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:53:42.914 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:53:42.915 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:53:42.916 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:53:42.917 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:53:42.918 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:53:42.918 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:53:42.918 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:53:42.918 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:53:42.918 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:53:42.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe42c066450 msgr2=0x7fe42c068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe450e17640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe42c066450 0x7fe42c068910 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe4340b0000 tx=0x7fe434008040 comp rx=0 tx=0).stop 2023-11-28T20:53:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 msgr2=0x7fe44c146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:53:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe450e17640 1 --2- 172.21.15.167:0/714538717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe44c070480 0x7fe44c146c70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe44400c3c0 tx=0x7fe44400c880 comp rx=0 tx=0).stop 2023-11-28T20:53:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe44ad9d640 1 -- 172.21.15.167:0/714538717 reap_dead start 2023-11-28T20:53:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe44ad9d640 1 -- 172.21.15.167:0/714538717 reap_dead start 2023-11-28T20:53:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 shutdown_connections 2023-11-28T20:53:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 >> 172.21.15.167:0/714538717 conn(0x7fe44c0cb1e0 msgr2=0x7fe44c0c4480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:53:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 shutdown_connections 2023-11-28T20:53:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:53:42.903+0000 7fe450e17640 1 -- 172.21.15.167:0/714538717 wait complete. 2023-11-28T20:53:42.921 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:53:42.921 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:53:46.852 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 2% (3/133) Updating files: 3% (4/133) Updating files: 4% (6/133) Updating files: 5% (7/133) Updating files: 6% (8/133) Updating files: 7% (10/133) Updating files: 8% (11/133) Updating files: 9% (12/133) Updating files: 10% (14/133) Updating files: 11% (15/133) Updating files: 12% (16/133) Updating files: 13% (18/133) Updating files: 14% (19/133) Updating files: 15% (20/133) Updating files: 16% (22/133) Updating files: 17% (23/133) Updating files: 18% (24/133) Updating files: 19% (26/133) Updating files: 20% (27/133) Updating files: 21% (28/133) Updating files: 22% (30/133) Updating files: 23% (31/133) Updating files: 24% (32/133) Updating files: 25% (34/133) Updating files: 26% (35/133) Updating files: 27% (36/133) Updating files: 28% (38/133) Updating files: 29% (39/133) Updating files: 30% (40/133) Updating files: 31% (42/133) Updating files: 32% (43/133) Updating files: 33% (44/133) Updating files: 34% (46/133) Updating files: 35% (47/133) Updating files: 36% (48/133) Updating files: 37% (50/133) Updating files: 38% (51/133) Updating files: 39% (52/133) Updating files: 40% (54/133) Updating files: 41% (55/133) Updating files: 42% (56/133) Updating files: 43% (58/133) Updating files: 44% (59/133) Updating files: 45% (60/133) Updating files: 46% (62/133) Updating files: 47% (63/133) Updating files: 48% (64/133) Updating files: 49% (66/133) Updating files: 50% (67/133) Updating files: 51% (68/133) Updating files: 52% (70/133) Updating files: 53% (71/133) Updating files: 54% (72/133) Updating files: 55% (74/133) Updating files: 56% (75/133) Updating files: 57% (76/133) Updating files: 58% (78/133) Updating files: 59% (79/133) Updating files: 60% (80/133) Updating files: 61% (82/133) Updating files: 62% (83/133) Updating files: 63% (84/133) Updating files: 64% (86/133) Updating files: 65% (87/133) Updating files: 66% (88/133) Updating files: 67% (90/133) Updating files: 68% (91/133) Updating files: 69% (92/133) Updating files: 70% (94/133) Updating files: 71% (95/133) Updating files: 72% (96/133) Updating files: 73% (98/133) Updating files: 74% (99/133) Updating files: 75% (100/133) Updating files: 76% (102/133) Updating files: 77% (103/133) Updating files: 78% (104/133) Updating files: 79% (106/133) Updating files: 80% (107/133) Updating files: 81% (108/133) Updating files: 82% (110/133) Updating files: 83% (111/133) Updating files: 84% (112/133) Updating files: 85% (114/133) Updating files: 86% (115/133) Updating files: 87% (116/133) Updating files: 88% (118/133) Updating files: 89% (119/133) Updating files: 90% (120/133) Updating files: 91% (122/133) Updating files: 92% (123/133) Updating files: 93% (124/133) Updating files: 94% (126/133) Updating files: 95% (127/133) Updating files: 96% (128/133) Updating files: 97% (130/133) Updating files: 98% (131/133) Updating files: 99% (132/133) Updating files: 100% (133/133) Updating files: 100% (133/133), done. 2023-11-28T20:53:46.927 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 2b32297267d v0.13 2023-11-28T20:53:46.931 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.13 2023-11-28T20:53:47.069 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 14 -eq 48 ] 2023-11-28T20:53:47.070 INFO:tasks.workunit.client.0.smithi167.stdout:v0.14 2023-11-28T20:53:47.070 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.14 2023-11-28T20:53:47.070 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.14 2023-11-28T20:53:47.070 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.14 2023-11-28T20:53:50.765 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:53:50.770 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:02.759 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 15% (23/151) Updating files: 16% (25/151) Updating files: 17% (26/151) Updating files: 18% (28/151) Updating files: 19% (29/151) Updating files: 20% (31/151) Updating files: 21% (32/151) Updating files: 22% (34/151) Updating files: 23% (35/151) Updating files: 24% (37/151) Updating files: 25% (38/151) Updating files: 26% (40/151) Updating files: 27% (41/151) Updating files: 28% (43/151) Updating files: 29% (44/151) Updating files: 30% (46/151) Updating files: 31% (47/151) Updating files: 32% (49/151) Updating files: 33% (50/151) Updating files: 34% (52/151) Updating files: 35% (53/151) Updating files: 36% (55/151) Updating files: 37% (56/151) Updating files: 38% (58/151) Updating files: 39% (59/151) Updating files: 40% (61/151) Updating files: 41% (62/151) Updating files: 41% (63/151) Updating files: 42% (64/151) Updating files: 43% (65/151) Updating files: 44% (67/151) Updating files: 45% (68/151) Updating files: 46% (70/151) Updating files: 47% (71/151) Updating files: 48% (73/151) Updating files: 49% (74/151) Updating files: 50% (76/151) Updating files: 50% (77/151) Updating files: 51% (78/151) Updating files: 52% (79/151) Updating files: 53% (81/151) Updating files: 54% (82/151) Updating files: 55% (84/151) Updating files: 56% (85/151) Updating files: 57% (87/151) Updating files: 58% (88/151) Updating files: 59% (90/151) Updating files: 60% (91/151) Updating files: 61% (93/151) Updating files: 62% (94/151) Updating files: 63% (96/151) Updating files: 64% (97/151) Updating files: 65% (99/151) Updating files: 66% (100/151) Updating files: 67% (102/151) Updating files: 68% (103/151) Updating files: 69% (105/151) Updating files: 70% (106/151) Updating files: 71% (108/151) Updating files: 72% (109/151) Updating files: 73% (111/151) Updating files: 74% (112/151) Updating files: 75% (114/151) Updating files: 76% (115/151) Updating files: 77% (117/151) Updating files: 78% (118/151) Updating files: 79% (120/151) Updating files: 80% (121/151) Updating files: 81% (123/151) Updating files: 82% (124/151) Updating files: 83% (126/151) Updating files: 84% (127/151) Updating files: 85% (129/151) Updating files: 86% (130/151) Updating files: 86% (131/151) Updating files: 87% (132/151) Updating files: 88% (133/151) Updating files: 89% (135/151) Updating files: 90% (136/151) Updating files: 91% (138/151) Updating files: 92% (139/151) Updating files: 93% (141/151) Updating files: 94% (142/151) Updating files: 95% (144/151) Updating files: 96% (145/151) Updating files: 97% (147/151) Updating files: 98% (148/151) Updating files: 99% (150/151) Updating files: 100% (151/151) Updating files: 100% (151/151), done. 2023-11-28T20:54:02.922 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T20:54:02.923 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2023-11-28T20:54:02.923 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T20:54:02.923 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T20:54:02.926 INFO:tasks.ceph.mon.b:Started 2023-11-28T20:54:02.927 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:54:02.927 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:54:03.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.070+0000 7f7a84ac9640 1 Processor -- start 2023-11-28T20:54:03.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.070+0000 7f7a84ac9640 1 -- start start 2023-11-28T20:54:03.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a84ac9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7a8006e030 0x7f7a801500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:03.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a84ac9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a801571d0 con 0x7f7a80070480 2023-11-28T20:54:03.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a84ac9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a80071a90 con 0x7f7a80072630 2023-11-28T20:54:03.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a84ac9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a800c70d0 con 0x7f7a8006e030 2023-11-28T20:54:03.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a75d9b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7a80070480 0x7f7a80071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51598/0 (socket says 172.21.15.167:51598) 2023-11-28T20:54:03.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a75d9b640 1 -- 172.21.15.167:0/2823122059 learned_addr learned my addr 172.21.15.167:0/2823122059 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:54:03.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7e59c640 1 --2- 172.21.15.167:0/2823122059 >> v2:172.21.15.178:3300/0 conn(0x7f7a8006e030 0x7f7a801500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:03.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7e59c640 1 -- 172.21.15.167:0/2823122059 >> v2:172.21.15.178:3300/0 conn(0x7f7a8006e030 msgr2=0x7f7a801500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:54:03.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7e59c640 1 -- 172.21.15.167:0/2823122059 >> v2:172.21.15.178:3300/0 conn(0x7f7a8006e030 msgr2=0x7f7a801500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:03.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7e59c640 1 --2- 172.21.15.167:0/2823122059 >> v2:172.21.15.178:3300/0 conn(0x7f7a8006e030 0x7f7a801500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:03.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7e59c640 1 --2- 172.21.15.167:0/2823122059 >> v2:172.21.15.178:3300/0 conn(0x7f7a8006e030 0x7f7a801500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:03.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461877005 0 0) 0x7f7a801571d0 con 0x7f7a80070480 2023-11-28T20:54:03.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a6c005740 con 0x7f7a80070480 2023-11-28T20:54:03.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1309839665 0 0) 0x7f7a6c005740 con 0x7f7a80070480 2023-11-28T20:54:03.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 >> v2:172.21.15.178:3300/0 conn(0x7f7a8006e030 msgr2=0x7f7a801500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 --2- 172.21.15.167:0/2823122059 >> v2:172.21.15.178:3300/0 conn(0x7f7a8006e030 0x7f7a801500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 >> v1:172.21.15.178:6789/0 conn(0x7f7a80072630 legacy=0x7f7a80160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800c73b0 con 0x7f7a80070480 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f7a70001680 con 0x7f7a80070480 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 >> v1:172.21.15.167:6789/0 conn(0x7f7a80070480 legacy=0x7f7a80071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c005b90 0x7f7a6c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a6c0069e0 0x7f7a6c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a6c0073a0 0x7f7a6c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800c70d0 con 0x7f7a6c0069e0 2023-11-28T20:54:03.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c00e2f0 con 0x7f7a6c005b90 2023-11-28T20:54:03.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c00e4b0 con 0x7f7a6c0073a0 2023-11-28T20:54:03.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a75d9b640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a6c0069e0 0x7f7a6c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:03.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7e59c640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c005b90 0x7f7a6c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:03.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7ed9d640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a6c0073a0 0x7f7a6c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:03.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a75d9b640 1 -- 172.21.15.167:0/2823122059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a6c0073a0 msgr2=0x7f7a6c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:03.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a75d9b640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a6c0073a0 0x7f7a6c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a75d9b640 1 -- 172.21.15.167:0/2823122059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c005b90 msgr2=0x7f7a6c005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:03.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a75d9b640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c005b90 0x7f7a6c005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a75d9b640 1 -- 172.21.15.167:0/2823122059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c005740 con 0x7f7a6c0069e0 2023-11-28T20:54:03.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.074+0000 7f7a7ed9d640 1 -- 172.21.15.167:0/2823122059 reap_dead start 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a75d9b640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a6c0069e0 0x7f7a6c006e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c210 tx=0x7f7a7001f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf09695fa9aa8b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70005ae0 con 0x7f7a6c0069e0 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a700ab070 con 0x7f7a6c0069e0 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a7dd9b640 1 -- 172.21.15.167:0/2823122059 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70007070 con 0x7f7a6c0069e0 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a84ac9640 1 -- 172.21.15.167:0/2823122059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a6c0069e0 msgr2=0x7f7a6c006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a84ac9640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a6c0069e0 0x7f7a6c006e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c210 tx=0x7f7a7001f330 comp rx=0 tx=0).stop 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a84ac9640 1 -- 172.21.15.167:0/2823122059 shutdown_connections 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a84ac9640 1 --2- 172.21.15.167:0/2823122059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a6c0069e0 0x7f7a6c006e60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a84ac9640 1 -- 172.21.15.167:0/2823122059 >> 172.21.15.167:0/2823122059 conn(0x7f7a800cb1e0 msgr2=0x7f7a800cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a84ac9640 1 -- 172.21.15.167:0/2823122059 shutdown_connections 2023-11-28T20:54:03.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a84ac9640 1 -- 172.21.15.167:0/2823122059 wait complete. 2023-11-28T20:54:03.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.078+0000 7f7a84ac9640 1 Processor -- start 2023-11-28T20:54:03.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 -- start start 2023-11-28T20:54:03.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c0069e0 0x7f7a80154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:03.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a80151950 0x7f7a801effc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:03.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a8014d430 0x7f7a8014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:03.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80154d90 con 0x7f7a80151950 2023-11-28T20:54:03.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a801f0500 con 0x7f7a6c0069e0 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80153e00 con 0x7f7a8014d430 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a75d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a80151950 0x7f7a801effc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a75d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a80151950 0x7f7a801effc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57896/0 (socket says 172.21.15.167:57896) 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a75d9b640 1 -- 172.21.15.167:0/893241387 learned_addr learned my addr 172.21.15.167:0/893241387 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a7ed9d640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a8014d430 0x7f7a8014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a7e59c640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c0069e0 0x7f7a80154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a7e59c640 1 -- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c0069e0 msgr2=0x7f7a80154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a7e59c640 1 -- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c0069e0 msgr2=0x7f7a80154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a7e59c640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c0069e0 0x7f7a80154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a75d9b640 1 -- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a8014d430 msgr2=0x7f7a8014bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a75d9b640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a8014d430 0x7f7a8014bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a75d9b640 1 -- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c0069e0 msgr2=0x7f7a80154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:03.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a7e59c640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c0069e0 0x7f7a80154850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:03.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a75d9b640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c0069e0 0x7f7a80154850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a75d9b640 1 -- 172.21.15.167:0/893241387 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a801543c0 con 0x7f7a80151950 2023-11-28T20:54:03.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a75d9b640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a80151950 0x7f7a801effc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7a70001940 tx=0x7f7a6c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:03.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a777fe640 1 -- 172.21.15.167:0/893241387 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70004af0 con 0x7f7a80151950 2023-11-28T20:54:03.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a777fe640 1 -- 172.21.15.167:0/893241387 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a70004c70 con 0x7f7a80151950 2023-11-28T20:54:03.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a80155850 con 0x7f7a80151950 2023-11-28T20:54:03.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a777fe640 1 -- 172.21.15.167:0/893241387 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70007070 con 0x7f7a80151950 2023-11-28T20:54:03.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a80155e10 con 0x7f7a80151950 2023-11-28T20:54:03.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.082+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a800682c0 con 0x7f7a80151950 2023-11-28T20:54:03.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.086+0000 7f7a777fe640 1 -- 172.21.15.167:0/893241387 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a700b9030 con 0x7f7a80151950 2023-11-28T20:54:03.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.086+0000 7f7a777fe640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a600664a0 0x7f7a60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:03.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.086+0000 7f7a777fe640 1 -- 172.21.15.167:0/893241387 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7a700b7070 con 0x7f7a80151950 2023-11-28T20:54:03.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.086+0000 7f7a7e59c640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a600664a0 0x7f7a60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:03.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.086+0000 7f7a7e59c640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a600664a0 0x7f7a60068960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000ee0 tx=0x7f7a6800c2a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:03.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.090+0000 7f7a777fe640 1 -- 172.21.15.167:0/893241387 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a700f1c20 con 0x7f7a80151950 2023-11-28T20:54:03.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.290+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7a80075c90 con 0x7f7a80151950 2023-11-28T20:54:03.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.290+0000 7f7a777fe640 1 -- 172.21.15.167:0/893241387 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f7a700c1620 con 0x7f7a80151950 2023-11-28T20:54:03.290 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":124,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:54:03.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.290+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a600664a0 msgr2=0x7f7a60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:03.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.290+0000 7f7a84ac9640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a600664a0 0x7f7a60068960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000ee0 tx=0x7f7a6800c2a0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a80151950 msgr2=0x7f7a801effc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:03.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a80151950 0x7f7a801effc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7a70001940 tx=0x7f7a6c007a10 comp rx=0 tx=0).stop 2023-11-28T20:54:03.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 shutdown_connections 2023-11-28T20:54:03.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a600664a0 0x7f7a60068960 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a8014d430 0x7f7a8014bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a80151950 0x7f7a801effc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 --2- 172.21.15.167:0/893241387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a6c0069e0 0x7f7a80154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:03.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 >> 172.21.15.167:0/893241387 conn(0x7f7a800cb1e0 msgr2=0x7f7a8014f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:03.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 shutdown_connections 2023-11-28T20:54:03.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:03.294+0000 7f7a84ac9640 1 -- 172.21.15.167:0/893241387 wait complete. 2023-11-28T20:54:05.341 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 1ec1e8d6fb6 v0.14 2023-11-28T20:54:05.345 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.14 2023-11-28T20:54:05.378 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 15 -eq 48 ] 2023-11-28T20:54:05.379 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.15 2023-11-28T20:54:05.379 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.15 2023-11-28T20:54:05.379 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.15 2023-11-28T20:54:05.379 INFO:tasks.workunit.client.0.smithi167.stdout:v0.15 2023-11-28T20:54:06.312 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:54:06.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faedbfd1640 1 Processor -- start 2023-11-28T20:54:06.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faedbfd1640 1 -- start start 2023-11-28T20:54:06.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faedbfd1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faed415d3b0 0x7faed4066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:06.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faedbfd1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40c8280 con 0x7faed40aff70 2023-11-28T20:54:06.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faedbfd1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed40c8910 con 0x7faed406d530 2023-11-28T20:54:06.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faedbfd1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed4066bc0 con 0x7faed415d3b0 2023-11-28T20:54:06.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faed9d6d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7faed40aff70 0x7faed406b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51608/0 (socket says 172.21.15.167:51608) 2023-11-28T20:54:06.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faed9d6d640 1 -- 172.21.15.167:0/1690226659 learned_addr learned my addr 172.21.15.167:0/1690226659 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:54:06.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faeda56e640 1 --2- 172.21.15.167:0/1690226659 >> v2:172.21.15.167:3300/0 conn(0x7faed415d3b0 0x7faed4066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:06.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faed8d6b640 1 -- 172.21.15.167:0/1690226659 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541206573 0 0) 0x7faed40c8280 con 0x7faed40aff70 2023-11-28T20:54:06.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faed8d6b640 1 -- 172.21.15.167:0/1690226659 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec0003530 con 0x7faed40aff70 2023-11-28T20:54:06.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faeda56e640 1 -- 172.21.15.167:0/1690226659 >> v1:172.21.15.178:6789/0 conn(0x7faed406d530 legacy=0x7faed41626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:06.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faeda56e640 1 -- 172.21.15.167:0/1690226659 >> v1:172.21.15.167:6789/0 conn(0x7faed40aff70 legacy=0x7faed406b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:06.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.458+0000 7faeda56e640 1 -- 172.21.15.167:0/1690226659 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40ca3b0 con 0x7faed415d3b0 2023-11-28T20:54:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.462+0000 7faeda56e640 1 --2- 172.21.15.167:0/1690226659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 0x7faed4066680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faecc009d90 tx=0x7faecc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34df31637ecaeacb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.462+0000 7faed8d6b640 1 -- 172.21.15.167:0/1690226659 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0a59e0 con 0x7faed415d3b0 2023-11-28T20:54:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.462+0000 7faed8d6b640 1 -- 172.21.15.167:0/1690226659 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc0a5b40 con 0x7faed415d3b0 2023-11-28T20:54:06.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.462+0000 7faed8d6b640 1 -- 172.21.15.167:0/1690226659 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0ad440 con 0x7faed415d3b0 2023-11-28T20:54:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.462+0000 7faedbfd1640 1 -- 172.21.15.167:0/1690226659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 msgr2=0x7faed4066680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.462+0000 7faedbfd1640 1 --2- 172.21.15.167:0/1690226659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 0x7faed4066680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faecc009d90 tx=0x7faecc01c920 comp rx=0 tx=0).stop 2023-11-28T20:54:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.462+0000 7faedbfd1640 1 -- 172.21.15.167:0/1690226659 shutdown_connections 2023-11-28T20:54:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.462+0000 7faedbfd1640 1 --2- 172.21.15.167:0/1690226659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 0x7faed4066680 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.462+0000 7faedbfd1640 1 -- 172.21.15.167:0/1690226659 >> 172.21.15.167:0/1690226659 conn(0x7faed406ee00 msgr2=0x7faed406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 -- 172.21.15.167:0/1690226659 shutdown_connections 2023-11-28T20:54:06.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 -- 172.21.15.167:0/1690226659 wait complete. 2023-11-28T20:54:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 Processor -- start 2023-11-28T20:54:06.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 -- start start 2023-11-28T20:54:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed406d530 0x7faed415c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faed40aff70 0x7faed40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:06.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 0x7faed40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40ccb40 con 0x7faed415d3b0 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed415be70 con 0x7faed406d530 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faedbfd1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed40cb410 con 0x7faed40aff70 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faeda56e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 0x7faed40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faeda56e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 0x7faed40cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57916/0 (socket says 172.21.15.167:57916) 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faeda56e640 1 -- 172.21.15.167:0/1600130693 learned_addr learned my addr 172.21.15.167:0/1600130693 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faed9d6d640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed406d530 0x7faed415c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faed956c640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faed40aff70 0x7faed40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faeda56e640 1 -- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faed40aff70 msgr2=0x7faed40cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faeda56e640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faed40aff70 0x7faed40cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faeda56e640 1 -- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed406d530 msgr2=0x7faed415c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:06.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faeda56e640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed406d530 0x7faed415c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faeda56e640 1 -- 172.21.15.167:0/1600130693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009a70 con 0x7faed415d3b0 2023-11-28T20:54:06.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.466+0000 7faeda56e640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 0x7faed40cc600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faecc0b0040 tx=0x7faecc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:06.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faeca7fc640 1 -- 172.21.15.167:0/1600130693 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0adce0 con 0x7faed415d3b0 2023-11-28T20:54:06.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faeca7fc640 1 -- 172.21.15.167:0/1600130693 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc0ade40 con 0x7faed415d3b0 2023-11-28T20:54:06.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed415d1e0 con 0x7faed415d3b0 2023-11-28T20:54:06.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faeca7fc640 1 -- 172.21.15.167:0/1600130693 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc0b9690 con 0x7faed415d3b0 2023-11-28T20:54:06.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed415cf00 con 0x7faed415d3b0 2023-11-28T20:54:06.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed4067c40 con 0x7faed415d3b0 2023-11-28T20:54:06.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faeca7fc640 1 -- 172.21.15.167:0/1600130693 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faecc0b97f0 con 0x7faed415d3b0 2023-11-28T20:54:06.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faeca7fc640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faeb8066470 0x7faeb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:06.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faeca7fc640 1 -- 172.21.15.167:0/1600130693 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7faecc11f930 con 0x7faed415d3b0 2023-11-28T20:54:06.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.470+0000 7faed9d6d640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faeb8066470 0x7faeb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:06.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.474+0000 7faed9d6d640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faeb8066470 0x7faeb8068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7faed00011f0 tx=0x7faed0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:06.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.474+0000 7faeca7fc640 1 -- 172.21.15.167:0/1600130693 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faecc0ec9b0 con 0x7faed415d3b0 2023-11-28T20:54:06.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.714+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7faed4075c90 con 0x7faed415d3b0 2023-11-28T20:54:06.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.714+0000 7faeca7fc640 1 -- 172.21.15.167:0/1600130693 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7faecc009450 con 0x7faed415d3b0 2023-11-28T20:54:06.716 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":124,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:54:06.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.718+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faeb8066470 msgr2=0x7faeb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:06.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.718+0000 7faedbfd1640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faeb8066470 0x7faeb8068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7faed00011f0 tx=0x7faed0009040 comp rx=0 tx=0).stop 2023-11-28T20:54:06.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.718+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 msgr2=0x7faed40cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:06.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.718+0000 7faedbfd1640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 0x7faed40cc600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faecc0b0040 tx=0x7faecc0196c0 comp rx=0 tx=0).stop 2023-11-28T20:54:06.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.718+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 shutdown_connections 2023-11-28T20:54:06.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.722+0000 7faedbfd1640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faeb8066470 0x7faeb8068930 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:06.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.722+0000 7faedbfd1640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed415d3b0 0x7faed40cc600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:06.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.722+0000 7faedbfd1640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faed40aff70 0x7faed40cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:06.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.722+0000 7faedbfd1640 1 --2- 172.21.15.167:0/1600130693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faed406d530 0x7faed415c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:06.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.722+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 >> 172.21.15.167:0/1600130693 conn(0x7faed406ee00 msgr2=0x7faed406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:06.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.722+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 shutdown_connections 2023-11-28T20:54:06.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:06.722+0000 7faedbfd1640 1 -- 172.21.15.167:0/1600130693 wait complete. 2023-11-28T20:54:08.866 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 13% (15/112) Updating files: 14% (16/112) Updating files: 15% (17/112) Updating files: 16% (18/112) Updating files: 17% (20/112) Updating files: 18% (21/112) Updating files: 19% (22/112) Updating files: 20% (23/112) Updating files: 21% (24/112) Updating files: 22% (25/112) Updating files: 23% (26/112) Updating files: 24% (27/112) Updating files: 25% (28/112) Updating files: 26% (30/112) Updating files: 27% (31/112) Updating files: 28% (32/112) Updating files: 29% (33/112) Updating files: 30% (34/112) Updating files: 31% (35/112) Updating files: 32% (36/112) Updating files: 33% (37/112) Updating files: 34% (39/112) Updating files: 35% (40/112) Updating files: 36% (41/112) Updating files: 37% (42/112) Updating files: 38% (43/112) Updating files: 39% (44/112) Updating files: 40% (45/112) Updating files: 41% (46/112) Updating files: 42% (48/112) Updating files: 43% (49/112) Updating files: 44% (50/112) Updating files: 45% (51/112) Updating files: 46% (52/112) Updating files: 47% (53/112) Updating files: 48% (54/112) Updating files: 49% (55/112) Updating files: 50% (56/112) Updating files: 51% (58/112) Updating files: 52% (59/112) Updating files: 53% (60/112) Updating files: 54% (61/112) Updating files: 55% (62/112) Updating files: 56% (63/112) Updating files: 57% (64/112) Updating files: 58% (65/112) Updating files: 59% (67/112) Updating files: 60% (68/112) Updating files: 61% (69/112) Updating files: 62% (70/112) Updating files: 63% (71/112) Updating files: 64% (72/112) Updating files: 65% (73/112) Updating files: 66% (74/112) Updating files: 67% (76/112) Updating files: 68% (77/112) Updating files: 69% (78/112) Updating files: 70% (79/112) Updating files: 71% (80/112) Updating files: 72% (81/112) Updating files: 73% (82/112) Updating files: 74% (83/112) Updating files: 75% (84/112) Updating files: 76% (86/112) Updating files: 77% (87/112) Updating files: 78% (88/112) Updating files: 79% (89/112) Updating files: 80% (90/112) Updating files: 81% (91/112) Updating files: 82% (92/112) Updating files: 83% (93/112) Updating files: 84% (95/112) Updating files: 85% (96/112) Updating files: 86% (97/112) Updating files: 87% (98/112) Updating files: 88% (99/112) Updating files: 89% (100/112) Updating files: 90% (101/112) Updating files: 91% (102/112) Updating files: 92% (104/112) Updating files: 93% (105/112) Updating files: 94% (106/112) Updating files: 95% (107/112) Updating files: 96% (108/112) Updating files: 97% (109/112) Updating files: 98% (110/112) Updating files: 99% (111/112) Updating files: 100% (112/112) Updating files: 100% (112/112), done. 2023-11-28T20:54:09.042 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at ab3c421eb95 v0.15 2023-11-28T20:54:09.046 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.15 2023-11-28T20:54:09.694 INFO:tasks.workunit.client.0.smithi167.stdout:v0.16 2023-11-28T20:54:09.694 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 16 -eq 48 ] 2023-11-28T20:54:09.694 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.16 2023-11-28T20:54:09.695 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.16 2023-11-28T20:54:09.695 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.16 2023-11-28T20:54:09.755 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:54:09.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa1d33e640 1 Processor -- start 2023-11-28T20:54:09.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa1d33e640 1 -- start start 2023-11-28T20:54:09.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa1d33e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 0x7ffa180c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:09.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa1d33e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa180c5c90 0x7ffa180c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:09.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa1d33e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1815b220 con 0x7ffa1806a580 2023-11-28T20:54:09.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa1d33e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa180c4da0 con 0x7ffa18151f60 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa1d33e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180c60f0 con 0x7ffa180c5c90 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa167fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa180c5c90 0x7ffa180c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa16ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 0x7ffa180c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa167fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa180c5c90 0x7ffa180c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:44054/0 (socket says 172.21.15.167:44054) 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa16ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 0x7ffa180c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:33554/0 (socket says 172.21.15.167:33554) 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa167fc640 1 -- 172.21.15.167:0/731274379 learned_addr learned my addr 172.21.15.167:0/731274379 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa16ffd640 1 -- 172.21.15.167:0/731274379 >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 msgr2=0x7ffa180c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa16ffd640 1 -- 172.21.15.167:0/731274379 >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 msgr2=0x7ffa180c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa16ffd640 1 --2- 172.21.15.167:0/731274379 >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 0x7ffa180c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa16ffd640 1 --2- 172.21.15.167:0/731274379 >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 0x7ffa180c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa167fc640 1 -- 172.21.15.167:0/731274379 >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 msgr2=0x7ffa180c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:09.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa167fc640 1 --2- 172.21.15.167:0/731274379 >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 0x7ffa180c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:09.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa167fc640 1 -- 172.21.15.167:0/731274379 >> v1:172.21.15.178:6789/0 conn(0x7ffa1806a580 legacy=0x7ffa1806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:09.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.906+0000 7ffa167fc640 1 -- 172.21.15.167:0/731274379 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18152340 con 0x7ffa180c5c90 2023-11-28T20:54:09.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.910+0000 7ffa167fc640 1 --2- 172.21.15.167:0/731274379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa180c5c90 0x7ffa180c26e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009870 tx=0x7ffa0c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57d5214273a2056a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:09.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa15ffb640 1 -- 172.21.15.167:0/731274379 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0ac600 con 0x7ffa180c5c90 2023-11-28T20:54:09.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa15ffb640 1 -- 172.21.15.167:0/731274379 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0a8050 con 0x7ffa180c5c90 2023-11-28T20:54:09.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa15ffb640 1 -- 172.21.15.167:0/731274379 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0ac980 con 0x7ffa180c5c90 2023-11-28T20:54:09.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 -- 172.21.15.167:0/731274379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa180c5c90 msgr2=0x7ffa180c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:09.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 --2- 172.21.15.167:0/731274379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa180c5c90 0x7ffa180c26e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009870 tx=0x7ffa0c01c4b0 comp rx=0 tx=0).stop 2023-11-28T20:54:09.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 -- 172.21.15.167:0/731274379 shutdown_connections 2023-11-28T20:54:09.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 --2- 172.21.15.167:0/731274379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa180c5c90 0x7ffa180c26e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:09.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 --2- 172.21.15.167:0/731274379 >> v2:172.21.15.178:3300/0 conn(0x7ffa18151f60 0x7ffa180c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:09.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 -- 172.21.15.167:0/731274379 >> 172.21.15.167:0/731274379 conn(0x7ffa180cb1e0 msgr2=0x7ffa180cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:09.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 -- 172.21.15.167:0/731274379 shutdown_connections 2023-11-28T20:54:09.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 -- 172.21.15.167:0/731274379 wait complete. 2023-11-28T20:54:09.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 Processor -- start 2023-11-28T20:54:09.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.918+0000 7ffa1d33e640 1 -- start start 2023-11-28T20:54:09.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa1d33e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa1806a580 0x7ffa18161a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:09.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa1d33e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180c5c90 0x7ffa181f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:09.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa1d33e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa18151f60 0x7ffa181f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:09.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa1d33e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa181f6d40 con 0x7ffa180c5c90 2023-11-28T20:54:09.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa1d33e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa181f6190 con 0x7ffa18151f60 2023-11-28T20:54:09.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa1d33e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18162ea0 con 0x7ffa1806a580 2023-11-28T20:54:09.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa167fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180c5c90 0x7ffa181f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:09.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa167fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180c5c90 0x7ffa181f2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57922/0 (socket says 172.21.15.167:57922) 2023-11-28T20:54:09.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa167fc640 1 -- 172.21.15.167:0/3488791497 learned_addr learned my addr 172.21.15.167:0/3488791497 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:09.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa16ffd640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa1806a580 0x7ffa18161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:09.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa177fe640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa18151f60 0x7ffa181f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:09.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa167fc640 1 -- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa1806a580 msgr2=0x7ffa18161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:09.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa167fc640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa1806a580 0x7ffa18161a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:09.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa167fc640 1 -- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa18151f60 msgr2=0x7ffa181f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:09.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa167fc640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa18151f60 0x7ffa181f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:09.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa167fc640 1 -- 172.21.15.167:0/3488791497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0094d0 con 0x7ffa180c5c90 2023-11-28T20:54:09.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa167fc640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180c5c90 0x7ffa181f2c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c01a0e0 tx=0x7ffa0c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:09.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ff9ff7fe640 1 -- 172.21.15.167:0/3488791497 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0bc070 con 0x7ffa180c5c90 2023-11-28T20:54:09.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ff9ff7fe640 1 -- 172.21.15.167:0/3488791497 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0ace70 con 0x7ffa180c5c90 2023-11-28T20:54:09.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa18163140 con 0x7ffa180c5c90 2023-11-28T20:54:09.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ff9ff7fe640 1 -- 172.21.15.167:0/3488791497 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0b7650 con 0x7ffa180c5c90 2023-11-28T20:54:09.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa181f6680 con 0x7ffa180c5c90 2023-11-28T20:54:09.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.922+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa180682c0 con 0x7ffa180c5c90 2023-11-28T20:54:09.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.926+0000 7ff9ff7fe640 1 -- 172.21.15.167:0/3488791497 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa0c0b3070 con 0x7ffa180c5c90 2023-11-28T20:54:09.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.926+0000 7ff9ff7fe640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffa04066470 0x7ffa04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:09.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.926+0000 7ff9ff7fe640 1 -- 172.21.15.167:0/3488791497 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ffa0c11dff0 con 0x7ffa180c5c90 2023-11-28T20:54:09.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.926+0000 7ffa16ffd640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffa04066470 0x7ffa04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:09.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.926+0000 7ffa16ffd640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffa04066470 0x7ffa04068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ffa08000ee0 tx=0x7ffa08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:09.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:09.930+0000 7ff9ff7fe640 1 -- 172.21.15.167:0/3488791497 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffa0c0eb090 con 0x7ffa180c5c90 2023-11-28T20:54:10.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.146+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ffa181f6e80 con 0x7ffa180c5c90 2023-11-28T20:54:10.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.146+0000 7ff9ff7fe640 1 -- 172.21.15.167:0/3488791497 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7ffa0c0ee6b0 con 0x7ffa180c5c90 2023-11-28T20:54:10.146 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:54:10.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffa04066470 msgr2=0x7ffa04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffa04066470 0x7ffa04068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ffa08000ee0 tx=0x7ffa08008040 comp rx=0 tx=0).stop 2023-11-28T20:54:10.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180c5c90 msgr2=0x7ffa181f2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180c5c90 0x7ffa181f2c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c01a0e0 tx=0x7ffa0c01acf0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 shutdown_connections 2023-11-28T20:54:10.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ffa04066470 0x7ffa04068930 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa18151f60 0x7ffa181f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180c5c90 0x7ffa181f2c20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 --2- 172.21.15.167:0/3488791497 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa1806a580 0x7ffa18161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 >> 172.21.15.167:0/3488791497 conn(0x7ffa180cb1e0 msgr2=0x7ffa18150b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:10.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 shutdown_connections 2023-11-28T20:54:10.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.150+0000 7ffa1d33e640 1 -- 172.21.15.167:0/3488791497 wait complete. 2023-11-28T20:54:10.169 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:54:10.169 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:54:10.169 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:54:10.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe2a4a17640 1 Processor -- start 2023-11-28T20:54:10.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe2a4a17640 1 -- start start 2023-11-28T20:54:10.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe2a4a17640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe2a0157560 0x7fe2a00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe2a4a17640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a0157940 con 0x7fe2a0150b40 2023-11-28T20:54:10.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe2a4a17640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a00c6ac0 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe2a4a17640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a00c62f0 con 0x7fe2a0157560 2023-11-28T20:54:10.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe29e59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe2a0150b40 0x7fe2a00c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51622/0 (socket says 172.21.15.167:51622) 2023-11-28T20:54:10.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe29e59c640 1 -- 172.21.15.167:0/3020174323 learned_addr learned my addr 172.21.15.167:0/3020174323 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:54:10.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe29ed9d640 1 --2- 172.21.15.167:0/3020174323 >> v2:172.21.15.167:3300/0 conn(0x7fe2a0157560 0x7fe2a00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe29d59a640 1 -- 172.21.15.167:0/3020174323 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251946353 0 0) 0x7fe2a0157940 con 0x7fe2a0150b40 2023-11-28T20:54:10.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe29d59a640 1 -- 172.21.15.167:0/3020174323 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe288003530 con 0x7fe2a0150b40 2023-11-28T20:54:10.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe29ed9d640 1 -- 172.21.15.167:0/3020174323 >> v1:172.21.15.178:6789/0 conn(0x7fe2a00c6ff0 legacy=0x7fe2a006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe29ed9d640 1 -- 172.21.15.167:0/3020174323 >> v1:172.21.15.167:6789/0 conn(0x7fe2a0150b40 legacy=0x7fe2a00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.318+0000 7fe29ed9d640 1 -- 172.21.15.167:0/3020174323 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a00c6500 con 0x7fe2a0157560 2023-11-28T20:54:10.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe29ed9d640 1 --2- 172.21.15.167:0/3020174323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0157560 0x7fe2a00c4510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe298009d90 tx=0x7fe29801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626b0d863adf27ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe29d59a640 1 -- 172.21.15.167:0/3020174323 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980af600 con 0x7fe2a0157560 2023-11-28T20:54:10.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe29d59a640 1 -- 172.21.15.167:0/3020174323 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2980ab050 con 0x7fe2a0157560 2023-11-28T20:54:10.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe29d59a640 1 -- 172.21.15.167:0/3020174323 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980af980 con 0x7fe2a0157560 2023-11-28T20:54:10.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe2a4a17640 1 -- 172.21.15.167:0/3020174323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0157560 msgr2=0x7fe2a00c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe2a4a17640 1 --2- 172.21.15.167:0/3020174323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0157560 0x7fe2a00c4510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe298009d90 tx=0x7fe29801f130 comp rx=0 tx=0).stop 2023-11-28T20:54:10.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe2a4a17640 1 -- 172.21.15.167:0/3020174323 shutdown_connections 2023-11-28T20:54:10.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe2a4a17640 1 --2- 172.21.15.167:0/3020174323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0157560 0x7fe2a00c4510 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe2a4a17640 1 -- 172.21.15.167:0/3020174323 >> 172.21.15.167:0/3020174323 conn(0x7fe2a00cb1e0 msgr2=0x7fe2a00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:10.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe2a4a17640 1 -- 172.21.15.167:0/3020174323 shutdown_connections 2023-11-28T20:54:10.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.322+0000 7fe2a4a17640 1 -- 172.21.15.167:0/3020174323 wait complete. 2023-11-28T20:54:10.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 Processor -- start 2023-11-28T20:54:10.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 -- start start 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a00c6ff0 0x7fe2a01f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2a0150b40 0x7fe2a0155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2a0157560 0x7fe2a0149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a01f36b0 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0148d90 con 0x7fe2a0150b40 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0158b60 con 0x7fe2a0157560 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a00c6ff0 0x7fe2a01f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a00c6ff0 0x7fe2a01f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57950/0 (socket says 172.21.15.167:57950) 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29e59c640 1 -- 172.21.15.167:0/2418805536 learned_addr learned my addr 172.21.15.167:0/2418805536 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:10.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29dd9b640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2a0150b40 0x7fe2a0155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29ed9d640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2a0157560 0x7fe2a0149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29e59c640 1 -- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2a0157560 msgr2=0x7fe2a0149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29e59c640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2a0157560 0x7fe2a0149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29e59c640 1 -- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2a0150b40 msgr2=0x7fe2a0155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29e59c640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2a0150b40 0x7fe2a0155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29e59c640 1 -- 172.21.15.167:0/2418805536 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe298009a70 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe29e59c640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a00c6ff0 0x7fe2a01f3170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c4d0 tx=0x7fe29000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290005cf0 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe290005e50 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a0158e20 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290007270 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a0148740 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0148930 0x7fe2a0149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.326+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0074770 con 0x7fe2a0148930 2023-11-28T20:54:10.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe29dd9b640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0148930 0x7fe2a0149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe29dd9b640 1 -- 172.21.15.167:0/2418805536 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2a0070920 con 0x7fe2a0148930 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe29dd9b640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0148930 0x7fe2a0149760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2a01f02e0 tx=0x7fe29400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2940052e0 con 0x7fe2a0148930 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe2900073d0 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe28effd640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe280066540 0x7fe280068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe290083850 con 0x7fe2a00c6ff0 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fe294005440 con 0x7fe2a0148930 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0148930 msgr2=0x7fe2a0149760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe28effd640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0148930 0x7fe2a0149760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2a01f02e0 tx=0x7fe29400e960 comp rx=0 tx=0).stop 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0148930 msgr2=0x7fe2a0149760 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe28effd640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a0148930 0x7fe2a0149760 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2a01f02e0 tx=0x7fe29400e960 comp rx=0 tx=0).stop 2023-11-28T20:54:10.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe29ed9d640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe280066540 0x7fe280068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.330+0000 7fe29ed9d640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe280066540 0x7fe280068a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe2980b1000 tx=0x7fe2980aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a01585b0 0x7fe2a01478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0156d60 con 0x7fe2a01585b0 2023-11-28T20:54:10.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe29dd9b640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a01585b0 0x7fe2a01478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe29dd9b640 1 -- 172.21.15.167:0/2418805536 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe2a0156a80 con 0x7fe2a01585b0 2023-11-28T20:54:10.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe29dd9b640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a01585b0 0x7fe2a01478e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe294016000 tx=0x7fe294001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe294021070 con 0x7fe2a01585b0 2023-11-28T20:54:10.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4642 (secure 0 0 0) 0x7fe294003600 con 0x7fe2a01585b0 2023-11-28T20:54:10.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a01585b0 msgr2=0x7fe2a01478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe28effd640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a01585b0 0x7fe2a01478e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe294016000 tx=0x7fe294001130 comp rx=0 tx=0).stop 2023-11-28T20:54:10.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe28effd640 1 -- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a01585b0 msgr2=0x7fe2a01478e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:10.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe28effd640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a01585b0 0x7fe2a01478e0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe294016000 tx=0x7fe294001130 comp rx=0 tx=0).stop 2023-11-28T20:54:10.340 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:54:10.340 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:10.340 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:10.340 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:54:10.340 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 126, 2023-11-28T20:54:10.340 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:54:10.340 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:54:10.340 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:54:10.341 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:54:10.341 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.341 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:54:10.341 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:10.341 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:54:10.341 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:54:10.341 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:10.341 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:10.342 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:10.342 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:10.342 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:10.342 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:10.342 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:10.342 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:10.342 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:10.342 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:10.343 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.343 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:54:10.343 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:54:10.343 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:10.343 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:10.343 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:10.343 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:10.343 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:10.344 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:10.344 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:10.344 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:10.344 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:10.344 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:10.344 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.345 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:54:10.345 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:54:10.345 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:54:10.345 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:54:10.345 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:54:10.345 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:54:10.346 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:10.346 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:10.346 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:54:10.346 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:54:10.346 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:54:10.346 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:54:10.347 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:54:10.347 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:54:10.347 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:54:10.347 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:10.347 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:54:10.347 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:10.347 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:10.347 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:54:10.348 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.349 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.350 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:10.351 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:10.352 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:54:10.353 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.355 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.356 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:54:10.357 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:54:10.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe280066540 msgr2=0x7fe280068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe280066540 0x7fe280068a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe2980b1000 tx=0x7fe2980aa000 comp rx=0 tx=0).stop 2023-11-28T20:54:10.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a00c6ff0 msgr2=0x7fe2a01f3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 --2- 172.21.15.167:0/2418805536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2a00c6ff0 0x7fe2a01f3170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c4d0 tx=0x7fe29000c990 comp rx=0 tx=0).stop 2023-11-28T20:54:10.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe29ed9d640 1 -- 172.21.15.167:0/2418805536 reap_dead start 2023-11-28T20:54:10.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe29ed9d640 1 -- 172.21.15.167:0/2418805536 reap_dead start 2023-11-28T20:54:10.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 shutdown_connections 2023-11-28T20:54:10.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 >> 172.21.15.167:0/2418805536 conn(0x7fe2a00cb1e0 msgr2=0x7fe2a006e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:10.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 shutdown_connections 2023-11-28T20:54:10.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.338+0000 7fe2a4a17640 1 -- 172.21.15.167:0/2418805536 wait complete. 2023-11-28T20:54:10.359 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:54:10.359 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:54:10.360 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:54:10.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.498+0000 7f1651dc4640 1 Processor -- start 2023-11-28T20:54:10.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.498+0000 7f1651dc4640 1 -- start start 2023-11-28T20:54:10.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f1651dc4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f164c0c75c0 0x7f164c0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f1651dc4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f164c06a580 0x7f164c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f1651dc4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0c7a50 con 0x7f164c151f60 2023-11-28T20:54:10.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f1651dc4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c06aed0 con 0x7f164c06a580 2023-11-28T20:54:10.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f1651dc4640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0c4da0 con 0x7f164c0c75c0 2023-11-28T20:54:10.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f164b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f164c151f60 0x7f164c0c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51634/0 (socket says 172.21.15.167:51634) 2023-11-28T20:54:10.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f164b7fe640 1 -- 172.21.15.167:0/3745022204 learned_addr learned my addr 172.21.15.167:0/3745022204 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:54:10.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f164bfff640 1 --2- 172.21.15.167:0/3745022204 >> v2:172.21.15.167:3300/0 conn(0x7f164c06a580 0x7f164c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f164affd640 1 --2- 172.21.15.167:0/3745022204 >> v2:172.21.15.178:3300/0 conn(0x7f164c0c75c0 0x7f164c0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f164bfff640 1 -- 172.21.15.167:0/3745022204 >> v2:172.21.15.178:3300/0 conn(0x7f164c0c75c0 msgr2=0x7f164c0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:10.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f164bfff640 1 --2- 172.21.15.167:0/3745022204 >> v2:172.21.15.178:3300/0 conn(0x7f164c0c75c0 0x7f164c0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f164bfff640 1 -- 172.21.15.167:0/3745022204 >> v1:172.21.15.167:6789/0 conn(0x7f164c151f60 legacy=0x7f164c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.502+0000 7f164bfff640 1 -- 172.21.15.167:0/3745022204 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c15b220 con 0x7f164c06a580 2023-11-28T20:54:10.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f164bfff640 1 --2- 172.21.15.167:0/3745022204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c06a580 0x7f164c06a990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f164c0c8d80 tx=0x7f164401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60fa385c135f0bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f164a7fc640 1 -- 172.21.15.167:0/3745022204 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440a5740 con 0x7f164c06a580 2023-11-28T20:54:10.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f164a7fc640 1 -- 172.21.15.167:0/3745022204 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16440a58a0 con 0x7f164c06a580 2023-11-28T20:54:10.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f164a7fc640 1 -- 172.21.15.167:0/3745022204 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440a5c30 con 0x7f164c06a580 2023-11-28T20:54:10.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 -- 172.21.15.167:0/3745022204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c06a580 msgr2=0x7f164c06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 --2- 172.21.15.167:0/3745022204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c06a580 0x7f164c06a990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f164c0c8d80 tx=0x7f164401c880 comp rx=0 tx=0).stop 2023-11-28T20:54:10.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 -- 172.21.15.167:0/3745022204 shutdown_connections 2023-11-28T20:54:10.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 --2- 172.21.15.167:0/3745022204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c06a580 0x7f164c06a990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 --2- 172.21.15.167:0/3745022204 >> v2:172.21.15.178:3300/0 conn(0x7f164c0c75c0 0x7f164c0c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 -- 172.21.15.167:0/3745022204 >> 172.21.15.167:0/3745022204 conn(0x7f164c0cb1e0 msgr2=0x7f164c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:10.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 -- 172.21.15.167:0/3745022204 shutdown_connections 2023-11-28T20:54:10.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 -- 172.21.15.167:0/3745022204 wait complete. 2023-11-28T20:54:10.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 Processor -- start 2023-11-28T20:54:10.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 -- start start 2023-11-28T20:54:10.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164c06a580 0x7f164c158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c0c75c0 0x7f164c143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c151f60 0x7f164c161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c070800 con 0x7f164c151f60 2023-11-28T20:54:10.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1f6540 con 0x7f164c0c75c0 2023-11-28T20:54:10.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.506+0000 7f1651dc4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1f31b0 con 0x7f164c06a580 2023-11-28T20:54:10.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c151f60 0x7f164c161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c151f60 0x7f164c161750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57970/0 (socket says 172.21.15.167:57970) 2023-11-28T20:54:10.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164bfff640 1 -- 172.21.15.167:0/3895873550 learned_addr learned my addr 172.21.15.167:0/3895873550 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:10.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164affd640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c0c75c0 0x7f164c143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164b7fe640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164c06a580 0x7f164c158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164bfff640 1 -- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164c06a580 msgr2=0x7f164c158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164bfff640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164c06a580 0x7f164c158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164bfff640 1 -- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c0c75c0 msgr2=0x7f164c143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164bfff640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c0c75c0 0x7f164c143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164bfff640 1 -- 172.21.15.167:0/3895873550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009a70 con 0x7f164c151f60 2023-11-28T20:54:10.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164affd640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c0c75c0 0x7f164c143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:54:10.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164bfff640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c151f60 0x7f164c161750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1644019490 tx=0x7f1644019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440b9650 con 0x7f164c151f60 2023-11-28T20:54:10.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16440b97b0 con 0x7f164c151f60 2023-11-28T20:54:10.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440b9b60 con 0x7f164c151f60 2023-11-28T20:54:10.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c1f5c10 con 0x7f164c151f60 2023-11-28T20:54:10.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c1f61d0 con 0x7f164c151f60 2023-11-28T20:54:10.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1651dc4640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c144240 0x7f164c161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c074770 con 0x7f164c144240 2023-11-28T20:54:10.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164b7fe640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c144240 0x7f164c161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16440b9cc0 con 0x7f164c151f60 2023-11-28T20:54:10.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164b7fe640 1 -- 172.21.15.167:0/3895873550 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f164c15ba30 con 0x7f164c144240 2023-11-28T20:54:10.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f164b7fe640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c144240 0x7f164c161c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f70 tx=0x7f163c00e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1633fff640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16380664a0 0x7f1638068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f164411f4b0 con 0x7f164c151f60 2023-11-28T20:54:10.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.510+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c005ad0 con 0x7f164c144240 2023-11-28T20:54:10.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.514+0000 7f164affd640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16380664a0 0x7f1638068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.514+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f163c005c30 con 0x7f164c144240 2023-11-28T20:54:10.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.514+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c144240 msgr2=0x7f164c161c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.514+0000 7f1633fff640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c144240 0x7f164c161c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f70 tx=0x7f163c00e960 comp rx=0 tx=0).stop 2023-11-28T20:54:10.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.514+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c144240 msgr2=0x7f164c161c90 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:10.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.514+0000 7f1633fff640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c144240 0x7f164c161c90 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f70 tx=0x7f163c00e960 comp rx=0 tx=0).stop 2023-11-28T20:54:10.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.514+0000 7f164affd640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16380664a0 0x7f1638068960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f164c1f0230 tx=0x7f1640008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.518+0000 7f1651dc4640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c1508f0 0x7f164c0ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.518+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1f5da0 con 0x7f164c1508f0 2023-11-28T20:54:10.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.518+0000 7f164b7fe640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c1508f0 0x7f164c0ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.518+0000 7f164b7fe640 1 -- 172.21.15.167:0/3895873550 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f164c158750 con 0x7f164c1508f0 2023-11-28T20:54:10.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.518+0000 7f164b7fe640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c1508f0 0x7f164c0ca030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f70 tx=0x7f163c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c0074e0 con 0x7f164c1508f0 2023-11-28T20:54:10.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f163c007640 con 0x7f164c1508f0 2023-11-28T20:54:10.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c1508f0 msgr2=0x7f164c0ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1633fff640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c1508f0 0x7f164c0ca030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f70 tx=0x7f163c005800 comp rx=0 tx=0).stop 2023-11-28T20:54:10.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1633fff640 1 -- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c1508f0 msgr2=0x7f164c0ca030 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:10.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1633fff640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164c1508f0 0x7f164c0ca030 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f70 tx=0x7f163c005800 comp rx=0 tx=0).stop 2023-11-28T20:54:10.522 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:54:10.522 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:10.522 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:10.522 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:54:10.522 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 126, 2023-11-28T20:54:10.522 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:54:10.522 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:54:10.522 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:54:10.522 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:10.523 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:10.524 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:54:10.525 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:54:10.526 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:54:10.526 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:54:10.526 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:54:10.526 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:54:10.526 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:10.526 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:10.526 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:54:10.526 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:10.527 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:54:10.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.529 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:10.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:10.531 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.532 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:10.533 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:10.533 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:10.533 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:10.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.533 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:10.533 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:54:10.533 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.534 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:10.534 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:54:10.534 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.534 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.534 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.535 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.536 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:54:10.537 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16380664a0 msgr2=0x7f1638068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1651dc4640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16380664a0 0x7f1638068960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f164c1f0230 tx=0x7f1640008040 comp rx=0 tx=0).stop 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c151f60 msgr2=0x7f164c161750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1651dc4640 1 --2- 172.21.15.167:0/3895873550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f164c151f60 0x7f164c161750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1644019490 tx=0x7f1644019620 comp rx=0 tx=0).stop 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f164bfff640 1 -- 172.21.15.167:0/3895873550 reap_dead start 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f164bfff640 1 -- 172.21.15.167:0/3895873550 reap_dead start 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 shutdown_connections 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 >> 172.21.15.167:0/3895873550 conn(0x7f164c0cb1e0 msgr2=0x7f164c157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 shutdown_connections 2023-11-28T20:54:10.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.522+0000 7f1651dc4640 1 -- 172.21.15.167:0/3895873550 wait complete. 2023-11-28T20:54:10.540 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:54:10.541 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:54:10.541 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:54:10.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.682+0000 7fa361780640 1 Processor -- start 2023-11-28T20:54:10.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa361780640 1 -- start start 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa361780640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa35c151f60 0x7fa35c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa361780640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c0c5c90 0x7fa35c0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa361780640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa35c06a580 0x7fa35c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa361780640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35c0c4da0 con 0x7fa35c151f60 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa361780640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35c15b220 con 0x7fa35c06a580 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa361780640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c0c60f0 con 0x7fa35c0c5c90 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35affd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa35c151f60 0x7fa35c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35affd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa35c151f60 0x7fa35c0c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57978/0 (socket says 172.21.15.167:57978) 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35affd640 1 -- 172.21.15.167:0/3734111518 learned_addr learned my addr 172.21.15.167:0/3734111518 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35a7fc640 1 --2- 172.21.15.167:0/3734111518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c0c5c90 0x7fa35c0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35b7fe640 1 --2- 172.21.15.167:0/3734111518 >> v2:172.21.15.178:3300/0 conn(0x7fa35c06a580 0x7fa35c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35affd640 1 -- 172.21.15.167:0/3734111518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c0c5c90 msgr2=0x7fa35c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35affd640 1 --2- 172.21.15.167:0/3734111518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c0c5c90 0x7fa35c0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35affd640 1 -- 172.21.15.167:0/3734111518 >> v2:172.21.15.178:3300/0 conn(0x7fa35c06a580 msgr2=0x7fa35c06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35affd640 1 --2- 172.21.15.167:0/3734111518 >> v2:172.21.15.178:3300/0 conn(0x7fa35c06a580 0x7fa35c06a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.686+0000 7fa35affd640 1 -- 172.21.15.167:0/3734111518 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c152340 con 0x7fa35c151f60 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa35affd640 1 --2- 172.21.15.167:0/3734111518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c151f60 0x7fa35c0c75c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa35c158660 tx=0x7fa34c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5263e362f119a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa359ffb640 1 -- 172.21.15.167:0/3734111518 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0ab600 con 0x7fa35c151f60 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa359ffb640 1 -- 172.21.15.167:0/3734111518 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c0a7050 con 0x7fa35c151f60 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa359ffb640 1 -- 172.21.15.167:0/3734111518 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0ab980 con 0x7fa35c151f60 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa361780640 1 -- 172.21.15.167:0/3734111518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c151f60 msgr2=0x7fa35c0c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa361780640 1 --2- 172.21.15.167:0/3734111518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c151f60 0x7fa35c0c75c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa35c158660 tx=0x7fa34c01c470 comp rx=0 tx=0).stop 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa361780640 1 -- 172.21.15.167:0/3734111518 shutdown_connections 2023-11-28T20:54:10.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa361780640 1 --2- 172.21.15.167:0/3734111518 >> v2:172.21.15.178:3300/0 conn(0x7fa35c06a580 0x7fa35c06a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa361780640 1 --2- 172.21.15.167:0/3734111518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c0c5c90 0x7fa35c0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa361780640 1 --2- 172.21.15.167:0/3734111518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c151f60 0x7fa35c0c75c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa361780640 1 -- 172.21.15.167:0/3734111518 >> 172.21.15.167:0/3734111518 conn(0x7fa35c0cb1e0 msgr2=0x7fa35c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa361780640 1 -- 172.21.15.167:0/3734111518 shutdown_connections 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.690+0000 7fa361780640 1 -- 172.21.15.167:0/3734111518 wait complete. 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 Processor -- start 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 -- start start 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c06a580 0x7fa35c0ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c0c5c90 0x7fa35c1f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa35c151f60 0x7fa35c1f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c155910 con 0x7fa35c0c5c90 2023-11-28T20:54:10.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c1f2460 con 0x7fa35c151f60 2023-11-28T20:54:10.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c1f6480 con 0x7fa35c06a580 2023-11-28T20:54:10.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c0c5c90 0x7fa35c1f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c0c5c90 0x7fa35c1f2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57986/0 (socket says 172.21.15.167:57986) 2023-11-28T20:54:10.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35a7fc640 1 -- 172.21.15.167:0/1942293609 learned_addr learned my addr 172.21.15.167:0/1942293609 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:10.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35affd640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c06a580 0x7fa35c0ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35b7fe640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa35c151f60 0x7fa35c1f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35a7fc640 1 -- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c06a580 msgr2=0x7fa35c0ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35a7fc640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c06a580 0x7fa35c0ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35a7fc640 1 -- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa35c151f60 msgr2=0x7fa35c1f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35a7fc640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa35c151f60 0x7fa35c1f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35a7fc640 1 -- 172.21.15.167:0/1942293609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c0094d0 con 0x7fa35c0c5c90 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35a7fc640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c0c5c90 0x7fa35c1f2890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa35000d800 tx=0x7fa35000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35000b6c0 con 0x7fa35c0c5c90 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35000b820 con 0x7fa35c0c5c90 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35000bb90 con 0x7fa35c0c5c90 2023-11-28T20:54:10.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c15c0d0 con 0x7fa35c0c5c90 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c155af0 con 0x7fa35c0c5c90 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c156230 0x7fa35c144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c074770 con 0x7fa35c156230 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.694+0000 7fa35affd640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c156230 0x7fa35c144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa35000bcf0 con 0x7fa35c0c5c90 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa35affd640 1 -- 172.21.15.167:0/1942293609 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa35c15bf50 con 0x7fa35c156230 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa35affd640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c156230 0x7fa35c144b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0ab000 tx=0x7fa34c01acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa3437fe640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa348066470 0x7fa348068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa3500848a0 con 0x7fa35c0c5c90 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0b6440 con 0x7fa35c156230 2023-11-28T20:54:10.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa35b7fe640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa348066470 0x7fa348068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa34c0b65a0 con 0x7fa35c156230 2023-11-28T20:54:10.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c156230 msgr2=0x7fa35c144b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa3437fe640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c156230 0x7fa35c144b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0ab000 tx=0x7fa34c01acb0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c156230 msgr2=0x7fa35c144b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:10.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa3437fe640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c156230 0x7fa35c144b50 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0ab000 tx=0x7fa34c01acb0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.698+0000 7fa35b7fe640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa348066470 0x7fa348068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa354009f00 tx=0x7fa35400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.702+0000 7fa361780640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c155cb0 0x7fa35c145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.702+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c15ba30 con 0x7fa35c155cb0 2023-11-28T20:54:10.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa35affd640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c155cb0 0x7fa35c145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa35affd640 1 -- 172.21.15.167:0/1942293609 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa35c0682c0 con 0x7fa35c155cb0 2023-11-28T20:54:10.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa35affd640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c155cb0 0x7fa35c145090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa34c01c4b0 tx=0x7fa34c019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0b6910 con 0x7fa35c155cb0 2023-11-28T20:54:10.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7fa34c0b6a70 con 0x7fa35c155cb0 2023-11-28T20:54:10.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c155cb0 msgr2=0x7fa35c145090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa3437fe640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c155cb0 0x7fa35c145090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa34c01c4b0 tx=0x7fa34c019210 comp rx=0 tx=0).stop 2023-11-28T20:54:10.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa3437fe640 1 -- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c155cb0 msgr2=0x7fa35c145090 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:10.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa3437fe640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa35c155cb0 0x7fa35c145090 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa34c01c4b0 tx=0x7fa34c019210 comp rx=0 tx=0).stop 2023-11-28T20:54:10.709 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:54:10.709 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:10.709 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:10.709 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 126, 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:10.710 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:54:10.711 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.712 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:54:10.713 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:10.714 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.715 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:54:10.716 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:54:10.717 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.718 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:10.718 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:54:10.718 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.718 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.718 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.721 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:54:10.721 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:54:10.721 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:10.721 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:10.721 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.722 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:10.723 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.724 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:54:10.725 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.725 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.725 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.725 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:54:10.725 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.725 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.726 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:54:10.726 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.726 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.726 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.726 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:54:10.726 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:54:10.727 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:54:10.728 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:54:10.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa348066470 msgr2=0x7fa348068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa361780640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa348066470 0x7fa348068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa354009f00 tx=0x7fa35400b040 comp rx=0 tx=0).stop 2023-11-28T20:54:10.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c0c5c90 msgr2=0x7fa35c1f2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa361780640 1 --2- 172.21.15.167:0/1942293609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa35c0c5c90 0x7fa35c1f2890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa35000d800 tx=0x7fa35000dcc0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa35b7fe640 1 -- 172.21.15.167:0/1942293609 reap_dead start 2023-11-28T20:54:10.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa35b7fe640 1 -- 172.21.15.167:0/1942293609 reap_dead start 2023-11-28T20:54:10.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 shutdown_connections 2023-11-28T20:54:10.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 >> 172.21.15.167:0/1942293609 conn(0x7fa35c0cb1e0 msgr2=0x7fa35c160670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:10.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 shutdown_connections 2023-11-28T20:54:10.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.706+0000 7fa361780640 1 -- 172.21.15.167:0/1942293609 wait complete. 2023-11-28T20:54:10.731 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:54:10.731 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:54:10.731 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:54:10.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f824578d640 1 Processor -- start 2023-11-28T20:54:10.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f824578d640 1 -- start start 2023-11-28T20:54:10.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f824578d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8240150b40 0x7f8240157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f824578d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f82400c6ff0 0x7f82400c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f824578d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82400c6ac0 con 0x7f82400c5be0 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f824578d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82400c6500 con 0x7f82400c6ff0 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f824578d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82400c67e0 con 0x7f8240150b40 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f82367fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f82400c6ff0 0x7f82400c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f82367fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f82400c6ff0 0x7f82400c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57994/0 (socket says 172.21.15.167:57994) 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f82367fc640 1 -- 172.21.15.167:0/3665420323 learned_addr learned my addr 172.21.15.167:0/3665420323 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f823effd640 1 --2- 172.21.15.167:0/3665420323 >> v2:172.21.15.178:3300/0 conn(0x7f8240150b40 0x7f8240157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f82367fc640 1 -- 172.21.15.167:0/3665420323 >> v2:172.21.15.178:3300/0 conn(0x7f8240150b40 msgr2=0x7f8240157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:10.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f82367fc640 1 --2- 172.21.15.167:0/3665420323 >> v2:172.21.15.178:3300/0 conn(0x7f8240150b40 0x7f8240157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f82367fc640 1 -- 172.21.15.167:0/3665420323 >> v1:172.21.15.178:6789/0 conn(0x7f82400c5be0 legacy=0x7f824006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.870+0000 7f82367fc640 1 -- 172.21.15.167:0/3665420323 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8240156a80 con 0x7f82400c6ff0 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f82367fc640 1 --2- 172.21.15.167:0/3665420323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82400c6ff0 0x7f82400c4510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82400cc090 tx=0x7f822801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ff0cb5413e585b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f823e7fc640 1 -- 172.21.15.167:0/3665420323 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82280aa610 con 0x7f82400c6ff0 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f823e7fc640 1 -- 172.21.15.167:0/3665420323 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82280aa770 con 0x7f82400c6ff0 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f823e7fc640 1 -- 172.21.15.167:0/3665420323 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82280aab00 con 0x7f82400c6ff0 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f824578d640 1 -- 172.21.15.167:0/3665420323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82400c6ff0 msgr2=0x7f82400c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f824578d640 1 --2- 172.21.15.167:0/3665420323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82400c6ff0 0x7f82400c4510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82400cc090 tx=0x7f822801e6e0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f824578d640 1 -- 172.21.15.167:0/3665420323 shutdown_connections 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f824578d640 1 --2- 172.21.15.167:0/3665420323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82400c6ff0 0x7f82400c4510 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f824578d640 1 --2- 172.21.15.167:0/3665420323 >> v2:172.21.15.178:3300/0 conn(0x7f8240150b40 0x7f8240157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f824578d640 1 -- 172.21.15.167:0/3665420323 >> 172.21.15.167:0/3665420323 conn(0x7f82400cb1e0 msgr2=0x7f82400cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:10.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f824578d640 1 -- 172.21.15.167:0/3665420323 shutdown_connections 2023-11-28T20:54:10.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.874+0000 7f824578d640 1 -- 172.21.15.167:0/3665420323 wait complete. 2023-11-28T20:54:10.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 Processor -- start 2023-11-28T20:54:10.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 -- start start 2023-11-28T20:54:10.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82400c5be0 0x7f8240071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82400c6ff0 0x7f8240071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8240150b40 0x7f82400c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82400c8fe0 con 0x7f8240150b40 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82401f60d0 con 0x7f82400c5be0 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82401f63b0 con 0x7f82400c6ff0 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8240150b40 0x7f82400c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8240150b40 0x7f82400c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58002/0 (socket says 172.21.15.167:58002) 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823f7fe640 1 -- 172.21.15.167:0/1255385750 learned_addr learned my addr 172.21.15.167:0/1255385750 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823effd640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82400c5be0 0x7f8240071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f82367fc640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82400c6ff0 0x7f8240071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823f7fe640 1 -- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82400c6ff0 msgr2=0x7f8240071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823f7fe640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82400c6ff0 0x7f8240071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823f7fe640 1 -- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82400c5be0 msgr2=0x7f8240071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:10.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823f7fe640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82400c5be0 0x7f8240071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:10.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823f7fe640 1 -- 172.21.15.167:0/1255385750 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280094d0 con 0x7f8240150b40 2023-11-28T20:54:10.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f823f7fe640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8240150b40 0x7f82400c9470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f823800c730 tx=0x7f823800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f8237fff640 1 -- 172.21.15.167:0/1255385750 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238003ba0 con 0x7f8240150b40 2023-11-28T20:54:10.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f8237fff640 1 -- 172.21.15.167:0/1255385750 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8238003d00 con 0x7f8240150b40 2023-11-28T20:54:10.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f8237fff640 1 -- 172.21.15.167:0/1255385750 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238005310 con 0x7f8240150b40 2023-11-28T20:54:10.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82401f6690 con 0x7f8240150b40 2023-11-28T20:54:10.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82401f6c50 con 0x7f8240150b40 2023-11-28T20:54:10.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.878+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82400682c0 con 0x7f8240150b40 2023-11-28T20:54:10.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.882+0000 7f8237fff640 1 -- 172.21.15.167:0/1255385750 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8238005680 con 0x7f8240150b40 2023-11-28T20:54:10.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.882+0000 7f8237fff640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f82200664a0 0x7f8220068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:10.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.882+0000 7f8237fff640 1 -- 172.21.15.167:0/1255385750 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f82380840e0 con 0x7f8240150b40 2023-11-28T20:54:10.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.882+0000 7f823effd640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f82200664a0 0x7f8220068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:10.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.882+0000 7f823effd640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f82200664a0 0x7f8220068960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8230009b60 tx=0x7f8230009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:10.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:10.886+0000 7f8237fff640 1 -- 172.21.15.167:0/1255385750 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8238051180 con 0x7f8240150b40 2023-11-28T20:54:11.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.090+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f8240075c90 con 0x7f8240150b40 2023-11-28T20:54:11.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f8237fff640 1 -- 172.21.15.167:0/1255385750 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f82380547a0 con 0x7f8240150b40 2023-11-28T20:54:11.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f82200664a0 msgr2=0x7f8220068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:11.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f82200664a0 0x7f8220068960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8230009b60 tx=0x7f8230009190 comp rx=0 tx=0).stop 2023-11-28T20:54:11.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8240150b40 msgr2=0x7f82400c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:11.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8240150b40 0x7f82400c9470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f823800c730 tx=0x7f823800cbf0 comp rx=0 tx=0).stop 2023-11-28T20:54:11.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 shutdown_connections 2023-11-28T20:54:11.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f82200664a0 0x7f8220068960 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:11.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8240150b40 0x7f82400c9470 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:11.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82400c6ff0 0x7f8240071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:11.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 --2- 172.21.15.167:0/1255385750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82400c5be0 0x7f8240071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:11.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.094+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 >> 172.21.15.167:0/1255385750 conn(0x7f82400cb1e0 msgr2=0x7f824015f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:11.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.098+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 shutdown_connections 2023-11-28T20:54:11.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:11.098+0000 7f824578d640 1 -- 172.21.15.167:0/1255385750 wait complete. 2023-11-28T20:54:11.115 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:54:12.724 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 58% (63/107) Updating files: 59% (64/107) Updating files: 60% (65/107) Updating files: 61% (66/107) Updating files: 62% (67/107) Updating files: 63% (68/107) Updating files: 64% (69/107) Updating files: 65% (70/107) Updating files: 66% (71/107) Updating files: 67% (72/107) Updating files: 68% (73/107) Updating files: 69% (74/107) Updating files: 70% (75/107) Updating files: 71% (76/107) Updating files: 72% (78/107) Updating files: 73% (79/107) Updating files: 74% (80/107) Updating files: 75% (81/107) Updating files: 76% (82/107) Updating files: 77% (83/107) Updating files: 78% (84/107) Updating files: 79% (85/107) Updating files: 80% (86/107) Updating files: 81% (87/107) Updating files: 82% (88/107) Updating files: 83% (89/107) Updating files: 84% (90/107) Updating files: 85% (91/107) Updating files: 86% (93/107) Updating files: 87% (94/107) Updating files: 88% (95/107) Updating files: 89% (96/107) Updating files: 90% (97/107) Updating files: 91% (98/107) Updating files: 92% (99/107) Updating files: 93% (100/107) Updating files: 94% (101/107) Updating files: 95% (102/107) Updating files: 96% (103/107) Updating files: 97% (104/107) Updating files: 98% (105/107) Updating files: 99% (106/107) Updating files: 100% (107/107) Updating files: 100% (107/107), done. 2023-11-28T20:54:12.836 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 38dbaa5175c v0.16 2023-11-28T20:54:12.839 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.16 2023-11-28T20:54:12.880 INFO:tasks.workunit.client.0.smithi167.stdout:v0.17 2023-11-28T20:54:12.881 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 17 -eq 48 ] 2023-11-28T20:54:12.881 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.17 2023-11-28T20:54:12.881 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.17 2023-11-28T20:54:12.881 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.17 2023-11-28T20:54:18.659 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 12% (27/217) Updating files: 13% (29/217) Updating files: 14% (31/217) Updating files: 15% (33/217) Updating files: 16% (35/217) Updating files: 17% (37/217) Updating files: 18% (40/217) Updating files: 19% (42/217) Updating files: 20% (44/217) Updating files: 21% (46/217) Updating files: 22% (48/217) Updating files: 23% (50/217) Updating files: 24% (53/217) Updating files: 25% (55/217) Updating files: 26% (57/217) Updating files: 26% (58/217) Updating files: 27% (59/217) Updating files: 28% (61/217) Updating files: 29% (63/217) Updating files: 30% (66/217) Updating files: 31% (68/217) Updating files: 32% (70/217) Updating files: 33% (72/217) Updating files: 34% (74/217) Updating files: 35% (76/217) Updating files: 36% (79/217) Updating files: 37% (81/217) Updating files: 38% (83/217) Updating files: 39% (85/217) Updating files: 40% (87/217) Updating files: 41% (89/217) Updating files: 42% (92/217) Updating files: 43% (94/217) Updating files: 44% (96/217) Updating files: 45% (98/217) Updating files: 46% (100/217) Updating files: 47% (102/217) Updating files: 48% (105/217) Updating files: 49% (107/217) Updating files: 50% (109/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 86% (187/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 88% (193/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2023-11-28T20:54:18.893 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at dac3a8c35fb v0.17 2023-11-28T20:54:18.894 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.17 2023-11-28T20:54:18.934 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 18 -eq 48 ] 2023-11-28T20:54:18.934 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.18 2023-11-28T20:54:18.934 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.18 2023-11-28T20:54:18.935 INFO:tasks.workunit.client.0.smithi167.stdout:v0.18 2023-11-28T20:54:18.935 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.18 2023-11-28T20:54:20.828 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:20.832 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:21.116 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:54:21.155 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:54:21.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.306+0000 7f8b0771d640 1 Processor -- start 2023-11-28T20:54:21.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b0771d640 1 -- start start 2023-11-28T20:54:21.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b0771d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b001585d0 0x7f8b000c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b0771d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 0x7f8b00161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b0771d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0015e5e0 con 0x7f8b000c7720 2023-11-28T20:54:21.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b0771d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0015f160 con 0x7f8b001585d0 2023-11-28T20:54:21.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b0771d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0015e8c0 con 0x7f8b0015e130 2023-11-28T20:54:21.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b054b9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b001585d0 0x7f8b000c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b054b9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b001585d0 0x7f8b000c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56402/0 (socket says 172.21.15.167:56402) 2023-11-28T20:54:21.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b054b9640 1 -- 172.21.15.167:0/957760108 learned_addr learned my addr 172.21.15.167:0/957760108 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:21.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b04cb8640 1 --2- 172.21.15.167:0/957760108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 0x7f8b00161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b054b9640 1 -- 172.21.15.167:0/957760108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 msgr2=0x7f8b00161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:21.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b054b9640 1 --2- 172.21.15.167:0/957760108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 0x7f8b00161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b054b9640 1 -- 172.21.15.167:0/957760108 >> v1:172.21.15.178:6789/0 conn(0x7f8b000c7720 legacy=0x7f8b0006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.310+0000 7f8b054b9640 1 -- 172.21.15.167:0/957760108 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0015eba0 con 0x7f8b001585d0 2023-11-28T20:54:21.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8b054b9640 1 --2- 172.21.15.167:0/957760108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 0x7f8b000c5e90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009870 tx=0x7f8afc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b5bd0b8e473c80 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:21.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8af7fff640 1 -- 172.21.15.167:0/957760108 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0ab620 con 0x7f8b001585d0 2023-11-28T20:54:21.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8af7fff640 1 -- 172.21.15.167:0/957760108 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc0ab780 con 0x7f8b001585d0 2023-11-28T20:54:21.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8af7fff640 1 -- 172.21.15.167:0/957760108 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc0abb10 con 0x7f8b001585d0 2023-11-28T20:54:21.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8b0771d640 1 -- 172.21.15.167:0/957760108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 msgr2=0x7f8b000c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8b0771d640 1 --2- 172.21.15.167:0/957760108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 0x7f8b000c5e90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009870 tx=0x7f8afc01c510 comp rx=0 tx=0).stop 2023-11-28T20:54:21.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8b0771d640 1 -- 172.21.15.167:0/957760108 shutdown_connections 2023-11-28T20:54:21.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8b0771d640 1 --2- 172.21.15.167:0/957760108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 0x7f8b00161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8b0771d640 1 --2- 172.21.15.167:0/957760108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 0x7f8b000c5e90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8b0771d640 1 -- 172.21.15.167:0/957760108 >> 172.21.15.167:0/957760108 conn(0x7f8b000cb1e0 msgr2=0x7f8b000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:21.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8b0771d640 1 -- 172.21.15.167:0/957760108 shutdown_connections 2023-11-28T20:54:21.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.314+0000 7f8b0771d640 1 -- 172.21.15.167:0/957760108 wait complete. 2023-11-28T20:54:21.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 Processor -- start 2023-11-28T20:54:21.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 -- start start 2023-11-28T20:54:21.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b000c7720 0x7f8b000707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 0x7f8b0014a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 0x7f8b0014a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000ca950 con 0x7f8b001585d0 2023-11-28T20:54:21.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000caed0 con 0x7f8b000c7720 2023-11-28T20:54:21.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b001faf20 con 0x7f8b0015e130 2023-11-28T20:54:21.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b04cb8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 0x7f8b0014a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b04cb8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 0x7f8b0014a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56410/0 (socket says 172.21.15.167:56410) 2023-11-28T20:54:21.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b04cb8640 1 -- 172.21.15.167:0/981953846 learned_addr learned my addr 172.21.15.167:0/981953846 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:21.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b054b9640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b000c7720 0x7f8b000707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b05cba640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 0x7f8b0014a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b04cb8640 1 -- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 msgr2=0x7f8b0014a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b04cb8640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 0x7f8b0014a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b04cb8640 1 -- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b000c7720 msgr2=0x7f8b000707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b04cb8640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b000c7720 0x7f8b000707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b04cb8640 1 -- 172.21.15.167:0/981953846 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc0094d0 con 0x7f8b001585d0 2023-11-28T20:54:21.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b05cba640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 0x7f8b0014a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:54:21.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b04cb8640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 0x7f8b0014a0e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8af000d7d0 tx=0x7f8af000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:21.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8af5ffb640 1 -- 172.21.15.167:0/981953846 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af000b6c0 con 0x7f8b001585d0 2023-11-28T20:54:21.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8af5ffb640 1 -- 172.21.15.167:0/981953846 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af000b820 con 0x7f8b001585d0 2023-11-28T20:54:21.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8af5ffb640 1 -- 172.21.15.167:0/981953846 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af000bbb0 con 0x7f8b001585d0 2023-11-28T20:54:21.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b000cabf0 con 0x7f8b001585d0 2023-11-28T20:54:21.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b00070ce0 con 0x7f8b001585d0 2023-11-28T20:54:21.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.318+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b000682c0 con 0x7f8b001585d0 2023-11-28T20:54:21.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.322+0000 7f8af5ffb640 1 -- 172.21.15.167:0/981953846 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8af000bd10 con 0x7f8b001585d0 2023-11-28T20:54:21.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.322+0000 7f8af5ffb640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ae4066470 0x7f8ae4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.322+0000 7f8af5ffb640 1 -- 172.21.15.167:0/981953846 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8af0084700 con 0x7f8b001585d0 2023-11-28T20:54:21.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.322+0000 7f8b054b9640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ae4066470 0x7f8ae4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.322+0000 7f8b054b9640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ae4066470 0x7f8ae4068930 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0af000 tx=0x7f8afc0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:21.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.326+0000 7f8af5ffb640 1 -- 172.21.15.167:0/981953846 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8af0051780 con 0x7f8b001585d0 2023-11-28T20:54:21.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8b00075c90 con 0x7f8b001585d0 2023-11-28T20:54:21.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8af5ffb640 1 -- 172.21.15.167:0/981953846 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f8af0054da0 con 0x7f8b001585d0 2023-11-28T20:54:21.545 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:54:21.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ae4066470 msgr2=0x7f8ae4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ae4066470 0x7f8ae4068930 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0af000 tx=0x7f8afc0b6040 comp rx=0 tx=0).stop 2023-11-28T20:54:21.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 msgr2=0x7f8b0014a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 0x7f8b0014a0e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8af000d7d0 tx=0x7f8af000dc90 comp rx=0 tx=0).stop 2023-11-28T20:54:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 shutdown_connections 2023-11-28T20:54:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8ae4066470 0x7f8ae4068930 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b0015e130 0x7f8b0014a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b001585d0 0x7f8b0014a0e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 --2- 172.21.15.167:0/981953846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b000c7720 0x7f8b000707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 >> 172.21.15.167:0/981953846 conn(0x7f8b000cb1e0 msgr2=0x7f8b000c3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:21.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 shutdown_connections 2023-11-28T20:54:21.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.546+0000 7f8b0771d640 1 -- 172.21.15.167:0/981953846 wait complete. 2023-11-28T20:54:21.572 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:54:21.572 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:54:21.572 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:54:21.572 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:54:21.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.842+0000 7f82af772640 1 Processor -- start 2023-11-28T20:54:21.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.842+0000 7f82af772640 1 -- start start 2023-11-28T20:54:21.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82af772640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f82a8151f60 0x7f82a80c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82af772640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 0x7f82a806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82af772640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a80c6120 con 0x7f82a80c5c90 2023-11-28T20:54:21.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82af772640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a806aed0 con 0x7f82a8151f60 2023-11-28T20:54:21.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82af772640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80c4da0 con 0x7f82a806a580 2023-11-28T20:54:21.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82ad50e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f82a8151f60 0x7f82a80c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82ad50e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f82a8151f60 0x7f82a80c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:58962/0 (socket says 172.21.15.167:58962) 2023-11-28T20:54:21.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82ad50e640 1 -- 172.21.15.167:0/2140405698 learned_addr learned my addr 172.21.15.167:0/2140405698 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:21.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82add0f640 1 --2- 172.21.15.167:0/2140405698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 0x7f82a806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82ad50e640 1 -- 172.21.15.167:0/2140405698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 msgr2=0x7f82a806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:21.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82ad50e640 1 --2- 172.21.15.167:0/2140405698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 0x7f82a806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82ad50e640 1 -- 172.21.15.167:0/2140405698 >> v1:172.21.15.167:6789/0 conn(0x7f82a80c5c90 legacy=0x7f82a80c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:21.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.846+0000 7f82ad50e640 1 -- 172.21.15.167:0/2140405698 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a815b220 con 0x7f82a8151f60 2023-11-28T20:54:21.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.850+0000 7f82ad50e640 1 --2- 172.21.15.167:0/2140405698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82a8151f60 0x7f82a80c75c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009870 tx=0x7f82a401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c05d6f7b6dc4dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:21.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.850+0000 7f829ffff640 1 -- 172.21.15.167:0/2140405698 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40ab600 con 0x7f82a8151f60 2023-11-28T20:54:21.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.850+0000 7f829ffff640 1 -- 172.21.15.167:0/2140405698 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a40a7050 con 0x7f82a8151f60 2023-11-28T20:54:21.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.850+0000 7f829ffff640 1 -- 172.21.15.167:0/2140405698 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40ab980 con 0x7f82a8151f60 2023-11-28T20:54:21.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 -- 172.21.15.167:0/2140405698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82a8151f60 msgr2=0x7f82a80c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 --2- 172.21.15.167:0/2140405698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82a8151f60 0x7f82a80c75c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009870 tx=0x7f82a401c470 comp rx=0 tx=0).stop 2023-11-28T20:54:21.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 -- 172.21.15.167:0/2140405698 shutdown_connections 2023-11-28T20:54:21.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 --2- 172.21.15.167:0/2140405698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 0x7f82a806a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 --2- 172.21.15.167:0/2140405698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82a8151f60 0x7f82a80c75c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 -- 172.21.15.167:0/2140405698 >> 172.21.15.167:0/2140405698 conn(0x7f82a80cb1e0 msgr2=0x7f82a80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:21.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 -- 172.21.15.167:0/2140405698 shutdown_connections 2023-11-28T20:54:21.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 -- 172.21.15.167:0/2140405698 wait complete. 2023-11-28T20:54:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 Processor -- start 2023-11-28T20:54:21.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.854+0000 7f82af772640 1 -- start start 2023-11-28T20:54:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82af772640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 0x7f82a80c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82af772640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82a80c5c90 0x7f82a81f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82af772640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8151f60 0x7f82a813d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82af772640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8154f40 con 0x7f82a8151f60 2023-11-28T20:54:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82af772640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8154610 con 0x7f82a80c5c90 2023-11-28T20:54:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82af772640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8155360 con 0x7f82a806a580 2023-11-28T20:54:21.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82ad50e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 0x7f82a80c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82ad50e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 0x7f82a80c35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:45238/0 (socket says 172.21.15.167:45238) 2023-11-28T20:54:21.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82ad50e640 1 -- 172.21.15.167:0/1286753531 learned_addr learned my addr 172.21.15.167:0/1286753531 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:21.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82acd0d640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82a80c5c90 0x7f82a81f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82add0f640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8151f60 0x7f82a813d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82ad50e640 1 -- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82a80c5c90 msgr2=0x7f82a81f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82ad50e640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82a80c5c90 0x7f82a81f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82ad50e640 1 -- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8151f60 msgr2=0x7f82a813d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82ad50e640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8151f60 0x7f82a813d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82ad50e640 1 -- 172.21.15.167:0/1286753531 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a40094d0 con 0x7f82a806a580 2023-11-28T20:54:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82ad50e640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 0x7f82a80c35f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f82a40ae040 tx=0x7f82a4019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40b4420 con 0x7f82a806a580 2023-11-28T20:54:21.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a40b45a0 con 0x7f82a806a580 2023-11-28T20:54:21.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40b4950 con 0x7f82a806a580 2023-11-28T20:54:21.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.858+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a80caac0 con 0x7f82a806a580 2023-11-28T20:54:21.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.862+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a8154880 con 0x7f82a806a580 2023-11-28T20:54:21.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.862+0000 7f82af772640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a81f6260 0x7f82a813dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.862+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8074770 con 0x7f82a81f6260 2023-11-28T20:54:21.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.862+0000 7f82acd0d640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a81f6260 0x7f82a813dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.866+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82a40b2070 con 0x7f82a806a580 2023-11-28T20:54:21.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.866+0000 7f829dffb640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f828c0664c0 0x7f828c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.866+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f82a40eef50 con 0x7f82a806a580 2023-11-28T20:54:21.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.866+0000 7f82acd0d640 1 -- 172.21.15.167:0/1286753531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82a806ba10 con 0x7f82a81f6260 2023-11-28T20:54:21.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.866+0000 7f82add0f640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f828c0664c0 0x7f828c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.866+0000 7f82acd0d640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a81f6260 0x7f82a813dd80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f82a81621d0 tx=0x7f829800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:21.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.866+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829800d770 con 0x7f82a81f6260 2023-11-28T20:54:21.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.866+0000 7f82add0f640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f828c0664c0 0x7f828c068980 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f82a00074a0 tx=0x7f82a000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:21.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.870+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f829800d8d0 con 0x7f82a81f6260 2023-11-28T20:54:21.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.870+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a81f6260 msgr2=0x7f82a813dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.870+0000 7f829dffb640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a81f6260 0x7f82a813dd80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f82a81621d0 tx=0x7f829800fc00 comp rx=0 tx=0).stop 2023-11-28T20:54:21.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.870+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a81f6260 msgr2=0x7f82a813dd80 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:21.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.870+0000 7f829dffb640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a81f6260 0x7f82a813dd80 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f82a81621d0 tx=0x7f829800fc00 comp rx=0 tx=0).stop 2023-11-28T20:54:21.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f82af772640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8157850 0x7f82a815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:21.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8072490 con 0x7f82a8157850 2023-11-28T20:54:21.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f82acd0d640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8157850 0x7f82a815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:21.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f82acd0d640 1 -- 172.21.15.167:0/1286753531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f82a8158750 con 0x7f82a8157850 2023-11-28T20:54:21.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f82acd0d640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8157850 0x7f82a815a050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8298016000 tx=0x7f8298003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:21.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298007250 con 0x7f82a8157850 2023-11-28T20:54:21.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4643 (secure 0 0 0) 0x7f82980073b0 con 0x7f82a8157850 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8157850 msgr2=0x7f82a815a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f829dffb640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8157850 0x7f82a815a050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8298016000 tx=0x7f8298003770 comp rx=0 tx=0).stop 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f829dffb640 1 -- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8157850 msgr2=0x7f82a815a050 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.882+0000 7f829dffb640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a8157850 0x7f82a815a050 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8298016000 tx=0x7f8298003770 comp rx=0 tx=0).stop 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 126, 2023-11-28T20:54:21.884 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:21.885 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:54:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:54:21.888 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:21.889 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:54:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:21.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:54:21.892 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:21.893 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:21.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:54:21.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:21.896 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:54:21.897 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:54:21.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f828c0664c0 msgr2=0x7f828c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82af772640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f828c0664c0 0x7f828c068980 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f82a00074a0 tx=0x7f82a000b040 comp rx=0 tx=0).stop 2023-11-28T20:54:21.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 msgr2=0x7f82a80c35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:21.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82af772640 1 --2- 172.21.15.167:0/1286753531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82a806a580 0x7f82a80c35f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f82a40ae040 tx=0x7f82a4019210 comp rx=0 tx=0).stop 2023-11-28T20:54:21.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82add0f640 1 -- 172.21.15.167:0/1286753531 reap_dead start 2023-11-28T20:54:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82add0f640 1 -- 172.21.15.167:0/1286753531 reap_dead start 2023-11-28T20:54:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 shutdown_connections 2023-11-28T20:54:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 >> 172.21.15.167:0/1286753531 conn(0x7f82a80cb1e0 msgr2=0x7f82a814f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 shutdown_connections 2023-11-28T20:54:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:21.886+0000 7f82af772640 1 -- 172.21.15.167:0/1286753531 wait complete. 2023-11-28T20:54:21.902 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:54:21.902 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:54:21.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:54:22.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.082+0000 7f0df7b01640 1 Processor -- start 2023-11-28T20:54:22.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.082+0000 7f0df7b01640 1 -- start start 2023-11-28T20:54:22.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df7b01640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0df01585d0 0x7f0df00c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df7b01640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0df015e130 0x7f0df0161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df7b01640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0df00c7720 0x7f0df0162320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df7b01640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df015f160 con 0x7f0df015e130 2023-11-28T20:54:22.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df7b01640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df015e5e0 con 0x7f0df00c7720 2023-11-28T20:54:22.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df7b01640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df015e8c0 con 0x7f0df01585d0 2023-11-28T20:54:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df509c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0df015e130 0x7f0df0161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df509c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0df015e130 0x7f0df0161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56448/0 (socket says 172.21.15.167:56448) 2023-11-28T20:54:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df509c640 1 -- 172.21.15.167:0/1802865453 learned_addr learned my addr 172.21.15.167:0/1802865453 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df609e640 1 --2- 172.21.15.167:0/1802865453 >> v2:172.21.15.178:3300/0 conn(0x7f0df00c7720 0x7f0df0162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df589d640 1 --2- 172.21.15.167:0/1802865453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0df01585d0 0x7f0df00c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df509c640 1 -- 172.21.15.167:0/1802865453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0df01585d0 msgr2=0x7f0df00c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:22.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df509c640 1 --2- 172.21.15.167:0/1802865453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0df01585d0 0x7f0df00c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df509c640 1 -- 172.21.15.167:0/1802865453 >> v2:172.21.15.178:3300/0 conn(0x7f0df00c7720 msgr2=0x7f0df0162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:22.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df509c640 1 --2- 172.21.15.167:0/1802865453 >> v2:172.21.15.178:3300/0 conn(0x7f0df00c7720 0x7f0df0162320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df509c640 1 -- 172.21.15.167:0/1802865453 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df015eba0 con 0x7f0df015e130 2023-11-28T20:54:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.086+0000 7f0df509c640 1 --2- 172.21.15.167:0/1802865453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df015e130 0x7f0df0161de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0df006c260 tx=0x7f0de001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72ff490fe05ae02 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df489b640 1 -- 172.21.15.167:0/1802865453 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00aa5f0 con 0x7f0df015e130 2023-11-28T20:54:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df489b640 1 -- 172.21.15.167:0/1802865453 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de00aa750 con 0x7f0df015e130 2023-11-28T20:54:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df489b640 1 -- 172.21.15.167:0/1802865453 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00aaae0 con 0x7f0df015e130 2023-11-28T20:54:22.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 -- 172.21.15.167:0/1802865453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df015e130 msgr2=0x7f0df0161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 --2- 172.21.15.167:0/1802865453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df015e130 0x7f0df0161de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0df006c260 tx=0x7f0de001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 -- 172.21.15.167:0/1802865453 shutdown_connections 2023-11-28T20:54:22.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 --2- 172.21.15.167:0/1802865453 >> v2:172.21.15.178:3300/0 conn(0x7f0df00c7720 0x7f0df0162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 --2- 172.21.15.167:0/1802865453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df015e130 0x7f0df0161de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 --2- 172.21.15.167:0/1802865453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0df01585d0 0x7f0df00c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 -- 172.21.15.167:0/1802865453 >> 172.21.15.167:0/1802865453 conn(0x7f0df00cb1e0 msgr2=0x7f0df00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:22.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 -- 172.21.15.167:0/1802865453 shutdown_connections 2023-11-28T20:54:22.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 -- 172.21.15.167:0/1802865453 wait complete. 2023-11-28T20:54:22.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 Processor -- start 2023-11-28T20:54:22.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 -- start start 2023-11-28T20:54:22.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df00c7720 0x7f0df0154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df01585d0 0x7f0df015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0df015e130 0x7f0df01fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df015a4a0 con 0x7f0df01585d0 2023-11-28T20:54:22.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0150200 con 0x7f0df00c7720 2023-11-28T20:54:22.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df7b01640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df01504e0 con 0x7f0df015e130 2023-11-28T20:54:22.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df509c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df01585d0 0x7f0df015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df509c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df01585d0 0x7f0df015aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56464/0 (socket says 172.21.15.167:56464) 2023-11-28T20:54:22.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.090+0000 7f0df509c640 1 -- 172.21.15.167:0/2575095486 learned_addr learned my addr 172.21.15.167:0/2575095486 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:22.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df589d640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df00c7720 0x7f0df0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df609e640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0df015e130 0x7f0df01fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df509c640 1 -- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0df015e130 msgr2=0x7f0df01fa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df509c640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0df015e130 0x7f0df01fa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df509c640 1 -- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df00c7720 msgr2=0x7f0df0154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df509c640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df00c7720 0x7f0df0154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df509c640 1 -- 172.21.15.167:0/2575095486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de00094d0 con 0x7f0df01585d0 2023-11-28T20:54:22.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df509c640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df01585d0 0x7f0df015aef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0de001ab80 tx=0x7f0de001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00b3800 con 0x7f0df01585d0 2023-11-28T20:54:22.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de00b3980 con 0x7f0df01585d0 2023-11-28T20:54:22.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de00b3d30 con 0x7f0df01585d0 2023-11-28T20:54:22.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df015a6f0 con 0x7f0df01585d0 2023-11-28T20:54:22.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df0154570 con 0x7f0df01585d0 2023-11-28T20:54:22.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df7b01640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df006ddd0 0x7f0df01fa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0074770 con 0x7f0df006ddd0 2023-11-28T20:54:22.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df589d640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df006ddd0 0x7f0df01fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df589d640 1 -- 172.21.15.167:0/2575095486 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0df01506b0 con 0x7f0df006ddd0 2023-11-28T20:54:22.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0de00b2380 con 0x7f0df01585d0 2023-11-28T20:54:22.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0df589d640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df006ddd0 0x7f0df01fa710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00f4b0 tx=0x7f0dec00f970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0de67fc640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0dd4066470 0x7f0dd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0de00a7070 con 0x7f0df01585d0 2023-11-28T20:54:22.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.094+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec014870 con 0x7f0df006ddd0 2023-11-28T20:54:22.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.098+0000 7f0df609e640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0dd4066470 0x7f0dd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.098+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0dec0149d0 con 0x7f0df006ddd0 2023-11-28T20:54:22.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.098+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df006ddd0 msgr2=0x7f0df01fa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.098+0000 7f0de67fc640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df006ddd0 0x7f0df01fa710 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00f4b0 tx=0x7f0dec00f970 comp rx=0 tx=0).stop 2023-11-28T20:54:22.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.098+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df006ddd0 msgr2=0x7f0df01fa710 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:22.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.098+0000 7f0de67fc640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df006ddd0 0x7f0df01fa710 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00f4b0 tx=0x7f0dec00f970 comp rx=0 tx=0).stop 2023-11-28T20:54:22.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.098+0000 7f0df609e640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0dd4066470 0x7f0dd4068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009f00 tx=0x7f0de800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.102+0000 7f0df7b01640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df014f1e0 0x7f0df014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.102+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00682c0 con 0x7f0df014f1e0 2023-11-28T20:54:22.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.102+0000 7f0df589d640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df014f1e0 0x7f0df014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.102+0000 7f0df589d640 1 -- 172.21.15.167:0/2575095486 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0df0075c90 con 0x7f0df014f1e0 2023-11-28T20:54:22.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.102+0000 7f0df589d640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df014f1e0 0x7f0df014f5f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0dec01a000 tx=0x7f0dec0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec004260 con 0x7f0df014f1e0 2023-11-28T20:54:22.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7f0dec0043c0 con 0x7f0df014f1e0 2023-11-28T20:54:22.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df014f1e0 msgr2=0x7f0df014f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0de67fc640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df014f1e0 0x7f0df014f5f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0dec01a000 tx=0x7f0dec0046d0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0de67fc640 1 -- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df014f1e0 msgr2=0x7f0df014f5f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:22.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0de67fc640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0df014f1e0 0x7f0df014f5f0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0dec01a000 tx=0x7f0dec0046d0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.110 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:54:22.110 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:22.110 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:22.110 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 126, 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:54:22.111 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:54:22.112 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:22.112 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:22.112 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:22.112 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:22.112 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:22.112 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:22.112 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:22.112 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:22.112 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:22.113 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:22.113 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.113 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:54:22.113 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:54:22.113 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:22.113 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:22.113 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:22.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:22.113 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.114 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:54:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:54:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:54:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:54:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:54:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:54:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:54:22.115 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:54:22.116 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:54:22.116 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:54:22.116 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:54:22.116 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:54:22.116 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:54:22.116 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:22.116 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:54:22.116 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:22.117 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:22.117 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:22.117 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:22.117 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:22.117 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:22.117 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:22.117 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:22.117 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:22.117 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:22.118 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.118 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:54:22.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.118 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:54:22.118 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.118 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:22.118 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:22.118 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:22.119 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:22.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.119 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:22.119 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:54:22.119 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.119 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.119 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:22.119 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:54:22.120 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.120 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.120 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.120 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:54:22.120 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:54:22.121 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:22.121 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:22.121 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:22.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.121 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.121 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:22.122 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:22.122 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:22.122 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:22.122 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.122 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:22.122 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:54:22.123 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.123 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.123 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:22.123 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:54:22.124 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.124 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.124 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.124 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:54:22.125 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:54:22.125 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:22.125 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:22.125 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:22.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.125 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.126 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:22.126 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:22.126 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:22.126 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:22.126 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.126 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:22.127 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:54:22.127 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.127 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.127 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:22.127 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:54:22.128 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.128 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.128 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.128 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:54:22.128 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:54:22.129 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:22.129 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:22.129 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:22.129 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.129 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.130 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:54:22.130 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:54:22.130 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.130 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:22.131 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:22.131 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:22.131 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.131 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.131 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:54:22.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.132 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:22.132 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:22.132 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:22.132 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.132 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.133 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:54:22.133 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:54:22.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0dd4066470 msgr2=0x7f0dd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df7b01640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0dd4066470 0x7f0dd4068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009f00 tx=0x7f0de800b040 comp rx=0 tx=0).stop 2023-11-28T20:54:22.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df01585d0 msgr2=0x7f0df015aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df7b01640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df01585d0 0x7f0df015aef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0de001ab80 tx=0x7f0de001ad10 comp rx=0 tx=0).stop 2023-11-28T20:54:22.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df609e640 1 -- 172.21.15.167:0/2575095486 reap_dead start 2023-11-28T20:54:22.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 shutdown_connections 2023-11-28T20:54:22.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df7b01640 1 --2- 172.21.15.167:0/2575095486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df01585d0 0x7f0df015aef0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 >> 172.21.15.167:0/2575095486 conn(0x7f0df00cb1e0 msgr2=0x7f0df015cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:22.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 shutdown_connections 2023-11-28T20:54:22.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.106+0000 7f0df7b01640 1 -- 172.21.15.167:0/2575095486 wait complete. 2023-11-28T20:54:22.137 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:54:22.138 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:54:22.138 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:54:22.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.278+0000 7f9306357640 1 Processor -- start 2023-11-28T20:54:22.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.278+0000 7f9306357640 1 -- start start 2023-11-28T20:54:22.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.278+0000 7f9306357640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9300150b40 0x7f9300157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.278+0000 7f9306357640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f93000c4510 0x7f930006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.278+0000 7f9306357640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93000c48f0 con 0x7f93000c6ff0 2023-11-28T20:54:22.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.278+0000 7f9306357640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93000c62f0 con 0x7f9300150b40 2023-11-28T20:54:22.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.278+0000 7f9306357640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93000c6ac0 con 0x7f93000c4510 2023-11-28T20:54:22.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.278+0000 7f92fffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9300150b40 0x7f9300157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92fffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9300150b40 0x7f9300157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56478/0 (socket says 172.21.15.167:56478) 2023-11-28T20:54:22.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92fffff640 1 -- 172.21.15.167:0/2144408015 learned_addr learned my addr 172.21.15.167:0/2144408015 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:22.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f93048f4640 1 --2- 172.21.15.167:0/2144408015 >> v2:172.21.15.178:3300/0 conn(0x7f93000c4510 0x7f930006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92fffff640 1 -- 172.21.15.167:0/2144408015 >> v2:172.21.15.178:3300/0 conn(0x7f93000c4510 msgr2=0x7f930006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:22.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92feffd640 1 -- 172.21.15.167:0/2144408015 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867349965 0 0) 0x7f93000c48f0 con 0x7f93000c6ff0 2023-11-28T20:54:22.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92fffff640 1 --2- 172.21.15.167:0/2144408015 >> v2:172.21.15.178:3300/0 conn(0x7f93000c4510 0x7f930006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92fffff640 1 -- 172.21.15.167:0/2144408015 >> v1:172.21.15.167:6789/0 conn(0x7f93000c6ff0 legacy=0x7f93000c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92fffff640 1 -- 172.21.15.167:0/2144408015 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93000c6500 con 0x7f9300150b40 2023-11-28T20:54:22.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92fffff640 1 --2- 172.21.15.167:0/2144408015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 0x7f9300157560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93000cc270 tx=0x7f92f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65def0ba87dba42 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92feffd640 1 -- 172.21.15.167:0/2144408015 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00ac640 con 0x7f9300150b40 2023-11-28T20:54:22.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92feffd640 1 -- 172.21.15.167:0/2144408015 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f00ac7a0 con 0x7f9300150b40 2023-11-28T20:54:22.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.282+0000 7f92feffd640 1 -- 172.21.15.167:0/2144408015 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00acb30 con 0x7f9300150b40 2023-11-28T20:54:22.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 -- 172.21.15.167:0/2144408015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 msgr2=0x7f9300157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 --2- 172.21.15.167:0/2144408015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 0x7f9300157560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93000cc270 tx=0x7f92f001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 -- 172.21.15.167:0/2144408015 shutdown_connections 2023-11-28T20:54:22.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 --2- 172.21.15.167:0/2144408015 >> v2:172.21.15.178:3300/0 conn(0x7f93000c4510 0x7f930006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 --2- 172.21.15.167:0/2144408015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 0x7f9300157560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 -- 172.21.15.167:0/2144408015 >> 172.21.15.167:0/2144408015 conn(0x7f93000cb1e0 msgr2=0x7f93000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:22.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 -- 172.21.15.167:0/2144408015 shutdown_connections 2023-11-28T20:54:22.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 -- 172.21.15.167:0/2144408015 wait complete. 2023-11-28T20:54:22.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 Processor -- start 2023-11-28T20:54:22.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 -- start start 2023-11-28T20:54:22.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000c4510 0x7f930014d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93000c6ff0 0x7f9300158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 0x7f93001594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93001f2c10 con 0x7f9300150b40 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9300159b10 con 0x7f93000c6ff0 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f9306357640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93001f2000 con 0x7f93000c4510 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f93048f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 0x7f93001594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f93048f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 0x7f93001594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56486/0 (socket says 172.21.15.167:56486) 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f93048f4640 1 -- 172.21.15.167:0/3394046369 learned_addr learned my addr 172.21.15.167:0/3394046369 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f92fffff640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000c4510 0x7f930014d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f92ff7fe640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93000c6ff0 0x7f9300158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f93048f4640 1 -- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000c4510 msgr2=0x7f930014d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f93048f4640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000c4510 0x7f930014d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f93048f4640 1 -- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93000c6ff0 msgr2=0x7f9300158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f93048f4640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93000c6ff0 0x7f9300158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f93048f4640 1 -- 172.21.15.167:0/3394046369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f00094d0 con 0x7f9300150b40 2023-11-28T20:54:22.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.286+0000 7f92fffff640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000c4510 0x7f930014d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f93048f4640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 0x7f93001594a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92f800efc0 tx=0x7f92f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8014480 con 0x7f9300150b40 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f800f040 con 0x7f9300150b40 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93001f22e0 con 0x7f9300150b40 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8014820 con 0x7f9300150b40 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93001f28a0 con 0x7f9300150b40 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f9306357640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001544a0 0x7f93001f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9300074770 con 0x7f93001544a0 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fffff640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001544a0 0x7f93001f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92f8014980 con 0x7f9300150b40 2023-11-28T20:54:22.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fffff640 1 -- 172.21.15.167:0/3394046369 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9300157040 con 0x7f93001544a0 2023-11-28T20:54:22.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fffff640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001544a0 0x7f93001f54d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f930006bba0 tx=0x7f92f001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fcff9640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f92ec066470 0x7f92ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f92f8085200 con 0x7f9300150b40 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92ff7fe640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f92ec066470 0x7f92ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.290+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00b5600 con 0x7f93001544a0 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.294+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f92f00b5760 con 0x7f93001544a0 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.294+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001544a0 msgr2=0x7f93001f54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.294+0000 7f92fcff9640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001544a0 0x7f93001f54d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f930006bba0 tx=0x7f92f001ad10 comp rx=0 tx=0).stop 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.294+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001544a0 msgr2=0x7f93001f54d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.294+0000 7f92fcff9640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001544a0 0x7f93001f54d0 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f930006bba0 tx=0x7f92f001ad10 comp rx=0 tx=0).stop 2023-11-28T20:54:22.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.294+0000 7f92ff7fe640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f92ec066470 0x7f92ec068930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f93001f6580 tx=0x7f92f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.298+0000 7f9306357640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001f5a10 0x7f930014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.298+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93000682c0 con 0x7f93001f5a10 2023-11-28T20:54:22.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.298+0000 7f92fffff640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001f5a10 0x7f930014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.298+0000 7f92fffff640 1 -- 172.21.15.167:0/3394046369 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9300075c90 con 0x7f93001f5a10 2023-11-28T20:54:22.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.298+0000 7f92fffff640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001f5a10 0x7f930014e780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f92f00190e0 tx=0x7f92f0019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00c17f0 con 0x7f93001f5a10 2023-11-28T20:54:22.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5124 (secure 0 0 0) 0x7f92f0003620 con 0x7f93001f5a10 2023-11-28T20:54:22.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001f5a10 msgr2=0x7f930014e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f92fcff9640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001f5a10 0x7f930014e780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f92f00190e0 tx=0x7f92f0019270 comp rx=0 tx=0).stop 2023-11-28T20:54:22.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f92fcff9640 1 -- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001f5a10 msgr2=0x7f930014e780 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:22.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f92fcff9640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93001f5a10 0x7f930014e780 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f92f00190e0 tx=0x7f92f0019270 comp rx=0 tx=0).stop 2023-11-28T20:54:22.301 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 126, 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:54:22.302 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:22.303 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:22.304 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:22.305 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:22.306 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:54:22.307 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:22.309 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.310 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:22.311 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:22.313 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:22.314 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:22.314 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.314 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.314 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:54:22.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.314 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:22.314 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:22.314 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:54:22.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.315 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.315 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:54:22.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.315 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:22.315 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:22.315 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:54:22.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.316 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:54:22.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.316 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:54:22.316 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:22.316 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:22.316 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.317 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:22.317 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:22.317 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:54:22.317 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.317 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:22.317 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:54:22.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:22.318 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:22.318 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:22.318 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:54:22.318 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:22.318 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:22.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:22.319 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:54:22.319 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:54:22.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f92ec066470 msgr2=0x7f92ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f9306357640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f92ec066470 0x7f92ec068930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f93001f6580 tx=0x7f92f4009040 comp rx=0 tx=0).stop 2023-11-28T20:54:22.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 msgr2=0x7f93001594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f9306357640 1 --2- 172.21.15.167:0/3394046369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9300150b40 0x7f93001594a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92f800efc0 tx=0x7f92f800c490 comp rx=0 tx=0).stop 2023-11-28T20:54:22.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f93048f4640 1 -- 172.21.15.167:0/3394046369 reap_dead start 2023-11-28T20:54:22.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f93048f4640 1 -- 172.21.15.167:0/3394046369 reap_dead start 2023-11-28T20:54:22.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 shutdown_connections 2023-11-28T20:54:22.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 >> 172.21.15.167:0/3394046369 conn(0x7f93000cb1e0 msgr2=0x7f930014ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:22.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 shutdown_connections 2023-11-28T20:54:22.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.302+0000 7f9306357640 1 -- 172.21.15.167:0/3394046369 wait complete. 2023-11-28T20:54:22.321 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:54:22.322 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2023-11-28T20:54:22.322 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:54:22.322 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2023-11-28T20:54:22.322 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:54:22.322 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T20:54:22.322 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:54:22.338 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T20:54:22.338 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:54:22.338 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:54:22.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.522+0000 7fe999cd6640 1 Processor -- start 2023-11-28T20:54:22.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.522+0000 7fe999cd6640 1 -- start start 2023-11-28T20:54:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.522+0000 7fe999cd6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe994070480 0x7fe994071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.522+0000 7fe999cd6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe99406e410 0x7fe994072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.522+0000 7fe999cd6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9941571d0 con 0x7fe99406e030 2023-11-28T20:54:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.522+0000 7fe999cd6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe994071a90 con 0x7fe99406e410 2023-11-28T20:54:22.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.522+0000 7fe999cd6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9940c70d0 con 0x7fe994070480 2023-11-28T20:54:22.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.526+0000 7fe993fff640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fe99406e410 msgr2=0x7fe994072460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:22.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.526+0000 7fe993fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe99406e410 0x7fe994072460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:22.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.526+0000 7fe992ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe994070480 0x7fe994071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.526+0000 7fe992ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe994070480 0x7fe994071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:59042/0 (socket says 172.21.15.167:59042) 2023-11-28T20:54:22.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.526+0000 7fe992ffd640 1 -- 172.21.15.167:0/2819191287 learned_addr learned my addr 172.21.15.167:0/2819191287 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:22.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.526+0000 7fe992ffd640 1 -- 172.21.15.167:0/2819191287 >> v2:172.21.15.167:3300/0 conn(0x7fe99406e410 msgr2=0x7fe994072460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:22.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.526+0000 7fe992ffd640 1 --2- 172.21.15.167:0/2819191287 >> v2:172.21.15.167:3300/0 conn(0x7fe99406e410 0x7fe994072460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.526+0000 7fe992ffd640 1 -- 172.21.15.167:0/2819191287 >> v1:172.21.15.178:6789/0 conn(0x7fe99406e030 legacy=0x7fe9941500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.526+0000 7fe992ffd640 1 -- 172.21.15.167:0/2819191287 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940c73b0 con 0x7fe994070480 2023-11-28T20:54:22.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe992ffd640 1 --2- 172.21.15.167:0/2819191287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe994070480 0x7fe994071f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe99406b790 tx=0x7fe98801d600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13d68c7085e28005 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe9927fc640 1 -- 172.21.15.167:0/2819191287 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880a9610 con 0x7fe994070480 2023-11-28T20:54:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe9927fc640 1 -- 172.21.15.167:0/2819191287 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9880a9770 con 0x7fe994070480 2023-11-28T20:54:22.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe9927fc640 1 -- 172.21.15.167:0/2819191287 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880a9b00 con 0x7fe994070480 2023-11-28T20:54:22.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 -- 172.21.15.167:0/2819191287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe994070480 msgr2=0x7fe994071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 --2- 172.21.15.167:0/2819191287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe994070480 0x7fe994071f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe99406b790 tx=0x7fe98801d600 comp rx=0 tx=0).stop 2023-11-28T20:54:22.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 -- 172.21.15.167:0/2819191287 shutdown_connections 2023-11-28T20:54:22.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 --2- 172.21.15.167:0/2819191287 >> v2:172.21.15.167:3300/0 conn(0x7fe99406e410 0x7fe994072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 --2- 172.21.15.167:0/2819191287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe994070480 0x7fe994071f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 -- 172.21.15.167:0/2819191287 >> 172.21.15.167:0/2819191287 conn(0x7fe9940cb1e0 msgr2=0x7fe9940cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:22.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 -- 172.21.15.167:0/2819191287 shutdown_connections 2023-11-28T20:54:22.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 -- 172.21.15.167:0/2819191287 wait complete. 2023-11-28T20:54:22.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 Processor -- start 2023-11-28T20:54:22.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 -- start start 2023-11-28T20:54:22.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe99406e030 0x7fe99415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe99406e410 0x7fe994146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe994070480 0x7fe994141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe994158020 con 0x7fe99406e410 2023-11-28T20:54:22.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe994157450 con 0x7fe99406e030 2023-11-28T20:54:22.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.530+0000 7fe999cd6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe994147410 con 0x7fe994070480 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe992ffd640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe99406e410 msgr2=0x7fe994146bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe992ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe99406e410 0x7fe994146bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe9937fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe99406e030 0x7fe99415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe993fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe994070480 0x7fe994141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe9937fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe99406e030 0x7fe99415a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:59050/0 (socket says 172.21.15.167:59050) 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe9937fe640 1 -- 172.21.15.167:0/3122072145 learned_addr learned my addr 172.21.15.167:0/3122072145 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe993fff640 1 -- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe99406e030 msgr2=0x7fe99415a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe993fff640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe99406e030 0x7fe99415a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe993fff640 1 -- 172.21.15.167:0/3122072145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe99406e410 msgr2=0x7fe994146bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe993fff640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe99406e410 0x7fe994146bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe993fff640 1 -- 172.21.15.167:0/3122072145 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9880094d0 con 0x7fe994070480 2023-11-28T20:54:22.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe9937fe640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe99406e030 0x7fe99415a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:54:22.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe993fff640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe994070480 0x7fe994141a60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00bd90 tx=0x7fe98c009eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe97bfff640 1 -- 172.21.15.167:0/3122072145 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0064e0 con 0x7fe994070480 2023-11-28T20:54:22.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9941576f0 con 0x7fe994070480 2023-11-28T20:54:22.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe97bfff640 1 -- 172.21.15.167:0/3122072145 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c00f070 con 0x7fe994070480 2023-11-28T20:54:22.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe97bfff640 1 -- 172.21.15.167:0/3122072145 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0068c0 con 0x7fe994070480 2023-11-28T20:54:22.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe994157cb0 con 0x7fe994070480 2023-11-28T20:54:22.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.534+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9940682c0 con 0x7fe994070480 2023-11-28T20:54:22.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.538+0000 7fe97bfff640 1 -- 172.21.15.167:0/3122072145 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe98c006a20 con 0x7fe994070480 2023-11-28T20:54:22.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.538+0000 7fe97bfff640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe980066420 0x7fe9800688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:22.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.538+0000 7fe97bfff640 1 -- 172.21.15.167:0/3122072145 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe98c0850a0 con 0x7fe994070480 2023-11-28T20:54:22.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.538+0000 7fe9937fe640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe980066420 0x7fe9800688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:22.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.538+0000 7fe9937fe640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe980066420 0x7fe9800688e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe984001c00 tx=0x7fe984009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:22.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.550+0000 7fe97bfff640 1 -- 172.21.15.167:0/3122072145 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe98c052090 con 0x7fe994070480 2023-11-28T20:54:22.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.758+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe994158190 con 0x7fe994070480 2023-11-28T20:54:22.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.758+0000 7fe97bfff640 1 -- 172.21.15.167:0/3122072145 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fe98c0556b0 con 0x7fe994070480 2023-11-28T20:54:22.759 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:54:22.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe980066420 msgr2=0x7fe9800688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe980066420 0x7fe9800688e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe984001c00 tx=0x7fe984009040 comp rx=0 tx=0).stop 2023-11-28T20:54:22.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe994070480 msgr2=0x7fe994141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:22.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe994070480 0x7fe994141a60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00bd90 tx=0x7fe98c009eb0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 shutdown_connections 2023-11-28T20:54:22.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe980066420 0x7fe9800688e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe994070480 0x7fe994141a60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe99406e410 0x7fe994146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 --2- 172.21.15.167:0/3122072145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe99406e030 0x7fe99415a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:22.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 >> 172.21.15.167:0/3122072145 conn(0x7fe9940cb1e0 msgr2=0x7fe9940c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:22.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 shutdown_connections 2023-11-28T20:54:22.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:22.762+0000 7fe999cd6640 1 -- 172.21.15.167:0/3122072145 wait complete. 2023-11-28T20:54:25.785 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:54:25.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.954+0000 7f780bb57640 1 Processor -- start 2023-11-28T20:54:25.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.954+0000 7f780bb57640 1 -- start start 2023-11-28T20:54:25.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.954+0000 7f780bb57640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f780406a580 0x7f780406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:25.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.954+0000 7f780bb57640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780415ada0 con 0x7f780415d770 2023-11-28T20:54:25.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.954+0000 7f780bb57640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7804159f40 con 0x7f7804153fa0 2023-11-28T20:54:25.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.954+0000 7f780bb57640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780415a220 con 0x7f780406a580 2023-11-28T20:54:25.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.954+0000 7f78090f2640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f780415d770 legacy=0x7f780415dbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:54:25.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.958+0000 7f780a0f4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f780406a580 0x7f780406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:25.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.958+0000 7f780a0f4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f780406a580 0x7f780406a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:34076/0 (socket says 172.21.15.167:34076) 2023-11-28T20:54:25.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.958+0000 7f780a0f4640 1 -- 172.21.15.167:0/3094130780 learned_addr learned my addr 172.21.15.167:0/3094130780 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.958+0000 7f780a0f4640 1 -- 172.21.15.167:0/3094130780 >> v1:172.21.15.178:6789/0 conn(0x7f7804153fa0 legacy=0x7f78040c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.958+0000 7f780a0f4640 1 -- 172.21.15.167:0/3094130780 >> v1:172.21.15.167:6789/0 conn(0x7f780415d770 legacy=0x7f780415dbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:25.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.958+0000 7f780a0f4640 1 -- 172.21.15.167:0/3094130780 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780415a500 con 0x7f780406a580 2023-11-28T20:54:25.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.958+0000 7f780a0f4640 1 --2- 172.21.15.167:0/3094130780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780406a580 0x7f780406a9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009e80 tx=0x7f77fc01c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b02f90ed44f08b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:25.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f78088f1640 1 -- 172.21.15.167:0/3094130780 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0a5840 con 0x7f780406a580 2023-11-28T20:54:25.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f78088f1640 1 -- 172.21.15.167:0/3094130780 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0a59a0 con 0x7f780406a580 2023-11-28T20:54:25.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f78088f1640 1 -- 172.21.15.167:0/3094130780 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0a5d30 con 0x7f780406a580 2023-11-28T20:54:25.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f780bb57640 1 -- 172.21.15.167:0/3094130780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780406a580 msgr2=0x7f780406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:25.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f780bb57640 1 --2- 172.21.15.167:0/3094130780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780406a580 0x7f780406a9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009e80 tx=0x7f77fc01c980 comp rx=0 tx=0).stop 2023-11-28T20:54:25.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f780bb57640 1 -- 172.21.15.167:0/3094130780 shutdown_connections 2023-11-28T20:54:25.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f780bb57640 1 --2- 172.21.15.167:0/3094130780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780406a580 0x7f780406a9f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:25.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f780bb57640 1 -- 172.21.15.167:0/3094130780 >> 172.21.15.167:0/3094130780 conn(0x7f78040cb1e0 msgr2=0x7f78040cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:25.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f780bb57640 1 -- 172.21.15.167:0/3094130780 shutdown_connections 2023-11-28T20:54:25.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f780bb57640 1 -- 172.21.15.167:0/3094130780 wait complete. 2023-11-28T20:54:25.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f780bb57640 1 Processor -- start 2023-11-28T20:54:25.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.962+0000 7f780bb57640 1 -- start start 2023-11-28T20:54:25.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780bb57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780406a580 0x7f78041f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:25.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780bb57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7804153fa0 0x7f78040c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:25.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780bb57640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780415d770 0x7f78040c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:25.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780bb57640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78041f6ec0 con 0x7f780406a580 2023-11-28T20:54:25.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780bb57640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7804158ca0 con 0x7f780415d770 2023-11-28T20:54:25.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780bb57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7804159130 con 0x7f7804153fa0 2023-11-28T20:54:25.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f78098f3640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780406a580 msgr2=0x7f78041f6980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:25.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f78098f3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780406a580 0x7f78041f6980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:25.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780a0f4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780415d770 0x7f78040c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780a0f4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780415d770 0x7f78040c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:34082/0 (socket says 172.21.15.167:34082) 2023-11-28T20:54:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780a0f4640 1 -- 172.21.15.167:0/4108239699 learned_addr learned my addr 172.21.15.167:0/4108239699 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f78090f2640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7804153fa0 0x7f78040c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780a0f4640 1 -- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7804153fa0 msgr2=0x7f78040c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780a0f4640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7804153fa0 0x7f78040c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780a0f4640 1 -- 172.21.15.167:0/4108239699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780406a580 msgr2=0x7f78041f6980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:54:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780a0f4640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780406a580 0x7f78041f6980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780a0f4640 1 -- 172.21.15.167:0/4108239699 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc009b30 con 0x7f780415d770 2023-11-28T20:54:25.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780a0f4640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780415d770 0x7f78040c8fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f77fc019590 tx=0x7f77fc019720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:25.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f77fa7fc640 1 -- 172.21.15.167:0/4108239699 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0b8670 con 0x7f780415d770 2023-11-28T20:54:25.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f77fa7fc640 1 -- 172.21.15.167:0/4108239699 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0b87f0 con 0x7f780415d770 2023-11-28T20:54:25.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f77fa7fc640 1 -- 172.21.15.167:0/4108239699 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0b8ba0 con 0x7f780415d770 2023-11-28T20:54:25.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7804157db0 con 0x7f780415d770 2023-11-28T20:54:25.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7804158370 con 0x7f780415d770 2023-11-28T20:54:25.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.966+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78040682c0 con 0x7f780415d770 2023-11-28T20:54:25.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.970+0000 7f77fa7fc640 1 -- 172.21.15.167:0/4108239699 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77fc0b8d00 con 0x7f780415d770 2023-11-28T20:54:25.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.970+0000 7f77fa7fc640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f77e8066420 0x7f77e80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:25.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.970+0000 7f77fa7fc640 1 -- 172.21.15.167:0/4108239699 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f77fc120480 con 0x7f780415d770 2023-11-28T20:54:25.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.970+0000 7f78098f3640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f77e8066420 0x7f77e80688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:25.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.970+0000 7f78098f3640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f77e8066420 0x7f77e80688e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7800001040 tx=0x7f7800007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:25.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:25.982+0000 7f77fa7fc640 1 -- 172.21.15.167:0/4108239699 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77fc0ed5c0 con 0x7f780415d770 2023-11-28T20:54:26.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.186+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f780415ada0 con 0x7f780415d770 2023-11-28T20:54:26.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.186+0000 7f77fa7fc640 1 -- 172.21.15.167:0/4108239699 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f780415ada0 con 0x7f780415d770 2023-11-28T20:54:26.187 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:54:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f77e8066420 msgr2=0x7f77e80688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f77e8066420 0x7f77e80688e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7800001040 tx=0x7f7800007a40 comp rx=0 tx=0).stop 2023-11-28T20:54:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780415d770 msgr2=0x7f78040c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:26.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780415d770 0x7f78040c8fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f77fc019590 tx=0x7f77fc019720 comp rx=0 tx=0).stop 2023-11-28T20:54:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 shutdown_connections 2023-11-28T20:54:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f77e8066420 0x7f77e80688e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f780415d770 0x7f78040c8fe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7804153fa0 0x7f78040c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 --2- 172.21.15.167:0/4108239699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f780406a580 0x7f78041f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 >> 172.21.15.167:0/4108239699 conn(0x7f78040cb1e0 msgr2=0x7f78041515a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 shutdown_connections 2023-11-28T20:54:26.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:26.190+0000 7f780bb57640 1 -- 172.21.15.167:0/4108239699 wait complete. 2023-11-28T20:54:29.209 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:54:29.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c7ab2a640 1 Processor -- start 2023-11-28T20:54:29.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c7ab2a640 1 -- start start 2023-11-28T20:54:29.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c7ab2a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c7406e030 0x7f4c741500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:29.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c7ab2a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c74070480 0x7f4c741505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:29.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c7ab2a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c741571d0 con 0x7f4c7406e410 2023-11-28T20:54:29.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c7ab2a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c74071a90 con 0x7f4c74070480 2023-11-28T20:54:29.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c7ab2a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c740c70d0 con 0x7f4c7406e030 2023-11-28T20:54:29.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c6bfff640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f4c74070480 msgr2=0x7f4c741505f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:29.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c6bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c74070480 0x7f4c741505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:29.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c788c6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c7406e030 0x7f4c741500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:29.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c788c6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c7406e030 0x7f4c741500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:34098/0 (socket says 172.21.15.167:34098) 2023-11-28T20:54:29.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.346+0000 7f4c788c6640 1 -- 172.21.15.167:0/1943504058 learned_addr learned my addr 172.21.15.167:0/1943504058 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:29.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.350+0000 7f4c788c6640 1 -- 172.21.15.167:0/1943504058 >> v2:172.21.15.167:3300/0 conn(0x7f4c74070480 msgr2=0x7f4c741505f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:29.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.350+0000 7f4c788c6640 1 --2- 172.21.15.167:0/1943504058 >> v2:172.21.15.167:3300/0 conn(0x7f4c74070480 0x7f4c741505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.350+0000 7f4c788c6640 1 -- 172.21.15.167:0/1943504058 >> v1:172.21.15.178:6789/0 conn(0x7f4c7406e410 legacy=0x7f4c74071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:29.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.350+0000 7f4c788c6640 1 -- 172.21.15.167:0/1943504058 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c740c73b0 con 0x7f4c7406e030 2023-11-28T20:54:29.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.350+0000 7f4c788c6640 1 --2- 172.21.15.167:0/1943504058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e030 0x7f4c741500b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c740cbff0 tx=0x7f4c7001d8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae954c8e5d57ccf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:29.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.350+0000 7f4c6b7fe640 1 -- 172.21.15.167:0/1943504058 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c700a6970 con 0x7f4c7406e030 2023-11-28T20:54:29.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.350+0000 7f4c6b7fe640 1 -- 172.21.15.167:0/1943504058 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c700a6ad0 con 0x7f4c7406e030 2023-11-28T20:54:29.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.350+0000 7f4c6b7fe640 1 -- 172.21.15.167:0/1943504058 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c700a6e60 con 0x7f4c7406e030 2023-11-28T20:54:29.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/1943504058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e030 msgr2=0x7f4c741500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:29.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 --2- 172.21.15.167:0/1943504058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e030 0x7f4c741500b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c740cbff0 tx=0x7f4c7001d8c0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/1943504058 shutdown_connections 2023-11-28T20:54:29.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 --2- 172.21.15.167:0/1943504058 >> v2:172.21.15.167:3300/0 conn(0x7f4c74070480 0x7f4c741505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 --2- 172.21.15.167:0/1943504058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e030 0x7f4c741500b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/1943504058 >> 172.21.15.167:0/1943504058 conn(0x7f4c740cb1e0 msgr2=0x7f4c740cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:29.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/1943504058 shutdown_connections 2023-11-28T20:54:29.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/1943504058 wait complete. 2023-11-28T20:54:29.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 Processor -- start 2023-11-28T20:54:29.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 -- start start 2023-11-28T20:54:29.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7406e030 0x7f4c74150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:29.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e410 0x7f4c74159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:29.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c74070480 0x7f4c7415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:29.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c741510a0 con 0x7f4c7406e030 2023-11-28T20:54:29.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74159880 con 0x7f4c7406e410 2023-11-28T20:54:29.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c7ab2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74158380 con 0x7f4c74070480 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c788c6640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7406e030 msgr2=0x7f4c74150b60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c788c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7406e030 0x7f4c74150b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c6bfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e410 0x7f4c74159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c790c7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c74070480 0x7f4c7415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c790c7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c74070480 0x7f4c7415a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:36826/0 (socket says 172.21.15.167:36826) 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.354+0000 7f4c790c7640 1 -- 172.21.15.167:0/2430944294 learned_addr learned my addr 172.21.15.167:0/2430944294 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c6bfff640 1 -- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c74070480 msgr2=0x7f4c7415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c6bfff640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c74070480 0x7f4c7415a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c6bfff640 1 -- 172.21.15.167:0/2430944294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7406e030 msgr2=0x7f4c74150b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c6bfff640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7406e030 0x7f4c74150b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c6bfff640 1 -- 172.21.15.167:0/2430944294 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7000a670 con 0x7f4c7406e410 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c6bfff640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e410 0x7f4c74159d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400b520 tx=0x7f4c6400b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:29.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c697fa640 1 -- 172.21.15.167:0/2430944294 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64003bd0 con 0x7f4c7406e410 2023-11-28T20:54:29.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c697fa640 1 -- 172.21.15.167:0/2430944294 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c64003d30 con 0x7f4c7406e410 2023-11-28T20:54:29.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c697fa640 1 -- 172.21.15.167:0/2430944294 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64003ea0 con 0x7f4c7406e410 2023-11-28T20:54:29.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c74157dc0 con 0x7f4c7406e410 2023-11-28T20:54:29.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c74159230 con 0x7f4c7406e410 2023-11-28T20:54:29.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.358+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c740682c0 con 0x7f4c7406e410 2023-11-28T20:54:29.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.362+0000 7f4c697fa640 1 -- 172.21.15.167:0/2430944294 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c64005290 con 0x7f4c7406e410 2023-11-28T20:54:29.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.362+0000 7f4c697fa640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c60066420 0x7f4c600688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:29.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.362+0000 7f4c697fa640 1 -- 172.21.15.167:0/2430944294 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4c64084500 con 0x7f4c7406e410 2023-11-28T20:54:29.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.362+0000 7f4c788c6640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c60066420 0x7f4c600688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:29.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.362+0000 7f4c788c6640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c60066420 0x7f4c600688e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c700b0000 tx=0x7f4c70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:29.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.374+0000 7f4c697fa640 1 -- 172.21.15.167:0/2430944294 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c64051700 con 0x7f4c7406e410 2023-11-28T20:54:29.611 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 11% (88/779) Updating files: 12% (94/779) Updating files: 13% (102/779) Updating files: 14% (110/779) Updating files: 15% (117/779) Updating files: 16% (125/779) Updating files: 17% (133/779) Updating files: 18% (141/779) Updating files: 19% (149/779) Updating files: 20% (156/779) Updating files: 21% (164/779) Updating files: 22% (172/779) Updating files: 23% (180/779) Updating files: 24% (187/779) Updating files: 25% (195/779) Updating files: 26% (203/779) Updating files: 27% (211/779) Updating files: 27% (216/779) Updating files: 28% (219/779) Updating files: 29% (226/779) Updating files: 30% (234/779) Updating files: 31% (242/779) Updating files: 32% (250/779) Updating files: 33% (258/779) Updating files: 34% (265/779) Updating files: 35% (273/779) Updating files: 36% (281/779) Updating files: 36% (287/779) Updating files: 37% (289/779) Updating files: 38% (297/779) Updating files: 39% (304/779) Updating files: 40% (312/779) Updating files: 41% (320/779) Updating files: 42% (328/779) Updating files: 43% (335/779) Updating files: 44% (343/779) Updating files: 45% (351/779) Updating files: 46% (359/779) Updating files: 47% (367/779) Updating files: 48% (374/779) Updating files: 49% (382/779) Updating files: 50% (390/779) Updating files: 50% (395/779) Updating files: 51% (398/779) Updating files: 52% (406/779) Updating files: 52% (412/779) Updating files: 53% (413/779) Updating files: 54% (421/779) Updating files: 55% (429/779) Updating files: 56% (437/779) Updating files: 57% (445/779) Updating files: 58% (452/779) Updating files: 59% (460/779) Updating files: 59% (464/779) Updating files: 60% (468/779) Updating files: 61% (476/779) Updating files: 62% (483/779) Updating files: 63% (491/779) Updating files: 64% (499/779) Updating files: 65% (507/779) Updating files: 66% (515/779) Updating files: 67% (522/779) Updating files: 68% (530/779) Updating files: 69% (538/779) Updating files: 70% (546/779) Updating files: 70% (548/779) Updating files: 71% (554/779) Updating files: 72% (561/779) Updating files: 73% (569/779) Updating files: 74% (577/779) Updating files: 75% (585/779) Updating files: 76% (593/779) Updating files: 77% (600/779) Updating files: 78% (608/779) Updating files: 79% (616/779) Updating files: 80% (624/779) Updating files: 81% (631/779) Updating files: 82% (639/779) Updating files: 83% (647/779) Updating files: 84% (655/779) Updating files: 85% (663/779) Updating files: 86% (670/779) Updating files: 86% (673/779) Updating files: 87% (678/779) Updating files: 88% (686/779) Updating files: 89% (694/779) Updating files: 90% (702/779) Updating files: 91% (709/779) Updating files: 92% (717/779) Updating files: 93% (725/779) Updating files: 94% (733/779) Updating files: 95% (741/779) Updating files: 95% (744/779) Updating files: 96% (748/779) Updating files: 97% (756/779) Updating files: 98% (764/779) Updating files: 99% (772/779) Updating files: 100% (779/779) Updating files: 100% (779/779), done. 2023-11-28T20:54:29.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.626+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f4c7406b0c0 con 0x7f4c7406e410 2023-11-28T20:54:29.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.626+0000 7f4c697fa640 1 -- 172.21.15.167:0/2430944294 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f4c64054d20 con 0x7f4c7406e410 2023-11-28T20:54:29.627 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":126,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:54:29.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c60066420 msgr2=0x7f4c600688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:29.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c60066420 0x7f4c600688e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4c700b0000 tx=0x7f4c70008040 comp rx=0 tx=0).stop 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e410 msgr2=0x7f4c74159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e410 0x7f4c74159d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400b520 tx=0x7f4c6400b9e0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 shutdown_connections 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c60066420 0x7f4c600688e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c74070480 0x7f4c7415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c7406e410 0x7f4c74159d10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 --2- 172.21.15.167:0/2430944294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7406e030 0x7f4c74150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 >> 172.21.15.167:0/2430944294 conn(0x7f4c740cb1e0 msgr2=0x7f4c7414e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 shutdown_connections 2023-11-28T20:54:29.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:29.630+0000 7f4c7ab2a640 1 -- 172.21.15.167:0/2430944294 wait complete. 2023-11-28T20:54:29.749 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 2f10137986a v0.18 2023-11-28T20:54:29.752 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.18 2023-11-28T20:54:30.023 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 19 -eq 48 ] 2023-11-28T20:54:30.023 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.19 2023-11-28T20:54:30.023 INFO:tasks.workunit.client.0.smithi167.stdout:v0.19 2023-11-28T20:54:30.023 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.19 2023-11-28T20:54:30.023 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.19 2023-11-28T20:54:32.652 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:54:32.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.878+0000 7f62e8217640 1 Processor -- start 2023-11-28T20:54:32.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.878+0000 7f62e8217640 1 -- start start 2023-11-28T20:54:32.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e8217640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:32.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e8217640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:32.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e8217640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e00c4940 con 0x7f62e00c6ff0 2023-11-28T20:54:32.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e8217640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00c62f0 con 0x7f62e00c4510 2023-11-28T20:54:32.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e8217640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00c6ac0 con 0x7f62e0150b40 2023-11-28T20:54:32.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e57b2640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f62e00c6ff0 legacy=0x7f62e00c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:54:32.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e67b4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e5fb3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e67b4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:58048/0 (socket says 172.21.15.167:58048) 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 learned_addr learned my addr 172.21.15.167:0/2801430967 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 msgr2=0x7f62e006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 msgr2=0x7f62e006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e5fb3640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 msgr2=0x7f62e0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e5fb3640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 msgr2=0x7f62e0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:32.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:32.882+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:33.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e57b2640 1 -- 172.21.15.167:0/2801430967 >> v1:172.21.15.167:6789/0 conn(0x7f62e00c6ff0 legacy=0x7f62e00c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:54:33.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:33.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:33.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e5fb3640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 msgr2=0x7f62e0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:54:33.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 msgr2=0x7f62e006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:54:33.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e5fb3640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 msgr2=0x7f62e0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:33.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 msgr2=0x7f62e006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:33.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:33.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:54:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.086+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:54:33.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e57b2640 1 -- 172.21.15.167:0/2801430967 >> v1:172.21.15.167:6789/0 conn(0x7f62e00c6ff0 legacy=0x7f62e00c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:54:33.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:33.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:33.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e5fb3640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 msgr2=0x7f62e0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:54:33.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e5fb3640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 msgr2=0x7f62e0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:33.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:33.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:54:33.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 msgr2=0x7f62e006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:54:33.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 msgr2=0x7f62e006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:33.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:33.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:33.490+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e57b2640 1 -- 172.21.15.167:0/2801430967 >> v1:172.21.15.167:6789/0 conn(0x7f62e00c6ff0 legacy=0x7f62e00c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e5fb3640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 msgr2=0x7f62e0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 msgr2=0x7f62e006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 msgr2=0x7f62e006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e5fb3640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 msgr2=0x7f62e0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:54:34.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:34.294+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:54:35.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62d77fe640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 msgr2=0x7f62e0157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:35.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62d77fe640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62e0150b40 0x7f62e0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:35.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62d77fe640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 msgr2=0x7f62e006a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:35.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62d77fe640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.178:3300/0 conn(0x7f62e00c4510 0x7f62e006a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:35.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62d77fe640 1 -- 172.21.15.167:0/2801430967 >> v1:172.21.15.167:6789/0 conn(0x7f62e00c6ff0 legacy=0x7f62e00c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:35.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62d77fe640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.167:3300/0 conn(0x7f62c4007340 0x7f62c4009800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:35.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62d77fe640 1 -- 172.21.15.167:0/2801430967 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e00c6500 con 0x7f62c4003690 2023-11-28T20:54:35.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62d77fe640 1 -- 172.21.15.167:0/2801430967 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00c62f0 con 0x7f62c4007340 2023-11-28T20:54:35.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62e57b2640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.167:3300/0 conn(0x7f62c4007340 msgr2=0x7f62c4009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:35.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:35.882+0000 7f62e57b2640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.167:3300/0 conn(0x7f62c4007340 0x7f62c4009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:36.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.086+0000 7f62e57b2640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.167:3300/0 conn(0x7f62c4007340 msgr2=0x7f62c4009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:36.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.086+0000 7f62e57b2640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.167:3300/0 conn(0x7f62c4007340 0x7f62c4009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:54:36.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.490+0000 7f62e57b2640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.167:3300/0 conn(0x7f62c4007340 msgr2=0x7f62c4009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:36.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.490+0000 7f62e57b2640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.167:3300/0 conn(0x7f62c4007340 0x7f62c4009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:54:36.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.746+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089219074 0 0) 0x7f62e00c6500 con 0x7f62c4003690 2023-11-28T20:54:36.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.746+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62cc003530 con 0x7f62c4003690 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3848338663 0 0) 0x7f62cc003530 con 0x7f62c4003690 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 >> v2:172.21.15.167:3300/0 conn(0x7f62c4007340 msgr2=0x7f62c4009800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 --2- 172.21.15.167:0/2801430967 >> v2:172.21.15.167:3300/0 conn(0x7f62c4007340 0x7f62c4009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00c4940 con 0x7f62c4003690 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f62dc00e510 con 0x7f62c4003690 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 >> v1:172.21.15.178:6789/0 conn(0x7f62c4003690 legacy=0x7f62c4005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e67b4640 1 -- 172.21.15.167:0/2801430967 reap_dead start 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc003980 0x7f62cc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc0047d0 0x7f62cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0052b0 0x7f62cc00fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00c62f0 con 0x7f62cc003980 2023-11-28T20:54:36.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc010610 con 0x7f62cc0047d0 2023-11-28T20:54:36.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc0107d0 con 0x7f62cc0052b0 2023-11-28T20:54:36.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e5fb3640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc003980 msgr2=0x7f62cc003d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:36.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc003980 0x7f62cc003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:36.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e57b2640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc0047d0 0x7f62cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:36.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e67b4640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0052b0 0x7f62cc00fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:36.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e57b2640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0052b0 msgr2=0x7f62cc00fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:36.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e57b2640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0052b0 0x7f62cc00fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e57b2640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc003980 msgr2=0x7f62cc003d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:36.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e57b2640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc003980 0x7f62cc003d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.750+0000 7f62e57b2640 1 -- 172.21.15.167:0/2801430967 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc003530 con 0x7f62cc0047d0 2023-11-28T20:54:36.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.754+0000 7f62e57b2640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc0047d0 0x7f62cc004c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62d0003990 tx=0x7f62d001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60057ca4905fdfca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:36.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.754+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d00a5840 con 0x7f62cc0047d0 2023-11-28T20:54:36.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.754+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d00a59a0 con 0x7f62cc0047d0 2023-11-28T20:54:36.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.754+0000 7f62e4fb1640 1 -- 172.21.15.167:0/2801430967 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d00a5d50 con 0x7f62cc0047d0 2023-11-28T20:54:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.754+0000 7f62e8217640 1 -- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc0047d0 msgr2=0x7f62cc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.754+0000 7f62e8217640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc0047d0 0x7f62cc004c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62d0003990 tx=0x7f62d001c950 comp rx=0 tx=0).stop 2023-11-28T20:54:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 -- 172.21.15.167:0/2801430967 shutdown_connections 2023-11-28T20:54:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0052b0 0x7f62cc00fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc0047d0 0x7f62cc004c50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 --2- 172.21.15.167:0/2801430967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc003980 0x7f62cc003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 -- 172.21.15.167:0/2801430967 >> 172.21.15.167:0/2801430967 conn(0x7f62e00cb1e0 msgr2=0x7f62e00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:36.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 -- 172.21.15.167:0/2801430967 shutdown_connections 2023-11-28T20:54:36.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 -- 172.21.15.167:0/2801430967 wait complete. 2023-11-28T20:54:36.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 Processor -- start 2023-11-28T20:54:36.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 -- start start 2023-11-28T20:54:36.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc003980 0x7f62e01511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:36.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0047d0 0x7f62e014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:36.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc0052b0 0x7f62e01ee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e01f2660 con 0x7f62cc0052b0 2023-11-28T20:54:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0151710 con 0x7f62cc003980 2023-11-28T20:54:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e8217640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e01f1ae0 con 0x7f62cc0047d0 2023-11-28T20:54:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e67b4640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc0052b0 msgr2=0x7f62e01ee8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.758+0000 7f62e67b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc0052b0 0x7f62e01ee8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e5fb3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc003980 0x7f62e01511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e5fb3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc003980 0x7f62e01511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:58098/0 (socket says 172.21.15.167:58098) 2023-11-28T20:54:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e5fb3640 1 -- 172.21.15.167:0/248077218 learned_addr learned my addr 172.21.15.167:0/248077218 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e57b2640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0047d0 0x7f62e014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:36.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e5fb3640 1 -- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0047d0 msgr2=0x7f62e014ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:36.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0047d0 0x7f62e014ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e5fb3640 1 -- 172.21.15.167:0/248077218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc0052b0 msgr2=0x7f62e01ee8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:54:36.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc0052b0 0x7f62e01ee8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e5fb3640 1 -- 172.21.15.167:0/248077218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e01f1dc0 con 0x7f62cc003980 2023-11-28T20:54:36.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e5fb3640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc003980 0x7f62e01511d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f62dc013a10 tx=0x7f62dc013ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:36.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62d67fc640 1 -- 172.21.15.167:0/248077218 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc011a20 con 0x7f62cc003980 2023-11-28T20:54:36.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e01f20a0 con 0x7f62cc003980 2023-11-28T20:54:36.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.762+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e01ee3b0 con 0x7f62cc003980 2023-11-28T20:54:36.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.766+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e00682c0 con 0x7f62cc003980 2023-11-28T20:54:36.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.766+0000 7f62d67fc640 1 -- 172.21.15.167:0/248077218 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc00c040 con 0x7f62cc003980 2023-11-28T20:54:36.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.766+0000 7f62d67fc640 1 -- 172.21.15.167:0/248077218 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc011d80 con 0x7f62cc003980 2023-11-28T20:54:36.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.770+0000 7f62d67fc640 1 -- 172.21.15.167:0/248077218 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62dc029480 con 0x7f62cc003980 2023-11-28T20:54:36.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.770+0000 7f62d67fc640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62c4066aa0 0x7f62c4068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:36.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.770+0000 7f62d67fc640 1 -- 172.21.15.167:0/248077218 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f62dc084c40 con 0x7f62cc003980 2023-11-28T20:54:36.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.770+0000 7f62e57b2640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62c4066aa0 0x7f62c4068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:36.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.770+0000 7f62e57b2640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62c4066aa0 0x7f62c4068f60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f62d00ad000 tx=0x7f62d0005040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:36.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.786+0000 7f62d67fc640 1 -- 172.21.15.167:0/248077218 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62dc051d80 con 0x7f62cc003980 2023-11-28T20:54:36.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f62e01ee210 con 0x7f62cc003980 2023-11-28T20:54:36.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62d67fc640 1 -- 172.21.15.167:0/248077218 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f62e01ee210 con 0x7f62cc003980 2023-11-28T20:54:36.990 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":128,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:54:36.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62c4066aa0 msgr2=0x7f62c4068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:36.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62c4066aa0 0x7f62c4068f60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f62d00ad000 tx=0x7f62d0005040 comp rx=0 tx=0).stop 2023-11-28T20:54:36.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc003980 msgr2=0x7f62e01511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:36.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc003980 0x7f62e01511d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f62dc013a10 tx=0x7f62dc013ed0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 shutdown_connections 2023-11-28T20:54:36.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f62c4066aa0 0x7f62c4068f60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62cc0052b0 0x7f62e01ee8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc0047d0 0x7f62e014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 --2- 172.21.15.167:0/248077218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc003980 0x7f62e01511d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.990+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 >> 172.21.15.167:0/248077218 conn(0x7f62e00cb1e0 msgr2=0x7f62e0071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.994+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 shutdown_connections 2023-11-28T20:54:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:36.994+0000 7f62e8217640 1 -- 172.21.15.167:0/248077218 wait complete. 2023-11-28T20:54:37.011 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:54:37.011 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:54:37.012 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:54:37.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.150+0000 7fec1edf5640 1 Processor -- start 2023-11-28T20:54:37.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.150+0000 7fec1edf5640 1 -- start start 2023-11-28T20:54:37.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.150+0000 7fec1edf5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec180c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.150+0000 7fec1edf5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1815b220 con 0x7fec1806a580 2023-11-28T20:54:37.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.150+0000 7fec1edf5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec180c60f0 con 0x7fec180c5c90 2023-11-28T20:54:37.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.150+0000 7fec1edf5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec180c4da0 con 0x7fec18151f60 2023-11-28T20:54:37.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.150+0000 7fec1d392640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fec1806a580 legacy=0x7fec181625b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:54:37.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.154+0000 7fec1cb91640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec180c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.154+0000 7fec0ffff640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fec180c5c90 0x7fec180c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:52182/0 (socket says 172.21.15.167:52182) 2023-11-28T20:54:37.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.154+0000 7fec0ffff640 1 -- 172.21.15.167:0/4087171559 learned_addr learned my addr 172.21.15.167:0/4087171559 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:54:37.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.154+0000 7fec0f7fe640 1 -- 172.21.15.167:0/4087171559 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629997249 0 0) 0x7fec180c60f0 con 0x7fec180c5c90 2023-11-28T20:54:37.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.154+0000 7fec0f7fe640 1 -- 172.21.15.167:0/4087171559 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec00003530 con 0x7fec180c5c90 2023-11-28T20:54:37.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.154+0000 7fec1cb91640 1 -- 172.21.15.167:0/4087171559 >> v1:172.21.15.178:6789/0 conn(0x7fec180c5c90 legacy=0x7fec180c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.154+0000 7fec1cb91640 1 -- 172.21.15.167:0/4087171559 >> v1:172.21.15.167:6789/0 conn(0x7fec1806a580 legacy=0x7fec181625b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:37.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.154+0000 7fec1cb91640 1 -- 172.21.15.167:0/4087171559 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18152340 con 0x7fec18151f60 2023-11-28T20:54:37.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.154+0000 7fec1cb91640 1 --2- 172.21.15.167:0/4087171559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec180c75c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec140097f0 tx=0x7fec1401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74203c1f90173ef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec0f7fe640 1 -- 172.21.15.167:0/4087171559 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140ab600 con 0x7fec18151f60 2023-11-28T20:54:37.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec0f7fe640 1 -- 172.21.15.167:0/4087171559 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec140a7050 con 0x7fec18151f60 2023-11-28T20:54:37.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec0f7fe640 1 -- 172.21.15.167:0/4087171559 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140ab980 con 0x7fec18151f60 2023-11-28T20:54:37.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 -- 172.21.15.167:0/4087171559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 msgr2=0x7fec180c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 --2- 172.21.15.167:0/4087171559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec180c75c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec140097f0 tx=0x7fec1401c3f0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 -- 172.21.15.167:0/4087171559 shutdown_connections 2023-11-28T20:54:37.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 --2- 172.21.15.167:0/4087171559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec180c75c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 -- 172.21.15.167:0/4087171559 >> 172.21.15.167:0/4087171559 conn(0x7fec180cb1e0 msgr2=0x7fec180cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:37.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 -- 172.21.15.167:0/4087171559 shutdown_connections 2023-11-28T20:54:37.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 -- 172.21.15.167:0/4087171559 wait complete. 2023-11-28T20:54:37.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 Processor -- start 2023-11-28T20:54:37.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 -- start start 2023-11-28T20:54:37.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1806a580 0x7fec181574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.158+0000 7fec1edf5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec180c5c90 0x7fec18156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1edf5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec18070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1edf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec181f3790 con 0x7fec1806a580 2023-11-28T20:54:37.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1edf5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec180707f0 con 0x7fec180c5c90 2023-11-28T20:54:37.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1edf5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec18157a20 con 0x7fec18151f60 2023-11-28T20:54:37.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1cb91640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1806a580 msgr2=0x7fec181574e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:37.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1cb91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1806a580 0x7fec181574e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:37.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1d392640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec18070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec0ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec180c5c90 0x7fec18156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1d392640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec18070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:50372/0 (socket says 172.21.15.167:50372) 2023-11-28T20:54:37.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1d392640 1 -- 172.21.15.167:0/2943107926 learned_addr learned my addr 172.21.15.167:0/2943107926 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:37.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1d392640 1 -- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec180c5c90 msgr2=0x7fec18156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1d392640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec180c5c90 0x7fec18156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1d392640 1 -- 172.21.15.167:0/2943107926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1806a580 msgr2=0x7fec181574e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:54:37.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1d392640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1806a580 0x7fec181574e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1d392640 1 -- 172.21.15.167:0/2943107926 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14009420 con 0x7fec18151f60 2023-11-28T20:54:37.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1d392640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec18070c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec1000be80 tx=0x7fec1000beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10016430 con 0x7fec18151f60 2023-11-28T20:54:37.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10016590 con 0x7fec18151f60 2023-11-28T20:54:37.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10016940 con 0x7fec18151f60 2023-11-28T20:54:37.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec181f2c10 con 0x7fec18151f60 2023-11-28T20:54:37.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec181f31d0 con 0x7fec18151f60 2023-11-28T20:54:37.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1edf5640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec181485a0 0x7fec180711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18074770 con 0x7fec181485a0 2023-11-28T20:54:37.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1cb91640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec181485a0 0x7fec180711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.162+0000 7fec1cb91640 1 -- 172.21.15.167:0/2943107926 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec180c55f0 con 0x7fec181485a0 2023-11-28T20:54:37.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec1cb91640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec181485a0 0x7fec180711c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fec18158660 tx=0x7fec1401ac30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140ab8d0 con 0x7fec181485a0 2023-11-28T20:54:37.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec10012020 con 0x7fec18151f60 2023-11-28T20:54:37.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0d7fa640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fec04066540 0x7fec04068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fec100843a0 con 0x7fec18151f60 2023-11-28T20:54:37.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fec14004020 con 0x7fec181485a0 2023-11-28T20:54:37.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec181485a0 msgr2=0x7fec180711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0d7fa640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec181485a0 0x7fec180711c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fec18158660 tx=0x7fec1401ac30 comp rx=0 tx=0).stop 2023-11-28T20:54:37.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec181485a0 msgr2=0x7fec180711c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:37.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0d7fa640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec181485a0 0x7fec180711c0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fec18158660 tx=0x7fec1401ac30 comp rx=0 tx=0).stop 2023-11-28T20:54:37.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0ffff640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fec04066540 0x7fec04068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.166+0000 7fec0ffff640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fec04066540 0x7fec04068a00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fec18072660 tx=0x7fec08007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.170+0000 7fec1edf5640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec18140900 0x7fec18140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.170+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1815ba30 con 0x7fec18140900 2023-11-28T20:54:37.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1cb91640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec18140900 0x7fec18140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1cb91640 1 -- 172.21.15.167:0/2943107926 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fec1815bf50 con 0x7fec18140900 2023-11-28T20:54:37.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1cb91640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec18140900 0x7fec18140d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec1401aaa0 tx=0x7fec14019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec14003820 con 0x7fec18140900 2023-11-28T20:54:37.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4631 (secure 0 0 0) 0x7fec14003980 con 0x7fec18140900 2023-11-28T20:54:37.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec18140900 msgr2=0x7fec18140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec0d7fa640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec18140900 0x7fec18140d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec1401aaa0 tx=0x7fec14019190 comp rx=0 tx=0).stop 2023-11-28T20:54:37.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec0d7fa640 1 -- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec18140900 msgr2=0x7fec18140d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:37.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec0d7fa640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec18140900 0x7fec18140d10 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec1401aaa0 tx=0x7fec14019190 comp rx=0 tx=0).stop 2023-11-28T20:54:37.175 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:54:37.175 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:54:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 128, 2023-11-28T20:54:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:54:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:54:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:54:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:54:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:37.177 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:37.178 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:37.179 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:54:37.180 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.181 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.182 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:37.184 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.185 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:54:37.186 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:54:37.187 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:37.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:54:37.189 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:54:37.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fec04066540 msgr2=0x7fec04068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1edf5640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fec04066540 0x7fec04068a00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fec18072660 tx=0x7fec08007d40 comp rx=0 tx=0).stop 2023-11-28T20:54:37.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 msgr2=0x7fec18070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1edf5640 1 --2- 172.21.15.167:0/2943107926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec18151f60 0x7fec18070c80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec1000be80 tx=0x7fec1000beb0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1d392640 1 -- 172.21.15.167:0/2943107926 reap_dead start 2023-11-28T20:54:37.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1d392640 1 -- 172.21.15.167:0/2943107926 reap_dead start 2023-11-28T20:54:37.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 shutdown_connections 2023-11-28T20:54:37.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 >> 172.21.15.167:0/2943107926 conn(0x7fec180cb1e0 msgr2=0x7fec18150780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:37.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 shutdown_connections 2023-11-28T20:54:37.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.174+0000 7fec1edf5640 1 -- 172.21.15.167:0/2943107926 wait complete. 2023-11-28T20:54:37.192 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:54:37.193 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:54:37.193 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:54:37.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.330+0000 7f80bf4d6640 1 Processor -- start 2023-11-28T20:54:37.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.330+0000 7f80bf4d6640 1 -- start start 2023-11-28T20:54:37.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bf4d6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80b8070480 0x7f80b8071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bf4d6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b81571d0 con 0x7f80b806e030 2023-11-28T20:54:37.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bf4d6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b8071a90 con 0x7f80b806e410 2023-11-28T20:54:37.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bf4d6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b80c70d0 con 0x7f80b8070480 2023-11-28T20:54:37.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bca71640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f80b8070480 msgr2=0x7f80b8071f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:37.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bd272640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f80b806e030 legacy=0x7f80b81500b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:54:37.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bca71640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80b8070480 0x7f80b8071f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:37.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bda73640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f80b806e410 0x7f80b8160b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:52196/0 (socket says 172.21.15.167:52196) 2023-11-28T20:54:37.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bda73640 1 -- 172.21.15.167:0/2098132986 learned_addr learned my addr 172.21.15.167:0/2098132986 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:54:37.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008829604 0 0) 0x7f80b8071a90 con 0x7f80b806e410 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a4003450 con 0x7f80b806e410 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3396574197 0 0) 0x7f80a4003450 con 0x7f80b806e410 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 >> v2:172.21.15.167:3300/0 conn(0x7f80b8070480 msgr2=0x7f80b8071f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 --2- 172.21.15.167:0/2098132986 >> v2:172.21.15.167:3300/0 conn(0x7f80b8070480 0x7f80b8071f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 >> v1:172.21.15.167:6789/0 conn(0x7f80b806e030 legacy=0x7f80b81500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80c73b0 con 0x7f80b806e410 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f80b0001a00 con 0x7f80b806e410 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 >> v1:172.21.15.178:6789/0 conn(0x7f80b806e410 legacy=0x7f80b8160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a4003a70 0x7f80a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a4008960 0x7f80a400adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a400b5b0 0x7f80a400da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c70d0 con 0x7f80a4008960 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a400e350 con 0x7f80a4003a70 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a400e510 con 0x7f80a400b5b0 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bca71640 1 -- 172.21.15.167:0/2098132986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a4008960 msgr2=0x7f80a400adb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bca71640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a4008960 0x7f80a400adb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bd272640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a4003a70 0x7f80a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bda73640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a400b5b0 0x7f80a400da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bd272640 1 -- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a400b5b0 msgr2=0x7f80a400da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bd272640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a400b5b0 0x7f80a400da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bd272640 1 -- 172.21.15.167:0/2098132986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a4008960 msgr2=0x7f80a400adb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bd272640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80a4008960 0x7f80a400adb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bd272640 1 -- 172.21.15.167:0/2098132986 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a4003450 con 0x7f80a4003a70 2023-11-28T20:54:37.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.334+0000 7f80bda73640 1 -- 172.21.15.167:0/2098132986 reap_dead start 2023-11-28T20:54:37.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80bd272640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a4003a70 0x7f80a4003e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f80b4003990 tx=0x7f80b401c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aa2465a5ce954b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4003bc0 con 0x7f80a4003a70 2023-11-28T20:54:37.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b40a7070 con 0x7f80a4003a70 2023-11-28T20:54:37.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80affff640 1 -- 172.21.15.167:0/2098132986 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4005070 con 0x7f80a4003a70 2023-11-28T20:54:37.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80bf4d6640 1 -- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a4003a70 msgr2=0x7f80a4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80bf4d6640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a4003a70 0x7f80a4003e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f80b4003990 tx=0x7f80b401c420 comp rx=0 tx=0).stop 2023-11-28T20:54:37.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80bf4d6640 1 -- 172.21.15.167:0/2098132986 shutdown_connections 2023-11-28T20:54:37.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80bf4d6640 1 --2- 172.21.15.167:0/2098132986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80a4003a70 0x7f80a4003e70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80bf4d6640 1 -- 172.21.15.167:0/2098132986 >> 172.21.15.167:0/2098132986 conn(0x7f80b80cb1e0 msgr2=0x7f80b80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:37.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80bf4d6640 1 -- 172.21.15.167:0/2098132986 shutdown_connections 2023-11-28T20:54:37.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.338+0000 7f80bf4d6640 1 -- 172.21.15.167:0/2098132986 wait complete. 2023-11-28T20:54:37.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bf4d6640 1 Processor -- start 2023-11-28T20:54:37.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bf4d6640 1 -- start start 2023-11-28T20:54:37.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bf4d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a4003a70 0x7f80b814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bf4d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b814dd50 0x7f80b80ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bf4d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b80ca740 0x7f80b81f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bf4d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c9d70 con 0x7f80b814dd50 2023-11-28T20:54:37.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bf4d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80cabc0 con 0x7f80b80ca740 2023-11-28T20:54:37.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bf4d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b81f34e0 con 0x7f80a4003a70 2023-11-28T20:54:37.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bca71640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b814dd50 msgr2=0x7f80b80ca200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:54:37.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bca71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b814dd50 0x7f80b80ca200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:37.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bd272640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a4003a70 0x7f80b814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bda73640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b80ca740 0x7f80b81f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bd272640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a4003a70 0x7f80b814d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:50388/0 (socket says 172.21.15.167:50388) 2023-11-28T20:54:37.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.342+0000 7f80bd272640 1 -- 172.21.15.167:0/3447398210 learned_addr learned my addr 172.21.15.167:0/3447398210 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:37.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bd272640 1 -- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b80ca740 msgr2=0x7f80b81f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bd272640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b80ca740 0x7f80b81f2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bd272640 1 -- 172.21.15.167:0/3447398210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b814dd50 msgr2=0x7f80b80ca200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bd272640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80b814dd50 0x7f80b80ca200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bd272640 1 -- 172.21.15.167:0/3447398210 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80c9160 con 0x7f80a4003a70 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bd272640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a4003a70 0x7f80b814d810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80b4097d20 tx=0x7f80a4003700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b40b2070 con 0x7f80a4003a70 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b80c9440 con 0x7f80a4003a70 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b40052f0 con 0x7f80a4003a70 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4005660 con 0x7f80a4003a70 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b80c9a00 con 0x7f80a4003a70 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bf4d6640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81f2db0 0x7f80b8140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b8074770 con 0x7f80b81f2db0 2023-11-28T20:54:37.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bca71640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81f2db0 0x7f80b8140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bca71640 1 -- 172.21.15.167:0/3447398210 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80b806b4b0 con 0x7f80b81f2db0 2023-11-28T20:54:37.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80b40a9020 con 0x7f80a4003a70 2023-11-28T20:54:37.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.346+0000 7f80bca71640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81f2db0 0x7f80b8140ca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80b80c4230 tx=0x7f80a800b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80adffb640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f809c066450 0x7f809c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f80b411d500 con 0x7f80a4003a70 2023-11-28T20:54:37.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8003e60 con 0x7f80b81f2db0 2023-11-28T20:54:37.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f80a8005070 con 0x7f80b81f2db0 2023-11-28T20:54:37.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81f2db0 msgr2=0x7f80b8140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80adffb640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81f2db0 0x7f80b8140ca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f80b80c4230 tx=0x7f80a800b8c0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81f2db0 msgr2=0x7f80b8140ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:37.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80adffb640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81f2db0 0x7f80b8140ca0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80bda73640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f809c066450 0x7f809c068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.350+0000 7f80bda73640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f809c066450 0x7f809c068910 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f80b806e7f0 tx=0x7f80b0001800 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.354+0000 7f80bf4d6640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81411e0 0x7f80b81ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:37.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.354+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c9ee0 con 0x7f80b81411e0 2023-11-28T20:54:37.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.354+0000 7f80bca71640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81411e0 0x7f80b81ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:37.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.354+0000 7f80bca71640 1 -- 172.21.15.167:0/3447398210 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f80b8071720 con 0x7f80b81411e0 2023-11-28T20:54:37.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bca71640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81411e0 0x7f80b81ef0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80a8011000 tx=0x7f80a8005a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:37.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8020070 con 0x7f80b81411e0 2023-11-28T20:54:37.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5112 (secure 0 0 0) 0x7f80a8005870 con 0x7f80b81411e0 2023-11-28T20:54:37.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81411e0 msgr2=0x7f80b81ef0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80adffb640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81411e0 0x7f80b81ef0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80a8011000 tx=0x7f80a8005a70 comp rx=0 tx=0).stop 2023-11-28T20:54:37.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80adffb640 1 -- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81411e0 msgr2=0x7f80b81ef0a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:54:37.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80adffb640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80b81411e0 0x7f80b81ef0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:37.358 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:54:37.358 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:37.358 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:37.358 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:54:37.358 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 128, 2023-11-28T20:54:37.358 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:54:37.358 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:37.359 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:54:37.361 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:54:37.362 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:54:37.362 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:37.362 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:54:37.362 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:54:37.362 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:54:37.362 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:54:37.362 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:54:37.363 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:54:37.364 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:54:37.365 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:37.365 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:37.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.365 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:37.365 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:54:37.365 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.365 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.365 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:37.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.367 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:37.368 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:54:37.368 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.368 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.368 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.368 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:54:37.368 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:54:37.368 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:37.368 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:37.369 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:37.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.369 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:54:37.369 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:54:37.369 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:54:37.369 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:54:37.369 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.369 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.371 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:54:37.371 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:54:37.371 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:54:37.371 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:54:37.371 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:54:37.371 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.371 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.372 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:54:37.372 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:54:37.373 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:54:37.374 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:54:37.375 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:54:37.376 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:54:37.376 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:54:37.376 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:54:37.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:54:37.376 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:54:37.376 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:54:37.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f809c066450 msgr2=0x7f809c068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bf4d6640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f809c066450 0x7f809c068910 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f80b806e7f0 tx=0x7f80b0001800 comp rx=0 tx=0).stop 2023-11-28T20:54:37.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a4003a70 msgr2=0x7f80b814d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:37.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bf4d6640 1 --2- 172.21.15.167:0/3447398210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80a4003a70 0x7f80b814d810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80b4097d20 tx=0x7f80a4003700 comp rx=0 tx=0).stop 2023-11-28T20:54:37.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bda73640 1 -- 172.21.15.167:0/3447398210 reap_dead start 2023-11-28T20:54:37.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bda73640 1 -- 172.21.15.167:0/3447398210 reap_dead start 2023-11-28T20:54:37.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 shutdown_connections 2023-11-28T20:54:37.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 >> 172.21.15.167:0/3447398210 conn(0x7f80b80cb1e0 msgr2=0x7f80b80c4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:37.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 shutdown_connections 2023-11-28T20:54:37.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:37.358+0000 7f80bf4d6640 1 -- 172.21.15.167:0/3447398210 wait complete. 2023-11-28T20:54:37.378 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:54:37.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:54:39.571 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 24% (54/217) Updating files: 25% (55/217) Updating files: 26% (57/217) Updating files: 27% (59/217) Updating files: 28% (61/217) Updating files: 29% (63/217) Updating files: 30% (66/217) Updating files: 31% (68/217) Updating files: 32% (70/217) Updating files: 33% (72/217) Updating files: 34% (74/217) Updating files: 35% (76/217) Updating files: 36% (79/217) Updating files: 37% (81/217) Updating files: 38% (83/217) Updating files: 39% (85/217) Updating files: 40% (87/217) Updating files: 41% (89/217) Updating files: 42% (92/217) Updating files: 43% (94/217) Updating files: 44% (96/217) Updating files: 45% (98/217) Updating files: 46% (100/217) Updating files: 47% (102/217) Updating files: 48% (105/217) Updating files: 49% (107/217) Updating files: 50% (109/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 69% (151/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 86% (187/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2023-11-28T20:54:39.914 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 98f5be53f85 v0.19 2023-11-28T20:54:39.919 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.19 2023-11-28T20:54:39.947 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 20 -eq 48 ] 2023-11-28T20:54:39.948 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.20 2023-11-28T20:54:39.948 INFO:tasks.workunit.client.0.smithi167.stdout:v0.20 2023-11-28T20:54:39.948 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.20 2023-11-28T20:54:39.948 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.20 2023-11-28T20:54:44.760 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 9% (24/245) Updating files: 10% (25/245) Updating files: 11% (27/245) Updating files: 12% (30/245) Updating files: 13% (32/245) Updating files: 14% (35/245) Updating files: 15% (37/245) Updating files: 16% (40/245) Updating files: 17% (42/245) Updating files: 18% (45/245) Updating files: 19% (47/245) Updating files: 20% (49/245) Updating files: 21% (52/245) Updating files: 22% (54/245) Updating files: 23% (57/245) Updating files: 24% (59/245) Updating files: 25% (62/245) Updating files: 26% (64/245) Updating files: 27% (67/245) Updating files: 28% (69/245) Updating files: 29% (72/245) Updating files: 30% (74/245) Updating files: 31% (76/245) Updating files: 32% (79/245) Updating files: 33% (81/245) Updating files: 34% (84/245) Updating files: 35% (86/245) Updating files: 36% (89/245) Updating files: 37% (91/245) Updating files: 37% (92/245) Updating files: 38% (94/245) Updating files: 39% (96/245) Updating files: 40% (98/245) Updating files: 41% (101/245) Updating files: 42% (103/245) Updating files: 43% (106/245) Updating files: 44% (108/245) Updating files: 45% (111/245) Updating files: 46% (113/245) Updating files: 47% (116/245) Updating files: 48% (118/245) Updating files: 49% (121/245) Updating files: 50% (123/245) Updating files: 51% (125/245) Updating files: 52% (128/245) Updating files: 53% (130/245) Updating files: 54% (133/245) Updating files: 55% (135/245) Updating files: 56% (138/245) Updating files: 57% (140/245) Updating files: 58% (143/245) Updating files: 59% (145/245) Updating files: 60% (147/245) Updating files: 61% (150/245) Updating files: 62% (152/245) Updating files: 63% (155/245) Updating files: 64% (157/245) Updating files: 65% (160/245) Updating files: 66% (162/245) Updating files: 67% (165/245) Updating files: 67% (166/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 76% (187/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 88% (216/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2023-11-28T20:54:45.394 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 266d2076b6c debian: fix up debian scripts 2023-11-28T20:54:45.399 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.20 2023-11-28T20:54:45.477 INFO:tasks.workunit.client.0.smithi167.stdout:v0.21 2023-11-28T20:54:45.478 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 21 -eq 48 ] 2023-11-28T20:54:45.478 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.21 2023-11-28T20:54:45.478 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.21 2023-11-28T20:54:45.478 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.21 2023-11-28T20:54:50.933 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:50.938 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:57.380 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:54:57.380 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2023-11-28T20:54:57.380 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T20:54:57.380 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T20:54:57.384 INFO:tasks.ceph.mon.a:Started 2023-11-28T20:54:57.384 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:54:57.384 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:54:57.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.617+0000 7feb5f780640 1 Processor -- start 2023-11-28T20:54:57.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.617+0000 7feb5f780640 1 -- start start 2023-11-28T20:54:57.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.617+0000 7feb5f780640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feb5814ffd0 0x7feb58156730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:57.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.617+0000 7feb5f780640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5815a010 con 0x7feb580c6330 2023-11-28T20:54:57.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.617+0000 7feb5f780640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb58159420 con 0x7feb58070800 2023-11-28T20:54:57.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.617+0000 7feb5f780640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb581596e0 con 0x7feb5814ffd0 2023-11-28T20:54:57.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.617+0000 7feb5cd1b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7feb580c6330 0x7feb5806a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56374/0 (socket says 172.21.15.167:56374) 2023-11-28T20:54:57.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.617+0000 7feb5cd1b640 1 -- 172.21.15.167:0/416236975 learned_addr learned my addr 172.21.15.167:0/416236975 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:54:57.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.617+0000 7feb5d51c640 1 --2- 172.21.15.167:0/416236975 >> v2:172.21.15.167:3300/0 conn(0x7feb5814ffd0 0x7feb58156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:57.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5d51c640 1 -- 172.21.15.167:0/416236975 >> v2:172.21.15.167:3300/0 conn(0x7feb5814ffd0 msgr2=0x7feb58156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:54:57.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5d51c640 1 -- 172.21.15.167:0/416236975 >> v2:172.21.15.167:3300/0 conn(0x7feb5814ffd0 msgr2=0x7feb58156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:54:57.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5d51c640 1 --2- 172.21.15.167:0/416236975 >> v2:172.21.15.167:3300/0 conn(0x7feb5814ffd0 0x7feb58156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:57.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5d51c640 1 --2- 172.21.15.167:0/416236975 >> v2:172.21.15.167:3300/0 conn(0x7feb5814ffd0 0x7feb58156730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:57.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439521120 0 0) 0x7feb58159420 con 0x7feb58070800 2023-11-28T20:54:57.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb44003530 con 0x7feb58070800 2023-11-28T20:54:57.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 627883293 0 0) 0x7feb44003530 con 0x7feb58070800 2023-11-28T20:54:57.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 >> v2:172.21.15.167:3300/0 conn(0x7feb5814ffd0 msgr2=0x7feb58156730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:54:57.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 --2- 172.21.15.167:0/416236975 >> v2:172.21.15.167:3300/0 conn(0x7feb5814ffd0 0x7feb58156730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 >> v1:172.21.15.167:6789/0 conn(0x7feb580c6330 legacy=0x7feb5806a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:57.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb581599c0 con 0x7feb58070800 2023-11-28T20:54:57.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7feb50001930 con 0x7feb58070800 2023-11-28T20:54:57.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 >> v1:172.21.15.178:6789/0 conn(0x7feb58070800 legacy=0x7feb58070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:57.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440039d0 0x7feb44003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:57.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb440047d0 0x7feb44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:57.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb440051e0 0x7feb4400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:57.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb581596e0 con 0x7feb440051e0 2023-11-28T20:54:57.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4400e340 con 0x7feb440047d0 2023-11-28T20:54:57.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4400e500 con 0x7feb440039d0 2023-11-28T20:54:57.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5d51c640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440039d0 0x7feb44003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:57.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5cd1b640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb440047d0 0x7feb44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:57.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5dd1d640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb440051e0 0x7feb4400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:57.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5cd1b640 1 -- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440039d0 msgr2=0x7feb44003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:57.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5cd1b640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440039d0 0x7feb44003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5cd1b640 1 -- 172.21.15.167:0/416236975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb440051e0 msgr2=0x7feb4400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:54:57.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5cd1b640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb440051e0 0x7feb4400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5cd1b640 1 -- 172.21.15.167:0/416236975 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb581599c0 con 0x7feb440047d0 2023-11-28T20:54:57.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5dd1d640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb440051e0 0x7feb4400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:54:57.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.621+0000 7feb5dd1d640 1 -- 172.21.15.167:0/416236975 reap_dead start 2023-11-28T20:54:57.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.625+0000 7feb5cd1b640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb440047d0 0x7feb44004c50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb4800aa80 tx=0x7feb4801c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee6858144f42cdf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:57.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.625+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480a5790 con 0x7feb440047d0 2023-11-28T20:54:57.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.625+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb48006030 con 0x7feb440047d0 2023-11-28T20:54:57.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.625+0000 7feb4ffff640 1 -- 172.21.15.167:0/416236975 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480a5b50 con 0x7feb440047d0 2023-11-28T20:54:57.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.629+0000 7feb5f780640 1 -- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb440047d0 msgr2=0x7feb44004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:57.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.629+0000 7feb5f780640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb440047d0 0x7feb44004c50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb4800aa80 tx=0x7feb4801c790 comp rx=0 tx=0).stop 2023-11-28T20:54:57.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.629+0000 7feb5f780640 1 -- 172.21.15.167:0/416236975 shutdown_connections 2023-11-28T20:54:57.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.629+0000 7feb5f780640 1 --2- 172.21.15.167:0/416236975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb440047d0 0x7feb44004c50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.629+0000 7feb5f780640 1 -- 172.21.15.167:0/416236975 >> 172.21.15.167:0/416236975 conn(0x7feb580cb1e0 msgr2=0x7feb580cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:57.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.629+0000 7feb5f780640 1 -- 172.21.15.167:0/416236975 shutdown_connections 2023-11-28T20:54:57.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.629+0000 7feb5f780640 1 -- 172.21.15.167:0/416236975 wait complete. 2023-11-28T20:54:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.629+0000 7feb5f780640 1 Processor -- start 2023-11-28T20:54:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.629+0000 7feb5f780640 1 -- start start 2023-11-28T20:54:57.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5f780640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440047d0 0x7feb5814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:57.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5f780640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb581f4c30 0x7feb5814d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:57.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5f780640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 0x7feb5814b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:57.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5f780640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5814af30 con 0x7feb5814e560 2023-11-28T20:54:57.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5f780640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5814bd70 con 0x7feb581f4c30 2023-11-28T20:54:57.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5f780640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5814a970 con 0x7feb440047d0 2023-11-28T20:54:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5dd1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 0x7feb5814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5dd1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 0x7feb5814b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37698/0 (socket says 172.21.15.167:37698) 2023-11-28T20:54:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5dd1d640 1 -- 172.21.15.167:0/3922023225 learned_addr learned my addr 172.21.15.167:0/3922023225 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:54:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5cd1b640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb581f4c30 0x7feb5814d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5d51c640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440047d0 0x7feb5814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5dd1d640 1 -- 172.21.15.167:0/3922023225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 msgr2=0x7feb5814b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:54:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5dd1d640 1 -- 172.21.15.167:0/3922023225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 msgr2=0x7feb5814b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:54:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5dd1d640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 0x7feb5814b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:54:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5dd1d640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 0x7feb5814b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:54:57.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5d51c640 1 -- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb581f4c30 msgr2=0x7feb5814d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:57.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5d51c640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb581f4c30 0x7feb5814d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5d51c640 1 -- 172.21.15.167:0/3922023225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 msgr2=0x7feb5814b830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:54:57.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5d51c640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 0x7feb5814b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.633+0000 7feb5d51c640 1 -- 172.21.15.167:0/3922023225 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5814ac50 con 0x7feb440047d0 2023-11-28T20:54:57.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.637+0000 7feb5d51c640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440047d0 0x7feb5814a280 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb540104e0 tx=0x7feb540109a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:57.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.637+0000 7feb4dffb640 1 -- 172.21.15.167:0/3922023225 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54015890 con 0x7feb440047d0 2023-11-28T20:54:57.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.637+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb581f4150 con 0x7feb440047d0 2023-11-28T20:54:57.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.637+0000 7feb4dffb640 1 -- 172.21.15.167:0/3922023225 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5400d030 con 0x7feb440047d0 2023-11-28T20:54:57.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.637+0000 7feb4dffb640 1 -- 172.21.15.167:0/3922023225 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54015890 con 0x7feb440047d0 2023-11-28T20:54:57.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.637+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb581f4710 con 0x7feb440047d0 2023-11-28T20:54:57.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.637+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb580682c0 con 0x7feb440047d0 2023-11-28T20:54:57.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.641+0000 7feb4dffb640 1 -- 172.21.15.167:0/3922023225 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb540159f0 con 0x7feb440047d0 2023-11-28T20:54:57.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.641+0000 7feb4dffb640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb3c0664d0 0x7feb3c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:54:57.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.641+0000 7feb4dffb640 1 -- 172.21.15.167:0/3922023225 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7feb54084310 con 0x7feb440047d0 2023-11-28T20:54:57.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.641+0000 7feb5cd1b640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb3c0664d0 0x7feb3c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:54:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.645+0000 7feb4dffb640 1 -- 172.21.15.167:0/3922023225 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb54051270 con 0x7feb440047d0 2023-11-28T20:54:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.645+0000 7feb5cd1b640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb3c0664d0 0x7feb3c068990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feb480ae000 tx=0x7feb48004b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:54:57.825 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 10% (57/537) Updating files: 11% (60/537) Updating files: 12% (65/537) Updating files: 13% (70/537) Updating files: 14% (76/537) Updating files: 15% (81/537) Updating files: 16% (86/537) Updating files: 17% (92/537) Updating files: 18% (97/537) Updating files: 19% (103/537) Updating files: 20% (108/537) Updating files: 21% (113/537) Updating files: 22% (119/537) Updating files: 23% (124/537) Updating files: 24% (129/537) Updating files: 25% (135/537) Updating files: 25% (136/537) Updating files: 26% (140/537) Updating files: 27% (145/537) Updating files: 28% (151/537) Updating files: 29% (156/537) Updating files: 30% (162/537) Updating files: 31% (167/537) Updating files: 32% (172/537) Updating files: 33% (178/537) Updating files: 34% (183/537) Updating files: 35% (188/537) Updating files: 36% (194/537) Updating files: 37% (199/537) Updating files: 38% (205/537) Updating files: 39% (210/537) Updating files: 40% (215/537) Updating files: 41% (221/537) Updating files: 42% (226/537) Updating files: 43% (231/537) Updating files: 44% (237/537) Updating files: 45% (242/537) Updating files: 46% (248/537) Updating files: 47% (253/537) Updating files: 48% (258/537) Updating files: 49% (264/537) Updating files: 49% (268/537) Updating files: 50% (269/537) Updating files: 51% (274/537) Updating files: 52% (280/537) Updating files: 53% (285/537) Updating files: 54% (290/537) Updating files: 55% (296/537) Updating files: 56% (301/537) Updating files: 57% (307/537) Updating files: 58% (312/537) Updating files: 59% (317/537) Updating files: 60% (323/537) Updating files: 61% (328/537) Updating files: 61% (330/537) Updating files: 62% (333/537) Updating files: 63% (339/537) Updating files: 64% (344/537) Updating files: 65% (350/537) Updating files: 66% (355/537) Updating files: 67% (360/537) Updating files: 68% (366/537) Updating files: 69% (371/537) Updating files: 70% (376/537) Updating files: 71% (382/537) Updating files: 72% (387/537) Updating files: 73% (393/537) Updating files: 74% (398/537) Updating files: 75% (403/537) Updating files: 76% (409/537) Updating files: 77% (414/537) Updating files: 78% (419/537) Updating files: 79% (425/537) Updating files: 79% (428/537) Updating files: 80% (430/537) Updating files: 81% (435/537) Updating files: 82% (441/537) Updating files: 83% (446/537) Updating files: 83% (449/537) Updating files: 84% (452/537) Updating files: 85% (457/537) Updating files: 86% (462/537) Updating files: 87% (468/537) Updating files: 88% (473/537) Updating files: 89% (478/537) Updating files: 90% (484/537) Updating files: 91% (489/537) Updating files: 91% (492/537) Updating files: 92% (495/537) Updating files: 93% (500/537) Updating files: 94% (505/537) Updating files: 95% (511/537) Updating files: 96% (516/537) Updating files: 97% (521/537) Updating files: 98% (527/537) Updating files: 99% (532/537) Updating files: 100% (537/537) Updating files: 100% (537/537), done. 2023-11-28T20:54:57.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.861+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7feb581f3fb0 con 0x7feb440047d0 2023-11-28T20:54:57.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb4dffb640 1 -- 172.21.15.167:0/3922023225 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7feb581f3fb0 con 0x7feb440047d0 2023-11-28T20:54:57.864 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":128,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:54:57.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb3c0664d0 msgr2=0x7feb3c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb3c0664d0 0x7feb3c068990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feb480ae000 tx=0x7feb48004b40 comp rx=0 tx=0).stop 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440047d0 msgr2=0x7feb5814a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440047d0 0x7feb5814a280 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb540104e0 tx=0x7feb540109a0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 shutdown_connections 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb3c0664d0 0x7feb3c068990 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb5814e560 0x7feb5814b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb581f4c30 0x7feb5814d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 --2- 172.21.15.167:0/3922023225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb440047d0 0x7feb5814a280 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 >> 172.21.15.167:0/3922023225 conn(0x7feb580cb1e0 msgr2=0x7feb58070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 shutdown_connections 2023-11-28T20:54:57.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:54:57.865+0000 7feb5f780640 1 -- 172.21.15.167:0/3922023225 wait complete. 2023-11-28T20:54:59.569 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 090436f56ac v0.21 2023-11-28T20:54:59.578 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.21 2023-11-28T20:54:59.627 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 22 -eq 48 ] 2023-11-28T20:54:59.627 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.22 2023-11-28T20:54:59.627 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.22 2023-11-28T20:54:59.628 INFO:tasks.workunit.client.0.smithi167.stdout:v0.22 2023-11-28T20:54:59.628 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.22 2023-11-28T20:55:00.886 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:55:01.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.021+0000 7f489de32640 1 Processor -- start 2023-11-28T20:55:01.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.021+0000 7f489de32640 1 -- start start 2023-11-28T20:55:01.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f489de32640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4898150b40 0x7f4898157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f489de32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 0x7f489806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f489de32640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48980c48f0 con 0x7f48980c6ff0 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f489de32640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48980c62f0 con 0x7f48980c4510 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f489de32640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48980c6ac0 con 0x7f4898150b40 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f4897fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 0x7f489806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f4897fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 0x7f489806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37700/0 (socket says 172.21.15.167:37700) 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f4897fff640 1 -- 172.21.15.167:0/1505938538 learned_addr learned my addr 172.21.15.167:0/1505938538 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f48977fe640 1 --2- 172.21.15.167:0/1505938538 >> v2:172.21.15.178:3300/0 conn(0x7f4898150b40 0x7f4898157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f4897fff640 1 -- 172.21.15.167:0/1505938538 >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 msgr2=0x7f489806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:01.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f4897fff640 1 -- 172.21.15.167:0/1505938538 >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 msgr2=0x7f489806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:01.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f4897fff640 1 --2- 172.21.15.167:0/1505938538 >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 0x7f489806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:01.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f4897fff640 1 --2- 172.21.15.167:0/1505938538 >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 0x7f489806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:01.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f48977fe640 1 -- 172.21.15.167:0/1505938538 >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 msgr2=0x7f489806a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:01.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f48977fe640 1 --2- 172.21.15.167:0/1505938538 >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 0x7f489806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f48977fe640 1 -- 172.21.15.167:0/1505938538 >> v1:172.21.15.178:6789/0 conn(0x7f48980c6ff0 legacy=0x7f48980c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:01.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.025+0000 7f48977fe640 1 -- 172.21.15.167:0/1505938538 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48980c6500 con 0x7f4898150b40 2023-11-28T20:55:01.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f48977fe640 1 --2- 172.21.15.167:0/1505938538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 0x7f4898157560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48980cc090 tx=0x7f488801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17fbcf0349b8fbc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:01.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f48967fc640 1 -- 172.21.15.167:0/1505938538 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48880ab600 con 0x7f4898150b40 2023-11-28T20:55:01.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f48967fc640 1 -- 172.21.15.167:0/1505938538 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48880a7050 con 0x7f4898150b40 2023-11-28T20:55:01.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f48967fc640 1 -- 172.21.15.167:0/1505938538 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48880ab980 con 0x7f4898150b40 2023-11-28T20:55:01.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 -- 172.21.15.167:0/1505938538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 msgr2=0x7f4898157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:01.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 --2- 172.21.15.167:0/1505938538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 0x7f4898157560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48980cc090 tx=0x7f488801c430 comp rx=0 tx=0).stop 2023-11-28T20:55:01.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 -- 172.21.15.167:0/1505938538 shutdown_connections 2023-11-28T20:55:01.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 --2- 172.21.15.167:0/1505938538 >> v2:172.21.15.167:3300/0 conn(0x7f48980c4510 0x7f489806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 --2- 172.21.15.167:0/1505938538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 0x7f4898157560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 -- 172.21.15.167:0/1505938538 >> 172.21.15.167:0/1505938538 conn(0x7f48980cb1e0 msgr2=0x7f48980cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:01.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 -- 172.21.15.167:0/1505938538 shutdown_connections 2023-11-28T20:55:01.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 -- 172.21.15.167:0/1505938538 wait complete. 2023-11-28T20:55:01.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 Processor -- start 2023-11-28T20:55:01.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.029+0000 7f489de32640 1 -- start start 2023-11-28T20:55:01.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f489de32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 0x7f4898143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:01.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f489de32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c6ff0 0x7f48980c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:01.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f489de32640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 0x7f489813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:01.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f489de32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48980caf30 con 0x7f48980c4510 2023-11-28T20:55:01.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f489de32640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48980c9800 con 0x7f4898150b40 2023-11-28T20:55:01.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f489de32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4898144920 con 0x7f48980c6ff0 2023-11-28T20:55:01.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f48977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 0x7f4898143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:01.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f48977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 0x7f4898143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37708/0 (socket says 172.21.15.167:37708) 2023-11-28T20:55:01.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f48977fe640 1 -- 172.21.15.167:0/2738274975 learned_addr learned my addr 172.21.15.167:0/2738274975 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:01.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f48977fe640 1 -- 172.21.15.167:0/2738274975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 msgr2=0x7f4898143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:55:01.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f48977fe640 1 -- 172.21.15.167:0/2738274975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 msgr2=0x7f4898143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:55:01.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f48977fe640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 0x7f4898143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:01.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f48977fe640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 0x7f4898143f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:01.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f4897fff640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 0x7f489813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:01.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f4896ffd640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c6ff0 0x7f48980c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f4897fff640 1 -- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c6ff0 msgr2=0x7f48980c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f4897fff640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c6ff0 0x7f48980c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f4897fff640 1 -- 172.21.15.167:0/2738274975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 msgr2=0x7f4898143f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f4897fff640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 0x7f4898143f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f4897fff640 1 -- 172.21.15.167:0/2738274975 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4888009420 con 0x7f4898150b40 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f4897fff640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 0x7f489813ed70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f489000b8e0 tx=0x7f48900085d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f487ffff640 1 -- 172.21.15.167:0/2738274975 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890010070 con 0x7f4898150b40 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f487ffff640 1 -- 172.21.15.167:0/2738274975 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890008ce0 con 0x7f4898150b40 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f487ffff640 1 -- 172.21.15.167:0/2738274975 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890008e50 con 0x7f4898150b40 2023-11-28T20:55:01.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48980ca970 con 0x7f4898150b40 2023-11-28T20:55:01.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48981445f0 con 0x7f4898150b40 2023-11-28T20:55:01.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.033+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48980682c0 con 0x7f4898150b40 2023-11-28T20:55:01.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.037+0000 7f487ffff640 1 -- 172.21.15.167:0/2738274975 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4890014070 con 0x7f4898150b40 2023-11-28T20:55:01.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.037+0000 7f487ffff640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4884066470 0x7f4884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:01.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.037+0000 7f487ffff640 1 -- 172.21.15.167:0/2738274975 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4890084390 con 0x7f4898150b40 2023-11-28T20:55:01.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.037+0000 7f48977fe640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4884066470 0x7f4884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:01.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.037+0000 7f48977fe640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4884066470 0x7f4884068930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f488801c470 tx=0x7f48880a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:01.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.049+0000 7f487ffff640 1 -- 172.21.15.167:0/2738274975 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4890051430 con 0x7f4898150b40 2023-11-28T20:55:01.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.257+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f48980c8fe0 con 0x7f4898150b40 2023-11-28T20:55:01.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.257+0000 7f487ffff640 1 -- 172.21.15.167:0/2738274975 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f4890024620 con 0x7f4898150b40 2023-11-28T20:55:01.258 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":128,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4884066470 msgr2=0x7f4884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4884066470 0x7f4884068930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f488801c470 tx=0x7f48880a6000 comp rx=0 tx=0).stop 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 msgr2=0x7f489813ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 0x7f489813ed70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f489000b8e0 tx=0x7f48900085d0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 shutdown_connections 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4884066470 0x7f4884068930 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898150b40 0x7f489813ed70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c6ff0 0x7f48980c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 --2- 172.21.15.167:0/2738274975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48980c4510 0x7f4898143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 >> 172.21.15.167:0/2738274975 conn(0x7f48980cb1e0 msgr2=0x7f4898073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:01.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 shutdown_connections 2023-11-28T20:55:01.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:01.261+0000 7f489de32640 1 -- 172.21.15.167:0/2738274975 wait complete. 2023-11-28T20:55:03.716 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 34% (71/204) Updating files: 35% (72/204) Updating files: 36% (74/204) Updating files: 37% (76/204) Updating files: 38% (78/204) Updating files: 39% (80/204) Updating files: 40% (82/204) Updating files: 41% (84/204) Updating files: 42% (86/204) Updating files: 43% (88/204) Updating files: 44% (90/204) Updating files: 45% (92/204) Updating files: 46% (94/204) Updating files: 47% (96/204) Updating files: 48% (98/204) Updating files: 49% (100/204) Updating files: 50% (102/204) Updating files: 51% (105/204) Updating files: 52% (107/204) Updating files: 53% (109/204) Updating files: 54% (111/204) Updating files: 55% (113/204) Updating files: 56% (115/204) Updating files: 57% (117/204) Updating files: 58% (119/204) Updating files: 59% (121/204) Updating files: 60% (123/204) Updating files: 61% (125/204) Updating files: 62% (127/204) Updating files: 63% (129/204) Updating files: 64% (131/204) Updating files: 65% (133/204) Updating files: 66% (135/204) Updating files: 67% (137/204) Updating files: 68% (139/204) Updating files: 69% (141/204) Updating files: 70% (143/204) Updating files: 71% (145/204) Updating files: 72% (147/204) Updating files: 73% (149/204) Updating files: 74% (151/204) Updating files: 75% (153/204) Updating files: 76% (156/204) Updating files: 77% (158/204) Updating files: 78% (160/204) Updating files: 79% (162/204) Updating files: 80% (164/204) Updating files: 81% (166/204) Updating files: 82% (168/204) Updating files: 82% (169/204) Updating files: 83% (170/204) Updating files: 84% (172/204) Updating files: 85% (174/204) Updating files: 86% (176/204) Updating files: 87% (178/204) Updating files: 88% (180/204) Updating files: 89% (182/204) Updating files: 90% (184/204) Updating files: 91% (186/204) Updating files: 92% (188/204) Updating files: 93% (190/204) Updating files: 94% (192/204) Updating files: 95% (194/204) Updating files: 96% (196/204) Updating files: 97% (198/204) Updating files: 98% (200/204) Updating files: 99% (202/204) Updating files: 100% (204/204) Updating files: 100% (204/204), done. 2023-11-28T20:55:04.145 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 8a7c95f60ad v0.22 2023-11-28T20:55:04.151 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.22 2023-11-28T20:55:04.281 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:55:04.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f6180f1d640 1 Processor -- start 2023-11-28T20:55:04.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f6180f1d640 1 -- start start 2023-11-28T20:55:04.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f6180f1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c0c75c0 0x7f617c0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:04.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f6180f1d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f617c06a580 0x7f617c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:04.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f6180f1d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617c15b220 con 0x7f617c151f60 2023-11-28T20:55:04.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f6180f1d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617c0c4da0 con 0x7f617c06a580 2023-11-28T20:55:04.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f6180f1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0c2df0 con 0x7f617c0c75c0 2023-11-28T20:55:04.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f617a59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f617c151f60 0x7f617c0c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44060/0 (socket says 172.21.15.167:44060) 2023-11-28T20:55:04.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f617a59c640 1 -- 172.21.15.167:0/2159485040 learned_addr learned my addr 172.21.15.167:0/2159485040 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:55:04.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f617ad9d640 1 --2- 172.21.15.167:0/2159485040 >> v2:172.21.15.178:3300/0 conn(0x7f617c06a580 0x7f617c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:04.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.417+0000 7f6179d9b640 1 --2- 172.21.15.167:0/2159485040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c0c75c0 0x7f617c0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:04.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f617ad9d640 1 -- 172.21.15.167:0/2159485040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c0c75c0 msgr2=0x7f617c0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:04.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f617ad9d640 1 --2- 172.21.15.167:0/2159485040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c0c75c0 0x7f617c0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f617ad9d640 1 -- 172.21.15.167:0/2159485040 >> v1:172.21.15.167:6789/0 conn(0x7f617c151f60 legacy=0x7f617c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:04.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f617ad9d640 1 -- 172.21.15.167:0/2159485040 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0c7a20 con 0x7f617c06a580 2023-11-28T20:55:04.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f617ad9d640 1 --2- 172.21.15.167:0/2159485040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c06a580 0x7f617c06a9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6174009dc0 tx=0x7f617401c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=318d06fffd59bc20 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:04.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f617959a640 1 -- 172.21.15.167:0/2159485040 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740a5870 con 0x7f617c06a580 2023-11-28T20:55:04.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f617959a640 1 -- 172.21.15.167:0/2159485040 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61740a59d0 con 0x7f617c06a580 2023-11-28T20:55:04.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f617959a640 1 -- 172.21.15.167:0/2159485040 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740a5d60 con 0x7f617c06a580 2023-11-28T20:55:04.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f6180f1d640 1 -- 172.21.15.167:0/2159485040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c06a580 msgr2=0x7f617c06a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:04.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.421+0000 7f6180f1d640 1 --2- 172.21.15.167:0/2159485040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c06a580 0x7f617c06a9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6174009dc0 tx=0x7f617401c8a0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 -- 172.21.15.167:0/2159485040 shutdown_connections 2023-11-28T20:55:04.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 --2- 172.21.15.167:0/2159485040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c06a580 0x7f617c06a9b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 --2- 172.21.15.167:0/2159485040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c0c75c0 0x7f617c0c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 -- 172.21.15.167:0/2159485040 >> 172.21.15.167:0/2159485040 conn(0x7f617c0cb1e0 msgr2=0x7f617c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:04.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 -- 172.21.15.167:0/2159485040 shutdown_connections 2023-11-28T20:55:04.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 -- 172.21.15.167:0/2159485040 wait complete. 2023-11-28T20:55:04.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 Processor -- start 2023-11-28T20:55:04.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 -- start start 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c06a580 0x7f617c15a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 0x7f617c0ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c151f60 0x7f617c143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c158e90 con 0x7f617c0c75c0 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1f2df0 con 0x7f617c151f60 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6180f1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c157760 con 0x7f617c06a580 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6179d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 0x7f617c0ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6179d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 0x7f617c0ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53260/0 (socket says 172.21.15.167:53260) 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6179d9b640 1 -- 172.21.15.167:0/2996611641 learned_addr learned my addr 172.21.15.167:0/2996611641 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:04.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f617ad9d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c151f60 0x7f617c143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f617a59c640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c06a580 0x7f617c15a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6179d9b640 1 -- 172.21.15.167:0/2996611641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 msgr2=0x7f617c0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6179d9b640 1 -- 172.21.15.167:0/2996611641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 msgr2=0x7f617c0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6179d9b640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 0x7f617c0ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.425+0000 7f6179d9b640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 0x7f617c0ca830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f617ad9d640 1 -- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c06a580 msgr2=0x7f617c15a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f617ad9d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c06a580 0x7f617c15a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f617ad9d640 1 -- 172.21.15.167:0/2996611641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 msgr2=0x7f617c0ca830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f617ad9d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 0x7f617c0ca830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f617ad9d640 1 -- 172.21.15.167:0/2996611641 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6174009a70 con 0x7f617c151f60 2023-11-28T20:55:04.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f617ad9d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c151f60 0x7f617c143f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61740ac000 tx=0x7f6174019640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:04.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f616affd640 1 -- 172.21.15.167:0/2996611641 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740ad850 con 0x7f617c151f60 2023-11-28T20:55:04.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f616affd640 1 -- 172.21.15.167:0/2996611641 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61740ad9d0 con 0x7f617c151f60 2023-11-28T20:55:04.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f616affd640 1 -- 172.21.15.167:0/2996611641 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740add80 con 0x7f617c151f60 2023-11-28T20:55:04.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c159130 con 0x7f617c151f60 2023-11-28T20:55:04.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c157a40 con 0x7f617c151f60 2023-11-28T20:55:04.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c0682c0 con 0x7f617c151f60 2023-11-28T20:55:04.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.429+0000 7f616affd640 1 -- 172.21.15.167:0/2996611641 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61740b4070 con 0x7f617c151f60 2023-11-28T20:55:04.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.433+0000 7f616affd640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f615c0664a0 0x7f615c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:04.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.433+0000 7f616affd640 1 -- 172.21.15.167:0/2996611641 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f617411ef40 con 0x7f617c151f60 2023-11-28T20:55:04.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.433+0000 7f617a59c640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f615c0664a0 0x7f615c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:04.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.433+0000 7f617a59c640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f615c0664a0 0x7f615c068960 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f616c000f70 tx=0x7f616c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:04.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.441+0000 7f616affd640 1 -- 172.21.15.167:0/2996611641 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61740ec1b0 con 0x7f617c151f60 2023-11-28T20:55:04.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f617c0c4090 con 0x7f617c151f60 2023-11-28T20:55:04.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f616affd640 1 -- 172.21.15.167:0/2996611641 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f61740ef7d0 con 0x7f617c151f60 2023-11-28T20:55:04.650 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":128,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":27,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:55:04.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f615c0664a0 msgr2=0x7f615c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:04.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f615c0664a0 0x7f615c068960 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f616c000f70 tx=0x7f616c007e90 comp rx=0 tx=0).stop 2023-11-28T20:55:04.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c151f60 msgr2=0x7f617c143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:04.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c151f60 0x7f617c143f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61740ac000 tx=0x7f6174019640 comp rx=0 tx=0).stop 2023-11-28T20:55:04.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 shutdown_connections 2023-11-28T20:55:04.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f615c0664a0 0x7f615c068960 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f617c151f60 0x7f617c143f80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f617c0c75c0 0x7f617c0ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 --2- 172.21.15.167:0/2996611641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f617c06a580 0x7f617c15a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:04.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 >> 172.21.15.167:0/2996611641 conn(0x7f617c0cb1e0 msgr2=0x7f617c0c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:04.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 shutdown_connections 2023-11-28T20:55:04.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:04.649+0000 7f6180f1d640 1 -- 172.21.15.167:0/2996611641 wait complete. 2023-11-28T20:55:04.767 INFO:tasks.workunit.client.0.smithi167.stdout:v0.23 2023-11-28T20:55:04.768 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 23 -eq 48 ] 2023-11-28T20:55:04.768 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.23 2023-11-28T20:55:04.768 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.23 2023-11-28T20:55:04.768 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.23 2023-11-28T20:55:07.672 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:55:07.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c3bc54640 1 Processor -- start 2023-11-28T20:55:07.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c3bc54640 1 -- start start 2023-11-28T20:55:07.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c3bc54640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c340c75c0 0x7f1c340c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:07.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c3bc54640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1c3406a580 0x7f1c3406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:07.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c3bc54640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3415b220 con 0x7f1c34151f60 2023-11-28T20:55:07.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c3bc54640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c340c4da0 con 0x7f1c3406a580 2023-11-28T20:55:07.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c3bc54640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340c2df0 con 0x7f1c340c75c0 2023-11-28T20:55:07.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c399f0640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1c34151f60 0x7f1c340c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44062/0 (socket says 172.21.15.167:44062) 2023-11-28T20:55:07.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c399f0640 1 -- 172.21.15.167:0/3771027812 learned_addr learned my addr 172.21.15.167:0/3771027812 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:55:07.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c391ef640 1 --2- 172.21.15.167:0/3771027812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c340c75c0 0x7f1c340c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:07.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c3a1f1640 1 --2- 172.21.15.167:0/3771027812 >> v2:172.21.15.178:3300/0 conn(0x7f1c3406a580 0x7f1c3406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:07.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c391ef640 1 -- 172.21.15.167:0/3771027812 >> v2:172.21.15.178:3300/0 conn(0x7f1c3406a580 msgr2=0x7f1c3406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:07.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c391ef640 1 --2- 172.21.15.167:0/3771027812 >> v2:172.21.15.178:3300/0 conn(0x7f1c3406a580 0x7f1c3406a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:07.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c391ef640 1 -- 172.21.15.167:0/3771027812 >> v1:172.21.15.167:6789/0 conn(0x7f1c34151f60 legacy=0x7f1c340c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:07.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c391ef640 1 -- 172.21.15.167:0/3771027812 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c340c7a20 con 0x7f1c340c75c0 2023-11-28T20:55:07.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.817+0000 7f1c3a1f1640 1 --2- 172.21.15.167:0/3771027812 >> v2:172.21.15.178:3300/0 conn(0x7f1c3406a580 0x7f1c3406a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:55:07.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.821+0000 7f1c391ef640 1 --2- 172.21.15.167:0/3771027812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c340c75c0 0x7f1c340c5c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1c240097c0 tx=0x7f1c2401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7690fd3b77806790 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:07.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.821+0000 7f1c389ee640 1 -- 172.21.15.167:0/3771027812 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240ab600 con 0x7f1c340c75c0 2023-11-28T20:55:07.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.821+0000 7f1c389ee640 1 -- 172.21.15.167:0/3771027812 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c240a7050 con 0x7f1c340c75c0 2023-11-28T20:55:07.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.821+0000 7f1c389ee640 1 -- 172.21.15.167:0/3771027812 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240ab980 con 0x7f1c340c75c0 2023-11-28T20:55:07.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.821+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3771027812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c340c75c0 msgr2=0x7f1c340c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:07.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.821+0000 7f1c3bc54640 1 --2- 172.21.15.167:0/3771027812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c340c75c0 0x7f1c340c5c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1c240097c0 tx=0x7f1c2401c3f0 comp rx=0 tx=0).stop 2023-11-28T20:55:07.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3771027812 shutdown_connections 2023-11-28T20:55:07.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 --2- 172.21.15.167:0/3771027812 >> v2:172.21.15.178:3300/0 conn(0x7f1c3406a580 0x7f1c3406a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:07.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 --2- 172.21.15.167:0/3771027812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c340c75c0 0x7f1c340c5c90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:07.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3771027812 >> 172.21.15.167:0/3771027812 conn(0x7f1c340cb1e0 msgr2=0x7f1c340cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:07.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3771027812 shutdown_connections 2023-11-28T20:55:07.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3771027812 wait complete. 2023-11-28T20:55:07.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 Processor -- start 2023-11-28T20:55:07.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 -- start start 2023-11-28T20:55:07.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c3406a580 0x7f1c340caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:07.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 0x7f1c3415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:07.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c34151f60 0x7f1c341f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:07.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c341f2810 con 0x7f1c340c75c0 2023-11-28T20:55:07.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c341f5f40 con 0x7f1c3406a580 2023-11-28T20:55:07.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3bc54640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34143770 con 0x7f1c34151f60 2023-11-28T20:55:07.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c391ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 0x7f1c3415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:07.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c391ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 0x7f1c3415a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53270/0 (socket says 172.21.15.167:53270) 2023-11-28T20:55:07.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c391ef640 1 -- 172.21.15.167:0/3491540462 learned_addr learned my addr 172.21.15.167:0/3491540462 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:07.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c399f0640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c3406a580 0x7f1c340caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:07.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3a1f1640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c34151f60 0x7f1c341f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:07.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c391ef640 1 -- 172.21.15.167:0/3491540462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 msgr2=0x7f1c3415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:55:07.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c391ef640 1 -- 172.21.15.167:0/3491540462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 msgr2=0x7f1c3415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:55:07.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c391ef640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 0x7f1c3415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:07.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c391ef640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 0x7f1c3415a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:07.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c399f0640 1 -- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c34151f60 msgr2=0x7f1c341f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:07.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c399f0640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c34151f60 0x7f1c341f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:07.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c399f0640 1 -- 172.21.15.167:0/3491540462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 msgr2=0x7f1c3415a3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c399f0640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 0x7f1c3415a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c399f0640 1 -- 172.21.15.167:0/3491540462 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c009a70 con 0x7f1c3406a580 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.825+0000 7f1c3a1f1640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c34151f60 0x7f1c341f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.829+0000 7f1c399f0640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c3406a580 0x7f1c340caa90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000c390 tx=0x7f1c3000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.829+0000 7f1c2a7fc640 1 -- 172.21.15.167:0/3491540462 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30005cf0 con 0x7f1c3406a580 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.829+0000 7f1c2a7fc640 1 -- 172.21.15.167:0/3491540462 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c30005e50 con 0x7f1c3406a580 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.829+0000 7f1c2a7fc640 1 -- 172.21.15.167:0/3491540462 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c300072d0 con 0x7f1c3406a580 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.829+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24009420 con 0x7f1c3406a580 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.829+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c34142ed0 con 0x7f1c3406a580 2023-11-28T20:55:07.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.829+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c340682c0 con 0x7f1c3406a580 2023-11-28T20:55:07.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.829+0000 7f1c2a7fc640 1 -- 172.21.15.167:0/3491540462 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1c30007430 con 0x7f1c3406a580 2023-11-28T20:55:07.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.833+0000 7f1c2a7fc640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c18066470 0x7f1c18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:07.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.833+0000 7f1c2a7fc640 1 -- 172.21.15.167:0/3491540462 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1c30083b10 con 0x7f1c3406a580 2023-11-28T20:55:07.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.833+0000 7f1c391ef640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c18066470 0x7f1c18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:07.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.833+0000 7f1c391ef640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c18066470 0x7f1c18068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1c2401c430 tx=0x7f1c240a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:07.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:07.841+0000 7f1c2a7fc640 1 -- 172.21.15.167:0/3491540462 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c30050ba0 con 0x7f1c3406a580 2023-11-28T20:55:08.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.045+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1c34075c90 con 0x7f1c3406a580 2023-11-28T20:55:08.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.049+0000 7f1c2a7fc640 1 -- 172.21.15.167:0/3491540462 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f1c30017020 con 0x7f1c3406a580 2023-11-28T20:55:08.053 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":128,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:55:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c18066470 msgr2=0x7f1c18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c18066470 0x7f1c18068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1c2401c430 tx=0x7f1c240a4f90 comp rx=0 tx=0).stop 2023-11-28T20:55:08.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c3406a580 msgr2=0x7f1c340caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c3406a580 0x7f1c340caa90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000c390 tx=0x7f1c3000c790 comp rx=0 tx=0).stop 2023-11-28T20:55:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 shutdown_connections 2023-11-28T20:55:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1c18066470 0x7f1c18068930 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c34151f60 0x7f1c341f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c340c75c0 0x7f1c3415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 --2- 172.21.15.167:0/3491540462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c3406a580 0x7f1c340caa90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 >> 172.21.15.167:0/3491540462 conn(0x7f1c340cb1e0 msgr2=0x7f1c34143cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 shutdown_connections 2023-11-28T20:55:08.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:08.053+0000 7f1c3bc54640 1 -- 172.21.15.167:0/3491540462 wait complete. 2023-11-28T20:55:11.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:55:11.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.217+0000 7f7fdb3b8640 1 Processor -- start 2023-11-28T20:55:11.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fdb3b8640 1 -- start start 2023-11-28T20:55:11.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fdb3b8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:11.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fdb3b8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:11.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fdb3b8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40c6120 con 0x7f7fd40c5c90 2023-11-28T20:55:11.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fdb3b8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd406aed0 con 0x7f7fd406a580 2023-11-28T20:55:11.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fdb3b8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40c4da0 con 0x7f7fd4151f60 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9955640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd8953640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7fd40c5c90 0x7f7fd40c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44068/0 (socket says 172.21.15.167:44068) 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 learned_addr learned my addr 172.21.15.167:0/1646643218 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 msgr2=0x7f7fd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 msgr2=0x7f7fd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fd40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fd40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:11.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:11.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.221+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:11.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:11.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:11.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 msgr2=0x7f7fd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:11.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 msgr2=0x7f7fd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:11.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:11.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:11.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fd40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:11.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fd40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:11.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:11.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.425+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:11.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:11.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:11.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 msgr2=0x7f7fd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:11.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 msgr2=0x7f7fd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:11.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:11.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:11.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fd40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:11.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fd40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:11.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:11.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:11.829+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:12.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.593+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> v1:172.21.15.167:6789/0 conn(0x7f7fd40c5c90 legacy=0x7f7fd40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-11-28T20:55:12.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.593+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> v1:172.21.15.167:6789/0 conn(0x7f7fd40c5c90 legacy=0x7f7fd40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:55:12.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.593+0000 7f7fd8953640 1 --1- 172.21.15.167:0/1646643218 >> v1:172.21.15.167:6789/0 conn(0x7f7fd40c5c90 0x7f7fd40c26e0 :-1 s=OPENED pgs=31 cs=1 l=1).handle_message read tag failed 2023-11-28T20:55:12.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.593+0000 7f7fd8953640 1 --1- 172.21.15.167:0/1646643218 >> v1:172.21.15.167:6789/0 conn(0x7f7fd40c5c90 0x7f7fd40c26e0 :-1 s=OPENED pgs=31 cs=1 l=1).fault on lossy channel, failing 2023-11-28T20:55:12.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:12.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 msgr2=0x7f7fd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:12.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 msgr2=0x7f7fd406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:12.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:12.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:12.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:12.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fd40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:12.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fd40c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:12.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:12.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:12.633+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:14.158 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 4% (8/163) Updating files: 5% (9/163) Updating files: 6% (10/163) Updating files: 7% (12/163) Updating files: 8% (14/163) Updating files: 9% (15/163) Updating files: 10% (17/163) Updating files: 11% (18/163) Updating files: 12% (20/163) Updating files: 13% (22/163) Updating files: 14% (23/163) Updating files: 15% (25/163) Updating files: 16% (27/163) Updating files: 17% (28/163) Updating files: 18% (30/163) Updating files: 19% (31/163) Updating files: 20% (33/163) Updating files: 21% (35/163) Updating files: 22% (36/163) Updating files: 23% (38/163) Updating files: 24% (40/163) Updating files: 25% (41/163) Updating files: 26% (43/163) Updating files: 27% (45/163) Updating files: 28% (46/163) Updating files: 29% (48/163) Updating files: 30% (49/163) Updating files: 31% (51/163) Updating files: 32% (53/163) Updating files: 33% (54/163) Updating files: 34% (56/163) Updating files: 35% (58/163) Updating files: 36% (59/163) Updating files: 37% (61/163) Updating files: 38% (62/163) Updating files: 39% (64/163) Updating files: 40% (66/163) Updating files: 41% (67/163) Updating files: 42% (69/163) Updating files: 43% (71/163) Updating files: 44% (72/163) Updating files: 45% (74/163) Updating files: 46% (75/163) Updating files: 47% (77/163) Updating files: 48% (79/163) Updating files: 49% (80/163) Updating files: 50% (82/163) Updating files: 51% (84/163) Updating files: 52% (85/163) Updating files: 52% (86/163) Updating files: 53% (87/163) Updating files: 54% (89/163) Updating files: 55% (90/163) Updating files: 56% (92/163) Updating files: 57% (93/163) Updating files: 58% (95/163) Updating files: 59% (97/163) Updating files: 60% (98/163) Updating files: 61% (100/163) Updating files: 62% (102/163) Updating files: 63% (103/163) Updating files: 64% (105/163) Updating files: 65% (106/163) Updating files: 66% (108/163) Updating files: 67% (110/163) Updating files: 68% (111/163) Updating files: 69% (113/163) Updating files: 70% (115/163) Updating files: 71% (116/163) Updating files: 72% (118/163) Updating files: 73% (119/163) Updating files: 74% (121/163) Updating files: 75% (123/163) Updating files: 76% (124/163) Updating files: 77% (126/163) Updating files: 78% (128/163) Updating files: 79% (129/163) Updating files: 80% (131/163) Updating files: 81% (133/163) Updating files: 82% (134/163) Updating files: 83% (136/163) Updating files: 84% (137/163) Updating files: 85% (139/163) Updating files: 86% (141/163) Updating files: 87% (142/163) Updating files: 88% (144/163) Updating files: 89% (146/163) Updating files: 90% (147/163) Updating files: 91% (149/163) Updating files: 92% (150/163) Updating files: 93% (152/163) Updating files: 94% (154/163) Updating files: 95% (155/163) Updating files: 96% (157/163) Updating files: 97% (159/163) Updating files: 98% (160/163) Updating files: 99% (162/163) Updating files: 100% (163/163) Updating files: 100% (163/163), done. 2023-11-28T20:55:14.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fd40c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:14.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fcaffd640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fd40c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:14.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 msgr2=0x7f7fd406a990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:14.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fcaffd640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fd406a580 0x7f7fd406a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:14.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 >> v1:172.21.15.167:6789/0 conn(0x7f7fd40c5c90 legacy=0x7f7fd40c26e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:14.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fcaffd640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:14.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd415b220 con 0x7f7fb8003620 2023-11-28T20:55:14.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd406aed0 con 0x7f7fb8007200 2023-11-28T20:55:14.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:14.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:14.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:14.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:14.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.221+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:14.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.425+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:14.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.425+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:14.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.425+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:14.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.425+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:14.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.425+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:14.703 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 5d1d8d0c460 v0.23 2023-11-28T20:55:14.708 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.23 2023-11-28T20:55:14.749 INFO:tasks.workunit.client.0.smithi167.stdout:v0.24 2023-11-28T20:55:14.749 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 24 -eq 48 ] 2023-11-28T20:55:14.749 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.24 2023-11-28T20:55:14.750 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.24 2023-11-28T20:55:14.750 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.24 2023-11-28T20:55:14.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.829+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:14.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.829+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:14.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.829+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:14.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.829+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:14.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:14.829+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:15.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:15.633+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:15.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:15.633+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:15.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:15.633+0000 7f7fd8953640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:15.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:15.633+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:15.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:15.633+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:17.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:17.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fcaffd640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8007200 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:17.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 >> v1:172.21.15.178:6789/0 conn(0x7f7fb8003620 legacy=0x7f7fb8005a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:17.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 reap_dead start 2023-11-28T20:55:17.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fcaffd640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:17.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fcaffd640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:17.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb800ae90 con 0x7f7fb800a450 2023-11-28T20:55:17.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd406aed0 con 0x7f7fd4151f60 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8005ab0 con 0x7f7fb800a980 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fb8009f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fb8009f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:17.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.221+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fb8009f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:17.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fb8009f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:17.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.425+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:17.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:17.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:17.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fb8009f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:17.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fb8009f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:17.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:17.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:17.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:17.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:17.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:17.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:17.829+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:18.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:18.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:18.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fb8009f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:18.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fb8009f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:18.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:18.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:18.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:18.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:18.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:18.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:18.633+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fb80096c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fcaffd640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fb80096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 msgr2=0x7f7fb8009f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fcaffd640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.178:3300/0 conn(0x7f7fd4151f60 0x7f7fb8009f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 >> v1:172.21.15.178:6789/0 conn(0x7f7fb800a450 legacy=0x7f7fb800f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fcaffd640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:20.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb8005c70 con 0x7f7fb8006c50 2023-11-28T20:55:20.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fcaffd640 1 -- 172.21.15.167:0/1646643218 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd406aed0 con 0x7f7fb8006300 2023-11-28T20:55:20.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:20.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 msgr2=0x7f7fb8006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:20.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 msgr2=0x7f7fb8006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:20.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:20.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.221+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:20.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.425+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:20.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.425+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 msgr2=0x7f7fb8006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:20.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.425+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 msgr2=0x7f7fb8006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:20.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.425+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:20.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.425+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:20.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.829+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:20.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.829+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 msgr2=0x7f7fb8006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:20.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.829+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 msgr2=0x7f7fb8006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:20.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.829+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:20.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:20.829+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:21.054 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:21.058 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:21.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:21.633+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:21.633+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 msgr2=0x7f7fb8006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:21.633+0000 7f7fd9154640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 msgr2=0x7f7fb8006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:21.633+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:23.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:21.633+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528034634 0 0) 0x7f7fb8005c70 con 0x7f7fb8006c50 2023-11-28T20:55:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc0003530 con 0x7f7fb8006c50 2023-11-28T20:55:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 848665748 0 0) 0x7f7fc0003530 con 0x7f7fb8006c50 2023-11-28T20:55:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 msgr2=0x7f7fb8006710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:23.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 --2- 172.21.15.167:0/1646643218 >> v2:172.21.15.167:3300/0 conn(0x7f7fb8006300 0x7f7fb8006710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8005260 con 0x7f7fb8006c50 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f7fc40016e0 con 0x7f7fb8006c50 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 >> v1:172.21.15.167:6789/0 conn(0x7f7fb8006c50 legacy=0x7f7fb8004a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 reap_dead start 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc0003980 0x7f7fc0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fc00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fc0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd406aed0 con 0x7f7fc0004d10 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc000bb20 con 0x7f7fc0003980 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc000bce0 con 0x7f7fb800a980 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fc0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc0003980 0x7f7fc0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:23.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fc00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 msgr2=0x7f7fc00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fc00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc0003980 msgr2=0x7f7fc0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc0003980 0x7f7fc0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.113+0000 7f7fd9955640 1 -- 172.21.15.167:0/1646643218 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc0003530 con 0x7f7fc0004d10 2023-11-28T20:55:23.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fc0005190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4070410 tx=0x7f7fcc01df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55604ed4762ee519 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:23.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0a6860 con 0x7f7fc0004d10 2023-11-28T20:55:23.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc0aa070 con 0x7f7fc0004d10 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fcbfff640 1 -- 172.21.15.167:0/1646643218 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0a6c00 con 0x7f7fc0004d10 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1646643218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 msgr2=0x7f7fc0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fc0005190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4070410 tx=0x7f7fcc01df00 comp rx=0 tx=0).stop 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1646643218 shutdown_connections 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fc0005190 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc0003980 0x7f7fc0003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1646643218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb800a980 0x7f7fc00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1646643218 >> 172.21.15.167:0/1646643218 conn(0x7f7fd40cb1e0 msgr2=0x7f7fd40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1646643218 shutdown_connections 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.117+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1646643218 wait complete. 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fdb3b8640 1 Processor -- start 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fdb3b8640 1 -- start start 2023-11-28T20:55:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fdb3b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb800a980 0x7f7fd41efa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fdb3b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fc0003980 0x7f7fd4157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fdb3b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fd415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fdb3b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd414dd90 con 0x7f7fc0004d10 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fdb3b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd41ef030 con 0x7f7fb800a980 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fdb3b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd41ef5b0 con 0x7f7fc0003980 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9955640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fd415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9955640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fd415a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52466/0 (socket says 172.21.15.167:52466) 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9955640 1 -- 172.21.15.167:0/1132426479 learned_addr learned my addr 172.21.15.167:0/1132426479 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb800a980 0x7f7fd41efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd8953640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fc0003980 0x7f7fd4157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9955640 1 -- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fc0003980 msgr2=0x7f7fd4157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fc0003980 0x7f7fd4157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9955640 1 -- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb800a980 msgr2=0x7f7fd41efa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb800a980 0x7f7fd41efa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9955640 1 -- 172.21.15.167:0/1132426479 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd41eff80 con 0x7f7fc0004d10 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.121+0000 7f7fd9955640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fd415a560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc01c600 tx=0x7f7fc0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.125+0000 7f7fc9ffb640 1 -- 172.21.15.167:0/1132426479 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0b8810 con 0x7f7fc0004d10 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.125+0000 7f7fc9ffb640 1 -- 172.21.15.167:0/1132426479 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc0b8970 con 0x7f7fc0004d10 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.125+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd4141b50 con 0x7f7fc0004d10 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.125+0000 7f7fc9ffb640 1 -- 172.21.15.167:0/1132426479 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0b8d20 con 0x7f7fc0004d10 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.125+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd414d0a0 con 0x7f7fc0004d10 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.125+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd40682c0 con 0x7f7fc0004d10 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.125+0000 7f7fc9ffb640 1 -- 172.21.15.167:0/1132426479 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7fcc0b6040 con 0x7f7fc0004d10 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.129+0000 7f7fc9ffb640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb8068010 0x7f7fb806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.129+0000 7f7fc9ffb640 1 -- 172.21.15.167:0/1132426479 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7fcc120260 con 0x7f7fc0004d10 2023-11-28T20:55:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.129+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb8068010 0x7f7fb806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.129+0000 7f7fd9154640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb8068010 0x7f7fb806a4d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0006cf0 tx=0x7f7fd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:23.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.133+0000 7f7fc9ffb640 1 -- 172.21.15.167:0/1132426479 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fcc0ed2f0 con 0x7f7fc0004d10 2023-11-28T20:55:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7fd4075c90 con 0x7f7fc0004d10 2023-11-28T20:55:23.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fc9ffb640 1 -- 172.21.15.167:0/1132426479 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f7fcc0ac080 con 0x7f7fc0004d10 2023-11-28T20:55:23.858 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb8068010 msgr2=0x7f7fb806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb8068010 0x7f7fb806a4d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0006cf0 tx=0x7f7fd0008040 comp rx=0 tx=0).stop 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 msgr2=0x7f7fd415a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fd415a560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc01c600 tx=0x7f7fc0005800 comp rx=0 tx=0).stop 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 shutdown_connections 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb8068010 0x7f7fb806a4d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0004d10 0x7f7fd415a560 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fc0003980 0x7f7fd4157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 --2- 172.21.15.167:0/1132426479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb800a980 0x7f7fd41efa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 >> 172.21.15.167:0/1132426479 conn(0x7f7fd40cb1e0 msgr2=0x7f7fd40cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 shutdown_connections 2023-11-28T20:55:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:23.341+0000 7f7fdb3b8640 1 -- 172.21.15.167:0/1132426479 wait complete. 2023-11-28T20:55:23.861 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:55:23.861 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:55:23.861 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:55:24.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c7f57640 1 Processor -- start 2023-11-28T20:55:24.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c7f57640 1 -- start start 2023-11-28T20:55:24.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c7f57640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27c0150b40 0x7f27c0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c7f57640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c00c48f0 con 0x7f27c00c4510 2023-11-28T20:55:24.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c7f57640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c00c6ac0 con 0x7f27c00c6ff0 2023-11-28T20:55:24.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c7f57640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c00c62f0 con 0x7f27c0150b40 2023-11-28T20:55:24.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c5cf3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27c0150b40 0x7f27c0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c64f4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f27c00c4510 0x7f27c006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36708/0 (socket says 172.21.15.167:36708) 2023-11-28T20:55:24.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c64f4640 1 -- 172.21.15.167:0/1918908825 learned_addr learned my addr 172.21.15.167:0/1918908825 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:55:24.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c5cf3640 1 -- 172.21.15.167:0/1918908825 >> v1:172.21.15.178:6789/0 conn(0x7f27c00c6ff0 legacy=0x7f27c00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c5cf3640 1 -- 172.21.15.167:0/1918908825 >> v1:172.21.15.167:6789/0 conn(0x7f27c00c4510 legacy=0x7f27c006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.001+0000 7f27c5cf3640 1 -- 172.21.15.167:0/1918908825 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00c6500 con 0x7f27c0150b40 2023-11-28T20:55:24.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c5cf3640 1 --2- 172.21.15.167:0/1918908825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 0x7f27c0157560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0097c0 tx=0x7f27bc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2218a0c1f56222b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c4cf1640 1 -- 172.21.15.167:0/1918908825 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0ab650 con 0x7f27c0150b40 2023-11-28T20:55:24.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c4cf1640 1 -- 172.21.15.167:0/1918908825 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc0ab7b0 con 0x7f27c0150b40 2023-11-28T20:55:24.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c4cf1640 1 -- 172.21.15.167:0/1918908825 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0abb40 con 0x7f27c0150b40 2023-11-28T20:55:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c7f57640 1 -- 172.21.15.167:0/1918908825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 msgr2=0x7f27c0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c7f57640 1 --2- 172.21.15.167:0/1918908825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 0x7f27c0157560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0097c0 tx=0x7f27bc01c450 comp rx=0 tx=0).stop 2023-11-28T20:55:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c7f57640 1 -- 172.21.15.167:0/1918908825 shutdown_connections 2023-11-28T20:55:24.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c7f57640 1 --2- 172.21.15.167:0/1918908825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 0x7f27c0157560 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c7f57640 1 -- 172.21.15.167:0/1918908825 >> 172.21.15.167:0/1918908825 conn(0x7f27c00cb1e0 msgr2=0x7f27c00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c7f57640 1 -- 172.21.15.167:0/1918908825 shutdown_connections 2023-11-28T20:55:24.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.005+0000 7f27c7f57640 1 -- 172.21.15.167:0/1918908825 wait complete. 2023-11-28T20:55:24.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 Processor -- start 2023-11-28T20:55:24.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 -- start start 2023-11-28T20:55:24.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27c00c4510 0x7f27c01f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27c00c6ff0 0x7f27c014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 0x7f27c0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01f3440 con 0x7f27c0150b40 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01f5a70 con 0x7f27c00c6ff0 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01f6310 con 0x7f27c00c4510 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c64f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 0x7f27c0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c64f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 0x7f27c0159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52486/0 (socket says 172.21.15.167:52486) 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c64f4640 1 -- 172.21.15.167:0/4031354013 learned_addr learned my addr 172.21.15.167:0/4031354013 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c54f2640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27c00c6ff0 0x7f27c014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c5cf3640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27c00c4510 0x7f27c01f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c64f4640 1 -- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27c00c4510 msgr2=0x7f27c01f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c64f4640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27c00c4510 0x7f27c01f2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c64f4640 1 -- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27c00c6ff0 msgr2=0x7f27c014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c64f4640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27c00c6ff0 0x7f27c014ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c64f4640 1 -- 172.21.15.167:0/4031354013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc009420 con 0x7f27c0150b40 2023-11-28T20:55:24.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c64f4640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 0x7f27c0159d90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f27b800ca70 tx=0x7f27b800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b800abd0 con 0x7f27c0150b40 2023-11-28T20:55:24.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b800ad30 con 0x7f27c0150b40 2023-11-28T20:55:24.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b800aea0 con 0x7f27c0150b40 2023-11-28T20:55:24.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c00c2cd0 con 0x7f27c0150b40 2023-11-28T20:55:24.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.009+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c0158150 con 0x7f27c0150b40 2023-11-28T20:55:24.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27c7f57640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0160e70 0x7f27c01f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c0074770 con 0x7f27c0160e70 2023-11-28T20:55:24.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27c5cf3640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0160e70 0x7f27c01f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27c5cf3640 1 -- 172.21.15.167:0/4031354013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27c0157040 con 0x7f27c0160e70 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27c5cf3640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0160e70 0x7f27c01f5bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f27c00cc270 tx=0x7f27bc0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0abcf0 con 0x7f27c0160e70 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27b8007070 con 0x7f27c0150b40 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27b67fc640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f27a4066510 0x7f27a40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f27b8084130 con 0x7f27c0150b40 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f27bc0abe50 con 0x7f27c0160e70 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0160e70 msgr2=0x7f27c01f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27b67fc640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0160e70 0x7f27c01f5bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f27c00cc270 tx=0x7f27bc0191f0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0160e70 msgr2=0x7f27c01f5bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27b67fc640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0160e70 0x7f27c01f5bb0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f27c00cc270 tx=0x7f27bc0191f0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27c54f2640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f27a4066510 0x7f27a40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.013+0000 7f27c54f2640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f27a4066510 0x7f27a40689d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f27c01f0090 tx=0x7f27b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0153b10 0x7f27c0153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00682c0 con 0x7f27c0153b10 2023-11-28T20:55:24.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c5cf3640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0153b10 0x7f27c0153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c5cf3640 1 -- 172.21.15.167:0/4031354013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f27c0154460 con 0x7f27c0153b10 2023-11-28T20:55:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c5cf3640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0153b10 0x7f27c0153f20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f27bc01c490 tx=0x7f27bc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0c56c0 con 0x7f27c0153b10 2023-11-28T20:55:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4472 (secure 0 0 0) 0x7f27bc0c5820 con 0x7f27c0153b10 2023-11-28T20:55:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0153b10 msgr2=0x7f27c0153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27b67fc640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0153b10 0x7f27c0153f20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f27bc01c490 tx=0x7f27bc009190 comp rx=0 tx=0).stop 2023-11-28T20:55:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27b67fc640 1 -- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0153b10 msgr2=0x7f27c0153f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:24.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27b67fc640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0153b10 0x7f27c0153f20 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f27bc01c490 tx=0x7f27bc009190 comp rx=0 tx=0).stop 2023-11-28T20:55:24.022 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 136, 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:55:24.023 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:55:24.024 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.025 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:55:24.026 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:24.027 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.028 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:24.029 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:24.030 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:24.031 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.032 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.033 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:55:24.034 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:55:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f27a4066510 msgr2=0x7f27a40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f27a4066510 0x7f27a40689d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f27c01f0090 tx=0x7f27b0009040 comp rx=0 tx=0).stop 2023-11-28T20:55:24.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 msgr2=0x7f27c0159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 --2- 172.21.15.167:0/4031354013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c0150b40 0x7f27c0159d90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f27b800ca70 tx=0x7f27b800cf30 comp rx=0 tx=0).stop 2023-11-28T20:55:24.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c64f4640 1 -- 172.21.15.167:0/4031354013 reap_dead start 2023-11-28T20:55:24.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c64f4640 1 -- 172.21.15.167:0/4031354013 reap_dead start 2023-11-28T20:55:24.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 shutdown_connections 2023-11-28T20:55:24.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 >> 172.21.15.167:0/4031354013 conn(0x7f27c00cb1e0 msgr2=0x7f27c0156100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:24.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 shutdown_connections 2023-11-28T20:55:24.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.021+0000 7f27c7f57640 1 -- 172.21.15.167:0/4031354013 wait complete. 2023-11-28T20:55:24.040 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:55:24.040 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:55:24.040 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:55:24.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa3218bb640 1 Processor -- start 2023-11-28T20:55:24.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa3218bb640 1 -- start start 2023-11-28T20:55:24.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa3218bb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa31c0b0110 0x7fa31c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa3218bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c0c8010 0x7fa31c066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa3218bb640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c06a8d0 con 0x7fa31c06d530 2023-11-28T20:55:24.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa3218bb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31c0ca230 con 0x7fa31c0b0110 2023-11-28T20:55:24.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa3218bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0c8990 con 0x7fa31c0c8010 2023-11-28T20:55:24.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa31affd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa31c0b0110 0x7fa31c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa31affd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa31c0b0110 0x7fa31c15d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52508/0 (socket says 172.21.15.167:52508) 2023-11-28T20:55:24.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa31affd640 1 -- 172.21.15.167:0/818665699 learned_addr learned my addr 172.21.15.167:0/818665699 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:24.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa31a7fc640 1 --2- 172.21.15.167:0/818665699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c0c8010 0x7fa31c066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa31affd640 1 -- 172.21.15.167:0/818665699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c0c8010 msgr2=0x7fa31c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:24.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa31affd640 1 --2- 172.21.15.167:0/818665699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c0c8010 0x7fa31c066730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa31affd640 1 -- 172.21.15.167:0/818665699 >> v1:172.21.15.178:6789/0 conn(0x7fa31c06d530 legacy=0x7fa31c06b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.181+0000 7fa31affd640 1 -- 172.21.15.167:0/818665699 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c0ca480 con 0x7fa31c0b0110 2023-11-28T20:55:24.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa31affd640 1 --2- 172.21.15.167:0/818665699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0b0110 0x7fa31c15d3b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009870 tx=0x7fa30c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1699f04dce77b962 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa319ffb640 1 -- 172.21.15.167:0/818665699 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0a8a30 con 0x7fa31c0b0110 2023-11-28T20:55:24.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa319ffb640 1 -- 172.21.15.167:0/818665699 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0a8b90 con 0x7fa31c0b0110 2023-11-28T20:55:24.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa319ffb640 1 -- 172.21.15.167:0/818665699 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0b0440 con 0x7fa31c0b0110 2023-11-28T20:55:24.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa3218bb640 1 -- 172.21.15.167:0/818665699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0b0110 msgr2=0x7fa31c15d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa3218bb640 1 --2- 172.21.15.167:0/818665699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0b0110 0x7fa31c15d3b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009870 tx=0x7fa30c01ed30 comp rx=0 tx=0).stop 2023-11-28T20:55:24.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa3218bb640 1 -- 172.21.15.167:0/818665699 shutdown_connections 2023-11-28T20:55:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa3218bb640 1 --2- 172.21.15.167:0/818665699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c0c8010 0x7fa31c066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa3218bb640 1 --2- 172.21.15.167:0/818665699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0b0110 0x7fa31c15d3b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa3218bb640 1 -- 172.21.15.167:0/818665699 >> 172.21.15.167:0/818665699 conn(0x7fa31c06ee30 msgr2=0x7fa31c06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa3218bb640 1 -- 172.21.15.167:0/818665699 shutdown_connections 2023-11-28T20:55:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.185+0000 7fa3218bb640 1 -- 172.21.15.167:0/818665699 wait complete. 2023-11-28T20:55:24.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 Processor -- start 2023-11-28T20:55:24.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 -- start start 2023-11-28T20:55:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c06d530 0x7fa31c1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b0110 0x7fa31c0c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0c8010 0x7fa31c1ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1f3af0 con 0x7fa31c0c8010 2023-11-28T20:55:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1f2c00 con 0x7fa31c0b0110 2023-11-28T20:55:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1f2e70 con 0x7fa31c06d530 2023-11-28T20:55:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0c8010 0x7fa31c1ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0c8010 0x7fa31c1ef900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52520/0 (socket says 172.21.15.167:52520) 2023-11-28T20:55:24.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31b7fe640 1 -- 172.21.15.167:0/993145035 learned_addr learned my addr 172.21.15.167:0/993145035 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31a7fc640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b0110 0x7fa31c0c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31affd640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c06d530 0x7fa31c1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31b7fe640 1 -- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c06d530 msgr2=0x7fa31c1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31b7fe640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c06d530 0x7fa31c1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31b7fe640 1 -- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b0110 msgr2=0x7fa31c0c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31b7fe640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b0110 0x7fa31c0c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31b7fe640 1 -- 172.21.15.167:0/993145035 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0094d0 con 0x7fa31c0c8010 2023-11-28T20:55:24.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31b7fe640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0c8010 0x7fa31c1ef900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c7a0 tx=0x7fa31400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314003b80 con 0x7fa31c0c8010 2023-11-28T20:55:24.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314003ce0 con 0x7fa31c0c8010 2023-11-28T20:55:24.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c1f3150 con 0x7fa31c0c8010 2023-11-28T20:55:24.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31400aa90 con 0x7fa31c0c8010 2023-11-28T20:55:24.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c1f3710 con 0x7fa31c0c8010 2023-11-28T20:55:24.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b2840 0x7fa31c1efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c06b130 con 0x7fa31c0b2840 2023-11-28T20:55:24.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.189+0000 7fa31affd640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b2840 0x7fa31c1efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa31affd640 1 -- 172.21.15.167:0/993145035 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa31c0ca760 con 0x7fa31c0b2840 2023-11-28T20:55:24.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa31400abf0 con 0x7fa31c0c8010 2023-11-28T20:55:24.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa31affd640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b2840 0x7fa31c1efe40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0cad20 tx=0x7fa30c01d570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa303fff640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa308066470 0x7fa308068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa314084020 con 0x7fa31c0c8010 2023-11-28T20:55:24.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0a8a30 con 0x7fa31c0b2840 2023-11-28T20:55:24.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa30c0bb420 con 0x7fa31c0b2840 2023-11-28T20:55:24.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b2840 msgr2=0x7fa31c1efe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa303fff640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b2840 0x7fa31c1efe40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0cad20 tx=0x7fa30c01d570 comp rx=0 tx=0).stop 2023-11-28T20:55:24.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b2840 msgr2=0x7fa31c1efe40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:24.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa303fff640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b2840 0x7fa31c1efe40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa31a7fc640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa308066470 0x7fa308068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.193+0000 7fa31a7fc640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa308066470 0x7fa308068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0c7bf0 tx=0x7fa310008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.197+0000 7fa3218bb640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c1502c0 0x7fa31c1506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.197+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0c8f10 con 0x7fa31c1502c0 2023-11-28T20:55:24.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa31affd640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c1502c0 0x7fa31c1506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa31affd640 1 -- 172.21.15.167:0/993145035 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa31c06bda0 con 0x7fa31c1502c0 2023-11-28T20:55:24.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa31affd640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c1502c0 0x7fa31c1506d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa30c01c960 tx=0x7fa30c01bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0c8070 con 0x7fa31c1502c0 2023-11-28T20:55:24.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4640 (secure 0 0 0) 0x7fa30c0bb590 con 0x7fa31c1502c0 2023-11-28T20:55:24.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c1502c0 msgr2=0x7fa31c1506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa303fff640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c1502c0 0x7fa31c1506d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa30c01c960 tx=0x7fa30c01bad0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa303fff640 1 -- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c1502c0 msgr2=0x7fa31c1506d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:24.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa303fff640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c1502c0 0x7fa31c1506d0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa30c01c960 tx=0x7fa30c01bad0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.203 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:55:24.203 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:24.203 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:24.203 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:55:24.203 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 136, 2023-11-28T20:55:24.203 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:55:24.203 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:55:24.203 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:24.204 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:24.205 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:55:24.206 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:55:24.207 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:55:24.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:24.211 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:24.212 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.213 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:55:24.214 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:24.215 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:55:24.216 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:55:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa308066470 msgr2=0x7fa308068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa3218bb640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa308066470 0x7fa308068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0c7bf0 tx=0x7fa310008040 comp rx=0 tx=0).stop 2023-11-28T20:55:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0c8010 msgr2=0x7fa31c1ef900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa3218bb640 1 --2- 172.21.15.167:0/993145035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa31c0c8010 0x7fa31c1ef900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c7a0 tx=0x7fa31400cc60 comp rx=0 tx=0).stop 2023-11-28T20:55:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa31b7fe640 1 -- 172.21.15.167:0/993145035 reap_dead start 2023-11-28T20:55:24.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa31b7fe640 1 -- 172.21.15.167:0/993145035 reap_dead start 2023-11-28T20:55:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 shutdown_connections 2023-11-28T20:55:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 >> 172.21.15.167:0/993145035 conn(0x7fa31c06ee30 msgr2=0x7fa31c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 shutdown_connections 2023-11-28T20:55:24.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.201+0000 7fa3218bb640 1 -- 172.21.15.167:0/993145035 wait complete. 2023-11-28T20:55:24.222 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:55:24.222 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:55:24.223 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:55:24.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.361+0000 7ff5a985f640 1 Processor -- start 2023-11-28T20:55:24.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.361+0000 7ff5a985f640 1 -- start start 2023-11-28T20:55:24.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff5a985f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5a406e030 0x7ff5a41500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff5a985f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff5a4070480 0x7ff5a41505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff5a985f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a41571d0 con 0x7ff5a406e410 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff5a985f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a4071a90 con 0x7ff5a4070480 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff5a985f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40c70d0 con 0x7ff5a406e030 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff59a7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff5a4070480 0x7ff5a41505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff59a7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff5a4070480 0x7ff5a41505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52536/0 (socket says 172.21.15.167:52536) 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff5a37fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff5a406e410 0x7ff5a4071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:36724/0 (socket says 172.21.15.167:36724) 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff59a7fc640 1 -- 172.21.15.167:0/2537891370 learned_addr learned my addr 172.21.15.167:0/2537891370 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff5a2ffd640 1 --2- 172.21.15.167:0/2537891370 >> v2:172.21.15.178:3300/0 conn(0x7ff5a406e030 0x7ff5a41500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff59a7fc640 1 -- 172.21.15.167:0/2537891370 >> v2:172.21.15.178:3300/0 conn(0x7ff5a406e030 msgr2=0x7ff5a41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff59a7fc640 1 --2- 172.21.15.167:0/2537891370 >> v2:172.21.15.178:3300/0 conn(0x7ff5a406e030 0x7ff5a41500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff59a7fc640 1 -- 172.21.15.167:0/2537891370 >> v1:172.21.15.167:6789/0 conn(0x7ff5a406e410 legacy=0x7ff5a4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff59a7fc640 1 -- 172.21.15.167:0/2537891370 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40c73b0 con 0x7ff5a4070480 2023-11-28T20:55:24.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff59a7fc640 1 --2- 172.21.15.167:0/2537891370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a4070480 0x7ff5a41505f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40cbff0 tx=0x7ff58c01daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79c3cf7465fb3b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff5a27fc640 1 -- 172.21.15.167:0/2537891370 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00a2d0 con 0x7ff5a4070480 2023-11-28T20:55:24.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.365+0000 7ff5a27fc640 1 -- 172.21.15.167:0/2537891370 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c0a6960 con 0x7ff5a4070480 2023-11-28T20:55:24.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a27fc640 1 -- 172.21.15.167:0/2537891370 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0a6cf0 con 0x7ff5a4070480 2023-11-28T20:55:24.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 -- 172.21.15.167:0/2537891370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a4070480 msgr2=0x7ff5a41505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 --2- 172.21.15.167:0/2537891370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a4070480 0x7ff5a41505f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40cbff0 tx=0x7ff58c01daa0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 -- 172.21.15.167:0/2537891370 shutdown_connections 2023-11-28T20:55:24.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 --2- 172.21.15.167:0/2537891370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a4070480 0x7ff5a41505f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 --2- 172.21.15.167:0/2537891370 >> v2:172.21.15.178:3300/0 conn(0x7ff5a406e030 0x7ff5a41500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 -- 172.21.15.167:0/2537891370 >> 172.21.15.167:0/2537891370 conn(0x7ff5a40cb1e0 msgr2=0x7ff5a40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:24.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 -- 172.21.15.167:0/2537891370 shutdown_connections 2023-11-28T20:55:24.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 -- 172.21.15.167:0/2537891370 wait complete. 2023-11-28T20:55:24.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 Processor -- start 2023-11-28T20:55:24.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 -- start start 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5a406e030 0x7ff5a41552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a406e410 0x7ff5a414e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a4070480 0x7ff5a4145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4160440 con 0x7ff5a406e410 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a41f6ff0 con 0x7ff5a406e030 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a985f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a41f72d0 con 0x7ff5a4070480 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff59a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a406e410 0x7ff5a414e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff59a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a406e410 0x7ff5a414e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52540/0 (socket says 172.21.15.167:52540) 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff59a7fc640 1 -- 172.21.15.167:0/3894748586 learned_addr learned my addr 172.21.15.167:0/3894748586 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a2ffd640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5a406e030 0x7ff5a41552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.369+0000 7ff5a37fe640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a4070480 0x7ff5a4145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff59a7fc640 1 -- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a4070480 msgr2=0x7ff5a4145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff59a7fc640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a4070480 0x7ff5a4145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff59a7fc640 1 -- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5a406e030 msgr2=0x7ff5a41552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff59a7fc640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5a406e030 0x7ff5a41552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff59a7fc640 1 -- 172.21.15.167:0/3894748586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c00ac40 con 0x7ff5a406e410 2023-11-28T20:55:24.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff59a7fc640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a406e410 0x7ff5a414e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff58c01a6b0 tx=0x7ff58c01a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c008700 con 0x7ff5a406e410 2023-11-28T20:55:24.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c0088a0 con 0x7ff5a406e410 2023-11-28T20:55:24.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c008c50 con 0x7ff5a406e410 2023-11-28T20:55:24.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a41f75b0 con 0x7ff5a406e410 2023-11-28T20:55:24.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a41f7b70 con 0x7ff5a406e410 2023-11-28T20:55:24.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a985f640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a40c1fe0 0x7ff5a41460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4074770 con 0x7ff5a40c1fe0 2023-11-28T20:55:24.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a2ffd640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a40c1fe0 0x7ff5a41460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff58c0b7480 con 0x7ff5a406e410 2023-11-28T20:55:24.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a2ffd640 1 -- 172.21.15.167:0/3894748586 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5a40682c0 con 0x7ff5a40c1fe0 2023-11-28T20:55:24.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a2ffd640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a40c1fe0 0x7ff5a41460c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff59400f410 tx=0x7ff59400f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a0ff9640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff584066470 0x7ff584068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff58c11fa30 con 0x7ff5a406e410 2023-11-28T20:55:24.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594014870 con 0x7ff5a40c1fe0 2023-11-28T20:55:24.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.373+0000 7ff5a37fe640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff584066470 0x7ff584068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.377+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff5940149d0 con 0x7ff5a40c1fe0 2023-11-28T20:55:24.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.377+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a40c1fe0 msgr2=0x7ff5a41460c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.377+0000 7ff5a0ff9640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a40c1fe0 0x7ff5a41460c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff59400f410 tx=0x7ff59400f8d0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.377+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a40c1fe0 msgr2=0x7ff5a41460c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:24.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.377+0000 7ff5a0ff9640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a40c1fe0 0x7ff5a41460c0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff59400f410 tx=0x7ff59400f8d0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.377+0000 7ff5a37fe640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff584066470 0x7ff584068930 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff59c000f70 tx=0x7ff59c007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.381+0000 7ff5a985f640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a414ecb0 0x7ff5a41fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.381+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a41f7d60 con 0x7ff5a414ecb0 2023-11-28T20:55:24.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.381+0000 7ff5a2ffd640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a414ecb0 0x7ff5a41fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.381+0000 7ff5a2ffd640 1 -- 172.21.15.167:0/3894748586 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff5a406ba20 con 0x7ff5a414ecb0 2023-11-28T20:55:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a2ffd640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a414ecb0 0x7ff5a41fa680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff59400f410 tx=0x7ff5940046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594004230 con 0x7ff5a414ecb0 2023-11-28T20:55:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7ff594004390 con 0x7ff5a414ecb0 2023-11-28T20:55:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a414ecb0 msgr2=0x7ff5a41fa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a0ff9640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a414ecb0 0x7ff5a41fa680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff59400f410 tx=0x7ff5940046d0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a0ff9640 1 -- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a414ecb0 msgr2=0x7ff5a41fa680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a0ff9640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a414ecb0 0x7ff5a41fa680 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 136, 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:55:24.386 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:24.387 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:24.388 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:55:24.389 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:55:24.390 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:24.391 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:24.393 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.394 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.395 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:24.395 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:55:24.395 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.395 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.398 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.398 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:55:24.398 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:55:24.398 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.400 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:24.400 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:55:24.400 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:24.400 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.400 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.400 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.401 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.402 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.403 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:55:24.404 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:24.405 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:24.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:24.405 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:55:24.405 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:55:24.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff584066470 msgr2=0x7ff584068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a985f640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff584066470 0x7ff584068930 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff59c000f70 tx=0x7ff59c007c10 comp rx=0 tx=0).stop 2023-11-28T20:55:24.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a406e410 msgr2=0x7ff5a414e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a985f640 1 --2- 172.21.15.167:0/3894748586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5a406e410 0x7ff5a414e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff58c01a6b0 tx=0x7ff58c01a840 comp rx=0 tx=0).stop 2023-11-28T20:55:24.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a37fe640 1 -- 172.21.15.167:0/3894748586 reap_dead start 2023-11-28T20:55:24.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a37fe640 1 -- 172.21.15.167:0/3894748586 reap_dead start 2023-11-28T20:55:24.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 shutdown_connections 2023-11-28T20:55:24.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 >> 172.21.15.167:0/3894748586 conn(0x7ff5a40cb1e0 msgr2=0x7ff5a415f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:24.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 shutdown_connections 2023-11-28T20:55:24.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.385+0000 7ff5a985f640 1 -- 172.21.15.167:0/3894748586 wait complete. 2023-11-28T20:55:24.407 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:55:24.407 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:55:24.408 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:55:24.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.545+0000 7f2f20409640 1 Processor -- start 2023-11-28T20:55:24.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.545+0000 7f2f20409640 1 -- start start 2023-11-28T20:55:24.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.545+0000 7f2f20409640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f18150b40 0x7f2f18157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.545+0000 7f2f20409640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c6ff0 0x7f2f180c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.545+0000 7f2f20409640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f180c5be0 0x7f2f1806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.545+0000 7f2f20409640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180c6ac0 con 0x7f2f180c5be0 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.545+0000 7f2f20409640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180c6500 con 0x7f2f18150b40 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.545+0000 7f2f20409640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180c67e0 con 0x7f2f180c6ff0 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.545+0000 7f2f1e9a6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f180c5be0 0x7f2f1806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1e9a6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f180c5be0 0x7f2f1806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52556/0 (socket says 172.21.15.167:52556) 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1e9a6640 1 -- 172.21.15.167:0/1098910457 learned_addr learned my addr 172.21.15.167:0/1098910457 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1d9a4640 1 --2- 172.21.15.167:0/1098910457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c6ff0 0x7f2f180c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1e1a5640 1 --2- 172.21.15.167:0/1098910457 >> v2:172.21.15.178:3300/0 conn(0x7f2f18150b40 0x7f2f18157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1e9a6640 1 -- 172.21.15.167:0/1098910457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c6ff0 msgr2=0x7f2f180c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1e9a6640 1 --2- 172.21.15.167:0/1098910457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c6ff0 0x7f2f180c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1e9a6640 1 -- 172.21.15.167:0/1098910457 >> v2:172.21.15.178:3300/0 conn(0x7f2f18150b40 msgr2=0x7f2f18157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1e9a6640 1 --2- 172.21.15.167:0/1098910457 >> v2:172.21.15.178:3300/0 conn(0x7f2f18150b40 0x7f2f18157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1e9a6640 1 -- 172.21.15.167:0/1098910457 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18156a80 con 0x7f2f180c5be0 2023-11-28T20:55:24.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1e9a6640 1 --2- 172.21.15.167:0/1098910457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c5be0 0x7f2f1806a580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2f180cc090 tx=0x7f2f1001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b639bffc3cb80e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1d1a3640 1 -- 172.21.15.167:0/1098910457 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1000b2d0 con 0x7f2f180c5be0 2023-11-28T20:55:24.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1d1a3640 1 -- 172.21.15.167:0/1098910457 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1000b430 con 0x7f2f180c5be0 2023-11-28T20:55:24.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.549+0000 7f2f1d1a3640 1 -- 172.21.15.167:0/1098910457 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100a7c50 con 0x7f2f180c5be0 2023-11-28T20:55:24.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 -- 172.21.15.167:0/1098910457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c5be0 msgr2=0x7f2f1806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 --2- 172.21.15.167:0/1098910457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c5be0 0x7f2f1806a580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2f180cc090 tx=0x7f2f1001eba0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 -- 172.21.15.167:0/1098910457 shutdown_connections 2023-11-28T20:55:24.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 --2- 172.21.15.167:0/1098910457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c5be0 0x7f2f1806a580 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 --2- 172.21.15.167:0/1098910457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c6ff0 0x7f2f180c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 --2- 172.21.15.167:0/1098910457 >> v2:172.21.15.178:3300/0 conn(0x7f2f18150b40 0x7f2f18157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 -- 172.21.15.167:0/1098910457 >> 172.21.15.167:0/1098910457 conn(0x7f2f180cb1e0 msgr2=0x7f2f180cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:24.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 -- 172.21.15.167:0/1098910457 shutdown_connections 2023-11-28T20:55:24.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 -- 172.21.15.167:0/1098910457 wait complete. 2023-11-28T20:55:24.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 Processor -- start 2023-11-28T20:55:24.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 -- start start 2023-11-28T20:55:24.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c5be0 0x7f2f1814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c6ff0 0x7f2f1814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f18150b40 0x7f2f1815f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1814fa20 con 0x7f2f180c6ff0 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1814e330 con 0x7f2f18150b40 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f20409640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1814e7c0 con 0x7f2f180c5be0 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1d9a4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c6ff0 0x7f2f1814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1d9a4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c6ff0 0x7f2f1814a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52558/0 (socket says 172.21.15.167:52558) 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1d9a4640 1 -- 172.21.15.167:0/3416423951 learned_addr learned my addr 172.21.15.167:0/3416423951 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1e1a5640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c5be0 0x7f2f1814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1e9a6640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f18150b40 0x7f2f1815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1d9a4640 1 -- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c5be0 msgr2=0x7f2f1814bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1d9a4640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c5be0 0x7f2f1814bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1d9a4640 1 -- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f18150b40 msgr2=0x7f2f1815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1d9a4640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f18150b40 0x7f2f1815f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1d9a4640 1 -- 172.21.15.167:0/3416423951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1000bd40 con 0x7f2f180c6ff0 2023-11-28T20:55:24.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.553+0000 7f2f1e9a6640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f18150b40 0x7f2f1815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:55:24.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f1d9a4640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c6ff0 0x7f2f1814a220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800d800 tx=0x7f2f0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f0effd640 1 -- 172.21.15.167:0/3416423951 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800b6c0 con 0x7f2f180c6ff0 2023-11-28T20:55:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f0effd640 1 -- 172.21.15.167:0/3416423951 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0800b820 con 0x7f2f180c6ff0 2023-11-28T20:55:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f0effd640 1 -- 172.21.15.167:0/3416423951 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800bb90 con 0x7f2f180c6ff0 2023-11-28T20:55:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1814fea0 con 0x7f2f180c6ff0 2023-11-28T20:55:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1814da00 con 0x7f2f180c6ff0 2023-11-28T20:55:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f180682c0 con 0x7f2f180c6ff0 2023-11-28T20:55:24.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f0effd640 1 -- 172.21.15.167:0/3416423951 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f0800bcf0 con 0x7f2f180c6ff0 2023-11-28T20:55:24.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f0effd640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2efc066470 0x7f2efc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:24.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f0effd640 1 -- 172.21.15.167:0/3416423951 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2f08084820 con 0x7f2f180c6ff0 2023-11-28T20:55:24.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.557+0000 7f2f1e1a5640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2efc066470 0x7f2efc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:24.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.561+0000 7f2f1e1a5640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2efc066470 0x7f2efc068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2f14007940 tx=0x7f2f14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:24.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.565+0000 7f2f0effd640 1 -- 172.21.15.167:0/3416423951 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f08051780 con 0x7f2f180c6ff0 2023-11-28T20:55:24.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.805+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f2f18075c90 con 0x7f2f180c6ff0 2023-11-28T20:55:24.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.809+0000 7f2f0effd640 1 -- 172.21.15.167:0/3416423951 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f2f08054da0 con 0x7f2f180c6ff0 2023-11-28T20:55:24.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2efc066470 msgr2=0x7f2efc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2efc066470 0x7f2efc068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2f14007940 tx=0x7f2f14008040 comp rx=0 tx=0).stop 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c6ff0 msgr2=0x7f2f1814a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c6ff0 0x7f2f1814a220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800d800 tx=0x7f2f0800dcc0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 shutdown_connections 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2efc066470 0x7f2efc068930 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f18150b40 0x7f2f1815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f180c6ff0 0x7f2f1814a220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 --2- 172.21.15.167:0/3416423951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f180c5be0 0x7f2f1814bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 >> 172.21.15.167:0/3416423951 conn(0x7f2f180cb1e0 msgr2=0x7f2f180cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 shutdown_connections 2023-11-28T20:55:24.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:24.813+0000 7f2f20409640 1 -- 172.21.15.167:0/3416423951 wait complete. 2023-11-28T20:55:24.840 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:55:27.926 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 30% (56/185) Updating files: 31% (58/185) Updating files: 32% (60/185) Updating files: 33% (62/185) Updating files: 34% (63/185) Updating files: 35% (65/185) Updating files: 36% (67/185) Updating files: 37% (69/185) Updating files: 38% (71/185) Updating files: 39% (73/185) Updating files: 40% (74/185) Updating files: 41% (76/185) Updating files: 42% (78/185) Updating files: 43% (80/185) Updating files: 44% (82/185) Updating files: 45% (84/185) Updating files: 46% (86/185) Updating files: 47% (87/185) Updating files: 48% (89/185) Updating files: 49% (91/185) Updating files: 50% (93/185) Updating files: 51% (95/185) Updating files: 52% (97/185) Updating files: 53% (99/185) Updating files: 54% (100/185) Updating files: 55% (102/185) Updating files: 56% (104/185) Updating files: 57% (106/185) Updating files: 58% (108/185) Updating files: 59% (110/185) Updating files: 60% (111/185) Updating files: 61% (113/185) Updating files: 62% (115/185) Updating files: 63% (117/185) Updating files: 64% (119/185) Updating files: 65% (121/185) Updating files: 66% (123/185) Updating files: 67% (124/185) Updating files: 68% (126/185) Updating files: 69% (128/185) Updating files: 70% (130/185) Updating files: 71% (132/185) Updating files: 72% (134/185) Updating files: 73% (136/185) Updating files: 74% (137/185) Updating files: 75% (139/185) Updating files: 76% (141/185) Updating files: 77% (143/185) Updating files: 78% (145/185) Updating files: 79% (147/185) Updating files: 80% (148/185) Updating files: 81% (150/185) Updating files: 82% (152/185) Updating files: 83% (154/185) Updating files: 84% (156/185) Updating files: 85% (158/185) Updating files: 86% (160/185) Updating files: 87% (161/185) Updating files: 88% (163/185) Updating files: 89% (165/185) Updating files: 90% (167/185) Updating files: 91% (169/185) Updating files: 92% (171/185) Updating files: 93% (173/185) Updating files: 94% (174/185) Updating files: 95% (176/185) Updating files: 96% (178/185) Updating files: 97% (180/185) Updating files: 98% (182/185) Updating files: 99% (184/185) Updating files: 100% (185/185) Updating files: 100% (185/185), done. 2023-11-28T20:55:28.828 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 180a4176035 v0.24 2023-11-28T20:55:28.833 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.24 2023-11-28T20:55:28.881 INFO:tasks.workunit.client.0.smithi167.stdout:v0.25 2023-11-28T20:55:28.881 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 25 -eq 48 ] 2023-11-28T20:55:28.881 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.25 2023-11-28T20:55:28.881 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.25 2023-11-28T20:55:28.881 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.25 2023-11-28T20:55:34.840 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:55:34.841 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:55:34.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.981+0000 7f5934e09640 1 Processor -- start 2023-11-28T20:55:34.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.981+0000 7f5934e09640 1 -- start start 2023-11-28T20:55:34.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f5934e09640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5930153db0 0x7f593015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:34.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f5934e09640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300cfef0 con 0x7f59300ccb70 2023-11-28T20:55:34.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f5934e09640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300cc6e0 con 0x7f59300cf440 2023-11-28T20:55:34.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f5934e09640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5930154190 con 0x7f5930153db0 2023-11-28T20:55:34.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f5927fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f59300ccb70 0x7f59300c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46566/0 (socket says 172.21.15.167:46566) 2023-11-28T20:55:34.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f5927fff640 1 -- 172.21.15.167:0/171582405 learned_addr learned my addr 172.21.15.167:0/171582405 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:55:34.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f592f7fe640 1 --2- 172.21.15.167:0/171582405 >> v2:172.21.15.178:3300/0 conn(0x7f5930153db0 0x7f593015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:34.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f592effd640 1 -- 172.21.15.167:0/171582405 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724523184 0 0) 0x7f59300cfef0 con 0x7f59300ccb70 2023-11-28T20:55:34.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f592effd640 1 -- 172.21.15.167:0/171582405 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f591c003530 con 0x7f59300ccb70 2023-11-28T20:55:34.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f592f7fe640 1 -- 172.21.15.167:0/171582405 >> v1:172.21.15.178:6789/0 conn(0x7f59300cf440 legacy=0x7f59300ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:34.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f592effd640 1 -- 172.21.15.167:0/171582405 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3420152535 0 0) 0x7f591c003530 con 0x7f59300ccb70 2023-11-28T20:55:34.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f592f7fe640 1 -- 172.21.15.167:0/171582405 >> v1:172.21.15.167:6789/0 conn(0x7f59300ccb70 legacy=0x7f59300c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:34.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.985+0000 7f592f7fe640 1 -- 172.21.15.167:0/171582405 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300cbad0 con 0x7f5930153db0 2023-11-28T20:55:34.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f592f7fe640 1 --2- 172.21.15.167:0/171582405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5930153db0 0x7f593015a540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59200097c0 tx=0x7f592001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75368e92cce993c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:34.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f592effd640 1 -- 172.21.15.167:0/171582405 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918001680 con 0x7f5930153db0 2023-11-28T20:55:34.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f592effd640 1 -- 172.21.15.167:0/171582405 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59200a7050 con 0x7f5930153db0 2023-11-28T20:55:34.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f592effd640 1 -- 172.21.15.167:0/171582405 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200ab600 con 0x7f5930153db0 2023-11-28T20:55:34.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f5934e09640 1 -- 172.21.15.167:0/171582405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5930153db0 msgr2=0x7f593015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:34.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f5934e09640 1 --2- 172.21.15.167:0/171582405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5930153db0 0x7f593015a540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59200097c0 tx=0x7f592001c3a0 comp rx=0 tx=0).stop 2023-11-28T20:55:34.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f5934e09640 1 -- 172.21.15.167:0/171582405 shutdown_connections 2023-11-28T20:55:34.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f5934e09640 1 --2- 172.21.15.167:0/171582405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5930153db0 0x7f593015a540 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:34.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f5934e09640 1 -- 172.21.15.167:0/171582405 >> 172.21.15.167:0/171582405 conn(0x7f593006b800 msgr2=0x7f593006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:34.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f5934e09640 1 -- 172.21.15.167:0/171582405 shutdown_connections 2023-11-28T20:55:34.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.989+0000 7f5934e09640 1 -- 172.21.15.167:0/171582405 wait complete. 2023-11-28T20:55:34.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 Processor -- start 2023-11-28T20:55:34.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 -- start start 2023-11-28T20:55:34.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59300ccb70 0x7f59300b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:34.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59300cf440 0x7f59301588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:34.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5930153db0 0x7f5930140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:34.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301f35d0 con 0x7f5930153db0 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930157fd0 con 0x7f59300cf440 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59301f2c70 con 0x7f59300ccb70 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5930153db0 0x7f5930140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5930153db0 0x7f5930140b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34494/0 (socket says 172.21.15.167:34494) 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592ffff640 1 -- 172.21.15.167:0/1936628761 learned_addr learned my addr 172.21.15.167:0/1936628761 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592f7fe640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59300ccb70 0x7f59300b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5927fff640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59300cf440 0x7f59301588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592ffff640 1 -- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59300ccb70 msgr2=0x7f59300b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592ffff640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59300ccb70 0x7f59300b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592ffff640 1 -- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59300cf440 msgr2=0x7f59301588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:34.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592ffff640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59300cf440 0x7f59301588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592ffff640 1 -- 172.21.15.167:0/1936628761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009420 con 0x7f5930153db0 2023-11-28T20:55:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592ffff640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5930153db0 0x7f5930140b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f592800c730 tx=0x7f592800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592cff9640 1 -- 172.21.15.167:0/1936628761 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928003b80 con 0x7f5930153db0 2023-11-28T20:55:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592cff9640 1 -- 172.21.15.167:0/1936628761 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5928003ce0 con 0x7f5930153db0 2023-11-28T20:55:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f592cff9640 1 -- 172.21.15.167:0/1936628761 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592800aa30 con 0x7f5930153db0 2023-11-28T20:55:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5930157d10 con 0x7f5930153db0 2023-11-28T20:55:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59301f2f10 con 0x7f5930153db0 2023-11-28T20:55:34.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.993+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59301f3710 con 0x7f5930153db0 2023-11-28T20:55:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.997+0000 7f592cff9640 1 -- 172.21.15.167:0/1936628761 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f592800ab90 con 0x7f5930153db0 2023-11-28T20:55:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.997+0000 7f592cff9640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f59100664a0 0x7f5910068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.997+0000 7f592cff9640 1 -- 172.21.15.167:0/1936628761 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5928084880 con 0x7f5930153db0 2023-11-28T20:55:34.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.997+0000 7f592f7fe640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f59100664a0 0x7f5910068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:34.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:34.997+0000 7f592f7fe640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f59100664a0 0x7f5910068960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f59200ad000 tx=0x7f59200a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.001+0000 7f592cff9640 1 -- 172.21.15.167:0/1936628761 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59280519a0 con 0x7f5930153db0 2023-11-28T20:55:35.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.201+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f59301f3710 con 0x7f5930153db0 2023-11-28T20:55:35.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f592cff9640 1 -- 172.21.15.167:0/1936628761 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f59301f3710 con 0x7f5930153db0 2023-11-28T20:55:35.205 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:55:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f59100664a0 msgr2=0x7f5910068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f59100664a0 0x7f5910068960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f59200ad000 tx=0x7f59200a6000 comp rx=0 tx=0).stop 2023-11-28T20:55:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5930153db0 msgr2=0x7f5930140b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5930153db0 0x7f5930140b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f592800c730 tx=0x7f592800cbf0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 shutdown_connections 2023-11-28T20:55:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f59100664a0 0x7f5910068960 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5930153db0 0x7f5930140b60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59300cf440 0x7f59301588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 --2- 172.21.15.167:0/1936628761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59300ccb70 0x7f59300b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 >> 172.21.15.167:0/1936628761 conn(0x7f593006b800 msgr2=0x7f593014e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 shutdown_connections 2023-11-28T20:55:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.205+0000 7f5934e09640 1 -- 172.21.15.167:0/1936628761 wait complete. 2023-11-28T20:55:35.226 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:55:35.226 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:55:35.226 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:55:35.227 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:55:35.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64e0de6640 1 Processor -- start 2023-11-28T20:55:35.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64e0de6640 1 -- start start 2023-11-28T20:55:35.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64e0de6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc0c5c90 0x7f64dc1635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64e0de6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc0c7a50 con 0x7f64dc151f60 2023-11-28T20:55:35.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64e0de6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc15b220 con 0x7f64dc0c75c0 2023-11-28T20:55:35.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64e0de6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0c4da0 con 0x7f64dc0c5c90 2023-11-28T20:55:35.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64da59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f64dc151f60 0x7f64dc0c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46574/0 (socket says 172.21.15.167:46574) 2023-11-28T20:55:35.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64da59c640 1 -- 172.21.15.167:0/126509068 learned_addr learned my addr 172.21.15.167:0/126509068 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:55:35.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64dad9d640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc0c5c90 0x7f64dc1635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551796573 0 0) 0x7f64c4001120 con 0x7f64dc151f60 2023-11-28T20:55:35.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c8003530 con 0x7f64dc151f60 2023-11-28T20:55:35.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4144974142 0 0) 0x7f64c8003530 con 0x7f64dc151f60 2023-11-28T20:55:35.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc0c5c90 msgr2=0x7f64dc1635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:35.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc0c5c90 0x7f64dc1635c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 >> v1:172.21.15.178:6789/0 conn(0x7f64dc0c75c0 legacy=0x7f64dc06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc152340 con 0x7f64dc151f60 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f64c4001810 con 0x7f64dc151f60 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 >> v1:172.21.15.167:6789/0 conn(0x7f64dc151f60 legacy=0x7f64dc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c8004360 0x7f64c8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc0c5c90 0x7f64c8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c800ba40 con 0x7f64c80039b0 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c800bb80 con 0x7f64c8004360 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.365+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c800bd40 con 0x7f64dc0c5c90 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64da59c640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64d1d9b640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c8004360 0x7f64c8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64dad9d640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc0c5c90 0x7f64c8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64da59c640 1 -- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc0c5c90 msgr2=0x7f64c8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:35.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64da59c640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc0c5c90 0x7f64c8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64da59c640 1 -- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c8004360 msgr2=0x7f64c8004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:35.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64da59c640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c8004360 0x7f64c8004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64da59c640 1 -- 172.21.15.167:0/126509068 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c8003530 con 0x7f64c80039b0 2023-11-28T20:55:35.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64da59c640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64c8003d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64c400c190 tx=0x7f64c401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b593406cd68b2df3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40058e0 con 0x7f64c80039b0 2023-11-28T20:55:35.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4005a40 con 0x7f64c80039b0 2023-11-28T20:55:35.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.369+0000 7f64d9d9b640 1 -- 172.21.15.167:0/126509068 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4005dd0 con 0x7f64c80039b0 2023-11-28T20:55:35.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 -- 172.21.15.167:0/126509068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 msgr2=0x7f64c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 --2- 172.21.15.167:0/126509068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64c8003d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64c400c190 tx=0x7f64c401cbc0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64dad9d640 1 -- 172.21.15.167:0/126509068 reap_dead start 2023-11-28T20:55:35.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 -- 172.21.15.167:0/126509068 shutdown_connections 2023-11-28T20:55:35.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 -- 172.21.15.167:0/126509068 >> 172.21.15.167:0/126509068 conn(0x7f64dc0cb1e0 msgr2=0x7f64dc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:35.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 -- 172.21.15.167:0/126509068 shutdown_connections 2023-11-28T20:55:35.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 -- 172.21.15.167:0/126509068 wait complete. 2023-11-28T20:55:35.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 Processor -- start 2023-11-28T20:55:35.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 -- start start 2023-11-28T20:55:35.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64dc15a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc1edd50 0x7f64dc1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64dc152520 0x7f64dc154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc150d90 con 0x7f64c80039b0 2023-11-28T20:55:35.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc15aea0 con 0x7f64dc152520 2023-11-28T20:55:35.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64e0de6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc15b130 con 0x7f64dc1edd50 2023-11-28T20:55:35.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64da59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64dc15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64da59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64dc15a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34512/0 (socket says 172.21.15.167:34512) 2023-11-28T20:55:35.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64da59c640 1 -- 172.21.15.167:0/3238961241 learned_addr learned my addr 172.21.15.167:0/3238961241 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:35.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64dad9d640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64dc152520 0x7f64dc154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64d1d9b640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc1edd50 0x7f64dc1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64da59c640 1 -- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc1edd50 msgr2=0x7f64dc1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64da59c640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64dc1edd50 0x7f64dc1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64da59c640 1 -- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64dc152520 msgr2=0x7f64dc154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64da59c640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64dc152520 0x7f64dc154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.373+0000 7f64da59c640 1 -- 172.21.15.167:0/3238961241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc1541f0 con 0x7f64c80039b0 2023-11-28T20:55:35.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64dad9d640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64dc152520 0x7f64dc154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:55:35.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64da59c640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64dc15a960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f64c401c9f0 tx=0x7f64c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40b4070 con 0x7f64c80039b0 2023-11-28T20:55:35.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40015d0 con 0x7f64c80039b0 2023-11-28T20:55:35.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc1544d0 con 0x7f64c80039b0 2023-11-28T20:55:35.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40070a0 con 0x7f64c80039b0 2023-11-28T20:55:35.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc153ef0 con 0x7f64c80039b0 2023-11-28T20:55:35.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64e0de6640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1438a0 0x7f64dc143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc074770 con 0x7f64dc1438a0 2023-11-28T20:55:35.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d1d9b640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1438a0 0x7f64dc143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d1d9b640 1 -- 172.21.15.167:0/3238961241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64dc15ba30 con 0x7f64dc1438a0 2023-11-28T20:55:35.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d1d9b640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1438a0 0x7f64dc143c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0cb8f0 tx=0x7f64cc001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc006ab0 con 0x7f64dc1438a0 2023-11-28T20:55:35.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64c4007220 con 0x7f64c80039b0 2023-11-28T20:55:35.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64bc066540 0x7f64bc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f64c411db50 con 0x7f64c80039b0 2023-11-28T20:55:35.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f64cc006c10 con 0x7f64dc1438a0 2023-11-28T20:55:35.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1438a0 msgr2=0x7f64dc143c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1438a0 0x7f64dc143c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0cb8f0 tx=0x7f64cc001860 comp rx=0 tx=0).stop 2023-11-28T20:55:35.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1438a0 msgr2=0x7f64dc143c80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:35.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64d37fe640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1438a0 0x7f64dc143c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.377+0000 7f64dad9d640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64bc066540 0x7f64bc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.381+0000 7f64dad9d640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64bc066540 0x7f64bc068a00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0c79a0 tx=0x7f64d400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1f12c0 0x7f64dc1f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc154660 con 0x7f64dc1f12c0 2023-11-28T20:55:35.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64d1d9b640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1f12c0 0x7f64dc1f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64d1d9b640 1 -- 172.21.15.167:0/3238961241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f64dc15b750 con 0x7f64dc1f12c0 2023-11-28T20:55:35.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64d1d9b640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1f12c0 0x7f64dc1f16d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0cb8f0 tx=0x7f64cc0012c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc023070 con 0x7f64dc1f12c0 2023-11-28T20:55:35.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4473 (secure 0 0 0) 0x7f64cc027410 con 0x7f64dc1f12c0 2023-11-28T20:55:35.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1f12c0 msgr2=0x7f64dc1f16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64d37fe640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1f12c0 0x7f64dc1f16d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0cb8f0 tx=0x7f64cc0012c0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64d37fe640 1 -- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1f12c0 msgr2=0x7f64dc1f16d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:35.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64d37fe640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64dc1f12c0 0x7f64dc1f16d0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0cb8f0 tx=0x7f64cc0012c0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.388 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:55:35.388 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:35.388 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:35.388 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:55:35.388 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 136, 2023-11-28T20:55:35.388 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:55:35.388 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:55:35.388 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:35.389 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:35.390 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:35.390 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:35.390 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:35.390 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:35.390 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:35.390 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:35.391 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.391 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:55:35.391 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:55:35.391 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:35.391 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:55:35.393 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:35.394 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:35.395 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:35.395 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:35.395 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:35.395 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:35.395 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.395 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:55:35.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.396 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:55:35.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.396 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:35.396 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:35.396 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:35.396 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:35.396 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.397 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.398 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:55:35.399 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:55:35.400 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:35.401 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.402 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:55:35.403 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:55:35.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64bc066540 msgr2=0x7f64bc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f64bc066540 0x7f64bc068a00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f64dc0c79a0 tx=0x7f64d400b040 comp rx=0 tx=0).stop 2023-11-28T20:55:35.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 msgr2=0x7f64dc15a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64dc15a960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f64c401c9f0 tx=0x7f64c8005800 comp rx=0 tx=0).stop 2023-11-28T20:55:35.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64dad9d640 1 -- 172.21.15.167:0/3238961241 reap_dead start 2023-11-28T20:55:35.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 shutdown_connections 2023-11-28T20:55:35.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 --2- 172.21.15.167:0/3238961241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64c80039b0 0x7f64dc15a960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 >> 172.21.15.167:0/3238961241 conn(0x7f64dc0cb1e0 msgr2=0x7f64dc073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:35.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 shutdown_connections 2023-11-28T20:55:35.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.385+0000 7f64e0de6640 1 -- 172.21.15.167:0/3238961241 wait complete. 2023-11-28T20:55:35.406 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:55:35.406 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:55:35.406 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:55:35.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b3891640 1 Processor -- start 2023-11-28T20:55:35.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b3891640 1 -- start start 2023-11-28T20:55:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b3891640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f18ac153fa0 0x7f18ac0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b3891640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 0x7f18ac06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b3891640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac15ada0 con 0x7f18ac0c63d0 2023-11-28T20:55:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b3891640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac159f40 con 0x7f18ac153fa0 2023-11-28T20:55:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b3891640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15a220 con 0x7f18ac15de80 2023-11-28T20:55:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b162d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f18ac153fa0 0x7f18ac0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b162d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f18ac153fa0 0x7f18ac0c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34536/0 (socket says 172.21.15.167:34536) 2023-11-28T20:55:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.545+0000 7f18b162d640 1 -- 172.21.15.167:0/3009895881 learned_addr learned my addr 172.21.15.167:0/3009895881 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18b1e2e640 1 --2- 172.21.15.167:0/3009895881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 0x7f18ac06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18b162d640 1 -- 172.21.15.167:0/3009895881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 msgr2=0x7f18ac06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18b162d640 1 --2- 172.21.15.167:0/3009895881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 0x7f18ac06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18b162d640 1 -- 172.21.15.167:0/3009895881 >> v1:172.21.15.178:6789/0 conn(0x7f18ac0c63d0 legacy=0x7f18ac15d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18b162d640 1 -- 172.21.15.167:0/3009895881 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac15a500 con 0x7f18ac153fa0 2023-11-28T20:55:35.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18b162d640 1 --2- 172.21.15.167:0/3009895881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac153fa0 0x7f18ac0c5e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009870 tx=0x7f18a801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4c32d3420b046b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18a3fff640 1 -- 172.21.15.167:0/3009895881 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80ab620 con 0x7f18ac153fa0 2023-11-28T20:55:35.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18a3fff640 1 -- 172.21.15.167:0/3009895881 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a80ab780 con 0x7f18ac153fa0 2023-11-28T20:55:35.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18a3fff640 1 -- 172.21.15.167:0/3009895881 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80abb10 con 0x7f18ac153fa0 2023-11-28T20:55:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18b3891640 1 -- 172.21.15.167:0/3009895881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac153fa0 msgr2=0x7f18ac0c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.549+0000 7f18b3891640 1 --2- 172.21.15.167:0/3009895881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac153fa0 0x7f18ac0c5e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009870 tx=0x7f18a801c510 comp rx=0 tx=0).stop 2023-11-28T20:55:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 -- 172.21.15.167:0/3009895881 shutdown_connections 2023-11-28T20:55:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 --2- 172.21.15.167:0/3009895881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 0x7f18ac06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 --2- 172.21.15.167:0/3009895881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac153fa0 0x7f18ac0c5e90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 -- 172.21.15.167:0/3009895881 >> 172.21.15.167:0/3009895881 conn(0x7f18ac0cb1e0 msgr2=0x7f18ac0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 -- 172.21.15.167:0/3009895881 shutdown_connections 2023-11-28T20:55:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 -- 172.21.15.167:0/3009895881 wait complete. 2023-11-28T20:55:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 Processor -- start 2023-11-28T20:55:35.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 -- start start 2023-11-28T20:55:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac0c63d0 0x7f18ac0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac153fa0 0x7f18ac0c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 0x7f18ac0c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac13f210 con 0x7f18ac0c63d0 2023-11-28T20:55:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac13aae0 con 0x7f18ac153fa0 2023-11-28T20:55:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b3891640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac142b20 con 0x7f18ac15de80 2023-11-28T20:55:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b162d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac0c63d0 0x7f18ac0c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b162d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac0c63d0 0x7f18ac0c4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34552/0 (socket says 172.21.15.167:34552) 2023-11-28T20:55:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b162d640 1 -- 172.21.15.167:0/3585637181 learned_addr learned my addr 172.21.15.167:0/3585637181 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b1e2e640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 0x7f18ac0c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b0e2c640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac153fa0 0x7f18ac0c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b162d640 1 -- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 msgr2=0x7f18ac0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b162d640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 0x7f18ac0c9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b162d640 1 -- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac153fa0 msgr2=0x7f18ac0c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b162d640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac153fa0 0x7f18ac0c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b162d640 1 -- 172.21.15.167:0/3585637181 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80094d0 con 0x7f18ac0c63d0 2023-11-28T20:55:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b1e2e640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18ac15de80 0x7f18ac0c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:55:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.553+0000 7f18b162d640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac0c63d0 0x7f18ac0c4420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18a801abc0 tx=0x7f18a801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80be3f0 con 0x7f18ac0c63d0 2023-11-28T20:55:35.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a80be550 con 0x7f18ac0c63d0 2023-11-28T20:55:35.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac071ed0 con 0x7f18ac0c63d0 2023-11-28T20:55:35.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80be900 con 0x7f18ac0c63d0 2023-11-28T20:55:35.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac1421f0 con 0x7f18ac0c63d0 2023-11-28T20:55:35.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18b3891640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac150f80 0x7f18ac0c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac074770 con 0x7f18ac150f80 2023-11-28T20:55:35.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18b0e2c640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac150f80 0x7f18ac0c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18b0e2c640 1 -- 172.21.15.167:0/3585637181 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18ac166f40 con 0x7f18ac150f80 2023-11-28T20:55:35.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18a80b43f0 con 0x7f18ac0c63d0 2023-11-28T20:55:35.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18b0e2c640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac150f80 0x7f18ac0c9760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18ac14a9c0 tx=0x7f189c00e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1890066470 0x7f1890068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f18a811e5e0 con 0x7f18ac0c63d0 2023-11-28T20:55:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c0052e0 con 0x7f18ac150f80 2023-11-28T20:55:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18b1e2e640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1890066470 0x7f1890068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f189c005440 con 0x7f18ac150f80 2023-11-28T20:55:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac150f80 msgr2=0x7f18ac0c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac150f80 0x7f18ac0c9760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18ac14a9c0 tx=0x7f189c00e960 comp rx=0 tx=0).stop 2023-11-28T20:55:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac150f80 msgr2=0x7f18ac0c9760 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.557+0000 7f18a1ffb640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac150f80 0x7f18ac0c9760 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18ac14a9c0 tx=0x7f189c00e960 comp rx=0 tx=0).stop 2023-11-28T20:55:35.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.561+0000 7f18b1e2e640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1890066470 0x7f1890068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009fa0 tx=0x7f18a400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.565+0000 7f18b3891640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1423e0 0x7f18ac0ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.565+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0682c0 con 0x7f18ac1423e0 2023-11-28T20:55:35.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.565+0000 7f18b0e2c640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1423e0 0x7f18ac0ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.565+0000 7f18b0e2c640 1 -- 172.21.15.167:0/3585637181 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f18ac075c90 con 0x7f18ac1423e0 2023-11-28T20:55:35.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.565+0000 7f18b0e2c640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1423e0 0x7f18ac0ca4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18ac15d160 tx=0x7f189c001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.565+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c021070 con 0x7f18ac1423e0 2023-11-28T20:55:35.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.565+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4641 (secure 0 0 0) 0x7f189c007020 con 0x7f18ac1423e0 2023-11-28T20:55:35.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.565+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1423e0 msgr2=0x7f18ac0ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.565+0000 7f18a1ffb640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1423e0 0x7f18ac0ca4f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18ac15d160 tx=0x7f189c001130 comp rx=0 tx=0).stop 2023-11-28T20:55:35.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18a1ffb640 1 -- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1423e0 msgr2=0x7f18ac0ca4f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:35.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18a1ffb640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1423e0 0x7f18ac0ca4f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 136, 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:55:35.569 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:35.570 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:55:35.571 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:55:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:35.572 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:55:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:55:35.573 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:55:35.574 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:35.575 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:35.576 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.577 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.578 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.579 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:55:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:55:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:35.580 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.581 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.582 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:35.583 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:55:35.584 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:55:35.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1890066470 msgr2=0x7f1890068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b3891640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1890066470 0x7f1890068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009fa0 tx=0x7f18a400b040 comp rx=0 tx=0).stop 2023-11-28T20:55:35.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac0c63d0 msgr2=0x7f18ac0c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b3891640 1 --2- 172.21.15.167:0/3585637181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18ac0c63d0 0x7f18ac0c4420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18a801abc0 tx=0x7f18a801ad50 comp rx=0 tx=0).stop 2023-11-28T20:55:35.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b1e2e640 1 -- 172.21.15.167:0/3585637181 reap_dead start 2023-11-28T20:55:35.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b1e2e640 1 -- 172.21.15.167:0/3585637181 reap_dead start 2023-11-28T20:55:35.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 shutdown_connections 2023-11-28T20:55:35.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 >> 172.21.15.167:0/3585637181 conn(0x7f18ac0cb1e0 msgr2=0x7f18ac140d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:35.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 shutdown_connections 2023-11-28T20:55:35.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.569+0000 7f18b3891640 1 -- 172.21.15.167:0/3585637181 wait complete. 2023-11-28T20:55:35.587 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:55:35.587 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:55:35.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:55:35.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8e2396640 1 Processor -- start 2023-11-28T20:55:35.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8e2396640 1 -- start start 2023-11-28T20:55:35.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8e2396640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8dc0cf860 0x7fc8dc0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8e2396640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8dc0cfc40 0x7fc8dc0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8e2396640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc15ac00 con 0x7fc8dc153ae0 2023-11-28T20:55:35.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8e2396640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc0cbd60 con 0x7fc8dc0cfc40 2023-11-28T20:55:35.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8e2396640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc159ff0 con 0x7fc8dc0cf860 2023-11-28T20:55:35.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8db7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8dc0cfc40 0x7fc8dc0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8db7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8dc0cfc40 0x7fc8dc0ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34556/0 (socket says 172.21.15.167:34556) 2023-11-28T20:55:35.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8db7fe640 1 -- 172.21.15.167:0/232821555 learned_addr learned my addr 172.21.15.167:0/232821555 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:35.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8dbfff640 1 --2- 172.21.15.167:0/232821555 >> v2:172.21.15.178:3300/0 conn(0x7fc8dc0cf860 0x7fc8dc0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8db7fe640 1 -- 172.21.15.167:0/232821555 >> v2:172.21.15.178:3300/0 conn(0x7fc8dc0cf860 msgr2=0x7fc8dc0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:35.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8db7fe640 1 --2- 172.21.15.167:0/232821555 >> v2:172.21.15.178:3300/0 conn(0x7fc8dc0cf860 0x7fc8dc0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8db7fe640 1 -- 172.21.15.167:0/232821555 >> v1:172.21.15.178:6789/0 conn(0x7fc8dc153ae0 legacy=0x7fc8dc15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:35.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.741+0000 7fc8db7fe640 1 -- 172.21.15.167:0/232821555 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc15a2d0 con 0x7fc8dc0cfc40 2023-11-28T20:55:35.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8db7fe640 1 --2- 172.21.15.167:0/232821555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cfc40 0x7fc8dc0ca510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0d03b0 tx=0x7fc8d001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e6531dc71d6c4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8daffd640 1 -- 172.21.15.167:0/232821555 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00aa5f0 con 0x7fc8dc0cfc40 2023-11-28T20:55:35.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8daffd640 1 -- 172.21.15.167:0/232821555 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d00aa750 con 0x7fc8dc0cfc40 2023-11-28T20:55:35.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8daffd640 1 -- 172.21.15.167:0/232821555 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00aaae0 con 0x7fc8dc0cfc40 2023-11-28T20:55:35.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8e2396640 1 -- 172.21.15.167:0/232821555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cfc40 msgr2=0x7fc8dc0ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8e2396640 1 --2- 172.21.15.167:0/232821555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cfc40 0x7fc8dc0ca510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0d03b0 tx=0x7fc8d001c490 comp rx=0 tx=0).stop 2023-11-28T20:55:35.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8e2396640 1 -- 172.21.15.167:0/232821555 shutdown_connections 2023-11-28T20:55:35.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8e2396640 1 --2- 172.21.15.167:0/232821555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cfc40 0x7fc8dc0ca510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8e2396640 1 --2- 172.21.15.167:0/232821555 >> v2:172.21.15.178:3300/0 conn(0x7fc8dc0cf860 0x7fc8dc0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8e2396640 1 -- 172.21.15.167:0/232821555 >> 172.21.15.167:0/232821555 conn(0x7fc8dc06c1f0 msgr2=0x7fc8dc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:35.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8e2396640 1 -- 172.21.15.167:0/232821555 shutdown_connections 2023-11-28T20:55:35.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8e2396640 1 -- 172.21.15.167:0/232821555 wait complete. 2023-11-28T20:55:35.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.745+0000 7fc8e2396640 1 Processor -- start 2023-11-28T20:55:35.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 -- start start 2023-11-28T20:55:35.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cf860 0x7fc8dc154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0cfc40 0x7fc8dc149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc153ae0 0x7fc8dc0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0c8e70 con 0x7fc8dc0cf860 2023-11-28T20:55:35.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc158da0 con 0x7fc8dc153ae0 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0c88d0 con 0x7fc8dc0cfc40 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cf860 0x7fc8dc154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8dbfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cf860 0x7fc8dc154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34560/0 (socket says 172.21.15.167:34560) 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8dbfff640 1 -- 172.21.15.167:0/447995356 learned_addr learned my addr 172.21.15.167:0/447995356 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e0933640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc153ae0 0x7fc8dc0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8db7fe640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0cfc40 0x7fc8dc149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8dbfff640 1 -- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0cfc40 msgr2=0x7fc8dc149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8dbfff640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0cfc40 0x7fc8dc149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8dbfff640 1 -- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc153ae0 msgr2=0x7fc8dc0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8dbfff640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc153ae0 0x7fc8dc0b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8dbfff640 1 -- 172.21.15.167:0/447995356 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00094d0 con 0x7fc8dc0cf860 2023-11-28T20:55:35.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e0933640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc153ae0 0x7fc8dc0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:55:35.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8dbfff640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cf860 0x7fc8dc154830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00d5f0 tx=0x7fc8cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc0125f0 con 0x7fc8dc0cf860 2023-11-28T20:55:35.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc012750 con 0x7fc8dc0cf860 2023-11-28T20:55:35.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc0c8b90 con 0x7fc8dc0cf860 2023-11-28T20:55:35.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc012ae0 con 0x7fc8dc0cf860 2023-11-28T20:55:35.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc1592d0 con 0x7fc8dc0cf860 2023-11-28T20:55:35.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc159a20 0x7fc8dc1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc072860 con 0x7fc8dc159a20 2023-11-28T20:55:35.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.749+0000 7fc8db7fe640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc159a20 0x7fc8dc1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8db7fe640 1 -- 172.21.15.167:0/447995356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8dc0caa50 con 0x7fc8dc159a20 2023-11-28T20:55:35.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc8cc012c40 con 0x7fc8dc0cf860 2023-11-28T20:55:35.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8db7fe640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc159a20 0x7fc8dc1477f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0b2240 tx=0x7fc8d001acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8d8ff9640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc8c80664a0 0x7fc8c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc8cc084660 con 0x7fc8dc0cf860 2023-11-28T20:55:35.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00aad80 con 0x7fc8dc159a20 2023-11-28T20:55:35.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc8d00bd410 con 0x7fc8dc159a20 2023-11-28T20:55:35.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc159a20 msgr2=0x7fc8dc1477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8d8ff9640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc159a20 0x7fc8dc1477f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0b2240 tx=0x7fc8d001acd0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc159a20 msgr2=0x7fc8dc1477f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:35.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8d8ff9640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc159a20 0x7fc8dc1477f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8e0933640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc8c80664a0 0x7fc8c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.753+0000 7fc8e0933640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc8c80664a0 0x7fc8c8068960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0c7270 tx=0x7fc8d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.757+0000 7fc8e2396640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0c6c20 0x7fc8dc0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.757+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc1594c0 con 0x7fc8dc0c6c20 2023-11-28T20:55:35.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8db7fe640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0c6c20 0x7fc8dc0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8db7fe640 1 -- 172.21.15.167:0/447995356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc8dc166e40 con 0x7fc8dc0c6c20 2023-11-28T20:55:35.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8db7fe640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0c6c20 0x7fc8dc0b3f80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc8d001a0c0 tx=0x7fc8d0019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00c5ad0 con 0x7fc8dc0c6c20 2023-11-28T20:55:35.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5124 (secure 0 0 0) 0x7fc8d00c5300 con 0x7fc8dc0c6c20 2023-11-28T20:55:35.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0c6c20 msgr2=0x7fc8dc0b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8d8ff9640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0c6c20 0x7fc8dc0b3f80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc8d001a0c0 tx=0x7fc8d0019230 comp rx=0 tx=0).stop 2023-11-28T20:55:35.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8d8ff9640 1 -- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0c6c20 msgr2=0x7fc8dc0b3f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:35.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8d8ff9640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0c6c20 0x7fc8dc0b3f80 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc8d001a0c0 tx=0x7fc8d0019230 comp rx=0 tx=0).stop 2023-11-28T20:55:35.762 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:55:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:35.762 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 136, 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:55:35.763 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:35.764 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:35.765 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:55:35.766 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:55:35.767 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:35.768 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:35.769 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.770 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.771 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:55:35.772 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:55:35.773 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:55:35.774 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.775 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:55:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:55:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.776 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:35.777 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:55:35.778 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.779 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:55:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.780 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:55:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T20:55:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.781 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:55:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:55:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.782 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:55:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.783 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:55:35.784 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:55:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc8c80664a0 msgr2=0x7fc8c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e2396640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc8c80664a0 0x7fc8c8068960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0c7270 tx=0x7fc8d4009040 comp rx=0 tx=0).stop 2023-11-28T20:55:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cf860 msgr2=0x7fc8dc154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e2396640 1 --2- 172.21.15.167:0/447995356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8dc0cf860 0x7fc8dc154830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00d5f0 tx=0x7fc8cc00dab0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e0933640 1 -- 172.21.15.167:0/447995356 reap_dead start 2023-11-28T20:55:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e0933640 1 -- 172.21.15.167:0/447995356 reap_dead start 2023-11-28T20:55:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 shutdown_connections 2023-11-28T20:55:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 >> 172.21.15.167:0/447995356 conn(0x7fc8dc06c1f0 msgr2=0x7fc8dc0662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 shutdown_connections 2023-11-28T20:55:35.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.761+0000 7fc8e2396640 1 -- 172.21.15.167:0/447995356 wait complete. 2023-11-28T20:55:35.787 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:55:35.787 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2023-11-28T20:55:35.787 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:55:35.787 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2023-11-28T20:55:35.787 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:55:35.788 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:55:35.788 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:55:35.820 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:55:35.820 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:55:35.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:55:35.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2d5765640 1 Processor -- start 2023-11-28T20:55:35.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2d5765640 1 -- start start 2023-11-28T20:55:35.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2d5765640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d0150b40 0x7fa2d0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2d5765640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2d00c4510 0x7fa2d006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2d5765640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d00c4940 con 0x7fa2d00c6ff0 2023-11-28T20:55:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2d5765640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d00c62f0 con 0x7fa2d00c4510 2023-11-28T20:55:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2d5765640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00c6ac0 con 0x7fa2d0150b40 2023-11-28T20:55:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2ceffd640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d0150b40 msgr2=0x7fa2d0157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2cf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2d00c4510 0x7fa2d006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d0150b40 0x7fa2d0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2cf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa2d00c4510 0x7fa2d006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34614/0 (socket says 172.21.15.167:34614) 2023-11-28T20:55:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2cf7fe640 1 -- 172.21.15.167:0/910680730 learned_addr learned my addr 172.21.15.167:0/910680730 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:35.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2cf7fe640 1 -- 172.21.15.167:0/910680730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d0150b40 msgr2=0x7fa2d0157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:35.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2cf7fe640 1 --2- 172.21.15.167:0/910680730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d0150b40 0x7fa2d0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2cf7fe640 1 -- 172.21.15.167:0/910680730 >> v1:172.21.15.178:6789/0 conn(0x7fa2d00c6ff0 legacy=0x7fa2d00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.961+0000 7fa2cf7fe640 1 -- 172.21.15.167:0/910680730 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00c6500 con 0x7fa2d00c4510 2023-11-28T20:55:35.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2cf7fe640 1 --2- 172.21.15.167:0/910680730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 0x7fa2d006a580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009e50 tx=0x7fa2c801ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b931096f200393e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2cdffb640 1 -- 172.21.15.167:0/910680730 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80a78f0 con 0x7fa2d00c4510 2023-11-28T20:55:35.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2cdffb640 1 -- 172.21.15.167:0/910680730 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c80a7a50 con 0x7fa2d00c4510 2023-11-28T20:55:35.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2cdffb640 1 -- 172.21.15.167:0/910680730 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80a7de0 con 0x7fa2d00c4510 2023-11-28T20:55:35.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 -- 172.21.15.167:0/910680730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 msgr2=0x7fa2d006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 --2- 172.21.15.167:0/910680730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 0x7fa2d006a580 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009e50 tx=0x7fa2c801ec10 comp rx=0 tx=0).stop 2023-11-28T20:55:35.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 -- 172.21.15.167:0/910680730 shutdown_connections 2023-11-28T20:55:35.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 --2- 172.21.15.167:0/910680730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 0x7fa2d006a580 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 --2- 172.21.15.167:0/910680730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d0150b40 0x7fa2d0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 -- 172.21.15.167:0/910680730 >> 172.21.15.167:0/910680730 conn(0x7fa2d00cb1e0 msgr2=0x7fa2d00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:35.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 -- 172.21.15.167:0/910680730 shutdown_connections 2023-11-28T20:55:35.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 -- 172.21.15.167:0/910680730 wait complete. 2023-11-28T20:55:35.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 Processor -- start 2023-11-28T20:55:35.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.965+0000 7fa2d5765640 1 -- start start 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2d5765640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 0x7fa2d0070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2d5765640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d00c6ff0 0x7fa2d0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2d5765640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d0150b40 0x7fa2d0159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2d5765640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0149dc0 con 0x7fa2d00c4510 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2d5765640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d01f32f0 con 0x7fa2d0150b40 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2d5765640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0157f50 con 0x7fa2d00c6ff0 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ce7fc640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d00c6ff0 msgr2=0x7fa2d0158ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 0x7fa2d0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ce7fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d00c6ff0 0x7fa2d0158ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:35.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 0x7fa2d0070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34618/0 (socket says 172.21.15.167:34618) 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ceffd640 1 -- 172.21.15.167:0/3501324894 learned_addr learned my addr 172.21.15.167:0/3501324894 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2cf7fe640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d0150b40 0x7fa2d0159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ceffd640 1 -- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d00c6ff0 msgr2=0x7fa2d0158ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ceffd640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d00c6ff0 0x7fa2d0158ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ceffd640 1 -- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d0150b40 msgr2=0x7fa2d0159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ceffd640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d0150b40 0x7fa2d0159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ceffd640 1 -- 172.21.15.167:0/3501324894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c8009b30 con 0x7fa2d00c4510 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2ceffd640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 0x7fa2d0070800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000b530 tx=0x7fa2c000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2b77fe640 1 -- 172.21.15.167:0/3501324894 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0003dd0 con 0x7fa2d00c4510 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2b77fe640 1 -- 172.21.15.167:0/3501324894 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c0005070 con 0x7fa2d00c4510 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d0158230 con 0x7fa2d00c4510 2023-11-28T20:55:35.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2b77fe640 1 -- 172.21.15.167:0/3501324894 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0005420 con 0x7fa2d00c4510 2023-11-28T20:55:35.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d01587f0 con 0x7fa2d00c4510 2023-11-28T20:55:35.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d00682c0 con 0x7fa2d00c4510 2023-11-28T20:55:35.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.969+0000 7fa2b77fe640 1 -- 172.21.15.167:0/3501324894 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2c0005580 con 0x7fa2d00c4510 2023-11-28T20:55:35.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.972+0000 7fa2b77fe640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2bc066420 0x7fa2bc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:35.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.972+0000 7fa2b77fe640 1 -- 172.21.15.167:0/3501324894 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa2c00841a0 con 0x7fa2d00c4510 2023-11-28T20:55:35.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.972+0000 7fa2ce7fc640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2bc066420 0x7fa2bc0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:35.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.972+0000 7fa2ce7fc640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2bc066420 0x7fa2bc0688e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4001040 tx=0x7fa2c4007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:35.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:35.976+0000 7fa2b77fe640 1 -- 172.21.15.167:0/3501324894 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2c0051190 con 0x7fa2d00c4510 2023-11-28T20:55:36.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.180+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa2d0067c40 con 0x7fa2d00c4510 2023-11-28T20:55:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.180+0000 7fa2b77fe640 1 -- 172.21.15.167:0/3501324894 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fa2c00547b0 con 0x7fa2d00c4510 2023-11-28T20:55:36.183 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:55:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2bc066420 msgr2=0x7fa2bc0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2bc066420 0x7fa2bc0688e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4001040 tx=0x7fa2c4007a40 comp rx=0 tx=0).stop 2023-11-28T20:55:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 msgr2=0x7fa2d0070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 0x7fa2d0070800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000b530 tx=0x7fa2c000b9f0 comp rx=0 tx=0).stop 2023-11-28T20:55:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 shutdown_connections 2023-11-28T20:55:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2bc066420 0x7fa2bc0688e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d0150b40 0x7fa2d0159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d00c6ff0 0x7fa2d0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 --2- 172.21.15.167:0/3501324894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2d00c4510 0x7fa2d0070800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 >> 172.21.15.167:0/3501324894 conn(0x7fa2d00cb1e0 msgr2=0x7fa2d0073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 shutdown_connections 2023-11-28T20:55:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:36.184+0000 7fa2d5765640 1 -- 172.21.15.167:0/3501324894 wait complete. 2023-11-28T20:55:39.205 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:55:39.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bd65d1640 1 Processor -- start 2023-11-28T20:55:39.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bd65d1640 1 -- start start 2023-11-28T20:55:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bd65d1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8bd00c75c0 0x7f8bd00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bd65d1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd00c7a50 con 0x7f8bd006a580 2023-11-28T20:55:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bd65d1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd015b220 con 0x7f8bd0151f60 2023-11-28T20:55:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bd65d1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd00c4da0 con 0x7f8bd00c75c0 2023-11-28T20:55:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bcf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8bd00c75c0 0x7f8bd00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bcf7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8bd00c75c0 0x7f8bd00c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34628/0 (socket says 172.21.15.167:34628) 2023-11-28T20:55:39.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bcf7fe640 1 -- 172.21.15.167:0/1887008364 learned_addr learned my addr 172.21.15.167:0/1887008364 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:39.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bcf7fe640 1 -- 172.21.15.167:0/1887008364 >> v1:172.21.15.178:6789/0 conn(0x7f8bd0151f60 legacy=0x7f8bd00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:39.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bcf7fe640 1 -- 172.21.15.167:0/1887008364 >> v1:172.21.15.167:6789/0 conn(0x7f8bd006a580 legacy=0x7f8bd01625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:39.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.352+0000 7f8bcf7fe640 1 -- 172.21.15.167:0/1887008364 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0152340 con 0x7f8bd00c75c0 2023-11-28T20:55:39.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bcf7fe640 1 --2- 172.21.15.167:0/1887008364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 0x7f8bd00c5c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009870 tx=0x7f8bc401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba47d5281ada237a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:39.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bceffd640 1 -- 172.21.15.167:0/1887008364 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40ab600 con 0x7f8bd00c75c0 2023-11-28T20:55:39.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bceffd640 1 -- 172.21.15.167:0/1887008364 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc40a7050 con 0x7f8bd00c75c0 2023-11-28T20:55:39.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bceffd640 1 -- 172.21.15.167:0/1887008364 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40ab980 con 0x7f8bd00c75c0 2023-11-28T20:55:39.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1887008364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 msgr2=0x7f8bd00c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:39.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bd65d1640 1 --2- 172.21.15.167:0/1887008364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 0x7f8bd00c5c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009870 tx=0x7f8bc401c4b0 comp rx=0 tx=0).stop 2023-11-28T20:55:39.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1887008364 shutdown_connections 2023-11-28T20:55:39.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bd65d1640 1 --2- 172.21.15.167:0/1887008364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 0x7f8bd00c5c90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:39.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1887008364 >> 172.21.15.167:0/1887008364 conn(0x7f8bd00cb1e0 msgr2=0x7f8bd00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:39.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1887008364 shutdown_connections 2023-11-28T20:55:39.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.356+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1887008364 wait complete. 2023-11-28T20:55:39.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 Processor -- start 2023-11-28T20:55:39.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 -- start start 2023-11-28T20:55:39.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006a580 0x7f8bd00c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:39.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 0x7f8bd01f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd0151f60 0x7f8bd01f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01f29c0 con 0x7f8bd00c75c0 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0072490 con 0x7f8bd0151f60 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01594e0 con 0x7f8bd006a580 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcffff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006a580 msgr2=0x7f8bd00c5b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006a580 0x7f8bd00c5b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 0x7f8bd01f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 0x7f8bd01f6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34630/0 (socket says 172.21.15.167:34630) 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcf7fe640 1 -- 172.21.15.167:0/1284467034 learned_addr learned my addr 172.21.15.167:0/1284467034 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd4b6e640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd0151f60 0x7f8bd01f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcf7fe640 1 -- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006a580 msgr2=0x7f8bd00c5b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:55:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcf7fe640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006a580 0x7f8bd00c5b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcf7fe640 1 -- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd0151f60 msgr2=0x7f8bd01f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcf7fe640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd0151f60 0x7f8bd01f6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcf7fe640 1 -- 172.21.15.167:0/1284467034 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40094d0 con 0x7f8bd00c75c0 2023-11-28T20:55:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bcf7fe640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 0x7f8bd01f6580 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40ae040 tx=0x7f8bc4019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bccff9640 1 -- 172.21.15.167:0/1284467034 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40b8070 con 0x7f8bd00c75c0 2023-11-28T20:55:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bccff9640 1 -- 172.21.15.167:0/1284467034 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc40b35d0 con 0x7f8bd00c75c0 2023-11-28T20:55:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd0071410 con 0x7f8bd00c75c0 2023-11-28T20:55:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bccff9640 1 -- 172.21.15.167:0/1284467034 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40b39a0 con 0x7f8bd00c75c0 2023-11-28T20:55:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.360+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd0158f20 con 0x7f8bd00c75c0 2023-11-28T20:55:39.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.364+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd00682c0 con 0x7f8bd00c75c0 2023-11-28T20:55:39.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.364+0000 7f8bccff9640 1 -- 172.21.15.167:0/1284467034 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8bc40b2070 con 0x7f8bd00c75c0 2023-11-28T20:55:39.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.364+0000 7f8bccff9640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bbc066420 0x7f8bbc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:39.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.364+0000 7f8bccff9640 1 -- 172.21.15.167:0/1284467034 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8bc411dbc0 con 0x7f8bd00c75c0 2023-11-28T20:55:39.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.364+0000 7f8bcffff640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bbc066420 0x7f8bbc0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:39.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.364+0000 7f8bcffff640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bbc066420 0x7f8bbc0688e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0001040 tx=0x7f8bc0007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:39.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.368+0000 7f8bccff9640 1 -- 172.21.15.167:0/1284467034 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bc40eac40 con 0x7f8bd00c75c0 2023-11-28T20:55:39.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8bd00c23f0 con 0x7f8bd00c75c0 2023-11-28T20:55:39.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bccff9640 1 -- 172.21.15.167:0/1284467034 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f8bc40b0080 con 0x7f8bd00c75c0 2023-11-28T20:55:39.578 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":136,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:55:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bbc066420 msgr2=0x7f8bbc0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bbc066420 0x7f8bbc0688e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0001040 tx=0x7f8bc0007a40 comp rx=0 tx=0).stop 2023-11-28T20:55:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 msgr2=0x7f8bd01f6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 0x7f8bd01f6580 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40ae040 tx=0x7f8bc4019250 comp rx=0 tx=0).stop 2023-11-28T20:55:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 shutdown_connections 2023-11-28T20:55:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8bbc066420 0x7f8bbc0688e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bd0151f60 0x7f8bd01f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bd00c75c0 0x7f8bd01f6580 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 --2- 172.21.15.167:0/1284467034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bd006a580 0x7f8bd00c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.576+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 >> 172.21.15.167:0/1284467034 conn(0x7f8bd00cb1e0 msgr2=0x7f8bd00c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.580+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 shutdown_connections 2023-11-28T20:55:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:39.580+0000 7f8bd65d1640 1 -- 172.21.15.167:0/1284467034 wait complete. 2023-11-28T20:55:42.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:55:42.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.736+0000 7f33bffaa640 1 Processor -- start 2023-11-28T20:55:42.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.736+0000 7f33bffaa640 1 -- start start 2023-11-28T20:55:42.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.740+0000 7f33bffaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f33b8161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:42.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.740+0000 7f33bffaa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b815e5e0 con 0x7f33b80c7720 2023-11-28T20:55:42.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.740+0000 7f33bffaa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b815e8c0 con 0x7f33b81585d0 2023-11-28T20:55:42.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.740+0000 7f33bffaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b815f160 con 0x7f33b815e130 2023-11-28T20:55:42.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.740+0000 7f33bd545640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f33b8161de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:42.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.740+0000 7f33bd545640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f33b8161de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:42.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.740+0000 7f33be547640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f33b80c7720 0x7f33b806a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46590/0 (socket says 172.21.15.167:46590) 2023-11-28T20:55:42.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.740+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 learned_addr learned my addr 172.21.15.167:0/4220256384 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:55:42.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.944+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f33b8161de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:42.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:42.944+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f33b8161de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:43.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:43.348+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f33b8161de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:43.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:43.348+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f33b8161de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:44.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:44.152+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f33b8161de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:44.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:44.152+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f33b8161de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f33b8161de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f33b8161de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 >> v1:172.21.15.178:6789/0 conn(0x7f33b81585d0 legacy=0x7f33b80c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 >> v1:172.21.15.167:6789/0 conn(0x7f33b80c7720 legacy=0x7f33b806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b815f160 con 0x7f339c003720 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339c008d20 con 0x7f339c0061f0 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:45.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:45.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:45.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:45.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:45.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:45.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:45.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:45.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:45.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.740+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:45.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:45.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:45.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:45.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:45.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:45.944+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:46.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:46.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:46.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:46.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:46.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:46.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:46.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:46.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:46.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:46.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:46.348+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:47.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:47.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:47.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:47.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:47.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:47.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:47.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:47.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:47.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:47.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:47.152+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:48.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c008690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:48.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:48.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:48.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:48.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 reap_dead start 2023-11-28T20:55:48.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f339c00b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:48.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:48.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:48.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b815f160 con 0x7f339c003720 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339c008d20 con 0x7f339c0061f0 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0087b0 con 0x7f33b815e130 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f339c00b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f339c00b0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c00b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:48.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c00b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:48.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:48.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.740+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f339c00b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f339c00b0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c00b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:48.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c00b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:48.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:48.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:48.944+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:55:49.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f339c00b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:49.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f339c00b0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:49.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:49.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:49.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:55:49.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:49.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:49.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:49.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c00b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:49.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c00b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:49.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:49.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:49.348+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f339c00b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f339c00b0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33bd545640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c00b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c00b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:55:50.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:55:50.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:50.152+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:55:51.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:51.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:51.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 msgr2=0x7f339c00b0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:51.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33b815e130 0x7f339c00b0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 msgr2=0x7f339c00b620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:51.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.178:3300/0 conn(0x7f339c0061f0 0x7f339c00b620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 msgr2=0x7f339c005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:51.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33af7fe640 1 --2- 172.21.15.167:0/4220256384 >> v2:172.21.15.167:3300/0 conn(0x7f339c003720 0x7f339c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b815eba0 con 0x7f339c00bb60 2023-11-28T20:55:51.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33af7fe640 1 -- 172.21.15.167:0/4220256384 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c014220 con 0x7f339c00f670 2023-11-28T20:55:51.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202936306 0 0) 0x7f33b815eba0 con 0x7f339c00bb60 2023-11-28T20:55:51.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a4003530 con 0x7f339c00bb60 2023-11-28T20:55:51.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873151970 0 0) 0x7f33a4003530 con 0x7f339c00bb60 2023-11-28T20:55:51.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 >> v1:172.21.15.178:6789/0 conn(0x7f339c00f670 legacy=0x7f339c011a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:51.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c015420 con 0x7f339c00bb60 2023-11-28T20:55:51.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f33b4001460 con 0x7f339c00bb60 2023-11-28T20:55:51.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 >> v1:172.21.15.167:6789/0 conn(0x7f339c00bb60 legacy=0x7f339c00df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:51.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 reap_dead start 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40039b0 0x7f33a4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40047d0 0x7f33a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33a400b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400c140 con 0x7f33a4005390 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400c2b0 con 0x7f33a40047d0 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400c470 con 0x7f33a40039b0 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bdd46640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40039b0 msgr2=0x7f33a4003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bdd46640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40039b0 0x7f33a4003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33a400b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33bd545640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40047d0 0x7f33a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:51.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40039b0 msgr2=0x7f33a4003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:51.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40039b0 0x7f33a4003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40047d0 msgr2=0x7f33a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:51.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40047d0 0x7f33a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.740+0000 7f33be547640 1 -- 172.21.15.167:0/4220256384 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4003530 con 0x7f33a4005390 2023-11-28T20:55:51.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33be547640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33a400b900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33b806fd20 tx=0x7f33b001d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b34cbc4c189c80a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:51.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00ab620 con 0x7f33a4005390 2023-11-28T20:55:51.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b00ab780 con 0x7f33a4005390 2023-11-28T20:55:51.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bcd44640 1 -- 172.21.15.167:0/4220256384 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00abb30 con 0x7f33a4005390 2023-11-28T20:55:51.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bffaa640 1 -- 172.21.15.167:0/4220256384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 msgr2=0x7f33a400b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:51.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bffaa640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33a400b900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33b806fd20 tx=0x7f33b001d7e0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bffaa640 1 -- 172.21.15.167:0/4220256384 shutdown_connections 2023-11-28T20:55:51.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bffaa640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33a400b900 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bffaa640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40047d0 0x7f33a4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bffaa640 1 --2- 172.21.15.167:0/4220256384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40039b0 0x7f33a4003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bffaa640 1 -- 172.21.15.167:0/4220256384 >> 172.21.15.167:0/4220256384 conn(0x7f33b80cb1e0 msgr2=0x7f33b80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:51.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bffaa640 1 -- 172.21.15.167:0/4220256384 shutdown_connections 2023-11-28T20:55:51.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.744+0000 7f33bffaa640 1 -- 172.21.15.167:0/4220256384 wait complete. 2023-11-28T20:55:51.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bffaa640 1 Processor -- start 2023-11-28T20:55:51.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bffaa640 1 -- start start 2023-11-28T20:55:51.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bffaa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40039b0 0x7f33b81f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:51.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bffaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40047d0 0x7f33b815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:51.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bffaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33b815f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:51.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bffaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81f36f0 con 0x7f33a4005390 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bffaa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81f7bb0 con 0x7f33a40039b0 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bffaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b815f2f0 con 0x7f33a40047d0 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bd545640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40047d0 msgr2=0x7f33b815cca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bd545640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40047d0 0x7f33b815cca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33be547640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33b815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33be547640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33b815f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37934/0 (socket says 172.21.15.167:37934) 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33be547640 1 -- 172.21.15.167:0/1097686060 learned_addr learned my addr 172.21.15.167:0/1097686060 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33bdd46640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40039b0 0x7f33b81f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33be547640 1 -- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40047d0 msgr2=0x7f33b815cca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33be547640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40047d0 0x7f33b815cca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33be547640 1 -- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40039b0 msgr2=0x7f33b81f7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:51.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33be547640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40039b0 0x7f33b81f7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.748+0000 7f33be547640 1 -- 172.21.15.167:0/1097686060 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b81f3900 con 0x7f33a4005390 2023-11-28T20:55:51.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33be547640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33b815f780 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33b001d820 tx=0x7f33a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:51.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33ae7fc640 1 -- 172.21.15.167:0/1097686060 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00abd00 con 0x7f33a4005390 2023-11-28T20:55:51.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33ae7fc640 1 -- 172.21.15.167:0/1097686060 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b00abe60 con 0x7f33a4005390 2023-11-28T20:55:51.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b81f3be0 con 0x7f33a4005390 2023-11-28T20:55:51.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33ae7fc640 1 -- 172.21.15.167:0/1097686060 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00b7640 con 0x7f33a4005390 2023-11-28T20:55:51.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b81f41a0 con 0x7f33a4005390 2023-11-28T20:55:51.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b80682c0 con 0x7f33a4005390 2023-11-28T20:55:51.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33ae7fc640 1 -- 172.21.15.167:0/1097686060 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f33b00b3040 con 0x7f33a4005390 2023-11-28T20:55:51.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33ae7fc640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f339c067780 0x7f339c069c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:51.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33ae7fc640 1 -- 172.21.15.167:0/1097686060 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f33b011e690 con 0x7f33a4005390 2023-11-28T20:55:51.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.752+0000 7f33bdd46640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f339c067780 0x7f339c069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:51.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.756+0000 7f33bdd46640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f339c067780 0x7f339c069c40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f33b4005630 tx=0x7f33b4013040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:51.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.756+0000 7f33ae7fc640 1 -- 172.21.15.167:0/1097686060 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f33b00eb860 con 0x7f33a4005390 2023-11-28T20:55:51.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f33b8075c90 con 0x7f33a4005390 2023-11-28T20:55:51.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33ae7fc640 1 -- 172.21.15.167:0/1097686060 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f33b00b1620 con 0x7f33a4005390 2023-11-28T20:55:51.997 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":140,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f339c067780 msgr2=0x7f339c069c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f339c067780 0x7f339c069c40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f33b4005630 tx=0x7f33b4013040 comp rx=0 tx=0).stop 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 msgr2=0x7f33b815f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33b815f780 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33b001d820 tx=0x7f33a4005800 comp rx=0 tx=0).stop 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 shutdown_connections 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f339c067780 0x7f339c069c40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a4005390 0x7f33b815f780 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a40047d0 0x7f33b815cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 --2- 172.21.15.167:0/1097686060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a40039b0 0x7f33b81f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 >> 172.21.15.167:0/1097686060 conn(0x7f33b80cb1e0 msgr2=0x7f33b814af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 shutdown_connections 2023-11-28T20:55:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:51.996+0000 7f33bffaa640 1 -- 172.21.15.167:0/1097686060 wait complete. 2023-11-28T20:55:52.017 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:55:52.018 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:55:52.018 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:55:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.180+0000 7f6da4e17640 1 Processor -- start 2023-11-28T20:55:52.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.180+0000 7f6da4e17640 1 -- start start 2023-11-28T20:55:52.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.180+0000 7f6da4e17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 0x7f6da0071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.180+0000 7f6da4e17640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6da006e410 0x7f6da0072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.180+0000 7f6da4e17640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da01571d0 con 0x7f6da006e030 2023-11-28T20:55:52.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.180+0000 7f6da4e17640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da0071a90 con 0x7f6da006e410 2023-11-28T20:55:52.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.180+0000 7f6da4e17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00c70d0 con 0x7f6da0070480 2023-11-28T20:55:52.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d95d9b640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 msgr2=0x7f6da0071f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:52.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9e59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6da006e030 0x7f6da01500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:40790/0 (socket says 172.21.15.167:40790) 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9e59c640 1 -- 172.21.15.167:0/2906309616 learned_addr learned my addr 172.21.15.167:0/2906309616 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d95d9b640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 0x7f6da0071f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9ed9d640 1 --2- 172.21.15.167:0/2906309616 >> v2:172.21.15.178:3300/0 conn(0x7f6da006e410 0x7f6da0072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431534025 0 0) 0x7f6da01571d0 con 0x7f6da006e030 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d8c003530 con 0x7f6da006e030 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931377447 0 0) 0x7f6d8c003530 con 0x7f6da006e030 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 msgr2=0x7f6da0071f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 0x7f6da0071f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 >> v2:172.21.15.178:3300/0 conn(0x7f6da006e410 msgr2=0x7f6da0072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 --2- 172.21.15.167:0/2906309616 >> v2:172.21.15.178:3300/0 conn(0x7f6da006e410 0x7f6da0072460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da00c73b0 con 0x7f6da006e030 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f6d90001a00 con 0x7f6da006e030 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 >> v1:172.21.15.167:6789/0 conn(0x7f6da006e030 legacy=0x7f6da01500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 0x7f6d8c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d8c003f20 0x7f6d8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d8c004d10 0x7f6d8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da0071a90 con 0x7f6d8c003f20 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00c70d0 con 0x7f6d8c004d10 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c00baf0 con 0x7f6da0070480 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9e59c640 1 -- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 msgr2=0x7f6d8c0039a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9e59c640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 0x7f6d8c0039a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d95d9b640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d8c003f20 0x7f6d8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9ed9d640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d8c004d10 0x7f6d8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d95d9b640 1 -- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 msgr2=0x7f6d8c0039a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d95d9b640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da0070480 0x7f6d8c0039a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d95d9b640 1 -- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d8c004d10 msgr2=0x7f6d8c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:55:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d95d9b640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d8c004d10 0x7f6d8c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d95d9b640 1 -- 172.21.15.167:0/2906309616 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c003530 con 0x7f6d8c003f20 2023-11-28T20:55:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.184+0000 7f6d9ed9d640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d8c004d10 0x7f6d8c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:55:52.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6d95d9b640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d8c003f20 0x7f6d8c0047d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d88003940 tx=0x7f6d8801e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e6b222ebdb3683 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88003bc0 con 0x7f6d8c003f20 2023-11-28T20:55:52.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d88003d20 con 0x7f6d8c003f20 2023-11-28T20:55:52.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6d9dd9b640 1 -- 172.21.15.167:0/2906309616 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880052b0 con 0x7f6d8c003f20 2023-11-28T20:55:52.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6da4e17640 1 -- 172.21.15.167:0/2906309616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d8c003f20 msgr2=0x7f6d8c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6da4e17640 1 --2- 172.21.15.167:0/2906309616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d8c003f20 0x7f6d8c0047d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d88003940 tx=0x7f6d8801e630 comp rx=0 tx=0).stop 2023-11-28T20:55:52.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6d9ed9d640 1 -- 172.21.15.167:0/2906309616 reap_dead start 2023-11-28T20:55:52.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6da4e17640 1 -- 172.21.15.167:0/2906309616 shutdown_connections 2023-11-28T20:55:52.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6da4e17640 1 -- 172.21.15.167:0/2906309616 >> 172.21.15.167:0/2906309616 conn(0x7f6da00cb1e0 msgr2=0x7f6da00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:52.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6da4e17640 1 -- 172.21.15.167:0/2906309616 shutdown_connections 2023-11-28T20:55:52.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6da4e17640 1 -- 172.21.15.167:0/2906309616 wait complete. 2023-11-28T20:55:52.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6da4e17640 1 Processor -- start 2023-11-28T20:55:52.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.188+0000 7f6da4e17640 1 -- start start 2023-11-28T20:55:52.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d8c003f20 0x7f6da0150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0155170 0x7f6da0157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da0157b50 0x7f6da01478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da01512a0 con 0x7f6da0155170 2023-11-28T20:55:52.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da0154ce0 con 0x7f6da0157b50 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da01535b0 con 0x7f6d8c003f20 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d9e59c640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d8c003f20 msgr2=0x7f6da0150b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d9e59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d8c003f20 0x7f6da0150b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d95d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0155170 0x7f6da0157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d95d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0155170 0x7f6da0157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37952/0 (socket says 172.21.15.167:37952) 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d95d9b640 1 -- 172.21.15.167:0/3188035592 learned_addr learned my addr 172.21.15.167:0/3188035592 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d9ed9d640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da0157b50 0x7f6da01478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d95d9b640 1 -- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d8c003f20 msgr2=0x7f6da0150b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d95d9b640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d8c003f20 0x7f6da0150b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d95d9b640 1 -- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da0157b50 msgr2=0x7f6da01478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d95d9b640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da0157b50 0x7f6da01478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d95d9b640 1 -- 172.21.15.167:0/3188035592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da0153870 con 0x7f6da0155170 2023-11-28T20:55:52.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d95d9b640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0155170 0x7f6da0157610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6d8801e460 tx=0x7f6d8c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88003bc0 con 0x7f6da0155170 2023-11-28T20:55:52.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8800e1d0 con 0x7f6da0155170 2023-11-28T20:55:52.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880ab680 con 0x7f6da0155170 2023-11-28T20:55:52.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da0154970 con 0x7f6da0155170 2023-11-28T20:55:52.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da0072180 con 0x7f6da0155170 2023-11-28T20:55:52.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0153a00 0x7f6da0147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da0074770 con 0x7f6da0153a00 2023-11-28T20:55:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d9e59c640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0153a00 0x7f6da0147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d9e59c640 1 -- 172.21.15.167:0/3188035592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6da00cb5f0 con 0x7f6da0153a00 2023-11-28T20:55:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d9e59c640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0153a00 0x7f6da0147e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d90001cc0 tx=0x7f6d9000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.192+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9000ddb0 con 0x7f6da0153a00 2023-11-28T20:55:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d880a9070 con 0x7f6da0155170 2023-11-28T20:55:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d977fe640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d800664e0 0x7f6d800689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6d8811e900 con 0x7f6da0155170 2023-11-28T20:55:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6d9000a0d0 con 0x7f6da0153a00 2023-11-28T20:55:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0153a00 msgr2=0x7f6da0147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d977fe640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0153a00 0x7f6da0147e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d90001cc0 tx=0x7f6d9000d430 comp rx=0 tx=0).stop 2023-11-28T20:55:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0153a00 msgr2=0x7f6da0147e00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d977fe640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0153a00 0x7f6da0147e00 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d90001cc0 tx=0x7f6d9000d430 comp rx=0 tx=0).stop 2023-11-28T20:55:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d9ed9d640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d800664e0 0x7f6d800689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.196+0000 7f6d9ed9d640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d800664e0 0x7f6d800689a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00bc80 tx=0x7f6d98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.200+0000 7f6da4e17640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da00c58d0 0x7f6da00c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.200+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da0155b30 con 0x7f6da00c58d0 2023-11-28T20:55:52.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.200+0000 7f6d9e59c640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da00c58d0 0x7f6da00c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.200+0000 7f6d9e59c640 1 -- 172.21.15.167:0/3188035592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6da006b4b0 con 0x7f6da00c58d0 2023-11-28T20:55:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.200+0000 7f6d9e59c640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da00c58d0 0x7f6da00c5ce0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d90001cc0 tx=0x7f6d90004b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90023070 con 0x7f6da00c58d0 2023-11-28T20:55:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5114 (secure 0 0 0) 0x7f6d900056f0 con 0x7f6da00c58d0 2023-11-28T20:55:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da00c58d0 msgr2=0x7f6da00c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6d977fe640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da00c58d0 0x7f6da00c5ce0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d90001cc0 tx=0x7f6d90004b70 comp rx=0 tx=0).stop 2023-11-28T20:55:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6d977fe640 1 -- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da00c58d0 msgr2=0x7f6da00c5ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6d977fe640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da00c58d0 0x7f6da00c5ce0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d90001cc0 tx=0x7f6d90004b70 comp rx=0 tx=0).stop 2023-11-28T20:55:52.205 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 140, 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:52.206 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:52.207 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:52.208 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:52.209 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:52.209 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.209 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:55:52.209 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:55:52.209 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:55:52.209 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:55:52.209 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:55:52.210 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:55:52.210 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:52.210 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:52.210 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:55:52.210 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:55:52.210 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:55:52.210 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:55:52.211 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:55:52.211 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:55:52.211 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:55:52.211 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:52.211 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:55:52.211 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:52.211 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:52.211 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:52.212 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:52.212 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:52.212 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:52.212 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:52.212 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:52.212 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:52.212 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:52.212 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.212 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:55:52.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.213 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:55:52.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.213 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:52.213 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:52.213 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:52.213 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:52.213 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.213 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.214 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:55:52.215 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:55:52.215 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:52.215 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:52.215 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:52.215 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.215 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.215 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:52.215 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.216 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.217 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.217 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:55:52.217 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:55:52.217 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:52.217 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:52.217 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:52.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:52.219 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.220 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.221 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:52.222 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.224 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:55:52.224 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d800664e0 msgr2=0x7f6d800689a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6da4e17640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6d800664e0 0x7f6d800689a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00bc80 tx=0x7f6d98008040 comp rx=0 tx=0).stop 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0155170 msgr2=0x7f6da0157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6da4e17640 1 --2- 172.21.15.167:0/3188035592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6da0155170 0x7f6da0157610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6d8801e460 tx=0x7f6d8c005800 comp rx=0 tx=0).stop 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6d9ed9d640 1 -- 172.21.15.167:0/3188035592 reap_dead start 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6d9ed9d640 1 -- 172.21.15.167:0/3188035592 reap_dead start 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 shutdown_connections 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 >> 172.21.15.167:0/3188035592 conn(0x7f6da00cb1e0 msgr2=0x7f6da014ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 shutdown_connections 2023-11-28T20:55:52.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.204+0000 7f6da4e17640 1 -- 172.21.15.167:0/3188035592 wait complete. 2023-11-28T20:55:52.227 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:55:52.227 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:55:52.227 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:55:52.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.404+0000 7f279dcc9640 1 Processor -- start 2023-11-28T20:55:52.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.404+0000 7f279dcc9640 1 -- start start 2023-11-28T20:55:52.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.404+0000 7f279dcc9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 0x7f2798157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.404+0000 7f279dcc9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27980c4510 0x7f279806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.404+0000 7f279dcc9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27980c4940 con 0x7f2798150b40 2023-11-28T20:55:52.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.404+0000 7f279dcc9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27980c62f0 con 0x7f27980c4510 2023-11-28T20:55:52.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.404+0000 7f279dcc9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c6ac0 con 0x7f27980c6ff0 2023-11-28T20:55:52.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f278ffff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 msgr2=0x7f2798157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:52.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f278ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 0x7f2798157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:52.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2797fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27980c4510 0x7f279806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2797fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27980c4510 0x7f279806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37972/0 (socket says 172.21.15.167:37972) 2023-11-28T20:55:52.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2797fff640 1 -- 172.21.15.167:0/1444448396 learned_addr learned my addr 172.21.15.167:0/1444448396 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:52.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2797fff640 1 -- 172.21.15.167:0/1444448396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 msgr2=0x7f2798157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:55:52.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2797fff640 1 --2- 172.21.15.167:0/1444448396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 0x7f2798157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2797fff640 1 -- 172.21.15.167:0/1444448396 >> v1:172.21.15.178:6789/0 conn(0x7f2798150b40 legacy=0x7f27980c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2797fff640 1 -- 172.21.15.167:0/1444448396 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27980c6500 con 0x7f27980c4510 2023-11-28T20:55:52.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2797fff640 1 --2- 172.21.15.167:0/1444448396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 0x7f279806a580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f279000d150 tx=0x7f279001ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d205dc93b59fabf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2796ffd640 1 -- 172.21.15.167:0/1444448396 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279000b2d0 con 0x7f27980c4510 2023-11-28T20:55:52.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2796ffd640 1 -- 172.21.15.167:0/1444448396 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279000b430 con 0x7f27980c4510 2023-11-28T20:55:52.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.408+0000 7f2796ffd640 1 -- 172.21.15.167:0/1444448396 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27900a7b00 con 0x7f27980c4510 2023-11-28T20:55:52.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 -- 172.21.15.167:0/1444448396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 msgr2=0x7f279806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 --2- 172.21.15.167:0/1444448396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 0x7f279806a580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f279000d150 tx=0x7f279001ec00 comp rx=0 tx=0).stop 2023-11-28T20:55:52.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 -- 172.21.15.167:0/1444448396 shutdown_connections 2023-11-28T20:55:52.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 --2- 172.21.15.167:0/1444448396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 0x7f279806a580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 --2- 172.21.15.167:0/1444448396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 0x7f2798157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 -- 172.21.15.167:0/1444448396 >> 172.21.15.167:0/1444448396 conn(0x7f27980cb1e0 msgr2=0x7f27980cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:52.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 -- 172.21.15.167:0/1444448396 shutdown_connections 2023-11-28T20:55:52.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 -- 172.21.15.167:0/1444448396 wait complete. 2023-11-28T20:55:52.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 Processor -- start 2023-11-28T20:55:52.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 -- start start 2023-11-28T20:55:52.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 0x7f27981424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 0x7f2798139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2798150b40 0x7f2798139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980c9580 con 0x7f27980c4510 2023-11-28T20:55:52.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279815a9b0 con 0x7f2798150b40 2023-11-28T20:55:52.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f279dcc9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27980caf70 con 0x7f27980c6ff0 2023-11-28T20:55:52.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f27977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 0x7f27981424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f278ffff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 msgr2=0x7f2798139970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f278ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 0x7f2798139970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f27977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 0x7f27981424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37978/0 (socket says 172.21.15.167:37978) 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f27977fe640 1 -- 172.21.15.167:0/3931634015 learned_addr learned my addr 172.21.15.167:0/3931634015 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f2797fff640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2798150b40 0x7f2798139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f27977fe640 1 -- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 msgr2=0x7f2798139970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f27977fe640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27980c6ff0 0x7f2798139970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f27977fe640 1 -- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2798150b40 msgr2=0x7f2798139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f27977fe640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2798150b40 0x7f2798139eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f27977fe640 1 -- 172.21.15.167:0/3931634015 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279000bd40 con 0x7f27980c4510 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.412+0000 7f27977fe640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 0x7f27981424a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f278800c3c0 tx=0x7f278800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880052d0 con 0x7f27980c4510 2023-11-28T20:55:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2788005430 con 0x7f27980c4510 2023-11-28T20:55:52.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27980caa20 con 0x7f27980c4510 2023-11-28T20:55:52.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788003840 con 0x7f27980c4510 2023-11-28T20:55:52.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279815abe0 con 0x7f27980c4510 2023-11-28T20:55:52.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f279dcc9640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279815a460 0x7f279813e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2798074770 con 0x7f279815a460 2023-11-28T20:55:52.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f278ffff640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279815a460 0x7f279813e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27880039a0 con 0x7f27980c4510 2023-11-28T20:55:52.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f278ffff640 1 -- 172.21.15.167:0/3931634015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2798157040 con 0x7f279815a460 2023-11-28T20:55:52.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f278ffff640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279815a460 0x7f279813e250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f279813fc30 tx=0x7f278000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2778066420 0x7f27780688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2788083880 con 0x7f27980c4510 2023-11-28T20:55:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780003e20 con 0x7f279815a460 2023-11-28T20:55:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2797fff640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2778066420 0x7f27780688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2780005070 con 0x7f279815a460 2023-11-28T20:55:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279815a460 msgr2=0x7f279813e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279815a460 0x7f279813e250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f279813fc30 tx=0x7f278000b8e0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279815a460 msgr2=0x7f279813e250 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.416+0000 7f2794ff9640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279815a460 0x7f279813e250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:55:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.420+0000 7f2797fff640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2778066420 0x7f27780688e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f27900b0000 tx=0x7f27900a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f279dcc9640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279813e790 0x7f27981f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:55:52.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27980682c0 con 0x7f279813e790 2023-11-28T20:55:52.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f278ffff640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279813e790 0x7f27981f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:55:52.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f278ffff640 1 -- 172.21.15.167:0/3931634015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2798075c90 con 0x7f279813e790 2023-11-28T20:55:52.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f278ffff640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279813e790 0x7f27981f1ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f278000bfd0 tx=0x7f2780005a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:55:52.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278001f070 con 0x7f279813e790 2023-11-28T20:55:52.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4799 (secure 0 0 0) 0x7f2780005890 con 0x7f279813e790 2023-11-28T20:55:52.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279813e790 msgr2=0x7f27981f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f2794ff9640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279813e790 0x7f27981f1ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f278000bfd0 tx=0x7f2780005a30 comp rx=0 tx=0).stop 2023-11-28T20:55:52.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f2794ff9640 1 -- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279813e790 msgr2=0x7f27981f1ab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:55:52.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.424+0000 7f2794ff9640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f279813e790 0x7f27981f1ab0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f278000bfd0 tx=0x7f2780005a30 comp rx=0 tx=0).stop 2023-11-28T20:55:52.428 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:55:52.428 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:52.428 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:52.428 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 140, 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:52.429 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:52.430 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:55:52.431 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:55:52.432 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:55:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:55:52.435 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:52.436 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:55:52.437 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:55:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:55:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:55:52.441 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:55:52.442 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:55:52.442 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:55:52.442 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:55:52.442 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:55:52.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:55:52.442 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:55:52.442 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:55:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2778066420 msgr2=0x7f27780688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f279dcc9640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2778066420 0x7f27780688e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f27900b0000 tx=0x7f27900a9070 comp rx=0 tx=0).stop 2023-11-28T20:55:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 msgr2=0x7f27981424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:55:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f279dcc9640 1 --2- 172.21.15.167:0/3931634015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27980c4510 0x7f27981424a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f278800c3c0 tx=0x7f278800c880 comp rx=0 tx=0).stop 2023-11-28T20:55:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f2797fff640 1 -- 172.21.15.167:0/3931634015 reap_dead start 2023-11-28T20:55:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f2797fff640 1 -- 172.21.15.167:0/3931634015 reap_dead start 2023-11-28T20:55:52.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 shutdown_connections 2023-11-28T20:55:52.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 >> 172.21.15.167:0/3931634015 conn(0x7f27980cb1e0 msgr2=0x7f27980c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:55:52.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 shutdown_connections 2023-11-28T20:55:52.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:55:52.428+0000 7f279dcc9640 1 -- 172.21.15.167:0/3931634015 wait complete. 2023-11-28T20:55:52.446 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:55:52.446 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:55:54.912 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 0% (6/622) Updating files: 1% (7/622) Updating files: 2% (13/622) Updating files: 3% (19/622) Updating files: 4% (25/622) Updating files: 4% (30/622) Updating files: 5% (32/622) Updating files: 5% (37/622) Updating files: 6% (38/622) Updating files: 7% (44/622) Updating files: 7% (48/622) Updating files: 8% (50/622) Updating files: 8% (53/622) Updating files: 9% (56/622) Updating files: 10% (63/622) Updating files: 10% (64/622) Updating files: 11% (69/622) Updating files: 12% (75/622) Updating files: 13% (81/622) Updating files: 14% (88/622) Updating files: 15% (94/622) Updating files: 15% (97/622) Updating files: 16% (100/622) Updating files: 17% (106/622) Updating files: 18% (112/622) Updating files: 19% (119/622) Updating files: 20% (125/622) Updating files: 21% (131/622) Updating files: 22% (137/622) Updating files: 23% (144/622) Updating files: 24% (150/622) Updating files: 25% (156/622) Updating files: 26% (162/622) Updating files: 27% (168/622) Updating files: 28% (175/622) Updating files: 29% (181/622) Updating files: 29% (183/622) Updating files: 30% (187/622) Updating files: 31% (193/622) Updating files: 31% (195/622) Updating files: 32% (200/622) Updating files: 33% (206/622) Updating files: 34% (212/622) Updating files: 35% (218/622) Updating files: 36% (224/622) Updating files: 37% (231/622) Updating files: 38% (237/622) Updating files: 39% (243/622) Updating files: 40% (249/622) Updating files: 41% (256/622) Updating files: 42% (262/622) Updating files: 43% (268/622) Updating files: 44% (274/622) Updating files: 45% (280/622) Updating files: 46% (287/622) Updating files: 47% (293/622) Updating files: 48% (299/622) Updating files: 49% (305/622) Updating files: 50% (311/622) Updating files: 51% (318/622) Updating files: 52% (324/622) Updating files: 53% (330/622) Updating files: 54% (336/622) Updating files: 55% (343/622) Updating files: 56% (349/622) Updating files: 57% (355/622) Updating files: 57% (356/622) Updating files: 58% (361/622) Updating files: 59% (367/622) Updating files: 60% (374/622) Updating files: 61% (380/622) Updating files: 61% (385/622) Updating files: 62% (386/622) Updating files: 63% (392/622) Updating files: 64% (399/622) Updating files: 65% (405/622) Updating files: 66% (411/622) Updating files: 67% (417/622) Updating files: 68% (423/622) Updating files: 68% (429/622) Updating files: 69% (430/622) Updating files: 70% (436/622) Updating files: 71% (442/622) Updating files: 71% (447/622) Updating files: 72% (448/622) Updating files: 73% (455/622) Updating files: 74% (461/622) Updating files: 75% (467/622) Updating files: 75% (469/622) Updating files: 76% (473/622) Updating files: 77% (479/622) Updating files: 78% (486/622) Updating files: 79% (492/622) Updating files: 80% (498/622) Updating files: 81% (504/622) Updating files: 82% (511/622) Updating files: 82% (512/622) Updating files: 83% (517/622) Updating files: 84% (523/622) Updating files: 85% (529/622) Updating files: 86% (535/622) Updating files: 87% (542/622) Updating files: 88% (548/622) Updating files: 89% (554/622) Updating files: 90% (560/622) Updating files: 91% (567/622) Updating files: 92% (573/622) Updating files: 93% (579/622) Updating files: 94% (585/622) Updating files: 94% (588/622) Updating files: 95% (591/622) Updating files: 96% (598/622) Updating files: 97% (604/622) Updating files: 98% (610/622) Updating files: 99% (616/622) Updating files: 100% (622/622) Updating files: 100% (622/622), done. 2023-11-28T20:55:55.149 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 3fa121bf0a8 v0.25 2023-11-28T20:55:55.154 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.25 2023-11-28T20:55:55.225 INFO:tasks.workunit.client.0.smithi167.stdout:v0.26 2023-11-28T20:55:55.225 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 26 -eq 48 ] 2023-11-28T20:55:55.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.26 2023-11-28T20:55:55.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.26 2023-11-28T20:55:55.226 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.26 2023-11-28T20:56:00.328 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 37% (90/239) Updating files: 38% (91/239) Updating files: 39% (94/239) Updating files: 40% (96/239) Updating files: 41% (98/239) Updating files: 42% (101/239) Updating files: 43% (103/239) Updating files: 44% (106/239) Updating files: 45% (108/239) Updating files: 46% (110/239) Updating files: 47% (113/239) Updating files: 48% (115/239) Updating files: 49% (118/239) Updating files: 50% (120/239) Updating files: 51% (122/239) Updating files: 52% (125/239) Updating files: 53% (127/239) Updating files: 54% (130/239) Updating files: 55% (132/239) Updating files: 56% (134/239) Updating files: 57% (137/239) Updating files: 58% (139/239) Updating files: 59% (142/239) Updating files: 60% (144/239) Updating files: 61% (146/239) Updating files: 62% (149/239) Updating files: 63% (151/239) Updating files: 64% (153/239) Updating files: 65% (156/239) Updating files: 66% (158/239) Updating files: 67% (161/239) Updating files: 68% (163/239) Updating files: 69% (165/239) Updating files: 70% (168/239) Updating files: 71% (170/239) Updating files: 72% (173/239) Updating files: 73% (175/239) Updating files: 74% (177/239) Updating files: 75% (180/239) Updating files: 76% (182/239) Updating files: 77% (185/239) Updating files: 78% (187/239) Updating files: 79% (189/239) Updating files: 80% (192/239) Updating files: 81% (194/239) Updating files: 82% (196/239) Updating files: 83% (199/239) Updating files: 84% (201/239) Updating files: 85% (204/239) Updating files: 86% (206/239) Updating files: 87% (208/239) Updating files: 88% (211/239) Updating files: 89% (213/239) Updating files: 90% (216/239) Updating files: 91% (218/239) Updating files: 92% (220/239) Updating files: 93% (223/239) Updating files: 94% (225/239) Updating files: 95% (228/239) Updating files: 96% (230/239) Updating files: 97% (232/239) Updating files: 98% (235/239) Updating files: 99% (237/239) Updating files: 100% (239/239) Updating files: 100% (239/239), done. 2023-11-28T20:56:00.445 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 9981ff90968 v0.26 2023-11-28T20:56:00.450 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.26 2023-11-28T20:56:00.494 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 27 -eq 48 ] 2023-11-28T20:56:00.494 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.27 2023-11-28T20:56:00.494 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.27 2023-11-28T20:56:00.494 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.27 2023-11-28T20:56:00.495 INFO:tasks.workunit.client.0.smithi167.stdout:v0.27 2023-11-28T20:56:04.703 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 28% (71/253) Updating files: 29% (74/253) Updating files: 30% (76/253) Updating files: 31% (79/253) Updating files: 32% (81/253) Updating files: 33% (84/253) Updating files: 34% (87/253) Updating files: 35% (89/253) Updating files: 36% (92/253) Updating files: 37% (94/253) Updating files: 38% (97/253) Updating files: 39% (99/253) Updating files: 40% (102/253) Updating files: 41% (104/253) Updating files: 42% (107/253) Updating files: 43% (109/253) Updating files: 44% (112/253) Updating files: 45% (114/253) Updating files: 46% (117/253) Updating files: 47% (119/253) Updating files: 48% (122/253) Updating files: 49% (124/253) Updating files: 50% (127/253) Updating files: 51% (130/253) Updating files: 52% (132/253) Updating files: 53% (135/253) Updating files: 54% (137/253) Updating files: 55% (140/253) Updating files: 56% (142/253) Updating files: 57% (145/253) Updating files: 57% (146/253) Updating files: 58% (147/253) Updating files: 59% (150/253) Updating files: 60% (152/253) Updating files: 61% (155/253) Updating files: 62% (157/253) Updating files: 63% (160/253) Updating files: 64% (162/253) Updating files: 65% (165/253) Updating files: 66% (167/253) Updating files: 67% (170/253) Updating files: 67% (172/253) Updating files: 68% (173/253) Updating files: 69% (175/253) Updating files: 70% (178/253) Updating files: 71% (180/253) Updating files: 72% (183/253) Updating files: 73% (185/253) Updating files: 74% (188/253) Updating files: 75% (190/253) Updating files: 76% (193/253) Updating files: 77% (195/253) Updating files: 78% (198/253) Updating files: 79% (200/253) Updating files: 80% (203/253) Updating files: 81% (205/253) Updating files: 82% (208/253) Updating files: 83% (210/253) Updating files: 84% (213/253) Updating files: 85% (216/253) Updating files: 86% (218/253) Updating files: 87% (221/253) Updating files: 88% (223/253) Updating files: 89% (226/253) Updating files: 90% (228/253) Updating files: 91% (231/253) Updating files: 92% (233/253) Updating files: 93% (236/253) Updating files: 94% (238/253) Updating files: 95% (241/253) Updating files: 96% (243/253) Updating files: 97% (246/253) Updating files: 98% (248/253) Updating files: 99% (251/253) Updating files: 100% (253/253) Updating files: 100% (253/253), done. 2023-11-28T20:56:04.812 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 793034c62c8 v0.27 2023-11-28T20:56:04.817 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.27 2023-11-28T20:56:04.942 INFO:tasks.workunit.client.0.smithi167.stdout:v0.28 2023-11-28T20:56:04.942 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 28 -eq 48 ] 2023-11-28T20:56:04.943 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.28 2023-11-28T20:56:04.943 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.28 2023-11-28T20:56:04.943 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.28 2023-11-28T20:56:12.448 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:56:12.448 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2023-11-28T20:56:12.448 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:56:12.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:56:12.451 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:56:12.451 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:56:12.451 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:56:12.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.596+0000 7f0bb4365640 1 Processor -- start 2023-11-28T20:56:12.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.596+0000 7f0bb4365640 1 -- start start 2023-11-28T20:56:12.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb4365640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0bac0c75c0 0x7f0bac0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:12.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb4365640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0bac06a580 0x7f0bac06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb4365640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bac0c7a50 con 0x7f0bac151f60 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb4365640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac06aed0 con 0x7f0bac0c75c0 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb4365640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac0c4da0 con 0x7f0bac06a580 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb1900640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0bac0c75c0 0x7f0bac0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb1900640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0bac0c75c0 0x7f0bac0c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53708/0 (socket says 172.21.15.167:53708) 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb1900640 1 -- 172.21.15.167:0/730298948 learned_addr learned my addr 172.21.15.167:0/730298948 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb2902640 1 --2- 172.21.15.167:0/730298948 >> v2:172.21.15.178:3300/0 conn(0x7f0bac06a580 0x7f0bac06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb1900640 1 -- 172.21.15.167:0/730298948 >> v2:172.21.15.178:3300/0 conn(0x7f0bac06a580 msgr2=0x7f0bac06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb1900640 1 --2- 172.21.15.167:0/730298948 >> v2:172.21.15.178:3300/0 conn(0x7f0bac06a580 0x7f0bac06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb1900640 1 -- 172.21.15.167:0/730298948 >> v1:172.21.15.178:6789/0 conn(0x7f0bac151f60 legacy=0x7f0bac0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:12.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.600+0000 7f0bb1900640 1 -- 172.21.15.167:0/730298948 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac15b220 con 0x7f0bac0c75c0 2023-11-28T20:56:12.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb1900640 1 --2- 172.21.15.167:0/730298948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac0c75c0 0x7f0bac0c5c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0c5580 tx=0x7f0b9c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213665c4efcd9daa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:12.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb10ff640 1 -- 172.21.15.167:0/730298948 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0ab600 con 0x7f0bac0c75c0 2023-11-28T20:56:12.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb10ff640 1 -- 172.21.15.167:0/730298948 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c0a7050 con 0x7f0bac0c75c0 2023-11-28T20:56:12.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb10ff640 1 -- 172.21.15.167:0/730298948 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0ab980 con 0x7f0bac0c75c0 2023-11-28T20:56:12.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 -- 172.21.15.167:0/730298948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac0c75c0 msgr2=0x7f0bac0c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:12.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 --2- 172.21.15.167:0/730298948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac0c75c0 0x7f0bac0c5c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0c5580 tx=0x7f0b9c01c470 comp rx=0 tx=0).stop 2023-11-28T20:56:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 -- 172.21.15.167:0/730298948 shutdown_connections 2023-11-28T20:56:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 --2- 172.21.15.167:0/730298948 >> v2:172.21.15.178:3300/0 conn(0x7f0bac06a580 0x7f0bac06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 --2- 172.21.15.167:0/730298948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac0c75c0 0x7f0bac0c5c90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 -- 172.21.15.167:0/730298948 >> 172.21.15.167:0/730298948 conn(0x7f0bac0cb1e0 msgr2=0x7f0bac0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 -- 172.21.15.167:0/730298948 shutdown_connections 2023-11-28T20:56:12.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 -- 172.21.15.167:0/730298948 wait complete. 2023-11-28T20:56:12.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 Processor -- start 2023-11-28T20:56:12.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.604+0000 7f0bb4365640 1 -- start start 2023-11-28T20:56:12.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb4365640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bac06a580 0x7f0bac155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb4365640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c75c0 0x7f0bac1f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb4365640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac151f60 0x7f0bac1f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb4365640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac143560 con 0x7f0bac151f60 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb4365640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac13e820 con 0x7f0bac06a580 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb4365640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac142f50 con 0x7f0bac0c75c0 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2902640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac151f60 0x7f0bac1f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2101640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bac06a580 0x7f0bac155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2902640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac151f60 0x7f0bac1f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53716/0 (socket says 172.21.15.167:53716) 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2902640 1 -- 172.21.15.167:0/2611486775 learned_addr learned my addr 172.21.15.167:0/2611486775 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:12.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb1900640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c75c0 0x7f0bac1f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb1900640 1 -- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c75c0 msgr2=0x7f0bac1f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb1900640 1 -- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c75c0 msgr2=0x7f0bac1f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb1900640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c75c0 0x7f0bac1f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb1900640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c75c0 0x7f0bac1f40d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2902640 1 -- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c75c0 msgr2=0x7f0bac1f40d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2902640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c75c0 0x7f0bac1f40d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2902640 1 -- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bac06a580 msgr2=0x7f0bac155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2902640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bac06a580 0x7f0bac155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2902640 1 -- 172.21.15.167:0/2611486775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0094d0 con 0x7f0bac151f60 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2101640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bac06a580 0x7f0bac155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb2902640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac151f60 0x7f0bac1f4610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400efc0 tx=0x7f0ba400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0ba2ffd640 1 -- 172.21.15.167:0/2611486775 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4009ba0 con 0x7f0bac151f60 2023-11-28T20:56:12.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0ba2ffd640 1 -- 172.21.15.167:0/2611486775 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba400f040 con 0x7f0bac151f60 2023-11-28T20:56:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0ba2ffd640 1 -- 172.21.15.167:0/2611486775 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40146c0 con 0x7f0bac151f60 2023-11-28T20:56:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac0ca240 con 0x7f0bac151f60 2023-11-28T20:56:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac1431f0 con 0x7f0bac151f60 2023-11-28T20:56:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac0682c0 con 0x7f0bac151f60 2023-11-28T20:56:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.608+0000 7f0ba2ffd640 1 -- 172.21.15.167:0/2611486775 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0ba4014820 con 0x7f0bac151f60 2023-11-28T20:56:12.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.612+0000 7f0ba2ffd640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b900664c0 0x7f0b90068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:12.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.612+0000 7f0ba2ffd640 1 -- 172.21.15.167:0/2611486775 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0ba4084cf0 con 0x7f0bac151f60 2023-11-28T20:56:12.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.612+0000 7f0bb2101640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b900664c0 0x7f0b90068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:12.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.612+0000 7f0bb2101640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b900664c0 0x7f0b90068980 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8007fd0 tx=0x7f0ba8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:12.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.616+0000 7f0ba2ffd640 1 -- 172.21.15.167:0/2611486775 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ba4051df0 con 0x7f0bac151f60 2023-11-28T20:56:12.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0bac1560a0 con 0x7f0bac151f60 2023-11-28T20:56:12.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0ba2ffd640 1 -- 172.21.15.167:0/2611486775 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f0ba4018080 con 0x7f0bac151f60 2023-11-28T20:56:12.822 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":140,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:56:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b900664c0 msgr2=0x7f0b90068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b900664c0 0x7f0b90068980 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8007fd0 tx=0x7f0ba8009040 comp rx=0 tx=0).stop 2023-11-28T20:56:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac151f60 msgr2=0x7f0bac1f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac151f60 0x7f0bac1f4610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400efc0 tx=0x7f0ba400c490 comp rx=0 tx=0).stop 2023-11-28T20:56:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 shutdown_connections 2023-11-28T20:56:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0b900664c0 0x7f0b90068980 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac151f60 0x7f0bac1f4610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bac0c75c0 0x7f0bac1f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 --2- 172.21.15.167:0/2611486775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bac06a580 0x7f0bac155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.820+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 >> 172.21.15.167:0/2611486775 conn(0x7f0bac0cb1e0 msgr2=0x7f0bac157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.824+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 shutdown_connections 2023-11-28T20:56:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:12.824+0000 7f0bb4365640 1 -- 172.21.15.167:0/2611486775 wait complete. 2023-11-28T20:56:15.843 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:56:15.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.988+0000 7fa22486b640 1 Processor -- start 2023-11-28T20:56:15.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.988+0000 7fa22486b640 1 -- start start 2023-11-28T20:56:15.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa22486b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa220153f90 0x7fa22006f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:15.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa22486b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa2200c8750 0x7fa22006f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:15.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa22486b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22015ad20 con 0x7fa2200c6e90 2023-11-28T20:56:15.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa22486b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa220159e70 con 0x7fa220153f90 2023-11-28T20:56:15.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa22486b640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22015a110 con 0x7fa2200c8750 2023-11-28T20:56:15.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa21e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa220153f90 0x7fa22006f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:15.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa21e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa220153f90 0x7fa22006f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43294/0 (socket says 172.21.15.167:43294) 2023-11-28T20:56:15.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa21e59c640 1 -- 172.21.15.167:0/3392833996 learned_addr learned my addr 172.21.15.167:0/3392833996 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:15.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa215d9b640 1 --2- 172.21.15.167:0/3392833996 >> v2:172.21.15.178:3300/0 conn(0x7fa2200c8750 0x7fa22006f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:15.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa21e59c640 1 -- 172.21.15.167:0/3392833996 >> v2:172.21.15.178:3300/0 conn(0x7fa2200c8750 msgr2=0x7fa22006f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:15.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa21e59c640 1 --2- 172.21.15.167:0/3392833996 >> v2:172.21.15.178:3300/0 conn(0x7fa2200c8750 0x7fa22006f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:15.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa21e59c640 1 -- 172.21.15.167:0/3392833996 >> v1:172.21.15.178:6789/0 conn(0x7fa2200c6e90 legacy=0x7fa2200c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:15.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.992+0000 7fa21e59c640 1 -- 172.21.15.167:0/3392833996 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22015a3f0 con 0x7fa220153f90 2023-11-28T20:56:15.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa21e59c640 1 --2- 172.21.15.167:0/3392833996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa220153f90 0x7fa22006f010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa22015e470 tx=0x7fa20801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd28eeb3bffe3d51 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:16.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa21dd9b640 1 -- 172.21.15.167:0/3392833996 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080a89b0 con 0x7fa220153f90 2023-11-28T20:56:16.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa21dd9b640 1 -- 172.21.15.167:0/3392833996 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2080a8b10 con 0x7fa220153f90 2023-11-28T20:56:16.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa21dd9b640 1 -- 172.21.15.167:0/3392833996 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080a8ea0 con 0x7fa220153f90 2023-11-28T20:56:16.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 -- 172.21.15.167:0/3392833996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa220153f90 msgr2=0x7fa22006f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:16.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 --2- 172.21.15.167:0/3392833996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa220153f90 0x7fa22006f010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa22015e470 tx=0x7fa20801ecb0 comp rx=0 tx=0).stop 2023-11-28T20:56:16.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 -- 172.21.15.167:0/3392833996 shutdown_connections 2023-11-28T20:56:16.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 --2- 172.21.15.167:0/3392833996 >> v2:172.21.15.178:3300/0 conn(0x7fa2200c8750 0x7fa22006f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:16.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 --2- 172.21.15.167:0/3392833996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa220153f90 0x7fa22006f010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:16.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 -- 172.21.15.167:0/3392833996 >> 172.21.15.167:0/3392833996 conn(0x7fa2200cc300 msgr2=0x7fa2200cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:16.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 -- 172.21.15.167:0/3392833996 shutdown_connections 2023-11-28T20:56:16.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 -- 172.21.15.167:0/3392833996 wait complete. 2023-11-28T20:56:16.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 Processor -- start 2023-11-28T20:56:16.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:15.996+0000 7fa22486b640 1 -- start start 2023-11-28T20:56:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa22486b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2200c6e90 0x7fa2201e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa22486b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2200c8750 0x7fa220157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa22486b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa220153f90 0x7fa2201efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa22486b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa220154c20 con 0x7fa2200c6e90 2023-11-28T20:56:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa22486b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2201ef9b0 con 0x7fa220153f90 2023-11-28T20:56:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa22486b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2201f3810 con 0x7fa2200c8750 2023-11-28T20:56:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2200c6e90 0x7fa2201e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2200c6e90 0x7fa2201e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43298/0 (socket says 172.21.15.167:43298) 2023-11-28T20:56:16.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21e59c640 1 -- 172.21.15.167:0/1314596990 learned_addr learned my addr 172.21.15.167:0/1314596990 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa215d9b640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2200c8750 0x7fa220157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21ed9d640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa220153f90 0x7fa2201efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21e59c640 1 -- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2200c8750 msgr2=0x7fa220157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21e59c640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2200c8750 0x7fa220157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21e59c640 1 -- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa220153f90 msgr2=0x7fa2201efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21e59c640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa220153f90 0x7fa2201efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21e59c640 1 -- 172.21.15.167:0/1314596990 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2080094d0 con 0x7fa2200c6e90 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa21e59c640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2200c6e90 0x7fa2201e34a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa20801c8e0 tx=0x7fa20801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa2177fe640 1 -- 172.21.15.167:0/1314596990 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080ba600 con 0x7fa2200c6e90 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa2177fe640 1 -- 172.21.15.167:0/1314596990 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2080ba760 con 0x7fa2200c6e90 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa220154e70 con 0x7fa2200c6e90 2023-11-28T20:56:16.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa2177fe640 1 -- 172.21.15.167:0/1314596990 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080bab10 con 0x7fa2200c6e90 2023-11-28T20:56:16.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2201ef640 con 0x7fa2200c6e90 2023-11-28T20:56:16.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2200682c0 con 0x7fa2200c6e90 2023-11-28T20:56:16.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.000+0000 7fa2177fe640 1 -- 172.21.15.167:0/1314596990 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2080bac70 con 0x7fa2200c6e90 2023-11-28T20:56:16.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.004+0000 7fa2177fe640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2000664a0 0x7fa200068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:16.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.004+0000 7fa2177fe640 1 -- 172.21.15.167:0/1314596990 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa208122840 con 0x7fa2200c6e90 2023-11-28T20:56:16.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.004+0000 7fa215d9b640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2000664a0 0x7fa200068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:16.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.004+0000 7fa215d9b640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2000664a0 0x7fa200068960 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa2200c6e00 tx=0x7fa210008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:16.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.008+0000 7fa2177fe640 1 -- 172.21.15.167:0/1314596990 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2080ef950 con 0x7fa2200c6e90 2023-11-28T20:56:16.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa2200682c0 con 0x7fa2200c6e90 2023-11-28T20:56:16.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa2177fe640 1 -- 172.21.15.167:0/1314596990 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fa2080f2f70 con 0x7fa2200c6e90 2023-11-28T20:56:16.213 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":140,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:56:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2000664a0 msgr2=0x7fa200068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:16.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2000664a0 0x7fa200068960 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa2200c6e00 tx=0x7fa210008040 comp rx=0 tx=0).stop 2023-11-28T20:56:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2200c6e90 msgr2=0x7fa2201e34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2200c6e90 0x7fa2201e34a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa20801c8e0 tx=0x7fa20801ba50 comp rx=0 tx=0).stop 2023-11-28T20:56:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 shutdown_connections 2023-11-28T20:56:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa2000664a0 0x7fa200068960 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:16.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa220153f90 0x7fa2201efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2200c8750 0x7fa220157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 --2- 172.21.15.167:0/1314596990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2200c6e90 0x7fa2201e34a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 >> 172.21.15.167:0/1314596990 conn(0x7fa2200cc300 msgr2=0x7fa22006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 shutdown_connections 2023-11-28T20:56:16.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:16.212+0000 7fa22486b640 1 -- 172.21.15.167:0/1314596990 wait complete. 2023-11-28T20:56:19.234 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:56:19.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.380+0000 7fce28079640 1 Processor -- start 2023-11-28T20:56:19.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.380+0000 7fce28079640 1 -- start start 2023-11-28T20:56:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce28079640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce200c6ff0 0x7fce20157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce28079640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce200c4940 con 0x7fce20150b40 2023-11-28T20:56:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce28079640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce200c6ac0 con 0x7fce200c4510 2023-11-28T20:56:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce28079640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce200c62f0 con 0x7fce200c6ff0 2023-11-28T20:56:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25e15640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fce20150b40 0x7fce200c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56628/0 (socket says 172.21.15.167:56628) 2023-11-28T20:56:19.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25e15640 1 -- 172.21.15.167:0/2112642441 learned_addr learned my addr 172.21.15.167:0/2112642441 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25614640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce200c6ff0 0x7fce20157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253409683 0 0) 0x7fce200c4940 con 0x7fce20150b40 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce0c003530 con 0x7fce20150b40 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1725222680 0 0) 0x7fce0c003530 con 0x7fce20150b40 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce200c6ff0 msgr2=0x7fce20157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce200c6ff0 0x7fce20157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 >> v1:172.21.15.178:6789/0 conn(0x7fce200c4510 legacy=0x7fce2006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce200c6500 con 0x7fce20150b40 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fce1c001680 con 0x7fce20150b40 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 >> v1:172.21.15.167:6789/0 conn(0x7fce20150b40 legacy=0x7fce200c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce0c0039b0 0x7fce0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce200c6ff0 0x7fce0c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce0c004d10 0x7fce0c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200c62f0 con 0x7fce0c0039b0 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c00ba70 con 0x7fce0c004d10 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c00bc30 con 0x7fce200c6ff0 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25e15640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce0c0039b0 0x7fce0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25614640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce200c6ff0 0x7fce0c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce26616640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce0c004d10 0x7fce0c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25e15640 1 -- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce200c6ff0 msgr2=0x7fce0c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25e15640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce200c6ff0 0x7fce0c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25e15640 1 -- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce0c004d10 msgr2=0x7fce0c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:19.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25e15640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce0c004d10 0x7fce0c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25e15640 1 -- 172.21.15.167:0/2112642441 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c003530 con 0x7fce0c0039b0 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.384+0000 7fce25614640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce200c6ff0 0x7fce0c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce25e15640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce0c0039b0 0x7fce0c003dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c210 tx=0x7fce1c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65caedeec46b8319 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c005ae0 con 0x7fce0c0039b0 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c005c40 con 0x7fce0c0039b0 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce24e13640 1 -- 172.21.15.167:0/2112642441 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c007070 con 0x7fce0c0039b0 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce28079640 1 -- 172.21.15.167:0/2112642441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce0c0039b0 msgr2=0x7fce0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce28079640 1 --2- 172.21.15.167:0/2112642441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce0c0039b0 0x7fce0c003dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c210 tx=0x7fce1c01cbf0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce26616640 1 -- 172.21.15.167:0/2112642441 reap_dead start 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce28079640 1 -- 172.21.15.167:0/2112642441 shutdown_connections 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce28079640 1 -- 172.21.15.167:0/2112642441 >> 172.21.15.167:0/2112642441 conn(0x7fce200cb1e0 msgr2=0x7fce200cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:19.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce28079640 1 -- 172.21.15.167:0/2112642441 shutdown_connections 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce28079640 1 -- 172.21.15.167:0/2112642441 wait complete. 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.388+0000 7fce28079640 1 Processor -- start 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 -- start start 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce0c0039b0 0x7fce20141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce20144b20 0x7fce20144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce20145ef0 0x7fce20146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce201468b0 con 0x7fce20145ef0 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce20147ef0 con 0x7fce20144b20 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce20148190 con 0x7fce0c0039b0 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce26616640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce20145ef0 0x7fce20146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce26616640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce20145ef0 0x7fce20146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43328/0 (socket says 172.21.15.167:43328) 2023-11-28T20:56:19.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce26616640 1 -- 172.21.15.167:0/3725171772 learned_addr learned my addr 172.21.15.167:0/3725171772 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:19.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce25e15640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce0c0039b0 0x7fce20141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce25614640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce20144b20 0x7fce20144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce26616640 1 -- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce0c0039b0 msgr2=0x7fce20141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce26616640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce0c0039b0 0x7fce20141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce26616640 1 -- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce20144b20 msgr2=0x7fce20144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce26616640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce20144b20 0x7fce20144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce26616640 1 -- 172.21.15.167:0/3725171772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20148430 con 0x7fce20145ef0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce25614640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce20144b20 0x7fce20144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce26616640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce20145ef0 0x7fce20146370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fce2006eee0 tx=0x7fce1800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce167fc640 1 -- 172.21.15.167:0/3725171772 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1800eed0 con 0x7fce20145ef0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce167fc640 1 -- 172.21.15.167:0/3725171772 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18003980 con 0x7fce20145ef0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce200ca670 con 0x7fce20145ef0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce167fc640 1 -- 172.21.15.167:0/3725171772 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18003d50 con 0x7fce20145ef0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce200cac30 con 0x7fce20145ef0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.392+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce200cadf0 con 0x7fce20145ef0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.396+0000 7fce167fc640 1 -- 172.21.15.167:0/3725171772 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce180050d0 con 0x7fce20145ef0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.396+0000 7fce167fc640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce040664a0 0x7fce04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.396+0000 7fce167fc640 1 -- 172.21.15.167:0/3725171772 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fce18083f30 con 0x7fce20145ef0 2023-11-28T20:56:19.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.396+0000 7fce25e15640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce040664a0 0x7fce04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.396+0000 7fce25e15640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce040664a0 0x7fce04068960 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0ab000 tx=0x7fce1c0b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.400+0000 7fce167fc640 1 -- 172.21.15.167:0/3725171772 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce18050fb0 con 0x7fce20145ef0 2023-11-28T20:56:19.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.604+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fce200682c0 con 0x7fce20145ef0 2023-11-28T20:56:19.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.604+0000 7fce167fc640 1 -- 172.21.15.167:0/3725171772 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fce180545d0 con 0x7fce20145ef0 2023-11-28T20:56:19.608 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":142,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:56:19.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.608+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce040664a0 msgr2=0x7fce04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.608+0000 7fce28079640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce040664a0 0x7fce04068960 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0ab000 tx=0x7fce1c0b1040 comp rx=0 tx=0).stop 2023-11-28T20:56:19.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.608+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce20145ef0 msgr2=0x7fce20146370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.608+0000 7fce28079640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce20145ef0 0x7fce20146370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fce2006eee0 tx=0x7fce1800eb90 comp rx=0 tx=0).stop 2023-11-28T20:56:19.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.612+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 shutdown_connections 2023-11-28T20:56:19.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.612+0000 7fce28079640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce040664a0 0x7fce04068960 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.612+0000 7fce28079640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce20145ef0 0x7fce20146370 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.612+0000 7fce28079640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce20144b20 0x7fce20144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.612+0000 7fce28079640 1 --2- 172.21.15.167:0/3725171772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce0c0039b0 0x7fce20141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.612+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 >> 172.21.15.167:0/3725171772 conn(0x7fce200cb1e0 msgr2=0x7fce200705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:19.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.616+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 shutdown_connections 2023-11-28T20:56:19.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.616+0000 7fce28079640 1 -- 172.21.15.167:0/3725171772 wait complete. 2023-11-28T20:56:19.641 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:56:19.641 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:56:19.642 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:56:19.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecba25a640 1 Processor -- start 2023-11-28T20:56:19.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecba25a640 1 -- start start 2023-11-28T20:56:19.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecba25a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fecb4070480 0x7fecb4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecba25a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fecb406e410 0x7fecb4072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecba25a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb41571d0 con 0x7fecb406e030 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecba25a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb4071a90 con 0x7fecb406e410 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecba25a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40c70d0 con 0x7fecb4070480 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecb3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fecb406e410 0x7fecb4072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecb3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fecb406e410 0x7fecb4072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43344/0 (socket says 172.21.15.167:43344) 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecb3fff640 1 -- 172.21.15.167:0/3264052202 learned_addr learned my addr 172.21.15.167:0/3264052202 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecb2ffd640 1 --2- 172.21.15.167:0/3264052202 >> v2:172.21.15.178:3300/0 conn(0x7fecb4070480 0x7fecb4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecb3fff640 1 -- 172.21.15.167:0/3264052202 >> v2:172.21.15.178:3300/0 conn(0x7fecb4070480 msgr2=0x7fecb4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecb3fff640 1 --2- 172.21.15.167:0/3264052202 >> v2:172.21.15.178:3300/0 conn(0x7fecb4070480 0x7fecb4071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecb3fff640 1 -- 172.21.15.167:0/3264052202 >> v1:172.21.15.178:6789/0 conn(0x7fecb406e030 legacy=0x7fecb41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:19.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.784+0000 7fecb3fff640 1 -- 172.21.15.167:0/3264052202 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40c73b0 con 0x7fecb406e410 2023-11-28T20:56:19.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecb3fff640 1 --2- 172.21.15.167:0/3264052202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb406e410 0x7fecb4072460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fecb406b790 tx=0x7fecac01daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffad0c8775952b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecb27fc640 1 -- 172.21.15.167:0/3264052202 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00a2d0 con 0x7fecb406e410 2023-11-28T20:56:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecb27fc640 1 -- 172.21.15.167:0/3264052202 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac0a6960 con 0x7fecb406e410 2023-11-28T20:56:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecb27fc640 1 -- 172.21.15.167:0/3264052202 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac0a6cf0 con 0x7fecb406e410 2023-11-28T20:56:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecba25a640 1 -- 172.21.15.167:0/3264052202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb406e410 msgr2=0x7fecb4072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecba25a640 1 --2- 172.21.15.167:0/3264052202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb406e410 0x7fecb4072460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fecb406b790 tx=0x7fecac01daa0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecba25a640 1 -- 172.21.15.167:0/3264052202 shutdown_connections 2023-11-28T20:56:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecba25a640 1 --2- 172.21.15.167:0/3264052202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb406e410 0x7fecb4072460 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecba25a640 1 --2- 172.21.15.167:0/3264052202 >> v2:172.21.15.178:3300/0 conn(0x7fecb4070480 0x7fecb4071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecba25a640 1 -- 172.21.15.167:0/3264052202 >> 172.21.15.167:0/3264052202 conn(0x7fecb40cb1e0 msgr2=0x7fecb40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:19.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecba25a640 1 -- 172.21.15.167:0/3264052202 shutdown_connections 2023-11-28T20:56:19.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.788+0000 7fecba25a640 1 -- 172.21.15.167:0/3264052202 wait complete. 2023-11-28T20:56:19.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 Processor -- start 2023-11-28T20:56:19.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 -- start start 2023-11-28T20:56:19.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecb406e030 0x7fecb41f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecb406e410 0x7fecb4155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb4070480 0x7fecb4155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41429f0 con 0x7fecb4070480 2023-11-28T20:56:19.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb4155260 con 0x7fecb406e030 2023-11-28T20:56:19.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40c9a80 con 0x7fecb406e410 2023-11-28T20:56:19.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb4070480 0x7fecb4155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb4070480 0x7fecb4155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43350/0 (socket says 172.21.15.167:43350) 2023-11-28T20:56:19.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb3fff640 1 -- 172.21.15.167:0/3144733019 learned_addr learned my addr 172.21.15.167:0/3144733019 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:19.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb37fe640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecb406e030 0x7fecb41f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb2ffd640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecb406e410 0x7fecb4155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb3fff640 1 -- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecb406e410 msgr2=0x7fecb4155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb3fff640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecb406e410 0x7fecb4155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb3fff640 1 -- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecb406e030 msgr2=0x7fecb41f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb3fff640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecb406e030 0x7fecb41f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb3fff640 1 -- 172.21.15.167:0/3144733019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac00ac40 con 0x7fecb4070480 2023-11-28T20:56:19.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecb3fff640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb4070480 0x7fecb4155dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fecac01a6b0 tx=0x7fecac01a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac008700 con 0x7fecb4070480 2023-11-28T20:56:19.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac008860 con 0x7fecb4070480 2023-11-28T20:56:19.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb4142710 con 0x7fecb4070480 2023-11-28T20:56:19.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac008c10 con 0x7fecb4070480 2023-11-28T20:56:19.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb40ca620 con 0x7fecb4070480 2023-11-28T20:56:19.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb414d6f0 0x7fecb413db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.792+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb4074770 con 0x7fecb414d6f0 2023-11-28T20:56:19.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fecb37fe640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb414d6f0 0x7fecb413db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fecb37fe640 1 -- 172.21.15.167:0/3144733019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecb406ba80 con 0x7fecb414d6f0 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fecb37fe640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb414d6f0 0x7fecb413db00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feca4000f70 tx=0x7feca400f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fecac0b7480 con 0x7fecb4070480 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fec9bfff640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feca0066470 0x7feca0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40052e0 con 0x7fecb414d6f0 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fecac11f820 con 0x7fecb4070480 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7feca4005440 con 0x7fecb414d6f0 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb414d6f0 msgr2=0x7fecb413db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fec9bfff640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb414d6f0 0x7fecb413db00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feca4000f70 tx=0x7feca400f9b0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb414d6f0 msgr2=0x7fecb413db00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:19.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fec9bfff640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb414d6f0 0x7fecb413db00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fecb2ffd640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feca0066470 0x7feca0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.796+0000 7fecb2ffd640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feca0066470 0x7feca0068930 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fecb415f5c0 tx=0x7feca8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb40c21b0 0x7fecb413e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb4162b80 con 0x7fecb40c21b0 2023-11-28T20:56:19.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecb37fe640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb40c21b0 0x7fecb413e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecb37fe640 1 -- 172.21.15.167:0/3144733019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fecb40682c0 con 0x7fecb40c21b0 2023-11-28T20:56:19.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecb37fe640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb40c21b0 0x7fecb413e040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feca4000f70 tx=0x7feca4001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4023070 con 0x7fecb40c21b0 2023-11-28T20:56:19.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5125 (secure 0 0 0) 0x7feca4003e50 con 0x7fecb40c21b0 2023-11-28T20:56:19.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb40c21b0 msgr2=0x7fecb413e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fec9bfff640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb40c21b0 0x7fecb413e040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feca4000f70 tx=0x7feca4001090 comp rx=0 tx=0).stop 2023-11-28T20:56:19.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fec9bfff640 1 -- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb40c21b0 msgr2=0x7fecb413e040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:19.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fec9bfff640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb40c21b0 0x7fecb413e040 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.807 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:56:19.807 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:19.807 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:19.807 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:56:19.807 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 142, 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 3, 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:19.808 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:56:19.809 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:19.810 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:19.810 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:19.810 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:19.810 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:19.810 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:19.810 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:19.810 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:19.810 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:19.810 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:19.811 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:56:19.812 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:56:19.813 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.814 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:56:19.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.814 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:19.814 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:19.814 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:19.814 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:19.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.814 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:19.814 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:56:19.815 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:19.816 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:19.817 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:19.818 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:19.819 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:56:19.820 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:19.820 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:19.820 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:19.820 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.820 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:56:19.820 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:56:19.820 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:19.820 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:19.820 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:19.821 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:19.821 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:19.821 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.821 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:56:19.821 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:56:19.821 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.821 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:19.821 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:19.822 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:19.822 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:19.822 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.822 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:56:19.822 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.822 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:19.822 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:19.822 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:56:19.822 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.823 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.824 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:56:19.825 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:19.825 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:19.825 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:19.825 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:56:19.825 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:19.825 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:19.825 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.825 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:56:19.825 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:56:19.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feca0066470 msgr2=0x7feca0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feca0066470 0x7feca0068930 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fecb415f5c0 tx=0x7feca8008040 comp rx=0 tx=0).stop 2023-11-28T20:56:19.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb4070480 msgr2=0x7fecb4155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 --2- 172.21.15.167:0/3144733019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb4070480 0x7fecb4155dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fecac01a6b0 tx=0x7fecac01a840 comp rx=0 tx=0).stop 2023-11-28T20:56:19.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecb3fff640 1 -- 172.21.15.167:0/3144733019 reap_dead start 2023-11-28T20:56:19.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecb3fff640 1 -- 172.21.15.167:0/3144733019 reap_dead start 2023-11-28T20:56:19.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 shutdown_connections 2023-11-28T20:56:19.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 >> 172.21.15.167:0/3144733019 conn(0x7fecb40cb1e0 msgr2=0x7fecb415f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:19.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 shutdown_connections 2023-11-28T20:56:19.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.804+0000 7fecba25a640 1 -- 172.21.15.167:0/3144733019 wait complete. 2023-11-28T20:56:19.828 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:56:19.829 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:56:19.829 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:56:19.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3e376640 1 Processor -- start 2023-11-28T20:56:19.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3e376640 1 -- start start 2023-11-28T20:56:19.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3e376640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d3806b2a0 0x7f0d380c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3e376640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d380c4b60 0x7f0d381612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3e376640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d38070b70 con 0x7f0d38150f30 2023-11-28T20:56:19.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3e376640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d380c3a80 con 0x7f0d380c4b60 2023-11-28T20:56:19.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3e376640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d38156b10 con 0x7f0d3806b2a0 2023-11-28T20:56:19.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3d374640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0d38150f30 0x7f0d38070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56640/0 (socket says 172.21.15.167:56640) 2023-11-28T20:56:19.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3d374640 1 -- 172.21.15.167:0/181125517 learned_addr learned my addr 172.21.15.167:0/181125517 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:56:19.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3db75640 1 --2- 172.21.15.167:0/181125517 >> v2:172.21.15.167:3300/0 conn(0x7f0d380c4b60 0x7f0d381612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3cb73640 1 --2- 172.21.15.167:0/181125517 >> v2:172.21.15.178:3300/0 conn(0x7f0d3806b2a0 0x7f0d380c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3db75640 1 -- 172.21.15.167:0/181125517 >> v2:172.21.15.178:3300/0 conn(0x7f0d3806b2a0 msgr2=0x7f0d380c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:19.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3db75640 1 --2- 172.21.15.167:0/181125517 >> v2:172.21.15.178:3300/0 conn(0x7f0d3806b2a0 0x7f0d380c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3db75640 1 -- 172.21.15.167:0/181125517 >> v1:172.21.15.167:6789/0 conn(0x7f0d38150f30 legacy=0x7f0d38070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.968+0000 7f0d3db75640 1 -- 172.21.15.167:0/181125517 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380c2cc0 con 0x7f0d380c4b60 2023-11-28T20:56:19.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d3db75640 1 --2- 172.21.15.167:0/181125517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d380c4b60 0x7f0d381612a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d380c3fd0 tx=0x7f0d3001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f664b7b8c4a4fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d2ffff640 1 -- 172.21.15.167:0/181125517 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300a59f0 con 0x7f0d380c4b60 2023-11-28T20:56:19.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d2ffff640 1 -- 172.21.15.167:0/181125517 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d300a5b50 con 0x7f0d380c4b60 2023-11-28T20:56:19.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d2ffff640 1 -- 172.21.15.167:0/181125517 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300ad440 con 0x7f0d380c4b60 2023-11-28T20:56:19.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d3e376640 1 -- 172.21.15.167:0/181125517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d380c4b60 msgr2=0x7f0d381612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d3e376640 1 --2- 172.21.15.167:0/181125517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d380c4b60 0x7f0d381612a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d380c3fd0 tx=0x7f0d3001c910 comp rx=0 tx=0).stop 2023-11-28T20:56:19.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d3e376640 1 -- 172.21.15.167:0/181125517 shutdown_connections 2023-11-28T20:56:19.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d3e376640 1 --2- 172.21.15.167:0/181125517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d380c4b60 0x7f0d381612a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d3e376640 1 --2- 172.21.15.167:0/181125517 >> v2:172.21.15.178:3300/0 conn(0x7f0d3806b2a0 0x7f0d380c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d3e376640 1 -- 172.21.15.167:0/181125517 >> 172.21.15.167:0/181125517 conn(0x7f0d380cb3f0 msgr2=0x7f0d380cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:19.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d3e376640 1 -- 172.21.15.167:0/181125517 shutdown_connections 2023-11-28T20:56:19.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.972+0000 7f0d3e376640 1 -- 172.21.15.167:0/181125517 wait complete. 2023-11-28T20:56:19.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 Processor -- start 2023-11-28T20:56:19.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 -- start start 2023-11-28T20:56:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3806b2a0 0x7f0d38164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d380c4b60 0x7f0d381559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d38150f30 0x7f0d38155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38143b20 con 0x7f0d38150f30 2023-11-28T20:56:19.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38166060 con 0x7f0d380c4b60 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d381654e0 con 0x7f0d3806b2a0 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3db75640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d38150f30 0x7f0d38155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3db75640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d38150f30 0x7f0d38155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43396/0 (socket says 172.21.15.167:43396) 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3db75640 1 -- 172.21.15.167:0/208080512 learned_addr learned my addr 172.21.15.167:0/208080512 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3d374640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3806b2a0 0x7f0d38164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3cb73640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d380c4b60 0x7f0d381559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3db75640 1 -- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3806b2a0 msgr2=0x7f0d38164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3db75640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3806b2a0 0x7f0d38164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3db75640 1 -- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d380c4b60 msgr2=0x7f0d381559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3db75640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d380c4b60 0x7f0d381559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:19.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3db75640 1 -- 172.21.15.167:0/208080512 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d30009a70 con 0x7f0d38150f30 2023-11-28T20:56:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3d374640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3806b2a0 0x7f0d38164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:56:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3db75640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d38150f30 0x7f0d38155f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009d60 tx=0x7f0d300196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300ade40 con 0x7f0d38150f30 2023-11-28T20:56:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d30009450 con 0x7f0d38150f30 2023-11-28T20:56:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300b9690 con 0x7f0d38150f30 2023-11-28T20:56:19.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d381657c0 con 0x7f0d38150f30 2023-11-28T20:56:19.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.976+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d38165d80 con 0x7f0d38150f30 2023-11-28T20:56:19.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d3e376640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38158e10 0x7f0d381593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38074740 con 0x7f0d38158e10 2023-11-28T20:56:19.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d3d374640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38158e10 0x7f0d381593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d3d374640 1 -- 172.21.15.167:0/208080512 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d380c3880 con 0x7f0d38158e10 2023-11-28T20:56:19.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d300b97f0 con 0x7f0d38150f30 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d3d374640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38158e10 0x7f0d381593d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000f70 tx=0x7f0d3400e980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d2dffb640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0d1c066470 0x7f0d1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0d3011f950 con 0x7f0d38150f30 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34005ad0 con 0x7f0d38158e10 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0d34005c30 con 0x7f0d38158e10 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38158e10 msgr2=0x7f0d381593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d2dffb640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38158e10 0x7f0d381593d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000f70 tx=0x7f0d3400e980 comp rx=0 tx=0).stop 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38158e10 msgr2=0x7f0d381593d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d2dffb640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38158e10 0x7f0d381593d0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000f70 tx=0x7f0d3400e980 comp rx=0 tx=0).stop 2023-11-28T20:56:19.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.980+0000 7f0d3cb73640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0d1c066470 0x7f0d1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.984+0000 7f0d3cb73640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0d1c066470 0x7f0d1c068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0d381507c0 tx=0x7f0d28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d3e376640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38164f50 0x7f0d38159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:19.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38068200 con 0x7f0d38164f50 2023-11-28T20:56:19.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d3d374640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38164f50 0x7f0d38159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:19.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d3d374640 1 -- 172.21.15.167:0/208080512 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0d380cb7d0 con 0x7f0d38164f50 2023-11-28T20:56:19.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d3d374640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38164f50 0x7f0d38159910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000f70 tx=0x7f0d34005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:19.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340074e0 con 0x7f0d38164f50 2023-11-28T20:56:19.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4810 (secure 0 0 0) 0x7f0d34007640 con 0x7f0d38164f50 2023-11-28T20:56:19.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38164f50 msgr2=0x7f0d38159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:19.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d2dffb640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38164f50 0x7f0d38159910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000f70 tx=0x7f0d34005800 comp rx=0 tx=0).stop 2023-11-28T20:56:19.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d2dffb640 1 -- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38164f50 msgr2=0x7f0d38159910 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:19.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.988+0000 7f0d2dffb640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d38164f50 0x7f0d38159910 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d34000f70 tx=0x7f0d34005800 comp rx=0 tx=0).stop 2023-11-28T20:56:19.993 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:56:19.993 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:19.993 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:19.993 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:56:19.993 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 142, 2023-11-28T20:56:19.993 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:56:19.993 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:56:19.993 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 3, 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:19.994 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:19.995 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:19.995 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:19.995 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:19.995 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:19.995 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:19.995 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:19.995 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.995 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:56:19.995 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:19.996 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:19.997 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.997 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:56:19.997 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:56:19.997 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:56:19.997 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:56:19.997 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:56:19.997 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:56:19.997 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:19.997 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:19.998 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:19.999 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.000 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:20.001 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.003 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:20.003 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:56:20.003 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.003 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.003 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.003 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:56:20.003 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:20.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.005 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:20.005 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:56:20.005 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.005 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:20.005 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:56:20.005 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.007 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:56:20.007 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:56:20.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.007 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:20.007 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:20.007 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:20.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.007 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:20.007 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:56:20.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.008 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:20.008 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:20.008 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:56:20.008 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.008 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:20.008 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:56:20.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.008 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:56:20.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.010 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.010 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:56:20.010 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:56:20.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0d1c066470 msgr2=0x7f0d1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3e376640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0d1c066470 0x7f0d1c068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0d381507c0 tx=0x7f0d28008040 comp rx=0 tx=0).stop 2023-11-28T20:56:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d38150f30 msgr2=0x7f0d38155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3e376640 1 --2- 172.21.15.167:0/208080512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d38150f30 0x7f0d38155f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009d60 tx=0x7f0d300196b0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3db75640 1 -- 172.21.15.167:0/208080512 reap_dead start 2023-11-28T20:56:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3db75640 1 -- 172.21.15.167:0/208080512 reap_dead start 2023-11-28T20:56:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 shutdown_connections 2023-11-28T20:56:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 >> 172.21.15.167:0/208080512 conn(0x7f0d380cb3f0 msgr2=0x7f0d3814eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 shutdown_connections 2023-11-28T20:56:20.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:19.992+0000 7f0d3e376640 1 -- 172.21.15.167:0/208080512 wait complete. 2023-11-28T20:56:20.012 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:56:20.013 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:56:20.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:56:20.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.148+0000 7fba4a417640 1 Processor -- start 2023-11-28T20:56:20.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba4a417640 1 -- start start 2023-11-28T20:56:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba4a417640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fba440c6ff0 0x7fba44157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba4a417640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440c48f0 con 0x7fba44150b40 2023-11-28T20:56:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba4a417640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440c6ac0 con 0x7fba440c4510 2023-11-28T20:56:20.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba4a417640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba440c62f0 con 0x7fba440c6ff0 2023-11-28T20:56:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba43fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fba44150b40 0x7fba440c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56654/0 (socket says 172.21.15.167:56654) 2023-11-28T20:56:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba43fff640 1 -- 172.21.15.167:0/3063253873 learned_addr learned my addr 172.21.15.167:0/3063253873 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:56:20.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba437fe640 1 --2- 172.21.15.167:0/3063253873 >> v2:172.21.15.178:3300/0 conn(0x7fba440c6ff0 0x7fba44157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101919732 0 0) 0x7fba440c48f0 con 0x7fba44150b40 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba2c003530 con 0x7fba44150b40 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4233938142 0 0) 0x7fba2c003530 con 0x7fba44150b40 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 >> v2:172.21.15.178:3300/0 conn(0x7fba440c6ff0 msgr2=0x7fba44157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 --2- 172.21.15.167:0/3063253873 >> v2:172.21.15.178:3300/0 conn(0x7fba440c6ff0 0x7fba44157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 >> v1:172.21.15.178:6789/0 conn(0x7fba440c4510 legacy=0x7fba4406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440c6500 con 0x7fba44150b40 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fba340016a0 con 0x7fba44150b40 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 >> v1:172.21.15.167:6789/0 conn(0x7fba44150b40 legacy=0x7fba440c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba2c003980 0x7fba2c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2c0047d0 0x7fba2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba2c005190 0x7fba2c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440c62f0 con 0x7fba2c0047d0 2023-11-28T20:56:20.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c00c030 con 0x7fba2c003980 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c00c1f0 con 0x7fba2c005190 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba437fe640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2c0047d0 0x7fba2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba43fff640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba2c003980 0x7fba2c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba489b4640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba2c005190 0x7fba2c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba437fe640 1 -- 172.21.15.167:0/3063253873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba2c005190 msgr2=0x7fba2c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba437fe640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba2c005190 0x7fba2c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba437fe640 1 -- 172.21.15.167:0/3063253873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba2c003980 msgr2=0x7fba2c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba437fe640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba2c003980 0x7fba2c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba437fe640 1 -- 172.21.15.167:0/3063253873 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c003530 con 0x7fba2c0047d0 2023-11-28T20:56:20.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.152+0000 7fba489b4640 1 -- 172.21.15.167:0/3063253873 reap_dead start 2023-11-28T20:56:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba437fe640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2c0047d0 0x7fba2c004c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fba38009670 tx=0x7fba3801ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77ea72dba2b54a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:20.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380a7770 con 0x7fba2c0047d0 2023-11-28T20:56:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba380a78d0 con 0x7fba2c0047d0 2023-11-28T20:56:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba42ffd640 1 -- 172.21.15.167:0/3063253873 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380a7c80 con 0x7fba2c0047d0 2023-11-28T20:56:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba4a417640 1 -- 172.21.15.167:0/3063253873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2c0047d0 msgr2=0x7fba2c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba4a417640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2c0047d0 0x7fba2c004c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fba38009670 tx=0x7fba3801ec80 comp rx=0 tx=0).stop 2023-11-28T20:56:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba4a417640 1 -- 172.21.15.167:0/3063253873 shutdown_connections 2023-11-28T20:56:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba4a417640 1 --2- 172.21.15.167:0/3063253873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2c0047d0 0x7fba2c004c50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba4a417640 1 -- 172.21.15.167:0/3063253873 >> 172.21.15.167:0/3063253873 conn(0x7fba440cb1e0 msgr2=0x7fba440cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba4a417640 1 -- 172.21.15.167:0/3063253873 shutdown_connections 2023-11-28T20:56:20.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.156+0000 7fba4a417640 1 -- 172.21.15.167:0/3063253873 wait complete. 2023-11-28T20:56:20.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 Processor -- start 2023-11-28T20:56:20.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 -- start start 2023-11-28T20:56:20.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba2c0047d0 0x7fba441479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44157c10 0x7fba44071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba44149580 0x7fba441595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44158ac0 con 0x7fba44149580 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44147fd0 con 0x7fba2c0047d0 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba44148290 con 0x7fba44157c10 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba489b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba44149580 0x7fba441595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba489b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba44149580 0x7fba441595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43418/0 (socket says 172.21.15.167:43418) 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba489b4640 1 -- 172.21.15.167:0/203740123 learned_addr learned my addr 172.21.15.167:0/203740123 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba437fe640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44157c10 0x7fba44071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba43fff640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba2c0047d0 0x7fba441479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba489b4640 1 -- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44157c10 msgr2=0x7fba44071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba489b4640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44157c10 0x7fba44071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba489b4640 1 -- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba2c0047d0 msgr2=0x7fba441479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba489b4640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba2c0047d0 0x7fba441479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba489b4640 1 -- 172.21.15.167:0/203740123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44148570 con 0x7fba44149580 2023-11-28T20:56:20.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba437fe640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44157c10 0x7fba44071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:56:20.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba489b4640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba44149580 0x7fba441595e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fba4406eee0 tx=0x7fba3c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:20.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00eed0 con 0x7fba44149580 2023-11-28T20:56:20.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c003980 con 0x7fba44149580 2023-11-28T20:56:20.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba44148850 con 0x7fba44149580 2023-11-28T20:56:20.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c003d70 con 0x7fba44149580 2023-11-28T20:56:20.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba441590c0 con 0x7fba44149580 2023-11-28T20:56:20.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44159b20 0x7fba440ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.160+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba44148700 con 0x7fba44159b20 2023-11-28T20:56:20.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba43fff640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44159b20 0x7fba440ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba43fff640 1 -- 172.21.15.167:0/203740123 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba44156d60 con 0x7fba44159b20 2023-11-28T20:56:20.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba3c0050d0 con 0x7fba44149580 2023-11-28T20:56:20.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba43fff640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44159b20 0x7fba440ca320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fba34013950 tx=0x7fba34013e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:20.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba40ff9640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba300664a0 0x7fba30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fba3c083fe0 con 0x7fba44149580 2023-11-28T20:56:20.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34011bb0 con 0x7fba44159b20 2023-11-28T20:56:20.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba437fe640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba300664a0 0x7fba30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fba34011d10 con 0x7fba44159b20 2023-11-28T20:56:20.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44159b20 msgr2=0x7fba440ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba40ff9640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44159b20 0x7fba440ca320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fba34013950 tx=0x7fba34013e10 comp rx=0 tx=0).stop 2023-11-28T20:56:20.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44159b20 msgr2=0x7fba440ca320 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:20.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba40ff9640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba44159b20 0x7fba440ca320 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fba34013950 tx=0x7fba34013e10 comp rx=0 tx=0).stop 2023-11-28T20:56:20.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.164+0000 7fba437fe640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba300664a0 0x7fba30068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fba380b1000 tx=0x7fba38010040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba440ca860 0x7fba441f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba44074770 con 0x7fba440ca860 2023-11-28T20:56:20.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba43fff640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba440ca860 0x7fba441f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba43fff640 1 -- 172.21.15.167:0/203740123 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fba44156a80 con 0x7fba440ca860 2023-11-28T20:56:20.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba43fff640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba440ca860 0x7fba441f28b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fba3401b000 tx=0x7fba34001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34026070 con 0x7fba440ca860 2023-11-28T20:56:20.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7fba340212e0 con 0x7fba440ca860 2023-11-28T20:56:20.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba440ca860 msgr2=0x7fba441f28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba40ff9640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba440ca860 0x7fba441f28b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fba3401b000 tx=0x7fba34001e80 comp rx=0 tx=0).stop 2023-11-28T20:56:20.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba40ff9640 1 -- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba440ca860 msgr2=0x7fba441f28b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:20.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba40ff9640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba440ca860 0x7fba441f28b0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fba3401b000 tx=0x7fba34001e80 comp rx=0 tx=0).stop 2023-11-28T20:56:20.175 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:56:20.175 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:20.175 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:20.175 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:56:20.175 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 142, 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 3, 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:20.176 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:20.177 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:56:20.178 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:20.179 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.180 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.181 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:20.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:56:20.183 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.185 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:20.186 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:20.187 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:20.187 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:20.187 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:20.187 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:56:20.187 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba300664a0 msgr2=0x7fba30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fba300664a0 0x7fba30068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fba380b1000 tx=0x7fba38010040 comp rx=0 tx=0).stop 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba44149580 msgr2=0x7fba441595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 --2- 172.21.15.167:0/203740123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba44149580 0x7fba441595e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fba4406eee0 tx=0x7fba3c00eb90 comp rx=0 tx=0).stop 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba489b4640 1 -- 172.21.15.167:0/203740123 reap_dead start 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba489b4640 1 -- 172.21.15.167:0/203740123 reap_dead start 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 shutdown_connections 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 >> 172.21.15.167:0/203740123 conn(0x7fba440cb1e0 msgr2=0x7fba440c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 shutdown_connections 2023-11-28T20:56:20.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.172+0000 7fba4a417640 1 -- 172.21.15.167:0/203740123 wait complete. 2023-11-28T20:56:20.193 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:56:20.193 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:56:20.193 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:56:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.328+0000 7f43618d6640 1 Processor -- start 2023-11-28T20:56:20.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.328+0000 7f43618d6640 1 -- start start 2023-11-28T20:56:20.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f43618d6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f435c15d700 0x7f435c15db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f43618d6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c15ad50 con 0x7f435c0c86f0 2023-11-28T20:56:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f43618d6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c154500 con 0x7f435c154120 2023-11-28T20:56:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f43618d6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c159ef0 con 0x7f435c15d700 2023-11-28T20:56:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f435b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f435c15d700 0x7f435c15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f435a7fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f435c0c86f0 0x7f435c0c6f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56656/0 (socket says 172.21.15.167:56656) 2023-11-28T20:56:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f435a7fc640 1 -- 172.21.15.167:0/3634879247 learned_addr learned my addr 172.21.15.167:0/3634879247 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:56:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f435b7fe640 1 -- 172.21.15.167:0/3634879247 >> v1:172.21.15.178:6789/0 conn(0x7f435c154120 legacy=0x7f435c0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f435b7fe640 1 -- 172.21.15.167:0/3634879247 >> v1:172.21.15.167:6789/0 conn(0x7f435c0c86f0 legacy=0x7f435c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.332+0000 7f435b7fe640 1 -- 172.21.15.167:0/3634879247 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c15a1d0 con 0x7f435c15d700 2023-11-28T20:56:20.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f435b7fe640 1 --2- 172.21.15.167:0/3634879247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c15d700 0x7f435c15db00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4354009d90 tx=0x7f435401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8864a11eeb8bc769 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:20.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f4359ffb640 1 -- 172.21.15.167:0/3634879247 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43540a58f0 con 0x7f435c15d700 2023-11-28T20:56:20.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f4359ffb640 1 -- 172.21.15.167:0/3634879247 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43540a5a50 con 0x7f435c15d700 2023-11-28T20:56:20.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f4359ffb640 1 -- 172.21.15.167:0/3634879247 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43540a5de0 con 0x7f435c15d700 2023-11-28T20:56:20.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 -- 172.21.15.167:0/3634879247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c15d700 msgr2=0x7f435c15db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 --2- 172.21.15.167:0/3634879247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c15d700 0x7f435c15db00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4354009d90 tx=0x7f435401c920 comp rx=0 tx=0).stop 2023-11-28T20:56:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 -- 172.21.15.167:0/3634879247 shutdown_connections 2023-11-28T20:56:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 --2- 172.21.15.167:0/3634879247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c15d700 0x7f435c15db00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 -- 172.21.15.167:0/3634879247 >> 172.21.15.167:0/3634879247 conn(0x7f435c0cc300 msgr2=0x7f435c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 -- 172.21.15.167:0/3634879247 shutdown_connections 2023-11-28T20:56:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 -- 172.21.15.167:0/3634879247 wait complete. 2023-11-28T20:56:20.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 Processor -- start 2023-11-28T20:56:20.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 -- start start 2023-11-28T20:56:20.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c0c86f0 0x7f435c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.336+0000 7f43618d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f435c154120 0x7f435c1479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f43618d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f435c15d700 0x7f435c15c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f43618d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0cb0c0 con 0x7f435c0c86f0 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f43618d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0cc1c0 con 0x7f435c15d700 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f43618d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c147ee0 con 0x7f435c154120 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c0c86f0 0x7f435c0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c0c86f0 0x7f435c0caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43442/0 (socket says 172.21.15.167:43442) 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435affd640 1 -- 172.21.15.167:0/3529656837 learned_addr learned my addr 172.21.15.167:0/3529656837 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435b7fe640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f435c15d700 0x7f435c15c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435a7fc640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f435c154120 0x7f435c1479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435affd640 1 -- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f435c154120 msgr2=0x7f435c1479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435affd640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f435c154120 0x7f435c1479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435affd640 1 -- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f435c15d700 msgr2=0x7f435c15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435affd640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f435c15d700 0x7f435c15c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435affd640 1 -- 172.21.15.167:0/3529656837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354009a70 con 0x7f435c0c86f0 2023-11-28T20:56:20.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f435affd640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c0c86f0 0x7f435c0caae0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f434c00c560 tx=0x7f434c00ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f4343fff640 1 -- 172.21.15.167:0/3529656837 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c005220 con 0x7f435c0c86f0 2023-11-28T20:56:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f4343fff640 1 -- 172.21.15.167:0/3529656837 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c005380 con 0x7f435c0c86f0 2023-11-28T20:56:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c0cb5b0 con 0x7f435c0c86f0 2023-11-28T20:56:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f4343fff640 1 -- 172.21.15.167:0/3529656837 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c007270 con 0x7f435c0c86f0 2023-11-28T20:56:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c0cbb70 con 0x7f435c0c86f0 2023-11-28T20:56:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c0682c0 con 0x7f435c0c86f0 2023-11-28T20:56:20.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f4343fff640 1 -- 172.21.15.167:0/3529656837 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f434c0073d0 con 0x7f435c0c86f0 2023-11-28T20:56:20.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.340+0000 7f4343fff640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43480664a0 0x7f4348068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:20.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.344+0000 7f4343fff640 1 -- 172.21.15.167:0/3529656837 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f434c0839d0 con 0x7f435c0c86f0 2023-11-28T20:56:20.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.344+0000 7f435a7fc640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43480664a0 0x7f4348068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:20.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.344+0000 7f435a7fc640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43480664a0 0x7f4348068960 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f435c070030 tx=0x7f4350009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:20.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.344+0000 7f4343fff640 1 -- 172.21.15.167:0/3529656837 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f434c050af0 con 0x7f435c0c86f0 2023-11-28T20:56:20.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.548+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f435c06acb0 con 0x7f435c0c86f0 2023-11-28T20:56:20.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f4343fff640 1 -- 172.21.15.167:0/3529656837 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f435c06acb0 con 0x7f435c0c86f0 2023-11-28T20:56:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43480664a0 msgr2=0x7f4348068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43480664a0 0x7f4348068960 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f435c070030 tx=0x7f4350009040 comp rx=0 tx=0).stop 2023-11-28T20:56:20.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c0c86f0 msgr2=0x7f435c0caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c0c86f0 0x7f435c0caae0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f434c00c560 tx=0x7f434c00ca20 comp rx=0 tx=0).stop 2023-11-28T20:56:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 shutdown_connections 2023-11-28T20:56:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43480664a0 0x7f4348068960 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f435c15d700 0x7f435c15c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f435c154120 0x7f435c1479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 --2- 172.21.15.167:0/3529656837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f435c0c86f0 0x7f435c0caae0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 >> 172.21.15.167:0/3529656837 conn(0x7f435c0cc300 msgr2=0x7f435c06af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:20.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 shutdown_connections 2023-11-28T20:56:20.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:20.552+0000 7f43618d6640 1 -- 172.21.15.167:0/3529656837 wait complete. 2023-11-28T20:56:20.575 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:56:21.274 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:21.277 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:23.542 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 18% (42/227) Updating files: 19% (44/227) Updating files: 20% (46/227) Updating files: 21% (48/227) Updating files: 22% (50/227) Updating files: 23% (53/227) Updating files: 24% (55/227) Updating files: 25% (57/227) Updating files: 26% (60/227) Updating files: 27% (62/227) Updating files: 28% (64/227) Updating files: 29% (66/227) Updating files: 30% (69/227) Updating files: 31% (71/227) Updating files: 32% (73/227) Updating files: 33% (75/227) Updating files: 34% (78/227) Updating files: 35% (80/227) Updating files: 36% (82/227) Updating files: 37% (84/227) Updating files: 38% (87/227) Updating files: 39% (89/227) Updating files: 40% (91/227) Updating files: 41% (94/227) Updating files: 42% (96/227) Updating files: 42% (97/227) Updating files: 43% (98/227) Updating files: 44% (100/227) Updating files: 45% (103/227) Updating files: 46% (105/227) Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 48% (111/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 60% (137/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 98% (224/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2023-11-28T20:56:23.782 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 071881d7e55 v0.28 2023-11-28T20:56:23.788 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.28 2023-11-28T20:56:24.070 INFO:tasks.workunit.client.0.smithi167.stdout:v0.29 2023-11-28T20:56:24.071 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 29 -eq 48 ] 2023-11-28T20:56:24.071 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.29 2023-11-28T20:56:24.071 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.29 2023-11-28T20:56:24.071 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.29 2023-11-28T20:56:30.575 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:56:30.576 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:56:30.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.720+0000 7fce9905a640 1 Processor -- start 2023-11-28T20:56:30.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.720+0000 7fce9905a640 1 -- start start 2023-11-28T20:56:30.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9905a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fce94151f60 0x7fce940c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:30.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9905a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce940c6120 con 0x7fce9406a580 2023-11-28T20:56:30.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9905a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9415b220 con 0x7fce940c5c90 2023-11-28T20:56:30.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9905a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce940c4da0 con 0x7fce94151f60 2023-11-28T20:56:30.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9359e640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fce9406a580 0x7fce941625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:58968/0 (socket says 172.21.15.167:58968) 2023-11-28T20:56:30.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9359e640 1 -- 172.21.15.167:0/2495422649 learned_addr learned my addr 172.21.15.167:0/2495422649 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:56:30.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce92d9d640 1 --2- 172.21.15.167:0/2495422649 >> v2:172.21.15.178:3300/0 conn(0x7fce94151f60 0x7fce940c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:30.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913240477 0 0) 0x7fce8c0014a0 con 0x7fce9406a580 2023-11-28T20:56:30.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce80003530 con 0x7fce9406a580 2023-11-28T20:56:30.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201963190 0 0) 0x7fce9415b220 con 0x7fce940c5c90 2023-11-28T20:56:30.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce8c0014a0 con 0x7fce940c5c90 2023-11-28T20:56:30.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3097342460 0 0) 0x7fce80003530 con 0x7fce9406a580 2023-11-28T20:56:30.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 >> v2:172.21.15.178:3300/0 conn(0x7fce94151f60 msgr2=0x7fce940c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:30.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 --2- 172.21.15.167:0/2495422649 >> v2:172.21.15.178:3300/0 conn(0x7fce94151f60 0x7fce940c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 >> v1:172.21.15.178:6789/0 conn(0x7fce940c5c90 legacy=0x7fce940c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:30.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94152340 con 0x7fce9406a580 2023-11-28T20:56:30.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fce8c001b90 con 0x7fce9406a580 2023-11-28T20:56:30.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 >> v1:172.21.15.167:6789/0 conn(0x7fce9406a580 legacy=0x7fce941625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:30.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce80003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:30.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce800047d0 0x7fce80004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:30.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce800051e0 0x7fce8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:30.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8000c0e0 con 0x7fce80003b60 2023-11-28T20:56:30.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8000c250 con 0x7fce800047d0 2023-11-28T20:56:30.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8000c410 con 0x7fce800051e0 2023-11-28T20:56:30.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce92d9d640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce80003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:30.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce8a59c640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce800047d0 0x7fce80004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:30.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9359e640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce800051e0 0x7fce8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:30.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce92d9d640 1 -- 172.21.15.167:0/2495422649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce800051e0 msgr2=0x7fce8000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:30.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce92d9d640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce800051e0 0x7fce8000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce92d9d640 1 -- 172.21.15.167:0/2495422649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce800047d0 msgr2=0x7fce80004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:30.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce92d9d640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce800047d0 0x7fce80004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce92d9d640 1 -- 172.21.15.167:0/2495422649 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80003530 con 0x7fce80003b60 2023-11-28T20:56:30.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.724+0000 7fce9359e640 1 -- 172.21.15.167:0/2495422649 reap_dead start 2023-11-28T20:56:30.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce92d9d640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce80003f60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fce84009ae0 tx=0x7fce8401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ad31172432c3c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:30.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840a5530 con 0x7fce80003b60 2023-11-28T20:56:30.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce840a5690 con 0x7fce80003b60 2023-11-28T20:56:30.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9259c640 1 -- 172.21.15.167:0/2495422649 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840a5a40 con 0x7fce80003b60 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9905a640 1 -- 172.21.15.167:0/2495422649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 msgr2=0x7fce80003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9905a640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce80003f60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fce84009ae0 tx=0x7fce8401ca50 comp rx=0 tx=0).stop 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9905a640 1 -- 172.21.15.167:0/2495422649 shutdown_connections 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9905a640 1 --2- 172.21.15.167:0/2495422649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce80003f60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9905a640 1 -- 172.21.15.167:0/2495422649 >> 172.21.15.167:0/2495422649 conn(0x7fce940cb1e0 msgr2=0x7fce940cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9905a640 1 -- 172.21.15.167:0/2495422649 shutdown_connections 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.728+0000 7fce9905a640 1 -- 172.21.15.167:0/2495422649 wait complete. 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 Processor -- start 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 -- start start 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce94141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce94142080 0x7fce94159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:30.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9415a310 0x7fce941f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce94142500 con 0x7fce80003b60 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce94156620 con 0x7fce9415a310 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce94159940 con 0x7fce94142080 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce92d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce94141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce92d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce94141b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52496/0 (socket says 172.21.15.167:52496) 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce92d9d640 1 -- 172.21.15.167:0/808202207 learned_addr learned my addr 172.21.15.167:0/808202207 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce8a59c640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce94142080 0x7fce94159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9359e640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9415a310 0x7fce941f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce92d9d640 1 -- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce94142080 msgr2=0x7fce94159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce92d9d640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce94142080 0x7fce94159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce92d9d640 1 -- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9415a310 msgr2=0x7fce941f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce92d9d640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9415a310 0x7fce941f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce92d9d640 1 -- 172.21.15.167:0/808202207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9415a790 con 0x7fce80003b60 2023-11-28T20:56:30.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce92d9d640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce94141b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fce8401c880 tx=0x7fce840197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:30.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce8bfff640 1 -- 172.21.15.167:0/808202207 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840a5530 con 0x7fce80003b60 2023-11-28T20:56:30.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce8bfff640 1 -- 172.21.15.167:0/808202207 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce84004020 con 0x7fce80003b60 2023-11-28T20:56:30.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce8bfff640 1 -- 172.21.15.167:0/808202207 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce840043d0 con 0x7fce80003b60 2023-11-28T20:56:30.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce94071a10 con 0x7fce80003b60 2023-11-28T20:56:30.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.732+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce94071cb0 con 0x7fce80003b60 2023-11-28T20:56:30.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.736+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce940682c0 con 0x7fce80003b60 2023-11-28T20:56:30.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.736+0000 7fce8bfff640 1 -- 172.21.15.167:0/808202207 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce840b4070 con 0x7fce80003b60 2023-11-28T20:56:30.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.736+0000 7fce8bfff640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce74066470 0x7fce74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:30.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.736+0000 7fce8bfff640 1 -- 172.21.15.167:0/808202207 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fce8411e6d0 con 0x7fce80003b60 2023-11-28T20:56:30.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.736+0000 7fce8a59c640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce74066470 0x7fce74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:30.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.736+0000 7fce8a59c640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce74066470 0x7fce74068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fce941f0860 tx=0x7fce7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:30.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.740+0000 7fce8bfff640 1 -- 172.21.15.167:0/808202207 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce840eb6c0 con 0x7fce80003b60 2023-11-28T20:56:30.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fce94075c90 con 0x7fce80003b60 2023-11-28T20:56:30.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce8bfff640 1 -- 172.21.15.167:0/808202207 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fce840b2630 con 0x7fce80003b60 2023-11-28T20:56:30.945 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":142,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:56:30.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce74066470 msgr2=0x7fce74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:30.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce74066470 0x7fce74068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fce941f0860 tx=0x7fce7c009040 comp rx=0 tx=0).stop 2023-11-28T20:56:30.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 msgr2=0x7fce94141b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:30.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce94141b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fce8401c880 tx=0x7fce840197f0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 shutdown_connections 2023-11-28T20:56:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce74066470 0x7fce74068930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9415a310 0x7fce941f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce94142080 0x7fce94159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 --2- 172.21.15.167:0/808202207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce80003b60 0x7fce94141b40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 >> 172.21.15.167:0/808202207 conn(0x7fce940cb1e0 msgr2=0x7fce9414dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 shutdown_connections 2023-11-28T20:56:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:30.944+0000 7fce9905a640 1 -- 172.21.15.167:0/808202207 wait complete. 2023-11-28T20:56:30.966 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:56:30.967 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:56:30.967 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:56:30.967 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:56:31.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a351f5640 1 Processor -- start 2023-11-28T20:56:31.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a351f5640 1 -- start start 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a351f5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a30150b40 0x7f1a30157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a351f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a300c6ff0 0x7f1a300c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a351f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a300c6ac0 con 0x7f1a300c5be0 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a351f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a300c6500 con 0x7f1a300c6ff0 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a351f5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a300c67e0 con 0x7f1a30150b40 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a2659c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a300c6ff0 0x7f1a300c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a2659c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a300c6ff0 0x7f1a300c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52506/0 (socket says 172.21.15.167:52506) 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a2659c640 1 -- 172.21.15.167:0/76603511 learned_addr learned my addr 172.21.15.167:0/76603511 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a2ed9d640 1 --2- 172.21.15.167:0/76603511 >> v2:172.21.15.178:3300/0 conn(0x7f1a30150b40 0x7f1a30157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a2659c640 1 -- 172.21.15.167:0/76603511 >> v2:172.21.15.178:3300/0 conn(0x7f1a30150b40 msgr2=0x7f1a30157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:31.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.104+0000 7f1a2659c640 1 --2- 172.21.15.167:0/76603511 >> v2:172.21.15.178:3300/0 conn(0x7f1a30150b40 0x7f1a30157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a2659c640 1 -- 172.21.15.167:0/76603511 >> v1:172.21.15.167:6789/0 conn(0x7f1a300c5be0 legacy=0x7f1a3006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a2659c640 1 -- 172.21.15.167:0/76603511 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a30156a80 con 0x7f1a300c6ff0 2023-11-28T20:56:31.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a2659c640 1 --2- 172.21.15.167:0/76603511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a300c6ff0 0x7f1a300c4510 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a300cc090 tx=0x7f1a1801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444c5634ce2f1554 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a2e59c640 1 -- 172.21.15.167:0/76603511 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180aa430 con 0x7f1a300c6ff0 2023-11-28T20:56:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a2e59c640 1 -- 172.21.15.167:0/76603511 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a180aa590 con 0x7f1a300c6ff0 2023-11-28T20:56:31.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a2e59c640 1 -- 172.21.15.167:0/76603511 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180aa920 con 0x7f1a300c6ff0 2023-11-28T20:56:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a351f5640 1 -- 172.21.15.167:0/76603511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a300c6ff0 msgr2=0x7f1a300c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a351f5640 1 --2- 172.21.15.167:0/76603511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a300c6ff0 0x7f1a300c4510 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a300cc090 tx=0x7f1a1801c4d0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a351f5640 1 -- 172.21.15.167:0/76603511 shutdown_connections 2023-11-28T20:56:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a351f5640 1 --2- 172.21.15.167:0/76603511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a300c6ff0 0x7f1a300c4510 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a351f5640 1 --2- 172.21.15.167:0/76603511 >> v2:172.21.15.178:3300/0 conn(0x7f1a30150b40 0x7f1a30157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a351f5640 1 -- 172.21.15.167:0/76603511 >> 172.21.15.167:0/76603511 conn(0x7f1a300cb1e0 msgr2=0x7f1a300cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a351f5640 1 -- 172.21.15.167:0/76603511 shutdown_connections 2023-11-28T20:56:31.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.108+0000 7f1a351f5640 1 -- 172.21.15.167:0/76603511 wait complete. 2023-11-28T20:56:31.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a351f5640 1 Processor -- start 2023-11-28T20:56:31.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a351f5640 1 -- start start 2023-11-28T20:56:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a351f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a300c5be0 0x7f1a301f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a351f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a300c6ff0 0x7f1a3015f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a351f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30150b40 0x7f1a30070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a351f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3014abf0 con 0x7f1a30150b40 2023-11-28T20:56:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a351f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a301f6a20 con 0x7f1a300c6ff0 2023-11-28T20:56:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a351f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3015f9c0 con 0x7f1a300c5be0 2023-11-28T20:56:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30150b40 0x7f1a30070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2f59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30150b40 0x7f1a30070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52520/0 (socket says 172.21.15.167:52520) 2023-11-28T20:56:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2f59e640 1 -- 172.21.15.167:0/3935047248 learned_addr learned my addr 172.21.15.167:0/3935047248 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:31.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2659c640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a300c6ff0 0x7f1a3015f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2ed9d640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a300c5be0 0x7f1a301f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2f59e640 1 -- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a300c5be0 msgr2=0x7f1a301f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2f59e640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a300c5be0 0x7f1a301f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2f59e640 1 -- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a300c6ff0 msgr2=0x7f1a3015f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2f59e640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a300c6ff0 0x7f1a3015f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2f59e640 1 -- 172.21.15.167:0/3935047248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a180094d0 con 0x7f1a30150b40 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.112+0000 7f1a2f59e640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30150b40 0x7f1a30070800 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800c730 tx=0x7f1a2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a28003ba0 con 0x7f1a30150b40 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a28003d00 con 0x7f1a30150b40 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a28005310 con 0x7f1a30150b40 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3014fc90 con 0x7f1a30150b40 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a30160240 con 0x7f1a30150b40 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a351f5640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30147ea0 0x7f1a30160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a30074770 con 0x7f1a30147ea0 2023-11-28T20:56:31.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a2ed9d640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30147ea0 0x7f1a30160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a2ed9d640 1 -- 172.21.15.167:0/3935047248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a3006ac90 con 0x7f1a30147ea0 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a2ed9d640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30147ea0 0x7f1a30160430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a20010820 tx=0x7f1a20010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20004240 con 0x7f1a30147ea0 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a28005680 con 0x7f1a30150b40 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a10066510 0x7f1a100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1a28084090 con 0x7f1a30150b40 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1a200043a0 con 0x7f1a30147ea0 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30147ea0 msgr2=0x7f1a30160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30147ea0 0x7f1a30160430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a20010820 tx=0x7f1a20010ce0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30147ea0 msgr2=0x7f1a30160430 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a27fff640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30147ea0 0x7f1a30160430 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a20010820 tx=0x7f1a20010ce0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.116+0000 7f1a2659c640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a10066510 0x7f1a100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.120+0000 7f1a2659c640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a10066510 0x7f1a100689d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1a180ae000 tx=0x7f1a180b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30148280 0x7f1a30160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a300682c0 con 0x7f1a30148280 2023-11-28T20:56:31.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a2ed9d640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30148280 0x7f1a30160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a2ed9d640 1 -- 172.21.15.167:0/3935047248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1a30075c90 con 0x7f1a30148280 2023-11-28T20:56:31.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a2ed9d640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30148280 0x7f1a30160970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1a20010820 tx=0x7f1a200046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20024070 con 0x7f1a30148280 2023-11-28T20:56:31.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5126 (secure 0 0 0) 0x7f1a20006d20 con 0x7f1a30148280 2023-11-28T20:56:31.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30148280 msgr2=0x7f1a30160970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a27fff640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30148280 0x7f1a30160970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1a20010820 tx=0x7f1a200046d0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a27fff640 1 -- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30148280 msgr2=0x7f1a30160970 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:31.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a27fff640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30148280 0x7f1a30160970 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1a20010820 tx=0x7f1a200046d0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.127 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 142, 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:56:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:56:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:56:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:56:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:56:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:56:31.132 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:31.133 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.134 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:56:31.135 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:31.136 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:56:31.137 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:31.138 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:56:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:56:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.140 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:56:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:56:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.141 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:56:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:56:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.142 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:56:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.143 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:56:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:56:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:56:31.144 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:56:31.145 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:56:31.146 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:56:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a10066510 msgr2=0x7f1a100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1a10066510 0x7f1a100689d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1a180ae000 tx=0x7f1a180b5040 comp rx=0 tx=0).stop 2023-11-28T20:56:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30150b40 msgr2=0x7f1a30070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30150b40 0x7f1a30070800 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800c730 tx=0x7f1a2800cbf0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a2f59e640 1 -- 172.21.15.167:0/3935047248 reap_dead start 2023-11-28T20:56:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 shutdown_connections 2023-11-28T20:56:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 --2- 172.21.15.167:0/3935047248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a30150b40 0x7f1a30070800 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 >> 172.21.15.167:0/3935047248 conn(0x7f1a300cb1e0 msgr2=0x7f1a3006ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 shutdown_connections 2023-11-28T20:56:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.124+0000 7f1a351f5640 1 -- 172.21.15.167:0/3935047248 wait complete. 2023-11-28T20:56:31.149 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:56:31.149 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:56:31.149 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:56:31.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa74b53e640 1 Processor -- start 2023-11-28T20:56:31.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa74b53e640 1 -- start start 2023-11-28T20:56:31.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa74b53e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7441585d0 0x7fa7440c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa74b53e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa74415e130 0x7fa744161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa74b53e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440c7720 0x7fa744162320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa74b53e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74415f160 con 0x7fa7441585d0 2023-11-28T20:56:31.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa74b53e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74415e5e0 con 0x7fa74415e130 2023-11-28T20:56:31.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa74b53e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74415e8c0 con 0x7fa7440c7720 2023-11-28T20:56:31.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa7492da640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7441585d0 0x7fa7440c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa7492da640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7441585d0 0x7fa7440c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52542/0 (socket says 172.21.15.167:52542) 2023-11-28T20:56:31.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa7492da640 1 -- 172.21.15.167:0/1960848839 learned_addr learned my addr 172.21.15.167:0/1960848839 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:31.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa749adb640 1 --2- 172.21.15.167:0/1960848839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440c7720 0x7fa744162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa748ad9640 1 --2- 172.21.15.167:0/1960848839 >> v2:172.21.15.178:3300/0 conn(0x7fa74415e130 0x7fa744161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa7492da640 1 -- 172.21.15.167:0/1960848839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440c7720 msgr2=0x7fa744162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:31.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa7492da640 1 --2- 172.21.15.167:0/1960848839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440c7720 0x7fa744162320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa7492da640 1 -- 172.21.15.167:0/1960848839 >> v2:172.21.15.178:3300/0 conn(0x7fa74415e130 msgr2=0x7fa744161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:31.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa7492da640 1 --2- 172.21.15.167:0/1960848839 >> v2:172.21.15.178:3300/0 conn(0x7fa74415e130 0x7fa744161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.288+0000 7fa7492da640 1 -- 172.21.15.167:0/1960848839 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74415eba0 con 0x7fa7441585d0 2023-11-28T20:56:31.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa7492da640 1 --2- 172.21.15.167:0/1960848839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 0x7fa7440c5e90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa74406eea0 tx=0x7fa74001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c07dc696034191 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa73bfff640 1 -- 172.21.15.167:0/1960848839 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7400aa5f0 con 0x7fa7441585d0 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa73bfff640 1 -- 172.21.15.167:0/1960848839 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7400aa750 con 0x7fa7441585d0 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa73bfff640 1 -- 172.21.15.167:0/1960848839 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7400aaae0 con 0x7fa7441585d0 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa74b53e640 1 -- 172.21.15.167:0/1960848839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 msgr2=0x7fa7440c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa74b53e640 1 --2- 172.21.15.167:0/1960848839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 0x7fa7440c5e90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa74406eea0 tx=0x7fa74001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa74b53e640 1 -- 172.21.15.167:0/1960848839 shutdown_connections 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa74b53e640 1 --2- 172.21.15.167:0/1960848839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440c7720 0x7fa744162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa74b53e640 1 --2- 172.21.15.167:0/1960848839 >> v2:172.21.15.178:3300/0 conn(0x7fa74415e130 0x7fa744161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa74b53e640 1 --2- 172.21.15.167:0/1960848839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 0x7fa7440c5e90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa74b53e640 1 -- 172.21.15.167:0/1960848839 >> 172.21.15.167:0/1960848839 conn(0x7fa7440cb1e0 msgr2=0x7fa7440cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa74b53e640 1 -- 172.21.15.167:0/1960848839 shutdown_connections 2023-11-28T20:56:31.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.292+0000 7fa74b53e640 1 -- 172.21.15.167:0/1960848839 wait complete. 2023-11-28T20:56:31.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 Processor -- start 2023-11-28T20:56:31.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 -- start start 2023-11-28T20:56:31.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440c7720 0x7fa7441f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 0x7fa744160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74415e130 0x7fa744159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7441f7800 con 0x7fa7441585d0 2023-11-28T20:56:31.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74415b480 con 0x7fa7440c7720 2023-11-28T20:56:31.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa744158b70 con 0x7fa74415e130 2023-11-28T20:56:31.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa748ad9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 0x7fa744160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa748ad9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 0x7fa744160d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52548/0 (socket says 172.21.15.167:52548) 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa748ad9640 1 -- 172.21.15.167:0/3455767214 learned_addr learned my addr 172.21.15.167:0/3455767214 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa7492da640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440c7720 0x7fa7441f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa749adb640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74415e130 0x7fa744159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa748ad9640 1 -- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74415e130 msgr2=0x7fa744159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa748ad9640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74415e130 0x7fa744159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa748ad9640 1 -- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440c7720 msgr2=0x7fa7441f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa748ad9640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440c7720 0x7fa7441f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa748ad9640 1 -- 172.21.15.167:0/3455767214 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400094d0 con 0x7fa7441585d0 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa7492da640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440c7720 0x7fa7441f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa748ad9640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 0x7fa744160d50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa73400d5f0 tx=0x7fa73400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340125f0 con 0x7fa7441585d0 2023-11-28T20:56:31.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734012750 con 0x7fa7441585d0 2023-11-28T20:56:31.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734012ae0 con 0x7fa7441585d0 2023-11-28T20:56:31.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74415a420 con 0x7fa7441585d0 2023-11-28T20:56:31.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74415b6d0 con 0x7fa7441585d0 2023-11-28T20:56:31.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74406ddd0 0x7fa744159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.296+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa744074770 con 0x7fa74406ddd0 2023-11-28T20:56:31.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa7492da640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74406ddd0 0x7fa744159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa7492da640 1 -- 172.21.15.167:0/3455767214 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7440c2f40 con 0x7fa74406ddd0 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa734012c40 con 0x7fa7441585d0 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa7492da640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74406ddd0 0x7fa744159540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c5e20 tx=0x7fa740019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa739ffb640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7280664a0 0x7fa728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa734084640 con 0x7fa7441585d0 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7400aad50 con 0x7fa74406ddd0 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa7400b33f0 con 0x7fa74406ddd0 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74406ddd0 msgr2=0x7fa744159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa739ffb640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74406ddd0 0x7fa744159540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c5e20 tx=0x7fa740019270 comp rx=0 tx=0).stop 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74406ddd0 msgr2=0x7fa744159540 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa739ffb640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74406ddd0 0x7fa744159540 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa749adb640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7280664a0 0x7fa728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.300+0000 7fa749adb640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7280664a0 0x7fa728068960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c2410 tx=0x7fa73c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74415aa50 0x7fa744154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440682c0 con 0x7fa74415aa50 2023-11-28T20:56:31.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa7492da640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74415aa50 0x7fa744154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa7492da640 1 -- 172.21.15.167:0/3455767214 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa744075c90 con 0x7fa74415aa50 2023-11-28T20:56:31.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa7492da640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74415aa50 0x7fa744154880 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa74001ab80 tx=0x7fa740009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7400bdae0 con 0x7fa74415aa50 2023-11-28T20:56:31.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4811 (secure 0 0 0) 0x7fa7400c4670 con 0x7fa74415aa50 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74415aa50 msgr2=0x7fa744154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa739ffb640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74415aa50 0x7fa744154880 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa74001ab80 tx=0x7fa740009240 comp rx=0 tx=0).stop 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa739ffb640 1 -- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74415aa50 msgr2=0x7fa744154880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa739ffb640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74415aa50 0x7fa744154880 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 142, 2023-11-28T20:56:31.311 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:31.312 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:31.313 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:56:31.314 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:56:31.315 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.316 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.318 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:31.318 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:56:31.318 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.318 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.318 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.318 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:31.319 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.320 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.321 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.322 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.323 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.324 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.325 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:56:31.326 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:56:31.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7280664a0 msgr2=0x7fa728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7280664a0 0x7fa728068960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c2410 tx=0x7fa73c00b040 comp rx=0 tx=0).stop 2023-11-28T20:56:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 msgr2=0x7fa744160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 --2- 172.21.15.167:0/3455767214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7441585d0 0x7fa744160d50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa73400d5f0 tx=0x7fa73400dab0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa749adb640 1 -- 172.21.15.167:0/3455767214 reap_dead start 2023-11-28T20:56:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa749adb640 1 -- 172.21.15.167:0/3455767214 reap_dead start 2023-11-28T20:56:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 shutdown_connections 2023-11-28T20:56:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 >> 172.21.15.167:0/3455767214 conn(0x7fa7440cb1e0 msgr2=0x7fa7440cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 shutdown_connections 2023-11-28T20:56:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.308+0000 7fa74b53e640 1 -- 172.21.15.167:0/3455767214 wait complete. 2023-11-28T20:56:31.329 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:56:31.329 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:56:31.329 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:56:31.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.464+0000 7f4c4dc9c640 1 Processor -- start 2023-11-28T20:56:31.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c4dc9c640 1 -- start start 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c4dc9c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c48151f60 0x7f4c480c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c4dc9c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c480c5c90 0x7f4c480c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c4dc9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4806a580 0x7f4c4806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c4dc9c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4806aed0 con 0x7f4c48151f60 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c4dc9c640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c480c4da0 con 0x7f4c480c5c90 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c4dc9c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c480c6120 con 0x7f4c4806a580 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c477fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c48151f60 0x7f4c480c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c477fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c48151f60 0x7f4c480c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52554/0 (socket says 172.21.15.167:52554) 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c477fe640 1 -- 172.21.15.167:0/2975672363 learned_addr learned my addr 172.21.15.167:0/2975672363 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c47fff640 1 --2- 172.21.15.167:0/2975672363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4806a580 0x7f4c4806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c46ffd640 1 --2- 172.21.15.167:0/2975672363 >> v2:172.21.15.178:3300/0 conn(0x7f4c480c5c90 0x7f4c480c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c477fe640 1 -- 172.21.15.167:0/2975672363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4806a580 msgr2=0x7f4c4806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:31.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c477fe640 1 --2- 172.21.15.167:0/2975672363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4806a580 0x7f4c4806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c477fe640 1 -- 172.21.15.167:0/2975672363 >> v2:172.21.15.178:3300/0 conn(0x7f4c480c5c90 msgr2=0x7f4c480c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:31.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c477fe640 1 --2- 172.21.15.167:0/2975672363 >> v2:172.21.15.178:3300/0 conn(0x7f4c480c5c90 0x7f4c480c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.468+0000 7f4c477fe640 1 -- 172.21.15.167:0/2975672363 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4815b220 con 0x7f4c48151f60 2023-11-28T20:56:31.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c477fe640 1 --2- 172.21.15.167:0/2975672363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c48151f60 0x7f4c480c75c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4c480c8d80 tx=0x7f4c3801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b37ebc9fbd2e3f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c467fc640 1 -- 172.21.15.167:0/2975672363 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c380ab600 con 0x7f4c48151f60 2023-11-28T20:56:31.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c467fc640 1 -- 172.21.15.167:0/2975672363 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c380a7050 con 0x7f4c48151f60 2023-11-28T20:56:31.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c467fc640 1 -- 172.21.15.167:0/2975672363 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c380ab980 con 0x7f4c48151f60 2023-11-28T20:56:31.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2975672363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c48151f60 msgr2=0x7f4c480c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 --2- 172.21.15.167:0/2975672363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c48151f60 0x7f4c480c75c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4c480c8d80 tx=0x7f4c3801c470 comp rx=0 tx=0).stop 2023-11-28T20:56:31.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2975672363 shutdown_connections 2023-11-28T20:56:31.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 --2- 172.21.15.167:0/2975672363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4806a580 0x7f4c4806a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 --2- 172.21.15.167:0/2975672363 >> v2:172.21.15.178:3300/0 conn(0x7f4c480c5c90 0x7f4c480c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 --2- 172.21.15.167:0/2975672363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c48151f60 0x7f4c480c75c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2975672363 >> 172.21.15.167:0/2975672363 conn(0x7f4c480cb1e0 msgr2=0x7f4c480cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:31.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2975672363 shutdown_connections 2023-11-28T20:56:31.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2975672363 wait complete. 2023-11-28T20:56:31.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 Processor -- start 2023-11-28T20:56:31.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.472+0000 7f4c4dc9c640 1 -- start start 2023-11-28T20:56:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4806a580 0x7f4c480c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c480c5c90 0x7f4c481473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c48151f60 0x7f4c48147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48070e60 con 0x7f4c480c5c90 2023-11-28T20:56:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48071fc0 con 0x7f4c4806a580 2023-11-28T20:56:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48071d00 con 0x7f4c48151f60 2023-11-28T20:56:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c46ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c480c5c90 0x7f4c481473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c46ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c480c5c90 0x7f4c481473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52568/0 (socket says 172.21.15.167:52568) 2023-11-28T20:56:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c46ffd640 1 -- 172.21.15.167:0/2748376047 learned_addr learned my addr 172.21.15.167:0/2748376047 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c477fe640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4806a580 0x7f4c480c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c47fff640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c48151f60 0x7f4c48147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c46ffd640 1 -- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c48151f60 msgr2=0x7f4c48147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c46ffd640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c48151f60 0x7f4c48147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c46ffd640 1 -- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4806a580 msgr2=0x7f4c480c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c46ffd640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4806a580 0x7f4c480c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c46ffd640 1 -- 172.21.15.167:0/2748376047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c380094d0 con 0x7f4c480c5c90 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c46ffd640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c480c5c90 0x7f4c481473c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00d800 tx=0x7f4c3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00b6c0 con 0x7f4c480c5c90 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c00b820 con 0x7f4c480c5c90 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00bb90 con 0x7f4c480c5c90 2023-11-28T20:56:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4815c0d0 con 0x7f4c480c5c90 2023-11-28T20:56:31.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c480724a0 con 0x7f4c480c5c90 2023-11-28T20:56:31.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481442d0 0x7f4c48070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48074770 con 0x7f4c481442d0 2023-11-28T20:56:31.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.476+0000 7f4c477fe640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481442d0 0x7f4c48070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c477fe640 1 -- 172.21.15.167:0/2748376047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c4815bf50 con 0x7f4c481442d0 2023-11-28T20:56:31.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c477fe640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481442d0 0x7f4c48070510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c480c62c0 tx=0x7f4c3801acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4c3c00bcf0 con 0x7f4c480c5c90 2023-11-28T20:56:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c2ffff640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c34066470 0x7f4c34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4c3c0845e0 con 0x7f4c480c5c90 2023-11-28T20:56:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c380abe00 con 0x7f4c481442d0 2023-11-28T20:56:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c47fff640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c34066470 0x7f4c34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f4c380b7450 con 0x7f4c481442d0 2023-11-28T20:56:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481442d0 msgr2=0x7f4c48070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c2ffff640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481442d0 0x7f4c48070510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c480c62c0 tx=0x7f4c3801acb0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481442d0 msgr2=0x7f4c48070510 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c2ffff640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481442d0 0x7f4c48070510 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.480+0000 7f4c47fff640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c34066470 0x7f4c34068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4c40003ab0 tx=0x7f4c40009790 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.484+0000 7f4c4dc9c640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481447f0 0x7f4c481f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:31.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.484+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4815ba30 con 0x7f4c481447f0 2023-11-28T20:56:31.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c477fe640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481447f0 0x7f4c481f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:31.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c477fe640 1 -- 172.21.15.167:0/2748376047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4c480682c0 con 0x7f4c481447f0 2023-11-28T20:56:31.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c477fe640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481447f0 0x7f4c481f5710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c3801ab20 tx=0x7f4c38019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38003c60 con 0x7f4c481447f0 2023-11-28T20:56:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7f4c38003dc0 con 0x7f4c481447f0 2023-11-28T20:56:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481447f0 msgr2=0x7f4c481f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c2ffff640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481447f0 0x7f4c481f5710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c3801ab20 tx=0x7f4c38019210 comp rx=0 tx=0).stop 2023-11-28T20:56:31.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c2ffff640 1 -- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481447f0 msgr2=0x7f4c481f5710 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:31.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c2ffff640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c481447f0 0x7f4c481f5710 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c3801ab20 tx=0x7f4c38019210 comp rx=0 tx=0).stop 2023-11-28T20:56:31.491 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:56:31.491 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:31.491 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:31.491 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:56:31.491 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 142, 2023-11-28T20:56:31.491 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:56:31.491 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:31.492 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:31.493 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:56:31.494 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:31.495 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:56:31.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:31.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.498 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:31.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:31.501 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:56:31.502 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.503 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:56:31.504 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:56:31.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c34066470 msgr2=0x7f4c34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c4dc9c640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4c34066470 0x7f4c34068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4c40003ab0 tx=0x7f4c40009790 comp rx=0 tx=0).stop 2023-11-28T20:56:31.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c480c5c90 msgr2=0x7f4c481473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:31.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c4dc9c640 1 --2- 172.21.15.167:0/2748376047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c480c5c90 0x7f4c481473c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00d800 tx=0x7f4c3c00dcc0 comp rx=0 tx=0).stop 2023-11-28T20:56:31.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c47fff640 1 -- 172.21.15.167:0/2748376047 reap_dead start 2023-11-28T20:56:31.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c47fff640 1 -- 172.21.15.167:0/2748376047 reap_dead start 2023-11-28T20:56:31.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 shutdown_connections 2023-11-28T20:56:31.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 >> 172.21.15.167:0/2748376047 conn(0x7f4c480cb1e0 msgr2=0x7f4c480c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:31.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 shutdown_connections 2023-11-28T20:56:31.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:31.488+0000 7f4c4dc9c640 1 -- 172.21.15.167:0/2748376047 wait complete. 2023-11-28T20:56:31.509 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:56:31.509 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2023-11-28T20:56:31.509 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2023-11-28T20:56:31.509 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2023-11-28T20:56:31.510 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:56:31.510 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:56:31.510 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:56:31.528 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:56:31.528 INFO:tasks.mon_thrash:Sending STOP to mon b 2023-11-28T20:56:31.528 INFO:tasks.ceph.mon.b:Sent signal 19 2023-11-28T20:56:31.528 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2023-11-28T20:56:46.529 INFO:tasks.mon_thrash:Sending CONT to mon b 2023-11-28T20:56:46.530 INFO:tasks.ceph.mon.b:Sent signal 18 2023-11-28T20:56:46.530 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:56:46.530 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:56:46.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe072cbb640 1 Processor -- start 2023-11-28T20:56:46.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe072cbb640 1 -- start start 2023-11-28T20:56:46.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe072cbb640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:46.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe072cbb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 0x7fe06c0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe072cbb640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06c15b220 con 0x7fe06c06a580 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe072cbb640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe06c0c4da0 con 0x7fe06c151f60 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe072cbb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c0c60f0 con 0x7fe06c0c5c90 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe06bfff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 msgr2=0x7fe06c0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe06bfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 0x7fe06c0c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe070a57640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe071258640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe06c06a580 0x7fe06c06ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:47444/0 (socket says 172.21.15.167:47444) 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe071258640 1 -- 172.21.15.167:0/1613277885 learned_addr learned my addr 172.21.15.167:0/1613277885 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 msgr2=0x7fe06c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 msgr2=0x7fe06c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:56:46.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:56:46.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.679+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:46.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.883+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 msgr2=0x7fe06c0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:46.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.883+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 0x7fe06c0c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:56:46.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.883+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:46.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.883+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 msgr2=0x7fe06c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:56:46.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.883+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 msgr2=0x7fe06c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:56:46.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.883+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:56:46.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:46.883+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:56:47.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:47.287+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 msgr2=0x7fe06c0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:47.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:47.287+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 0x7fe06c0c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:56:47.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:47.287+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:47.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:47.287+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 msgr2=0x7fe06c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:56:47.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:47.287+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 msgr2=0x7fe06c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:56:47.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:47.287+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:56:47.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:47.287+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:56:48.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:48.091+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 msgr2=0x7fe06c0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:48.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:48.091+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 0x7fe06c0c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:56:48.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:48.091+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:48.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:48.091+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 msgr2=0x7fe06c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:56:48.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:48.091+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 msgr2=0x7fe06c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:56:48.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:48.091+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:56:48.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:48.091+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:56:49.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06a7fc640 1 -- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 msgr2=0x7fe06c0c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06a7fc640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe06c0c5c90 0x7fe06c0c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06a7fc640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 msgr2=0x7fe06c0c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06a7fc640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.178:3300/0 conn(0x7fe06c151f60 0x7fe06c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06a7fc640 1 -- 172.21.15.167:0/1613277885 >> v1:172.21.15.178:6789/0 conn(0x7fe06c06a580 legacy=0x7fe06c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06a7fc640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06a7fc640 1 -- 172.21.15.167:0/1613277885 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06c152340 con 0x7fe0500036f0 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06a7fc640 1 -- 172.21.15.167:0/1613277885 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe06c0c60f0 con 0x7fe050007380 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 msgr2=0x7fe050009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 msgr2=0x7fe050009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:56:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:56:49.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.679+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:49.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.883+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:49.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.883+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 msgr2=0x7fe050009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:56:49.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.883+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 msgr2=0x7fe050009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:56:49.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.883+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:56:49.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:49.883+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:56:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:50.287+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:50.287+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 msgr2=0x7fe050009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:56:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:50.287+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 msgr2=0x7fe050009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:56:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:50.287+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:56:50.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:50.287+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:56:51.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.091+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.091+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 msgr2=0x7fe050009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:56:51.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.091+0000 7fe06bfff640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 msgr2=0x7fe050009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:56:51.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.091+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:56:51.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.091+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:56:51.324 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:51.329 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:51.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507262949 0 0) 0x7fe06c152340 con 0x7fe0500036f0 2023-11-28T20:56:51.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe05c003530 con 0x7fe0500036f0 2023-11-28T20:56:51.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3798343063 0 0) 0x7fe05c003530 con 0x7fe0500036f0 2023-11-28T20:56:51.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 msgr2=0x7fe050009840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:56:51.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 --2- 172.21.15.167:0/1613277885 >> v2:172.21.15.167:3300/0 conn(0x7fe050007380 0x7fe050009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05000af50 con 0x7fe0500036f0 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fe060009a00 con 0x7fe0500036f0 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 >> v1:172.21.15.167:6789/0 conn(0x7fe0500036f0 legacy=0x7fe050005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe071258640 1 -- 172.21.15.167:0/1613277885 reap_dead start 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe05c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 0x7fe05c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 0x7fe05c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c0c60f0 con 0x7fe05c003980 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c00c110 con 0x7fe05c0047d0 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c00c2d0 con 0x7fe05c0051e0 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe05c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe071258640 1 -- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 msgr2=0x7fe05c00b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:51.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe071258640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 0x7fe05c00b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:51.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe06bfff640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 0x7fe05c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 msgr2=0x7fe05c00b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:56:51.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 0x7fe05c00b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 msgr2=0x7fe05c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:51.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 0x7fe05c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.551+0000 7fe070a57640 1 -- 172.21.15.167:0/1613277885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c003530 con 0x7fe05c003980 2023-11-28T20:56:51.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe070a57640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe05c003d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe060009610 tx=0x7fe06001da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab4ad014cc589e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:51.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600a6870 con 0x7fe05c003980 2023-11-28T20:56:51.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0600aa070 con 0x7fe05c003980 2023-11-28T20:56:51.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe06b7fe640 1 -- 172.21.15.167:0/1613277885 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600a6c10 con 0x7fe05c003980 2023-11-28T20:56:51.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe072cbb640 1 -- 172.21.15.167:0/1613277885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 msgr2=0x7fe05c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe072cbb640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe05c003d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe060009610 tx=0x7fe06001da00 comp rx=0 tx=0).stop 2023-11-28T20:56:51.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe072cbb640 1 -- 172.21.15.167:0/1613277885 shutdown_connections 2023-11-28T20:56:51.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe072cbb640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 0x7fe05c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe072cbb640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 0x7fe05c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe072cbb640 1 --2- 172.21.15.167:0/1613277885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe05c003d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe072cbb640 1 -- 172.21.15.167:0/1613277885 >> 172.21.15.167:0/1613277885 conn(0x7fe06c0cb1e0 msgr2=0x7fe06c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:51.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe072cbb640 1 -- 172.21.15.167:0/1613277885 shutdown_connections 2023-11-28T20:56:51.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.555+0000 7fe072cbb640 1 -- 172.21.15.167:0/1613277885 wait complete. 2023-11-28T20:56:51.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe072cbb640 1 Processor -- start 2023-11-28T20:56:51.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe072cbb640 1 -- start start 2023-11-28T20:56:51.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe072cbb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe06c1f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe072cbb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 0x7fe06c071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe072cbb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 0x7fe06c14e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe072cbb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c070480 con 0x7fe05c003980 2023-11-28T20:56:51.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe072cbb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c0706e0 con 0x7fe05c0047d0 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe072cbb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c0709c0 con 0x7fe05c0051e0 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe070a57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe06c1f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe071258640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 msgr2=0x7fe06c14e000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe070a57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe06c1f22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60634/0 (socket says 172.21.15.167:60634) 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe070a57640 1 -- 172.21.15.167:0/3380861074 learned_addr learned my addr 172.21.15.167:0/3380861074 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe071258640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 0x7fe06c14e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe06bfff640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 0x7fe06c071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe070a57640 1 -- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 msgr2=0x7fe06c14e000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe070a57640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 0x7fe06c14e000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe070a57640 1 -- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 msgr2=0x7fe06c071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe070a57640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 0x7fe06c071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe070a57640 1 -- 172.21.15.167:0/3380861074 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c070ca0 con 0x7fe05c003980 2023-11-28T20:56:51.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe06bfff640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 0x7fe06c071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:56:51.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.559+0000 7fe070a57640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe06c1f22e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe06001d830 tx=0x7fe05c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:51.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.563+0000 7fe0697fa640 1 -- 172.21.15.167:0/3380861074 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600a6cc0 con 0x7fe05c003980 2023-11-28T20:56:51.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.563+0000 7fe0697fa640 1 -- 172.21.15.167:0/3380861074 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06000f040 con 0x7fe05c003980 2023-11-28T20:56:51.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.563+0000 7fe0697fa640 1 -- 172.21.15.167:0/3380861074 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600b9640 con 0x7fe05c003980 2023-11-28T20:56:51.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.563+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06c070f80 con 0x7fe05c003980 2023-11-28T20:56:51.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.563+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe06c071540 con 0x7fe05c003980 2023-11-28T20:56:51.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.563+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe06c0682c0 con 0x7fe05c003980 2023-11-28T20:56:51.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.563+0000 7fe0697fa640 1 -- 172.21.15.167:0/3380861074 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0600b97a0 con 0x7fe05c003980 2023-11-28T20:56:51.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.563+0000 7fe0697fa640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe050066c30 0x7fe0500690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.563+0000 7fe0697fa640 1 -- 172.21.15.167:0/3380861074 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe06011ea10 con 0x7fe05c003980 2023-11-28T20:56:51.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.567+0000 7fe06bfff640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe050066c30 0x7fe0500690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.567+0000 7fe06bfff640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe050066c30 0x7fe0500690f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe06c14f620 tx=0x7fe05800d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:51.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.571+0000 7fe0697fa640 1 -- 172.21.15.167:0/3380861074 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0600ef490 con 0x7fe05c003980 2023-11-28T20:56:51.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe06c075c90 con 0x7fe05c003980 2023-11-28T20:56:51.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe0697fa640 1 -- 172.21.15.167:0/3380861074 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fe0600bf620 con 0x7fe05c003980 2023-11-28T20:56:51.810 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":144,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe050066c30 msgr2=0x7fe0500690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe050066c30 0x7fe0500690f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe06c14f620 tx=0x7fe05800d040 comp rx=0 tx=0).stop 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 msgr2=0x7fe06c1f22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe06c1f22e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe06001d830 tx=0x7fe05c005800 comp rx=0 tx=0).stop 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 shutdown_connections 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe050066c30 0x7fe0500690f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05c0051e0 0x7fe06c14e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05c0047d0 0x7fe06c071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 --2- 172.21.15.167:0/3380861074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c003980 0x7fe06c1f22e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.807+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 >> 172.21.15.167:0/3380861074 conn(0x7fe06c0cb1e0 msgr2=0x7fe06c0c7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:51.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.811+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 shutdown_connections 2023-11-28T20:56:51.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.811+0000 7fe072cbb640 1 -- 172.21.15.167:0/3380861074 wait complete. 2023-11-28T20:56:51.830 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:56:51.831 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:56:51.831 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:56:51.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b3509f640 1 Processor -- start 2023-11-28T20:56:51.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b3509f640 1 -- start start 2023-11-28T20:56:51.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b3509f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 0x7f6b30070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b3509f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b30156b10 con 0x7f6b3006b2a0 2023-11-28T20:56:51.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b3509f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b300c2cc0 con 0x7f6b3015f290 2023-11-28T20:56:51.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b3509f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300c3a80 con 0x7f6b30150f30 2023-11-28T20:56:51.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2ffff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 msgr2=0x7f6b30070460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:51.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 0x7f6b30070460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:51.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6b3006b2a0 0x7f6b300c4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52296/0 (socket says 172.21.15.167:52296) 2023-11-28T20:56:51.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2f7fe640 1 -- 172.21.15.167:0/3908510781 learned_addr learned my addr 172.21.15.167:0/3908510781 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131901291 0 0) 0x7f6b30156b10 con 0x7f6b3006b2a0 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b18003530 con 0x7f6b3006b2a0 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860091431 0 0) 0x7f6b18003530 con 0x7f6b3006b2a0 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 msgr2=0x7f6b30070460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 0x7f6b30070460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 >> v1:172.21.15.178:6789/0 conn(0x7f6b3015f290 legacy=0x7f6b30161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b30156db0 con 0x7f6b3006b2a0 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f6b24001680 con 0x7f6b3006b2a0 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 >> v1:172.21.15.167:6789/0 conn(0x7f6b3006b2a0 legacy=0x7f6b300c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b180039b0 0x7f6b18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b180047d0 0x7f6b18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 0x7f6b18005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1800dd50 con 0x7f6b180047d0 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1800dec0 con 0x7f6b180039b0 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1800e080 con 0x7f6b30150f30 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2f7fe640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b180047d0 0x7f6b18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b3489e640 1 -- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 msgr2=0x7f6b18005280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b3489e640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 0x7f6b18005280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2ffff640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b180039b0 0x7f6b18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2f7fe640 1 -- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 msgr2=0x7f6b18005280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2f7fe640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b30150f30 0x7f6b18005280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2f7fe640 1 -- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b180039b0 msgr2=0x7f6b18003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:51.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2f7fe640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b180039b0 0x7f6b18003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.975+0000 7f6b2f7fe640 1 -- 172.21.15.167:0/3908510781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18003530 con 0x7f6b180047d0 2023-11-28T20:56:51.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b2f7fe640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b180047d0 0x7f6b18004c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b3006b6e0 tx=0x7f6b2401f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b182e31dca10c3f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:51.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24005ae0 con 0x7f6b180047d0 2023-11-28T20:56:51.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b240ab070 con 0x7f6b180047d0 2023-11-28T20:56:51.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b2effd640 1 -- 172.21.15.167:0/3908510781 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24005e80 con 0x7f6b180047d0 2023-11-28T20:56:51.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b3509f640 1 -- 172.21.15.167:0/3908510781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b180047d0 msgr2=0x7f6b18004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b3509f640 1 --2- 172.21.15.167:0/3908510781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b180047d0 0x7f6b18004c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b3006b6e0 tx=0x7f6b2401f330 comp rx=0 tx=0).stop 2023-11-28T20:56:51.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b3489e640 1 -- 172.21.15.167:0/3908510781 reap_dead start 2023-11-28T20:56:51.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b3509f640 1 -- 172.21.15.167:0/3908510781 shutdown_connections 2023-11-28T20:56:51.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b3509f640 1 -- 172.21.15.167:0/3908510781 >> 172.21.15.167:0/3908510781 conn(0x7f6b300cb3f0 msgr2=0x7f6b300cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:51.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b3509f640 1 -- 172.21.15.167:0/3908510781 shutdown_connections 2023-11-28T20:56:51.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.979+0000 7f6b3509f640 1 -- 172.21.15.167:0/3908510781 wait complete. 2023-11-28T20:56:51.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 Processor -- start 2023-11-28T20:56:51.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 -- start start 2023-11-28T20:56:51.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b180047d0 0x7f6b30146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b301ef820 0x7f6b3013dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b301efca0 0x7f6b3013e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3014ad40 con 0x7f6b301ef820 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300c6530 con 0x7f6b301efca0 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b301f3920 con 0x7f6b180047d0 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2ffff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b180047d0 msgr2=0x7f6b30146890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b180047d0 0x7f6b30146890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b301ef820 0x7f6b3013dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b301ef820 0x7f6b3013dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60658/0 (socket says 172.21.15.167:60658) 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2f7fe640 1 -- 172.21.15.167:0/2008806412 learned_addr learned my addr 172.21.15.167:0/2008806412 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3489e640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b301efca0 0x7f6b3013e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2f7fe640 1 -- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b180047d0 msgr2=0x7f6b30146890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:56:51.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2f7fe640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b180047d0 0x7f6b30146890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2f7fe640 1 -- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b301efca0 msgr2=0x7f6b3013e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2f7fe640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b301efca0 0x7f6b3013e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2f7fe640 1 -- 172.21.15.167:0/2008806412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300c67d0 con 0x7f6b301ef820 2023-11-28T20:56:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2f7fe640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b301ef820 0x7f6b3013dbe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6b24001900 tx=0x7f6b18005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b240b7070 con 0x7f6b301ef820 2023-11-28T20:56:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b24005980 con 0x7f6b301ef820 2023-11-28T20:56:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b300c6ab0 con 0x7f6b301ef820 2023-11-28T20:56:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24005d10 con 0x7f6b301ef820 2023-11-28T20:56:51.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.983+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b301f3c00 con 0x7f6b301ef820 2023-11-28T20:56:51.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b3509f640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b300c60c0 0x7f6b30155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300c6960 con 0x7f6b300c60c0 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2ffff640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b300c60c0 0x7f6b30155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2ffff640 1 -- 172.21.15.167:0/2008806412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b30157890 con 0x7f6b300c60c0 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2ffff640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b300c60c0 0x7f6b30155780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6b20003940 tx=0x7f6b20009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000e660 con 0x7f6b300c60c0 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6b2000e7c0 con 0x7f6b300c60c0 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b300c60c0 msgr2=0x7f6b30155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2cff9640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b300c60c0 0x7f6b30155780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6b20003940 tx=0x7f6b20009a00 comp rx=0 tx=0).stop 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b300c60c0 msgr2=0x7f6b30155780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2cff9640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b300c60c0 0x7f6b30155780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b240ad020 con 0x7f6b301ef820 2023-11-28T20:56:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2cff9640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6b1c0661b0 0x7f6b1c068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.987+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6b24120fe0 con 0x7f6b301ef820 2023-11-28T20:56:51.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.991+0000 7f6b2ffff640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6b1c0661b0 0x7f6b1c068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.991+0000 7f6b2ffff640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6b1c0661b0 0x7f6b1c068670 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6b20003940 tx=0x7f6b20008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:51.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b30155cc0 0x7f6b301560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:51.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30074740 con 0x7f6b30155cc0 2023-11-28T20:56:51.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3489e640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b30155cc0 0x7f6b301560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:51.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3489e640 1 -- 172.21.15.167:0/2008806412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6b30157370 con 0x7f6b30155cc0 2023-11-28T20:56:51.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3489e640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b30155cc0 0x7f6b301560d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b300c9280 tx=0x7f6b2800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:51.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b28005b50 con 0x7f6b30155cc0 2023-11-28T20:56:51.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5114 (secure 0 0 0) 0x7f6b28005cb0 con 0x7f6b30155cc0 2023-11-28T20:56:51.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b30155cc0 msgr2=0x7f6b301560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:51.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b2cff9640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b30155cc0 0x7f6b301560d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b300c9280 tx=0x7f6b2800eb90 comp rx=0 tx=0).stop 2023-11-28T20:56:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b2cff9640 1 -- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b30155cc0 msgr2=0x7f6b301560d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:51.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b2cff9640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b30155cc0 0x7f6b301560d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:51.999 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:56:51.999 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:51.999 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:51.999 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:56:51.999 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 144, 2023-11-28T20:56:51.999 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:56:51.999 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:52.000 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:52.001 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:52.002 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:52.003 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.004 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.005 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:52.006 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.008 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:52.009 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:56:52.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.011 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.012 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:52.013 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.013 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:56:52.013 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.013 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.013 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:56:52.013 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6b1c0661b0 msgr2=0x7f6b1c068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6b1c0661b0 0x7f6b1c068670 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6b20003940 tx=0x7f6b20008030 comp rx=0 tx=0).stop 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b301ef820 msgr2=0x7f6b3013dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b301ef820 0x7f6b3013dbe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6b24001900 tx=0x7f6b18005800 comp rx=0 tx=0).stop 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3489e640 1 -- 172.21.15.167:0/2008806412 reap_dead start 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 shutdown_connections 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 --2- 172.21.15.167:0/2008806412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b301ef820 0x7f6b3013dbe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 >> 172.21.15.167:0/2008806412 conn(0x7f6b300cb3f0 msgr2=0x7f6b30070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 shutdown_connections 2023-11-28T20:56:52.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:51.995+0000 7f6b3509f640 1 -- 172.21.15.167:0/2008806412 wait complete. 2023-11-28T20:56:52.017 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:56:52.017 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:56:52.017 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:56:52.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.163+0000 7f5f41ec8640 1 Processor -- start 2023-11-28T20:56:52.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.163+0000 7f5f41ec8640 1 -- start start 2023-11-28T20:56:52.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f41ec8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 0x7f5f3c159b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:52.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f41ec8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5f3c0ca3c0 0x7f5f3c0c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:52.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f41ec8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c15a1b0 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f41ec8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c15a450 con 0x7f5f3c0ca3c0 2023-11-28T20:56:52.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f41ec8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c15a710 con 0x7f5f3c153d20 2023-11-28T20:56:52.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f40ec6640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 msgr2=0x7f5f3c159b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:52.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f40ec6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 0x7f5f3c159b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:52.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f3bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5f3c0ca3c0 0x7f5f3c0c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:52.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f3bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5f3c0ca3c0 0x7f5f3c0c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60694/0 (socket says 172.21.15.167:60694) 2023-11-28T20:56:52.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f3bfff640 1 -- 172.21.15.167:0/776821310 learned_addr learned my addr 172.21.15.167:0/776821310 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:52.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f3bfff640 1 -- 172.21.15.167:0/776821310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 msgr2=0x7f5f3c159b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:56:52.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f3bfff640 1 --2- 172.21.15.167:0/776821310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 0x7f5f3c159b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:52.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f3bfff640 1 -- 172.21.15.167:0/776821310 >> v1:172.21.15.178:6789/0 conn(0x7f5f3c0c5fb0 legacy=0x7f5f3c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:56:52.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.167+0000 7f5f3bfff640 1 -- 172.21.15.167:0/776821310 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c15a9f0 con 0x7f5f3c0ca3c0 2023-11-28T20:56:52.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f3bfff640 1 --2- 172.21.15.167:0/776821310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0ca3c0 0x7f5f3c0c5a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009870 tx=0x7f5f2801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936d84ae288fc710 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:52.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f3b7fe640 1 -- 172.21.15.167:0/776821310 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280a89d0 con 0x7f5f3c0ca3c0 2023-11-28T20:56:52.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f3b7fe640 1 -- 172.21.15.167:0/776821310 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f280a8b30 con 0x7f5f3c0ca3c0 2023-11-28T20:56:52.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f3b7fe640 1 -- 172.21.15.167:0/776821310 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280b0440 con 0x7f5f3c0ca3c0 2023-11-28T20:56:52.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 -- 172.21.15.167:0/776821310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0ca3c0 msgr2=0x7f5f3c0c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:52.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 --2- 172.21.15.167:0/776821310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0ca3c0 0x7f5f3c0c5a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009870 tx=0x7f5f2801ed10 comp rx=0 tx=0).stop 2023-11-28T20:56:52.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 -- 172.21.15.167:0/776821310 shutdown_connections 2023-11-28T20:56:52.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 --2- 172.21.15.167:0/776821310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0ca3c0 0x7f5f3c0c5a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:52.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 --2- 172.21.15.167:0/776821310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 0x7f5f3c159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:52.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 -- 172.21.15.167:0/776821310 >> 172.21.15.167:0/776821310 conn(0x7f5f3c06b800 msgr2=0x7f5f3c06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:52.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 -- 172.21.15.167:0/776821310 shutdown_connections 2023-11-28T20:56:52.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 -- 172.21.15.167:0/776821310 wait complete. 2023-11-28T20:56:52.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 Processor -- start 2023-11-28T20:56:52.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.171+0000 7f5f41ec8640 1 -- start start 2023-11-28T20:56:52.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0c5fb0 0x7f5f3c0c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:52.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c0ca3c0 0x7f5f3c14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:52.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 0x7f5f3c1ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:52.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c15aee0 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c14b2c0 con 0x7f5f3c0ca3c0 2023-11-28T20:56:52.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c14b530 con 0x7f5f3c153d20 2023-11-28T20:56:52.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f416c7640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 msgr2=0x7f5f3c1ef6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f40ec6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0c5fb0 0x7f5f3c0c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f416c7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 0x7f5f3c1ef6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f40ec6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0c5fb0 0x7f5f3c0c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60708/0 (socket says 172.21.15.167:60708) 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f40ec6640 1 -- 172.21.15.167:0/785180627 learned_addr learned my addr 172.21.15.167:0/785180627 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f3bfff640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c0ca3c0 0x7f5f3c14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f40ec6640 1 -- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 msgr2=0x7f5f3c1ef6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f40ec6640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f3c153d20 0x7f5f3c1ef6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f40ec6640 1 -- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c0ca3c0 msgr2=0x7f5f3c14ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f40ec6640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c0ca3c0 0x7f5f3c14ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f40ec6640 1 -- 172.21.15.167:0/785180627 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f280094d0 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f40ec6640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0c5fb0 0x7f5f3c0c92e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b530 tx=0x7f5f3000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30003dd0 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f30005070 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30005420 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c14b810 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c1f3090 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3890 0x7f5f3c0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c072740 con 0x7f5f3c1f3890 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f3bfff640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3890 0x7f5f3c0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f30005580 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.175+0000 7f5f3bfff640 1 -- 172.21.15.167:0/785180627 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f3c0cf8e0 con 0x7f5f3c1f3890 2023-11-28T20:56:52.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f3bfff640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3890 0x7f5f3c0cc3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0c9a90 tx=0x7f5f2801d550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f397fa640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5f20066420 0x7f5f200688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f5f30084190 con 0x7f5f3c0c5fb0 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f416c7640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5f20066420 0x7f5f200688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280a8970 con 0x7f5f3c1f3890 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f5f280b9400 con 0x7f5f3c1f3890 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3890 msgr2=0x7f5f3c0cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f397fa640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3890 0x7f5f3c0cc3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0c9a90 tx=0x7f5f2801d550 comp rx=0 tx=0).stop 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3890 msgr2=0x7f5f3c0cc3c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f397fa640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3890 0x7f5f3c0cc3c0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0c9a90 tx=0x7f5f2801d550 comp rx=0 tx=0).stop 2023-11-28T20:56:52.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.179+0000 7f5f416c7640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5f20066420 0x7f5f200688e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0c6400 tx=0x7f5f34007d20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.183+0000 7f5f41ec8640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3280 0x7f5f3c149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:56:52.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.183+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c5550 con 0x7f5f3c1f3280 2023-11-28T20:56:52.188 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 8% (13/159) Updating files: 9% (15/159) Updating files: 10% (16/159) Updating files: 11% (18/159) Updating files: 12% (20/159) Updating files: 13% (21/159) Updating files: 14% (23/159) Updating files: 15% (24/159) Updating files: 15% (25/159) Updating files: 16% (26/159) Updating files: 17% (28/159) Updating files: 18% (29/159) Updating files: 19% (31/159) Updating files: 20% (32/159) Updating files: 21% (34/159) Updating files: 22% (35/159) Updating files: 23% (37/159) Updating files: 24% (39/159) Updating files: 25% (40/159) Updating files: 26% (42/159) Updating files: 27% (43/159) Updating files: 28% (45/159) Updating files: 29% (47/159) Updating files: 30% (48/159) Updating files: 31% (50/159) Updating files: 32% (51/159) Updating files: 33% (53/159) Updating files: 34% (55/159) Updating files: 35% (56/159) Updating files: 36% (58/159) Updating files: 37% (59/159) Updating files: 38% (61/159) Updating files: 39% (63/159) Updating files: 40% (64/159) Updating files: 41% (66/159) Updating files: 42% (67/159) Updating files: 43% (69/159) Updating files: 44% (70/159) Updating files: 45% (72/159) Updating files: 46% (74/159) Updating files: 47% (75/159) Updating files: 48% (77/159) Updating files: 49% (78/159) Updating files: 50% (80/159) Updating files: 51% (82/159) Updating files: 52% (83/159) Updating files: 53% (85/159) Updating files: 54% (86/159) Updating files: 55% (88/159) Updating files: 55% (89/159) Updating files: 56% (90/159) Updating files: 57% (91/159) Updating files: 57% (92/159) Updating files: 58% (93/159) Updating files: 59% (94/159) Updating files: 60% (96/159) Updating files: 61% (97/159) Updating files: 62% (99/159) Updating files: 63% (101/159) Updating files: 64% (102/159) Updating files: 65% (104/159) Updating files: 66% (105/159) Updating files: 67% (107/159) Updating files: 68% (109/159) Updating files: 69% (110/159) Updating files: 70% (112/159) Updating files: 71% (113/159) Updating files: 72% (115/159) Updating files: 73% (117/159) Updating files: 74% (118/159) Updating files: 75% (120/159) Updating files: 76% (121/159) Updating files: 77% (123/159) Updating files: 78% (125/159) Updating files: 79% (126/159) Updating files: 80% (128/159) Updating files: 81% (129/159) Updating files: 82% (131/159) Updating files: 83% (132/159) Updating files: 84% (134/159) Updating files: 85% (136/159) Updating files: 86% (137/159) Updating files: 87% (139/159) Updating files: 88% (140/159) Updating files: 89% (142/159) Updating files: 90% (144/159) Updating files: 91% (145/159) Updating files: 92% (147/159) Updating files: 93% (148/159) Updating files: 94% (150/159) Updating files: 95% (152/159) Updating files: 96% (153/159) Updating files: 97% (155/159) Updating files: 98% (156/159) Updating files: 99% (158/159) Updating files: 100% (159/159) Updating files: 100% (159/159), done. 2023-11-28T20:56:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f3bfff640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3280 0x7f5f3c149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:56:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f3bfff640 1 -- 172.21.15.167:0/785180627 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5f3c0c5270 con 0x7f5f3c1f3280 2023-11-28T20:56:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f3bfff640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3280 0x7f5f3c149cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f2801ed50 tx=0x7f5f280aa000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:56:52.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280c6a50 con 0x7f5f3c1f3280 2023-11-28T20:56:52.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4799 (secure 0 0 0) 0x7f5f280ca070 con 0x7f5f3c1f3280 2023-11-28T20:56:52.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3280 msgr2=0x7f5f3c149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:52.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f397fa640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3280 0x7f5f3c149cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f2801ed50 tx=0x7f5f280aa000 comp rx=0 tx=0).stop 2023-11-28T20:56:52.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f397fa640 1 -- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3280 msgr2=0x7f5f3c149cf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:56:52.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f397fa640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f3c1f3280 0x7f5f3c149cf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 144, 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:52.191 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.192 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.193 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:56:52.194 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:56:52.195 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:52.196 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:52.198 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:52.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.199 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:52.199 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:56:52.199 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:52.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:56:52.201 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:56:52.202 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.203 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:56:52.204 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:56:52.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:56:52.205 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:56:52.205 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:56:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5f20066420 msgr2=0x7f5f200688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f41ec8640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5f20066420 0x7f5f200688e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0c6400 tx=0x7f5f34007d20 comp rx=0 tx=0).stop 2023-11-28T20:56:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0c5fb0 msgr2=0x7f5f3c0c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:56:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f41ec8640 1 --2- 172.21.15.167:0/785180627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f3c0c5fb0 0x7f5f3c0c92e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000b530 tx=0x7f5f3000b9f0 comp rx=0 tx=0).stop 2023-11-28T20:56:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f416c7640 1 -- 172.21.15.167:0/785180627 reap_dead start 2023-11-28T20:56:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f416c7640 1 -- 172.21.15.167:0/785180627 reap_dead start 2023-11-28T20:56:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 shutdown_connections 2023-11-28T20:56:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 >> 172.21.15.167:0/785180627 conn(0x7f5f3c06b800 msgr2=0x7f5f3c06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:56:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 shutdown_connections 2023-11-28T20:56:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:56:52.187+0000 7f5f41ec8640 1 -- 172.21.15.167:0/785180627 wait complete. 2023-11-28T20:56:52.209 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:56:52.209 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:56:52.551 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 8e69c39f699 v0.29 2023-11-28T20:56:52.557 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.29 2023-11-28T20:56:52.707 INFO:tasks.workunit.client.0.smithi167.stdout:v0.30 2023-11-28T20:56:52.708 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 30 -eq 48 ] 2023-11-28T20:56:52.708 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.30 2023-11-28T20:56:52.708 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.30 2023-11-28T20:56:52.708 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.30 2023-11-28T20:57:02.129 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 42% (121/285) Updating files: 43% (123/285) Updating files: 44% (126/285) Updating files: 45% (129/285) Updating files: 46% (132/285) Updating files: 47% (134/285) Updating files: 48% (137/285) Updating files: 49% (140/285) Updating files: 50% (143/285) Updating files: 51% (146/285) Updating files: 52% (149/285) Updating files: 53% (152/285) Updating files: 54% (154/285) Updating files: 55% (157/285) Updating files: 56% (160/285) Updating files: 57% (163/285) Updating files: 58% (166/285) Updating files: 59% (169/285) Updating files: 60% (171/285) Updating files: 61% (174/285) Updating files: 62% (177/285) Updating files: 63% (180/285) Updating files: 64% (183/285) Updating files: 65% (186/285) Updating files: 66% (189/285) Updating files: 67% (191/285) Updating files: 68% (194/285) Updating files: 69% (197/285) Updating files: 70% (200/285) Updating files: 71% (203/285) Updating files: 72% (206/285) Updating files: 73% (209/285) Updating files: 74% (211/285) Updating files: 74% (213/285) Updating files: 75% (214/285) Updating files: 76% (217/285) Updating files: 77% (220/285) Updating files: 78% (223/285) Updating files: 79% (226/285) Updating files: 80% (228/285) Updating files: 81% (231/285) Updating files: 82% (234/285) Updating files: 83% (237/285) Updating files: 84% (240/285) Updating files: 85% (243/285) Updating files: 86% (246/285) Updating files: 87% (248/285) Updating files: 88% (251/285) Updating files: 89% (254/285) Updating files: 89% (256/285) Updating files: 90% (257/285) Updating files: 91% (260/285) Updating files: 92% (263/285) Updating files: 93% (266/285) Updating files: 94% (268/285) Updating files: 95% (271/285) Updating files: 96% (274/285) Updating files: 97% (277/285) Updating files: 98% (280/285) Updating files: 99% (283/285) Updating files: 100% (285/285) Updating files: 100% (285/285), done. 2023-11-28T20:57:02.640 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 64b1b2c70f0 v0.30 2023-11-28T20:57:02.645 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.30 2023-11-28T20:57:02.691 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 31 -eq 48 ] 2023-11-28T20:57:02.691 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.31 2023-11-28T20:57:02.691 INFO:tasks.workunit.client.0.smithi167.stdout:v0.31 2023-11-28T20:57:02.691 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.31 2023-11-28T20:57:02.691 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.31 2023-11-28T20:57:11.492 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 11% (44/398) Updating files: 12% (48/398) Updating files: 13% (52/398) Updating files: 14% (56/398) Updating files: 15% (60/398) Updating files: 16% (64/398) Updating files: 17% (68/398) Updating files: 18% (72/398) Updating files: 19% (76/398) Updating files: 20% (80/398) Updating files: 21% (84/398) Updating files: 22% (88/398) Updating files: 23% (92/398) Updating files: 24% (96/398) Updating files: 25% (100/398) Updating files: 26% (104/398) Updating files: 27% (108/398) Updating files: 28% (112/398) Updating files: 28% (113/398) Updating files: 29% (116/398) Updating files: 30% (120/398) Updating files: 31% (124/398) Updating files: 32% (128/398) Updating files: 33% (132/398) Updating files: 34% (136/398) Updating files: 35% (140/398) Updating files: 36% (144/398) Updating files: 37% (148/398) Updating files: 38% (152/398) Updating files: 39% (156/398) Updating files: 40% (160/398) Updating files: 41% (164/398) Updating files: 42% (168/398) Updating files: 43% (172/398) Updating files: 44% (176/398) Updating files: 45% (180/398) Updating files: 46% (184/398) Updating files: 47% (188/398) Updating files: 48% (192/398) Updating files: 49% (196/398) Updating files: 50% (199/398) Updating files: 51% (203/398) Updating files: 52% (207/398) Updating files: 53% (211/398) Updating files: 54% (215/398) Updating files: 55% (219/398) Updating files: 56% (223/398) Updating files: 57% (227/398) Updating files: 58% (231/398) Updating files: 59% (235/398) Updating files: 60% (239/398) Updating files: 61% (243/398) Updating files: 61% (246/398) Updating files: 62% (247/398) Updating files: 63% (251/398) Updating files: 64% (255/398) Updating files: 65% (259/398) Updating files: 66% (263/398) Updating files: 67% (267/398) Updating files: 68% (271/398) Updating files: 69% (275/398) Updating files: 70% (279/398) Updating files: 71% (283/398) Updating files: 72% (287/398) Updating files: 73% (291/398) Updating files: 74% (295/398) Updating files: 75% (299/398) Updating files: 76% (303/398) Updating files: 76% (305/398) Updating files: 77% (307/398) Updating files: 78% (311/398) Updating files: 79% (315/398) Updating files: 80% (319/398) Updating files: 81% (323/398) Updating files: 82% (327/398) Updating files: 83% (331/398) Updating files: 84% (335/398) Updating files: 85% (339/398) Updating files: 86% (343/398) Updating files: 86% (346/398) Updating files: 87% (347/398) Updating files: 88% (351/398) Updating files: 89% (355/398) Updating files: 89% (356/398) Updating files: 90% (359/398) Updating files: 91% (363/398) Updating files: 92% (367/398) Updating files: 93% (371/398) Updating files: 94% (375/398) Updating files: 95% (379/398) Updating files: 96% (383/398) Updating files: 97% (387/398) Updating files: 98% (391/398) Updating files: 99% (395/398) Updating files: 100% (398/398) Updating files: 100% (398/398), done. 2023-11-28T20:57:11.761 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 9019c6ce640 v0.31 2023-11-28T20:57:11.764 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.31 2023-11-28T20:57:12.209 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:57:12.210 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2023-11-28T20:57:12.210 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:57:12.210 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:57:12.213 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:57:12.213 INFO:tasks.mon_thrash:Sending STOP to mon b 2023-11-28T20:57:12.213 INFO:tasks.ceph.mon.b:Sent signal 19 2023-11-28T20:57:12.213 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2023-11-28T20:57:12.422 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 32 -eq 48 ] 2023-11-28T20:57:12.423 INFO:tasks.workunit.client.0.smithi167.stdout:v0.32 2023-11-28T20:57:12.423 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.32 2023-11-28T20:57:12.423 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.32 2023-11-28T20:57:12.423 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.32 2023-11-28T20:57:20.003 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 34% (67/195) Updating files: 35% (69/195) Updating files: 36% (71/195) Updating files: 37% (73/195) Updating files: 38% (75/195) Updating files: 39% (77/195) Updating files: 40% (78/195) Updating files: 41% (80/195) Updating files: 42% (82/195) Updating files: 43% (84/195) Updating files: 44% (86/195) Updating files: 45% (88/195) Updating files: 46% (90/195) Updating files: 47% (92/195) Updating files: 48% (94/195) Updating files: 49% (96/195) Updating files: 50% (98/195) Updating files: 51% (100/195) Updating files: 52% (102/195) Updating files: 53% (104/195) Updating files: 54% (106/195) Updating files: 55% (108/195) Updating files: 56% (110/195) Updating files: 57% (112/195) Updating files: 58% (114/195) Updating files: 59% (116/195) Updating files: 60% (117/195) Updating files: 61% (119/195) Updating files: 61% (120/195) Updating files: 62% (121/195) Updating files: 63% (123/195) Updating files: 64% (125/195) Updating files: 65% (127/195) Updating files: 66% (129/195) Updating files: 67% (131/195) Updating files: 68% (133/195) Updating files: 69% (135/195) Updating files: 70% (137/195) Updating files: 71% (139/195) Updating files: 72% (141/195) Updating files: 73% (143/195) Updating files: 74% (145/195) Updating files: 75% (147/195) Updating files: 76% (149/195) Updating files: 77% (151/195) Updating files: 78% (153/195) Updating files: 79% (155/195) Updating files: 80% (156/195) Updating files: 81% (158/195) Updating files: 81% (159/195) Updating files: 82% (160/195) Updating files: 83% (162/195) Updating files: 84% (164/195) Updating files: 85% (166/195) Updating files: 86% (168/195) Updating files: 87% (170/195) Updating files: 88% (172/195) Updating files: 89% (174/195) Updating files: 90% (176/195) Updating files: 91% (178/195) Updating files: 92% (180/195) Updating files: 93% (182/195) Updating files: 94% (184/195) Updating files: 95% (186/195) Updating files: 96% (188/195) Updating files: 97% (190/195) Updating files: 98% (192/195) Updating files: 99% (194/195) Updating files: 100% (195/195) Updating files: 100% (195/195), done. 2023-11-28T20:57:20.811 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at c08d08baa6a v0.32 2023-11-28T20:57:20.815 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.32 2023-11-28T20:57:21.110 INFO:tasks.workunit.client.0.smithi167.stdout:v0.33 2023-11-28T20:57:21.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 33 -eq 48 ] 2023-11-28T20:57:21.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.33 2023-11-28T20:57:21.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.33 2023-11-28T20:57:21.111 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.33 2023-11-28T20:57:21.382 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:21.386 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:27.215 INFO:tasks.mon_thrash:Sending CONT to mon b 2023-11-28T20:57:28.477 INFO:tasks.ceph.mon.b:Sent signal 18 2023-11-28T20:57:28.477 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:57:28.478 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:57:28.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a7679640 1 Processor -- start 2023-11-28T20:57:28.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a7679640 1 -- start start 2023-11-28T20:57:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a7679640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5a0150b40 0x7fc5a0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a7679640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a00c4510 0x7fc5a006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a7679640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a00c4920 con 0x7fc5a00c6ff0 2023-11-28T20:57:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a7679640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a00c62f0 con 0x7fc5a0150b40 2023-11-28T20:57:28.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a7679640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00c6ac0 con 0x7fc5a00c4510 2023-11-28T20:57:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a5415640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5a0150b40 0x7fc5a0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a5415640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5a0150b40 0x7fc5a0157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48916/0 (socket says 172.21.15.167:48916) 2023-11-28T20:57:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a5415640 1 -- 172.21.15.167:0/2878471961 learned_addr learned my addr 172.21.15.167:0/2878471961 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a5c16640 1 --2- 172.21.15.167:0/2878471961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a00c4510 0x7fc5a006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a5415640 1 -- 172.21.15.167:0/2878471961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a00c4510 msgr2=0x7fc5a006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a5415640 1 --2- 172.21.15.167:0/2878471961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a00c4510 0x7fc5a006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a5415640 1 -- 172.21.15.167:0/2878471961 >> v1:172.21.15.167:6789/0 conn(0x7fc5a00c6ff0 legacy=0x7fc5a00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:28.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.627+0000 7fc5a5415640 1 -- 172.21.15.167:0/2878471961 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00c6500 con 0x7fc5a0150b40 2023-11-28T20:57:28.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc5a5415640 1 --2- 172.21.15.167:0/2878471961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a0150b40 0x7fc5a0157560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc59c009870 tx=0x7fc59c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ea997d165d07f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:28.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc597fff640 1 -- 172.21.15.167:0/2878471961 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c0ab620 con 0x7fc5a0150b40 2023-11-28T20:57:28.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc597fff640 1 -- 172.21.15.167:0/2878471961 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c0ab780 con 0x7fc5a0150b40 2023-11-28T20:57:28.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc597fff640 1 -- 172.21.15.167:0/2878471961 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c0abb10 con 0x7fc5a0150b40 2023-11-28T20:57:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc5a7679640 1 -- 172.21.15.167:0/2878471961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a0150b40 msgr2=0x7fc5a0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc5a7679640 1 --2- 172.21.15.167:0/2878471961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a0150b40 0x7fc5a0157560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc59c009870 tx=0x7fc59c01c510 comp rx=0 tx=0).stop 2023-11-28T20:57:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc5a7679640 1 -- 172.21.15.167:0/2878471961 shutdown_connections 2023-11-28T20:57:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc5a7679640 1 --2- 172.21.15.167:0/2878471961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a00c4510 0x7fc5a006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:28.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc5a7679640 1 --2- 172.21.15.167:0/2878471961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a0150b40 0x7fc5a0157560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc5a7679640 1 -- 172.21.15.167:0/2878471961 >> 172.21.15.167:0/2878471961 conn(0x7fc5a00cb1e0 msgr2=0x7fc5a00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc5a7679640 1 -- 172.21.15.167:0/2878471961 shutdown_connections 2023-11-28T20:57:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.631+0000 7fc5a7679640 1 -- 172.21.15.167:0/2878471961 wait complete. 2023-11-28T20:57:28.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 Processor -- start 2023-11-28T20:57:28.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 -- start start 2023-11-28T20:57:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a00c4510 0x7fc5a00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5a00c6ff0 0x7fc5a013ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a0150b40 0x7fc5a013da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a0163010 con 0x7fc5a00c4510 2023-11-28T20:57:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00ca950 con 0x7fc5a00c6ff0 2023-11-28T20:57:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a01f2520 con 0x7fc5a0150b40 2023-11-28T20:57:28.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5415640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a00c4510 0x7fc5a00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5415640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a00c4510 0x7fc5a00c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48918/0 (socket says 172.21.15.167:48918) 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5415640 1 -- 172.21.15.167:0/3121389507 learned_addr learned my addr 172.21.15.167:0/3121389507 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5c16640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a0150b40 0x7fc5a013da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a4c14640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5a00c6ff0 0x7fc5a013ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5415640 1 -- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a0150b40 msgr2=0x7fc5a013da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5415640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a0150b40 0x7fc5a013da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5415640 1 -- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5a00c6ff0 msgr2=0x7fc5a013ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5415640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5a00c6ff0 0x7fc5a013ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5415640 1 -- 172.21.15.167:0/3121389507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c0094d0 con 0x7fc5a00c4510 2023-11-28T20:57:28.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a4c14640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5a00c6ff0 0x7fc5a013ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:57:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a5415640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a00c4510 0x7fc5a00c9650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc59c01a140 tx=0x7fc59c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc595ffb640 1 -- 172.21.15.167:0/3121389507 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c0be3f0 con 0x7fc5a00c4510 2023-11-28T20:57:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc595ffb640 1 -- 172.21.15.167:0/3121389507 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c0be570 con 0x7fc5a00c4510 2023-11-28T20:57:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc595ffb640 1 -- 172.21.15.167:0/3121389507 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c0be920 con 0x7fc5a00c4510 2023-11-28T20:57:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a00cabf0 con 0x7fc5a00c4510 2023-11-28T20:57:28.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a01f2aa0 con 0x7fc5a00c4510 2023-11-28T20:57:28.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.635+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a00682c0 con 0x7fc5a00c4510 2023-11-28T20:57:28.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.639+0000 7fc595ffb640 1 -- 172.21.15.167:0/3121389507 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc59c0b43f0 con 0x7fc5a00c4510 2023-11-28T20:57:28.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.639+0000 7fc595ffb640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc584066470 0x7fc584068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:28.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.639+0000 7fc595ffb640 1 -- 172.21.15.167:0/3121389507 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc59c11e880 con 0x7fc5a00c4510 2023-11-28T20:57:28.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.639+0000 7fc5a4c14640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc584066470 0x7fc584068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:28.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.639+0000 7fc5a4c14640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc584066470 0x7fc584068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00ca6f0 tx=0x7fc590009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:28.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.643+0000 7fc595ffb640 1 -- 172.21.15.167:0/3121389507 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc59c0eba50 con 0x7fc5a00c4510 2023-11-28T20:57:28.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc5a0075c90 con 0x7fc5a00c4510 2023-11-28T20:57:28.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc595ffb640 1 -- 172.21.15.167:0/3121389507 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fc59c0c4620 con 0x7fc5a00c4510 2023-11-28T20:57:28.849 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:57:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc584066470 msgr2=0x7fc584068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc584066470 0x7fc584068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00ca6f0 tx=0x7fc590009040 comp rx=0 tx=0).stop 2023-11-28T20:57:28.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a00c4510 msgr2=0x7fc5a00c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a00c4510 0x7fc5a00c9650 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc59c01a140 tx=0x7fc59c01ad50 comp rx=0 tx=0).stop 2023-11-28T20:57:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 shutdown_connections 2023-11-28T20:57:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc584066470 0x7fc584068930 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5a0150b40 0x7fc5a013da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5a00c6ff0 0x7fc5a013ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 --2- 172.21.15.167:0/3121389507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5a00c4510 0x7fc5a00c9650 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 >> 172.21.15.167:0/3121389507 conn(0x7fc5a00cb1e0 msgr2=0x7fc5a0154520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 shutdown_connections 2023-11-28T20:57:28.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:28.847+0000 7fc5a7679640 1 -- 172.21.15.167:0/3121389507 wait complete. 2023-11-28T20:57:28.870 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:57:28.870 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:57:28.870 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:57:29.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d79d8640 1 Processor -- start 2023-11-28T20:57:29.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d79d8640 1 -- start start 2023-11-28T20:57:29.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d79d8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f54d0151d20 0x7f54d00c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d79d8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f54d00c5ff0 0x7f54d015b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d79d8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d00c2960 con 0x7f54d00c56e0 2023-11-28T20:57:29.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d79d8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d00c5070 con 0x7f54d0151d20 2023-11-28T20:57:29.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d79d8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d00c3170 con 0x7f54d00c5ff0 2023-11-28T20:57:29.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d5774640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f54d0151d20 0x7f54d00c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d5774640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f54d0151d20 0x7f54d00c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48934/0 (socket says 172.21.15.167:48934) 2023-11-28T20:57:29.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d5774640 1 -- 172.21.15.167:0/3101127090 learned_addr learned my addr 172.21.15.167:0/3101127090 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:29.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d5f75640 1 --2- 172.21.15.167:0/3101127090 >> v2:172.21.15.178:3300/0 conn(0x7f54d00c5ff0 0x7f54d015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d5774640 1 -- 172.21.15.167:0/3101127090 >> v2:172.21.15.178:3300/0 conn(0x7f54d00c5ff0 msgr2=0x7f54d015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:29.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d5774640 1 --2- 172.21.15.167:0/3101127090 >> v2:172.21.15.178:3300/0 conn(0x7f54d00c5ff0 0x7f54d015b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d5774640 1 -- 172.21.15.167:0/3101127090 >> v1:172.21.15.167:6789/0 conn(0x7f54d00c56e0 legacy=0x7f54d00c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.007+0000 7f54d5774640 1 -- 172.21.15.167:0/3101127090 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d00c77c0 con 0x7f54d0151d20 2023-11-28T20:57:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54d5774640 1 --2- 172.21.15.167:0/3101127090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0151d20 0x7f54d00c3d30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f54d006d580 tx=0x7f54cc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6709ff9ce6b2ec52 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54c7fff640 1 -- 172.21.15.167:0/3101127090 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0a89f0 con 0x7f54d0151d20 2023-11-28T20:57:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54c7fff640 1 -- 172.21.15.167:0/3101127090 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc0a8b50 con 0x7f54d0151d20 2023-11-28T20:57:29.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54c7fff640 1 -- 172.21.15.167:0/3101127090 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0b0440 con 0x7f54d0151d20 2023-11-28T20:57:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54d79d8640 1 -- 172.21.15.167:0/3101127090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0151d20 msgr2=0x7f54d00c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54d79d8640 1 --2- 172.21.15.167:0/3101127090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0151d20 0x7f54d00c3d30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f54d006d580 tx=0x7f54cc01ecf0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54d79d8640 1 -- 172.21.15.167:0/3101127090 shutdown_connections 2023-11-28T20:57:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54d79d8640 1 --2- 172.21.15.167:0/3101127090 >> v2:172.21.15.178:3300/0 conn(0x7f54d00c5ff0 0x7f54d015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54d79d8640 1 --2- 172.21.15.167:0/3101127090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0151d20 0x7f54d00c3d30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54d79d8640 1 -- 172.21.15.167:0/3101127090 >> 172.21.15.167:0/3101127090 conn(0x7f54d00cb460 msgr2=0x7f54d00cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:29.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54d79d8640 1 -- 172.21.15.167:0/3101127090 shutdown_connections 2023-11-28T20:57:29.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.011+0000 7f54d79d8640 1 -- 172.21.15.167:0/3101127090 wait complete. 2023-11-28T20:57:29.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 Processor -- start 2023-11-28T20:57:29.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 -- start start 2023-11-28T20:57:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d00c56e0 0x7f54d014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d00c5ff0 0x7f54d014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54d0151d20 0x7f54d0150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d014eb10 con 0x7f54d00c56e0 2023-11-28T20:57:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d01f0200 con 0x7f54d00c5ff0 2023-11-28T20:57:29.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d014c6c0 con 0x7f54d0151d20 2023-11-28T20:57:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5774640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d00c56e0 0x7f54d014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5774640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d00c56e0 0x7f54d014cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48950/0 (socket says 172.21.15.167:48950) 2023-11-28T20:57:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5774640 1 -- 172.21.15.167:0/3302411085 learned_addr learned my addr 172.21.15.167:0/3302411085 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5f75640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54d0151d20 0x7f54d0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d4f73640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d00c5ff0 0x7f54d014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5774640 1 -- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54d0151d20 msgr2=0x7f54d0150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5774640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54d0151d20 0x7f54d0150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5774640 1 -- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d00c5ff0 msgr2=0x7f54d014bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5774640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d00c5ff0 0x7f54d014bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5774640 1 -- 172.21.15.167:0/3302411085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0094d0 con 0x7f54d00c56e0 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d4f73640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d00c5ff0 0x7f54d014bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5f75640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54d0151d20 0x7f54d0150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d5774640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d00c56e0 0x7f54d014cef0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f54cc01b900 tx=0x7f54cc01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0ba600 con 0x7f54d00c56e0 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc0ba760 con 0x7f54d00c56e0 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0bab10 con 0x7f54d00c56e0 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d014d430 con 0x7f54d00c56e0 2023-11-28T20:57:29.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d014c410 con 0x7f54d00c56e0 2023-11-28T20:57:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d01f0670 0x7f54d01efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d00682a0 con 0x7f54d01f0670 2023-11-28T20:57:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d4f73640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d01f0670 0x7f54d01efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.015+0000 7f54d4f73640 1 -- 172.21.15.167:0/3302411085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54d00c2e90 con 0x7f54d01f0670 2023-11-28T20:57:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54d4f73640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d01f0670 0x7f54d01efa10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ca480 tx=0x7f54c000d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0016070 con 0x7f54d01f0670 2023-11-28T20:57:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f54cc0bac70 con 0x7f54d00c56e0 2023-11-28T20:57:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54c5ffb640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f54b4066540 0x7f54b4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f54cc1227a0 con 0x7f54d00c56e0 2023-11-28T20:57:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f54c0005280 con 0x7f54d01f0670 2023-11-28T20:57:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d01f0670 msgr2=0x7f54d01efa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54c5ffb640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d01f0670 0x7f54d01efa10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ca480 tx=0x7f54c000d970 comp rx=0 tx=0).stop 2023-11-28T20:57:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d01f0670 msgr2=0x7f54d01efa10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54c5ffb640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d01f0670 0x7f54d01efa10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54d5f75640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f54b4066540 0x7f54b4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.019+0000 7f54d5f75640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f54b4066540 0x7f54b4068a00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f54d0150070 tx=0x7f54c800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.023+0000 7f54d79d8640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0142d20 0x7f54d0143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d01f0370 con 0x7f54d0142d20 2023-11-28T20:57:29.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d4f73640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0142d20 0x7f54d0143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d4f73640 1 -- 172.21.15.167:0/3302411085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f54d00c2bb0 con 0x7f54d0142d20 2023-11-28T20:57:29.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d4f73640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0142d20 0x7f54d0143130 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ca480 tx=0x7f54c0001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0020070 con 0x7f54d0142d20 2023-11-28T20:57:29.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5125 (secure 0 0 0) 0x7f54c0012410 con 0x7f54d0142d20 2023-11-28T20:57:29.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0142d20 msgr2=0x7f54d0143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54c5ffb640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0142d20 0x7f54d0143130 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ca480 tx=0x7f54c0001130 comp rx=0 tx=0).stop 2023-11-28T20:57:29.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54c5ffb640 1 -- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0142d20 msgr2=0x7f54d0143130 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:29.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54c5ffb640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d0142d20 0x7f54d0143130 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.030 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:57:29.030 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:29.030 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:29.030 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:57:29.030 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 146, 2023-11-28T20:57:29.030 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:57:29.030 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:57:29.030 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:57:29.030 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:29.031 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:29.032 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:57:29.033 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.035 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.036 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:29.037 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.038 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:29.039 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.040 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.041 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.042 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:57:29.043 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.044 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:57:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:57:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.045 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:57:29.045 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:57:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f54b4066540 msgr2=0x7f54b4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d79d8640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f54b4066540 0x7f54b4068a00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f54d0150070 tx=0x7f54c800b040 comp rx=0 tx=0).stop 2023-11-28T20:57:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d00c56e0 msgr2=0x7f54d014cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d79d8640 1 --2- 172.21.15.167:0/3302411085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d00c56e0 0x7f54d014cef0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f54cc01b900 tx=0x7f54cc01ba90 comp rx=0 tx=0).stop 2023-11-28T20:57:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d5f75640 1 -- 172.21.15.167:0/3302411085 reap_dead start 2023-11-28T20:57:29.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d5f75640 1 -- 172.21.15.167:0/3302411085 reap_dead start 2023-11-28T20:57:29.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 shutdown_connections 2023-11-28T20:57:29.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 >> 172.21.15.167:0/3302411085 conn(0x7f54d00cb460 msgr2=0x7f54d015b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:29.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 shutdown_connections 2023-11-28T20:57:29.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.027+0000 7f54d79d8640 1 -- 172.21.15.167:0/3302411085 wait complete. 2023-11-28T20:57:29.048 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:57:29.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:57:29.048 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:57:29.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.183+0000 7fc53789e640 1 Processor -- start 2023-11-28T20:57:29.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.183+0000 7fc53789e640 1 -- start start 2023-11-28T20:57:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53789e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 0x7fc530157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53789e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc5300c6ff0 0x7fc5300c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53789e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5300c6ac0 con 0x7fc5300c5be0 2023-11-28T20:57:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53789e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5300c6500 con 0x7fc5300c6ff0 2023-11-28T20:57:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53789e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300c67e0 con 0x7fc530150b40 2023-11-28T20:57:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc535e3b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc5300c5be0 0x7fc53006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46958/0 (socket says 172.21.15.167:46958) 2023-11-28T20:57:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc535e3b640 1 -- 172.21.15.167:0/1001951162 learned_addr learned my addr 172.21.15.167:0/1001951162 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:57:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc534e39640 1 --2- 172.21.15.167:0/1001951162 >> v2:172.21.15.178:3300/0 conn(0x7fc5300c6ff0 0x7fc5300c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 0x7fc530157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341805275 0 0) 0x7fc5300c6ac0 con 0x7fc5300c5be0 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc51c005740 con 0x7fc5300c5be0 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 -- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 msgr2=0x7fc530157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 -- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 msgr2=0x7fc530157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 0x7fc530157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 0x7fc530157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4117988068 0 0) 0x7fc51c005740 con 0x7fc5300c5be0 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 msgr2=0x7fc530157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 0x7fc530157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 >> v2:172.21.15.178:3300/0 conn(0x7fc5300c6ff0 msgr2=0x7fc5300c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 --2- 172.21.15.167:0/1001951162 >> v2:172.21.15.178:3300/0 conn(0x7fc5300c6ff0 0x7fc5300c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc530156a80 con 0x7fc5300c5be0 2023-11-28T20:57:29.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fc528001a00 con 0x7fc5300c5be0 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 >> v1:172.21.15.167:6789/0 conn(0x7fc5300c5be0 legacy=0x7fc53006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc51c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc51c0069e0 0x7fc51c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 0x7fc51c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300c6500 con 0x7fc51c005b90 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300c67e0 con 0x7fc51c0069e0 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c00dba0 con 0x7fc530150b40 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc51c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc534e39640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc51c0069e0 0x7fc51c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc535e3b640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 0x7fc51c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 -- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 msgr2=0x7fc51c0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:29.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc530150b40 0x7fc51c0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 -- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc51c0069e0 msgr2=0x7fc51c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:29.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc51c0069e0 0x7fc51c006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc53563a640 1 -- 172.21.15.167:0/1001951162 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c005740 con 0x7fc51c005b90 2023-11-28T20:57:29.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.187+0000 7fc534e39640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc51c0069e0 0x7fc51c006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:57:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc53563a640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc51c005fb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00c820 tx=0x7fc52c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427a2f1ebd6f851a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0ac640 con 0x7fc51c005b90 2023-11-28T20:57:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c0ac7a0 con 0x7fc51c005b90 2023-11-28T20:57:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc527fff640 1 -- 172.21.15.167:0/1001951162 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0acb50 con 0x7fc51c005b90 2023-11-28T20:57:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc53789e640 1 -- 172.21.15.167:0/1001951162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 msgr2=0x7fc51c005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc53789e640 1 --2- 172.21.15.167:0/1001951162 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc51c005fb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00c820 tx=0x7fc52c01c4c0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc535e3b640 1 -- 172.21.15.167:0/1001951162 reap_dead start 2023-11-28T20:57:29.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc53789e640 1 -- 172.21.15.167:0/1001951162 shutdown_connections 2023-11-28T20:57:29.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc53789e640 1 -- 172.21.15.167:0/1001951162 >> 172.21.15.167:0/1001951162 conn(0x7fc5300cb1e0 msgr2=0x7fc5300cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:29.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc53789e640 1 -- 172.21.15.167:0/1001951162 shutdown_connections 2023-11-28T20:57:29.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.191+0000 7fc53789e640 1 -- 172.21.15.167:0/1001951162 wait complete. 2023-11-28T20:57:29.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 Processor -- start 2023-11-28T20:57:29.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 -- start start 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc5301f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f5c90 0x7fc530070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc53014bdd0 0x7fc5301479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53014a920 con 0x7fc51c005b90 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5301f36e0 con 0x7fc5301f5c90 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5301f2720 con 0x7fc53014bdd0 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53563a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc5301f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53563a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc5301f31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48990/0 (socket says 172.21.15.167:48990) 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53563a640 1 -- 172.21.15.167:0/304752634 learned_addr learned my addr 172.21.15.167:0/304752634 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc534e39640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f5c90 0x7fc530070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc535e3b640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc53014bdd0 0x7fc5301479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53563a640 1 -- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc53014bdd0 msgr2=0x7fc5301479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53563a640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc53014bdd0 0x7fc5301479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53563a640 1 -- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f5c90 msgr2=0x7fc530070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53563a640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f5c90 0x7fc530070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53563a640 1 -- 172.21.15.167:0/304752634 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53014a0a0 con 0x7fc51c005b90 2023-11-28T20:57:29.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc534e39640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f5c90 0x7fc530070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:57:29.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53563a640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc5301f31a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0af040 tx=0x7fc51c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0b7480 con 0x7fc51c005b90 2023-11-28T20:57:29.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c0b75e0 con 0x7fc51c005b90 2023-11-28T20:57:29.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53014a360 con 0x7fc51c005b90 2023-11-28T20:57:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c0b7990 con 0x7fc51c005b90 2023-11-28T20:57:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5301f29a0 con 0x7fc51c005b90 2023-11-28T20:57:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f2b60 0x7fc530147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.195+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc530074770 con 0x7fc5301f2b60 2023-11-28T20:57:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc534e39640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f2b60 0x7fc530147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc52c0b3040 con 0x7fc51c005b90 2023-11-28T20:57:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc534e39640 1 -- 172.21.15.167:0/304752634 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc53006a960 con 0x7fc5301f2b60 2023-11-28T20:57:29.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc534e39640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f2b60 0x7fc530147f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc520009fd0 tx=0x7fc520013ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc525ffb640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc514066470 0x7fc514068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc52c11e6c0 con 0x7fc51c005b90 2023-11-28T20:57:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520011a10 con 0x7fc5301f2b60 2023-11-28T20:57:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc535e3b640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc514066470 0x7fc514068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc520011b70 con 0x7fc5301f2b60 2023-11-28T20:57:29.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f2b60 msgr2=0x7fc530147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc525ffb640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f2b60 0x7fc530147f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc520009fd0 tx=0x7fc520013ae0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f2b60 msgr2=0x7fc530147f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:29.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc525ffb640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5301f2b60 0x7fc530147f20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.199+0000 7fc535e3b640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc514066470 0x7fc514068930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc53006eee0 tx=0x7fc528009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.203+0000 7fc53789e640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc53014c1b0 0x7fc5300ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.203+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53006ac90 con 0x7fc53014c1b0 2023-11-28T20:57:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc534e39640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc53014c1b0 0x7fc5300ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc534e39640 1 -- 172.21.15.167:0/304752634 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc5300682c0 con 0x7fc53014c1b0 2023-11-28T20:57:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc534e39640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc53014c1b0 0x7fc5300ca030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc520009fd0 tx=0x7fc5200046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52002f070 con 0x7fc53014c1b0 2023-11-28T20:57:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4810 (secure 0 0 0) 0x7fc52002b400 con 0x7fc53014c1b0 2023-11-28T20:57:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc53014c1b0 msgr2=0x7fc5300ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc525ffb640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc53014c1b0 0x7fc5300ca030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc520009fd0 tx=0x7fc5200046d0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc525ffb640 1 -- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc53014c1b0 msgr2=0x7fc5300ca030 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc525ffb640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc53014c1b0 0x7fc5300ca030 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc520009fd0 tx=0x7fc5200046d0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.210 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 146, 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:29.211 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.212 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.213 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:57:29.214 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.215 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.216 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.218 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:29.219 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:57:29.220 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.221 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:57:29.223 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:57:29.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc514066470 msgr2=0x7fc514068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc53789e640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc514066470 0x7fc514068930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc53006eee0 tx=0x7fc528009040 comp rx=0 tx=0).stop 2023-11-28T20:57:29.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 msgr2=0x7fc5301f31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc53789e640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc5301f31a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0af040 tx=0x7fc51c007a10 comp rx=0 tx=0).stop 2023-11-28T20:57:29.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc535e3b640 1 -- 172.21.15.167:0/304752634 reap_dead start 2023-11-28T20:57:29.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 shutdown_connections 2023-11-28T20:57:29.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc53789e640 1 --2- 172.21.15.167:0/304752634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc51c005b90 0x7fc5301f31a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 >> 172.21.15.167:0/304752634 conn(0x7fc5300cb1e0 msgr2=0x7fc5301489d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:29.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 shutdown_connections 2023-11-28T20:57:29.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.207+0000 7fc53789e640 1 -- 172.21.15.167:0/304752634 wait complete. 2023-11-28T20:57:29.228 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:57:29.228 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:57:29.229 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:57:29.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad98eea640 1 Processor -- start 2023-11-28T20:57:29.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad98eea640 1 -- start start 2023-11-28T20:57:29.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad98eea640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fad94150b40 0x7fad94157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad98eea640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fad940c6ff0 0x7fad940c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad98eea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad940c5be0 0x7fad9406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad98eea640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940c6ac0 con 0x7fad94150b40 2023-11-28T20:57:29.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad98eea640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940c6500 con 0x7fad940c6ff0 2023-11-28T20:57:29.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad98eea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad940c67e0 con 0x7fad940c5be0 2023-11-28T20:57:29.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad9259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fad94150b40 0x7fad94157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad9259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fad94150b40 0x7fad94157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48998/0 (socket says 172.21.15.167:48998) 2023-11-28T20:57:29.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad9259c640 1 -- 172.21.15.167:0/2037506871 learned_addr learned my addr 172.21.15.167:0/2037506871 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:29.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad92d9d640 1 --2- 172.21.15.167:0/2037506871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad940c5be0 0x7fad9406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad91d9b640 1 --2- 172.21.15.167:0/2037506871 >> v2:172.21.15.178:3300/0 conn(0x7fad940c6ff0 0x7fad940c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad9259c640 1 -- 172.21.15.167:0/2037506871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad940c5be0 msgr2=0x7fad9406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:29.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad9259c640 1 --2- 172.21.15.167:0/2037506871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad940c5be0 0x7fad9406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad9259c640 1 -- 172.21.15.167:0/2037506871 >> v2:172.21.15.178:3300/0 conn(0x7fad940c6ff0 msgr2=0x7fad940c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:29.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad9259c640 1 --2- 172.21.15.167:0/2037506871 >> v2:172.21.15.178:3300/0 conn(0x7fad940c6ff0 0x7fad940c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.367+0000 7fad9259c640 1 -- 172.21.15.167:0/2037506871 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94156a80 con 0x7fad94150b40 2023-11-28T20:57:29.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad9259c640 1 --2- 172.21.15.167:0/2037506871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad94150b40 0x7fad94157560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad9406bba0 tx=0x7fad8401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48185b7b4e139a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad9159a640 1 -- 172.21.15.167:0/2037506871 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad840aa5f0 con 0x7fad94150b40 2023-11-28T20:57:29.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad9159a640 1 -- 172.21.15.167:0/2037506871 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad840aa750 con 0x7fad94150b40 2023-11-28T20:57:29.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad9159a640 1 -- 172.21.15.167:0/2037506871 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad840aaae0 con 0x7fad94150b40 2023-11-28T20:57:29.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad98eea640 1 -- 172.21.15.167:0/2037506871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad94150b40 msgr2=0x7fad94157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad98eea640 1 --2- 172.21.15.167:0/2037506871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad94150b40 0x7fad94157560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad9406bba0 tx=0x7fad8401c4d0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad98eea640 1 -- 172.21.15.167:0/2037506871 shutdown_connections 2023-11-28T20:57:29.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad98eea640 1 --2- 172.21.15.167:0/2037506871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad940c5be0 0x7fad9406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad98eea640 1 --2- 172.21.15.167:0/2037506871 >> v2:172.21.15.178:3300/0 conn(0x7fad940c6ff0 0x7fad940c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad98eea640 1 --2- 172.21.15.167:0/2037506871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad94150b40 0x7fad94157560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad98eea640 1 -- 172.21.15.167:0/2037506871 >> 172.21.15.167:0/2037506871 conn(0x7fad940cb1e0 msgr2=0x7fad940cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:29.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad98eea640 1 -- 172.21.15.167:0/2037506871 shutdown_connections 2023-11-28T20:57:29.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.371+0000 7fad98eea640 1 -- 172.21.15.167:0/2037506871 wait complete. 2023-11-28T20:57:29.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 Processor -- start 2023-11-28T20:57:29.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 -- start start 2023-11-28T20:57:29.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad940c5be0 0x7fad94140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940c6ff0 0x7fad9413ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad94150b40 0x7fad9413cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad941f1610 con 0x7fad940c6ff0 2023-11-28T20:57:29.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad941f0a90 con 0x7fad940c5be0 2023-11-28T20:57:29.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad941f0d70 con 0x7fad94150b40 2023-11-28T20:57:29.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad91d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940c6ff0 0x7fad9413ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad91d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940c6ff0 0x7fad9413ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49012/0 (socket says 172.21.15.167:49012) 2023-11-28T20:57:29.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad91d9b640 1 -- 172.21.15.167:0/2486946044 learned_addr learned my addr 172.21.15.167:0/2486946044 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:29.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad940c5be0 0x7fad94140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad92d9d640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad94150b40 0x7fad9413cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad91d9b640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad94150b40 msgr2=0x7fad9413cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad91d9b640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad94150b40 0x7fad9413cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad91d9b640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad940c5be0 msgr2=0x7fad94140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:29.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad91d9b640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad940c5be0 0x7fad94140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:29.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad91d9b640 1 -- 172.21.15.167:0/2486946044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840094d0 con 0x7fad940c6ff0 2023-11-28T20:57:29.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad940c5be0 0x7fad94140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:57:29.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad91d9b640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940c6ff0 0x7fad9413ca60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad8800d800 tx=0x7fad8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8800b6c0 con 0x7fad940c6ff0 2023-11-28T20:57:29.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8800b820 con 0x7fad940c6ff0 2023-11-28T20:57:29.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8800bb90 con 0x7fad940c6ff0 2023-11-28T20:57:29.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad941f1050 con 0x7fad940c6ff0 2023-11-28T20:57:29.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad94140f60 con 0x7fad940c6ff0 2023-11-28T20:57:29.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad94074770 con 0x7fad941f0600 2023-11-28T20:57:29.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2023-11-28T20:57:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:57:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.375+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.379+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad8800bcf0 con 0x7fad940c6ff0 2023-11-28T20:57:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.379+0000 7fad82ffd640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fad74066470 0x7fad74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.379+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fad88084710 con 0x7fad940c6ff0 2023-11-28T20:57:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.379+0000 7fad92d9d640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fad74066470 0x7fad74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.379+0000 7fad92d9d640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fad74066470 0x7fad74068930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009f80 tx=0x7fad8c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:29.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.579+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.579+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:57:29.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.579+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:57:29.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.579+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:29.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.579+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:57:29.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.983+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:29.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.983+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:57:29.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.983+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:57:29.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.983+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:29.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:29.983+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:57:30.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:30.787+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:30.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:30.787+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:57:30.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:30.787+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:57:30.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:30.787+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:30.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:30.787+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:57:32.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.391+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:32.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.395+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad9415a770 con 0x7fad941f0600 2023-11-28T20:57:32.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.395+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fad940cc090 tx=0x7fad84019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:32.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.395+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad840aacd0 con 0x7fad941f0600 2023-11-28T20:57:32.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.395+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fad840aae30 con 0x7fad941f0600 2023-11-28T20:57:32.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.395+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.395+0000 7fad82ffd640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fad940cc090 tx=0x7fad84019270 comp rx=0 tx=0).stop 2023-11-28T20:57:32.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.395+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 msgr2=0x7fad94141480 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:32.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.395+0000 7fad82ffd640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f0600 0x7fad94141480 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fad940cc090 tx=0x7fad84019270 comp rx=0 tx=0).stop 2023-11-28T20:57:32.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad98eea640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f3b70 0x7fad941419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:32.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad941f11e0 con 0x7fad941f3b70 2023-11-28T20:57:32.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f3b70 0x7fad941419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:32.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad9259c640 1 -- 172.21.15.167:0/2486946044 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fad940682c0 con 0x7fad941f3b70 2023-11-28T20:57:32.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad9259c640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f3b70 0x7fad941419c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad8401ab80 tx=0x7fad840b5040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:32.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84003bf0 con 0x7fad941f3b70 2023-11-28T20:57:32.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7fad84003d50 con 0x7fad941f3b70 2023-11-28T20:57:32.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f3b70 msgr2=0x7fad941419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad82ffd640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f3b70 0x7fad941419c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad8401ab80 tx=0x7fad840b5040 comp rx=0 tx=0).stop 2023-11-28T20:57:32.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad82ffd640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f3b70 msgr2=0x7fad941419c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:32.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.399+0000 7fad82ffd640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad941f3b70 0x7fad941419c0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad8401ab80 tx=0x7fad840b5040 comp rx=0 tx=0).stop 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 146, 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 3, 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:32.404 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:57:32.405 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:32.406 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:57:32.407 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:32.408 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:32.409 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.410 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:57:32.411 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:57:32.412 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:32.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:32.415 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:32.416 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:32.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:32.416 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:57:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fad74066470 msgr2=0x7fad74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad98eea640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fad74066470 0x7fad74068930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009f80 tx=0x7fad8c00b040 comp rx=0 tx=0).stop 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940c6ff0 msgr2=0x7fad9413ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad98eea640 1 --2- 172.21.15.167:0/2486946044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad940c6ff0 0x7fad9413ca60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad8800d800 tx=0x7fad8800dcc0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad92d9d640 1 -- 172.21.15.167:0/2486946044 reap_dead start 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad92d9d640 1 -- 172.21.15.167:0/2486946044 reap_dead start 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 shutdown_connections 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 >> 172.21.15.167:0/2486946044 conn(0x7fad940cb1e0 msgr2=0x7fad94155840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 shutdown_connections 2023-11-28T20:57:32.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.403+0000 7fad98eea640 1 -- 172.21.15.167:0/2486946044 wait complete. 2023-11-28T20:57:32.425 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:57:32.425 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:57:32.425 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:57:32.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3e48fd640 1 Processor -- start 2023-11-28T20:57:32.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3e48fd640 1 -- start start 2023-11-28T20:57:32.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3e48fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3e00cfc40 0x7fb3e00cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:32.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3e48fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb3e0153ae0 0x7fb3e0153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:32.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3e48fd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e015ac00 con 0x7fb3e00cf860 2023-11-28T20:57:32.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3e48fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e00cbd60 con 0x7fb3e00cfc40 2023-11-28T20:57:32.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3e48fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e0159ff0 con 0x7fb3e0153ae0 2023-11-28T20:57:32.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3d5d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3e00cfc40 0x7fb3e00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:32.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3d5d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3e00cfc40 0x7fb3e00cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49014/0 (socket says 172.21.15.167:49014) 2023-11-28T20:57:32.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3d5d9b640 1 -- 172.21.15.167:0/3589047664 learned_addr learned my addr 172.21.15.167:0/3589047664 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:32.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3ded9d640 1 --2- 172.21.15.167:0/3589047664 >> v2:172.21.15.178:3300/0 conn(0x7fb3e0153ae0 0x7fb3e0153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:32.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3d5d9b640 1 -- 172.21.15.167:0/3589047664 >> v2:172.21.15.178:3300/0 conn(0x7fb3e0153ae0 msgr2=0x7fb3e0153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:32.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3d5d9b640 1 --2- 172.21.15.167:0/3589047664 >> v2:172.21.15.178:3300/0 conn(0x7fb3e0153ae0 0x7fb3e0153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3d5d9b640 1 -- 172.21.15.167:0/3589047664 >> v1:172.21.15.178:6789/0 conn(0x7fb3e00cf860 legacy=0x7fb3e00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.567+0000 7fb3d5d9b640 1 -- 172.21.15.167:0/3589047664 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e015a2d0 con 0x7fb3e00cfc40 2023-11-28T20:57:32.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3d5d9b640 1 --2- 172.21.15.167:0/3589047664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 0x7fb3e00cb770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00b2240 tx=0x7fb3c801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81189b17687be99c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:32.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3ddd9b640 1 -- 172.21.15.167:0/3589047664 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80a5890 con 0x7fb3e00cfc40 2023-11-28T20:57:32.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3ddd9b640 1 -- 172.21.15.167:0/3589047664 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c80a59f0 con 0x7fb3e00cfc40 2023-11-28T20:57:32.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3ddd9b640 1 -- 172.21.15.167:0/3589047664 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80a5d80 con 0x7fb3e00cfc40 2023-11-28T20:57:32.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3e48fd640 1 -- 172.21.15.167:0/3589047664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 msgr2=0x7fb3e00cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3e48fd640 1 --2- 172.21.15.167:0/3589047664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 0x7fb3e00cb770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00b2240 tx=0x7fb3c801c9d0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3e48fd640 1 -- 172.21.15.167:0/3589047664 shutdown_connections 2023-11-28T20:57:32.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3e48fd640 1 --2- 172.21.15.167:0/3589047664 >> v2:172.21.15.178:3300/0 conn(0x7fb3e0153ae0 0x7fb3e0153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3e48fd640 1 --2- 172.21.15.167:0/3589047664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 0x7fb3e00cb770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3e48fd640 1 -- 172.21.15.167:0/3589047664 >> 172.21.15.167:0/3589047664 conn(0x7fb3e006c1f0 msgr2=0x7fb3e0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:32.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3e48fd640 1 -- 172.21.15.167:0/3589047664 shutdown_connections 2023-11-28T20:57:32.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.571+0000 7fb3e48fd640 1 -- 172.21.15.167:0/3589047664 wait complete. 2023-11-28T20:57:32.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 Processor -- start 2023-11-28T20:57:32.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 -- start start 2023-11-28T20:57:32.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e00cf860 0x7fb3e0148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:32.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 0x7fb3e0149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:32.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e0153ae0 0x7fb3e0149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:32.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e01433b0 con 0x7fb3e00cfc40 2023-11-28T20:57:32.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e01430d0 con 0x7fb3e00cf860 2023-11-28T20:57:32.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e0148e90 con 0x7fb3e0153ae0 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d5d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 0x7fb3e0149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d5d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 0x7fb3e0149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49016/0 (socket says 172.21.15.167:49016) 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d5d9b640 1 -- 172.21.15.167:0/993828580 learned_addr learned my addr 172.21.15.167:0/993828580 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3de59c640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e00cf860 0x7fb3e0148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3ded9d640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e0153ae0 0x7fb3e0149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d5d9b640 1 -- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e0153ae0 msgr2=0x7fb3e0149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d5d9b640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e0153ae0 0x7fb3e0149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d5d9b640 1 -- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e00cf860 msgr2=0x7fb3e0148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d5d9b640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e00cf860 0x7fb3e0148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d5d9b640 1 -- 172.21.15.167:0/993828580 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8009b30 con 0x7fb3e00cfc40 2023-11-28T20:57:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d5d9b640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 0x7fb3e0149530 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80af040 tx=0x7fb3c8019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d77fe640 1 -- 172.21.15.167:0/993828580 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80a5d60 con 0x7fb3e00cfc40 2023-11-28T20:57:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d77fe640 1 -- 172.21.15.167:0/993828580 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c80b8470 con 0x7fb3e00cfc40 2023-11-28T20:57:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e0157100 con 0x7fb3e00cfc40 2023-11-28T20:57:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3d77fe640 1 -- 172.21.15.167:0/993828580 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80b8820 con 0x7fb3e00cfc40 2023-11-28T20:57:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.575+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e01f37b0 con 0x7fb3e00cfc40 2023-11-28T20:57:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.579+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e0075c90 con 0x7fb3e00cfc40 2023-11-28T20:57:32.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.579+0000 7fb3d77fe640 1 -- 172.21.15.167:0/993828580 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3c80b8980 con 0x7fb3e00cfc40 2023-11-28T20:57:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.579+0000 7fb3d77fe640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3c0066470 0x7fb3c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.579+0000 7fb3d77fe640 1 -- 172.21.15.167:0/993828580 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb3c811f3c0 con 0x7fb3e00cfc40 2023-11-28T20:57:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.579+0000 7fb3de59c640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3c0066470 0x7fb3c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.579+0000 7fb3de59c640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3c0066470 0x7fb3c0068930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0000f70 tx=0x7fb3d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.583+0000 7fb3d77fe640 1 -- 172.21.15.167:0/993828580 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3c80ec3b0 con 0x7fb3e00cfc40 2023-11-28T20:57:32.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.791+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fb3e00cb070 con 0x7fb3e00cfc40 2023-11-28T20:57:32.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.791+0000 7fb3d77fe640 1 -- 172.21.15.167:0/993828580 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fb3c80ef9d0 con 0x7fb3e00cfc40 2023-11-28T20:57:32.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3c0066470 msgr2=0x7fb3c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3c0066470 0x7fb3c0068930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0000f70 tx=0x7fb3d0009040 comp rx=0 tx=0).stop 2023-11-28T20:57:32.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 msgr2=0x7fb3e0149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:32.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 0x7fb3e0149530 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80af040 tx=0x7fb3c8019770 comp rx=0 tx=0).stop 2023-11-28T20:57:32.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 shutdown_connections 2023-11-28T20:57:32.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3c0066470 0x7fb3c0068930 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e0153ae0 0x7fb3e0149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3e00cfc40 0x7fb3e0149530 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 --2- 172.21.15.167:0/993828580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e00cf860 0x7fb3e0148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:32.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 >> 172.21.15.167:0/993828580 conn(0x7fb3e006c1f0 msgr2=0x7fb3e00cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:32.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 shutdown_connections 2023-11-28T20:57:32.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:32.795+0000 7fb3e48fd640 1 -- 172.21.15.167:0/993828580 wait complete. 2023-11-28T20:57:32.815 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:57:34.278 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 1% (3/160) Updating files: 2% (4/160) Updating files: 3% (5/160) Updating files: 4% (7/160) Updating files: 5% (8/160) Updating files: 6% (10/160) Updating files: 7% (12/160) Updating files: 8% (13/160) Updating files: 9% (15/160) Updating files: 10% (16/160) Updating files: 11% (18/160) Updating files: 12% (20/160) Updating files: 13% (21/160) Updating files: 14% (23/160) Updating files: 15% (24/160) Updating files: 16% (26/160) Updating files: 17% (28/160) Updating files: 18% (29/160) Updating files: 19% (31/160) Updating files: 20% (32/160) Updating files: 21% (34/160) Updating files: 22% (36/160) Updating files: 23% (37/160) Updating files: 24% (39/160) Updating files: 25% (40/160) Updating files: 26% (42/160) Updating files: 27% (44/160) Updating files: 28% (45/160) Updating files: 29% (47/160) Updating files: 30% (48/160) Updating files: 31% (50/160) Updating files: 32% (52/160) Updating files: 33% (53/160) Updating files: 34% (55/160) Updating files: 35% (56/160) Updating files: 36% (58/160) Updating files: 37% (60/160) Updating files: 38% (61/160) Updating files: 39% (63/160) Updating files: 40% (64/160) Updating files: 41% (66/160) Updating files: 42% (68/160) Updating files: 43% (69/160) Updating files: 44% (71/160) Updating files: 45% (72/160) Updating files: 46% (74/160) Updating files: 47% (76/160) Updating files: 48% (77/160) Updating files: 48% (78/160) Updating files: 49% (79/160) Updating files: 50% (80/160) Updating files: 51% (82/160) Updating files: 52% (84/160) Updating files: 53% (85/160) Updating files: 54% (87/160) Updating files: 55% (88/160) Updating files: 56% (90/160) Updating files: 57% (92/160) Updating files: 58% (93/160) Updating files: 59% (95/160) Updating files: 60% (96/160) Updating files: 61% (98/160) Updating files: 62% (100/160) Updating files: 63% (101/160) Updating files: 64% (103/160) Updating files: 65% (104/160) Updating files: 66% (106/160) Updating files: 67% (108/160) Updating files: 68% (109/160) Updating files: 69% (111/160) Updating files: 70% (112/160) Updating files: 71% (114/160) Updating files: 72% (116/160) Updating files: 73% (117/160) Updating files: 74% (119/160) Updating files: 75% (120/160) Updating files: 76% (122/160) Updating files: 77% (124/160) Updating files: 78% (125/160) Updating files: 79% (127/160) Updating files: 80% (128/160) Updating files: 81% (130/160) Updating files: 82% (132/160) Updating files: 83% (133/160) Updating files: 84% (135/160) Updating files: 85% (136/160) Updating files: 86% (138/160) Updating files: 87% (140/160) Updating files: 88% (141/160) Updating files: 89% (143/160) Updating files: 90% (144/160) Updating files: 91% (146/160) Updating files: 92% (148/160) Updating files: 93% (149/160) Updating files: 94% (151/160) Updating files: 95% (152/160) Updating files: 96% (154/160) Updating files: 97% (156/160) Updating files: 98% (157/160) Updating files: 99% (159/160) Updating files: 100% (160/160) Updating files: 100% (160/160), done. 2023-11-28T20:57:36.742 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 340b4348bf6 v0.33 2023-11-28T20:57:36.746 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.33 2023-11-28T20:57:36.797 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 34 -eq 48 ] 2023-11-28T20:57:36.797 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.34 2023-11-28T20:57:36.798 INFO:tasks.workunit.client.0.smithi167.stdout:v0.34 2023-11-28T20:57:36.798 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.34 2023-11-28T20:57:36.798 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.34 2023-11-28T20:57:41.154 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 24% (31/129) Updating files: 25% (33/129) Updating files: 26% (34/129) Updating files: 27% (35/129) Updating files: 28% (37/129) Updating files: 29% (38/129) Updating files: 30% (39/129) Updating files: 31% (40/129) Updating files: 32% (42/129) Updating files: 33% (43/129) Updating files: 34% (44/129) Updating files: 35% (46/129) Updating files: 36% (47/129) Updating files: 37% (48/129) Updating files: 38% (50/129) Updating files: 39% (51/129) Updating files: 40% (52/129) Updating files: 41% (53/129) Updating files: 42% (55/129) Updating files: 43% (56/129) Updating files: 44% (57/129) Updating files: 45% (59/129) Updating files: 46% (60/129) Updating files: 47% (61/129) Updating files: 48% (62/129) Updating files: 49% (64/129) Updating files: 50% (65/129) Updating files: 51% (66/129) Updating files: 52% (68/129) Updating files: 53% (69/129) Updating files: 54% (70/129) Updating files: 55% (71/129) Updating files: 56% (73/129) Updating files: 57% (74/129) Updating files: 58% (75/129) Updating files: 59% (77/129) Updating files: 60% (78/129) Updating files: 61% (79/129) Updating files: 62% (80/129) Updating files: 63% (82/129) Updating files: 64% (83/129) Updating files: 65% (84/129) Updating files: 66% (86/129) Updating files: 67% (87/129) Updating files: 68% (88/129) Updating files: 69% (90/129) Updating files: 70% (91/129) Updating files: 71% (92/129) Updating files: 72% (93/129) Updating files: 73% (95/129) Updating files: 74% (96/129) Updating files: 75% (97/129) Updating files: 76% (99/129) Updating files: 77% (100/129) Updating files: 78% (101/129) Updating files: 79% (102/129) Updating files: 80% (104/129) Updating files: 81% (105/129) Updating files: 82% (106/129) Updating files: 83% (108/129) Updating files: 84% (109/129) Updating files: 85% (110/129) Updating files: 86% (111/129) Updating files: 87% (113/129) Updating files: 88% (114/129) Updating files: 89% (115/129) Updating files: 90% (117/129) Updating files: 91% (118/129) Updating files: 92% (119/129) Updating files: 93% (120/129) Updating files: 94% (122/129) Updating files: 95% (123/129) Updating files: 96% (124/129) Updating files: 97% (126/129) Updating files: 98% (127/129) Updating files: 99% (128/129) Updating files: 100% (129/129) Updating files: 100% (129/129), done. 2023-11-28T20:57:41.318 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 2f039eeeb74 v0.34 2023-11-28T20:57:41.321 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.34 2023-11-28T20:57:41.361 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 35 -eq 48 ] 2023-11-28T20:57:41.361 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.35 2023-11-28T20:57:41.361 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.35 2023-11-28T20:57:41.362 INFO:tasks.workunit.client.0.smithi167.stdout:v0.35 2023-11-28T20:57:41.362 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.35 2023-11-28T20:57:42.816 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:57:42.817 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:57:42.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b9901640 1 Processor -- start 2023-11-28T20:57:42.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b9901640 1 -- start start 2023-11-28T20:57:42.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b9901640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4070480 0x7f43b406e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:42.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b9901640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f43b4071020 0x7f43b406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:42.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b9901640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f43b4156c40 0x7f43b41500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:42.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b9901640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b41571d0 con 0x7f43b4156c40 2023-11-28T20:57:42.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b9901640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b4071a90 con 0x7f43b4071020 2023-11-28T20:57:42.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b9901640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40c70d0 con 0x7f43b4070480 2023-11-28T20:57:42.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f43b4156c40 0x7f43b41500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:42.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b37fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f43b4156c40 0x7f43b41500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47566/0 (socket says 172.21.15.167:47566) 2023-11-28T20:57:42.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.963+0000 7f43b37fe640 1 -- 172.21.15.167:0/2322756580 learned_addr learned my addr 172.21.15.167:0/2322756580 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:42.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b2ffd640 1 --2- 172.21.15.167:0/2322756580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4070480 0x7f43b406e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43aa7fc640 1 --2- 172.21.15.167:0/2322756580 >> v2:172.21.15.178:3300/0 conn(0x7f43b4071020 0x7f43b406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b37fe640 1 -- 172.21.15.167:0/2322756580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4070480 msgr2=0x7f43b406e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b37fe640 1 --2- 172.21.15.167:0/2322756580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4070480 0x7f43b406e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b37fe640 1 -- 172.21.15.167:0/2322756580 >> v2:172.21.15.178:3300/0 conn(0x7f43b4071020 msgr2=0x7f43b406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b37fe640 1 --2- 172.21.15.167:0/2322756580 >> v2:172.21.15.178:3300/0 conn(0x7f43b4071020 0x7f43b406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b37fe640 1 -- 172.21.15.167:0/2322756580 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b40c73b0 con 0x7f43b4156c40 2023-11-28T20:57:42.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b37fe640 1 --2- 172.21.15.167:0/2322756580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4156c40 0x7f43b41500b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f43b406fe60 tx=0x7f43ac01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f64f2585b573a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b27fc640 1 -- 172.21.15.167:0/2322756580 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0a7b40 con 0x7f43b4156c40 2023-11-28T20:57:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b27fc640 1 -- 172.21.15.167:0/2322756580 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac0a7ca0 con 0x7f43b4156c40 2023-11-28T20:57:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b27fc640 1 -- 172.21.15.167:0/2322756580 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0af660 con 0x7f43b4156c40 2023-11-28T20:57:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b9901640 1 -- 172.21.15.167:0/2322756580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4156c40 msgr2=0x7f43b41500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.967+0000 7f43b9901640 1 --2- 172.21.15.167:0/2322756580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4156c40 0x7f43b41500b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f43b406fe60 tx=0x7f43ac01eba0 comp rx=0 tx=0).stop 2023-11-28T20:57:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 -- 172.21.15.167:0/2322756580 shutdown_connections 2023-11-28T20:57:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 --2- 172.21.15.167:0/2322756580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4156c40 0x7f43b41500b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 --2- 172.21.15.167:0/2322756580 >> v2:172.21.15.178:3300/0 conn(0x7f43b4071020 0x7f43b406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 --2- 172.21.15.167:0/2322756580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4070480 0x7f43b406e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 -- 172.21.15.167:0/2322756580 >> 172.21.15.167:0/2322756580 conn(0x7f43b40cb1e0 msgr2=0x7f43b40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 -- 172.21.15.167:0/2322756580 shutdown_connections 2023-11-28T20:57:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 -- 172.21.15.167:0/2322756580 wait complete. 2023-11-28T20:57:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 Processor -- start 2023-11-28T20:57:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 -- start start 2023-11-28T20:57:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4070480 0x7f43b415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:42.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4071020 0x7f43b4160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b4156c40 0x7f43b4142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b4152780 con 0x7f43b4070480 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b4160270 con 0x7f43b4156c40 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b9901640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b4160c40 con 0x7f43b4071020 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4070480 0x7f43b415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4070480 0x7f43b415a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47578/0 (socket says 172.21.15.167:47578) 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b2ffd640 1 -- 172.21.15.167:0/2667182762 learned_addr learned my addr 172.21.15.167:0/2667182762 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43aa7fc640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4071020 0x7f43b4160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b37fe640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b4156c40 0x7f43b4142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:42.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b2ffd640 1 -- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4071020 msgr2=0x7f43b4160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b2ffd640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4071020 0x7f43b4160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b2ffd640 1 -- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b4156c40 msgr2=0x7f43b4142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b2ffd640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b4156c40 0x7f43b4142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b2ffd640 1 -- 172.21.15.167:0/2667182762 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac00b770 con 0x7f43b4070480 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43aa7fc640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4071020 0x7f43b4160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b37fe640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b4156c40 0x7f43b4142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.971+0000 7f43b2ffd640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4070480 0x7f43b415a160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43a4007e60 tx=0x7f43a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43b0ff9640 1 -- 172.21.15.167:0/2667182762 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4014620 con 0x7f43b4070480 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43b0ff9640 1 -- 172.21.15.167:0/2667182762 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a400ee90 con 0x7f43b4070480 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43b0ff9640 1 -- 172.21.15.167:0/2667182762 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40149a0 con 0x7f43b4070480 2023-11-28T20:57:42.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b4143360 con 0x7f43b4070480 2023-11-28T20:57:42.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b415f940 con 0x7f43b4070480 2023-11-28T20:57:42.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b40682c0 con 0x7f43b4070480 2023-11-28T20:57:42.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43b0ff9640 1 -- 172.21.15.167:0/2667182762 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43a4014b00 con 0x7f43b4070480 2023-11-28T20:57:42.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43b0ff9640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43940664a0 0x7f4394068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:42.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43b0ff9640 1 -- 172.21.15.167:0/2667182762 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f43a4084ad0 con 0x7f43b4070480 2023-11-28T20:57:42.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.975+0000 7f43aa7fc640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43940664a0 0x7f4394068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:42.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.979+0000 7f43aa7fc640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43940664a0 0x7f4394068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f43b4156000 tx=0x7f439c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:42.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:42.979+0000 7f43b0ff9640 1 -- 172.21.15.167:0/2667182762 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f43a4051bf0 con 0x7f43b4070480 2023-11-28T20:57:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.183+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f43b4075c90 con 0x7f43b4070480 2023-11-28T20:57:43.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.183+0000 7f43b0ff9640 1 -- 172.21.15.167:0/2667182762 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f43a4014db0 con 0x7f43b4070480 2023-11-28T20:57:43.183 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:57:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43940664a0 msgr2=0x7f4394068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43940664a0 0x7f4394068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f43b4156000 tx=0x7f439c008040 comp rx=0 tx=0).stop 2023-11-28T20:57:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4070480 msgr2=0x7f43b415a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4070480 0x7f43b415a160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43a4007e60 tx=0x7f43a400e4b0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 shutdown_connections 2023-11-28T20:57:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f43940664a0 0x7f4394068960 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b4156c40 0x7f43b4142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b4071020 0x7f43b4160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 --2- 172.21.15.167:0/2667182762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b4070480 0x7f43b415a160 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 >> 172.21.15.167:0/2667182762 conn(0x7f43b40cb1e0 msgr2=0x7f43b40c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:43.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 shutdown_connections 2023-11-28T20:57:43.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.187+0000 7f43b9901640 1 -- 172.21.15.167:0/2667182762 wait complete. 2023-11-28T20:57:43.203 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:57:43.203 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:57:43.204 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:57:43.204 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:57:43.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7fab0489c640 1 Processor -- start 2023-11-28T20:57:43.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7fab0489c640 1 -- start start 2023-11-28T20:57:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7fab0489c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fab00150b40 0x7fab00157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7fab0489c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab000c6ff0 0x7fab000c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7fab0489c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c5be0 0x7fab0006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7fab0489c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000c6ac0 con 0x7fab00150b40 2023-11-28T20:57:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7fab0489c640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000c6500 con 0x7fab000c6ff0 2023-11-28T20:57:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7fab0489c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000c67e0 con 0x7fab000c5be0 2023-11-28T20:57:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafe59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fab00150b40 0x7fab00157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafe59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fab00150b40 0x7fab00157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47584/0 (socket says 172.21.15.167:47584) 2023-11-28T20:57:43.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafe59c640 1 -- 172.21.15.167:0/4203157223 learned_addr learned my addr 172.21.15.167:0/4203157223 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:43.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafdd9b640 1 --2- 172.21.15.167:0/4203157223 >> v2:172.21.15.178:3300/0 conn(0x7fab000c6ff0 0x7fab000c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafed9d640 1 --2- 172.21.15.167:0/4203157223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c5be0 0x7fab0006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafe59c640 1 -- 172.21.15.167:0/4203157223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c5be0 msgr2=0x7fab0006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:43.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafe59c640 1 --2- 172.21.15.167:0/4203157223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c5be0 0x7fab0006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafe59c640 1 -- 172.21.15.167:0/4203157223 >> v2:172.21.15.178:3300/0 conn(0x7fab000c6ff0 msgr2=0x7fab000c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:43.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafe59c640 1 --2- 172.21.15.167:0/4203157223 >> v2:172.21.15.178:3300/0 conn(0x7fab000c6ff0 0x7fab000c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.347+0000 7faafe59c640 1 -- 172.21.15.167:0/4203157223 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab00156a80 con 0x7fab00150b40 2023-11-28T20:57:43.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7faafe59c640 1 --2- 172.21.15.167:0/4203157223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00150b40 0x7fab00157560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fab0006bba0 tx=0x7faaf001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6ae5dab485e222 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7faafd59a640 1 -- 172.21.15.167:0/4203157223 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00aa5f0 con 0x7fab00150b40 2023-11-28T20:57:43.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7faafd59a640 1 -- 172.21.15.167:0/4203157223 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf00aa750 con 0x7fab00150b40 2023-11-28T20:57:43.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7faafd59a640 1 -- 172.21.15.167:0/4203157223 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00aaae0 con 0x7fab00150b40 2023-11-28T20:57:43.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7fab0489c640 1 -- 172.21.15.167:0/4203157223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00150b40 msgr2=0x7fab00157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7fab0489c640 1 --2- 172.21.15.167:0/4203157223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00150b40 0x7fab00157560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fab0006bba0 tx=0x7faaf001c4d0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7fab0489c640 1 -- 172.21.15.167:0/4203157223 shutdown_connections 2023-11-28T20:57:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7fab0489c640 1 --2- 172.21.15.167:0/4203157223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c5be0 0x7fab0006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7fab0489c640 1 --2- 172.21.15.167:0/4203157223 >> v2:172.21.15.178:3300/0 conn(0x7fab000c6ff0 0x7fab000c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7fab0489c640 1 --2- 172.21.15.167:0/4203157223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00150b40 0x7fab00157560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7fab0489c640 1 -- 172.21.15.167:0/4203157223 >> 172.21.15.167:0/4203157223 conn(0x7fab000cb1e0 msgr2=0x7fab000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7fab0489c640 1 -- 172.21.15.167:0/4203157223 shutdown_connections 2023-11-28T20:57:43.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.351+0000 7fab0489c640 1 -- 172.21.15.167:0/4203157223 wait complete. 2023-11-28T20:57:43.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 Processor -- start 2023-11-28T20:57:43.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 -- start start 2023-11-28T20:57:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab000c5be0 0x7fab001432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c6ff0 0x7fab0013fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab00150b40 0x7fab001403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00159530 con 0x7fab000c5be0 2023-11-28T20:57:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00148670 con 0x7fab00150b40 2023-11-28T20:57:43.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0013f990 con 0x7fab000c6ff0 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafe59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab000c5be0 0x7fab001432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafe59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab000c5be0 0x7fab001432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47588/0 (socket says 172.21.15.167:47588) 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafe59c640 1 -- 172.21.15.167:0/2979024310 learned_addr learned my addr 172.21.15.167:0/2979024310 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafed9d640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab00150b40 0x7fab001403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafdd9b640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c6ff0 0x7fab0013fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafe59c640 1 -- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c6ff0 msgr2=0x7fab0013fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafe59c640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c6ff0 0x7fab0013fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafe59c640 1 -- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab00150b40 msgr2=0x7fab001403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafe59c640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab00150b40 0x7fab001403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafe59c640 1 -- 172.21.15.167:0/2979024310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf00094d0 con 0x7fab000c5be0 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafed9d640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab00150b40 0x7fab001403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:57:43.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafdd9b640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab000c6ff0 0x7fab0013fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:57:43.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faafe59c640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab000c5be0 0x7fab001432d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faaf001ab80 tx=0x7faaf001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00b3800 con 0x7fab000c5be0 2023-11-28T20:57:43.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf00b3980 con 0x7fab000c5be0 2023-11-28T20:57:43.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00b3d30 con 0x7fab000c5be0 2023-11-28T20:57:43.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab00157b30 con 0x7fab000c5be0 2023-11-28T20:57:43.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.355+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab00146ba0 con 0x7fab000c5be0 2023-11-28T20:57:43.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7fab0489c640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001597f0 0x7fab00157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00074770 con 0x7fab001597f0 2023-11-28T20:57:43.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faafdd9b640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001597f0 0x7fab00157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faafdd9b640 1 -- 172.21.15.167:0/2979024310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab0015a770 con 0x7fab001597f0 2023-11-28T20:57:43.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faafdd9b640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001597f0 0x7fab00157d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab00149910 tx=0x7faae800f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8014870 con 0x7fab001597f0 2023-11-28T20:57:43.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faaf00b2380 con 0x7fab000c5be0 2023-11-28T20:57:43.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faaf6ffd640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faae0066540 0x7faae0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7faaf00a7070 con 0x7fab000c5be0 2023-11-28T20:57:43.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7faae80149d0 con 0x7fab001597f0 2023-11-28T20:57:43.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001597f0 msgr2=0x7fab00157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faaf6ffd640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001597f0 0x7fab00157d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab00149910 tx=0x7faae800f9e0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001597f0 msgr2=0x7fab00157d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faafed9d640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faae0066540 0x7faae0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faaf6ffd640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001597f0 0x7fab00157d50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.359+0000 7faafed9d640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faae0066540 0x7faae0068a00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faaf8007380 tx=0x7faaf800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001488d0 0x7fab00148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00159bd0 con 0x7fab001488d0 2023-11-28T20:57:43.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faafdd9b640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001488d0 0x7fab00148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faafdd9b640 1 -- 172.21.15.167:0/2979024310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fab000682c0 con 0x7fab001488d0 2023-11-28T20:57:43.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faafdd9b640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001488d0 0x7fab00148ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faae801a000 tx=0x7faae80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae802a620 con 0x7fab001488d0 2023-11-28T20:57:43.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5126 (secure 0 0 0) 0x7faae802a780 con 0x7fab001488d0 2023-11-28T20:57:43.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001488d0 msgr2=0x7fab00148ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faaf6ffd640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001488d0 0x7fab00148ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faae801a000 tx=0x7faae80046d0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faaf6ffd640 1 -- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001488d0 msgr2=0x7fab00148ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:43.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faaf6ffd640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab001488d0 0x7fab00148ce0 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faae801a000 tx=0x7faae80046d0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.366 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:57:43.366 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 146, 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:57:43.367 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:57:43.368 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:43.369 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:57:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:57:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:57:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:57:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:57:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:57:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:43.371 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:57:43.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:43.373 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.374 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:57:43.375 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:43.376 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.377 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:57:43.378 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.379 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:43.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:57:43.381 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.382 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.382 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:57:43.382 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:57:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faae0066540 msgr2=0x7faae0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faae0066540 0x7faae0068a00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faaf8007380 tx=0x7faaf800b040 comp rx=0 tx=0).stop 2023-11-28T20:57:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab000c5be0 msgr2=0x7fab001432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab000c5be0 0x7fab001432d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faaf001ab80 tx=0x7faaf001ad10 comp rx=0 tx=0).stop 2023-11-28T20:57:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7faafed9d640 1 -- 172.21.15.167:0/2979024310 reap_dead start 2023-11-28T20:57:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 shutdown_connections 2023-11-28T20:57:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 --2- 172.21.15.167:0/2979024310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab000c5be0 0x7fab001432d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 >> 172.21.15.167:0/2979024310 conn(0x7fab000cb1e0 msgr2=0x7fab000cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 shutdown_connections 2023-11-28T20:57:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.367+0000 7fab0489c640 1 -- 172.21.15.167:0/2979024310 wait complete. 2023-11-28T20:57:43.384 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:57:43.385 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:57:43.385 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:57:43.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd64173e640 1 Processor -- start 2023-11-28T20:57:43.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd64173e640 1 -- start start 2023-11-28T20:57:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd64173e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd63c150b40 0x7fd63c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd64173e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c0c4510 0x7fd63c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd64173e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c0c4920 con 0x7fd63c0c6ff0 2023-11-28T20:57:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd64173e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c0c62f0 con 0x7fd63c150b40 2023-11-28T20:57:43.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd64173e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0c6ac0 con 0x7fd63c0c4510 2023-11-28T20:57:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd63affd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd63c150b40 0x7fd63c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd63affd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd63c150b40 0x7fd63c157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47618/0 (socket says 172.21.15.167:47618) 2023-11-28T20:57:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd63affd640 1 -- 172.21.15.167:0/2023371318 learned_addr learned my addr 172.21.15.167:0/2023371318 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd63b7fe640 1 --2- 172.21.15.167:0/2023371318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c0c4510 0x7fd63c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd63affd640 1 -- 172.21.15.167:0/2023371318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c0c4510 msgr2=0x7fd63c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd63affd640 1 --2- 172.21.15.167:0/2023371318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c0c4510 0x7fd63c06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd63affd640 1 -- 172.21.15.167:0/2023371318 >> v1:172.21.15.167:6789/0 conn(0x7fd63c0c6ff0 legacy=0x7fd63c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.527+0000 7fd63affd640 1 -- 172.21.15.167:0/2023371318 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c0c6500 con 0x7fd63c150b40 2023-11-28T20:57:43.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd63affd640 1 --2- 172.21.15.167:0/2023371318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c150b40 0x7fd63c157560 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009870 tx=0x7fd62c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f662c6e3c45733e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd639ffb640 1 -- 172.21.15.167:0/2023371318 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0ab620 con 0x7fd63c150b40 2023-11-28T20:57:43.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd639ffb640 1 -- 172.21.15.167:0/2023371318 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c0ab780 con 0x7fd63c150b40 2023-11-28T20:57:43.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd639ffb640 1 -- 172.21.15.167:0/2023371318 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0abb10 con 0x7fd63c150b40 2023-11-28T20:57:43.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd64173e640 1 -- 172.21.15.167:0/2023371318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c150b40 msgr2=0x7fd63c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd64173e640 1 --2- 172.21.15.167:0/2023371318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c150b40 0x7fd63c157560 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009870 tx=0x7fd62c01c510 comp rx=0 tx=0).stop 2023-11-28T20:57:43.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd64173e640 1 -- 172.21.15.167:0/2023371318 shutdown_connections 2023-11-28T20:57:43.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd64173e640 1 --2- 172.21.15.167:0/2023371318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c0c4510 0x7fd63c06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd64173e640 1 --2- 172.21.15.167:0/2023371318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c150b40 0x7fd63c157560 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd64173e640 1 -- 172.21.15.167:0/2023371318 >> 172.21.15.167:0/2023371318 conn(0x7fd63c0cb1e0 msgr2=0x7fd63c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:43.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd64173e640 1 -- 172.21.15.167:0/2023371318 shutdown_connections 2023-11-28T20:57:43.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.531+0000 7fd64173e640 1 -- 172.21.15.167:0/2023371318 wait complete. 2023-11-28T20:57:43.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 Processor -- start 2023-11-28T20:57:43.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 -- start start 2023-11-28T20:57:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c0c4510 0x7fd63c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c0c6ff0 0x7fd63c144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c150b40 0x7fd63c160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c147710 con 0x7fd63c0c4510 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0ca000 con 0x7fd63c150b40 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c1452d0 con 0x7fd63c0c6ff0 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c0c4510 0x7fd63c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c0c4510 0x7fd63c0c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47624/0 (socket says 172.21.15.167:47624) 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63affd640 1 -- 172.21.15.167:0/314323733 learned_addr learned my addr 172.21.15.167:0/314323733 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63a7fc640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c0c6ff0 0x7fd63c144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63b7fe640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c150b40 0x7fd63c160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63affd640 1 -- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c0c6ff0 msgr2=0x7fd63c144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63affd640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd63c0c6ff0 0x7fd63c144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63affd640 1 -- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c150b40 msgr2=0x7fd63c160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63affd640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c150b40 0x7fd63c160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63affd640 1 -- 172.21.15.167:0/314323733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0094d0 con 0x7fd63c0c4510 2023-11-28T20:57:43.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd63affd640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c0c4510 0x7fd63c0c9ac0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd62c01a140 tx=0x7fd62c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0be3f0 con 0x7fd63c0c4510 2023-11-28T20:57:43.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c0be570 con 0x7fd63c0c4510 2023-11-28T20:57:43.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c1455b0 con 0x7fd63c0c4510 2023-11-28T20:57:43.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0be920 con 0x7fd63c0c4510 2023-11-28T20:57:43.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c0c8fe0 con 0x7fd63c0c4510 2023-11-28T20:57:43.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c145be0 0x7fd63c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.535+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c074770 con 0x7fd63c145be0 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd63a7fc640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c145be0 0x7fd63c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd63a7fc640 1 -- 172.21.15.167:0/314323733 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd63c157040 con 0x7fd63c145be0 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd62c0bea80 con 0x7fd63c0c4510 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd63a7fc640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c145be0 0x7fd63c0c91d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd63c15af30 tx=0x7fd63000fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd6237fe640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd628066470 0x7fd628068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd62c11e830 con 0x7fd63c0c4510 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6300050d0 con 0x7fd63c145be0 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd63b7fe640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd628066470 0x7fd628068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd630005230 con 0x7fd63c145be0 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c145be0 msgr2=0x7fd63c0c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd6237fe640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c145be0 0x7fd63c0c91d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd63c15af30 tx=0x7fd63000fc00 comp rx=0 tx=0).stop 2023-11-28T20:57:43.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c145be0 msgr2=0x7fd63c0c91d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:43.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd6237fe640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c145be0 0x7fd63c0c91d0 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd63c15af30 tx=0x7fd63000fc00 comp rx=0 tx=0).stop 2023-11-28T20:57:43.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.539+0000 7fd63b7fe640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd628066470 0x7fd628068930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd634009f80 tx=0x7fd63400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.543+0000 7fd64173e640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c14f990 0x7fd63c146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.543+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0682c0 con 0x7fd63c14f990 2023-11-28T20:57:43.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd63a7fc640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c14f990 0x7fd63c146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd63a7fc640 1 -- 172.21.15.167:0/314323733 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd63c075c90 con 0x7fd63c14f990 2023-11-28T20:57:43.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd63a7fc640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c14f990 0x7fd63c146440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0c7810 tx=0x7fd630001130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630023070 con 0x7fd63c14f990 2023-11-28T20:57:43.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4811 (secure 0 0 0) 0x7fd63000d930 con 0x7fd63c14f990 2023-11-28T20:57:43.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c14f990 msgr2=0x7fd63c146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd6237fe640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c14f990 0x7fd63c146440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0c7810 tx=0x7fd630001130 comp rx=0 tx=0).stop 2023-11-28T20:57:43.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd6237fe640 1 -- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c14f990 msgr2=0x7fd63c146440 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:43.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd6237fe640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd63c14f990 0x7fd63c146440 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0c7810 tx=0x7fd630001130 comp rx=0 tx=0).stop 2023-11-28T20:57:43.546 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 146, 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 15, 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:43.547 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:43.548 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:43.549 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:57:43.550 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:43.551 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:43.552 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:43.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.555 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:43.556 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:43.557 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.558 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:57:43.559 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:57:43.560 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:57:43.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd628066470 msgr2=0x7fd628068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd64173e640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd628066470 0x7fd628068930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd634009f80 tx=0x7fd63400b040 comp rx=0 tx=0).stop 2023-11-28T20:57:43.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c0c4510 msgr2=0x7fd63c0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd64173e640 1 --2- 172.21.15.167:0/314323733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63c0c4510 0x7fd63c0c9ac0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd62c01a140 tx=0x7fd62c01ad50 comp rx=0 tx=0).stop 2023-11-28T20:57:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd63b7fe640 1 -- 172.21.15.167:0/314323733 reap_dead start 2023-11-28T20:57:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd63b7fe640 1 -- 172.21.15.167:0/314323733 reap_dead start 2023-11-28T20:57:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 shutdown_connections 2023-11-28T20:57:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 >> 172.21.15.167:0/314323733 conn(0x7fd63c0cb1e0 msgr2=0x7fd63c071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 shutdown_connections 2023-11-28T20:57:43.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.547+0000 7fd64173e640 1 -- 172.21.15.167:0/314323733 wait complete. 2023-11-28T20:57:43.564 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:57:43.564 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:57:43.565 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:57:43.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a0d716640 1 Processor -- start 2023-11-28T20:57:43.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a0d716640 1 -- start start 2023-11-28T20:57:43.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a0d716640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a08153f40 0x7f0a08159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a0d716640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080caa90 0x7f0a080c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a0d716640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a080cb5c0 con 0x7f0a080ca660 2023-11-28T20:57:43.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a0d716640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a080b2c60 con 0x7f0a08153f40 2023-11-28T20:57:43.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a0d716640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080c4f00 con 0x7f0a080caa90 2023-11-28T20:57:43.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a067fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0a080ca660 0x7f0a080cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:49664/0 (socket says 172.21.15.167:49664) 2023-11-28T20:57:43.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a067fc640 1 -- 172.21.15.167:0/2958414361 learned_addr learned my addr 172.21.15.167:0/2958414361 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:57:43.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a06ffd640 1 --2- 172.21.15.167:0/2958414361 >> v2:172.21.15.178:3300/0 conn(0x7f0a08153f40 0x7f0a08159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a077fe640 1 --2- 172.21.15.167:0/2958414361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080caa90 0x7f0a080c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a05ffb640 1 -- 172.21.15.167:0/2958414361 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541819089 0 0) 0x7f0a080cb5c0 con 0x7f0a080ca660 2023-11-28T20:57:43.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a05ffb640 1 -- 172.21.15.167:0/2958414361 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f0003530 con 0x7f0a080ca660 2023-11-28T20:57:43.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a06ffd640 1 -- 172.21.15.167:0/2958414361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080caa90 msgr2=0x7f0a080c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:43.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a06ffd640 1 --2- 172.21.15.167:0/2958414361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080caa90 0x7f0a080c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a06ffd640 1 -- 172.21.15.167:0/2958414361 >> v1:172.21.15.167:6789/0 conn(0x7f0a080ca660 legacy=0x7f0a080cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.711+0000 7f0a06ffd640 1 -- 172.21.15.167:0/2958414361 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080c54c0 con 0x7f0a08153f40 2023-11-28T20:57:43.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.715+0000 7f0a06ffd640 1 --2- 172.21.15.167:0/2958414361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a08153f40 0x7f0a08159aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f09f80097c0 tx=0x7f09f801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=384fed16ad6e0ab6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.715+0000 7f0a05ffb640 1 -- 172.21.15.167:0/2958414361 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80ab600 con 0x7f0a08153f40 2023-11-28T20:57:43.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.715+0000 7f0a05ffb640 1 -- 172.21.15.167:0/2958414361 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f80a7050 con 0x7f0a08153f40 2023-11-28T20:57:43.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.715+0000 7f0a05ffb640 1 -- 172.21.15.167:0/2958414361 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80ab960 con 0x7f0a08153f40 2023-11-28T20:57:43.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 -- 172.21.15.167:0/2958414361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a08153f40 msgr2=0x7f0a08159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 --2- 172.21.15.167:0/2958414361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a08153f40 0x7f0a08159aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f09f80097c0 tx=0x7f09f801c480 comp rx=0 tx=0).stop 2023-11-28T20:57:43.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 -- 172.21.15.167:0/2958414361 shutdown_connections 2023-11-28T20:57:43.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 --2- 172.21.15.167:0/2958414361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080caa90 0x7f0a080c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 --2- 172.21.15.167:0/2958414361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a08153f40 0x7f0a08159aa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 -- 172.21.15.167:0/2958414361 >> 172.21.15.167:0/2958414361 conn(0x7f0a0806b800 msgr2=0x7f0a0806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:43.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 -- 172.21.15.167:0/2958414361 shutdown_connections 2023-11-28T20:57:43.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 -- 172.21.15.167:0/2958414361 wait complete. 2023-11-28T20:57:43.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 Processor -- start 2023-11-28T20:57:43.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 -- start start 2023-11-28T20:57:43.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a080ca660 0x7f0a080c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080caa90 0x7f0a080cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08153f40 0x7f0a0813dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080c6750 con 0x7f0a08153f40 2023-11-28T20:57:43.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080c69f0 con 0x7f0a080ca660 2023-11-28T20:57:43.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a0d716640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080c6cd0 con 0x7f0a080caa90 2023-11-28T20:57:43.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08153f40 0x7f0a0813dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08153f40 0x7f0a0813dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47638/0 (socket says 172.21.15.167:47638) 2023-11-28T20:57:43.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a077fe640 1 -- 172.21.15.167:0/3975730610 learned_addr learned my addr 172.21.15.167:0/3975730610 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:43.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a067fc640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080caa90 0x7f0a080cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a06ffd640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a080ca660 0x7f0a080c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a077fe640 1 -- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080caa90 msgr2=0x7f0a080cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a077fe640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080caa90 0x7f0a080cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a077fe640 1 -- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a080ca660 msgr2=0x7f0a080c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a077fe640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a080ca660 0x7f0a080c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a077fe640 1 -- 172.21.15.167:0/3975730610 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8009420 con 0x7f0a08153f40 2023-11-28T20:57:43.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.719+0000 7f0a06ffd640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a080ca660 0x7f0a080c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:57:43.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f0a077fe640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08153f40 0x7f0a0813dca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000efc0 tx=0x7f0a0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00009ca0 con 0x7f0a08153f40 2023-11-28T20:57:43.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000f040 con 0x7f0a08153f40 2023-11-28T20:57:43.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a080c6fb0 con 0x7f0a08153f40 2023-11-28T20:57:43.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a000146c0 con 0x7f0a08153f40 2023-11-28T20:57:43.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a080c7570 con 0x7f0a08153f40 2023-11-28T20:57:43.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f0a0d716640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080ceca0 0x7f0a0813e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08072740 con 0x7f0a080ceca0 2023-11-28T20:57:43.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f0a06ffd640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080ceca0 0x7f0a0813e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f0a06ffd640 1 -- 172.21.15.167:0/3975730610 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a0815a8e0 con 0x7f0a080ceca0 2023-11-28T20:57:43.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a00014820 con 0x7f0a08153f40 2023-11-28T20:57:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f0a06ffd640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080ceca0 0x7f0a0813e1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0a0808ce20 tx=0x7f09f8019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09f40664f0 0x7f09f40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0a00085150 con 0x7f0a08153f40 2023-11-28T20:57:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8003a30 con 0x7f0a080ceca0 2023-11-28T20:57:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f0a067fc640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09f40664f0 0x7f09f40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f09f8003b90 con 0x7f0a080ceca0 2023-11-28T20:57:43.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080ceca0 msgr2=0x7f0a0813e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080ceca0 0x7f0a0813e1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0a0808ce20 tx=0x7f09f8019220 comp rx=0 tx=0).stop 2023-11-28T20:57:43.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080ceca0 msgr2=0x7f0a0813e1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:43.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.723+0000 7f09ef7fe640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a080ceca0 0x7f0a0813e1e0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0a0808ce20 tx=0x7f09f8019220 comp rx=0 tx=0).stop 2023-11-28T20:57:43.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.727+0000 7f0a067fc640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09f40664f0 0x7f09f40689b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f09fc007fd0 tx=0x7f09fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.731+0000 7f0a0d716640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a081f2f20 0x7f0a081f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.731+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0815a640 con 0x7f0a081f2f20 2023-11-28T20:57:43.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.731+0000 7f0a06ffd640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a081f2f20 0x7f0a081f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.731+0000 7f0a06ffd640 1 -- 172.21.15.167:0/3975730610 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0a08166c40 con 0x7f0a081f2f20 2023-11-28T20:57:43.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.731+0000 7f0a06ffd640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a081f2f20 0x7f0a081f3330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09f80097c0 tx=0x7f09f80a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.731+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80c6070 con 0x7f0a081f2f20 2023-11-28T20:57:43.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7f09f8003e70 con 0x7f0a081f2f20 2023-11-28T20:57:43.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a081f2f20 msgr2=0x7f0a081f3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f09ef7fe640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a081f2f20 0x7f0a081f3330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09f80097c0 tx=0x7f09f80a8000 comp rx=0 tx=0).stop 2023-11-28T20:57:43.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f09ef7fe640 1 -- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a081f2f20 msgr2=0x7f0a081f3330 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:43.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f09ef7fe640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a081f2f20 0x7f0a081f3330 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09f80097c0 tx=0x7f09f80a8000 comp rx=0 tx=0).stop 2023-11-28T20:57:43.733 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:57:43.733 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:43.733 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:43.734 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:57:43.734 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 146, 2023-11-28T20:57:43.734 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:57:43.734 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:57:43.734 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:57:43.734 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:57:43.735 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.735 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 15, 2023-11-28T20:57:43.735 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:43.735 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:57:43.735 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:57:43.735 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:43.736 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:43.736 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:43.736 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:43.736 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:43.736 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:43.736 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:43.737 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:43.737 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:43.737 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:43.737 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.737 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:57:43.737 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:57:43.738 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:43.738 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:43.738 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:43.738 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:43.738 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:43.738 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:43.738 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:43.739 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:43.739 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:43.739 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:43.739 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.739 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:57:43.739 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:57:43.740 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:57:43.740 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:57:43.740 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:57:43.740 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:57:43.740 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:43.740 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:43.741 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:57:43.741 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:57:43.741 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:57:43.741 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:57:43.741 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:57:43.741 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:57:43.742 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:57:43.742 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:43.742 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:57:43.742 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:43.742 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:43.742 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:43.743 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:43.743 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:43.743 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:43.743 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:43.743 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:43.743 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:43.744 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:43.744 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.744 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:57:43.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.744 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:57:43.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.745 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:43.745 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:43.745 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:43.745 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:43.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.745 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:43.745 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:57:43.746 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.746 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:43.746 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:57:43.746 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.747 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.747 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.747 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:57:43.747 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:57:43.747 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:43.747 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:43.748 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:43.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.748 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:43.748 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:43.748 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:43.749 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:43.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.749 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:43.749 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:57:43.749 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.750 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:43.750 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:57:43.750 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.750 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.750 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.751 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:57:43.751 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:57:43.751 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:43.751 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:43.751 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:43.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.752 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:43.752 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:43.752 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:43.752 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:43.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.753 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:43.753 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:57:43.753 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.754 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:43.754 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:57:43.754 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:43.754 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.754 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.755 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:57:43.755 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:57:43.755 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:43.755 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:43.755 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:43.755 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.756 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.756 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:57:43.756 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:57:43.756 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.756 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.757 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.757 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:43.757 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.757 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:43.757 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:57:43.757 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:43.758 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:43.758 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:43.758 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:43.758 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:43.758 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:43.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:43.759 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:57:43.759 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:57:43.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09f40664f0 msgr2=0x7f09f40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a0d716640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09f40664f0 0x7f09f40689b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f09fc007fd0 tx=0x7f09fc009040 comp rx=0 tx=0).stop 2023-11-28T20:57:43.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08153f40 msgr2=0x7f0a0813dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a0d716640 1 --2- 172.21.15.167:0/3975730610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08153f40 0x7f0a0813dca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000efc0 tx=0x7f0a0000c490 comp rx=0 tx=0).stop 2023-11-28T20:57:43.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a077fe640 1 -- 172.21.15.167:0/3975730610 reap_dead start 2023-11-28T20:57:43.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a077fe640 1 -- 172.21.15.167:0/3975730610 reap_dead start 2023-11-28T20:57:43.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 shutdown_connections 2023-11-28T20:57:43.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 >> 172.21.15.167:0/3975730610 conn(0x7f0a0806b800 msgr2=0x7f0a0806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:43.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 shutdown_connections 2023-11-28T20:57:43.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.735+0000 7f0a0d716640 1 -- 172.21.15.167:0/3975730610 wait complete. 2023-11-28T20:57:43.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:57:43.763 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2023-11-28T20:57:43.763 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:57:43.763 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2023-11-28T20:57:43.763 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:57:43.764 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:57:43.764 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:57:43.780 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:57:43.780 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:57:43.780 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:57:43.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.919+0000 7f9e68cfd640 1 Processor -- start 2023-11-28T20:57:43.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.919+0000 7f9e68cfd640 1 -- start start 2023-11-28T20:57:43.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e68cfd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e640cf860 0x7f9e640cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e68cfd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9e64153ae0 0x7f9e64153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e68cfd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6415ac00 con 0x7f9e640cfc40 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e68cfd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e640cbd60 con 0x7f9e640cf860 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e68cfd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e64159ff0 con 0x7f9e64153ae0 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e6259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e640cf860 0x7f9e640cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e6259c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e640cf860 0x7f9e640cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47650/0 (socket says 172.21.15.167:47650) 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e6259c640 1 -- 172.21.15.167:0/2440297913 learned_addr learned my addr 172.21.15.167:0/2440297913 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e62d9d640 1 --2- 172.21.15.167:0/2440297913 >> v2:172.21.15.178:3300/0 conn(0x7f9e64153ae0 0x7f9e64153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e6259c640 1 -- 172.21.15.167:0/2440297913 >> v2:172.21.15.178:3300/0 conn(0x7f9e64153ae0 msgr2=0x7f9e64153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e6259c640 1 --2- 172.21.15.167:0/2440297913 >> v2:172.21.15.178:3300/0 conn(0x7f9e64153ae0 0x7f9e64153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e6259c640 1 -- 172.21.15.167:0/2440297913 >> v1:172.21.15.178:6789/0 conn(0x7f9e640cfc40 legacy=0x7f9e640ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.923+0000 7f9e6259c640 1 -- 172.21.15.167:0/2440297913 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6415a2d0 con 0x7f9e640cf860 2023-11-28T20:57:43.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e6259c640 1 --2- 172.21.15.167:0/2440297913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cf860 0x7f9e640cb770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9e640b2240 tx=0x7f9e5401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9047e0437c8bbd8d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e61d9b640 1 -- 172.21.15.167:0/2440297913 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540aa660 con 0x7f9e640cf860 2023-11-28T20:57:43.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e61d9b640 1 -- 172.21.15.167:0/2440297913 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e540aa7c0 con 0x7f9e640cf860 2023-11-28T20:57:43.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e61d9b640 1 -- 172.21.15.167:0/2440297913 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540aab50 con 0x7f9e640cf860 2023-11-28T20:57:43.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 -- 172.21.15.167:0/2440297913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cf860 msgr2=0x7f9e640cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 --2- 172.21.15.167:0/2440297913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cf860 0x7f9e640cb770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9e640b2240 tx=0x7f9e5401c500 comp rx=0 tx=0).stop 2023-11-28T20:57:43.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 -- 172.21.15.167:0/2440297913 shutdown_connections 2023-11-28T20:57:43.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 --2- 172.21.15.167:0/2440297913 >> v2:172.21.15.178:3300/0 conn(0x7f9e64153ae0 0x7f9e64153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 --2- 172.21.15.167:0/2440297913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cf860 0x7f9e640cb770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 -- 172.21.15.167:0/2440297913 >> 172.21.15.167:0/2440297913 conn(0x7f9e6406c1f0 msgr2=0x7f9e64071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:43.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 -- 172.21.15.167:0/2440297913 shutdown_connections 2023-11-28T20:57:43.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 -- 172.21.15.167:0/2440297913 wait complete. 2023-11-28T20:57:43.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 Processor -- start 2023-11-28T20:57:43.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.927+0000 7f9e68cfd640 1 -- start start 2023-11-28T20:57:43.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e68cfd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e640cf860 0x7f9e640b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e68cfd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cfc40 0x7f9e64155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e68cfd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e64153ae0 0x7f9e64156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e68cfd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640b5790 con 0x7f9e640cfc40 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e68cfd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641554f0 con 0x7f9e64153ae0 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e68cfd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6415c900 con 0x7f9e640cf860 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e6259c640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e640cf860 msgr2=0x7f9e640b49a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e6259c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e640cf860 0x7f9e640b49a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cfc40 0x7f9e64155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cfc40 0x7f9e64155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47656/0 (socket says 172.21.15.167:47656) 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5bfff640 1 -- 172.21.15.167:0/1154092504 learned_addr learned my addr 172.21.15.167:0/1154092504 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e62d9d640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e64153ae0 0x7f9e64156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5bfff640 1 -- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e640cf860 msgr2=0x7f9e640b49a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5bfff640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e640cf860 0x7f9e640b49a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5bfff640 1 -- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e64153ae0 msgr2=0x7f9e64156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:43.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5bfff640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e64153ae0 0x7f9e64156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:43.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5bfff640 1 -- 172.21.15.167:0/1154092504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540094d0 con 0x7f9e640cfc40 2023-11-28T20:57:43.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5bfff640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cfc40 0x7f9e64155c40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c3f0 tx=0x7f9e4c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5affd640 1 -- 172.21.15.167:0/1154092504 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0052d0 con 0x7f9e640cfc40 2023-11-28T20:57:43.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5affd640 1 -- 172.21.15.167:0/1154092504 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c005430 con 0x7f9e640cfc40 2023-11-28T20:57:43.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5affd640 1 -- 172.21.15.167:0/1154092504 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c003840 con 0x7f9e640cfc40 2023-11-28T20:57:43.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6415ba10 con 0x7f9e640cfc40 2023-11-28T20:57:43.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e64155720 con 0x7f9e640cfc40 2023-11-28T20:57:43.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e64075c90 con 0x7f9e640cfc40 2023-11-28T20:57:43.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.931+0000 7f9e5affd640 1 -- 172.21.15.167:0/1154092504 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e4c0039a0 con 0x7f9e640cfc40 2023-11-28T20:57:43.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.935+0000 7f9e5affd640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9e44066420 0x7f9e440688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:43.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.935+0000 7f9e5affd640 1 -- 172.21.15.167:0/1154092504 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9e4c083830 con 0x7f9e640cfc40 2023-11-28T20:57:43.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.935+0000 7f9e6259c640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9e44066420 0x7f9e440688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:43.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.935+0000 7f9e6259c640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9e44066420 0x7f9e440688e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9e540ae000 tx=0x7f9e54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:43.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:43.939+0000 7f9e5affd640 1 -- 172.21.15.167:0/1154092504 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e4c050840 con 0x7f9e640cfc40 2023-11-28T20:57:44.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.147+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9e64153f50 con 0x7f9e640cfc40 2023-11-28T20:57:44.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.147+0000 7f9e5affd640 1 -- 172.21.15.167:0/1154092504 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f9e4c017630 con 0x7f9e640cfc40 2023-11-28T20:57:44.147 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:57:44.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9e44066420 msgr2=0x7f9e440688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:44.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9e44066420 0x7f9e440688e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9e540ae000 tx=0x7f9e54008040 comp rx=0 tx=0).stop 2023-11-28T20:57:44.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cfc40 msgr2=0x7f9e64155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:44.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cfc40 0x7f9e64155c40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c3f0 tx=0x7f9e4c00c8b0 comp rx=0 tx=0).stop 2023-11-28T20:57:44.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 shutdown_connections 2023-11-28T20:57:44.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9e44066420 0x7f9e440688e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:44.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e64153ae0 0x7f9e64156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:44.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e640cfc40 0x7f9e64155c40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:44.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 --2- 172.21.15.167:0/1154092504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e640cf860 0x7f9e640b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:44.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 >> 172.21.15.167:0/1154092504 conn(0x7f9e6406c1f0 msgr2=0x7f9e64066b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:44.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 shutdown_connections 2023-11-28T20:57:44.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:44.151+0000 7f9e68cfd640 1 -- 172.21.15.167:0/1154092504 wait complete. 2023-11-28T20:57:47.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:57:47.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.306+0000 7f603f417640 1 Processor -- start 2023-11-28T20:57:47.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.306+0000 7f603f417640 1 -- start start 2023-11-28T20:57:47.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.306+0000 7f603f417640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f60380c7720 0x7f603806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:47.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.306+0000 7f603f417640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603815e5e0 con 0x7f603815e130 2023-11-28T20:57:47.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.306+0000 7f603f417640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603815e8c0 con 0x7f60381585d0 2023-11-28T20:57:47.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.306+0000 7f603f417640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603815f160 con 0x7f60380c7720 2023-11-28T20:57:47.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.306+0000 7f603c9b2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f603815e130 0x7f6038161de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:49680/0 (socket says 172.21.15.167:49680) 2023-11-28T20:57:47.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.306+0000 7f603c9b2640 1 -- 172.21.15.167:0/4066426872 learned_addr learned my addr 172.21.15.167:0/4066426872 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:57:47.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.306+0000 7f603d9b4640 1 --2- 172.21.15.167:0/4066426872 >> v2:172.21.15.178:3300/0 conn(0x7f60380c7720 0x7f603806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:47.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272043364 0 0) 0x7f603815e5e0 con 0x7f603815e130 2023-11-28T20:57:47.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6024003530 con 0x7f603815e130 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90380811 0 0) 0x7f6024003530 con 0x7f603815e130 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 >> v2:172.21.15.178:3300/0 conn(0x7f60380c7720 msgr2=0x7f603806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 --2- 172.21.15.167:0/4066426872 >> v2:172.21.15.178:3300/0 conn(0x7f60380c7720 0x7f603806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 >> v1:172.21.15.178:6789/0 conn(0x7f60381585d0 legacy=0x7f60380c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603815eba0 con 0x7f603815e130 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f6028001680 con 0x7f603815e130 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 >> v1:172.21.15.167:6789/0 conn(0x7f603815e130 legacy=0x7f6038161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6024003980 0x7f6024003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60240047d0 0x7f6024004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:47.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f602400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603815f160 con 0x7f6024005190 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602400c030 con 0x7f6024003980 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602400c1f0 con 0x7f60240047d0 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f603c9b2640 1 -- 172.21.15.167:0/4066426872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60240047d0 msgr2=0x7f6024004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f603c9b2640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60240047d0 0x7f6024004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f603d9b4640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f602400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f603d1b3640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6024003980 0x7f6024003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f603d9b4640 1 -- 172.21.15.167:0/4066426872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60240047d0 msgr2=0x7f6024004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f603d9b4640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60240047d0 0x7f6024004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f603d9b4640 1 -- 172.21.15.167:0/4066426872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6024003980 msgr2=0x7f6024003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:47.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f603d9b4640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6024003980 0x7f6024003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.310+0000 7f603d9b4640 1 -- 172.21.15.167:0/4066426872 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024003530 con 0x7f6024005190 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603d9b4640 1 -- 172.21.15.167:0/4066426872 reap_dead start 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603d9b4640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f602400b990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6030009fc0 tx=0x7f603001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6b83dfcf901f9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300a5cb0 con 0x7f6024005190 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000f040 con 0x7f6024005190 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f602ffff640 1 -- 172.21.15.167:0/4066426872 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030003be0 con 0x7f6024005190 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 -- 172.21.15.167:0/4066426872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 msgr2=0x7f602400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f602400b990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6030009fc0 tx=0x7f603001cca0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 -- 172.21.15.167:0/4066426872 shutdown_connections 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 --2- 172.21.15.167:0/4066426872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f602400b990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 -- 172.21.15.167:0/4066426872 >> 172.21.15.167:0/4066426872 conn(0x7f60380cb1e0 msgr2=0x7f60380cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:47.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 -- 172.21.15.167:0/4066426872 shutdown_connections 2023-11-28T20:57:47.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 -- 172.21.15.167:0/4066426872 wait complete. 2023-11-28T20:57:47.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 Processor -- start 2023-11-28T20:57:47.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 -- start start 2023-11-28T20:57:47.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f603815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60380ca4c0 0x7f60380caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60381569a0 0x7f603814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380caf80 con 0x7f6024005190 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603815ae00 con 0x7f60380ca4c0 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.314+0000 7f603f417640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60381590f0 con 0x7f60381569a0 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d1b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f603815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d9b4640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60381569a0 msgr2=0x7f603814b340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d1b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f603815b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:47678/0 (socket says 172.21.15.167:47678) 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d9b4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60381569a0 0x7f603814b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d1b3640 1 -- 172.21.15.167:0/3292704843 learned_addr learned my addr 172.21.15.167:0/3292704843 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:47.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603c9b2640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60380ca4c0 0x7f60380caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d1b3640 1 -- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60381569a0 msgr2=0x7f603814b340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d1b3640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60381569a0 0x7f603814b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d1b3640 1 -- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60380ca4c0 msgr2=0x7f60380caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d1b3640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60380ca4c0 0x7f60380caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d1b3640 1 -- 172.21.15.167:0/3292704843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038158b70 con 0x7f6024005190 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603c9b2640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60380ca4c0 0x7f60380caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603d1b3640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f603815b700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f603400f5f0 tx=0x7f603400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f602dffb640 1 -- 172.21.15.167:0/3292704843 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340052e0 con 0x7f6024005190 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f602dffb640 1 -- 172.21.15.167:0/3292704843 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034005440 con 0x7f6024005190 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f602dffb640 1 -- 172.21.15.167:0/3292704843 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034003820 con 0x7f6024005190 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6038158e10 con 0x7f6024005190 2023-11-28T20:57:47.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603815aa90 con 0x7f6024005190 2023-11-28T20:57:47.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60380682c0 con 0x7f6024005190 2023-11-28T20:57:47.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.318+0000 7f602dffb640 1 -- 172.21.15.167:0/3292704843 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6034003980 con 0x7f6024005190 2023-11-28T20:57:47.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.322+0000 7f602dffb640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f601c066450 0x7f601c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:47.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.322+0000 7f602dffb640 1 -- 172.21.15.167:0/3292704843 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6034084150 con 0x7f6024005190 2023-11-28T20:57:47.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.322+0000 7f603c9b2640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f601c066450 0x7f601c068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:47.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.322+0000 7f603c9b2640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f601c066450 0x7f601c068910 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f60381561e0 tx=0x7f6028009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:47.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.326+0000 7f602dffb640 1 -- 172.21.15.167:0/3292704843 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60340511e0 con 0x7f6024005190 2023-11-28T20:57:47.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.534+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f603815a610 con 0x7f6024005190 2023-11-28T20:57:47.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.534+0000 7f602dffb640 1 -- 172.21.15.167:0/3292704843 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f603815a610 con 0x7f6024005190 2023-11-28T20:57:47.534 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":146,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:57:47.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f601c066450 msgr2=0x7f601c068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f601c066450 0x7f601c068910 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f60381561e0 tx=0x7f6028009040 comp rx=0 tx=0).stop 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 msgr2=0x7f603815b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f603815b700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f603400f5f0 tx=0x7f603400fab0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 shutdown_connections 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f601c066450 0x7f601c068910 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60381569a0 0x7f603814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60380ca4c0 0x7f60380caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 --2- 172.21.15.167:0/3292704843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6024005190 0x7f603815b700 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 >> 172.21.15.167:0/3292704843 conn(0x7f60380cb1e0 msgr2=0x7f6038157670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 shutdown_connections 2023-11-28T20:57:47.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:47.538+0000 7f603f417640 1 -- 172.21.15.167:0/3292704843 wait complete. 2023-11-28T20:57:48.871 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 29% (100/334) Updating files: 30% (101/334) Updating files: 31% (104/334) Updating files: 32% (107/334) Updating files: 33% (111/334) Updating files: 34% (114/334) Updating files: 35% (117/334) Updating files: 36% (121/334) Updating files: 36% (123/334) Updating files: 37% (124/334) Updating files: 38% (127/334) Updating files: 39% (131/334) Updating files: 39% (132/334) Updating files: 40% (134/334) Updating files: 41% (137/334) Updating files: 42% (141/334) Updating files: 42% (143/334) Updating files: 43% (144/334) Updating files: 44% (147/334) Updating files: 45% (151/334) Updating files: 46% (154/334) Updating files: 47% (157/334) Updating files: 48% (161/334) Updating files: 49% (164/334) Updating files: 50% (167/334) Updating files: 51% (171/334) Updating files: 52% (174/334) Updating files: 53% (178/334) Updating files: 54% (181/334) Updating files: 55% (184/334) Updating files: 56% (188/334) Updating files: 57% (191/334) Updating files: 58% (194/334) Updating files: 59% (198/334) Updating files: 60% (201/334) Updating files: 61% (204/334) Updating files: 62% (208/334) Updating files: 63% (211/334) Updating files: 64% (214/334) Updating files: 65% (218/334) Updating files: 66% (221/334) Updating files: 67% (224/334) Updating files: 67% (226/334) Updating files: 68% (228/334) Updating files: 69% (231/334) Updating files: 70% (234/334) Updating files: 70% (235/334) Updating files: 71% (238/334) Updating files: 72% (241/334) Updating files: 73% (244/334) Updating files: 74% (248/334) Updating files: 75% (251/334) Updating files: 76% (254/334) Updating files: 77% (258/334) Updating files: 78% (261/334) Updating files: 79% (264/334) Updating files: 80% (268/334) Updating files: 81% (271/334) Updating files: 82% (274/334) Updating files: 83% (278/334) Updating files: 84% (281/334) Updating files: 85% (284/334) Updating files: 86% (288/334) Updating files: 87% (291/334) Updating files: 88% (294/334) Updating files: 89% (298/334) Updating files: 90% (301/334) Updating files: 91% (304/334) Updating files: 92% (308/334) Updating files: 93% (311/334) Updating files: 93% (313/334) Updating files: 94% (314/334) Updating files: 95% (318/334) Updating files: 96% (321/334) Updating files: 97% (324/334) Updating files: 98% (328/334) Updating files: 99% (331/334) Updating files: 100% (334/334) Updating files: 100% (334/334), done. 2023-11-28T20:57:49.357 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 0afda378124 v0.35 2023-11-28T20:57:49.361 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.35 2023-11-28T20:57:49.783 INFO:tasks.workunit.client.0.smithi167.stdout:v0.36 2023-11-28T20:57:49.783 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 36 -eq 48 ] 2023-11-28T20:57:49.783 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.36 2023-11-28T20:57:49.783 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.36 2023-11-28T20:57:49.784 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.36 2023-11-28T20:57:50.556 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:57:50.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab93e6640 1 Processor -- start 2023-11-28T20:57:50.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab93e6640 1 -- start start 2023-11-28T20:57:50.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab93e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 0x7f3ab415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:50.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab93e6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab415ac00 con 0x7f3ab40cfc40 2023-11-28T20:57:50.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab93e6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab40cbd60 con 0x7f3ab40cf860 2023-11-28T20:57:50.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab93e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab4159ff0 con 0x7f3ab40cb770 2023-11-28T20:57:50.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab37fe640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 msgr2=0x7f3ab415d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:50.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab37fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 0x7f3ab415d4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:50.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab27fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3ab40cfc40 0x7f3ab4153ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:49692/0 (socket says 172.21.15.167:49692) 2023-11-28T20:57:50.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.698+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 learned_addr learned my addr 172.21.15.167:0/1184874501 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:57:50.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.902+0000 7f3ab37fe640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 msgr2=0x7f3ab415d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:50.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:50.902+0000 7f3ab37fe640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 0x7f3ab415d4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:57:51.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:51.306+0000 7f3ab37fe640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 msgr2=0x7f3ab415d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:51.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:51.306+0000 7f3ab37fe640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 0x7f3ab415d4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:57:51.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:51.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:52.110+0000 7f3ab37fe640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 msgr2=0x7f3ab415d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:52.110+0000 7f3ab37fe640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 0x7f3ab415d4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:57:53.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 msgr2=0x7f3ab415d4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:53.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab0ff9640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab40cb770 0x7f3ab415d4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 >> v1:172.21.15.178:6789/0 conn(0x7f3ab40cf860 legacy=0x7f3ab40ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 >> v1:172.21.15.167:6789/0 conn(0x7f3ab40cfc40 legacy=0x7f3ab4153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab0ff9640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab0ff9640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab4159ff0 con 0x7f3aa00061f0 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa0008d40 con 0x7f3aa0003720 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 msgr2=0x7f3aa00086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 msgr2=0x7f3aa00086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:53.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:53.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 msgr2=0x7f3aa0005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:57:53.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 msgr2=0x7f3aa0005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:53.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:53.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.698+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:53.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 msgr2=0x7f3aa00086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:57:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 msgr2=0x7f3aa00086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:57:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 msgr2=0x7f3aa0005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:57:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 msgr2=0x7f3aa0005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:53.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:53.902+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:57:54.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 msgr2=0x7f3aa00086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:57:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 msgr2=0x7f3aa00086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:57:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 msgr2=0x7f3aa0005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:57:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 msgr2=0x7f3aa0005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:54.306+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:57:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 msgr2=0x7f3aa00086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:57:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 msgr2=0x7f3aa00086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:57:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 msgr2=0x7f3aa0005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:57:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 msgr2=0x7f3aa0005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:55.110+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:57:56.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 msgr2=0x7f3aa0005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:56.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab0ff9640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0003720 0x7f3aa0005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:56.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 msgr2=0x7f3aa00086b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:56.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab0ff9640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.167:3300/0 conn(0x7f3aa00061f0 0x7f3aa00086b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:56.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab37fe640 1 -- 172.21.15.167:0/1184874501 reap_dead start 2023-11-28T20:57:56.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab0ff9640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 0x7f3aa0006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:56.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab0ff9640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:56.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab415a2d0 con 0x7f3aa00075a0 2023-11-28T20:57:56.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab4159ff0 con 0x7f3aa0006b60 2023-11-28T20:57:56.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab0ff9640 1 -- 172.21.15.167:0/1184874501 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0008d40 con 0x7f3aa0003b90 2023-11-28T20:57:56.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 msgr2=0x7f3aa0006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:56.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 0x7f3aa0006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:56.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:56.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 msgr2=0x7f3aa0006fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:57:56.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 msgr2=0x7f3aa0006fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:56.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:56.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.698+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:56.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.902+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 msgr2=0x7f3aa0006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:56.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.902+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 0x7f3aa0006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:57:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.902+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.902+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 msgr2=0x7f3aa0006fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:57:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.902+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 msgr2=0x7f3aa0006fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.902+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:56.902+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:57:57.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:57.306+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 msgr2=0x7f3aa0006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:57.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:57.306+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 0x7f3aa0006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:57:57.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:57.306+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:57.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:57.306+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 msgr2=0x7f3aa0006fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:57:57.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:57.306+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 msgr2=0x7f3aa0006fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:57.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:57.306+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:57.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:57.306+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:57:58.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.110+0000 7f3ab2ffd640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 msgr2=0x7f3aa0006620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.110+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 0x7f3aa0006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:57:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.110+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.110+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 msgr2=0x7f3aa0006fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:57:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.110+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 msgr2=0x7f3aa0006fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:57:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.110+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:57:58.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.110+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:57:58.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95696664 0 0) 0x7f3ab415a2d0 con 0x7f3aa00075a0 2023-11-28T20:57:58.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a9c003530 con 0x7f3aa00075a0 2023-11-28T20:57:58.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4183263263 0 0) 0x7f3a9c003530 con 0x7f3aa00075a0 2023-11-28T20:57:58.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 msgr2=0x7f3aa0006620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:58.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 0x7f3aa0006620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 msgr2=0x7f3aa0006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:58.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 --2- 172.21.15.167:0/1184874501 >> v2:172.21.15.178:3300/0 conn(0x7f3aa0006b60 0x7f3aa0006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0008450 con 0x7f3aa00075a0 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f3aac0043f0 con 0x7f3aa00075a0 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 >> v1:172.21.15.167:6789/0 conn(0x7f3aa00075a0 legacy=0x7f3aa0007a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a9c003980 0x7f3a9c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 0x7f3a9c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a9c004d10 0x7f3a9c005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab4159ff0 con 0x7f3a9c004d10 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0008d40 con 0x7f3a9c003980 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c00bc20 con 0x7f3aa0003b90 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab27fc640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 msgr2=0x7f3a9c0047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 0x7f3a9c0047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab37fe640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a9c004d10 0x7f3a9c005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:58.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a9c003980 0x7f3a9c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:58.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab37fe640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 msgr2=0x7f3a9c0047d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:58.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab37fe640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa0003b90 0x7f3a9c0047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab37fe640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a9c003980 msgr2=0x7f3a9c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:58.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab37fe640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a9c003980 0x7f3a9c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.658+0000 7f3ab37fe640 1 -- 172.21.15.167:0/1184874501 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c003530 con 0x7f3a9c004d10 2023-11-28T20:57:58.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab37fe640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a9c004d10 0x7f3a9c005170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40b2d80 tx=0x7f3aac01d1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9bd4178e96117c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:58.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0ac620 con 0x7f3a9c004d10 2023-11-28T20:57:58.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac0a8070 con 0x7f3a9c004d10 2023-11-28T20:57:58.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab1ffb640 1 -- 172.21.15.167:0/1184874501 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0ac9e0 con 0x7f3a9c004d10 2023-11-28T20:57:58.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab93e6640 1 -- 172.21.15.167:0/1184874501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a9c004d10 msgr2=0x7f3a9c005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:58.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab93e6640 1 --2- 172.21.15.167:0/1184874501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a9c004d10 0x7f3a9c005170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40b2d80 tx=0x7f3aac01d1a0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab37fe640 1 -- 172.21.15.167:0/1184874501 reap_dead start 2023-11-28T20:57:58.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab93e6640 1 -- 172.21.15.167:0/1184874501 shutdown_connections 2023-11-28T20:57:58.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab93e6640 1 -- 172.21.15.167:0/1184874501 >> 172.21.15.167:0/1184874501 conn(0x7f3ab406c1f0 msgr2=0x7f3ab4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:58.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab93e6640 1 -- 172.21.15.167:0/1184874501 shutdown_connections 2023-11-28T20:57:58.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.662+0000 7f3ab93e6640 1 -- 172.21.15.167:0/1184874501 wait complete. 2023-11-28T20:57:58.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab93e6640 1 Processor -- start 2023-11-28T20:57:58.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab93e6640 1 -- start start 2023-11-28T20:57:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab93e6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ab40b4e40 0x7f3ab4157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab93e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab41f02d0 0x7f3ab40cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab93e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab414fb10 0x7f3ab4156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:58.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab93e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab41ef5a0 con 0x7f3ab41f02d0 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab93e6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab41efe40 con 0x7f3ab40b4e40 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab93e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab40cefb0 con 0x7f3ab414fb10 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab37fe640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab414fb10 msgr2=0x7f3ab4156000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab37fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab414fb10 0x7f3ab4156000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab41f02d0 0x7f3ab40cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab41f02d0 0x7f3ab40cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49520/0 (socket says 172.21.15.167:49520) 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab27fc640 1 -- 172.21.15.167:0/3243365417 learned_addr learned my addr 172.21.15.167:0/3243365417 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ab40b4e40 0x7f3ab4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab27fc640 1 -- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab414fb10 msgr2=0x7f3ab4156000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab414fb10 0x7f3ab4156000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab27fc640 1 -- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ab40b4e40 msgr2=0x7f3ab4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.666+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ab40b4e40 0x7f3ab4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3ab27fc640 1 -- 172.21.15.167:0/3243365417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab40cf210 con 0x7f3ab41f02d0 2023-11-28T20:57:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3ab27fc640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab41f02d0 0x7f3ab40cd450 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8007790 tx=0x7f3aa801a830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3a9b7fe640 1 -- 172.21.15.167:0/3243365417 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa801f070 con 0x7f3ab41f02d0 2023-11-28T20:57:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3a9b7fe640 1 -- 172.21.15.167:0/3243365417 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa80077c0 con 0x7f3ab41f02d0 2023-11-28T20:57:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3a9b7fe640 1 -- 172.21.15.167:0/3243365417 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8018660 con 0x7f3ab41f02d0 2023-11-28T20:57:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab41ef7f0 con 0x7f3ab41f02d0 2023-11-28T20:57:58.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab40cd990 con 0x7f3ab41f02d0 2023-11-28T20:57:58.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab4075c90 con 0x7f3ab41f02d0 2023-11-28T20:57:58.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3a9b7fe640 1 -- 172.21.15.167:0/3243365417 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3aa80187c0 con 0x7f3ab41f02d0 2023-11-28T20:57:58.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3a9b7fe640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3aa006af30 0x7f3aa006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:58.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.670+0000 7f3a9b7fe640 1 -- 172.21.15.167:0/3243365417 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3aa8085660 con 0x7f3ab41f02d0 2023-11-28T20:57:58.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.674+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3aa006af30 0x7f3aa006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:58.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.674+0000 7f3ab2ffd640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3aa006af30 0x7f3aa006d3f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4000c10 tx=0x7f3aa4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:58.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.678+0000 7f3a9b7fe640 1 -- 172.21.15.167:0/3243365417 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3aa8052780 con 0x7f3ab41f02d0 2023-11-28T20:57:58.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.882+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3ab41eff80 con 0x7f3ab41f02d0 2023-11-28T20:57:58.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.882+0000 7f3a9b7fe640 1 -- 172.21.15.167:0/3243365417 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f3aa8055da0 con 0x7f3ab41f02d0 2023-11-28T20:57:58.882 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:57:58.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3aa006af30 msgr2=0x7f3aa006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:58.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3aa006af30 0x7f3aa006d3f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4000c10 tx=0x7f3aa4009040 comp rx=0 tx=0).stop 2023-11-28T20:57:58.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab41f02d0 msgr2=0x7f3ab40cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:58.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab41f02d0 0x7f3ab40cd450 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8007790 tx=0x7f3aa801a830 comp rx=0 tx=0).stop 2023-11-28T20:57:58.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 shutdown_connections 2023-11-28T20:57:58.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3aa006af30 0x7f3aa006d3f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ab414fb10 0x7f3ab4156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab41f02d0 0x7f3ab40cd450 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 --2- 172.21.15.167:0/3243365417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ab40b4e40 0x7f3ab4157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:58.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 >> 172.21.15.167:0/3243365417 conn(0x7f3ab406c1f0 msgr2=0x7f3ab4150330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:58.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 shutdown_connections 2023-11-28T20:57:58.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:58.886+0000 7f3ab93e6640 1 -- 172.21.15.167:0/3243365417 wait complete. 2023-11-28T20:57:58.902 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:57:58.903 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T20:57:58.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:57:59.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.042+0000 7ff53ae54640 1 Processor -- start 2023-11-28T20:57:59.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.042+0000 7ff53ae54640 1 -- start start 2023-11-28T20:57:59.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.042+0000 7ff53ae54640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 0x7ff534157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff53ae54640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340c4940 con 0x7ff5340c6ff0 2023-11-28T20:57:59.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff53ae54640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340c6ac0 con 0x7ff5340c4510 2023-11-28T20:57:59.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff53ae54640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340c62f0 con 0x7ff534150b40 2023-11-28T20:57:59.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff538bf0640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 msgr2=0x7ff534157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:59.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff538bf0640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 0x7ff534157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:59.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff5340c6ff0 0x7ff5340c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:44754/0 (socket says 172.21.15.167:44754) 2023-11-28T20:57:59.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52bfff640 1 -- 172.21.15.167:0/2208035843 learned_addr learned my addr 172.21.15.167:0/2208035843 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:57:59.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358047022 0 0) 0x7ff5340c4940 con 0x7ff5340c6ff0 2023-11-28T20:57:59.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff51c003530 con 0x7ff5340c6ff0 2023-11-28T20:57:59.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556982836 0 0) 0x7ff5340c6ac0 con 0x7ff5340c4510 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5340c4940 con 0x7ff5340c4510 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3814919034 0 0) 0x7ff51c003530 con 0x7ff5340c6ff0 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 msgr2=0x7ff534157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 0x7ff534157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 >> v1:172.21.15.178:6789/0 conn(0x7ff5340c4510 legacy=0x7ff53406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340c6500 con 0x7ff5340c6ff0 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7ff524001600 con 0x7ff5340c6ff0 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 >> v1:172.21.15.167:6789/0 conn(0x7ff5340c6ff0 legacy=0x7ff5340c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 0x7ff51c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff51c0040c0 0x7ff51c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 0x7ff51c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340c62f0 con 0x7ff51c004e30 2023-11-28T20:57:59.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c005510 con 0x7ff51c0040c0 2023-11-28T20:57:59.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c00bed0 con 0x7ff534150b40 2023-11-28T20:57:59.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff538bf0640 1 -- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 msgr2=0x7ff51c003b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:59.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff538bf0640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 0x7ff51c003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:59.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff5393f1640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 0x7ff51c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff52bfff640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff51c0040c0 0x7ff51c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff5393f1640 1 -- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 msgr2=0x7ff51c003b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:57:59.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff5393f1640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534150b40 0x7ff51c003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff5393f1640 1 -- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff51c0040c0 msgr2=0x7ff51c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:59.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff5393f1640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff51c0040c0 0x7ff51c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.046+0000 7ff5393f1640 1 -- 172.21.15.167:0/2208035843 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c003530 con 0x7ff51c004e30 2023-11-28T20:57:59.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff5393f1640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 0x7ff51c00b990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff52c002040 tx=0x7ff52c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2af9024bd86024c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c006d60 con 0x7ff51c004e30 2023-11-28T20:57:59.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c0039a0 con 0x7ff51c004e30 2023-11-28T20:57:59.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff52b7fe640 1 -- 172.21.15.167:0/2208035843 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c003d10 con 0x7ff51c004e30 2023-11-28T20:57:59.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff53ae54640 1 -- 172.21.15.167:0/2208035843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 msgr2=0x7ff51c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff53ae54640 1 --2- 172.21.15.167:0/2208035843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 0x7ff51c00b990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff52c002040 tx=0x7ff52c01c920 comp rx=0 tx=0).stop 2023-11-28T20:57:59.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff5393f1640 1 -- 172.21.15.167:0/2208035843 reap_dead start 2023-11-28T20:57:59.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff53ae54640 1 -- 172.21.15.167:0/2208035843 shutdown_connections 2023-11-28T20:57:59.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff53ae54640 1 -- 172.21.15.167:0/2208035843 >> 172.21.15.167:0/2208035843 conn(0x7ff5340cb1e0 msgr2=0x7ff5340cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:59.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff53ae54640 1 -- 172.21.15.167:0/2208035843 shutdown_connections 2023-11-28T20:57:59.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff53ae54640 1 -- 172.21.15.167:0/2208035843 wait complete. 2023-11-28T20:57:59.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff53ae54640 1 Processor -- start 2023-11-28T20:57:59.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.050+0000 7ff53ae54640 1 -- start start 2023-11-28T20:57:59.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 0x7ff53415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534157b30 0x7ff5341e6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5341f2f90 0x7ff5341f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53415abb0 con 0x7ff51c004e30 2023-11-28T20:57:59.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5341597b0 con 0x7ff5341f2f90 2023-11-28T20:57:59.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5341543d0 con 0x7ff534157b30 2023-11-28T20:57:59.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff52bfff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534157b30 msgr2=0x7ff5341e6630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff52bfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534157b30 0x7ff5341e6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff538bf0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 0x7ff53415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff538bf0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 0x7ff53415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49552/0 (socket says 172.21.15.167:49552) 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff538bf0640 1 -- 172.21.15.167:0/4272896094 learned_addr learned my addr 172.21.15.167:0/4272896094 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff5393f1640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5341f2f90 0x7ff5341f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff538bf0640 1 -- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534157b30 msgr2=0x7ff5341e6630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff538bf0640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff534157b30 0x7ff5341e6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff538bf0640 1 -- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5341f2f90 msgr2=0x7ff5341f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff538bf0640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5341f2f90 0x7ff5341f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff538bf0640 1 -- 172.21.15.167:0/4272896094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5341f3950 con 0x7ff51c004e30 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff538bf0640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 0x7ff53415a670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff53000b5a0 tx=0x7ff53000ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530003e60 con 0x7ff51c004e30 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff530005070 con 0x7ff51c004e30 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530005420 con 0x7ff51c004e30 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff534158ba0 con 0x7ff51c004e30 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff534159160 con 0x7ff51c004e30 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534159380 0x7ff53414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534074770 con 0x7ff534159380 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff52bfff640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534159380 0x7ff53414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff52bfff640 1 -- 172.21.15.167:0/4272896094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5340c3320 con 0x7ff534159380 2023-11-28T20:57:59.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff52bfff640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534159380 0x7ff53414b970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5340c36e0 tx=0x7ff524012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.054+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524014810 con 0x7ff534159380 2023-11-28T20:57:59.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff530005580 con 0x7ff51c004e30 2023-11-28T20:57:59.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5297fa640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff520066510 0x7ff5200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff530083e70 con 0x7ff51c004e30 2023-11-28T20:57:59.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff524014970 con 0x7ff534159380 2023-11-28T20:57:59.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534159380 msgr2=0x7ff53414b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5297fa640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534159380 0x7ff53414b970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5340c36e0 tx=0x7ff524012920 comp rx=0 tx=0).stop 2023-11-28T20:57:59.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534159380 msgr2=0x7ff53414b970 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:59.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5297fa640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534159380 0x7ff53414b970 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5340c36e0 tx=0x7ff524012920 comp rx=0 tx=0).stop 2023-11-28T20:57:59.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5393f1640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff520066510 0x7ff5200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.058+0000 7ff5393f1640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff520066510 0x7ff5200689d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0ac000 tx=0x7ff52c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.062+0000 7ff53ae54640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff53414beb0 0x7ff53414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.062+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534156d60 con 0x7ff53414beb0 2023-11-28T20:57:59.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.062+0000 7ff52bfff640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff53414beb0 0x7ff53414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.062+0000 7ff52bfff640 1 -- 172.21.15.167:0/4272896094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff534156a80 con 0x7ff53414beb0 2023-11-28T20:57:59.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff52bfff640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff53414beb0 0x7ff53414dd20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff5340c36e0 tx=0x7ff5240018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524024070 con 0x7ff53414beb0 2023-11-28T20:57:59.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5114 (secure 0 0 0) 0x7ff524016440 con 0x7ff53414beb0 2023-11-28T20:57:59.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff53414beb0 msgr2=0x7ff53414dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff5297fa640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff53414beb0 0x7ff53414dd20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff5340c36e0 tx=0x7ff5240018c0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff5297fa640 1 -- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff53414beb0 msgr2=0x7ff53414dd20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:59.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff5297fa640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff53414beb0 0x7ff53414dd20 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff5340c36e0 tx=0x7ff5240018c0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.065 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:57:59.065 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:59.065 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:59.066 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:57:59.066 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 150, 2023-11-28T20:57:59.066 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:57:59.066 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:57:59.066 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:57:59.066 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.066 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:57:59.066 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:59.067 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:59.068 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:59.069 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:59.069 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.069 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:57:59.069 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:57:59.069 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:57:59.069 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:57:59.069 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:57:59.069 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:59.070 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:59.071 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:59.072 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:57:59.073 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.074 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.075 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.076 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:57:59.077 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:59.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:59.079 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.080 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.081 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:57:59.082 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:57:59.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff520066510 msgr2=0x7ff5200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff53ae54640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff520066510 0x7ff5200689d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0ac000 tx=0x7ff52c009040 comp rx=0 tx=0).stop 2023-11-28T20:57:59.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 msgr2=0x7ff53415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff53ae54640 1 --2- 172.21.15.167:0/4272896094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff51c004e30 0x7ff53415a670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff53000b5a0 tx=0x7ff53000ba60 comp rx=0 tx=0).stop 2023-11-28T20:57:59.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff5393f1640 1 -- 172.21.15.167:0/4272896094 reap_dead start 2023-11-28T20:57:59.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff5393f1640 1 -- 172.21.15.167:0/4272896094 reap_dead start 2023-11-28T20:57:59.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 shutdown_connections 2023-11-28T20:57:59.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 >> 172.21.15.167:0/4272896094 conn(0x7ff5340cb1e0 msgr2=0x7ff5341547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:59.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 shutdown_connections 2023-11-28T20:57:59.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.066+0000 7ff53ae54640 1 -- 172.21.15.167:0/4272896094 wait complete. 2023-11-28T20:57:59.084 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:57:59.084 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:57:59.084 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:57:59.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.222+0000 7f6b0f11d640 1 Processor -- start 2023-11-28T20:57:59.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.222+0000 7f6b0f11d640 1 -- start start 2023-11-28T20:57:59.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0f11d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6b08150b40 0x7f6b08157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0f11d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b080c4510 0x7f6b0806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0f11d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080c48f0 con 0x7f6b080c6ff0 2023-11-28T20:57:59.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0f11d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b080c62f0 con 0x7f6b080c4510 2023-11-28T20:57:59.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0f11d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b080c6ac0 con 0x7f6b08150b40 2023-11-28T20:57:59.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0d6ba640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b080c4510 0x7f6b0806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0d6ba640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b080c4510 0x7f6b0806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49578/0 (socket says 172.21.15.167:49578) 2023-11-28T20:57:59.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0d6ba640 1 -- 172.21.15.167:0/3478726303 learned_addr learned my addr 172.21.15.167:0/3478726303 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:59.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0ceb9640 1 --2- 172.21.15.167:0/3478726303 >> v2:172.21.15.178:3300/0 conn(0x7f6b08150b40 0x7f6b08157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0d6ba640 1 -- 172.21.15.167:0/3478726303 >> v2:172.21.15.178:3300/0 conn(0x7f6b08150b40 msgr2=0x7f6b08157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:57:59.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0d6ba640 1 --2- 172.21.15.167:0/3478726303 >> v2:172.21.15.178:3300/0 conn(0x7f6b08150b40 0x7f6b08157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0d6ba640 1 -- 172.21.15.167:0/3478726303 >> v1:172.21.15.178:6789/0 conn(0x7f6b080c6ff0 legacy=0x7f6b080c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0d6ba640 1 -- 172.21.15.167:0/3478726303 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080c6500 con 0x7f6b080c4510 2023-11-28T20:57:59.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0ceb9640 1 --2- 172.21.15.167:0/3478726303 >> v2:172.21.15.178:3300/0 conn(0x7f6b08150b40 0x7f6b08157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:57:59.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.226+0000 7f6b0d6ba640 1 --2- 172.21.15.167:0/3478726303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c4510 0x7f6b0806a580 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6b080cc090 tx=0x7f6b0001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b0a83ae328e0fb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6aff7fe640 1 -- 172.21.15.167:0/3478726303 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b000a5770 con 0x7f6b080c4510 2023-11-28T20:57:59.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6aff7fe640 1 -- 172.21.15.167:0/3478726303 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000a58d0 con 0x7f6b080c4510 2023-11-28T20:57:59.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6aff7fe640 1 -- 172.21.15.167:0/3478726303 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b000a5c60 con 0x7f6b080c4510 2023-11-28T20:57:59.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 -- 172.21.15.167:0/3478726303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c4510 msgr2=0x7f6b0806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 --2- 172.21.15.167:0/3478726303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c4510 0x7f6b0806a580 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6b080cc090 tx=0x7f6b0001c9a0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 -- 172.21.15.167:0/3478726303 shutdown_connections 2023-11-28T20:57:59.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 --2- 172.21.15.167:0/3478726303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c4510 0x7f6b0806a580 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 --2- 172.21.15.167:0/3478726303 >> v2:172.21.15.178:3300/0 conn(0x7f6b08150b40 0x7f6b08157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 -- 172.21.15.167:0/3478726303 >> 172.21.15.167:0/3478726303 conn(0x7f6b080cb1e0 msgr2=0x7f6b080cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:59.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 -- 172.21.15.167:0/3478726303 shutdown_connections 2023-11-28T20:57:59.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 -- 172.21.15.167:0/3478726303 wait complete. 2023-11-28T20:57:59.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 Processor -- start 2023-11-28T20:57:59.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 -- start start 2023-11-28T20:57:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b080c4510 0x7f6b0814d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c6ff0 0x7f6b08160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08150b40 0x7f6b08153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0814d2e0 con 0x7f6b080c6ff0 2023-11-28T20:57:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0814e690 con 0x7f6b08150b40 2023-11-28T20:57:59.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.230+0000 7f6b0f11d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0814e970 con 0x7f6b080c4510 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0ceb9640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b080c4510 msgr2=0x7f6b0814d770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0ceb9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b080c4510 0x7f6b0814d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c6ff0 0x7f6b08160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c6ff0 0x7f6b08160640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49580/0 (socket says 172.21.15.167:49580) 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afffff640 1 -- 172.21.15.167:0/1444337268 learned_addr learned my addr 172.21.15.167:0/1444337268 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0d6ba640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08150b40 0x7f6b08153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afffff640 1 -- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b080c4510 msgr2=0x7f6b0814d770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afffff640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b080c4510 0x7f6b0814d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afffff640 1 -- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08150b40 msgr2=0x7f6b08153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afffff640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08150b40 0x7f6b08153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afffff640 1 -- 172.21.15.167:0/1444337268 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00009b30 con 0x7f6b080c6ff0 2023-11-28T20:57:59.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afffff640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c6ff0 0x7f6b08160640 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c450 tx=0x7f6af800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af80052d0 con 0x7f6b080c6ff0 2023-11-28T20:57:59.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8005450 con 0x7f6b080c6ff0 2023-11-28T20:57:59.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0814ec50 con 0x7f6b080c6ff0 2023-11-28T20:57:59.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8012870 con 0x7f6b080c6ff0 2023-11-28T20:57:59.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0814dcb0 con 0x7f6b080c6ff0 2023-11-28T20:57:59.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0f11d640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08153e90 0x7f6b081f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08074770 con 0x7f6b08153e90 2023-11-28T20:57:59.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0ceb9640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08153e90 0x7f6b081f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0ceb9640 1 -- 172.21.15.167:0/1444337268 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b08157040 con 0x7f6b08153e90 2023-11-28T20:57:59.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6af80129d0 con 0x7f6b080c6ff0 2023-11-28T20:57:59.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.234+0000 7f6b0ceb9640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08153e90 0x7f6b081f5830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400e740 tx=0x7f6b0400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6afd7fa640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6af4066420 0x7f6af40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6af8083ca0 con 0x7f6b080c6ff0 2023-11-28T20:57:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04004030 con 0x7f6b08153e90 2023-11-28T20:57:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f6b04004190 con 0x7f6b08153e90 2023-11-28T20:57:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6b0d6ba640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6af4066420 0x7f6af40688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08153e90 msgr2=0x7f6b081f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6afd7fa640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08153e90 0x7f6b081f5830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400e740 tx=0x7f6b0400ec00 comp rx=0 tx=0).stop 2023-11-28T20:57:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08153e90 msgr2=0x7f6b081f5830 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6afd7fa640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b08153e90 0x7f6b081f5830 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:57:59.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.238+0000 7f6b0d6ba640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6af4066420 0x7f6af40688e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6b000ae000 tx=0x7f6b000a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.242+0000 7f6b0f11d640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b081f5d70 0x7f6b081f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:57:59.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.242+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081f66c0 con 0x7f6b081f5d70 2023-11-28T20:57:59.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.242+0000 7f6b0ceb9640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b081f5d70 0x7f6b081f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:57:59.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.242+0000 7f6b0ceb9640 1 -- 172.21.15.167:0/1444337268 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6b080682c0 con 0x7f6b081f5d70 2023-11-28T20:57:59.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.242+0000 7f6b0ceb9640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b081f5d70 0x7f6b081f6180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400e740 tx=0x7f6b04004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:57:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04029070 con 0x7f6b081f5d70 2023-11-28T20:57:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4799 (secure 0 0 0) 0x7f6b04021040 con 0x7f6b081f5d70 2023-11-28T20:57:59.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b081f5d70 msgr2=0x7f6b081f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6afd7fa640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b081f5d70 0x7f6b081f6180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400e740 tx=0x7f6b04004740 comp rx=0 tx=0).stop 2023-11-28T20:57:59.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6afd7fa640 1 -- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b081f5d70 msgr2=0x7f6b081f6180 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:57:59.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6afd7fa640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b081f5d70 0x7f6b081f6180 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400e740 tx=0x7f6b04004740 comp rx=0 tx=0).stop 2023-11-28T20:57:59.245 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:57:59.245 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:59.245 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:59.245 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 150, 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:59.246 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:57:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.248 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:57:59.249 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:57:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:57:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:57:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:57:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:57:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:57:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:57:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:57:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:57:59.250 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:59.251 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.253 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:57:59.254 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.255 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:57:59.256 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.257 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.258 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:57:59.259 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:57:59.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6af4066420 msgr2=0x7f6af40688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0f11d640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6af4066420 0x7f6af40688e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6b000ae000 tx=0x7f6b000a7070 comp rx=0 tx=0).stop 2023-11-28T20:57:59.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c6ff0 msgr2=0x7f6b08160640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:57:59.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0f11d640 1 --2- 172.21.15.167:0/1444337268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b080c6ff0 0x7f6b08160640 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c450 tx=0x7f6af800c910 comp rx=0 tx=0).stop 2023-11-28T20:57:59.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0d6ba640 1 -- 172.21.15.167:0/1444337268 reap_dead start 2023-11-28T20:57:59.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0d6ba640 1 -- 172.21.15.167:0/1444337268 reap_dead start 2023-11-28T20:57:59.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 shutdown_connections 2023-11-28T20:57:59.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 >> 172.21.15.167:0/1444337268 conn(0x7f6b080cb1e0 msgr2=0x7f6b080706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:57:59.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 shutdown_connections 2023-11-28T20:57:59.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:57:59.246+0000 7f6b0f11d640 1 -- 172.21.15.167:0/1444337268 wait complete. 2023-11-28T20:57:59.263 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:57:59.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:58:14.748 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 11% (29/244) Updating files: 12% (30/244) Updating files: 13% (32/244) Updating files: 14% (35/244) Updating files: 15% (37/244) Updating files: 16% (40/244) Updating files: 17% (42/244) Updating files: 18% (44/244) Updating files: 19% (47/244) Updating files: 20% (49/244) Updating files: 21% (52/244) Updating files: 22% (54/244) Updating files: 23% (57/244) Updating files: 24% (59/244) Updating files: 25% (61/244) Updating files: 25% (62/244) Updating files: 26% (64/244) Updating files: 27% (66/244) Updating files: 28% (69/244) Updating files: 29% (71/244) Updating files: 30% (74/244) Updating files: 31% (76/244) Updating files: 32% (79/244) Updating files: 33% (81/244) Updating files: 34% (83/244) Updating files: 35% (86/244) Updating files: 36% (88/244) Updating files: 37% (91/244) Updating files: 38% (93/244) Updating files: 39% (96/244) Updating files: 40% (98/244) Updating files: 41% (101/244) Updating files: 42% (103/244) Updating files: 43% (105/244) Updating files: 44% (108/244) Updating files: 45% (110/244) Updating files: 46% (113/244) Updating files: 47% (115/244) Updating files: 47% (116/244) Updating files: 48% (118/244) Updating files: 49% (120/244) Updating files: 50% (122/244) Updating files: 51% (125/244) Updating files: 52% (127/244) Updating files: 53% (130/244) Updating files: 54% (132/244) Updating files: 55% (135/244) Updating files: 56% (137/244) Updating files: 57% (140/244) Updating files: 58% (142/244) Updating files: 59% (144/244) Updating files: 60% (147/244) Updating files: 61% (149/244) Updating files: 62% (152/244) Updating files: 63% (154/244) Updating files: 64% (157/244) Updating files: 65% (159/244) Updating files: 66% (162/244) Updating files: 67% (164/244) Updating files: 68% (166/244) Updating files: 69% (169/244) Updating files: 70% (171/244) Updating files: 71% (174/244) Updating files: 72% (176/244) Updating files: 73% (179/244) Updating files: 74% (181/244) Updating files: 75% (183/244) Updating files: 75% (185/244) Updating files: 76% (186/244) Updating files: 77% (188/244) Updating files: 78% (191/244) Updating files: 79% (193/244) Updating files: 80% (196/244) Updating files: 81% (198/244) Updating files: 82% (201/244) Updating files: 83% (203/244) Updating files: 84% (205/244) Updating files: 85% (208/244) Updating files: 86% (210/244) Updating files: 87% (213/244) Updating files: 88% (215/244) Updating files: 89% (218/244) Updating files: 90% (220/244) Updating files: 91% (223/244) Updating files: 92% (225/244) Updating files: 93% (227/244) Updating files: 94% (230/244) Updating files: 95% (232/244) Updating files: 96% (235/244) Updating files: 97% (237/244) Updating files: 98% (240/244) Updating files: 99% (242/244) Updating files: 100% (244/244) Updating files: 100% (244/244), done. 2023-11-28T20:58:16.541 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 877cacbbdbb v0.36 2023-11-28T20:58:16.543 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.36 2023-11-28T20:58:16.587 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 37 -eq 48 ] 2023-11-28T20:58:16.588 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.37 2023-11-28T20:58:16.588 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.37 2023-11-28T20:58:16.589 INFO:tasks.workunit.client.0.smithi167.stdout:v0.37 2023-11-28T20:58:16.589 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.37 2023-11-28T20:58:19.263 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:58:19.264 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2023-11-28T20:58:19.264 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T20:58:19.264 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T20:58:19.267 INFO:tasks.ceph.mon.c:Started 2023-11-28T20:58:19.267 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:58:19.267 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:58:19.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.422+0000 7f97d670f640 1 Processor -- start 2023-11-28T20:58:19.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.422+0000 7f97d670f640 1 -- start start 2023-11-28T20:58:19.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d670f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 0x7f97d00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:19.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d670f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d0157970 con 0x7f97d0150b40 2023-11-28T20:58:19.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d670f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d00c6ac0 con 0x7f97d00c6ff0 2023-11-28T20:58:19.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d670f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00c62f0 con 0x7f97d0157560 2023-11-28T20:58:19.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97cffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f97d0150b40 0x7f97d00c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:60476/0 (socket says 172.21.15.167:60476) 2023-11-28T20:58:19.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97cffff640 1 -- 172.21.15.167:0/1616661799 learned_addr learned my addr 172.21.15.167:0/1616661799 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:58:19.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97cf7fe640 1 --1- 172.21.15.167:0/1616661799 >> v1:172.21.15.178:6789/0 conn(0x7f97d00c6ff0 0x7f97d006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:45656/0 (socket says 172.21.15.167:45656) 2023-11-28T20:58:19.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 0x7f97d00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 -- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 msgr2=0x7f97d00c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 -- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 msgr2=0x7f97d00c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 0x7f97d00c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 0x7f97d00c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906245291 0 0) 0x7f97d0157970 con 0x7f97d0150b40 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b8003530 con 0x7f97d0150b40 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037040479 0 0) 0x7f97d00c6ac0 con 0x7f97d00c6ff0 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d0157970 con 0x7f97d00c6ff0 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1367290808 0 0) 0x7f97b8003530 con 0x7f97d0150b40 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 msgr2=0x7f97d00c4510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:19.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 0x7f97d00c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 >> v1:172.21.15.178:6789/0 conn(0x7f97d00c6ff0 legacy=0x7f97d006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00c6500 con 0x7f97d0150b40 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f97c00016a0 con 0x7f97d0150b40 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 >> v1:172.21.15.167:6789/0 conn(0x7f97d0150b40 legacy=0x7f97d00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 0x7f97b8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97b80040f0 0x7f97b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b8004d10 0x7f97b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00c62f0 con 0x7f97b8004d10 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b800bb80 con 0x7f97b80040f0 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b800bd40 con 0x7f97d0157560 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b8004d10 0x7f97b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97cf7fe640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97b80040f0 0x7f97b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:19.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97cffff640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 0x7f97b8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:19.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 -- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 msgr2=0x7f97b8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:19.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0157560 0x7f97b8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 -- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97b80040f0 msgr2=0x7f97b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:19.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97b80040f0 0x7f97b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.426+0000 7f97d4cac640 1 -- 172.21.15.167:0/1616661799 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b8003530 con 0x7f97b8004d10 2023-11-28T20:58:19.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97d4cac640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b8004d10 0x7f97b8005190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009fd0 tx=0x7f97c801ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671f1e25bb6d995c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:19.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c80a5d00 con 0x7f97b8004d10 2023-11-28T20:58:19.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c80a5e60 con 0x7f97b8004d10 2023-11-28T20:58:19.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97ceffd640 1 -- 172.21.15.167:0/1616661799 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c80ad680 con 0x7f97b8004d10 2023-11-28T20:58:19.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97d670f640 1 -- 172.21.15.167:0/1616661799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b8004d10 msgr2=0x7f97b8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:19.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97d670f640 1 --2- 172.21.15.167:0/1616661799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b8004d10 0x7f97b8005190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f97c8009fd0 tx=0x7f97c801ce00 comp rx=0 tx=0).stop 2023-11-28T20:58:19.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97d4cac640 1 -- 172.21.15.167:0/1616661799 reap_dead start 2023-11-28T20:58:19.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97d670f640 1 -- 172.21.15.167:0/1616661799 shutdown_connections 2023-11-28T20:58:19.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97d670f640 1 -- 172.21.15.167:0/1616661799 >> 172.21.15.167:0/1616661799 conn(0x7f97d00cb1e0 msgr2=0x7f97d00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:19.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97d670f640 1 -- 172.21.15.167:0/1616661799 shutdown_connections 2023-11-28T20:58:19.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.430+0000 7f97d670f640 1 -- 172.21.15.167:0/1616661799 wait complete. 2023-11-28T20:58:19.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 Processor -- start 2023-11-28T20:58:19.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 -- start start 2023-11-28T20:58:19.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97b8004d10 0x7f97d01471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:19.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97d01482a0 0x7f97d00c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:19.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0146300 0x7f97d0146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:19.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d013d430 con 0x7f97d01482a0 2023-11-28T20:58:19.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d0152270 con 0x7f97b8004d10 2023-11-28T20:58:19.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d0145e70 con 0x7f97d0146300 2023-11-28T20:58:19.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97d01482a0 0x7f97d00c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:19.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97d01482a0 0x7f97d00c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45662/0 (socket says 172.21.15.167:45662) 2023-11-28T20:58:19.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cf7fe640 1 -- 172.21.15.167:0/4252372210 learned_addr learned my addr 172.21.15.167:0/4252372210 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:19.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cffff640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97b8004d10 0x7f97d01471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:19.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d4cac640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0146300 0x7f97d0146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:19.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d4cac640 1 -- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0146300 msgr2=0x7f97d0146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:58:19.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d4cac640 1 -- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0146300 msgr2=0x7f97d0146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d4cac640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0146300 0x7f97d0146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cf7fe640 1 -- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0146300 msgr2=0x7f97d0146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d4cac640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0146300 0x7f97d0146780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cf7fe640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0146300 0x7f97d0146780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cf7fe640 1 -- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97b8004d10 msgr2=0x7f97d01471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cf7fe640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97b8004d10 0x7f97d01471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cf7fe640 1 -- 172.21.15.167:0/4252372210 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d0152620 con 0x7f97d01482a0 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97cf7fe640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97d01482a0 0x7f97d00c7ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f97c4001670 tx=0x7f97c4001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97ccff9640 1 -- 172.21.15.167:0/4252372210 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40049d0 con 0x7f97d01482a0 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97ccff9640 1 -- 172.21.15.167:0/4252372210 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c400f750 con 0x7f97d01482a0 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d0146cc0 con 0x7f97d01482a0 2023-11-28T20:58:19.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97ccff9640 1 -- 172.21.15.167:0/4252372210 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400fb00 con 0x7f97d01482a0 2023-11-28T20:58:19.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d013d900 con 0x7f97d01482a0 2023-11-28T20:58:19.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.434+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d00682c0 con 0x7f97d01482a0 2023-11-28T20:58:19.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.438+0000 7f97ccff9640 1 -- 172.21.15.167:0/4252372210 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97c400fc60 con 0x7f97d01482a0 2023-11-28T20:58:19.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.438+0000 7f97ccff9640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97bc0664a0 0x7f97bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:19.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.438+0000 7f97ccff9640 1 -- 172.21.15.167:0/4252372210 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f97c4084390 con 0x7f97d01482a0 2023-11-28T20:58:19.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.438+0000 7f97cffff640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97bc0664a0 0x7f97bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:19.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.438+0000 7f97cffff640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97bc0664a0 0x7f97bc068960 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f97c0001ec0 tx=0x7f97c0000ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:19.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.442+0000 7f97ccff9640 1 -- 172.21.15.167:0/4252372210 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97c40512f0 con 0x7f97d01482a0 2023-11-28T20:58:19.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.646+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f97d0145fe0 con 0x7f97d01482a0 2023-11-28T20:58:19.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.646+0000 7f97ccff9640 1 -- 172.21.15.167:0/4252372210 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f97c4054910 con 0x7f97d01482a0 2023-11-28T20:58:19.646 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":150,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:58:19.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97bc0664a0 msgr2=0x7f97bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:19.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97bc0664a0 0x7f97bc068960 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f97c0001ec0 tx=0x7f97c0000ee0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97d01482a0 msgr2=0x7f97d00c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:19.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97d01482a0 0x7f97d00c7ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f97c4001670 tx=0x7f97c4001a70 comp rx=0 tx=0).stop 2023-11-28T20:58:19.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 shutdown_connections 2023-11-28T20:58:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97bc0664a0 0x7f97bc068960 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97d0146300 0x7f97d0146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97d01482a0 0x7f97d00c7ed0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 --2- 172.21.15.167:0/4252372210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97b8004d10 0x7f97d01471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 >> 172.21.15.167:0/4252372210 conn(0x7f97d00cb1e0 msgr2=0x7f97d0155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 shutdown_connections 2023-11-28T20:58:19.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:19.650+0000 7f97d670f640 1 -- 172.21.15.167:0/4252372210 wait complete. 2023-11-28T20:58:21.802 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:21.806 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:22.670 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:58:22.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.810+0000 7f3bb9193640 1 Processor -- start 2023-11-28T20:58:22.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.810+0000 7f3bb9193640 1 -- start start 2023-11-28T20:58:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb9193640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40ccb70 0x7f3bb415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb9193640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3bb40cf440 0x7f3bb40cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb9193640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb40cfef0 con 0x7f3bb4153db0 2023-11-28T20:58:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb9193640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40cc6e0 con 0x7f3bb40cf440 2023-11-28T20:58:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb9193640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4154190 con 0x7f3bb40ccb70 2023-11-28T20:58:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb8992640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3bb40cf440 0x7f3bb40cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:22.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb8992640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3bb40cf440 0x7f3bb40cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45672/0 (socket says 172.21.15.167:45672) 2023-11-28T20:58:22.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb8992640 1 -- 172.21.15.167:0/2563504854 learned_addr learned my addr 172.21.15.167:0/2563504854 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:22.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3babfff640 1 --2- 172.21.15.167:0/2563504854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40ccb70 0x7f3bb415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:22.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb8992640 1 -- 172.21.15.167:0/2563504854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40ccb70 msgr2=0x7f3bb415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:22.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb8992640 1 --2- 172.21.15.167:0/2563504854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40ccb70 0x7f3bb415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:22.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb8992640 1 -- 172.21.15.167:0/2563504854 >> v1:172.21.15.178:6789/0 conn(0x7f3bb4153db0 legacy=0x7f3bb40c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:22.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.814+0000 7f3bb8992640 1 -- 172.21.15.167:0/2563504854 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40cbad0 con 0x7f3bb40cf440 2023-11-28T20:58:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb8992640 1 --2- 172.21.15.167:0/2563504854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40cf440 0x7f3bb40cf8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009e50 tx=0x7f3bac01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373783fd5e979bb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb37fe640 1 -- 172.21.15.167:0/2563504854 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0a57d0 con 0x7f3bb40cf440 2023-11-28T20:58:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb37fe640 1 -- 172.21.15.167:0/2563504854 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0a5930 con 0x7f3bb40cf440 2023-11-28T20:58:22.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb37fe640 1 -- 172.21.15.167:0/2563504854 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0a5cc0 con 0x7f3bb40cf440 2023-11-28T20:58:22.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 -- 172.21.15.167:0/2563504854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40cf440 msgr2=0x7f3bb40cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:22.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 --2- 172.21.15.167:0/2563504854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40cf440 0x7f3bb40cf8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009e50 tx=0x7f3bac01ca10 comp rx=0 tx=0).stop 2023-11-28T20:58:22.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 -- 172.21.15.167:0/2563504854 shutdown_connections 2023-11-28T20:58:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 --2- 172.21.15.167:0/2563504854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40cf440 0x7f3bb40cf8f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 --2- 172.21.15.167:0/2563504854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40ccb70 0x7f3bb415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 -- 172.21.15.167:0/2563504854 >> 172.21.15.167:0/2563504854 conn(0x7f3bb406b800 msgr2=0x7f3bb406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 -- 172.21.15.167:0/2563504854 shutdown_connections 2023-11-28T20:58:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 -- 172.21.15.167:0/2563504854 wait complete. 2023-11-28T20:58:22.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 Processor -- start 2023-11-28T20:58:22.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.818+0000 7f3bb9193640 1 -- start start 2023-11-28T20:58:22.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb9193640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40ccb70 0x7f3bb4142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb9193640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40cf440 0x7f3bb40ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb9193640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb4153db0 0x7f3bb41592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb9193640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41584a0 con 0x7f3bb40ccb70 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb9193640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41434f0 con 0x7f3bb4153db0 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb9193640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40ce750 con 0x7f3bb40cf440 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40ccb70 0x7f3bb4142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40ccb70 0x7f3bb4142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50372/0 (socket says 172.21.15.167:50372) 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3babfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40cf440 0x7f3bb40ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb3fff640 1 -- 172.21.15.167:0/1811494947 learned_addr learned my addr 172.21.15.167:0/1811494947 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb8992640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb4153db0 0x7f3bb41592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3babfff640 1 -- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40cf440 msgr2=0x7f3bb40ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:58:22.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3babfff640 1 -- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40cf440 msgr2=0x7f3bb40ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:58:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3babfff640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40cf440 0x7f3bb40ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3babfff640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40cf440 0x7f3bb40ce210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb3fff640 1 -- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40cf440 msgr2=0x7f3bb40ce210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:58:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb3fff640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40cf440 0x7f3bb40ce210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb3fff640 1 -- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb4153db0 msgr2=0x7f3bb41592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb3fff640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb4153db0 0x7f3bb41592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb3fff640 1 -- 172.21.15.167:0/1811494947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009b30 con 0x7f3bb40ccb70 2023-11-28T20:58:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb3fff640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40ccb70 0x7f3bb4142fb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c3f0 tx=0x7f3ba400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb17fa640 1 -- 172.21.15.167:0/1811494947 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40052d0 con 0x7f3bb40ccb70 2023-11-28T20:58:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb17fa640 1 -- 172.21.15.167:0/1811494947 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba4005430 con 0x7f3bb40ccb70 2023-11-28T20:58:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb17fa640 1 -- 172.21.15.167:0/1811494947 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4003840 con 0x7f3bb40ccb70 2023-11-28T20:58:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb4158d80 con 0x7f3bb40ccb70 2023-11-28T20:58:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb40b3ad0 con 0x7f3bb40ccb70 2023-11-28T20:58:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb415a850 con 0x7f3bb40ccb70 2023-11-28T20:58:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.822+0000 7f3bb17fa640 1 -- 172.21.15.167:0/1811494947 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ba40039a0 con 0x7f3bb40ccb70 2023-11-28T20:58:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.826+0000 7f3bb17fa640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b94066470 0x7f3b94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.826+0000 7f3bb17fa640 1 -- 172.21.15.167:0/1811494947 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3ba4083530 con 0x7f3bb40ccb70 2023-11-28T20:58:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.826+0000 7f3babfff640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b94066470 0x7f3b94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.826+0000 7f3babfff640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b94066470 0x7f3b94068930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3bb414fdb0 tx=0x7f3b9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:22.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:22.830+0000 7f3bb17fa640 1 -- 172.21.15.167:0/1811494947 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ba4050670 con 0x7f3bb40ccb70 2023-11-28T20:58:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3bb4158d80 con 0x7f3bb40ccb70 2023-11-28T20:58:23.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb17fa640 1 -- 172.21.15.167:0/1811494947 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f3ba4017620 con 0x7f3bb40ccb70 2023-11-28T20:58:23.041 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":152,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:58:23.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b94066470 msgr2=0x7f3b94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b94066470 0x7f3b94068930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3bb414fdb0 tx=0x7f3b9c008040 comp rx=0 tx=0).stop 2023-11-28T20:58:23.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40ccb70 msgr2=0x7f3bb4142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40ccb70 0x7f3bb4142fb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c3f0 tx=0x7f3ba400c8b0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 shutdown_connections 2023-11-28T20:58:23.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3b94066470 0x7f3b94068930 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb4153db0 0x7f3bb41592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb40cf440 0x7f3bb40ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 --2- 172.21.15.167:0/1811494947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb40ccb70 0x7f3bb4142fb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 >> 172.21.15.167:0/1811494947 conn(0x7f3bb406b800 msgr2=0x7f3bb4150020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 shutdown_connections 2023-11-28T20:58:23.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.042+0000 7f3bb9193640 1 -- 172.21.15.167:0/1811494947 wait complete. 2023-11-28T20:58:23.062 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:58:23.062 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:58:23.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:58:23.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d1ae79640 1 Processor -- start 2023-11-28T20:58:23.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d1ae79640 1 -- start start 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d1ae79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 0x7f1d140c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d1ae79640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d1406a580 0x7f1d1406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d1ae79640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1415b220 con 0x7f1d14151f60 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d1ae79640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d140c4da0 con 0x7f1d1406a580 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d1ae79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d140c2df0 con 0x7f1d140c75c0 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d18c15640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1d14151f60 0x7f1d140c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56188/0 (socket says 172.21.15.167:56188) 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d18c15640 1 -- 172.21.15.167:0/3280138104 learned_addr learned my addr 172.21.15.167:0/3280138104 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d19416640 1 --2- 172.21.15.167:0/3280138104 >> v2:172.21.15.178:3300/0 conn(0x7f1d1406a580 0x7f1d1406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 0x7f1d140c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077430238 0 0) 0x7f1d1415b220 con 0x7f1d14151f60 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cfc003530 con 0x7f1d14151f60 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0bfff640 1 -- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 msgr2=0x7f1d140c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0bfff640 1 -- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 msgr2=0x7f1d140c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 0x7f1d140c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 0x7f1d140c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3793054018 0 0) 0x7f1cfc003530 con 0x7f1d14151f60 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 msgr2=0x7f1d140c5c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 0x7f1d140c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 >> v2:172.21.15.178:3300/0 conn(0x7f1d1406a580 msgr2=0x7f1d1406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 --2- 172.21.15.167:0/3280138104 >> v2:172.21.15.178:3300/0 conn(0x7f1d1406a580 0x7f1d1406a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d140c7a20 con 0x7f1d14151f60 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f1d10001680 con 0x7f1d14151f60 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 >> v1:172.21.15.167:6789/0 conn(0x7f1d14151f60 legacy=0x7f1d140c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 0x7f1cfc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cfc003f30 0x7f1cfc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 0x7f1cfc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d140c2df0 con 0x7f1cfc004d10 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc00ba40 con 0x7f1cfc003f30 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.202+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc00bc00 con 0x7f1d140c75c0 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d19416640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 0x7f1cfc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cfc003f30 0x7f1cfc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d18c15640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 0x7f1cfc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d19416640 1 -- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 msgr2=0x7f1cfc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d19416640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d140c75c0 0x7f1cfc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d19416640 1 -- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cfc003f30 msgr2=0x7f1cfc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d19416640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cfc003f30 0x7f1cfc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d19416640 1 -- 172.21.15.167:0/3280138104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc003530 con 0x7f1cfc004d10 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d19416640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 0x7f1cfc005190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009fc0 tx=0x7f1d0c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ec1ebab7fcb19b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0a5bb0 con 0x7f1cfc004d10 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c00f040 con 0x7f1cfc004d10 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.206+0000 7f1d0b7fe640 1 -- 172.21.15.167:0/3280138104 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0ad440 con 0x7f1cfc004d10 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 -- 172.21.15.167:0/3280138104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 msgr2=0x7f1cfc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 --2- 172.21.15.167:0/3280138104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 0x7f1cfc005190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009fc0 tx=0x7f1d0c01cca0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d19416640 1 -- 172.21.15.167:0/3280138104 reap_dead start 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 -- 172.21.15.167:0/3280138104 shutdown_connections 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 -- 172.21.15.167:0/3280138104 >> 172.21.15.167:0/3280138104 conn(0x7f1d140cb1e0 msgr2=0x7f1d140cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:23.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 -- 172.21.15.167:0/3280138104 shutdown_connections 2023-11-28T20:58:23.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 -- 172.21.15.167:0/3280138104 wait complete. 2023-11-28T20:58:23.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 Processor -- start 2023-11-28T20:58:23.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 -- start start 2023-11-28T20:58:23.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 0x7f1d14152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d14150f50 0x7f1d141564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d141ef5e0 0x7f1d141efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d141f3650 con 0x7f1cfc004d10 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d141f3a70 con 0x7f1d14150f50 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d1ae79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14152620 con 0x7f1d141ef5e0 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d18c15640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 0x7f1d14152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d18c15640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 0x7f1d14152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50386/0 (socket says 172.21.15.167:50386) 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d18c15640 1 -- 172.21.15.167:0/1536957059 learned_addr learned my addr 172.21.15.167:0/1536957059 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d19416640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d141ef5e0 0x7f1d141efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d14150f50 0x7f1d141564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d19416640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d141ef5e0 msgr2=0x7f1d141efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d19416640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d141ef5e0 msgr2=0x7f1d141efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d19416640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d141ef5e0 0x7f1d141efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:23.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d19416640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d141ef5e0 0x7f1d141efa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d18c15640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d141ef5e0 msgr2=0x7f1d141efa70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d18c15640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d141ef5e0 0x7f1d141efa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d18c15640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d14150f50 msgr2=0x7f1d141564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d18c15640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d14150f50 0x7f1d141564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d18c15640 1 -- 172.21.15.167:0/1536957059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d14153580 con 0x7f1cfc004d10 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.210+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d14150f50 0x7f1d141564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d18c15640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 0x7f1d14152a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1d10012800 tx=0x7f1d10012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10005780 con 0x7f1cfc004d10 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d10010940 con 0x7f1cfc004d10 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d141f2cf0 con 0x7f1cfc004d10 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10010cf0 con 0x7f1cfc004d10 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d141f2f90 con 0x7f1cfc004d10 2023-11-28T20:58:23.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d1ae79640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d14147ae0 0x7f1d14147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14074770 con 0x7f1d14147ae0 2023-11-28T20:58:23.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d14147ae0 0x7f1d14147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d0bfff640 1 -- 172.21.15.167:0/1536957059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d1406ecb0 con 0x7f1d14147ae0 2023-11-28T20:58:23.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d14147ae0 0x7f1d14147f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d140c60f0 tx=0x7f1d04012ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04010980 con 0x7f1d14147ae0 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d10016480 con 0x7f1cfc004d10 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d00066510 0x7f1d000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1d10087680 con 0x7f1cfc004d10 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1d04010ae0 con 0x7f1d14147ae0 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d14147ae0 msgr2=0x7f1d14147f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d14147ae0 0x7f1d14147f00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d140c60f0 tx=0x7f1d04012ad0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d14147ae0 msgr2=0x7f1d14147f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d097fa640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d14147ae0 0x7f1d14147f00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.214+0000 7f1d19416640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d00066510 0x7f1d000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.218+0000 7f1d19416640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d00066510 0x7f1d000689d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1d14155790 tx=0x7f1d0c004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d141f31b0 0x7f1d141fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14158750 con 0x7f1d141f31b0 2023-11-28T20:58:23.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d141f31b0 0x7f1d141fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d0bfff640 1 -- 172.21.15.167:0/1536957059 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1d14152340 con 0x7f1d141f31b0 2023-11-28T20:58:23.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d0bfff640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d141f31b0 0x7f1d141fbe90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d140c60f0 tx=0x7f1d04004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04022040 con 0x7f1d141f31b0 2023-11-28T20:58:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5125 (secure 0 0 0) 0x7f1d0402d410 con 0x7f1d141f31b0 2023-11-28T20:58:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d141f31b0 msgr2=0x7f1d141fbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d097fa640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d141f31b0 0x7f1d141fbe90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d140c60f0 tx=0x7f1d04004740 comp rx=0 tx=0).stop 2023-11-28T20:58:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d097fa640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d141f31b0 msgr2=0x7f1d141fbe90 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:23.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d097fa640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d141f31b0 0x7f1d141fbe90 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d140c60f0 tx=0x7f1d04004740 comp rx=0 tx=0).stop 2023-11-28T20:58:23.223 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:58:23.223 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:23.223 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:23.223 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 152, 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:23.224 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:23.225 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.226 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:58:23.227 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:58:23.228 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:58:23.229 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:23.229 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:58:23.229 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:23.229 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:23.229 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:23.229 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:23.229 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:23.229 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:23.229 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:23.230 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:23.230 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:23.230 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:23.230 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.230 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:58:23.230 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.230 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:58:23.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.230 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:23.231 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:23.231 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:23.231 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:23.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.231 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:23.232 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.233 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.235 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.236 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:58:23.236 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:58:23.236 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:23.236 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:23.236 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:23.236 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.236 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.236 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:58:23.237 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.238 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:23.239 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.239 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.239 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:23.239 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.239 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:58:23.239 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:58:23.240 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d00066510 msgr2=0x7f1d000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1d00066510 0x7f1d000689d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1d14155790 tx=0x7f1d0c004ac0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 msgr2=0x7f1d14152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 --2- 172.21.15.167:0/1536957059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cfc004d10 0x7f1d14152a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1d10012800 tx=0x7f1d10012cc0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d19416640 1 -- 172.21.15.167:0/1536957059 reap_dead start 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d19416640 1 -- 172.21.15.167:0/1536957059 reap_dead start 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 shutdown_connections 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 >> 172.21.15.167:0/1536957059 conn(0x7f1d140cb1e0 msgr2=0x7f1d14157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 shutdown_connections 2023-11-28T20:58:23.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.222+0000 7f1d1ae79640 1 -- 172.21.15.167:0/1536957059 wait complete. 2023-11-28T20:58:23.243 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:58:23.243 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:58:23.243 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:58:23.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.382+0000 7f934c9a7640 1 Processor -- start 2023-11-28T20:58:23.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.382+0000 7f934c9a7640 1 -- start start 2023-11-28T20:58:23.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.382+0000 7f934c9a7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 0x7f9348070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.382+0000 7f934c9a7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934806d900 con 0x7f9348159900 2023-11-28T20:58:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.382+0000 7f934c9a7640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93480714b0 con 0x7f93480c6770 2023-11-28T20:58:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.382+0000 7f934c9a7640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934806db50 con 0x7f934815a1c0 2023-11-28T20:58:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93477fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9348159900 0x7f934806e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56192/0 (socket says 172.21.15.167:56192) 2023-11-28T20:58:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93477fe640 1 -- 172.21.15.167:0/4178458261 learned_addr learned my addr 172.21.15.167:0/4178458261 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:58:23.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 0x7f9348070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 -- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 msgr2=0x7f9348070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:58:23.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 -- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 msgr2=0x7f9348070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:23.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 0x7f9348070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:23.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 0x7f9348070e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:23.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234035866 0 0) 0x7f934806d900 con 0x7f9348159900 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9330003530 con 0x7f9348159900 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748529467 0 0) 0x7f93480714b0 con 0x7f93480c6770 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f934806d900 con 0x7f93480c6770 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2098612354 0 0) 0x7f9330003530 con 0x7f9348159900 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 msgr2=0x7f9348070e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 0x7f9348070e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 >> v1:172.21.15.178:6789/0 conn(0x7f93480c6770 legacy=0x7f934814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934806de30 con 0x7f9348159900 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9338001680 con 0x7f9348159900 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 >> v1:172.21.15.167:6789/0 conn(0x7f9348159900 legacy=0x7f934806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9330003b40 0x7f9330003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93300047d0 0x7f9330004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 0x7f93300051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934806db50 con 0x7f93300047d0 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9330005b40 con 0x7f9330003b40 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9330005d00 con 0x7f934815a1c0 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93300047d0 0x7f9330004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93477fe640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9330003b40 0x7f9330003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9347fff640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 0x7f93300051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 -- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 msgr2=0x7f93300051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f934815a1c0 0x7f93300051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 -- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9330003b40 msgr2=0x7f9330003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9330003b40 0x7f9330003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f9346ffd640 1 -- 172.21.15.167:0/4178458261 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9330003530 con 0x7f93300047d0 2023-11-28T20:58:23.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.386+0000 7f93477fe640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9330003b40 0x7f9330003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:58:23.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f9346ffd640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93300047d0 0x7f9330004c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f933c00c820 tx=0x7f933c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd5566a76e64825 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0a9400 con 0x7f93300047d0 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c0a9560 con 0x7f93300047d0 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f93467fc640 1 -- 172.21.15.167:0/4178458261 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0a9910 con 0x7f93300047d0 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f934c9a7640 1 -- 172.21.15.167:0/4178458261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93300047d0 msgr2=0x7f9330004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f934c9a7640 1 --2- 172.21.15.167:0/4178458261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93300047d0 0x7f9330004c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f933c00c820 tx=0x7f933c01c4f0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f9347fff640 1 -- 172.21.15.167:0/4178458261 reap_dead start 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f934c9a7640 1 -- 172.21.15.167:0/4178458261 shutdown_connections 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f934c9a7640 1 -- 172.21.15.167:0/4178458261 >> 172.21.15.167:0/4178458261 conn(0x7f93480cb3f0 msgr2=0x7f93480cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f934c9a7640 1 -- 172.21.15.167:0/4178458261 shutdown_connections 2023-11-28T20:58:23.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f934c9a7640 1 -- 172.21.15.167:0/4178458261 wait complete. 2023-11-28T20:58:23.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f934c9a7640 1 Processor -- start 2023-11-28T20:58:23.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.390+0000 7f934c9a7640 1 -- start start 2023-11-28T20:58:23.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93300047d0 0x7f93481eba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481535b0 0x7f934814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93481df580 0x7f934814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481547d0 con 0x7f93481df580 2023-11-28T20:58:23.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481528c0 con 0x7f93481535b0 2023-11-28T20:58:23.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93481ebf40 con 0x7f93300047d0 2023-11-28T20:58:23.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9347fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93481df580 0x7f934814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9347fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93481df580 0x7f934814bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50420/0 (socket says 172.21.15.167:50420) 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9347fff640 1 -- 172.21.15.167:0/2823054678 learned_addr learned my addr 172.21.15.167:0/2823054678 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f93477fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93300047d0 0x7f93481eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9346ffd640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481535b0 0x7f934814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f93477fe640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93300047d0 msgr2=0x7f93481eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f93477fe640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93300047d0 msgr2=0x7f93481eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f93477fe640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93300047d0 0x7f93481eba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f93477fe640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93300047d0 0x7f93481eba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9347fff640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93300047d0 msgr2=0x7f93481eba00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9347fff640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93300047d0 0x7f93481eba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9347fff640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481535b0 msgr2=0x7f934814ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9347fff640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481535b0 0x7f934814ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9347fff640 1 -- 172.21.15.167:0/2823054678 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9348153120 con 0x7f93481df580 2023-11-28T20:58:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9346ffd640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481535b0 0x7f934814ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:58:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f9347fff640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93481df580 0x7f934814bb80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9348072ca0 tx=0x7f9340011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934000fbd0 con 0x7f93481df580 2023-11-28T20:58:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934000fd30 con 0x7f93481df580 2023-11-28T20:58:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340015650 con 0x7f93481df580 2023-11-28T20:58:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934814e310 con 0x7f93481df580 2023-11-28T20:58:23.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9348154230 con 0x7f93481df580 2023-11-28T20:58:23.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9348152a30 0x7f934814c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348074740 con 0x7f9348152a30 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f93477fe640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9348152a30 0x7f934814c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f93477fe640 1 -- 172.21.15.167:0/2823054678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93480680b0 con 0x7f9348152a30 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93400157b0 con 0x7f93481df580 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.394+0000 7f93477fe640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9348152a30 0x7f934814c0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9338000c10 tx=0x7f9338010c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f932ffff640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9334066470 0x7f9334068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9340087730 con 0x7f93481df580 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800e960 con 0x7f9348152a30 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f9346ffd640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9334066470 0x7f9334068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9338001640 con 0x7f9348152a30 2023-11-28T20:58:23.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9348152a30 msgr2=0x7f934814c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f932ffff640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9348152a30 0x7f934814c0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9338000c10 tx=0x7f9338010c10 comp rx=0 tx=0).stop 2023-11-28T20:58:23.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9348152a30 msgr2=0x7f934814c0c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:23.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f932ffff640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9348152a30 0x7f934814c0c0 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9338000c10 tx=0x7f9338010c10 comp rx=0 tx=0).stop 2023-11-28T20:58:23.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.398+0000 7f9346ffd640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9334066470 0x7f9334068930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f933c0ae000 tx=0x7f933c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.402+0000 7f934c9a7640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481ee4f0 0x7f93481ee900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.402+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934806e3f0 con 0x7f93481ee4f0 2023-11-28T20:58:23.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.402+0000 7f93477fe640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481ee4f0 0x7f93481ee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f93477fe640 1 -- 172.21.15.167:0/2823054678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9348067c40 con 0x7f93481ee4f0 2023-11-28T20:58:23.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f93477fe640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481ee4f0 0x7f93481ee900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9338019000 tx=0x7f9338001990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338014c20 con 0x7f93481ee4f0 2023-11-28T20:58:23.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4810 (secure 0 0 0) 0x7f9338014d80 con 0x7f93481ee4f0 2023-11-28T20:58:23.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481ee4f0 msgr2=0x7f93481ee900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f932ffff640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481ee4f0 0x7f93481ee900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9338019000 tx=0x7f9338001990 comp rx=0 tx=0).stop 2023-11-28T20:58:23.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f932ffff640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481ee4f0 msgr2=0x7f93481ee900 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:23.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f932ffff640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93481ee4f0 0x7f93481ee900 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9338019000 tx=0x7f9338001990 comp rx=0 tx=0).stop 2023-11-28T20:58:23.406 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:58:23.406 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:23.406 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:23.406 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:58:23.406 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 152, 2023-11-28T20:58:23.406 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:58:23.406 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:58:23.406 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:23.408 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:58:23.409 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:58:23.410 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:58:23.410 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:23.410 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:23.410 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:58:23.410 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:58:23.410 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:58:23.410 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:58:23.410 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:58:23.410 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:58:23.411 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:58:23.411 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:23.411 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:58:23.411 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:23.411 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:23.411 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:23.411 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:23.411 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:23.411 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:23.412 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:23.413 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:23.413 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:23.413 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:23.413 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.413 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:58:23.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.413 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:58:23.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.413 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:58:23.414 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:23.415 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.416 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:23.417 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:58:23.418 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:23.419 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:23.420 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:23.421 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:58:23.422 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:58:23.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9334066470 msgr2=0x7f9334068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f934c9a7640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9334066470 0x7f9334068930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f933c0ae000 tx=0x7f933c0b3040 comp rx=0 tx=0).stop 2023-11-28T20:58:23.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93481df580 msgr2=0x7f934814bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f934c9a7640 1 --2- 172.21.15.167:0/2823054678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93481df580 0x7f934814bb80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9348072ca0 tx=0x7f9340011f90 comp rx=0 tx=0).stop 2023-11-28T20:58:23.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f9347fff640 1 -- 172.21.15.167:0/2823054678 reap_dead start 2023-11-28T20:58:23.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f9347fff640 1 -- 172.21.15.167:0/2823054678 reap_dead start 2023-11-28T20:58:23.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 shutdown_connections 2023-11-28T20:58:23.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 >> 172.21.15.167:0/2823054678 conn(0x7f93480cb3f0 msgr2=0x7f93481584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:23.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 shutdown_connections 2023-11-28T20:58:23.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.406+0000 7f934c9a7640 1 -- 172.21.15.167:0/2823054678 wait complete. 2023-11-28T20:58:23.424 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:58:23.424 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:58:23.424 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:58:23.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.562+0000 7fe79a980640 1 Processor -- start 2023-11-28T20:58:23.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.562+0000 7fe79a980640 1 -- start start 2023-11-28T20:58:23.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe79a980640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe7940c5c90 0x7fe7941635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe79a980640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940c7a50 con 0x7fe794151f60 2023-11-28T20:58:23.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe79a980640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79415b220 con 0x7fe7940c75c0 2023-11-28T20:58:23.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe79a980640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940c4da0 con 0x7fe7940c5c90 2023-11-28T20:58:23.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe798f1d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe7940c5c90 0x7fe7941635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe798f1d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe7940c5c90 0x7fe7941635c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50428/0 (socket says 172.21.15.167:50428) 2023-11-28T20:58:23.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe798f1d640 1 -- 172.21.15.167:0/4236936891 learned_addr learned my addr 172.21.15.167:0/4236936891 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:23.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe798f1d640 1 -- 172.21.15.167:0/4236936891 >> v1:172.21.15.178:6789/0 conn(0x7fe7940c75c0 legacy=0x7fe79406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe798f1d640 1 -- 172.21.15.167:0/4236936891 >> v1:172.21.15.167:6789/0 conn(0x7fe794151f60 legacy=0x7fe7940c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe798f1d640 1 -- 172.21.15.167:0/4236936891 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794152340 con 0x7fe7940c5c90 2023-11-28T20:58:23.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe798f1d640 1 --2- 172.21.15.167:0/4236936891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7940c5c90 0x7fe7941635c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009e50 tx=0x7fe78c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c7fbb0759acf09 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe792ffd640 1 -- 172.21.15.167:0/4236936891 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0a5640 con 0x7fe7940c5c90 2023-11-28T20:58:23.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe792ffd640 1 -- 172.21.15.167:0/4236936891 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c0a57a0 con 0x7fe7940c5c90 2023-11-28T20:58:23.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.566+0000 7fe792ffd640 1 -- 172.21.15.167:0/4236936891 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0a5b30 con 0x7fe7940c5c90 2023-11-28T20:58:23.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 -- 172.21.15.167:0/4236936891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7940c5c90 msgr2=0x7fe7941635c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 --2- 172.21.15.167:0/4236936891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7940c5c90 0x7fe7941635c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009e50 tx=0x7fe78c01c980 comp rx=0 tx=0).stop 2023-11-28T20:58:23.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 -- 172.21.15.167:0/4236936891 shutdown_connections 2023-11-28T20:58:23.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 --2- 172.21.15.167:0/4236936891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7940c5c90 0x7fe7941635c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 -- 172.21.15.167:0/4236936891 >> 172.21.15.167:0/4236936891 conn(0x7fe7940cb1e0 msgr2=0x7fe7940cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:23.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 -- 172.21.15.167:0/4236936891 shutdown_connections 2023-11-28T20:58:23.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 -- 172.21.15.167:0/4236936891 wait complete. 2023-11-28T20:58:23.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 Processor -- start 2023-11-28T20:58:23.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 -- start start 2023-11-28T20:58:23.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7940c5c90 0x7fe7941471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7940c75c0 0x7fe794147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe794151f60 0x7fe79413ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940c3d80 con 0x7fe794151f60 2023-11-28T20:58:23.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79415b020 con 0x7fe7940c5c90 2023-11-28T20:58:23.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe79a980640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79415a1c0 con 0x7fe7940c75c0 2023-11-28T20:58:23.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe798f1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe794151f60 0x7fe79413ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe798f1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe794151f60 0x7fe79413ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50434/0 (socket says 172.21.15.167:50434) 2023-11-28T20:58:23.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe798f1d640 1 -- 172.21.15.167:0/2957646364 learned_addr learned my addr 172.21.15.167:0/2957646364 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.570+0000 7fe7937fe640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7940c75c0 0x7fe794147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7940c5c90 0x7fe7941471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe798f1d640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7940c75c0 msgr2=0x7fe794147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe7937fe640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7940c75c0 msgr2=0x7fe794147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe7937fe640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7940c75c0 msgr2=0x7fe794147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe7937fe640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7940c75c0 0x7fe794147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe7937fe640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7940c75c0 0x7fe794147730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe798f1d640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7940c75c0 0x7fe794147730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe798f1d640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7940c5c90 msgr2=0x7fe7941471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:23.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe798f1d640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7940c5c90 0x7fe7941471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:23.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe798f1d640 1 -- 172.21.15.167:0/2957646364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c009b30 con 0x7fe794151f60 2023-11-28T20:58:23.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7940c5c90 0x7fe7941471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:58:23.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe798f1d640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe794151f60 0x7fe79413ea80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe78c019590 tx=0x7fe78c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0a5640 con 0x7fe794151f60 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c0b8880 con 0x7fe794151f60 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0b8bf0 con 0x7fe794151f60 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79413e140 con 0x7fe794151f60 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe794159ee0 con 0x7fe794151f60 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe79a980640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe794074770 con 0x7fe794146220 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe793fff640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 msgr2=0x7fe79413efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe793fff640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 msgr2=0x7fe79413efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:58:23.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:23.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:23.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe78c0b8d50 con 0x7fe794151f60 2023-11-28T20:58:23.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.574+0000 7fe790ff9640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe780066470 0x7fe780068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:23.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.578+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe78c11f960 con 0x7fe794151f60 2023-11-28T20:58:23.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.578+0000 7fe7937fe640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe780066470 0x7fe780068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.578+0000 7fe7937fe640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe780066470 0x7fe780068930 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe794145f90 tx=0x7fe788009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.778+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.778+0000 7fe793fff640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 msgr2=0x7fe79413efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:58:23.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.778+0000 7fe793fff640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 msgr2=0x7fe79413efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:58:23.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.778+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:23.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:23.778+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:58:24.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.182+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:24.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.182+0000 7fe793fff640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 msgr2=0x7fe79413efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2023-11-28T20:58:24.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.182+0000 7fe793fff640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 msgr2=0x7fe79413efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:58:24.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.182+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:24.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.182+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:58:24.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.986+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:24.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.986+0000 7fe793fff640 1 -- 172.21.15.167:0/2957646364 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe79414fe10 con 0x7fe794146220 2023-11-28T20:58:24.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.986+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe784005610 tx=0x7fe7840017d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:24.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.986+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784015680 con 0x7fe794146220 2023-11-28T20:58:24.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.986+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fe7840157e0 con 0x7fe794146220 2023-11-28T20:58:24.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.986+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 msgr2=0x7fe79413efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:24.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.986+0000 7fe790ff9640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe784005610 tx=0x7fe7840017d0 comp rx=0 tx=0).stop 2023-11-28T20:58:24.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.986+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 msgr2=0x7fe79413efc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:24.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.986+0000 7fe790ff9640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794146220 0x7fe79413efc0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe784005610 tx=0x7fe7840017d0 comp rx=0 tx=0).stop 2023-11-28T20:58:24.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe79a980640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794139aa0 0x7fe794139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:24.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79415ba30 con 0x7fe794139aa0 2023-11-28T20:58:24.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794139aa0 0x7fe794139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:24.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe793fff640 1 -- 172.21.15.167:0/2957646364 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe79415b750 con 0x7fe794139aa0 2023-11-28T20:58:24.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe793fff640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794139aa0 0x7fe794139eb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe78401b000 tx=0x7fe784000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:24.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784029400 con 0x7fe794139aa0 2023-11-28T20:58:24.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7fe7840143a0 con 0x7fe794139aa0 2023-11-28T20:58:24.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794139aa0 msgr2=0x7fe794139eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:24.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe790ff9640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794139aa0 0x7fe794139eb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe78401b000 tx=0x7fe784000ee0 comp rx=0 tx=0).stop 2023-11-28T20:58:24.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe790ff9640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794139aa0 msgr2=0x7fe794139eb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:24.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe790ff9640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe794139aa0 0x7fe794139eb0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe78401b000 tx=0x7fe784000ee0 comp rx=0 tx=0).stop 2023-11-28T20:58:24.995 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:58:24.995 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:24.995 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 152, 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:24.996 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:58:24.997 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:58:24.998 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:24.998 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:24.998 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:24.998 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:24.998 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:24.998 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:24.998 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:24.998 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:24.999 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:24.999 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:24.999 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:24.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:24.999 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:58:24.999 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:58:24.999 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:58:25.000 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:25.001 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:25.002 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:25.003 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:25.004 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:25.005 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:25.006 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:25.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.008 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:25.009 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:25.010 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:58:25.010 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:58:25.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe780066470 msgr2=0x7fe780068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:25.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe79a980640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe780066470 0x7fe780068930 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe794145f90 tx=0x7fe788009040 comp rx=0 tx=0).stop 2023-11-28T20:58:25.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe794151f60 msgr2=0x7fe79413ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:25.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe79a980640 1 --2- 172.21.15.167:0/2957646364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe794151f60 0x7fe79413ea80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe78c019590 tx=0x7fe78c019720 comp rx=0 tx=0).stop 2023-11-28T20:58:25.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe798f1d640 1 -- 172.21.15.167:0/2957646364 reap_dead start 2023-11-28T20:58:25.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.994+0000 7fe798f1d640 1 -- 172.21.15.167:0/2957646364 reap_dead start 2023-11-28T20:58:25.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.998+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 shutdown_connections 2023-11-28T20:58:25.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.998+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 >> 172.21.15.167:0/2957646364 conn(0x7fe7940cb1e0 msgr2=0x7fe7940c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:25.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.998+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 shutdown_connections 2023-11-28T20:58:25.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:24.998+0000 7fe79a980640 1 -- 172.21.15.167:0/2957646364 wait complete. 2023-11-28T20:58:25.014 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:58:25.014 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:58:25.014 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:58:25.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.150+0000 7f10d1cd6640 1 Processor -- start 2023-11-28T20:58:25.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10d1cd6640 1 -- start start 2023-11-28T20:58:25.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10d1cd6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10cc0cb770 0x7f10cc15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:25.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10d1cd6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc15ac00 con 0x7f10cc0cf860 2023-11-28T20:58:25.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10d1cd6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc0cbd60 con 0x7f10cc0cfc40 2023-11-28T20:58:25.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10d1cd6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc159ff0 con 0x7f10cc0cb770 2023-11-28T20:58:25.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10cbfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10cc0cb770 0x7f10cc15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:25.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10cbfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10cc0cb770 0x7f10cc15d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50444/0 (socket says 172.21.15.167:50444) 2023-11-28T20:58:25.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10cbfff640 1 -- 172.21.15.167:0/3450092847 learned_addr learned my addr 172.21.15.167:0/3450092847 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:25.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10cbfff640 1 -- 172.21.15.167:0/3450092847 >> v1:172.21.15.178:6789/0 conn(0x7f10cc0cfc40 legacy=0x7f10cc153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:25.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10cbfff640 1 -- 172.21.15.167:0/3450092847 >> v1:172.21.15.167:6789/0 conn(0x7f10cc0cf860 legacy=0x7f10cc0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:25.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.154+0000 7f10cbfff640 1 -- 172.21.15.167:0/3450092847 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc15a2d0 con 0x7f10cc0cb770 2023-11-28T20:58:25.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10cbfff640 1 --2- 172.21.15.167:0/3450092847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cb770 0x7f10cc15d4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009e50 tx=0x7f10c401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d642bac218c43b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:25.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10ca7fc640 1 -- 172.21.15.167:0/3450092847 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40a58a0 con 0x7f10cc0cb770 2023-11-28T20:58:25.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10ca7fc640 1 -- 172.21.15.167:0/3450092847 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40a5a00 con 0x7f10cc0cb770 2023-11-28T20:58:25.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10ca7fc640 1 -- 172.21.15.167:0/3450092847 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40a5d90 con 0x7f10cc0cb770 2023-11-28T20:58:25.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3450092847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cb770 msgr2=0x7f10cc15d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:25.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10d1cd6640 1 --2- 172.21.15.167:0/3450092847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cb770 0x7f10cc15d4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009e50 tx=0x7f10c401c9e0 comp rx=0 tx=0).stop 2023-11-28T20:58:25.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3450092847 shutdown_connections 2023-11-28T20:58:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10d1cd6640 1 --2- 172.21.15.167:0/3450092847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cb770 0x7f10cc15d4d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3450092847 >> 172.21.15.167:0/3450092847 conn(0x7f10cc06c1f0 msgr2=0x7f10cc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3450092847 shutdown_connections 2023-11-28T20:58:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3450092847 wait complete. 2023-11-28T20:58:25.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10d1cd6640 1 Processor -- start 2023-11-28T20:58:25.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.158+0000 7f10d1cd6640 1 -- start start 2023-11-28T20:58:25.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10d1cd6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc0cb770 0x7f10cc0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10d1cd6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cf860 0x7f10cc0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10d1cd6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc0cfc40 0x7f10cc142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10d1cd6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc148400 con 0x7f10cc0cf860 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10d1cd6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc159990 con 0x7f10cc0cfc40 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10d1cd6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc148650 con 0x7f10cc0cb770 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10caffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cf860 0x7f10cc0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10caffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cf860 0x7f10cc0b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50456/0 (socket says 172.21.15.167:50456) 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10caffd640 1 -- 172.21.15.167:0/3260887293 learned_addr learned my addr 172.21.15.167:0/3260887293 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10cb7fe640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc0cb770 0x7f10cc0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10cbfff640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc0cfc40 0x7f10cc142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10caffd640 1 -- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc0cb770 msgr2=0x7f10cc0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10caffd640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc0cb770 0x7f10cc0b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:25.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10caffd640 1 -- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc0cfc40 msgr2=0x7f10cc142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:25.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10caffd640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc0cfc40 0x7f10cc142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:25.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10caffd640 1 -- 172.21.15.167:0/3260887293 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4009b30 con 0x7f10cc0cf860 2023-11-28T20:58:25.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10caffd640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cf860 0x7f10cc0b47b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f10c000c500 tx=0x7f10c000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:25.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10b3fff640 1 -- 172.21.15.167:0/3260887293 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0005220 con 0x7f10cc0cf860 2023-11-28T20:58:25.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10b3fff640 1 -- 172.21.15.167:0/3260887293 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0005380 con 0x7f10cc0cf860 2023-11-28T20:58:25.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc0b3790 con 0x7f10cc0cf860 2023-11-28T20:58:25.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10b3fff640 1 -- 172.21.15.167:0/3260887293 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0007270 con 0x7f10cc0cf860 2023-11-28T20:58:25.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc0b3d50 con 0x7f10cc0cf860 2023-11-28T20:58:25.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc067c40 con 0x7f10cc0cf860 2023-11-28T20:58:25.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.162+0000 7f10b3fff640 1 -- 172.21.15.167:0/3260887293 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10c00073d0 con 0x7f10cc0cf860 2023-11-28T20:58:25.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.166+0000 7f10b3fff640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f10b80664a0 0x7f10b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:25.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.166+0000 7f10b3fff640 1 -- 172.21.15.167:0/3260887293 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f10c0083af0 con 0x7f10cc0cf860 2023-11-28T20:58:25.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.166+0000 7f10cb7fe640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f10b80664a0 0x7f10b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:25.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.166+0000 7f10cb7fe640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f10b80664a0 0x7f10b8068960 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f10bc000f70 tx=0x7f10bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:25.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.170+0000 7f10b3fff640 1 -- 172.21.15.167:0/3260887293 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10c0050b90 con 0x7f10cc0cf860 2023-11-28T20:58:25.309 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 4% (9/181) Updating files: 5% (10/181) Updating files: 6% (11/181) Updating files: 7% (13/181) Updating files: 8% (15/181) Updating files: 9% (17/181) Updating files: 10% (19/181) Updating files: 11% (20/181) Updating files: 12% (22/181) Updating files: 13% (24/181) Updating files: 14% (26/181) Updating files: 15% (28/181) Updating files: 16% (29/181) Updating files: 17% (31/181) Updating files: 18% (33/181) Updating files: 19% (35/181) Updating files: 20% (37/181) Updating files: 21% (39/181) Updating files: 22% (40/181) Updating files: 23% (42/181) Updating files: 24% (44/181) Updating files: 25% (46/181) Updating files: 25% (47/181) Updating files: 26% (48/181) Updating files: 27% (49/181) Updating files: 28% (51/181) Updating files: 29% (53/181) Updating files: 30% (55/181) Updating files: 31% (57/181) Updating files: 32% (58/181) Updating files: 33% (60/181) Updating files: 34% (62/181) Updating files: 35% (64/181) Updating files: 36% (66/181) Updating files: 37% (67/181) Updating files: 38% (69/181) Updating files: 39% (71/181) Updating files: 40% (73/181) Updating files: 41% (75/181) Updating files: 42% (77/181) Updating files: 43% (78/181) Updating files: 44% (80/181) Updating files: 45% (82/181) Updating files: 46% (84/181) Updating files: 47% (86/181) Updating files: 48% (87/181) Updating files: 49% (89/181) Updating files: 50% (91/181) Updating files: 51% (93/181) Updating files: 52% (95/181) Updating files: 53% (96/181) Updating files: 53% (97/181) Updating files: 54% (98/181) Updating files: 55% (100/181) Updating files: 56% (102/181) Updating files: 57% (104/181) Updating files: 58% (105/181) Updating files: 59% (107/181) Updating files: 60% (109/181) Updating files: 61% (111/181) Updating files: 62% (113/181) Updating files: 63% (115/181) Updating files: 64% (116/181) Updating files: 65% (118/181) Updating files: 66% (120/181) Updating files: 67% (122/181) Updating files: 68% (124/181) Updating files: 69% (125/181) Updating files: 70% (127/181) Updating files: 71% (129/181) Updating files: 72% (131/181) Updating files: 73% (133/181) Updating files: 74% (134/181) Updating files: 75% (136/181) Updating files: 76% (138/181) Updating files: 77% (140/181) Updating files: 78% (142/181) Updating files: 79% (143/181) Updating files: 80% (145/181) Updating files: 81% (147/181) Updating files: 82% (149/181) Updating files: 83% (151/181) Updating files: 84% (153/181) Updating files: 85% (154/181) Updating files: 86% (156/181) Updating files: 87% (158/181) Updating files: 88% (160/181) Updating files: 89% (162/181) Updating files: 90% (163/181) Updating files: 91% (165/181) Updating files: 92% (167/181) Updating files: 93% (169/181) Updating files: 94% (171/181) Updating files: 95% (172/181) Updating files: 96% (174/181) Updating files: 97% (176/181) Updating files: 98% (178/181) Updating files: 99% (180/181) Updating files: 100% (181/181) Updating files: 100% (181/181), done. 2023-11-28T20:58:25.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.378+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f10cc075c90 con 0x7f10cc0cf860 2023-11-28T20:58:25.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.378+0000 7f10b3fff640 1 -- 172.21.15.167:0/3260887293 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f10c00541b0 con 0x7f10cc0cf860 2023-11-28T20:58:25.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f10b80664a0 msgr2=0x7f10b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:25.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f10b80664a0 0x7f10b8068960 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f10bc000f70 tx=0x7f10bc009040 comp rx=0 tx=0).stop 2023-11-28T20:58:25.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cf860 msgr2=0x7f10cc0b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:25.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cf860 0x7f10cc0b47b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f10c000c500 tx=0x7f10c000c9c0 comp rx=0 tx=0).stop 2023-11-28T20:58:25.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 shutdown_connections 2023-11-28T20:58:25.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f10b80664a0 0x7f10b8068960 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:25.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc0cfc40 0x7f10cc142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:25.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10cc0cf860 0x7f10cc0b47b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:25.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 --2- 172.21.15.167:0/3260887293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc0cb770 0x7f10cc0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:25.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 >> 172.21.15.167:0/3260887293 conn(0x7f10cc06c1f0 msgr2=0x7f10cc0c5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:25.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 shutdown_connections 2023-11-28T20:58:25.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:25.382+0000 7f10d1cd6640 1 -- 172.21.15.167:0/3260887293 wait complete. 2023-11-28T20:58:25.400 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:58:25.500 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at a6f3bbb744a v0.37 2023-11-28T20:58:25.503 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.37 2023-11-28T20:58:26.017 INFO:tasks.workunit.client.0.smithi167.stdout:v0.38 2023-11-28T20:58:26.018 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 38 -eq 48 ] 2023-11-28T20:58:26.018 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.38 2023-11-28T20:58:26.018 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.38 2023-11-28T20:58:26.018 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.38 2023-11-28T20:58:35.250 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 16% (29/171) Updating files: 17% (30/171) Updating files: 18% (31/171) Updating files: 19% (33/171) Updating files: 20% (35/171) Updating files: 21% (36/171) Updating files: 22% (38/171) Updating files: 23% (40/171) Updating files: 24% (42/171) Updating files: 25% (43/171) Updating files: 26% (45/171) Updating files: 27% (47/171) Updating files: 28% (48/171) Updating files: 29% (50/171) Updating files: 30% (52/171) Updating files: 31% (54/171) Updating files: 32% (55/171) Updating files: 33% (57/171) Updating files: 34% (59/171) Updating files: 35% (60/171) Updating files: 36% (62/171) Updating files: 37% (64/171) Updating files: 38% (65/171) Updating files: 39% (67/171) Updating files: 40% (69/171) Updating files: 41% (71/171) Updating files: 42% (72/171) Updating files: 43% (74/171) Updating files: 44% (76/171) Updating files: 45% (77/171) Updating files: 46% (79/171) Updating files: 47% (81/171) Updating files: 48% (83/171) Updating files: 49% (84/171) Updating files: 50% (86/171) Updating files: 50% (87/171) Updating files: 51% (88/171) Updating files: 52% (89/171) Updating files: 53% (91/171) Updating files: 54% (93/171) Updating files: 55% (95/171) Updating files: 56% (96/171) Updating files: 57% (98/171) Updating files: 58% (100/171) Updating files: 59% (101/171) Updating files: 60% (103/171) Updating files: 61% (105/171) Updating files: 62% (107/171) Updating files: 63% (108/171) Updating files: 64% (110/171) Updating files: 65% (112/171) Updating files: 66% (113/171) Updating files: 67% (115/171) Updating files: 67% (116/171) Updating files: 68% (117/171) Updating files: 69% (118/171) Updating files: 70% (120/171) Updating files: 71% (122/171) Updating files: 71% (123/171) Updating files: 72% (124/171) Updating files: 73% (125/171) Updating files: 74% (127/171) Updating files: 75% (129/171) Updating files: 76% (130/171) Updating files: 77% (132/171) Updating files: 78% (134/171) Updating files: 79% (136/171) Updating files: 80% (137/171) Updating files: 81% (139/171) Updating files: 82% (141/171) Updating files: 83% (142/171) Updating files: 84% (144/171) Updating files: 85% (146/171) Updating files: 86% (148/171) Updating files: 87% (149/171) Updating files: 88% (151/171) Updating files: 89% (153/171) Updating files: 90% (154/171) Updating files: 91% (156/171) Updating files: 92% (158/171) Updating files: 93% (160/171) Updating files: 94% (161/171) Updating files: 95% (163/171) Updating files: 96% (165/171) Updating files: 97% (166/171) Updating files: 98% (168/171) Updating files: 99% (170/171) Updating files: 100% (171/171) Updating files: 100% (171/171), done. 2023-11-28T20:58:35.401 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:58:35.401 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:58:35.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2557a17640 1 Processor -- start 2023-11-28T20:58:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2557a17640 1 -- start start 2023-11-28T20:58:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2557a17640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2550151f60 0x7f25500c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2557a17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25500c5c90 0x7f25500c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2557a17640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255015b220 con 0x7f255006a580 2023-11-28T20:58:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2557a17640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25500c4da0 con 0x7f2550151f60 2023-11-28T20:58:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2557a17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500c60f0 con 0x7f25500c5c90 2023-11-28T20:58:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f25557b3640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2550151f60 0x7f25500c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2554fb2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25500c5c90 0x7f25500c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2554fb2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25500c5c90 0x7f25500c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:45368/0 (socket says 172.21.15.167:45368) 2023-11-28T20:58:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2554fb2640 1 -- 172.21.15.167:0/2019472812 learned_addr learned my addr 172.21.15.167:0/2019472812 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2555fb4640 1 --1- 172.21.15.167:0/2019472812 >> v1:172.21.15.178:6789/0 conn(0x7f255006a580 0x7f255006ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:47234/0 (socket says 172.21.15.167:47234) 2023-11-28T20:58:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f25557b3640 1 -- 172.21.15.167:0/2019472812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25500c5c90 msgr2=0x7f25500c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f25557b3640 1 --2- 172.21.15.167:0/2019472812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25500c5c90 0x7f25500c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f25557b3640 1 -- 172.21.15.167:0/2019472812 >> v1:172.21.15.178:6789/0 conn(0x7f255006a580 legacy=0x7f255006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f25557b3640 1 -- 172.21.15.167:0/2019472812 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2550152340 con 0x7f2550151f60 2023-11-28T20:58:35.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.546+0000 7f2554fb2640 1 --2- 172.21.15.167:0/2019472812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25500c5c90 0x7f25500c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:58:35.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f25557b3640 1 --2- 172.21.15.167:0/2019472812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2550151f60 0x7f25500c75c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f254c0097c0 tx=0x7f254c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1388348b5842e883 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:35.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2547fff640 1 -- 172.21.15.167:0/2019472812 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0ab600 con 0x7f2550151f60 2023-11-28T20:58:35.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2547fff640 1 -- 172.21.15.167:0/2019472812 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c0a7050 con 0x7f2550151f60 2023-11-28T20:58:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2547fff640 1 -- 172.21.15.167:0/2019472812 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0ab980 con 0x7f2550151f60 2023-11-28T20:58:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2557a17640 1 -- 172.21.15.167:0/2019472812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2550151f60 msgr2=0x7f25500c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2557a17640 1 --2- 172.21.15.167:0/2019472812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2550151f60 0x7f25500c75c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f254c0097c0 tx=0x7f254c01c3f0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2557a17640 1 -- 172.21.15.167:0/2019472812 shutdown_connections 2023-11-28T20:58:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2557a17640 1 --2- 172.21.15.167:0/2019472812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25500c5c90 0x7f25500c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2557a17640 1 --2- 172.21.15.167:0/2019472812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2550151f60 0x7f25500c75c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2557a17640 1 -- 172.21.15.167:0/2019472812 >> 172.21.15.167:0/2019472812 conn(0x7f25500cb1e0 msgr2=0x7f25500cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2557a17640 1 -- 172.21.15.167:0/2019472812 shutdown_connections 2023-11-28T20:58:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.550+0000 7f2557a17640 1 -- 172.21.15.167:0/2019472812 wait complete. 2023-11-28T20:58:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 Processor -- start 2023-11-28T20:58:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 -- start start 2023-11-28T20:58:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255006a580 0x7f25501400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25500c5c90 0x7f2550140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2550151f60 0x7f2550141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2550140890 con 0x7f255006a580 2023-11-28T20:58:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25501f26e0 con 0x7f25500c5c90 2023-11-28T20:58:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25501f2940 con 0x7f2550151f60 2023-11-28T20:58:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f25557b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255006a580 0x7f25501400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f25557b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255006a580 0x7f25501400b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58178/0 (socket says 172.21.15.167:58178) 2023-11-28T20:58:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f25557b3640 1 -- 172.21.15.167:0/422829337 learned_addr learned my addr 172.21.15.167:0/422829337 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2554fb2640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25500c5c90 0x7f2550140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2555fb4640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2550151f60 0x7f2550141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f25557b3640 1 -- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2550151f60 msgr2=0x7f2550141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f25557b3640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2550151f60 0x7f2550141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f25557b3640 1 -- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25500c5c90 msgr2=0x7f2550140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f25557b3640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25500c5c90 0x7f2550140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f25557b3640 1 -- 172.21.15.167:0/422829337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400094d0 con 0x7f255006a580 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2555fb4640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2550151f60 0x7f2550141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2554fb2640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25500c5c90 0x7f2550140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f25557b3640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255006a580 0x7f25501400b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f254c01aaa0 tx=0x7f254c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2545ffb640 1 -- 172.21.15.167:0/422829337 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0b9070 con 0x7f255006a580 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2545ffb640 1 -- 172.21.15.167:0/422829337 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c006e20 con 0x7f255006a580 2023-11-28T20:58:35.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2545ffb640 1 -- 172.21.15.167:0/422829337 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0b4400 con 0x7f255006a580 2023-11-28T20:58:35.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c009420 con 0x7f255006a580 2023-11-28T20:58:35.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.554+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25501f2f00 con 0x7f255006a580 2023-11-28T20:58:35.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.558+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25500682c0 con 0x7f255006a580 2023-11-28T20:58:35.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.558+0000 7f2545ffb640 1 -- 172.21.15.167:0/422829337 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f254c0b2040 con 0x7f255006a580 2023-11-28T20:58:35.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.558+0000 7f2545ffb640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25340664a0 0x7f2534068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.558+0000 7f2545ffb640 1 -- 172.21.15.167:0/422829337 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f254c11d760 con 0x7f255006a580 2023-11-28T20:58:35.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.558+0000 7f2554fb2640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25340664a0 0x7f2534068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.558+0000 7f2554fb2640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25340664a0 0x7f2534068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f25500c5110 tx=0x7f2540008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:35.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.562+0000 7f2545ffb640 1 -- 172.21.15.167:0/422829337 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f254c0ea760 con 0x7f255006a580 2023-11-28T20:58:35.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2550075c90 con 0x7f255006a580 2023-11-28T20:58:35.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2545ffb640 1 -- 172.21.15.167:0/422829337 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f254c0b0080 con 0x7f255006a580 2023-11-28T20:58:35.769 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":152,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:58:35.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25340664a0 msgr2=0x7f2534068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25340664a0 0x7f2534068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f25500c5110 tx=0x7f2540008040 comp rx=0 tx=0).stop 2023-11-28T20:58:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255006a580 msgr2=0x7f25501400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255006a580 0x7f25501400b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f254c01aaa0 tx=0x7f254c019190 comp rx=0 tx=0).stop 2023-11-28T20:58:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 shutdown_connections 2023-11-28T20:58:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f25340664a0 0x7f2534068960 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2550151f60 0x7f2550141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25500c5c90 0x7f2550140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 --2- 172.21.15.167:0/422829337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255006a580 0x7f25501400b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 >> 172.21.15.167:0/422829337 conn(0x7f25500cb1e0 msgr2=0x7f255006ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 shutdown_connections 2023-11-28T20:58:35.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.770+0000 7f2557a17640 1 -- 172.21.15.167:0/422829337 wait complete. 2023-11-28T20:58:35.792 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:58:35.792 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:58:35.792 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:58:35.792 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:58:35.835 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at b600ec2ac7c v0.38 2023-11-28T20:58:35.838 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.38 2023-11-28T20:58:35.882 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 39 -eq 48 ] 2023-11-28T20:58:35.882 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.39 2023-11-28T20:58:35.883 INFO:tasks.workunit.client.0.smithi167.stdout:v0.39 2023-11-28T20:58:35.883 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.39 2023-11-28T20:58:35.883 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.39 2023-11-28T20:58:35.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa94359d640 1 Processor -- start 2023-11-28T20:58:35.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa94359d640 1 -- start start 2023-11-28T20:58:35.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa94359d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa93c0c44d0 0x7fa93c0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa94359d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93c0ca230 con 0x7fa93c0c2630 2023-11-28T20:58:35.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa94359d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93c0c9b90 con 0x7fa93c157e30 2023-11-28T20:58:35.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa94359d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93c0c9e70 con 0x7fa93c0c44d0 2023-11-28T20:58:35.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa940b38640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa93c0c44d0 0x7fa93c0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa940b38640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa93c0c44d0 0x7fa93c0c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58186/0 (socket says 172.21.15.167:58186) 2023-11-28T20:58:35.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa940b38640 1 -- 172.21.15.167:0/506535254 learned_addr learned my addr 172.21.15.167:0/506535254 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:35.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa940b38640 1 -- 172.21.15.167:0/506535254 >> v1:172.21.15.178:6789/0 conn(0x7fa93c157e30 legacy=0x7fa93c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa940b38640 1 -- 172.21.15.167:0/506535254 >> v1:172.21.15.167:6789/0 conn(0x7fa93c0c2630 legacy=0x7fa93c0c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.942+0000 7fa940b38640 1 -- 172.21.15.167:0/506535254 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c0ca480 con 0x7fa93c0c44d0 2023-11-28T20:58:35.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa940b38640 1 --2- 172.21.15.167:0/506535254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c0c44d0 0x7fa93c0c8010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009870 tx=0x7fa92c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700f94f0ddba1bdb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:35.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa933fff640 1 -- 172.21.15.167:0/506535254 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0a8a30 con 0x7fa93c0c44d0 2023-11-28T20:58:35.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa933fff640 1 -- 172.21.15.167:0/506535254 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c0a8b90 con 0x7fa93c0c44d0 2023-11-28T20:58:35.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa933fff640 1 -- 172.21.15.167:0/506535254 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0b0440 con 0x7fa93c0c44d0 2023-11-28T20:58:35.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa94359d640 1 -- 172.21.15.167:0/506535254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c0c44d0 msgr2=0x7fa93c0c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa94359d640 1 --2- 172.21.15.167:0/506535254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c0c44d0 0x7fa93c0c8010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009870 tx=0x7fa92c01ed30 comp rx=0 tx=0).stop 2023-11-28T20:58:35.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa94359d640 1 -- 172.21.15.167:0/506535254 shutdown_connections 2023-11-28T20:58:35.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa94359d640 1 --2- 172.21.15.167:0/506535254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c0c44d0 0x7fa93c0c8010 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa94359d640 1 -- 172.21.15.167:0/506535254 >> 172.21.15.167:0/506535254 conn(0x7fa93c06ee30 msgr2=0x7fa93c06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:35.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa94359d640 1 -- 172.21.15.167:0/506535254 shutdown_connections 2023-11-28T20:58:35.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.946+0000 7fa94359d640 1 -- 172.21.15.167:0/506535254 wait complete. 2023-11-28T20:58:35.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 Processor -- start 2023-11-28T20:58:35.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 -- start start 2023-11-28T20:58:35.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa93c0c2630 0x7fa93c1e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa93c0c44d0 0x7fa93c1edaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c157e30 0x7fa93c1edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c1dfba0 con 0x7fa93c157e30 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c1f0df0 con 0x7fa93c0c44d0 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c1e0670 con 0x7fa93c0c2630 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941b3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c157e30 0x7fa93c1edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941b3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c157e30 0x7fa93c1edfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58192/0 (socket says 172.21.15.167:58192) 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941b3a640 1 -- 172.21.15.167:0/2246713868 learned_addr learned my addr 172.21.15.167:0/2246713868 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa940b38640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa93c0c44d0 0x7fa93c1edaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941339640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa93c0c2630 0x7fa93c1e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941b3a640 1 -- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa93c0c2630 msgr2=0x7fa93c1e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941b3a640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa93c0c2630 0x7fa93c1e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941b3a640 1 -- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa93c0c44d0 msgr2=0x7fa93c1edaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941b3a640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa93c0c44d0 0x7fa93c1edaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:35.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941b3a640 1 -- 172.21.15.167:0/2246713868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c0094d0 con 0x7fa93c157e30 2023-11-28T20:58:35.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa941b3a640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c157e30 0x7fa93c1edfe0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa93400c760 tx=0x7fa93400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:35.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934003b80 con 0x7fa93c157e30 2023-11-28T20:58:35.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934003ce0 con 0x7fa93c157e30 2023-11-28T20:58:35.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400aa30 con 0x7fa93c157e30 2023-11-28T20:58:35.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93c157820 con 0x7fa93c157e30 2023-11-28T20:58:35.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.950+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c1f12e0 con 0x7fa93c157e30 2023-11-28T20:58:35.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa94359d640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c1f14d0 0x7fa93c14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c06b130 con 0x7fa93c1f14d0 2023-11-28T20:58:35.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa941339640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c1f14d0 0x7fa93c14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa941339640 1 -- 172.21.15.167:0/2246713868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa93c06f8e0 con 0x7fa93c1f14d0 2023-11-28T20:58:35.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa941339640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c1f14d0 0x7fa93c14b1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa93800e4d0 tx=0x7fa93800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:35.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380052e0 con 0x7fa93c1f14d0 2023-11-28T20:58:35.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa93400ab90 con 0x7fa93c157e30 2023-11-28T20:58:35.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa931ffb640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa920066510 0x7fa9200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa934084000 con 0x7fa93c157e30 2023-11-28T20:58:35.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa938005440 con 0x7fa93c1f14d0 2023-11-28T20:58:35.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c1f14d0 msgr2=0x7fa93c14b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa931ffb640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c1f14d0 0x7fa93c14b1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa93800e4d0 tx=0x7fa93800e990 comp rx=0 tx=0).stop 2023-11-28T20:58:35.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c1f14d0 msgr2=0x7fa93c14b1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:35.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa931ffb640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c1f14d0 0x7fa93c14b1c0 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa93800e4d0 tx=0x7fa93800e990 comp rx=0 tx=0).stop 2023-11-28T20:58:35.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.954+0000 7fa940b38640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa920066510 0x7fa9200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.958+0000 7fa940b38640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa920066510 0x7fa9200689d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0b2000 tx=0x7fa92c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:35.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c14b700 0x7fa93c1e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:35.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c150a00 con 0x7fa93c14b700 2023-11-28T20:58:35.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa941339640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c14b700 0x7fa93c1e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:35.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa941339640 1 -- 172.21.15.167:0/2246713868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa93c0c8550 con 0x7fa93c14b700 2023-11-28T20:58:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa941339640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c14b700 0x7fa93c1e1ed0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa93800e4d0 tx=0x7fa938001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938021070 con 0x7fa93c14b700 2023-11-28T20:58:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5126 (secure 0 0 0) 0x7fa9380069f0 con 0x7fa93c14b700 2023-11-28T20:58:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c14b700 msgr2=0x7fa93c1e1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa931ffb640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c14b700 0x7fa93c1e1ed0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa93800e4d0 tx=0x7fa938001130 comp rx=0 tx=0).stop 2023-11-28T20:58:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa931ffb640 1 -- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c14b700 msgr2=0x7fa93c1e1ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:35.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa931ffb640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c14b700 0x7fa93c1e1ed0 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa93800e4d0 tx=0x7fa938001130 comp rx=0 tx=0).stop 2023-11-28T20:58:35.962 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 152, 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:58:35.963 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:35.964 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:35.965 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:35.966 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:35.966 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:35.966 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:35.966 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:35.966 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:35.966 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:35.966 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.966 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:58:35.966 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:58:35.967 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:35.968 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:35.969 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:35.969 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:35.969 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:35.969 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:35.969 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:35.970 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:58:35.970 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.970 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:58:35.970 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.970 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:35.970 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:35.971 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:35.971 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:35.971 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.971 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:35.971 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:58:35.971 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:35.971 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:58:35.972 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.973 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:35.974 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:58:35.974 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:35.974 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.974 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.974 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:35.974 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:58:35.975 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:35.975 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:35.975 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:35.975 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.975 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:58:35.975 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:58:35.975 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:35.976 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:35.976 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:35.976 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.976 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.976 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:35.976 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:35.976 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:35.977 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:35.977 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.977 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:35.977 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:58:35.977 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:35.977 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:35.978 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:35.979 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.980 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:35.981 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:35.981 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:58:35.981 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:35.981 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:35.981 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:58:35.981 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.981 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:58:35.981 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:58:35.982 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:35.983 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:35.983 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:35.983 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:58:35.983 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:35.983 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:35.983 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:35.983 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:58:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:58:35.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa920066510 msgr2=0x7fa9200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa920066510 0x7fa9200689d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0b2000 tx=0x7fa92c008040 comp rx=0 tx=0).stop 2023-11-28T20:58:35.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c157e30 msgr2=0x7fa93c1edfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:35.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 --2- 172.21.15.167:0/2246713868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa93c157e30 0x7fa93c1edfe0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa93400c760 tx=0x7fa93400cc20 comp rx=0 tx=0).stop 2023-11-28T20:58:35.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa941b3a640 1 -- 172.21.15.167:0/2246713868 reap_dead start 2023-11-28T20:58:35.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa941b3a640 1 -- 172.21.15.167:0/2246713868 reap_dead start 2023-11-28T20:58:35.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 shutdown_connections 2023-11-28T20:58:35.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 >> 172.21.15.167:0/2246713868 conn(0x7fa93c06ee30 msgr2=0x7fa93c158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:35.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 shutdown_connections 2023-11-28T20:58:35.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:35.962+0000 7fa94359d640 1 -- 172.21.15.167:0/2246713868 wait complete. 2023-11-28T20:58:35.986 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:58:35.986 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:58:35.986 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:58:36.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe111eea640 1 Processor -- start 2023-11-28T20:58:36.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe111eea640 1 -- start start 2023-11-28T20:58:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe111eea640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe10c150b40 0x7fe10c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe111eea640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c0c48f0 con 0x7fe10c0c4510 2023-11-28T20:58:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe111eea640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c0c6ac0 con 0x7fe10c0c6ff0 2023-11-28T20:58:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe111eea640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c0c62f0 con 0x7fe10c150b40 2023-11-28T20:58:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe10b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe10c150b40 0x7fe10c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe10b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe10c150b40 0x7fe10c157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58228/0 (socket says 172.21.15.167:58228) 2023-11-28T20:58:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe10b7fe640 1 -- 172.21.15.167:0/710433199 learned_addr learned my addr 172.21.15.167:0/710433199 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:36.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.174+0000 7fe10b7fe640 1 -- 172.21.15.167:0/710433199 >> v1:172.21.15.178:6789/0 conn(0x7fe10c0c6ff0 legacy=0x7fe10c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:36.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe10b7fe640 1 -- 172.21.15.167:0/710433199 >> v1:172.21.15.167:6789/0 conn(0x7fe10c0c4510 legacy=0x7fe10c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe10b7fe640 1 -- 172.21.15.167:0/710433199 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0c6500 con 0x7fe10c150b40 2023-11-28T20:58:36.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe10b7fe640 1 --2- 172.21.15.167:0/710433199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 0x7fe10c157560 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009870 tx=0x7fe0fc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4635d817d951228 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe10a7fc640 1 -- 172.21.15.167:0/710433199 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0aa670 con 0x7fe10c150b40 2023-11-28T20:58:36.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe10a7fc640 1 -- 172.21.15.167:0/710433199 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc0aa7d0 con 0x7fe10c150b40 2023-11-28T20:58:36.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe10a7fc640 1 -- 172.21.15.167:0/710433199 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0aab60 con 0x7fe10c150b40 2023-11-28T20:58:36.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe111eea640 1 -- 172.21.15.167:0/710433199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 msgr2=0x7fe10c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe111eea640 1 --2- 172.21.15.167:0/710433199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 0x7fe10c157560 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009870 tx=0x7fe0fc01c510 comp rx=0 tx=0).stop 2023-11-28T20:58:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe111eea640 1 -- 172.21.15.167:0/710433199 shutdown_connections 2023-11-28T20:58:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe111eea640 1 --2- 172.21.15.167:0/710433199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 0x7fe10c157560 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe111eea640 1 -- 172.21.15.167:0/710433199 >> 172.21.15.167:0/710433199 conn(0x7fe10c0cb1e0 msgr2=0x7fe10c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.178+0000 7fe111eea640 1 -- 172.21.15.167:0/710433199 shutdown_connections 2023-11-28T20:58:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe111eea640 1 -- 172.21.15.167:0/710433199 wait complete. 2023-11-28T20:58:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe111eea640 1 Processor -- start 2023-11-28T20:58:36.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe111eea640 1 -- start start 2023-11-28T20:58:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe111eea640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c0c4510 0x7fe10c148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe111eea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe10c0c6ff0 0x7fe10c14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe111eea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 0x7fe10c14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe111eea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c14a030 con 0x7fe10c150b40 2023-11-28T20:58:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe111eea640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c14afe0 con 0x7fe10c0c4510 2023-11-28T20:58:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe111eea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c1486c0 con 0x7fe10c0c6ff0 2023-11-28T20:58:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 0x7fe10c14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 0x7fe10c14b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58242/0 (socket says 172.21.15.167:58242) 2023-11-28T20:58:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10bfff640 1 -- 172.21.15.167:0/919112822 learned_addr learned my addr 172.21.15.167:0/919112822 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:36.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10b7fe640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c0c4510 0x7fe10c148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10affd640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe10c0c6ff0 0x7fe10c14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10bfff640 1 -- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe10c0c6ff0 msgr2=0x7fe10c14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10bfff640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe10c0c6ff0 0x7fe10c14b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10bfff640 1 -- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c0c4510 msgr2=0x7fe10c148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10bfff640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c0c4510 0x7fe10c148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10bfff640 1 -- 172.21.15.167:0/919112822 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0094d0 con 0x7fe10c150b40 2023-11-28T20:58:36.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.182+0000 7fe10bfff640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 0x7fe10c14b9b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe10400c730 tx=0x7fe10400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104003ba0 con 0x7fe10c150b40 2023-11-28T20:58:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104003d00 con 0x7fe10c150b40 2023-11-28T20:58:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104005310 con 0x7fe10c150b40 2023-11-28T20:58:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c14a260 con 0x7fe10c150b40 2023-11-28T20:58:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c14ac20 con 0x7fe10c150b40 2023-11-28T20:58:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe111eea640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c1544a0 0x7fe10c13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c074770 con 0x7fe10c1544a0 2023-11-28T20:58:36.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe10b7fe640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c1544a0 0x7fe10c13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe10b7fe640 1 -- 172.21.15.167:0/919112822 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe10c0c3a50 con 0x7fe10c1544a0 2023-11-28T20:58:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe104005680 con 0x7fe10c150b40 2023-11-28T20:58:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe10b7fe640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c1544a0 0x7fe10c13ea50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0cc270 tx=0x7fe0fc01ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe0f8066470 0x7fe0f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe104084320 con 0x7fe10c150b40 2023-11-28T20:58:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0aade0 con 0x7fe10c1544a0 2023-11-28T20:58:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe10affd640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe0f8066470 0x7fe0f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fe0fc0bd410 con 0x7fe10c1544a0 2023-11-28T20:58:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c1544a0 msgr2=0x7fe10c13ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c1544a0 0x7fe10c13ea50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0cc270 tx=0x7fe0fc01ad50 comp rx=0 tx=0).stop 2023-11-28T20:58:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c1544a0 msgr2=0x7fe10c13ea50 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.186+0000 7fe0f3fff640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c1544a0 0x7fe10c13ea50 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0cc270 tx=0x7fe0fc01ad50 comp rx=0 tx=0).stop 2023-11-28T20:58:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.190+0000 7fe10affd640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe0f8066470 0x7fe0f8068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe10c06ea60 tx=0x7fe100009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.194+0000 7fe111eea640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c159b10 0x7fe10c13ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.194+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c071310 con 0x7fe10c159b10 2023-11-28T20:58:36.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.194+0000 7fe10b7fe640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c159b10 0x7fe10c13ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.194+0000 7fe10b7fe640 1 -- 172.21.15.167:0/919112822 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe10c0cb5c0 con 0x7fe10c159b10 2023-11-28T20:58:36.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.194+0000 7fe10b7fe640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c159b10 0x7fe10c13ef90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc019120 tx=0x7fe0fc0192b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.194+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0c5ad0 con 0x7fe10c159b10 2023-11-28T20:58:36.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4811 (secure 0 0 0) 0x7fe0fc0c5c30 con 0x7fe10c159b10 2023-11-28T20:58:36.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c159b10 msgr2=0x7fe10c13ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe0f3fff640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c159b10 0x7fe10c13ef90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc019120 tx=0x7fe0fc0192b0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe0f3fff640 1 -- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c159b10 msgr2=0x7fe10c13ef90 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:36.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe0f3fff640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe10c159b10 0x7fe10c13ef90 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc019120 tx=0x7fe0fc0192b0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.196 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:58:36.196 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 152, 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:58:36.197 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:58:36.198 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:58:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:36.201 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:36.202 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.203 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.204 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:58:36.205 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:58:36.206 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:36.207 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.208 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:58:36.209 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:58:36.210 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:58:36.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe0f8066470 msgr2=0x7fe0f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe111eea640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe0f8066470 0x7fe0f8068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe10c06ea60 tx=0x7fe100009040 comp rx=0 tx=0).stop 2023-11-28T20:58:36.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 msgr2=0x7fe10c14b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe111eea640 1 --2- 172.21.15.167:0/919112822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe10c150b40 0x7fe10c14b9b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe10400c730 tx=0x7fe10400cbf0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe10bfff640 1 -- 172.21.15.167:0/919112822 reap_dead start 2023-11-28T20:58:36.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe10bfff640 1 -- 172.21.15.167:0/919112822 reap_dead start 2023-11-28T20:58:36.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 shutdown_connections 2023-11-28T20:58:36.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 >> 172.21.15.167:0/919112822 conn(0x7fe10c0cb1e0 msgr2=0x7fe10c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:36.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 shutdown_connections 2023-11-28T20:58:36.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.198+0000 7fe111eea640 1 -- 172.21.15.167:0/919112822 wait complete. 2023-11-28T20:58:36.214 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:58:36.214 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:58:36.214 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:58:36.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.354+0000 7fd4b0a6b640 1 Processor -- start 2023-11-28T20:58:36.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.354+0000 7fd4b0a6b640 1 -- start start 2023-11-28T20:58:36.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.354+0000 7fd4b0a6b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd4ac150b40 0x7fd4ac157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.354+0000 7fd4b0a6b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd4ac0c4510 0x7fd4ac06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.354+0000 7fd4b0a6b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac0c48f0 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.354+0000 7fd4b0a6b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac0c62f0 con 0x7fd4ac150b40 2023-11-28T20:58:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.354+0000 7fd4b0a6b640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac0c6ac0 con 0x7fd4ac0c4510 2023-11-28T20:58:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4aa59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd4ac150b40 0x7fd4ac157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4aa59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd4ac150b40 0x7fd4ac157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58250/0 (socket says 172.21.15.167:58250) 2023-11-28T20:58:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4aa59c640 1 -- 172.21.15.167:0/1132124737 learned_addr learned my addr 172.21.15.167:0/1132124737 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4aad9d640 1 --2- 172.21.15.167:0/1132124737 >> v2:172.21.15.178:3300/0 conn(0x7fd4ac0c4510 0x7fd4ac06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4aa59c640 1 -- 172.21.15.167:0/1132124737 >> v2:172.21.15.178:3300/0 conn(0x7fd4ac0c4510 msgr2=0x7fd4ac06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4aa59c640 1 --2- 172.21.15.167:0/1132124737 >> v2:172.21.15.178:3300/0 conn(0x7fd4ac0c4510 0x7fd4ac06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4aa59c640 1 -- 172.21.15.167:0/1132124737 >> v1:172.21.15.178:6789/0 conn(0x7fd4ac0c6ff0 legacy=0x7fd4ac0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4aa59c640 1 -- 172.21.15.167:0/1132124737 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac0c6500 con 0x7fd4ac150b40 2023-11-28T20:58:36.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4aa59c640 1 --2- 172.21.15.167:0/1132124737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac150b40 0x7fd4ac157560 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0cc270 tx=0x7fd49c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ace1e71d943fa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4a959a640 1 -- 172.21.15.167:0/1132124737 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0a5770 con 0x7fd4ac150b40 2023-11-28T20:58:36.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4a959a640 1 -- 172.21.15.167:0/1132124737 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c0a58d0 con 0x7fd4ac150b40 2023-11-28T20:58:36.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.358+0000 7fd4a959a640 1 -- 172.21.15.167:0/1132124737 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0a5c60 con 0x7fd4ac150b40 2023-11-28T20:58:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/1132124737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac150b40 msgr2=0x7fd4ac157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 --2- 172.21.15.167:0/1132124737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac150b40 0x7fd4ac157560 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0cc270 tx=0x7fd49c01c9a0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/1132124737 shutdown_connections 2023-11-28T20:58:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 --2- 172.21.15.167:0/1132124737 >> v2:172.21.15.178:3300/0 conn(0x7fd4ac0c4510 0x7fd4ac06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 --2- 172.21.15.167:0/1132124737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac150b40 0x7fd4ac157560 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/1132124737 >> 172.21.15.167:0/1132124737 conn(0x7fd4ac0cb1e0 msgr2=0x7fd4ac0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/1132124737 shutdown_connections 2023-11-28T20:58:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/1132124737 wait complete. 2023-11-28T20:58:36.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 Processor -- start 2023-11-28T20:58:36.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 -- start start 2023-11-28T20:58:36.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4ac0c4510 0x7fd4ac0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac0c6ff0 0x7fd4ac1449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac150b40 0x7fd4ac070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac144f30 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac1f11c0 con 0x7fd4ac0c4510 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4b0a6b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac154160 con 0x7fd4ac150b40 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4a9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac0c6ff0 0x7fd4ac1449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4a9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac0c6ff0 0x7fd4ac1449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58252/0 (socket says 172.21.15.167:58252) 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4a9d9b640 1 -- 172.21.15.167:0/856923911 learned_addr learned my addr 172.21.15.167:0/856923911 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4aa59c640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4ac0c4510 0x7fd4ac0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.362+0000 7fd4aad9d640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac150b40 0x7fd4ac070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4a9d9b640 1 -- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac150b40 msgr2=0x7fd4ac070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4a9d9b640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac150b40 0x7fd4ac070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4a9d9b640 1 -- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4ac0c4510 msgr2=0x7fd4ac0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4a9d9b640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4ac0c4510 0x7fd4ac0cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:36.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4a9d9b640 1 -- 172.21.15.167:0/856923911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c009b30 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4a9d9b640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac0c6ff0 0x7fd4ac1449f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c480 tx=0x7fd4a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00052d0 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a0005450 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0012870 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac1f02d0 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac1f0890 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4b0a6b640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac147600 0x7fd4ac1f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac074770 con 0x7fd4ac147600 2023-11-28T20:58:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4aa59c640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac147600 0x7fd4ac1f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4aa59c640 1 -- 172.21.15.167:0/856923911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4ac157040 con 0x7fd4ac147600 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd4a00129d0 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd4aa59c640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac147600 0x7fd4ac1f0a20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac06bba0 tx=0x7fd49c019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd49affd640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd48c0664a0 0x7fd48c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.366+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd4a0083ce0 con 0x7fd4ac0c6ff0 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.370+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0c0640 con 0x7fd4ac147600 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.370+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd49c0c0820 con 0x7fd4ac147600 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.370+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac147600 msgr2=0x7fd4ac1f0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.370+0000 7fd49affd640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac147600 0x7fd4ac1f0a20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac06bba0 tx=0x7fd49c019740 comp rx=0 tx=0).stop 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.370+0000 7fd4aad9d640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd48c0664a0 0x7fd48c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.370+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac147600 msgr2=0x7fd4ac1f0a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.370+0000 7fd49affd640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac147600 0x7fd4ac1f0a20 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac06bba0 tx=0x7fd49c019740 comp rx=0 tx=0).stop 2023-11-28T20:58:36.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.370+0000 7fd4aad9d640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd48c0664a0 0x7fd48c068960 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac145430 tx=0x7fd4a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.374+0000 7fd4b0a6b640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac0c92f0 0x7fd4ac0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:36.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.374+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0682c0 con 0x7fd4ac0c92f0 2023-11-28T20:58:36.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.374+0000 7fd4aa59c640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac0c92f0 0x7fd4ac0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:36.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.374+0000 7fd4aa59c640 1 -- 172.21.15.167:0/856923911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd4ac1f0f60 con 0x7fd4ac0c92f0 2023-11-28T20:58:36.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.374+0000 7fd4aa59c640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac0c92f0 0x7fd4ac0c9700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd49c01a5d0 tx=0x7fd49c009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:36.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.374+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0c5070 con 0x7fd4ac0c92f0 2023-11-28T20:58:36.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7fd49c0c9400 con 0x7fd4ac0c92f0 2023-11-28T20:58:36.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac0c92f0 msgr2=0x7fd4ac0c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd49affd640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac0c92f0 0x7fd4ac0c9700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd49c01a5d0 tx=0x7fd49c009810 comp rx=0 tx=0).stop 2023-11-28T20:58:36.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd49affd640 1 -- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac0c92f0 msgr2=0x7fd4ac0c9700 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:36.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd49affd640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4ac0c92f0 0x7fd4ac0c9700 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd49c01a5d0 tx=0x7fd49c009810 comp rx=0 tx=0).stop 2023-11-28T20:58:36.376 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:58:36.376 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 152, 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:58:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:58:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:36.378 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:36.379 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:58:36.380 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:58:36.381 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:36.382 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:36.383 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:58:36.384 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:36.385 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:58:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:58:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:36.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.388 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:36.389 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:36.390 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.390 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:36.390 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:58:36.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:36.390 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:36.390 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:36.390 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:36.390 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:36.390 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:36.391 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:36.391 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:58:36.391 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:58:36.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd48c0664a0 msgr2=0x7fd48c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4b0a6b640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd48c0664a0 0x7fd48c068960 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac145430 tx=0x7fd4a4008040 comp rx=0 tx=0).stop 2023-11-28T20:58:36.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac0c6ff0 msgr2=0x7fd4ac1449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:36.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4b0a6b640 1 --2- 172.21.15.167:0/856923911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4ac0c6ff0 0x7fd4ac1449f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c480 tx=0x7fd4a000c940 comp rx=0 tx=0).stop 2023-11-28T20:58:36.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4aad9d640 1 -- 172.21.15.167:0/856923911 reap_dead start 2023-11-28T20:58:36.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4aad9d640 1 -- 172.21.15.167:0/856923911 reap_dead start 2023-11-28T20:58:36.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 shutdown_connections 2023-11-28T20:58:36.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 >> 172.21.15.167:0/856923911 conn(0x7fd4ac0cb1e0 msgr2=0x7fd4ac071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:36.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 shutdown_connections 2023-11-28T20:58:36.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:36.378+0000 7fd4b0a6b640 1 -- 172.21.15.167:0/856923911 wait complete. 2023-11-28T20:58:36.394 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:58:36.394 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2023-11-28T20:58:36.394 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2023-11-28T20:58:36.395 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2023-11-28T20:58:36.395 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:58:36.395 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T20:58:36.395 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:58:36.415 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T20:58:36.415 INFO:tasks.mon_thrash:Sending STOP to mon b 2023-11-28T20:58:36.415 INFO:tasks.ceph.mon.b:Sent signal 19 2023-11-28T20:58:36.415 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2023-11-28T20:58:43.330 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 12% (33/258) Updating files: 13% (34/258) Updating files: 14% (37/258) Updating files: 15% (39/258) Updating files: 16% (42/258) Updating files: 17% (44/258) Updating files: 18% (47/258) Updating files: 19% (50/258) Updating files: 20% (52/258) Updating files: 21% (55/258) Updating files: 22% (57/258) Updating files: 23% (60/258) Updating files: 24% (62/258) Updating files: 25% (65/258) Updating files: 26% (68/258) Updating files: 27% (70/258) Updating files: 28% (73/258) Updating files: 29% (75/258) Updating files: 30% (78/258) Updating files: 31% (80/258) Updating files: 32% (83/258) Updating files: 33% (86/258) Updating files: 34% (88/258) Updating files: 35% (91/258) Updating files: 36% (93/258) Updating files: 37% (96/258) Updating files: 38% (99/258) Updating files: 39% (101/258) Updating files: 40% (104/258) Updating files: 41% (106/258) Updating files: 42% (109/258) Updating files: 43% (111/258) Updating files: 44% (114/258) Updating files: 45% (117/258) Updating files: 46% (119/258) Updating files: 47% (122/258) Updating files: 48% (124/258) Updating files: 49% (127/258) Updating files: 49% (128/258) Updating files: 50% (129/258) Updating files: 51% (132/258) Updating files: 52% (135/258) Updating files: 53% (137/258) Updating files: 54% (140/258) Updating files: 55% (142/258) Updating files: 56% (145/258) Updating files: 57% (148/258) Updating files: 58% (150/258) Updating files: 59% (153/258) Updating files: 60% (155/258) Updating files: 61% (158/258) Updating files: 62% (160/258) Updating files: 63% (163/258) Updating files: 64% (166/258) Updating files: 65% (168/258) Updating files: 66% (171/258) Updating files: 67% (173/258) Updating files: 68% (176/258) Updating files: 69% (179/258) Updating files: 70% (181/258) Updating files: 71% (184/258) Updating files: 72% (186/258) Updating files: 73% (189/258) Updating files: 74% (191/258) Updating files: 75% (194/258) Updating files: 76% (197/258) Updating files: 77% (199/258) Updating files: 78% (202/258) Updating files: 79% (204/258) Updating files: 80% (207/258) Updating files: 81% (209/258) Updating files: 82% (212/258) Updating files: 83% (215/258) Updating files: 84% (217/258) Updating files: 85% (220/258) Updating files: 86% (222/258) Updating files: 87% (225/258) Updating files: 88% (228/258) Updating files: 89% (230/258) Updating files: 90% (233/258) Updating files: 91% (235/258) Updating files: 92% (238/258) Updating files: 93% (240/258) Updating files: 94% (243/258) Updating files: 95% (246/258) Updating files: 96% (248/258) Updating files: 97% (251/258) Updating files: 98% (253/258) Updating files: 99% (256/258) Updating files: 99% (257/258) Updating files: 100% (258/258) Updating files: 100% (258/258), done. 2023-11-28T20:58:44.619 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 321ecdaba2c v0.39 2023-11-28T20:58:44.624 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.39 2023-11-28T20:58:45.593 INFO:tasks.workunit.client.0.smithi167.stdout:v0.40 2023-11-28T20:58:45.593 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 40 -eq 48 ] 2023-11-28T20:58:45.593 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.40 2023-11-28T20:58:45.594 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.40 2023-11-28T20:58:45.594 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.40 2023-11-28T20:58:51.416 INFO:tasks.mon_thrash:Sending CONT to mon b 2023-11-28T20:58:51.417 INFO:tasks.ceph.mon.b:Sent signal 18 2023-11-28T20:58:51.417 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:58:51.417 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:58:51.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.562+0000 7f641f716640 1 Processor -- start 2023-11-28T20:58:51.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.562+0000 7f641f716640 1 -- start start 2023-11-28T20:58:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.566+0000 7f641f716640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 0x7f6418066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.566+0000 7f641f716640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64180c8280 con 0x7f641806d530 2023-11-28T20:58:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.566+0000 7f641f716640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64180c8910 con 0x7f641815d3b0 2023-11-28T20:58:51.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.566+0000 7f641f716640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6418066bc0 con 0x7f64180aff70 2023-11-28T20:58:51.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.566+0000 7f641d4b2640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 msgr2=0x7f6418066680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:58:51.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.566+0000 7f641ccb1640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f641806d530 legacy=0x7f641806b690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:58:51.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.566+0000 7f641d4b2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 0x7f6418066680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:51.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.566+0000 7f641dcb3640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f641815d3b0 0x7f64181646e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:43424/0 (socket says 172.21.15.167:43424) 2023-11-28T20:58:51.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.566+0000 7f641dcb3640 1 -- 172.21.15.167:0/751259743 learned_addr learned my addr 172.21.15.167:0/751259743 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:58:51.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.770+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 msgr2=0x7f6418066680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:58:51.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.770+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v1:172.21.15.167:6789/0 conn(0x7f641806d530 legacy=0x7f641806b690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:58:51.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:51.770+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 0x7f6418066680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:58:51.865 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:51.869 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:52.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:52.174+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 msgr2=0x7f6418066680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:58:52.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:52.174+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v1:172.21.15.167:6789/0 conn(0x7f641806d530 legacy=0x7f641806b690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:58:52.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:52.174+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 0x7f6418066680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:58:52.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:52.978+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 msgr2=0x7f6418066680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:58:53.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:52.978+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v1:172.21.15.167:6789/0 conn(0x7f641806d530 legacy=0x7f641806b690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:58:53.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:52.978+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 0x7f6418066680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:58:54.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 msgr2=0x7f6418066680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:54.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f640effd640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 0x7f6418066680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:54.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 >> v1:172.21.15.178:6789/0 conn(0x7f641815d3b0 legacy=0x7f64181646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:54.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 >> v1:172.21.15.167:6789/0 conn(0x7f641806d530 legacy=0x7f641806b690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f640effd640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f640effd640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6418066bc0 con 0x7f63fc0061b0 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc008d20 con 0x7f63fc0036d0 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 msgr2=0x7f63fc008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 msgr2=0x7f63fc008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:54.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 msgr2=0x7f63fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:58:54.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 msgr2=0x7f63fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:54.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:54.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.566+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 msgr2=0x7f63fc008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:58:54.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 msgr2=0x7f63fc008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:58:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 msgr2=0x7f63fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:58:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 msgr2=0x7f63fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:54.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:54.770+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:58:55.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:55.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:55.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 msgr2=0x7f63fc008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:58:55.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 msgr2=0x7f63fc008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:55.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:55.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:58:55.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 msgr2=0x7f63fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:58:55.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 msgr2=0x7f63fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:55.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:55.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.174+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:58:55.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:55.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:55.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 msgr2=0x7f63fc008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:58:55.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641ccb1640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 msgr2=0x7f63fc008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:55.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:55.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:58:55.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 msgr2=0x7f63fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:58:55.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 msgr2=0x7f63fc005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:58:55.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:58:55.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:55.977+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:58:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 msgr2=0x7f63fc005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640effd640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63fc0036d0 0x7f63fc005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 msgr2=0x7f63fc008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640effd640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.178:3300/0 conn(0x7f63fc0061b0 0x7f63fc008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f641dcb3640 1 -- 172.21.15.167:0/751259743 reap_dead start 2023-11-28T20:58:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640effd640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 0x7f63fc011fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64180ca3b0 con 0x7f641806d530 2023-11-28T20:58:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64180c8280 con 0x7f641815d3b0 2023-11-28T20:58:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640effd640 1 -- 172.21.15.167:0/751259743 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6418066bc0 con 0x7f64180aff70 2023-11-28T20:58:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> v1:172.21.15.167:6789/0 conn(0x7f641806d530 legacy=0x7f63fc00b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:58:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f641dcb3640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 msgr2=0x7f63fc011fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:58:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f641dcb3640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 0x7f63fc011fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411326473 0 0) 0x7f64180c8280 con 0x7f641815d3b0 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6404003530 con 0x7f641815d3b0 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 679563896 0 0) 0x7f6404003530 con 0x7f641815d3b0 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 msgr2=0x7f63fc011fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 --2- 172.21.15.167:0/751259743 >> v2:172.21.15.167:3300/0 conn(0x7f64180aff70 0x7f63fc011fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 >> v1:172.21.15.167:6789/0 conn(0x7f641806d530 legacy=0x7f63fc00b0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc004b20 con 0x7f641815d3b0 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f640800e390 con 0x7f641815d3b0 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 >> v1:172.21.15.178:6789/0 conn(0x7f641815d3b0 legacy=0x7f63fc00e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6404003980 0x7f6404003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64040047d0 0x7f6404004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64040052b0 0x7f640400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6418066bc0 con 0x7f64040052b0 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640400c200 con 0x7f6404003980 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640400c3c0 con 0x7f64040047d0 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f641dcb3640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64040052b0 msgr2=0x7f640400b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.565+0000 7f641dcb3640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64040052b0 0x7f640400b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6404003980 0x7f6404003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64040047d0 0x7f6404004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64040047d0 msgr2=0x7f6404004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64040047d0 0x7f6404004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64040052b0 msgr2=0x7f640400b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:57.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64040052b0 0x7f640400b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641d4b2640 1 -- 172.21.15.167:0/751259743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404003530 con 0x7f6404003980 2023-11-28T20:58:57.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641dcb3640 1 -- 172.21.15.167:0/751259743 reap_dead start 2023-11-28T20:58:57.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641ccb1640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64040047d0 0x7f6404004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:58:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.569+0000 7f641d4b2640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6404003980 0x7f6404003d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6414003990 tx=0x7f641401d2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51c891c64694115e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64140ae410 con 0x7f6404003980 2023-11-28T20:58:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64140a8030 con 0x7f6404003980 2023-11-28T20:58:57.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f640ffff640 1 -- 172.21.15.167:0/751259743 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64140ae5d0 con 0x7f6404003980 2023-11-28T20:58:57.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f641f716640 1 -- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6404003980 msgr2=0x7f6404003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f641f716640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6404003980 0x7f6404003d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6414003990 tx=0x7f641401d2f0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f641f716640 1 -- 172.21.15.167:0/751259743 shutdown_connections 2023-11-28T20:58:57.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f641f716640 1 --2- 172.21.15.167:0/751259743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6404003980 0x7f6404003d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f641f716640 1 -- 172.21.15.167:0/751259743 >> 172.21.15.167:0/751259743 conn(0x7f641806ee00 msgr2=0x7f641806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:57.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f641f716640 1 -- 172.21.15.167:0/751259743 shutdown_connections 2023-11-28T20:58:57.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f641f716640 1 -- 172.21.15.167:0/751259743 wait complete. 2023-11-28T20:58:57.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f641f716640 1 Processor -- start 2023-11-28T20:58:57.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.573+0000 7f641f716640 1 -- start start 2023-11-28T20:58:57.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641f716640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6404003980 0x7f6418150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641f716640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64180c7820 0x7f64180c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641f716640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64180c6fa0 0x7f641814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641f716640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64180c5960 con 0x7f64180c6fa0 2023-11-28T20:58:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641f716640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64181ef4f0 con 0x7f64180c7820 2023-11-28T20:58:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641f716640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64181f04a0 con 0x7f6404003980 2023-11-28T20:58:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641dcb3640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64180c6fa0 msgr2=0x7f641814f290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:58:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641dcb3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64180c6fa0 0x7f641814f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641d4b2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6404003980 0x7f6418150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641ccb1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64180c7820 0x7f64180c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641d4b2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6404003980 0x7f6418150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:60660/0 (socket says 172.21.15.167:60660) 2023-11-28T20:58:57.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641d4b2640 1 -- 172.21.15.167:0/3019507051 learned_addr learned my addr 172.21.15.167:0/3019507051 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:57.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641ccb1640 1 -- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6404003980 msgr2=0x7f6418150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641ccb1640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6404003980 0x7f6418150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641ccb1640 1 -- 172.21.15.167:0/3019507051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64180c6fa0 msgr2=0x7f641814f290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641ccb1640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64180c6fa0 0x7f641814f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641ccb1640 1 -- 172.21.15.167:0/3019507051 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64181f0010 con 0x7f64180c7820 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641d4b2640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6404003980 0x7f6418150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641ccb1640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64180c7820 0x7f64180c26a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6408000eb0 tx=0x7f640800fd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f640dffb640 1 -- 172.21.15.167:0/3019507051 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408014cb0 con 0x7f64180c7820 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f640dffb640 1 -- 172.21.15.167:0/3019507051 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6408014e10 con 0x7f64180c7820 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f640dffb640 1 -- 172.21.15.167:0/3019507051 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408016630 con 0x7f64180c7820 2023-11-28T20:58:57.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64180c5050 con 0x7f64180c7820 2023-11-28T20:58:57.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64180c4d70 con 0x7f64180c7820 2023-11-28T20:58:57.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.577+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64180c8b20 con 0x7f64180c7820 2023-11-28T20:58:57.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.581+0000 7f640dffb640 1 -- 172.21.15.167:0/3019507051 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6408016790 con 0x7f64180c7820 2023-11-28T20:58:57.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.581+0000 7f640dffb640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f63fc069940 0x7f63fc06be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.581+0000 7f640dffb640 1 -- 172.21.15.167:0/3019507051 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6408084e90 con 0x7f64180c7820 2023-11-28T20:58:57.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.581+0000 7f641d4b2640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f63fc069940 0x7f63fc06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.581+0000 7f641d4b2640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f63fc069940 0x7f63fc06be00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f641401d120 tx=0x7f6414005d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:57.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.593+0000 7f640dffb640 1 -- 172.21.15.167:0/3019507051 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6408052060 con 0x7f64180c7820 2023-11-28T20:58:57.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.805+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f64181f01a0 con 0x7f64180c7820 2023-11-28T20:58:57.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.805+0000 7f640dffb640 1 -- 172.21.15.167:0/3019507051 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f6408055680 con 0x7f64180c7820 2023-11-28T20:58:57.806 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":154,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:58:57.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f63fc069940 msgr2=0x7f63fc06be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f63fc069940 0x7f63fc06be00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f641401d120 tx=0x7f6414005d80 comp rx=0 tx=0).stop 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64180c7820 msgr2=0x7f64180c26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64180c7820 0x7f64180c26a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6408000eb0 tx=0x7f640800fd60 comp rx=0 tx=0).stop 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 shutdown_connections 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f63fc069940 0x7f63fc06be00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64180c6fa0 0x7f641814f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64180c7820 0x7f64180c26a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 --2- 172.21.15.167:0/3019507051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6404003980 0x7f6418150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 >> 172.21.15.167:0/3019507051 conn(0x7f641806ee00 msgr2=0x7f64180c9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 shutdown_connections 2023-11-28T20:58:57.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.809+0000 7f641f716640 1 -- 172.21.15.167:0/3019507051 wait complete. 2023-11-28T20:58:57.827 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T20:58:57.827 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T20:58:57.827 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:58:57.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf23f1d640 1 Processor -- start 2023-11-28T20:58:57.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf23f1d640 1 -- start start 2023-11-28T20:58:57.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf23f1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c151f60 0x7fdf1c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf23f1d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c15b220 con 0x7fdf1c0c5c90 2023-11-28T20:58:57.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf23f1d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c0c60f0 con 0x7fdf1c06a580 2023-11-28T20:58:57.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf23f1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0c4da0 con 0x7fdf1c151f60 2023-11-28T20:58:57.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf214b8640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fdf1c0c5c90 legacy=0x7fdf1c0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:58:57.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf21cb9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c151f60 0x7fdf1c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf224ba640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fdf1c06a580 0x7fdf1c1625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:55874/0 (socket says 172.21.15.167:55874) 2023-11-28T20:58:57.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf224ba640 1 -- 172.21.15.167:0/3042642303 learned_addr learned my addr 172.21.15.167:0/3042642303 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:58:57.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf20cb7640 1 -- 172.21.15.167:0/3042642303 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610607015 0 0) 0x7fdf1c0c60f0 con 0x7fdf1c06a580 2023-11-28T20:58:57.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf20cb7640 1 -- 172.21.15.167:0/3042642303 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf08003530 con 0x7fdf1c06a580 2023-11-28T20:58:57.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf21cb9640 1 -- 172.21.15.167:0/3042642303 >> v1:172.21.15.178:6789/0 conn(0x7fdf1c06a580 legacy=0x7fdf1c1625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf21cb9640 1 -- 172.21.15.167:0/3042642303 >> v1:172.21.15.167:6789/0 conn(0x7fdf1c0c5c90 legacy=0x7fdf1c0c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:57.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.969+0000 7fdf21cb9640 1 -- 172.21.15.167:0/3042642303 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c152340 con 0x7fdf1c151f60 2023-11-28T20:58:57.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf21cb9640 1 --2- 172.21.15.167:0/3042642303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c151f60 0x7fdf1c0c75c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf180097f0 tx=0x7fdf1801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce89b2b8aa45772d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:57.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf20cb7640 1 -- 172.21.15.167:0/3042642303 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180ab400 con 0x7fdf1c151f60 2023-11-28T20:58:57.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf20cb7640 1 -- 172.21.15.167:0/3042642303 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf180a7050 con 0x7fdf1c151f60 2023-11-28T20:58:57.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf20cb7640 1 -- 172.21.15.167:0/3042642303 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180ab760 con 0x7fdf1c151f60 2023-11-28T20:58:57.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf23f1d640 1 -- 172.21.15.167:0/3042642303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c151f60 msgr2=0x7fdf1c0c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf23f1d640 1 --2- 172.21.15.167:0/3042642303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c151f60 0x7fdf1c0c75c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf180097f0 tx=0x7fdf1801c3b0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf23f1d640 1 -- 172.21.15.167:0/3042642303 shutdown_connections 2023-11-28T20:58:57.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf23f1d640 1 --2- 172.21.15.167:0/3042642303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c151f60 0x7fdf1c0c75c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf23f1d640 1 -- 172.21.15.167:0/3042642303 >> 172.21.15.167:0/3042642303 conn(0x7fdf1c0cb1e0 msgr2=0x7fdf1c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:57.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf23f1d640 1 -- 172.21.15.167:0/3042642303 shutdown_connections 2023-11-28T20:58:57.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.973+0000 7fdf23f1d640 1 -- 172.21.15.167:0/3042642303 wait complete. 2023-11-28T20:58:57.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf23f1d640 1 Processor -- start 2023-11-28T20:58:57.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf23f1d640 1 -- start start 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf23f1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c06a580 0x7fdf1c14e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf23f1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c0c5c90 0x7fdf1c1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf23f1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c151f60 0x7fdf1c0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf23f1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c1453d0 con 0x7fdf1c0c5c90 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf23f1d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c1456b0 con 0x7fdf1c151f60 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf23f1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c145990 con 0x7fdf1c06a580 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf214b8640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c0c5c90 msgr2=0x7fdf1c1594b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf214b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c0c5c90 0x7fdf1c1594b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf224ba640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c151f60 0x7fdf1c0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf21cb9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c06a580 0x7fdf1c14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf224ba640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c151f60 0x7fdf1c0714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:50982/0 (socket says 172.21.15.167:50982) 2023-11-28T20:58:57.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf224ba640 1 -- 172.21.15.167:0/1417621883 learned_addr learned my addr 172.21.15.167:0/1417621883 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:57.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf224ba640 1 -- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c06a580 msgr2=0x7fdf1c14e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf224ba640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c06a580 0x7fdf1c14e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf224ba640 1 -- 172.21.15.167:0/1417621883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c0c5c90 msgr2=0x7fdf1c1594b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:58:57.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf224ba640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c0c5c90 0x7fdf1c1594b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf224ba640 1 -- 172.21.15.167:0/1417621883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18009420 con 0x7fdf1c151f60 2023-11-28T20:58:57.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf21cb9640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c06a580 0x7fdf1c14e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:58:57.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.977+0000 7fdf224ba640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c151f60 0x7fdf1c0714d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c8c0 tx=0x7fdf1400cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:57.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400a640 con 0x7fdf1c151f60 2023-11-28T20:58:57.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1400a7a0 con 0x7fdf1c151f60 2023-11-28T20:58:57.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c145c70 con 0x7fdf1c151f60 2023-11-28T20:58:57.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400ab10 con 0x7fdf1c151f60 2023-11-28T20:58:57.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c0c7880 con 0x7fdf1c151f60 2023-11-28T20:58:57.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf23f1d640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c1448b0 0x7fdf1c071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c074770 con 0x7fdf1c1448b0 2023-11-28T20:58:57.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf21cb9640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c1448b0 0x7fdf1c071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf21cb9640 1 -- 172.21.15.167:0/1417621883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf1c06ada0 con 0x7fdf1c1448b0 2023-11-28T20:58:57.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf21cb9640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c1448b0 0x7fdf1c071a10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c06fe60 tx=0x7fdf18019150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:57.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.981+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdf1400ac70 con 0x7fdf1c151f60 2023-11-28T20:58:57.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf127fc640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdf00066420 0x7fdf000688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fdf14083be0 con 0x7fdf1c151f60 2023-11-28T20:58:57.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18006e20 con 0x7fdf1c1448b0 2023-11-28T20:58:57.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fdf180bb070 con 0x7fdf1c1448b0 2023-11-28T20:58:57.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c1448b0 msgr2=0x7fdf1c071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf127fc640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c1448b0 0x7fdf1c071a10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c06fe60 tx=0x7fdf18019150 comp rx=0 tx=0).stop 2023-11-28T20:58:57.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c1448b0 msgr2=0x7fdf1c071a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:57.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf127fc640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c1448b0 0x7fdf1c071a10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf214b8640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdf00066420 0x7fdf000688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.985+0000 7fdf214b8640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdf00066420 0x7fdf000688e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c146aa0 tx=0x7fdf0c006d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:57.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.989+0000 7fdf23f1d640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c146570 0x7fdf1c071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:57.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.989+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c15ba30 con 0x7fdf1c146570 2023-11-28T20:58:57.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.989+0000 7fdf21cb9640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c146570 0x7fdf1c071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:57.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.989+0000 7fdf21cb9640 1 -- 172.21.15.167:0/1417621883 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdf1c15bf50 con 0x7fdf1c146570 2023-11-28T20:58:57.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf21cb9640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c146570 0x7fdf1c071f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf180097f0 tx=0x7fdf180a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:57.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180c0930 con 0x7fdf1c146570 2023-11-28T20:58:57.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4801 (secure 0 0 0) 0x7fdf180ca070 con 0x7fdf1c146570 2023-11-28T20:58:57.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c146570 msgr2=0x7fdf1c071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:57.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf127fc640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c146570 0x7fdf1c071f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf180097f0 tx=0x7fdf180a8000 comp rx=0 tx=0).stop 2023-11-28T20:58:57.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf127fc640 1 -- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c146570 msgr2=0x7fdf1c071f50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:57.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf127fc640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c146570 0x7fdf1c071f50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:57.993 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:58:57.993 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:57.993 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:57.993 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:58:57.993 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 154, 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:57.994 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:57.995 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:58:57.996 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:58:57.997 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:57.998 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:57.999 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:58:58.000 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:58:58.001 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:58.002 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.003 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:58.004 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:58:58.005 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.006 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:58:58.007 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.007 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:58.007 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.007 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:58:58.007 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.007 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.007 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.007 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:58:58.007 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:58:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdf00066420 msgr2=0x7fdf000688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf23f1d640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdf00066420 0x7fdf000688e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c146aa0 tx=0x7fdf0c006d90 comp rx=0 tx=0).stop 2023-11-28T20:58:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c151f60 msgr2=0x7fdf1c0714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf23f1d640 1 --2- 172.21.15.167:0/1417621883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c151f60 0x7fdf1c0714d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c8c0 tx=0x7fdf1400cd80 comp rx=0 tx=0).stop 2023-11-28T20:58:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf224ba640 1 -- 172.21.15.167:0/1417621883 reap_dead start 2023-11-28T20:58:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf224ba640 1 -- 172.21.15.167:0/1417621883 reap_dead start 2023-11-28T20:58:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 shutdown_connections 2023-11-28T20:58:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 >> 172.21.15.167:0/1417621883 conn(0x7fdf1c0cb1e0 msgr2=0x7fdf1c150540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:58.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 shutdown_connections 2023-11-28T20:58:58.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:57.993+0000 7fdf23f1d640 1 -- 172.21.15.167:0/1417621883 wait complete. 2023-11-28T20:58:58.010 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:58:58.011 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T20:58:58.011 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:58:58.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.149+0000 7f28b7bf8640 1 Processor -- start 2023-11-28T20:58:58.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.149+0000 7f28b7bf8640 1 -- start start 2023-11-28T20:58:58.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.149+0000 7f28b7bf8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28b01585d0 0x7f28b00c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:58.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.149+0000 7f28b7bf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b015e130 0x7f28b0161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:58.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.149+0000 7f28b7bf8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b015e5e0 con 0x7f28b00c7720 2023-11-28T20:58:58.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.149+0000 7f28b7bf8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b015f160 con 0x7f28b01585d0 2023-11-28T20:58:58.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.149+0000 7f28b7bf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b015e8c0 con 0x7f28b015e130 2023-11-28T20:58:58.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.149+0000 7f28b6195640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f28b00c7720 legacy=0x7f28b006a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T20:58:58.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.153+0000 7f28b5994640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28b01585d0 0x7f28b00c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:58.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.153+0000 7f28b5193640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b015e130 0x7f28b0161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:58.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.153+0000 7f28b5994640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28b01585d0 0x7f28b00c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:51006/0 (socket says 172.21.15.167:51006) 2023-11-28T20:58:58.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.153+0000 7f28b5994640 1 -- 172.21.15.167:0/1563034002 learned_addr learned my addr 172.21.15.167:0/1563034002 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:58.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.153+0000 7f28b5994640 1 -- 172.21.15.167:0/1563034002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b015e130 msgr2=0x7f28b0161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:58:58.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.153+0000 7f28b5994640 1 --2- 172.21.15.167:0/1563034002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b015e130 0x7f28b0161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:58.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.153+0000 7f28b5994640 1 -- 172.21.15.167:0/1563034002 >> v1:172.21.15.167:6789/0 conn(0x7f28b00c7720 legacy=0x7f28b006a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:58:58.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.153+0000 7f28b5994640 1 -- 172.21.15.167:0/1563034002 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b015eba0 con 0x7f28b01585d0 2023-11-28T20:58:58.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.153+0000 7f28b5994640 1 --2- 172.21.15.167:0/1563034002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b01585d0 0x7f28b00c5e90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009870 tx=0x7f28ac01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b956926ce2c050 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:58.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b4992640 1 -- 172.21.15.167:0/1563034002 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0ac600 con 0x7f28b01585d0 2023-11-28T20:58:58.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b4992640 1 -- 172.21.15.167:0/1563034002 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac0a8050 con 0x7f28b01585d0 2023-11-28T20:58:58.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b4992640 1 -- 172.21.15.167:0/1563034002 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0ac980 con 0x7f28b01585d0 2023-11-28T20:58:58.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 -- 172.21.15.167:0/1563034002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b01585d0 msgr2=0x7f28b00c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:58.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 --2- 172.21.15.167:0/1563034002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b01585d0 0x7f28b00c5e90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009870 tx=0x7f28ac01c4d0 comp rx=0 tx=0).stop 2023-11-28T20:58:58.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 -- 172.21.15.167:0/1563034002 shutdown_connections 2023-11-28T20:58:58.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 --2- 172.21.15.167:0/1563034002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b015e130 0x7f28b0161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:58.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 --2- 172.21.15.167:0/1563034002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b01585d0 0x7f28b00c5e90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:58.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 -- 172.21.15.167:0/1563034002 >> 172.21.15.167:0/1563034002 conn(0x7f28b00cb1e0 msgr2=0x7f28b00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:58.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 -- 172.21.15.167:0/1563034002 shutdown_connections 2023-11-28T20:58:58.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 -- 172.21.15.167:0/1563034002 wait complete. 2023-11-28T20:58:58.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 Processor -- start 2023-11-28T20:58:58.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 -- start start 2023-11-28T20:58:58.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b00c7720 0x7f28b015ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:58.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01585d0 0x7f28b01f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:58.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b015e130 0x7f28b01f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:58.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b0151ae0 con 0x7f28b015e130 2023-11-28T20:58:58.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b01fa840 con 0x7f28b00c7720 2023-11-28T20:58:58.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b7bf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b01faae0 con 0x7f28b01585d0 2023-11-28T20:58:58.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.157+0000 7f28b6195640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b015e130 msgr2=0x7f28b01f7e40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b6195640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b015e130 0x7f28b01f7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5193640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01585d0 0x7f28b01f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5994640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b00c7720 0x7f28b015ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5193640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01585d0 0x7f28b01f7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:60694/0 (socket says 172.21.15.167:60694) 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5193640 1 -- 172.21.15.167:0/2420104524 learned_addr learned my addr 172.21.15.167:0/2420104524 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5193640 1 -- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b00c7720 msgr2=0x7f28b015ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5193640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28b00c7720 0x7f28b015ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5193640 1 -- 172.21.15.167:0/2420104524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b015e130 msgr2=0x7f28b01f7e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5193640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28b015e130 0x7f28b01f7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:58:58.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5193640 1 -- 172.21.15.167:0/2420104524 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0094d0 con 0x7f28b01585d0 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5193640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01585d0 0x7f28b01f7900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f28a000e840 tx=0x7f28a000ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0009510 con 0x7f28b01585d0 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a000ee90 con 0x7f28b01585d0 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000cb80 con 0x7f28b01585d0 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b01fadc0 con 0x7f28b01585d0 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b01fb380 con 0x7f28b01585d0 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b7bf8640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01f72d0 0x7f28b01483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b0074770 con 0x7f28b01f72d0 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5994640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01f72d0 0x7f28b01483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:58.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.161+0000 7f28b5994640 1 -- 172.21.15.167:0/2420104524 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28b00680b0 con 0x7f28b01f72d0 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28b5994640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01f72d0 0x7f28b01483a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f28b006c260 tx=0x7f28ac019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28a000cce0 con 0x7f28b01585d0 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28a67fc640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2894066420 0x7f28940688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f28a0084230 con 0x7f28b01585d0 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0c0640 con 0x7f28b01f72d0 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f28ac0ace10 con 0x7f28b01f72d0 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01f72d0 msgr2=0x7f28b01483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28a67fc640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01f72d0 0x7f28b01483a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f28b006c260 tx=0x7f28ac019270 comp rx=0 tx=0).stop 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01f72d0 msgr2=0x7f28b01483a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:58.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28a67fc640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01f72d0 0x7f28b01483a0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f28b006c260 tx=0x7f28ac019270 comp rx=0 tx=0).stop 2023-11-28T20:58:58.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28b6195640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2894066420 0x7f28940688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:58.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.165+0000 7f28b6195640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2894066420 0x7f28940688e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f28a8003d10 tx=0x7f28a8009270 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:58.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.169+0000 7f28b7bf8640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b0148f50 0x7f28b01488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:58:58.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.169+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b016b2d0 con 0x7f28b0148f50 2023-11-28T20:58:58.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.169+0000 7f28b5994640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b0148f50 0x7f28b01488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:58:58.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.169+0000 7f28b5994640 1 -- 172.21.15.167:0/2420104524 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f28b00682c0 con 0x7f28b0148f50 2023-11-28T20:58:58.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b5994640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b0148f50 0x7f28b01488e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28ac01cd70 tx=0x7f28ac009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:58:58.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0c4040 con 0x7f28b0148f50 2023-11-28T20:58:58.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5112 (secure 0 0 0) 0x7f28ac003820 con 0x7f28b0148f50 2023-11-28T20:58:58.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b0148f50 msgr2=0x7f28b01488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:58.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28a67fc640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b0148f50 0x7f28b01488e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28ac01cd70 tx=0x7f28ac009240 comp rx=0 tx=0).stop 2023-11-28T20:58:58.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28a67fc640 1 -- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b0148f50 msgr2=0x7f28b01488e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:58:58.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28a67fc640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b0148f50 0x7f28b01488e0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28ac01cd70 tx=0x7f28ac009240 comp rx=0 tx=0).stop 2023-11-28T20:58:58.173 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 154, 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:58.174 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:58.175 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:58.176 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:58:58.177 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:58:58.178 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.179 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:58.180 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.181 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:58.182 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.183 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:58:58.184 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.185 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:58:58.186 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:58:58.187 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T20:58:58.188 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:58:58.189 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:58:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2894066420 msgr2=0x7f28940688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b7bf8640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2894066420 0x7f28940688e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f28a8003d10 tx=0x7f28a8009270 comp rx=0 tx=0).stop 2023-11-28T20:58:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01585d0 msgr2=0x7f28b01f7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:58:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b7bf8640 1 --2- 172.21.15.167:0/2420104524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28b01585d0 0x7f28b01f7900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f28a000e840 tx=0x7f28a000ec40 comp rx=0 tx=0).stop 2023-11-28T20:58:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b6195640 1 -- 172.21.15.167:0/2420104524 reap_dead start 2023-11-28T20:58:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b6195640 1 -- 172.21.15.167:0/2420104524 reap_dead start 2023-11-28T20:58:58.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 shutdown_connections 2023-11-28T20:58:58.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 >> 172.21.15.167:0/2420104524 conn(0x7f28b00cb1e0 msgr2=0x7f28b00c7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:58:58.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 shutdown_connections 2023-11-28T20:58:58.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:58:58.173+0000 7f28b7bf8640 1 -- 172.21.15.167:0/2420104524 wait complete. 2023-11-28T20:58:58.192 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T20:58:58.192 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T20:59:01.242 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 7% (16/226) Updating files: 8% (19/226) Updating files: 9% (21/226) Updating files: 10% (23/226) Updating files: 11% (25/226) Updating files: 12% (28/226) Updating files: 13% (30/226) Updating files: 14% (32/226) Updating files: 15% (34/226) Updating files: 16% (37/226) Updating files: 17% (39/226) Updating files: 18% (41/226) Updating files: 19% (43/226) Updating files: 20% (46/226) Updating files: 21% (48/226) Updating files: 22% (50/226) Updating files: 23% (52/226) Updating files: 24% (55/226) Updating files: 25% (57/226) Updating files: 26% (59/226) Updating files: 27% (62/226) Updating files: 28% (64/226) Updating files: 29% (66/226) Updating files: 30% (68/226) Updating files: 31% (71/226) Updating files: 32% (73/226) Updating files: 32% (74/226) Updating files: 33% (75/226) Updating files: 34% (77/226) Updating files: 35% (80/226) Updating files: 36% (82/226) Updating files: 37% (84/226) Updating files: 38% (86/226) Updating files: 39% (89/226) Updating files: 40% (91/226) Updating files: 41% (93/226) Updating files: 42% (95/226) Updating files: 43% (98/226) Updating files: 44% (100/226) Updating files: 45% (102/226) Updating files: 46% (104/226) Updating files: 47% (107/226) Updating files: 48% (109/226) Updating files: 49% (111/226) Updating files: 50% (113/226) Updating files: 51% (116/226) Updating files: 52% (118/226) Updating files: 53% (120/226) Updating files: 54% (123/226) Updating files: 55% (125/226) Updating files: 56% (127/226) Updating files: 57% (129/226) Updating files: 58% (132/226) Updating files: 59% (134/226) Updating files: 60% (136/226) Updating files: 61% (138/226) Updating files: 62% (141/226) Updating files: 63% (143/226) Updating files: 64% (145/226) Updating files: 65% (147/226) Updating files: 66% (150/226) Updating files: 67% (152/226) Updating files: 68% (154/226) Updating files: 69% (156/226) Updating files: 70% (159/226) Updating files: 71% (161/226) Updating files: 72% (163/226) Updating files: 73% (165/226) Updating files: 74% (168/226) Updating files: 75% (170/226) Updating files: 76% (172/226) Updating files: 76% (173/226) Updating files: 77% (175/226) Updating files: 78% (177/226) Updating files: 79% (179/226) Updating files: 80% (181/226) Updating files: 81% (184/226) Updating files: 82% (186/226) Updating files: 83% (188/226) Updating files: 84% (190/226) Updating files: 85% (193/226) Updating files: 86% (195/226) Updating files: 87% (197/226) Updating files: 88% (199/226) Updating files: 89% (202/226) Updating files: 90% (204/226) Updating files: 91% (206/226) Updating files: 92% (208/226) Updating files: 93% (211/226) Updating files: 94% (213/226) Updating files: 95% (215/226) Updating files: 96% (217/226) Updating files: 97% (220/226) Updating files: 98% (222/226) Updating files: 99% (224/226) Updating files: 100% (226/226) Updating files: 100% (226/226), done. 2023-11-28T20:59:01.432 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at 7eea40ea37f v0.40 2023-11-28T20:59:01.436 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.40 2023-11-28T20:59:01.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 41 -eq 48 ] 2023-11-28T20:59:01.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.41 2023-11-28T20:59:01.520 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.41 2023-11-28T20:59:01.520 INFO:tasks.workunit.client.0.smithi167.stdout:v0.41 2023-11-28T20:59:01.521 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.41 2023-11-28T20:59:04.683 INFO:tasks.workunit.client.0.smithi167.stderr:Updating files: 42% (37/87) Updating files: 43% (38/87) Updating files: 44% (39/87) Updating files: 45% (40/87) Updating files: 47% (41/87) Updating files: 48% (42/87) Updating files: 49% (43/87) Updating files: 50% (44/87) Updating files: 51% (45/87) Updating files: 52% (46/87) Updating files: 54% (47/87) Updating files: 55% (48/87) Updating files: 56% (49/87) Updating files: 57% (50/87) Updating files: 58% (51/87) Updating files: 59% (52/87) Updating files: 60% (53/87) Updating files: 62% (54/87) Updating files: 63% (55/87) Updating files: 64% (56/87) Updating files: 65% (57/87) Updating files: 66% (58/87) Updating files: 67% (59/87) Updating files: 68% (60/87) Updating files: 70% (61/87) Updating files: 71% (62/87) Updating files: 72% (63/87) Updating files: 73% (64/87) Updating files: 74% (65/87) Updating files: 75% (66/87) Updating files: 77% (67/87) Updating files: 78% (68/87) Updating files: 79% (69/87) Updating files: 80% (70/87) Updating files: 81% (71/87) Updating files: 82% (72/87) Updating files: 83% (73/87) Updating files: 85% (74/87) Updating files: 86% (75/87) Updating files: 87% (76/87) Updating files: 88% (77/87) Updating files: 89% (78/87) Updating files: 90% (79/87) Updating files: 91% (80/87) Updating files: 93% (81/87) Updating files: 94% (82/87) Updating files: 95% (83/87) Updating files: 96% (84/87) Updating files: 97% (85/87) Updating files: 98% (86/87) Updating files: 100% (87/87) Updating files: 100% (87/87), done. 2023-11-28T20:59:04.801 INFO:tasks.workunit.client.0.smithi167.stdout:HEAD is now at c1345f7136a v0.41 2023-11-28T20:59:04.803 INFO:tasks.workunit.client.0.smithi167.stderr:+ mkdir .snap/v0.41 2023-11-28T20:59:05.330 INFO:tasks.workunit.client.0.smithi167.stdout:v0.42 2023-11-28T20:59:05.331 INFO:tasks.workunit.client.0.smithi167.stderr:+ [ 42 -eq 48 ] 2023-11-28T20:59:05.331 INFO:tasks.workunit.client.0.smithi167.stderr:+ ver=v0.42 2023-11-28T20:59:05.331 INFO:tasks.workunit.client.0.smithi167.stderr:+ echo v0.42 2023-11-28T20:59:05.331 INFO:tasks.workunit.client.0.smithi167.stderr:+ git reset --hard v0.42 2023-11-28T20:59:05.384 INFO:tasks.ceph.mds.c.smithi167.stderr:./src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f1341268640 time 2023-11-28T20:59:05.387431+0000 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr:./src/mds/MDSRank.cc: 944: ceph_abort_msg("abort() called") 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev) 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f1347170513] 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x560201c117a1] 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: 3: (CDentry::check_corruption(bool)+0x419) [0x560201e204c9] 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: 4: ceph-mds(+0x182c09) [0x560201c56c09] 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: 5: (Locker::_do_cap_update(CInode*, Capability*, int, snapid_t, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool*)+0xbe1) [0x560201ddea61] 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: 6: (Locker::handle_client_caps(boost::intrusive_ptr const&)+0x2084) [0x560201dd5934] 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: 7: (Locker::dispatch(boost::intrusive_ptr const&)+0x1cc) [0x560201db66cc] 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x560201c1a99b] 2023-11-28T20:59:05.385 INFO:tasks.ceph.mds.c.smithi167.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560201c1ae6c] 2023-11-28T20:59:05.386 INFO:tasks.ceph.mds.c.smithi167.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x560201c05c85] 2023-11-28T20:59:05.386 INFO:tasks.ceph.mds.c.smithi167.stderr: 11: (DispatchQueue::entry()+0x5ea) [0x7f134735c1ea] 2023-11-28T20:59:05.386 INFO:tasks.ceph.mds.c.smithi167.stderr: 12: /usr/lib/ceph/libceph-common.so.2(+0x3eea01) [0x7f13473eea01] 2023-11-28T20:59:05.386 INFO:tasks.ceph.mds.c.smithi167.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f1346894b43] 2023-11-28T20:59:05.386 INFO:tasks.ceph.mds.c.smithi167.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f1346926a00] 2023-11-28T20:59:05.386 INFO:tasks.ceph.mds.c.smithi167.stderr:*** Caught signal (Aborted) ** 2023-11-28T20:59:05.386 INFO:tasks.ceph.mds.c.smithi167.stderr: in thread 7f1341268640 thread_name:ms_dispatch 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev) 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1346842520] 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 2: pthread_kill() 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 3: raise() 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 4: abort() 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x189) [0x7f13471705c9] 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x560201c117a1] 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 7: (CDentry::check_corruption(bool)+0x419) [0x560201e204c9] 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 8: ceph-mds(+0x182c09) [0x560201c56c09] 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 9: (Locker::_do_cap_update(CInode*, Capability*, int, snapid_t, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool*)+0xbe1) [0x560201ddea61] 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 10: (Locker::handle_client_caps(boost::intrusive_ptr const&)+0x2084) [0x560201dd5934] 2023-11-28T20:59:05.387 INFO:tasks.ceph.mds.c.smithi167.stderr: 11: (Locker::dispatch(boost::intrusive_ptr const&)+0x1cc) [0x560201db66cc] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x560201c1a99b] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560201c1ae6c] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x560201c05c85] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr: 15: (DispatchQueue::entry()+0x5ea) [0x7f134735c1ea] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr: 16: /usr/lib/ceph/libceph-common.so.2(+0x3eea01) [0x7f13473eea01] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f1346894b43] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr: 18: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f1346926a00] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr:2023-11-28T20:59:05.385+0000 7f1341268640 -1 mds.1.cache.den(0x10000002d3d.111* admin_socket.h) newly corrupt dentry to be committed: [dentry #0x1/client.0/tmp/ceph/src/common/admin_socket.h [223,head] auth (dn sync l) (dversion lock) pv=2285 v=2273 ino=0x20000001a8b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x5602056c0f00] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr:2023-11-28T20:59:05.385+0000 7f1341268640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/client.0/tmp/ceph/src/common/admin_socket.h [223,head] auth (dn sync l) (dversion lock) pv=2285 v=2273 ino=0x20000001a8b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x5602056c0f00] 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr:2023-11-28T20:59:05.385+0000 7f1341268640 -1 ./src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f1341268640 time 2023-11-28T20:59:05.387431+0000 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr:./src/mds/MDSRank.cc: 944: ceph_abort_msg("abort() called") 2023-11-28T20:59:05.388 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev) 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f1347170513] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x560201c117a1] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 3: (CDentry::check_corruption(bool)+0x419) [0x560201e204c9] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 4: ceph-mds(+0x182c09) [0x560201c56c09] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 5: (Locker::_do_cap_update(CInode*, Capability*, int, snapid_t, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool*)+0xbe1) [0x560201ddea61] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 6: (Locker::handle_client_caps(boost::intrusive_ptr const&)+0x2084) [0x560201dd5934] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 7: (Locker::dispatch(boost::intrusive_ptr const&)+0x1cc) [0x560201db66cc] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x560201c1a99b] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560201c1ae6c] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x560201c05c85] 2023-11-28T20:59:05.389 INFO:tasks.ceph.mds.c.smithi167.stderr: 11: (DispatchQueue::entry()+0x5ea) [0x7f134735c1ea] 2023-11-28T20:59:05.390 INFO:tasks.ceph.mds.c.smithi167.stderr: 12: /usr/lib/ceph/libceph-common.so.2(+0x3eea01) [0x7f13473eea01] 2023-11-28T20:59:05.390 INFO:tasks.ceph.mds.c.smithi167.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f1346894b43] 2023-11-28T20:59:05.390 INFO:tasks.ceph.mds.c.smithi167.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f1346926a00] 2023-11-28T20:59:05.390 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.390 INFO:tasks.ceph.mds.c.smithi167.stderr:2023-11-28T20:59:05.385+0000 7f1341268640 -1 *** Caught signal (Aborted) ** 2023-11-28T20:59:05.390 INFO:tasks.ceph.mds.c.smithi167.stderr: in thread 7f1341268640 thread_name:ms_dispatch 2023-11-28T20:59:05.390 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev) 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1346842520] 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 2: pthread_kill() 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 3: raise() 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 4: abort() 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x189) [0x7f13471705c9] 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x560201c117a1] 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 7: (CDentry::check_corruption(bool)+0x419) [0x560201e204c9] 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 8: ceph-mds(+0x182c09) [0x560201c56c09] 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 9: (Locker::_do_cap_update(CInode*, Capability*, int, snapid_t, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool*)+0xbe1) [0x560201ddea61] 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 10: (Locker::handle_client_caps(boost::intrusive_ptr const&)+0x2084) [0x560201dd5934] 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 11: (Locker::dispatch(boost::intrusive_ptr const&)+0x1cc) [0x560201db66cc] 2023-11-28T20:59:05.391 INFO:tasks.ceph.mds.c.smithi167.stderr: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x560201c1a99b] 2023-11-28T20:59:05.392 INFO:tasks.ceph.mds.c.smithi167.stderr: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560201c1ae6c] 2023-11-28T20:59:05.392 INFO:tasks.ceph.mds.c.smithi167.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x560201c05c85] 2023-11-28T20:59:05.392 INFO:tasks.ceph.mds.c.smithi167.stderr: 15: (DispatchQueue::entry()+0x5ea) [0x7f134735c1ea] 2023-11-28T20:59:05.392 INFO:tasks.ceph.mds.c.smithi167.stderr: 16: /usr/lib/ceph/libceph-common.so.2(+0x3eea01) [0x7f13473eea01] 2023-11-28T20:59:05.392 INFO:tasks.ceph.mds.c.smithi167.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f1346894b43] 2023-11-28T20:59:05.392 INFO:tasks.ceph.mds.c.smithi167.stderr: 18: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f1346926a00] 2023-11-28T20:59:05.392 INFO:tasks.ceph.mds.c.smithi167.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-28T20:59:05.392 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.427 INFO:tasks.ceph.mds.c.smithi167.stderr: -8> 2023-11-28T20:59:05.385+0000 7f1341268640 -1 mds.1.cache.den(0x10000002d3d.111* admin_socket.h) newly corrupt dentry to be committed: [dentry #0x1/client.0/tmp/ceph/src/common/admin_socket.h [223,head] auth (dn sync l) (dversion lock) pv=2285 v=2273 ino=0x20000001a8b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x5602056c0f00] 2023-11-28T20:59:05.427 INFO:tasks.ceph.mds.c.smithi167.stderr: -6> 2023-11-28T20:59:05.385+0000 7f1341268640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/client.0/tmp/ceph/src/common/admin_socket.h [223,head] auth (dn sync l) (dversion lock) pv=2285 v=2273 ino=0x20000001a8b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x5602056c0f00] 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: -1> 2023-11-28T20:59:05.385+0000 7f1341268640 -1 ./src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f1341268640 time 2023-11-28T20:59:05.387431+0000 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr:./src/mds/MDSRank.cc: 944: ceph_abort_msg("abort() called") 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev) 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f1347170513] 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x560201c117a1] 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: 3: (CDentry::check_corruption(bool)+0x419) [0x560201e204c9] 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: 4: ceph-mds(+0x182c09) [0x560201c56c09] 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: 5: (Locker::_do_cap_update(CInode*, Capability*, int, snapid_t, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool*)+0xbe1) [0x560201ddea61] 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: 6: (Locker::handle_client_caps(boost::intrusive_ptr const&)+0x2084) [0x560201dd5934] 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: 7: (Locker::dispatch(boost::intrusive_ptr const&)+0x1cc) [0x560201db66cc] 2023-11-28T20:59:05.428 INFO:tasks.ceph.mds.c.smithi167.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x560201c1a99b] 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560201c1ae6c] 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x560201c05c85] 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 11: (DispatchQueue::entry()+0x5ea) [0x7f134735c1ea] 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 12: /usr/lib/ceph/libceph-common.so.2(+0x3eea01) [0x7f13473eea01] 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f1346894b43] 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f1346926a00] 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 0> 2023-11-28T20:59:05.385+0000 7f1341268640 -1 *** Caught signal (Aborted) ** 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: in thread 7f1341268640 thread_name:ms_dispatch 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev) 2023-11-28T20:59:05.429 INFO:tasks.ceph.mds.c.smithi167.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1346842520] 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 2: pthread_kill() 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 3: raise() 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 4: abort() 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x189) [0x7f13471705c9] 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x560201c117a1] 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 7: (CDentry::check_corruption(bool)+0x419) [0x560201e204c9] 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 8: ceph-mds(+0x182c09) [0x560201c56c09] 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 9: (Locker::_do_cap_update(CInode*, Capability*, int, snapid_t, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool*)+0xbe1) [0x560201ddea61] 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 10: (Locker::handle_client_caps(boost::intrusive_ptr const&)+0x2084) [0x560201dd5934] 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 11: (Locker::dispatch(boost::intrusive_ptr const&)+0x1cc) [0x560201db66cc] 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x560201c1a99b] 2023-11-28T20:59:05.430 INFO:tasks.ceph.mds.c.smithi167.stderr: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560201c1ae6c] 2023-11-28T20:59:05.431 INFO:tasks.ceph.mds.c.smithi167.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x560201c05c85] 2023-11-28T20:59:05.431 INFO:tasks.ceph.mds.c.smithi167.stderr: 15: (DispatchQueue::entry()+0x5ea) [0x7f134735c1ea] 2023-11-28T20:59:05.431 INFO:tasks.ceph.mds.c.smithi167.stderr: 16: /usr/lib/ceph/libceph-common.so.2(+0x3eea01) [0x7f13473eea01] 2023-11-28T20:59:05.431 INFO:tasks.ceph.mds.c.smithi167.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f1346894b43] 2023-11-28T20:59:05.431 INFO:tasks.ceph.mds.c.smithi167.stderr: 18: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f1346926a00] 2023-11-28T20:59:05.431 INFO:tasks.ceph.mds.c.smithi167.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-28T20:59:05.431 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.440 INFO:tasks.ceph.mds.c.smithi167.stderr: -9> 2023-11-28T20:59:05.385+0000 7f1341268640 -1 mds.1.cache.den(0x10000002d3d.111* admin_socket.h) newly corrupt dentry to be committed: [dentry #0x1/client.0/tmp/ceph/src/common/admin_socket.h [223,head] auth (dn sync l) (dversion lock) pv=2285 v=2273 ino=0x20000001a8b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x5602056c0f00] 2023-11-28T20:59:05.440 INFO:tasks.ceph.mds.c.smithi167.stderr: -7> 2023-11-28T20:59:05.385+0000 7f1341268640 -1 log_channel(cluster) log [ERR] : MDS abort because newly corrupt dentry to be committed: [dentry #0x1/client.0/tmp/ceph/src/common/admin_socket.h [223,head] auth (dn sync l) (dversion lock) pv=2285 v=2273 ino=0x20000001a8b state=1610612736 | request=0 lock=0 inodepin=1 dirty=1 authpin=0 clientlease=1 0x5602056c0f00] 2023-11-28T20:59:05.440 INFO:tasks.ceph.mds.c.smithi167.stderr: -2> 2023-11-28T20:59:05.385+0000 7f1341268640 -1 ./src/mds/MDSRank.cc: In function 'void MDSRank::abort(std::string_view)' thread 7f1341268640 time 2023-11-28T20:59:05.387431+0000 2023-11-28T20:59:05.440 INFO:tasks.ceph.mds.c.smithi167.stderr:./src/mds/MDSRank.cc: 944: ceph_abort_msg("abort() called") 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev) 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd3) [0x7f1347170513] 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: 2: (MDSRank::abort(std::basic_string_view >)+0x61) [0x560201c117a1] 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: 3: (CDentry::check_corruption(bool)+0x419) [0x560201e204c9] 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: 4: ceph-mds(+0x182c09) [0x560201c56c09] 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: 5: (Locker::_do_cap_update(CInode*, Capability*, int, snapid_t, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool*)+0xbe1) [0x560201ddea61] 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: 6: (Locker::handle_client_caps(boost::intrusive_ptr const&)+0x2084) [0x560201dd5934] 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: 7: (Locker::dispatch(boost::intrusive_ptr const&)+0x1cc) [0x560201db66cc] 2023-11-28T20:59:05.441 INFO:tasks.ceph.mds.c.smithi167.stderr: 8: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x560201c1a99b] 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: 9: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560201c1ae6c] 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: 10: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x560201c05c85] 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: 11: (DispatchQueue::entry()+0x5ea) [0x7f134735c1ea] 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: 12: /usr/lib/ceph/libceph-common.so.2(+0x3eea01) [0x7f13473eea01] 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f1346894b43] 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f1346926a00] 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: -1> 2023-11-28T20:59:05.385+0000 7f1341268640 -1 *** Caught signal (Aborted) ** 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: in thread 7f1341268640 thread_name:ms_dispatch 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:05.442 INFO:tasks.ceph.mds.c.smithi167.stderr: ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev) 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1346842520] 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 2: pthread_kill() 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 3: raise() 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 4: abort() 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x189) [0x7f13471705c9] 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 6: (MDSRank::abort(std::basic_string_view >)+0x61) [0x560201c117a1] 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 7: (CDentry::check_corruption(bool)+0x419) [0x560201e204c9] 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 8: ceph-mds(+0x182c09) [0x560201c56c09] 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 9: (Locker::_do_cap_update(CInode*, Capability*, int, snapid_t, boost::intrusive_ptr const&, boost::intrusive_ptr const&, bool*)+0xbe1) [0x560201ddea61] 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 10: (Locker::handle_client_caps(boost::intrusive_ptr const&)+0x2084) [0x560201dd5934] 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 11: (Locker::dispatch(boost::intrusive_ptr const&)+0x1cc) [0x560201db66cc] 2023-11-28T20:59:05.443 INFO:tasks.ceph.mds.c.smithi167.stderr: 12: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x560201c1a99b] 2023-11-28T20:59:05.444 INFO:tasks.ceph.mds.c.smithi167.stderr: 13: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560201c1ae6c] 2023-11-28T20:59:05.444 INFO:tasks.ceph.mds.c.smithi167.stderr: 14: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x560201c05c85] 2023-11-28T20:59:05.444 INFO:tasks.ceph.mds.c.smithi167.stderr: 15: (DispatchQueue::entry()+0x5ea) [0x7f134735c1ea] 2023-11-28T20:59:05.444 INFO:tasks.ceph.mds.c.smithi167.stderr: 16: /usr/lib/ceph/libceph-common.so.2(+0x3eea01) [0x7f13473eea01] 2023-11-28T20:59:05.444 INFO:tasks.ceph.mds.c.smithi167.stderr: 17: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f1346894b43] 2023-11-28T20:59:05.444 INFO:tasks.ceph.mds.c.smithi167.stderr: 18: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f1346926a00] 2023-11-28T20:59:05.444 INFO:tasks.ceph.mds.c.smithi167.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-28T20:59:05.444 INFO:tasks.ceph.mds.c.smithi167.stderr: 2023-11-28T20:59:06.845 INFO:tasks.ceph.mds.c.smithi167.stderr:daemon-helper: command crashed with signal 6 2023-11-28T20:59:13.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-28T20:59:18.193 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T20:59:18.194 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2023-11-28T20:59:18.194 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T20:59:18.194 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T20:59:18.198 INFO:tasks.ceph.mon.a:Started 2023-11-28T20:59:18.198 INFO:tasks.mon_thrash:Sending STOP to mon b 2023-11-28T20:59:18.198 INFO:tasks.ceph.mon.b:Sent signal 19 2023-11-28T20:59:18.198 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2023-11-28T20:59:20.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-28T20:59:22.004 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:22.008 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:27.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~14s 2023-11-28T20:59:33.200 INFO:tasks.mon_thrash:Sending CONT to mon b 2023-11-28T20:59:33.200 INFO:tasks.ceph.mon.b:Sent signal 18 2023-11-28T20:59:33.200 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:59:33.201 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:59:33.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33e49de640 1 Processor -- start 2023-11-28T20:59:33.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33e49de640 1 -- start start 2023-11-28T20:59:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33e49de640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33e49de640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33e49de640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e0072990 con 0x7f33e0153bb0 2023-11-28T20:59:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33e49de640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e015d100 con 0x7f33e00725b0 2023-11-28T20:59:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33e49de640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e015d3a0 con 0x7f33e00c6d70 2023-11-28T20:59:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33df59e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33ded9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f33e0153bb0 0x7f33e00c7760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45536/0 (socket says 172.21.15.167:45536) 2023-11-28T20:59:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 learned_addr learned my addr 172.21.15.167:0/1414500915 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:59:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 msgr2=0x7f33e006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 msgr2=0x7f33e006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 msgr2=0x7f33e0072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:59:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 msgr2=0x7f33e0072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.349+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 msgr2=0x7f33e006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 msgr2=0x7f33e006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:59:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 msgr2=0x7f33e0072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:59:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 msgr2=0x7f33e0072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.553+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:59:33.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:33.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 msgr2=0x7f33e006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:33.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 msgr2=0x7f33e006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:33.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:33.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:33.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:59:33.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 msgr2=0x7f33e0072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:59:33.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 msgr2=0x7f33e0072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:33.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:33.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:33.957+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:59:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 msgr2=0x7f33e006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 msgr2=0x7f33e006f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:59:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 msgr2=0x7f33e0072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:59:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 msgr2=0x7f33e0072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:34.761+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:59:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 msgr2=0x7f33e0072070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:59:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33dd59a640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33e00c6d70 0x7f33e0072070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 msgr2=0x7f33e006f0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:59:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33dd59a640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33e00725b0 0x7f33e006f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 >> v1:172.21.15.167:6789/0 conn(0x7f33e0153bb0 legacy=0x7f33e00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33dd59a640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e015d680 con 0x7f33c0006160 2023-11-28T20:59:36.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e015d100 con 0x7f33c0003680 2023-11-28T20:59:36.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:36.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 msgr2=0x7f33c0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:36.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 msgr2=0x7f33c0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:36.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:36.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.349+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:36.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.553+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:36.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.553+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 msgr2=0x7f33c0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:36.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.553+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 msgr2=0x7f33c0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:36.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.553+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:36.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.553+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:59:36.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.957+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:36.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.957+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 msgr2=0x7f33c0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:36.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.957+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 msgr2=0x7f33c0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:36.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.957+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:36.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:36.957+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:59:37.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:37.761+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:37.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:37.761+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 msgr2=0x7f33c0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:37.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:37.761+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 msgr2=0x7f33c0005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:37.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:37.761+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:37.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:37.761+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:59:38.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~25s 2023-11-28T20:59:38.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:38.245+0000 7f33de59c640 1 -- 172.21.15.167:0/1414500915 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641484145 0 0) 0x7f33e015d680 con 0x7f33c0006160 2023-11-28T20:59:38.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:38.245+0000 7f33de59c640 1 -- 172.21.15.167:0/1414500915 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33cc003530 con 0x7f33c0006160 2023-11-28T20:59:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 msgr2=0x7f33c0005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:59:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33dd59a640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0003680 0x7f33c0005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 >> v1:172.21.15.178:6789/0 conn(0x7f33c0006160 legacy=0x7f33c0008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 reap_dead start 2023-11-28T20:59:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33dd59a640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c000afb0 con 0x7f33e0153bb0 2023-11-28T20:59:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c00099a0 con 0x7f33c000a700 2023-11-28T20:59:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e015d100 con 0x7f33c0005ad0 2023-11-28T20:59:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 msgr2=0x7f33c0009460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:59:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 msgr2=0x7f33c0009460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.349+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:39.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.553+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:39.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.553+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 msgr2=0x7f33c0009460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:59:39.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.553+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 msgr2=0x7f33c0009460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:39.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.553+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:39.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.553+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:59:39.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.957+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:39.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.957+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 msgr2=0x7f33c0009460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:59:39.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.957+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 msgr2=0x7f33c0009460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:39.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.957+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:39.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:39.957+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:59:40.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:40.761+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:40.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:40.761+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 msgr2=0x7f33c0009460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T20:59:40.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:40.761+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 msgr2=0x7f33c0009460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:40.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:40.761+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:40.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:40.761+0000 7f33df59e640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:59:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 msgr2=0x7f33c0009460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:59:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33dd59a640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c0005ad0 0x7f33c0009460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 >> v1:172.21.15.178:6789/0 conn(0x7f33c000a700 legacy=0x7f33c0008d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 >> v1:172.21.15.167:6789/0 conn(0x7f33e0153bb0 legacy=0x7f33c0009ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33dd59a640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33dd59a640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e015d100 con 0x7f33c0008320 2023-11-28T20:59:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33dd59a640 1 -- 172.21.15.167:0/1414500915 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e015d3a0 con 0x7f33c0007840 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 msgr2=0x7f33c00087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 msgr2=0x7f33c00087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 msgr2=0x7f33c0007c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 msgr2=0x7f33c0007c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.353+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 msgr2=0x7f33c00087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 msgr2=0x7f33c00087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:42.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:59:42.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 msgr2=0x7f33c0007c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:59:42.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 msgr2=0x7f33c0007c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:42.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:42.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.557+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T20:59:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 msgr2=0x7f33c00087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 msgr2=0x7f33c00087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:42.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:59:42.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 msgr2=0x7f33c0007c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T20:59:42.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 msgr2=0x7f33c0007c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:42.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:42.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:42.961+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T20:59:43.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.765+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:43.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.765+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.178:3300/0 conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:43.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.765+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 msgr2=0x7f33c00087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T20:59:43.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.765+0000 7f33d659c640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 msgr2=0x7f33c00087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T20:59:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.765+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.765+0000 7f33d659c640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T20:59:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.765+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 msgr2=0x7f33c00087b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:59:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.765+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> v2:172.21.15.167:3300/0 conn(0x7f33c0008320 0x7f33c00087b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:43.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.765+0000 7f33ded9d640 1 -- 172.21.15.167:0/1414500915 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c0009b80 con 0x7f33c0007840 2023-11-28T20:59:43.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.769+0000 7f33ded9d640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c0007840 0x7f33c0007c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f33c00077d0 tx=0x7f33d001dbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba966b0c684523b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.781+0000 7f33de59c640 1 -- 172.21.15.167:0/1414500915 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d00a6790 con 0x7f33c0007840 2023-11-28T20:59:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.781+0000 7f33de59c640 1 -- 172.21.15.167:0/1414500915 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00aa070 con 0x7f33c0007840 2023-11-28T20:59:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.781+0000 7f33de59c640 1 -- 172.21.15.167:0/1414500915 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d00a6af0 con 0x7f33c0007840 2023-11-28T20:59:43.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.785+0000 7f33e49de640 1 -- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c0007840 msgr2=0x7f33c0007c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.785+0000 7f33e49de640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c0007840 0x7f33c0007c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f33c00077d0 tx=0x7f33d001dbd0 comp rx=0 tx=0).stop 2023-11-28T20:59:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.785+0000 7f33df59e640 1 -- 172.21.15.167:0/1414500915 reap_dead start 2023-11-28T20:59:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.785+0000 7f33e49de640 1 -- 172.21.15.167:0/1414500915 shutdown_connections 2023-11-28T20:59:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.785+0000 7f33e49de640 1 --2- 172.21.15.167:0/1414500915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c0007840 0x7f33c0007c50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.785+0000 7f33e49de640 1 -- 172.21.15.167:0/1414500915 >> 172.21.15.167:0/1414500915 conn(0x7f33e006b690 msgr2=0x7f33e006baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.785+0000 7f33e49de640 1 -- 172.21.15.167:0/1414500915 shutdown_connections 2023-11-28T20:59:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.785+0000 7f33e49de640 1 -- 172.21.15.167:0/1414500915 wait complete. 2023-11-28T20:59:43.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.785+0000 7f33e49de640 1 Processor -- start 2023-11-28T20:59:43.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33e49de640 1 -- start start 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33e49de640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c0007840 0x7f33e0156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33e49de640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e00c49a0 0x7f33e015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33e49de640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e00cad90 0x7f33e00cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33e49de640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0157400 con 0x7f33c0007840 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33e49de640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0156b20 con 0x7f33e00c49a0 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33e49de640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00ca900 con 0x7f33e00cad90 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33ded9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c0007840 0x7f33e0156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33ded9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c0007840 0x7f33e0156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54254/0 (socket says 172.21.15.167:54254) 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33ded9d640 1 -- 172.21.15.167:0/2724659310 learned_addr learned my addr 172.21.15.167:0/2724659310 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33df59e640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e00cad90 0x7f33e00cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33d659c640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e00c49a0 0x7f33e015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33df59e640 1 -- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e00cad90 msgr2=0x7f33e00cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33df59e640 1 -- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e00cad90 msgr2=0x7f33e00cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33df59e640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e00cad90 0x7f33e00cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33df59e640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e00cad90 0x7f33e00cb210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33ded9d640 1 -- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e00cad90 msgr2=0x7f33e00cb210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33ded9d640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e00cad90 0x7f33e00cb210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33ded9d640 1 -- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e00c49a0 msgr2=0x7f33e015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33ded9d640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e00c49a0 0x7f33e015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33ded9d640 1 -- 172.21.15.167:0/2724659310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c000afb0 con 0x7f33c0007840 2023-11-28T20:59:43.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33ded9d640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c0007840 0x7f33e0156ec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f33d00087f0 tx=0x7f33d000b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:43.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33d7fff640 1 -- 172.21.15.167:0/2724659310 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0007e40 con 0x7f33c0007840 2023-11-28T20:59:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33d7fff640 1 -- 172.21.15.167:0/2724659310 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00a6790 con 0x7f33c0007840 2023-11-28T20:59:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e00cb750 con 0x7f33c0007840 2023-11-28T20:59:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33d7fff640 1 -- 172.21.15.167:0/2724659310 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d00a6b40 con 0x7f33c0007840 2023-11-28T20:59:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.789+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e00c45b0 con 0x7f33c0007840 2023-11-28T20:59:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.793+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e004e850 con 0x7f33c0007840 2023-11-28T20:59:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.793+0000 7f33d7fff640 1 -- 172.21.15.167:0/2724659310 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f33d00a6ca0 con 0x7f33c0007840 2023-11-28T20:59:43.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.793+0000 7f33d7fff640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33c0068500 0x7f33c006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:43.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.793+0000 7f33d7fff640 1 -- 172.21.15.167:0/2724659310 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f33d0120590 con 0x7f33c0007840 2023-11-28T20:59:43.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.793+0000 7f33d659c640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33c0068500 0x7f33c006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:43.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.797+0000 7f33d659c640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33c0068500 0x7f33c006a9c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f33e01f0430 tx=0x7f33c800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:43.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:43.797+0000 7f33d7fff640 1 -- 172.21.15.167:0/2724659310 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f33d00ed720 con 0x7f33c0007840 2023-11-28T20:59:44.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.009+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f33e004e850 con 0x7f33c0007840 2023-11-28T20:59:44.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.009+0000 7f33d7fff640 1 -- 172.21.15.167:0/2724659310 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f33d00ac620 con 0x7f33c0007840 2023-11-28T20:59:44.011 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":164,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:59:44.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33c0068500 msgr2=0x7f33c006a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33c0068500 0x7f33c006a9c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f33e01f0430 tx=0x7f33c800b040 comp rx=0 tx=0).stop 2023-11-28T20:59:44.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c0007840 msgr2=0x7f33e0156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c0007840 0x7f33e0156ec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f33d00087f0 tx=0x7f33d000b950 comp rx=0 tx=0).stop 2023-11-28T20:59:44.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 shutdown_connections 2023-11-28T20:59:44.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33c0068500 0x7f33c006a9c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e00cad90 0x7f33e00cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e00c49a0 0x7f33e015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 --2- 172.21.15.167:0/2724659310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33c0007840 0x7f33e0156ec0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 >> 172.21.15.167:0/2724659310 conn(0x7f33e006b690 msgr2=0x7f33e0150b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:44.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 shutdown_connections 2023-11-28T20:59:44.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.013+0000 7f33e49de640 1 -- 172.21.15.167:0/2724659310 wait complete. 2023-11-28T20:59:44.033 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:59:44.033 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:59:44.033 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:59:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa753479640 1 Processor -- start 2023-11-28T20:59:44.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa753479640 1 -- start start 2023-11-28T20:59:44.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa753479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74c153fa0 0x7fa74c0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa753479640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa74c0c63d0 0x7fa74c15d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa753479640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa74c15dcb0 0x7fa74c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa753479640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c15ada0 con 0x7fa74c0c63d0 2023-11-28T20:59:44.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa753479640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c15e140 con 0x7fa74c15dcb0 2023-11-28T20:59:44.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa753479640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c159f40 con 0x7fa74c153fa0 2023-11-28T20:59:44.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa750a14640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa74c0c63d0 0x7fa74c15d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa750a14640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa74c0c63d0 0x7fa74c15d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54270/0 (socket says 172.21.15.167:54270) 2023-11-28T20:59:44.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa750a14640 1 -- 172.21.15.167:0/1661473798 learned_addr learned my addr 172.21.15.167:0/1661473798 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:44.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa751a16640 1 --2- 172.21.15.167:0/1661473798 >> v2:172.21.15.178:3300/0 conn(0x7fa74c15dcb0 0x7fa74c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa751215640 1 --2- 172.21.15.167:0/1661473798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74c153fa0 0x7fa74c0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa750a14640 1 -- 172.21.15.167:0/1661473798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74c153fa0 msgr2=0x7fa74c0c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:44.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa750a14640 1 --2- 172.21.15.167:0/1661473798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74c153fa0 0x7fa74c0c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa750a14640 1 -- 172.21.15.167:0/1661473798 >> v2:172.21.15.178:3300/0 conn(0x7fa74c15dcb0 msgr2=0x7fa74c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:44.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa750a14640 1 --2- 172.21.15.167:0/1661473798 >> v2:172.21.15.178:3300/0 conn(0x7fa74c15dcb0 0x7fa74c06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.173+0000 7fa750a14640 1 -- 172.21.15.167:0/1661473798 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c15a220 con 0x7fa74c0c63d0 2023-11-28T20:59:44.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa750a14640 1 --2- 172.21.15.167:0/1661473798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 0x7fa74c15d770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa74c06bba0 tx=0x7fa73c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4bf74bd984bff7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa743fff640 1 -- 172.21.15.167:0/1661473798 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0ac410 con 0x7fa74c0c63d0 2023-11-28T20:59:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa743fff640 1 -- 172.21.15.167:0/1661473798 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c0ac570 con 0x7fa74c0c63d0 2023-11-28T20:59:44.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa743fff640 1 -- 172.21.15.167:0/1661473798 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0ac900 con 0x7fa74c0c63d0 2023-11-28T20:59:44.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa753479640 1 -- 172.21.15.167:0/1661473798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 msgr2=0x7fa74c15d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa753479640 1 --2- 172.21.15.167:0/1661473798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 0x7fa74c15d770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa74c06bba0 tx=0x7fa73c01c500 comp rx=0 tx=0).stop 2023-11-28T20:59:44.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa753479640 1 -- 172.21.15.167:0/1661473798 shutdown_connections 2023-11-28T20:59:44.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa753479640 1 --2- 172.21.15.167:0/1661473798 >> v2:172.21.15.178:3300/0 conn(0x7fa74c15dcb0 0x7fa74c06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa753479640 1 --2- 172.21.15.167:0/1661473798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 0x7fa74c15d770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa753479640 1 --2- 172.21.15.167:0/1661473798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74c153fa0 0x7fa74c0c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa753479640 1 -- 172.21.15.167:0/1661473798 >> 172.21.15.167:0/1661473798 conn(0x7fa74c0cb1e0 msgr2=0x7fa74c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:44.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa753479640 1 -- 172.21.15.167:0/1661473798 shutdown_connections 2023-11-28T20:59:44.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.177+0000 7fa753479640 1 -- 172.21.15.167:0/1661473798 wait complete. 2023-11-28T20:59:44.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 Processor -- start 2023-11-28T20:59:44.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 -- start start 2023-11-28T20:59:44.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 0x7fa74c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74c153fa0 0x7fa74c15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74c15dcb0 0x7fa74c154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c157cf0 con 0x7fa74c0c63d0 2023-11-28T20:59:44.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c1f3450 con 0x7fa74c153fa0 2023-11-28T20:59:44.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c157780 con 0x7fa74c15dcb0 2023-11-28T20:59:44.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751215640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 0x7fa74c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751215640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 0x7fa74c157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54282/0 (socket says 172.21.15.167:54282) 2023-11-28T20:59:44.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751215640 1 -- 172.21.15.167:0/2569595315 learned_addr learned my addr 172.21.15.167:0/2569595315 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:44.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751a16640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74c15dcb0 0x7fa74c154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa750a14640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74c153fa0 0x7fa74c15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751215640 1 -- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74c15dcb0 msgr2=0x7fa74c154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751215640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa74c15dcb0 0x7fa74c154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751215640 1 -- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74c153fa0 msgr2=0x7fa74c15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751215640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74c153fa0 0x7fa74c15c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751215640 1 -- 172.21.15.167:0/2569595315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0094d0 con 0x7fa74c0c63d0 2023-11-28T20:59:44.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa750a14640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa74c153fa0 0x7fa74c15c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:59:44.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa751215640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 0x7fa74c157240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa74800d830 tx=0x7fa74800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480096a0 con 0x7fa74c0c63d0 2023-11-28T20:59:44.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748009800 con 0x7fa74c0c63d0 2023-11-28T20:59:44.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c1f38e0 con 0x7fa74c0c63d0 2023-11-28T20:59:44.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748009b70 con 0x7fa74c0c63d0 2023-11-28T20:59:44.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c1f2b20 con 0x7fa74c0c63d0 2023-11-28T20:59:44.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c154bd0 0x7fa74c1f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c074770 con 0x7fa74c154bd0 2023-11-28T20:59:44.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.181+0000 7fa750a14640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c154bd0 0x7fa74c1f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa750a14640 1 -- 172.21.15.167:0/2569595315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa74c0c7920 con 0x7fa74c154bd0 2023-11-28T20:59:44.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa748014410 con 0x7fa74c0c63d0 2023-11-28T20:59:44.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa750a14640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c154bd0 0x7fa74c1f2d10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa74c06fe60 tx=0x7fa73c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa741ffb640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa730066470 0x7fa730068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa748084dc0 con 0x7fa74c0c63d0 2023-11-28T20:59:44.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0ace20 con 0x7fa74c154bd0 2023-11-28T20:59:44.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa73c0b5610 con 0x7fa74c154bd0 2023-11-28T20:59:44.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c154bd0 msgr2=0x7fa74c1f2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa741ffb640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c154bd0 0x7fa74c1f2d10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa74c06fe60 tx=0x7fa73c01ad40 comp rx=0 tx=0).stop 2023-11-28T20:59:44.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c154bd0 msgr2=0x7fa74c1f2d10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:44.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa741ffb640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c154bd0 0x7fa74c1f2d10 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa74c06fe60 tx=0x7fa73c01ad40 comp rx=0 tx=0).stop 2023-11-28T20:59:44.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa751a16640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa730066470 0x7fa730068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.185+0000 7fa751a16640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa730066470 0x7fa730068930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa744009ee0 tx=0x7fa74400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.189+0000 7fa753479640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c1561f0 0x7fa74c145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.189+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c1f3590 con 0x7fa74c1561f0 2023-11-28T20:59:44.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.189+0000 7fa750a14640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c1561f0 0x7fa74c145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa750a14640 1 -- 172.21.15.167:0/2569595315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa74c0682c0 con 0x7fa74c1561f0 2023-11-28T20:59:44.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa750a14640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c1561f0 0x7fa74c145a30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa73c01abb0 tx=0x7fa73c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0c0420 con 0x7fa74c1561f0 2023-11-28T20:59:44.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4472 (secure 0 0 0) 0x7fa73c0c0580 con 0x7fa74c1561f0 2023-11-28T20:59:44.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c1561f0 msgr2=0x7fa74c145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa741ffb640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c1561f0 0x7fa74c145a30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa73c01abb0 tx=0x7fa73c0192a0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa741ffb640 1 -- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c1561f0 msgr2=0x7fa74c145a30 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:44.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa741ffb640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c1561f0 0x7fa74c145a30 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa73c01abb0 tx=0x7fa73c0192a0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.193 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:59:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:59:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:59:44.193 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 164, 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:59:44.194 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.195 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:44.196 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:44.197 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:44.198 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:44.199 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:44.199 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:44.199 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:44.199 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:44.199 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:44.199 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:44.199 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:44.199 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.199 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:59:44.200 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.201 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:44.201 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.202 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.203 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.204 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:44.204 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:59:44.204 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.204 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.204 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.205 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:59:44.205 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:59:44.205 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:44.205 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:44.205 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.206 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:44.207 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.208 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:59:44.209 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.209 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.209 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.209 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:59:44.209 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.209 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.209 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.209 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:59:44.209 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:59:44.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa730066470 msgr2=0x7fa730068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa753479640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa730066470 0x7fa730068930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa744009ee0 tx=0x7fa74400b040 comp rx=0 tx=0).stop 2023-11-28T20:59:44.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 msgr2=0x7fa74c157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa753479640 1 --2- 172.21.15.167:0/2569595315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa74c0c63d0 0x7fa74c157240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa74800d830 tx=0x7fa74800dcf0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa751a16640 1 -- 172.21.15.167:0/2569595315 reap_dead start 2023-11-28T20:59:44.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa751a16640 1 -- 172.21.15.167:0/2569595315 reap_dead start 2023-11-28T20:59:44.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 shutdown_connections 2023-11-28T20:59:44.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 >> 172.21.15.167:0/2569595315 conn(0x7fa74c0cb1e0 msgr2=0x7fa74c1518d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:44.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 shutdown_connections 2023-11-28T20:59:44.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.193+0000 7fa753479640 1 -- 172.21.15.167:0/2569595315 wait complete. 2023-11-28T20:59:44.212 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:59:44.212 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:59:44.213 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:59:44.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c9501640 1 Processor -- start 2023-11-28T20:59:44.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c9501640 1 -- start start 2023-11-28T20:59:44.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c9501640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 0x7f89c4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c9501640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c40c4940 con 0x7f89c40c6ff0 2023-11-28T20:59:44.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c9501640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c40c6ac0 con 0x7f89c40c4510 2023-11-28T20:59:44.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c9501640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40c62f0 con 0x7f89c4150b40 2023-11-28T20:59:44.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89ba7fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f89c40c6ff0 0x7f89c40c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45044/0 (socket says 172.21.15.167:45044) 2023-11-28T20:59:44.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89ba7fc640 1 -- 172.21.15.167:0/518322107 learned_addr learned my addr 172.21.15.167:0/518322107 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:59:44.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c2ffd640 1 --2- 172.21.15.167:0/518322107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 0x7f89c4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c27fc640 1 -- 172.21.15.167:0/518322107 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160395517 0 0) 0x7f89c40c4940 con 0x7f89c40c6ff0 2023-11-28T20:59:44.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c27fc640 1 -- 172.21.15.167:0/518322107 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b0003530 con 0x7f89c40c6ff0 2023-11-28T20:59:44.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c2ffd640 1 -- 172.21.15.167:0/518322107 >> v1:172.21.15.178:6789/0 conn(0x7f89c40c4510 legacy=0x7f89c406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c2ffd640 1 -- 172.21.15.167:0/518322107 >> v1:172.21.15.167:6789/0 conn(0x7f89c40c6ff0 legacy=0x7f89c40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c27fc640 1 -- 172.21.15.167:0/518322107 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3908865017 0 0) 0x7f89b0003530 con 0x7f89c40c6ff0 2023-11-28T20:59:44.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.353+0000 7f89c2ffd640 1 -- 172.21.15.167:0/518322107 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c40c6500 con 0x7f89c4150b40 2023-11-28T20:59:44.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c2ffd640 1 --2- 172.21.15.167:0/518322107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 0x7f89c4157560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89b40097f0 tx=0x7f89b401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcee716760f83187 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c27fc640 1 -- 172.21.15.167:0/518322107 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac001a00 con 0x7f89c4150b40 2023-11-28T20:59:44.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c27fc640 1 -- 172.21.15.167:0/518322107 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b40a7050 con 0x7f89c4150b40 2023-11-28T20:59:44.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c27fc640 1 -- 172.21.15.167:0/518322107 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b40ab600 con 0x7f89c4150b40 2023-11-28T20:59:44.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c9501640 1 -- 172.21.15.167:0/518322107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 msgr2=0x7f89c4157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c9501640 1 --2- 172.21.15.167:0/518322107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 0x7f89c4157560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89b40097f0 tx=0x7f89b401c3b0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c9501640 1 -- 172.21.15.167:0/518322107 shutdown_connections 2023-11-28T20:59:44.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c9501640 1 --2- 172.21.15.167:0/518322107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 0x7f89c4157560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c9501640 1 -- 172.21.15.167:0/518322107 >> 172.21.15.167:0/518322107 conn(0x7f89c40cb1e0 msgr2=0x7f89c40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:44.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c9501640 1 -- 172.21.15.167:0/518322107 shutdown_connections 2023-11-28T20:59:44.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.357+0000 7f89c9501640 1 -- 172.21.15.167:0/518322107 wait complete. 2023-11-28T20:59:44.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 Processor -- start 2023-11-28T20:59:44.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 -- start start 2023-11-28T20:59:44.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c40c4510 0x7f89c414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c40c6ff0 0x7f89c414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 0x7f89c40c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40c9420 con 0x7f89c40c4510 2023-11-28T20:59:44.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4146940 con 0x7f89c40c6ff0 2023-11-28T20:59:44.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c414ab60 con 0x7f89c4150b40 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c40c4510 0x7f89c414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c40c4510 0x7f89c414e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54322/0 (socket says 172.21.15.167:54322) 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c2ffd640 1 -- 172.21.15.167:0/2944857723 learned_addr learned my addr 172.21.15.167:0/2944857723 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89ba7fc640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c40c6ff0 0x7f89c414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c37fe640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 0x7f89c40c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c2ffd640 1 -- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 msgr2=0x7f89c40c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c2ffd640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 0x7f89c40c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c2ffd640 1 -- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c40c6ff0 msgr2=0x7f89c414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c2ffd640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c40c6ff0 0x7f89c414ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c2ffd640 1 -- 172.21.15.167:0/2944857723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4009420 con 0x7f89c40c4510 2023-11-28T20:59:44.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89ba7fc640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c40c6ff0 0x7f89c414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:59:44.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c37fe640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89c4150b40 0x7f89c40c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:59:44.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c2ffd640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c40c4510 0x7f89c414e9c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009740 tx=0x7f89b4019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4003af0 con 0x7f89c40c4510 2023-11-28T20:59:44.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4003c50 con 0x7f89c40c4510 2023-11-28T20:59:44.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b40ab400 con 0x7f89c40c4510 2023-11-28T20:59:44.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c40c9080 con 0x7f89c40c4510 2023-11-28T20:59:44.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.361+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c414b0c0 con 0x7f89c40c4510 2023-11-28T20:59:44.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89c9501640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c4153ba0 0x7f89c40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4074770 con 0x7f89c4153ba0 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89ba7fc640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c4153ba0 0x7f89c40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f89b40b2040 con 0x7f89c40c4510 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89ba7fc640 1 -- 172.21.15.167:0/2944857723 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89c4157040 con 0x7f89c4153ba0 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89ba7fc640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c4153ba0 0x7f89c40c9d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f89c41506d0 tx=0x7f89ac00c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89bbfff640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f89a40664a0 0x7f89a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f89b411d650 con 0x7f89c40c4510 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac00ce10 con 0x7f89c4153ba0 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89c37fe640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f89a40664a0 0x7f89a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f89ac0070d0 con 0x7f89c4153ba0 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c4153ba0 msgr2=0x7f89c40c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89bbfff640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c4153ba0 0x7f89c40c9d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f89c41506d0 tx=0x7f89ac00c4b0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c4153ba0 msgr2=0x7f89c40c9d80 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:44.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89bbfff640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c4153ba0 0x7f89c40c9d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.365+0000 7f89c37fe640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f89a40664a0 0x7f89a4068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f89bc000f70 tx=0x7f89bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89c9501640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c41f5390 0x7f89c41f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40682c0 con 0x7f89c41f5390 2023-11-28T20:59:44.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89ba7fc640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c41f5390 0x7f89c41f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89ba7fc640 1 -- 172.21.15.167:0/2944857723 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f89c4075c90 con 0x7f89c41f5390 2023-11-28T20:59:44.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89ba7fc640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c41f5390 0x7f89c41f57a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f89ac014000 tx=0x7f89ac001260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac007950 con 0x7f89c41f5390 2023-11-28T20:59:44.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4810 (secure 0 0 0) 0x7f89ac007ab0 con 0x7f89c41f5390 2023-11-28T20:59:44.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c41f5390 msgr2=0x7f89c41f57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89bbfff640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c41f5390 0x7f89c41f57a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f89ac014000 tx=0x7f89ac001260 comp rx=0 tx=0).stop 2023-11-28T20:59:44.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89bbfff640 1 -- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c41f5390 msgr2=0x7f89c41f57a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:44.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.373+0000 7f89bbfff640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89c41f5390 0x7f89c41f57a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.376 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:59:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:59:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:59:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:59:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 164, 2023-11-28T20:59:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:59:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:59:44.376 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:44.377 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:44.378 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:59:44.379 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:59:44.380 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.381 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.382 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:44.383 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:59:44.384 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:59:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:44.385 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:59:44.386 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.387 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.389 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.390 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:59:44.391 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:59:44.392 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:59:44.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f89a40664a0 msgr2=0x7f89a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c9501640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f89a40664a0 0x7f89a4068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f89bc000f70 tx=0x7f89bc009040 comp rx=0 tx=0).stop 2023-11-28T20:59:44.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c40c4510 msgr2=0x7f89c414e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c9501640 1 --2- 172.21.15.167:0/2944857723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89c40c4510 0x7f89c414e9c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009740 tx=0x7f89b4019150 comp rx=0 tx=0).stop 2023-11-28T20:59:44.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c37fe640 1 -- 172.21.15.167:0/2944857723 reap_dead start 2023-11-28T20:59:44.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c37fe640 1 -- 172.21.15.167:0/2944857723 reap_dead start 2023-11-28T20:59:44.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 shutdown_connections 2023-11-28T20:59:44.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 >> 172.21.15.167:0/2944857723 conn(0x7f89c40cb1e0 msgr2=0x7f89c40705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:44.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 shutdown_connections 2023-11-28T20:59:44.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.377+0000 7f89c9501640 1 -- 172.21.15.167:0/2944857723 wait complete. 2023-11-28T20:59:44.394 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:59:44.395 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:59:44.395 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:59:44.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.533+0000 7ff249a9e640 1 Processor -- start 2023-11-28T20:59:44.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.533+0000 7ff249a9e640 1 -- start start 2023-11-28T20:59:44.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.533+0000 7ff249a9e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 0x7ff244157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.533+0000 7ff249a9e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2440c4940 con 0x7ff2440c4510 2023-11-28T20:59:44.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.533+0000 7ff249a9e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2440c6ac0 con 0x7ff244150b40 2023-11-28T20:59:44.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.533+0000 7ff249a9e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440c62f0 con 0x7ff2440c6ff0 2023-11-28T20:59:44.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff243fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff2440c4510 0x7ff24406a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45052/0 (socket says 172.21.15.167:45052) 2023-11-28T20:59:44.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff243fff640 1 -- 172.21.15.167:0/485398826 learned_addr learned my addr 172.21.15.167:0/485398826 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:59:44.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff242ffd640 1 --2- 172.21.15.167:0/485398826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 0x7ff244157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff2427fc640 1 -- 172.21.15.167:0/485398826 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864551040 0 0) 0x7ff2440c4940 con 0x7ff2440c4510 2023-11-28T20:59:44.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff2427fc640 1 -- 172.21.15.167:0/485398826 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff22c003530 con 0x7ff2440c4510 2023-11-28T20:59:44.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff242ffd640 1 -- 172.21.15.167:0/485398826 >> v1:172.21.15.178:6789/0 conn(0x7ff244150b40 legacy=0x7ff2440c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff2427fc640 1 -- 172.21.15.167:0/485398826 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530956105 0 0) 0x7ff2440c6ac0 con 0x7ff244150b40 2023-11-28T20:59:44.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff242ffd640 1 -- 172.21.15.167:0/485398826 >> v1:172.21.15.167:6789/0 conn(0x7ff2440c4510 legacy=0x7ff24406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff242ffd640 1 -- 172.21.15.167:0/485398826 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2440c6500 con 0x7ff2440c6ff0 2023-11-28T20:59:44.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.537+0000 7ff242ffd640 1 --2- 172.21.15.167:0/485398826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 0x7ff244157560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2380097f0 tx=0x7ff23801c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65f009684c34a0de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff2427fc640 1 -- 172.21.15.167:0/485398826 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c001a00 con 0x7ff2440c6ff0 2023-11-28T20:59:44.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff2427fc640 1 -- 172.21.15.167:0/485398826 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2380a7050 con 0x7ff2440c6ff0 2023-11-28T20:59:44.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff2427fc640 1 -- 172.21.15.167:0/485398826 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2380ab600 con 0x7ff2440c6ff0 2023-11-28T20:59:44.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 -- 172.21.15.167:0/485398826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 msgr2=0x7ff244157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 --2- 172.21.15.167:0/485398826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 0x7ff244157560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2380097f0 tx=0x7ff23801c2d0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 -- 172.21.15.167:0/485398826 shutdown_connections 2023-11-28T20:59:44.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 --2- 172.21.15.167:0/485398826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 0x7ff244157560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 -- 172.21.15.167:0/485398826 >> 172.21.15.167:0/485398826 conn(0x7ff2440cb1e0 msgr2=0x7ff2440cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:44.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 -- 172.21.15.167:0/485398826 shutdown_connections 2023-11-28T20:59:44.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 -- 172.21.15.167:0/485398826 wait complete. 2023-11-28T20:59:44.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 Processor -- start 2023-11-28T20:59:44.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 -- start start 2023-11-28T20:59:44.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2440c4510 0x7ff24413df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 0x7ff2441f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff244150b40 0x7ff2441f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff244150460 con 0x7ff2440c4510 2023-11-28T20:59:44.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440c8fe0 con 0x7ff244150b40 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff249a9e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2441f4340 con 0x7ff2440c6ff0 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff2437fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2440c4510 0x7ff24413df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.541+0000 7ff2437fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2440c4510 0x7ff24413df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54336/0 (socket says 172.21.15.167:54336) 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff2437fe640 1 -- 172.21.15.167:0/3772629813 learned_addr learned my addr 172.21.15.167:0/3772629813 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff242ffd640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 0x7ff2441f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff243fff640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff244150b40 0x7ff2441f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff2437fe640 1 -- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 msgr2=0x7ff2441f37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff2437fe640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 0x7ff2441f37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff2437fe640 1 -- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff244150b40 msgr2=0x7ff2441f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff2437fe640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff244150b40 0x7ff2441f3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff2437fe640 1 -- 172.21.15.167:0/3772629813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff238009420 con 0x7ff2440c4510 2023-11-28T20:59:44.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff242ffd640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c6ff0 0x7ff2441f37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:59:44.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff2437fe640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2440c4510 0x7ff24413df20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c3e0 tx=0x7ff23400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340052d0 con 0x7ff2440c4510 2023-11-28T20:59:44.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234005450 con 0x7ff2440c4510 2023-11-28T20:59:44.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234003840 con 0x7ff2440c4510 2023-11-28T20:59:44.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2440c92a0 con 0x7ff2440c4510 2023-11-28T20:59:44.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2441404d0 con 0x7ff2440c4510 2023-11-28T20:59:44.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff249a9e640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c94e0 0x7ff244139990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff244074770 con 0x7ff2440c94e0 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff242ffd640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c94e0 0x7ff244139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2340039a0 con 0x7ff2440c4510 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff242ffd640 1 -- 172.21.15.167:0/3772629813 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2440c8c60 con 0x7ff2440c94e0 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff242ffd640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c94e0 0x7ff244139990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff244070410 tx=0x7ff23801ab10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff22bfff640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff230066470 0x7ff230068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff2340838b0 con 0x7ff2440c4510 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.545+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2380bf460 con 0x7ff2440c94e0 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.549+0000 7ff243fff640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff230066470 0x7ff230068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.549+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff2380bf5c0 con 0x7ff2440c94e0 2023-11-28T20:59:44.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.549+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c94e0 msgr2=0x7ff244139990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.549+0000 7ff22bfff640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c94e0 0x7ff244139990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff244070410 tx=0x7ff23801ab10 comp rx=0 tx=0).stop 2023-11-28T20:59:44.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.549+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c94e0 msgr2=0x7ff244139990 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:44.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.549+0000 7ff22bfff640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2440c94e0 0x7ff244139990 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff244070410 tx=0x7ff23801ab10 comp rx=0 tx=0).stop 2023-11-28T20:59:44.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.549+0000 7ff243fff640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff230066470 0x7ff230068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff23c001b30 tx=0x7ff23c001ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.553+0000 7ff249a9e640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff24413e460 0x7ff244139ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.553+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24413a410 con 0x7ff24413e460 2023-11-28T20:59:44.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.553+0000 7ff242ffd640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff24413e460 0x7ff244139ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.553+0000 7ff242ffd640 1 -- 172.21.15.167:0/3772629813 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff24406a7b0 con 0x7ff24413e460 2023-11-28T20:59:44.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff242ffd640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff24413e460 0x7ff244139ed0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff238019f00 tx=0x7ff238019070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2380bfb60 con 0x7ff24413e460 2023-11-28T20:59:44.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7ff2380bfcc0 con 0x7ff24413e460 2023-11-28T20:59:44.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff24413e460 msgr2=0x7ff244139ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff22bfff640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff24413e460 0x7ff244139ed0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff238019f00 tx=0x7ff238019070 comp rx=0 tx=0).stop 2023-11-28T20:59:44.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff22bfff640 1 -- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff24413e460 msgr2=0x7ff244139ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:44.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff22bfff640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff24413e460 0x7ff244139ed0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff238019f00 tx=0x7ff238019070 comp rx=0 tx=0).stop 2023-11-28T20:59:44.557 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:59:44.557 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:59:44.557 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:59:44.557 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:59:44.557 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 164, 2023-11-28T20:59:44.557 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:44.558 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:59:44.559 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.560 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:59:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:44.562 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:59:44.563 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:59:44.565 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:44.565 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:44.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.565 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:44.565 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:59:44.565 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.565 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:44.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.567 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:44.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.569 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:44.570 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:44.571 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.572 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:44.574 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:44.575 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:59:44.575 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:59:44.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff230066470 msgr2=0x7ff230068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff249a9e640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff230066470 0x7ff230068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff23c001b30 tx=0x7ff23c001ac0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2440c4510 msgr2=0x7ff24413df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff249a9e640 1 --2- 172.21.15.167:0/3772629813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2440c4510 0x7ff24413df20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c3e0 tx=0x7ff23400c8a0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff243fff640 1 -- 172.21.15.167:0/3772629813 reap_dead start 2023-11-28T20:59:44.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff243fff640 1 -- 172.21.15.167:0/3772629813 reap_dead start 2023-11-28T20:59:44.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 shutdown_connections 2023-11-28T20:59:44.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 >> 172.21.15.167:0/3772629813 conn(0x7ff2440cb1e0 msgr2=0x7ff2440cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:44.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 shutdown_connections 2023-11-28T20:59:44.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.557+0000 7ff249a9e640 1 -- 172.21.15.167:0/3772629813 wait complete. 2023-11-28T20:59:44.577 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:59:44.577 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T20:59:44.577 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T20:59:44.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.713+0000 7ff26471d640 1 Processor -- start 2023-11-28T20:59:44.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.713+0000 7ff26471d640 1 -- start start 2023-11-28T20:59:44.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff26471d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff25c070480 0x7ff25c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff26471d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e410 0x7ff25c072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff26471d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c1571d0 con 0x7ff25c06e030 2023-11-28T20:59:44.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff26471d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c071a90 con 0x7ff25c070480 2023-11-28T20:59:44.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff26471d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0c70d0 con 0x7ff25c06e410 2023-11-28T20:59:44.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff261cb8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff25c070480 0x7ff25c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff2624b9640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff25c06e030 0x7ff25c1500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:45060/0 (socket says 172.21.15.167:45060) 2023-11-28T20:59:44.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff2624b9640 1 -- 172.21.15.167:0/738741429 learned_addr learned my addr 172.21.15.167:0/738741429 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:59:44.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff262cba640 1 --2- 172.21.15.167:0/738741429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e410 0x7ff25c072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff261cb8640 1 -- 172.21.15.167:0/738741429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e410 msgr2=0x7ff25c072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:44.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff261cb8640 1 --2- 172.21.15.167:0/738741429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e410 0x7ff25c072460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff261cb8640 1 -- 172.21.15.167:0/738741429 >> v1:172.21.15.167:6789/0 conn(0x7ff25c06e030 legacy=0x7ff25c1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff261cb8640 1 -- 172.21.15.167:0/738741429 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0c73b0 con 0x7ff25c070480 2023-11-28T20:59:44.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.717+0000 7ff2614b7640 1 -- 172.21.15.167:0/738741429 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731222805 0 0) 0x7ff25c1571d0 con 0x7ff25c06e030 2023-11-28T20:59:44.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff261cb8640 1 --2- 172.21.15.167:0/738741429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 0x7ff25c071f20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0097c0 tx=0x7ff24c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba623bd8253bf12 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff2614b7640 1 -- 172.21.15.167:0/738741429 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0ab650 con 0x7ff25c070480 2023-11-28T20:59:44.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff2614b7640 1 -- 172.21.15.167:0/738741429 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24c0ab7b0 con 0x7ff25c070480 2023-11-28T20:59:44.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff2614b7640 1 -- 172.21.15.167:0/738741429 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0abb40 con 0x7ff25c070480 2023-11-28T20:59:44.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 -- 172.21.15.167:0/738741429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 msgr2=0x7ff25c071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 --2- 172.21.15.167:0/738741429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 0x7ff25c071f20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0097c0 tx=0x7ff24c01c450 comp rx=0 tx=0).stop 2023-11-28T20:59:44.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 -- 172.21.15.167:0/738741429 shutdown_connections 2023-11-28T20:59:44.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 --2- 172.21.15.167:0/738741429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 0x7ff25c071f20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 --2- 172.21.15.167:0/738741429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e410 0x7ff25c072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 -- 172.21.15.167:0/738741429 >> 172.21.15.167:0/738741429 conn(0x7ff25c0cb1e0 msgr2=0x7ff25c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:44.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 -- 172.21.15.167:0/738741429 shutdown_connections 2023-11-28T20:59:44.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 -- 172.21.15.167:0/738741429 wait complete. 2023-11-28T20:59:44.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 Processor -- start 2023-11-28T20:59:44.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.721+0000 7ff26471d640 1 -- start start 2023-11-28T20:59:44.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff26471d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e030 0x7ff25c145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff26471d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff25c06e410 0x7ff25c1f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff26471d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 0x7ff25c1e9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff26471d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c1f3e30 con 0x7ff25c070480 2023-11-28T20:59:44.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff26471d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c143cd0 con 0x7ff25c06e410 2023-11-28T20:59:44.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff26471d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c143f70 con 0x7ff25c06e030 2023-11-28T20:59:44.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff262cba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 0x7ff25c1e9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff262cba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 0x7ff25c1e9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54358/0 (socket says 172.21.15.167:54358) 2023-11-28T20:59:44.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff262cba640 1 -- 172.21.15.167:0/2505481454 learned_addr learned my addr 172.21.15.167:0/2505481454 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff2624b9640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e030 0x7ff25c145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff261cb8640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff25c06e410 0x7ff25c1f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff262cba640 1 -- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e030 msgr2=0x7ff25c145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff262cba640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e030 0x7ff25c145010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff262cba640 1 -- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff25c06e410 msgr2=0x7ff25c1f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff262cba640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff25c06e410 0x7ff25c1f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff262cba640 1 -- 172.21.15.167:0/2505481454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c009420 con 0x7ff25c070480 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff262cba640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 0x7ff25c1e9500 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff25400efc0 tx=0x7ff25400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff252ffd640 1 -- 172.21.15.167:0/2505481454 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254009b20 con 0x7ff25c070480 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff252ffd640 1 -- 172.21.15.167:0/2505481454 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25400f040 con 0x7ff25c070480 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c144250 con 0x7ff25c070480 2023-11-28T20:59:44.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff252ffd640 1 -- 172.21.15.167:0/2505481454 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2540146c0 con 0x7ff25c070480 2023-11-28T20:59:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c144810 con 0x7ff25c070480 2023-11-28T20:59:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c145550 con 0x7ff25c070480 2023-11-28T20:59:44.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.725+0000 7ff252ffd640 1 -- 172.21.15.167:0/2505481454 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff254014820 con 0x7ff25c070480 2023-11-28T20:59:44.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.729+0000 7ff252ffd640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2400664a0 0x7ff240068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:44.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.729+0000 7ff252ffd640 1 -- 172.21.15.167:0/2505481454 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff254085130 con 0x7ff25c070480 2023-11-28T20:59:44.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.729+0000 7ff2624b9640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2400664a0 0x7ff240068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:44.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.729+0000 7ff2624b9640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2400664a0 0x7ff240068960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff258000f70 tx=0x7ff258007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:44.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.733+0000 7ff252ffd640 1 -- 172.21.15.167:0/2505481454 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff254052130 con 0x7ff25c070480 2023-11-28T20:59:44.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.937+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7ff25c0682c0 con 0x7ff25c070480 2023-11-28T20:59:44.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff252ffd640 1 -- 172.21.15.167:0/2505481454 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7ff254018080 con 0x7ff25c070480 2023-11-28T20:59:44.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2400664a0 msgr2=0x7ff240068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2400664a0 0x7ff240068960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff258000f70 tx=0x7ff258007c10 comp rx=0 tx=0).stop 2023-11-28T20:59:44.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 msgr2=0x7ff25c1e9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:44.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 0x7ff25c1e9500 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff25400efc0 tx=0x7ff25400c490 comp rx=0 tx=0).stop 2023-11-28T20:59:44.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 shutdown_connections 2023-11-28T20:59:44.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff2400664a0 0x7ff240068960 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff25c070480 0x7ff25c1e9500 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff25c06e410 0x7ff25c1f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 --2- 172.21.15.167:0/2505481454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff25c06e030 0x7ff25c145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:44.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 >> 172.21.15.167:0/2505481454 conn(0x7ff25c0cb1e0 msgr2=0x7ff25c15f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:44.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 shutdown_connections 2023-11-28T20:59:44.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:44.941+0000 7ff26471d640 1 -- 172.21.15.167:0/2505481454 wait complete. 2023-11-28T20:59:44.966 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T20:59:45.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~32s 2023-11-28T20:59:51.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~38s 2023-11-28T20:59:52.066 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:52.070 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:54.967 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T20:59:54.967 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:59:55.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.112+0000 7f3fdeb1d640 1 Processor -- start 2023-11-28T20:59:55.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.112+0000 7f3fdeb1d640 1 -- start start 2023-11-28T20:59:55.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fdeb1d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3fd8151f60 0x7f3fd80c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fdeb1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 0x7f3fd80c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fdeb1d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd815b220 con 0x7f3fd806a580 2023-11-28T20:59:55.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fdeb1d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd80c4da0 con 0x7f3fd8151f60 2023-11-28T20:59:55.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fdeb1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd80c60f0 con 0x7f3fd80c5c90 2023-11-28T20:59:55.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fdc8b9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3fd8151f60 0x7f3fd80c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fd7fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 0x7f3fd80c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fdc8b9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3fd8151f60 0x7f3fd80c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:54238/0 (socket says 172.21.15.167:54238) 2023-11-28T20:59:55.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fdc8b9640 1 -- 172.21.15.167:0/1068761038 learned_addr learned my addr 172.21.15.167:0/1068761038 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:55.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fd7fff640 1 -- 172.21.15.167:0/1068761038 >> v2:172.21.15.178:3300/0 conn(0x7f3fd8151f60 msgr2=0x7f3fd80c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:55.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fd7fff640 1 --2- 172.21.15.167:0/1068761038 >> v2:172.21.15.178:3300/0 conn(0x7f3fd8151f60 0x7f3fd80c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fd7fff640 1 -- 172.21.15.167:0/1068761038 >> v1:172.21.15.178:6789/0 conn(0x7f3fd806a580 legacy=0x7f3fd806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fd7fff640 1 -- 172.21.15.167:0/1068761038 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd8152340 con 0x7f3fd80c5c90 2023-11-28T20:59:55.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.116+0000 7f3fdc8b9640 1 --2- 172.21.15.167:0/1068761038 >> v2:172.21.15.178:3300/0 conn(0x7f3fd8151f60 0x7f3fd80c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T20:59:55.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fd7fff640 1 --2- 172.21.15.167:0/1068761038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 0x7f3fd80c26e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40097c0 tx=0x7f3fc401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41005452f53fe09e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fd77fe640 1 -- 172.21.15.167:0/1068761038 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40ab600 con 0x7f3fd80c5c90 2023-11-28T20:59:55.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fd77fe640 1 -- 172.21.15.167:0/1068761038 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc40a7050 con 0x7f3fd80c5c90 2023-11-28T20:59:55.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fd77fe640 1 -- 172.21.15.167:0/1068761038 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40ab980 con 0x7f3fd80c5c90 2023-11-28T20:59:55.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/1068761038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 msgr2=0x7f3fd80c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fdeb1d640 1 --2- 172.21.15.167:0/1068761038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 0x7f3fd80c26e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40097c0 tx=0x7f3fc401c3f0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/1068761038 shutdown_connections 2023-11-28T20:59:55.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fdeb1d640 1 --2- 172.21.15.167:0/1068761038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 0x7f3fd80c26e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fdeb1d640 1 --2- 172.21.15.167:0/1068761038 >> v2:172.21.15.178:3300/0 conn(0x7f3fd8151f60 0x7f3fd80c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/1068761038 >> 172.21.15.167:0/1068761038 conn(0x7f3fd80cb1e0 msgr2=0x7f3fd80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:55.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/1068761038 shutdown_connections 2023-11-28T20:59:55.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.120+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/1068761038 wait complete. 2023-11-28T20:59:55.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 Processor -- start 2023-11-28T20:59:55.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 -- start start 2023-11-28T20:59:55.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd806a580 0x7f3fd8141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 0x7f3fd80c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd8151f60 0x7f3fd80c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8146870 con 0x7f3fd806a580 2023-11-28T20:59:55.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8142450 con 0x7f3fd8151f60 2023-11-28T20:59:55.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8147a70 con 0x7f3fd80c5c90 2023-11-28T20:59:55.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdc8b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd806a580 0x7f3fd8141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdc8b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd806a580 0x7f3fd8141f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35258/0 (socket says 172.21.15.167:35258) 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdc8b9640 1 -- 172.21.15.167:0/2578423886 learned_addr learned my addr 172.21.15.167:0/2578423886 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fd7fff640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 0x7f3fd80c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdd0ba640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd8151f60 0x7f3fd80c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdc8b9640 1 -- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 msgr2=0x7f3fd80c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdc8b9640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 0x7f3fd80c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdc8b9640 1 -- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd8151f60 msgr2=0x7f3fd80c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdc8b9640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd8151f60 0x7f3fd80c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdc8b9640 1 -- 172.21.15.167:0/2578423886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0094d0 con 0x7f3fd806a580 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdc8b9640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd806a580 0x7f3fd8141f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00e930 tx=0x7f3fcc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fd57fa640 1 -- 172.21.15.167:0/2578423886 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00ca00 con 0x7f3fd806a580 2023-11-28T20:59:55.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fd57fa640 1 -- 172.21.15.167:0/2578423886 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00cb60 con 0x7f3fd806a580 2023-11-28T20:59:55.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc4009420 con 0x7f3fd806a580 2023-11-28T20:59:55.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fd57fa640 1 -- 172.21.15.167:0/2578423886 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc013470 con 0x7f3fd806a580 2023-11-28T20:59:55.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd8145a10 con 0x7f3fd806a580 2023-11-28T20:59:55.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.124+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd80682c0 con 0x7f3fd806a580 2023-11-28T20:59:55.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.128+0000 7f3fd57fa640 1 -- 172.21.15.167:0/2578423886 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3fcc0135d0 con 0x7f3fd806a580 2023-11-28T20:59:55.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.128+0000 7f3fd57fa640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fbc0664a0 0x7f3fbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.128+0000 7f3fd57fa640 1 -- 172.21.15.167:0/2578423886 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3fcc084360 con 0x7f3fd806a580 2023-11-28T20:59:55.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.128+0000 7f3fd7fff640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fbc0664a0 0x7f3fbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.128+0000 7f3fd7fff640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fbc0664a0 0x7f3fbc068960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40ad000 tx=0x7f3fc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.132+0000 7f3fd57fa640 1 -- 172.21.15.167:0/2578423886 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3fcc051530 con 0x7f3fd806a580 2023-11-28T20:59:55.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.336+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3fd8075c90 con 0x7f3fd806a580 2023-11-28T20:59:55.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.336+0000 7f3fd57fa640 1 -- 172.21.15.167:0/2578423886 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f3fcc054b50 con 0x7f3fd806a580 2023-11-28T20:59:55.339 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":164,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:59:55.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fbc0664a0 msgr2=0x7f3fbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fbc0664a0 0x7f3fbc068960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40ad000 tx=0x7f3fc4008040 comp rx=0 tx=0).stop 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd806a580 msgr2=0x7f3fd8141f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd806a580 0x7f3fd8141f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00e930 tx=0x7f3fcc00edf0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 shutdown_connections 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3fbc0664a0 0x7f3fbc068960 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fd8151f60 0x7f3fd80c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fd80c5c90 0x7f3fd80c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 --2- 172.21.15.167:0/2578423886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd806a580 0x7f3fd8141f10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 >> 172.21.15.167:0/2578423886 conn(0x7f3fd80cb1e0 msgr2=0x7f3fd8159000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:55.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 shutdown_connections 2023-11-28T20:59:55.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.340+0000 7f3fdeb1d640 1 -- 172.21.15.167:0/2578423886 wait complete. 2023-11-28T20:59:55.360 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T20:59:55.360 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T20:59:55.360 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T20:59:55.360 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T20:59:55.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.500+0000 7f724b3d8640 1 Processor -- start 2023-11-28T20:59:55.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.500+0000 7f724b3d8640 1 -- start start 2023-11-28T20:59:55.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f724b3d8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f72440c75c0 0x7f72440c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f724b3d8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f724406a580 0x7f724406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f724b3d8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72440c7a50 con 0x7f7244151f60 2023-11-28T20:59:55.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f724b3d8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724406aed0 con 0x7f72440c75c0 2023-11-28T20:59:55.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f724b3d8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72440c4da0 con 0x7f724406a580 2023-11-28T20:59:55.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249174640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7244151f60 0x7f72440c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38402/0 (socket says 172.21.15.167:38402) 2023-11-28T20:59:55.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249174640 1 -- 172.21.15.167:0/4275100129 learned_addr learned my addr 172.21.15.167:0/4275100129 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:59:55.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249975640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f724406a580 0x7f724406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7248973640 1 --2- 172.21.15.167:0/4275100129 >> v2:172.21.15.178:3300/0 conn(0x7f72440c75c0 0x7f72440c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417402341 0 0) 0x7f7240001120 con 0x7f7244151f60 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7230003530 con 0x7f7244151f60 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1217291722 0 0) 0x7f7230003530 con 0x7f7244151f60 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f724406a580 msgr2=0x7f724406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f724406a580 0x7f724406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 >> v2:172.21.15.178:3300/0 conn(0x7f72440c75c0 msgr2=0x7f72440c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 --2- 172.21.15.167:0/4275100129 >> v2:172.21.15.178:3300/0 conn(0x7f72440c75c0 0x7f72440c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724415b220 con 0x7f7244151f60 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f7240001810 con 0x7f7244151f60 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 >> v1:172.21.15.167:6789/0 conn(0x7f7244151f60 legacy=0x7f72440c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f724406a580 0x7f7230003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7230003f00 0x7f72300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f7230005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724406aed0 con 0x7f7230004d10 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723000b990 con 0x7f7230003f00 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723000bb20 con 0x7f724406a580 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249975640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f7230005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7248973640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7230003f00 0x7f72300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249174640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f724406a580 0x7f7230003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249975640 1 -- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f724406a580 msgr2=0x7f7230003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249975640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f724406a580 0x7f7230003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249975640 1 -- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7230003f00 msgr2=0x7f72300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249975640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7230003f00 0x7f72300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7249975640 1 -- 172.21.15.167:0/4275100129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230003530 con 0x7f7230004d10 2023-11-28T20:59:55.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.504+0000 7f7248973640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7230003f00 0x7f72300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:59:55.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f7249975640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f7230005190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f723c00e170 tx=0x7f723c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77868a21e59516ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c0a5c50 con 0x7f7230004d10 2023-11-28T20:59:55.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c00f040 con 0x7f7230004d10 2023-11-28T20:59:55.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f723bfff640 1 -- 172.21.15.167:0/4275100129 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c0ad440 con 0x7f7230004d10 2023-11-28T20:59:55.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f724b3d8640 1 -- 172.21.15.167:0/4275100129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 msgr2=0x7f7230005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f724b3d8640 1 --2- 172.21.15.167:0/4275100129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f7230005190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f723c00e170 tx=0x7f723c01cc40 comp rx=0 tx=0).stop 2023-11-28T20:59:55.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f7249975640 1 -- 172.21.15.167:0/4275100129 reap_dead start 2023-11-28T20:59:55.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f724b3d8640 1 -- 172.21.15.167:0/4275100129 shutdown_connections 2023-11-28T20:59:55.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f724b3d8640 1 -- 172.21.15.167:0/4275100129 >> 172.21.15.167:0/4275100129 conn(0x7f72440cb1e0 msgr2=0x7f72440cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:55.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f724b3d8640 1 -- 172.21.15.167:0/4275100129 shutdown_connections 2023-11-28T20:59:55.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.508+0000 7f724b3d8640 1 -- 172.21.15.167:0/4275100129 wait complete. 2023-11-28T20:59:55.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 Processor -- start 2023-11-28T20:59:55.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 -- start start 2023-11-28T20:59:55.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f72441f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7244145060 0x7f7244156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7244156f60 0x7f724414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724415ad30 con 0x7f7230004d10 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72441ef2e0 con 0x7f7244156f60 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72441ef5c0 con 0x7f7244145060 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249174640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f72441f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249174640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f72441f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35274/0 (socket says 172.21.15.167:35274) 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249174640 1 -- 172.21.15.167:0/691080099 learned_addr learned my addr 172.21.15.167:0/691080099 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7248973640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7244145060 0x7f7244156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249975640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7244156f60 0x7f724414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249174640 1 -- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7244145060 msgr2=0x7f7244156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249174640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7244145060 0x7f7244156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249174640 1 -- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7244156f60 msgr2=0x7f724414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249174640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7244156f60 0x7f724414d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249174640 1 -- 172.21.15.167:0/691080099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72441ef8a0 con 0x7f7230004d10 2023-11-28T20:59:55.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7249174640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f72441f2660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72400117a0 tx=0x7f7240011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000fb60 con 0x7f7230004d10 2023-11-28T20:59:55.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724000fcc0 con 0x7f7230004d10 2023-11-28T20:59:55.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240015650 con 0x7f7230004d10 2023-11-28T20:59:55.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72441efb80 con 0x7f7230004d10 2023-11-28T20:59:55.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724414ca00 con 0x7f7230004d10 2023-11-28T20:59:55.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f724414d7b0 0x7f72440ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7244074770 con 0x7f724414d7b0 2023-11-28T20:59:55.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.512+0000 7f7248973640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f724414d7b0 0x7f72440ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7248973640 1 -- 172.21.15.167:0/691080099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7244152340 con 0x7f724414d7b0 2023-11-28T20:59:55.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7248973640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f724414d7b0 0x7f72440ca030 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7234013650 tx=0x7f7234013b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234011ab0 con 0x7f724414d7b0 2023-11-28T20:59:55.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72400157b0 con 0x7f7230004d10 2023-11-28T20:59:55.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7239ffb640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7228066540 0x7f7228068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7240087320 con 0x7f7230004d10 2023-11-28T20:59:55.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7234011c10 con 0x7f724414d7b0 2023-11-28T20:59:55.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f724414d7b0 msgr2=0x7f72440ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7239ffb640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f724414d7b0 0x7f72440ca030 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7234013650 tx=0x7f7234013b10 comp rx=0 tx=0).stop 2023-11-28T20:59:55.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f724414d7b0 msgr2=0x7f72440ca030 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:55.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7239ffb640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f724414d7b0 0x7f72440ca030 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7234013650 tx=0x7f7234013b10 comp rx=0 tx=0).stop 2023-11-28T20:59:55.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7249975640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7228066540 0x7f7228068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.516+0000 7f7249975640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7228066540 0x7f7228068a00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f723c0af000 tx=0x7f723c004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72440ca570 0x7f72440ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72440c2df0 con 0x7f72440ca570 2023-11-28T20:59:55.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7248973640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72440ca570 0x7f72440ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7248973640 1 -- 172.21.15.167:0/691080099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7244158750 con 0x7f72440ca570 2023-11-28T20:59:55.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7248973640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72440ca570 0x7f72440ca980 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7234009fd0 tx=0x7f7234004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7234026070 con 0x7f72440ca570 2023-11-28T20:59:55.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4643 (secure 0 0 0) 0x7f7234011e60 con 0x7f72440ca570 2023-11-28T20:59:55.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72440ca570 msgr2=0x7f72440ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7239ffb640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72440ca570 0x7f72440ca980 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7234009fd0 tx=0x7f7234004740 comp rx=0 tx=0).stop 2023-11-28T20:59:55.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7239ffb640 1 -- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72440ca570 msgr2=0x7f72440ca980 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:55.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7239ffb640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72440ca570 0x7f72440ca980 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7234009fd0 tx=0x7f7234004740 comp rx=0 tx=0).stop 2023-11-28T20:59:55.525 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 164, 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 11, 2023-11-28T20:59:55.526 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:55.527 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:55.528 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:59:55.529 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:55.530 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:55.531 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:55.532 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.533 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:59:55.534 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.535 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.536 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.537 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.538 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:59:55.538 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.538 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.538 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:59:55.538 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7228066540 msgr2=0x7f7228068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7228066540 0x7f7228068a00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f723c0af000 tx=0x7f723c004ac0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 msgr2=0x7f72441f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f72441f2660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72400117a0 tx=0x7f7240011c60 comp rx=0 tx=0).stop 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f7249975640 1 -- 172.21.15.167:0/691080099 reap_dead start 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 shutdown_connections 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 --2- 172.21.15.167:0/691080099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7230004d10 0x7f72441f2660 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 >> 172.21.15.167:0/691080099 conn(0x7f72440cb1e0 msgr2=0x7f7244150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 shutdown_connections 2023-11-28T20:59:55.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.524+0000 7f724b3d8640 1 -- 172.21.15.167:0/691080099 wait complete. 2023-11-28T20:59:55.543 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:59:55.543 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T20:59:55.544 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T20:59:55.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.680+0000 7f09c2279640 1 Processor -- start 2023-11-28T20:59:55.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.680+0000 7f09c2279640 1 -- start start 2023-11-28T20:59:55.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c2279640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09bc150b40 0x7f09bc157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c2279640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0c6ff0 0x7f09bc0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c2279640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f09bc0c5be0 0x7f09bc06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c2279640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc0c6ac0 con 0x7f09bc0c5be0 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c2279640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc0c6500 con 0x7f09bc150b40 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c2279640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c67e0 con 0x7f09bc0c6ff0 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c0816640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f09bc0c5be0 0x7f09bc06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c0816640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f09bc0c5be0 0x7f09bc06a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35308/0 (socket says 172.21.15.167:35308) 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c0816640 1 -- 172.21.15.167:0/2873058060 learned_addr learned my addr 172.21.15.167:0/2873058060 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09bb7fe640 1 --2- 172.21.15.167:0/2873058060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0c6ff0 0x7f09bc0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09bbfff640 1 --2- 172.21.15.167:0/2873058060 >> v2:172.21.15.178:3300/0 conn(0x7f09bc150b40 0x7f09bc157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c0816640 1 -- 172.21.15.167:0/2873058060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0c6ff0 msgr2=0x7f09bc0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c0816640 1 --2- 172.21.15.167:0/2873058060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0c6ff0 0x7f09bc0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c0816640 1 -- 172.21.15.167:0/2873058060 >> v2:172.21.15.178:3300/0 conn(0x7f09bc150b40 msgr2=0x7f09bc157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c0816640 1 --2- 172.21.15.167:0/2873058060 >> v2:172.21.15.178:3300/0 conn(0x7f09bc150b40 0x7f09bc157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c0816640 1 -- 172.21.15.167:0/2873058060 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc156a80 con 0x7f09bc0c5be0 2023-11-28T20:59:55.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.684+0000 7f09c0816640 1 --2- 172.21.15.167:0/2873058060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc0c5be0 0x7f09bc06a580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0cc090 tx=0x7f09b401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6e6f5766e7bb9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09baffd640 1 -- 172.21.15.167:0/2873058060 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40a5820 con 0x7f09bc0c5be0 2023-11-28T20:59:55.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09baffd640 1 -- 172.21.15.167:0/2873058060 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40a5980 con 0x7f09bc0c5be0 2023-11-28T20:59:55.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09baffd640 1 -- 172.21.15.167:0/2873058060 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40a5d10 con 0x7f09bc0c5be0 2023-11-28T20:59:55.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 -- 172.21.15.167:0/2873058060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc0c5be0 msgr2=0x7f09bc06a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 --2- 172.21.15.167:0/2873058060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc0c5be0 0x7f09bc06a580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0cc090 tx=0x7f09b401c9a0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 -- 172.21.15.167:0/2873058060 shutdown_connections 2023-11-28T20:59:55.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 --2- 172.21.15.167:0/2873058060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc0c5be0 0x7f09bc06a580 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 --2- 172.21.15.167:0/2873058060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0c6ff0 0x7f09bc0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 --2- 172.21.15.167:0/2873058060 >> v2:172.21.15.178:3300/0 conn(0x7f09bc150b40 0x7f09bc157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 -- 172.21.15.167:0/2873058060 >> 172.21.15.167:0/2873058060 conn(0x7f09bc0cb1e0 msgr2=0x7f09bc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:55.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 -- 172.21.15.167:0/2873058060 shutdown_connections 2023-11-28T20:59:55.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 -- 172.21.15.167:0/2873058060 wait complete. 2023-11-28T20:59:55.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 Processor -- start 2023-11-28T20:59:55.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 -- start start 2023-11-28T20:59:55.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.688+0000 7f09c2279640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0c5be0 0x7f09bc14bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c2279640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc0c6ff0 0x7f09bc14a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c2279640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc150b40 0x7f09bc15f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c2279640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc14fa20 con 0x7f09bc150b40 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c2279640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc14e330 con 0x7f09bc0c6ff0 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c2279640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc14e7c0 con 0x7f09bc0c5be0 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c0816640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc150b40 0x7f09bc15f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c0816640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc150b40 0x7f09bc15f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35312/0 (socket says 172.21.15.167:35312) 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c0816640 1 -- 172.21.15.167:0/1669147289 learned_addr learned my addr 172.21.15.167:0/1669147289 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09bb7fe640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc0c6ff0 0x7f09bc14a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09bbfff640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0c5be0 0x7f09bc14bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c0816640 1 -- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0c5be0 msgr2=0x7f09bc14bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c0816640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0c5be0 0x7f09bc14bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c0816640 1 -- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc0c6ff0 msgr2=0x7f09bc14a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c0816640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc0c6ff0 0x7f09bc14a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c0816640 1 -- 172.21.15.167:0/1669147289 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b4009b30 con 0x7f09bc150b40 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c0816640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc150b40 0x7f09bc15f480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f09b40af040 tx=0x7f09b4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40b8670 con 0x7f09bc150b40 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40b8810 con 0x7f09bc150b40 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40b8bc0 con 0x7f09bc150b40 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc14fea0 con 0x7f09bc150b40 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc14da00 con 0x7f09bc150b40 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c2279640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15f9c0 0x7f09bc14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc074770 con 0x7f09bc15f9c0 2023-11-28T20:59:55.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09bbfff640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15f9c0 0x7f09bc14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09bbfff640 1 -- 172.21.15.167:0/1669147289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09bc0c3d30 con 0x7f09bc15f9c0 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09bbfff640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15f9c0 0x7f09bc14dbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f09ac010820 tx=0x7f09ac010ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.692+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f09b40b8d20 con 0x7f09bc150b40 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09b8ff9640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09a8066470 0x7f09a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f09b411f970 con 0x7f09bc150b40 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac010ed0 con 0x7f09bc15f9c0 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f09ac004240 con 0x7f09bc15f9c0 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15f9c0 msgr2=0x7f09bc14dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09b8ff9640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15f9c0 0x7f09bc14dbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f09ac010820 tx=0x7f09ac010ce0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15f9c0 msgr2=0x7f09bc14dbf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09b8ff9640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15f9c0 0x7f09bc14dbf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09bb7fe640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09a8066470 0x7f09a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.696+0000 7f09bb7fe640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09a8066470 0x7f09a8068930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f09bc1f0680 tx=0x7f09b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.700+0000 7f09c2279640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc145a30 0x7f09bc145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.700+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc15fda0 con 0x7f09bc145a30 2023-11-28T20:59:55.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.700+0000 7f09bbfff640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc145a30 0x7f09bc145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09bbfff640 1 -- 172.21.15.167:0/1669147289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f09bc15a770 con 0x7f09bc145a30 2023-11-28T20:59:55.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09bbfff640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc145a30 0x7f09bc145e40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09ac010820 tx=0x7f09ac0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac024070 con 0x7f09bc145a30 2023-11-28T20:59:55.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4811 (secure 0 0 0) 0x7f09ac00eb50 con 0x7f09bc145a30 2023-11-28T20:59:55.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc145a30 msgr2=0x7f09bc145e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09b8ff9640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc145a30 0x7f09bc145e40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09ac010820 tx=0x7f09ac0046d0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09b8ff9640 1 -- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc145a30 msgr2=0x7f09bc145e40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:55.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09b8ff9640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc145a30 0x7f09bc145e40 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09ac010820 tx=0x7f09ac0046d0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.705 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:59:55.705 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:59:55.705 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:59:55.705 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 164, 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 11, 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:55.706 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:55.707 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:59:55.708 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:55.709 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:59:55.710 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.711 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.712 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:59:55.712 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:59:55.712 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:55.712 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:55.712 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:55.712 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:59:55.713 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:59:55.714 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.715 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.716 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.717 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:59:55.718 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:59:55.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09a8066470 msgr2=0x7f09a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c2279640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f09a8066470 0x7f09a8068930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f09bc1f0680 tx=0x7f09b0008040 comp rx=0 tx=0).stop 2023-11-28T20:59:55.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc150b40 msgr2=0x7f09bc15f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c2279640 1 --2- 172.21.15.167:0/1669147289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09bc150b40 0x7f09bc15f480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f09b40af040 tx=0x7f09b4019740 comp rx=0 tx=0).stop 2023-11-28T20:59:55.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c0816640 1 -- 172.21.15.167:0/1669147289 reap_dead start 2023-11-28T20:59:55.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c0816640 1 -- 172.21.15.167:0/1669147289 reap_dead start 2023-11-28T20:59:55.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 shutdown_connections 2023-11-28T20:59:55.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 >> 172.21.15.167:0/1669147289 conn(0x7f09bc0cb1e0 msgr2=0x7f09bc0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:55.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 shutdown_connections 2023-11-28T20:59:55.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.704+0000 7f09c2279640 1 -- 172.21.15.167:0/1669147289 wait complete. 2023-11-28T20:59:55.723 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:59:55.723 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T20:59:55.724 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T20:59:55.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.860+0000 7f61c8cbb640 1 Processor -- start 2023-11-28T20:59:55.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.860+0000 7f61c8cbb640 1 -- start start 2023-11-28T20:59:55.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61c8cbb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61c4070480 0x7f61c4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61c8cbb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c41571d0 con 0x7f61c406e030 2023-11-28T20:59:55.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61c8cbb640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c4071a90 con 0x7f61c406e410 2023-11-28T20:59:55.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61c8cbb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c40c70d0 con 0x7f61c4070480 2023-11-28T20:59:55.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61c259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f61c406e030 0x7f61c41500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38406/0 (socket says 172.21.15.167:38406) 2023-11-28T20:59:55.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61c259c640 1 -- 172.21.15.167:0/280884335 learned_addr learned my addr 172.21.15.167:0/280884335 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:59:55.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61b9d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61c4070480 0x7f61c4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61c1d9b640 1 -- 172.21.15.167:0/280884335 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636505872 0 0) 0x7f61c41571d0 con 0x7f61c406e030 2023-11-28T20:59:55.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61b9d9b640 1 -- 172.21.15.167:0/280884335 >> v1:172.21.15.178:6789/0 conn(0x7f61c406e410 legacy=0x7f61c4160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61b9d9b640 1 -- 172.21.15.167:0/280884335 >> v1:172.21.15.167:6789/0 conn(0x7f61c406e030 legacy=0x7f61c41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.864+0000 7f61b9d9b640 1 -- 172.21.15.167:0/280884335 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c40c73b0 con 0x7f61c4070480 2023-11-28T20:59:55.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61b9d9b640 1 --2- 172.21.15.167:0/280884335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c4070480 0x7f61c4071f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009d90 tx=0x7f61ac01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee854a7b27c8d0c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c1d9b640 1 -- 172.21.15.167:0/280884335 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0a59e0 con 0x7f61c4070480 2023-11-28T20:59:55.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c1d9b640 1 -- 172.21.15.167:0/280884335 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0a5b40 con 0x7f61c4070480 2023-11-28T20:59:55.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c1d9b640 1 -- 172.21.15.167:0/280884335 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0ad440 con 0x7f61c4070480 2023-11-28T20:59:55.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c8cbb640 1 -- 172.21.15.167:0/280884335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c4070480 msgr2=0x7f61c4071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c8cbb640 1 --2- 172.21.15.167:0/280884335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c4070480 0x7f61c4071f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009d90 tx=0x7f61ac01c920 comp rx=0 tx=0).stop 2023-11-28T20:59:55.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c8cbb640 1 -- 172.21.15.167:0/280884335 shutdown_connections 2023-11-28T20:59:55.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c8cbb640 1 --2- 172.21.15.167:0/280884335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c4070480 0x7f61c4071f20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c8cbb640 1 -- 172.21.15.167:0/280884335 >> 172.21.15.167:0/280884335 conn(0x7f61c40cb1e0 msgr2=0x7f61c40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:55.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c8cbb640 1 -- 172.21.15.167:0/280884335 shutdown_connections 2023-11-28T20:59:55.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c8cbb640 1 -- 172.21.15.167:0/280884335 wait complete. 2023-11-28T20:59:55.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c8cbb640 1 Processor -- start 2023-11-28T20:59:55.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.868+0000 7f61c8cbb640 1 -- start start 2023-11-28T20:59:55.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c406e030 0x7f61c41f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c406e410 0x7f61c41f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61c4070480 0x7f61c41426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4155f10 con 0x7f61c406e410 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c41f3060 con 0x7f61c4070480 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c41f2d80 con 0x7f61c406e030 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61b9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c406e410 0x7f61c41f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61b9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c406e410 0x7f61c41f2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35316/0 (socket says 172.21.15.167:35316) 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61b9d9b640 1 -- 172.21.15.167:0/3632699078 learned_addr learned my addr 172.21.15.167:0/3632699078 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c259c640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c406e030 0x7f61c41f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c2d9d640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61c4070480 0x7f61c41426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61b9d9b640 1 -- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c406e030 msgr2=0x7f61c41f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61b9d9b640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c406e030 0x7f61c41f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61b9d9b640 1 -- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61c4070480 msgr2=0x7f61c41426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61b9d9b640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61c4070480 0x7f61c41426d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61b9d9b640 1 -- 172.21.15.167:0/3632699078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac009a70 con 0x7f61c406e410 2023-11-28T20:59:55.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c2d9d640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61c4070480 0x7f61c41426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:59:55.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61b9d9b640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c406e410 0x7f61c41f2420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f61ac019530 tx=0x7f61ac0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0a59e0 con 0x7f61c406e410 2023-11-28T20:59:55.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0b7410 con 0x7f61c406e410 2023-11-28T20:59:55.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0b7780 con 0x7f61c406e410 2023-11-28T20:59:55.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c41590c0 con 0x7f61c406e410 2023-11-28T20:59:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c4159680 con 0x7f61c406e410 2023-11-28T20:59:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4155210 0x7f61c4142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4074770 con 0x7f61c4155210 2023-11-28T20:59:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c259c640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4155210 0x7f61c4142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61c259c640 1 -- 172.21.15.167:0/3632699078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61c4072460 con 0x7f61c4155210 2023-11-28T20:59:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.872+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61ac0b4050 con 0x7f61c406e410 2023-11-28T20:59:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61c259c640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4155210 0x7f61c4142c10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f61b4007fd0 tx=0x7f61b40018c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61bb7fe640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f61a4066470 0x7f61a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f61ac11eb50 con 0x7f61c406e410 2023-11-28T20:59:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400f5e0 con 0x7f61c4155210 2023-11-28T20:59:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f61b400f740 con 0x7f61c4155210 2023-11-28T20:59:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4155210 msgr2=0x7f61c4142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61bb7fe640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4155210 0x7f61c4142c10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f61b4007fd0 tx=0x7f61b40018c0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61c2d9d640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f61a4066470 0x7f61a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4155210 msgr2=0x7f61c4142c10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:55.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61bb7fe640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4155210 0x7f61c4142c10 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f61b4007fd0 tx=0x7f61b40018c0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.876+0000 7f61c2d9d640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f61a4066470 0x7f61a4068930 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f61bc000f70 tx=0x7f61bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.880+0000 7f61c8cbb640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4159ba0 0x7f61c4143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:55.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.880+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4159250 con 0x7f61c4159ba0 2023-11-28T20:59:55.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.880+0000 7f61c259c640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4159ba0 0x7f61c4143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:55.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c259c640 1 -- 172.21.15.167:0/3632699078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f61c40682c0 con 0x7f61c4159ba0 2023-11-28T20:59:55.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c259c640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4159ba0 0x7f61c4143150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f61b4007fd0 tx=0x7f61b4000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:55.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4023070 con 0x7f61c4159ba0 2023-11-28T20:59:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5124 (secure 0 0 0) 0x7f61b40133f0 con 0x7f61c4159ba0 2023-11-28T20:59:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4159ba0 msgr2=0x7f61c4143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61bb7fe640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4159ba0 0x7f61c4143150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f61b4007fd0 tx=0x7f61b4000ee0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61bb7fe640 1 -- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4159ba0 msgr2=0x7f61c4143150 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T20:59:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61bb7fe640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c4159ba0 0x7f61c4143150 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f61b4007fd0 tx=0x7f61b4000ee0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 164, 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T20:59:55.886 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:55.887 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:55.888 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T20:59:55.889 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T20:59:55.890 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T20:59:55.891 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.892 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:55.894 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.895 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T20:59:55.896 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.897 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.898 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T20:59:55.899 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T20:59:55.900 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T20:59:55.901 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T20:59:55.901 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T20:59:55.901 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T20:59:55.901 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T20:59:55.901 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T20:59:55.901 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T20:59:55.901 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T20:59:55.901 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T20:59:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f61a4066470 msgr2=0x7f61a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c8cbb640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f61a4066470 0x7f61a4068930 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f61bc000f70 tx=0x7f61bc009040 comp rx=0 tx=0).stop 2023-11-28T20:59:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c406e410 msgr2=0x7f61c41f2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c8cbb640 1 --2- 172.21.15.167:0/3632699078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61c406e410 0x7f61c41f2420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f61ac019530 tx=0x7f61ac0196c0 comp rx=0 tx=0).stop 2023-11-28T20:59:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c2d9d640 1 -- 172.21.15.167:0/3632699078 reap_dead start 2023-11-28T20:59:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c2d9d640 1 -- 172.21.15.167:0/3632699078 reap_dead start 2023-11-28T20:59:55.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 shutdown_connections 2023-11-28T20:59:55.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 >> 172.21.15.167:0/3632699078 conn(0x7f61c40cb1e0 msgr2=0x7f61c40c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:55.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 shutdown_connections 2023-11-28T20:59:55.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:55.884+0000 7f61c8cbb640 1 -- 172.21.15.167:0/3632699078 wait complete. 2023-11-28T20:59:55.904 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T20:59:55.904 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2023-11-28T20:59:55.904 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T20:59:55.904 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2023-11-28T20:59:55.904 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T20:59:55.904 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T20:59:55.905 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T20:59:55.926 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T20:59:55.926 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T20:59:55.926 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:59:56.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a7eaa640 1 Processor -- start 2023-11-28T20:59:56.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a7eaa640 1 -- start start 2023-11-28T20:59:56.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a7eaa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f75a00c75c0 0x7f75a00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:56.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a7eaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 0x7f75a006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:56.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a7eaa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00c7a50 con 0x7f75a0151f60 2023-11-28T20:59:56.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a7eaa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a006aed0 con 0x7f75a00c75c0 2023-11-28T20:59:56.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a7eaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00c4da0 con 0x7f75a006a580 2023-11-28T20:59:56.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a6447640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 msgr2=0x7f75a006a990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:59:56.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a6447640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 0x7f75a006a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:56.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a5c46640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f75a0151f60 0x7f75a00c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38416/0 (socket says 172.21.15.167:38416) 2023-11-28T20:59:56.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a5c46640 1 -- 172.21.15.167:0/3317315017 learned_addr learned my addr 172.21.15.167:0/3317315017 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:59:56.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.064+0000 7f75a5445640 1 --2- 172.21.15.167:0/3317315017 >> v2:172.21.15.178:3300/0 conn(0x7f75a00c75c0 0x7f75a00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:56.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739502432 0 0) 0x7f759c001120 con 0x7f75a0151f60 2023-11-28T20:59:56.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f758c003530 con 0x7f75a0151f60 2023-11-28T20:59:56.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2768496964 0 0) 0x7f758c003530 con 0x7f75a0151f60 2023-11-28T20:59:56.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 msgr2=0x7f75a006a990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:59:56.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 0x7f75a006a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 >> v2:172.21.15.178:3300/0 conn(0x7f75a00c75c0 msgr2=0x7f75a00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:56.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 --2- 172.21.15.167:0/3317315017 >> v2:172.21.15.178:3300/0 conn(0x7f75a00c75c0 0x7f75a00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a015b220 con 0x7f75a0151f60 2023-11-28T20:59:56.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f759c001810 con 0x7f75a0151f60 2023-11-28T20:59:56.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 >> v1:172.21.15.167:6789/0 conn(0x7f75a0151f60 legacy=0x7f75a00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:56.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f758c003980 0x7f758c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:56.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 0x7f758c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:56.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f758c004d10 0x7f758c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:56.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a006aed0 con 0x7f758c003980 2023-11-28T20:59:56.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c00ba70 con 0x7f758c004d10 2023-11-28T20:59:56.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c00bc30 con 0x7f75a006a580 2023-11-28T20:59:56.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a5445640 1 -- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 msgr2=0x7f758c0047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:59:56.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a5445640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 0x7f758c0047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:56.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a5c46640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f758c003980 0x7f758c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:56.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a6447640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f758c004d10 0x7f758c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:56.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a5c46640 1 -- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 msgr2=0x7f758c0047d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:59:56.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a5c46640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75a006a580 0x7f758c0047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a5c46640 1 -- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f758c004d10 msgr2=0x7f758c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T20:59:56.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a5c46640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f758c004d10 0x7f758c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a5c46640 1 -- 172.21.15.167:0/3317315017 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c003530 con 0x7f758c003980 2023-11-28T20:59:56.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a6447640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f758c004d10 0x7f758c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T20:59:56.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.068+0000 7f75a5c46640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f758c003980 0x7f758c003da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c240 tx=0x7f759c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64568ab74a016d10 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:56.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c005ae0 con 0x7f758c003980 2023-11-28T20:59:56.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c005c40 con 0x7f758c003980 2023-11-28T20:59:56.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a4c44640 1 -- 172.21.15.167:0/3317315017 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c007070 con 0x7f758c003980 2023-11-28T20:59:56.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3317315017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f758c003980 msgr2=0x7f758c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:56.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 --2- 172.21.15.167:0/3317315017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f758c003980 0x7f758c003da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c240 tx=0x7f759c01cc20 comp rx=0 tx=0).stop 2023-11-28T20:59:56.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a6447640 1 -- 172.21.15.167:0/3317315017 reap_dead start 2023-11-28T20:59:56.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3317315017 shutdown_connections 2023-11-28T20:59:56.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3317315017 >> 172.21.15.167:0/3317315017 conn(0x7f75a00cb1e0 msgr2=0x7f75a00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:56.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3317315017 shutdown_connections 2023-11-28T20:59:56.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3317315017 wait complete. 2023-11-28T20:59:56.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 Processor -- start 2023-11-28T20:59:56.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 -- start start 2023-11-28T20:59:56.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f758c003980 0x7f75a0159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:56.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a0158df0 0x7f75a00ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:56.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75a0159430 0x7f75a00caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:56.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0140140 con 0x7f75a0158df0 2023-11-28T20:59:56.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a015ab00 con 0x7f75a0159430 2023-11-28T20:59:56.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a7eaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a015ade0 con 0x7f758c003980 2023-11-28T20:59:56.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a5c46640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f758c003980 msgr2=0x7f75a0159b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:59:56.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a5445640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a0158df0 0x7f75a00ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:56.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a5c46640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f758c003980 0x7f75a0159b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:56.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a5445640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a0158df0 0x7f75a00ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35350/0 (socket says 172.21.15.167:35350) 2023-11-28T20:59:56.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.072+0000 7f75a5445640 1 -- 172.21.15.167:0/3229004766 learned_addr learned my addr 172.21.15.167:0/3229004766 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:56.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a6447640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75a0159430 0x7f75a00caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:56.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a5445640 1 -- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f758c003980 msgr2=0x7f75a0159b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:59:56.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a5445640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f758c003980 0x7f75a0159b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a5445640 1 -- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75a0159430 msgr2=0x7f75a00caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:56.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a5445640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75a0159430 0x7f75a00caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a5445640 1 -- 172.21.15.167:0/3229004766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a014c3b0 con 0x7f75a0158df0 2023-11-28T20:59:56.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a5445640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a0158df0 0x7f75a00ca660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f759000e9b0 tx=0x7f759000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:56.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75967fc640 1 -- 172.21.15.167:0/3229004766 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900096d0 con 0x7f75a0158df0 2023-11-28T20:59:56.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75967fc640 1 -- 172.21.15.167:0/3229004766 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759000ca00 con 0x7f75a0158df0 2023-11-28T20:59:56.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75967fc640 1 -- 172.21.15.167:0/3229004766 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759000cd90 con 0x7f75a0158df0 2023-11-28T20:59:56.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a014c690 con 0x7f75a0158df0 2023-11-28T20:59:56.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a014c970 con 0x7f75a0158df0 2023-11-28T20:59:56.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a00682c0 con 0x7f75a0158df0 2023-11-28T20:59:56.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75967fc640 1 -- 172.21.15.167:0/3229004766 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7590013470 con 0x7f75a0158df0 2023-11-28T20:59:56.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75967fc640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7584066420 0x7f75840688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:56.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75967fc640 1 -- 172.21.15.167:0/3229004766 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7590084420 con 0x7f75a0158df0 2023-11-28T20:59:56.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.076+0000 7f75a5c46640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7584066420 0x7f75840688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:56.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.080+0000 7f75a5c46640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7584066420 0x7f75840688e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f759c0ab000 tx=0x7f759c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:56.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.080+0000 7f75967fc640 1 -- 172.21.15.167:0/3229004766 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75900514a0 con 0x7f75a0158df0 2023-11-28T20:59:56.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f75a014c210 con 0x7f75a0158df0 2023-11-28T20:59:56.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75967fc640 1 -- 172.21.15.167:0/3229004766 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f7590017630 con 0x7f75a0158df0 2023-11-28T20:59:56.285 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":164,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:59:56.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7584066420 msgr2=0x7f75840688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7584066420 0x7f75840688e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f759c0ab000 tx=0x7f759c0a7070 comp rx=0 tx=0).stop 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a0158df0 msgr2=0x7f75a00ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a0158df0 0x7f75a00ca660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f759000e9b0 tx=0x7f759000ee70 comp rx=0 tx=0).stop 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 shutdown_connections 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7584066420 0x7f75840688e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75a0159430 0x7f75a00caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a0158df0 0x7f75a00ca660 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 --2- 172.21.15.167:0/3229004766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f758c003980 0x7f75a0159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 >> 172.21.15.167:0/3229004766 conn(0x7f75a00cb1e0 msgr2=0x7f75a0140d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 shutdown_connections 2023-11-28T20:59:56.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:56.284+0000 7f75a7eaa640 1 -- 172.21.15.167:0/3229004766 wait complete. 2023-11-28T20:59:58.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~45s 2023-11-28T20:59:59.307 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T20:59:59.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19e0017640 1 Processor -- start 2023-11-28T20:59:59.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19e0017640 1 -- start start 2023-11-28T20:59:59.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19e0017640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f19d80cf860 0x7f19d80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:59.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19e0017640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d8153ae0 0x7f19d8153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:59.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19e0017640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d815ac00 con 0x7f19d80cfc40 2023-11-28T20:59:59.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19e0017640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d80cbd60 con 0x7f19d80cf860 2023-11-28T20:59:59.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19e0017640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8159ff0 con 0x7f19d8153ae0 2023-11-28T20:59:59.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19de5b4640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d8153ae0 msgr2=0x7f19d8153f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:59:59.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19de5b4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d8153ae0 0x7f19d8153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:59.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19dddb3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f19d80cf860 0x7f19d80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:59.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19dd5b2640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f19d80cfc40 0x7f19d80ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38422/0 (socket says 172.21.15.167:38422) 2023-11-28T20:59:59.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19dd5b2640 1 -- 172.21.15.167:0/2982207920 learned_addr learned my addr 172.21.15.167:0/2982207920 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T20:59:59.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19dddb3640 1 -- 172.21.15.167:0/2982207920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d8153ae0 msgr2=0x7f19d8153f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T20:59:59.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19dddb3640 1 --2- 172.21.15.167:0/2982207920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d8153ae0 0x7f19d8153f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19dddb3640 1 -- 172.21.15.167:0/2982207920 >> v1:172.21.15.167:6789/0 conn(0x7f19d80cfc40 legacy=0x7f19d80ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:59.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19dcdb1640 1 -- 172.21.15.167:0/2982207920 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171477419 0 0) 0x7f19d815ac00 con 0x7f19d80cfc40 2023-11-28T20:59:59.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.456+0000 7f19dddb3640 1 -- 172.21.15.167:0/2982207920 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d815a2d0 con 0x7f19d80cf860 2023-11-28T20:59:59.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19dddb3640 1 --2- 172.21.15.167:0/2982207920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d80cf860 0x7f19d80cb770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19d40097c0 tx=0x7f19d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567406355cb88b3e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:59.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19dcdb1640 1 -- 172.21.15.167:0/2982207920 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d40a6040 con 0x7f19d80cf860 2023-11-28T20:59:59.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19dcdb1640 1 -- 172.21.15.167:0/2982207920 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d40aa600 con 0x7f19d80cf860 2023-11-28T20:59:59.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19dcdb1640 1 -- 172.21.15.167:0/2982207920 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d40aa990 con 0x7f19d80cf860 2023-11-28T20:59:59.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19e0017640 1 -- 172.21.15.167:0/2982207920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d80cf860 msgr2=0x7f19d80cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:59.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19e0017640 1 --2- 172.21.15.167:0/2982207920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d80cf860 0x7f19d80cb770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19d40097c0 tx=0x7f19d401c4a0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19e0017640 1 -- 172.21.15.167:0/2982207920 shutdown_connections 2023-11-28T20:59:59.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19e0017640 1 --2- 172.21.15.167:0/2982207920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d8153ae0 0x7f19d8153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19e0017640 1 --2- 172.21.15.167:0/2982207920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d80cf860 0x7f19d80cb770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19e0017640 1 -- 172.21.15.167:0/2982207920 >> 172.21.15.167:0/2982207920 conn(0x7f19d806c1f0 msgr2=0x7f19d8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19e0017640 1 -- 172.21.15.167:0/2982207920 shutdown_connections 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.460+0000 7f19e0017640 1 -- 172.21.15.167:0/2982207920 wait complete. 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 Processor -- start 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 -- start start 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d80cf860 0x7f19d80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d80cfc40 0x7f19d815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d8153ae0 0x7f19d81f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d81481a0 con 0x7f19d8153ae0 2023-11-28T20:59:59.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80c6970 con 0x7f19d80cfc40 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d81489f0 con 0x7f19d80cf860 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19dddb3640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d80cf860 msgr2=0x7f19d80ceb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19dddb3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d80cf860 0x7f19d80ceb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19de5b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d8153ae0 0x7f19d81f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19de5b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d8153ae0 0x7f19d81f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35356/0 (socket says 172.21.15.167:35356) 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19de5b4640 1 -- 172.21.15.167:0/4101908611 learned_addr learned my addr 172.21.15.167:0/4101908611 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19dd5b2640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d80cfc40 0x7f19d815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19de5b4640 1 -- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d80cf860 msgr2=0x7f19d80ceb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19de5b4640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d80cf860 0x7f19d80ceb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19de5b4640 1 -- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d80cfc40 msgr2=0x7f19d815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19de5b4640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d80cfc40 0x7f19d815ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19de5b4640 1 -- 172.21.15.167:0/4101908611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d4009420 con 0x7f19d8153ae0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19de5b4640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d8153ae0 0x7f19d81f5cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19d000be50 tx=0x7f19d000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19ce7fc640 1 -- 172.21.15.167:0/4101908611 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0016430 con 0x7f19d8153ae0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19ce7fc640 1 -- 172.21.15.167:0/4101908611 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0016590 con 0x7f19d8153ae0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19ce7fc640 1 -- 172.21.15.167:0/4101908611 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0016980 con 0x7f19d8153ae0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d81483f0 con 0x7f19d8153ae0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d80c6c30 con 0x7f19d8153ae0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.464+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d8067c40 con 0x7f19d8153ae0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.468+0000 7f19ce7fc640 1 -- 172.21.15.167:0/4101908611 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f19d0012020 con 0x7f19d8153ae0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.468+0000 7f19ce7fc640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19bc066450 0x7f19bc068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.468+0000 7f19ce7fc640 1 -- 172.21.15.167:0/4101908611 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f19d0084540 con 0x7f19d8153ae0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.468+0000 7f19dddb3640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19bc066450 0x7f19bc068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T20:59:59.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.468+0000 7f19dddb3640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19bc066450 0x7f19bc068910 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f19d40ae000 tx=0x7f19d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T20:59:59.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.472+0000 7f19ce7fc640 1 -- 172.21.15.167:0/4101908611 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19d00515e0 con 0x7f19d8153ae0 2023-11-28T20:59:59.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.676+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f19d80c7430 con 0x7f19d8153ae0 2023-11-28T20:59:59.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.676+0000 7f19ce7fc640 1 -- 172.21.15.167:0/4101908611 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f19d80c7430 con 0x7f19d8153ae0 2023-11-28T20:59:59.679 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":164,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19bc066450 msgr2=0x7f19bc068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19bc066450 0x7f19bc068910 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f19d40ae000 tx=0x7f19d4008040 comp rx=0 tx=0).stop 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d8153ae0 msgr2=0x7f19d81f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d8153ae0 0x7f19d81f5cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19d000be50 tx=0x7f19d000be80 comp rx=0 tx=0).stop 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 shutdown_connections 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19bc066450 0x7f19bc068910 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19d8153ae0 0x7f19d81f5cc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d80cfc40 0x7f19d815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 --2- 172.21.15.167:0/4101908611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d80cf860 0x7f19d80ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T20:59:59.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 >> 172.21.15.167:0/4101908611 conn(0x7f19d806c1f0 msgr2=0x7f19d8147710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T20:59:59.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 shutdown_connections 2023-11-28T20:59:59.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T20:59:59.680+0000 7f19e0017640 1 -- 172.21.15.167:0/4101908611 wait complete. 2023-11-28T21:00:02.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:00:02.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a3a32640 1 Processor -- start 2023-11-28T21:00:02.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a3a32640 1 -- start start 2023-11-28T21:00:02.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a3a32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 0x7f049c0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:02.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a3a32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f049c0c7720 0x7f049c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:02.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a3a32640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c15e5e0 con 0x7f049c15e130 2023-11-28T21:00:02.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a3a32640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c15f160 con 0x7f049c0c7720 2023-11-28T21:00:02.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a3a32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c15e8c0 con 0x7f049c1585d0 2023-11-28T21:00:02.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a17ce640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 msgr2=0x7f049c0c5e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:02.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a1fcf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f049c0c7720 0x7f049c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:02.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a17ce640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 0x7f049c0c5e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:02.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a1fcf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f049c0c7720 0x7f049c06a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38442/0 (socket says 172.21.15.167:38442) 2023-11-28T21:00:02.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a1fcf640 1 -- 172.21.15.167:0/1862558978 learned_addr learned my addr 172.21.15.167:0/1862558978 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:02.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a1fcf640 1 -- 172.21.15.167:0/1862558978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 msgr2=0x7f049c0c5e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:02.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a1fcf640 1 --2- 172.21.15.167:0/1862558978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 0x7f049c0c5e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:02.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a1fcf640 1 -- 172.21.15.167:0/1862558978 >> v1:172.21.15.178:6789/0 conn(0x7f049c15e130 legacy=0x7f049c161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:02.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.848+0000 7f04a1fcf640 1 -- 172.21.15.167:0/1862558978 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c15eba0 con 0x7f049c0c7720 2023-11-28T21:00:02.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f04a1fcf640 1 --2- 172.21.15.167:0/1862558978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c0c7720 0x7f049c06a580 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0494009e50 tx=0x7f049401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ecf816cf76e68c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:02.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f0493fff640 1 -- 172.21.15.167:0/1862558978 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940a57e0 con 0x7f049c0c7720 2023-11-28T21:00:02.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f0493fff640 1 -- 172.21.15.167:0/1862558978 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04940a5940 con 0x7f049c0c7720 2023-11-28T21:00:02.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f0493fff640 1 -- 172.21.15.167:0/1862558978 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940a5cd0 con 0x7f049c0c7720 2023-11-28T21:00:02.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f04a3a32640 1 -- 172.21.15.167:0/1862558978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c0c7720 msgr2=0x7f049c06a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:02.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f04a3a32640 1 --2- 172.21.15.167:0/1862558978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c0c7720 0x7f049c06a580 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0494009e50 tx=0x7f049401ca00 comp rx=0 tx=0).stop 2023-11-28T21:00:02.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f04a3a32640 1 -- 172.21.15.167:0/1862558978 shutdown_connections 2023-11-28T21:00:02.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f04a3a32640 1 --2- 172.21.15.167:0/1862558978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c0c7720 0x7f049c06a580 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f04a3a32640 1 --2- 172.21.15.167:0/1862558978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 0x7f049c0c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f04a3a32640 1 -- 172.21.15.167:0/1862558978 >> 172.21.15.167:0/1862558978 conn(0x7f049c0cb1e0 msgr2=0x7f049c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f04a3a32640 1 -- 172.21.15.167:0/1862558978 shutdown_connections 2023-11-28T21:00:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.852+0000 7f04a3a32640 1 -- 172.21.15.167:0/1862558978 wait complete. 2023-11-28T21:00:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 Processor -- start 2023-11-28T21:00:02.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 -- start start 2023-11-28T21:00:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f049c0c7720 0x7f049c1fa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 0x7f049c14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c15e130 0x7f049c148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c151200 con 0x7f049c15e130 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c1fab00 con 0x7f049c0c7720 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c15f390 con 0x7f049c1585d0 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a0fcd640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 msgr2=0x7f049c14e9f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a0fcd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 0x7f049c14e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a1fcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c15e130 0x7f049c148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a1fcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c15e130 0x7f049c148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38456/0 (socket says 172.21.15.167:38456) 2023-11-28T21:00:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a1fcf640 1 -- 172.21.15.167:0/2888069101 learned_addr learned my addr 172.21.15.167:0/2888069101 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a17ce640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f049c0c7720 0x7f049c1fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a1fcf640 1 -- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 msgr2=0x7f049c14e9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a1fcf640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 0x7f049c14e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a1fcf640 1 -- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f049c0c7720 msgr2=0x7f049c1fa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a1fcf640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f049c0c7720 0x7f049c1fa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a1fcf640 1 -- 172.21.15.167:0/2888069101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009b30 con 0x7f049c15e130 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a17ce640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f049c0c7720 0x7f049c1fa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a1fcf640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c15e130 0x7f049c148270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f04940af040 tx=0x7f04940197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f0491ffb640 1 -- 172.21.15.167:0/2888069101 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940b8670 con 0x7f049c15e130 2023-11-28T21:00:02.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f0491ffb640 1 -- 172.21.15.167:0/2888069101 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04940b87d0 con 0x7f049c15e130 2023-11-28T21:00:02.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c0c3fa0 con 0x7f049c15e130 2023-11-28T21:00:02.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f0491ffb640 1 -- 172.21.15.167:0/2888069101 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940b8b60 con 0x7f049c15e130 2023-11-28T21:00:02.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.856+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c15f910 con 0x7f049c15e130 2023-11-28T21:00:02.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.860+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c0682c0 con 0x7f049c15e130 2023-11-28T21:00:02.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.860+0000 7f0491ffb640 1 -- 172.21.15.167:0/2888069101 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f04940b8cc0 con 0x7f049c15e130 2023-11-28T21:00:02.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.860+0000 7f0491ffb640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0480066420 0x7f04800688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:02.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.860+0000 7f0491ffb640 1 -- 172.21.15.167:0/2888069101 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f049411fa90 con 0x7f049c15e130 2023-11-28T21:00:02.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.860+0000 7f04a17ce640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0480066420 0x7f04800688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:02.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.860+0000 7f04a17ce640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0480066420 0x7f04800688e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0498003940 tx=0x7f0498008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:02.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:02.864+0000 7f0491ffb640 1 -- 172.21.15.167:0/2888069101 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04940ecb10 con 0x7f049c15e130 2023-11-28T21:00:03.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.064+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f049c075c90 con 0x7f049c15e130 2023-11-28T21:00:03.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.064+0000 7f0491ffb640 1 -- 172.21.15.167:0/2888069101 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f04940f0130 con 0x7f049c15e130 2023-11-28T21:00:03.067 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":164,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:00:03.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0480066420 msgr2=0x7f04800688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:03.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0480066420 0x7f04800688e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0498003940 tx=0x7f0498008040 comp rx=0 tx=0).stop 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c15e130 msgr2=0x7f049c148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c15e130 0x7f049c148270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f04940af040 tx=0x7f04940197a0 comp rx=0 tx=0).stop 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 shutdown_connections 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0480066420 0x7f04800688e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f049c15e130 0x7f049c148270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f049c1585d0 0x7f049c14e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 --2- 172.21.15.167:0/2888069101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f049c0c7720 0x7f049c1fa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 >> 172.21.15.167:0/2888069101 conn(0x7f049c0cb1e0 msgr2=0x7f049c1525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 shutdown_connections 2023-11-28T21:00:03.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:03.068+0000 7f04a3a32640 1 -- 172.21.15.167:0/2888069101 wait complete. 2023-11-28T21:00:05.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~52s 2023-11-28T21:00:06.089 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:00:06.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b4491640 1 Processor -- start 2023-11-28T21:00:06.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b4491640 1 -- start start 2023-11-28T21:00:06.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b4491640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 0x7f11ac157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b4491640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b4491640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac0c6ac0 con 0x7f11ac0c5be0 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b4491640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac0c6500 con 0x7f11ac0c6ff0 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b4491640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac0c67e0 con 0x7f11ac150b40 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b222d640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 msgr2=0x7f11ac157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b222d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 0x7f11ac157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b1a2c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b1a2c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:57626/0 (socket says 172.21.15.167:57626) 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 learned_addr learned my addr 172.21.15.167:0/1568908019 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:06.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 msgr2=0x7f11ac0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:00:06.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 msgr2=0x7f11ac0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:06.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:06.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.236+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:06.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.440+0000 7f11b222d640 1 -- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 msgr2=0x7f11ac157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:06.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.440+0000 7f11b222d640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 0x7f11ac157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:00:06.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.440+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:06.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.440+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 msgr2=0x7f11ac0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:00:06.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.440+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 msgr2=0x7f11ac0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:06.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.440+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:06.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.440+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:00:06.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.844+0000 7f11b222d640 1 -- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 msgr2=0x7f11ac157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:06.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.844+0000 7f11b222d640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 0x7f11ac157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:00:06.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.844+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:06.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.844+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 msgr2=0x7f11ac0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:00:06.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.844+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 msgr2=0x7f11ac0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:06.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.844+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:06.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:06.844+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:00:07.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:07.648+0000 7f11b222d640 1 -- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 msgr2=0x7f11ac157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:07.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:07.648+0000 7f11b222d640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 0x7f11ac157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:00:07.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:07.648+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:07.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:07.648+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 msgr2=0x7f11ac0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:07.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:07.648+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 msgr2=0x7f11ac0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:07.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:07.648+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:07.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:07.648+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:00:09.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11a3fff640 1 -- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 msgr2=0x7f11ac157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:09.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11a3fff640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11ac150b40 0x7f11ac157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:09.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11a3fff640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 msgr2=0x7f11ac0c4510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:09.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11a3fff640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.178:3300/0 conn(0x7f11ac0c6ff0 0x7f11ac0c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:09.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11a3fff640 1 -- 172.21.15.167:0/1568908019 >> v1:172.21.15.178:6789/0 conn(0x7f11ac0c5be0 legacy=0x7f11ac06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:09.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11a3fff640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:09.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11a3fff640 1 -- 172.21.15.167:0/1568908019 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac156a80 con 0x7f1190005900 2023-11-28T21:00:09.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11a3fff640 1 -- 172.21.15.167:0/1568908019 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac0c6500 con 0x7f1190009590 2023-11-28T21:00:09.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:09.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 msgr2=0x7f119000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:09.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 msgr2=0x7f119000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:09.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:09.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.240+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:09.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.444+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:09.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.444+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 msgr2=0x7f119000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:09.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.444+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 msgr2=0x7f119000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:09.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.444+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:09.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.444+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:00:09.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.848+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:09.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.848+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 msgr2=0x7f119000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:09.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.848+0000 7f11b1a2c640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 msgr2=0x7f119000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:09.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.848+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:09.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:09.848+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:00:10.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456031403 0 0) 0x7f11ac156a80 con 0x7f1190005900 2023-11-28T21:00:10.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1198003530 con 0x7f1190005900 2023-11-28T21:00:10.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 530154719 0 0) 0x7f1198003530 con 0x7f1190005900 2023-11-28T21:00:10.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 msgr2=0x7f119000ba50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:10.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 --2- 172.21.15.167:0/1568908019 >> v2:172.21.15.167:3300/0 conn(0x7f1190009590 0x7f119000ba50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119000d150 con 0x7f1190005900 2023-11-28T21:00:10.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f11a8004350 con 0x7f1190005900 2023-11-28T21:00:10.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 >> v1:172.21.15.167:6789/0 conn(0x7f1190005900 legacy=0x7f1190007d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b2a2e640 1 -- 172.21.15.167:0/1568908019 reap_dead start 2023-11-28T21:00:10.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f1198003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 0x7f1198004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 0x7f119800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac0c6500 con 0x7f1198003980 2023-11-28T21:00:10.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119800c110 con 0x7f11980047d0 2023-11-28T21:00:10.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119800c2d0 con 0x7f11980051e0 2023-11-28T21:00:10.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b222d640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f1198003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b2a2e640 1 -- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 msgr2=0x7f119800b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:10.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b2a2e640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 0x7f119800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:10.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 0x7f1198004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b222d640 1 -- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 msgr2=0x7f119800b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:10.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b222d640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 0x7f119800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b222d640 1 -- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 msgr2=0x7f1198004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:10.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b222d640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 0x7f1198004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b222d640 1 -- 172.21.15.167:0/1568908019 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1198003530 con 0x7f1198003980 2023-11-28T21:00:10.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.388+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 0x7f1198004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:10.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b222d640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f1198003d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11a8003940 tx=0x7f11a801cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f2d05f56d229e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80a5bf0 con 0x7f1198003980 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a80a5d70 con 0x7f1198003980 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b122b640 1 -- 172.21.15.167:0/1568908019 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80ae6b0 con 0x7f1198003980 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b4491640 1 -- 172.21.15.167:0/1568908019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 msgr2=0x7f1198003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b4491640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f1198003d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11a8003940 tx=0x7f11a801cd10 comp rx=0 tx=0).stop 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b4491640 1 -- 172.21.15.167:0/1568908019 shutdown_connections 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b4491640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 0x7f119800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b4491640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 0x7f1198004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b4491640 1 --2- 172.21.15.167:0/1568908019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f1198003d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b4491640 1 -- 172.21.15.167:0/1568908019 >> 172.21.15.167:0/1568908019 conn(0x7f11ac0cb1e0 msgr2=0x7f11ac0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b4491640 1 -- 172.21.15.167:0/1568908019 shutdown_connections 2023-11-28T21:00:10.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.392+0000 7f11b4491640 1 -- 172.21.15.167:0/1568908019 wait complete. 2023-11-28T21:00:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b4491640 1 Processor -- start 2023-11-28T21:00:10.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b4491640 1 -- start start 2023-11-28T21:00:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b4491640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f11ac153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b4491640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 0x7f11ac070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b4491640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 0x7f11ac1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b4491640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac0b82e0 con 0x7f1198003980 2023-11-28T21:00:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b4491640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac1542d0 con 0x7f11980047d0 2023-11-28T21:00:10.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b4491640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac1f1600 con 0x7f11980051e0 2023-11-28T21:00:10.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b2a2e640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 msgr2=0x7f11ac1523b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:10.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b222d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f11ac153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b2a2e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 0x7f11ac1523b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:10.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b222d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f11ac153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38514/0 (socket says 172.21.15.167:38514) 2023-11-28T21:00:10.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b222d640 1 -- 172.21.15.167:0/3510734385 learned_addr learned my addr 172.21.15.167:0/3510734385 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:10.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 0x7f11ac070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b222d640 1 -- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 msgr2=0x7f11ac1523b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:00:10.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b222d640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 0x7f11ac1523b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b222d640 1 -- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 msgr2=0x7f11ac070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b222d640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 0x7f11ac070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b222d640 1 -- 172.21.15.167:0/3510734385 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac1f18a0 con 0x7f1198003980 2023-11-28T21:00:10.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b222d640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f11ac153c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11a801cb40 tx=0x7f1198005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11a2ffd640 1 -- 172.21.15.167:0/3510734385 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8004150 con 0x7f1198003980 2023-11-28T21:00:10.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11a2ffd640 1 -- 172.21.15.167:0/3510734385 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a80042b0 con 0x7f1198003980 2023-11-28T21:00:10.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ac1f1b80 con 0x7f1198003980 2023-11-28T21:00:10.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.396+0000 7f11a2ffd640 1 -- 172.21.15.167:0/3510734385 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80aeb50 con 0x7f1198003980 2023-11-28T21:00:10.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.400+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ac1f2140 con 0x7f1198003980 2023-11-28T21:00:10.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.400+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ac0682c0 con 0x7f1198003980 2023-11-28T21:00:10.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.400+0000 7f11a2ffd640 1 -- 172.21.15.167:0/3510734385 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f11a80ab070 con 0x7f1198003980 2023-11-28T21:00:10.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.400+0000 7f11a2ffd640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1190068ef0 0x7f119006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.400+0000 7f11a2ffd640 1 -- 172.21.15.167:0/3510734385 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f11a811d840 con 0x7f1198003980 2023-11-28T21:00:10.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.404+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1190068ef0 0x7f119006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.404+0000 7f11b1a2c640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1190068ef0 0x7f119006b3b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0c6ed0 tx=0x7f119c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.404+0000 7f11a2ffd640 1 -- 172.21.15.167:0/3510734385 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f11a80ea9f0 con 0x7f1198003980 2023-11-28T21:00:10.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f11ac1f2360 con 0x7f1198003980 2023-11-28T21:00:10.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11a2ffd640 1 -- 172.21.15.167:0/3510734385 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f11a80ee010 con 0x7f1198003980 2023-11-28T21:00:10.616 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":168,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:00:10.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1190068ef0 msgr2=0x7f119006b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1190068ef0 0x7f119006b3b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0c6ed0 tx=0x7f119c008040 comp rx=0 tx=0).stop 2023-11-28T21:00:10.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 msgr2=0x7f11ac153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f11ac153c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11a801cb40 tx=0x7f1198005800 comp rx=0 tx=0).stop 2023-11-28T21:00:10.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 shutdown_connections 2023-11-28T21:00:10.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1190068ef0 0x7f119006b3b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11980051e0 0x7f11ac1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11980047d0 0x7f11ac070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 --2- 172.21.15.167:0/3510734385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1198003980 0x7f11ac153c40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 >> 172.21.15.167:0/3510734385 conn(0x7f11ac0cb1e0 msgr2=0x7f11ac14fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:10.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 shutdown_connections 2023-11-28T21:00:10.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.616+0000 7f11b4491640 1 -- 172.21.15.167:0/3510734385 wait complete. 2023-11-28T21:00:10.637 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T21:00:10.637 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T21:00:10.638 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:00:10.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f17127f5640 1 Processor -- start 2023-11-28T21:00:10.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f17127f5640 1 -- start start 2023-11-28T21:00:10.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f17127f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e030 0x7f170c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f17127f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f170c070480 0x7f170c1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f17127f5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f170c06e410 0x7f170c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f17127f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170c1571d0 con 0x7f170c070480 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f17127f5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170c071a90 con 0x7f170c06e410 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f17127f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0c70d0 con 0x7f170c06e030 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170bfff640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e030 msgr2=0x7f170c1500b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170bfff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e030 0x7f170c1500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f170c070480 0x7f170c1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170b7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f170c070480 0x7f170c1505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38528/0 (socket says 172.21.15.167:38528) 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170b7fe640 1 -- 172.21.15.167:0/1434846731 learned_addr learned my addr 172.21.15.167:0/1434846731 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f1710d92640 1 --2- 172.21.15.167:0/1434846731 >> v2:172.21.15.178:3300/0 conn(0x7f170c06e410 0x7f170c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170b7fe640 1 -- 172.21.15.167:0/1434846731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e030 msgr2=0x7f170c1500b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170b7fe640 1 --2- 172.21.15.167:0/1434846731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e030 0x7f170c1500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170b7fe640 1 -- 172.21.15.167:0/1434846731 >> v2:172.21.15.178:3300/0 conn(0x7f170c06e410 msgr2=0x7f170c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:10.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170b7fe640 1 --2- 172.21.15.167:0/1434846731 >> v2:172.21.15.178:3300/0 conn(0x7f170c06e410 0x7f170c071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.776+0000 7f170b7fe640 1 -- 172.21.15.167:0/1434846731 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c0c73b0 con 0x7f170c070480 2023-11-28T21:00:10.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f170b7fe640 1 --2- 172.21.15.167:0/1434846731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c070480 0x7f170c1505f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f170c0c7c90 tx=0x7f170001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7e381ff1376add server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f170affd640 1 -- 172.21.15.167:0/1434846731 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000aa610 con 0x7f170c070480 2023-11-28T21:00:10.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f170affd640 1 -- 172.21.15.167:0/1434846731 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17000a6040 con 0x7f170c070480 2023-11-28T21:00:10.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f170affd640 1 -- 172.21.15.167:0/1434846731 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000aa990 con 0x7f170c070480 2023-11-28T21:00:10.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f17127f5640 1 -- 172.21.15.167:0/1434846731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c070480 msgr2=0x7f170c1505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f17127f5640 1 --2- 172.21.15.167:0/1434846731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c070480 0x7f170c1505f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f170c0c7c90 tx=0x7f170001c4f0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f17127f5640 1 -- 172.21.15.167:0/1434846731 shutdown_connections 2023-11-28T21:00:10.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f17127f5640 1 --2- 172.21.15.167:0/1434846731 >> v2:172.21.15.178:3300/0 conn(0x7f170c06e410 0x7f170c071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f17127f5640 1 --2- 172.21.15.167:0/1434846731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c070480 0x7f170c1505f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f17127f5640 1 --2- 172.21.15.167:0/1434846731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e030 0x7f170c1500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f17127f5640 1 -- 172.21.15.167:0/1434846731 >> 172.21.15.167:0/1434846731 conn(0x7f170c0cb1e0 msgr2=0x7f170c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:10.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f17127f5640 1 -- 172.21.15.167:0/1434846731 shutdown_connections 2023-11-28T21:00:10.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.780+0000 7f17127f5640 1 -- 172.21.15.167:0/1434846731 wait complete. 2023-11-28T21:00:10.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 Processor -- start 2023-11-28T21:00:10.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 -- start start 2023-11-28T21:00:10.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c06e030 0x7f170c14e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e410 0x7f170c1f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f170c070480 0x7f170c1f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1573b0 con 0x7f170c06e030 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c157650 con 0x7f170c070480 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c157930 con 0x7f170c06e410 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170b7fe640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e410 msgr2=0x7f170c1f42a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170b7fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e410 0x7f170c1f42a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c06e030 0x7f170c14e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c06e030 0x7f170c14e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38536/0 (socket says 172.21.15.167:38536) 2023-11-28T21:00:10.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170bfff640 1 -- 172.21.15.167:0/2414442276 learned_addr learned my addr 172.21.15.167:0/2414442276 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f1710d92640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f170c070480 0x7f170c1f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170bfff640 1 -- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e410 msgr2=0x7f170c1f42a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170bfff640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f170c06e410 0x7f170c1f42a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170bfff640 1 -- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f170c070480 msgr2=0x7f170c1f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170bfff640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f170c070480 0x7f170c1f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170bfff640 1 -- 172.21.15.167:0/2414442276 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17000094d0 con 0x7f170c06e030 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f1710d92640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f170c070480 0x7f170c1f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170bfff640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c06e030 0x7f170c14e0b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b530 tx=0x7f16fc00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc003dd0 con 0x7f170c06e030 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc005070 con 0x7f170c06e030 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c157c10 con 0x7f170c06e030 2023-11-28T21:00:10.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc005420 con 0x7f170c06e030 2023-11-28T21:00:10.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c1581d0 con 0x7f170c06e030 2023-11-28T21:00:10.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c1535a0 0x7f170c1435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c074770 con 0x7f170c1535a0 2023-11-28T21:00:10.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.784+0000 7f170b7fe640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c1535a0 0x7f170c1435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f170b7fe640 1 -- 172.21.15.167:0/2414442276 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f170c0682c0 con 0x7f170c1535a0 2023-11-28T21:00:10.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f170b7fe640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c1535a0 0x7f170c1435c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f170c06fe60 tx=0x7f170001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16fc005580 con 0x7f170c06e030 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1708ff9640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16f8066420 0x7f16f80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f16fc084230 con 0x7f170c06e030 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000aa820 con 0x7f170c1535a0 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f17000b7070 con 0x7f170c1535a0 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c1535a0 msgr2=0x7f170c1435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1708ff9640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c1535a0 0x7f170c1435c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f170c06fe60 tx=0x7f170001ad30 comp rx=0 tx=0).stop 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c1535a0 msgr2=0x7f170c1435c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1708ff9640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c1535a0 0x7f170c1435c0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f170c06fe60 tx=0x7f170001ad30 comp rx=0 tx=0).stop 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1710d92640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16f8066420 0x7f16f80688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.788+0000 7f1710d92640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16f8066420 0x7f16f80688e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f170c15a8a0 tx=0x7f170400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.792+0000 7f17127f5640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c150b60 0x7f170c143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.792+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c075c90 con 0x7f170c150b60 2023-11-28T21:00:10.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f170b7fe640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c150b60 0x7f170c143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f170b7fe640 1 -- 172.21.15.167:0/2414442276 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f170c0c8b90 con 0x7f170c150b60 2023-11-28T21:00:10.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f170b7fe640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c150b60 0x7f170c143b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f170001cd90 tx=0x7f1700019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000c1040 con 0x7f170c150b60 2023-11-28T21:00:10.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5114 (secure 0 0 0) 0x7f1700003d50 con 0x7f170c150b60 2023-11-28T21:00:10.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c150b60 msgr2=0x7f170c143b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f1708ff9640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c150b60 0x7f170c143b00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f170001cd90 tx=0x7f1700019290 comp rx=0 tx=0).stop 2023-11-28T21:00:10.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f1708ff9640 1 -- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c150b60 msgr2=0x7f170c143b00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:10.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f1708ff9640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c150b60 0x7f170c143b00 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f170001cd90 tx=0x7f1700019290 comp rx=0 tx=0).stop 2023-11-28T21:00:10.799 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:00:10.799 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:10.799 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:10.799 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 168, 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:10.800 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:10.801 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.802 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:00:10.803 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:10.804 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:10.805 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.806 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:10.807 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.808 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.809 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:10.810 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.811 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.812 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.813 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:00:10.814 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.815 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:10.815 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.815 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:00:10.815 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.815 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.815 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.815 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:00:10.815 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:00:10.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16f8066420 msgr2=0x7f16f80688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f17127f5640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16f8066420 0x7f16f80688e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f170c15a8a0 tx=0x7f170400b040 comp rx=0 tx=0).stop 2023-11-28T21:00:10.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c06e030 msgr2=0x7f170c14e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f17127f5640 1 --2- 172.21.15.167:0/2414442276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c06e030 0x7f170c14e0b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b530 tx=0x7f16fc00b9f0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f1710d92640 1 -- 172.21.15.167:0/2414442276 reap_dead start 2023-11-28T21:00:10.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f1710d92640 1 -- 172.21.15.167:0/2414442276 reap_dead start 2023-11-28T21:00:10.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 shutdown_connections 2023-11-28T21:00:10.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 >> 172.21.15.167:0/2414442276 conn(0x7f170c0cb1e0 msgr2=0x7f170c0c3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:10.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 shutdown_connections 2023-11-28T21:00:10.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.796+0000 7f17127f5640 1 -- 172.21.15.167:0/2414442276 wait complete. 2023-11-28T21:00:10.818 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:00:10.818 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T21:00:10.818 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:00:10.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.956+0000 7f2eeafb8640 1 Processor -- start 2023-11-28T21:00:10.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.956+0000 7f2eeafb8640 1 -- start start 2023-11-28T21:00:10.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.956+0000 7f2eeafb8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 0x7f2ee4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.956+0000 7f2eeafb8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ee40c4510 0x7f2ee406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.956+0000 7f2eeafb8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40c4940 con 0x7f2ee40c6ff0 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.956+0000 7f2eeafb8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee40c62f0 con 0x7f2ee40c4510 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.956+0000 7f2eeafb8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40c6ac0 con 0x7f2ee4150b40 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee8d54640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 msgr2=0x7f2ee4157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee8d54640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 0x7f2ee4157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee3fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2ee40c6ff0 0x7f2ee40c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47852/0 (socket says 172.21.15.167:47852) 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee3fff640 1 -- 172.21.15.167:0/68743449 learned_addr learned my addr 172.21.15.167:0/68743449 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee9555640 1 --2- 172.21.15.167:0/68743449 >> v2:172.21.15.178:3300/0 conn(0x7f2ee40c4510 0x7f2ee406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204531456 0 0) 0x7f2ee40c4940 con 0x7f2ee40c6ff0 2023-11-28T21:00:10.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed4003530 con 0x7f2ee40c6ff0 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2049715247 0 0) 0x7f2ed4003530 con 0x7f2ee40c6ff0 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 msgr2=0x7f2ee4157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 0x7f2ee4157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 >> v2:172.21.15.178:3300/0 conn(0x7f2ee40c4510 msgr2=0x7f2ee406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 --2- 172.21.15.167:0/68743449 >> v2:172.21.15.178:3300/0 conn(0x7f2ee40c4510 0x7f2ee406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40c6500 con 0x7f2ee40c6ff0 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f2ed0001680 con 0x7f2ee40c6ff0 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 >> v1:172.21.15.167:6789/0 conn(0x7f2ee40c6ff0 legacy=0x7f2ee40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ed4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed4004370 0x7f2ed4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 0x7f2ed40050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40c62f0 con 0x7f2ed4003980 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40c6ac0 con 0x7f2ed4004370 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed400ba40 con 0x7f2ee4150b40 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee9555640 1 -- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 msgr2=0x7f2ed40050d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee8d54640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ed4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee9555640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 0x7f2ed40050d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee3fff640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed4004370 0x7f2ed4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee8d54640 1 -- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 msgr2=0x7f2ed40050d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee8d54640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4150b40 0x7f2ed40050d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee8d54640 1 -- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed4004370 msgr2=0x7f2ed4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee8d54640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed4004370 0x7f2ed4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee8d54640 1 -- 172.21.15.167:0/68743449 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed4003530 con 0x7f2ed4003980 2023-11-28T21:00:10.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.960+0000 7f2ee3fff640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ed4004370 0x7f2ed4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2ee8d54640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ed4003da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8003940 tx=0x7f2ed801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf625886a5c00e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8003bc0 con 0x7f2ed4003980 2023-11-28T21:00:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed80a7070 con 0x7f2ed4003980 2023-11-28T21:00:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2ee37fe640 1 -- 172.21.15.167:0/68743449 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8005070 con 0x7f2ed4003980 2023-11-28T21:00:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2eeafb8640 1 -- 172.21.15.167:0/68743449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 msgr2=0x7f2ed4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2eeafb8640 1 --2- 172.21.15.167:0/68743449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ed4003da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8003940 tx=0x7f2ed801c3f0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2ee9555640 1 -- 172.21.15.167:0/68743449 reap_dead start 2023-11-28T21:00:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2eeafb8640 1 -- 172.21.15.167:0/68743449 shutdown_connections 2023-11-28T21:00:10.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2eeafb8640 1 -- 172.21.15.167:0/68743449 >> 172.21.15.167:0/68743449 conn(0x7f2ee40cb1e0 msgr2=0x7f2ee40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:10.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2eeafb8640 1 -- 172.21.15.167:0/68743449 shutdown_connections 2023-11-28T21:00:10.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2eeafb8640 1 -- 172.21.15.167:0/68743449 wait complete. 2023-11-28T21:00:10.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2eeafb8640 1 Processor -- start 2023-11-28T21:00:10.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.964+0000 7f2eeafb8640 1 -- start start 2023-11-28T21:00:10.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ee4144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee414a230 0x7f2ee414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4071590 0x7f2ee4071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee415dff0 con 0x7f2ed4003980 2023-11-28T21:00:10.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40cb000 con 0x7f2ee414a230 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee415f950 con 0x7f2ee4071590 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee9555640 1 -- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4071590 msgr2=0x7f2ee4071a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3301/0 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee8d54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ee4144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee9555640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4071590 0x7f2ee4071a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee8d54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ee4144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:38564/0 (socket says 172.21.15.167:38564) 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee8d54640 1 -- 172.21.15.167:0/852144935 learned_addr learned my addr 172.21.15.167:0/852144935 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee3fff640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee414a230 0x7f2ee414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee8d54640 1 -- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4071590 msgr2=0x7f2ee4071a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee8d54640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee4071590 0x7f2ee4071a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee8d54640 1 -- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee414a230 msgr2=0x7f2ee414a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee8d54640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee414a230 0x7f2ee414a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee8d54640 1 -- 172.21.15.167:0/852144935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee4071f50 con 0x7f2ed4003980 2023-11-28T21:00:10.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee3fff640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee414a230 0x7f2ee414a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:10.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee8d54640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ee4144fd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ed801c220 tx=0x7f2ed4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80b3070 con 0x7f2ed4003980 2023-11-28T21:00:10.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed8005160 con 0x7f2ed4003980 2023-11-28T21:00:10.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80054d0 con 0x7f2ed4003980 2023-11-28T21:00:10.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee40caa80 con 0x7f2ed4003980 2023-11-28T21:00:10.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee415f300 con 0x7f2ed4003980 2023-11-28T21:00:10.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee415f4f0 0x7f2ee41f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4074770 con 0x7f2ee415f4f0 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee3fff640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee415f4f0 0x7f2ee41f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ed80a9020 con 0x7f2ed4003980 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.968+0000 7f2ee3fff640 1 -- 172.21.15.167:0/852144935 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ee4160c10 con 0x7f2ee415f4f0 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee3fff640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee415f4f0 0x7f2ee41f3a70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2ee415b0d0 tx=0x7f2ed0010b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee17fa640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec8066450 0x7f2ec8068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2ed811d480 con 0x7f2ed4003980 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000e930 con 0x7f2ee415f4f0 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee9555640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec8066450 0x7f2ec8068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2ed0010e90 con 0x7f2ee415f4f0 2023-11-28T21:00:10.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee415f4f0 msgr2=0x7f2ee41f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee17fa640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee415f4f0 0x7f2ee41f3a70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2ee415b0d0 tx=0x7f2ed0010b50 comp rx=0 tx=0).stop 2023-11-28T21:00:10.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee415f4f0 msgr2=0x7f2ee41f3a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:10.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee17fa640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee415f4f0 0x7f2ee41f3a70 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2ee415b0d0 tx=0x7f2ed0010b50 comp rx=0 tx=0).stop 2023-11-28T21:00:10.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.972+0000 7f2ee9555640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec8066450 0x7f2ec8068910 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2ee406eee0 tx=0x7f2edc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.976+0000 7f2eeafb8640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee41f3fb0 0x7f2ee414b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:10.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.976+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee415fac0 con 0x7f2ee41f3fb0 2023-11-28T21:00:10.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.976+0000 7f2ee3fff640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee41f3fb0 0x7f2ee414b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:10.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2ee3fff640 1 -- 172.21.15.167:0/852144935 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2ee4157040 con 0x7f2ee41f3fb0 2023-11-28T21:00:10.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2ee3fff640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee41f3fb0 0x7f2ee414b160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0019000 tx=0x7f2ed0001160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:10.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed001d620 con 0x7f2ee41f3fb0 2023-11-28T21:00:10.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4799 (secure 0 0 0) 0x7f2ed001d780 con 0x7f2ee41f3fb0 2023-11-28T21:00:10.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee41f3fb0 msgr2=0x7f2ee414b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2ee17fa640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee41f3fb0 0x7f2ee414b160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0019000 tx=0x7f2ed0001160 comp rx=0 tx=0).stop 2023-11-28T21:00:10.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2ee17fa640 1 -- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee41f3fb0 msgr2=0x7f2ee414b160 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:10.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2ee17fa640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee41f3fb0 0x7f2ee414b160 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0019000 tx=0x7f2ed0001160 comp rx=0 tx=0).stop 2023-11-28T21:00:10.982 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:00:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:00:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 168, 2023-11-28T21:00:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:00:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:00:10.982 INFO:teuthology.orchestra.run.smithi167.stdout: 1 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:10.983 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:10.984 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:00:10.985 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:10.986 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.987 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:10.989 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:10.991 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:10.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.994 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.995 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:00:10.996 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:00:10.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec8066450 msgr2=0x7f2ec8068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2eeafb8640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ec8066450 0x7f2ec8068910 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2ee406eee0 tx=0x7f2edc00b040 comp rx=0 tx=0).stop 2023-11-28T21:00:10.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 msgr2=0x7f2ee4144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:10.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2eeafb8640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ee4144fd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ed801c220 tx=0x7f2ed4005800 comp rx=0 tx=0).stop 2023-11-28T21:00:10.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2ee9555640 1 -- 172.21.15.167:0/852144935 reap_dead start 2023-11-28T21:00:10.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 shutdown_connections 2023-11-28T21:00:10.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2eeafb8640 1 --2- 172.21.15.167:0/852144935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ed4003980 0x7f2ee4144fd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:10.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 >> 172.21.15.167:0/852144935 conn(0x7f2ee40cb1e0 msgr2=0x7f2ee4155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:10.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 shutdown_connections 2023-11-28T21:00:10.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:10.980+0000 7f2eeafb8640 1 -- 172.21.15.167:0/852144935 wait complete. 2023-11-28T21:00:11.002 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:00:11.002 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T21:00:11.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~59s 2023-11-28T21:00:18.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2023-11-28T21:00:22.122 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:22.127 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:25.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~72s 2023-11-28T21:00:31.002 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2023-11-28T21:00:31.003 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2023-11-28T21:00:31.003 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T21:00:31.003 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T21:00:31.005 INFO:tasks.ceph.mon.c:Started 2023-11-28T21:00:31.006 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:00:31.006 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:00:31.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.147+0000 7fc8a6c17640 1 Processor -- start 2023-11-28T21:00:31.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.147+0000 7fc8a6c17640 1 -- start start 2023-11-28T21:00:31.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6c17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 0x7fc8a00ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:31.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6c17640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a015a9f0 con 0x7fc8a00ccb70 2023-11-28T21:00:31.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6c17640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00cfef0 con 0x7fc8a0153db0 2023-11-28T21:00:31.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6c17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00cc6e0 con 0x7fc8a015a540 2023-11-28T21:00:31.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5414640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc8a00ccb70 0x7fc8a00cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57058/0 (socket says 172.21.15.167:57058) 2023-11-28T21:00:31.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5414640 1 -- 172.21.15.167:0/983909215 learned_addr learned my addr 172.21.15.167:0/983909215 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:00:31.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6416640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 0x7fc8a00ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820581884 0 0) 0x7fc890001120 con 0x7fc8a00ccb70 2023-11-28T21:00:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc88c003530 con 0x7fc8a00ccb70 2023-11-28T21:00:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6416640 1 -- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 msgr2=0x7fc8a00ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:00:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6416640 1 -- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 msgr2=0x7fc8a00ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6416640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 0x7fc8a00ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6416640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 0x7fc8a00ca350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688916397 0 0) 0x7fc8a00cfef0 con 0x7fc8a0153db0 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc890001120 con 0x7fc8a0153db0 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3645158085 0 0) 0x7fc88c003530 con 0x7fc8a00ccb70 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 msgr2=0x7fc8a00ca350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 0x7fc8a00ca350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 >> v1:172.21.15.178:6789/0 conn(0x7fc8a0153db0 legacy=0x7fc8a00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0154190 con 0x7fc8a00ccb70 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fc890001810 con 0x7fc8a00ccb70 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 >> v1:172.21.15.167:6789/0 conn(0x7fc8a00ccb70 legacy=0x7fc8a00cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc88c003b40 0x7fc88c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc88c0047d0 0x7fc88c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 0x7fc88c0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00cc6e0 con 0x7fc88c003b40 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c00baa0 con 0x7fc88c0047d0 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c00bc60 con 0x7fc8a015a540 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5c15640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc88c003b40 0x7fc88c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5414640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc88c0047d0 0x7fc88c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6416640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 0x7fc88c0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5c15640 1 -- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 msgr2=0x7fc88c0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5c15640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 0x7fc88c0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5c15640 1 -- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc88c0047d0 msgr2=0x7fc88c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5c15640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc88c0047d0 0x7fc88c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5c15640 1 -- 172.21.15.167:0/983909215 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c003530 con 0x7fc88c003b40 2023-11-28T21:00:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a6416640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a015a540 0x7fc88c0051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:31.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.151+0000 7fc8a5414640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc88c0047d0 0x7fc88c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a5c15640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc88c003b40 0x7fc88c003f40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0018d0 tx=0x7fc89c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c84ea05625a493 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0052d0 con 0x7fc88c003b40 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c005450 con 0x7fc88c003b40 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a4c13640 1 -- 172.21.15.167:0/983909215 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c003840 con 0x7fc88c003b40 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a6c17640 1 -- 172.21.15.167:0/983909215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc88c003b40 msgr2=0x7fc88c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a6c17640 1 --2- 172.21.15.167:0/983909215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc88c003b40 0x7fc88c003f40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0018d0 tx=0x7fc89c01c530 comp rx=0 tx=0).stop 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a6416640 1 -- 172.21.15.167:0/983909215 reap_dead start 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a6c17640 1 -- 172.21.15.167:0/983909215 shutdown_connections 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a6c17640 1 -- 172.21.15.167:0/983909215 >> 172.21.15.167:0/983909215 conn(0x7fc8a006b800 msgr2=0x7fc8a006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a6c17640 1 -- 172.21.15.167:0/983909215 shutdown_connections 2023-11-28T21:00:31.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a6c17640 1 -- 172.21.15.167:0/983909215 wait complete. 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a6c17640 1 Processor -- start 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.155+0000 7fc8a6c17640 1 -- start start 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6c17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88c003b40 0x7fc8a00ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6c17640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a0154380 0x7fc8a0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6c17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a015d350 0x7fc8a015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6c17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00c67b0 con 0x7fc8a015d350 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6c17640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a015abf0 con 0x7fc8a0154380 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6c17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a015ae40 con 0x7fc88c003b40 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6416640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a015d350 0x7fc8a015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6416640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a015d350 0x7fc8a015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54406/0 (socket says 172.21.15.167:54406) 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6416640 1 -- 172.21.15.167:0/1883569274 learned_addr learned my addr 172.21.15.167:0/1883569274 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a5414640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a0154380 0x7fc8a0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a5c15640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88c003b40 0x7fc8a00ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6416640 1 -- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88c003b40 msgr2=0x7fc8a00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6416640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88c003b40 0x7fc8a00ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6416640 1 -- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a0154380 msgr2=0x7fc8a0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6416640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a0154380 0x7fc8a0154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6416640 1 -- 172.21.15.167:0/1883569274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a015b120 con 0x7fc8a015d350 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a5414640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a0154380 0x7fc8a0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6416640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a015d350 0x7fc8a015d7d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0157640 tx=0x7fc8980047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8967fc640 1 -- 172.21.15.167:0/1883569274 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898007d30 con 0x7fc8a015d350 2023-11-28T21:00:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8967fc640 1 -- 172.21.15.167:0/1883569274 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89800f050 con 0x7fc8a015d350 2023-11-28T21:00:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8967fc640 1 -- 172.21.15.167:0/1883569274 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898014650 con 0x7fc8a015d350 2023-11-28T21:00:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a015b400 con 0x7fc8a015d350 2023-11-28T21:00:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a015b9c0 con 0x7fc8a015d350 2023-11-28T21:00:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a004e850 con 0x7fc8a015d350 2023-11-28T21:00:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.159+0000 7fc8967fc640 1 -- 172.21.15.167:0/1883569274 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc8980147b0 con 0x7fc8a015d350 2023-11-28T21:00:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.163+0000 7fc8967fc640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc884066470 0x7fc884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.163+0000 7fc8967fc640 1 -- 172.21.15.167:0/1883569274 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc898084590 con 0x7fc8a015d350 2023-11-28T21:00:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.163+0000 7fc8a5c15640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc884066470 0x7fc884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.163+0000 7fc8a5c15640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc884066470 0x7fc884068930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0ad000 tx=0x7fc89c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:31.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.167+0000 7fc8967fc640 1 -- 172.21.15.167:0/1883569274 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc898051620 con 0x7fc8a015d350 2023-11-28T21:00:31.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.367+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc8a00cae70 con 0x7fc8a015d350 2023-11-28T21:00:31.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.367+0000 7fc8967fc640 1 -- 172.21.15.167:0/1883569274 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fc89805b020 con 0x7fc8a015d350 2023-11-28T21:00:31.371 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":168,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc884066470 msgr2=0x7fc884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc884066470 0x7fc884068930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0ad000 tx=0x7fc89c0a7000 comp rx=0 tx=0).stop 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a015d350 msgr2=0x7fc8a015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a015d350 0x7fc8a015d7d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0157640 tx=0x7fc8980047d0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 shutdown_connections 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc884066470 0x7fc884068930 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8a015d350 0x7fc8a015d7d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a0154380 0x7fc8a0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 --2- 172.21.15.167:0/1883569274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc88c003b40 0x7fc8a00ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:31.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 >> 172.21.15.167:0/1883569274 conn(0x7fc8a006b800 msgr2=0x7fc8a00cb090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:31.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 shutdown_connections 2023-11-28T21:00:31.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:31.371+0000 7fc8a6c17640 1 -- 172.21.15.167:0/1883569274 wait complete. 2023-11-28T21:00:32.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~79s 2023-11-28T21:00:34.393 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:00:34.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7aea3d1640 1 Processor -- start 2023-11-28T21:00:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7aea3d1640 1 -- start start 2023-11-28T21:00:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7aea3d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 0x7f7ae40c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7aea3d1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ae415de80 0x7f7ae406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7aea3d1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae415ada0 con 0x7f7ae40c63d0 2023-11-28T21:00:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7aea3d1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae4159f40 con 0x7f7ae415de80 2023-11-28T21:00:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7aea3d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae415a220 con 0x7f7ae4153fa0 2023-11-28T21:00:34.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae896e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ae415de80 0x7f7ae406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:34.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 0x7f7ae40c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:34.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 0x7f7ae40c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:48168/0 (socket says 172.21.15.167:48168) 2023-11-28T21:00:34.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae896e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ae415de80 0x7f7ae406a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:57152/0 (socket says 172.21.15.167:57152) 2023-11-28T21:00:34.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae3fff640 1 -- 172.21.15.167:0/4126640790 learned_addr learned my addr 172.21.15.167:0/4126640790 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:34.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae3fff640 1 -- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 msgr2=0x7f7ae40c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:00:34.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae3fff640 1 -- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 msgr2=0x7f7ae40c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:34.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae3fff640 1 --2- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 0x7f7ae40c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:34.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae3fff640 1 --2- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 0x7f7ae40c5e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:34.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae896e640 1 -- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 msgr2=0x7f7ae40c5e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:34.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae896e640 1 --2- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 0x7f7ae40c5e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:34.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae896e640 1 -- 172.21.15.167:0/4126640790 >> v1:172.21.15.178:6789/0 conn(0x7f7ae40c63d0 legacy=0x7f7ae415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:34.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.539+0000 7f7ae896e640 1 -- 172.21.15.167:0/4126640790 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae415a500 con 0x7f7ae415de80 2023-11-28T21:00:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7ae896e640 1 --2- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae415de80 0x7f7ae406a580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009d90 tx=0x7f7adc01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e3072f024f7263 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7ae2ffd640 1 -- 172.21.15.167:0/4126640790 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0a5900 con 0x7f7ae415de80 2023-11-28T21:00:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7ae2ffd640 1 -- 172.21.15.167:0/4126640790 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc0a5a60 con 0x7f7ae415de80 2023-11-28T21:00:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7ae2ffd640 1 -- 172.21.15.167:0/4126640790 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0a5df0 con 0x7f7ae415de80 2023-11-28T21:00:34.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7aea3d1640 1 -- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae415de80 msgr2=0x7f7ae406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:34.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7aea3d1640 1 --2- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae415de80 0x7f7ae406a580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009d90 tx=0x7f7adc01c950 comp rx=0 tx=0).stop 2023-11-28T21:00:34.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7aea3d1640 1 -- 172.21.15.167:0/4126640790 shutdown_connections 2023-11-28T21:00:34.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7aea3d1640 1 --2- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae415de80 0x7f7ae406a580 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:34.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7aea3d1640 1 --2- 172.21.15.167:0/4126640790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae4153fa0 0x7f7ae40c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:34.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7aea3d1640 1 -- 172.21.15.167:0/4126640790 >> 172.21.15.167:0/4126640790 conn(0x7f7ae40cb1e0 msgr2=0x7f7ae40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:34.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7aea3d1640 1 -- 172.21.15.167:0/4126640790 shutdown_connections 2023-11-28T21:00:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.543+0000 7f7aea3d1640 1 -- 172.21.15.167:0/4126640790 wait complete. 2023-11-28T21:00:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 Processor -- start 2023-11-28T21:00:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 -- start start 2023-11-28T21:00:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ae40c63d0 0x7f7ae4145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae4153fa0 0x7f7ae40c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae415de80 0x7f7ae4144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40c5300 con 0x7f7ae40c63d0 2023-11-28T21:00:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae413dfc0 con 0x7f7ae4153fa0 2023-11-28T21:00:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae413e210 con 0x7f7ae415de80 2023-11-28T21:00:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ae40c63d0 0x7f7ae4145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ae40c63d0 0x7f7ae4145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56104/0 (socket says 172.21.15.167:56104) 2023-11-28T21:00:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae3fff640 1 -- 172.21.15.167:0/3578295901 learned_addr learned my addr 172.21.15.167:0/3578295901 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae37fe640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae4153fa0 0x7f7ae40c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae896e640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae415de80 0x7f7ae4144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae3fff640 1 -- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae415de80 msgr2=0x7f7ae4144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae3fff640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae415de80 0x7f7ae4144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae3fff640 1 -- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae4153fa0 msgr2=0x7f7ae40c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae3fff640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae4153fa0 0x7f7ae40c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae3fff640 1 -- 172.21.15.167:0/3578295901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc009a70 con 0x7f7ae40c63d0 2023-11-28T21:00:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae37fe640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae4153fa0 0x7f7ae40c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae3fff640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ae40c63d0 0x7f7ae4145a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400e840 tx=0x7f7ad400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae0ff9640 1 -- 172.21.15.167:0/3578295901 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4004020 con 0x7f7ae40c63d0 2023-11-28T21:00:34.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae0ff9640 1 -- 172.21.15.167:0/3578295901 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad4004180 con 0x7f7ae40c63d0 2023-11-28T21:00:34.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7ae0ff9640 1 -- 172.21.15.167:0/3578295901 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400c6d0 con 0x7f7ae40c63d0 2023-11-28T21:00:34.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae40ca160 con 0x7f7ae40c63d0 2023-11-28T21:00:34.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.547+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae4151410 con 0x7f7ae40c63d0 2023-11-28T21:00:34.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.551+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae40682c0 con 0x7f7ae40c63d0 2023-11-28T21:00:34.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.551+0000 7f7ae0ff9640 1 -- 172.21.15.167:0/3578295901 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ad400c830 con 0x7f7ae40c63d0 2023-11-28T21:00:34.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.551+0000 7f7ae0ff9640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ad0066470 0x7f7ad0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:34.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.551+0000 7f7ae0ff9640 1 -- 172.21.15.167:0/3578295901 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7ad4083d30 con 0x7f7ae40c63d0 2023-11-28T21:00:34.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.551+0000 7f7ae37fe640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ad0066470 0x7f7ad0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:34.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.551+0000 7f7ae37fe640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ad0066470 0x7f7ad0068930 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4070f40 tx=0x7f7ad8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:34.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.555+0000 7f7ae0ff9640 1 -- 172.21.15.167:0/3578295901 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ad4050db0 con 0x7f7ae40c63d0 2023-11-28T21:00:34.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.763+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7ae4075c90 con 0x7f7ae40c63d0 2023-11-28T21:00:34.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.763+0000 7f7ae0ff9640 1 -- 172.21.15.167:0/3578295901 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f7ad4020620 con 0x7f7ae40c63d0 2023-11-28T21:00:34.767 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":168,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:00:34.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ad0066470 msgr2=0x7f7ad0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:34.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ad0066470 0x7f7ad0068930 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4070f40 tx=0x7f7ad8009040 comp rx=0 tx=0).stop 2023-11-28T21:00:34.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ae40c63d0 msgr2=0x7f7ae4145a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:34.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ae40c63d0 0x7f7ae4145a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400e840 tx=0x7f7ad400ed00 comp rx=0 tx=0).stop 2023-11-28T21:00:34.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 shutdown_connections 2023-11-28T21:00:34.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7ad0066470 0x7f7ad0068930 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:34.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae415de80 0x7f7ae4144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:34.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae4153fa0 0x7f7ae40c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:34.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 --2- 172.21.15.167:0/3578295901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ae40c63d0 0x7f7ae4145a20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:34.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 >> 172.21.15.167:0/3578295901 conn(0x7f7ae40cb1e0 msgr2=0x7f7ae415d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:34.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 shutdown_connections 2023-11-28T21:00:34.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:34.767+0000 7f7aea3d1640 1 -- 172.21.15.167:0/3578295901 wait complete. 2023-11-28T21:00:37.789 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:00:37.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f508aa6b640 1 Processor -- start 2023-11-28T21:00:37.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f508aa6b640 1 -- start start 2023-11-28T21:00:37.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f508aa6b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:37.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f508aa6b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840c4940 con 0x7f50840c4510 2023-11-28T21:00:37.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f508aa6b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840c6ac0 con 0x7f5084150b40 2023-11-28T21:00:37.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f508aa6b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50840c62f0 con 0x7f50840c6ff0 2023-11-28T21:00:37.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f5089008640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f50840c4510 0x7f508406a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38332/0 (socket says 172.21.15.167:38332) 2023-11-28T21:00:37.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f5089008640 1 -- 172.21.15.167:0/386722251 learned_addr learned my addr 172.21.15.167:0/386722251 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:00:37.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:37.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 msgr2=0x7f5084157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 msgr2=0x7f5084157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:37.935+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:38.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.139+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:38.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.139+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 msgr2=0x7f5084157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:38.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.139+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 msgr2=0x7f5084157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:38.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.139+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:38.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.139+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:00:38.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.543+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:38.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.543+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 msgr2=0x7f5084157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:38.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.543+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 msgr2=0x7f5084157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:38.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.543+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:38.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:38.543+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:00:39.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~86s 2023-11-28T21:00:39.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:39.347+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:39.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:39.347+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 msgr2=0x7f5084157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:39.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:39.347+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 msgr2=0x7f5084157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:39.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:39.347+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:39.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:39.347+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:00:40.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507a7fc640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 msgr2=0x7f5084157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507a7fc640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50840c6ff0 0x7f5084157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507a7fc640 1 -- 172.21.15.167:0/386722251 >> v1:172.21.15.178:6789/0 conn(0x7f5084150b40 legacy=0x7f50840c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507a7fc640 1 -- 172.21.15.167:0/386722251 >> v1:172.21.15.167:6789/0 conn(0x7f50840c4510 legacy=0x7f508406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507a7fc640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507a7fc640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507a7fc640 1 -- 172.21.15.167:0/386722251 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50840c62f0 con 0x7f50700061d0 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507a7fc640 1 -- 172.21.15.167:0/386722251 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5070008d40 con 0x7f5070003720 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 msgr2=0x7f5070008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:40.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 msgr2=0x7f5070008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:40.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:40.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:40.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f5088807640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 msgr2=0x7f5070005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:00:40.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f5088807640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 msgr2=0x7f5070005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:40.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:40.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:40.939+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 msgr2=0x7f5070008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 msgr2=0x7f5070008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f5088807640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 msgr2=0x7f5070005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f5088807640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 msgr2=0x7f5070005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.143+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:00:41.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:41.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 msgr2=0x7f5070008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:00:41.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 msgr2=0x7f5070008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:41.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:41.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:00:41.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:41.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f5088807640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 msgr2=0x7f5070005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:00:41.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f5088807640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 msgr2=0x7f5070005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:41.547+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:00:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.351+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.167:3300/0 conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.351+0000 7f5088807640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.351+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 msgr2=0x7f5070005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.351+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> v2:172.21.15.178:3300/0 conn(0x7f5070003720 0x7f5070005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.351+0000 7f507bfff640 1 -- 172.21.15.167:0/386722251 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840c6500 con 0x7f50700061d0 2023-11-28T21:00:42.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.351+0000 7f507bfff640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 0x7f5070008690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50700036b0 tx=0x7f507401da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6812174159ae4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:42.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f507b7fe640 1 -- 172.21.15.167:0/386722251 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50740a69d0 con 0x7f50700061d0 2023-11-28T21:00:42.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f507b7fe640 1 -- 172.21.15.167:0/386722251 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50740aa070 con 0x7f50700061d0 2023-11-28T21:00:42.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f507b7fe640 1 -- 172.21.15.167:0/386722251 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50740a6db0 con 0x7f50700061d0 2023-11-28T21:00:42.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f508aa6b640 1 -- 172.21.15.167:0/386722251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 msgr2=0x7f5070008690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:42.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f508aa6b640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 0x7f5070008690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f50700036b0 tx=0x7f507401da50 comp rx=0 tx=0).stop 2023-11-28T21:00:42.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f5089008640 1 -- 172.21.15.167:0/386722251 reap_dead start 2023-11-28T21:00:42.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f508aa6b640 1 -- 172.21.15.167:0/386722251 shutdown_connections 2023-11-28T21:00:42.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f508aa6b640 1 --2- 172.21.15.167:0/386722251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 0x7f5070008690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:42.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f508aa6b640 1 -- 172.21.15.167:0/386722251 >> 172.21.15.167:0/386722251 conn(0x7f50840cb1e0 msgr2=0x7f50840cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:42.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f508aa6b640 1 -- 172.21.15.167:0/386722251 shutdown_connections 2023-11-28T21:00:42.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f508aa6b640 1 -- 172.21.15.167:0/386722251 wait complete. 2023-11-28T21:00:42.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f508aa6b640 1 Processor -- start 2023-11-28T21:00:42.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.355+0000 7f508aa6b640 1 -- start start 2023-11-28T21:00:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f508aa6b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 0x7f50841e13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f508aa6b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50841e2540 0x7f508414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f508aa6b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50841dfd80 0x7f50841ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f508aa6b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50841e0630 con 0x7f50700061d0 2023-11-28T21:00:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f508aa6b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50841e0350 con 0x7f50841e2540 2023-11-28T21:00:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f508aa6b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5084157cd0 con 0x7f50841dfd80 2023-11-28T21:00:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5088807640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 0x7f50841e13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5088807640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 0x7f50841e13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56142/0 (socket says 172.21.15.167:56142) 2023-11-28T21:00:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5088807640 1 -- 172.21.15.167:0/2111863611 learned_addr learned my addr 172.21.15.167:0/2111863611 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:42.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f507bfff640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50841e2540 0x7f508414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:42.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5089008640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50841dfd80 0x7f50841ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5089008640 1 -- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50841dfd80 msgr2=0x7f50841ee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T21:00:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5089008640 1 -- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50841dfd80 msgr2=0x7f50841ee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:00:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5089008640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50841dfd80 0x7f50841ee4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5089008640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50841dfd80 0x7f50841ee4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5088807640 1 -- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50841dfd80 msgr2=0x7f50841ee4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:00:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5088807640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50841dfd80 0x7f50841ee4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5088807640 1 -- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50841e2540 msgr2=0x7f508414daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5088807640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50841e2540 0x7f508414daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5088807640 1 -- 172.21.15.167:0/2111863611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507400e040 con 0x7f50700061d0 2023-11-28T21:00:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f5088807640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 0x7f50841e13d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5080003f90 tx=0x7f5080001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f50797fa640 1 -- 172.21.15.167:0/2111863611 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508001b030 con 0x7f50700061d0 2023-11-28T21:00:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f50797fa640 1 -- 172.21.15.167:0/2111863611 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080015680 con 0x7f50700061d0 2023-11-28T21:00:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5084157fb0 con 0x7f50700061d0 2023-11-28T21:00:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f50797fa640 1 -- 172.21.15.167:0/2111863611 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080015a30 con 0x7f50700061d0 2023-11-28T21:00:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.359+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5084158570 con 0x7f50700061d0 2023-11-28T21:00:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.363+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5084158730 con 0x7f50700061d0 2023-11-28T21:00:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.363+0000 7f50797fa640 1 -- 172.21.15.167:0/2111863611 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f508001e070 con 0x7f50700061d0 2023-11-28T21:00:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.363+0000 7f50797fa640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5070069a30 0x7f507006bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.363+0000 7f50797fa640 1 -- 172.21.15.167:0/2111863611 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f508001c070 con 0x7f50700061d0 2023-11-28T21:00:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.363+0000 7f507bfff640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5070069a30 0x7f507006bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.363+0000 7f507bfff640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5070069a30 0x7f507006bef0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f50740af000 tx=0x7f50740b4040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.367+0000 7f50797fa640 1 -- 172.21.15.167:0/2111863611 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5080051870 con 0x7f50700061d0 2023-11-28T21:00:42.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f50840682c0 con 0x7f50700061d0 2023-11-28T21:00:42.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f50797fa640 1 -- 172.21.15.167:0/2111863611 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f5080054e90 con 0x7f50700061d0 2023-11-28T21:00:42.577 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":172,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:00:42.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5070069a30 msgr2=0x7f507006bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:42.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5070069a30 0x7f507006bef0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f50740af000 tx=0x7f50740b4040 comp rx=0 tx=0).stop 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 msgr2=0x7f50841e13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 0x7f50841e13d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5080003f90 tx=0x7f5080001730 comp rx=0 tx=0).stop 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 shutdown_connections 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5070069a30 0x7f507006bef0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50841dfd80 0x7f50841ee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50841e2540 0x7f508414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 --2- 172.21.15.167:0/2111863611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50700061d0 0x7f50841e13d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 >> 172.21.15.167:0/2111863611 conn(0x7f50840cb1e0 msgr2=0x7f5084071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 shutdown_connections 2023-11-28T21:00:42.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:42.575+0000 7f508aa6b640 1 -- 172.21.15.167:0/2111863611 wait complete. 2023-11-28T21:00:45.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:00:45.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8cac26b640 1 Processor -- start 2023-11-28T21:00:45.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8cac26b640 1 -- start start 2023-11-28T21:00:45.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8cac26b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca406e030 0x7f8ca41500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8cac26b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ca4072630 0x7f8ca41505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8cac26b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca41571d0 con 0x7f8ca4070480 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8cac26b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca4071a90 con 0x7f8ca4072630 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8cac26b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40c70d0 con 0x7f8ca406e030 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa808640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ca4072630 0x7f8ca41505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa808640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ca4072630 0x7f8ca41505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54090/0 (socket says 172.21.15.167:54090) 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa808640 1 -- 172.21.15.167:0/1388257937 learned_addr learned my addr 172.21.15.167:0/1388257937 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa007640 1 --2- 172.21.15.167:0/1388257937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca406e030 0x7f8ca41500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa007640 1 -- 172.21.15.167:0/1388257937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca406e030 msgr2=0x7f8ca41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:00:45.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa007640 1 -- 172.21.15.167:0/1388257937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca406e030 msgr2=0x7f8ca41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:00:45.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa007640 1 --2- 172.21.15.167:0/1388257937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca406e030 0x7f8ca41500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:00:45.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa808640 1 -- 172.21.15.167:0/1388257937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca406e030 msgr2=0x7f8ca41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:45.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa007640 1 --2- 172.21.15.167:0/1388257937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca406e030 0x7f8ca41500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:45.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa808640 1 --2- 172.21.15.167:0/1388257937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca406e030 0x7f8ca41500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa808640 1 -- 172.21.15.167:0/1388257937 >> v1:172.21.15.178:6789/0 conn(0x7f8ca4070480 legacy=0x7f8ca4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:45.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.747+0000 7f8caa808640 1 -- 172.21.15.167:0/1388257937 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40c73b0 con 0x7f8ca4072630 2023-11-28T21:00:45.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8caa808640 1 --2- 172.21.15.167:0/1388257937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4072630 0x7f8ca41505f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009e50 tx=0x7f8c9c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53517cd1c86ee6c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:45.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8ca9005640 1 -- 172.21.15.167:0/1388257937 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0a5790 con 0x7f8ca4072630 2023-11-28T21:00:45.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8ca9005640 1 -- 172.21.15.167:0/1388257937 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c0a58f0 con 0x7f8ca4072630 2023-11-28T21:00:45.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8ca9005640 1 -- 172.21.15.167:0/1388257937 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0a5c80 con 0x7f8ca4072630 2023-11-28T21:00:45.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8cac26b640 1 -- 172.21.15.167:0/1388257937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4072630 msgr2=0x7f8ca41505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:45.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8cac26b640 1 --2- 172.21.15.167:0/1388257937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4072630 0x7f8ca41505f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009e50 tx=0x7f8c9c01c9e0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8cac26b640 1 -- 172.21.15.167:0/1388257937 shutdown_connections 2023-11-28T21:00:45.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8cac26b640 1 --2- 172.21.15.167:0/1388257937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4072630 0x7f8ca41505f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8cac26b640 1 --2- 172.21.15.167:0/1388257937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca406e030 0x7f8ca41500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8cac26b640 1 -- 172.21.15.167:0/1388257937 >> 172.21.15.167:0/1388257937 conn(0x7f8ca40cb1e0 msgr2=0x7f8ca40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:45.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8cac26b640 1 -- 172.21.15.167:0/1388257937 shutdown_connections 2023-11-28T21:00:45.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.751+0000 7f8cac26b640 1 -- 172.21.15.167:0/1388257937 wait complete. 2023-11-28T21:00:45.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 Processor -- start 2023-11-28T21:00:45.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 -- start start 2023-11-28T21:00:45.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ca406e030 0x7f8ca4150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:45.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4070480 0x7f8ca41421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:45.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca4072630 0x7f8ca41427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:45.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41f0d20 con 0x7f8ca4070480 2023-11-28T21:00:45.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41f1580 con 0x7f8ca406e030 2023-11-28T21:00:45.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca414d620 con 0x7f8ca4072630 2023-11-28T21:00:45.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8ca9806640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4070480 0x7f8ca41421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:45.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8ca9806640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4070480 0x7f8ca41421a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54098/0 (socket says 172.21.15.167:54098) 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8ca9806640 1 -- 172.21.15.167:0/2669462217 learned_addr learned my addr 172.21.15.167:0/2669462217 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8caa007640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ca406e030 0x7f8ca4150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8caa808640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca4072630 0x7f8ca41427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8ca9806640 1 -- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca4072630 msgr2=0x7f8ca41427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8ca9806640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca4072630 0x7f8ca41427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8ca9806640 1 -- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ca406e030 msgr2=0x7f8ca4150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8ca9806640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ca406e030 0x7f8ca4150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8ca9806640 1 -- 172.21.15.167:0/2669462217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c009b30 con 0x7f8ca4070480 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8caa007640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ca406e030 0x7f8ca4150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8ca9806640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4070480 0x7f8ca41421a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c3f0 tx=0x7f8c9400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8c9affd640 1 -- 172.21.15.167:0/2669462217 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c940052d0 con 0x7f8ca4070480 2023-11-28T21:00:45.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8c9affd640 1 -- 172.21.15.167:0/2669462217 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c94005430 con 0x7f8ca4070480 2023-11-28T21:00:45.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8c9affd640 1 -- 172.21.15.167:0/2669462217 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94003840 con 0x7f8ca4070480 2023-11-28T21:00:45.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca4153840 con 0x7f8ca4070480 2023-11-28T21:00:45.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.755+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca41f0f30 con 0x7f8ca4070480 2023-11-28T21:00:45.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.759+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca40682c0 con 0x7f8ca4070480 2023-11-28T21:00:45.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.759+0000 7f8c9affd640 1 -- 172.21.15.167:0/2669462217 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8c940039a0 con 0x7f8ca4070480 2023-11-28T21:00:45.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.759+0000 7f8c9affd640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c88066470 0x7f8c88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:45.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.759+0000 7f8c9affd640 1 -- 172.21.15.167:0/2669462217 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8c94083870 con 0x7f8ca4070480 2023-11-28T21:00:45.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.759+0000 7f8caa007640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c88066470 0x7f8c88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:45.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.759+0000 7f8caa007640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c88066470 0x7f8c88068930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0006aa0 tx=0x7f8ca0006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:45.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.763+0000 7f8c9affd640 1 -- 172.21.15.167:0/2669462217 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c94050870 con 0x7f8ca4070480 2023-11-28T21:00:45.824 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~92s 2023-11-28T21:00:45.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.971+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8ca4075c90 con 0x7f8ca4070480 2023-11-28T21:00:45.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.971+0000 7f8c9affd640 1 -- 172.21.15.167:0/2669462217 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f8c94017080 con 0x7f8ca4070480 2023-11-28T21:00:45.974 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:00:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c88066470 msgr2=0x7f8c88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c88066470 0x7f8c88068930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0006aa0 tx=0x7f8ca0006a30 comp rx=0 tx=0).stop 2023-11-28T21:00:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4070480 msgr2=0x7f8ca41421a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:45.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4070480 0x7f8ca41421a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c3f0 tx=0x7f8c9400c8b0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 shutdown_connections 2023-11-28T21:00:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8c88066470 0x7f8c88068930 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ca4072630 0x7f8ca41427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ca4070480 0x7f8ca41421a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 --2- 172.21.15.167:0/2669462217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ca406e030 0x7f8ca4150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 >> 172.21.15.167:0/2669462217 conn(0x7f8ca40cb1e0 msgr2=0x7f8ca414f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 shutdown_connections 2023-11-28T21:00:45.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:45.975+0000 7f8cac26b640 1 -- 172.21.15.167:0/2669462217 wait complete. 2023-11-28T21:00:45.995 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:00:45.996 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T21:00:45.996 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:00:46.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a54b65640 1 Processor -- start 2023-11-28T21:00:46.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a54b65640 1 -- start start 2023-11-28T21:00:46.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a54b65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 0x7f7a50157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a54b65640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7a500c4510 0x7f7a5006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a54b65640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a500c4940 con 0x7f7a500c6ff0 2023-11-28T21:00:46.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a54b65640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a500c62f0 con 0x7f7a500c4510 2023-11-28T21:00:46.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a54b65640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500c6ac0 con 0x7f7a50150b40 2023-11-28T21:00:46.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a4ed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7a500c4510 0x7f7a5006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a4ed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7a500c4510 0x7f7a5006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54108/0 (socket says 172.21.15.167:54108) 2023-11-28T21:00:46.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a4ed9d640 1 -- 172.21.15.167:0/3778127598 learned_addr learned my addr 172.21.15.167:0/3778127598 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:46.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a4e59c640 1 --2- 172.21.15.167:0/3778127598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 0x7f7a50157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a4ed9d640 1 -- 172.21.15.167:0/3778127598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 msgr2=0x7f7a50157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:46.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a4ed9d640 1 --2- 172.21.15.167:0/3778127598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 0x7f7a50157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a4ed9d640 1 -- 172.21.15.167:0/3778127598 >> v1:172.21.15.178:6789/0 conn(0x7f7a500c6ff0 legacy=0x7f7a500c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a4ed9d640 1 -- 172.21.15.167:0/3778127598 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a500c6500 con 0x7f7a500c4510 2023-11-28T21:00:46.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.135+0000 7f7a4e59c640 1 --2- 172.21.15.167:0/3778127598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 0x7f7a50157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:46.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a4ed9d640 1 --2- 172.21.15.167:0/3778127598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c4510 0x7f7a5006a580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009870 tx=0x7f7a4801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382ba0648fb08777 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a4dd9b640 1 -- 172.21.15.167:0/3778127598 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480ab620 con 0x7f7a500c4510 2023-11-28T21:00:46.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a4dd9b640 1 -- 172.21.15.167:0/3778127598 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a480ab780 con 0x7f7a500c4510 2023-11-28T21:00:46.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a4dd9b640 1 -- 172.21.15.167:0/3778127598 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480abb10 con 0x7f7a500c4510 2023-11-28T21:00:46.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a54b65640 1 -- 172.21.15.167:0/3778127598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c4510 msgr2=0x7f7a5006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a54b65640 1 --2- 172.21.15.167:0/3778127598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c4510 0x7f7a5006a580 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009870 tx=0x7f7a4801c510 comp rx=0 tx=0).stop 2023-11-28T21:00:46.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a54b65640 1 -- 172.21.15.167:0/3778127598 shutdown_connections 2023-11-28T21:00:46.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a54b65640 1 --2- 172.21.15.167:0/3778127598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c4510 0x7f7a5006a580 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a54b65640 1 --2- 172.21.15.167:0/3778127598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 0x7f7a50157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a54b65640 1 -- 172.21.15.167:0/3778127598 >> 172.21.15.167:0/3778127598 conn(0x7f7a500cb1e0 msgr2=0x7f7a500cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:46.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a54b65640 1 -- 172.21.15.167:0/3778127598 shutdown_connections 2023-11-28T21:00:46.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.139+0000 7f7a54b65640 1 -- 172.21.15.167:0/3778127598 wait complete. 2023-11-28T21:00:46.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a54b65640 1 Processor -- start 2023-11-28T21:00:46.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a54b65640 1 -- start start 2023-11-28T21:00:46.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a54b65640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a500c4510 0x7f7a50164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a54b65640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c6ff0 0x7f7a50154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a54b65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 0x7f7a50154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a54b65640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a501f37d0 con 0x7f7a500c6ff0 2023-11-28T21:00:46.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a54b65640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a501559e0 con 0x7f7a500c4510 2023-11-28T21:00:46.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a54b65640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a501f2bc0 con 0x7f7a50150b40 2023-11-28T21:00:46.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a45d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c6ff0 0x7f7a50154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a45d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c6ff0 0x7f7a50154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54112/0 (socket says 172.21.15.167:54112) 2023-11-28T21:00:46.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a45d9b640 1 -- 172.21.15.167:0/4157301563 learned_addr learned my addr 172.21.15.167:0/4157301563 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:46.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a4e59c640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a500c4510 0x7f7a50164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a4ed9d640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 0x7f7a50154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a45d9b640 1 -- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 msgr2=0x7f7a50154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a45d9b640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a50150b40 0x7f7a50154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a45d9b640 1 -- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a500c4510 msgr2=0x7f7a50164ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a45d9b640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a500c4510 0x7f7a50164ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a45d9b640 1 -- 172.21.15.167:0/4157301563 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480094d0 con 0x7f7a500c6ff0 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.143+0000 7f7a45d9b640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c6ff0 0x7f7a50154630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800c7f0 tx=0x7f7a3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38003b80 con 0x7f7a500c6ff0 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a38003ce0 con 0x7f7a500c6ff0 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3800aa90 con 0x7f7a500c6ff0 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a501f2ea0 con 0x7f7a500c6ff0 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a501f3460 con 0x7f7a500c6ff0 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a54b65640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a50157b30 0x7f7a500c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a50074770 con 0x7f7a50157b30 2023-11-28T21:00:46.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a4e59c640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a50157b30 0x7f7a500c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a4e59c640 1 -- 172.21.15.167:0/4157301563 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a50157040 con 0x7f7a50157b30 2023-11-28T21:00:46.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a4e59c640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a50157b30 0x7f7a500c8fe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a400107f0 tx=0x7f7a40010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a3800abf0 con 0x7f7a500c6ff0 2023-11-28T21:00:46.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a30066470 0x7f7a30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7a38084090 con 0x7f7a500c6ff0 2023-11-28T21:00:46.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000ea30 con 0x7f7a50157b30 2023-11-28T21:00:46.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7a4000eb90 con 0x7f7a50157b30 2023-11-28T21:00:46.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a50157b30 msgr2=0x7f7a500c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a50157b30 0x7f7a500c8fe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a400107f0 tx=0x7f7a40010cb0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a50157b30 msgr2=0x7f7a500c8fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:46.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a477fe640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a50157b30 0x7f7a500c8fe0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a400107f0 tx=0x7f7a40010cb0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.147+0000 7f7a4ed9d640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a30066470 0x7f7a30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.151+0000 7f7a4ed9d640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a30066470 0x7f7a30068930 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7a480af000 tx=0x7f7a480b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a501554a0 0x7f7a500c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a501f3030 con 0x7f7a501554a0 2023-11-28T21:00:46.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a4e59c640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a501554a0 0x7f7a500c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a4e59c640 1 -- 172.21.15.167:0/4157301563 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7a500682c0 con 0x7f7a501554a0 2023-11-28T21:00:46.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a4e59c640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a501554a0 0x7f7a500c9520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000e640 tx=0x7f7a400046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40014630 con 0x7f7a501554a0 2023-11-28T21:00:46.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5125 (secure 0 0 0) 0x7f7a40023040 con 0x7f7a501554a0 2023-11-28T21:00:46.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a501554a0 msgr2=0x7f7a500c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a477fe640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a501554a0 0x7f7a500c9520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000e640 tx=0x7f7a400046d0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a477fe640 1 -- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a501554a0 msgr2=0x7f7a500c9520 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:46.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a477fe640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a501554a0 0x7f7a500c9520 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000e640 tx=0x7f7a400046d0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.159 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:00:46.159 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:46.160 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:46.160 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:00:46.160 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 174, 2023-11-28T21:00:46.160 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:00:46.160 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:00:46.160 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:00:46.160 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:00:46.160 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.160 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 3, 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:46.161 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:46.162 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:46.162 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:46.162 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:46.162 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.162 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:00:46.162 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:00:46.162 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:46.162 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:46.162 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.163 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:00:46.164 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:46.165 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:46.166 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:46.166 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:46.166 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:46.166 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:46.166 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:46.166 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:46.166 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.166 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:00:46.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.167 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:00:46.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.167 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:46.167 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:46.167 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:46.167 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:46.167 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.167 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:46.167 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.168 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:46.169 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:46.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.170 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:46.170 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:00:46.170 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.170 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.170 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.170 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:46.170 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:00:46.170 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.171 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.172 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:46.173 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:46.174 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:00:46.175 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.176 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.177 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.178 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.178 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:00:46.178 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.178 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.178 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.178 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:00:46.178 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:00:46.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a30066470 msgr2=0x7f7a30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7a30066470 0x7f7a30068930 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7a480af000 tx=0x7f7a480b6040 comp rx=0 tx=0).stop 2023-11-28T21:00:46.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c6ff0 msgr2=0x7f7a50154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 --2- 172.21.15.167:0/4157301563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a500c6ff0 0x7f7a50154630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800c7f0 tx=0x7f7a3800ccb0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a4ed9d640 1 -- 172.21.15.167:0/4157301563 reap_dead start 2023-11-28T21:00:46.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a4ed9d640 1 -- 172.21.15.167:0/4157301563 reap_dead start 2023-11-28T21:00:46.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 shutdown_connections 2023-11-28T21:00:46.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 >> 172.21.15.167:0/4157301563 conn(0x7f7a500cb1e0 msgr2=0x7f7a50160030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:46.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 shutdown_connections 2023-11-28T21:00:46.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.155+0000 7f7a54b65640 1 -- 172.21.15.167:0/4157301563 wait complete. 2023-11-28T21:00:46.181 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:00:46.181 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T21:00:46.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:00:46.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd761f96640 1 Processor -- start 2023-11-28T21:00:46.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd761f96640 1 -- start start 2023-11-28T21:00:46.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd761f96640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0c5c90 0x7fd75c1635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd761f96640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c0c7a50 con 0x7fd75c151f60 2023-11-28T21:00:46.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd761f96640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c15b220 con 0x7fd75c0c75c0 2023-11-28T21:00:46.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd761f96640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0c4da0 con 0x7fd75c0c5c90 2023-11-28T21:00:46.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd75c151f60 0x7fd75c0c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:59428/0 (socket says 172.21.15.167:59428) 2023-11-28T21:00:46.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75b7fe640 1 -- 172.21.15.167:0/2292465037 learned_addr learned my addr 172.21.15.167:0/2292465037 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:00:46.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75bfff640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0c5c90 0x7fd75c1635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656697269 0 0) 0x7fd74c001120 con 0x7fd75c151f60 2023-11-28T21:00:46.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd744003530 con 0x7fd75c151f60 2023-11-28T21:00:46.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1988916702 0 0) 0x7fd744003530 con 0x7fd75c151f60 2023-11-28T21:00:46.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0c5c90 msgr2=0x7fd75c1635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:46.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0c5c90 0x7fd75c1635c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 >> v1:172.21.15.178:6789/0 conn(0x7fd75c0c75c0 legacy=0x7fd75c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c152340 con 0x7fd75c151f60 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fd74c001810 con 0x7fd75c151f60 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 >> v1:172.21.15.167:6789/0 conn(0x7fd75c151f60 legacy=0x7fd75c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 0x7fd744003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0c5c90 0x7fd7440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd744004d10 0x7fd744005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74400ba40 con 0x7fd7440039b0 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74400bb80 con 0x7fd744004d10 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.319+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74400bd40 con 0x7fd75c0c5c90 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75b7fe640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 0x7fd744003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75bfff640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd744004d10 0x7fd744005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75affd640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0c5c90 0x7fd7440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75b7fe640 1 -- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0c5c90 msgr2=0x7fd7440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:46.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75b7fe640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0c5c90 0x7fd7440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75b7fe640 1 -- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd744004d10 msgr2=0x7fd744005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:46.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75b7fe640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd744004d10 0x7fd744005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75b7fe640 1 -- 172.21.15.167:0/2292465037 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744003530 con 0x7fd7440039b0 2023-11-28T21:00:46.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75b7fe640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 0x7fd744003d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00c190 tx=0x7fd74c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2d7b46153cd097 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c005ae0 con 0x7fd7440039b0 2023-11-28T21:00:46.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c005c40 con 0x7fd7440039b0 2023-11-28T21:00:46.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.323+0000 7fd75a7fc640 1 -- 172.21.15.167:0/2292465037 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c007070 con 0x7fd7440039b0 2023-11-28T21:00:46.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 -- 172.21.15.167:0/2292465037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 msgr2=0x7fd744003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 --2- 172.21.15.167:0/2292465037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 0x7fd744003d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00c190 tx=0x7fd74c01cbc0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75bfff640 1 -- 172.21.15.167:0/2292465037 reap_dead start 2023-11-28T21:00:46.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 -- 172.21.15.167:0/2292465037 shutdown_connections 2023-11-28T21:00:46.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 -- 172.21.15.167:0/2292465037 >> 172.21.15.167:0/2292465037 conn(0x7fd75c0cb1e0 msgr2=0x7fd75c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:46.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 -- 172.21.15.167:0/2292465037 shutdown_connections 2023-11-28T21:00:46.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 -- 172.21.15.167:0/2292465037 wait complete. 2023-11-28T21:00:46.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 Processor -- start 2023-11-28T21:00:46.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 -- start start 2023-11-28T21:00:46.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 0x7fd75c14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c1f6600 0x7fd75c144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0ca860 0x7fd75c143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c14d490 con 0x7fd7440039b0 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0c9b30 con 0x7fd75c1f6600 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd761f96640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0ca3d0 con 0x7fd75c0ca860 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 0x7fd75c14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 0x7fd75c14d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54142/0 (socket says 172.21.15.167:54142) 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75b7fe640 1 -- 172.21.15.167:0/697415205 learned_addr learned my addr 172.21.15.167:0/697415205 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75bfff640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0ca860 0x7fd75c143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75affd640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c1f6600 0x7fd75c144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75b7fe640 1 -- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0ca860 msgr2=0x7fd75c143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75b7fe640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0ca860 0x7fd75c143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75b7fe640 1 -- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c1f6600 msgr2=0x7fd75c144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75b7fe640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c1f6600 0x7fd75c144bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75b7fe640 1 -- 172.21.15.167:0/697415205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c1f3af0 con 0x7fd7440039b0 2023-11-28T21:00:46.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.327+0000 7fd75bfff640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75c0ca860 0x7fd75c143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:46.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd75b7fe640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 0x7fd75c14d750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd74c01c9f0 tx=0x7fd744005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c0b4070 con 0x7fd7440039b0 2023-11-28T21:00:46.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c0047f0 con 0x7fd7440039b0 2023-11-28T21:00:46.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c004b60 con 0x7fd7440039b0 2023-11-28T21:00:46.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c160ff0 con 0x7fd7440039b0 2023-11-28T21:00:46.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c14e070 con 0x7fd7440039b0 2023-11-28T21:00:46.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd761f96640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0cac40 0x7fd75c143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c144520 con 0x7fd75c0cac40 2023-11-28T21:00:46.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd75affd640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0cac40 0x7fd75c143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd75affd640 1 -- 172.21.15.167:0/697415205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd75c0c39b0 con 0x7fd75c0cac40 2023-11-28T21:00:46.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd74c004cc0 con 0x7fd7440039b0 2023-11-28T21:00:46.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd75affd640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0cac40 0x7fd75c143fe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd750003d70 tx=0x7fd7500017a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd743fff640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd748066470 0x7fd748068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd74c11d7e0 con 0x7fd7440039b0 2023-11-28T21:00:46.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750006cb0 con 0x7fd75c0cac40 2023-11-28T21:00:46.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.331+0000 7fd75bfff640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd748066470 0x7fd748068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.335+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fd750006e10 con 0x7fd75c0cac40 2023-11-28T21:00:46.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.335+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0cac40 msgr2=0x7fd75c143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.335+0000 7fd743fff640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0cac40 0x7fd75c143fe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd750003d70 tx=0x7fd7500017a0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.335+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0cac40 msgr2=0x7fd75c143fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:46.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.335+0000 7fd743fff640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0cac40 0x7fd75c143fe0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd750003d70 tx=0x7fd7500017a0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.335+0000 7fd75bfff640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd748066470 0x7fd748068930 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0c79a0 tx=0x7fd75400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.339+0000 7fd761f96640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0c9c70 0x7fd75c1467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.339+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c074770 con 0x7fd75c0c9c70 2023-11-28T21:00:46.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.339+0000 7fd75affd640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0c9c70 0x7fd75c1467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.339+0000 7fd75affd640 1 -- 172.21.15.167:0/697415205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd75c15b750 con 0x7fd75c0c9c70 2023-11-28T21:00:46.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.339+0000 7fd75affd640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0c9c70 0x7fd75c1467d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd750001ec0 tx=0x7fd7500012c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.339+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75001ebe0 con 0x7fd75c0c9c70 2023-11-28T21:00:46.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4810 (secure 0 0 0) 0x7fd750015460 con 0x7fd75c0c9c70 2023-11-28T21:00:46.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0c9c70 msgr2=0x7fd75c1467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd743fff640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0c9c70 0x7fd75c1467d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd750001ec0 tx=0x7fd7500012c0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd743fff640 1 -- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0c9c70 msgr2=0x7fd75c1467d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:46.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd743fff640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd75c0c9c70 0x7fd75c1467d0 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd750001ec0 tx=0x7fd7500012c0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.345 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:00:46.345 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:46.345 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:46.345 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 174, 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 3, 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:46.346 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:46.347 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:00:46.348 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:00:46.349 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:46.350 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:46.351 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:46.354 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.355 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.356 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.357 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.358 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:00:46.359 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.359 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.359 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.359 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:00:46.359 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.359 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.359 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.359 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:00:46.359 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:00:46.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd748066470 msgr2=0x7fd748068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd761f96640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd748066470 0x7fd748068930 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0c79a0 tx=0x7fd75400b040 comp rx=0 tx=0).stop 2023-11-28T21:00:46.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 msgr2=0x7fd75c14d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd761f96640 1 --2- 172.21.15.167:0/697415205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7440039b0 0x7fd75c14d750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd74c01c9f0 tx=0x7fd744005800 comp rx=0 tx=0).stop 2023-11-28T21:00:46.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd75bfff640 1 -- 172.21.15.167:0/697415205 reap_dead start 2023-11-28T21:00:46.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd75bfff640 1 -- 172.21.15.167:0/697415205 reap_dead start 2023-11-28T21:00:46.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 shutdown_connections 2023-11-28T21:00:46.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 >> 172.21.15.167:0/697415205 conn(0x7fd75c0cb1e0 msgr2=0x7fd75c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:46.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 shutdown_connections 2023-11-28T21:00:46.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.343+0000 7fd761f96640 1 -- 172.21.15.167:0/697415205 wait complete. 2023-11-28T21:00:46.363 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:00:46.363 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T21:00:46.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:00:46.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.499+0000 7f7f7d8d6640 1 Processor -- start 2023-11-28T21:00:46.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.499+0000 7f7f7d8d6640 1 -- start start 2023-11-28T21:00:46.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f7d8d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78070480 0x7f7f7806e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f7d8d6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7f78156c40 0x7f7f781500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f7d8d6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f781571d0 con 0x7f7f78071020 2023-11-28T21:00:46.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f7d8d6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7806ac90 con 0x7f7f78156c40 2023-11-28T21:00:46.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f7d8d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78071a90 con 0x7f7f78070480 2023-11-28T21:00:46.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f777fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7f78156c40 0x7f7f781500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f777fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7f78156c40 0x7f7f781500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54152/0 (socket says 172.21.15.167:54152) 2023-11-28T21:00:46.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f777fe640 1 -- 172.21.15.167:0/4240969995 learned_addr learned my addr 172.21.15.167:0/4240969995 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:46.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f76ffd640 1 --2- 172.21.15.167:0/4240969995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78070480 0x7f7f7806e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f777fe640 1 -- 172.21.15.167:0/4240969995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78070480 msgr2=0x7f7f7806e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:46.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f777fe640 1 --2- 172.21.15.167:0/4240969995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78070480 0x7f7f7806e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f777fe640 1 -- 172.21.15.167:0/4240969995 >> v1:172.21.15.178:6789/0 conn(0x7f7f78071020 legacy=0x7f7f7806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.503+0000 7f7f777fe640 1 -- 172.21.15.167:0/4240969995 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780c70d0 con 0x7f7f78156c40 2023-11-28T21:00:46.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f777fe640 1 --2- 172.21.15.167:0/4240969995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 0x7f7f781500b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009e50 tx=0x7f7f7001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c533b49e7907ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f767fc640 1 -- 172.21.15.167:0/4240969995 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700a57c0 con 0x7f7f78156c40 2023-11-28T21:00:46.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f767fc640 1 -- 172.21.15.167:0/4240969995 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f700a5920 con 0x7f7f78156c40 2023-11-28T21:00:46.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f767fc640 1 -- 172.21.15.167:0/4240969995 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700a5cb0 con 0x7f7f78156c40 2023-11-28T21:00:46.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/4240969995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 msgr2=0x7f7f781500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 --2- 172.21.15.167:0/4240969995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 0x7f7f781500b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009e50 tx=0x7f7f7001c9e0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/4240969995 shutdown_connections 2023-11-28T21:00:46.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 --2- 172.21.15.167:0/4240969995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 0x7f7f781500b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 --2- 172.21.15.167:0/4240969995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78070480 0x7f7f7806e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/4240969995 >> 172.21.15.167:0/4240969995 conn(0x7f7f780cb1e0 msgr2=0x7f7f780cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:46.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/4240969995 shutdown_connections 2023-11-28T21:00:46.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/4240969995 wait complete. 2023-11-28T21:00:46.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 Processor -- start 2023-11-28T21:00:46.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.507+0000 7f7f7d8d6640 1 -- start start 2023-11-28T21:00:46.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f78070480 0x7f7f78140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78071020 0x7f7f780c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 0x7f7f78148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7814a2f0 con 0x7f7f78156c40 2023-11-28T21:00:46.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7814a0a0 con 0x7f7f78070480 2023-11-28T21:00:46.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780c91f0 con 0x7f7f78071020 2023-11-28T21:00:46.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 0x7f7f78148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 0x7f7f78148c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54164/0 (socket says 172.21.15.167:54164) 2023-11-28T21:00:46.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f777fe640 1 -- 172.21.15.167:0/3106551734 learned_addr learned my addr 172.21.15.167:0/3106551734 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:46.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f6e7fc640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78071020 0x7f7f780c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f76ffd640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f78070480 0x7f7f78140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f777fe640 1 -- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78071020 msgr2=0x7f7f780c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f777fe640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78071020 0x7f7f780c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f777fe640 1 -- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f78070480 msgr2=0x7f7f78140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f777fe640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f78070480 0x7f7f78140ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f777fe640 1 -- 172.21.15.167:0/3106551734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70009b30 con 0x7f7f78156c40 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f777fe640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 0x7f7f78148c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f700af040 tx=0x7f7f70019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700b8670 con 0x7f7f78156c40 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f700b87f0 con 0x7f7f78156c40 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700b8ba0 con 0x7f7f78156c40 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f780caa70 con 0x7f7f78156c40 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f780cad10 con 0x7f7f78156c40 2023-11-28T21:00:46.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f7814d6c0 0x7f7f781491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78074770 con 0x7f7f7814d6c0 2023-11-28T21:00:46.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f76ffd640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f7814d6c0 0x7f7f781491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f76ffd640 1 -- 172.21.15.167:0/3106551734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f7806e570 con 0x7f7f7814d6c0 2023-11-28T21:00:46.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.511+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7f700b8d00 con 0x7f7f78156c40 2023-11-28T21:00:46.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f76ffd640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f7814d6c0 0x7f7f781491d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f60011860 tx=0x7f7f60011d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f74ff9640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f58066470 0x7f7f58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7f7011f8a0 con 0x7f7f78156c40 2023-11-28T21:00:46.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60004240 con 0x7f7f7814d6c0 2023-11-28T21:00:46.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f6e7fc640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f58066470 0x7f7f58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7f600043a0 con 0x7f7f7814d6c0 2023-11-28T21:00:46.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f7814d6c0 msgr2=0x7f7f781491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f74ff9640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f7814d6c0 0x7f7f781491d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f60011860 tx=0x7f7f60011d20 comp rx=0 tx=0).stop 2023-11-28T21:00:46.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f7814d6c0 msgr2=0x7f7f781491d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:46.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f74ff9640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f7814d6c0 0x7f7f781491d0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f60011860 tx=0x7f7f60011d20 comp rx=0 tx=0).stop 2023-11-28T21:00:46.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.515+0000 7f7f6e7fc640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f58066470 0x7f7f58068930 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7f781419a0 tx=0x7f7f68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.519+0000 7f7f7d8d6640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78149710 0x7f7f781f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.519+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7806b4b0 con 0x7f7f78149710 2023-11-28T21:00:46.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.519+0000 7f7f76ffd640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78149710 0x7f7f781f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f76ffd640 1 -- 172.21.15.167:0/3106551734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7f78163c90 con 0x7f7f78149710 2023-11-28T21:00:46.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f76ffd640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78149710 0x7f7f781f6670 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f60011860 tx=0x7f7f600046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6001e450 con 0x7f7f78149710 2023-11-28T21:00:46.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f7f600283a0 con 0x7f7f78149710 2023-11-28T21:00:46.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78149710 msgr2=0x7f7f781f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f74ff9640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78149710 0x7f7f781f6670 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f60011860 tx=0x7f7f600046d0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f74ff9640 1 -- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78149710 msgr2=0x7f7f781f6670 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:46.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f74ff9640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f78149710 0x7f7f781f6670 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f60011860 tx=0x7f7f600046d0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.526 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:00:46.526 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 174, 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 3, 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:00:46.527 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:46.528 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:46.529 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:46.530 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:46.531 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.532 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:46.533 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.534 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:00:46.535 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.536 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.537 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:46.538 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:46.539 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:00:46.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:46.540 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:46.540 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:46.540 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:46.540 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:46.540 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:46.540 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:46.540 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:00:46.540 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:00:46.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f58066470 msgr2=0x7f7f58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f7d8d6640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f58066470 0x7f7f58068930 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7f781419a0 tx=0x7f7f68009040 comp rx=0 tx=0).stop 2023-11-28T21:00:46.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 msgr2=0x7f7f78148c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f7d8d6640 1 --2- 172.21.15.167:0/3106551734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f78156c40 0x7f7f78148c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f700af040 tx=0x7f7f70019780 comp rx=0 tx=0).stop 2023-11-28T21:00:46.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f777fe640 1 -- 172.21.15.167:0/3106551734 reap_dead start 2023-11-28T21:00:46.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f777fe640 1 -- 172.21.15.167:0/3106551734 reap_dead start 2023-11-28T21:00:46.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 shutdown_connections 2023-11-28T21:00:46.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 >> 172.21.15.167:0/3106551734 conn(0x7f7f780cb1e0 msgr2=0x7f7f780c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:46.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 shutdown_connections 2023-11-28T21:00:46.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.523+0000 7f7f7d8d6640 1 -- 172.21.15.167:0/3106551734 wait complete. 2023-11-28T21:00:46.544 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:00:46.545 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T21:00:46.545 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T21:00:46.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.679+0000 7f7f8d7b8640 1 Processor -- start 2023-11-28T21:00:46.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.679+0000 7f7f8d7b8640 1 -- start start 2023-11-28T21:00:46.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f8d7b8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7f8806e030 0x7f7f881500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f8d7b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f88070480 0x7f7f881505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f8d7b8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7f8806e410 0x7f7f88071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f8d7b8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f881571d0 con 0x7f7f8806e410 2023-11-28T21:00:46.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f8d7b8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f88071a90 con 0x7f7f8806e030 2023-11-28T21:00:46.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f8d7b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880c70d0 con 0x7f7f88070480 2023-11-28T21:00:46.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f877fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7f8806e410 0x7f7f88071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f877fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7f8806e410 0x7f7f88071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54170/0 (socket says 172.21.15.167:54170) 2023-11-28T21:00:46.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f877fe640 1 -- 172.21.15.167:0/503902687 learned_addr learned my addr 172.21.15.167:0/503902687 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:46.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f7e7fc640 1 --2- 172.21.15.167:0/503902687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f88070480 0x7f7f881505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f86ffd640 1 --2- 172.21.15.167:0/503902687 >> v2:172.21.15.178:3300/0 conn(0x7f7f8806e030 0x7f7f881500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f877fe640 1 -- 172.21.15.167:0/503902687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f88070480 msgr2=0x7f7f881505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:46.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f877fe640 1 --2- 172.21.15.167:0/503902687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f88070480 0x7f7f881505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f877fe640 1 -- 172.21.15.167:0/503902687 >> v2:172.21.15.178:3300/0 conn(0x7f7f8806e030 msgr2=0x7f7f881500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:46.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f877fe640 1 --2- 172.21.15.167:0/503902687 >> v2:172.21.15.178:3300/0 conn(0x7f7f8806e030 0x7f7f881500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f877fe640 1 -- 172.21.15.167:0/503902687 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880c73b0 con 0x7f7f8806e410 2023-11-28T21:00:46.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.683+0000 7f7f877fe640 1 --2- 172.21.15.167:0/503902687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e410 0x7f7f88071f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f880cbff0 tx=0x7f7f8001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7aa50725e68f43f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f867fc640 1 -- 172.21.15.167:0/503902687 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8000b2d0 con 0x7f7f8806e410 2023-11-28T21:00:46.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f867fc640 1 -- 172.21.15.167:0/503902687 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8000b430 con 0x7f7f8806e410 2023-11-28T21:00:46.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f867fc640 1 -- 172.21.15.167:0/503902687 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f800a7c50 con 0x7f7f8806e410 2023-11-28T21:00:46.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/503902687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e410 msgr2=0x7f7f88071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/503902687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e410 0x7f7f88071f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f880cbff0 tx=0x7f7f8001eba0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/503902687 shutdown_connections 2023-11-28T21:00:46.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/503902687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e410 0x7f7f88071f20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/503902687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f88070480 0x7f7f881505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/503902687 >> v2:172.21.15.178:3300/0 conn(0x7f7f8806e030 0x7f7f881500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/503902687 >> 172.21.15.167:0/503902687 conn(0x7f7f880cb1e0 msgr2=0x7f7f880cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:46.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/503902687 shutdown_connections 2023-11-28T21:00:46.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/503902687 wait complete. 2023-11-28T21:00:46.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 Processor -- start 2023-11-28T21:00:46.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 -- start start 2023-11-28T21:00:46.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e030 0x7f7f881f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f8806e410 0x7f7f8813dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f88070480 0x7f7f881555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88141e40 con 0x7f7f8806e030 2023-11-28T21:00:46.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8814eb90 con 0x7f7f88070480 2023-11-28T21:00:46.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.687+0000 7f7f8d7b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8814ee70 con 0x7f7f8806e410 2023-11-28T21:00:46.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e030 0x7f7f881f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e030 0x7f7f881f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54178/0 (socket says 172.21.15.167:54178) 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f86ffd640 1 -- 172.21.15.167:0/2931594532 learned_addr learned my addr 172.21.15.167:0/2931594532 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f7e7fc640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f8806e410 0x7f7f8813dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f877fe640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f88070480 0x7f7f881555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f86ffd640 1 -- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f8806e410 msgr2=0x7f7f8813dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f86ffd640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f8806e410 0x7f7f8813dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f86ffd640 1 -- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f88070480 msgr2=0x7f7f881555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f86ffd640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f88070480 0x7f7f881555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f86ffd640 1 -- 172.21.15.167:0/2931594532 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8000bd40 con 0x7f7f8806e030 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f877fe640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f88070480 0x7f7f881555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:00:46.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f86ffd640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e030 0x7f7f881f5dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000d830 tx=0x7f7f7000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f7ffff640 1 -- 172.21.15.167:0/2931594532 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000be10 con 0x7f7f8806e030 2023-11-28T21:00:46.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f7ffff640 1 -- 172.21.15.167:0/2931594532 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f700098b0 con 0x7f7f8806e030 2023-11-28T21:00:46.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f7ffff640 1 -- 172.21.15.167:0/2931594532 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70009a40 con 0x7f7f8806e030 2023-11-28T21:00:46.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f881f6310 con 0x7f7f8806e030 2023-11-28T21:00:46.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f88142050 con 0x7f7f8806e030 2023-11-28T21:00:46.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f880682c0 con 0x7f7f8806e030 2023-11-28T21:00:46.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f7ffff640 1 -- 172.21.15.167:0/2931594532 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7f70009ba0 con 0x7f7f8806e030 2023-11-28T21:00:46.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f7ffff640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f68066470 0x7f7f68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:46.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.691+0000 7f7f7ffff640 1 -- 172.21.15.167:0/2931594532 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7f700845a0 con 0x7f7f8806e030 2023-11-28T21:00:46.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.695+0000 7f7f7e7fc640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f68066470 0x7f7f68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:46.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.695+0000 7f7f7e7fc640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f68066470 0x7f7f68068930 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7f88153e90 tx=0x7f7f78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:46.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.695+0000 7f7f7ffff640 1 -- 172.21.15.167:0/2931594532 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f700516c0 con 0x7f7f8806e030 2023-11-28T21:00:46.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.903+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f7f88075c90 con 0x7f7f8806e030 2023-11-28T21:00:46.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f7ffff640 1 -- 172.21.15.167:0/2931594532 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f7f70054ce0 con 0x7f7f8806e030 2023-11-28T21:00:46.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f68066470 msgr2=0x7f7f68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f68066470 0x7f7f68068930 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7f88153e90 tx=0x7f7f78008040 comp rx=0 tx=0).stop 2023-11-28T21:00:46.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e030 msgr2=0x7f7f881f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:46.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e030 0x7f7f881f5dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000d830 tx=0x7f7f7000dcf0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 shutdown_connections 2023-11-28T21:00:46.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7f68066470 0x7f7f68068930 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f88070480 0x7f7f881555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f8806e410 0x7f7f8813dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 --2- 172.21.15.167:0/2931594532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f8806e030 0x7f7f881f5dd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:46.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 >> 172.21.15.167:0/2931594532 conn(0x7f7f880cb1e0 msgr2=0x7f7f880c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:46.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 shutdown_connections 2023-11-28T21:00:46.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:46.907+0000 7f7f8d7b8640 1 -- 172.21.15.167:0/2931594532 wait complete. 2023-11-28T21:00:46.931 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T21:00:52.243 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:52.248 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:52.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~99s 2023-11-28T21:00:56.931 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:00:56.931 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:00:57.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.075+0000 7f71b845f640 1 Processor -- start 2023-11-28T21:00:57.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.075+0000 7f71b845f640 1 -- start start 2023-11-28T21:00:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b845f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71b00cf860 0x7f71b00cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b845f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 0x7f71b0153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b845f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b015ac00 con 0x7f71b00cfc40 2023-11-28T21:00:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b845f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00cbd60 con 0x7f71b00cf860 2023-11-28T21:00:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b845f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0159ff0 con 0x7f71b0153ae0 2023-11-28T21:00:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b61fb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71b00cf860 0x7f71b00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b61fb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f71b00cf860 0x7f71b00cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49684/0 (socket says 172.21.15.167:49684) 2023-11-28T21:00:57.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b61fb640 1 -- 172.21.15.167:0/585511663 learned_addr learned my addr 172.21.15.167:0/585511663 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:57.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b69fc640 1 --2- 172.21.15.167:0/585511663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 0x7f71b0153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b61fb640 1 -- 172.21.15.167:0/585511663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 msgr2=0x7f71b0153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:57.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b61fb640 1 --2- 172.21.15.167:0/585511663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 0x7f71b0153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b61fb640 1 -- 172.21.15.167:0/585511663 >> v1:172.21.15.178:6789/0 conn(0x7f71b00cfc40 legacy=0x7f71b00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.079+0000 7f71b61fb640 1 -- 172.21.15.167:0/585511663 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b015a2d0 con 0x7f71b00cf860 2023-11-28T21:00:57.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b61fb640 1 --2- 172.21.15.167:0/585511663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 0x7f71b00cb770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009870 tx=0x7f71ac01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8051caedf27e8051 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b51f9640 1 -- 172.21.15.167:0/585511663 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0a9400 con 0x7f71b00cf860 2023-11-28T21:00:57.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b51f9640 1 -- 172.21.15.167:0/585511663 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac0a9560 con 0x7f71b00cf860 2023-11-28T21:00:57.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b51f9640 1 -- 172.21.15.167:0/585511663 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0a98f0 con 0x7f71b00cf860 2023-11-28T21:00:57.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 -- 172.21.15.167:0/585511663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 msgr2=0x7f71b00cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 --2- 172.21.15.167:0/585511663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 0x7f71b00cb770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009870 tx=0x7f71ac01c540 comp rx=0 tx=0).stop 2023-11-28T21:00:57.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 -- 172.21.15.167:0/585511663 shutdown_connections 2023-11-28T21:00:57.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 --2- 172.21.15.167:0/585511663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 0x7f71b0153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 --2- 172.21.15.167:0/585511663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 0x7f71b00cb770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 -- 172.21.15.167:0/585511663 >> 172.21.15.167:0/585511663 conn(0x7f71b006c1f0 msgr2=0x7f71b0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:57.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 -- 172.21.15.167:0/585511663 shutdown_connections 2023-11-28T21:00:57.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 -- 172.21.15.167:0/585511663 wait complete. 2023-11-28T21:00:57.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 Processor -- start 2023-11-28T21:00:57.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 -- start start 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 0x7f71b0155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b00cfc40 0x7f71b00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 0x7f71b0143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c6970 con 0x7f71b00cf860 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0142dd0 con 0x7f71b00cfc40 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.083+0000 7f71b845f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00cdf00 con 0x7f71b0153ae0 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b61fb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 0x7f71b0155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b61fb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 0x7f71b0155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49700/0 (socket says 172.21.15.167:49700) 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b61fb640 1 -- 172.21.15.167:0/4277869257 learned_addr learned my addr 172.21.15.167:0/4277869257 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b69fc640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 0x7f71b0143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b59fa640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b00cfc40 0x7f71b00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b61fb640 1 -- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 msgr2=0x7f71b0143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b61fb640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 0x7f71b0143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b61fb640 1 -- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b00cfc40 msgr2=0x7f71b00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b61fb640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b00cfc40 0x7f71b00b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b61fb640 1 -- 172.21.15.167:0/4277869257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0094d0 con 0x7f71b00cf860 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b61fb640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 0x7f71b0155320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f71ac01abf0 tx=0x7f71ac0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71a6ffd640 1 -- 172.21.15.167:0/4277869257 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0a9400 con 0x7f71b00cf860 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71a6ffd640 1 -- 172.21.15.167:0/4277869257 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac0b1800 con 0x7f71b00cf860 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71a6ffd640 1 -- 172.21.15.167:0/4277869257 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0b1b90 con 0x7f71b00cf860 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b00c6ba0 con 0x7f71b00cf860 2023-11-28T21:00:57.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b00ce480 con 0x7f71b00cf860 2023-11-28T21:00:57.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b0142f40 con 0x7f71b00cf860 2023-11-28T21:00:57.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71a6ffd640 1 -- 172.21.15.167:0/4277869257 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71ac0b1cf0 con 0x7f71b00cf860 2023-11-28T21:00:57.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71a6ffd640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f71940664a0 0x7f7194068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.087+0000 7f71a6ffd640 1 -- 172.21.15.167:0/4277869257 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f71ac11e660 con 0x7f71b00cf860 2023-11-28T21:00:57.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.091+0000 7f71b59fa640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f71940664a0 0x7f7194068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.091+0000 7f71b59fa640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f71940664a0 0x7f7194068960 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f71b0155260 tx=0x7f71a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.091+0000 7f71a6ffd640 1 -- 172.21.15.167:0/4277869257 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71ac0eb800 con 0x7f71b00cf860 2023-11-28T21:00:57.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f71b0075c90 con 0x7f71b00cf860 2023-11-28T21:00:57.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71a6ffd640 1 -- 172.21.15.167:0/4277869257 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f71ac0a6030 con 0x7f71b00cf860 2023-11-28T21:00:57.298 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f71940664a0 msgr2=0x7f7194068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f71940664a0 0x7f7194068960 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f71b0155260 tx=0x7f71a0009040 comp rx=0 tx=0).stop 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 msgr2=0x7f71b0155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 0x7f71b0155320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f71ac01abf0 tx=0x7f71ac0192e0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 shutdown_connections 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f71940664a0 0x7f7194068960 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0153ae0 0x7f71b0143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b00cfc40 0x7f71b00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 --2- 172.21.15.167:0/4277869257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71b00cf860 0x7f71b0155320 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 >> 172.21.15.167:0/4277869257 conn(0x7f71b006c1f0 msgr2=0x7f71b00b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:57.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.295+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 shutdown_connections 2023-11-28T21:00:57.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.299+0000 7f71b845f640 1 -- 172.21.15.167:0/4277869257 wait complete. 2023-11-28T21:00:57.319 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:00:57.319 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T21:00:57.319 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T21:00:57.319 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:00:57.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.455+0000 7f2df4b01640 1 Processor -- start 2023-11-28T21:00:57.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.455+0000 7f2df4b01640 1 -- start start 2023-11-28T21:00:57.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.455+0000 7f2df4b01640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 0x7f2df00c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.455+0000 7f2df4b01640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2df00c5c90 0x7f2df00c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.455+0000 7f2df4b01640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df015b220 con 0x7f2df006a580 2023-11-28T21:00:57.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.455+0000 7f2df4b01640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df00c4da0 con 0x7f2df00c5c90 2023-11-28T21:00:57.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.455+0000 7f2df4b01640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00c60f0 con 0x7f2df0151f60 2023-11-28T21:00:57.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.459+0000 7f2dee59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 0x7f2df00c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.459+0000 7f2de7fff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2df00c5c90 0x7f2df00c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.459+0000 7f2dee59c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 0x7f2df00c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:34990/0 (socket says 172.21.15.167:34990) 2023-11-28T21:00:57.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.459+0000 7f2dee59c640 1 -- 172.21.15.167:0/1908743883 learned_addr learned my addr 172.21.15.167:0/1908743883 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:57.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.459+0000 7f2de7fff640 1 -- 172.21.15.167:0/1908743883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 msgr2=0x7f2df00c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:57.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.459+0000 7f2de7fff640 1 --2- 172.21.15.167:0/1908743883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 0x7f2df00c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.459+0000 7f2de7fff640 1 -- 172.21.15.167:0/1908743883 >> v1:172.21.15.178:6789/0 conn(0x7f2df006a580 legacy=0x7f2df006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.459+0000 7f2de7fff640 1 -- 172.21.15.167:0/1908743883 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df0152340 con 0x7f2df00c5c90 2023-11-28T21:00:57.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.459+0000 7f2dee59c640 1 --2- 172.21.15.167:0/1908743883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 0x7f2df00c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:00:57.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2de7fff640 1 --2- 172.21.15.167:0/1908743883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df00c5c90 0x7f2df00c26e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80097c0 tx=0x7f2dd801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb4d105913a8dda server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2dedd9b640 1 -- 172.21.15.167:0/1908743883 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80ab600 con 0x7f2df00c5c90 2023-11-28T21:00:57.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2dedd9b640 1 -- 172.21.15.167:0/1908743883 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd80a7050 con 0x7f2df00c5c90 2023-11-28T21:00:57.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2dedd9b640 1 -- 172.21.15.167:0/1908743883 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80ab980 con 0x7f2df00c5c90 2023-11-28T21:00:57.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 -- 172.21.15.167:0/1908743883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df00c5c90 msgr2=0x7f2df00c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 --2- 172.21.15.167:0/1908743883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df00c5c90 0x7f2df00c26e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80097c0 tx=0x7f2dd801c3f0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 -- 172.21.15.167:0/1908743883 shutdown_connections 2023-11-28T21:00:57.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 --2- 172.21.15.167:0/1908743883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df00c5c90 0x7f2df00c26e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 --2- 172.21.15.167:0/1908743883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 0x7f2df00c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 -- 172.21.15.167:0/1908743883 >> 172.21.15.167:0/1908743883 conn(0x7f2df00cb1e0 msgr2=0x7f2df00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:57.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 -- 172.21.15.167:0/1908743883 shutdown_connections 2023-11-28T21:00:57.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 -- 172.21.15.167:0/1908743883 wait complete. 2023-11-28T21:00:57.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 Processor -- start 2023-11-28T21:00:57.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.463+0000 7f2df4b01640 1 -- start start 2023-11-28T21:00:57.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df006a580 0x7f2df0147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df00c5c90 0x7f2df01fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 0x7f2df014d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df014b770 con 0x7f2df00c5c90 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df014ba10 con 0x7f2df006a580 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df01f6e50 con 0x7f2df0151f60 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df00c5c90 0x7f2df01fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df00c5c90 0x7f2df01fa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49712/0 (socket says 172.21.15.167:49712) 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de7fff640 1 -- 172.21.15.167:0/409746669 learned_addr learned my addr 172.21.15.167:0/409746669 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2dee59c640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df006a580 0x7f2df0147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2deed9d640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 0x7f2df014d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de7fff640 1 -- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 msgr2=0x7f2df014d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de7fff640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2df0151f60 0x7f2df014d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de7fff640 1 -- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df006a580 msgr2=0x7f2df0147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de7fff640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df006a580 0x7f2df0147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de7fff640 1 -- 172.21.15.167:0/409746669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de00094d0 con 0x7f2df00c5c90 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2dee59c640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2df006a580 0x7f2df0147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de7fff640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df00c5c90 0x7f2df01fa2d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80ae040 tx=0x7f2dd8019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80b4430 con 0x7f2df00c5c90 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd80b45b0 con 0x7f2df00c5c90 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd8009420 con 0x7f2df00c5c90 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80b4960 con 0x7f2df00c5c90 2023-11-28T21:00:57.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df01f7410 con 0x7f2df00c5c90 2023-11-28T21:00:57.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df0149ff0 0x7f2df014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df0074770 con 0x7f2df0149ff0 2023-11-28T21:00:57.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2dee59c640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df0149ff0 0x7f2df014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2dee59c640 1 -- 172.21.15.167:0/409746669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2df006ada0 con 0x7f2df0149ff0 2023-11-28T21:00:57.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2dee59c640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df0149ff0 0x7f2df014daf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2de0011830 tx=0x7f2de0011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0011ee0 con 0x7f2df0149ff0 2023-11-28T21:00:57.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.467+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2dd80b2040 con 0x7f2df00c5c90 2023-11-28T21:00:57.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.471+0000 7f2de6ffd640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2dd0066540 0x7f2dd0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.471+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2dd811e120 con 0x7f2df00c5c90 2023-11-28T21:00:57.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.471+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f2de000fc40 con 0x7f2df0149ff0 2023-11-28T21:00:57.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.471+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df0149ff0 msgr2=0x7f2df014daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.471+0000 7f2de6ffd640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df0149ff0 0x7f2df014daf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2de0011830 tx=0x7f2de0011cf0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.471+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df0149ff0 msgr2=0x7f2df014daf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:57.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.471+0000 7f2de6ffd640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df0149ff0 0x7f2df014daf0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2de0011830 tx=0x7f2de0011cf0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.471+0000 7f2deed9d640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2dd0066540 0x7f2dd0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.471+0000 7f2deed9d640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2dd0066540 0x7f2dd0068a00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2de80012f0 tx=0x7f2de8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.475+0000 7f2df4b01640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df01fa810 0x7f2df00ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.475+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df015ba30 con 0x7f2df01fa810 2023-11-28T21:00:57.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.475+0000 7f2dee59c640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df01fa810 0x7f2df00ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.475+0000 7f2dee59c640 1 -- 172.21.15.167:0/409746669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2df015bf50 con 0x7f2df01fa810 2023-11-28T21:00:57.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.475+0000 7f2dee59c640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df01fa810 0x7f2df00ca030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2de0011830 tx=0x7f2de00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000fed0 con 0x7f2df01fa810 2023-11-28T21:00:57.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5126 (secure 0 0 0) 0x7f2de0023040 con 0x7f2df01fa810 2023-11-28T21:00:57.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df01fa810 msgr2=0x7f2df00ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2de6ffd640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df01fa810 0x7f2df00ca030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2de0011830 tx=0x7f2de00046d0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2de6ffd640 1 -- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df01fa810 msgr2=0x7f2df00ca030 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:57.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2de6ffd640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df01fa810 0x7f2df00ca030 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2de0011830 tx=0x7f2de00046d0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.481 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:00:57.481 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:57.481 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:57.481 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:00:57.481 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 174, 2023-11-28T21:00:57.481 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:00:57.481 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:57.482 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:57.483 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:00:57.484 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:00:57.485 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.486 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:57.487 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:00:57.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.488 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.488 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.488 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.488 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:00:57.490 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:00:57.490 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:57.490 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:57.490 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:57.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.490 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.490 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:57.490 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:57.490 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.491 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:57.492 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:57.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.493 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:57.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:00:57.493 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:57.496 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:00:57.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.498 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.499 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:00:57.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.500 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.500 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.500 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:00:57.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.500 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.500 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:00:57.500 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2dd0066540 msgr2=0x7f2dd0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2df4b01640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2dd0066540 0x7f2dd0068a00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2de80012f0 tx=0x7f2de8009040 comp rx=0 tx=0).stop 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df00c5c90 msgr2=0x7f2df01fa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2df4b01640 1 --2- 172.21.15.167:0/409746669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2df00c5c90 0x7f2df01fa2d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80ae040 tx=0x7f2dd8019190 comp rx=0 tx=0).stop 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2deed9d640 1 -- 172.21.15.167:0/409746669 reap_dead start 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2deed9d640 1 -- 172.21.15.167:0/409746669 reap_dead start 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 shutdown_connections 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 >> 172.21.15.167:0/409746669 conn(0x7f2df00cb1e0 msgr2=0x7f2df00c1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 shutdown_connections 2023-11-28T21:00:57.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.479+0000 7f2df4b01640 1 -- 172.21.15.167:0/409746669 wait complete. 2023-11-28T21:00:57.503 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:00:57.503 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T21:00:57.503 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:00:57.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d1a365640 1 Processor -- start 2023-11-28T21:00:57.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d1a365640 1 -- start start 2023-11-28T21:00:57.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d1a365640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d14153eb0 0x7f4d140c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d1a365640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d1415d840 0x7f4d1415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d1a365640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1415e210 con 0x7f4d140c6260 2023-11-28T21:00:57.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d1a365640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d140c2df0 con 0x7f4d14153eb0 2023-11-28T21:00:57.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d1a365640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1415abe0 con 0x7f4d1415d840 2023-11-28T21:00:57.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d137fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4d140c6260 0x7f4d140c8040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46510/0 (socket says 172.21.15.167:46510) 2023-11-28T21:00:57.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d137fe640 1 -- 172.21.15.167:0/3182333064 learned_addr learned my addr 172.21.15.167:0/3182333064 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:00:57.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d18902640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d1415d840 0x7f4d1415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d13fff640 1 --2- 172.21.15.167:0/3182333064 >> v2:172.21.15.178:3300/0 conn(0x7f4d14153eb0 0x7f4d140c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603631568 0 0) 0x7f4d1415e210 con 0x7f4d140c6260 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cfc003530 con 0x7f4d140c6260 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 58519686 0 0) 0x7f4cfc003530 con 0x7f4d140c6260 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d1415d840 msgr2=0x7f4d1415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d12ffd640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d1415d840 0x7f4d1415dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 >> v2:172.21.15.178:3300/0 conn(0x7f4d14153eb0 msgr2=0x7f4d140c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d12ffd640 1 --2- 172.21.15.167:0/3182333064 >> v2:172.21.15.178:3300/0 conn(0x7f4d14153eb0 0x7f4d140c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.639+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1415a060 con 0x7f4d140c6260 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f4d08001680 con 0x7f4d140c6260 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 >> v1:172.21.15.167:6789/0 conn(0x7f4d140c6260 legacy=0x7f4d140c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d1415d840 0x7f4cfc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cfc003f00 0x7f4cfc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cfc004d10 0x7f4cfc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140c2df0 con 0x7f4cfc003f00 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1415abe0 con 0x7f4cfc004d10 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc00b9c0 con 0x7f4d1415d840 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d137fe640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cfc003f00 0x7f4cfc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d18902640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cfc004d10 0x7f4cfc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d13fff640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d1415d840 0x7f4cfc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d137fe640 1 -- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d1415d840 msgr2=0x7f4cfc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d137fe640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d1415d840 0x7f4cfc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d137fe640 1 -- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cfc004d10 msgr2=0x7f4cfc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d137fe640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cfc004d10 0x7f4cfc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d137fe640 1 -- 172.21.15.167:0/3182333064 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc003530 con 0x7f4cfc003f00 2023-11-28T21:00:57.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d18902640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cfc004d10 0x7f4cfc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:57.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d137fe640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cfc003f00 0x7f4cfc0047d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c240 tx=0x7f4d0801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec3c76833a5a31c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080a5960 con 0x7f4cfc003f00 2023-11-28T21:00:57.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d080a5ac0 con 0x7f4cfc003f00 2023-11-28T21:00:57.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.643+0000 7f4d12ffd640 1 -- 172.21.15.167:0/3182333064 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080058e0 con 0x7f4cfc003f00 2023-11-28T21:00:57.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 -- 172.21.15.167:0/3182333064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cfc003f00 msgr2=0x7f4cfc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 --2- 172.21.15.167:0/3182333064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cfc003f00 0x7f4cfc0047d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c240 tx=0x7f4d0801cc60 comp rx=0 tx=0).stop 2023-11-28T21:00:57.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d18902640 1 -- 172.21.15.167:0/3182333064 reap_dead start 2023-11-28T21:00:57.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 -- 172.21.15.167:0/3182333064 shutdown_connections 2023-11-28T21:00:57.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 -- 172.21.15.167:0/3182333064 >> 172.21.15.167:0/3182333064 conn(0x7f4d1406a580 msgr2=0x7f4d1406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:57.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 -- 172.21.15.167:0/3182333064 shutdown_connections 2023-11-28T21:00:57.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 -- 172.21.15.167:0/3182333064 wait complete. 2023-11-28T21:00:57.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 Processor -- start 2023-11-28T21:00:57.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 -- start start 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cfc003f00 0x7f4d14070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1415cb60 0x7f4d1414e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d1414eec0 0x7f4d141470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1414d740 con 0x7f4d1415cb60 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d141f2760 con 0x7f4d1414eec0 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d1a365640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14151080 con 0x7f4cfc003f00 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d137fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1415cb60 0x7f4d1414e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d137fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1415cb60 0x7f4d1414e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49742/0 (socket says 172.21.15.167:49742) 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d137fe640 1 -- 172.21.15.167:0/1383874222 learned_addr learned my addr 172.21.15.167:0/1383874222 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:57.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d13fff640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cfc003f00 0x7f4d14070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.647+0000 7f4d18902640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d1414eec0 0x7f4d141470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d137fe640 1 -- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cfc003f00 msgr2=0x7f4d14070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d137fe640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cfc003f00 0x7f4d14070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d137fe640 1 -- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d1414eec0 msgr2=0x7f4d141470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d137fe640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d1414eec0 0x7f4d141470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d137fe640 1 -- 172.21.15.167:0/1383874222 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d14151360 con 0x7f4d1415cb60 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d13fff640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cfc003f00 0x7f4d14070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d137fe640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1415cb60 0x7f4d1414e980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d080ab040 tx=0x7f4cfc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08001c60 con 0x7f4d1415cb60 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d080b3070 con 0x7f4d1415cb60 2023-11-28T21:00:57.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d14151640 con 0x7f4d1415cb60 2023-11-28T21:00:57.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080072d0 con 0x7f4d1415cb60 2023-11-28T21:00:57.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1406e540 con 0x7f4d1415cb60 2023-11-28T21:00:57.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d1a365640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147630 0x7f4d140ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d141514f0 con 0x7f4d14147630 2023-11-28T21:00:57.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d13fff640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147630 0x7f4d140ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d13fff640 1 -- 172.21.15.167:0/1383874222 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d1415a900 con 0x7f4d14147630 2023-11-28T21:00:57.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d08007430 con 0x7f4d1415cb60 2023-11-28T21:00:57.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d13fff640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147630 0x7f4d140ca400 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d040138b0 tx=0x7f4d04013d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d10ff9640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d000664a0 0x7f4d00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4d080b5070 con 0x7f4d1415cb60 2023-11-28T21:00:57.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.651+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04011ac0 con 0x7f4d14147630 2023-11-28T21:00:57.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.655+0000 7f4d18902640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d000664a0 0x7f4d00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.655+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f4d04011c20 con 0x7f4d14147630 2023-11-28T21:00:57.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.655+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147630 msgr2=0x7f4d140ca400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.655+0000 7f4d10ff9640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147630 0x7f4d140ca400 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d040138b0 tx=0x7f4d04013d70 comp rx=0 tx=0).stop 2023-11-28T21:00:57.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.655+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147630 msgr2=0x7f4d140ca400 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:57.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.655+0000 7f4d10ff9640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147630 0x7f4d140ca400 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.655+0000 7f4d18902640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d000664a0 0x7f4d00068960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4d14067fa0 tx=0x7f4d0c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.659+0000 7f4d1a365640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147a10 0x7f4d140ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.659+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14066f30 con 0x7f4d14147a10 2023-11-28T21:00:57.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.659+0000 7f4d13fff640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147a10 0x7f4d140ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.659+0000 7f4d13fff640 1 -- 172.21.15.167:0/1383874222 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4d1415a620 con 0x7f4d14147a10 2023-11-28T21:00:57.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.659+0000 7f4d13fff640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147a10 0x7f4d140ca940 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4d040138b0 tx=0x7f4d04004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.659+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04026070 con 0x7f4d14147a10 2023-11-28T21:00:57.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4811 (secure 0 0 0) 0x7f4d04006910 con 0x7f4d14147a10 2023-11-28T21:00:57.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147a10 msgr2=0x7f4d140ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d10ff9640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147a10 0x7f4d140ca940 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4d040138b0 tx=0x7f4d04004740 comp rx=0 tx=0).stop 2023-11-28T21:00:57.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d10ff9640 1 -- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147a10 msgr2=0x7f4d140ca940 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:57.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d10ff9640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d14147a10 0x7f4d140ca940 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4d040138b0 tx=0x7f4d04004740 comp rx=0 tx=0).stop 2023-11-28T21:00:57.665 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:00:57.665 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:57.665 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 174, 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:00:57.666 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:57.667 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:57.668 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:00:57.669 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:57.670 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:57.671 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.672 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:57.673 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:57.674 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:57.676 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:00:57.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T21:00:57.678 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:00:57.679 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:00:57.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d000664a0 msgr2=0x7f4d00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d1a365640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4d000664a0 0x7f4d00068960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4d14067fa0 tx=0x7f4d0c00b040 comp rx=0 tx=0).stop 2023-11-28T21:00:57.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1415cb60 msgr2=0x7f4d1414e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d1a365640 1 --2- 172.21.15.167:0/1383874222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1415cb60 0x7f4d1414e980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d080ab040 tx=0x7f4cfc005800 comp rx=0 tx=0).stop 2023-11-28T21:00:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d18902640 1 -- 172.21.15.167:0/1383874222 reap_dead start 2023-11-28T21:00:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d18902640 1 -- 172.21.15.167:0/1383874222 reap_dead start 2023-11-28T21:00:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 shutdown_connections 2023-11-28T21:00:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 >> 172.21.15.167:0/1383874222 conn(0x7f4d1406a580 msgr2=0x7f4d1406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 shutdown_connections 2023-11-28T21:00:57.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.663+0000 7f4d1a365640 1 -- 172.21.15.167:0/1383874222 wait complete. 2023-11-28T21:00:57.683 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:00:57.683 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T21:00:57.683 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:00:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.823+0000 7fbf9da5f640 1 Processor -- start 2023-11-28T21:00:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.823+0000 7fbf9da5f640 1 -- start start 2023-11-28T21:00:57.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.823+0000 7fbf9da5f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbf98157560 0x7fbf980c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.823+0000 7fbf9da5f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf98157940 con 0x7fbf98150b40 2023-11-28T21:00:57.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.823+0000 7fbf9da5f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf980c6ac0 con 0x7fbf980c6ff0 2023-11-28T21:00:57.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.823+0000 7fbf9da5f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf980c62f0 con 0x7fbf98157560 2023-11-28T21:00:57.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.823+0000 7fbf96ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbf98150b40 0x7fbf980c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46516/0 (socket says 172.21.15.167:46516) 2023-11-28T21:00:57.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.823+0000 7fbf96ffd640 1 -- 172.21.15.167:0/3192216298 learned_addr learned my addr 172.21.15.167:0/3192216298 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:00:57.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.823+0000 7fbf977fe640 1 --2- 172.21.15.167:0/3192216298 >> v2:172.21.15.167:3300/0 conn(0x7fbf98157560 0x7fbf980c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf967fc640 1 -- 172.21.15.167:0/3192216298 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875423327 0 0) 0x7fbf98157940 con 0x7fbf98150b40 2023-11-28T21:00:57.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf967fc640 1 -- 172.21.15.167:0/3192216298 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf84005740 con 0x7fbf98150b40 2023-11-28T21:00:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf977fe640 1 -- 172.21.15.167:0/3192216298 >> v1:172.21.15.178:6789/0 conn(0x7fbf980c6ff0 legacy=0x7fbf9806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf977fe640 1 -- 172.21.15.167:0/3192216298 >> v1:172.21.15.167:6789/0 conn(0x7fbf98150b40 legacy=0x7fbf980c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf977fe640 1 -- 172.21.15.167:0/3192216298 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf980c6500 con 0x7fbf98157560 2023-11-28T21:00:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf977fe640 1 --2- 172.21.15.167:0/3192216298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 0x7fbf980c4510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009d90 tx=0x7fbf9001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30dcf7193287449 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf967fc640 1 -- 172.21.15.167:0/3192216298 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900af600 con 0x7fbf98157560 2023-11-28T21:00:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf967fc640 1 -- 172.21.15.167:0/3192216298 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf900ab050 con 0x7fbf98157560 2023-11-28T21:00:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf967fc640 1 -- 172.21.15.167:0/3192216298 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900af980 con 0x7fbf98157560 2023-11-28T21:00:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf9da5f640 1 -- 172.21.15.167:0/3192216298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 msgr2=0x7fbf980c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.827+0000 7fbf9da5f640 1 --2- 172.21.15.167:0/3192216298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 0x7fbf980c4510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009d90 tx=0x7fbf9001f130 comp rx=0 tx=0).stop 2023-11-28T21:00:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 -- 172.21.15.167:0/3192216298 shutdown_connections 2023-11-28T21:00:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 --2- 172.21.15.167:0/3192216298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 0x7fbf980c4510 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 -- 172.21.15.167:0/3192216298 >> 172.21.15.167:0/3192216298 conn(0x7fbf980cb1e0 msgr2=0x7fbf980cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 -- 172.21.15.167:0/3192216298 shutdown_connections 2023-11-28T21:00:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 -- 172.21.15.167:0/3192216298 wait complete. 2023-11-28T21:00:57.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 Processor -- start 2023-11-28T21:00:57.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 -- start start 2023-11-28T21:00:57.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf980c6ff0 0x7fbf9815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98150b40 0x7fbf9814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 0x7fbf981ef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf98152a70 con 0x7fbf98157560 2023-11-28T21:00:57.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9815aa30 con 0x7fbf980c6ff0 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf981538f0 con 0x7fbf98150b40 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 0x7fbf981ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 0x7fbf981ef700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49770/0 (socket says 172.21.15.167:49770) 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf977fe640 1 -- 172.21.15.167:0/1788626828 learned_addr learned my addr 172.21.15.167:0/1788626828 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf96ffd640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf980c6ff0 0x7fbf9815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf8ffff640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98150b40 0x7fbf9814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf977fe640 1 -- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98150b40 msgr2=0x7fbf9814de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf977fe640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98150b40 0x7fbf9814de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf977fe640 1 -- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf980c6ff0 msgr2=0x7fbf9815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf977fe640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf980c6ff0 0x7fbf9815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf977fe640 1 -- 172.21.15.167:0/1788626828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf90009a70 con 0x7fbf98157560 2023-11-28T21:00:57.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf977fe640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 0x7fbf981ef700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009d90 tx=0x7fbf9001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90009450 con 0x7fbf98157560 2023-11-28T21:00:57.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf900b9410 con 0x7fbf98157560 2023-11-28T21:00:57.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900b97c0 con 0x7fbf98157560 2023-11-28T21:00:57.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.831+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9815ac30 con 0x7fbf98157560 2023-11-28T21:00:57.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf98153e40 con 0x7fbf98157560 2023-11-28T21:00:57.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf9da5f640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9814e810 0x7fbf981efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf98074770 con 0x7fbf9814e810 2023-11-28T21:00:57.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf96ffd640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9814e810 0x7fbf981efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbf900b6050 con 0x7fbf98157560 2023-11-28T21:00:57.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf96ffd640 1 -- 172.21.15.167:0/1788626828 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf981550b0 con 0x7fbf9814e810 2023-11-28T21:00:57.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf96ffd640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9814e810 0x7fbf981efc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbf88000f70 tx=0x7fbf8800fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf94ff9640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf78066470 0x7fbf78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fbf90122610 con 0x7fbf98157560 2023-11-28T21:00:57.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880058c0 con 0x7fbf9814e810 2023-11-28T21:00:57.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf8ffff640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf78066470 0x7fbf78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fbf88005a20 con 0x7fbf9814e810 2023-11-28T21:00:57.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9814e810 msgr2=0x7fbf981efc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf94ff9640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9814e810 0x7fbf981efc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbf88000f70 tx=0x7fbf8800fc00 comp rx=0 tx=0).stop 2023-11-28T21:00:57.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9814e810 msgr2=0x7fbf981efc40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:57.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.835+0000 7fbf94ff9640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9814e810 0x7fbf981efc40 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbf88000f70 tx=0x7fbf8800fc00 comp rx=0 tx=0).stop 2023-11-28T21:00:57.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.839+0000 7fbf8ffff640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf78066470 0x7fbf78068930 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbf98154d10 tx=0x7fbf80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.843+0000 7fbf9da5f640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98154030 0x7fbf9814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:57.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.843+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf981ef4a0 con 0x7fbf98154030 2023-11-28T21:00:57.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.843+0000 7fbf96ffd640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98154030 0x7fbf9814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:57.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.843+0000 7fbf96ffd640 1 -- 172.21.15.167:0/1788626828 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbf9806a6a0 con 0x7fbf98154030 2023-11-28T21:00:57.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.843+0000 7fbf96ffd640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98154030 0x7fbf9814b7e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf88017000 tx=0x7fbf88005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:57.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.843+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88023070 con 0x7fbf98154030 2023-11-28T21:00:57.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.843+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7fbf880072e0 con 0x7fbf98154030 2023-11-28T21:00:57.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.843+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98154030 msgr2=0x7fbf9814b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.843+0000 7fbf94ff9640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98154030 0x7fbf9814b7e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf88017000 tx=0x7fbf88005800 comp rx=0 tx=0).stop 2023-11-28T21:00:57.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf94ff9640 1 -- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98154030 msgr2=0x7fbf9814b7e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:00:57.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf94ff9640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf98154030 0x7fbf9814b7e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.848 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 174, 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 15, 2023-11-28T21:00:57.849 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:57.850 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:57.851 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:00:57.852 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:00:57.853 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:57.854 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:00:57.855 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:00:57.856 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:57.857 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.858 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:00:57.859 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:00:57.860 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:00:57.861 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:00:57.861 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:00:57.861 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:00:57.861 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:00:57.861 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:00:57.861 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:00:57.861 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:00:57.861 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:00:57.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf78066470 msgr2=0x7fbf78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf9da5f640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbf78066470 0x7fbf78068930 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbf98154d10 tx=0x7fbf80009040 comp rx=0 tx=0).stop 2023-11-28T21:00:57.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 msgr2=0x7fbf981ef700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:57.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf9da5f640 1 --2- 172.21.15.167:0/1788626828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf98157560 0x7fbf981ef700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009d90 tx=0x7fbf9001bed0 comp rx=0 tx=0).stop 2023-11-28T21:00:57.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf977fe640 1 -- 172.21.15.167:0/1788626828 reap_dead start 2023-11-28T21:00:57.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf977fe640 1 -- 172.21.15.167:0/1788626828 reap_dead start 2023-11-28T21:00:57.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 shutdown_connections 2023-11-28T21:00:57.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 >> 172.21.15.167:0/1788626828 conn(0x7fbf980cb1e0 msgr2=0x7fbf98070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:57.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 shutdown_connections 2023-11-28T21:00:57.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:57.847+0000 7fbf9da5f640 1 -- 172.21.15.167:0/1788626828 wait complete. 2023-11-28T21:00:57.867 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:00:57.867 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2023-11-28T21:00:57.867 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T21:00:57.867 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2023-11-28T21:00:57.867 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T21:00:57.867 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T21:00:57.868 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:00:57.891 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T21:00:57.891 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T21:00:57.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:00:58.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.023+0000 7fc2a332a640 1 Processor -- start 2023-11-28T21:00:58.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.023+0000 7fc2a332a640 1 -- start start 2023-11-28T21:00:58.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a332a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc29c0c6ff0 0x7fc29c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a332a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc29c0c4510 0x7fc29c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a332a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0c48f0 con 0x7fc29c150b40 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a332a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0c62f0 con 0x7fc29c0c6ff0 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a332a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0c6ac0 con 0x7fc29c0c4510 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a10c6640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc29c150b40 0x7fc29c0c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46520/0 (socket says 172.21.15.167:46520) 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a10c6640 1 -- 172.21.15.167:0/4073684668 learned_addr learned my addr 172.21.15.167:0/4073684668 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a08c5640 1 --2- 172.21.15.167:0/4073684668 >> v2:172.21.15.167:3300/0 conn(0x7fc29c0c6ff0 0x7fc29c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a18c7640 1 -- 172.21.15.167:0/4073684668 >> v2:172.21.15.178:3300/0 conn(0x7fc29c0c4510 msgr2=0x7fc29c06a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a18c7640 1 --2- 172.21.15.167:0/4073684668 >> v2:172.21.15.178:3300/0 conn(0x7fc29c0c4510 0x7fc29c06a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a08c5640 1 -- 172.21.15.167:0/4073684668 >> v2:172.21.15.178:3300/0 conn(0x7fc29c0c4510 msgr2=0x7fc29c06a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a08c5640 1 --2- 172.21.15.167:0/4073684668 >> v2:172.21.15.178:3300/0 conn(0x7fc29c0c4510 0x7fc29c06a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:58.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a08c5640 1 -- 172.21.15.167:0/4073684668 >> v1:172.21.15.167:6789/0 conn(0x7fc29c150b40 legacy=0x7fc29c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:58.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.027+0000 7fc2a08c5640 1 -- 172.21.15.167:0/4073684668 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0c6500 con 0x7fc29c0c6ff0 2023-11-28T21:00:58.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a08c5640 1 --2- 172.21.15.167:0/4073684668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c6ff0 0x7fc29c157560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0cc270 tx=0x7fc28c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c914bfd3be31f25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:58.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc293fff640 1 -- 172.21.15.167:0/4073684668 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0ad660 con 0x7fc29c0c6ff0 2023-11-28T21:00:58.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc293fff640 1 -- 172.21.15.167:0/4073684668 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c0ad7c0 con 0x7fc29c0c6ff0 2023-11-28T21:00:58.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc293fff640 1 -- 172.21.15.167:0/4073684668 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0adb50 con 0x7fc29c0c6ff0 2023-11-28T21:00:58.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 -- 172.21.15.167:0/4073684668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c6ff0 msgr2=0x7fc29c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:58.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 --2- 172.21.15.167:0/4073684668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c6ff0 0x7fc29c157560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0cc270 tx=0x7fc28c01c450 comp rx=0 tx=0).stop 2023-11-28T21:00:58.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 -- 172.21.15.167:0/4073684668 shutdown_connections 2023-11-28T21:00:58.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 --2- 172.21.15.167:0/4073684668 >> v2:172.21.15.178:3300/0 conn(0x7fc29c0c4510 0x7fc29c06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:58.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 --2- 172.21.15.167:0/4073684668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c6ff0 0x7fc29c157560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:58.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 -- 172.21.15.167:0/4073684668 >> 172.21.15.167:0/4073684668 conn(0x7fc29c0cb1e0 msgr2=0x7fc29c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:58.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 -- 172.21.15.167:0/4073684668 shutdown_connections 2023-11-28T21:00:58.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 -- 172.21.15.167:0/4073684668 wait complete. 2023-11-28T21:00:58.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 Processor -- start 2023-11-28T21:00:58.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.031+0000 7fc2a332a640 1 -- start start 2023-11-28T21:00:58.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a332a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c4510 0x7fc29c1f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a332a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c0c6ff0 0x7fc29c141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a332a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c150b40 0x7fc29c144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a332a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c14a690 con 0x7fc29c0c4510 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a332a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c14a970 con 0x7fc29c150b40 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a332a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c14ac50 con 0x7fc29c0c6ff0 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a10c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c4510 0x7fc29c1f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a18c7640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c150b40 msgr2=0x7fc29c144650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a18c7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c150b40 0x7fc29c144650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a10c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c4510 0x7fc29c1f08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49828/0 (socket says 172.21.15.167:49828) 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a10c6640 1 -- 172.21.15.167:0/3856600837 learned_addr learned my addr 172.21.15.167:0/3856600837 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a08c5640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c0c6ff0 0x7fc29c141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a10c6640 1 -- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c0c6ff0 msgr2=0x7fc29c141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:58.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a10c6640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c0c6ff0 0x7fc29c141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a10c6640 1 -- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c150b40 msgr2=0x7fc29c144650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a10c6640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c150b40 0x7fc29c144650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a10c6640 1 -- 172.21.15.167:0/3856600837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c009420 con 0x7fc29c0c4510 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a08c5640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c0c6ff0 0x7fc29c141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a10c6640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c4510 0x7fc29c1f08f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc298007fd0 tx=0x7fc29800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc291ffb640 1 -- 172.21.15.167:0/3856600837 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298005cf0 con 0x7fc29c0c4510 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc291ffb640 1 -- 172.21.15.167:0/3856600837 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298005e70 con 0x7fc29c0c4510 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c14af30 con 0x7fc29c0c4510 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc291ffb640 1 -- 172.21.15.167:0/3856600837 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980072f0 con 0x7fc29c0c4510 2023-11-28T21:00:58.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c148bb0 con 0x7fc29c0c4510 2023-11-28T21:00:58.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c0682c0 con 0x7fc29c0c4510 2023-11-28T21:00:58.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.035+0000 7fc291ffb640 1 -- 172.21.15.167:0/3856600837 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc298007450 con 0x7fc29c0c4510 2023-11-28T21:00:58.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.039+0000 7fc291ffb640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc280066450 0x7fc280068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:00:58.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.039+0000 7fc291ffb640 1 -- 172.21.15.167:0/3856600837 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc298083860 con 0x7fc29c0c4510 2023-11-28T21:00:58.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.039+0000 7fc2a08c5640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc280066450 0x7fc280068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:00:58.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.039+0000 7fc2a08c5640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc280066450 0x7fc280068910 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0af000 tx=0x7fc28c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:00:58.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.043+0000 7fc291ffb640 1 -- 172.21.15.167:0/3856600837 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc298050860 con 0x7fc29c0c4510 2023-11-28T21:00:58.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.243+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc29c075c90 con 0x7fc29c0c4510 2023-11-28T21:00:58.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc291ffb640 1 -- 172.21.15.167:0/3856600837 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fc298017080 con 0x7fc29c0c4510 2023-11-28T21:00:58.248 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:00:58.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc280066450 msgr2=0x7fc280068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:58.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc280066450 0x7fc280068910 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0af000 tx=0x7fc28c008040 comp rx=0 tx=0).stop 2023-11-28T21:00:58.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c4510 msgr2=0x7fc29c1f08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:00:58.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c4510 0x7fc29c1f08f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc298007fd0 tx=0x7fc29800c890 comp rx=0 tx=0).stop 2023-11-28T21:00:58.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 shutdown_connections 2023-11-28T21:00:58.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc280066450 0x7fc280068910 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:58.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c150b40 0x7fc29c144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:58.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c0c6ff0 0x7fc29c141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:58.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 --2- 172.21.15.167:0/3856600837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc29c0c4510 0x7fc29c1f08f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:00:58.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 >> 172.21.15.167:0/3856600837 conn(0x7fc29c0cb1e0 msgr2=0x7fc29c0705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:00:58.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 shutdown_connections 2023-11-28T21:00:58.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:00:58.247+0000 7fc2a332a640 1 -- 172.21.15.167:0/3856600837 wait complete. 2023-11-28T21:00:59.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~106s 2023-11-28T21:01:01.270 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:01:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f40924f5640 1 Processor -- start 2023-11-28T21:01:01.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f40924f5640 1 -- start start 2023-11-28T21:01:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f40924f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c153db0 0x7f408c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f40924f5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f408c0ccb70 0x7f408c0c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f40924f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c0cfef0 con 0x7f408c0cf440 2023-11-28T21:01:01.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f40924f5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0cc6e0 con 0x7f408c0ccb70 2023-11-28T21:01:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f40924f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c154190 con 0x7f408c153db0 2023-11-28T21:01:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f4090cf2640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f408c0ccb70 msgr2=0x7f408c0c43d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f4090cf2640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f408c0ccb70 0x7f408c0c43d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f4091cf4640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f408c0cf440 0x7f408c0ca350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:46528/0 (socket says 172.21.15.167:46528) 2023-11-28T21:01:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f4091cf4640 1 -- 172.21.15.167:0/1140775153 learned_addr learned my addr 172.21.15.167:0/1140775153 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:01:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f40914f3640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c153db0 0x7f408c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460233512 0 0) 0x7f408c0cfef0 con 0x7f408c0cf440 2023-11-28T21:01:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4078003530 con 0x7f408c0cf440 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.415+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1696891747 0 0) 0x7f4078003530 con 0x7f408c0cf440 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c153db0 msgr2=0x7f408c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c153db0 0x7f408c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 >> v2:172.21.15.178:3300/0 conn(0x7f408c0ccb70 msgr2=0x7f408c0c43d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 --2- 172.21.15.167:0/1140775153 >> v2:172.21.15.178:3300/0 conn(0x7f408c0ccb70 0x7f408c0c43d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0c4910 con 0x7f408c0cf440 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f4084001a00 con 0x7f408c0cf440 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 >> v1:172.21.15.167:6789/0 conn(0x7f408c0cf440 legacy=0x7f408c0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4078003980 0x7f4078003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c153db0 0x7f40780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f4078005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0cc6e0 con 0x7f4078004d10 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c154190 con 0x7f4078003980 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407800ba10 con 0x7f408c153db0 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f40914f3640 1 -- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4078003980 msgr2=0x7f4078003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f40914f3640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4078003980 0x7f4078003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4091cf4640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f4078005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4090cf2640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c153db0 0x7f40780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4091cf4640 1 -- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c153db0 msgr2=0x7f40780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4091cf4640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c153db0 0x7f40780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4091cf4640 1 -- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4078003980 msgr2=0x7f4078003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4091cf4640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4078003980 0x7f4078003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4091cf4640 1 -- 172.21.15.167:0/1140775153 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4078003530 con 0x7f4078004d10 2023-11-28T21:01:01.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4091cf4640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f4078005190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f408400a830 tx=0x7f408401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a19f9cdf65e3a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:01.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840ad630 con 0x7f4078004d10 2023-11-28T21:01:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40840a8070 con 0x7f4078004d10 2023-11-28T21:01:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.419+0000 7f4083fff640 1 -- 172.21.15.167:0/1140775153 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840ad9f0 con 0x7f4078004d10 2023-11-28T21:01:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 -- 172.21.15.167:0/1140775153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 msgr2=0x7f4078005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 --2- 172.21.15.167:0/1140775153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f4078005190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f408400a830 tx=0x7f408401d340 comp rx=0 tx=0).stop 2023-11-28T21:01:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f4091cf4640 1 -- 172.21.15.167:0/1140775153 reap_dead start 2023-11-28T21:01:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 -- 172.21.15.167:0/1140775153 shutdown_connections 2023-11-28T21:01:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 -- 172.21.15.167:0/1140775153 >> 172.21.15.167:0/1140775153 conn(0x7f408c06b800 msgr2=0x7f408c06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 -- 172.21.15.167:0/1140775153 shutdown_connections 2023-11-28T21:01:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 -- 172.21.15.167:0/1140775153 wait complete. 2023-11-28T21:01:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 Processor -- start 2023-11-28T21:01:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 -- start start 2023-11-28T21:01:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f408c1efed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c1f0970 0x7f408c156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408c157310 0x7f408c0b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0c8ba0 con 0x7f4078004d10 2023-11-28T21:01:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1ef500 con 0x7f408c157310 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40924f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c1efa40 con 0x7f408c1f0970 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40914f3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f408c1efed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40914f3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f408c1efed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49852/0 (socket says 172.21.15.167:49852) 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40914f3640 1 -- 172.21.15.167:0/599251030 learned_addr learned my addr 172.21.15.167:0/599251030 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f4091cf4640 1 -- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408c157310 msgr2=0x7f408c0b3530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f4091cf4640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408c157310 0x7f408c0b3530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f4090cf2640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c1f0970 0x7f408c156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40914f3640 1 -- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c1f0970 msgr2=0x7f408c156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40914f3640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c1f0970 0x7f408c156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40914f3640 1 -- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408c157310 msgr2=0x7f408c0b3530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.423+0000 7f40914f3640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408c157310 0x7f408c0b3530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f40914f3640 1 -- 172.21.15.167:0/599251030 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c1595f0 con 0x7f4078004d10 2023-11-28T21:01:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f40914f3640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f408c1efed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f408800e930 tx=0x7f408800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f4081ffb640 1 -- 172.21.15.167:0/599251030 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088009650 con 0x7f4078004d10 2023-11-28T21:01:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f4081ffb640 1 -- 172.21.15.167:0/599251030 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800ca00 con 0x7f4078004d10 2023-11-28T21:01:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f4081ffb640 1 -- 172.21.15.167:0/599251030 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800cd90 con 0x7f4078004d10 2023-11-28T21:01:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c1ef6f0 con 0x7f4078004d10 2023-11-28T21:01:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c1f3760 con 0x7f4078004d10 2023-11-28T21:01:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c1ef880 con 0x7f4078004d10 2023-11-28T21:01:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f4081ffb640 1 -- 172.21.15.167:0/599251030 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4088013470 con 0x7f4078004d10 2023-11-28T21:01:01.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f4081ffb640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4070066450 0x7f4070068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:01.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.427+0000 7f4081ffb640 1 -- 172.21.15.167:0/599251030 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f40880843f0 con 0x7f4078004d10 2023-11-28T21:01:01.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.431+0000 7f4090cf2640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4070066450 0x7f4070068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:01.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.431+0000 7f4090cf2640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4070066450 0x7f4070068910 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f408c1f0d50 tx=0x7f407c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.431+0000 7f4081ffb640 1 -- 172.21.15.167:0/599251030 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f408c1ef880 con 0x7f4078004d10 2023-11-28T21:01:01.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f408c1ef880 con 0x7f4078004d10 2023-11-28T21:01:01.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f4081ffb640 1 -- 172.21.15.167:0/599251030 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f4088017630 con 0x7f4078004d10 2023-11-28T21:01:01.637 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:01:01.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4070066450 msgr2=0x7f4070068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:01.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4070066450 0x7f4070068910 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f408c1f0d50 tx=0x7f407c008040 comp rx=0 tx=0).stop 2023-11-28T21:01:01.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 msgr2=0x7f408c1efed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:01.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f408c1efed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f408800e930 tx=0x7f408800edf0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 shutdown_connections 2023-11-28T21:01:01.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f4070066450 0x7f4070068910 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408c157310 0x7f408c0b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f408c1f0970 0x7f408c156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 --2- 172.21.15.167:0/599251030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4078004d10 0x7f408c1efed0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:01.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 >> 172.21.15.167:0/599251030 conn(0x7f408c06b800 msgr2=0x7f408c0cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:01.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 shutdown_connections 2023-11-28T21:01:01.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:01.635+0000 7f40924f5640 1 -- 172.21.15.167:0/599251030 wait complete. 2023-11-28T21:01:04.659 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:01:04.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c8c32640 1 Processor -- start 2023-11-28T21:01:04.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c8c32640 1 -- start start 2023-11-28T21:01:04.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c8c32640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff1c40cfc40 0x7ff1c40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:04.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c8c32640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c415ac00 con 0x7ff1c4153ae0 2023-11-28T21:01:04.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c8c32640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c40cbd60 con 0x7ff1c40cf860 2023-11-28T21:01:04.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c8c32640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c4159ff0 con 0x7ff1c40cfc40 2023-11-28T21:01:04.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c259c640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7ff1c40cf860 legacy=0x7ff1c40ca510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:01:04.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c1d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff1c40cfc40 0x7ff1c40cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:04.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c1d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff1c40cfc40 0x7ff1c40cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58586/0 (socket says 172.21.15.167:58586) 2023-11-28T21:01:04.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c1d9b640 1 -- 172.21.15.167:0/3172523077 learned_addr learned my addr 172.21.15.167:0/3172523077 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:04.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c1d9b640 1 -- 172.21.15.167:0/3172523077 >> v1:172.21.15.178:6789/0 conn(0x7ff1c40cf860 legacy=0x7ff1c40ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:04.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c1d9b640 1 -- 172.21.15.167:0/3172523077 >> v1:172.21.15.167:6789/0 conn(0x7ff1c4153ae0 legacy=0x7ff1c415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:04.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.811+0000 7ff1c1d9b640 1 -- 172.21.15.167:0/3172523077 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c415a2d0 con 0x7ff1c40cfc40 2023-11-28T21:01:04.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c1d9b640 1 --2- 172.21.15.167:0/3172523077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c40cfc40 0x7ff1c40cb770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009870 tx=0x7ff1b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90866e9e91adc57 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:04.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c159a640 1 -- 172.21.15.167:0/3172523077 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b80aa430 con 0x7ff1c40cfc40 2023-11-28T21:01:04.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c159a640 1 -- 172.21.15.167:0/3172523077 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b80aa590 con 0x7ff1c40cfc40 2023-11-28T21:01:04.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c159a640 1 -- 172.21.15.167:0/3172523077 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b80aa920 con 0x7ff1c40cfc40 2023-11-28T21:01:04.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c8c32640 1 -- 172.21.15.167:0/3172523077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c40cfc40 msgr2=0x7ff1c40cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:04.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c8c32640 1 --2- 172.21.15.167:0/3172523077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c40cfc40 0x7ff1c40cb770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009870 tx=0x7ff1b801c4d0 comp rx=0 tx=0).stop 2023-11-28T21:01:04.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c8c32640 1 -- 172.21.15.167:0/3172523077 shutdown_connections 2023-11-28T21:01:04.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c8c32640 1 --2- 172.21.15.167:0/3172523077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c40cfc40 0x7ff1c40cb770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:04.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c8c32640 1 -- 172.21.15.167:0/3172523077 >> 172.21.15.167:0/3172523077 conn(0x7ff1c406c1f0 msgr2=0x7ff1c4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:04.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c8c32640 1 -- 172.21.15.167:0/3172523077 shutdown_connections 2023-11-28T21:01:04.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.815+0000 7ff1c8c32640 1 -- 172.21.15.167:0/3172523077 wait complete. 2023-11-28T21:01:04.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 Processor -- start 2023-11-28T21:01:04.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 -- start start 2023-11-28T21:01:04.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1c40cf860 0x7ff1c40b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:04.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1c40cfc40 0x7ff1c40b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c4153ae0 0x7ff1c40b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4147c20 con 0x7ff1c4153ae0 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c415cad0 con 0x7ff1c40cfc40 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40b4fb0 con 0x7ff1c40cf860 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c1d9b640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1c40cfc40 msgr2=0x7ff1c40b4a70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c1d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1c40cfc40 0x7ff1c40b4a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c2d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c4153ae0 0x7ff1c40b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c2d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c4153ae0 0x7ff1c40b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58592/0 (socket says 172.21.15.167:58592) 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c2d9d640 1 -- 172.21.15.167:0/2650276735 learned_addr learned my addr 172.21.15.167:0/2650276735 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c259c640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1c40cf860 0x7ff1c40b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c2d9d640 1 -- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1c40cf860 msgr2=0x7ff1c40b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:04.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c2d9d640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1c40cf860 0x7ff1c40b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c2d9d640 1 -- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1c40cfc40 msgr2=0x7ff1c40b4a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c2d9d640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1c40cfc40 0x7ff1c40b4a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c2d9d640 1 -- 172.21.15.167:0/2650276735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80094d0 con 0x7ff1c4153ae0 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c259c640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1c40cf860 0x7ff1c40b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c2d9d640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c4153ae0 0x7ff1c40b3660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00c7a0 tx=0x7ff1bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1b2ffd640 1 -- 172.21.15.167:0/2650276735 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc003b80 con 0x7ff1c4153ae0 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1b2ffd640 1 -- 172.21.15.167:0/2650276735 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc003ce0 con 0x7ff1c4153ae0 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c41f3b50 con 0x7ff1c4153ae0 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1b2ffd640 1 -- 172.21.15.167:0/2650276735 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00aa90 con 0x7ff1c4153ae0 2023-11-28T21:01:04.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c41f4080 con 0x7ff1c4153ae0 2023-11-28T21:01:04.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.819+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c4067c40 con 0x7ff1c4153ae0 2023-11-28T21:01:04.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.823+0000 7ff1b2ffd640 1 -- 172.21.15.167:0/2650276735 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1bc00abf0 con 0x7ff1c4153ae0 2023-11-28T21:01:04.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.823+0000 7ff1b2ffd640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1a4066420 0x7ff1a40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:04.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.823+0000 7ff1b2ffd640 1 -- 172.21.15.167:0/2650276735 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff1bc084150 con 0x7ff1c4153ae0 2023-11-28T21:01:04.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.823+0000 7ff1c259c640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1a4066420 0x7ff1a40688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:04.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.823+0000 7ff1c259c640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1a4066420 0x7ff1a40688e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4003940 tx=0x7ff1b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:04.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:04.827+0000 7ff1b2ffd640 1 -- 172.21.15.167:0/2650276735 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1bc051140 con 0x7ff1c4153ae0 2023-11-28T21:01:05.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff1c415cc40 con 0x7ff1c4153ae0 2023-11-28T21:01:05.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1b2ffd640 1 -- 172.21.15.167:0/2650276735 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7ff1c415cc40 con 0x7ff1c4153ae0 2023-11-28T21:01:05.029 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":174,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:01:05.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1a4066420 msgr2=0x7ff1a40688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:05.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1a4066420 0x7ff1a40688e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4003940 tx=0x7ff1b4008040 comp rx=0 tx=0).stop 2023-11-28T21:01:05.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c4153ae0 msgr2=0x7ff1c40b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:05.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c4153ae0 0x7ff1c40b3660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00c7a0 tx=0x7ff1bc00cc60 comp rx=0 tx=0).stop 2023-11-28T21:01:05.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 shutdown_connections 2023-11-28T21:01:05.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff1a4066420 0x7ff1a40688e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:05.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1c4153ae0 0x7ff1c40b3660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:05.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1c40cfc40 0x7ff1c40b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:05.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 --2- 172.21.15.167:0/2650276735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1c40cf860 0x7ff1c40b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:05.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 >> 172.21.15.167:0/2650276735 conn(0x7ff1c406c1f0 msgr2=0x7ff1c40c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:05.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 shutdown_connections 2023-11-28T21:01:05.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:05.031+0000 7ff1c8c32640 1 -- 172.21.15.167:0/2650276735 wait complete. 2023-11-28T21:01:06.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~113s 2023-11-28T21:01:08.051 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:01:08.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.199+0000 7fb896f96640 1 Processor -- start 2023-11-28T21:01:08.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.199+0000 7fb896f96640 1 -- start start 2023-11-28T21:01:08.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896f96640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:08.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896f96640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:08.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896f96640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900cfef0 con 0x7fb890153db0 2023-11-28T21:01:08.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896f96640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8900cc6e0 con 0x7fb8900cf440 2023-11-28T21:01:08.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896f96640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb890154190 con 0x7fb8900ccb70 2023-11-28T21:01:08.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb895f94640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7fb890153db0 legacy=0x7fb8900c43d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:01:08.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896795640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:08.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896795640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58606/0 (socket says 172.21.15.167:58606) 2023-11-28T21:01:08.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 learned_addr learned my addr 172.21.15.167:0/111334240 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:08.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 msgr2=0x7fb8900cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:01:08.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 msgr2=0x7fb8900cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:01:08.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:08.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:08.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:08.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 msgr2=0x7fb89015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:01:08.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 msgr2=0x7fb89015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:01:08.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:08.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.203+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb895f94640 1 -- 172.21.15.167:0/111334240 >> v1:172.21.15.178:6789/0 conn(0x7fb890153db0 legacy=0x7fb8900c43d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:01:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 msgr2=0x7fb8900cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:01:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 msgr2=0x7fb8900cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:01:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:01:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 msgr2=0x7fb89015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:01:08.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 msgr2=0x7fb89015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:01:08.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:08.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.407+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:01:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb895f94640 1 -- 172.21.15.167:0/111334240 >> v1:172.21.15.178:6789/0 conn(0x7fb890153db0 legacy=0x7fb8900c43d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:01:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 msgr2=0x7fb8900cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:01:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 msgr2=0x7fb8900cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:01:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:01:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 msgr2=0x7fb89015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:01:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 msgr2=0x7fb89015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:01:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:08.811+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:01:09.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb895f94640 1 -- 172.21.15.167:0/111334240 >> v1:172.21.15.178:6789/0 conn(0x7fb890153db0 legacy=0x7fb8900c43d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:01:09.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:09.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:09.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 msgr2=0x7fb8900cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:01:09.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 msgr2=0x7fb8900cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:01:09.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:09.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:01:09.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 msgr2=0x7fb89015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:01:09.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 msgr2=0x7fb89015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:01:09.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:09.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:09.615+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:01:11.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb8877fe640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 msgr2=0x7fb89015a540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:11.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb8877fe640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8900ccb70 0x7fb89015a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:11.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb8877fe640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 msgr2=0x7fb8900cf8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:11.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb8877fe640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.167:3300/0 conn(0x7fb8900cf440 0x7fb8900cf8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:11.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb8877fe640 1 -- 172.21.15.167:0/111334240 >> v1:172.21.15.178:6789/0 conn(0x7fb890153db0 legacy=0x7fb8900c43d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:11.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb8877fe640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 0x7fb874009800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:11.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb8877fe640 1 -- 172.21.15.167:0/111334240 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900cbad0 con 0x7fb874003690 2023-11-28T21:01:11.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb8877fe640 1 -- 172.21.15.167:0/111334240 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8900cc6e0 con 0x7fb874007340 2023-11-28T21:01:11.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 msgr2=0x7fb874009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:11.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.203+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 0x7fb874009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:11.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.407+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 msgr2=0x7fb874009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:11.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.407+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 0x7fb874009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:01:11.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.810+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 msgr2=0x7fb874009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:11.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:11.810+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 0x7fb874009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:01:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.614+0000 7fb895793640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 msgr2=0x7fb874009800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:12.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.614+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 0x7fb874009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:01:12.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~119s 2023-11-28T21:01:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16899473 0 0) 0x7fb8900cbad0 con 0x7fb874003690 2023-11-28T21:01:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb87c003530 con 0x7fb874003690 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1141654006 0 0) 0x7fb87c003530 con 0x7fb874003690 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 msgr2=0x7fb874009800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 --2- 172.21.15.167:0/111334240 >> v2:172.21.15.178:3300/0 conn(0x7fb874007340 0x7fb874009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8900cfef0 con 0x7fb874003690 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fb88c004250 con 0x7fb874003690 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 >> v1:172.21.15.167:6789/0 conn(0x7fb874003690 legacy=0x7fb874005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 reap_dead start 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb87c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0047d0 0x7fb87c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0052b0 0x7fb87c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900cc6e0 con 0x7fb87c003980 2023-11-28T21:01:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c00c200 con 0x7fb87c0052b0 2023-11-28T21:01:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c00c3c0 con 0x7fb87c0047d0 2023-11-28T21:01:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb895f94640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb87c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb896795640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0052b0 msgr2=0x7fb87c00b990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb896795640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0052b0 0x7fb87c00b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb895793640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0047d0 0x7fb87c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb895f94640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0047d0 msgr2=0x7fb87c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb895f94640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0047d0 0x7fb87c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:12.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb895f94640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0052b0 msgr2=0x7fb87c00b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb895f94640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0052b0 0x7fb87c00b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:12.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.826+0000 7fb895f94640 1 -- 172.21.15.167:0/111334240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c003530 con 0x7fb87c003980 2023-11-28T21:01:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb895f94640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb87c003d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb88c000eb0 tx=0x7fb88c01ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc8163e9f391bd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0a5a30 con 0x7fb87c003980 2023-11-28T21:01:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c0a5bb0 con 0x7fb87c003980 2023-11-28T21:01:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb894f92640 1 -- 172.21.15.167:0/111334240 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0ac320 con 0x7fb87c003980 2023-11-28T21:01:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb896f96640 1 -- 172.21.15.167:0/111334240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 msgr2=0x7fb87c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb896f96640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb87c003d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb88c000eb0 tx=0x7fb88c01ce10 comp rx=0 tx=0).stop 2023-11-28T21:01:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb896f96640 1 -- 172.21.15.167:0/111334240 shutdown_connections 2023-11-28T21:01:12.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb896f96640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0052b0 0x7fb87c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb896f96640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0047d0 0x7fb87c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb896f96640 1 --2- 172.21.15.167:0/111334240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb87c003d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb896f96640 1 -- 172.21.15.167:0/111334240 >> 172.21.15.167:0/111334240 conn(0x7fb89006b800 msgr2=0x7fb89006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb896f96640 1 -- 172.21.15.167:0/111334240 shutdown_connections 2023-11-28T21:01:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.830+0000 7fb896f96640 1 -- 172.21.15.167:0/111334240 wait complete. 2023-11-28T21:01:12.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb896f96640 1 Processor -- start 2023-11-28T21:01:12.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb896f96640 1 -- start start 2023-11-28T21:01:12.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb896f96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb8901527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:12.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb896f96640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0047d0 0x7fb8900c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:12.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb896f96640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0052b0 0x7fb8901f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:12.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb896f96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8901f5920 con 0x7fb87c003980 2023-11-28T21:01:12.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb896f96640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89015abf0 con 0x7fb87c0047d0 2023-11-28T21:01:12.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb896f96640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89015d4a0 con 0x7fb87c0052b0 2023-11-28T21:01:12.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895f94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb8901527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:12.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895793640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0047d0 msgr2=0x7fb8900c89b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:12.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895f94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb8901527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46496/0 (socket says 172.21.15.167:46496) 2023-11-28T21:01:12.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895f94640 1 -- 172.21.15.167:0/1043873027 learned_addr learned my addr 172.21.15.167:0/1043873027 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:12.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895793640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0047d0 0x7fb8900c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:12.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb896795640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0052b0 0x7fb8901f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:12.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895f94640 1 -- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0052b0 msgr2=0x7fb8901f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:12.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895f94640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0052b0 0x7fb8901f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:12.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895f94640 1 -- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0047d0 msgr2=0x7fb8900c89b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:01:12.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895f94640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0047d0 0x7fb8900c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:12.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.834+0000 7fb895f94640 1 -- 172.21.15.167:0/1043873027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89015d760 con 0x7fb87c003980 2023-11-28T21:01:12.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb895f94640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb8901527a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0ab040 tx=0x7fb87c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:12.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb8867fc640 1 -- 172.21.15.167:0/1043873027 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0b9660 con 0x7fb87c003980 2023-11-28T21:01:12.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb8867fc640 1 -- 172.21.15.167:0/1043873027 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c0b97e0 con 0x7fb87c003980 2023-11-28T21:01:12.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb8867fc640 1 -- 172.21.15.167:0/1043873027 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0b9b90 con 0x7fb87c003980 2023-11-28T21:01:12.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89015da40 con 0x7fb87c003980 2023-11-28T21:01:12.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8901f5b70 con 0x7fb87c003980 2023-11-28T21:01:12.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89004e850 con 0x7fb87c003980 2023-11-28T21:01:12.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb8867fc640 1 -- 172.21.15.167:0/1043873027 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb88c0ae430 con 0x7fb87c003980 2023-11-28T21:01:12.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb8867fc640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb874066a50 0x7fb874068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:12.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.838+0000 7fb8867fc640 1 -- 172.21.15.167:0/1043873027 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb88c11e1f0 con 0x7fb87c003980 2023-11-28T21:01:12.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.842+0000 7fb895793640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb874066a50 0x7fb874068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:12.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.842+0000 7fb895793640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb874066a50 0x7fb874068f10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb880006cf0 tx=0x7fb880006c40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:12.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:12.846+0000 7fb8867fc640 1 -- 172.21.15.167:0/1043873027 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb88c0eb310 con 0x7fb87c003980 2023-11-28T21:01:13.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.050+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb8900cae70 con 0x7fb87c003980 2023-11-28T21:01:13.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.050+0000 7fb8867fc640 1 -- 172.21.15.167:0/1043873027 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fb88c0f3e60 con 0x7fb87c003980 2023-11-28T21:01:13.051 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":178,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:01:13.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb874066a50 msgr2=0x7fb874068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb874066a50 0x7fb874068f10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb880006cf0 tx=0x7fb880006c40 comp rx=0 tx=0).stop 2023-11-28T21:01:13.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 msgr2=0x7fb8901527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb8901527a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0ab040 tx=0x7fb87c005800 comp rx=0 tx=0).stop 2023-11-28T21:01:13.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 shutdown_connections 2023-11-28T21:01:13.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb874066a50 0x7fb874068f10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb87c0052b0 0x7fb8901f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb87c0047d0 0x7fb8900c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 --2- 172.21.15.167:0/1043873027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb87c003980 0x7fb8901527a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 >> 172.21.15.167:0/1043873027 conn(0x7fb89006b800 msgr2=0x7fb89006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:13.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 shutdown_connections 2023-11-28T21:01:13.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.054+0000 7fb896f96640 1 -- 172.21.15.167:0/1043873027 wait complete. 2023-11-28T21:01:13.072 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T21:01:13.072 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T21:01:13.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:01:13.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608eff8640 1 Processor -- start 2023-11-28T21:01:13.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608eff8640 1 -- start start 2023-11-28T21:01:13.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608eff8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60880c6ff0 0x7f6088157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608eff8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f60880c4510 0x7f608806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608eff8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60880c4940 con 0x7f6088150b40 2023-11-28T21:01:13.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608eff8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60880c62f0 con 0x7f60880c4510 2023-11-28T21:01:13.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608eff8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60880c6ac0 con 0x7f60880c6ff0 2023-11-28T21:01:13.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608cd94640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f6088150b40 legacy=0x7f60880c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:01:13.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608d595640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f60880c4510 msgr2=0x7f608806a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:13.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f608d595640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f60880c4510 0x7f608806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:13.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f607ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60880c6ff0 0x7f6088157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f607ffff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60880c6ff0 0x7f6088157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:45490/0 (socket says 172.21.15.167:45490) 2023-11-28T21:01:13.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f607ffff640 1 -- 172.21.15.167:0/1243417616 learned_addr learned my addr 172.21.15.167:0/1243417616 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:13.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f607ffff640 1 -- 172.21.15.167:0/1243417616 >> v2:172.21.15.178:3300/0 conn(0x7f60880c4510 msgr2=0x7f608806a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:13.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f607ffff640 1 --2- 172.21.15.167:0/1243417616 >> v2:172.21.15.178:3300/0 conn(0x7f60880c4510 0x7f608806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f607ffff640 1 -- 172.21.15.167:0/1243417616 >> v1:172.21.15.178:6789/0 conn(0x7f6088150b40 legacy=0x7f60880c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:13.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.214+0000 7f607ffff640 1 -- 172.21.15.167:0/1243417616 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880c6500 con 0x7f60880c6ff0 2023-11-28T21:01:13.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f607ffff640 1 --2- 172.21.15.167:0/1243417616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60880c6ff0 0x7f6088157560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f607800bb10 tx=0x7f607801ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62c904a3eb7caf55 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f607f7fe640 1 -- 172.21.15.167:0/1243417616 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780a7a60 con 0x7f60880c6ff0 2023-11-28T21:01:13.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f607f7fe640 1 -- 172.21.15.167:0/1243417616 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60780a7bc0 con 0x7f60880c6ff0 2023-11-28T21:01:13.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f607f7fe640 1 -- 172.21.15.167:0/1243417616 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780af440 con 0x7f60880c6ff0 2023-11-28T21:01:13.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f608eff8640 1 -- 172.21.15.167:0/1243417616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60880c6ff0 msgr2=0x7f6088157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f608eff8640 1 --2- 172.21.15.167:0/1243417616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60880c6ff0 0x7f6088157560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f607800bb10 tx=0x7f607801ebc0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f608eff8640 1 -- 172.21.15.167:0/1243417616 shutdown_connections 2023-11-28T21:01:13.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f608eff8640 1 --2- 172.21.15.167:0/1243417616 >> v2:172.21.15.178:3300/0 conn(0x7f60880c4510 0x7f608806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f608eff8640 1 --2- 172.21.15.167:0/1243417616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60880c6ff0 0x7f6088157560 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f608eff8640 1 -- 172.21.15.167:0/1243417616 >> 172.21.15.167:0/1243417616 conn(0x7f60880cb1e0 msgr2=0x7f60880cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:13.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f608eff8640 1 -- 172.21.15.167:0/1243417616 shutdown_connections 2023-11-28T21:01:13.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.218+0000 7f608eff8640 1 -- 172.21.15.167:0/1243417616 wait complete. 2023-11-28T21:01:13.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 Processor -- start 2023-11-28T21:01:13.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 -- start start 2023-11-28T21:01:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60880c4510 0x7f608814be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60880c6ff0 0x7f60880c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6088150b40 0x7f608814abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60881f1fb0 con 0x7f60880c4510 2023-11-28T21:01:13.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608814a740 con 0x7f60880c6ff0 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60881f2200 con 0x7f6088150b40 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f607ffff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60880c6ff0 msgr2=0x7f60880c2840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f607ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60880c6ff0 0x7f60880c2840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608cd94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60880c4510 0x7f608814be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608cd94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60880c4510 0x7f608814be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46504/0 (socket says 172.21.15.167:46504) 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608cd94640 1 -- 172.21.15.167:0/1727880128 learned_addr learned my addr 172.21.15.167:0/1727880128 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608d595640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6088150b40 0x7f608814abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608cd94640 1 -- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6088150b40 msgr2=0x7f608814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608cd94640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6088150b40 0x7f608814abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608cd94640 1 -- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60880c6ff0 msgr2=0x7f60880c2840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608cd94640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60880c6ff0 0x7f60880c2840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608cd94640 1 -- 172.21.15.167:0/1727880128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607800b770 con 0x7f60880c4510 2023-11-28T21:01:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608cd94640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60880c4510 0x7f608814be20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f608400b530 tx=0x7f608400b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084003dd0 con 0x7f60880c4510 2023-11-28T21:01:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6084005070 con 0x7f60880c4510 2023-11-28T21:01:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608814a0f0 con 0x7f60880c4510 2023-11-28T21:01:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084005420 con 0x7f60880c4510 2023-11-28T21:01:13.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.222+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608815add0 con 0x7f60880c4510 2023-11-28T21:01:13.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f608eff8640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608814cb50 0x7f608814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6088074770 con 0x7f608814cb50 2023-11-28T21:01:13.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607ffff640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608814cb50 0x7f608814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607ffff640 1 -- 172.21.15.167:0/1727880128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6088157040 con 0x7f608814cb50 2023-11-28T21:01:13.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607ffff640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608814cb50 0x7f608814b110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f60880cc090 tx=0x7f607801b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6084005580 con 0x7f60880c4510 2023-11-28T21:01:13.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607d7fa640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6074066420 0x7f60740688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f60840840c0 con 0x7f60880c4510 2023-11-28T21:01:13.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780af440 con 0x7f608814cb50 2023-11-28T21:01:13.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f60780a7860 con 0x7f608814cb50 2023-11-28T21:01:13.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608814cb50 msgr2=0x7f608814b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607d7fa640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608814cb50 0x7f608814b110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f60880cc090 tx=0x7f607801b960 comp rx=0 tx=0).stop 2023-11-28T21:01:13.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608814cb50 msgr2=0x7f608814b110 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:13.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f607d7fa640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608814cb50 0x7f608814b110 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f60880cc090 tx=0x7f607801b960 comp rx=0 tx=0).stop 2023-11-28T21:01:13.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f608d595640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6074066420 0x7f60740688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.226+0000 7f608d595640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6074066420 0x7f60740688e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6080003bd0 tx=0x7f608000d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088147b20 0x7f6088147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608814a8b0 con 0x7f6088147b20 2023-11-28T21:01:13.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f607ffff640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088147b20 0x7f6088147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f607ffff640 1 -- 172.21.15.167:0/1727880128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f60880682c0 con 0x7f6088147b20 2023-11-28T21:01:13.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f607ffff640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088147b20 0x7f6088147f30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f607801f460 tx=0x7f607800b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780c4750 con 0x7f6088147b20 2023-11-28T21:01:13.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5114 (secure 0 0 0) 0x7f60780c48b0 con 0x7f6088147b20 2023-11-28T21:01:13.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088147b20 msgr2=0x7f6088147f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f607d7fa640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088147b20 0x7f6088147f30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f607801f460 tx=0x7f607800b450 comp rx=0 tx=0).stop 2023-11-28T21:01:13.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f607d7fa640 1 -- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088147b20 msgr2=0x7f6088147f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:13.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f607d7fa640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088147b20 0x7f6088147f30 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f607801f460 tx=0x7f607800b450 comp rx=0 tx=0).stop 2023-11-28T21:01:13.235 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:01:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 178, 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:01:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:01:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:01:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:01:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:01:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:01:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:01:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:01:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:01:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:01:13.246 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:13.247 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.248 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.249 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:01:13.250 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:01:13.251 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.252 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:01:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.253 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:01:13.253 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:01:13.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6074066420 msgr2=0x7f60740688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6074066420 0x7f60740688e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6080003bd0 tx=0x7f608000d040 comp rx=0 tx=0).stop 2023-11-28T21:01:13.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60880c4510 msgr2=0x7f608814be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 --2- 172.21.15.167:0/1727880128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60880c4510 0x7f608814be20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f608400b530 tx=0x7f608400b9f0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608d595640 1 -- 172.21.15.167:0/1727880128 reap_dead start 2023-11-28T21:01:13.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608d595640 1 -- 172.21.15.167:0/1727880128 reap_dead start 2023-11-28T21:01:13.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 shutdown_connections 2023-11-28T21:01:13.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 >> 172.21.15.167:0/1727880128 conn(0x7f60880cb1e0 msgr2=0x7f6088148bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:13.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 shutdown_connections 2023-11-28T21:01:13.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.234+0000 7f608eff8640 1 -- 172.21.15.167:0/1727880128 wait complete. 2023-11-28T21:01:13.256 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:01:13.256 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T21:01:13.256 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:01:13.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.394+0000 7f86ed8e3640 1 Processor -- start 2023-11-28T21:01:13.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.394+0000 7f86ed8e3640 1 -- start start 2023-11-28T21:01:13.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86ed8e3640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f86e8150b40 0x7f86e8157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86ed8e3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e80c6ff0 0x7f86e80c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86ed8e3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e80c6ac0 con 0x7f86e80c5be0 2023-11-28T21:01:13.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86ed8e3640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e80c6500 con 0x7f86e8150b40 2023-11-28T21:01:13.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86ed8e3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80c67e0 con 0x7f86e80c6ff0 2023-11-28T21:01:13.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86e6ffd640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f86e8150b40 msgr2=0x7f86e8157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:13.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86e6ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f86e8150b40 0x7f86e8157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:13.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86e77fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f86e80c5be0 0x7f86e806a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47280/0 (socket says 172.21.15.167:47280) 2023-11-28T21:01:13.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86e77fe640 1 -- 172.21.15.167:0/295989601 learned_addr learned my addr 172.21.15.167:0/295989601 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:01:13.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86de7fc640 1 --2- 172.21.15.167:0/295989601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e80c6ff0 0x7f86e80c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86e67fc640 1 -- 172.21.15.167:0/295989601 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460006769 0 0) 0x7f86e80c6ac0 con 0x7f86e80c5be0 2023-11-28T21:01:13.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86e67fc640 1 -- 172.21.15.167:0/295989601 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d4003530 con 0x7f86e80c5be0 2023-11-28T21:01:13.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86e67fc640 1 -- 172.21.15.167:0/295989601 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1038266593 0 0) 0x7f86d4003530 con 0x7f86e80c5be0 2023-11-28T21:01:13.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86de7fc640 1 -- 172.21.15.167:0/295989601 >> v2:172.21.15.178:3300/0 conn(0x7f86e8150b40 msgr2=0x7f86e8157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:13.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86de7fc640 1 --2- 172.21.15.167:0/295989601 >> v2:172.21.15.178:3300/0 conn(0x7f86e8150b40 0x7f86e8157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86de7fc640 1 -- 172.21.15.167:0/295989601 >> v1:172.21.15.167:6789/0 conn(0x7f86e80c5be0 legacy=0x7f86e806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.398+0000 7f86de7fc640 1 -- 172.21.15.167:0/295989601 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e8156a80 con 0x7f86e80c6ff0 2023-11-28T21:01:13.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86de7fc640 1 --2- 172.21.15.167:0/295989601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e80c6ff0 0x7f86e80c4510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86d00097c0 tx=0x7f86d001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c7b6df824f4b4ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86e67fc640 1 -- 172.21.15.167:0/295989601 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0001a00 con 0x7f86e80c6ff0 2023-11-28T21:01:13.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86e67fc640 1 -- 172.21.15.167:0/295989601 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d00a7050 con 0x7f86e80c6ff0 2023-11-28T21:01:13.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86e67fc640 1 -- 172.21.15.167:0/295989601 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00ab600 con 0x7f86e80c6ff0 2023-11-28T21:01:13.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 -- 172.21.15.167:0/295989601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e80c6ff0 msgr2=0x7f86e80c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 --2- 172.21.15.167:0/295989601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e80c6ff0 0x7f86e80c4510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86d00097c0 tx=0x7f86d001c390 comp rx=0 tx=0).stop 2023-11-28T21:01:13.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 -- 172.21.15.167:0/295989601 shutdown_connections 2023-11-28T21:01:13.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 --2- 172.21.15.167:0/295989601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e80c6ff0 0x7f86e80c4510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 --2- 172.21.15.167:0/295989601 >> v2:172.21.15.178:3300/0 conn(0x7f86e8150b40 0x7f86e8157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 -- 172.21.15.167:0/295989601 >> 172.21.15.167:0/295989601 conn(0x7f86e80cb1e0 msgr2=0x7f86e80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:13.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 -- 172.21.15.167:0/295989601 shutdown_connections 2023-11-28T21:01:13.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 -- 172.21.15.167:0/295989601 wait complete. 2023-11-28T21:01:13.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 Processor -- start 2023-11-28T21:01:13.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 -- start start 2023-11-28T21:01:13.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e80c5be0 0x7f86e81f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.402+0000 7f86ed8e3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e80c6ff0 0x7f86e815fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86ed8e3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8150b40 0x7f86e80c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86ed8e3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8159310 con 0x7f86e80c5be0 2023-11-28T21:01:13.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86ed8e3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80c9790 con 0x7f86e80c6ff0 2023-11-28T21:01:13.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86ed8e3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e81f6340 con 0x7f86e8150b40 2023-11-28T21:01:13.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86de7fc640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e80c6ff0 msgr2=0x7f86e815fdc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:01:13.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86de7fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e80c6ff0 0x7f86e815fdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:13.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e80c5be0 0x7f86e81f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e80c5be0 0x7f86e81f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46534/0 (socket says 172.21.15.167:46534) 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e6ffd640 1 -- 172.21.15.167:0/111578355 learned_addr learned my addr 172.21.15.167:0/111578355 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e77fe640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8150b40 0x7f86e80c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e6ffd640 1 -- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8150b40 msgr2=0x7f86e80c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e6ffd640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8150b40 0x7f86e80c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e6ffd640 1 -- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e80c6ff0 msgr2=0x7f86e815fdc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e6ffd640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e80c6ff0 0x7f86e815fdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e6ffd640 1 -- 172.21.15.167:0/111578355 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d0009420 con 0x7f86e80c5be0 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e6ffd640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e80c5be0 0x7f86e81f5460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86d800b530 tx=0x7f86d800b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8003dd0 con 0x7f86e80c5be0 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8005070 con 0x7f86e80c5be0 2023-11-28T21:01:13.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e81f5aa0 con 0x7f86e80c5be0 2023-11-28T21:01:13.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8005420 con 0x7f86e80c5be0 2023-11-28T21:01:13.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e81f6060 con 0x7f86e80c5be0 2023-11-28T21:01:13.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86ed8e3640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8157b30 0x7f86e8157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8074770 con 0x7f86e8157b30 2023-11-28T21:01:13.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86de7fc640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8157b30 0x7f86e8157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f86d8005580 con 0x7f86e80c5be0 2023-11-28T21:01:13.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86de7fc640 1 -- 172.21.15.167:0/111578355 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86e806ac90 con 0x7f86e8157b30 2023-11-28T21:01:13.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86de7fc640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8157b30 0x7f86e8157f10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f86e8070410 tx=0x7f86d0019130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.406+0000 7f86e4ff9640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86c8066420 0x7f86c80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.410+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f86d80841a0 con 0x7f86e80c5be0 2023-11-28T21:01:13.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.410+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0003a30 con 0x7f86e8157b30 2023-11-28T21:01:13.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.410+0000 7f86e77fe640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86c8066420 0x7f86c80688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.410+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f86d0003b90 con 0x7f86e8157b30 2023-11-28T21:01:13.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.410+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8157b30 msgr2=0x7f86e8157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.410+0000 7f86e4ff9640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8157b30 0x7f86e8157f10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f86e8070410 tx=0x7f86d0019130 comp rx=0 tx=0).stop 2023-11-28T21:01:13.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.410+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8157b30 msgr2=0x7f86e8157f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:13.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.410+0000 7f86e4ff9640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e8157b30 0x7f86e8157f10 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f86e8070410 tx=0x7f86d0019130 comp rx=0 tx=0).stop 2023-11-28T21:01:13.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.410+0000 7f86e77fe640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86c8066420 0x7f86c80688e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f86e81598e0 tx=0x7f86e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.414+0000 7f86ed8e3640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e81474c0 0x7f86e81478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:13.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.414+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80c9900 con 0x7f86e81474c0 2023-11-28T21:01:13.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.414+0000 7f86de7fc640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e81474c0 0x7f86e81478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:13.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.414+0000 7f86de7fc640 1 -- 172.21.15.167:0/111578355 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f86e80682c0 con 0x7f86e81474c0 2023-11-28T21:01:13.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86de7fc640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e81474c0 0x7f86e81478a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86d0000c10 tx=0x7f86d0009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:13.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00c4070 con 0x7f86e81474c0 2023-11-28T21:01:13.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4629 (secure 0 0 0) 0x7f86d0000e90 con 0x7f86e81474c0 2023-11-28T21:01:13.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e81474c0 msgr2=0x7f86e81478a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86e4ff9640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e81474c0 0x7f86e81478a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86d0000c10 tx=0x7f86d0009190 comp rx=0 tx=0).stop 2023-11-28T21:01:13.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86e4ff9640 1 -- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e81474c0 msgr2=0x7f86e81478a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:13.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86e4ff9640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86e81474c0 0x7f86e81478a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 178, 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:01:13.418 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:13.419 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:13.420 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:01:13.421 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:13.422 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.423 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:01:13.424 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:01:13.425 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:13.426 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.427 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.428 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:13.429 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:01:13.430 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:01:13.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86c8066420 msgr2=0x7f86c80688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86ed8e3640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86c8066420 0x7f86c80688e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f86e81598e0 tx=0x7f86e0009040 comp rx=0 tx=0).stop 2023-11-28T21:01:13.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e80c5be0 msgr2=0x7f86e81f5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:13.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86ed8e3640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e80c5be0 0x7f86e81f5460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86d800b530 tx=0x7f86d800b9f0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86e77fe640 1 -- 172.21.15.167:0/111578355 reap_dead start 2023-11-28T21:01:13.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 shutdown_connections 2023-11-28T21:01:13.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86ed8e3640 1 --2- 172.21.15.167:0/111578355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86e80c5be0 0x7f86e81f5460 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:13.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 >> 172.21.15.167:0/111578355 conn(0x7f86e80cb1e0 msgr2=0x7f86e806a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:13.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 shutdown_connections 2023-11-28T21:01:13.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:13.418+0000 7f86ed8e3640 1 -- 172.21.15.167:0/111578355 wait complete. 2023-11-28T21:01:13.436 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:01:13.436 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T21:01:19.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~126s 2023-11-28T21:01:22.356 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:22.361 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:26.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~133s 2023-11-28T21:01:32.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~140s 2023-11-28T21:01:33.935 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T21:01:33.935 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2023-11-28T21:01:33.935 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T21:01:33.936 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T21:01:33.943 INFO:tasks.ceph.mon.b:Started 2023-11-28T21:01:33.944 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:01:33.944 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:01:34.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a985a640 1 Processor -- start 2023-11-28T21:01:34.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a985a640 1 -- start start 2023-11-28T21:01:34.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a985a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f01a4070480 0x7f01a4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:34.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a985a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a41571d0 con 0x7f01a406e030 2023-11-28T21:01:34.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a985a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a4071a90 con 0x7f01a406e410 2023-11-28T21:01:34.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a985a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a40c70d0 con 0x7f01a4070480 2023-11-28T21:01:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f01a4070480 0x7f01a4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f01a4070480 0x7f01a4071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56404/0 (socket says 172.21.15.167:56404) 2023-11-28T21:01:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a27fc640 1 -- 172.21.15.167:0/1609090604 learned_addr learned my addr 172.21.15.167:0/1609090604 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a27fc640 1 -- 172.21.15.167:0/1609090604 >> v1:172.21.15.178:6789/0 conn(0x7f01a406e410 legacy=0x7f01a4160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a27fc640 1 -- 172.21.15.167:0/1609090604 >> v1:172.21.15.167:6789/0 conn(0x7f01a406e030 legacy=0x7f01a41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.094+0000 7f01a27fc640 1 -- 172.21.15.167:0/1609090604 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40c73b0 con 0x7f01a4070480 2023-11-28T21:01:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a27fc640 1 --2- 172.21.15.167:0/1609090604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a4070480 0x7f01a4071f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0198009870 tx=0x7f019801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed286ecc3e6b930 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a1ffb640 1 -- 172.21.15.167:0/1609090604 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980aa670 con 0x7f01a4070480 2023-11-28T21:01:34.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a1ffb640 1 -- 172.21.15.167:0/1609090604 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980aa7d0 con 0x7f01a4070480 2023-11-28T21:01:34.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a1ffb640 1 -- 172.21.15.167:0/1609090604 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980aab60 con 0x7f01a4070480 2023-11-28T21:01:34.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a985a640 1 -- 172.21.15.167:0/1609090604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a4070480 msgr2=0x7f01a4071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:34.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a985a640 1 --2- 172.21.15.167:0/1609090604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a4070480 0x7f01a4071f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0198009870 tx=0x7f019801c510 comp rx=0 tx=0).stop 2023-11-28T21:01:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a985a640 1 -- 172.21.15.167:0/1609090604 shutdown_connections 2023-11-28T21:01:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a985a640 1 --2- 172.21.15.167:0/1609090604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a4070480 0x7f01a4071f20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a985a640 1 -- 172.21.15.167:0/1609090604 >> 172.21.15.167:0/1609090604 conn(0x7f01a40cb1e0 msgr2=0x7f01a40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a985a640 1 -- 172.21.15.167:0/1609090604 shutdown_connections 2023-11-28T21:01:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a985a640 1 -- 172.21.15.167:0/1609090604 wait complete. 2023-11-28T21:01:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.098+0000 7f01a985a640 1 Processor -- start 2023-11-28T21:01:34.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 -- start start 2023-11-28T21:01:34.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a406e030 0x7f01a41ee910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a406e410 0x7f01a4144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a4070480 0x7f01a4145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a415a700 con 0x7f01a406e410 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a415a1f0 con 0x7f01a4070480 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a41eee50 con 0x7f01a406e030 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a406e410 0x7f01a4144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a406e410 0x7f01a4144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56412/0 (socket says 172.21.15.167:56412) 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a27fc640 1 -- 172.21.15.167:0/4267443798 learned_addr learned my addr 172.21.15.167:0/4267443798 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a37fe640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a4070480 0x7f01a4145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a2ffd640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a406e030 0x7f01a41ee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a37fe640 1 -- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a4070480 msgr2=0x7f01a4145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a37fe640 1 -- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a4070480 msgr2=0x7f01a4145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:01:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a37fe640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a4070480 0x7f01a4145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a37fe640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a4070480 0x7f01a4145780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a27fc640 1 -- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a406e030 msgr2=0x7f01a41ee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a27fc640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a406e030 0x7f01a41ee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a27fc640 1 -- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a4070480 msgr2=0x7f01a4145780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a27fc640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a4070480 0x7f01a4145780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a27fc640 1 -- 172.21.15.167:0/4267443798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980094d0 con 0x7f01a406e410 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a2ffd640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a406e030 0x7f01a41ee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a27fc640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a406e410 0x7f01a4144560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f019801a140 tx=0x7f019801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f018bfff640 1 -- 172.21.15.167:0/4267443798 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980b3800 con 0x7f01a406e410 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f018bfff640 1 -- 172.21.15.167:0/4267443798 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980b3980 con 0x7f01a406e410 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f018bfff640 1 -- 172.21.15.167:0/4267443798 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980b3d30 con 0x7f01a406e410 2023-11-28T21:01:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a4157950 con 0x7f01a406e410 2023-11-28T21:01:34.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a41f4060 con 0x7f01a406e410 2023-11-28T21:01:34.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.102+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a40682c0 con 0x7f01a406e410 2023-11-28T21:01:34.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.106+0000 7f018bfff640 1 -- 172.21.15.167:0/4267443798 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01980b2380 con 0x7f01a406e410 2023-11-28T21:01:34.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.106+0000 7f018bfff640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0190066470 0x7f0190068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:34.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.106+0000 7f018bfff640 1 -- 172.21.15.167:0/4267443798 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f019811ead0 con 0x7f01a406e410 2023-11-28T21:01:34.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.106+0000 7f01a2ffd640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0190066470 0x7f0190068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:34.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.106+0000 7f01a2ffd640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0190066470 0x7f0190068930 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0194007fd0 tx=0x7f0194009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:34.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.110+0000 7f018bfff640 1 -- 172.21.15.167:0/4267443798 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f01980ebb70 con 0x7f01a406e410 2023-11-28T21:01:34.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f01a41f3ec0 con 0x7f01a406e410 2023-11-28T21:01:34.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f018bfff640 1 -- 172.21.15.167:0/4267443798 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f01a41f3ec0 con 0x7f01a406e410 2023-11-28T21:01:34.313 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":178,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:01:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0190066470 msgr2=0x7f0190068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0190066470 0x7f0190068930 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0194007fd0 tx=0x7f0194009040 comp rx=0 tx=0).stop 2023-11-28T21:01:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a406e410 msgr2=0x7f01a4144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a406e410 0x7f01a4144560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f019801a140 tx=0x7f019801ad50 comp rx=0 tx=0).stop 2023-11-28T21:01:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 shutdown_connections 2023-11-28T21:01:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0190066470 0x7f0190068930 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a4070480 0x7f01a4145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:34.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a406e410 0x7f01a4144560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:34.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 --2- 172.21.15.167:0/4267443798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a406e030 0x7f01a41ee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:34.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 >> 172.21.15.167:0/4267443798 conn(0x7f01a40cb1e0 msgr2=0x7f01a40cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:34.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 shutdown_connections 2023-11-28T21:01:34.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:34.314+0000 7f01a985a640 1 -- 172.21.15.167:0/4267443798 wait complete. 2023-11-28T21:01:37.334 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:01:37.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.482+0000 7fe83e8fd640 1 Processor -- start 2023-11-28T21:01:37.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.482+0000 7fe83e8fd640 1 -- start start 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.482+0000 7fe83e8fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe83806e030 0x7fe8381500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.482+0000 7fe83e8fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe838072630 0x7fe8381505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.482+0000 7fe83e8fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8381571d0 con 0x7fe838070480 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.482+0000 7fe83e8fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe838071a90 con 0x7fe838072630 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.482+0000 7fe83e8fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8380c70d0 con 0x7fe83806e030 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.482+0000 7fe8377fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe838070480 0x7fe838071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56606/0 (socket says 172.21.15.167:56606) 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.482+0000 7fe8377fe640 1 -- 172.21.15.167:0/2539029487 learned_addr learned my addr 172.21.15.167:0/2539029487 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe837fff640 1 --2- 172.21.15.167:0/2539029487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe83806e030 0x7fe8381500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe83ce9a640 1 --2- 172.21.15.167:0/2539029487 >> v2:172.21.15.178:3300/0 conn(0x7fe838072630 0x7fe8381505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe836ffd640 1 -- 172.21.15.167:0/2539029487 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644831731 0 0) 0x7fe8381571d0 con 0x7fe838070480 2023-11-28T21:01:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe836ffd640 1 -- 172.21.15.167:0/2539029487 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe820003530 con 0x7fe838070480 2023-11-28T21:01:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe83ce9a640 1 -- 172.21.15.167:0/2539029487 >> v2:172.21.15.178:3300/0 conn(0x7fe838072630 msgr2=0x7fe8381505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:01:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe83ce9a640 1 -- 172.21.15.167:0/2539029487 >> v2:172.21.15.178:3300/0 conn(0x7fe838072630 msgr2=0x7fe8381505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:01:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe83ce9a640 1 --2- 172.21.15.167:0/2539029487 >> v2:172.21.15.178:3300/0 conn(0x7fe838072630 0x7fe8381505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:01:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe83ce9a640 1 --2- 172.21.15.167:0/2539029487 >> v2:172.21.15.178:3300/0 conn(0x7fe838072630 0x7fe8381505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe837fff640 1 -- 172.21.15.167:0/2539029487 >> v2:172.21.15.178:3300/0 conn(0x7fe838072630 msgr2=0x7fe8381505f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe837fff640 1 --2- 172.21.15.167:0/2539029487 >> v2:172.21.15.178:3300/0 conn(0x7fe838072630 0x7fe8381505f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe837fff640 1 -- 172.21.15.167:0/2539029487 >> v1:172.21.15.167:6789/0 conn(0x7fe838070480 legacy=0x7fe838071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe836ffd640 1 -- 172.21.15.167:0/2539029487 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303558609 0 0) 0x7fe820003530 con 0x7fe838070480 2023-11-28T21:01:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe837fff640 1 -- 172.21.15.167:0/2539029487 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8380c73b0 con 0x7fe83806e030 2023-11-28T21:01:37.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.486+0000 7fe837fff640 1 --2- 172.21.15.167:0/2539029487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe83806e030 0x7fe8381500b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe8280097c0 tx=0x7fe82801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e948d95c364caa05 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:37.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe836ffd640 1 -- 172.21.15.167:0/2539029487 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c001680 con 0x7fe83806e030 2023-11-28T21:01:37.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe836ffd640 1 -- 172.21.15.167:0/2539029487 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8280a7050 con 0x7fe83806e030 2023-11-28T21:01:37.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe836ffd640 1 -- 172.21.15.167:0/2539029487 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8280ab600 con 0x7fe83806e030 2023-11-28T21:01:37.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 -- 172.21.15.167:0/2539029487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe83806e030 msgr2=0x7fe8381500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:37.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 --2- 172.21.15.167:0/2539029487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe83806e030 0x7fe8381500b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe8280097c0 tx=0x7fe82801c370 comp rx=0 tx=0).stop 2023-11-28T21:01:37.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 -- 172.21.15.167:0/2539029487 shutdown_connections 2023-11-28T21:01:37.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 --2- 172.21.15.167:0/2539029487 >> v2:172.21.15.178:3300/0 conn(0x7fe838072630 0x7fe8381505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 --2- 172.21.15.167:0/2539029487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe83806e030 0x7fe8381500b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 -- 172.21.15.167:0/2539029487 >> 172.21.15.167:0/2539029487 conn(0x7fe8380cb1e0 msgr2=0x7fe8380cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:37.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 -- 172.21.15.167:0/2539029487 shutdown_connections 2023-11-28T21:01:37.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 -- 172.21.15.167:0/2539029487 wait complete. 2023-11-28T21:01:37.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 Processor -- start 2023-11-28T21:01:37.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 -- start start 2023-11-28T21:01:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe83806e030 0x7fe838145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe838070480 0x7fe838146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe838072630 0x7fe8381f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe838155b20 con 0x7fe838072630 2023-11-28T21:01:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83813b030 con 0x7fe83806e030 2023-11-28T21:01:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83e8fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83813b290 con 0x7fe838070480 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83ce9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe838072630 0x7fe8381f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83ce9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe838072630 0x7fe8381f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56426/0 (socket says 172.21.15.167:56426) 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.490+0000 7fe83ce9a640 1 -- 172.21.15.167:0/543839713 learned_addr learned my addr 172.21.15.167:0/543839713 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe8377fe640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe838070480 0x7fe838146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe837fff640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe83806e030 0x7fe838145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe83ce9a640 1 -- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe838070480 msgr2=0x7fe838146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe83ce9a640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe838070480 0x7fe838146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe83ce9a640 1 -- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe83806e030 msgr2=0x7fe838145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe83ce9a640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe83806e030 0x7fe838145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe83ce9a640 1 -- 172.21.15.167:0/543839713 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828009420 con 0x7fe838072630 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe8377fe640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe838070480 0x7fe838146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:01:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe83ce9a640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe838072630 0x7fe8381f43f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe830007cf0 tx=0x7fe83000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:37.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe834ff9640 1 -- 172.21.15.167:0/543839713 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830014420 con 0x7fe838072630 2023-11-28T21:01:37.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe834ff9640 1 -- 172.21.15.167:0/543839713 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8300145a0 con 0x7fe838072630 2023-11-28T21:01:37.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe834ff9640 1 -- 172.21.15.167:0/543839713 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830014950 con 0x7fe838072630 2023-11-28T21:01:37.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83813b570 con 0x7fe838072630 2023-11-28T21:01:37.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe838145540 con 0x7fe838072630 2023-11-28T21:01:37.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8380682c0 con 0x7fe838072630 2023-11-28T21:01:37.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe834ff9640 1 -- 172.21.15.167:0/543839713 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe830014ab0 con 0x7fe838072630 2023-11-28T21:01:37.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe834ff9640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe824066470 0x7fe824068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:37.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.494+0000 7fe834ff9640 1 -- 172.21.15.167:0/543839713 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe830084c60 con 0x7fe838072630 2023-11-28T21:01:37.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.498+0000 7fe837fff640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe824066470 0x7fe824068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:37.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.498+0000 7fe837fff640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe824066470 0x7fe824068930 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe8280ad000 tx=0x7fe828008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:37.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.498+0000 7fe834ff9640 1 -- 172.21.15.167:0/543839713 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe830051bc0 con 0x7fe838072630 2023-11-28T21:01:37.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.702+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe838075c90 con 0x7fe838072630 2023-11-28T21:01:37.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.702+0000 7fe834ff9640 1 -- 172.21.15.167:0/543839713 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fe8300551e0 con 0x7fe838072630 2023-11-28T21:01:37.703 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":178,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:01:37.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe824066470 msgr2=0x7fe824068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:37.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe824066470 0x7fe824068930 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe8280ad000 tx=0x7fe828008040 comp rx=0 tx=0).stop 2023-11-28T21:01:37.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe838072630 msgr2=0x7fe8381f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:37.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe838072630 0x7fe8381f43f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe830007cf0 tx=0x7fe83000e4b0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 shutdown_connections 2023-11-28T21:01:37.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe824066470 0x7fe824068930 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe838072630 0x7fe8381f43f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe838070480 0x7fe838146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 --2- 172.21.15.167:0/543839713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe83806e030 0x7fe838145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:37.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 >> 172.21.15.167:0/543839713 conn(0x7fe8380cb1e0 msgr2=0x7fe83814e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:37.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 shutdown_connections 2023-11-28T21:01:37.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:37.706+0000 7fe83e8fd640 1 -- 172.21.15.167:0/543839713 wait complete. 2023-11-28T21:01:40.724 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:01:40.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~147s 2023-11-28T21:01:40.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90f669e640 1 Processor -- start 2023-11-28T21:01:40.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90f669e640 1 -- start start 2023-11-28T21:01:40.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90f669e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90f0150b40 0x7f90f0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90f669e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c6ff0 0x7f90f00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90f669e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f00c6ac0 con 0x7f90f00c5be0 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90f669e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f00c6500 con 0x7f90f0150b40 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90f669e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00c67e0 con 0x7f90f00c6ff0 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90f4c3b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f90f00c5be0 0x7f90f006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56618/0 (socket says 172.21.15.167:56618) 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90f4c3b640 1 -- 172.21.15.167:0/2052645838 learned_addr learned my addr 172.21.15.167:0/2052645838 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90effff640 1 --2- 172.21.15.167:0/2052645838 >> v2:172.21.15.178:3300/0 conn(0x7f90f0150b40 0x7f90f0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90ef7fe640 1 --2- 172.21.15.167:0/2052645838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c6ff0 0x7f90f00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90eeffd640 1 -- 172.21.15.167:0/2052645838 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068209378 0 0) 0x7f90f00c6ac0 con 0x7f90f00c5be0 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90eeffd640 1 -- 172.21.15.167:0/2052645838 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d8003530 con 0x7f90f00c5be0 2023-11-28T21:01:40.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90effff640 1 -- 172.21.15.167:0/2052645838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c6ff0 msgr2=0x7f90f00c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:40.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90effff640 1 --2- 172.21.15.167:0/2052645838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c6ff0 0x7f90f00c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:40.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90effff640 1 -- 172.21.15.167:0/2052645838 >> v1:172.21.15.167:6789/0 conn(0x7f90f00c5be0 legacy=0x7f90f006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:40.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.874+0000 7f90effff640 1 -- 172.21.15.167:0/2052645838 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f0156a80 con 0x7f90f0150b40 2023-11-28T21:01:40.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.878+0000 7f90effff640 1 --2- 172.21.15.167:0/2052645838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f0150b40 0x7f90f0157560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f90e000ba60 tx=0x7f90e001eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ae9297f57a403ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:40.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.878+0000 7f90eeffd640 1 -- 172.21.15.167:0/2052645838 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00a7af0 con 0x7f90f0150b40 2023-11-28T21:01:40.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.878+0000 7f90eeffd640 1 -- 172.21.15.167:0/2052645838 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e00a7c50 con 0x7f90f0150b40 2023-11-28T21:01:40.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.878+0000 7f90eeffd640 1 -- 172.21.15.167:0/2052645838 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00af440 con 0x7f90f0150b40 2023-11-28T21:01:40.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 -- 172.21.15.167:0/2052645838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f0150b40 msgr2=0x7f90f0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:40.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 --2- 172.21.15.167:0/2052645838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f0150b40 0x7f90f0157560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f90e000ba60 tx=0x7f90e001eb20 comp rx=0 tx=0).stop 2023-11-28T21:01:40.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 -- 172.21.15.167:0/2052645838 shutdown_connections 2023-11-28T21:01:40.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 --2- 172.21.15.167:0/2052645838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c6ff0 0x7f90f00c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:40.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 --2- 172.21.15.167:0/2052645838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f0150b40 0x7f90f0157560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 -- 172.21.15.167:0/2052645838 >> 172.21.15.167:0/2052645838 conn(0x7f90f00cb1e0 msgr2=0x7f90f00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 -- 172.21.15.167:0/2052645838 shutdown_connections 2023-11-28T21:01:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 -- 172.21.15.167:0/2052645838 wait complete. 2023-11-28T21:01:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 Processor -- start 2023-11-28T21:01:40.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 -- start start 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c5be0 0x7f90f00ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90f00c6ff0 0x7f90f015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f0150b40 0x7f90f015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00c2340 con 0x7f90f00c6ff0 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0158b50 con 0x7f90f0150b40 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f669e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0157c60 con 0x7f90f00c5be0 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90ef7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90f00c6ff0 0x7f90f015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90ef7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90f00c6ff0 0x7f90f015a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56428/0 (socket says 172.21.15.167:56428) 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90ef7fe640 1 -- 172.21.15.167:0/3237262918 learned_addr learned my addr 172.21.15.167:0/3237262918 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:40.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90effff640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c5be0 0x7f90f00ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90f4c3b640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f0150b40 0x7f90f015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90ef7fe640 1 -- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c5be0 msgr2=0x7f90f00ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90ef7fe640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c5be0 0x7f90f00ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90ef7fe640 1 -- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f0150b40 msgr2=0x7f90f015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90ef7fe640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f0150b40 0x7f90f015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.882+0000 7f90ef7fe640 1 -- 172.21.15.167:0/3237262918 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e000b6c0 con 0x7f90f00c6ff0 2023-11-28T21:01:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90ef7fe640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90f00c6ff0 0x7f90f015a4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e930 tx=0x7f90e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:40.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90ecff9640 1 -- 172.21.15.167:0/3237262918 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4009690 con 0x7f90f00c6ff0 2023-11-28T21:01:40.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90ecff9640 1 -- 172.21.15.167:0/3237262918 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e400ca00 con 0x7f90f00c6ff0 2023-11-28T21:01:40.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f0157f40 con 0x7f90f00c6ff0 2023-11-28T21:01:40.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90ecff9640 1 -- 172.21.15.167:0/3237262918 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e400cd70 con 0x7f90f00c6ff0 2023-11-28T21:01:40.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f0158500 con 0x7f90f00c6ff0 2023-11-28T21:01:40.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f00682c0 con 0x7f90f00c6ff0 2023-11-28T21:01:40.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90ecff9640 1 -- 172.21.15.167:0/3237262918 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90e4013470 con 0x7f90f00c6ff0 2023-11-28T21:01:40.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90ecff9640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90dc0664a0 0x7f90dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:40.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90ecff9640 1 -- 172.21.15.167:0/3237262918 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f90e4084490 con 0x7f90f00c6ff0 2023-11-28T21:01:40.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.886+0000 7f90effff640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90dc0664a0 0x7f90dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:40.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.890+0000 7f90effff640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90dc0664a0 0x7f90dc068960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f90e00b1000 tx=0x7f90e00a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:40.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:40.890+0000 7f90ecff9640 1 -- 172.21.15.167:0/3237262918 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90e40515f0 con 0x7f90f00c6ff0 2023-11-28T21:01:41.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.094+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f90f0158ce0 con 0x7f90f00c6ff0 2023-11-28T21:01:41.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.094+0000 7f90ecff9640 1 -- 172.21.15.167:0/3237262918 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f90e4017620 con 0x7f90f00c6ff0 2023-11-28T21:01:41.095 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:01:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90dc0664a0 msgr2=0x7f90dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90dc0664a0 0x7f90dc068960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f90e00b1000 tx=0x7f90e00a9070 comp rx=0 tx=0).stop 2023-11-28T21:01:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90f00c6ff0 msgr2=0x7f90f015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90f00c6ff0 0x7f90f015a4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e930 tx=0x7f90e400edf0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 shutdown_connections 2023-11-28T21:01:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f90dc0664a0 0x7f90dc068960 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f0150b40 0x7f90f015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90f00c6ff0 0x7f90f015a4c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 --2- 172.21.15.167:0/3237262918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f00c5be0 0x7f90f00ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 >> 172.21.15.167:0/3237262918 conn(0x7f90f00cb1e0 msgr2=0x7f90f0155240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 shutdown_connections 2023-11-28T21:01:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.098+0000 7f90f669e640 1 -- 172.21.15.167:0/3237262918 wait complete. 2023-11-28T21:01:41.116 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:01:41.116 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T21:01:41.116 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:01:41.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.254+0000 7f29ce8c9640 1 Processor -- start 2023-11-28T21:01:41.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.254+0000 7f29ce8c9640 1 -- start start 2023-11-28T21:01:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29ce8c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c806e030 0x7f29c81500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29ce8c9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f29c8070480 0x7f29c81505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29ce8c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29c806e410 0x7f29c8071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29ce8c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c81571d0 con 0x7f29c806e410 2023-11-28T21:01:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29ce8c9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c8071a90 con 0x7f29c8070480 2023-11-28T21:01:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29ce8c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80c70d0 con 0x7f29c806e030 2023-11-28T21:01:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29cce66640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29c806e410 0x7f29c8071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29cce66640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29c806e410 0x7f29c8071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56442/0 (socket says 172.21.15.167:56442) 2023-11-28T21:01:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29cce66640 1 -- 172.21.15.167:0/706385735 learned_addr learned my addr 172.21.15.167:0/706385735 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29c7fff640 1 --2- 172.21.15.167:0/706385735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c806e030 0x7f29c81500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29c77fe640 1 --2- 172.21.15.167:0/706385735 >> v2:172.21.15.178:3300/0 conn(0x7f29c8070480 0x7f29c81505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29cce66640 1 -- 172.21.15.167:0/706385735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c806e030 msgr2=0x7f29c81500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29cce66640 1 --2- 172.21.15.167:0/706385735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c806e030 0x7f29c81500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29cce66640 1 -- 172.21.15.167:0/706385735 >> v2:172.21.15.178:3300/0 conn(0x7f29c8070480 msgr2=0x7f29c81505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29cce66640 1 --2- 172.21.15.167:0/706385735 >> v2:172.21.15.178:3300/0 conn(0x7f29c8070480 0x7f29c81505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29cce66640 1 -- 172.21.15.167:0/706385735 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c80c73b0 con 0x7f29c806e410 2023-11-28T21:01:41.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.258+0000 7f29cce66640 1 --2- 172.21.15.167:0/706385735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 0x7f29c8071f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29c806fe60 tx=0x7f29c001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61a83ce951f7cc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29c6ffd640 1 -- 172.21.15.167:0/706385735 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c00a5820 con 0x7f29c806e410 2023-11-28T21:01:41.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29c6ffd640 1 -- 172.21.15.167:0/706385735 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c00a5980 con 0x7f29c806e410 2023-11-28T21:01:41.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29c6ffd640 1 -- 172.21.15.167:0/706385735 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c00a5d10 con 0x7f29c806e410 2023-11-28T21:01:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 -- 172.21.15.167:0/706385735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 msgr2=0x7f29c8071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 --2- 172.21.15.167:0/706385735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 0x7f29c8071f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29c806fe60 tx=0x7f29c001c9a0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 -- 172.21.15.167:0/706385735 shutdown_connections 2023-11-28T21:01:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 --2- 172.21.15.167:0/706385735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 0x7f29c8071f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 --2- 172.21.15.167:0/706385735 >> v2:172.21.15.178:3300/0 conn(0x7f29c8070480 0x7f29c81505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 --2- 172.21.15.167:0/706385735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c806e030 0x7f29c81500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 -- 172.21.15.167:0/706385735 >> 172.21.15.167:0/706385735 conn(0x7f29c80cb1e0 msgr2=0x7f29c80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:41.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 -- 172.21.15.167:0/706385735 shutdown_connections 2023-11-28T21:01:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 -- 172.21.15.167:0/706385735 wait complete. 2023-11-28T21:01:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 Processor -- start 2023-11-28T21:01:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 -- start start 2023-11-28T21:01:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c806e030 0x7f29c8155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 0x7f29c80ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c8070480 0x7f29c81f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80ca160 con 0x7f29c806e410 2023-11-28T21:01:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c81560a0 con 0x7f29c806e030 2023-11-28T21:01:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29ce8c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80c90c0 con 0x7f29c8070480 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29c77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 0x7f29c80ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29c77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 0x7f29c80ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56450/0 (socket says 172.21.15.167:56450) 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29c77fe640 1 -- 172.21.15.167:0/2288747642 learned_addr learned my addr 172.21.15.167:0/2288747642 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29c7fff640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c806e030 0x7f29c8155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.262+0000 7f29cce66640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c8070480 0x7f29c81f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c77fe640 1 -- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c8070480 msgr2=0x7f29c81f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c77fe640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c8070480 0x7f29c81f6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c77fe640 1 -- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c806e030 msgr2=0x7f29c8155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c77fe640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c806e030 0x7f29c8155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c77fe640 1 -- 172.21.15.167:0/2288747642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0009b30 con 0x7f29c806e410 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c77fe640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 0x7f29c80ca5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00d620 tx=0x7f29bc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00b620 con 0x7f29c806e410 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00b780 con 0x7f29c806e410 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00bb10 con 0x7f29c806e410 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c80c9e30 con 0x7f29c806e410 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c80c9340 con 0x7f29c806e410 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29ce8c9640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c80cab30 0x7f29c81f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8074770 con 0x7f29c80cab30 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c7fff640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c80cab30 0x7f29c81f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c7fff640 1 -- 172.21.15.167:0/2288747642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29c806ba40 con 0x7f29c80cab30 2023-11-28T21:01:41.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c7fff640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c80cab30 0x7f29c81f36b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f29b800b6e0 tx=0x7f29b800bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b80108a0 con 0x7f29c80cab30 2023-11-28T21:01:41.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29bc00bc70 con 0x7f29c806e410 2023-11-28T21:01:41.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c4ff9640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29b4066540 0x7f29b4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.266+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f29bc0845f0 con 0x7f29c806e410 2023-11-28T21:01:41.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.270+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f29b8010a00 con 0x7f29c80cab30 2023-11-28T21:01:41.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.270+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c80cab30 msgr2=0x7f29c81f36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.270+0000 7f29c4ff9640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c80cab30 0x7f29c81f36b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f29b800b6e0 tx=0x7f29b800bba0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.270+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c80cab30 msgr2=0x7f29c81f36b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:41.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.270+0000 7f29c4ff9640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c80cab30 0x7f29c81f36b0 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f29b800b6e0 tx=0x7f29b800bba0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.270+0000 7f29cce66640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29b4066540 0x7f29b4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.270+0000 7f29cce66640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29b4066540 0x7f29b4068a00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f29c00ae000 tx=0x7f29c00a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29ce8c9640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c8072460 0x7f29c81f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80682c0 con 0x7f29c8072460 2023-11-28T21:01:41.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29c7fff640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c8072460 0x7f29c81f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29c7fff640 1 -- 172.21.15.167:0/2288747642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f29c80ca310 con 0x7f29c8072460 2023-11-28T21:01:41.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29c7fff640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c8072460 0x7f29c81f6560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29b800b6e0 tx=0x7f29b8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8022040 con 0x7f29c8072460 2023-11-28T21:01:41.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5125 (secure 0 0 0) 0x7f29b8014430 con 0x7f29c8072460 2023-11-28T21:01:41.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c8072460 msgr2=0x7f29c81f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29c4ff9640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c8072460 0x7f29c81f6560 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29b800b6e0 tx=0x7f29b8004740 comp rx=0 tx=0).stop 2023-11-28T21:01:41.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29c4ff9640 1 -- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c8072460 msgr2=0x7f29c81f6560 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:41.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.274+0000 7f29c4ff9640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c8072460 0x7f29c81f6560 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29b800b6e0 tx=0x7f29b8004740 comp rx=0 tx=0).stop 2023-11-28T21:01:41.276 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:01:41.276 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:41.276 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:41.276 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 180, 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:41.277 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:41.278 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:01:41.279 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:41.280 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:01:41.281 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.282 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.283 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:41.284 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:41.285 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.286 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.287 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.288 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:41.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:01:41.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.291 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.291 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:01:41.291 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29b4066540 msgr2=0x7f29b4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29ce8c9640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29b4066540 0x7f29b4068a00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f29c00ae000 tx=0x7f29c00a7070 comp rx=0 tx=0).stop 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 msgr2=0x7f29c80ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29ce8c9640 1 --2- 172.21.15.167:0/2288747642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c806e410 0x7f29c80ca5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00d620 tx=0x7f29bc00dae0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29cce66640 1 -- 172.21.15.167:0/2288747642 reap_dead start 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29cce66640 1 -- 172.21.15.167:0/2288747642 reap_dead start 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 shutdown_connections 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 >> 172.21.15.167:0/2288747642 conn(0x7f29c80cb1e0 msgr2=0x7f29c8161480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 shutdown_connections 2023-11-28T21:01:41.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.278+0000 7f29ce8c9640 1 -- 172.21.15.167:0/2288747642 wait complete. 2023-11-28T21:01:41.294 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:01:41.294 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T21:01:41.294 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:01:41.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.434+0000 7f74219f8640 1 Processor -- start 2023-11-28T21:01:41.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.434+0000 7f74219f8640 1 -- start start 2023-11-28T21:01:41.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f74219f8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f741c0c86f0 0x7f741c0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f74219f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c74b0 0x7f741c15d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f74219f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c15ad50 con 0x7f741c154120 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f74219f8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c154500 con 0x7f741c0c86f0 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f74219f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c159ef0 con 0x7f741c0c74b0 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f741a7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f741c0c86f0 0x7f741c0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f741a7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f741c0c86f0 0x7f741c0c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56476/0 (socket says 172.21.15.167:56476) 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f741a7fc640 1 -- 172.21.15.167:0/4144762516 learned_addr learned my addr 172.21.15.167:0/4144762516 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f741b7fe640 1 --2- 172.21.15.167:0/4144762516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c74b0 0x7f741c15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f741a7fc640 1 -- 172.21.15.167:0/4144762516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c74b0 msgr2=0x7f741c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f741a7fc640 1 --2- 172.21.15.167:0/4144762516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c74b0 0x7f741c15d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f741a7fc640 1 -- 172.21.15.167:0/4144762516 >> v1:172.21.15.167:6789/0 conn(0x7f741c154120 legacy=0x7f741c0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.438+0000 7f741a7fc640 1 -- 172.21.15.167:0/4144762516 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c15a1d0 con 0x7f741c0c86f0 2023-11-28T21:01:41.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f741a7fc640 1 --2- 172.21.15.167:0/4144762516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c86f0 0x7f741c0c6f70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f741001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16d49d536632059 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f7419ffb640 1 -- 172.21.15.167:0/4144762516 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100ab620 con 0x7f741c0c86f0 2023-11-28T21:01:41.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f7419ffb640 1 -- 172.21.15.167:0/4144762516 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74100ab780 con 0x7f741c0c86f0 2023-11-28T21:01:41.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f7419ffb640 1 -- 172.21.15.167:0/4144762516 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100abb10 con 0x7f741c0c86f0 2023-11-28T21:01:41.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 -- 172.21.15.167:0/4144762516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c86f0 msgr2=0x7f741c0c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 --2- 172.21.15.167:0/4144762516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c86f0 0x7f741c0c6f70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f741001c510 comp rx=0 tx=0).stop 2023-11-28T21:01:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 -- 172.21.15.167:0/4144762516 shutdown_connections 2023-11-28T21:01:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 --2- 172.21.15.167:0/4144762516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c86f0 0x7f741c0c6f70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 --2- 172.21.15.167:0/4144762516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c74b0 0x7f741c15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 -- 172.21.15.167:0/4144762516 >> 172.21.15.167:0/4144762516 conn(0x7f741c0cc300 msgr2=0x7f741c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 -- 172.21.15.167:0/4144762516 shutdown_connections 2023-11-28T21:01:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 -- 172.21.15.167:0/4144762516 wait complete. 2023-11-28T21:01:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 Processor -- start 2023-11-28T21:01:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 -- start start 2023-11-28T21:01:41.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.442+0000 7f74219f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c74b0 0x7f741c1460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f74219f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c86f0 0x7f741c158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f74219f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c154120 0x7f741c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f74219f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c158640 con 0x7f741c0c74b0 2023-11-28T21:01:41.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f74219f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c5e50 con 0x7f741c0c86f0 2023-11-28T21:01:41.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f74219f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c1f6f70 con 0x7f741c154120 2023-11-28T21:01:41.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c74b0 0x7f741c1460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c74b0 0x7f741c1460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56478/0 (socket says 172.21.15.167:56478) 2023-11-28T21:01:41.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741affd640 1 -- 172.21.15.167:0/647799779 learned_addr learned my addr 172.21.15.167:0/647799779 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:41.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741a7fc640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c86f0 0x7f741c158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741b7fe640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c154120 0x7f741c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741affd640 1 -- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c154120 msgr2=0x7f741c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741affd640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c154120 0x7f741c159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741affd640 1 -- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c86f0 msgr2=0x7f741c158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741affd640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c86f0 0x7f741c158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741affd640 1 -- 172.21.15.167:0/647799779 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100094d0 con 0x7f741c0c74b0 2023-11-28T21:01:41.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741a7fc640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c86f0 0x7f741c158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:01:41.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741affd640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c74b0 0x7f741c1460d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c450 tx=0x7f740c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0052d0 con 0x7f741c0c74b0 2023-11-28T21:01:41.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c005450 con 0x7f741c0c74b0 2023-11-28T21:01:41.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c012870 con 0x7f741c0c74b0 2023-11-28T21:01:41.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c0c5560 con 0x7f741c0c74b0 2023-11-28T21:01:41.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c0c5ae0 con 0x7f741c0c74b0 2023-11-28T21:01:41.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f74219f8640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c157f30 0x7f741c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c074770 con 0x7f741c157f30 2023-11-28T21:01:41.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741a7fc640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c157f30 0x7f741c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741a7fc640 1 -- 172.21.15.167:0/647799779 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f741c15e050 con 0x7f741c157f30 2023-11-28T21:01:41.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f740c0129d0 con 0x7f741c0c74b0 2023-11-28T21:01:41.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.446+0000 7f741a7fc640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c157f30 0x7f741c0cb150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f741c070e60 tx=0x7f74100192b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f7403fff640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7408066470 0x7f7408068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f740c083cf0 con 0x7f741c0c74b0 2023-11-28T21:01:41.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100abe40 con 0x7f741c157f30 2023-11-28T21:01:41.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f741b7fe640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7408066470 0x7f7408068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f74100b43f0 con 0x7f741c157f30 2023-11-28T21:01:41.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c157f30 msgr2=0x7f741c0cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f7403fff640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c157f30 0x7f741c0cb150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f741c070e60 tx=0x7f74100192b0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c157f30 msgr2=0x7f741c0cb150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:41.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f7403fff640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c157f30 0x7f741c0cb150 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.450+0000 7f741b7fe640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7408066470 0x7f7408068930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f741c0c5370 tx=0x7f741400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.454+0000 7f74219f8640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c14a7d0 0x7f741c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.454+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c5fc0 con 0x7f741c14a7d0 2023-11-28T21:01:41.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.454+0000 7f741a7fc640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c14a7d0 0x7f741c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f741a7fc640 1 -- 172.21.15.167:0/647799779 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f741c158780 con 0x7f741c14a7d0 2023-11-28T21:01:41.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f741a7fc640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c14a7d0 0x7f741c0cb690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f7410009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100c5a80 con 0x7f741c14a7d0 2023-11-28T21:01:41.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7f74100c5310 con 0x7f741c14a7d0 2023-11-28T21:01:41.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c14a7d0 msgr2=0x7f741c0cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f7403fff640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c14a7d0 0x7f741c0cb690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f7410009240 comp rx=0 tx=0).stop 2023-11-28T21:01:41.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f7403fff640 1 -- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c14a7d0 msgr2=0x7f741c0cb690 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:41.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f7403fff640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c14a7d0 0x7f741c0cb690 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f7410009240 comp rx=0 tx=0).stop 2023-11-28T21:01:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:01:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:01:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 180, 2023-11-28T21:01:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:01:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:01:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:01:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:01:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T21:01:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:01:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:01:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:01:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:01:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:01:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:01:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:01:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:01:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:01:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:01:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:01:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:01:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:01:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:01:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:01:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:01:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:01:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:01:41.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7408066470 msgr2=0x7f7408068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f74219f8640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7408066470 0x7f7408068930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f741c0c5370 tx=0x7f741400b040 comp rx=0 tx=0).stop 2023-11-28T21:01:41.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c74b0 msgr2=0x7f741c1460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f74219f8640 1 --2- 172.21.15.167:0/647799779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f741c0c74b0 0x7f741c1460d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c450 tx=0x7f740c00c910 comp rx=0 tx=0).stop 2023-11-28T21:01:41.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f741b7fe640 1 -- 172.21.15.167:0/647799779 reap_dead start 2023-11-28T21:01:41.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f741b7fe640 1 -- 172.21.15.167:0/647799779 reap_dead start 2023-11-28T21:01:41.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 shutdown_connections 2023-11-28T21:01:41.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 >> 172.21.15.167:0/647799779 conn(0x7f741c0cc300 msgr2=0x7f741c143990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:41.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 shutdown_connections 2023-11-28T21:01:41.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.458+0000 7f74219f8640 1 -- 172.21.15.167:0/647799779 wait complete. 2023-11-28T21:01:41.484 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:01:41.484 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T21:01:41.484 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:01:41.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.622+0000 7f8b5bbf8640 1 Processor -- start 2023-11-28T21:01:41.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.622+0000 7f8b5bbf8640 1 -- start start 2023-11-28T21:01:41.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b5bbf8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b540cfc40 0x7f8b540cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b5bbf8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8b54153ae0 0x7f8b54153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b5bbf8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5415ac00 con 0x7f8b540cf860 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b5bbf8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b540cbd60 con 0x7f8b540cfc40 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b5bbf8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b54159ff0 con 0x7f8b54153ae0 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b59193640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b540cfc40 0x7f8b540cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b59193640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b540cfc40 0x7f8b540cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56486/0 (socket says 172.21.15.167:56486) 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b59193640 1 -- 172.21.15.167:0/911232730 learned_addr learned my addr 172.21.15.167:0/911232730 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b5a195640 1 --2- 172.21.15.167:0/911232730 >> v2:172.21.15.178:3300/0 conn(0x7f8b54153ae0 0x7f8b54153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b59193640 1 -- 172.21.15.167:0/911232730 >> v2:172.21.15.178:3300/0 conn(0x7f8b54153ae0 msgr2=0x7f8b54153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b59193640 1 --2- 172.21.15.167:0/911232730 >> v2:172.21.15.178:3300/0 conn(0x7f8b54153ae0 0x7f8b54153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b59193640 1 -- 172.21.15.167:0/911232730 >> v1:172.21.15.167:6789/0 conn(0x7f8b540cf860 legacy=0x7f8b540ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.626+0000 7f8b59193640 1 -- 172.21.15.167:0/911232730 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5415a2d0 con 0x7f8b540cfc40 2023-11-28T21:01:41.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b59193640 1 --2- 172.21.15.167:0/911232730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540cfc40 0x7f8b540cb770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8b540b2240 tx=0x7f8b4401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59f345ab7d31eeb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b58992640 1 -- 172.21.15.167:0/911232730 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440aa660 con 0x7f8b540cfc40 2023-11-28T21:01:41.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b58992640 1 -- 172.21.15.167:0/911232730 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b440aa7c0 con 0x7f8b540cfc40 2023-11-28T21:01:41.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b58992640 1 -- 172.21.15.167:0/911232730 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440aab50 con 0x7f8b540cfc40 2023-11-28T21:01:41.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/911232730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540cfc40 msgr2=0x7f8b540cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 --2- 172.21.15.167:0/911232730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540cfc40 0x7f8b540cb770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8b540b2240 tx=0x7f8b4401c500 comp rx=0 tx=0).stop 2023-11-28T21:01:41.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/911232730 shutdown_connections 2023-11-28T21:01:41.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 --2- 172.21.15.167:0/911232730 >> v2:172.21.15.178:3300/0 conn(0x7f8b54153ae0 0x7f8b54153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 --2- 172.21.15.167:0/911232730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540cfc40 0x7f8b540cb770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/911232730 >> 172.21.15.167:0/911232730 conn(0x7f8b5406c1f0 msgr2=0x7f8b54071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:41.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/911232730 shutdown_connections 2023-11-28T21:01:41.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/911232730 wait complete. 2023-11-28T21:01:41.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 Processor -- start 2023-11-28T21:01:41.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.630+0000 7f8b5bbf8640 1 -- start start 2023-11-28T21:01:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b540cf860 0x7f8b54154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b540cfc40 0x7f8b541557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54153ae0 0x7f8b540b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b541f2830 con 0x7f8b54153ae0 2023-11-28T21:01:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b541f37e0 con 0x7f8b540cf860 2023-11-28T21:01:41.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540b37e0 con 0x7f8b540cfc40 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5a195640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54153ae0 0x7f8b540b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5a195640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54153ae0 0x7f8b540b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56492/0 (socket says 172.21.15.167:56492) 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5a195640 1 -- 172.21.15.167:0/3749209721 learned_addr learned my addr 172.21.15.167:0/3749209721 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b59994640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b540cf860 0x7f8b54154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b59193640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b540cfc40 0x7f8b541557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5a195640 1 -- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b540cfc40 msgr2=0x7f8b541557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5a195640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b540cfc40 0x7f8b541557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5a195640 1 -- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b540cf860 msgr2=0x7f8b54154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5a195640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b540cf860 0x7f8b54154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5a195640 1 -- 172.21.15.167:0/3749209721 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440094d0 con 0x7f8b54153ae0 2023-11-28T21:01:41.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5a195640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54153ae0 0x7f8b540b3d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c007e70 tx=0x7f8b4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c014620 con 0x7f8b54153ae0 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c0147a0 con 0x7f8b54153ae0 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b541f2a20 con 0x7f8b54153ae0 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c014b50 con 0x7f8b54153ae0 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b541f2fe0 con 0x7f8b54153ae0 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54155d00 0x7f8b54143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b54072860 con 0x7f8b54155d00 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b59994640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54155d00 0x7f8b54143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b59994640 1 -- 172.21.15.167:0/3749209721 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b54075c90 con 0x7f8b54155d00 2023-11-28T21:01:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8b4c014cb0 con 0x7f8b54153ae0 2023-11-28T21:01:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.634+0000 7f8b59994640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54155d00 0x7f8b54143530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f70 tx=0x7f8b5000f9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b4a7fc640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8b38066470 0x7f8b38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8b4c084b90 con 0x7f8b54153ae0 2023-11-28T21:01:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b500052e0 con 0x7f8b54155d00 2023-11-28T21:01:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8b50005440 con 0x7f8b54155d00 2023-11-28T21:01:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54155d00 msgr2=0x7f8b54143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b4a7fc640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54155d00 0x7f8b54143530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f70 tx=0x7f8b5000f9b0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54155d00 msgr2=0x7f8b54143530 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b4a7fc640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54155d00 0x7f8b54143530 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b59193640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8b38066470 0x7f8b38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.638+0000 7f8b59193640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8b38066470 0x7f8b38068930 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8b440ae000 tx=0x7f8b440b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.642+0000 7f8b5bbf8640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54166630 0x7f8b54143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.642+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b54143fb0 con 0x7f8b54166630 2023-11-28T21:01:41.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.642+0000 7f8b59994640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54166630 0x7f8b54143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.642+0000 7f8b59994640 1 -- 172.21.15.167:0/3749209721 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f8b540c9fd0 con 0x7f8b54166630 2023-11-28T21:01:41.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b59994640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54166630 0x7f8b54143a70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f70 tx=0x7f8b50001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50023070 con 0x7f8b54166630 2023-11-28T21:01:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4640 (secure 0 0 0) 0x7f8b50003e80 con 0x7f8b54166630 2023-11-28T21:01:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54166630 msgr2=0x7f8b54143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b4a7fc640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54166630 0x7f8b54143a70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f70 tx=0x7f8b50001090 comp rx=0 tx=0).stop 2023-11-28T21:01:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b4a7fc640 1 -- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54166630 msgr2=0x7f8b54143a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b4a7fc640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b54166630 0x7f8b54143a70 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f70 tx=0x7f8b50001090 comp rx=0 tx=0).stop 2023-11-28T21:01:41.646 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:01:41.646 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:41.646 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:41.646 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:01:41.646 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 180, 2023-11-28T21:01:41.646 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:01:41.646 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:01:41.646 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:41.647 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:41.648 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:41.649 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:41.649 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:41.649 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:41.649 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:41.649 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:41.649 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:41.649 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:41.649 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:01:41.650 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:01:41.651 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.652 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:01:41.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.653 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:01:41.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.653 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:41.653 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:41.653 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:41.654 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:41.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.654 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:41.654 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:01:41.654 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.654 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.654 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:41.654 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.655 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.656 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.658 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.659 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:01:41.660 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:41.661 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:41.662 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:41.662 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:41.662 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:01:41.662 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:01:41.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8b38066470 msgr2=0x7f8b38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5bbf8640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8b38066470 0x7f8b38068930 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8b440ae000 tx=0x7f8b440b5040 comp rx=0 tx=0).stop 2023-11-28T21:01:41.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54153ae0 msgr2=0x7f8b540b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5bbf8640 1 --2- 172.21.15.167:0/3749209721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54153ae0 0x7f8b540b3d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c007e70 tx=0x7f8b4c00e4b0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5a195640 1 -- 172.21.15.167:0/3749209721 reap_dead start 2023-11-28T21:01:41.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5a195640 1 -- 172.21.15.167:0/3749209721 reap_dead start 2023-11-28T21:01:41.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 shutdown_connections 2023-11-28T21:01:41.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 >> 172.21.15.167:0/3749209721 conn(0x7f8b5406c1f0 msgr2=0x7f8b540cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:41.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 shutdown_connections 2023-11-28T21:01:41.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.646+0000 7f8b5bbf8640 1 -- 172.21.15.167:0/3749209721 wait complete. 2023-11-28T21:01:41.664 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:01:41.664 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T21:01:41.665 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T21:01:41.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.802+0000 7f19beefd640 1 Processor -- start 2023-11-28T21:01:41.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.802+0000 7f19beefd640 1 -- start start 2023-11-28T21:01:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19beefd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8151f60 0x7f19b80c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19beefd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b815b220 con 0x7f19b806a580 2023-11-28T21:01:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19beefd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b80c60f0 con 0x7f19b80c5c90 2023-11-28T21:01:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19beefd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80c4da0 con 0x7f19b8151f60 2023-11-28T21:01:41.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19bd49a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f19b806a580 0x7f19b81625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:56650/0 (socket says 172.21.15.167:56650) 2023-11-28T21:01:41.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19bd49a640 1 -- 172.21.15.167:0/1732943601 learned_addr learned my addr 172.21.15.167:0/1732943601 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:01:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19bcc99640 1 --2- 172.21.15.167:0/1732943601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8151f60 0x7f19b80c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19af7fe640 1 -- 172.21.15.167:0/1732943601 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410188557 0 0) 0x7f19b815b220 con 0x7f19b806a580 2023-11-28T21:01:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19af7fe640 1 -- 172.21.15.167:0/1732943601 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a0003530 con 0x7f19b806a580 2023-11-28T21:01:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19af7fe640 1 -- 172.21.15.167:0/1732943601 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209512411 0 0) 0x7f19b80c60f0 con 0x7f19b80c5c90 2023-11-28T21:01:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19af7fe640 1 -- 172.21.15.167:0/1732943601 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b815b220 con 0x7f19b80c5c90 2023-11-28T21:01:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19af7fe640 1 -- 172.21.15.167:0/1732943601 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2162235404 0 0) 0x7f19a0003530 con 0x7f19b806a580 2023-11-28T21:01:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19bcc99640 1 -- 172.21.15.167:0/1732943601 >> v1:172.21.15.178:6789/0 conn(0x7f19b80c5c90 legacy=0x7f19b80c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19bcc99640 1 -- 172.21.15.167:0/1732943601 >> v1:172.21.15.167:6789/0 conn(0x7f19b806a580 legacy=0x7f19b81625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.806+0000 7f19bcc99640 1 -- 172.21.15.167:0/1732943601 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b8152340 con 0x7f19b8151f60 2023-11-28T21:01:41.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19bcc99640 1 --2- 172.21.15.167:0/1732943601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8151f60 0x7f19b80c75c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19b40097f0 tx=0x7f19b401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26d02f4cc0627cb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19af7fe640 1 -- 172.21.15.167:0/1732943601 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0001a00 con 0x7f19b8151f60 2023-11-28T21:01:41.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19af7fe640 1 -- 172.21.15.167:0/1732943601 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b40a7050 con 0x7f19b8151f60 2023-11-28T21:01:41.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19af7fe640 1 -- 172.21.15.167:0/1732943601 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b40ab600 con 0x7f19b8151f60 2023-11-28T21:01:41.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19beefd640 1 -- 172.21.15.167:0/1732943601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8151f60 msgr2=0x7f19b80c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19beefd640 1 --2- 172.21.15.167:0/1732943601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8151f60 0x7f19b80c75c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19b40097f0 tx=0x7f19b401c350 comp rx=0 tx=0).stop 2023-11-28T21:01:41.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19beefd640 1 -- 172.21.15.167:0/1732943601 shutdown_connections 2023-11-28T21:01:41.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19beefd640 1 --2- 172.21.15.167:0/1732943601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b8151f60 0x7f19b80c75c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19beefd640 1 -- 172.21.15.167:0/1732943601 >> 172.21.15.167:0/1732943601 conn(0x7f19b80cb1e0 msgr2=0x7f19b80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:41.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19beefd640 1 -- 172.21.15.167:0/1732943601 shutdown_connections 2023-11-28T21:01:41.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19beefd640 1 -- 172.21.15.167:0/1732943601 wait complete. 2023-11-28T21:01:41.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19beefd640 1 Processor -- start 2023-11-28T21:01:41.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.810+0000 7f19beefd640 1 -- start start 2023-11-28T21:01:41.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19beefd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806a580 0x7f19b8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19beefd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b80c5c90 0x7f19b8158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19beefd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b8151f60 0x7f19b8156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19beefd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80ca6e0 con 0x7f19b80c5c90 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19beefd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b81f33c0 con 0x7f19b8151f60 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19beefd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80ca440 con 0x7f19b806a580 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19affff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b80c5c90 0x7f19b8158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19affff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b80c5c90 0x7f19b8158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56504/0 (socket says 172.21.15.167:56504) 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19affff640 1 -- 172.21.15.167:0/909186349 learned_addr learned my addr 172.21.15.167:0/909186349 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19bd49a640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b8151f60 0x7f19b8156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19bcc99640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806a580 0x7f19b8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19affff640 1 -- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806a580 msgr2=0x7f19b8159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19affff640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806a580 0x7f19b8159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19affff640 1 -- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b8151f60 msgr2=0x7f19b8156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19affff640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b8151f60 0x7f19b8156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19affff640 1 -- 172.21.15.167:0/909186349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009420 con 0x7f19b80c5c90 2023-11-28T21:01:41.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19bcc99640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806a580 0x7f19b8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:01:41.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19bd49a640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b8151f60 0x7f19b8156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:01:41.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19affff640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b80c5c90 0x7f19b8158df0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c490 tx=0x7f19a800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19ad7fa640 1 -- 172.21.15.167:0/909186349 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80052d0 con 0x7f19b80c5c90 2023-11-28T21:01:41.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19ad7fa640 1 -- 172.21.15.167:0/909186349 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8005430 con 0x7f19b80c5c90 2023-11-28T21:01:41.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b81f2600 con 0x7f19b80c5c90 2023-11-28T21:01:41.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19ad7fa640 1 -- 172.21.15.167:0/909186349 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8012870 con 0x7f19b80c5c90 2023-11-28T21:01:41.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b81f2bc0 con 0x7f19b80c5c90 2023-11-28T21:01:41.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b80682c0 con 0x7f19b80c5c90 2023-11-28T21:01:41.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.814+0000 7f19ad7fa640 1 -- 172.21.15.167:0/909186349 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f19a80129d0 con 0x7f19b80c5c90 2023-11-28T21:01:41.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.818+0000 7f19ad7fa640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19a40664a0 0x7f19a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:41.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.818+0000 7f19ad7fa640 1 -- 172.21.15.167:0/909186349 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f19a8083d70 con 0x7f19b80c5c90 2023-11-28T21:01:41.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.818+0000 7f19bcc99640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19a40664a0 0x7f19a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:41.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.818+0000 7f19bcc99640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19a40664a0 0x7f19a4068960 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f19b40ad000 tx=0x7f19b40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:41.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:41.822+0000 7f19ad7fa640 1 -- 172.21.15.167:0/909186349 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19a8050e90 con 0x7f19b80c5c90 2023-11-28T21:01:42.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.026+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f19b8075c90 con 0x7f19b80c5c90 2023-11-28T21:01:42.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.026+0000 7f19ad7fa640 1 -- 172.21.15.167:0/909186349 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f19a80544b0 con 0x7f19b80c5c90 2023-11-28T21:01:42.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19a40664a0 msgr2=0x7f19a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:42.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19a40664a0 0x7f19a4068960 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f19b40ad000 tx=0x7f19b40a6000 comp rx=0 tx=0).stop 2023-11-28T21:01:42.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b80c5c90 msgr2=0x7f19b8158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b80c5c90 0x7f19b8158df0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c490 tx=0x7f19a800c950 comp rx=0 tx=0).stop 2023-11-28T21:01:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 shutdown_connections 2023-11-28T21:01:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f19a40664a0 0x7f19a4068960 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b8151f60 0x7f19b8156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19b80c5c90 0x7f19b8158df0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 --2- 172.21.15.167:0/909186349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b806a580 0x7f19b8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 >> 172.21.15.167:0/909186349 conn(0x7f19b80cb1e0 msgr2=0x7f19b8144bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 shutdown_connections 2023-11-28T21:01:42.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:42.030+0000 7f19beefd640 1 -- 172.21.15.167:0/909186349 wait complete. 2023-11-28T21:01:42.049 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T21:01:47.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~154s 2023-11-28T21:01:52.050 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:01:52.050 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:01:52.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f8714f2a640 1 Processor -- start 2023-11-28T21:01:52.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f8714f2a640 1 -- start start 2023-11-28T21:01:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f8714f2a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87100aff70 0x7f8710066680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f8714f2a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f871006d530 0x7f871006b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f8714f2a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87100c8280 con 0x7f871015d3b0 2023-11-28T21:01:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f8714f2a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87100c8910 con 0x7f87100aff70 2023-11-28T21:01:52.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f8714f2a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8710066bc0 con 0x7f871006d530 2023-11-28T21:01:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f870e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87100aff70 0x7f8710066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f870e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f87100aff70 0x7f8710066680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:35986/0 (socket says 172.21.15.167:35986) 2023-11-28T21:01:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f870e59c640 1 -- 172.21.15.167:0/2660540792 learned_addr learned my addr 172.21.15.167:0/2660540792 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f870dd9b640 1 --2- 172.21.15.167:0/2660540792 >> v2:172.21.15.178:3300/0 conn(0x7f871006d530 0x7f871006b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f870e59c640 1 -- 172.21.15.167:0/2660540792 >> v2:172.21.15.178:3300/0 conn(0x7f871006d530 msgr2=0x7f871006b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f870e59c640 1 --2- 172.21.15.167:0/2660540792 >> v2:172.21.15.178:3300/0 conn(0x7f871006d530 0x7f871006b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f870e59c640 1 -- 172.21.15.167:0/2660540792 >> v1:172.21.15.178:6789/0 conn(0x7f871015d3b0 legacy=0x7f87100cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:52.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.198+0000 7f870e59c640 1 -- 172.21.15.167:0/2660540792 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100ca3b0 con 0x7f87100aff70 2023-11-28T21:01:52.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f870e59c640 1 --2- 172.21.15.167:0/2660540792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 0x7f8710066680 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f87100ca1a0 tx=0x7f870001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3117412f19baa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f870d59a640 1 -- 172.21.15.167:0/2660540792 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87000aa5f0 con 0x7f87100aff70 2023-11-28T21:01:52.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f870d59a640 1 -- 172.21.15.167:0/2660540792 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87000aa750 con 0x7f87100aff70 2023-11-28T21:01:52.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f870d59a640 1 -- 172.21.15.167:0/2660540792 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87000aaae0 con 0x7f87100aff70 2023-11-28T21:01:52.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f8714f2a640 1 -- 172.21.15.167:0/2660540792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 msgr2=0x7f8710066680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f8714f2a640 1 --2- 172.21.15.167:0/2660540792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 0x7f8710066680 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f87100ca1a0 tx=0x7f870001c490 comp rx=0 tx=0).stop 2023-11-28T21:01:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f8714f2a640 1 -- 172.21.15.167:0/2660540792 shutdown_connections 2023-11-28T21:01:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f8714f2a640 1 --2- 172.21.15.167:0/2660540792 >> v2:172.21.15.178:3300/0 conn(0x7f871006d530 0x7f871006b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f8714f2a640 1 --2- 172.21.15.167:0/2660540792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 0x7f8710066680 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f8714f2a640 1 -- 172.21.15.167:0/2660540792 >> 172.21.15.167:0/2660540792 conn(0x7f871006ee00 msgr2=0x7f871006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:52.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f8714f2a640 1 -- 172.21.15.167:0/2660540792 shutdown_connections 2023-11-28T21:01:52.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.202+0000 7f8714f2a640 1 -- 172.21.15.167:0/2660540792 wait complete. 2023-11-28T21:01:52.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 Processor -- start 2023-11-28T21:01:52.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 -- start start 2023-11-28T21:01:52.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871006d530 0x7f87100cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 0x7f871015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871015d3b0 0x7f87100b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87100b1220 con 0x7f87100aff70 2023-11-28T21:01:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87100cbb70 con 0x7f871006d530 2023-11-28T21:01:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87100b1de0 con 0x7f871015d3b0 2023-11-28T21:01:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 0x7f871015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 0x7f871015bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36002/0 (socket says 172.21.15.167:36002) 2023-11-28T21:01:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870dd9b640 1 -- 172.21.15.167:0/1709688311 learned_addr learned my addr 172.21.15.167:0/1709688311 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:52.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870e59c640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871006d530 0x7f87100cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870ed9d640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871015d3b0 0x7f87100b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870dd9b640 1 -- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871015d3b0 msgr2=0x7f87100b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870dd9b640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871015d3b0 0x7f87100b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870dd9b640 1 -- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871006d530 msgr2=0x7f87100cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870dd9b640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871006d530 0x7f87100cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870dd9b640 1 -- 172.21.15.167:0/1709688311 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87000094d0 con 0x7f87100aff70 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870ed9d640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871015d3b0 0x7f87100b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f870dd9b640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 0x7f871015bd10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f870400d800 tx=0x7f870400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f86feffd640 1 -- 172.21.15.167:0/1709688311 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400b6c0 con 0x7f87100aff70 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f86feffd640 1 -- 172.21.15.167:0/1709688311 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870400b820 con 0x7f87100aff70 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f86feffd640 1 -- 172.21.15.167:0/1709688311 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400bb90 con 0x7f87100aff70 2023-11-28T21:01:52.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87100b0570 con 0x7f87100aff70 2023-11-28T21:01:52.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.206+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87100cb520 con 0x7f87100aff70 2023-11-28T21:01:52.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.210+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8710067c40 con 0x7f87100aff70 2023-11-28T21:01:52.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.210+0000 7f86feffd640 1 -- 172.21.15.167:0/1709688311 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f870400bcf0 con 0x7f87100aff70 2023-11-28T21:01:52.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.210+0000 7f86feffd640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86f00664a0 0x7f86f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.210+0000 7f86feffd640 1 -- 172.21.15.167:0/1709688311 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8704084770 con 0x7f87100aff70 2023-11-28T21:01:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.210+0000 7f870e59c640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86f00664a0 0x7f86f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.210+0000 7f870e59c640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86f00664a0 0x7f86f0068960 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f87000ae000 tx=0x7f87000b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.214+0000 7f86feffd640 1 -- 172.21.15.167:0/1709688311 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8704051760 con 0x7f87100aff70 2023-11-28T21:01:52.412 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:52.416 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:52.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.418+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8710075c90 con 0x7f87100aff70 2023-11-28T21:01:52.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.418+0000 7f86feffd640 1 -- 172.21.15.167:0/1709688311 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f8704054d80 con 0x7f87100aff70 2023-11-28T21:01:52.418 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:01:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.418+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86f00664a0 msgr2=0x7f86f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.418+0000 7f8714f2a640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86f00664a0 0x7f86f0068960 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f87000ae000 tx=0x7f87000b5040 comp rx=0 tx=0).stop 2023-11-28T21:01:52.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.418+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 msgr2=0x7f871015bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.418+0000 7f8714f2a640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 0x7f871015bd10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f870400d800 tx=0x7f870400dcc0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.422+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 shutdown_connections 2023-11-28T21:01:52.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.422+0000 7f8714f2a640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f86f00664a0 0x7f86f0068960 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.422+0000 7f8714f2a640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871015d3b0 0x7f87100b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.422+0000 7f8714f2a640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87100aff70 0x7f871015bd10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.422+0000 7f8714f2a640 1 --2- 172.21.15.167:0/1709688311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871006d530 0x7f87100cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.422+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 >> 172.21.15.167:0/1709688311 conn(0x7f871006ee00 msgr2=0x7f87100cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:52.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.422+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 shutdown_connections 2023-11-28T21:01:52.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.422+0000 7f8714f2a640 1 -- 172.21.15.167:0/1709688311 wait complete. 2023-11-28T21:01:52.441 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:01:52.441 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T21:01:52.441 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T21:01:52.441 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:01:52.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f012afaa640 1 Processor -- start 2023-11-28T21:01:52.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f012afaa640 1 -- start start 2023-11-28T21:01:52.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f012afaa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f01240c6ff0 0x7f0124157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f012afaa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01240c48f0 con 0x7f0124150b40 2023-11-28T21:01:52.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f012afaa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01240c6ac0 con 0x7f01240c4510 2023-11-28T21:01:52.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f012afaa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01240c62f0 con 0x7f01240c6ff0 2023-11-28T21:01:52.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f011bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f01240c6ff0 0x7f0124157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f011bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f01240c6ff0 0x7f0124157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36004/0 (socket says 172.21.15.167:36004) 2023-11-28T21:01:52.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f011bfff640 1 -- 172.21.15.167:0/3298191369 learned_addr learned my addr 172.21.15.167:0/3298191369 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:52.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f011bfff640 1 -- 172.21.15.167:0/3298191369 >> v1:172.21.15.178:6789/0 conn(0x7f01240c4510 legacy=0x7f012406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f011bfff640 1 -- 172.21.15.167:0/3298191369 >> v1:172.21.15.167:6789/0 conn(0x7f0124150b40 legacy=0x7f01240c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.646+0000 7f011bfff640 1 -- 172.21.15.167:0/3298191369 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01240c6500 con 0x7f01240c6ff0 2023-11-28T21:01:52.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f011bfff640 1 --2- 172.21.15.167:0/3298191369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c6ff0 0x7f0124157560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f011400bb10 tx=0x7f011401ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ead7830c2a642b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f011b7fe640 1 -- 172.21.15.167:0/3298191369 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01140a7bb0 con 0x7f01240c6ff0 2023-11-28T21:01:52.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f011b7fe640 1 -- 172.21.15.167:0/3298191369 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01140a7d10 con 0x7f01240c6ff0 2023-11-28T21:01:52.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f011b7fe640 1 -- 172.21.15.167:0/3298191369 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01140af660 con 0x7f01240c6ff0 2023-11-28T21:01:52.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f012afaa640 1 -- 172.21.15.167:0/3298191369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c6ff0 msgr2=0x7f0124157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f012afaa640 1 --2- 172.21.15.167:0/3298191369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c6ff0 0x7f0124157560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f011400bb10 tx=0x7f011401ebe0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f012afaa640 1 -- 172.21.15.167:0/3298191369 shutdown_connections 2023-11-28T21:01:52.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f012afaa640 1 --2- 172.21.15.167:0/3298191369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c6ff0 0x7f0124157560 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f012afaa640 1 -- 172.21.15.167:0/3298191369 >> 172.21.15.167:0/3298191369 conn(0x7f01240cb1e0 msgr2=0x7f01240cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:52.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f012afaa640 1 -- 172.21.15.167:0/3298191369 shutdown_connections 2023-11-28T21:01:52.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.650+0000 7f012afaa640 1 -- 172.21.15.167:0/3298191369 wait complete. 2023-11-28T21:01:52.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 Processor -- start 2023-11-28T21:01:52.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 -- start start 2023-11-28T21:01:52.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c4510 0x7f0124147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01240c6ff0 0x7f012415a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0124150b40 0x7f012415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01241f5bf0 con 0x7f01240c4510 2023-11-28T21:01:52.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012415f480 con 0x7f0124150b40 2023-11-28T21:01:52.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012415f720 con 0x7f01240c6ff0 2023-11-28T21:01:52.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0128d46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c4510 0x7f0124147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0128d46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c4510 0x7f0124147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36012/0 (socket says 172.21.15.167:36012) 2023-11-28T21:01:52.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0128d46640 1 -- 172.21.15.167:0/1117740987 learned_addr learned my addr 172.21.15.167:0/1117740987 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0129547640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0124150b40 0x7f012415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f011bfff640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01240c6ff0 0x7f012415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0128d46640 1 -- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01240c6ff0 msgr2=0x7f012415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0128d46640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01240c6ff0 0x7f012415a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0128d46640 1 -- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0124150b40 msgr2=0x7f012415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0128d46640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0124150b40 0x7f012415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0128d46640 1 -- 172.21.15.167:0/1117740987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011400b770 con 0x7f01240c4510 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f0128d46640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c4510 0x7f0124147e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f012000c450 tx=0x7f012000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200052d0 con 0x7f01240c4510 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120005450 con 0x7f01240c4510 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120012870 con 0x7f01240c4510 2023-11-28T21:01:52.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01241f5e40 con 0x7f01240c4510 2023-11-28T21:01:52.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.654+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01241f6400 con 0x7f01240c4510 2023-11-28T21:01:52.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f012afaa640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0124153c50 0x7f01241f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0124074770 con 0x7f0124153c50 2023-11-28T21:01:52.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f011bfff640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0124153c50 0x7f01241f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f011bfff640 1 -- 172.21.15.167:0/1117740987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01240c3a50 con 0x7f0124153c50 2023-11-28T21:01:52.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f011bfff640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0124153c50 0x7f01241f65f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01240cc090 tx=0x7f011401d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01140afc20 con 0x7f0124153c50 2023-11-28T21:01:52.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01200129d0 con 0x7f01240c4510 2023-11-28T21:01:52.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f01197fa640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0110066510 0x7f01100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f01140afd80 con 0x7f0124153c50 2023-11-28T21:01:52.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0124153c50 msgr2=0x7f01241f65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f01197fa640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0124153c50 0x7f01241f65f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01240cc090 tx=0x7f011401d420 comp rx=0 tx=0).stop 2023-11-28T21:01:52.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0124153c50 msgr2=0x7f01241f65f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:52.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f01197fa640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0124153c50 0x7f01241f65f0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01240cc090 tx=0x7f011401d420 comp rx=0 tx=0).stop 2023-11-28T21:01:52.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0120083e50 con 0x7f01240c4510 2023-11-28T21:01:52.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.658+0000 7f0129547640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0110066510 0x7f01100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.662+0000 7f0129547640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0110066510 0x7f01100689d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f011c0012f0 tx=0x7f011c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01241f2680 0x7f01241f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01241f5fd0 con 0x7f01241f2680 2023-11-28T21:01:52.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f011bfff640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01241f2680 0x7f01241f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f011bfff640 1 -- 172.21.15.167:0/1117740987 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0124157040 con 0x7f01241f2680 2023-11-28T21:01:52.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f011bfff640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01241f2680 0x7f01241f2a60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f011401c810 tx=0x7f01140a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01140c4ce0 con 0x7f01241f2680 2023-11-28T21:01:52.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5126 (secure 0 0 0) 0x7f01140c4e40 con 0x7f01241f2680 2023-11-28T21:01:52.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01241f2680 msgr2=0x7f01241f2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f01197fa640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01241f2680 0x7f01241f2a60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f011401c810 tx=0x7f01140a9000 comp rx=0 tx=0).stop 2023-11-28T21:01:52.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f01197fa640 1 -- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01241f2680 msgr2=0x7f01241f2a60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:52.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f01197fa640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01241f2680 0x7f01241f2a60 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f011401c810 tx=0x7f01140a9000 comp rx=0 tx=0).stop 2023-11-28T21:01:52.667 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:01:52.667 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:52.667 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:52.667 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:01:52.667 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 180, 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:52.668 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:52.669 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.670 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:01:52.671 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:01:52.671 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:01:52.671 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:01:52.671 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:01:52.671 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:01:52.671 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:52.671 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:52.671 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:01:52.672 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:01:52.672 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:01:52.672 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:01:52.672 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:01:52.672 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:01:52.672 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:01:52.672 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:52.672 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:52.673 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:01:52.674 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:01:52.675 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:01:52.676 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:52.677 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.678 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:52.679 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.680 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 8 2023-11-28T21:01:52.681 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.682 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.682 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:01:52.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.682 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 6 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.683 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:52.684 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:52.684 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:01:52.684 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.684 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.684 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:01:52.684 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:01:52.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0110066510 msgr2=0x7f01100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0110066510 0x7f01100689d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f011c0012f0 tx=0x7f011c009040 comp rx=0 tx=0).stop 2023-11-28T21:01:52.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c4510 msgr2=0x7f0124147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 --2- 172.21.15.167:0/1117740987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01240c4510 0x7f0124147e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f012000c450 tx=0x7f012000c910 comp rx=0 tx=0).stop 2023-11-28T21:01:52.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f0129547640 1 -- 172.21.15.167:0/1117740987 reap_dead start 2023-11-28T21:01:52.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f0129547640 1 -- 172.21.15.167:0/1117740987 reap_dead start 2023-11-28T21:01:52.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 shutdown_connections 2023-11-28T21:01:52.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 >> 172.21.15.167:0/1117740987 conn(0x7f01240cb1e0 msgr2=0x7f01240c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:52.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 shutdown_connections 2023-11-28T21:01:52.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.666+0000 7f012afaa640 1 -- 172.21.15.167:0/1117740987 wait complete. 2023-11-28T21:01:52.687 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:01:52.687 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T21:01:52.687 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:01:52.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd54eea640 1 Processor -- start 2023-11-28T21:01:52.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd54eea640 1 -- start start 2023-11-28T21:01:52.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd54eea640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdd50150b40 0x7fdd50157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd54eea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd500c4510 0x7fdd5006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd54eea640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd500c4920 con 0x7fdd500c6ff0 2023-11-28T21:01:52.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd54eea640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd500c62f0 con 0x7fdd50150b40 2023-11-28T21:01:52.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd54eea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c6ac0 con 0x7fdd500c4510 2023-11-28T21:01:52.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd4dd9b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fdd500c6ff0 0x7fdd500c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51494/0 (socket says 172.21.15.167:51494) 2023-11-28T21:01:52.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd4dd9b640 1 -- 172.21.15.167:0/1636205831 learned_addr learned my addr 172.21.15.167:0/1636205831 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:01:52.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.826+0000 7fdd4e59c640 1 --2- 172.21.15.167:0/1636205831 >> v2:172.21.15.178:3300/0 conn(0x7fdd50150b40 0x7fdd50157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4ed9d640 1 --2- 172.21.15.167:0/1636205831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd500c4510 0x7fdd5006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4d59a640 1 -- 172.21.15.167:0/1636205831 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045779015 0 0) 0x7fdd500c4920 con 0x7fdd500c6ff0 2023-11-28T21:01:52.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4d59a640 1 -- 172.21.15.167:0/1636205831 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd38003530 con 0x7fdd500c6ff0 2023-11-28T21:01:52.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4d59a640 1 -- 172.21.15.167:0/1636205831 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4037107221 0 0) 0x7fdd38003530 con 0x7fdd500c6ff0 2023-11-28T21:01:52.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4e59c640 1 -- 172.21.15.167:0/1636205831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd500c4510 msgr2=0x7fdd5006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:52.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4e59c640 1 --2- 172.21.15.167:0/1636205831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd500c4510 0x7fdd5006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4e59c640 1 -- 172.21.15.167:0/1636205831 >> v1:172.21.15.167:6789/0 conn(0x7fdd500c6ff0 legacy=0x7fdd500c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4e59c640 1 -- 172.21.15.167:0/1636205831 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500c6500 con 0x7fdd50150b40 2023-11-28T21:01:52.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4e59c640 1 --2- 172.21.15.167:0/1636205831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50150b40 0x7fdd50157560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdd400097c0 tx=0x7fdd4001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ad42f44558cbf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4d59a640 1 -- 172.21.15.167:0/1636205831 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd440016a0 con 0x7fdd50150b40 2023-11-28T21:01:52.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4d59a640 1 -- 172.21.15.167:0/1636205831 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd400a7050 con 0x7fdd50150b40 2023-11-28T21:01:52.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.830+0000 7fdd4d59a640 1 -- 172.21.15.167:0/1636205831 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400ab620 con 0x7fdd50150b40 2023-11-28T21:01:52.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 -- 172.21.15.167:0/1636205831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50150b40 msgr2=0x7fdd50157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 --2- 172.21.15.167:0/1636205831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50150b40 0x7fdd50157560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdd400097c0 tx=0x7fdd4001c370 comp rx=0 tx=0).stop 2023-11-28T21:01:52.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 -- 172.21.15.167:0/1636205831 shutdown_connections 2023-11-28T21:01:52.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 --2- 172.21.15.167:0/1636205831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd500c4510 0x7fdd5006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 --2- 172.21.15.167:0/1636205831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50150b40 0x7fdd50157560 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 -- 172.21.15.167:0/1636205831 >> 172.21.15.167:0/1636205831 conn(0x7fdd500cb1e0 msgr2=0x7fdd500cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:52.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 -- 172.21.15.167:0/1636205831 shutdown_connections 2023-11-28T21:01:52.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 -- 172.21.15.167:0/1636205831 wait complete. 2023-11-28T21:01:52.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 Processor -- start 2023-11-28T21:01:52.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 -- start start 2023-11-28T21:01:52.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd500c4510 0x7fdd5015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd500c6ff0 0x7fdd50160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50150b40 0x7fdd50148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd501f2a10 con 0x7fdd500c6ff0 2023-11-28T21:01:52.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50159900 con 0x7fdd50150b40 2023-11-28T21:01:52.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd54eea640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd501f2f20 con 0x7fdd500c4510 2023-11-28T21:01:52.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.834+0000 7fdd4dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd500c6ff0 0x7fdd50160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd500c6ff0 0x7fdd50160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34390/0 (socket says 172.21.15.167:34390) 2023-11-28T21:01:52.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4dd9b640 1 -- 172.21.15.167:0/2626263434 learned_addr learned my addr 172.21.15.167:0/2626263434 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:52.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4e59c640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd500c4510 0x7fdd5015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4ed9d640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50150b40 0x7fdd50148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4dd9b640 1 -- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd500c4510 msgr2=0x7fdd5015a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4dd9b640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd500c4510 0x7fdd5015a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4dd9b640 1 -- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50150b40 msgr2=0x7fdd50148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4dd9b640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50150b40 0x7fdd50148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4dd9b640 1 -- 172.21.15.167:0/2626263434 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40009420 con 0x7fdd500c6ff0 2023-11-28T21:01:52.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4dd9b640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd500c6ff0 0x7fdd50160540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400c730 tx=0x7fdd4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd440072d0 con 0x7fdd500c6ff0 2023-11-28T21:01:52.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd44007450 con 0x7fdd500c6ff0 2023-11-28T21:01:52.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd440047f0 con 0x7fdd500c6ff0 2023-11-28T21:01:52.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd501f2c40 con 0x7fdd500c6ff0 2023-11-28T21:01:52.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd501592b0 con 0x7fdd500c6ff0 2023-11-28T21:01:52.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd54eea640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50148960 0x7fdd50146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50074770 con 0x7fdd50148960 2023-11-28T21:01:52.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4e59c640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50148960 0x7fdd50146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4e59c640 1 -- 172.21.15.167:0/2626263434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd50150f90 con 0x7fdd50148960 2023-11-28T21:01:52.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd44004b60 con 0x7fdd500c6ff0 2023-11-28T21:01:52.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd4e59c640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50148960 0x7fdd50146240 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdd5006bba0 tx=0x7fdd4001abb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.838+0000 7fdd3effd640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdd30066470 0x7fdd30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.842+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fdd44083790 con 0x7fdd500c6ff0 2023-11-28T21:01:52.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.842+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400b6680 con 0x7fdd50148960 2023-11-28T21:01:52.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.842+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fdd40006e20 con 0x7fdd50148960 2023-11-28T21:01:52.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.842+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50148960 msgr2=0x7fdd50146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.842+0000 7fdd3effd640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50148960 0x7fdd50146240 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdd5006bba0 tx=0x7fdd4001abb0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.842+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50148960 msgr2=0x7fdd50146240 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:52.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.842+0000 7fdd3effd640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50148960 0x7fdd50146240 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdd5006bba0 tx=0x7fdd4001abb0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.842+0000 7fdd4ed9d640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdd30066470 0x7fdd30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.842+0000 7fdd4ed9d640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdd30066470 0x7fdd30068930 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdd50146ef0 tx=0x7fdd4800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.846+0000 7fdd54eea640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50159440 0x7fdd50146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:52.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.846+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50157040 con 0x7fdd50159440 2023-11-28T21:01:52.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.846+0000 7fdd4e59c640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50159440 0x7fdd50146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:52.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.846+0000 7fdd4e59c640 1 -- 172.21.15.167:0/2626263434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdd500682c0 con 0x7fdd50159440 2023-11-28T21:01:52.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.846+0000 7fdd4e59c640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50159440 0x7fdd50146780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdd4001cc10 tx=0x7fdd40019110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:52.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.846+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400bf8b0 con 0x7fdd50159440 2023-11-28T21:01:52.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4471 (secure 0 0 0) 0x7fdd400bfa10 con 0x7fdd50159440 2023-11-28T21:01:52.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50159440 msgr2=0x7fdd50146780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd3effd640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50159440 0x7fdd50146780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdd4001cc10 tx=0x7fdd40019110 comp rx=0 tx=0).stop 2023-11-28T21:01:52.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd3effd640 1 -- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50159440 msgr2=0x7fdd50146780 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:52.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd3effd640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd50159440 0x7fdd50146780 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdd4001cc10 tx=0x7fdd40019110 comp rx=0 tx=0).stop 2023-11-28T21:01:52.851 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:01:52.851 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:52.851 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:52.852 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:01:52.852 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 180, 2023-11-28T21:01:52.852 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:01:52.852 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:01:52.852 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:01:52.852 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:01:52.853 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.853 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T21:01:52.853 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:52.853 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:01:52.853 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:01:52.854 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:52.854 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:52.854 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:52.854 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:52.855 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:52.855 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:52.855 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:52.855 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:52.855 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:52.855 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:52.857 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.857 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:01:52.857 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:01:52.857 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:52.857 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:52.858 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:52.858 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:52.858 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:52.858 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:52.858 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:52.858 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:52.858 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:52.859 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:52.859 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.859 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.859 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:01:52.859 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:01:52.859 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:01:52.860 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:01:52.860 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:01:52.860 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:01:52.860 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:52.860 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:52.860 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:01:52.860 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:01:52.860 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:01:52.861 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:01:52.861 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:01:52.861 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:01:52.861 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:01:52.861 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:52.861 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:01:52.862 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:52.862 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:52.862 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:52.862 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:52.862 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:52.863 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:52.863 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:52.863 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:52.863 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:52.863 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:52.863 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.863 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:01:52.864 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.864 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:01:52.864 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.864 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:52.864 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:52.864 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:52.864 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:52.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.865 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:52.865 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:01:52.865 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.865 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.865 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.865 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:52.866 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:01:52.866 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.866 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.866 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.866 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.866 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:01:52.866 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:01:52.866 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:52.867 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:52.867 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:52.867 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.867 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.867 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:52.867 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:52.867 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:52.868 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:52.868 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.868 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:52.868 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:01:52.868 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.868 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.869 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.869 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:52.869 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:01:52.869 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.869 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.869 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.869 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.869 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:01:52.870 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:01:52.870 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:52.870 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:52.870 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:52.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.870 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:52.871 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:52.871 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:52.871 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:52.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.871 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:52.871 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:01:52.871 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.872 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:52.872 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:01:52.872 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:52.872 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.872 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.873 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:01:52.873 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:01:52.873 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:52.873 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:52.873 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:52.873 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.873 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.873 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.874 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:01:52.874 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:01:52.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.874 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:52.874 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:52.874 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:52.874 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.875 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:52.875 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:01:52.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:52.875 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:52.875 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:52.876 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:52.876 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:52.876 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:52.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:52.876 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:01:52.876 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:01:52.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdd30066470 msgr2=0x7fdd30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd54eea640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fdd30066470 0x7fdd30068930 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdd50146ef0 tx=0x7fdd4800b040 comp rx=0 tx=0).stop 2023-11-28T21:01:52.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd500c6ff0 msgr2=0x7fdd50160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:52.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd54eea640 1 --2- 172.21.15.167:0/2626263434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd500c6ff0 0x7fdd50160540 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400c730 tx=0x7fdd4400cbf0 comp rx=0 tx=0).stop 2023-11-28T21:01:52.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd4ed9d640 1 -- 172.21.15.167:0/2626263434 reap_dead start 2023-11-28T21:01:52.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd4ed9d640 1 -- 172.21.15.167:0/2626263434 reap_dead start 2023-11-28T21:01:52.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 shutdown_connections 2023-11-28T21:01:52.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 >> 172.21.15.167:0/2626263434 conn(0x7fdd500cb1e0 msgr2=0x7fdd50070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:52.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 shutdown_connections 2023-11-28T21:01:52.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:52.850+0000 7fdd54eea640 1 -- 172.21.15.167:0/2626263434 wait complete. 2023-11-28T21:01:52.880 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:01:52.880 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T21:01:52.880 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:01:53.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53fcdc1640 1 Processor -- start 2023-11-28T21:01:53.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53fcdc1640 1 -- start start 2023-11-28T21:01:53.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53fcdc1640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f53f8070480 0x7f53f8071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53fcdc1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f53f806e410 0x7f53f8072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53fcdc1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f81571d0 con 0x7f53f806e030 2023-11-28T21:01:53.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53fcdc1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f8071a90 con 0x7f53f806e410 2023-11-28T21:01:53.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53fcdc1640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f80c70d0 con 0x7f53f8070480 2023-11-28T21:01:53.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53f6d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f53f806e410 0x7f53f8072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53f6d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f53f806e410 0x7f53f8072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34404/0 (socket says 172.21.15.167:34404) 2023-11-28T21:01:53.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53f6d9d640 1 -- 172.21.15.167:0/653701026 learned_addr learned my addr 172.21.15.167:0/653701026 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:53.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53f659c640 1 --1- 172.21.15.167:0/653701026 >> v1:172.21.15.167:6789/0 conn(0x7f53f806e030 0x7f53f81500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51496/0 (socket says 172.21.15.167:51496) 2023-11-28T21:01:53.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.018+0000 7f53effff640 1 --2- 172.21.15.167:0/653701026 >> v2:172.21.15.178:3300/0 conn(0x7f53f8070480 0x7f53f8071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53f6d9d640 1 -- 172.21.15.167:0/653701026 >> v2:172.21.15.178:3300/0 conn(0x7f53f8070480 msgr2=0x7f53f8071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:01:53.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53f6d9d640 1 --2- 172.21.15.167:0/653701026 >> v2:172.21.15.178:3300/0 conn(0x7f53f8070480 0x7f53f8071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53f6d9d640 1 -- 172.21.15.167:0/653701026 >> v1:172.21.15.167:6789/0 conn(0x7f53f806e030 legacy=0x7f53f81500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53f6d9d640 1 -- 172.21.15.167:0/653701026 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80c73b0 con 0x7f53f806e410 2023-11-28T21:01:53.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53f6d9d640 1 --2- 172.21.15.167:0/653701026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f806e410 0x7f53f8072460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f53f806b790 tx=0x7f53f001daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90796800e352f307 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:53.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53f5d9b640 1 -- 172.21.15.167:0/653701026 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000a2d0 con 0x7f53f806e410 2023-11-28T21:01:53.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53f5d9b640 1 -- 172.21.15.167:0/653701026 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f00a6960 con 0x7f53f806e410 2023-11-28T21:01:53.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53f5d9b640 1 -- 172.21.15.167:0/653701026 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f00a6cf0 con 0x7f53f806e410 2023-11-28T21:01:53.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53fcdc1640 1 -- 172.21.15.167:0/653701026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f806e410 msgr2=0x7f53f8072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53fcdc1640 1 --2- 172.21.15.167:0/653701026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f806e410 0x7f53f8072460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f53f806b790 tx=0x7f53f001daa0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53fcdc1640 1 -- 172.21.15.167:0/653701026 shutdown_connections 2023-11-28T21:01:53.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53fcdc1640 1 --2- 172.21.15.167:0/653701026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f806e410 0x7f53f8072460 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53fcdc1640 1 --2- 172.21.15.167:0/653701026 >> v2:172.21.15.178:3300/0 conn(0x7f53f8070480 0x7f53f8071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53fcdc1640 1 -- 172.21.15.167:0/653701026 >> 172.21.15.167:0/653701026 conn(0x7f53f80cb1e0 msgr2=0x7f53f80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:53.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53fcdc1640 1 -- 172.21.15.167:0/653701026 shutdown_connections 2023-11-28T21:01:53.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.022+0000 7f53fcdc1640 1 -- 172.21.15.167:0/653701026 wait complete. 2023-11-28T21:01:53.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53fcdc1640 1 Processor -- start 2023-11-28T21:01:53.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53fcdc1640 1 -- start start 2023-11-28T21:01:53.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53fcdc1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f806e030 0x7f53f81f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53fcdc1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f806e410 0x7f53f8155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53fcdc1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f8070480 0x7f53f8155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53fcdc1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81429f0 con 0x7f53f8070480 2023-11-28T21:01:53.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53fcdc1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8155260 con 0x7f53f806e030 2023-11-28T21:01:53.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53fcdc1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80c9a80 con 0x7f53f806e410 2023-11-28T21:01:53.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f8070480 0x7f53f8155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f8070480 0x7f53f8155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34418/0 (socket says 172.21.15.167:34418) 2023-11-28T21:01:53.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f6d9d640 1 -- 172.21.15.167:0/2368970448 learned_addr learned my addr 172.21.15.167:0/2368970448 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:53.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f659c640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f806e030 0x7f53f81f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53effff640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f806e410 0x7f53f8155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f6d9d640 1 -- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f806e410 msgr2=0x7f53f8155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f6d9d640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f806e410 0x7f53f8155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f6d9d640 1 -- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f806e030 msgr2=0x7f53f81f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f6d9d640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f806e030 0x7f53f81f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f6d9d640 1 -- 172.21.15.167:0/2368970448 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f000ac40 con 0x7f53f8070480 2023-11-28T21:01:53.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53effff640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f806e410 0x7f53f8155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:01:53.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53f6d9d640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f8070480 0x7f53f8155dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f53f001a6b0 tx=0x7f53f001a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:53.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.026+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0008500 con 0x7f53f8070480 2023-11-28T21:01:53.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f0008680 con 0x7f53f8070480 2023-11-28T21:01:53.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0008a30 con 0x7f53f8070480 2023-11-28T21:01:53.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f8142710 con 0x7f53f8070480 2023-11-28T21:01:53.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f80ca620 con 0x7f53f8070480 2023-11-28T21:01:53.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53fcdc1640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f814d6f0 0x7f53f813db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8074770 con 0x7f53f814d6f0 2023-11-28T21:01:53.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53f659c640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f814d6f0 0x7f53f813db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53f659c640 1 -- 172.21.15.167:0/2368970448 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53f806ba80 con 0x7f53f814d6f0 2023-11-28T21:01:53.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53f0008b90 con 0x7f53f8070480 2023-11-28T21:01:53.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53f659c640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f814d6f0 0x7f53f813db00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53e8001450 tx=0x7f53e8001910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:53.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f53d8066470 0x7f53d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f53f011f850 con 0x7f53f8070480 2023-11-28T21:01:53.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8017070 con 0x7f53f814d6f0 2023-11-28T21:01:53.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53effff640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f53d8066470 0x7f53d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f53e80115d0 con 0x7f53f814d6f0 2023-11-28T21:01:53.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f814d6f0 msgr2=0x7f53f813db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f814d6f0 0x7f53f813db00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53e8001450 tx=0x7f53e8001910 comp rx=0 tx=0).stop 2023-11-28T21:01:53.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f814d6f0 msgr2=0x7f53f813db00 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:53.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.030+0000 7f53eeffd640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f814d6f0 0x7f53f813db00 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53e8001450 tx=0x7f53e8001910 comp rx=0 tx=0).stop 2023-11-28T21:01:53.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.034+0000 7f53effff640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f53d8066470 0x7f53d8068930 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f53f815f5c0 tx=0x7f53e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:53.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.038+0000 7f53fcdc1640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f80c21b0 0x7f53f813e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.038+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8162b80 con 0x7f53f80c21b0 2023-11-28T21:01:53.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.038+0000 7f53f659c640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f80c21b0 0x7f53f813e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.038+0000 7f53f659c640 1 -- 172.21.15.167:0/2368970448 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f53f80682c0 con 0x7f53f80c21b0 2023-11-28T21:01:53.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.038+0000 7f53f659c640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f80c21b0 0x7f53f813e040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53e8015040 tx=0x7f53e8001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:53.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.038+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8023070 con 0x7f53f80c21b0 2023-11-28T21:01:53.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4641 (secure 0 0 0) 0x7f53e801e110 con 0x7f53f80c21b0 2023-11-28T21:01:53.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f80c21b0 msgr2=0x7f53f813e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53eeffd640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f80c21b0 0x7f53f813e040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53e8015040 tx=0x7f53e8001090 comp rx=0 tx=0).stop 2023-11-28T21:01:53.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53eeffd640 1 -- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f80c21b0 msgr2=0x7f53f813e040 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:01:53.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53eeffd640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f80c21b0 0x7f53f813e040 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53e8015040 tx=0x7f53e8001090 comp rx=0 tx=0).stop 2023-11-28T21:01:53.045 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:01:53.045 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:53.046 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:53.046 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:01:53.046 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 180, 2023-11-28T21:01:53.046 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:01:53.046 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:01:53.047 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:01:53.047 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:01:53.047 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:53.047 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 14, 2023-11-28T21:01:53.047 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:53.047 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:01:53.048 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:01:53.048 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:53.048 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:53.048 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:53.048 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:53.049 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:53.049 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:53.049 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:53.049 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:53.049 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:53.049 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:53.049 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:53.050 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:01:53.050 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:01:53.050 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:53.050 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:53.050 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:53.050 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:53.050 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:53.051 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:53.051 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:53.051 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:53.051 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:53.051 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:53.051 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:53.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.052 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:01:53.052 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:01:53.052 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:01:53.052 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:01:53.052 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:01:53.052 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:01:53.052 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:53.053 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:01:53.053 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:01:53.053 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:01:53.053 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:01:53.053 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:01:53.053 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:01:53.053 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:01:53.054 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:01:53.055 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:01:53.056 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:53.056 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:53.056 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.056 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:53.056 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:01:53.056 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:53.057 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.057 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.057 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:53.057 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:01:53.057 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:53.058 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:53.058 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:53.058 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.058 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:01:53.058 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:01:53.058 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:53.059 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:53.059 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:53.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.059 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.059 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:01:53.059 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:01:53.059 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:53.059 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:53.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.060 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:53.060 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:01:53.060 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:53.060 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.060 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.060 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:53.060 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:01:53.060 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:53.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.062 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.062 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:01:53.062 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:01:53.062 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:01:53.062 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:53.063 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:01:53.064 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:53.065 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:01:53.066 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:01:53.066 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:01:53.066 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:01:53.066 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:01:53.066 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:01:53.066 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:01:53.066 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:01:53.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:01:53.067 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:01:53.067 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:01:53.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f53d8066470 msgr2=0x7f53d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53fcdc1640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f53d8066470 0x7f53d8068930 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f53f815f5c0 tx=0x7f53e0008040 comp rx=0 tx=0).stop 2023-11-28T21:01:53.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f8070480 msgr2=0x7f53f8155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53fcdc1640 1 --2- 172.21.15.167:0/2368970448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f8070480 0x7f53f8155dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f53f001a6b0 tx=0x7f53f001a840 comp rx=0 tx=0).stop 2023-11-28T21:01:53.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53f6d9d640 1 -- 172.21.15.167:0/2368970448 reap_dead start 2023-11-28T21:01:53.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53f6d9d640 1 -- 172.21.15.167:0/2368970448 reap_dead start 2023-11-28T21:01:53.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 shutdown_connections 2023-11-28T21:01:53.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 >> 172.21.15.167:0/2368970448 conn(0x7f53f80cb1e0 msgr2=0x7f53f815f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:53.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 shutdown_connections 2023-11-28T21:01:53.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.042+0000 7f53fcdc1640 1 -- 172.21.15.167:0/2368970448 wait complete. 2023-11-28T21:01:53.069 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:01:53.070 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2023-11-28T21:01:53.070 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T21:01:53.070 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2023-11-28T21:01:53.070 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T21:01:53.070 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T21:01:53.070 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:01:53.089 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T21:01:53.089 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T21:01:53.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:01:53.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.266+0000 7fbd1d0d6640 1 Processor -- start 2023-11-28T21:01:53.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.266+0000 7fbd1d0d6640 1 -- start start 2023-11-28T21:01:53.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1d0d6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd180ca560 0x7fbd180c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1d0d6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbd180ca940 0x7fbd180cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1d0d6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd18159e60 con 0x7fbd180c6d00 2023-11-28T21:01:53.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1d0d6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd180c32f0 con 0x7fbd180ca560 2023-11-28T21:01:53.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1d0d6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd18154410 con 0x7fbd180ca940 2023-11-28T21:01:53.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd16d9d640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7fbd180ca560 msgr2=0x7fbd180c97c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:01:53.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd16d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd180ca560 0x7fbd180c97c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:53.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1659c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbd180ca940 0x7fbd180cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1659c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbd180ca940 0x7fbd180cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:43120/0 (socket says 172.21.15.167:43120) 2023-11-28T21:01:53.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1659c640 1 -- 172.21.15.167:0/3928678000 learned_addr learned my addr 172.21.15.167:0/3928678000 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:53.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1659c640 1 -- 172.21.15.167:0/3928678000 >> v2:172.21.15.167:3300/0 conn(0x7fbd180ca560 msgr2=0x7fbd180c97c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:53.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1659c640 1 --2- 172.21.15.167:0/3928678000 >> v2:172.21.15.167:3300/0 conn(0x7fbd180ca560 0x7fbd180c97c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1659c640 1 -- 172.21.15.167:0/3928678000 >> v1:172.21.15.178:6789/0 conn(0x7fbd180c6d00 legacy=0x7fbd180c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.270+0000 7fbd1659c640 1 -- 172.21.15.167:0/3928678000 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1815a100 con 0x7fbd180ca940 2023-11-28T21:01:53.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1659c640 1 --2- 172.21.15.167:0/3928678000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 0x7fbd180cb0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd1806f850 tx=0x7fbd0c01c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=336cf97da12c0ed3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:53.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd15d9b640 1 -- 172.21.15.167:0/3928678000 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0ab600 con 0x7fbd180ca940 2023-11-28T21:01:53.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd15d9b640 1 -- 172.21.15.167:0/3928678000 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c0a7050 con 0x7fbd180ca940 2023-11-28T21:01:53.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd15d9b640 1 -- 172.21.15.167:0/3928678000 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0ab980 con 0x7fbd180ca940 2023-11-28T21:01:53.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/3928678000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 msgr2=0x7fbd180cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 --2- 172.21.15.167:0/3928678000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 0x7fbd180cb0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd1806f850 tx=0x7fbd0c01c400 comp rx=0 tx=0).stop 2023-11-28T21:01:53.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/3928678000 shutdown_connections 2023-11-28T21:01:53.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 --2- 172.21.15.167:0/3928678000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 0x7fbd180cb0a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 --2- 172.21.15.167:0/3928678000 >> v2:172.21.15.167:3300/0 conn(0x7fbd180ca560 0x7fbd180c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/3928678000 >> 172.21.15.167:0/3928678000 conn(0x7fbd1806a580 msgr2=0x7fbd1806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:53.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/3928678000 shutdown_connections 2023-11-28T21:01:53.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/3928678000 wait complete. 2023-11-28T21:01:53.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 Processor -- start 2023-11-28T21:01:53.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.274+0000 7fbd1d0d6640 1 -- start start 2023-11-28T21:01:53.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1d0d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd180c6d00 0x7fbd1815af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1d0d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd180ca560 0x7fbd18154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1d0d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 0x7fbd181f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1d0d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1815cdb0 con 0x7fbd180ca560 2023-11-28T21:01:53.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1d0d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1815c970 con 0x7fbd180ca940 2023-11-28T21:01:53.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1d0d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1815d130 con 0x7fbd180c6d00 2023-11-28T21:01:53.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1659c640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd180ca560 msgr2=0x7fbd18154de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:01:53.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd180ca560 0x7fbd18154de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:53.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1759e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 0x7fbd181f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1759e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 0x7fbd181f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:43126/0 (socket says 172.21.15.167:43126) 2023-11-28T21:01:53.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1759e640 1 -- 172.21.15.167:0/2456000682 learned_addr learned my addr 172.21.15.167:0/2456000682 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:53.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd16d9d640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd180c6d00 0x7fbd1815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1759e640 1 -- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd180c6d00 msgr2=0x7fbd1815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1759e640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd180c6d00 0x7fbd1815af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1759e640 1 -- 172.21.15.167:0/2456000682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd180ca560 msgr2=0x7fbd18154de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:01:53.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1759e640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd180ca560 0x7fbd18154de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1759e640 1 -- 172.21.15.167:0/2456000682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c0094d0 con 0x7fbd180ca940 2023-11-28T21:01:53.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd16d9d640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd180c6d00 0x7fbd1815af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:01:53.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1759e640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 0x7fbd181f60c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c770 tx=0x7fbd1000cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:53.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbcff7fe640 1 -- 172.21.15.167:0/2456000682 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10003b80 con 0x7fbd180ca940 2023-11-28T21:01:53.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1815b730 con 0x7fbd180ca940 2023-11-28T21:01:53.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbcff7fe640 1 -- 172.21.15.167:0/2456000682 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10003ce0 con 0x7fbd180ca940 2023-11-28T21:01:53.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbcff7fe640 1 -- 172.21.15.167:0/2456000682 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000aa90 con 0x7fbd180ca940 2023-11-28T21:01:53.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1815d6b0 con 0x7fbd180ca940 2023-11-28T21:01:53.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.278+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd18067c40 con 0x7fbd180ca940 2023-11-28T21:01:53.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.282+0000 7fbcff7fe640 1 -- 172.21.15.167:0/2456000682 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd1000abf0 con 0x7fbd180ca940 2023-11-28T21:01:53.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.282+0000 7fbcff7fe640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd04066420 0x7fbd040688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:53.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.282+0000 7fbcff7fe640 1 -- 172.21.15.167:0/2456000682 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fbd10084b80 con 0x7fbd180ca940 2023-11-28T21:01:53.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.282+0000 7fbd16d9d640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd04066420 0x7fbd040688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:53.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.282+0000 7fbd16d9d640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd04066420 0x7fbd040688e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbd08003990 tx=0x7fbd08003ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:53.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.294+0000 7fbcff7fe640 1 -- 172.21.15.167:0/2456000682 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd10051b80 con 0x7fbd180ca940 2023-11-28T21:01:53.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbd18075c90 con 0x7fbd180ca940 2023-11-28T21:01:53.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbcff7fe640 1 -- 172.21.15.167:0/2456000682 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fbd100551a0 con 0x7fbd180ca940 2023-11-28T21:01:53.498 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:01:53.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd04066420 msgr2=0x7fbd040688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd04066420 0x7fbd040688e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbd08003990 tx=0x7fbd08003ba0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 msgr2=0x7fbd181f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 0x7fbd181f60c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c770 tx=0x7fbd1000cc30 comp rx=0 tx=0).stop 2023-11-28T21:01:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 shutdown_connections 2023-11-28T21:01:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd04066420 0x7fbd040688e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd180ca940 0x7fbd181f60c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd180ca560 0x7fbd18154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 --2- 172.21.15.167:0/2456000682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd180c6d00 0x7fbd1815af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.498+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 >> 172.21.15.167:0/2456000682 conn(0x7fbd1806a580 msgr2=0x7fbd1806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.502+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 shutdown_connections 2023-11-28T21:01:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:53.502+0000 7fbd1d0d6640 1 -- 172.21.15.167:0/2456000682 wait complete. 2023-11-28T21:01:54.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~161s 2023-11-28T21:01:56.521 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:01:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.665+0000 7fb2ba6c9640 1 Processor -- start 2023-11-28T21:01:56.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.665+0000 7fb2ba6c9640 1 -- start start 2023-11-28T21:01:56.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2ba6c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c6ff0 0x7fb2b4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2ba6c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b40c4940 con 0x7fb2b40c4510 2023-11-28T21:01:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2ba6c9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b40c6ac0 con 0x7fb2b4150b40 2023-11-28T21:01:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2ba6c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b40c62f0 con 0x7fb2b40c6ff0 2023-11-28T21:01:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2b8c66640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fb2b40c4510 legacy=0x7fb2b406a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:01:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2b3fff640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb2b4150b40 0x7fb2b40c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:46164/0 (socket says 172.21.15.167:46164) 2023-11-28T21:01:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2b37fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c6ff0 0x7fb2b4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:56.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2b3fff640 1 -- 172.21.15.167:0/251793809 learned_addr learned my addr 172.21.15.167:0/251793809 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:01:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2b2ffd640 1 -- 172.21.15.167:0/251793809 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917367358 0 0) 0x7fb2b40c6ac0 con 0x7fb2b4150b40 2023-11-28T21:01:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2b2ffd640 1 -- 172.21.15.167:0/251793809 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb29c003530 con 0x7fb2b4150b40 2023-11-28T21:01:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2b37fe640 1 -- 172.21.15.167:0/251793809 >> v1:172.21.15.178:6789/0 conn(0x7fb2b4150b40 legacy=0x7fb2b40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2b37fe640 1 -- 172.21.15.167:0/251793809 >> v1:172.21.15.167:6789/0 conn(0x7fb2b40c4510 legacy=0x7fb2b406a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:01:56.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.669+0000 7fb2b37fe640 1 -- 172.21.15.167:0/251793809 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b40c6500 con 0x7fb2b40c6ff0 2023-11-28T21:01:56.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2b37fe640 1 --2- 172.21.15.167:0/251793809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c6ff0 0x7fb2b4157560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80097f0 tx=0x7fb2a801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7215aad510b01dd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2b2ffd640 1 -- 172.21.15.167:0/251793809 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80ab650 con 0x7fb2b40c6ff0 2023-11-28T21:01:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2b2ffd640 1 -- 172.21.15.167:0/251793809 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a80ab7b0 con 0x7fb2b40c6ff0 2023-11-28T21:01:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2b2ffd640 1 -- 172.21.15.167:0/251793809 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80abb20 con 0x7fb2b40c6ff0 2023-11-28T21:01:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/251793809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c6ff0 msgr2=0x7fb2b4157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2ba6c9640 1 --2- 172.21.15.167:0/251793809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c6ff0 0x7fb2b4157560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80097f0 tx=0x7fb2a801c450 comp rx=0 tx=0).stop 2023-11-28T21:01:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/251793809 shutdown_connections 2023-11-28T21:01:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2ba6c9640 1 --2- 172.21.15.167:0/251793809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c6ff0 0x7fb2b4157560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/251793809 >> 172.21.15.167:0/251793809 conn(0x7fb2b40cb1e0 msgr2=0x7fb2b40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/251793809 shutdown_connections 2023-11-28T21:01:56.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/251793809 wait complete. 2023-11-28T21:01:56.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2ba6c9640 1 Processor -- start 2023-11-28T21:01:56.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.673+0000 7fb2ba6c9640 1 -- start start 2023-11-28T21:01:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2ba6c9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c4510 0x7fb2b40c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2ba6c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b40c6ff0 0x7fb2b41fa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2ba6c9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2b4150b40 0x7fb2b4154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2ba6c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41f6970 con 0x7fb2b40c6ff0 2023-11-28T21:01:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2ba6c9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41f7920 con 0x7fb2b4150b40 2023-11-28T21:01:56.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2ba6c9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41fae30 con 0x7fb2b40c4510 2023-11-28T21:01:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b37fe640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b40c6ff0 msgr2=0x7fb2b41fa8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:01:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b40c6ff0 0x7fb2b41fa8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:01:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c4510 0x7fb2b40c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b8c66640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2b4150b40 0x7fb2b4154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c4510 0x7fb2b40c1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:38464/0 (socket says 172.21.15.167:38464) 2023-11-28T21:01:56.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b3fff640 1 -- 172.21.15.167:0/3527301434 learned_addr learned my addr 172.21.15.167:0/3527301434 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:01:56.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b3fff640 1 -- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2b4150b40 msgr2=0x7fb2b4154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:56.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b3fff640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2b4150b40 0x7fb2b4154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:56.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b3fff640 1 -- 172.21.15.167:0/3527301434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b40c6ff0 msgr2=0x7fb2b41fa8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b3fff640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b40c6ff0 0x7fb2b41fa8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b3fff640 1 -- 172.21.15.167:0/3527301434 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009420 con 0x7fb2b40c4510 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b8c66640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2b4150b40 0x7fb2b4154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b3fff640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c4510 0x7fb2b40c1b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c420 tx=0x7fb2a400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b0ff9640 1 -- 172.21.15.167:0/3527301434 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005cf0 con 0x7fb2b40c4510 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b0ff9640 1 -- 172.21.15.167:0/3527301434 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4005e50 con 0x7fb2b40c4510 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b41f7490 con 0x7fb2b40c4510 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2b0ff9640 1 -- 172.21.15.167:0/3527301434 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40072d0 con 0x7fb2b40c4510 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b41f6b60 con 0x7fb2b40c4510 2023-11-28T21:01:56.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.677+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b40682c0 con 0x7fb2b40c4510 2023-11-28T21:01:56.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.681+0000 7fb2b0ff9640 1 -- 172.21.15.167:0/3527301434 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2a4007430 con 0x7fb2b40c4510 2023-11-28T21:01:56.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.681+0000 7fb2b0ff9640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2a0066420 0x7fb2a00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:01:56.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.681+0000 7fb2b0ff9640 1 -- 172.21.15.167:0/3527301434 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb2a4083eb0 con 0x7fb2b40c4510 2023-11-28T21:01:56.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.681+0000 7fb2b37fe640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2a0066420 0x7fb2a00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:01:56.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.681+0000 7fb2b37fe640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2a0066420 0x7fb2a00688e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80af000 tx=0x7fb2a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:01:56.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.693+0000 7fb2b0ff9640 1 -- 172.21.15.167:0/3527301434 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2a4051190 con 0x7fb2b40c4510 2023-11-28T21:01:56.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb2b4075c90 con 0x7fb2b40c4510 2023-11-28T21:01:56.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2b0ff9640 1 -- 172.21.15.167:0/3527301434 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fb2a4021630 con 0x7fb2b40c4510 2023-11-28T21:01:56.898 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:01:56.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2a0066420 msgr2=0x7fb2a00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:56.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2a0066420 0x7fb2a00688e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80af000 tx=0x7fb2a8008040 comp rx=0 tx=0).stop 2023-11-28T21:01:56.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c4510 msgr2=0x7fb2b40c1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:01:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c4510 0x7fb2b40c1b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c420 tx=0x7fb2a400c8e0 comp rx=0 tx=0).stop 2023-11-28T21:01:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 shutdown_connections 2023-11-28T21:01:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb2a0066420 0x7fb2a00688e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2b4150b40 0x7fb2b4154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2b40c6ff0 0x7fb2b41fa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.897+0000 7fb2ba6c9640 1 --2- 172.21.15.167:0/3527301434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2b40c4510 0x7fb2b40c1b20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:01:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.901+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 >> 172.21.15.167:0/3527301434 conn(0x7fb2b40cb1e0 msgr2=0x7fb2b406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:01:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.901+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 shutdown_connections 2023-11-28T21:01:56.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:01:56.901+0000 7fb2ba6c9640 1 -- 172.21.15.167:0/3527301434 wait complete. 2023-11-28T21:01:59.920 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:00.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.065+0000 7f09a3ec9640 1 Processor -- start 2023-11-28T21:02:00.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.065+0000 7f09a3ec9640 1 -- start start 2023-11-28T21:02:00.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a3ec9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f099c151f60 0x7f099c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:00.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a3ec9640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f099c0c5c90 0x7f099c0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:00.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a3ec9640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c0c6120 con 0x7f099c06a580 2023-11-28T21:02:00.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a3ec9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c0c4da0 con 0x7f099c151f60 2023-11-28T21:02:00.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a3ec9640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c15b220 con 0x7f099c0c5c90 2023-11-28T21:02:00.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a1c65640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f099c151f60 msgr2=0x7f099c0c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:00.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a1c65640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f099c151f60 0x7f099c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:00.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a1464640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f099c0c5c90 0x7f099c0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:00.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a1464640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f099c0c5c90 0x7f099c0c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:43136/0 (socket says 172.21.15.167:43136) 2023-11-28T21:02:00.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a1464640 1 -- 172.21.15.167:0/1122914577 learned_addr learned my addr 172.21.15.167:0/1122914577 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:00.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a1464640 1 -- 172.21.15.167:0/1122914577 >> v2:172.21.15.167:3300/0 conn(0x7f099c151f60 msgr2=0x7f099c0c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:00.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a1464640 1 --2- 172.21.15.167:0/1122914577 >> v2:172.21.15.167:3300/0 conn(0x7f099c151f60 0x7f099c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a1464640 1 -- 172.21.15.167:0/1122914577 >> v1:172.21.15.178:6789/0 conn(0x7f099c06a580 legacy=0x7f099c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:00.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.069+0000 7f09a1464640 1 -- 172.21.15.167:0/1122914577 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c152340 con 0x7f099c0c5c90 2023-11-28T21:02:00.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a1464640 1 --2- 172.21.15.167:0/1122914577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 0x7f099c0c26e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f099c0c8d80 tx=0x7f098c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e7fb1c148e0196e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:00.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a0c63640 1 -- 172.21.15.167:0/1122914577 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0ad680 con 0x7f099c0c5c90 2023-11-28T21:02:00.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a0c63640 1 -- 172.21.15.167:0/1122914577 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c0ad7e0 con 0x7f099c0c5c90 2023-11-28T21:02:00.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a0c63640 1 -- 172.21.15.167:0/1122914577 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0adb70 con 0x7f099c0c5c90 2023-11-28T21:02:00.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 -- 172.21.15.167:0/1122914577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 msgr2=0x7f099c0c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:00.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 --2- 172.21.15.167:0/1122914577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 0x7f099c0c26e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f099c0c8d80 tx=0x7f098c01c490 comp rx=0 tx=0).stop 2023-11-28T21:02:00.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 -- 172.21.15.167:0/1122914577 shutdown_connections 2023-11-28T21:02:00.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 --2- 172.21.15.167:0/1122914577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 0x7f099c0c26e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 --2- 172.21.15.167:0/1122914577 >> v2:172.21.15.167:3300/0 conn(0x7f099c151f60 0x7f099c0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 -- 172.21.15.167:0/1122914577 >> 172.21.15.167:0/1122914577 conn(0x7f099c0cb1e0 msgr2=0x7f099c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:00.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 -- 172.21.15.167:0/1122914577 shutdown_connections 2023-11-28T21:02:00.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 -- 172.21.15.167:0/1122914577 wait complete. 2023-11-28T21:02:00.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 Processor -- start 2023-11-28T21:02:00.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.073+0000 7f09a3ec9640 1 -- start start 2023-11-28T21:02:00.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a3ec9640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f099c06a580 0x7f099c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:00.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a3ec9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 0x7f099c162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:00.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a3ec9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f099c151f60 0x7f099c0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:00.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a3ec9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c1f2b50 con 0x7f099c151f60 2023-11-28T21:02:00.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a3ec9640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c1f2e10 con 0x7f099c0c5c90 2023-11-28T21:02:00.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a3ec9640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c1f30f0 con 0x7f099c06a580 2023-11-28T21:02:00.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a2466640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f099c151f60 msgr2=0x7f099c0c9350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:00.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a2466640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f099c151f60 0x7f099c0c9350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:00.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1c65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f099c06a580 0x7f099c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:00.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1464640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 0x7f099c162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:00.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1c65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f099c06a580 0x7f099c15a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:38478/0 (socket says 172.21.15.167:38478) 2023-11-28T21:02:00.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1c65640 1 -- 172.21.15.167:0/2663682474 learned_addr learned my addr 172.21.15.167:0/2663682474 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:00.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1464640 1 -- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f099c06a580 msgr2=0x7f099c15a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:00.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1464640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f099c06a580 0x7f099c15a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1464640 1 -- 172.21.15.167:0/2663682474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f099c151f60 msgr2=0x7f099c0c9350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:00.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1464640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f099c151f60 0x7f099c0c9350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1464640 1 -- 172.21.15.167:0/2663682474 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c0094d0 con 0x7f099c0c5c90 2023-11-28T21:02:00.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a1464640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 0x7f099c162ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f098c0ac000 tx=0x7f098c01acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:00.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09927fc640 1 -- 172.21.15.167:0/2663682474 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0b8650 con 0x7f099c0c5c90 2023-11-28T21:02:00.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c1f33d0 con 0x7f099c0c5c90 2023-11-28T21:02:00.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09927fc640 1 -- 172.21.15.167:0/2663682474 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c0b87d0 con 0x7f099c0c5c90 2023-11-28T21:02:00.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09927fc640 1 -- 172.21.15.167:0/2663682474 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0b8b80 con 0x7f099c0c5c90 2023-11-28T21:02:00.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c0723f0 con 0x7f099c0c5c90 2023-11-28T21:02:00.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.077+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c0682c0 con 0x7f099c0c5c90 2023-11-28T21:02:00.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.081+0000 7f09927fc640 1 -- 172.21.15.167:0/2663682474 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f098c0b4070 con 0x7f099c0c5c90 2023-11-28T21:02:00.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.081+0000 7f09927fc640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0980066450 0x7f0980068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:00.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.081+0000 7f09927fc640 1 -- 172.21.15.167:0/2663682474 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f098c11ee20 con 0x7f099c0c5c90 2023-11-28T21:02:00.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.081+0000 7f09a1c65640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0980066450 0x7f0980068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:00.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.081+0000 7f09a1c65640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0980066450 0x7f0980068910 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0998009470 tx=0x7f0998009400 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:00.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.093+0000 7f09927fc640 1 -- 172.21.15.167:0/2663682474 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f098c0ebea0 con 0x7f099c0c5c90 2023-11-28T21:02:00.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.297+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f099c1f3230 con 0x7f099c0c5c90 2023-11-28T21:02:00.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.297+0000 7f09927fc640 1 -- 172.21.15.167:0/2663682474 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f098c0b2630 con 0x7f099c0c5c90 2023-11-28T21:02:00.299 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":180,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:00.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0980066450 msgr2=0x7f0980068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:00.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0980066450 0x7f0980068910 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0998009470 tx=0x7f0998009400 comp rx=0 tx=0).stop 2023-11-28T21:02:00.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 msgr2=0x7f099c162ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:00.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 0x7f099c162ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f098c0ac000 tx=0x7f098c01acd0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 shutdown_connections 2023-11-28T21:02:00.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0980066450 0x7f0980068910 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f099c151f60 0x7f099c0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f099c0c5c90 0x7f099c162ab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 --2- 172.21.15.167:0/2663682474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f099c06a580 0x7f099c15a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:00.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 >> 172.21.15.167:0/2663682474 conn(0x7f099c0cb1e0 msgr2=0x7f099c0c8500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:00.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 shutdown_connections 2023-11-28T21:02:00.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:00.301+0000 7f09a3ec9640 1 -- 172.21.15.167:0/2663682474 wait complete. 2023-11-28T21:02:01.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~168s 2023-11-28T21:02:03.322 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:03.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f177825f640 1 Processor -- start 2023-11-28T21:02:03.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f177825f640 1 -- start start 2023-11-28T21:02:03.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f177825f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 0x7f17700c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:03.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f177825f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1770157940 con 0x7f1770150b40 2023-11-28T21:02:03.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f177825f640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17700c6ac0 con 0x7f17700c6ff0 2023-11-28T21:02:03.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f177825f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700c62f0 con 0x7f1770157560 2023-11-28T21:02:03.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f1775ffb640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f1770150b40 legacy=0x7f17700c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:02:03.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f17767fc640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 msgr2=0x7f17700c4510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:03.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f17767fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 0x7f17700c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:03.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f17757fa640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f17700c6ff0 0x7f177006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:57576/0 (socket says 172.21.15.167:57576) 2023-11-28T21:02:03.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.473+0000 7f17757fa640 1 -- 172.21.15.167:0/973962157 learned_addr learned my addr 172.21.15.167:0/973962157 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:02:03.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.677+0000 7f17767fc640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 msgr2=0x7f17700c4510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:03.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.677+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> v1:172.21.15.167:6789/0 conn(0x7f1770150b40 legacy=0x7f17700c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:02:03.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:03.677+0000 7f17767fc640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 0x7f17700c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:02:04.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:04.081+0000 7f17767fc640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 msgr2=0x7f17700c4510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:04.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:04.081+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> v1:172.21.15.167:6789/0 conn(0x7f1770150b40 legacy=0x7f17700c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:02:04.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:04.081+0000 7f17767fc640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 0x7f17700c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:02:04.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:04.885+0000 7f17767fc640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 msgr2=0x7f17700c4510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:04.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:04.885+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> v1:172.21.15.167:6789/0 conn(0x7f1770150b40 legacy=0x7f17700c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:02:04.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:04.885+0000 7f17767fc640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 0x7f17700c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:02:06.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17677fe640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 msgr2=0x7f17700c4510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17677fe640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.167:3300/0 conn(0x7f1770157560 0x7f17700c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17677fe640 1 -- 172.21.15.167:0/973962157 >> v1:172.21.15.178:6789/0 conn(0x7f17700c6ff0 legacy=0x7f177006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17677fe640 1 -- 172.21.15.167:0/973962157 >> v1:172.21.15.167:6789/0 conn(0x7f1770150b40 legacy=0x7f17700c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17677fe640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17677fe640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17677fe640 1 -- 172.21.15.167:0/973962157 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700c62f0 con 0x7f1754008440 2023-11-28T21:02:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17677fe640 1 -- 172.21.15.167:0/973962157 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175400afb0 con 0x7f17540058d0 2023-11-28T21:02:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:06.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 msgr2=0x7f1754007d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:02:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 msgr2=0x7f1754007d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17757fa640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 msgr2=0x7f175400a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:02:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17757fa640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 msgr2=0x7f175400a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:06.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.473+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f17757fa640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 msgr2=0x7f175400a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:02:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f17757fa640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 msgr2=0x7f175400a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:06.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:06.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 msgr2=0x7f1754007d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:02:06.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 msgr2=0x7f1754007d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:06.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:06.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:02:06.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:06.677+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:02:07.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:07.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:07.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f17757fa640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 msgr2=0x7f175400a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:02:07.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f17757fa640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 msgr2=0x7f175400a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:07.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:07.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:02:07.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 msgr2=0x7f1754007d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:02:07.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 msgr2=0x7f1754007d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:07.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:07.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.081+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:02:07.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~174s 2023-11-28T21:02:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.885+0000 7f17757fa640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.885+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:07.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.885+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 msgr2=0x7f175400a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:07.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.885+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> v2:172.21.15.178:3300/0 conn(0x7f1754008440 0x7f175400a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:07.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.885+0000 7f1775ffb640 1 -- 172.21.15.167:0/973962157 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700c6500 con 0x7f17540058d0 2023-11-28T21:02:07.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f1775ffb640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f176c003990 tx=0x7f176c01d2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91d181a85bed229 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:07.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f1774ff9640 1 -- 172.21.15.167:0/973962157 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0ae410 con 0x7f17540058d0 2023-11-28T21:02:07.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f1774ff9640 1 -- 172.21.15.167:0/973962157 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0a8030 con 0x7f17540058d0 2023-11-28T21:02:07.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f1774ff9640 1 -- 172.21.15.167:0/973962157 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0ae790 con 0x7f17540058d0 2023-11-28T21:02:07.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f177825f640 1 -- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 msgr2=0x7f1754007d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:07.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f177825f640 1 --2- 172.21.15.167:0/973962157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f1754007d20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f176c003990 tx=0x7f176c01d2e0 comp rx=0 tx=0).stop 2023-11-28T21:02:07.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f17767fc640 1 -- 172.21.15.167:0/973962157 reap_dead start 2023-11-28T21:02:07.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f177825f640 1 -- 172.21.15.167:0/973962157 shutdown_connections 2023-11-28T21:02:07.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f177825f640 1 -- 172.21.15.167:0/973962157 >> 172.21.15.167:0/973962157 conn(0x7f17700cb1e0 msgr2=0x7f17700cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:07.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f177825f640 1 -- 172.21.15.167:0/973962157 shutdown_connections 2023-11-28T21:02:07.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.889+0000 7f177825f640 1 -- 172.21.15.167:0/973962157 wait complete. 2023-11-28T21:02:07.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 Processor -- start 2023-11-28T21:02:07.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 -- start start 2023-11-28T21:02:07.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f17701f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:07.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f177014dfd0 0x7f1770148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:07.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17701e5ee0 0x7f17701e6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:07.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177014cac0 con 0x7f177014dfd0 2023-11-28T21:02:07.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1770149d90 con 0x7f17701e5ee0 2023-11-28T21:02:07.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17701f39a0 con 0x7f17540058d0 2023-11-28T21:02:07.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f17757fa640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f177014dfd0 msgr2=0x7f1770148a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:07.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f17757fa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f177014dfd0 0x7f1770148a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:07.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f1775ffb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f17701f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:07.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f17767fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17701e5ee0 0x7f17701e6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:07.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f1775ffb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f17701f3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:53862/0 (socket says 172.21.15.167:53862) 2023-11-28T21:02:07.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f1775ffb640 1 -- 172.21.15.167:0/4009953327 learned_addr learned my addr 172.21.15.167:0/4009953327 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:07.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f1775ffb640 1 -- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17701e5ee0 msgr2=0x7f17701e6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:07.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f1775ffb640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17701e5ee0 0x7f17701e6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:07.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f1775ffb640 1 -- 172.21.15.167:0/4009953327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f177014dfd0 msgr2=0x7f1770148a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:07.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f1775ffb640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f177014dfd0 0x7f1770148a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:07.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f1775ffb640 1 -- 172.21.15.167:0/4009953327 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c005170 con 0x7f17540058d0 2023-11-28T21:02:07.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f1775ffb640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f17701f3460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f176c01b990 tx=0x7f176c01bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:07.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f17667fc640 1 -- 172.21.15.167:0/4009953327 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0b9660 con 0x7f17540058d0 2023-11-28T21:02:07.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f17667fc640 1 -- 172.21.15.167:0/4009953327 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0b97c0 con 0x7f17540058d0 2023-11-28T21:02:07.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17701f1040 con 0x7f17540058d0 2023-11-28T21:02:07.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f17667fc640 1 -- 172.21.15.167:0/4009953327 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0b9930 con 0x7f17540058d0 2023-11-28T21:02:07.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.893+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177014e5a0 con 0x7f17540058d0 2023-11-28T21:02:07.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.897+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17700682c0 con 0x7f17540058d0 2023-11-28T21:02:07.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.897+0000 7f17667fc640 1 -- 172.21.15.167:0/4009953327 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f176c0b5070 con 0x7f17540058d0 2023-11-28T21:02:07.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.897+0000 7f17667fc640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1754069a70 0x7f175406bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:07.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.897+0000 7f17667fc640 1 -- 172.21.15.167:0/4009953327 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f176c11fdf0 con 0x7f17540058d0 2023-11-28T21:02:07.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.897+0000 7f17757fa640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1754069a70 0x7f175406bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:07.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.901+0000 7f17757fa640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1754069a70 0x7f175406bf30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1760000c10 tx=0x7f1760009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:07.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:07.909+0000 7f17667fc640 1 -- 172.21.15.167:0/4009953327 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f176c0ed080 con 0x7f17540058d0 2023-11-28T21:02:08.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.117+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1770075c90 con 0x7f17540058d0 2023-11-28T21:02:08.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.117+0000 7f17667fc640 1 -- 172.21.15.167:0/4009953327 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f176c0b3620 con 0x7f17540058d0 2023-11-28T21:02:08.119 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":182,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:08.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1754069a70 msgr2=0x7f175406bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1754069a70 0x7f175406bf30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1760000c10 tx=0x7f1760009040 comp rx=0 tx=0).stop 2023-11-28T21:02:08.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 msgr2=0x7f17701f3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f17701f3460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f176c01b990 tx=0x7f176c01bb20 comp rx=0 tx=0).stop 2023-11-28T21:02:08.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 shutdown_connections 2023-11-28T21:02:08.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1754069a70 0x7f175406bf30 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17701e5ee0 0x7f17701e6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f177014dfd0 0x7f1770148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 --2- 172.21.15.167:0/4009953327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17540058d0 0x7f17701f3460 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 >> 172.21.15.167:0/4009953327 conn(0x7f17700cb1e0 msgr2=0x7f1770154dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:08.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 shutdown_connections 2023-11-28T21:02:08.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.121+0000 7f177825f640 1 -- 172.21.15.167:0/4009953327 wait complete. 2023-11-28T21:02:08.141 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T21:02:08.141 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T21:02:08.141 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:02:08.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.277+0000 7f57e4ad6640 1 Processor -- start 2023-11-28T21:02:08.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.277+0000 7f57e4ad6640 1 -- start start 2023-11-28T21:02:08.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.277+0000 7f57e4ad6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57e0150b40 0x7f57e0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.277+0000 7f57e4ad6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f57e00c4510 0x7f57e006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.277+0000 7f57e4ad6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e00c48f0 con 0x7f57e00c6ff0 2023-11-28T21:02:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.277+0000 7f57e4ad6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e00c62f0 con 0x7f57e00c4510 2023-11-28T21:02:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.277+0000 7f57e4ad6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e00c6ac0 con 0x7f57e0150b40 2023-11-28T21:02:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.281+0000 7f57ded9d640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f57e00c4510 msgr2=0x7f57e006a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.281+0000 7f57ded9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f57e00c4510 0x7f57e006a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.281+0000 7f57de59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57e0150b40 0x7f57e0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.281+0000 7f57de59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57e0150b40 0x7f57e0157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:42852/0 (socket says 172.21.15.167:42852) 2023-11-28T21:02:08.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.281+0000 7f57de59c640 1 -- 172.21.15.167:0/2559330899 learned_addr learned my addr 172.21.15.167:0/2559330899 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:08.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.281+0000 7f57de59c640 1 -- 172.21.15.167:0/2559330899 >> v2:172.21.15.167:3300/0 conn(0x7f57e00c4510 msgr2=0x7f57e006a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:08.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.281+0000 7f57de59c640 1 --2- 172.21.15.167:0/2559330899 >> v2:172.21.15.167:3300/0 conn(0x7f57e00c4510 0x7f57e006a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.281+0000 7f57de59c640 1 -- 172.21.15.167:0/2559330899 >> v1:172.21.15.178:6789/0 conn(0x7f57e00c6ff0 legacy=0x7f57e00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.281+0000 7f57de59c640 1 -- 172.21.15.167:0/2559330899 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00c6500 con 0x7f57e0150b40 2023-11-28T21:02:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57de59c640 1 --2- 172.21.15.167:0/2559330899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0150b40 0x7f57e0157560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f57e00cc090 tx=0x7f57d001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5828890c3a23fe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57ddd9b640 1 -- 172.21.15.167:0/2559330899 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d00ab600 con 0x7f57e0150b40 2023-11-28T21:02:08.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57ddd9b640 1 -- 172.21.15.167:0/2559330899 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d00ab760 con 0x7f57e0150b40 2023-11-28T21:02:08.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57ddd9b640 1 -- 172.21.15.167:0/2559330899 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d00abaf0 con 0x7f57e0150b40 2023-11-28T21:02:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 -- 172.21.15.167:0/2559330899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0150b40 msgr2=0x7f57e0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 --2- 172.21.15.167:0/2559330899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0150b40 0x7f57e0157560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f57e00cc090 tx=0x7f57d001c4f0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 -- 172.21.15.167:0/2559330899 shutdown_connections 2023-11-28T21:02:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 --2- 172.21.15.167:0/2559330899 >> v2:172.21.15.167:3300/0 conn(0x7f57e00c4510 0x7f57e006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 --2- 172.21.15.167:0/2559330899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0150b40 0x7f57e0157560 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 -- 172.21.15.167:0/2559330899 >> 172.21.15.167:0/2559330899 conn(0x7f57e00cb1e0 msgr2=0x7f57e00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 -- 172.21.15.167:0/2559330899 shutdown_connections 2023-11-28T21:02:08.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 -- 172.21.15.167:0/2559330899 wait complete. 2023-11-28T21:02:08.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 Processor -- start 2023-11-28T21:02:08.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 -- start start 2023-11-28T21:02:08.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.285+0000 7f57e4ad6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e00c4510 0x7f57e01f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57e4ad6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c6ff0 0x7f57e00ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57e4ad6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0150b40 0x7f57e0147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57e4ad6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01f35e0 con 0x7f57e00c4510 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57e4ad6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01f6ae0 con 0x7f57e0150b40 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57e4ad6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e01f27c0 con 0x7f57e00c6ff0 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57de59c640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e00c4510 msgr2=0x7f57e01f65a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57de59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e00c4510 0x7f57e01f65a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57ded9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0150b40 0x7f57e0147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d7fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c6ff0 0x7f57e00ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d7fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c6ff0 0x7f57e00ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:53876/0 (socket says 172.21.15.167:53876) 2023-11-28T21:02:08.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57ded9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0150b40 0x7f57e0147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:42860/0 (socket says 172.21.15.167:42860) 2023-11-28T21:02:08.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d7fff640 1 -- 172.21.15.167:0/19256734 learned_addr learned my addr 172.21.15.167:0/19256734 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:08.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d7fff640 1 -- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0150b40 msgr2=0x7f57e0147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d7fff640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0150b40 0x7f57e0147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d7fff640 1 -- 172.21.15.167:0/19256734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e00c4510 msgr2=0x7f57e01f65a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:08.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d7fff640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57e00c4510 0x7f57e01f65a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d7fff640 1 -- 172.21.15.167:0/19256734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d00094d0 con 0x7f57e00c6ff0 2023-11-28T21:02:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d7fff640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c6ff0 0x7f57e00ca3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c450 tx=0x7f57c800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c80052d0 con 0x7f57e00c6ff0 2023-11-28T21:02:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8005450 con 0x7f57e00c6ff0 2023-11-28T21:02:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8003860 con 0x7f57e00c6ff0 2023-11-28T21:02:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e01f2a60 con 0x7f57e00c6ff0 2023-11-28T21:02:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e01f3020 con 0x7f57e00c6ff0 2023-11-28T21:02:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57e4ad6640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e01560b0 0x7f57e0148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0074770 con 0x7f57e01560b0 2023-11-28T21:02:08.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57de59c640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e01560b0 0x7f57e0148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.289+0000 7f57de59c640 1 -- 172.21.15.167:0/19256734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57e0157040 con 0x7f57e01560b0 2023-11-28T21:02:08.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57de59c640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e01560b0 0x7f57e0148530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f57e006bba0 tx=0x7f57d001ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57c80039c0 con 0x7f57e00c6ff0 2023-11-28T21:02:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57d6ffd640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57c0066420 0x7f57c00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f57c8083860 con 0x7f57e00c6ff0 2023-11-28T21:02:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d00abad0 con 0x7f57e01560b0 2023-11-28T21:02:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f57d00b8070 con 0x7f57e01560b0 2023-11-28T21:02:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e01560b0 msgr2=0x7f57e0148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57d6ffd640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e01560b0 0x7f57e0148530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f57e006bba0 tx=0x7f57d001ad30 comp rx=0 tx=0).stop 2023-11-28T21:02:08.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57ded9d640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57c0066420 0x7f57c00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e01560b0 msgr2=0x7f57e0148530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:08.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57d6ffd640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e01560b0 0x7f57e0148530 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.293+0000 7f57ded9d640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57c0066420 0x7f57c00688e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f57d8003d10 tx=0x7f57d80095f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0145ac0 0x7f57e0145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00682c0 con 0x7f57e0145ac0 2023-11-28T21:02:08.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57de59c640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0145ac0 0x7f57e0145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57de59c640 1 -- 172.21.15.167:0/19256734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f57e0157810 con 0x7f57e0145ac0 2023-11-28T21:02:08.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57de59c640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0145ac0 0x7f57e0145ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f57d001a120 tx=0x7f57d0009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d00c5a80 con 0x7f57e0145ac0 2023-11-28T21:02:08.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5114 (secure 0 0 0) 0x7f57d00c5be0 con 0x7f57e0145ac0 2023-11-28T21:02:08.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0145ac0 msgr2=0x7f57e0145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57d6ffd640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0145ac0 0x7f57e0145ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f57d001a120 tx=0x7f57d0009240 comp rx=0 tx=0).stop 2023-11-28T21:02:08.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57d6ffd640 1 -- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0145ac0 msgr2=0x7f57e0145ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:08.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57d6ffd640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e0145ac0 0x7f57e0145ed0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.303 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:02:08.303 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:02:08.303 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:02:08.303 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:02:08.303 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 182, 2023-11-28T21:02:08.303 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:02:08.303 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:08.304 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:08.305 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:02:08.306 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:02:08.307 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:08.308 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:08.309 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:02:08.310 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:08.311 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:02:08.312 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:02:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:02:08.314 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:08.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.316 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.317 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:02:08.318 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:02:08.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57c0066420 msgr2=0x7f57c00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57c0066420 0x7f57c00688e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f57d8003d10 tx=0x7f57d80095f0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c6ff0 msgr2=0x7f57e00ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 --2- 172.21.15.167:0/19256734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c6ff0 0x7f57e00ca3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c450 tx=0x7f57c800c910 comp rx=0 tx=0).stop 2023-11-28T21:02:08.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57ded9d640 1 -- 172.21.15.167:0/19256734 reap_dead start 2023-11-28T21:02:08.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57ded9d640 1 -- 172.21.15.167:0/19256734 reap_dead start 2023-11-28T21:02:08.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 shutdown_connections 2023-11-28T21:02:08.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 >> 172.21.15.167:0/19256734 conn(0x7f57e00cb1e0 msgr2=0x7f57e00c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:08.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 shutdown_connections 2023-11-28T21:02:08.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.301+0000 7f57e4ad6640 1 -- 172.21.15.167:0/19256734 wait complete. 2023-11-28T21:02:08.321 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:02:08.321 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T21:02:08.322 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:02:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce94d72640 1 Processor -- start 2023-11-28T21:02:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce94d72640 1 -- start start 2023-11-28T21:02:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce94d72640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fce90151f60 0x7fce900c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce94d72640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce900c6120 con 0x7fce9006a580 2023-11-28T21:02:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce94d72640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9015b220 con 0x7fce900c5c90 2023-11-28T21:02:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce94d72640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce900c4da0 con 0x7fce90151f60 2023-11-28T21:02:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce8ed9d640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fce9006a580 legacy=0x7fce901625b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:02:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce8e59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fce90151f60 0x7fce900c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce8e59c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fce90151f60 0x7fce900c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:42898/0 (socket says 172.21.15.167:42898) 2023-11-28T21:02:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce8e59c640 1 -- 172.21.15.167:0/3773269779 learned_addr learned my addr 172.21.15.167:0/3773269779 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:08.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce8e59c640 1 -- 172.21.15.167:0/3773269779 >> v1:172.21.15.178:6789/0 conn(0x7fce900c5c90 legacy=0x7fce900c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce8e59c640 1 -- 172.21.15.167:0/3773269779 >> v1:172.21.15.167:6789/0 conn(0x7fce9006a580 legacy=0x7fce901625b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.461+0000 7fce8e59c640 1 -- 172.21.15.167:0/3773269779 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90152340 con 0x7fce90151f60 2023-11-28T21:02:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce8e59c640 1 --2- 172.21.15.167:0/3773269779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce90151f60 0x7fce900c75c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce80009870 tx=0x7fce8001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9026d9998ccfc04 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce8dd9b640 1 -- 172.21.15.167:0/3773269779 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce800ab600 con 0x7fce90151f60 2023-11-28T21:02:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce8dd9b640 1 -- 172.21.15.167:0/3773269779 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce800a7050 con 0x7fce90151f60 2023-11-28T21:02:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce8dd9b640 1 -- 172.21.15.167:0/3773269779 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce800ab980 con 0x7fce90151f60 2023-11-28T21:02:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce94d72640 1 -- 172.21.15.167:0/3773269779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce90151f60 msgr2=0x7fce900c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce94d72640 1 --2- 172.21.15.167:0/3773269779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce90151f60 0x7fce900c75c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce80009870 tx=0x7fce8001c470 comp rx=0 tx=0).stop 2023-11-28T21:02:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce94d72640 1 -- 172.21.15.167:0/3773269779 shutdown_connections 2023-11-28T21:02:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce94d72640 1 --2- 172.21.15.167:0/3773269779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce90151f60 0x7fce900c75c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce94d72640 1 -- 172.21.15.167:0/3773269779 >> 172.21.15.167:0/3773269779 conn(0x7fce900cb1e0 msgr2=0x7fce900cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce94d72640 1 -- 172.21.15.167:0/3773269779 shutdown_connections 2023-11-28T21:02:08.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.465+0000 7fce94d72640 1 -- 172.21.15.167:0/3773269779 wait complete. 2023-11-28T21:02:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce94d72640 1 Processor -- start 2023-11-28T21:02:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce94d72640 1 -- start start 2023-11-28T21:02:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce94d72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce9006a580 0x7fce90152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce94d72640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce900c5c90 0x7fce901572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce94d72640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90151f60 0x7fce901401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce94d72640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90148a60 con 0x7fce9006a580 2023-11-28T21:02:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce94d72640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90153410 con 0x7fce900c5c90 2023-11-28T21:02:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce94d72640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce901539d0 con 0x7fce90151f60 2023-11-28T21:02:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce8e59c640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce9006a580 msgr2=0x7fce90152760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:02:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce8e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce9006a580 0x7fce90152760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce87fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce900c5c90 0x7fce901572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce8ed9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90151f60 0x7fce901401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce87fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce900c5c90 0x7fce901572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:42906/0 (socket says 172.21.15.167:42906) 2023-11-28T21:02:08.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce87fff640 1 -- 172.21.15.167:0/1623491168 learned_addr learned my addr 172.21.15.167:0/1623491168 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce87fff640 1 -- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90151f60 msgr2=0x7fce901401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce87fff640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90151f60 0x7fce901401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce87fff640 1 -- 172.21.15.167:0/1623491168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce9006a580 msgr2=0x7fce90152760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce87fff640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce9006a580 0x7fce90152760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce87fff640 1 -- 172.21.15.167:0/1623491168 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800094d0 con 0x7fce900c5c90 2023-11-28T21:02:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce87fff640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce900c5c90 0x7fce901572d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce7800c530 tx=0x7fce7800c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.469+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78005220 con 0x7fce900c5c90 2023-11-28T21:02:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78005380 con 0x7fce900c5c90 2023-11-28T21:02:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78007270 con 0x7fce900c5c90 2023-11-28T21:02:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9014b720 con 0x7fce900c5c90 2023-11-28T21:02:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce90148c70 con 0x7fce900c5c90 2023-11-28T21:02:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce94d72640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce901441f0 0x7fce90155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce90074770 con 0x7fce901441f0 2023-11-28T21:02:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce8e59c640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce901441f0 0x7fce90155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce8e59c640 1 -- 172.21.15.167:0/1623491168 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce9006ada0 con 0x7fce901441f0 2023-11-28T21:02:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce8e59c640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce901441f0 0x7fce90155080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce900c5580 tx=0x7fce8001acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80004020 con 0x7fce901441f0 2023-11-28T21:02:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.473+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce780073d0 con 0x7fce900c5c90 2023-11-28T21:02:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.477+0000 7fce86ffd640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce70066510 0x7fce700689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.477+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fce78083a30 con 0x7fce900c5c90 2023-11-28T21:02:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.477+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fce80004180 con 0x7fce901441f0 2023-11-28T21:02:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.477+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce901441f0 msgr2=0x7fce90155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.477+0000 7fce86ffd640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce901441f0 0x7fce90155080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce900c5580 tx=0x7fce8001acb0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.477+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce901441f0 msgr2=0x7fce90155080 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.477+0000 7fce86ffd640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce901441f0 0x7fce90155080 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce900c5580 tx=0x7fce8001acb0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.477+0000 7fce8ed9d640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce70066510 0x7fce700689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.477+0000 7fce8ed9d640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce70066510 0x7fce700689d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fce90067950 tx=0x7fce880095f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.481+0000 7fce94d72640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90153550 0x7fce901406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:08.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.481+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9015ba30 con 0x7fce90153550 2023-11-28T21:02:08.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.481+0000 7fce8e59c640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90153550 0x7fce901406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.481+0000 7fce8e59c640 1 -- 172.21.15.167:0/1623491168 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fce9015bf50 con 0x7fce90153550 2023-11-28T21:02:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce8e59c640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90153550 0x7fce901406f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce80009870 tx=0x7fce80019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce800bfb60 con 0x7fce90153550 2023-11-28T21:02:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4969 (secure 0 0 0) 0x7fce800c3070 con 0x7fce90153550 2023-11-28T21:02:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90153550 msgr2=0x7fce901406f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce86ffd640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90153550 0x7fce901406f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce80009870 tx=0x7fce80019210 comp rx=0 tx=0).stop 2023-11-28T21:02:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce86ffd640 1 -- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90153550 msgr2=0x7fce901406f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:08.486 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:02:08.486 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:02:08.486 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:02:08.486 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 182, 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 1, 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:08.487 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:02:08.488 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.489 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:02:08.490 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:08.491 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:02:08.492 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:02:08.493 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.494 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:02:08.495 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:02:08.496 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:08.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.498 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.499 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.500 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:08.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:08.502 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:02:08.502 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce86ffd640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce90153550 0x7fce901406f0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce80009870 tx=0x7fce80019210 comp rx=0 tx=0).stop 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce70066510 msgr2=0x7fce700689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce94d72640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce70066510 0x7fce700689d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fce90067950 tx=0x7fce880095f0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce900c5c90 msgr2=0x7fce901572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce94d72640 1 --2- 172.21.15.167:0/1623491168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce900c5c90 0x7fce901572d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce7800c530 tx=0x7fce7800c9f0 comp rx=0 tx=0).stop 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce8ed9d640 1 -- 172.21.15.167:0/1623491168 reap_dead start 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce8ed9d640 1 -- 172.21.15.167:0/1623491168 reap_dead start 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 shutdown_connections 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 >> 172.21.15.167:0/1623491168 conn(0x7fce900cb1e0 msgr2=0x7fce900c7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 shutdown_connections 2023-11-28T21:02:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:08.485+0000 7fce94d72640 1 -- 172.21.15.167:0/1623491168 wait complete. 2023-11-28T21:02:08.505 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:02:08.505 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T21:02:14.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~181s 2023-11-28T21:02:21.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~188s 2023-11-28T21:02:22.517 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:22.521 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:27.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~194s 2023-11-28T21:02:28.505 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T21:02:28.506 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2023-11-28T21:02:28.506 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T21:02:28.506 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T21:02:28.510 INFO:tasks.ceph.mon.a:Started 2023-11-28T21:02:28.510 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:02:28.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:28.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.661+0000 7f578b7b8640 1 Processor -- start 2023-11-28T21:02:28.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.661+0000 7f578b7b8640 1 -- start start 2023-11-28T21:02:28.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f578b7b8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f57840cfc40 0x7f57840cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f578b7b8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5784153ae0 0x7f5784153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f578b7b8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578415ac00 con 0x7f57840cf860 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f578b7b8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57840cbd60 con 0x7f57840cfc40 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f578b7b8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5784159ff0 con 0x7f5784153ae0 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5789554640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f57840cf860 0x7f57840ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:58606/0 (socket says 172.21.15.167:58606) 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5789554640 1 -- 172.21.15.167:0/293152502 learned_addr learned my addr 172.21.15.167:0/293152502 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5788d53640 1 --2- 172.21.15.167:0/293152502 >> v2:172.21.15.167:3300/0 conn(0x7f57840cfc40 0x7f57840cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5789d55640 1 --2- 172.21.15.167:0/293152502 >> v2:172.21.15.178:3300/0 conn(0x7f5784153ae0 0x7f5784153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5788d53640 1 -- 172.21.15.167:0/293152502 >> v2:172.21.15.167:3300/0 conn(0x7f57840cfc40 msgr2=0x7f57840cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5788d53640 1 -- 172.21.15.167:0/293152502 >> v2:172.21.15.167:3300/0 conn(0x7f57840cfc40 msgr2=0x7f57840cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:28.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5788d53640 1 --2- 172.21.15.167:0/293152502 >> v2:172.21.15.167:3300/0 conn(0x7f57840cfc40 0x7f57840cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:28.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5788d53640 1 --2- 172.21.15.167:0/293152502 >> v2:172.21.15.167:3300/0 conn(0x7f57840cfc40 0x7f57840cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:28.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5789d55640 1 -- 172.21.15.167:0/293152502 >> v2:172.21.15.167:3300/0 conn(0x7f57840cfc40 msgr2=0x7f57840cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:28.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5789d55640 1 --2- 172.21.15.167:0/293152502 >> v2:172.21.15.167:3300/0 conn(0x7f57840cfc40 0x7f57840cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5789d55640 1 -- 172.21.15.167:0/293152502 >> v1:172.21.15.167:6789/0 conn(0x7f57840cf860 legacy=0x7f57840ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:28.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.665+0000 7f5789d55640 1 -- 172.21.15.167:0/293152502 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578415a2d0 con 0x7f5784153ae0 2023-11-28T21:02:28.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f5789d55640 1 --2- 172.21.15.167:0/293152502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 0x7f5784153f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57840b2240 tx=0x7f577c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a31a964fc0c0fe7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:28.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f577bfff640 1 -- 172.21.15.167:0/293152502 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0a59d0 con 0x7f5784153ae0 2023-11-28T21:02:28.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f577bfff640 1 -- 172.21.15.167:0/293152502 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0a5b30 con 0x7f5784153ae0 2023-11-28T21:02:28.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f577bfff640 1 -- 172.21.15.167:0/293152502 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0ad440 con 0x7f5784153ae0 2023-11-28T21:02:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 -- 172.21.15.167:0/293152502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 msgr2=0x7f5784153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 --2- 172.21.15.167:0/293152502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 0x7f5784153f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f57840b2240 tx=0x7f577c01c910 comp rx=0 tx=0).stop 2023-11-28T21:02:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 -- 172.21.15.167:0/293152502 shutdown_connections 2023-11-28T21:02:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 --2- 172.21.15.167:0/293152502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 0x7f5784153f50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 --2- 172.21.15.167:0/293152502 >> v2:172.21.15.167:3300/0 conn(0x7f57840cfc40 0x7f57840cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 -- 172.21.15.167:0/293152502 >> 172.21.15.167:0/293152502 conn(0x7f578406c1f0 msgr2=0x7f5784071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 -- 172.21.15.167:0/293152502 shutdown_connections 2023-11-28T21:02:28.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 -- 172.21.15.167:0/293152502 wait complete. 2023-11-28T21:02:28.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 Processor -- start 2023-11-28T21:02:28.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.669+0000 7f578b7b8640 1 -- start start 2023-11-28T21:02:28.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f578b7b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57840cf860 0x7f57840b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:28.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f578b7b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 0x7f578415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:28.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f578b7b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 0x7f57840c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f578b7b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57841f3630 con 0x7f57840cfc40 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f578b7b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578415cbf0 con 0x7f5784153ae0 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f578b7b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578415ceb0 con 0x7f57840cf860 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5788d53640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 0x7f578415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5788d53640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 0x7f578415c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46212/0 (socket says 172.21.15.167:46212) 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5788d53640 1 -- 172.21.15.167:0/2083885501 learned_addr learned my addr 172.21.15.167:0/2083885501 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5788d53640 1 -- 172.21.15.167:0/2083885501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 msgr2=0x7f578415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5788d53640 1 -- 172.21.15.167:0/2083885501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 msgr2=0x7f578415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5788d53640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 0x7f578415c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5789d55640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 0x7f57840c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:28.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5789554640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57840cf860 0x7f57840b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5788d53640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 0x7f578415c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5789d55640 1 -- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57840cf860 msgr2=0x7f57840b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5789d55640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57840cf860 0x7f57840b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5789d55640 1 -- 172.21.15.167:0/2083885501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 msgr2=0x7f578415c2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5789d55640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 0x7f578415c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5789d55640 1 -- 172.21.15.167:0/2083885501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c009a70 con 0x7f5784153ae0 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5789d55640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 0x7f57840c8040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f577c0ac000 tx=0x7f577c0196b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5779ffb640 1 -- 172.21.15.167:0/2083885501 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0b9860 con 0x7f5784153ae0 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57841f2f70 con 0x7f5784153ae0 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5779ffb640 1 -- 172.21.15.167:0/2083885501 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0b99c0 con 0x7f5784153ae0 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f5779ffb640 1 -- 172.21.15.167:0/2083885501 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0b9d70 con 0x7f5784153ae0 2023-11-28T21:02:28.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57840c6da0 con 0x7f5784153ae0 2023-11-28T21:02:28.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.673+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57841f3770 con 0x7f5784153ae0 2023-11-28T21:02:28.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.677+0000 7f5779ffb640 1 -- 172.21.15.167:0/2083885501 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f577c0ad440 con 0x7f5784153ae0 2023-11-28T21:02:28.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.677+0000 7f5779ffb640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57680664a0 0x7f5768068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:28.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.677+0000 7f5779ffb640 1 -- 172.21.15.167:0/2083885501 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f577c11f760 con 0x7f5784153ae0 2023-11-28T21:02:28.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.677+0000 7f5789554640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57680664a0 0x7f5768068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:28.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.677+0000 7f5789554640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57680664a0 0x7f5768068960 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5780005890 tx=0x7f5780009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:28.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.689+0000 7f5779ffb640 1 -- 172.21.15.167:0/2083885501 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f577c0ec880 con 0x7f5784153ae0 2023-11-28T21:02:28.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.897+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f57841f3770 con 0x7f5784153ae0 2023-11-28T21:02:28.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.897+0000 7f5779ffb640 1 -- 172.21.15.167:0/2083885501 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f57841f3770 con 0x7f5784153ae0 2023-11-28T21:02:28.898 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":182,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.897+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57680664a0 msgr2=0x7f5768068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.897+0000 7f578b7b8640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57680664a0 0x7f5768068960 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5780005890 tx=0x7f5780009040 comp rx=0 tx=0).stop 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.897+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 msgr2=0x7f57840c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.897+0000 7f578b7b8640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 0x7f57840c8040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f577c0ac000 tx=0x7f577c0196b0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.901+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 shutdown_connections 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.901+0000 7f578b7b8640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f57680664a0 0x7f5768068960 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.901+0000 7f578b7b8640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5784153ae0 0x7f57840c8040 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.901+0000 7f578b7b8640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57840cfc40 0x7f578415c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.901+0000 7f578b7b8640 1 --2- 172.21.15.167:0/2083885501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57840cf860 0x7f57840b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.901+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 >> 172.21.15.167:0/2083885501 conn(0x7f578406c1f0 msgr2=0x7f57840cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.901+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 shutdown_connections 2023-11-28T21:02:28.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:28.901+0000 7f578b7b8640 1 -- 172.21.15.167:0/2083885501 wait complete. 2023-11-28T21:02:31.921 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:32.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.061+0000 7ff77b32a640 1 Processor -- start 2023-11-28T21:02:32.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff77b32a640 1 -- start start 2023-11-28T21:02:32.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff77b32a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff77415e130 0x7ff774161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:32.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff77b32a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7740c7720 0x7ff774162320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:32.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff77b32a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77415e5e0 con 0x7ff7741585d0 2023-11-28T21:02:32.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff77b32a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77415f160 con 0x7ff77415e130 2023-11-28T21:02:32.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff77b32a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77415e8c0 con 0x7ff7740c7720 2023-11-28T21:02:32.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7788c5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff77415e130 0x7ff774161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:32.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7798c7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7740c7720 0x7ff774162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:32.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7798c7640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7740c7720 0x7ff774162320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:33438/0 (socket says 172.21.15.167:33438) 2023-11-28T21:02:32.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7788c5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff77415e130 0x7ff774161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:59448/0 (socket says 172.21.15.167:59448) 2023-11-28T21:02:32.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7798c7640 1 -- 172.21.15.167:0/2348526998 learned_addr learned my addr 172.21.15.167:0/2348526998 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7788c5640 1 -- 172.21.15.167:0/2348526998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7740c7720 msgr2=0x7ff774162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7788c5640 1 --2- 172.21.15.167:0/2348526998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7740c7720 0x7ff774162320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7788c5640 1 -- 172.21.15.167:0/2348526998 >> v1:172.21.15.178:6789/0 conn(0x7ff7741585d0 legacy=0x7ff7740c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7788c5640 1 -- 172.21.15.167:0/2348526998 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77415eba0 con 0x7ff77415e130 2023-11-28T21:02:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.065+0000 7ff7798c7640 1 --2- 172.21.15.167:0/2348526998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7740c7720 0x7ff774162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:02:32.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff7788c5640 1 --2- 172.21.15.167:0/2348526998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77415e130 0x7ff774161de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7640097c0 tx=0x7ff76401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=175e58e388c275e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:32.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff76bfff640 1 -- 172.21.15.167:0/2348526998 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640ab650 con 0x7ff77415e130 2023-11-28T21:02:32.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff76bfff640 1 -- 172.21.15.167:0/2348526998 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7640ab7b0 con 0x7ff77415e130 2023-11-28T21:02:32.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff76bfff640 1 -- 172.21.15.167:0/2348526998 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640abb40 con 0x7ff77415e130 2023-11-28T21:02:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff77b32a640 1 -- 172.21.15.167:0/2348526998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77415e130 msgr2=0x7ff774161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff77b32a640 1 --2- 172.21.15.167:0/2348526998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77415e130 0x7ff774161de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7640097c0 tx=0x7ff76401c450 comp rx=0 tx=0).stop 2023-11-28T21:02:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff77b32a640 1 -- 172.21.15.167:0/2348526998 shutdown_connections 2023-11-28T21:02:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff77b32a640 1 --2- 172.21.15.167:0/2348526998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7740c7720 0x7ff774162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff77b32a640 1 --2- 172.21.15.167:0/2348526998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77415e130 0x7ff774161de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff77b32a640 1 -- 172.21.15.167:0/2348526998 >> 172.21.15.167:0/2348526998 conn(0x7ff7740cb1e0 msgr2=0x7ff7740cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:32.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff77b32a640 1 -- 172.21.15.167:0/2348526998 shutdown_connections 2023-11-28T21:02:32.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.069+0000 7ff77b32a640 1 -- 172.21.15.167:0/2348526998 wait complete. 2023-11-28T21:02:32.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 Processor -- start 2023-11-28T21:02:32.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 -- start start 2023-11-28T21:02:32.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7740c7720 0x7ff774156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:32.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7741585d0 0x7ff7740c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:32.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 0x7ff774154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:32.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77415b8e0 con 0x7ff77415e130 2023-11-28T21:02:32.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77415acd0 con 0x7ff7740c7720 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77415afb0 con 0x7ff7741585d0 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7798c7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 0x7ff774154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7798c7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 0x7ff774154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46218/0 (socket says 172.21.15.167:46218) 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7798c7640 1 -- 172.21.15.167:0/1494360026 learned_addr learned my addr 172.21.15.167:0/1494360026 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7788c5640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7741585d0 0x7ff7740c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7790c6640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7740c7720 0x7ff774156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7798c7640 1 -- 172.21.15.167:0/1494360026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 msgr2=0x7ff774154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7798c7640 1 -- 172.21.15.167:0/1494360026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 msgr2=0x7ff774154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7798c7640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 0x7ff774154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7798c7640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 0x7ff774154a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7788c5640 1 -- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7740c7720 msgr2=0x7ff774156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:32.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7788c5640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7740c7720 0x7ff774156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7788c5640 1 -- 172.21.15.167:0/1494360026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 msgr2=0x7ff774154a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:32.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7788c5640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 0x7ff774154a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7788c5640 1 -- 172.21.15.167:0/1494360026 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c009b30 con 0x7ff7741585d0 2023-11-28T21:02:32.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff7788c5640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7741585d0 0x7ff7740c3630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7640ac000 tx=0x7ff7640191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:32.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff769ffb640 1 -- 172.21.15.167:0/1494360026 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640abe70 con 0x7ff7741585d0 2023-11-28T21:02:32.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff769ffb640 1 -- 172.21.15.167:0/1494360026 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7640be3f0 con 0x7ff7741585d0 2023-11-28T21:02:32.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff769ffb640 1 -- 172.21.15.167:0/1494360026 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640be7a0 con 0x7ff7741585d0 2023-11-28T21:02:32.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff764009420 con 0x7ff7741585d0 2023-11-28T21:02:32.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.073+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77415b570 con 0x7ff7741585d0 2023-11-28T21:02:32.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.077+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7740682c0 con 0x7ff7741585d0 2023-11-28T21:02:32.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.077+0000 7ff769ffb640 1 -- 172.21.15.167:0/1494360026 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7640b43f0 con 0x7ff7741585d0 2023-11-28T21:02:32.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.077+0000 7ff769ffb640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff758066470 0x7ff758068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:32.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.077+0000 7ff769ffb640 1 -- 172.21.15.167:0/1494360026 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff76411ebc0 con 0x7ff7741585d0 2023-11-28T21:02:32.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.077+0000 7ff7790c6640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff758066470 0x7ff758068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:32.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.081+0000 7ff7790c6640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff758066470 0x7ff758068930 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff770007fd0 tx=0x7ff770009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:32.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.089+0000 7ff769ffb640 1 -- 172.21.15.167:0/1494360026 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7640ebe70 con 0x7ff7741585d0 2023-11-28T21:02:32.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.289+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff77415b0f0 con 0x7ff7741585d0 2023-11-28T21:02:32.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff769ffb640 1 -- 172.21.15.167:0/1494360026 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7ff77415b0f0 con 0x7ff7741585d0 2023-11-28T21:02:32.293 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":182,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:32.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff758066470 msgr2=0x7ff758068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:32.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff758066470 0x7ff758068930 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff770007fd0 tx=0x7ff770009040 comp rx=0 tx=0).stop 2023-11-28T21:02:32.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7741585d0 msgr2=0x7ff7740c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:32.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7741585d0 0x7ff7740c3630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7640ac000 tx=0x7ff7640191f0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 shutdown_connections 2023-11-28T21:02:32.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff758066470 0x7ff758068930 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff77415e130 0x7ff774154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7741585d0 0x7ff7740c3630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 --2- 172.21.15.167:0/1494360026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7740c7720 0x7ff774156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:32.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 >> 172.21.15.167:0/1494360026 conn(0x7ff7740cb1e0 msgr2=0x7ff77415c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:32.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 shutdown_connections 2023-11-28T21:02:32.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:32.293+0000 7ff77b32a640 1 -- 172.21.15.167:0/1494360026 wait complete. 2023-11-28T21:02:34.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~201s 2023-11-28T21:02:35.315 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:35.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.464+0000 7f0cb1f9d640 1 Processor -- start 2023-11-28T21:02:35.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.464+0000 7f0cb1f9d640 1 -- start start 2023-11-28T21:02:35.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.464+0000 7f0cb1f9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 0x7f0cac071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:35.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.464+0000 7f0cb1f9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 0x7f0cac072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:35.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.464+0000 7f0cb1f9d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cac1571d0 con 0x7f0cac06e030 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.464+0000 7f0cb1f9d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cac071a90 con 0x7f0cac06e410 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.464+0000 7f0cb1f9d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac0c70d0 con 0x7f0cac070480 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0cabfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 0x7f0cac072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0cabfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 0x7f0cac072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52598/0 (socket says 172.21.15.167:52598) 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0cabfff640 1 -- 172.21.15.167:0/2485975357 learned_addr learned my addr 172.21.15.167:0/2485975357 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0cabfff640 1 -- 172.21.15.167:0/2485975357 >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 msgr2=0x7f0cac072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0cabfff640 1 -- 172.21.15.167:0/2485975357 >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 msgr2=0x7f0cac072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0cabfff640 1 --2- 172.21.15.167:0/2485975357 >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 0x7f0cac072460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0caaffd640 1 --2- 172.21.15.167:0/2485975357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 0x7f0cac071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0cabfff640 1 --2- 172.21.15.167:0/2485975357 >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 0x7f0cac072460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:35.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0caa7fc640 1 -- 172.21.15.167:0/2485975357 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839842412 0 0) 0x7f0cac1571d0 con 0x7f0cac06e030 2023-11-28T21:02:35.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0caa7fc640 1 -- 172.21.15.167:0/2485975357 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c94003530 con 0x7f0cac06e030 2023-11-28T21:02:35.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0caaffd640 1 -- 172.21.15.167:0/2485975357 >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 msgr2=0x7f0cac072460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:35.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0caaffd640 1 --2- 172.21.15.167:0/2485975357 >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 0x7f0cac072460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0caaffd640 1 -- 172.21.15.167:0/2485975357 >> v1:172.21.15.178:6789/0 conn(0x7f0cac06e030 legacy=0x7f0cac1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:35.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.468+0000 7f0caaffd640 1 -- 172.21.15.167:0/2485975357 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac0c73b0 con 0x7f0cac070480 2023-11-28T21:02:35.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0caaffd640 1 --2- 172.21.15.167:0/2485975357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 0x7f0cac071f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00097c0 tx=0x7f0ca001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbd5e9d1427f9f84 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:35.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0caa7fc640 1 -- 172.21.15.167:0/2485975357 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00ab650 con 0x7f0cac070480 2023-11-28T21:02:35.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0caa7fc640 1 -- 172.21.15.167:0/2485975357 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca00ab7b0 con 0x7f0cac070480 2023-11-28T21:02:35.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0caa7fc640 1 -- 172.21.15.167:0/2485975357 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00abb40 con 0x7f0cac070480 2023-11-28T21:02:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/2485975357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 msgr2=0x7f0cac071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 --2- 172.21.15.167:0/2485975357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 0x7f0cac071f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00097c0 tx=0x7f0ca001c450 comp rx=0 tx=0).stop 2023-11-28T21:02:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/2485975357 shutdown_connections 2023-11-28T21:02:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 --2- 172.21.15.167:0/2485975357 >> v2:172.21.15.167:3300/0 conn(0x7f0cac06e410 0x7f0cac072460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 --2- 172.21.15.167:0/2485975357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 0x7f0cac071f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/2485975357 >> 172.21.15.167:0/2485975357 conn(0x7f0cac0cb1e0 msgr2=0x7f0cac0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/2485975357 shutdown_connections 2023-11-28T21:02:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/2485975357 wait complete. 2023-11-28T21:02:35.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 Processor -- start 2023-11-28T21:02:35.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 -- start start 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac06e030 0x7f0cac1490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 0x7f0cac1f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 0x7f0cac1f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac147d60 con 0x7f0cac06e410 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac148020 con 0x7f0cac06e030 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.472+0000 7f0cb1f9d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac148300 con 0x7f0cac070480 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0caaffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 0x7f0cac1f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0caaffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 0x7f0cac1f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52612/0 (socket says 172.21.15.167:52612) 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0caaffd640 1 -- 172.21.15.167:0/3376867495 learned_addr learned my addr 172.21.15.167:0/3376867495 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0caaffd640 1 -- 172.21.15.167:0/3376867495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 msgr2=0x7f0cac1f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-11-28T21:02:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0caaffd640 1 -- 172.21.15.167:0/3376867495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 msgr2=0x7f0cac1f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:02:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0caaffd640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 0x7f0cac1f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cabfff640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 0x7f0cac1f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cab7fe640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac06e030 0x7f0cac1490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0caaffd640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 0x7f0cac1f4110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cab7fe640 1 -- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 msgr2=0x7f0cac1f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cab7fe640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 0x7f0cac1f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cab7fe640 1 -- 172.21.15.167:0/3376867495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 msgr2=0x7f0cac1f4110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cab7fe640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 0x7f0cac1f4110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cab7fe640 1 -- 172.21.15.167:0/3376867495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0009420 con 0x7f0cac06e030 2023-11-28T21:02:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cab7fe640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac06e030 0x7f0cac1490c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c430 tx=0x7f0c9c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0c93fff640 1 -- 172.21.15.167:0/3376867495 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0052d0 con 0x7f0cac06e030 2023-11-28T21:02:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0c93fff640 1 -- 172.21.15.167:0/3376867495 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c005430 con 0x7f0cac06e030 2023-11-28T21:02:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cac1485e0 con 0x7f0cac06e030 2023-11-28T21:02:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0c93fff640 1 -- 172.21.15.167:0/3376867495 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c003840 con 0x7f0cac06e030 2023-11-28T21:02:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cac148ba0 con 0x7f0cac06e030 2023-11-28T21:02:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.476+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cac0682c0 con 0x7f0cac06e030 2023-11-28T21:02:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.480+0000 7f0c93fff640 1 -- 172.21.15.167:0/3376867495 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0c9c0039a0 con 0x7f0cac06e030 2023-11-28T21:02:35.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.480+0000 7f0c93fff640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0c980664a0 0x7f0c98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:35.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.480+0000 7f0c93fff640 1 -- 172.21.15.167:0/3376867495 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0c9c083d90 con 0x7f0cac06e030 2023-11-28T21:02:35.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.480+0000 7f0caaffd640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0c980664a0 0x7f0c98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:35.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.480+0000 7f0caaffd640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0c980664a0 0x7f0c98068960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00097c0 tx=0x7f0ca00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:35.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.492+0000 7f0c93fff640 1 -- 172.21.15.167:0/3376867495 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c9c050da0 con 0x7f0cac06e030 2023-11-28T21:02:35.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0cac148d90 con 0x7f0cac06e030 2023-11-28T21:02:35.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0c93fff640 1 -- 172.21.15.167:0/3376867495 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f0c9c017020 con 0x7f0cac06e030 2023-11-28T21:02:35.698 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":182,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:35.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0c980664a0 msgr2=0x7f0c98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:35.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0c980664a0 0x7f0c98068960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00097c0 tx=0x7f0ca00a7000 comp rx=0 tx=0).stop 2023-11-28T21:02:35.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac06e030 msgr2=0x7f0cac1490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:35.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac06e030 0x7f0cac1490c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c430 tx=0x7f0c9c00c8f0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 shutdown_connections 2023-11-28T21:02:35.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0c980664a0 0x7f0c98068960 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cac070480 0x7f0cac1f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cac06e410 0x7f0cac1f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 --2- 172.21.15.167:0/3376867495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac06e030 0x7f0cac1490c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:35.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 >> 172.21.15.167:0/3376867495 conn(0x7f0cac0cb1e0 msgr2=0x7f0cac0c6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:35.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 shutdown_connections 2023-11-28T21:02:35.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:35.696+0000 7f0cb1f9d640 1 -- 172.21.15.167:0/3376867495 wait complete. 2023-11-28T21:02:38.720 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:38.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.864+0000 7f606d879640 1 Processor -- start 2023-11-28T21:02:38.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.864+0000 7f606d879640 1 -- start start 2023-11-28T21:02:38.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f606d879640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6068153f40 0x7f6068159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:38.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f606d879640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60680caa90 0x7f60680c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:38.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f606d879640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60680cb5c0 con 0x7f60680ca660 2023-11-28T21:02:38.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f606d879640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60680b2c60 con 0x7f6068153f40 2023-11-28T21:02:38.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f606d879640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60680c4f00 con 0x7f60680caa90 2023-11-28T21:02:38.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f6066ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6068153f40 0x7f6068159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:38.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f60677fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60680caa90 0x7f60680c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f6066ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6068153f40 0x7f6068159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:35984/0 (socket says 172.21.15.167:35984) 2023-11-28T21:02:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f6066ffd640 1 -- 172.21.15.167:0/1615252529 learned_addr learned my addr 172.21.15.167:0/1615252529 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f60677fe640 1 -- 172.21.15.167:0/1615252529 >> v2:172.21.15.178:3300/0 conn(0x7f6068153f40 msgr2=0x7f6068159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f60677fe640 1 --2- 172.21.15.167:0/1615252529 >> v2:172.21.15.178:3300/0 conn(0x7f6068153f40 0x7f6068159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f60677fe640 1 -- 172.21.15.167:0/1615252529 >> v1:172.21.15.178:6789/0 conn(0x7f60680ca660 legacy=0x7f60680cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.868+0000 7f60677fe640 1 -- 172.21.15.167:0/1615252529 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680c54c0 con 0x7f60680caa90 2023-11-28T21:02:38.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f60677fe640 1 --2- 172.21.15.167:0/1615252529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60680caa90 0x7f60680c5950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6060009d90 tx=0x7f606001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a640d2f9bab56058 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f60667fc640 1 -- 172.21.15.167:0/1615252529 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60600a5810 con 0x7f60680caa90 2023-11-28T21:02:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f60667fc640 1 -- 172.21.15.167:0/1615252529 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60600a5970 con 0x7f60680caa90 2023-11-28T21:02:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f60667fc640 1 -- 172.21.15.167:0/1615252529 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60600a5d00 con 0x7f60680caa90 2023-11-28T21:02:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f606d879640 1 -- 172.21.15.167:0/1615252529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60680caa90 msgr2=0x7f60680c5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:38.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f606d879640 1 --2- 172.21.15.167:0/1615252529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60680caa90 0x7f60680c5950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6060009d90 tx=0x7f606001c950 comp rx=0 tx=0).stop 2023-11-28T21:02:38.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f606d879640 1 -- 172.21.15.167:0/1615252529 shutdown_connections 2023-11-28T21:02:38.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f606d879640 1 --2- 172.21.15.167:0/1615252529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60680caa90 0x7f60680c5950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:38.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f606d879640 1 --2- 172.21.15.167:0/1615252529 >> v2:172.21.15.178:3300/0 conn(0x7f6068153f40 0x7f6068159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:38.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f606d879640 1 -- 172.21.15.167:0/1615252529 >> 172.21.15.167:0/1615252529 conn(0x7f606806b800 msgr2=0x7f606806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:38.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f606d879640 1 -- 172.21.15.167:0/1615252529 shutdown_connections 2023-11-28T21:02:38.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f606d879640 1 -- 172.21.15.167:0/1615252529 wait complete. 2023-11-28T21:02:38.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.872+0000 7f606d879640 1 Processor -- start 2023-11-28T21:02:38.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 -- start start 2023-11-28T21:02:38.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60680ca660 0x7f606815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 0x7f60681ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6068153f40 0x7f60681579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606815b8d0 con 0x7f60680caa90 2023-11-28T21:02:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60681f2cc0 con 0x7f60680ca660 2023-11-28T21:02:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60681ec010 con 0x7f6068153f40 2023-11-28T21:02:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f605ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 0x7f60681ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:38.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f605ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 0x7f60681ebad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52614/0 (socket says 172.21.15.167:52614) 2023-11-28T21:02:38.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f605ffff640 1 -- 172.21.15.167:0/670337018 learned_addr learned my addr 172.21.15.167:0/670337018 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:38.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6066ffd640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60680ca660 0x7f606815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:38.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f605ffff640 1 -- 172.21.15.167:0/670337018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 msgr2=0x7f60681ebad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T21:02:38.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f605ffff640 1 -- 172.21.15.167:0/670337018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 msgr2=0x7f60681ebad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:02:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f60677fe640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6068153f40 0x7f60681579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f605ffff640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 0x7f60681ebad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f605ffff640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 0x7f60681ebad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6066ffd640 1 -- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6068153f40 msgr2=0x7f60681579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6066ffd640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6068153f40 0x7f60681579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6066ffd640 1 -- 172.21.15.167:0/670337018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 msgr2=0x7f60681ebad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:38.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6066ffd640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 0x7f60681ebad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:38.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6066ffd640 1 -- 172.21.15.167:0/670337018 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6060009a70 con 0x7f60680ca660 2023-11-28T21:02:38.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6066ffd640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60680ca660 0x7f606815ac60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f605800e8a0 tx=0x7f605800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:38.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6064ff9640 1 -- 172.21.15.167:0/670337018 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058009e70 con 0x7f60680ca660 2023-11-28T21:02:38.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60681524b0 con 0x7f60680ca660 2023-11-28T21:02:38.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6064ff9640 1 -- 172.21.15.167:0/670337018 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605800c940 con 0x7f60680ca660 2023-11-28T21:02:38.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f6064ff9640 1 -- 172.21.15.167:0/670337018 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800ccd0 con 0x7f60680ca660 2023-11-28T21:02:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606815b5f0 con 0x7f60680ca660 2023-11-28T21:02:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.876+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606804e850 con 0x7f60680ca660 2023-11-28T21:02:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.880+0000 7f6064ff9640 1 -- 172.21.15.167:0/670337018 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6058013470 con 0x7f60680ca660 2023-11-28T21:02:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.880+0000 7f6064ff9640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f60480664a0 0x7f6048068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.880+0000 7f6064ff9640 1 -- 172.21.15.167:0/670337018 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6058084b40 con 0x7f60680ca660 2023-11-28T21:02:38.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.880+0000 7f605ffff640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f60480664a0 0x7f6048068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:38.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.880+0000 7f605ffff640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f60480664a0 0x7f6048068960 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f60681ece10 tx=0x7f6050009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:38.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:38.892+0000 7f6064ff9640 1 -- 172.21.15.167:0/670337018 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6058051b50 con 0x7f60680ca660 2023-11-28T21:02:39.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.092+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f60680caec0 con 0x7f60680ca660 2023-11-28T21:02:39.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.092+0000 7f6064ff9640 1 -- 172.21.15.167:0/670337018 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f6058017080 con 0x7f60680ca660 2023-11-28T21:02:39.095 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":182,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:39.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f60480664a0 msgr2=0x7f6048068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:39.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f60480664a0 0x7f6048068960 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f60681ece10 tx=0x7f6050009040 comp rx=0 tx=0).stop 2023-11-28T21:02:39.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60680ca660 msgr2=0x7f606815ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:39.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60680ca660 0x7f606815ac60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f605800e8a0 tx=0x7f605800ed60 comp rx=0 tx=0).stop 2023-11-28T21:02:39.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 shutdown_connections 2023-11-28T21:02:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f60480664a0 0x7f6048068960 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6068153f40 0x7f60681579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60680caa90 0x7f60681ebad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 --2- 172.21.15.167:0/670337018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60680ca660 0x7f606815ac60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 >> 172.21.15.167:0/670337018 conn(0x7f606806b800 msgr2=0x7f6068151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 shutdown_connections 2023-11-28T21:02:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:39.096+0000 7f606d879640 1 -- 172.21.15.167:0/670337018 wait complete. 2023-11-28T21:02:41.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~208s 2023-11-28T21:02:42.117 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:42.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.260+0000 7f9fd2cbb640 1 Processor -- start 2023-11-28T21:02:42.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.260+0000 7f9fd2cbb640 1 -- start start 2023-11-28T21:02:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd2cbb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9fcc153db0 0x7f9fcc15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd2cbb640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc0cfef0 con 0x7f9fcc0cf440 2023-11-28T21:02:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd2cbb640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc0cc6e0 con 0x7f9fcc0ccb70 2023-11-28T21:02:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd2cbb640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc154190 con 0x7f9fcc153db0 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd1cb9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9fcc153db0 0x7f9fcc15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd1cb9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9fcc153db0 0x7f9fcc15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52628/0 (socket says 172.21.15.167:52628) 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd24ba640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9fcc0cf440 0x7f9fcc0ca350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51816/0 (socket says 172.21.15.167:51816) 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd1cb9640 1 -- 172.21.15.167:0/3920584779 learned_addr learned my addr 172.21.15.167:0/3920584779 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd1cb9640 1 -- 172.21.15.167:0/3920584779 >> v2:172.21.15.167:3300/0 conn(0x7f9fcc153db0 msgr2=0x7f9fcc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd1cb9640 1 -- 172.21.15.167:0/3920584779 >> v2:172.21.15.167:3300/0 conn(0x7f9fcc153db0 msgr2=0x7f9fcc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd1cb9640 1 --2- 172.21.15.167:0/3920584779 >> v2:172.21.15.167:3300/0 conn(0x7f9fcc153db0 0x7f9fcc15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd1cb9640 1 --2- 172.21.15.167:0/3920584779 >> v2:172.21.15.167:3300/0 conn(0x7f9fcc153db0 0x7f9fcc15a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194462261 0 0) 0x7f9fcc0cc6e0 con 0x7f9fcc0ccb70 2023-11-28T21:02:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb8003530 con 0x7f9fcc0ccb70 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2597786355 0 0) 0x7f9fb8003530 con 0x7f9fcc0ccb70 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 >> v2:172.21.15.167:3300/0 conn(0x7f9fcc153db0 msgr2=0x7f9fcc15a540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 --2- 172.21.15.167:0/3920584779 >> v2:172.21.15.167:3300/0 conn(0x7f9fcc153db0 0x7f9fcc15a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 >> v1:172.21.15.167:6789/0 conn(0x7f9fcc0cf440 legacy=0x7f9fcc0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc0cbad0 con 0x7f9fcc0ccb70 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9fbc001680 con 0x7f9fcc0ccb70 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 >> v1:172.21.15.178:6789/0 conn(0x7f9fcc0ccb70 legacy=0x7f9fcc0c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fb80039d0 0x7f9fb8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80047d0 0x7f9fb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb80051e0 0x7f9fb800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc154190 con 0x7f9fb80051e0 2023-11-28T21:02:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb800c130 con 0x7f9fb80047d0 2023-11-28T21:02:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb800c2f0 con 0x7f9fb80039d0 2023-11-28T21:02:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd24ba640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb80051e0 0x7f9fb800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd1cb9640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fb80039d0 0x7f9fb8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd14b8640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80047d0 0x7f9fb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd24ba640 1 -- 172.21.15.167:0/3920584779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fb80039d0 msgr2=0x7f9fb8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd24ba640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fb80039d0 0x7f9fb8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd24ba640 1 -- 172.21.15.167:0/3920584779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80047d0 msgr2=0x7f9fb8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd24ba640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80047d0 0x7f9fb8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd24ba640 1 -- 172.21.15.167:0/3920584779 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb8003530 con 0x7f9fb80051e0 2023-11-28T21:02:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.264+0000 7f9fd14b8640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80047d0 0x7f9fb8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd24ba640 1 -- 172.21.15.167:0/3920584779 reap_dead start 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd24ba640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb80051e0 0x7f9fb800b990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4001e90 tx=0x7f9fc401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94285779f86f1ac8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4004d70 con 0x7f9fb80051e0 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc40a6480 con 0x7f9fb80051e0 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd0cb7640 1 -- 172.21.15.167:0/3920584779 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40a67f0 con 0x7f9fb80051e0 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3920584779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb80051e0 msgr2=0x7f9fb800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd2cbb640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb80051e0 0x7f9fb800b990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4001e90 tx=0x7f9fc401c780 comp rx=0 tx=0).stop 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3920584779 shutdown_connections 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd2cbb640 1 --2- 172.21.15.167:0/3920584779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb80051e0 0x7f9fb800b990 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3920584779 >> 172.21.15.167:0/3920584779 conn(0x7f9fcc06b800 msgr2=0x7f9fcc06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:42.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3920584779 shutdown_connections 2023-11-28T21:02:42.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.268+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3920584779 wait complete. 2023-11-28T21:02:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 Processor -- start 2023-11-28T21:02:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 -- start start 2023-11-28T21:02:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80051e0 0x7f9fcc1effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc1498a0 0x7f9fcc0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 0x7f9fcc0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0b3d90 con 0x7f9fcc149d20 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc1593f0 con 0x7f9fb80051e0 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc159f80 con 0x7f9fcc1498a0 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd24ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 0x7f9fcc0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd24ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 0x7f9fcc0b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52642/0 (socket says 172.21.15.167:52642) 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd24ba640 1 -- 172.21.15.167:0/3903222463 learned_addr learned my addr 172.21.15.167:0/3903222463 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd24ba640 1 -- 172.21.15.167:0/3903222463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 msgr2=0x7f9fcc0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd24ba640 1 -- 172.21.15.167:0/3903222463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 msgr2=0x7f9fcc0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd24ba640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 0x7f9fcc0b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd1cb9640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80051e0 0x7f9fcc1effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd14b8640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc1498a0 0x7f9fcc0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd24ba640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 0x7f9fcc0b46f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd1cb9640 1 -- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc1498a0 msgr2=0x7f9fcc0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd1cb9640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc1498a0 0x7f9fcc0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd1cb9640 1 -- 172.21.15.167:0/3903222463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 msgr2=0x7f9fcc0b46f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd1cb9640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 0x7f9fcc0b46f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd1cb9640 1 -- 172.21.15.167:0/3903222463 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc157ea0 con 0x7f9fb80051e0 2023-11-28T21:02:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd1cb9640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80051e0 0x7f9fcc1effe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8010630 tx=0x7f9fc8010af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fc27fc640 1 -- 172.21.15.167:0/3903222463 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800e7d0 con 0x7f9fb80051e0 2023-11-28T21:02:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc1f0520 con 0x7f9fb80051e0 2023-11-28T21:02:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fc27fc640 1 -- 172.21.15.167:0/3903222463 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc800e930 con 0x7f9fb80051e0 2023-11-28T21:02:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fc27fc640 1 -- 172.21.15.167:0/3903222463 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800ecc0 con 0x7f9fb80051e0 2023-11-28T21:02:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.272+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc157bc0 con 0x7f9fb80051e0 2023-11-28T21:02:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.276+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb4005260 con 0x7f9fb80051e0 2023-11-28T21:02:42.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.276+0000 7f9fc27fc640 1 -- 172.21.15.167:0/3903222463 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9fc8015470 con 0x7f9fb80051e0 2023-11-28T21:02:42.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.276+0000 7f9fc27fc640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9fb0066470 0x7f9fb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:42.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.276+0000 7f9fc27fc640 1 -- 172.21.15.167:0/3903222463 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9fc8084b90 con 0x7f9fb80051e0 2023-11-28T21:02:42.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.276+0000 7f9fd14b8640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9fb0066470 0x7f9fb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:42.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.280+0000 7f9fd14b8640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9fb0066470 0x7f9fb0068930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc001ec0 tx=0x7f9fbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.288+0000 7f9fc27fc640 1 -- 172.21.15.167:0/3903222463 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fc8051c70 con 0x7f9fb80051e0 2023-11-28T21:02:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.492+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9fb40057e0 con 0x7f9fb80051e0 2023-11-28T21:02:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.492+0000 7f9fc27fc640 1 -- 172.21.15.167:0/3903222463 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f9fc8055290 con 0x7f9fb80051e0 2023-11-28T21:02:42.495 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":182,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":35,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9fb0066470 msgr2=0x7f9fb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9fb0066470 0x7f9fb0068930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc001ec0 tx=0x7f9fbc009040 comp rx=0 tx=0).stop 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80051e0 msgr2=0x7f9fcc1effe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80051e0 0x7f9fcc1effe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8010630 tx=0x7f9fc8010af0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 shutdown_connections 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9fb0066470 0x7f9fb0068930 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fcc149d20 0x7f9fcc0b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc1498a0 0x7f9fcc0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 --2- 172.21.15.167:0/3903222463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fb80051e0 0x7f9fcc1effe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 >> 172.21.15.167:0/3903222463 conn(0x7f9fcc06b800 msgr2=0x7f9fcc0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 shutdown_connections 2023-11-28T21:02:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:42.496+0000 7f9fd2cbb640 1 -- 172.21.15.167:0/3903222463 wait complete. 2023-11-28T21:02:45.517 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:45.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0763996640 1 Processor -- start 2023-11-28T21:02:45.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0763996640 1 -- start start 2023-11-28T21:02:45.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0763996640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f075c150b40 0x7f075c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:45.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0763996640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c0c6ff0 0x7f075c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:45.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0763996640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 0x7f075c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:45.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0763996640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c0c6ac0 con 0x7f075c0c5be0 2023-11-28T21:02:45.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0763996640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c0c6500 con 0x7f075c150b40 2023-11-28T21:02:45.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0763996640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0c67e0 con 0x7f075c0c6ff0 2023-11-28T21:02:45.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761f33640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 0x7f075c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:45.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761f33640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 0x7f075c06a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37790/0 (socket says 172.21.15.167:37790) 2023-11-28T21:02:45.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761f33640 1 -- 172.21.15.167:0/2248430958 learned_addr learned my addr 172.21.15.167:0/2248430958 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:45.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761732640 1 --2- 172.21.15.167:0/2248430958 >> v2:172.21.15.178:3300/0 conn(0x7f075c150b40 0x7f075c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:45.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0760f31640 1 --2- 172.21.15.167:0/2248430958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c0c6ff0 0x7f075c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:45.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761f33640 1 -- 172.21.15.167:0/2248430958 >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 msgr2=0x7f075c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:02:45.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761f33640 1 -- 172.21.15.167:0/2248430958 >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 msgr2=0x7f075c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:45.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761f33640 1 --2- 172.21.15.167:0/2248430958 >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 0x7f075c06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:45.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761f33640 1 --2- 172.21.15.167:0/2248430958 >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 0x7f075c06a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:45.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761732640 1 -- 172.21.15.167:0/2248430958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c0c6ff0 msgr2=0x7f075c0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:45.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761732640 1 --2- 172.21.15.167:0/2248430958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c0c6ff0 0x7f075c0c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761732640 1 -- 172.21.15.167:0/2248430958 >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 msgr2=0x7f075c06a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:45.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761732640 1 --2- 172.21.15.167:0/2248430958 >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 0x7f075c06a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.664+0000 7f0761732640 1 -- 172.21.15.167:0/2248430958 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c156a80 con 0x7f075c150b40 2023-11-28T21:02:45.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0761732640 1 --2- 172.21.15.167:0/2248430958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f075c150b40 0x7f075c157560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f075c0cc090 tx=0x7f075801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47d18191f7de7a78 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:45.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0753fff640 1 -- 172.21.15.167:0/2248430958 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580ab5f0 con 0x7f075c150b40 2023-11-28T21:02:45.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0753fff640 1 -- 172.21.15.167:0/2248430958 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07580ab750 con 0x7f075c150b40 2023-11-28T21:02:45.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0753fff640 1 -- 172.21.15.167:0/2248430958 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580abae0 con 0x7f075c150b40 2023-11-28T21:02:45.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0763996640 1 -- 172.21.15.167:0/2248430958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f075c150b40 msgr2=0x7f075c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:45.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0763996640 1 --2- 172.21.15.167:0/2248430958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f075c150b40 0x7f075c157560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f075c0cc090 tx=0x7f075801c430 comp rx=0 tx=0).stop 2023-11-28T21:02:45.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0763996640 1 -- 172.21.15.167:0/2248430958 shutdown_connections 2023-11-28T21:02:45.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0763996640 1 --2- 172.21.15.167:0/2248430958 >> v2:172.21.15.167:3300/0 conn(0x7f075c0c5be0 0x7f075c06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0763996640 1 --2- 172.21.15.167:0/2248430958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c0c6ff0 0x7f075c0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0763996640 1 --2- 172.21.15.167:0/2248430958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f075c150b40 0x7f075c157560 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0763996640 1 -- 172.21.15.167:0/2248430958 >> 172.21.15.167:0/2248430958 conn(0x7f075c0cb1e0 msgr2=0x7f075c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:45.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0763996640 1 -- 172.21.15.167:0/2248430958 shutdown_connections 2023-11-28T21:02:45.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.668+0000 7f0763996640 1 -- 172.21.15.167:0/2248430958 wait complete. 2023-11-28T21:02:45.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0763996640 1 Processor -- start 2023-11-28T21:02:45.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0763996640 1 -- start start 2023-11-28T21:02:45.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0763996640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f075c0c5be0 0x7f075c14e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:45.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0763996640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 0x7f075c1f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:45.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0763996640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c150b40 0x7f075c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:45.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0763996640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c14e810 con 0x7f075c0c6ff0 2023-11-28T21:02:45.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0763996640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c1f10f0 con 0x7f075c0c5be0 2023-11-28T21:02:45.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0763996640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c14cf40 con 0x7f075c150b40 2023-11-28T21:02:45.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0760f31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 0x7f075c1f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:45.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0760f31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 0x7f075c1f05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37796/0 (socket says 172.21.15.167:37796) 2023-11-28T21:02:45.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0760f31640 1 -- 172.21.15.167:0/2022213590 learned_addr learned my addr 172.21.15.167:0/2022213590 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:45.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0761732640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f075c0c5be0 0x7f075c14e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:45.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0760f31640 1 -- 172.21.15.167:0/2022213590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 msgr2=0x7f075c1f05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T21:02:45.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0760f31640 1 -- 172.21.15.167:0/2022213590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 msgr2=0x7f075c1f05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:02:45.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0760f31640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 0x7f075c1f05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:45.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0761f33640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c150b40 0x7f075c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:45.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0760f31640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 0x7f075c1f05e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:45.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0761f33640 1 -- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f075c0c5be0 msgr2=0x7f075c14e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:45.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0761f33640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f075c0c5be0 0x7f075c14e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0761f33640 1 -- 172.21.15.167:0/2022213590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 msgr2=0x7f075c1f05e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:45.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0761f33640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 0x7f075c1f05e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0761f33640 1 -- 172.21.15.167:0/2022213590 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758009420 con 0x7f075c150b40 2023-11-28T21:02:45.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.672+0000 7f0761f33640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c150b40 0x7f075c147950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0754009fd0 tx=0x7f0754007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:45.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.680+0000 7f0751ffb640 1 -- 172.21.15.167:0/2022213590 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400dbe0 con 0x7f075c150b40 2023-11-28T21:02:45.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.680+0000 7f0751ffb640 1 -- 172.21.15.167:0/2022213590 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075400f040 con 0x7f075c150b40 2023-11-28T21:02:45.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.680+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c14d220 con 0x7f075c150b40 2023-11-28T21:02:45.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.680+0000 7f0751ffb640 1 -- 172.21.15.167:0/2022213590 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754015400 con 0x7f075c150b40 2023-11-28T21:02:45.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.680+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c0c8fe0 con 0x7f075c150b40 2023-11-28T21:02:45.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.680+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c0682c0 con 0x7f075c150b40 2023-11-28T21:02:45.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.680+0000 7f0751ffb640 1 -- 172.21.15.167:0/2022213590 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0754015560 con 0x7f075c150b40 2023-11-28T21:02:45.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.680+0000 7f0751ffb640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f07400664c0 0x7f0740068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:45.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.680+0000 7f0751ffb640 1 -- 172.21.15.167:0/2022213590 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0754084170 con 0x7f075c150b40 2023-11-28T21:02:45.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.684+0000 7f0761732640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f07400664c0 0x7f0740068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:45.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.684+0000 7f0761732640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f07400664c0 0x7f0740068980 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f07580af000 tx=0x7f07580a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:45.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.692+0000 7f0751ffb640 1 -- 172.21.15.167:0/2022213590 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0754051390 con 0x7f075c150b40 2023-11-28T21:02:45.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.896+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f075c14d740 con 0x7f075c150b40 2023-11-28T21:02:45.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.896+0000 7f0751ffb640 1 -- 172.21.15.167:0/2022213590 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f075401a620 con 0x7f075c150b40 2023-11-28T21:02:45.899 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":182,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":38,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:45.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f07400664c0 msgr2=0x7f0740068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:45.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f07400664c0 0x7f0740068980 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f07580af000 tx=0x7f07580a7000 comp rx=0 tx=0).stop 2023-11-28T21:02:45.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c150b40 msgr2=0x7f075c147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:45.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c150b40 0x7f075c147950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0754009fd0 tx=0x7f0754007ef0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 shutdown_connections 2023-11-28T21:02:45.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f07400664c0 0x7f0740068980 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f075c150b40 0x7f075c147950 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f075c0c6ff0 0x7f075c1f05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 --2- 172.21.15.167:0/2022213590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f075c0c5be0 0x7f075c14e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:45.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 >> 172.21.15.167:0/2022213590 conn(0x7f075c0cb1e0 msgr2=0x7f075c0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:45.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 shutdown_connections 2023-11-28T21:02:45.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:45.900+0000 7f0763996640 1 -- 172.21.15.167:0/2022213590 wait complete. 2023-11-28T21:02:48.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~215s 2023-11-28T21:02:48.922 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:49.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f4530e6b640 1 Processor -- start 2023-11-28T21:02:49.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f4530e6b640 1 -- start start 2023-11-28T21:02:49.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f4530e6b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 0x7f452c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f4530e6b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c6ff0 0x7f452c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f4530e6b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c0c6ac0 con 0x7f452c0c5be0 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f4530e6b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f452c0c6500 con 0x7f452c150b40 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f4530e6b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0c67e0 con 0x7f452c0c6ff0 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f452a59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 0x7f452c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f452ad9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f452c0c5be0 0x7f452c06a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51798/0 (socket says 172.21.15.167:51798) 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f452ad9d640 1 -- 172.21.15.167:0/428533472 learned_addr learned my addr 172.21.15.167:0/428533472 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f452a59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 0x7f452c157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37804/0 (socket says 172.21.15.167:37804) 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f4523fff640 1 --2- 172.21.15.167:0/428533472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c6ff0 0x7f452c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:49.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f452a59c640 1 -- 172.21.15.167:0/428533472 >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 msgr2=0x7f452c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:02:49.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f452a59c640 1 -- 172.21.15.167:0/428533472 >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 msgr2=0x7f452c157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:02:49.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f452a59c640 1 --2- 172.21.15.167:0/428533472 >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 0x7f452c157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:49.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.068+0000 7f452a59c640 1 --2- 172.21.15.167:0/428533472 >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 0x7f452c157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:49.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4523fff640 1 -- 172.21.15.167:0/428533472 >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 msgr2=0x7f452c157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:02:49.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4523fff640 1 --2- 172.21.15.167:0/428533472 >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 0x7f452c157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4523fff640 1 -- 172.21.15.167:0/428533472 >> v1:172.21.15.167:6789/0 conn(0x7f452c0c5be0 legacy=0x7f452c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:49.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4523fff640 1 -- 172.21.15.167:0/428533472 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c156a80 con 0x7f452c0c6ff0 2023-11-28T21:02:49.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4523fff640 1 --2- 172.21.15.167:0/428533472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c6ff0 0x7f452c0c4510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f45140097c0 tx=0x7f451401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad8f39d47606138 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:49.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4529d9b640 1 -- 172.21.15.167:0/428533472 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140ab650 con 0x7f452c0c6ff0 2023-11-28T21:02:49.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4529d9b640 1 -- 172.21.15.167:0/428533472 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45140ab7b0 con 0x7f452c0c6ff0 2023-11-28T21:02:49.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4529d9b640 1 -- 172.21.15.167:0/428533472 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140abb40 con 0x7f452c0c6ff0 2023-11-28T21:02:49.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4530e6b640 1 -- 172.21.15.167:0/428533472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c6ff0 msgr2=0x7f452c0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:49.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.072+0000 7f4530e6b640 1 --2- 172.21.15.167:0/428533472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c6ff0 0x7f452c0c4510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f45140097c0 tx=0x7f451401c450 comp rx=0 tx=0).stop 2023-11-28T21:02:49.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 -- 172.21.15.167:0/428533472 shutdown_connections 2023-11-28T21:02:49.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 --2- 172.21.15.167:0/428533472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c6ff0 0x7f452c0c4510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 --2- 172.21.15.167:0/428533472 >> v2:172.21.15.167:3300/0 conn(0x7f452c150b40 0x7f452c157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 -- 172.21.15.167:0/428533472 >> 172.21.15.167:0/428533472 conn(0x7f452c0cb1e0 msgr2=0x7f452c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:49.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 -- 172.21.15.167:0/428533472 shutdown_connections 2023-11-28T21:02:49.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 -- 172.21.15.167:0/428533472 wait complete. 2023-11-28T21:02:49.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 Processor -- start 2023-11-28T21:02:49.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 -- start start 2023-11-28T21:02:49.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c5be0 0x7f452c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:49.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0c6ff0 0x7f452c149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:49.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 0x7f452c149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:49.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c1548a0 con 0x7f452c150b40 2023-11-28T21:02:49.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c155d70 con 0x7f452c0c6ff0 2023-11-28T21:02:49.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4530e6b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c156560 con 0x7f452c0c5be0 2023-11-28T21:02:49.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 0x7f452c149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:49.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 0x7f452c149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37818/0 (socket says 172.21.15.167:37818) 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452ad9d640 1 -- 172.21.15.167:0/2966680698 learned_addr learned my addr 172.21.15.167:0/2966680698 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452a59c640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c5be0 0x7f452c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f4523fff640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0c6ff0 0x7f452c149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452ad9d640 1 -- 172.21.15.167:0/2966680698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 msgr2=0x7f452c149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452ad9d640 1 -- 172.21.15.167:0/2966680698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 msgr2=0x7f452c149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452ad9d640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 0x7f452c149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452ad9d640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 0x7f452c149ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452a59c640 1 -- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0c6ff0 msgr2=0x7f452c149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452a59c640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0c6ff0 0x7f452c149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452a59c640 1 -- 172.21.15.167:0/2966680698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 msgr2=0x7f452c149ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:49.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452a59c640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 0x7f452c149ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.076+0000 7f452a59c640 1 -- 172.21.15.167:0/2966680698 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514009420 con 0x7f452c0c5be0 2023-11-28T21:02:49.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f452a59c640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c5be0 0x7f452c14f420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f451c00e7e0 tx=0x7f451c00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:49.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4522ffd640 1 -- 172.21.15.167:0/2966680698 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c00edd0 con 0x7f452c0c5be0 2023-11-28T21:02:49.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4522ffd640 1 -- 172.21.15.167:0/2966680698 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c004020 con 0x7f452c0c5be0 2023-11-28T21:02:49.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4522ffd640 1 -- 172.21.15.167:0/2966680698 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0043d0 con 0x7f452c0c5be0 2023-11-28T21:02:49.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c14ef40 con 0x7f452c0c5be0 2023-11-28T21:02:49.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c155fa0 con 0x7f452c0c5be0 2023-11-28T21:02:49.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c0682c0 con 0x7f452c0c5be0 2023-11-28T21:02:49.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4522ffd640 1 -- 172.21.15.167:0/2966680698 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f451c00c6d0 con 0x7f452c0c5be0 2023-11-28T21:02:49.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4522ffd640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f450c066470 0x7f450c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:49.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4522ffd640 1 -- 172.21.15.167:0/2966680698 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f451c0844d0 con 0x7f452c0c5be0 2023-11-28T21:02:49.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.080+0000 7f4523fff640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f450c066470 0x7f450c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:49.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.084+0000 7f4523fff640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f450c066470 0x7f450c068930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f45140af000 tx=0x7f45140a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:49.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.092+0000 7f4522ffd640 1 -- 172.21.15.167:0/2966680698 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f451c0515d0 con 0x7f452c0c5be0 2023-11-28T21:02:49.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.296+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f452c075c90 con 0x7f452c0c5be0 2023-11-28T21:02:49.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4522ffd640 1 -- 172.21.15.167:0/2966680698 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f451c017080 con 0x7f452c0c5be0 2023-11-28T21:02:49.301 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":182,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":41,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:49.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f450c066470 msgr2=0x7f450c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:49.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f450c066470 0x7f450c068930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f45140af000 tx=0x7f45140a7000 comp rx=0 tx=0).stop 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c5be0 msgr2=0x7f452c14f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c5be0 0x7f452c14f420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f451c00e7e0 tx=0x7f451c00eca0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 shutdown_connections 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f450c066470 0x7f450c068930 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f452c150b40 0x7f452c149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0c6ff0 0x7f452c149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 --2- 172.21.15.167:0/2966680698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c0c5be0 0x7f452c14f420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 >> 172.21.15.167:0/2966680698 conn(0x7f452c0cb1e0 msgr2=0x7f452c160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 shutdown_connections 2023-11-28T21:02:49.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:49.300+0000 7f4530e6b640 1 -- 172.21.15.167:0/2966680698 wait complete. 2023-11-28T21:02:52.323 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:52.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37e18bb640 1 Processor -- start 2023-11-28T21:02:52.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37e18bb640 1 -- start start 2023-11-28T21:02:52.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37e18bb640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37dc150b40 0x7f37dc157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:52.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37e18bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c6ff0 0x7f37dc0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:52.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37e18bb640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc0c6ac0 con 0x7f37dc0c5be0 2023-11-28T21:02:52.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37e18bb640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc0c6500 con 0x7f37dc150b40 2023-11-28T21:02:52.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37e18bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c67e0 con 0x7f37dc0c6ff0 2023-11-28T21:02:52.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37d27fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c6ff0 0x7f37dc0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:52.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37daffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37dc150b40 0x7f37dc157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:52.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37d27fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c6ff0 0x7f37dc0c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:39122/0 (socket says 172.21.15.167:39122) 2023-11-28T21:02:52.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37daffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37dc150b40 0x7f37dc157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:39794/0 (socket says 172.21.15.167:39794) 2023-11-28T21:02:52.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.468+0000 7f37d27fc640 1 -- 172.21.15.167:0/1833114511 learned_addr learned my addr 172.21.15.167:0/1833114511 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:52.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.472+0000 7f37d27fc640 1 -- 172.21.15.167:0/1833114511 >> v2:172.21.15.178:3300/0 conn(0x7f37dc150b40 msgr2=0x7f37dc157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:52.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.472+0000 7f37d27fc640 1 --2- 172.21.15.167:0/1833114511 >> v2:172.21.15.178:3300/0 conn(0x7f37dc150b40 0x7f37dc157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:52.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.472+0000 7f37d27fc640 1 -- 172.21.15.167:0/1833114511 >> v1:172.21.15.178:6789/0 conn(0x7f37dc0c5be0 legacy=0x7f37dc06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:52.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.472+0000 7f37d27fc640 1 -- 172.21.15.167:0/1833114511 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc156a80 con 0x7f37dc0c6ff0 2023-11-28T21:02:52.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.472+0000 7f37d27fc640 1 --2- 172.21.15.167:0/1833114511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c6ff0 0x7f37dc0c4510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009870 tx=0x7f37c401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a0977da5f14619 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:52.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.472+0000 7f37da7fc640 1 -- 172.21.15.167:0/1833114511 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40ab610 con 0x7f37dc0c6ff0 2023-11-28T21:02:52.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.472+0000 7f37da7fc640 1 -- 172.21.15.167:0/1833114511 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c40ab770 con 0x7f37dc0c6ff0 2023-11-28T21:02:52.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.472+0000 7f37da7fc640 1 -- 172.21.15.167:0/1833114511 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40abb00 con 0x7f37dc0c6ff0 2023-11-28T21:02:52.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 -- 172.21.15.167:0/1833114511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c6ff0 msgr2=0x7f37dc0c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:52.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 --2- 172.21.15.167:0/1833114511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c6ff0 0x7f37dc0c4510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009870 tx=0x7f37c401c510 comp rx=0 tx=0).stop 2023-11-28T21:02:52.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 -- 172.21.15.167:0/1833114511 shutdown_connections 2023-11-28T21:02:52.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 --2- 172.21.15.167:0/1833114511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c6ff0 0x7f37dc0c4510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:52.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 --2- 172.21.15.167:0/1833114511 >> v2:172.21.15.178:3300/0 conn(0x7f37dc150b40 0x7f37dc157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:52.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 -- 172.21.15.167:0/1833114511 >> 172.21.15.167:0/1833114511 conn(0x7f37dc0cb1e0 msgr2=0x7f37dc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:52.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 -- 172.21.15.167:0/1833114511 shutdown_connections 2023-11-28T21:02:52.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 -- 172.21.15.167:0/1833114511 wait complete. 2023-11-28T21:02:52.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 Processor -- start 2023-11-28T21:02:52.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 -- start start 2023-11-28T21:02:52.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c5be0 0x7f37dc1f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:52.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 0x7f37dc141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:52.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37dc150b40 0x7f37dc1484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:52.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc14e0a0 con 0x7f37dc0c6ff0 2023-11-28T21:02:52.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc146ca0 con 0x7f37dc150b40 2023-11-28T21:02:52.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37e18bb640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc146120 con 0x7f37dc0c5be0 2023-11-28T21:02:52.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37d27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 0x7f37dc141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:52.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37d27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 0x7f37dc141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37828/0 (socket says 172.21.15.167:37828) 2023-11-28T21:02:52.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37d27fc640 1 -- 172.21.15.167:0/795569567 learned_addr learned my addr 172.21.15.167:0/795569567 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:52.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37db7fe640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37dc150b40 0x7f37dc1484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:52.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37daffd640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c5be0 0x7f37dc1f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:52.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37d27fc640 1 -- 172.21.15.167:0/795569567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 msgr2=0x7f37dc141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T21:02:52.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37d27fc640 1 -- 172.21.15.167:0/795569567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 msgr2=0x7f37dc141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:02:52.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37d27fc640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 0x7f37dc141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:02:52.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.476+0000 7f37d27fc640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 0x7f37dc141da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:02:52.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37daffd640 1 -- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37dc150b40 msgr2=0x7f37dc1484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:52.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37daffd640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37dc150b40 0x7f37dc1484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:52.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37daffd640 1 -- 172.21.15.167:0/795569567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 msgr2=0x7f37dc141da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:02:52.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37daffd640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 0x7f37dc141da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:52.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37daffd640 1 -- 172.21.15.167:0/795569567 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c40094d0 con 0x7f37dc0c5be0 2023-11-28T21:02:52.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37daffd640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c5be0 0x7f37dc1f6310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00bd50 tx=0x7f37cc00e490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:52.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37d8ff9640 1 -- 172.21.15.167:0/795569567 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc010040 con 0x7f37dc0c5be0 2023-11-28T21:02:52.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37d8ff9640 1 -- 172.21.15.167:0/795569567 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc00b0d0 con 0x7f37dc0c5be0 2023-11-28T21:02:52.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37d8ff9640 1 -- 172.21.15.167:0/795569567 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc009540 con 0x7f37dc0c5be0 2023-11-28T21:02:52.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc146400 con 0x7f37dc0c5be0 2023-11-28T21:02:52.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc1469c0 con 0x7f37dc0c5be0 2023-11-28T21:02:52.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc0682c0 con 0x7f37dc0c5be0 2023-11-28T21:02:52.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.480+0000 7f37d8ff9640 1 -- 172.21.15.167:0/795569567 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37cc0096a0 con 0x7f37dc0c5be0 2023-11-28T21:02:52.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.484+0000 7f37d8ff9640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37bc0664a0 0x7f37bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:52.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.484+0000 7f37d8ff9640 1 -- 172.21.15.167:0/795569567 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f37cc0850f0 con 0x7f37dc0c5be0 2023-11-28T21:02:52.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.484+0000 7f37d27fc640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37bc0664a0 0x7f37bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:52.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.484+0000 7f37d27fc640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37bc0664a0 0x7f37bc068960 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009870 tx=0x7f37c40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:52.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.492+0000 7f37d8ff9640 1 -- 172.21.15.167:0/795569567 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37cc0521f0 con 0x7f37dc0c5be0 2023-11-28T21:02:52.614 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:52.619 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:52.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f37dc075c90 con 0x7f37dc0c5be0 2023-11-28T21:02:52.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37d8ff9640 1 -- 172.21.15.167:0/795569567 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f37cc055810 con 0x7f37dc0c5be0 2023-11-28T21:02:52.702 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":182,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":45,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:52.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37bc0664a0 msgr2=0x7f37bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:52.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37bc0664a0 0x7f37bc068960 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009870 tx=0x7f37c40a7000 comp rx=0 tx=0).stop 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c5be0 msgr2=0x7f37dc1f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c5be0 0x7f37dc1f6310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00bd50 tx=0x7f37cc00e490 comp rx=0 tx=0).stop 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 shutdown_connections 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37bc0664a0 0x7f37bc068960 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37dc150b40 0x7f37dc1484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37dc0c6ff0 0x7f37dc141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 --2- 172.21.15.167:0/795569567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37dc0c5be0 0x7f37dc1f6310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.700+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 >> 172.21.15.167:0/795569567 conn(0x7f37dc0cb1e0 msgr2=0x7f37dc073a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.704+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 shutdown_connections 2023-11-28T21:02:52.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:52.704+0000 7f37e18bb640 1 -- 172.21.15.167:0/795569567 wait complete. 2023-11-28T21:02:55.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~222s 2023-11-28T21:02:55.724 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:02:55.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fecf5396640 1 Processor -- start 2023-11-28T21:02:55.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fecf5396640 1 -- start start 2023-11-28T21:02:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fecf5396640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fecf006e030 0x7fecf01500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fecf5396640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fecf0072630 0x7fecf01505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:55.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fecf5396640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf01571d0 con 0x7fecf0070480 2023-11-28T21:02:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fecf5396640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf0071a90 con 0x7fecf006e030 2023-11-28T21:02:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fecf5396640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf00c70d0 con 0x7fecf0072630 2023-11-28T21:02:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7feceeffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fecf006e030 0x7fecf01500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fece67fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fecf0070480 0x7fecf0071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50914/0 (socket says 172.21.15.167:50914) 2023-11-28T21:02:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fece67fc640 1 -- 172.21.15.167:0/1558198462 learned_addr learned my addr 172.21.15.167:0/1558198462 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:02:55.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.872+0000 7fecef7fe640 1 --2- 172.21.15.167:0/1558198462 >> v2:172.21.15.178:3300/0 conn(0x7fecf0072630 0x7fecf01505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:55.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.876+0000 7feceeffd640 1 -- 172.21.15.167:0/1558198462 >> v2:172.21.15.178:3300/0 conn(0x7fecf0072630 msgr2=0x7fecf01505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:55.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.876+0000 7feceeffd640 1 --2- 172.21.15.167:0/1558198462 >> v2:172.21.15.178:3300/0 conn(0x7fecf0072630 0x7fecf01505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:55.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.876+0000 7feceeffd640 1 -- 172.21.15.167:0/1558198462 >> v1:172.21.15.167:6789/0 conn(0x7fecf0070480 legacy=0x7fecf0071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:55.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.876+0000 7fecee7fc640 1 -- 172.21.15.167:0/1558198462 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451279628 0 0) 0x7fecf01571d0 con 0x7fecf0070480 2023-11-28T21:02:55.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.876+0000 7feceeffd640 1 -- 172.21.15.167:0/1558198462 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf00c73b0 con 0x7fecf006e030 2023-11-28T21:02:55.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.876+0000 7feceeffd640 1 --2- 172.21.15.167:0/1558198462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf006e030 0x7fecf01500b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fecf006c280 tx=0x7fece001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e9cce365700787 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:55.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.876+0000 7fecee7fc640 1 -- 172.21.15.167:0/1558198462 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00a7070 con 0x7fecf006e030 2023-11-28T21:02:55.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.876+0000 7fecee7fc640 1 -- 172.21.15.167:0/1558198462 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece00ab430 con 0x7fecf006e030 2023-11-28T21:02:55.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.876+0000 7fecee7fc640 1 -- 172.21.15.167:0/1558198462 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00ab7c0 con 0x7fecf006e030 2023-11-28T21:02:55.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 -- 172.21.15.167:0/1558198462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf006e030 msgr2=0x7fecf01500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:55.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 --2- 172.21.15.167:0/1558198462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf006e030 0x7fecf01500b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fecf006c280 tx=0x7fece001c430 comp rx=0 tx=0).stop 2023-11-28T21:02:55.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 -- 172.21.15.167:0/1558198462 shutdown_connections 2023-11-28T21:02:55.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 --2- 172.21.15.167:0/1558198462 >> v2:172.21.15.178:3300/0 conn(0x7fecf0072630 0x7fecf01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:55.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 --2- 172.21.15.167:0/1558198462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf006e030 0x7fecf01500b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:55.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 -- 172.21.15.167:0/1558198462 >> 172.21.15.167:0/1558198462 conn(0x7fecf00cb1e0 msgr2=0x7fecf00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:55.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 -- 172.21.15.167:0/1558198462 shutdown_connections 2023-11-28T21:02:55.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 -- 172.21.15.167:0/1558198462 wait complete. 2023-11-28T21:02:55.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 Processor -- start 2023-11-28T21:02:55.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 -- start start 2023-11-28T21:02:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf006e030 0x7fecf01f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf0070480 0x7fecf0159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0072630 0x7fecf0143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf01f4d80 con 0x7fecf0072630 2023-11-28T21:02:55.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf01f1d10 con 0x7fecf0070480 2023-11-28T21:02:55.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecf5396640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf0148b90 con 0x7fecf006e030 2023-11-28T21:02:55.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0072630 0x7fecf0143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:55.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0072630 0x7fecf0143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34398/0 (socket says 172.21.15.167:34398) 2023-11-28T21:02:55.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fecef7fe640 1 -- 172.21.15.167:0/2936172837 learned_addr learned my addr 172.21.15.167:0/2936172837 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:55.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7fece67fc640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf0070480 0x7fecf0159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:55.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.880+0000 7feceeffd640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf006e030 0x7fecf01f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fecef7fe640 1 -- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf006e030 msgr2=0x7fecf01f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fecef7fe640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf006e030 0x7fecf01f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fecef7fe640 1 -- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf0070480 msgr2=0x7fecf0159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fecef7fe640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf0070480 0x7fecf0159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fecef7fe640 1 -- 172.21.15.167:0/2936172837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0009420 con 0x7fecf0072630 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fece67fc640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf0070480 0x7fecf0159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fecef7fe640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0072630 0x7fecf0143d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fece800d500 tx=0x7fece800d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fece7fff640 1 -- 172.21.15.167:0/2936172837 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece80125f0 con 0x7fecf0072630 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fece7fff640 1 -- 172.21.15.167:0/2936172837 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece8012750 con 0x7fecf0072630 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fece7fff640 1 -- 172.21.15.167:0/2936172837 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8012b00 con 0x7fecf0072630 2023-11-28T21:02:55.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf0148e50 con 0x7fecf0072630 2023-11-28T21:02:55.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf01f43e0 con 0x7fecf0072630 2023-11-28T21:02:55.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf00682c0 con 0x7fecf0072630 2023-11-28T21:02:55.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fece7fff640 1 -- 172.21.15.167:0/2936172837 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fece8012c60 con 0x7fecf0072630 2023-11-28T21:02:55.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fece7fff640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fecd0066470 0x7fecd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:55.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7fece7fff640 1 -- 172.21.15.167:0/2936172837 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fece8084480 con 0x7fecf0072630 2023-11-28T21:02:55.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.884+0000 7feceeffd640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fecd0066470 0x7fecd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:55.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.888+0000 7feceeffd640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fecd0066470 0x7fecd0068930 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fece00af000 tx=0x7fece00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:55.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:55.892+0000 7fece7fff640 1 -- 172.21.15.167:0/2936172837 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fece8051480 con 0x7fecf0072630 2023-11-28T21:02:56.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fecf01f4ec0 con 0x7fecf0072630 2023-11-28T21:02:56.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fece7fff640 1 -- 172.21.15.167:0/2936172837 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7fece8054aa0 con 0x7fecf0072630 2023-11-28T21:02:56.098 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":186,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:02:56.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fecd0066470 msgr2=0x7fecd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fecd0066470 0x7fecd0068930 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fece00af000 tx=0x7fece00a7000 comp rx=0 tx=0).stop 2023-11-28T21:02:56.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0072630 msgr2=0x7fecf0143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0072630 0x7fecf0143d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fece800d500 tx=0x7fece800d9c0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 shutdown_connections 2023-11-28T21:02:56.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fecd0066470 0x7fecd0068930 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecf0072630 0x7fecf0143d40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf0070480 0x7fecf0159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 --2- 172.21.15.167:0/2936172837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf006e030 0x7fecf01f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 >> 172.21.15.167:0/2936172837 conn(0x7fecf00cb1e0 msgr2=0x7fecf00c4960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:56.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 shutdown_connections 2023-11-28T21:02:56.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.096+0000 7fecf5396640 1 -- 172.21.15.167:0/2936172837 wait complete. 2023-11-28T21:02:56.119 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:02:56.119 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T21:02:56.119 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:02:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.256+0000 7f9de29f2640 1 Processor -- start 2023-11-28T21:02:56.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.256+0000 7f9de29f2640 1 -- start start 2023-11-28T21:02:56.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de29f2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc14e260 0x7f9ddc1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de29f2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ddc06f100 con 0x7f9ddc0c24b0 2023-11-28T21:02:56.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de29f2640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ddc06e810 con 0x7f9ddc0c2c50 2023-11-28T21:02:56.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de29f2640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0c3970 con 0x7f9ddc14e260 2023-11-28T21:02:56.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de11ef640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9ddc0c24b0 0x7f9ddc0c8e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50920/0 (socket says 172.21.15.167:50920) 2023-11-28T21:02:56.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de11ef640 1 -- 172.21.15.167:0/3773898845 learned_addr learned my addr 172.21.15.167:0/3773898845 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:02:56.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de19f0640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc14e260 0x7f9ddc1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234600984 0 0) 0x7f9ddc06f100 con 0x7f9ddc0c24b0 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc8003530 con 0x7f9ddc0c24b0 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 690900771 0 0) 0x7f9dc8003530 con 0x7f9ddc0c24b0 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc14e260 msgr2=0x7f9ddc1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc14e260 0x7f9ddc1582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 >> v1:172.21.15.178:6789/0 conn(0x7f9ddc0c2c50 legacy=0x7f9ddc1621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc0c8010 con 0x7f9ddc0c24b0 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9dcc001680 con 0x7f9ddc0c24b0 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 >> v1:172.21.15.167:6789/0 conn(0x7f9ddc0c24b0 legacy=0x7f9ddc0c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc80039b0 0x7f9dc8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc14e260 0x7f9dc80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 0x7f9dc8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0c3970 con 0x7f9dc8004d10 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc800b990 con 0x7f9dc80039b0 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc800bb50 con 0x7f9ddc14e260 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de21f1640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 0x7f9dc8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de19f0640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc80039b0 0x7f9dc8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de11ef640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc14e260 0x7f9dc80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de21f1640 1 -- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc14e260 msgr2=0x7f9dc80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de21f1640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc14e260 0x7f9dc80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de21f1640 1 -- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc80039b0 msgr2=0x7f9dc8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de21f1640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dc80039b0 0x7f9dc8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.260+0000 7f9de21f1640 1 -- 172.21.15.167:0/3773898845 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc8003530 con 0x7f9dc8004d10 2023-11-28T21:02:56.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de21f1640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 0x7f9dc8005190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4001f60 tx=0x7f9dd401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519228b35f14f8a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40a5750 con 0x7f9dc8004d10 2023-11-28T21:02:56.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd40a58b0 con 0x7f9dc8004d10 2023-11-28T21:02:56.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de09ee640 1 -- 172.21.15.167:0/3773898845 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40a5c60 con 0x7f9dc8004d10 2023-11-28T21:02:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de29f2640 1 -- 172.21.15.167:0/3773898845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 msgr2=0x7f9dc8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de29f2640 1 --2- 172.21.15.167:0/3773898845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 0x7f9dc8005190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4001f60 tx=0x7f9dd401c860 comp rx=0 tx=0).stop 2023-11-28T21:02:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de21f1640 1 -- 172.21.15.167:0/3773898845 reap_dead start 2023-11-28T21:02:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de29f2640 1 -- 172.21.15.167:0/3773898845 shutdown_connections 2023-11-28T21:02:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de29f2640 1 -- 172.21.15.167:0/3773898845 >> 172.21.15.167:0/3773898845 conn(0x7f9ddc0701a0 msgr2=0x7f9ddc0705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:56.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de29f2640 1 -- 172.21.15.167:0/3773898845 shutdown_connections 2023-11-28T21:02:56.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.264+0000 7f9de29f2640 1 -- 172.21.15.167:0/3773898845 wait complete. 2023-11-28T21:02:56.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 Processor -- start 2023-11-28T21:02:56.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 -- start start 2023-11-28T21:02:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 0x7f9ddc15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ddc1589e0 0x7f9ddc1ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc0cb290 0x7f9ddc0cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0ce150 con 0x7f9dc8004d10 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0c67a0 con 0x7f9ddc1589e0 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0c6a80 con 0x7f9ddc0cb290 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de19f0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 0x7f9ddc15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de19f0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 0x7f9ddc15b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34410/0 (socket says 172.21.15.167:34410) 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de19f0640 1 -- 172.21.15.167:0/2569417205 learned_addr learned my addr 172.21.15.167:0/2569417205 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de11ef640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ddc1589e0 0x7f9ddc1ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de21f1640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc0cb290 0x7f9ddc0cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de19f0640 1 -- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc0cb290 msgr2=0x7f9ddc0cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de19f0640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ddc0cb290 0x7f9ddc0cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de19f0640 1 -- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ddc1589e0 msgr2=0x7f9ddc1ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de19f0640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ddc1589e0 0x7f9ddc1ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de19f0640 1 -- 172.21.15.167:0/2569417205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc0cbc10 con 0x7f9dc8004d10 2023-11-28T21:02:56.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de19f0640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 0x7f9ddc15b960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80119d0 tx=0x7f9dd8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800fb50 con 0x7f9dc8004d10 2023-11-28T21:02:56.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd800fcb0 con 0x7f9dc8004d10 2023-11-28T21:02:56.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ddc0cbef0 con 0x7f9dc8004d10 2023-11-28T21:02:56.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8014440 con 0x7f9dc8004d10 2023-11-28T21:02:56.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ddc0c7230 con 0x7f9dc8004d10 2023-11-28T21:02:56.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc0c7480 0x7f9ddc15aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.268+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc06b0c0 con 0x7f9ddc0c7480 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9de11ef640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc0c7480 0x7f9ddc15aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9de11ef640 1 -- 172.21.15.167:0/2569417205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ddc067e30 con 0x7f9ddc0c7480 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9de11ef640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc0c7480 0x7f9ddc15aa80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001cb0 tx=0x7f9dcc010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9dd80145a0 con 0x7f9dc8004d10 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9dd27fc640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9dc0066470 0x7f9dc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00e930 con 0x7f9ddc0c7480 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9dd8084b00 con 0x7f9dc8004d10 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f9dcc00ea90 con 0x7f9ddc0c7480 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9de21f1640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9dc0066470 0x7f9dc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc0c7480 msgr2=0x7f9ddc15aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9dd27fc640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc0c7480 0x7f9ddc15aa80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001cb0 tx=0x7f9dcc010c10 comp rx=0 tx=0).stop 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc0c7480 msgr2=0x7f9ddc15aa80 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:56.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9dd27fc640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc0c7480 0x7f9ddc15aa80 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001cb0 tx=0x7f9dcc010c10 comp rx=0 tx=0).stop 2023-11-28T21:02:56.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.272+0000 7f9de21f1640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9dc0066470 0x7f9dc0068930 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40af000 tx=0x7f9dd40a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc15afc0 0x7f9ddc1f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0cbda0 con 0x7f9ddc15afc0 2023-11-28T21:02:56.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de11ef640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc15afc0 0x7f9ddc1f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de11ef640 1 -- 172.21.15.167:0/2569417205 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9ddc0c82f0 con 0x7f9ddc15afc0 2023-11-28T21:02:56.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de11ef640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc15afc0 0x7f9ddc1f02a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001cb0 tx=0x7f9dcc001c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc01d6e0 con 0x7f9ddc15afc0 2023-11-28T21:02:56.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4472 (secure 0 0 0) 0x7f9dcc01d840 con 0x7f9ddc15afc0 2023-11-28T21:02:56.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc15afc0 msgr2=0x7f9ddc1f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9dd27fc640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc15afc0 0x7f9ddc1f02a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001cb0 tx=0x7f9dcc001c40 comp rx=0 tx=0).stop 2023-11-28T21:02:56.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9dd27fc640 1 -- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc15afc0 msgr2=0x7f9ddc1f02a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:56.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9dd27fc640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ddc15afc0 0x7f9ddc1f02a0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc001cb0 tx=0x7f9dcc001c40 comp rx=0 tx=0).stop 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 186, 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.283 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:56.284 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:56.285 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:56.286 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:56.287 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:02:56.288 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.289 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:56.290 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:02:56.291 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:56.292 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:02:56.293 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.294 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:02:56.295 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:02:56.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9dc0066470 msgr2=0x7f9dc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9dc0066470 0x7f9dc0068930 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40af000 tx=0x7f9dd40a7070 comp rx=0 tx=0).stop 2023-11-28T21:02:56.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 msgr2=0x7f9ddc15b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 --2- 172.21.15.167:0/2569417205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8004d10 0x7f9ddc15b960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80119d0 tx=0x7f9dd8011e90 comp rx=0 tx=0).stop 2023-11-28T21:02:56.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de21f1640 1 -- 172.21.15.167:0/2569417205 reap_dead start 2023-11-28T21:02:56.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de21f1640 1 -- 172.21.15.167:0/2569417205 reap_dead start 2023-11-28T21:02:56.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 shutdown_connections 2023-11-28T21:02:56.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 >> 172.21.15.167:0/2569417205 conn(0x7f9ddc0701a0 msgr2=0x7f9ddc0b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:56.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 shutdown_connections 2023-11-28T21:02:56.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.280+0000 7f9de29f2640 1 -- 172.21.15.167:0/2569417205 wait complete. 2023-11-28T21:02:56.300 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:02:56.300 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T21:02:56.300 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:02:56.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.436+0000 7f70a619d640 1 Processor -- start 2023-11-28T21:02:56.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.436+0000 7f70a619d640 1 -- start start 2023-11-28T21:02:56.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f70a619d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a0150b40 0x7f70a0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f70a619d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f70a00c4510 0x7f70a006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f70a619d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a00c4940 con 0x7f70a00c6ff0 2023-11-28T21:02:56.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f70a619d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a00c62f0 con 0x7f70a00c4510 2023-11-28T21:02:56.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f70a619d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00c6ac0 con 0x7f70a0150b40 2023-11-28T21:02:56.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709ffff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f70a00c4510 0x7f70a006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709f7fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a0150b40 0x7f70a0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709effd640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f70a00c6ff0 0x7f70a00c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:34364/0 (socket says 172.21.15.167:34364) 2023-11-28T21:02:56.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709ffff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f70a00c4510 0x7f70a006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:52268/0 (socket says 172.21.15.167:52268) 2023-11-28T21:02:56.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709effd640 1 -- 172.21.15.167:0/91043747 learned_addr learned my addr 172.21.15.167:0/91043747 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:02:56.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709f7fe640 1 -- 172.21.15.167:0/91043747 >> v2:172.21.15.178:3300/0 conn(0x7f70a00c4510 msgr2=0x7f70a006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709f7fe640 1 --2- 172.21.15.167:0/91043747 >> v2:172.21.15.178:3300/0 conn(0x7f70a00c4510 0x7f70a006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709f7fe640 1 -- 172.21.15.167:0/91043747 >> v1:172.21.15.178:6789/0 conn(0x7f70a00c6ff0 legacy=0x7f70a00c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709f7fe640 1 -- 172.21.15.167:0/91043747 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00c6500 con 0x7f70a0150b40 2023-11-28T21:02:56.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.440+0000 7f709ffff640 1 --2- 172.21.15.167:0/91043747 >> v2:172.21.15.178:3300/0 conn(0x7f70a00c4510 0x7f70a006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:02:56.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f709f7fe640 1 --2- 172.21.15.167:0/91043747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a0150b40 0x7f70a0157560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70900097c0 tx=0x7f709001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49ff2bb3f7211088 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f709e7fc640 1 -- 172.21.15.167:0/91043747 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70900ad660 con 0x7f70a0150b40 2023-11-28T21:02:56.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f709e7fc640 1 -- 172.21.15.167:0/91043747 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70900ad7c0 con 0x7f70a0150b40 2023-11-28T21:02:56.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f709e7fc640 1 -- 172.21.15.167:0/91043747 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70900adb50 con 0x7f70a0150b40 2023-11-28T21:02:56.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 -- 172.21.15.167:0/91043747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a0150b40 msgr2=0x7f70a0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 --2- 172.21.15.167:0/91043747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a0150b40 0x7f70a0157560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70900097c0 tx=0x7f709001c450 comp rx=0 tx=0).stop 2023-11-28T21:02:56.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 -- 172.21.15.167:0/91043747 shutdown_connections 2023-11-28T21:02:56.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 --2- 172.21.15.167:0/91043747 >> v2:172.21.15.178:3300/0 conn(0x7f70a00c4510 0x7f70a006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 --2- 172.21.15.167:0/91043747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a0150b40 0x7f70a0157560 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 -- 172.21.15.167:0/91043747 >> 172.21.15.167:0/91043747 conn(0x7f70a00cb1e0 msgr2=0x7f70a00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:56.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 -- 172.21.15.167:0/91043747 shutdown_connections 2023-11-28T21:02:56.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 -- 172.21.15.167:0/91043747 wait complete. 2023-11-28T21:02:56.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 Processor -- start 2023-11-28T21:02:56.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.444+0000 7f70a619d640 1 -- start start 2023-11-28T21:02:56.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70a00c4510 0x7f70a01535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a00c6ff0 0x7f70a014d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0150b40 0x7f70a0152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0151260 con 0x7f70a00c4510 2023-11-28T21:02:56.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0151da0 con 0x7f70a0150b40 2023-11-28T21:02:56.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0153b30 con 0x7f70a00c6ff0 2023-11-28T21:02:56.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70a00c4510 0x7f70a01535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70a00c4510 0x7f70a01535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34436/0 (socket says 172.21.15.167:34436) 2023-11-28T21:02:56.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709f7fe640 1 -- 172.21.15.167:0/2592664708 learned_addr learned my addr 172.21.15.167:0/2592664708 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:56.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709ffff640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0150b40 0x7f70a0152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709effd640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a00c6ff0 0x7f70a014d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709f7fe640 1 -- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a00c6ff0 msgr2=0x7f70a014d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709f7fe640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70a00c6ff0 0x7f70a014d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709f7fe640 1 -- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0150b40 msgr2=0x7f70a0152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709f7fe640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0150b40 0x7f70a0152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709f7fe640 1 -- 172.21.15.167:0/2592664708 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098009a70 con 0x7f70a00c4510 2023-11-28T21:02:56.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709f7fe640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70a00c4510 0x7f70a01535f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f70900b0040 tx=0x7f70900191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70900b6610 con 0x7f70a00c4510 2023-11-28T21:02:56.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70900b67b0 con 0x7f70a00c4510 2023-11-28T21:02:56.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7090009420 con 0x7f70a00c4510 2023-11-28T21:02:56.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70900b6b60 con 0x7f70a00c4510 2023-11-28T21:02:56.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a0151470 con 0x7f70a00c4510 2023-11-28T21:02:56.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0153f00 0x7f70a0151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0074770 con 0x7f70a0153f00 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709effd640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0153f00 0x7f70a0151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709effd640 1 -- 172.21.15.167:0/2592664708 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70a0157040 con 0x7f70a0153f00 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70900b4040 con 0x7f70a00c4510 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.448+0000 7f709effd640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0153f00 0x7f70a0151660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70a0150390 tx=0x7f709400e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f7087fff640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f708c0664a0 0x7f708c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f709011e0e0 con 0x7f70a00c4510 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094005ad0 con 0x7f70a0153f00 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f709ffff640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f708c0664a0 0x7f708c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7094005c30 con 0x7f70a0153f00 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0153f00 msgr2=0x7f70a0151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f7087fff640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0153f00 0x7f70a0151660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70a0150390 tx=0x7f709400e960 comp rx=0 tx=0).stop 2023-11-28T21:02:56.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0153f00 msgr2=0x7f70a0151660 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:56.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f7087fff640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a0153f00 0x7f70a0151660 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70a0150390 tx=0x7f709400e960 comp rx=0 tx=0).stop 2023-11-28T21:02:56.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.452+0000 7f709ffff640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f708c0664a0 0x7f708c068960 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7098007660 tx=0x7f709800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.456+0000 7f70a619d640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a01f3c50 0x7f70a01f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.456+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00682c0 con 0x7f70a01f3c50 2023-11-28T21:02:56.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.456+0000 7f709effd640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a01f3c50 0x7f70a01f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.456+0000 7f709effd640 1 -- 172.21.15.167:0/2592664708 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f70a0159d50 con 0x7f70a01f3c50 2023-11-28T21:02:56.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f709effd640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a01f3c50 0x7f70a01f4030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f70a0067070 tx=0x7f7094005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940074e0 con 0x7f70a01f3c50 2023-11-28T21:02:56.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7f7094007640 con 0x7f70a01f3c50 2023-11-28T21:02:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a01f3c50 msgr2=0x7f70a01f4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f7087fff640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a01f3c50 0x7f70a01f4030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f70a0067070 tx=0x7f7094005800 comp rx=0 tx=0).stop 2023-11-28T21:02:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f7087fff640 1 -- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a01f3c50 msgr2=0x7f70a01f4030 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:56.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f7087fff640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70a01f3c50 0x7f70a01f4030 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f70a0067070 tx=0x7f7094005800 comp rx=0 tx=0).stop 2023-11-28T21:02:56.462 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:02:56.462 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:02:56.462 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:02:56.462 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:02:56.462 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 186, 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:56.463 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:56.464 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:02:56.465 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:56.466 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.467 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:02:56.468 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:56.469 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.470 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:02:56.471 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:56.472 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.473 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.474 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.475 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:56.476 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.476 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.476 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:02:56.476 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f708c0664a0 msgr2=0x7f708c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f70a619d640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f708c0664a0 0x7f708c068960 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7098007660 tx=0x7f709800b040 comp rx=0 tx=0).stop 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70a00c4510 msgr2=0x7f70a01535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f70a619d640 1 --2- 172.21.15.167:0/2592664708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70a00c4510 0x7f70a01535f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f70900b0040 tx=0x7f70900191f0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f709ffff640 1 -- 172.21.15.167:0/2592664708 reap_dead start 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f709ffff640 1 -- 172.21.15.167:0/2592664708 reap_dead start 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 shutdown_connections 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 >> 172.21.15.167:0/2592664708 conn(0x7f70a00cb1e0 msgr2=0x7f70a00cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 shutdown_connections 2023-11-28T21:02:56.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.460+0000 7f70a619d640 1 -- 172.21.15.167:0/2592664708 wait complete. 2023-11-28T21:02:56.480 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:02:56.480 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T21:02:56.481 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:02:56.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.616+0000 7f273e65a640 1 Processor -- start 2023-11-28T21:02:56.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.616+0000 7f273e65a640 1 -- start start 2023-11-28T21:02:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.616+0000 7f273e65a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27380cf860 0x7f27380cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.616+0000 7f273e65a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f27380cfc40 0x7f27380ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f273e65a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273815ac00 con 0x7f2738153ae0 2023-11-28T21:02:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f273e65a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27380cbd60 con 0x7f27380cfc40 2023-11-28T21:02:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f273e65a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2738159ff0 con 0x7f27380cf860 2023-11-28T21:02:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f273cbf7640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2738153ae0 0x7f273815d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50936/0 (socket says 172.21.15.167:50936) 2023-11-28T21:02:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f273cbf7640 1 -- 172.21.15.167:0/2725522085 learned_addr learned my addr 172.21.15.167:0/2725522085 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:02:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2737fff640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27380cf860 0x7f27380cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f27377fe640 1 --2- 172.21.15.167:0/2725522085 >> v2:172.21.15.178:3300/0 conn(0x7f27380cfc40 0x7f27380ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879243118 0 0) 0x7f273815ac00 con 0x7f2738153ae0 2023-11-28T21:02:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2720003530 con 0x7f2738153ae0 2023-11-28T21:02:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3957269976 0 0) 0x7f2720003530 con 0x7f2738153ae0 2023-11-28T21:02:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27380cf860 msgr2=0x7f27380cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27380cf860 0x7f27380cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 >> v2:172.21.15.178:3300/0 conn(0x7f27380cfc40 msgr2=0x7f27380ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 --2- 172.21.15.167:0/2725522085 >> v2:172.21.15.178:3300/0 conn(0x7f27380cfc40 0x7f27380ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273815a2d0 con 0x7f2738153ae0 2023-11-28T21:02:56.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f2730001a00 con 0x7f2738153ae0 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 >> v1:172.21.15.167:6789/0 conn(0x7f2738153ae0 legacy=0x7f273815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2720003980 0x7f2720003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27380cf860 0x7f27200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2720004d10 0x7f2720005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27380cbd60 con 0x7f2720003980 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2738159ff0 con 0x7f2720004d10 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272000b990 con 0x7f27380cf860 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2737fff640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2720003980 0x7f2720003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f27377fe640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27380cf860 0x7f27200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f273cbf7640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2720004d10 0x7f2720005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2737fff640 1 -- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27380cf860 msgr2=0x7f27200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2737fff640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27380cf860 0x7f27200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2737fff640 1 -- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2720004d10 msgr2=0x7f2720005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2737fff640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2720004d10 0x7f2720005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.620+0000 7f2737fff640 1 -- 172.21.15.167:0/2725522085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720003530 con 0x7f2720003980 2023-11-28T21:02:56.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f2737fff640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2720003980 0x7f2720003da0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2728009ae0 tx=0x7f272801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b33e9fe0ddb826 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280a55f0 con 0x7f2720003980 2023-11-28T21:02:56.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27280a5750 con 0x7f2720003980 2023-11-28T21:02:56.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f2736ffd640 1 -- 172.21.15.167:0/2725522085 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280a5b00 con 0x7f2720003980 2023-11-28T21:02:56.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f273e65a640 1 -- 172.21.15.167:0/2725522085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2720003980 msgr2=0x7f2720003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f273e65a640 1 --2- 172.21.15.167:0/2725522085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2720003980 0x7f2720003da0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2728009ae0 tx=0x7f272801ca20 comp rx=0 tx=0).stop 2023-11-28T21:02:56.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f273cbf7640 1 -- 172.21.15.167:0/2725522085 reap_dead start 2023-11-28T21:02:56.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f273e65a640 1 -- 172.21.15.167:0/2725522085 shutdown_connections 2023-11-28T21:02:56.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f273e65a640 1 -- 172.21.15.167:0/2725522085 >> 172.21.15.167:0/2725522085 conn(0x7f273806c1f0 msgr2=0x7f2738071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:56.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f273e65a640 1 -- 172.21.15.167:0/2725522085 shutdown_connections 2023-11-28T21:02:56.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f273e65a640 1 -- 172.21.15.167:0/2725522085 wait complete. 2023-11-28T21:02:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f273e65a640 1 Processor -- start 2023-11-28T21:02:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.624+0000 7f273e65a640 1 -- start start 2023-11-28T21:02:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2720003980 0x7f27380b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27380b4ae0 0x7f27381f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2738160600 0x7f27381492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27381f3110 con 0x7f2738160600 2023-11-28T21:02:56.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2738149ee0 con 0x7f27380b4ae0 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27380b4fd0 con 0x7f2720003980 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273cbf7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2738160600 0x7f27381492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273cbf7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2738160600 0x7f27381492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34454/0 (socket says 172.21.15.167:34454) 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273cbf7640 1 -- 172.21.15.167:0/1926006111 learned_addr learned my addr 172.21.15.167:0/1926006111 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f27377fe640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27380b4ae0 0x7f27381f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f2737fff640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2720003980 0x7f27380b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273cbf7640 1 -- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2720003980 msgr2=0x7f27380b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273cbf7640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2720003980 0x7f27380b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273cbf7640 1 -- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27380b4ae0 msgr2=0x7f27381f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273cbf7640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27380b4ae0 0x7f27381f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273cbf7640 1 -- 172.21.15.167:0/1926006111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380b52b0 con 0x7f2738160600 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f27377fe640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27380b4ae0 0x7f27381f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273cbf7640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2738160600 0x7f27381492d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2730002070 tx=0x7f273000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730007a80 con 0x7f2738160600 2023-11-28T21:02:56.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273000ee20 con 0x7f2738160600 2023-11-28T21:02:56.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730013660 con 0x7f2738160600 2023-11-28T21:02:56.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27380b5590 con 0x7f2738160600 2023-11-28T21:02:56.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27381f36b0 con 0x7f2738160600 2023-11-28T21:02:56.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2738143de0 0x7f27381441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27381f3280 con 0x7f2738143de0 2023-11-28T21:02:56.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f2737fff640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2738143de0 0x7f27381441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27300137c0 con 0x7f2738160600 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.628+0000 7f2737fff640 1 -- 172.21.15.167:0/1926006111 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27380caa50 con 0x7f2738143de0 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f2737fff640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2738143de0 0x7f27381441c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2728009ab0 tx=0x7f2720005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f2734ff9640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2724066470 0x7f2724068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2730084780 con 0x7f2738160600 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280a55f0 con 0x7f2738143de0 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f27377fe640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2724066470 0x7f2724068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f272800f000 con 0x7f2738143de0 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2738143de0 msgr2=0x7f27381441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f2734ff9640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2738143de0 0x7f27381441c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2728009ab0 tx=0x7f2720005800 comp rx=0 tx=0).stop 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2738143de0 msgr2=0x7f27381441c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f2734ff9640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2738143de0 0x7f27381441c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.632+0000 7f27377fe640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2724066470 0x7f2724068930 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f27380c4f50 tx=0x7f272c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.636+0000 7f273e65a640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27381f6630 0x7f27381f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.636+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2738072860 con 0x7f27381f6630 2023-11-28T21:02:56.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.636+0000 7f2737fff640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27381f6630 0x7f27381f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f2737fff640 1 -- 172.21.15.167:0/1926006111 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f27380b5780 con 0x7f27381f6630 2023-11-28T21:02:56.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f2737fff640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27381f6630 0x7f27381f6a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f272801c850 tx=0x7f27280a7070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728004020 con 0x7f27381f6630 2023-11-28T21:02:56.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4980 (secure 0 0 0) 0x7f27280c7070 con 0x7f27381f6630 2023-11-28T21:02:56.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27381f6630 msgr2=0x7f27381f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f2734ff9640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27381f6630 0x7f27381f6a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f272801c850 tx=0x7f27280a7070 comp rx=0 tx=0).stop 2023-11-28T21:02:56.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f2734ff9640 1 -- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27381f6630 msgr2=0x7f27381f6a40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:02:56.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f2734ff9640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27381f6630 0x7f27381f6a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.643 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:02:56.643 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:02:56.643 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:02:56.643 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:02:56.644 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 186, 2023-11-28T21:02:56.644 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:02:56.644 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:02:56.644 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:02:56.644 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:02:56.644 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.645 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 2, 2023-11-28T21:02:56.645 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:56.645 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:02:56.645 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:02:56.645 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:56.645 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:56.646 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:56.646 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:56.646 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:56.646 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:56.646 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:56.646 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:56.647 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:56.647 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:56.647 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.647 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:02:56.647 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:02:56.647 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:56.648 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:56.648 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:56.648 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:56.648 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:56.648 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:56.648 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:56.648 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:56.649 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:56.649 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:56.649 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.649 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:02:56.650 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:02:56.650 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:02:56.650 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:02:56.650 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:02:56.650 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:02:56.650 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:56.651 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:02:56.651 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:02:56.652 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:02:56.652 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:02:56.652 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:02:56.652 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:02:56.652 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:02:56.652 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:02:56.653 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:02:56.653 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:02:56.653 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:02:56.653 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:02:56.653 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:02:56.653 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:02:56.653 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:02:56.654 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:02:56.654 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:02:56.654 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:02:56.655 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:02:56.655 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:02:56.655 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.656 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:02:56.656 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.656 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:02:56.656 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.656 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:02:56.656 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:02:56.657 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:56.657 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:56.657 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.657 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:56.658 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:02:56.658 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.658 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.659 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.659 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:56.659 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:02:56.660 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.660 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.660 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:02:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:02:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:56.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:02:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:02:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:56.662 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.663 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:56.663 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:02:56.663 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.663 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.663 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.663 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:56.664 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:02:56.664 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.664 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.664 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.664 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.664 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:02:56.664 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:02:56.665 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:56.665 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:56.665 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:56.665 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.665 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.665 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:02:56.666 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:02:56.666 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:02:56.666 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:02:56.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.666 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:02:56.666 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:02:56.666 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.666 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:02:56.667 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.668 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:02:56.669 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:02:56.670 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:02:56.671 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:02:56.671 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:02:56.671 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:02:56.671 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:02:56.671 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:02:56.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2724066470 msgr2=0x7f2724068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273e65a640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2724066470 0x7f2724068930 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f27380c4f50 tx=0x7f272c008040 comp rx=0 tx=0).stop 2023-11-28T21:02:56.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2738160600 msgr2=0x7f27381492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273e65a640 1 --2- 172.21.15.167:0/1926006111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2738160600 0x7f27381492d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2730002070 tx=0x7f273000e530 comp rx=0 tx=0).stop 2023-11-28T21:02:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273cbf7640 1 -- 172.21.15.167:0/1926006111 reap_dead start 2023-11-28T21:02:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273cbf7640 1 -- 172.21.15.167:0/1926006111 reap_dead start 2023-11-28T21:02:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 shutdown_connections 2023-11-28T21:02:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 >> 172.21.15.167:0/1926006111 conn(0x7f273806c1f0 msgr2=0x7f2738071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 shutdown_connections 2023-11-28T21:02:56.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.640+0000 7f273e65a640 1 -- 172.21.15.167:0/1926006111 wait complete. 2023-11-28T21:02:56.673 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:02:56.673 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T21:02:56.674 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T21:02:56.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37bd89e640 1 Processor -- start 2023-11-28T21:02:56.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37bd89e640 1 -- start start 2023-11-28T21:02:56.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37bd89e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37b80ca660 0x7f37b80cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37bd89e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b80cb5c0 con 0x7f37b8153f40 2023-11-28T21:02:56.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37bd89e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b80c4f00 con 0x7f37b80caa90 2023-11-28T21:02:56.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37bd89e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b80b2c60 con 0x7f37b80ca660 2023-11-28T21:02:56.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b6ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f37b8153f40 0x7f37b8159aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50944/0 (socket says 172.21.15.167:50944) 2023-11-28T21:02:56.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b6ffd640 1 -- 172.21.15.167:0/265182366 learned_addr learned my addr 172.21.15.167:0/265182366 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:02:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b67fc640 1 --2- 172.21.15.167:0/265182366 >> v2:172.21.15.178:3300/0 conn(0x7f37b80ca660 0x7f37b80cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805518379 0 0) 0x7f37b80cb5c0 con 0x7f37b8153f40 2023-11-28T21:02:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a0003530 con 0x7f37b8153f40 2023-11-28T21:02:56.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 302671678 0 0) 0x7f37a0003530 con 0x7f37b8153f40 2023-11-28T21:02:56.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 >> v2:172.21.15.178:3300/0 conn(0x7f37b80ca660 msgr2=0x7f37b80cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 --2- 172.21.15.167:0/265182366 >> v2:172.21.15.178:3300/0 conn(0x7f37b80ca660 0x7f37b80cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 >> v1:172.21.15.178:6789/0 conn(0x7f37b80caa90 legacy=0x7f37b80c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b80c54c0 con 0x7f37b8153f40 2023-11-28T21:02:56.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f37a8001680 con 0x7f37b8153f40 2023-11-28T21:02:56.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 >> v1:172.21.15.167:6789/0 conn(0x7f37b8153f40 legacy=0x7f37b8159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37a00039d0 0x7f37a0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a00047d0 0x7f37a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a0005190 0x7f37a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80b2c60 con 0x7f37a00039d0 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a000c090 con 0x7f37a00047d0 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a000c250 con 0x7f37a0005190 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b6ffd640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37a00039d0 0x7f37a0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b67fc640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a00047d0 0x7f37a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b77fe640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a0005190 0x7f37a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b6ffd640 1 -- 172.21.15.167:0/265182366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a0005190 msgr2=0x7f37a000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b6ffd640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a0005190 0x7f37a000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b6ffd640 1 -- 172.21.15.167:0/265182366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a00047d0 msgr2=0x7f37a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:02:56.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b6ffd640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a00047d0 0x7f37a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b6ffd640 1 -- 172.21.15.167:0/265182366 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a0003530 con 0x7f37a00039d0 2023-11-28T21:02:56.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b67fc640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a00047d0 0x7f37a0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:02:56.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.812+0000 7f37b77fe640 1 -- 172.21.15.167:0/265182366 reap_dead start 2023-11-28T21:02:56.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37b6ffd640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37a00039d0 0x7f37a0003df0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f37a800c0e0 tx=0x7f37a801cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1012e53050f43de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8005ae0 con 0x7f37a00039d0 2023-11-28T21:02:56.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8005c60 con 0x7f37a00039d0 2023-11-28T21:02:56.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37b5ffb640 1 -- 172.21.15.167:0/265182366 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8007070 con 0x7f37a00039d0 2023-11-28T21:02:56.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37bd89e640 1 -- 172.21.15.167:0/265182366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37a00039d0 msgr2=0x7f37a0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37bd89e640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37a00039d0 0x7f37a0003df0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f37a800c0e0 tx=0x7f37a801cb10 comp rx=0 tx=0).stop 2023-11-28T21:02:56.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37bd89e640 1 -- 172.21.15.167:0/265182366 shutdown_connections 2023-11-28T21:02:56.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37bd89e640 1 --2- 172.21.15.167:0/265182366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37a00039d0 0x7f37a0003df0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37bd89e640 1 -- 172.21.15.167:0/265182366 >> 172.21.15.167:0/265182366 conn(0x7f37b806b800 msgr2=0x7f37b806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:56.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37bd89e640 1 -- 172.21.15.167:0/265182366 shutdown_connections 2023-11-28T21:02:56.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.816+0000 7f37bd89e640 1 -- 172.21.15.167:0/265182366 wait complete. 2023-11-28T21:02:56.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 Processor -- start 2023-11-28T21:02:56.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 -- start start 2023-11-28T21:02:56.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a00039d0 0x7f37b81454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37b80c93a0 0x7f37b815c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37b815db50 0x7f37b80c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80c6ce0 con 0x7f37b80c93a0 2023-11-28T21:02:56.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b80c6a20 con 0x7f37b815db50 2023-11-28T21:02:56.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81f3370 con 0x7f37a00039d0 2023-11-28T21:02:56.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b67fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37b80c93a0 0x7f37b815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b67fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37b80c93a0 0x7f37b815c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:34468/0 (socket says 172.21.15.167:34468) 2023-11-28T21:02:56.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b67fc640 1 -- 172.21.15.167:0/3271469533 learned_addr learned my addr 172.21.15.167:0/3271469533 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:02:56.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b6ffd640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a00039d0 0x7f37b81454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b77fe640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37b815db50 0x7f37b80c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b67fc640 1 -- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a00039d0 msgr2=0x7f37b81454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b67fc640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a00039d0 0x7f37b81454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b67fc640 1 -- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37b815db50 msgr2=0x7f37b80c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b67fc640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37b815db50 0x7f37b80c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b67fc640 1 -- 172.21.15.167:0/3271469533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b81f3650 con 0x7f37b80c93a0 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37b67fc640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37b80c93a0 0x7f37b815c590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f37ac011510 tx=0x7f37ac0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f379ffff640 1 -- 172.21.15.167:0/3271469533 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac004220 con 0x7f37b80c93a0 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f379ffff640 1 -- 172.21.15.167:0/3271469533 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac004380 con 0x7f37b80c93a0 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f379ffff640 1 -- 172.21.15.167:0/3271469533 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac015890 con 0x7f37b80c93a0 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b815bd90 con 0x7f37b80c93a0 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.820+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b815b070 con 0x7f37b80c93a0 2023-11-28T21:02:56.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.824+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b804e850 con 0x7f37b80c93a0 2023-11-28T21:02:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.824+0000 7f379ffff640 1 -- 172.21.15.167:0/3271469533 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37ac0159f0 con 0x7f37b80c93a0 2023-11-28T21:02:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.824+0000 7f379ffff640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37a40664a0 0x7f37a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:02:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.824+0000 7f379ffff640 1 -- 172.21.15.167:0/3271469533 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f37ac084610 con 0x7f37b80c93a0 2023-11-28T21:02:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.824+0000 7f37b6ffd640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37a40664a0 0x7f37a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:02:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.824+0000 7f37b6ffd640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37a40664a0 0x7f37a4068960 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f37a80ab000 tx=0x7f37a80b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:02:56.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:56.828+0000 7f379ffff640 1 -- 172.21.15.167:0/3271469533 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37ac051690 con 0x7f37b80c93a0 2023-11-28T21:02:57.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.028+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f37b80caec0 con 0x7f37b80c93a0 2023-11-28T21:02:57.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.032+0000 7f379ffff640 1 -- 172.21.15.167:0/3271469533 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f37ac054cb0 con 0x7f37b80c93a0 2023-11-28T21:02:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37a40664a0 msgr2=0x7f37a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37a40664a0 0x7f37a4068960 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f37a80ab000 tx=0x7f37a80b1040 comp rx=0 tx=0).stop 2023-11-28T21:02:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37b80c93a0 msgr2=0x7f37b815c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:02:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37b80c93a0 0x7f37b815c590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f37ac011510 tx=0x7f37ac0119d0 comp rx=0 tx=0).stop 2023-11-28T21:02:57.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 shutdown_connections 2023-11-28T21:02:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f37a40664a0 0x7f37a4068960 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37b815db50 0x7f37b80c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37b80c93a0 0x7f37b815c590 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 --2- 172.21.15.167:0/3271469533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a00039d0 0x7f37b81454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:02:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 >> 172.21.15.167:0/3271469533 conn(0x7f37b806b800 msgr2=0x7f37b8151800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:02:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 shutdown_connections 2023-11-28T21:02:57.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:02:57.036+0000 7f37bd89e640 1 -- 172.21.15.167:0/3271469533 wait complete. 2023-11-28T21:02:57.057 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T21:03:01.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~228s 2023-11-28T21:03:07.057 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:03:07.058 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:03:07.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26c525f640 1 Processor -- start 2023-11-28T21:03:07.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26c525f640 1 -- start start 2023-11-28T21:03:07.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26c525f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26c0153fa0 0x7f26c00c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26c525f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c00c63d0 0x7f26c015d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26c525f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f26c015dcb0 0x7f26c006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26c525f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c015ada0 con 0x7f26c0153fa0 2023-11-28T21:03:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26c525f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c015e140 con 0x7f26c015dcb0 2023-11-28T21:03:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26c525f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c0159f40 con 0x7f26c00c63d0 2023-11-28T21:03:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26bed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26c0153fa0 0x7f26c00c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26bed9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26c0153fa0 0x7f26c00c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44770/0 (socket says 172.21.15.167:44770) 2023-11-28T21:03:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26bed9d640 1 -- 172.21.15.167:0/3554895653 learned_addr learned my addr 172.21.15.167:0/3554895653 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26bf59e640 1 --2- 172.21.15.167:0/3554895653 >> v2:172.21.15.178:3300/0 conn(0x7f26c015dcb0 0x7f26c006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26b659c640 1 --2- 172.21.15.167:0/3554895653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c00c63d0 0x7f26c015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26bed9d640 1 -- 172.21.15.167:0/3554895653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c00c63d0 msgr2=0x7f26c015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:03:07.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26bed9d640 1 --2- 172.21.15.167:0/3554895653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c00c63d0 0x7f26c015d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26bed9d640 1 -- 172.21.15.167:0/3554895653 >> v2:172.21.15.178:3300/0 conn(0x7f26c015dcb0 msgr2=0x7f26c006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:03:07.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26bed9d640 1 --2- 172.21.15.167:0/3554895653 >> v2:172.21.15.178:3300/0 conn(0x7f26c015dcb0 0x7f26c006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.204+0000 7f26bed9d640 1 -- 172.21.15.167:0/3554895653 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c015a220 con 0x7f26c0153fa0 2023-11-28T21:03:07.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26bed9d640 1 --2- 172.21.15.167:0/3554895653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c0153fa0 0x7f26c00c5e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f26c006bba0 tx=0x7f26b001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a925a4cf283cdc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26be59c640 1 -- 172.21.15.167:0/3554895653 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00ac410 con 0x7f26c0153fa0 2023-11-28T21:03:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26be59c640 1 -- 172.21.15.167:0/3554895653 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b00ac570 con 0x7f26c0153fa0 2023-11-28T21:03:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26be59c640 1 -- 172.21.15.167:0/3554895653 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00ac900 con 0x7f26c0153fa0 2023-11-28T21:03:07.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26c525f640 1 -- 172.21.15.167:0/3554895653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c0153fa0 msgr2=0x7f26c00c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26c525f640 1 --2- 172.21.15.167:0/3554895653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c0153fa0 0x7f26c00c5e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f26c006bba0 tx=0x7f26b001c500 comp rx=0 tx=0).stop 2023-11-28T21:03:07.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26c525f640 1 -- 172.21.15.167:0/3554895653 shutdown_connections 2023-11-28T21:03:07.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26c525f640 1 --2- 172.21.15.167:0/3554895653 >> v2:172.21.15.178:3300/0 conn(0x7f26c015dcb0 0x7f26c006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26c525f640 1 --2- 172.21.15.167:0/3554895653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c00c63d0 0x7f26c015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26c525f640 1 --2- 172.21.15.167:0/3554895653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c0153fa0 0x7f26c00c5e90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26c525f640 1 -- 172.21.15.167:0/3554895653 >> 172.21.15.167:0/3554895653 conn(0x7f26c00cb1e0 msgr2=0x7f26c00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:07.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26c525f640 1 -- 172.21.15.167:0/3554895653 shutdown_connections 2023-11-28T21:03:07.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.208+0000 7f26c525f640 1 -- 172.21.15.167:0/3554895653 wait complete. 2023-11-28T21:03:07.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26c525f640 1 Processor -- start 2023-11-28T21:03:07.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26c525f640 1 -- start start 2023-11-28T21:03:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26c525f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26c00c63d0 0x7f26c00c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26c525f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c0153fa0 0x7f26c00c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26c525f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c015dcb0 0x7f26c0143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26c525f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c01557d0 con 0x7f26c015dcb0 2023-11-28T21:03:07.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26c525f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c00c4390 con 0x7f26c00c63d0 2023-11-28T21:03:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26c525f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c0158ed0 con 0x7f26c0153fa0 2023-11-28T21:03:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26bf59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c015dcb0 0x7f26c0143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26bf59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c015dcb0 0x7f26c0143e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44774/0 (socket says 172.21.15.167:44774) 2023-11-28T21:03:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26bf59e640 1 -- 172.21.15.167:0/1587071213 learned_addr learned my addr 172.21.15.167:0/1587071213 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26b659c640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c0153fa0 0x7f26c00c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26bed9d640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26c00c63d0 0x7f26c00c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26bf59e640 1 -- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c0153fa0 msgr2=0x7f26c00c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26bf59e640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c0153fa0 0x7f26c00c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26bf59e640 1 -- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26c00c63d0 msgr2=0x7f26c00c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26bf59e640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26c00c63d0 0x7f26c00c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.212+0000 7f26bf59e640 1 -- 172.21.15.167:0/1587071213 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b00094d0 con 0x7f26c015dcb0 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26bf59e640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c015dcb0 0x7f26c0143e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f26b800d560 tx=0x7f26b800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26b7fff640 1 -- 172.21.15.167:0/1587071213 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b80125f0 con 0x7f26c015dcb0 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26b7fff640 1 -- 172.21.15.167:0/1587071213 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b8012770 con 0x7f26c015dcb0 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c0159170 con 0x7f26c015dcb0 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26b7fff640 1 -- 172.21.15.167:0/1587071213 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8012b20 con 0x7f26c015dcb0 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c0159c20 con 0x7f26c015dcb0 2023-11-28T21:03:07.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c00682c0 con 0x7f26c015dcb0 2023-11-28T21:03:07.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26b7fff640 1 -- 172.21.15.167:0/1587071213 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26b8012c80 con 0x7f26c015dcb0 2023-11-28T21:03:07.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26b7fff640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f26a00664a0 0x7f26a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26b7fff640 1 -- 172.21.15.167:0/1587071213 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f26b8084670 con 0x7f26c015dcb0 2023-11-28T21:03:07.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.216+0000 7f26bed9d640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f26a00664a0 0x7f26a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.220+0000 7f26bed9d640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f26a00664a0 0x7f26a0068960 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f26b00ae000 tx=0x7f26b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.224+0000 7f26b7fff640 1 -- 172.21.15.167:0/1587071213 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26b8051710 con 0x7f26c015dcb0 2023-11-28T21:03:07.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.424+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f26c01579a0 con 0x7f26c015dcb0 2023-11-28T21:03:07.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.424+0000 7f26b7fff640 1 -- 172.21.15.167:0/1587071213 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f26b8054d30 con 0x7f26c015dcb0 2023-11-28T21:03:07.429 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":186,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:03:07.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f26a00664a0 msgr2=0x7f26a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f26a00664a0 0x7f26a0068960 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f26b00ae000 tx=0x7f26b0008040 comp rx=0 tx=0).stop 2023-11-28T21:03:07.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c015dcb0 msgr2=0x7f26c0143e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c015dcb0 0x7f26c0143e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f26b800d560 tx=0x7f26b800da20 comp rx=0 tx=0).stop 2023-11-28T21:03:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 shutdown_connections 2023-11-28T21:03:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f26a00664a0 0x7f26a0068960 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26c015dcb0 0x7f26c0143e60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26c0153fa0 0x7f26c00c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 --2- 172.21.15.167:0/1587071213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26c00c63d0 0x7f26c00c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 >> 172.21.15.167:0/1587071213 conn(0x7f26c00cb1e0 msgr2=0x7f26c0071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 shutdown_connections 2023-11-28T21:03:07.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.428+0000 7f26c525f640 1 -- 172.21.15.167:0/1587071213 wait complete. 2023-11-28T21:03:07.451 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:03:07.451 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T21:03:07.451 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T21:03:07.451 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:03:07.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29fad9d640 1 Processor -- start 2023-11-28T21:03:07.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29fad9d640 1 -- start start 2023-11-28T21:03:07.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29fad9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 0x7f29f4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29fad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f29f40c4510 0x7f29f406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29fad9d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f40c4940 con 0x7f29f4150b40 2023-11-28T21:03:07.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29fad9d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f40c62f0 con 0x7f29f40c4510 2023-11-28T21:03:07.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29fad9d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c6ac0 con 0x7f29f40c6ff0 2023-11-28T21:03:07.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29f8b39640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f29f4150b40 0x7f29f40c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48360/0 (socket says 172.21.15.167:48360) 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29f8b39640 1 -- 172.21.15.167:0/2457243949 learned_addr learned my addr 172.21.15.167:0/2457243949 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29f933a640 1 --2- 172.21.15.167:0/2457243949 >> v2:172.21.15.167:3300/0 conn(0x7f29f40c4510 0x7f29f406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29ebfff640 1 --2- 172.21.15.167:0/2457243949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 0x7f29f4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29eb7fe640 1 -- 172.21.15.167:0/2457243949 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838068682 0 0) 0x7f29f40c4940 con 0x7f29f4150b40 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29eb7fe640 1 -- 172.21.15.167:0/2457243949 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29dc005740 con 0x7f29f4150b40 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29f933a640 1 -- 172.21.15.167:0/2457243949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 msgr2=0x7f29f4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29f933a640 1 --2- 172.21.15.167:0/2457243949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 0x7f29f4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29f933a640 1 -- 172.21.15.167:0/2457243949 >> v1:172.21.15.167:6789/0 conn(0x7f29f4150b40 legacy=0x7f29f40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29f933a640 1 -- 172.21.15.167:0/2457243949 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f40c6500 con 0x7f29f40c4510 2023-11-28T21:03:07.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.588+0000 7f29ebfff640 1 --2- 172.21.15.167:0/2457243949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 0x7f29f4157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:03:07.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29f933a640 1 --2- 172.21.15.167:0/2457243949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f40c4510 0x7f29f406a580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009d90 tx=0x7f29ec01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8e191397ebfeeb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29eb7fe640 1 -- 172.21.15.167:0/2457243949 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0a57f0 con 0x7f29f40c4510 2023-11-28T21:03:07.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29eb7fe640 1 -- 172.21.15.167:0/2457243949 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec0a5950 con 0x7f29f40c4510 2023-11-28T21:03:07.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29eb7fe640 1 -- 172.21.15.167:0/2457243949 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0a5cc0 con 0x7f29f40c4510 2023-11-28T21:03:07.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29fad9d640 1 -- 172.21.15.167:0/2457243949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f40c4510 msgr2=0x7f29f406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29fad9d640 1 --2- 172.21.15.167:0/2457243949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f40c4510 0x7f29f406a580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009d90 tx=0x7f29ec01c920 comp rx=0 tx=0).stop 2023-11-28T21:03:07.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29fad9d640 1 -- 172.21.15.167:0/2457243949 shutdown_connections 2023-11-28T21:03:07.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29fad9d640 1 --2- 172.21.15.167:0/2457243949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f40c4510 0x7f29f406a580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29fad9d640 1 --2- 172.21.15.167:0/2457243949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 0x7f29f4157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29fad9d640 1 -- 172.21.15.167:0/2457243949 >> 172.21.15.167:0/2457243949 conn(0x7f29f40cb1e0 msgr2=0x7f29f40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:07.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29fad9d640 1 -- 172.21.15.167:0/2457243949 shutdown_connections 2023-11-28T21:03:07.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.592+0000 7f29fad9d640 1 -- 172.21.15.167:0/2457243949 wait complete. 2023-11-28T21:03:07.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 Processor -- start 2023-11-28T21:03:07.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 -- start start 2023-11-28T21:03:07.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f40c4510 0x7f29f4159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 0x7f29f415a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4150b40 0x7f29f414bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f415b410 con 0x7f29f4150b40 2023-11-28T21:03:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f41f36d0 con 0x7f29f40c4510 2023-11-28T21:03:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f415a470 con 0x7f29f40c6ff0 2023-11-28T21:03:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f933a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4150b40 0x7f29f414bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f933a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4150b40 0x7f29f414bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44786/0 (socket says 172.21.15.167:44786) 2023-11-28T21:03:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f933a640 1 -- 172.21.15.167:0/1564821795 learned_addr learned my addr 172.21.15.167:0/1564821795 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:07.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f8b39640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f40c4510 0x7f29f4159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29ebfff640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 0x7f29f415a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f933a640 1 -- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 msgr2=0x7f29f415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f933a640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 0x7f29f415a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f933a640 1 -- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f40c4510 msgr2=0x7f29f4159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f933a640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f40c4510 0x7f29f4159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f933a640 1 -- 172.21.15.167:0/1564821795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009a70 con 0x7f29f4150b40 2023-11-28T21:03:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29ebfff640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f40c6ff0 0x7f29f415a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:03:07.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29f933a640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4150b40 0x7f29f414bd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009d90 tx=0x7f29ec0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0ad640 con 0x7f29f4150b40 2023-11-28T21:03:07.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec0ad7a0 con 0x7f29f4150b40 2023-11-28T21:03:07.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0adb30 con 0x7f29f4150b40 2023-11-28T21:03:07.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f41f2da0 con 0x7f29f4150b40 2023-11-28T21:03:07.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.596+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f41f3360 con 0x7f29f4150b40 2023-11-28T21:03:07.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29fad9d640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4157b30 0x7f29f4157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f4074770 con 0x7f29f4157b30 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29f8b39640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4157b30 0x7f29f4157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29f8b39640 1 -- 172.21.15.167:0/1564821795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29f40c3a50 con 0x7f29f4157b30 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29f8b39640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4157b30 0x7f29f4157f10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f29f0005890 tx=0x7f29f000f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0005ad0 con 0x7f29f4157b30 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29ec0b4070 con 0x7f29f4150b40 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29e97fa640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29e0066540 0x7f29e0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f29ec11ef00 con 0x7f29f4150b40 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f29f0005c30 con 0x7f29f4157b30 2023-11-28T21:03:07.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4157b30 msgr2=0x7f29f4157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29e97fa640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4157b30 0x7f29f4157f10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f29f0005890 tx=0x7f29f000f9b0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4157b30 msgr2=0x7f29f4157f10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:07.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29e97fa640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4157b30 0x7f29f4157f10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29ebfff640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29e0066540 0x7f29e0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.600+0000 7f29ebfff640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29e0066540 0x7f29e0068a00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f29f4155ef0 tx=0x7f29e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4146960 0x7f29f4146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f4071f30 con 0x7f29f4146960 2023-11-28T21:03:07.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29f8b39640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4146960 0x7f29f4146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29f8b39640 1 -- 172.21.15.167:0/1564821795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f29f4157040 con 0x7f29f4146960 2023-11-28T21:03:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29f8b39640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4146960 0x7f29f4146d70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29f0005890 tx=0x7f29f00010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0023070 con 0x7f29f4146960 2023-11-28T21:03:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4473 (secure 0 0 0) 0x7f29f0007760 con 0x7f29f4146960 2023-11-28T21:03:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4146960 msgr2=0x7f29f4146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29e97fa640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4146960 0x7f29f4146d70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29f0005890 tx=0x7f29f00010b0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29e97fa640 1 -- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4146960 msgr2=0x7f29f4146d70 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:07.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29e97fa640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4146960 0x7f29f4146d70 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29f0005890 tx=0x7f29f00010b0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 186, 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:03:07.612 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:07.613 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:03:07.615 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:03:07.616 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:07.617 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:07.618 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:03:07.619 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.620 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:03:07.621 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:07.622 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.623 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.624 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.625 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:03:07.626 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:03:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29e0066540 msgr2=0x7f29e0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f29e0066540 0x7f29e0068a00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f29f4155ef0 tx=0x7f29e4008040 comp rx=0 tx=0).stop 2023-11-28T21:03:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4150b40 msgr2=0x7f29f414bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 --2- 172.21.15.167:0/1564821795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29f4150b40 0x7f29f414bd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009d90 tx=0x7f29ec0196c0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29f933a640 1 -- 172.21.15.167:0/1564821795 reap_dead start 2023-11-28T21:03:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29f933a640 1 -- 172.21.15.167:0/1564821795 reap_dead start 2023-11-28T21:03:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 shutdown_connections 2023-11-28T21:03:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 >> 172.21.15.167:0/1564821795 conn(0x7f29f40cb1e0 msgr2=0x7f29f40705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 shutdown_connections 2023-11-28T21:03:07.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.608+0000 7f29fad9d640 1 -- 172.21.15.167:0/1564821795 wait complete. 2023-11-28T21:03:07.629 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:03:07.629 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T21:03:07.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:03:07.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6d157640 1 Processor -- start 2023-11-28T21:03:07.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6d157640 1 -- start start 2023-11-28T21:03:07.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6d157640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0f6806a580 0x7f0f6806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6d157640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6815ada0 con 0x7f0f68153fa0 2023-11-28T21:03:07.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6d157640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f68159f40 con 0x7f0f6815d770 2023-11-28T21:03:07.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6d157640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6815a220 con 0x7f0f6806a580 2023-11-28T21:03:07.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f66d9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0f68153fa0 0x7f0f680c5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:48364/0 (socket says 172.21.15.167:48364) 2023-11-28T21:03:07.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f66d9d640 1 -- 172.21.15.167:0/1312594804 learned_addr learned my addr 172.21.15.167:0/1312594804 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:03:07.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6759e640 1 --2- 172.21.15.167:0/1312594804 >> v2:172.21.15.167:3300/0 conn(0x7f0f6806a580 0x7f0f6806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6659c640 1 -- 172.21.15.167:0/1312594804 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840753595 0 0) 0x7f0f58001120 con 0x7f0f68153fa0 2023-11-28T21:03:07.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6759e640 1 -- 172.21.15.167:0/1312594804 >> v1:172.21.15.178:6789/0 conn(0x7f0f6815d770 legacy=0x7f0f6815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6759e640 1 -- 172.21.15.167:0/1312594804 >> v1:172.21.15.167:6789/0 conn(0x7f0f68153fa0 legacy=0x7f0f680c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.768+0000 7f0f6759e640 1 -- 172.21.15.167:0/1312594804 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6815a500 con 0x7f0f6806a580 2023-11-28T21:03:07.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6759e640 1 --2- 172.21.15.167:0/1312594804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6806a580 0x7f0f6806a9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009dc0 tx=0x7f0f6001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1560779a0b16b818 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6659c640 1 -- 172.21.15.167:0/1312594804 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600a59c0 con 0x7f0f6806a580 2023-11-28T21:03:07.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6659c640 1 -- 172.21.15.167:0/1312594804 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f600a5b20 con 0x7f0f6806a580 2023-11-28T21:03:07.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6659c640 1 -- 172.21.15.167:0/1312594804 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600ad440 con 0x7f0f6806a580 2023-11-28T21:03:07.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6d157640 1 -- 172.21.15.167:0/1312594804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6806a580 msgr2=0x7f0f6806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6d157640 1 --2- 172.21.15.167:0/1312594804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6806a580 0x7f0f6806a9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009dc0 tx=0x7f0f6001c900 comp rx=0 tx=0).stop 2023-11-28T21:03:07.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6d157640 1 -- 172.21.15.167:0/1312594804 shutdown_connections 2023-11-28T21:03:07.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6d157640 1 --2- 172.21.15.167:0/1312594804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6806a580 0x7f0f6806a9f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6d157640 1 -- 172.21.15.167:0/1312594804 >> 172.21.15.167:0/1312594804 conn(0x7f0f680cb1e0 msgr2=0x7f0f680cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:07.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6d157640 1 -- 172.21.15.167:0/1312594804 shutdown_connections 2023-11-28T21:03:07.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.772+0000 7f0f6d157640 1 -- 172.21.15.167:0/1312594804 wait complete. 2023-11-28T21:03:07.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 Processor -- start 2023-11-28T21:03:07.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 -- start start 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6806a580 0x7f0f681f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68153fa0 0x7f0f681419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6815d770 0x7f0f680ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68141f20 con 0x7f0f6815d770 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6813fd30 con 0x7f0f68153fa0 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68140f40 con 0x7f0f6806a580 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6815d770 0x7f0f680ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6815d770 0x7f0f680ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44806/0 (socket says 172.21.15.167:44806) 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6759e640 1 -- 172.21.15.167:0/2664974289 learned_addr learned my addr 172.21.15.167:0/2664974289 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:07.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f5e59c640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68153fa0 0x7f0f681419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f66d9d640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6806a580 0x7f0f681f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6759e640 1 -- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6806a580 msgr2=0x7f0f681f9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6759e640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6806a580 0x7f0f681f9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6759e640 1 -- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68153fa0 msgr2=0x7f0f681419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6759e640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68153fa0 0x7f0f681419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6759e640 1 -- 172.21.15.167:0/2664974289 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60009a70 con 0x7f0f6815d770 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6759e640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6815d770 0x7f0f680ca960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0f6001cde0 tx=0x7f0f600196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600adde0 con 0x7f0f6815d770 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f600b9450 con 0x7f0f6815d770 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f600b9800 con 0x7f0f6815d770 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f68154730 con 0x7f0f6815d770 2023-11-28T21:03:07.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f680c8600 con 0x7f0f6815d770 2023-11-28T21:03:07.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68154a30 0x7f0f6813ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.776+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68074770 con 0x7f0f68154a30 2023-11-28T21:03:07.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f66d9d640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68154a30 0x7f0f6813ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f600b9960 con 0x7f0f6815d770 2023-11-28T21:03:07.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f66d9d640 1 -- 172.21.15.167:0/2664974289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f680c65a0 con 0x7f0f68154a30 2023-11-28T21:03:07.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f66d9d640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68154a30 0x7f0f6813ec90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f58000f70 tx=0x7f0f58001820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5ffff640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0f48066470 0x7f0f48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f0f6011fba0 con 0x7f0f6815d770 2023-11-28T21:03:07.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58010510 con 0x7f0f68154a30 2023-11-28T21:03:07.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5e59c640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0f48066470 0x7f0f48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f0f58010670 con 0x7f0f68154a30 2023-11-28T21:03:07.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68154a30 msgr2=0x7f0f6813ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5ffff640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68154a30 0x7f0f6813ec90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f58000f70 tx=0x7f0f58001820 comp rx=0 tx=0).stop 2023-11-28T21:03:07.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68154a30 msgr2=0x7f0f6813ec90 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:07.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5ffff640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68154a30 0x7f0f6813ec90 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f58000f70 tx=0x7f0f58001820 comp rx=0 tx=0).stop 2023-11-28T21:03:07.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.780+0000 7f0f5e59c640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0f48066470 0x7f0f48068930 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0f68142330 tx=0x7f0f50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f6d157640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f6813fec0 0x7f0f6813f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680682c0 con 0x7f0f6813fec0 2023-11-28T21:03:07.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f66d9d640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f6813fec0 0x7f0f6813f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f66d9d640 1 -- 172.21.15.167:0/2664974289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0f68141700 con 0x7f0f6813fec0 2023-11-28T21:03:07.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f66d9d640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f6813fec0 0x7f0f6813f1d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f58007fd0 tx=0x7f0f58000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58021070 con 0x7f0f6813fec0 2023-11-28T21:03:07.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5124 (secure 0 0 0) 0x7f0f5801c8d0 con 0x7f0f6813fec0 2023-11-28T21:03:07.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f6813fec0 msgr2=0x7f0f6813f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f5ffff640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f6813fec0 0x7f0f6813f1d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f58007fd0 tx=0x7f0f58000ee0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f5ffff640 1 -- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f6813fec0 msgr2=0x7f0f6813f1d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:07.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.788+0000 7f0f5ffff640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f6813fec0 0x7f0f6813f1d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.793 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:03:07.793 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:03:07.793 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:03:07.793 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:03:07.793 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 186, 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:07.794 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:03:07.795 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.796 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:03:07.797 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:07.798 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:03:07.799 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:03:07.800 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.801 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.802 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.804 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:07.805 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.806 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.807 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.808 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:03:07.808 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.808 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.808 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.809 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:03:07.810 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:03:07.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0f48066470 msgr2=0x7f0f48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6d157640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0f48066470 0x7f0f48068930 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0f68142330 tx=0x7f0f50009040 comp rx=0 tx=0).stop 2023-11-28T21:03:07.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6815d770 msgr2=0x7f0f680ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6d157640 1 --2- 172.21.15.167:0/2664974289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f6815d770 0x7f0f680ca960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0f6001cde0 tx=0x7f0f600196a0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6759e640 1 -- 172.21.15.167:0/2664974289 reap_dead start 2023-11-28T21:03:07.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6759e640 1 -- 172.21.15.167:0/2664974289 reap_dead start 2023-11-28T21:03:07.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 shutdown_connections 2023-11-28T21:03:07.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 >> 172.21.15.167:0/2664974289 conn(0x7f0f680cb1e0 msgr2=0x7f0f680cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:07.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 shutdown_connections 2023-11-28T21:03:07.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.792+0000 7f0f6d157640 1 -- 172.21.15.167:0/2664974289 wait complete. 2023-11-28T21:03:07.813 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:03:07.813 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T21:03:07.813 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:03:07.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.948+0000 7f1e61c17640 1 Processor -- start 2023-11-28T21:03:07.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.948+0000 7f1e61c17640 1 -- start start 2023-11-28T21:03:07.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e61c17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c151f60 0x7f1e5c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e61c17640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e5c0c5c90 0x7f1e5c0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e61c17640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e5c06a580 0x7f1e5c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e61c17640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5c0c4da0 con 0x7f1e5c06a580 2023-11-28T21:03:07.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e61c17640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5c15b220 con 0x7f1e5c0c5c90 2023-11-28T21:03:07.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e61c17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0c60f0 con 0x7f1e5c151f60 2023-11-28T21:03:07.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e5c06a580 0x7f1e5c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e5c06a580 0x7f1e5c06a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44812/0 (socket says 172.21.15.167:44812) 2023-11-28T21:03:07.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5bfff640 1 -- 172.21.15.167:0/2437859408 learned_addr learned my addr 172.21.15.167:0/2437859408 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:07.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5affd640 1 --2- 172.21.15.167:0/2437859408 >> v2:172.21.15.178:3300/0 conn(0x7f1e5c0c5c90 0x7f1e5c0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5b7fe640 1 --2- 172.21.15.167:0/2437859408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c151f60 0x7f1e5c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5bfff640 1 -- 172.21.15.167:0/2437859408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c151f60 msgr2=0x7f1e5c0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:03:07.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5bfff640 1 --2- 172.21.15.167:0/2437859408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c151f60 0x7f1e5c0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5bfff640 1 -- 172.21.15.167:0/2437859408 >> v2:172.21.15.178:3300/0 conn(0x7f1e5c0c5c90 msgr2=0x7f1e5c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:03:07.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5bfff640 1 --2- 172.21.15.167:0/2437859408 >> v2:172.21.15.178:3300/0 conn(0x7f1e5c0c5c90 0x7f1e5c0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5bfff640 1 -- 172.21.15.167:0/2437859408 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c152340 con 0x7f1e5c06a580 2023-11-28T21:03:07.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.952+0000 7f1e5affd640 1 --2- 172.21.15.167:0/2437859408 >> v2:172.21.15.178:3300/0 conn(0x7f1e5c0c5c90 0x7f1e5c0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:03:07.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e5bfff640 1 --2- 172.21.15.167:0/2437859408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c06a580 0x7f1e5c06a9b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c06fe60 tx=0x7f1e5401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7088d1e28e775c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e5a7fc640 1 -- 172.21.15.167:0/2437859408 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540a56d0 con 0x7f1e5c06a580 2023-11-28T21:03:07.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e5a7fc640 1 -- 172.21.15.167:0/2437859408 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e540a5830 con 0x7f1e5c06a580 2023-11-28T21:03:07.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e5a7fc640 1 -- 172.21.15.167:0/2437859408 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540a5bc0 con 0x7f1e5c06a580 2023-11-28T21:03:07.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 -- 172.21.15.167:0/2437859408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c06a580 msgr2=0x7f1e5c06a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 --2- 172.21.15.167:0/2437859408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c06a580 0x7f1e5c06a9b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c06fe60 tx=0x7f1e5401c940 comp rx=0 tx=0).stop 2023-11-28T21:03:07.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 -- 172.21.15.167:0/2437859408 shutdown_connections 2023-11-28T21:03:07.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 --2- 172.21.15.167:0/2437859408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c06a580 0x7f1e5c06a9b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 --2- 172.21.15.167:0/2437859408 >> v2:172.21.15.178:3300/0 conn(0x7f1e5c0c5c90 0x7f1e5c0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 --2- 172.21.15.167:0/2437859408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c151f60 0x7f1e5c0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 -- 172.21.15.167:0/2437859408 >> 172.21.15.167:0/2437859408 conn(0x7f1e5c0cb1e0 msgr2=0x7f1e5c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:07.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 -- 172.21.15.167:0/2437859408 shutdown_connections 2023-11-28T21:03:07.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 -- 172.21.15.167:0/2437859408 wait complete. 2023-11-28T21:03:07.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 Processor -- start 2023-11-28T21:03:07.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.956+0000 7f1e61c17640 1 -- start start 2023-11-28T21:03:07.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e5c06a580 0x7f1e5c0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c5c90 0x7f1e5c143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c151f60 0x7f1e5c1f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0c8fe0 con 0x7f1e5c151f60 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c1f5c80 con 0x7f1e5c06a580 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0ca8d0 con 0x7f1e5c0c5c90 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c151f60 0x7f1e5c1f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c151f60 0x7f1e5c1f6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44828/0 (socket says 172.21.15.167:44828) 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5bfff640 1 -- 172.21.15.167:0/1867362573 learned_addr learned my addr 172.21.15.167:0/1867362573 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5affd640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c5c90 0x7f1e5c143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5b7fe640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e5c06a580 0x7f1e5c0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5bfff640 1 -- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c5c90 msgr2=0x7f1e5c143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5bfff640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c5c90 0x7f1e5c143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5bfff640 1 -- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e5c06a580 msgr2=0x7f1e5c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5bfff640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e5c06a580 0x7f1e5c0cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5bfff640 1 -- 172.21.15.167:0/1867362573 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e54009b30 con 0x7f1e5c151f60 2023-11-28T21:03:07.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5affd640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c5c90 0x7f1e5c143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:03:07.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5bfff640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c151f60 0x7f1e5c1f6110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e540af040 tx=0x7f1e540196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540b8670 con 0x7f1e5c151f60 2023-11-28T21:03:07.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e540b87d0 con 0x7f1e5c151f60 2023-11-28T21:03:07.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540b8b80 con 0x7f1e5c151f60 2023-11-28T21:03:07.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c15c0d0 con 0x7f1e5c151f60 2023-11-28T21:03:07.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5c1504e0 con 0x7f1e5c151f60 2023-11-28T21:03:07.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c148000 0x7f1e5c1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c074770 con 0x7f1e5c148000 2023-11-28T21:03:07.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5b7fe640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c148000 0x7f1e5c1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e540b8ce0 con 0x7f1e5c151f60 2023-11-28T21:03:07.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.960+0000 7f1e5b7fe640 1 -- 172.21.15.167:0/1867362573 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e5c15bf50 con 0x7f1e5c148000 2023-11-28T21:03:07.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e5b7fe640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c148000 0x7f1e5c1f6650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c011510 tx=0x7f1e4c0119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e43fff640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e480664a0 0x7f1e48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1e5411f600 con 0x7f1e5c151f60 2023-11-28T21:03:07.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c004230 con 0x7f1e5c148000 2023-11-28T21:03:07.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e5affd640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e480664a0 0x7f1e48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f1e4c004390 con 0x7f1e5c148000 2023-11-28T21:03:07.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c148000 msgr2=0x7f1e5c1f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e43fff640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c148000 0x7f1e5c1f6650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c011510 tx=0x7f1e4c0119d0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c148000 msgr2=0x7f1e5c1f6650 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:07.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e43fff640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c148000 0x7f1e5c1f6650 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c011510 tx=0x7f1e4c0119d0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.964+0000 7f1e5affd640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e480664a0 0x7f1e48068960 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c1f3710 tx=0x7f1e50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.968+0000 7f1e61c17640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c9120 0x7f1e5c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:07.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.968+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c15ba30 con 0x7f1e5c0c9120 2023-11-28T21:03:07.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.968+0000 7f1e5b7fe640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c9120 0x7f1e5c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:07.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e5b7fe640 1 -- 172.21.15.167:0/1867362573 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1e5c0682c0 con 0x7f1e5c0c9120 2023-11-28T21:03:07.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e5b7fe640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c9120 0x7f1e5c156950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c011510 tx=0x7f1e4c0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:07.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c024070 con 0x7f1e5c0c9120 2023-11-28T21:03:07.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4981 (secure 0 0 0) 0x7f1e4c003620 con 0x7f1e5c0c9120 2023-11-28T21:03:07.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c9120 msgr2=0x7f1e5c156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e43fff640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c9120 0x7f1e5c156950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c011510 tx=0x7f1e4c0046d0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e43fff640 1 -- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c9120 msgr2=0x7f1e5c156950 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:07.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e43fff640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e5c0c9120 0x7f1e5c156950 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c011510 tx=0x7f1e4c0046d0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.975 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:03:07.975 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:03:07.975 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:03:07.975 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 186, 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 13, 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:03:07.976 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:07.977 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:07.977 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:07.977 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:07.977 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:07.977 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:07.977 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:07.978 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:07.978 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:07.978 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:07.978 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.979 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:03:07.979 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:03:07.979 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:07.979 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:07.980 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:07.980 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:07.980 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:07.980 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:07.980 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:07.981 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:07.981 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:07.981 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:07.981 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.982 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.982 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:03:07.982 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:03:07.982 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:03:07.983 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:03:07.983 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:03:07.983 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:03:07.983 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:07.983 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:07.983 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:03:07.984 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:03:07.984 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:03:07.984 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:07.985 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:07.986 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:07.986 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:07.986 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:07.986 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:07.986 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:07.986 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.986 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:03:07.987 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:07.988 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.989 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:07.990 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.991 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:07.992 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.993 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.994 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:03:07.995 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:07.996 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:07.996 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:07.996 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:07.996 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:07.996 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:07.996 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:07.996 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:03:07.996 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:03:07.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e480664a0 msgr2=0x7f1e48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e61c17640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1e480664a0 0x7f1e48068960 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c1f3710 tx=0x7f1e50008040 comp rx=0 tx=0).stop 2023-11-28T21:03:07.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c151f60 msgr2=0x7f1e5c1f6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:07.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e61c17640 1 --2- 172.21.15.167:0/1867362573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e5c151f60 0x7f1e5c1f6110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e540af040 tx=0x7f1e540196e0 comp rx=0 tx=0).stop 2023-11-28T21:03:07.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e5bfff640 1 -- 172.21.15.167:0/1867362573 reap_dead start 2023-11-28T21:03:07.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e5bfff640 1 -- 172.21.15.167:0/1867362573 reap_dead start 2023-11-28T21:03:07.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 shutdown_connections 2023-11-28T21:03:07.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 >> 172.21.15.167:0/1867362573 conn(0x7f1e5c0cb1e0 msgr2=0x7f1e5c0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:07.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 shutdown_connections 2023-11-28T21:03:07.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:07.972+0000 7f1e61c17640 1 -- 172.21.15.167:0/1867362573 wait complete. 2023-11-28T21:03:07.999 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:03:08.000 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2023-11-28T21:03:08.000 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2023-11-28T21:03:08.000 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2023-11-28T21:03:08.000 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T21:03:08.001 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T21:03:08.001 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:03:08.017 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T21:03:08.017 INFO:tasks.mon_thrash:Sending STOP to mon c 2023-11-28T21:03:08.018 INFO:tasks.ceph.mon.c:Sent signal 19 2023-11-28T21:03:08.018 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2023-11-28T21:03:08.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~235s 2023-11-28T21:03:15.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~242s 2023-11-28T21:03:22.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~249s 2023-11-28T21:03:22.680 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:22.685 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:23.019 INFO:tasks.mon_thrash:Sending CONT to mon c 2023-11-28T21:03:23.020 INFO:tasks.ceph.mon.c:Sent signal 18 2023-11-28T21:03:23.020 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T21:03:23.020 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:03:23.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.163+0000 7f3e04491640 1 Processor -- start 2023-11-28T21:03:23.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.163+0000 7f3e04491640 1 -- start start 2023-11-28T21:03:23.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e04491640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:23.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e04491640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:23.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e04491640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc0c7a50 con 0x7f3dfc151f60 2023-11-28T21:03:23.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e04491640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc06aed0 con 0x7f3dfc0c75c0 2023-11-28T21:03:23.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e04491640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc0c4da0 con 0x7f3dfc06a580 2023-11-28T21:03:23.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e0222d640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f3dfc151f60 legacy=0x7f3dfc0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:03:23.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e01a2c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:23.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e02a2e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e02a2e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:32878/0 (socket says 172.21.15.167:32878) 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e01a2c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:33546/0 (socket says 172.21.15.167:33546) 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 learned_addr learned my addr 172.21.15.167:0/2477194253 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 msgr2=0x7f3dfc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 msgr2=0x7f3dfc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e01a2c640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 msgr2=0x7f3dfc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e01a2c640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 msgr2=0x7f3dfc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:03:23.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.167+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:03:23.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 >> v1:172.21.15.167:6789/0 conn(0x7f3dfc151f60 legacy=0x7f3dfc0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:03:23.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 msgr2=0x7f3dfc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:03:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 msgr2=0x7f3dfc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:03:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:03:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e01a2c640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 msgr2=0x7f3dfc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:03:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e01a2c640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 msgr2=0x7f3dfc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:03:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:03:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:03:23.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.371+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:03:23.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 >> v1:172.21.15.167:6789/0 conn(0x7f3dfc151f60 legacy=0x7f3dfc0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:03:23.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:23.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:23.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 msgr2=0x7f3dfc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:03:23.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 msgr2=0x7f3dfc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:03:23.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:03:23.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:03:23.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e01a2c640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 msgr2=0x7f3dfc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:03:23.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e01a2c640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 msgr2=0x7f3dfc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:03:23.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:03:23.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:23.775+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:03:24.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 >> v1:172.21.15.167:6789/0 conn(0x7f3dfc151f60 legacy=0x7f3dfc0c26e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 msgr2=0x7f3dfc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e01a2c640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 msgr2=0x7f3dfc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 msgr2=0x7f3dfc06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e01a2c640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 msgr2=0x7f3dfc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:03:24.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:24.579+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:03:26.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3df3fff640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 msgr2=0x7f3dfc06a990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:03:26.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3df3fff640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dfc06a580 0x7f3dfc06a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:26.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3df3fff640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 msgr2=0x7f3dfc0c5c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:03:26.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3df3fff640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.178:3300/0 conn(0x7f3dfc0c75c0 0x7f3dfc0c5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:26.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3df3fff640 1 -- 172.21.15.167:0/2477194253 >> v1:172.21.15.167:6789/0 conn(0x7f3dfc151f60 legacy=0x7f3dfc0c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:03:26.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3df3fff640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 0x7f3de0005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:26.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3df3fff640 1 -- 172.21.15.167:0/2477194253 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc15b220 con 0x7f3de0006160 2023-11-28T21:03:26.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3df3fff640 1 -- 172.21.15.167:0/2477194253 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc06aed0 con 0x7f3de00036b0 2023-11-28T21:03:26.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 msgr2=0x7f3de0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:03:26.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.167+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 0x7f3de0005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:03:26.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.371+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 msgr2=0x7f3de0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:03:26.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.371+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 0x7f3de0005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:03:26.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.775+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 msgr2=0x7f3de0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:03:26.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:26.775+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 0x7f3de0005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:03:27.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:27.579+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 msgr2=0x7f3de0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:03:27.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:27.579+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 0x7f3de0005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:03:28.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.055+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872521497 0 0) 0x7f3dfc15b220 con 0x7f3de0006160 2023-11-28T21:03:28.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.055+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de8003530 con 0x7f3de0006160 2023-11-28T21:03:28.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1555603463 0 0) 0x7f3de8003530 con 0x7f3de0006160 2023-11-28T21:03:28.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 msgr2=0x7f3de0005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:03:28.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 --2- 172.21.15.167:0/2477194253 >> v2:172.21.15.167:3300/0 conn(0x7f3de00036b0 0x7f3de0005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de000af30 con 0x7f3de0006160 2023-11-28T21:03:28.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f3dec00e510 con 0x7f3de0006160 2023-11-28T21:03:28.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 >> v1:172.21.15.178:6789/0 conn(0x7f3de0006160 legacy=0x7f3de0008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e02a2e640 1 -- 172.21.15.167:0/2477194253 reap_dead start 2023-11-28T21:03:28.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8003980 0x7f3de8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80052b0 0x7f3de800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc06aed0 con 0x7f3de80047d0 2023-11-28T21:03:28.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de800c200 con 0x7f3de8003980 2023-11-28T21:03:28.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de800c3c0 con 0x7f3de80052b0 2023-11-28T21:03:28.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e01a2c640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80047d0 msgr2=0x7f3de8004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:03:28.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:03:28.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8003980 0x7f3de8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e02a2e640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80052b0 0x7f3de800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80052b0 msgr2=0x7f3de800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:03:28.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80052b0 0x7f3de800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80047d0 msgr2=0x7f3de8004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:03:28.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.059+0000 7f3e0222d640 1 -- 172.21.15.167:0/2477194253 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8003530 con 0x7f3de8003980 2023-11-28T21:03:28.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.063+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8003980 0x7f3de8003d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3df8003990 tx=0x7f3df801c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8294158585ff72d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.063+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80a6690 con 0x7f3de8003980 2023-11-28T21:03:28.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.063+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df80a67f0 con 0x7f3de8003980 2023-11-28T21:03:28.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.063+0000 7f3e0122b640 1 -- 172.21.15.167:0/2477194253 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80a6be0 con 0x7f3de8003980 2023-11-28T21:03:28.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 -- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8003980 msgr2=0x7f3de8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8003980 0x7f3de8003d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3df8003990 tx=0x7f3df801c980 comp rx=0 tx=0).stop 2023-11-28T21:03:28.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 -- 172.21.15.167:0/2477194253 shutdown_connections 2023-11-28T21:03:28.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80052b0 0x7f3de800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80047d0 0x7f3de8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 --2- 172.21.15.167:0/2477194253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8003980 0x7f3de8003d80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 -- 172.21.15.167:0/2477194253 >> 172.21.15.167:0/2477194253 conn(0x7f3dfc0cb1e0 msgr2=0x7f3dfc0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:28.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 -- 172.21.15.167:0/2477194253 shutdown_connections 2023-11-28T21:03:28.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 -- 172.21.15.167:0/2477194253 wait complete. 2023-11-28T21:03:28.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 Processor -- start 2023-11-28T21:03:28.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.067+0000 7f3e04491640 1 -- start start 2023-11-28T21:03:28.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e04491640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de8003980 0x7f3dfc0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e04491640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de80047d0 0x7f3dfc154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e04491640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80052b0 0x7f3dfc1f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e04491640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc1f3bf0 con 0x7f3de80052b0 2023-11-28T21:03:28.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e04491640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc150c00 con 0x7f3de80047d0 2023-11-28T21:03:28.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e04491640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc1f08f0 con 0x7f3de8003980 2023-11-28T21:03:28.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e02a2e640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80052b0 msgr2=0x7f3dfc1f4080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:03:28.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e02a2e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80052b0 0x7f3dfc1f4080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:03:28.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e0222d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de8003980 0x7f3dfc0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e01a2c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de80047d0 0x7f3dfc154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e0222d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de8003980 0x7f3dfc0ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:32918/0 (socket says 172.21.15.167:32918) 2023-11-28T21:03:28.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e0222d640 1 -- 172.21.15.167:0/2933658325 learned_addr learned my addr 172.21.15.167:0/2933658325 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:28.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e0222d640 1 -- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de80047d0 msgr2=0x7f3dfc154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de80047d0 0x7f3dfc154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e0222d640 1 -- 172.21.15.167:0/2933658325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80052b0 msgr2=0x7f3dfc1f4080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:03:28.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80052b0 0x7f3dfc1f4080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e0222d640 1 -- 172.21.15.167:0/2933658325 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc1f0bd0 con 0x7f3de8003980 2023-11-28T21:03:28.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de80047d0 0x7f3dfc154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:03:28.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.071+0000 7f3e0222d640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de8003980 0x7f3dfc0ca960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3df801c7b0 tx=0x7f3de8005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.075+0000 7f3df2ffd640 1 -- 172.21.15.167:0/2933658325 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80b7070 con 0x7f3de8003980 2023-11-28T21:03:28.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.075+0000 7f3df2ffd640 1 -- 172.21.15.167:0/2933658325 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df8003970 con 0x7f3de8003980 2023-11-28T21:03:28.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.075+0000 7f3df2ffd640 1 -- 172.21.15.167:0/2933658325 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80a7470 con 0x7f3de8003980 2023-11-28T21:03:28.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.075+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc1f0eb0 con 0x7f3de8003980 2023-11-28T21:03:28.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.079+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc1f05c0 con 0x7f3de8003980 2023-11-28T21:03:28.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.079+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc1f08f0 con 0x7f3de8003980 2023-11-28T21:03:28.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.079+0000 7f3df2ffd640 1 -- 172.21.15.167:0/2933658325 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3df80a75d0 con 0x7f3de8003980 2023-11-28T21:03:28.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.079+0000 7f3df2ffd640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3de0066c80 0x7f3de0069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.079+0000 7f3df2ffd640 1 -- 172.21.15.167:0/2933658325 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3df811df80 con 0x7f3de8003980 2023-11-28T21:03:28.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.079+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3de0066c80 0x7f3de0069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.083+0000 7f3e01a2c640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3de0066c80 0x7f3de0069140 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0cb1b0 tx=0x7f3dec00e4c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.091+0000 7f3df2ffd640 1 -- 172.21.15.167:0/2933658325 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3df80eb230 con 0x7f3de8003980 2023-11-28T21:03:28.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.295+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3dfc0682c0 con 0x7f3de8003980 2023-11-28T21:03:28.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3df2ffd640 1 -- 172.21.15.167:0/2933658325 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f3df80c1070 con 0x7f3de8003980 2023-11-28T21:03:28.301 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":188,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:03:28.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3de0066c80 msgr2=0x7f3de0069140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3de0066c80 0x7f3de0069140 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0cb1b0 tx=0x7f3dec00e4c0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de8003980 msgr2=0x7f3dfc0ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de8003980 0x7f3dfc0ca960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3df801c7b0 tx=0x7f3de8005800 comp rx=0 tx=0).stop 2023-11-28T21:03:28.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 shutdown_connections 2023-11-28T21:03:28.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3de0066c80 0x7f3de0069140 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de80052b0 0x7f3dfc1f4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de80047d0 0x7f3dfc154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 --2- 172.21.15.167:0/2933658325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de8003980 0x7f3dfc0ca960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 >> 172.21.15.167:0/2933658325 conn(0x7f3dfc0cb1e0 msgr2=0x7f3dfc14f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:28.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 shutdown_connections 2023-11-28T21:03:28.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.299+0000 7f3e04491640 1 -- 172.21.15.167:0/2933658325 wait complete. 2023-11-28T21:03:28.322 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T21:03:28.322 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2023-11-28T21:03:28.323 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:03:28.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb78e1f8640 1 Processor -- start 2023-11-28T21:03:28.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb78e1f8640 1 -- start start 2023-11-28T21:03:28.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb78e1f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7880c6ff0 0x7fb788157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb78e1f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb78806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb78e1f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880c4920 con 0x7fb788150b40 2023-11-28T21:03:28.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb78e1f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880c62f0 con 0x7fb7880c6ff0 2023-11-28T21:03:28.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb78e1f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c6ac0 con 0x7fb7880c4510 2023-11-28T21:03:28.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb7877fe640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7fb788150b40 legacy=0x7fb7880c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2023-11-28T21:03:28.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb786ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7880c6ff0 0x7fb788157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb787fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb78806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb786ffd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7880c6ff0 0x7fb788157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:33602/0 (socket says 172.21.15.167:33602) 2023-11-28T21:03:28.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb786ffd640 1 -- 172.21.15.167:0/1215281005 learned_addr learned my addr 172.21.15.167:0/1215281005 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:28.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb787fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb78806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:32932/0 (socket says 172.21.15.167:32932) 2023-11-28T21:03:28.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb786ffd640 1 -- 172.21.15.167:0/1215281005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 msgr2=0x7fb78806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:03:28.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb786ffd640 1 --2- 172.21.15.167:0/1215281005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb78806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb786ffd640 1 -- 172.21.15.167:0/1215281005 >> v1:172.21.15.167:6789/0 conn(0x7fb788150b40 legacy=0x7fb7880c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:03:28.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb786ffd640 1 -- 172.21.15.167:0/1215281005 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880c6500 con 0x7fb7880c6ff0 2023-11-28T21:03:28.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.459+0000 7fb787fff640 1 --2- 172.21.15.167:0/1215281005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb78806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:03:28.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb786ffd640 1 --2- 172.21.15.167:0/1215281005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880c6ff0 0x7fb788157560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb78806bba0 tx=0x7fb77c01eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d44028fc2f8cd4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb7867fc640 1 -- 172.21.15.167:0/1215281005 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0a7a20 con 0x7fb7880c6ff0 2023-11-28T21:03:28.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb7867fc640 1 -- 172.21.15.167:0/1215281005 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c0a7b80 con 0x7fb7880c6ff0 2023-11-28T21:03:28.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb7867fc640 1 -- 172.21.15.167:0/1215281005 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0af440 con 0x7fb7880c6ff0 2023-11-28T21:03:28.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb78e1f8640 1 -- 172.21.15.167:0/1215281005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880c6ff0 msgr2=0x7fb788157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb78e1f8640 1 --2- 172.21.15.167:0/1215281005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880c6ff0 0x7fb788157560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb78806bba0 tx=0x7fb77c01eb80 comp rx=0 tx=0).stop 2023-11-28T21:03:28.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb78e1f8640 1 -- 172.21.15.167:0/1215281005 shutdown_connections 2023-11-28T21:03:28.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb78e1f8640 1 --2- 172.21.15.167:0/1215281005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880c6ff0 0x7fb788157560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb78e1f8640 1 --2- 172.21.15.167:0/1215281005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb78806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb78e1f8640 1 -- 172.21.15.167:0/1215281005 >> 172.21.15.167:0/1215281005 conn(0x7fb7880cb1e0 msgr2=0x7fb7880cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:28.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb78e1f8640 1 -- 172.21.15.167:0/1215281005 shutdown_connections 2023-11-28T21:03:28.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.463+0000 7fb78e1f8640 1 -- 172.21.15.167:0/1215281005 wait complete. 2023-11-28T21:03:28.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb78e1f8640 1 Processor -- start 2023-11-28T21:03:28.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb78e1f8640 1 -- start start 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb78e1f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb7881f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb78e1f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7880c6ff0 0x7fb7881f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb78e1f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788150b40 0x7fb788148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb78e1f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7881581a0 con 0x7fb7880c6ff0 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb78e1f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7881f29a0 con 0x7fb788150b40 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb78e1f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880cb060 con 0x7fb7880c4510 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb786ffd640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7880c6ff0 msgr2=0x7fb7881f3370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb786ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7880c6ff0 0x7fb7881f3370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb787fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788150b40 0x7fb788148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb7877fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb7881f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb787fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788150b40 0x7fb788148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:33616/0 (socket says 172.21.15.167:33616) 2023-11-28T21:03:28.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb787fff640 1 -- 172.21.15.167:0/2975687002 learned_addr learned my addr 172.21.15.167:0/2975687002 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:28.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb7877fe640 1 -- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788150b40 msgr2=0x7fb788148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb7877fe640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788150b40 0x7fb788148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb7877fe640 1 -- 172.21.15.167:0/2975687002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7880c6ff0 msgr2=0x7fb7881f3370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:03:28.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb7877fe640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7880c6ff0 0x7fb7881f3370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.467+0000 7fb7877fe640 1 -- 172.21.15.167:0/2975687002 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb780009a70 con 0x7fb7880c4510 2023-11-28T21:03:28.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb7877fe640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb7881f6920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb77800b470 tx=0x7fb77800b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778003dd0 con 0x7fb7880c4510 2023-11-28T21:03:28.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb778005070 con 0x7fb7880c4510 2023-11-28T21:03:28.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c00b770 con 0x7fb7880c4510 2023-11-28T21:03:28.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778005420 con 0x7fb7880c4510 2023-11-28T21:03:28.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7881f2ee0 con 0x7fb7880c4510 2023-11-28T21:03:28.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb78e1f8640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880ca3a0 0x7fb7880c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7881f2d80 con 0x7fb7880ca3a0 2023-11-28T21:03:28.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb786ffd640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880ca3a0 0x7fb7880c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb786ffd640 1 -- 172.21.15.167:0/2975687002 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb788157040 con 0x7fb7880ca3a0 2023-11-28T21:03:28.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb786ffd640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880ca3a0 0x7fb7880c9070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7880cc090 tx=0x7fb77c01d3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c006ea0 con 0x7fb7880ca3a0 2023-11-28T21:03:28.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.471+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb778005580 con 0x7fb7880c4510 2023-11-28T21:03:28.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.475+0000 7fb76ffff640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb774066510 0x7fb7740689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.475+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb778083d90 con 0x7fb7880c4510 2023-11-28T21:03:28.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.475+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb77c0af440 con 0x7fb7880ca3a0 2023-11-28T21:03:28.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.475+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880ca3a0 msgr2=0x7fb7880c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.475+0000 7fb76ffff640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880ca3a0 0x7fb7880c9070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7880cc090 tx=0x7fb77c01d3c0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.475+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880ca3a0 msgr2=0x7fb7880c9070 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:28.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.475+0000 7fb76ffff640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7880ca3a0 0x7fb7880c9070 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7880cc090 tx=0x7fb77c01d3c0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.475+0000 7fb787fff640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb774066510 0x7fb7740689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.475+0000 7fb787fff640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb774066510 0x7fb7740689d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb78000f5c0 tx=0x7fb78000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.479+0000 7fb78e1f8640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788152c00 0x7fb788153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.479+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb788074770 con 0x7fb788152c00 2023-11-28T21:03:28.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.479+0000 7fb786ffd640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788152c00 0x7fb788153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.479+0000 7fb786ffd640 1 -- 172.21.15.167:0/2975687002 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb7880682c0 con 0x7fb788152c00 2023-11-28T21:03:28.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb786ffd640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788152c00 0x7fb788153240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb77c01f420 tx=0x7fb77c01b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c003620 con 0x7fb788152c00 2023-11-28T21:03:28.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5114 (secure 0 0 0) 0x7fb77c003780 con 0x7fb788152c00 2023-11-28T21:03:28.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788152c00 msgr2=0x7fb788153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb76ffff640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788152c00 0x7fb788153240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb77c01f420 tx=0x7fb77c01b920 comp rx=0 tx=0).stop 2023-11-28T21:03:28.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb76ffff640 1 -- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788152c00 msgr2=0x7fb788153240 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:28.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb76ffff640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb788152c00 0x7fb788153240 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.486 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 188, 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:03:28.487 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:28.488 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:28.489 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:28.489 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:28.489 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.489 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:03:28.489 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:03:28.489 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:28.489 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:28.489 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:28.489 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:03:28.490 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:03:28.491 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:03:28.491 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:03:28.491 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:03:28.491 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:03:28.491 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:28.491 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:28.491 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:03:28.491 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:28.492 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:03:28.493 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:03:28.494 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:28.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:28.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.494 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:28.494 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:03:28.494 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.494 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.494 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.494 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:28.495 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:03:28.495 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.495 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.495 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.495 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:03:28.495 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:03:28.495 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:28.496 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:28.496 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:28.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.496 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:03:28.496 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:03:28.496 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:28.496 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:28.496 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.497 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:28.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:03:28.497 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.497 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.497 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:28.497 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:03:28.497 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.497 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.498 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.498 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:03:28.498 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:03:28.498 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:28.498 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:28.498 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:28.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.498 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.499 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:28.501 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:28.502 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:28.502 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.502 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.502 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.502 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:03:28.502 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:03:28.502 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.502 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.503 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.504 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.505 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.506 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.506 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:03:28.506 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:03:28.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb774066510 msgr2=0x7fb7740689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb78e1f8640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb774066510 0x7fb7740689d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb78000f5c0 tx=0x7fb78000b040 comp rx=0 tx=0).stop 2023-11-28T21:03:28.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 msgr2=0x7fb7881f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb78e1f8640 1 --2- 172.21.15.167:0/2975687002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7880c4510 0x7fb7881f6920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb77800b470 tx=0x7fb77800b930 comp rx=0 tx=0).stop 2023-11-28T21:03:28.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb787fff640 1 -- 172.21.15.167:0/2975687002 reap_dead start 2023-11-28T21:03:28.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb787fff640 1 -- 172.21.15.167:0/2975687002 reap_dead start 2023-11-28T21:03:28.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 shutdown_connections 2023-11-28T21:03:28.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 >> 172.21.15.167:0/2975687002 conn(0x7fb7880cb1e0 msgr2=0x7fb7880c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:28.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 shutdown_connections 2023-11-28T21:03:28.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.483+0000 7fb78e1f8640 1 -- 172.21.15.167:0/2975687002 wait complete. 2023-11-28T21:03:28.508 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:03:28.509 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T21:03:28.509 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:03:28.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.643+0000 7ff362b1d640 1 Processor -- start 2023-11-28T21:03:28.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.643+0000 7ff362b1d640 1 -- start start 2023-11-28T21:03:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff362b1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 0x7ff35c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff362b1d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff35c0c4510 0x7ff35c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff362b1d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c0c4940 con 0x7ff35c150b40 2023-11-28T21:03:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff362b1d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c0c62f0 con 0x7ff35c0c4510 2023-11-28T21:03:28.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff362b1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0c6ac0 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff3608b9640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff35c150b40 0x7ff35c0c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:45408/0 (socket says 172.21.15.167:45408) 2023-11-28T21:03:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff353fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 0x7ff35c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff3608b9640 1 -- 172.21.15.167:0/1097340927 learned_addr learned my addr 172.21.15.167:0/1097340927 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:03:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff3610ba640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff35c0c4510 0x7ff35c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff3537fe640 1 -- 172.21.15.167:0/1097340927 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860000722 0 0) 0x7ff35c0c4940 con 0x7ff35c150b40 2023-11-28T21:03:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff3537fe640 1 -- 172.21.15.167:0/1097340927 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff344003530 con 0x7ff35c150b40 2023-11-28T21:03:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff353fff640 1 -- 172.21.15.167:0/1097340927 >> v2:172.21.15.178:3300/0 conn(0x7ff35c0c4510 msgr2=0x7ff35c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:03:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff353fff640 1 --2- 172.21.15.167:0/1097340927 >> v2:172.21.15.178:3300/0 conn(0x7ff35c0c4510 0x7ff35c06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff353fff640 1 -- 172.21.15.167:0/1097340927 >> v1:172.21.15.178:6789/0 conn(0x7ff35c150b40 legacy=0x7ff35c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.647+0000 7ff353fff640 1 -- 172.21.15.167:0/1097340927 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0c6500 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff353fff640 1 --2- 172.21.15.167:0/1097340927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 0x7ff35c157560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0097c0 tx=0x7ff34c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=994c9a20830597af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff3537fe640 1 -- 172.21.15.167:0/1097340927 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0ad660 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff3537fe640 1 -- 172.21.15.167:0/1097340927 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c0ad7c0 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff3537fe640 1 -- 172.21.15.167:0/1097340927 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0adb30 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 -- 172.21.15.167:0/1097340927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 msgr2=0x7ff35c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 --2- 172.21.15.167:0/1097340927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 0x7ff35c157560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0097c0 tx=0x7ff34c01c450 comp rx=0 tx=0).stop 2023-11-28T21:03:28.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 -- 172.21.15.167:0/1097340927 shutdown_connections 2023-11-28T21:03:28.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 --2- 172.21.15.167:0/1097340927 >> v2:172.21.15.178:3300/0 conn(0x7ff35c0c4510 0x7ff35c06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 --2- 172.21.15.167:0/1097340927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 0x7ff35c157560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 -- 172.21.15.167:0/1097340927 >> 172.21.15.167:0/1097340927 conn(0x7ff35c0cb1e0 msgr2=0x7ff35c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:28.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 -- 172.21.15.167:0/1097340927 shutdown_connections 2023-11-28T21:03:28.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 -- 172.21.15.167:0/1097340927 wait complete. 2023-11-28T21:03:28.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 Processor -- start 2023-11-28T21:03:28.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.651+0000 7ff362b1d640 1 -- start start 2023-11-28T21:03:28.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0c4510 0x7ff35c147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 0x7ff35c14bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c150b40 0x7ff35c14c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c14afd0 con 0x7ff35c150b40 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c157f80 con 0x7ff35c0c4510 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c14b4b0 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3610ba640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c150b40 msgr2=0x7ff35c14c160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3610ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c150b40 0x7ff35c14c160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3608b9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0c4510 0x7ff35c147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff353fff640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 0x7ff35c14bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3608b9640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0c4510 0x7ff35c147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:33650/0 (socket says 172.21.15.167:33650) 2023-11-28T21:03:28.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3608b9640 1 -- 172.21.15.167:0/334112875 learned_addr learned my addr 172.21.15.167:0/334112875 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:03:28.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff353fff640 1 -- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0c4510 msgr2=0x7ff35c147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff353fff640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0c4510 0x7ff35c147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff353fff640 1 -- 172.21.15.167:0/334112875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c150b40 msgr2=0x7ff35c14c160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:03:28.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff353fff640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c150b40 0x7ff35c14c160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff353fff640 1 -- 172.21.15.167:0/334112875 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c009420 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3608b9640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0c4510 0x7ff35c147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:03:28.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff353fff640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 0x7ff35c14bc20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0ac000 tx=0x7ff34c0191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0bc070 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c006e20 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c14b790 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c0b6640 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c157b30 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c14e310 0x7ff35c14d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c074770 con 0x7ff35c14e310 2023-11-28T21:03:28.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.655+0000 7ff3608b9640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c14e310 0x7ff35c14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3608b9640 1 -- 172.21.15.167:0/334112875 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff35c0c3520 con 0x7ff35c14e310 2023-11-28T21:03:28.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3608b9640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c14e310 0x7ff35c14d760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff358005890 tx=0x7ff35800ff70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35800dae0 con 0x7ff35c14e310 2023-11-28T21:03:28.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff34c0b4040 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3517fa640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff348066510 0x7ff3480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff34c11d9c0 con 0x7ff35c0c6ff0 2023-11-28T21:03:28.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7ff35800dc40 con 0x7ff35c14e310 2023-11-28T21:03:28.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c14e310 msgr2=0x7ff35c14d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3517fa640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c14e310 0x7ff35c14d760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff358005890 tx=0x7ff35800ff70 comp rx=0 tx=0).stop 2023-11-28T21:03:28.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3610ba640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff348066510 0x7ff3480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c14e310 msgr2=0x7ff35c14d760 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:28.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3517fa640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c14e310 0x7ff35c14d760 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff358005890 tx=0x7ff35800ff70 comp rx=0 tx=0).stop 2023-11-28T21:03:28.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.659+0000 7ff3610ba640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff348066510 0x7ff3480689d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff35c14dfb0 tx=0x7ff35400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c149a60 0x7ff35c147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:03:28.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c157040 con 0x7ff35c149a60 2023-11-28T21:03:28.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3608b9640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c149a60 0x7ff35c147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:03:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3608b9640 1 -- 172.21.15.167:0/334112875 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff35c0682c0 con 0x7ff35c149a60 2023-11-28T21:03:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3608b9640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c149a60 0x7ff35c147f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff358005890 tx=0x7ff358000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:03:28.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358023070 con 0x7ff35c149a60 2023-11-28T21:03:28.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4969 (secure 0 0 0) 0x7ff3580070d0 con 0x7ff35c149a60 2023-11-28T21:03:28.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c149a60 msgr2=0x7ff35c147f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3517fa640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c149a60 0x7ff35c147f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff358005890 tx=0x7ff358000ee0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3517fa640 1 -- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c149a60 msgr2=0x7ff35c147f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:03:28.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3517fa640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c149a60 0x7ff35c147f30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.672 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:03:28.672 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:03:28.672 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:03:28.672 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:03:28.672 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 188, 2023-11-28T21:03:28.672 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:03:28.672 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:03:28.672 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:28.673 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:28.674 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:03:28.675 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:03:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:03:28.677 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:03:28.677 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:03:28.677 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:03:28.677 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:03:28.677 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:03:28.677 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:03:28.677 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:03:28.678 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:03:28.678 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:03:28.678 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:03:28.678 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:03:28.678 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:03:28.678 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:03:28.678 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:28.679 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:03:28.680 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.680 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.680 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.680 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:28.680 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:03:28.680 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.680 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.680 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.681 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:03:28.681 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:03:28.681 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:28.681 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:28.681 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:28.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.681 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:28.682 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:03:28.683 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.683 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.683 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.683 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.683 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:03:28.683 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:03:28.683 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:28.684 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:28.684 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:28.684 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.684 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.684 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:03:28.684 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:03:28.684 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:03:28.684 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.685 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:03:28.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.687 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.687 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.687 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:28.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.687 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.687 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:03:28.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.687 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.688 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 5 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:03:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:03:28.690 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:03:28.690 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:03:28.690 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:03:28.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:03:28.690 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:03:28.690 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:03:28.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff348066510 msgr2=0x7ff3480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff348066510 0x7ff3480689d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff35c14dfb0 tx=0x7ff35400b040 comp rx=0 tx=0).stop 2023-11-28T21:03:28.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 msgr2=0x7ff35c14bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:03:28.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 --2- 172.21.15.167:0/334112875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c6ff0 0x7ff35c14bc20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0ac000 tx=0x7ff34c0191f0 comp rx=0 tx=0).stop 2023-11-28T21:03:28.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3610ba640 1 -- 172.21.15.167:0/334112875 reap_dead start 2023-11-28T21:03:28.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff3610ba640 1 -- 172.21.15.167:0/334112875 reap_dead start 2023-11-28T21:03:28.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 shutdown_connections 2023-11-28T21:03:28.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 >> 172.21.15.167:0/334112875 conn(0x7ff35c0cb1e0 msgr2=0x7ff35c0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:03:28.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 shutdown_connections 2023-11-28T21:03:28.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:03:28.667+0000 7ff362b1d640 1 -- 172.21.15.167:0/334112875 wait complete. 2023-11-28T21:03:28.694 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:03:28.695 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T21:03:28.897 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~256s 2023-11-28T21:03:35.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~262s 2023-11-28T21:03:42.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~269s 2023-11-28T21:03:48.696 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2023-11-28T21:03:48.696 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2023-11-28T21:03:48.696 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T21:03:48.697 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T21:03:48.701 INFO:tasks.ceph.mon.a:Started 2023-11-28T21:03:48.701 INFO:tasks.mon_thrash:Sending STOP to mon c 2023-11-28T21:03:48.701 INFO:tasks.ceph.mon.c:Sent signal 19 2023-11-28T21:03:48.702 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2023-11-28T21:03:49.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~276s 2023-11-28T21:03:52.759 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:53.727 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:55.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~282s 2023-11-28T21:04:02.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~289s 2023-11-28T21:04:03.703 INFO:tasks.mon_thrash:Sending CONT to mon c 2023-11-28T21:04:03.703 INFO:tasks.ceph.mon.c:Sent signal 18 2023-11-28T21:04:03.703 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:04:03.704 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:04:03.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.850+0000 7f998759e640 1 Processor -- start 2023-11-28T21:04:03.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.850+0000 7f998759e640 1 -- start start 2023-11-28T21:04:03.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f998759e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 0x7f998806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:03.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f998759e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f998815a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:03.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f998759e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998806af30 con 0x7f9988150b20 2023-11-28T21:04:03.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f998759e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9988072840 con 0x7f99880c2750 2023-11-28T21:04:03.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f998759e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9988071cc0 con 0x7f998806aac0 2023-11-28T21:04:03.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f997ffff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 0x7f998806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:03.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f998659c640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9988150b20 0x7f9988070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:35014/0 (socket says 172.21.15.167:35014) 2023-11-28T21:04:03.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f998659c640 1 -- 172.21.15.167:0/1612887373 learned_addr learned my addr 172.21.15.167:0/1612887373 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:03.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f9986d9d640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f998815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:03.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f997ffff640 1 -- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 msgr2=0x7f998806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:04:03.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f997ffff640 1 -- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 msgr2=0x7f998806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:04:03.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f997ffff640 1 --2- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 0x7f998806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:04:03.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f997ffff640 1 --2- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 0x7f998806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:03.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f9986d9d640 1 -- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 msgr2=0x7f998815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:04:03.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f9986d9d640 1 -- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 msgr2=0x7f998815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:04:03.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f9986d9d640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f998815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:04:03.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:03.854+0000 7f9986d9d640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f998815a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:04.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f9986d9d640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f998815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f997ffff640 1 --2- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 0x7f998806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f9986d9d640 1 -- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 msgr2=0x7f998815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:04:04.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f9986d9d640 1 -- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 msgr2=0x7f998815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:04:04.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f9986d9d640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f998815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:04:04.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f9986d9d640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f998815a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:04:04.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f997ffff640 1 -- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 msgr2=0x7f998806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:04:04.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f997ffff640 1 -- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 msgr2=0x7f998806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:04:04.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f997ffff640 1 --2- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 0x7f998806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:04:04.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.058+0000 7f997ffff640 1 --2- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 0x7f998806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:04:04.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.142+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894309246 0 0) 0x7f998806af30 con 0x7f9988150b20 2023-11-28T21:04:04.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.142+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9974003530 con 0x7f9988150b20 2023-11-28T21:04:04.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.150+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3410490010 0 0) 0x7f9974003530 con 0x7f9988150b20 2023-11-28T21:04:04.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.150+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 msgr2=0x7f998815a290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:04.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.150+0000 7f9985d9b640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f998815a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.150+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 msgr2=0x7f998806a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:04.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.150+0000 7f9985d9b640 1 --2- 172.21.15.167:0/1612887373 >> v2:172.21.15.178:3300/0 conn(0x7f99880c2750 0x7f998806a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.150+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9988071fa0 con 0x7f9988150b20 2023-11-28T21:04:04.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.150+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9978001680 con 0x7f9988150b20 2023-11-28T21:04:04.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 >> v1:172.21.15.178:6789/0 conn(0x7f9988150b20 legacy=0x7f9988070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9974003980 0x7f9974003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99740047d0 0x7f9974004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f9974005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9988072840 con 0x7f9974003980 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9988071cc0 con 0x7f99740047d0 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997400bb20 con 0x7f998806aac0 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f998659c640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9974003980 0x7f9974003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f997ffff640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99740047d0 0x7f9974004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9986d9d640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f9974005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f998659c640 1 -- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 msgr2=0x7f9974005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:04.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f998659c640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f998806aac0 0x7f9974005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f998659c640 1 -- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99740047d0 msgr2=0x7f9974004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:04.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f998659c640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99740047d0 0x7f9974004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f998659c640 1 -- 172.21.15.167:0/1612887373 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974003530 con 0x7f9974003980 2023-11-28T21:04:04.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f998659c640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9974003980 0x7f9974003da0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9978001060 tx=0x7f997801f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168df77eaaafe080 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99780a8cb0 con 0x7f9974003980 2023-11-28T21:04:04.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99780a8e10 con 0x7f9974003980 2023-11-28T21:04:04.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.154+0000 7f9985d9b640 1 -- 172.21.15.167:0/1612887373 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978005b20 con 0x7f9974003980 2023-11-28T21:04:04.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 -- 172.21.15.167:0/1612887373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9974003980 msgr2=0x7f9974003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 --2- 172.21.15.167:0/1612887373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9974003980 0x7f9974003da0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9978001060 tx=0x7f997801f290 comp rx=0 tx=0).stop 2023-11-28T21:04:04.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f9986d9d640 1 -- 172.21.15.167:0/1612887373 reap_dead start 2023-11-28T21:04:04.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 -- 172.21.15.167:0/1612887373 shutdown_connections 2023-11-28T21:04:04.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 -- 172.21.15.167:0/1612887373 >> 172.21.15.167:0/1612887373 conn(0x7f99880cb1e0 msgr2=0x7f99880cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:04.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 -- 172.21.15.167:0/1612887373 shutdown_connections 2023-11-28T21:04:04.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 -- 172.21.15.167:0/1612887373 wait complete. 2023-11-28T21:04:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 Processor -- start 2023-11-28T21:04:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 -- start start 2023-11-28T21:04:04.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9974003980 0x7f9988158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99881597b0 0x7f998814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998814bab0 0x7f998814bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99881ef790 con 0x7f99881597b0 2023-11-28T21:04:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9988158ad0 con 0x7f998814bab0 2023-11-28T21:04:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f998759e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9988151920 con 0x7f9974003980 2023-11-28T21:04:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.158+0000 7f997ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99881597b0 0x7f998814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99881597b0 0x7f998814f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57744/0 (socket says 172.21.15.167:57744) 2023-11-28T21:04:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997ffff640 1 -- 172.21.15.167:0/1730626807 learned_addr learned my addr 172.21.15.167:0/1730626807 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f9986d9d640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998814bab0 0x7f998814bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f998659c640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9974003980 0x7f9988158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997ffff640 1 -- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9974003980 msgr2=0x7f9988158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997ffff640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9974003980 0x7f9988158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997ffff640 1 -- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998814bab0 msgr2=0x7f998814bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997ffff640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998814bab0 0x7f998814bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997ffff640 1 -- 172.21.15.167:0/1730626807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99881ee8c0 con 0x7f99881597b0 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f998659c640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9974003980 0x7f9988158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997ffff640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99881597b0 0x7f998814f6e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9970012840 tx=0x7f9970012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997effd640 1 -- 172.21.15.167:0/1730626807 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000ec40 con 0x7f99881597b0 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997effd640 1 -- 172.21.15.167:0/1730626807 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997000c040 con 0x7f99881597b0 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998814c470 con 0x7f99881597b0 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997effd640 1 -- 172.21.15.167:0/1730626807 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997001b440 con 0x7f99881597b0 2023-11-28T21:04:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99881eedf0 con 0x7f99881597b0 2023-11-28T21:04:04.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998814b8b0 con 0x7f99881597b0 2023-11-28T21:04:04.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997effd640 1 -- 172.21.15.167:0/1730626807 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99700243f0 con 0x7f99881597b0 2023-11-28T21:04:04.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997effd640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f99680664a0 0x7f9968068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.162+0000 7f997effd640 1 -- 172.21.15.167:0/1730626807 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9970084490 con 0x7f99881597b0 2023-11-28T21:04:04.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.166+0000 7f998659c640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f99680664a0 0x7f9968068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.166+0000 7f998659c640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f99680664a0 0x7f9968068960 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f99740057b0 tx=0x7f9978001940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.170+0000 7f997effd640 1 -- 172.21.15.167:0/1730626807 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9970051520 con 0x7f99881597b0 2023-11-28T21:04:04.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f998804e850 con 0x7f99881597b0 2023-11-28T21:04:04.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f997effd640 1 -- 172.21.15.167:0/1730626807 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7f9970054b40 con 0x7f99881597b0 2023-11-28T21:04:04.374 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":196,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f99680664a0 msgr2=0x7f9968068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f99680664a0 0x7f9968068960 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f99740057b0 tx=0x7f9978001940 comp rx=0 tx=0).stop 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99881597b0 msgr2=0x7f998814f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99881597b0 0x7f998814f6e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9970012840 tx=0x7f9970012d00 comp rx=0 tx=0).stop 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 shutdown_connections 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f99680664a0 0x7f9968068960 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998814bab0 0x7f998814bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99881597b0 0x7f998814f6e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 --2- 172.21.15.167:0/1730626807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9974003980 0x7f9988158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 >> 172.21.15.167:0/1730626807 conn(0x7f99880cb1e0 msgr2=0x7f9988146ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:04.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 shutdown_connections 2023-11-28T21:04:04.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.374+0000 7f998759e640 1 -- 172.21.15.167:0/1730626807 wait complete. 2023-11-28T21:04:04.395 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:04:04.396 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T21:04:04.396 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:04:04.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.534+0000 7f13e57f5640 1 Processor -- start 2023-11-28T21:04:04.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.534+0000 7f13e57f5640 1 -- start start 2023-11-28T21:04:04.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13e57f5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f13e00c75c0 0x7f13e00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13e57f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e00c7a50 con 0x7f13e006a580 2023-11-28T21:04:04.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13e57f5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e015b220 con 0x7f13e0151f60 2023-11-28T21:04:04.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13e57f5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e00c4da0 con 0x7f13e00c75c0 2023-11-28T21:04:04.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13de7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f13e00c75c0 0x7f13e00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13de7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f13e00c75c0 0x7f13e00c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57758/0 (socket says 172.21.15.167:57758) 2023-11-28T21:04:04.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13de7fc640 1 -- 172.21.15.167:0/4238684911 learned_addr learned my addr 172.21.15.167:0/4238684911 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:04.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13df7fe640 1 --1- 172.21.15.167:0/4238684911 >> v1:172.21.15.167:6789/0 conn(0x7f13e006a580 0x7f13e01625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47004/0 (socket says 172.21.15.167:47004) 2023-11-28T21:04:04.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13de7fc640 1 -- 172.21.15.167:0/4238684911 >> v1:172.21.15.178:6789/0 conn(0x7f13e0151f60 legacy=0x7f13e00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13de7fc640 1 -- 172.21.15.167:0/4238684911 >> v1:172.21.15.167:6789/0 conn(0x7f13e006a580 legacy=0x7f13e01625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13de7fc640 1 -- 172.21.15.167:0/4238684911 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e0152340 con 0x7f13e00c75c0 2023-11-28T21:04:04.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.538+0000 7f13ddffb640 1 -- 172.21.15.167:0/4238684911 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648740063 0 0) 0x7f13d80014a0 con 0x7f13e006a580 2023-11-28T21:04:04.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13de7fc640 1 --2- 172.21.15.167:0/4238684911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00c75c0 0x7f13e00c5c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009870 tx=0x7f13d401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9455b57abcd8cbc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13ddffb640 1 -- 172.21.15.167:0/4238684911 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40ab600 con 0x7f13e00c75c0 2023-11-28T21:04:04.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13ddffb640 1 -- 172.21.15.167:0/4238684911 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d40a7050 con 0x7f13e00c75c0 2023-11-28T21:04:04.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13ddffb640 1 -- 172.21.15.167:0/4238684911 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40ab980 con 0x7f13e00c75c0 2023-11-28T21:04:04.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13e57f5640 1 -- 172.21.15.167:0/4238684911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00c75c0 msgr2=0x7f13e00c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13e57f5640 1 --2- 172.21.15.167:0/4238684911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00c75c0 0x7f13e00c5c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009870 tx=0x7f13d401c4b0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13e57f5640 1 -- 172.21.15.167:0/4238684911 shutdown_connections 2023-11-28T21:04:04.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13e57f5640 1 --2- 172.21.15.167:0/4238684911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00c75c0 0x7f13e00c5c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13e57f5640 1 -- 172.21.15.167:0/4238684911 >> 172.21.15.167:0/4238684911 conn(0x7f13e00cb1e0 msgr2=0x7f13e00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:04.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13e57f5640 1 -- 172.21.15.167:0/4238684911 shutdown_connections 2023-11-28T21:04:04.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13e57f5640 1 -- 172.21.15.167:0/4238684911 wait complete. 2023-11-28T21:04:04.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13e57f5640 1 Processor -- start 2023-11-28T21:04:04.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.542+0000 7f13e57f5640 1 -- start start 2023-11-28T21:04:04.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e006a580 0x7f13e014dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c75c0 0x7f13e00c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e0151f60 0x7f13e014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e014c0a0 con 0x7f13e006a580 2023-11-28T21:04:04.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e014e380 con 0x7f13e0151f60 2023-11-28T21:04:04.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0071dd0 con 0x7f13e00c75c0 2023-11-28T21:04:04.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13deffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e006a580 0x7f13e014dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13deffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e006a580 0x7f13e014dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57770/0 (socket says 172.21.15.167:57770) 2023-11-28T21:04:04.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13deffd640 1 -- 172.21.15.167:0/68673234 learned_addr learned my addr 172.21.15.167:0/68673234 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:04.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13df7fe640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e0151f60 0x7f13e014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13de7fc640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c75c0 0x7f13e00c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13deffd640 1 -- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c75c0 msgr2=0x7f13e00c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13deffd640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e00c75c0 0x7f13e00c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13deffd640 1 -- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e0151f60 msgr2=0x7f13e014d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13deffd640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e0151f60 0x7f13e014d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13deffd640 1 -- 172.21.15.167:0/68673234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d40094d0 con 0x7f13e006a580 2023-11-28T21:04:04.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13df7fe640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e0151f60 0x7f13e014d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:04:04.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13deffd640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e006a580 0x7f13e014dd80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c500 tx=0x7f13d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0005220 con 0x7f13e006a580 2023-11-28T21:04:04.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d0005380 con 0x7f13e006a580 2023-11-28T21:04:04.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e00720b0 con 0x7f13e006a580 2023-11-28T21:04:04.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0007270 con 0x7f13e006a580 2023-11-28T21:04:04.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e014c2a0 con 0x7f13e006a580 2023-11-28T21:04:04.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e014d730 0x7f13e00ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0155410 con 0x7f13e014d730 2023-11-28T21:04:04.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13de7fc640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e014d730 0x7f13e00ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13de7fc640 1 -- 172.21.15.167:0/68673234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13e006ada0 con 0x7f13e014d730 2023-11-28T21:04:04.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13de7fc640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e014d730 0x7f13e00ca350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f13e00c5580 tx=0x7f13d401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.546+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13d00073d0 con 0x7f13e006a580 2023-11-28T21:04:04.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13c77fe640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13cc066470 0x7f13cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f13d0083bb0 con 0x7f13e006a580 2023-11-28T21:04:04.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13df7fe640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13cc066470 0x7f13cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40b7450 con 0x7f13e014d730 2023-11-28T21:04:04.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f13d40b75b0 con 0x7f13e014d730 2023-11-28T21:04:04.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e014d730 msgr2=0x7f13e00ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13c77fe640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e014d730 0x7f13e00ca350 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f13e00c5580 tx=0x7f13d401acf0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e014d730 msgr2=0x7f13e00ca350 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:04.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13c77fe640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e014d730 0x7f13e00ca350 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.550+0000 7f13df7fe640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13cc066470 0x7f13cc068930 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007fd0 tx=0x7f13d8005b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.554+0000 7f13e57f5640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00ca890 0x7f13e01fe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.554+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0074770 con 0x7f13e00ca890 2023-11-28T21:04:04.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.554+0000 7f13de7fc640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00ca890 0x7f13e01fe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.554+0000 7f13de7fc640 1 -- 172.21.15.167:0/68673234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f13e015ba30 con 0x7f13e00ca890 2023-11-28T21:04:04.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.554+0000 7f13de7fc640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00ca890 0x7f13e01fe2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f13d40190c0 tx=0x7f13d4019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.554+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40b7d60 con 0x7f13e00ca890 2023-11-28T21:04:04.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4472 (secure 0 0 0) 0x7f13d4003620 con 0x7f13e00ca890 2023-11-28T21:04:04.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00ca890 msgr2=0x7f13e01fe2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13c77fe640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00ca890 0x7f13e01fe2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f13d40190c0 tx=0x7f13d4019250 comp rx=0 tx=0).stop 2023-11-28T21:04:04.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13c77fe640 1 -- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00ca890 msgr2=0x7f13e01fe2f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:04.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13c77fe640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e00ca890 0x7f13e01fe2f0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f13d40190c0 tx=0x7f13d4019250 comp rx=0 tx=0).stop 2023-11-28T21:04:04.558 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:04:04.558 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:04.558 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:04.558 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:04:04.558 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 196, 2023-11-28T21:04:04.558 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:04:04.558 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:04.559 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:04.560 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:04:04.561 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:04:04.562 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:04.563 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:04.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.565 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:04.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.567 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:04.568 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:04:04.569 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:04.570 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:04:04.571 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:04:04.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13cc066470 msgr2=0x7f13cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13e57f5640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f13cc066470 0x7f13cc068930 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007fd0 tx=0x7f13d8005b80 comp rx=0 tx=0).stop 2023-11-28T21:04:04.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e006a580 msgr2=0x7f13e014dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13e57f5640 1 --2- 172.21.15.167:0/68673234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e006a580 0x7f13e014dd80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c500 tx=0x7f13d000c9c0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13df7fe640 1 -- 172.21.15.167:0/68673234 reap_dead start 2023-11-28T21:04:04.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13df7fe640 1 -- 172.21.15.167:0/68673234 reap_dead start 2023-11-28T21:04:04.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 shutdown_connections 2023-11-28T21:04:04.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 >> 172.21.15.167:0/68673234 conn(0x7f13e00cb1e0 msgr2=0x7f13e00cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:04.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 shutdown_connections 2023-11-28T21:04:04.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.558+0000 7f13e57f5640 1 -- 172.21.15.167:0/68673234 wait complete. 2023-11-28T21:04:04.575 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:04:04.575 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T21:04:04.576 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:04:04.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc63f8640 1 Processor -- start 2023-11-28T21:04:04.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc63f8640 1 -- start start 2023-11-28T21:04:04.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc63f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbdc014e260 0x7fbdc01582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc63f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc00c24b0 0x7fbdc00c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc63f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc006f100 con 0x7fbdc00c2c50 2023-11-28T21:04:04.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc63f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc00c3970 con 0x7fbdc014e260 2023-11-28T21:04:04.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc63f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc006e810 con 0x7fbdc00c24b0 2023-11-28T21:04:04.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc5bf7640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbdc00c2c50 0x7fbdc015ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:47016/0 (socket says 172.21.15.167:47016) 2023-11-28T21:04:04.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc5bf7640 1 -- 172.21.15.167:0/2384075632 learned_addr learned my addr 172.21.15.167:0/2384075632 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:04.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc53f6640 1 --2- 172.21.15.167:0/2384075632 >> v2:172.21.15.178:3300/0 conn(0x7fbdc014e260 0x7fbdc01582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdc4bf5640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc00c24b0 0x7fbdc00c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205466731 0 0) 0x7fbdc006f100 con 0x7fbdc00c2c50 2023-11-28T21:04:04.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdac003530 con 0x7fbdc00c2c50 2023-11-28T21:04:04.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2092600581 0 0) 0x7fbdac003530 con 0x7fbdc00c2c50 2023-11-28T21:04:04.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc00c24b0 msgr2=0x7fbdc00c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:04.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc00c24b0 0x7fbdc00c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 >> v2:172.21.15.178:3300/0 conn(0x7fbdc014e260 msgr2=0x7fbdc01582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:04.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 --2- 172.21.15.167:0/2384075632 >> v2:172.21.15.178:3300/0 conn(0x7fbdc014e260 0x7fbdc01582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc00c8010 con 0x7fbdc00c2c50 2023-11-28T21:04:04.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fbdb8001a00 con 0x7fbdc00c2c50 2023-11-28T21:04:04.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 >> v1:172.21.15.167:6789/0 conn(0x7fbdc00c2c50 legacy=0x7fbdc015ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 0x7fbdac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc00c24b0 0x7fbdac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac004d10 0x7fbdac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00c3970 con 0x7fbdac003980 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc006e810 con 0x7fbdac004d10 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.714+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac00b9c0 con 0x7fbdc00c24b0 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdc53f6640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 0x7fbdac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdc4bf5640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc00c24b0 0x7fbdac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdc5bf7640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac004d10 0x7fbdac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdc53f6640 1 -- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc00c24b0 msgr2=0x7fbdac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdc53f6640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc00c24b0 0x7fbdac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdc53f6640 1 -- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac004d10 msgr2=0x7fbdac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:04.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdc53f6640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac004d10 0x7fbdac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdc53f6640 1 -- 172.21.15.167:0/2384075632 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac003530 con 0x7fbdac003980 2023-11-28T21:04:04.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdc53f6640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 0x7fbdac003da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009ae0 tx=0x7fbdbc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b29707e0e8c6287 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0a5680 con 0x7fbdac003980 2023-11-28T21:04:04.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc0a57e0 con 0x7fbdac003980 2023-11-28T21:04:04.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.718+0000 7fbdb7fff640 1 -- 172.21.15.167:0/2384075632 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0a5b90 con 0x7fbdac003980 2023-11-28T21:04:04.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 -- 172.21.15.167:0/2384075632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 msgr2=0x7fbdac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 --2- 172.21.15.167:0/2384075632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 0x7fbdac003da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009ae0 tx=0x7fbdbc01ca90 comp rx=0 tx=0).stop 2023-11-28T21:04:04.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc5bf7640 1 -- 172.21.15.167:0/2384075632 reap_dead start 2023-11-28T21:04:04.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 -- 172.21.15.167:0/2384075632 shutdown_connections 2023-11-28T21:04:04.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 -- 172.21.15.167:0/2384075632 >> 172.21.15.167:0/2384075632 conn(0x7fbdc00701a0 msgr2=0x7fbdc00705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:04.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 -- 172.21.15.167:0/2384075632 shutdown_connections 2023-11-28T21:04:04.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 -- 172.21.15.167:0/2384075632 wait complete. 2023-11-28T21:04:04.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 Processor -- start 2023-11-28T21:04:04.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 -- start start 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 0x7fbdc0158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00afcd0 0x7fbdc014a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc014a660 0x7fbdc0147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00cd2a0 con 0x7fbdac003980 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0149e60 con 0x7fbdc00afcd0 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc63f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc015a150 con 0x7fbdc014a660 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc53f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 0x7fbdc0158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc53f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 0x7fbdc0158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57784/0 (socket says 172.21.15.167:57784) 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc53f6640 1 -- 172.21.15.167:0/3218292549 learned_addr learned my addr 172.21.15.167:0/3218292549 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc4bf5640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00afcd0 0x7fbdc014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc5bf7640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc014a660 0x7fbdc0147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc53f6640 1 -- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc014a660 msgr2=0x7fbdc0147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc53f6640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc014a660 0x7fbdc0147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc53f6640 1 -- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00afcd0 msgr2=0x7fbdc014a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc53f6640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00afcd0 0x7fbdc014a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc53f6640 1 -- 172.21.15.167:0/3218292549 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc00cd4b0 con 0x7fbdac003980 2023-11-28T21:04:04.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.722+0000 7fbdc5bf7640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdc014a660 0x7fbdc0147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:04:04.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdc53f6640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 0x7fbdc0158710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0b0040 tx=0x7fbdac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc004220 con 0x7fbdac003980 2023-11-28T21:04:04.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc004380 con 0x7fbdac003980 2023-11-28T21:04:04.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0ad890 con 0x7fbdac003980 2023-11-28T21:04:04.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc00cd790 con 0x7fbdac003980 2023-11-28T21:04:04.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc00cdd50 con 0x7fbdac003980 2023-11-28T21:04:04.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdc63f8640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00cdf40 0x7fbdc0148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc006b0c0 con 0x7fbdc00cdf40 2023-11-28T21:04:04.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdc4bf5640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00cdf40 0x7fbdc0148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbdbc0b4040 con 0x7fbdac003980 2023-11-28T21:04:04.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdc4bf5640 1 -- 172.21.15.167:0/3218292549 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdc00c82f0 con 0x7fbdc00cdf40 2023-11-28T21:04:04.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdc4bf5640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00cdf40 0x7fbdc0148100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009fd0 tx=0x7fbdb0014d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdb5ffb640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbda4066470 0x7fbda4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fbdbc11e210 con 0x7fbdac003980 2023-11-28T21:04:04.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0012bf0 con 0x7fbdc00cdf40 2023-11-28T21:04:04.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdc5bf7640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbda4066470 0x7fbda4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.726+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fbdb0012d50 con 0x7fbdc00cdf40 2023-11-28T21:04:04.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.730+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00cdf40 msgr2=0x7fbdc0148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.730+0000 7fbdb5ffb640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00cdf40 0x7fbdc0148100 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009fd0 tx=0x7fbdb0014d80 comp rx=0 tx=0).stop 2023-11-28T21:04:04.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.730+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00cdf40 msgr2=0x7fbdc0148100 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:04.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.730+0000 7fbdb5ffb640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00cdf40 0x7fbdc0148100 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.730+0000 7fbdc5bf7640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbda4066470 0x7fbda4068930 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00682e0 tx=0x7fbdb8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.734+0000 7fbdc63f8640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00b00b0 0x7fbdc0146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.734+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc006ed90 con 0x7fbdc00b00b0 2023-11-28T21:04:04.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.734+0000 7fbdc4bf5640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00b00b0 0x7fbdc0146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.734+0000 7fbdc4bf5640 1 -- 172.21.15.167:0/3218292549 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbdc014e640 con 0x7fbdc00b00b0 2023-11-28T21:04:04.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.734+0000 7fbdc4bf5640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00b00b0 0x7fbdc0146b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009fd0 tx=0x7fbdb0004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.734+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0025320 con 0x7fbdc00b00b0 2023-11-28T21:04:04.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5123 (secure 0 0 0) 0x7fbdb002f440 con 0x7fbdc00b00b0 2023-11-28T21:04:04.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00b00b0 msgr2=0x7fbdc0146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdb5ffb640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00b00b0 0x7fbdc0146b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009fd0 tx=0x7fbdb0004740 comp rx=0 tx=0).stop 2023-11-28T21:04:04.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdb5ffb640 1 -- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00b00b0 msgr2=0x7fbdc0146b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:04.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdb5ffb640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdc00b00b0 0x7fbdc0146b60 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009fd0 tx=0x7fbdb0004740 comp rx=0 tx=0).stop 2023-11-28T21:04:04.738 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:04:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:04:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 196, 2023-11-28T21:04:04.738 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:04.739 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:04.740 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:04:04.741 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:04:04.742 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:04.743 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:04.744 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:04:04.745 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:04.746 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:04.747 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:04.749 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:04:04.750 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.751 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.752 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:04:04.753 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.753 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.753 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.753 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:04.753 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.753 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.753 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:04:04.753 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:04:04.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbda4066470 msgr2=0x7fbda4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc63f8640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbda4066470 0x7fbda4068930 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00682e0 tx=0x7fbdb8009040 comp rx=0 tx=0).stop 2023-11-28T21:04:04.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 msgr2=0x7fbdc0158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc63f8640 1 --2- 172.21.15.167:0/3218292549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdac003980 0x7fbdc0158710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0b0040 tx=0x7fbdac005800 comp rx=0 tx=0).stop 2023-11-28T21:04:04.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc5bf7640 1 -- 172.21.15.167:0/3218292549 reap_dead start 2023-11-28T21:04:04.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc5bf7640 1 -- 172.21.15.167:0/3218292549 reap_dead start 2023-11-28T21:04:04.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 shutdown_connections 2023-11-28T21:04:04.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 >> 172.21.15.167:0/3218292549 conn(0x7fbdc00701a0 msgr2=0x7fbdc006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:04.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 shutdown_connections 2023-11-28T21:04:04.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.738+0000 7fbdc63f8640 1 -- 172.21.15.167:0/3218292549 wait complete. 2023-11-28T21:04:04.756 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:04:04.756 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T21:04:04.756 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:04:04.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6ba5f8640 1 Processor -- start 2023-11-28T21:04:04.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6ba5f8640 1 -- start start 2023-11-28T21:04:04.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6ba5f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb6b40c75c0 0x7fb6b40c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6ba5f8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb6b406a580 0x7fb6b406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6ba5f8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b40c7a50 con 0x7fb6b4151f60 2023-11-28T21:04:04.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6ba5f8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b406aed0 con 0x7fb6b406a580 2023-11-28T21:04:04.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6ba5f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b40c4da0 con 0x7fb6b40c75c0 2023-11-28T21:04:04.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6b8b95640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb6b406a580 0x7fb6b406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6b8b95640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb6b406a580 0x7fb6b406a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57798/0 (socket says 172.21.15.167:57798) 2023-11-28T21:04:04.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6b8b95640 1 -- 172.21.15.167:0/2362459706 learned_addr learned my addr 172.21.15.167:0/2362459706 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:04.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6b37fe640 1 --2- 172.21.15.167:0/2362459706 >> v2:172.21.15.178:3300/0 conn(0x7fb6b40c75c0 0x7fb6b40c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6b8b95640 1 -- 172.21.15.167:0/2362459706 >> v2:172.21.15.178:3300/0 conn(0x7fb6b40c75c0 msgr2=0x7fb6b40c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:04.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6b8b95640 1 --2- 172.21.15.167:0/2362459706 >> v2:172.21.15.178:3300/0 conn(0x7fb6b40c75c0 0x7fb6b40c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6b8b95640 1 -- 172.21.15.167:0/2362459706 >> v1:172.21.15.178:6789/0 conn(0x7fb6b4151f60 legacy=0x7fb6b40c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.894+0000 7fb6b8b95640 1 -- 172.21.15.167:0/2362459706 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b415b220 con 0x7fb6b406a580 2023-11-28T21:04:04.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6b8b95640 1 --2- 172.21.15.167:0/2362459706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b406a580 0x7fb6b406a990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40c8d80 tx=0x7fb6ac01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fdcadf242d6cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6b2ffd640 1 -- 172.21.15.167:0/2362459706 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0a5600 con 0x7fb6b406a580 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6b2ffd640 1 -- 172.21.15.167:0/2362459706 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac0a5760 con 0x7fb6b406a580 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6b2ffd640 1 -- 172.21.15.167:0/2362459706 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0a5af0 con 0x7fb6b406a580 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/2362459706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b406a580 msgr2=0x7fb6b406a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6ba5f8640 1 --2- 172.21.15.167:0/2362459706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b406a580 0x7fb6b406a990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40c8d80 tx=0x7fb6ac01c940 comp rx=0 tx=0).stop 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/2362459706 shutdown_connections 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6ba5f8640 1 --2- 172.21.15.167:0/2362459706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b406a580 0x7fb6b406a990 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6ba5f8640 1 --2- 172.21.15.167:0/2362459706 >> v2:172.21.15.178:3300/0 conn(0x7fb6b40c75c0 0x7fb6b40c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/2362459706 >> 172.21.15.167:0/2362459706 conn(0x7fb6b40cb1e0 msgr2=0x7fb6b40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/2362459706 shutdown_connections 2023-11-28T21:04:04.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.898+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/2362459706 wait complete. 2023-11-28T21:04:04.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 Processor -- start 2023-11-28T21:04:04.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 -- start start 2023-11-28T21:04:04.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b406a580 0x7fb6b41f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b40c75c0 0x7fb6b414d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6b4151f60 0x7fb6b414d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b41f5f10 con 0x7fb6b40c75c0 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b414f3c0 con 0x7fb6b4151f60 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b41420f0 con 0x7fb6b406a580 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b40c75c0 0x7fb6b414d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b40c75c0 0x7fb6b414d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57802/0 (socket says 172.21.15.167:57802) 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b37fe640 1 -- 172.21.15.167:0/3846747816 learned_addr learned my addr 172.21.15.167:0/3846747816 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b8b95640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6b4151f60 0x7fb6b414d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b3fff640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b406a580 0x7fb6b41f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b37fe640 1 -- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b406a580 msgr2=0x7fb6b41f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b37fe640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b406a580 0x7fb6b41f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b37fe640 1 -- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6b4151f60 msgr2=0x7fb6b414d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b37fe640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6b4151f60 0x7fb6b414d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:04.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b37fe640 1 -- 172.21.15.167:0/3846747816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac009b30 con 0x7fb6b40c75c0 2023-11-28T21:04:04.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b37fe640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b40c75c0 0x7fb6b414d390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800e990 tx=0x7fb6a800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8009690 con 0x7fb6b40c75c0 2023-11-28T21:04:04.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a800c980 con 0x7fb6b40c75c0 2023-11-28T21:04:04.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b40c3af0 con 0x7fb6b40c75c0 2023-11-28T21:04:04.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a800ccf0 con 0x7fb6b40c75c0 2023-11-28T21:04:04.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.902+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b40c3830 con 0x7fb6b40c75c0 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6ba5f8640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41605d0 0x7fb6b4070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b4074770 con 0x7fb6b41605d0 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b3fff640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41605d0 0x7fb6b4070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b3fff640 1 -- 172.21.15.167:0/3846747816 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6b415ba30 con 0x7fb6b41605d0 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6a8013470 con 0x7fb6b40c75c0 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b3fff640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41605d0 0x7fb6b4070fc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400e4d0 tx=0x7fb6a400e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b0ff9640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6a00664a0 0x7fb6a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb6a8084840 con 0x7fb6b40c75c0 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40052e0 con 0x7fb6b41605d0 2023-11-28T21:04:04.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b8b95640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6a00664a0 0x7fb6a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fb6a4005440 con 0x7fb6b41605d0 2023-11-28T21:04:04.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41605d0 msgr2=0x7fb6b4070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b0ff9640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41605d0 0x7fb6b4070fc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400e4d0 tx=0x7fb6a400e990 comp rx=0 tx=0).stop 2023-11-28T21:04:04.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41605d0 msgr2=0x7fb6b4070fc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:04.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b0ff9640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41605d0 0x7fb6b4070fc0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400e4d0 tx=0x7fb6a400e990 comp rx=0 tx=0).stop 2023-11-28T21:04:04.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.906+0000 7fb6b8b95640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6a00664a0 0x7fb6a0068960 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0ae000 tx=0x7fb6ac0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6ba5f8640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41f2490 0x7fb6b4141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:04.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b4158750 con 0x7fb6b41f2490 2023-11-28T21:04:04.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b3fff640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41f2490 0x7fb6b4141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:04.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b3fff640 1 -- 172.21.15.167:0/3846747816 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb6b415bf50 con 0x7fb6b41f2490 2023-11-28T21:04:04.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b3fff640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41f2490 0x7fb6b4141530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400e4d0 tx=0x7fb6a4001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:04.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4021070 con 0x7fb6b41f2490 2023-11-28T21:04:04.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4980 (secure 0 0 0) 0x7fb6a40069f0 con 0x7fb6b41f2490 2023-11-28T21:04:04.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41f2490 msgr2=0x7fb6b4141530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b0ff9640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41f2490 0x7fb6b4141530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400e4d0 tx=0x7fb6a4001130 comp rx=0 tx=0).stop 2023-11-28T21:04:04.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b0ff9640 1 -- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41f2490 msgr2=0x7fb6b4141530 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:04.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b0ff9640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6b41f2490 0x7fb6b4141530 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400e4d0 tx=0x7fb6a4001130 comp rx=0 tx=0).stop 2023-11-28T21:04:04.917 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:04:04.917 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:04.917 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:04.917 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:04:04.917 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 196, 2023-11-28T21:04:04.917 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:04:04.917 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:04:04.917 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:04:04.917 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:04.918 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:04.919 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:04:04.920 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:04:04.921 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:04.922 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:04.923 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.924 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.925 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.925 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:04:04.925 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:04:04.925 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:04.925 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:04.925 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:04.925 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.925 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:04.926 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:04.927 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:04.928 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:04:04.929 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:04:04.930 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.931 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:04:04.932 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:04:04.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6a00664a0 msgr2=0x7fb6a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6ba5f8640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb6a00664a0 0x7fb6a0068960 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0ae000 tx=0x7fb6ac0a7070 comp rx=0 tx=0).stop 2023-11-28T21:04:04.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b40c75c0 msgr2=0x7fb6b414d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:04.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6ba5f8640 1 --2- 172.21.15.167:0/3846747816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6b40c75c0 0x7fb6b414d390 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800e990 tx=0x7fb6a800ee50 comp rx=0 tx=0).stop 2023-11-28T21:04:04.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b8b95640 1 -- 172.21.15.167:0/3846747816 reap_dead start 2023-11-28T21:04:04.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6b8b95640 1 -- 172.21.15.167:0/3846747816 reap_dead start 2023-11-28T21:04:04.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 shutdown_connections 2023-11-28T21:04:04.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.914+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 >> 172.21.15.167:0/3846747816 conn(0x7fb6b40cb1e0 msgr2=0x7fb6b4073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:04.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.918+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 shutdown_connections 2023-11-28T21:04:04.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:04.918+0000 7fb6ba5f8640 1 -- 172.21.15.167:0/3846747816 wait complete. 2023-11-28T21:04:04.935 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:04:04.935 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T21:04:04.935 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T21:04:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc72f1d640 1 Processor -- start 2023-11-28T21:04:05.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc72f1d640 1 -- start start 2023-11-28T21:04:05.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc72f1d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc6c151f60 0x7fbc6c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:05.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc72f1d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc6c0c5c90 0x7fbc6c0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:05.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc72f1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c06a580 0x7fbc6c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:05.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc72f1d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c06aed0 con 0x7fbc6c151f60 2023-11-28T21:04:05.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc72f1d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c0c4da0 con 0x7fbc6c0c5c90 2023-11-28T21:04:05.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc72f1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c0c6120 con 0x7fbc6c06a580 2023-11-28T21:04:05.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc70cb9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc6c151f60 0x7fbc6c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc70cb9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc6c151f60 0x7fbc6c0c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57814/0 (socket says 172.21.15.167:57814) 2023-11-28T21:04:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc70cb9640 1 -- 172.21.15.167:0/2047726015 learned_addr learned my addr 172.21.15.167:0/2047726015 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc714ba640 1 --2- 172.21.15.167:0/2047726015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c06a580 0x7fbc6c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc6bfff640 1 --2- 172.21.15.167:0/2047726015 >> v2:172.21.15.178:3300/0 conn(0x7fbc6c0c5c90 0x7fbc6c0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc70cb9640 1 -- 172.21.15.167:0/2047726015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c06a580 msgr2=0x7fbc6c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc70cb9640 1 --2- 172.21.15.167:0/2047726015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c06a580 0x7fbc6c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc70cb9640 1 -- 172.21.15.167:0/2047726015 >> v2:172.21.15.178:3300/0 conn(0x7fbc6c0c5c90 msgr2=0x7fbc6c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc70cb9640 1 --2- 172.21.15.167:0/2047726015 >> v2:172.21.15.178:3300/0 conn(0x7fbc6c0c5c90 0x7fbc6c0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.074+0000 7fbc70cb9640 1 -- 172.21.15.167:0/2047726015 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c15b220 con 0x7fbc6c151f60 2023-11-28T21:04:05.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc70cb9640 1 --2- 172.21.15.167:0/2047726015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 0x7fbc6c0c75c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0c8d80 tx=0x7fbc6001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289d03d51659c787 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:05.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc6b7fe640 1 -- 172.21.15.167:0/2047726015 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc600ab600 con 0x7fbc6c151f60 2023-11-28T21:04:05.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc6b7fe640 1 -- 172.21.15.167:0/2047726015 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc600a7050 con 0x7fbc6c151f60 2023-11-28T21:04:05.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc6b7fe640 1 -- 172.21.15.167:0/2047726015 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc600ab980 con 0x7fbc6c151f60 2023-11-28T21:04:05.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2047726015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 msgr2=0x7fbc6c0c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:05.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2047726015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 0x7fbc6c0c75c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0c8d80 tx=0x7fbc6001c470 comp rx=0 tx=0).stop 2023-11-28T21:04:05.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2047726015 shutdown_connections 2023-11-28T21:04:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2047726015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c06a580 0x7fbc6c06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2047726015 >> v2:172.21.15.178:3300/0 conn(0x7fbc6c0c5c90 0x7fbc6c0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2047726015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 0x7fbc6c0c75c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2047726015 >> 172.21.15.167:0/2047726015 conn(0x7fbc6c0cb1e0 msgr2=0x7fbc6c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2047726015 shutdown_connections 2023-11-28T21:04:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.078+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2047726015 wait complete. 2023-11-28T21:04:05.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 Processor -- start 2023-11-28T21:04:05.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 -- start start 2023-11-28T21:04:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6c06a580 0x7fbc6c0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c0c5c90 0x7fbc6c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 0x7fbc6c147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c070e60 con 0x7fbc6c151f60 2023-11-28T21:04:05.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c071fc0 con 0x7fbc6c06a580 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c071d00 con 0x7fbc6c0c5c90 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc714ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 0x7fbc6c147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc714ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 0x7fbc6c147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57824/0 (socket says 172.21.15.167:57824) 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc714ba640 1 -- 172.21.15.167:0/2488464862 learned_addr learned my addr 172.21.15.167:0/2488464862 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc70cb9640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6c06a580 0x7fbc6c0c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc6bfff640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c0c5c90 0x7fbc6c1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc714ba640 1 -- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c0c5c90 msgr2=0x7fbc6c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc714ba640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c0c5c90 0x7fbc6c1473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc714ba640 1 -- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6c06a580 msgr2=0x7fbc6c0c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc714ba640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6c06a580 0x7fbc6c0c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc714ba640 1 -- 172.21.15.167:0/2488464862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600094d0 con 0x7fbc6c151f60 2023-11-28T21:04:05.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc714ba640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 0x7fbc6c147900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007e60 tx=0x7fbc6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc697fa640 1 -- 172.21.15.167:0/2488464862 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64014620 con 0x7fbc6c151f60 2023-11-28T21:04:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc697fa640 1 -- 172.21.15.167:0/2488464862 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6400ee90 con 0x7fbc6c151f60 2023-11-28T21:04:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc697fa640 1 -- 172.21.15.167:0/2488464862 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc640149e0 con 0x7fbc6c151f60 2023-11-28T21:04:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c15c0d0 con 0x7fbc6c151f60 2023-11-28T21:04:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c0724a0 con 0x7fbc6c151f60 2023-11-28T21:04:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.082+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6c0682c0 con 0x7fbc6c151f60 2023-11-28T21:04:05.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.086+0000 7fbc697fa640 1 -- 172.21.15.167:0/2488464862 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbc64014b40 con 0x7fbc6c151f60 2023-11-28T21:04:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.086+0000 7fbc697fa640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc50066470 0x7fbc50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.086+0000 7fbc697fa640 1 -- 172.21.15.167:0/2488464862 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fbc64084a70 con 0x7fbc6c151f60 2023-11-28T21:04:05.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.086+0000 7fbc70cb9640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc50066470 0x7fbc50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:05.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.086+0000 7fbc70cb9640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc50066470 0x7fbc50068930 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbc600ad000 tx=0x7fbc60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:05.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.090+0000 7fbc697fa640 1 -- 172.21.15.167:0/2488464862 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc64051ba0 con 0x7fbc6c151f60 2023-11-28T21:04:05.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.298+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fbc6c075c90 con 0x7fbc6c151f60 2023-11-28T21:04:05.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.298+0000 7fbc697fa640 1 -- 172.21.15.167:0/2488464862 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fbc640551c0 con 0x7fbc6c151f60 2023-11-28T21:04:05.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc50066470 msgr2=0x7fbc50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:05.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc50066470 0x7fbc50068930 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbc600ad000 tx=0x7fbc60008040 comp rx=0 tx=0).stop 2023-11-28T21:04:05.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 msgr2=0x7fbc6c147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:05.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 0x7fbc6c147900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007e60 tx=0x7fbc6400e4b0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 shutdown_connections 2023-11-28T21:04:05.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbc50066470 0x7fbc50068930 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6c151f60 0x7fbc6c147900 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc6c0c5c90 0x7fbc6c1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 --2- 172.21.15.167:0/2488464862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6c06a580 0x7fbc6c0c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:05.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 >> 172.21.15.167:0/2488464862 conn(0x7fbc6c0cb1e0 msgr2=0x7fbc6c0c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:05.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 shutdown_connections 2023-11-28T21:04:05.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:05.302+0000 7fbc72f1d640 1 -- 172.21.15.167:0/2488464862 wait complete. 2023-11-28T21:04:05.322 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T21:04:09.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~296s 2023-11-28T21:04:15.323 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:04:15.323 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:04:15.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe93befd640 1 Processor -- start 2023-11-28T21:04:15.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe93befd640 1 -- start start 2023-11-28T21:04:15.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe93befd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe934150b40 0x7fe934157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe93befd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9340c4510 0x7fe93406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe93befd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9340c48f0 con 0x7fe9340c6ff0 2023-11-28T21:04:15.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe93befd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9340c62f0 con 0x7fe934150b40 2023-11-28T21:04:15.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe93befd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9340c6ac0 con 0x7fe9340c4510 2023-11-28T21:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe939c99640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe934150b40 0x7fe934157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe939498640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe9340c6ff0 0x7fe9340c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:32836/0 (socket says 172.21.15.167:32836) 2023-11-28T21:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe939498640 1 -- 172.21.15.167:0/514023796 learned_addr learned my addr 172.21.15.167:0/514023796 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe93a49a640 1 --2- 172.21.15.167:0/514023796 >> v2:172.21.15.178:3300/0 conn(0x7fe9340c4510 0x7fe93406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe939c99640 1 -- 172.21.15.167:0/514023796 >> v2:172.21.15.178:3300/0 conn(0x7fe9340c4510 msgr2=0x7fe93406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe939c99640 1 --2- 172.21.15.167:0/514023796 >> v2:172.21.15.178:3300/0 conn(0x7fe9340c4510 0x7fe93406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe939c99640 1 -- 172.21.15.167:0/514023796 >> v1:172.21.15.167:6789/0 conn(0x7fe9340c6ff0 legacy=0x7fe9340c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe939c99640 1 -- 172.21.15.167:0/514023796 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9340c6500 con 0x7fe934150b40 2023-11-28T21:04:15.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.470+0000 7fe93a49a640 1 --2- 172.21.15.167:0/514023796 >> v2:172.21.15.178:3300/0 conn(0x7fe9340c4510 0x7fe93406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:04:15.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe939c99640 1 --2- 172.21.15.167:0/514023796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934150b40 0x7fe934157560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe9340cc270 tx=0x7fe93001eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0094f9b06915b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:15.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe938c97640 1 -- 172.21.15.167:0/514023796 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9300a79e0 con 0x7fe934150b40 2023-11-28T21:04:15.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe938c97640 1 -- 172.21.15.167:0/514023796 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9300a7b40 con 0x7fe934150b40 2023-11-28T21:04:15.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe938c97640 1 -- 172.21.15.167:0/514023796 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9300af440 con 0x7fe934150b40 2023-11-28T21:04:15.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe93befd640 1 -- 172.21.15.167:0/514023796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934150b40 msgr2=0x7fe934157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe93befd640 1 --2- 172.21.15.167:0/514023796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934150b40 0x7fe934157560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe9340cc270 tx=0x7fe93001eb00 comp rx=0 tx=0).stop 2023-11-28T21:04:15.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe93befd640 1 -- 172.21.15.167:0/514023796 shutdown_connections 2023-11-28T21:04:15.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe93befd640 1 --2- 172.21.15.167:0/514023796 >> v2:172.21.15.178:3300/0 conn(0x7fe9340c4510 0x7fe93406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe93befd640 1 --2- 172.21.15.167:0/514023796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934150b40 0x7fe934157560 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe93befd640 1 -- 172.21.15.167:0/514023796 >> 172.21.15.167:0/514023796 conn(0x7fe9340cb1e0 msgr2=0x7fe9340cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:15.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe93befd640 1 -- 172.21.15.167:0/514023796 shutdown_connections 2023-11-28T21:04:15.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.474+0000 7fe93befd640 1 -- 172.21.15.167:0/514023796 wait complete. 2023-11-28T21:04:15.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 Processor -- start 2023-11-28T21:04:15.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 -- start start 2023-11-28T21:04:15.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9340c4510 0x7fe93413f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9340c6ff0 0x7fe93413fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934150b40 0x7fe9341ee280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe934145d30 con 0x7fe9340c4510 2023-11-28T21:04:15.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9341f17f0 con 0x7fe9340c6ff0 2023-11-28T21:04:15.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9341447f0 con 0x7fe934150b40 2023-11-28T21:04:15.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939c99640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9340c4510 0x7fe93413f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939c99640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9340c4510 0x7fe93413f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49300/0 (socket says 172.21.15.167:49300) 2023-11-28T21:04:15.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939c99640 1 -- 172.21.15.167:0/937249508 learned_addr learned my addr 172.21.15.167:0/937249508 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939498640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9340c6ff0 0x7fe93413fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93a49a640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934150b40 0x7fe9341ee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939c99640 1 -- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934150b40 msgr2=0x7fe9341ee280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939c99640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934150b40 0x7fe9341ee280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939c99640 1 -- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9340c6ff0 msgr2=0x7fe93413fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939c99640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9340c6ff0 0x7fe93413fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939c99640 1 -- 172.21.15.167:0/937249508 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93000b6c0 con 0x7fe9340c4510 2023-11-28T21:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93a49a640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934150b40 0x7fe9341ee280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:04:15.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe939c99640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9340c4510 0x7fe93413f560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe9300b2040 tx=0x7fe93001b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:15.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe92a7fc640 1 -- 172.21.15.167:0/937249508 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9300b9600 con 0x7fe9340c4510 2023-11-28T21:04:15.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe92a7fc640 1 -- 172.21.15.167:0/937249508 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9300b9780 con 0x7fe9340c4510 2023-11-28T21:04:15.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe92a7fc640 1 -- 172.21.15.167:0/937249508 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9300b9b30 con 0x7fe9340c4510 2023-11-28T21:04:15.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe934144ad0 con 0x7fe9340c4510 2023-11-28T21:04:15.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.478+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9341f1ce0 con 0x7fe9340c4510 2023-11-28T21:04:15.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.482+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9340682c0 con 0x7fe9340c4510 2023-11-28T21:04:15.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.482+0000 7fe92a7fc640 1 -- 172.21.15.167:0/937249508 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe9300b9c90 con 0x7fe9340c4510 2023-11-28T21:04:15.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.482+0000 7fe92a7fc640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe918066470 0x7fe918068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.482+0000 7fe92a7fc640 1 -- 172.21.15.167:0/937249508 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe930121b40 con 0x7fe9340c4510 2023-11-28T21:04:15.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.482+0000 7fe939498640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe918066470 0x7fe918068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.482+0000 7fe939498640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe918066470 0x7fe918068930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe9341f28b0 tx=0x7fe924009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:15.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.486+0000 7fe92a7fc640 1 -- 172.21.15.167:0/937249508 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe9300eeb30 con 0x7fe9340c4510 2023-11-28T21:04:15.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe934075c90 con 0x7fe9340c4510 2023-11-28T21:04:15.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe92a7fc640 1 -- 172.21.15.167:0/937249508 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fe9300b4630 con 0x7fe9340c4510 2023-11-28T21:04:15.695 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":196,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:04:15.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe918066470 msgr2=0x7fe918068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe918066470 0x7fe918068930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe9341f28b0 tx=0x7fe924009040 comp rx=0 tx=0).stop 2023-11-28T21:04:15.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9340c4510 msgr2=0x7fe93413f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9340c4510 0x7fe93413f560 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe9300b2040 tx=0x7fe93001b8a0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 shutdown_connections 2023-11-28T21:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe918066470 0x7fe918068930 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe934150b40 0x7fe9341ee280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9340c6ff0 0x7fe93413fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 --2- 172.21.15.167:0/937249508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9340c4510 0x7fe93413f560 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 >> 172.21.15.167:0/937249508 conn(0x7fe9340cb1e0 msgr2=0x7fe9340cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 shutdown_connections 2023-11-28T21:04:15.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.694+0000 7fe93befd640 1 -- 172.21.15.167:0/937249508 wait complete. 2023-11-28T21:04:15.716 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:04:15.716 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2023-11-28T21:04:15.716 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T21:04:15.717 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:04:15.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.858+0000 7f7fd7a79640 1 Processor -- start 2023-11-28T21:04:15.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.858+0000 7f7fd7a79640 1 -- start start 2023-11-28T21:04:15.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.858+0000 7f7fd7a79640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7fd00c75c0 0x7f7fd00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.858+0000 7f7fd7a79640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7fd006a580 0x7f7fd006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd7a79640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd00c7a50 con 0x7f7fd0151f60 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd7a79640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd006aed0 con 0x7f7fd006a580 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd7a79640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd00c4da0 con 0x7f7fd00c75c0 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd6016640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7fd006a580 0x7f7fd006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd5815640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7fd0151f60 0x7f7fd00c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:32848/0 (socket says 172.21.15.167:32848) 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd5815640 1 -- 172.21.15.167:0/2245603145 learned_addr learned my addr 172.21.15.167:0/2245603145 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd5014640 1 --2- 172.21.15.167:0/2245603145 >> v2:172.21.15.178:3300/0 conn(0x7f7fd00c75c0 0x7f7fd00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd6016640 1 -- 172.21.15.167:0/2245603145 >> v2:172.21.15.178:3300/0 conn(0x7f7fd00c75c0 msgr2=0x7f7fd00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd6016640 1 --2- 172.21.15.167:0/2245603145 >> v2:172.21.15.178:3300/0 conn(0x7f7fd00c75c0 0x7f7fd00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd6016640 1 -- 172.21.15.167:0/2245603145 >> v1:172.21.15.167:6789/0 conn(0x7f7fd0151f60 legacy=0x7f7fd00c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd6016640 1 -- 172.21.15.167:0/2245603145 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd015b220 con 0x7f7fd006a580 2023-11-28T21:04:15.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd4813640 1 -- 172.21.15.167:0/2245603145 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709989307 0 0) 0x7f7fcc001120 con 0x7f7fd0151f60 2023-11-28T21:04:15.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd6016640 1 --2- 172.21.15.167:0/2245603145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 0x7f7fd006a990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00c8d80 tx=0x7f7fc801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec75b3d2954afc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:15.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd4813640 1 -- 172.21.15.167:0/2245603145 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80a5740 con 0x7f7fd006a580 2023-11-28T21:04:15.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.862+0000 7f7fd4813640 1 -- 172.21.15.167:0/2245603145 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc80a58a0 con 0x7f7fd006a580 2023-11-28T21:04:15.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd4813640 1 -- 172.21.15.167:0/2245603145 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80a5c30 con 0x7f7fd006a580 2023-11-28T21:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 -- 172.21.15.167:0/2245603145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 msgr2=0x7f7fd006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 --2- 172.21.15.167:0/2245603145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 0x7f7fd006a990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00c8d80 tx=0x7f7fc801c880 comp rx=0 tx=0).stop 2023-11-28T21:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 -- 172.21.15.167:0/2245603145 shutdown_connections 2023-11-28T21:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 --2- 172.21.15.167:0/2245603145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 0x7f7fd006a990 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 --2- 172.21.15.167:0/2245603145 >> v2:172.21.15.178:3300/0 conn(0x7f7fd00c75c0 0x7f7fd00c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 -- 172.21.15.167:0/2245603145 >> 172.21.15.167:0/2245603145 conn(0x7f7fd00cb1e0 msgr2=0x7f7fd00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 -- 172.21.15.167:0/2245603145 shutdown_connections 2023-11-28T21:04:15.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 -- 172.21.15.167:0/2245603145 wait complete. 2023-11-28T21:04:15.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 Processor -- start 2023-11-28T21:04:15.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 -- start start 2023-11-28T21:04:15.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 0x7f7fd0150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fd00c75c0 0x7f7fd01605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fd0151f60 0x7f7fd0160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00c3ea0 con 0x7f7fd006a580 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd01f6c70 con 0x7f7fd00c75c0 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd7a79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd01f6030 con 0x7f7fd0151f60 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd5815640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 0x7f7fd0150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd5815640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 0x7f7fd0150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49308/0 (socket says 172.21.15.167:49308) 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd5815640 1 -- 172.21.15.167:0/802845746 learned_addr learned my addr 172.21.15.167:0/802845746 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd6016640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fd0151f60 0x7f7fd0160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.866+0000 7f7fd5014640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fd00c75c0 0x7f7fd01605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd5815640 1 -- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fd0151f60 msgr2=0x7f7fd0160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd5815640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fd0151f60 0x7f7fd0160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd5815640 1 -- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fd00c75c0 msgr2=0x7f7fd01605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd5815640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fd00c75c0 0x7f7fd01605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd5815640 1 -- 172.21.15.167:0/802845746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8009a70 con 0x7f7fd006a580 2023-11-28T21:04:15.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd5815640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 0x7f7fd0150390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c780 tx=0x7f7fcc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:15.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0072d0 con 0x7f7fd006a580 2023-11-28T21:04:15.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc007450 con 0x7f7fd006a580 2023-11-28T21:04:15.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd01f62d0 con 0x7f7fd006a580 2023-11-28T21:04:15.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0047f0 con 0x7f7fd006a580 2023-11-28T21:04:15.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd01f6890 con 0x7f7fd006a580 2023-11-28T21:04:15.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd7a79640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0155cb0 0x7f7fd01437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0074770 con 0x7f7fd0155cb0 2023-11-28T21:04:15.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd5014640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0155cb0 0x7f7fd01437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd5014640 1 -- 172.21.15.167:0/802845746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fd006b9d0 con 0x7f7fd0155cb0 2023-11-28T21:04:15.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fd5014640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0155cb0 0x7f7fd01437e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00115d0 tx=0x7f7fc0011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:15.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0004230 con 0x7f7fd0155cb0 2023-11-28T21:04:15.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f7fc0004390 con 0x7f7fd0155cb0 2023-11-28T21:04:15.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0155cb0 msgr2=0x7f7fd01437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0155cb0 0x7f7fd01437e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00115d0 tx=0x7f7fc0011a90 comp rx=0 tx=0).stop 2023-11-28T21:04:15.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0155cb0 msgr2=0x7f7fd01437e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:15.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0155cb0 0x7f7fd01437e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:15.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7fcc004950 con 0x7f7fd006a580 2023-11-28T21:04:15.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb4066170 0x7f7fb4068630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.870+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f7fcc0835d0 con 0x7f7fd006a580 2023-11-28T21:04:15.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.874+0000 7f7fd5014640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb4066170 0x7f7fb4068630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.874+0000 7f7fd5014640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb4066170 0x7f7fb4068630 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0000c10 tx=0x7f7fc0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:15.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0156ea0 0x7f7fd0143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:15.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd015ba30 con 0x7f7fd0156ea0 2023-11-28T21:04:15.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd6016640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0156ea0 0x7f7fd0143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:15.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd6016640 1 -- 172.21.15.167:0/802845746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7fd0158750 con 0x7f7fd0156ea0 2023-11-28T21:04:15.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd6016640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0156ea0 0x7f7fd0143d20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00c62c0 tx=0x7f7fc8019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:15.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80b8680 con 0x7f7fd0156ea0 2023-11-28T21:04:15.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4473 (secure 0 0 0) 0x7f7fc80b87e0 con 0x7f7fd0156ea0 2023-11-28T21:04:15.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0156ea0 msgr2=0x7f7fd0143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fc67fc640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0156ea0 0x7f7fd0143d20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00c62c0 tx=0x7f7fc8019620 comp rx=0 tx=0).stop 2023-11-28T21:04:15.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fc67fc640 1 -- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0156ea0 msgr2=0x7f7fd0143d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:15.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fc67fc640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd0156ea0 0x7f7fd0143d20 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00c62c0 tx=0x7f7fc8019620 comp rx=0 tx=0).stop 2023-11-28T21:04:15.881 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:04:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:04:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 196, 2023-11-28T21:04:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:04:15.881 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 11, 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:15.882 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:15.883 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:15.884 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:04:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:04:15.885 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:04:15.886 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:04:15.886 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:04:15.886 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:04:15.886 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:15.886 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:15.886 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:04:15.887 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:04:15.887 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:04:15.887 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:04:15.887 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:04:15.887 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:04:15.887 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:04:15.887 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:15.888 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:04:15.888 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:15.888 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:15.888 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:15.888 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:15.888 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:15.889 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:15.889 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:15.889 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:15.889 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:15.889 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:15.889 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:15.890 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:04:15.890 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.890 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:04:15.890 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.890 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:15.891 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:15.891 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:15.891 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:15.891 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.891 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:15.891 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:04:15.891 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:04:15.892 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:15.893 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:04:15.894 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:15.895 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.896 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:15.897 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:15.898 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:15.899 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:04:15.899 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb4066170 msgr2=0x7f7fb4068630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f7fb4066170 0x7f7fb4068630 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0000c10 tx=0x7f7fc0017000 comp rx=0 tx=0).stop 2023-11-28T21:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 msgr2=0x7f7fd0150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 --2- 172.21.15.167:0/802845746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fd006a580 0x7f7fd0150390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c780 tx=0x7f7fcc00cc40 comp rx=0 tx=0).stop 2023-11-28T21:04:15.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd6016640 1 -- 172.21.15.167:0/802845746 reap_dead start 2023-11-28T21:04:15.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 shutdown_connections 2023-11-28T21:04:15.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 >> 172.21.15.167:0/802845746 conn(0x7f7fd00cb1e0 msgr2=0x7f7fd00c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:15.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 shutdown_connections 2023-11-28T21:04:15.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:15.878+0000 7f7fd7a79640 1 -- 172.21.15.167:0/802845746 wait complete. 2023-11-28T21:04:15.901 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:04:15.901 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T21:04:15.901 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:04:16.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.038+0000 7fc5d05aa640 1 Processor -- start 2023-11-28T21:04:16.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.038+0000 7fc5d05aa640 1 -- start start 2023-11-28T21:04:16.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5d05aa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5c80b0110 0x7fc5c815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5d05aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5c806bda0 0x7fc5c8066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5d05aa640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c806a8d0 con 0x7fc5c80c8010 2023-11-28T21:04:16.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5d05aa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c80ca230 con 0x7fc5c80b0110 2023-11-28T21:04:16.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5d05aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80c8990 con 0x7fc5c806bda0 2023-11-28T21:04:16.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5ce346640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5c80b0110 0x7fc5c815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5ce346640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5c80b0110 0x7fc5c815d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49326/0 (socket says 172.21.15.167:49326) 2023-11-28T21:04:16.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5ce346640 1 -- 172.21.15.167:0/1419338339 learned_addr learned my addr 172.21.15.167:0/1419338339 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:16.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5ceb47640 1 --2- 172.21.15.167:0/1419338339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5c806bda0 0x7fc5c8066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5ce346640 1 -- 172.21.15.167:0/1419338339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5c806bda0 msgr2=0x7fc5c8066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:16.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5ce346640 1 --2- 172.21.15.167:0/1419338339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5c806bda0 0x7fc5c8066730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5ce346640 1 -- 172.21.15.167:0/1419338339 >> v1:172.21.15.178:6789/0 conn(0x7fc5c80c8010 legacy=0x7fc5c806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.042+0000 7fc5ce346640 1 -- 172.21.15.167:0/1419338339 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c80ca480 con 0x7fc5c80b0110 2023-11-28T21:04:16.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5ce346640 1 --2- 172.21.15.167:0/1419338339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 0x7fc5c815d3b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009870 tx=0x7fc5c401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc015bba4a952c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5cd344640 1 -- 172.21.15.167:0/1419338339 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40a8a30 con 0x7fc5c80b0110 2023-11-28T21:04:16.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5cd344640 1 -- 172.21.15.167:0/1419338339 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c40a8b90 con 0x7fc5c80b0110 2023-11-28T21:04:16.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5cd344640 1 -- 172.21.15.167:0/1419338339 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40b0440 con 0x7fc5c80b0110 2023-11-28T21:04:16.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 -- 172.21.15.167:0/1419338339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 msgr2=0x7fc5c815d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 --2- 172.21.15.167:0/1419338339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 0x7fc5c815d3b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009870 tx=0x7fc5c401ed30 comp rx=0 tx=0).stop 2023-11-28T21:04:16.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 -- 172.21.15.167:0/1419338339 shutdown_connections 2023-11-28T21:04:16.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 --2- 172.21.15.167:0/1419338339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5c806bda0 0x7fc5c8066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 --2- 172.21.15.167:0/1419338339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 0x7fc5c815d3b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 -- 172.21.15.167:0/1419338339 >> 172.21.15.167:0/1419338339 conn(0x7fc5c806ee30 msgr2=0x7fc5c806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:16.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 -- 172.21.15.167:0/1419338339 shutdown_connections 2023-11-28T21:04:16.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 -- 172.21.15.167:0/1419338339 wait complete. 2023-11-28T21:04:16.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 Processor -- start 2023-11-28T21:04:16.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.046+0000 7fc5d05aa640 1 -- start start 2023-11-28T21:04:16.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5c806bda0 0x7fc5c80c2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 0x7fc5c81e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c80c8010 0x7fc5c81e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c815c3a0 con 0x7fc5c80b0110 2023-11-28T21:04:16.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c81e4d20 con 0x7fc5c80c8010 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c81e5000 con 0x7fc5c806bda0 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5cdb45640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 0x7fc5c81e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5cdb45640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 0x7fc5c81e3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49342/0 (socket says 172.21.15.167:49342) 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5cdb45640 1 -- 172.21.15.167:0/2932139359 learned_addr learned my addr 172.21.15.167:0/2932139359 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5ce346640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5c806bda0 0x7fc5c80c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5ceb47640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c80c8010 0x7fc5c81e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5cdb45640 1 -- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5c806bda0 msgr2=0x7fc5c80c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5cdb45640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5c806bda0 0x7fc5c80c2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5cdb45640 1 -- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c80c8010 msgr2=0x7fc5c81e4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5cdb45640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c80c8010 0x7fc5c81e4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5cdb45640 1 -- 172.21.15.167:0/2932139359 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40094d0 con 0x7fc5c80b0110 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5cdb45640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 0x7fc5c81e3cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c3c0 tx=0x7fc5b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b80052d0 con 0x7fc5c80b0110 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b8005430 con 0x7fc5c80b0110 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8003840 con 0x7fc5c80b0110 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c81e52e0 con 0x7fc5c80b0110 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c81e58a0 con 0x7fc5c80b0110 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c81e31b0 0x7fc5c815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c806b130 con 0x7fc5c81e31b0 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5ce346640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c81e31b0 0x7fc5c815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5b80039a0 con 0x7fc5c80b0110 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.050+0000 7fc5ce346640 1 -- 172.21.15.167:0/2932139359 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5c80ca760 con 0x7fc5c81e31b0 2023-11-28T21:04:16.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5ce346640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c81e31b0 0x7fc5c815c4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8066f30 tx=0x7fc5c401d570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5beffd640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5ac0664a0 0x7fc5ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc5b8083800 con 0x7fc5c80b0110 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5ceb47640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5ac0664a0 0x7fc5ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40b0e00 con 0x7fc5c81e31b0 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fc5c40bb420 con 0x7fc5c81e31b0 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c81e31b0 msgr2=0x7fc5c815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5beffd640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c81e31b0 0x7fc5c815c4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8066f30 tx=0x7fc5c401d570 comp rx=0 tx=0).stop 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c81e31b0 msgr2=0x7fc5c815c4e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5beffd640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c81e31b0 0x7fc5c815c4e0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8066f30 tx=0x7fc5c401d570 comp rx=0 tx=0).stop 2023-11-28T21:04:16.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.054+0000 7fc5ceb47640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5ac0664a0 0x7fc5ac068960 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc5c806c1c0 tx=0x7fc5c000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.058+0000 7fc5d05aa640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c815ca20 0x7fc5c81f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.058+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80c8f10 con 0x7fc5c815ca20 2023-11-28T21:04:16.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.058+0000 7fc5ce346640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c815ca20 0x7fc5c81f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5ce346640 1 -- 172.21.15.167:0/2932139359 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc5c806d530 con 0x7fc5c815ca20 2023-11-28T21:04:16.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5ce346640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c815ca20 0x7fc5c81f2a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5c401ed70 tx=0x7fc5c401bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40c8070 con 0x7fc5c815ca20 2023-11-28T21:04:16.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5124 (secure 0 0 0) 0x7fc5c4003ce0 con 0x7fc5c815ca20 2023-11-28T21:04:16.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c815ca20 msgr2=0x7fc5c81f2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5beffd640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c815ca20 0x7fc5c81f2a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5c401ed70 tx=0x7fc5c401bad0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5beffd640 1 -- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c815ca20 msgr2=0x7fc5c81f2a60 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:16.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5beffd640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5c815ca20 0x7fc5c81f2a60 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5c401ed70 tx=0x7fc5c401bad0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.063 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 196, 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 11, 2023-11-28T21:04:16.064 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:16.065 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:04:16.067 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:16.068 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:04:16.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:16.071 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:16.072 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:16.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.072 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.072 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:16.072 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:16.072 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:16.072 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:16.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.073 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:16.073 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:04:16.073 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.073 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:16.074 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:04:16.074 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.074 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.074 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.074 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:04:16.075 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:04:16.075 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:16.075 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:16.075 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:16.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.076 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:16.076 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:16.076 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:16.076 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:16.076 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.076 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:16.076 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:04:16.077 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.077 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.077 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:16.077 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:04:16.077 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.077 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.077 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.078 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:04:16.078 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:04:16.078 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:16.078 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:16.078 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:16.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.079 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.079 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:04:16.079 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:04:16.079 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.079 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.079 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.080 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:16.080 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.080 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.080 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:04:16.080 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.080 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.080 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.080 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:04:16.081 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.081 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.081 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:04:16.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.081 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.081 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.081 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:04:16.081 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.081 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.082 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.083 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:04:16.084 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:04:16.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5ac0664a0 msgr2=0x7fc5ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5d05aa640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc5ac0664a0 0x7fc5ac068960 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc5c806c1c0 tx=0x7fc5c000b040 comp rx=0 tx=0).stop 2023-11-28T21:04:16.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 msgr2=0x7fc5c81e3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5d05aa640 1 --2- 172.21.15.167:0/2932139359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5c80b0110 0x7fc5c81e3cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c3c0 tx=0x7fc5b800c880 comp rx=0 tx=0).stop 2023-11-28T21:04:16.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5ceb47640 1 -- 172.21.15.167:0/2932139359 reap_dead start 2023-11-28T21:04:16.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5ceb47640 1 -- 172.21.15.167:0/2932139359 reap_dead start 2023-11-28T21:04:16.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 shutdown_connections 2023-11-28T21:04:16.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 >> 172.21.15.167:0/2932139359 conn(0x7fc5c806ee30 msgr2=0x7fc5c806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:16.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 shutdown_connections 2023-11-28T21:04:16.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.062+0000 7fc5d05aa640 1 -- 172.21.15.167:0/2932139359 wait complete. 2023-11-28T21:04:16.086 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:04:16.086 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T21:04:16.087 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:04:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f8094c3c640 1 Processor -- start 2023-11-28T21:04:16.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f8094c3c640 1 -- start start 2023-11-28T21:04:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f8094c3c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8090153d20 0x7f8090159b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f8094c3c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80900ca3c0 0x7f80900c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f8094c3c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809015a1b0 con 0x7f80900c5fb0 2023-11-28T21:04:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f8094c3c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809015a450 con 0x7f80900ca3c0 2023-11-28T21:04:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f8094c3c640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809015a710 con 0x7f8090153d20 2023-11-28T21:04:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80900ca3c0 0x7f80900c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80900ca3c0 0x7f80900c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49352/0 (socket says 172.21.15.167:49352) 2023-11-28T21:04:16.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f80900c5fb0 0x7f80900cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:32864/0 (socket says 172.21.15.167:32864) 2023-11-28T21:04:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808effd640 1 -- 172.21.15.167:0/3815502250 learned_addr learned my addr 172.21.15.167:0/3815502250 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808f7fe640 1 --2- 172.21.15.167:0/3815502250 >> v2:172.21.15.178:3300/0 conn(0x7f8090153d20 0x7f8090159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808effd640 1 -- 172.21.15.167:0/3815502250 >> v2:172.21.15.178:3300/0 conn(0x7f8090153d20 msgr2=0x7f8090159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808effd640 1 --2- 172.21.15.167:0/3815502250 >> v2:172.21.15.178:3300/0 conn(0x7f8090153d20 0x7f8090159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808effd640 1 -- 172.21.15.167:0/3815502250 >> v1:172.21.15.167:6789/0 conn(0x7f80900c5fb0 legacy=0x7f80900cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808effd640 1 -- 172.21.15.167:0/3815502250 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809015a9f0 con 0x7f80900ca3c0 2023-11-28T21:04:16.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.226+0000 7f808e7fc640 1 -- 172.21.15.167:0/3815502250 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059563199 0 0) 0x7f809015a1b0 con 0x7f80900c5fb0 2023-11-28T21:04:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f808effd640 1 --2- 172.21.15.167:0/3815502250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 0x7f80900c5a70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f80900c6780 tx=0x7f808401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df12d3ef1dea12a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f808e7fc640 1 -- 172.21.15.167:0/3815502250 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80840a89f0 con 0x7f80900ca3c0 2023-11-28T21:04:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f808e7fc640 1 -- 172.21.15.167:0/3815502250 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80840a8b50 con 0x7f80900ca3c0 2023-11-28T21:04:16.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f808e7fc640 1 -- 172.21.15.167:0/3815502250 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80840b0440 con 0x7f80900ca3c0 2023-11-28T21:04:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f8094c3c640 1 -- 172.21.15.167:0/3815502250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 msgr2=0x7f80900c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f8094c3c640 1 --2- 172.21.15.167:0/3815502250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 0x7f80900c5a70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f80900c6780 tx=0x7f808401ecf0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f8094c3c640 1 -- 172.21.15.167:0/3815502250 shutdown_connections 2023-11-28T21:04:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f8094c3c640 1 --2- 172.21.15.167:0/3815502250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 0x7f80900c5a70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f8094c3c640 1 --2- 172.21.15.167:0/3815502250 >> v2:172.21.15.178:3300/0 conn(0x7f8090153d20 0x7f8090159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f8094c3c640 1 -- 172.21.15.167:0/3815502250 >> 172.21.15.167:0/3815502250 conn(0x7f809006b800 msgr2=0x7f809006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f8094c3c640 1 -- 172.21.15.167:0/3815502250 shutdown_connections 2023-11-28T21:04:16.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.230+0000 7f8094c3c640 1 -- 172.21.15.167:0/3815502250 wait complete. 2023-11-28T21:04:16.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 Processor -- start 2023-11-28T21:04:16.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 -- start start 2023-11-28T21:04:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80900c5fb0 0x7f80900b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 0x7f809014c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8090153d20 0x7f80900c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80900c7070 con 0x7f80900ca3c0 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809014bd90 con 0x7f8090153d20 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809014bab0 con 0x7f80900c5fb0 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 0x7f809014c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 0x7f809014c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49366/0 (socket says 172.21.15.167:49366) 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808effd640 1 -- 172.21.15.167:0/1889485729 learned_addr learned my addr 172.21.15.167:0/1889485729 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808ffff640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8090153d20 0x7f80900c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808f7fe640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80900c5fb0 0x7f80900b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808effd640 1 -- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80900c5fb0 msgr2=0x7f80900b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808effd640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80900c5fb0 0x7f80900b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808effd640 1 -- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8090153d20 msgr2=0x7f80900c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808effd640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8090153d20 0x7f80900c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808effd640 1 -- 172.21.15.167:0/1889485729 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80840094d0 con 0x7f80900ca3c0 2023-11-28T21:04:16.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f808effd640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 0x7f809014c600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f808401b900 tx=0x7f808401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80840ba600 con 0x7f80900ca3c0 2023-11-28T21:04:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80840ba760 con 0x7f80900ca3c0 2023-11-28T21:04:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80901f27e0 con 0x7f80900ca3c0 2023-11-28T21:04:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80840bab10 con 0x7f80900ca3c0 2023-11-28T21:04:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.234+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80901f2da0 con 0x7f80900ca3c0 2023-11-28T21:04:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8094c3c640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809015dc90 0x7f80900c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8090072740 con 0x7f809015dc90 2023-11-28T21:04:16.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f808f7fe640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809015dc90 0x7f80900c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80840bac70 con 0x7f80900ca3c0 2023-11-28T21:04:16.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f808f7fe640 1 -- 172.21.15.167:0/1889485729 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80900c4780 con 0x7f809015dc90 2023-11-28T21:04:16.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f808f7fe640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809015dc90 0x7f80900c8ce0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8080011510 tx=0x7f80800119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8077fff640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f807c0664a0 0x7f807c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f80841228d0 con 0x7f80900ca3c0 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080004230 con 0x7f809015dc90 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f808ffff640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f807c0664a0 0x7f807c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f8080004390 con 0x7f809015dc90 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809015dc90 msgr2=0x7f80900c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8077fff640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809015dc90 0x7f80900c8ce0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8080011510 tx=0x7f80800119d0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809015dc90 msgr2=0x7f80900c8ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f8077fff640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809015dc90 0x7f80900c8ce0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8080011510 tx=0x7f80800119d0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.238+0000 7f808ffff640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f807c0664a0 0x7f807c068960 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8088007fd0 tx=0x7f8088007e60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f8094c3c640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809014cb40 0x7f809015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80901f2970 con 0x7f809014cb40 2023-11-28T21:04:16.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f808f7fe640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809014cb40 0x7f809015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f808f7fe640 1 -- 172.21.15.167:0/1889485729 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f80900c5550 con 0x7f809014cb40 2023-11-28T21:04:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f808f7fe640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809014cb40 0x7f809015bf40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8080011510 tx=0x7f80800046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080024070 con 0x7f809014cb40 2023-11-28T21:04:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4981 (secure 0 0 0) 0x7f8080003620 con 0x7f809014cb40 2023-11-28T21:04:16.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809014cb40 msgr2=0x7f809015bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f8077fff640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809014cb40 0x7f809015bf40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8080011510 tx=0x7f80800046d0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f8077fff640 1 -- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809014cb40 msgr2=0x7f809015bf40 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:16.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.246+0000 7f8077fff640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f809014cb40 0x7f809015bf40 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8080011510 tx=0x7f80800046d0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.250 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:04:16.250 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:16.251 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:16.251 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:04:16.251 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 196, 2023-11-28T21:04:16.251 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:04:16.251 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:04:16.252 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:04:16.252 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:04:16.252 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.252 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 12, 2023-11-28T21:04:16.252 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:16.252 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:04:16.253 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:04:16.253 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:16.253 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:16.253 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:16.253 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:16.254 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:16.254 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:16.254 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:16.254 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:16.254 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:16.254 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:16.255 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:04:16.256 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:04:16.257 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:16.258 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:16.259 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.260 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:16.261 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.262 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:16.263 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:16.264 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:16.264 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:16.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.264 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:16.264 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:04:16.264 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.264 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.264 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.264 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.265 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.266 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.266 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:04:16.266 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:04:16.266 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.266 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.266 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.266 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:16.266 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.266 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.267 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.268 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:04:16.269 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f807c0664a0 msgr2=0x7f807c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f8094c3c640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f807c0664a0 0x7f807c068960 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8088007fd0 tx=0x7f8088007e60 comp rx=0 tx=0).stop 2023-11-28T21:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 msgr2=0x7f809014c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f8094c3c640 1 --2- 172.21.15.167:0/1889485729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80900ca3c0 0x7f809014c600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f808401b900 tx=0x7f808401ba90 comp rx=0 tx=0).stop 2023-11-28T21:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f808ffff640 1 -- 172.21.15.167:0/1889485729 reap_dead start 2023-11-28T21:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f808ffff640 1 -- 172.21.15.167:0/1889485729 reap_dead start 2023-11-28T21:04:16.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 shutdown_connections 2023-11-28T21:04:16.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 >> 172.21.15.167:0/1889485729 conn(0x7f809006b800 msgr2=0x7f809006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:16.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 shutdown_connections 2023-11-28T21:04:16.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.250+0000 7f8094c3c640 1 -- 172.21.15.167:0/1889485729 wait complete. 2023-11-28T21:04:16.272 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:04:16.273 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2023-11-28T21:04:16.273 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2023-11-28T21:04:16.273 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2023-11-28T21:04:16.273 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T21:04:16.274 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T21:04:16.274 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:04:16.300 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T21:04:16.300 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2023-11-28T21:04:16.300 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:04:16.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~303s 2023-11-28T21:04:16.304 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-28T21:04:16.305 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T21:04:16.305 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:04:16.359 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T21:04:16.359 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:04:16.411 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:04:16.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a46dd640 1 Processor -- start 2023-11-28T21:04:16.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a46dd640 1 -- start start 2023-11-28T21:04:16.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a46dd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd79c151f60 0x7fd79c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a46dd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79c0c5c90 0x7fd79c0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a46dd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c15b220 con 0x7fd79c06a580 2023-11-28T21:04:16.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a46dd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c0c4da0 con 0x7fd79c151f60 2023-11-28T21:04:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a46dd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0c60f0 con 0x7fd79c0c5c90 2023-11-28T21:04:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a2c7a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd79c06a580 0x7fd79c06ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:32876/0 (socket says 172.21.15.167:32876) 2023-11-28T21:04:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a2c7a640 1 -- 172.21.15.167:0/1601553928 learned_addr learned my addr 172.21.15.167:0/1601553928 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a2479640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7fd79c151f60 msgr2=0x7fd79c0c75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:16.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a2479640 1 --2- 172.21.15.167:0/1601553928 >> v2:172.21.15.178:3300/0 conn(0x7fd79c151f60 0x7fd79c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:16.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1c78640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79c0c5c90 0x7fd79c0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449518450 0 0) 0x7fd79c15b220 con 0x7fd79c06a580 2023-11-28T21:04:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd788003530 con 0x7fd79c06a580 2023-11-28T21:04:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3433904776 0 0) 0x7fd788003530 con 0x7fd79c06a580 2023-11-28T21:04:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79c0c5c90 msgr2=0x7fd79c0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79c0c5c90 0x7fd79c0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 >> v2:172.21.15.178:3300/0 conn(0x7fd79c151f60 msgr2=0x7fd79c0c75c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:16.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 --2- 172.21.15.167:0/1601553928 >> v2:172.21.15.178:3300/0 conn(0x7fd79c151f60 0x7fd79c0c75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c152340 con 0x7fd79c06a580 2023-11-28T21:04:16.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fd794001a00 con 0x7fd79c06a580 2023-11-28T21:04:16.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 >> v1:172.21.15.167:6789/0 conn(0x7fd79c06a580 legacy=0x7fd79c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.438+0000 7fd7a1477640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79c0c5c90 0x7fd788003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1477640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd788003f00 0x7fd7880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1477640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd788004d10 0x7fd788005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0c60f0 con 0x7fd788003f00 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78800baa0 con 0x7fd788004d10 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78800bc60 con 0x7fd79c0c5c90 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a2c7a640 1 -- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd788004d10 msgr2=0x7fd788005190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a2c7a640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd788004d10 0x7fd788005190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1c78640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd788003f00 0x7fd7880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a2479640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79c0c5c90 0x7fd788003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1c78640 1 -- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79c0c5c90 msgr2=0x7fd788003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1c78640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79c0c5c90 0x7fd788003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1c78640 1 -- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd788004d10 msgr2=0x7fd788005190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:16.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1c78640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd788004d10 0x7fd788005190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1c78640 1 -- 172.21.15.167:0/1601553928 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd788003530 con 0x7fd788003f00 2023-11-28T21:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1c78640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd788003f00 0x7fd7880047d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009ae0 tx=0x7fd78c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519b8e33b0bccfb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0a8420 con 0x7fd788003f00 2023-11-28T21:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c0a8580 con 0x7fd788003f00 2023-11-28T21:04:16.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.442+0000 7fd7a1477640 1 -- 172.21.15.167:0/1601553928 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0a8930 con 0x7fd788003f00 2023-11-28T21:04:16.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 -- 172.21.15.167:0/1601553928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd788003f00 msgr2=0x7fd7880047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 --2- 172.21.15.167:0/1601553928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd788003f00 0x7fd7880047d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009ae0 tx=0x7fd78c01ca50 comp rx=0 tx=0).stop 2023-11-28T21:04:16.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a2c7a640 1 -- 172.21.15.167:0/1601553928 reap_dead start 2023-11-28T21:04:16.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 -- 172.21.15.167:0/1601553928 shutdown_connections 2023-11-28T21:04:16.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 -- 172.21.15.167:0/1601553928 >> 172.21.15.167:0/1601553928 conn(0x7fd79c0cb1e0 msgr2=0x7fd79c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:16.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 -- 172.21.15.167:0/1601553928 shutdown_connections 2023-11-28T21:04:16.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 -- 172.21.15.167:0/1601553928 wait complete. 2023-11-28T21:04:16.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 Processor -- start 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 -- start start 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd788003f00 0x7fd79c1f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd79c1f3ae0 0x7fd79c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79c15a7a0 0x7fd79c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c15db30 con 0x7fd79c15a7a0 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c14e250 con 0x7fd79c1f3ae0 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a46dd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c14da80 con 0x7fd788003f00 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a1c78640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd79c1f3ae0 msgr2=0x7fd79c159050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a1c78640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd79c1f3ae0 0x7fd79c159050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a2c7a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79c15a7a0 0x7fd79c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a2479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd788003f00 0x7fd79c1f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a2c7a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79c15a7a0 0x7fd79c15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49420/0 (socket says 172.21.15.167:49420) 2023-11-28T21:04:16.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.446+0000 7fd7a2c7a640 1 -- 172.21.15.167:0/527269766 learned_addr learned my addr 172.21.15.167:0/527269766 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:16.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd7a2c7a640 1 -- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd788003f00 msgr2=0x7fd79c1f6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd7a2c7a640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd788003f00 0x7fd79c1f6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd7a2c7a640 1 -- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd79c1f3ae0 msgr2=0x7fd79c159050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:16.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd7a2c7a640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd79c1f3ae0 0x7fd79c159050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd7a2c7a640 1 -- 172.21.15.167:0/527269766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c1f60f0 con 0x7fd79c15a7a0 2023-11-28T21:04:16.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd7a2c7a640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79c15a7a0 0x7fd79c15c230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd794001790 tx=0x7fd79400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd792ffd640 1 -- 172.21.15.167:0/527269766 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79400a610 con 0x7fd79c15a7a0 2023-11-28T21:04:16.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd792ffd640 1 -- 172.21.15.167:0/527269766 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79400a770 con 0x7fd79c15a7a0 2023-11-28T21:04:16.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd792ffd640 1 -- 172.21.15.167:0/527269766 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79400ab20 con 0x7fd79c15a7a0 2023-11-28T21:04:16.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c1f6ac0 con 0x7fd79c15a7a0 2023-11-28T21:04:16.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c14df70 con 0x7fd79c15a7a0 2023-11-28T21:04:16.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c0682c0 con 0x7fd79c15a7a0 2023-11-28T21:04:16.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd792ffd640 1 -- 172.21.15.167:0/527269766 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd79400ac80 con 0x7fd79c15a7a0 2023-11-28T21:04:16.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd792ffd640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd780066420 0x7fd7800688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.450+0000 7fd792ffd640 1 -- 172.21.15.167:0/527269766 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd794083ab0 con 0x7fd79c15a7a0 2023-11-28T21:04:16.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.454+0000 7fd7a2479640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd780066420 0x7fd7800688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.454+0000 7fd7a2479640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd780066420 0x7fd7800688e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd798006fd0 tx=0x7fd7980090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.462+0000 7fd792ffd640 1 -- 172.21.15.167:0/527269766 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd794050b50 con 0x7fd79c15a7a0 2023-11-28T21:04:16.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d8db8640 1 Processor -- start 2023-11-28T21:04:16.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d8db8640 1 -- start start 2023-11-28T21:04:16.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d8db8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3d40cf860 0x7fa3d40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d8db8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3d40cfc40 0x7fa3d40ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d8db8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d415ac00 con 0x7fa3d4153ae0 2023-11-28T21:04:16.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d8db8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d40cbd60 con 0x7fa3d40cfc40 2023-11-28T21:04:16.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d8db8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d4159ff0 con 0x7fa3d40cf860 2023-11-28T21:04:16.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d259c640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7fa3d40cf860 msgr2=0x7fa3d40cb770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:16.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d2d9d640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7fa3d4153ae0 legacy=0x7fa3d415d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:04:16.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d259c640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3d40cf860 0x7fa3d40cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:16.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.582+0000 7fa3d1d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3d40cfc40 0x7fa3d40ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d1d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa3d40cfc40 0x7fa3d40ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49424/0 (socket says 172.21.15.167:49424) 2023-11-28T21:04:16.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d1d9b640 1 -- 172.21.15.167:0/2269136060 learned_addr learned my addr 172.21.15.167:0/2269136060 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:16.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d1d9b640 1 -- 172.21.15.167:0/2269136060 >> v2:172.21.15.178:3300/0 conn(0x7fa3d40cf860 msgr2=0x7fa3d40cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:16.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d1d9b640 1 --2- 172.21.15.167:0/2269136060 >> v2:172.21.15.178:3300/0 conn(0x7fa3d40cf860 0x7fa3d40cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d1d9b640 1 -- 172.21.15.167:0/2269136060 >> v1:172.21.15.178:6789/0 conn(0x7fa3d4153ae0 legacy=0x7fa3d415d4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:16.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d1d9b640 1 -- 172.21.15.167:0/2269136060 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d415a2d0 con 0x7fa3d40cfc40 2023-11-28T21:04:16.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d1d9b640 1 --2- 172.21.15.167:0/2269136060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d40cfc40 0x7fa3d40ca510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40d03b0 tx=0x7fa3c801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ac707ded6a5ad9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d159a640 1 -- 172.21.15.167:0/2269136060 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80aa610 con 0x7fa3d40cfc40 2023-11-28T21:04:16.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d159a640 1 -- 172.21.15.167:0/2269136060 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c80a6040 con 0x7fa3d40cfc40 2023-11-28T21:04:16.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.586+0000 7fa3d159a640 1 -- 172.21.15.167:0/2269136060 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80aa990 con 0x7fa3d40cfc40 2023-11-28T21:04:16.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 -- 172.21.15.167:0/2269136060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d40cfc40 msgr2=0x7fa3d40ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 --2- 172.21.15.167:0/2269136060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d40cfc40 0x7fa3d40ca510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40d03b0 tx=0x7fa3c801c4b0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 -- 172.21.15.167:0/2269136060 shutdown_connections 2023-11-28T21:04:16.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 --2- 172.21.15.167:0/2269136060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d40cfc40 0x7fa3d40ca510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 --2- 172.21.15.167:0/2269136060 >> v2:172.21.15.178:3300/0 conn(0x7fa3d40cf860 0x7fa3d40cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 -- 172.21.15.167:0/2269136060 >> 172.21.15.167:0/2269136060 conn(0x7fa3d406c1f0 msgr2=0x7fa3d4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:16.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 -- 172.21.15.167:0/2269136060 shutdown_connections 2023-11-28T21:04:16.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 -- 172.21.15.167:0/2269136060 wait complete. 2023-11-28T21:04:16.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 Processor -- start 2023-11-28T21:04:16.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 -- start start 2023-11-28T21:04:16.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3d40cf860 0x7fa3d413c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3d40cfc40 0x7fa3d415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d4153ae0 0x7fa3d415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d413c810 con 0x7fa3d4153ae0 2023-11-28T21:04:16.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d415bbf0 con 0x7fa3d40cf860 2023-11-28T21:04:16.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d8db8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d41585c0 con 0x7fa3d40cfc40 2023-11-28T21:04:16.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d259c640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3d40cf860 msgr2=0x7fa3d413c2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:16.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d2d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d4153ae0 0x7fa3d415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d259c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3d40cf860 0x7fa3d413c2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:16.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d2d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d4153ae0 0x7fa3d415c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49438/0 (socket says 172.21.15.167:49438) 2023-11-28T21:04:16.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d2d9d640 1 -- 172.21.15.167:0/3025825314 learned_addr learned my addr 172.21.15.167:0/3025825314 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:16.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d1d9b640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3d40cfc40 0x7fa3d415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d2d9d640 1 -- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3d40cfc40 msgr2=0x7fa3d415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.590+0000 7fa3d2d9d640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3d40cfc40 0x7fa3d415c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3d2d9d640 1 -- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3d40cf860 msgr2=0x7fa3d413c2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3d2d9d640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3d40cf860 0x7fa3d413c2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3d2d9d640 1 -- 172.21.15.167:0/3025825314 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80094d0 con 0x7fa3d4153ae0 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3d2d9d640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d4153ae0 0x7fa3d415c5c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00b7c0 tx=0x7fa3cc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3c2ffd640 1 -- 172.21.15.167:0/3025825314 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00c960 con 0x7fa3d4153ae0 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3c2ffd640 1 -- 172.21.15.167:0/3025825314 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc00cac0 con 0x7fa3d4153ae0 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3c2ffd640 1 -- 172.21.15.167:0/3025825314 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00ce70 con 0x7fa3d4153ae0 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d4158830 con 0x7fa3d4153ae0 2023-11-28T21:04:16.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d415b880 con 0x7fa3d4153ae0 2023-11-28T21:04:16.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d40caa00 con 0x7fa3d4153ae0 2023-11-28T21:04:16.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.594+0000 7fa3c2ffd640 1 -- 172.21.15.167:0/3025825314 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3cc012070 con 0x7fa3d4153ae0 2023-11-28T21:04:16.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.598+0000 7fa3c2ffd640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa3b4066420 0x7fa3b40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.598+0000 7fa3c2ffd640 1 -- 172.21.15.167:0/3025825314 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa3cc083fb0 con 0x7fa3d4153ae0 2023-11-28T21:04:16.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.598+0000 7fa3d259c640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa3b4066420 0x7fa3b40688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.598+0000 7fa3d259c640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa3b4066420 0x7fa3b40688e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4003940 tx=0x7fa3c4006d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.602+0000 7fa3c2ffd640 1 -- 172.21.15.167:0/3025825314 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3cc0b5280 con 0x7fa3d4153ae0 2023-11-28T21:04:16.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.670+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd79c1f62a0 con 0x7fd79c15a7a0 2023-11-28T21:04:16.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd792ffd640 1 -- 172.21.15.167:0/527269766 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7fd79c1f62a0 con 0x7fd79c15a7a0 2023-11-28T21:04:16.673 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":196,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:04:16.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd780066420 msgr2=0x7fd7800688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd780066420 0x7fd7800688e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd798006fd0 tx=0x7fd7980090e0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79c15a7a0 msgr2=0x7fd79c15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79c15a7a0 0x7fd79c15c230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd794001790 tx=0x7fd79400ccf0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 shutdown_connections 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fd780066420 0x7fd7800688e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79c15a7a0 0x7fd79c15c230 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd79c1f3ae0 0x7fd79c159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 --2- 172.21.15.167:0/527269766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd788003f00 0x7fd79c1f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 >> 172.21.15.167:0/527269766 conn(0x7fd79c0cb1e0 msgr2=0x7fd79c14e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 shutdown_connections 2023-11-28T21:04:16.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.674+0000 7fd7a46dd640 1 -- 172.21.15.167:0/527269766 wait complete. 2023-11-28T21:04:16.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.754+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3d4075c90 con 0x7fa3d4153ae0 2023-11-28T21:04:16.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3c2ffd640 1 -- 172.21.15.167:0/3025825314 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18899 (secure 0 0 0) 0x7fa3cc01a020 con 0x7fa3d4153ae0 2023-11-28T21:04:16.758 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:04:16.758 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":51,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:44:44.525039+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":504,"length":2}]},{"pool":4,"snaps":[{"begin":504,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:04:16.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa3b4066420 msgr2=0x7fa3b40688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa3b4066420 0x7fa3b40688e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4003940 tx=0x7fa3c4006d90 comp rx=0 tx=0).stop 2023-11-28T21:04:16.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d4153ae0 msgr2=0x7fa3d415c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d4153ae0 0x7fa3d415c5c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00b7c0 tx=0x7fa3cc00bc80 comp rx=0 tx=0).stop 2023-11-28T21:04:16.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 shutdown_connections 2023-11-28T21:04:16.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa3b4066420 0x7fa3b40688e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3d4153ae0 0x7fa3d415c5c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3d40cfc40 0x7fa3d415c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 --2- 172.21.15.167:0/3025825314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3d40cf860 0x7fa3d413c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 >> 172.21.15.167:0/3025825314 conn(0x7fa3d406c1f0 msgr2=0x7fa3d40cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:16.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 shutdown_connections 2023-11-28T21:04:16.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.758+0000 7fa3d8db8640 1 -- 172.21.15.167:0/3025825314 wait complete. 2023-11-28T21:04:16.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T20:38:05.507993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T20:38:17.477871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T20:38:17.884061+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 49, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-28T20:38:21.578587+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 49, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-28T21:04:16.779 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:04:16.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.918+0000 7f615f757640 1 Processor -- start 2023-11-28T21:04:16.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.918+0000 7f615f757640 1 -- start start 2023-11-28T21:04:16.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615f757640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61581585d0 0x7f61580c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615f757640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615815e130 0x7f6158161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615f757640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615815e5e0 con 0x7f61580c7720 2023-11-28T21:04:16.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615f757640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615815f160 con 0x7f61581585d0 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615f757640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615815e8c0 con 0x7f615815e130 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615d4f3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61581585d0 0x7f61580c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615dcf4640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7f61580c7720 legacy=0x7f615806a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615d4f3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61581585d0 0x7f61580c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49450/0 (socket says 172.21.15.167:49450) 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615d4f3640 1 -- 172.21.15.167:0/3933578443 learned_addr learned my addr 172.21.15.167:0/3933578443 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615ccf2640 1 --2- 172.21.15.167:0/3933578443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615815e130 0x7f6158161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615d4f3640 1 -- 172.21.15.167:0/3933578443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615815e130 msgr2=0x7f6158161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615d4f3640 1 --2- 172.21.15.167:0/3933578443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615815e130 0x7f6158161de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615d4f3640 1 -- 172.21.15.167:0/3933578443 >> v1:172.21.15.178:6789/0 conn(0x7f61580c7720 legacy=0x7f615806a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:16.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.922+0000 7f615d4f3640 1 -- 172.21.15.167:0/3933578443 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615815eba0 con 0x7f61581585d0 2023-11-28T21:04:16.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615d4f3640 1 --2- 172.21.15.167:0/3933578443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61581585d0 0x7f61580c5e90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6154009870 tx=0x7f615401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d24d3dd45120343 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f614ffff640 1 -- 172.21.15.167:0/3933578443 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61540ac600 con 0x7f61581585d0 2023-11-28T21:04:16.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f614ffff640 1 -- 172.21.15.167:0/3933578443 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61540a8050 con 0x7f61581585d0 2023-11-28T21:04:16.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f614ffff640 1 -- 172.21.15.167:0/3933578443 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61540ac980 con 0x7f61581585d0 2023-11-28T21:04:16.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 -- 172.21.15.167:0/3933578443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61581585d0 msgr2=0x7f61580c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 --2- 172.21.15.167:0/3933578443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61581585d0 0x7f61580c5e90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6154009870 tx=0x7f615401c4d0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 -- 172.21.15.167:0/3933578443 shutdown_connections 2023-11-28T21:04:16.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 --2- 172.21.15.167:0/3933578443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615815e130 0x7f6158161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 --2- 172.21.15.167:0/3933578443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61581585d0 0x7f61580c5e90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 -- 172.21.15.167:0/3933578443 >> 172.21.15.167:0/3933578443 conn(0x7f61580cb1e0 msgr2=0x7f61580cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:16.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 -- 172.21.15.167:0/3933578443 shutdown_connections 2023-11-28T21:04:16.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 -- 172.21.15.167:0/3933578443 wait complete. 2023-11-28T21:04:16.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 Processor -- start 2023-11-28T21:04:16.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 -- start start 2023-11-28T21:04:16.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61580c7720 0x7f6158148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61581585d0 0x7f615815f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615815e130 0x7f615815f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61581f7a40 con 0x7f615815e130 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61581f6ec0 con 0x7f61581585d0 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.926+0000 7f615f757640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61581f71a0 con 0x7f61580c7720 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615ccf2640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61581585d0 msgr2=0x7f615815f2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615ccf2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61581585d0 0x7f615815f2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615dcf4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615815e130 0x7f615815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615dcf4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615815e130 0x7f615815f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49460/0 (socket says 172.21.15.167:49460) 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615dcf4640 1 -- 172.21.15.167:0/1102120595 learned_addr learned my addr 172.21.15.167:0/1102120595 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615d4f3640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61580c7720 0x7f6158148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615dcf4640 1 -- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61580c7720 msgr2=0x7f6158148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:16.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615dcf4640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61580c7720 0x7f6158148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615dcf4640 1 -- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61581585d0 msgr2=0x7f615815f2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:16.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615dcf4640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61581585d0 0x7f615815f2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:16.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615dcf4640 1 -- 172.21.15.167:0/1102120595 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540094d0 con 0x7f615815e130 2023-11-28T21:04:16.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615dcf4640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615815e130 0x7f615815f830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f615000b760 tx=0x7f615000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f614dffb640 1 -- 172.21.15.167:0/1102120595 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000c960 con 0x7f615815e130 2023-11-28T21:04:16.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f614dffb640 1 -- 172.21.15.167:0/1102120595 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000cac0 con 0x7f615815e130 2023-11-28T21:04:16.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61581f7480 con 0x7f615815e130 2023-11-28T21:04:16.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f614dffb640 1 -- 172.21.15.167:0/1102120595 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150015470 con 0x7f615815e130 2023-11-28T21:04:16.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61581f0300 con 0x7f615815e130 2023-11-28T21:04:16.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61580682c0 con 0x7f615815e130 2023-11-28T21:04:16.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f614dffb640 1 -- 172.21.15.167:0/1102120595 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6150012070 con 0x7f615815e130 2023-11-28T21:04:16.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.930+0000 7f614dffb640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f613c066420 0x7f613c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:16.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.934+0000 7f614dffb640 1 -- 172.21.15.167:0/1102120595 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6150083f00 con 0x7f615815e130 2023-11-28T21:04:16.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.934+0000 7f615d4f3640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f613c066420 0x7f613c0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:16.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.934+0000 7f615d4f3640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f613c066420 0x7f613c0688e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f61540ae000 tx=0x7f61540a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:16.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:16.934+0000 7f614dffb640 1 -- 172.21.15.167:0/1102120595 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6150050f90 con 0x7f615815e130 2023-11-28T21:04:17.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.086+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61581f0160 con 0x7f615815e130 2023-11-28T21:04:17.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.086+0000 7f614dffb640 1 -- 172.21.15.167:0/1102120595 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61581f0160 con 0x7f615815e130 2023-11-28T21:04:17.088 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 1 2023-11-28T21:04:17.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f613c066420 msgr2=0x7f613c0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f613c066420 0x7f613c0688e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f61540ae000 tx=0x7f61540a7000 comp rx=0 tx=0).stop 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615815e130 msgr2=0x7f615815f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615815e130 0x7f615815f830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f615000b760 tx=0x7f615000bc20 comp rx=0 tx=0).stop 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 shutdown_connections 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f613c066420 0x7f613c0688e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615815e130 0x7f615815f830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61581585d0 0x7f615815f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 --2- 172.21.15.167:0/1102120595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61580c7720 0x7f6158148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 >> 172.21.15.167:0/1102120595 conn(0x7f61580cb1e0 msgr2=0x7f6158157910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:17.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 shutdown_connections 2023-11-28T21:04:17.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.090+0000 7f615f757640 1 -- 172.21.15.167:0/1102120595 wait complete. 2023-11-28T21:04:17.109 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:04:17.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45f6780640 1 Processor -- start 2023-11-28T21:04:17.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45f6780640 1 -- start start 2023-11-28T21:04:17.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45f6780640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45f0150b40 0x7f45f0157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45f6780640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f45f00c6ff0 0x7f45f00c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45f6780640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c5be0 0x7f45f006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45f6780640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f00c6ac0 con 0x7f45f00c6ff0 2023-11-28T21:04:17.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45f6780640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f00c6500 con 0x7f45f0150b40 2023-11-28T21:04:17.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45f6780640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00c67e0 con 0x7f45f00c5be0 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45effff640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f45f0150b40 msgr2=0x7f45f0157560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45effff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45f0150b40 0x7f45f0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45ef7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f45f00c6ff0 0x7f45f00c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45ef7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f45f00c6ff0 0x7f45f00c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49462/0 (socket says 172.21.15.167:49462) 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45ef7fe640 1 -- 172.21.15.167:0/1904055754 learned_addr learned my addr 172.21.15.167:0/1904055754 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.250+0000 7f45f4d1d640 1 --2- 172.21.15.167:0/1904055754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c5be0 0x7f45f006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45ef7fe640 1 -- 172.21.15.167:0/1904055754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c5be0 msgr2=0x7f45f006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45ef7fe640 1 --2- 172.21.15.167:0/1904055754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c5be0 0x7f45f006a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45ef7fe640 1 -- 172.21.15.167:0/1904055754 >> v2:172.21.15.178:3300/0 conn(0x7f45f0150b40 msgr2=0x7f45f0157560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45ef7fe640 1 --2- 172.21.15.167:0/1904055754 >> v2:172.21.15.178:3300/0 conn(0x7f45f0150b40 0x7f45f0157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45ef7fe640 1 -- 172.21.15.167:0/1904055754 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f0156a80 con 0x7f45f00c6ff0 2023-11-28T21:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45ef7fe640 1 --2- 172.21.15.167:0/1904055754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f00c6ff0 0x7f45f00c4510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45f00cc090 tx=0x7f45e401e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8e7b17542df172 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45eeffd640 1 -- 172.21.15.167:0/1904055754 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40a8690 con 0x7f45f00c6ff0 2023-11-28T21:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45eeffd640 1 -- 172.21.15.167:0/1904055754 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e40a87f0 con 0x7f45f00c6ff0 2023-11-28T21:04:17.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45eeffd640 1 -- 172.21.15.167:0/1904055754 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40a8b80 con 0x7f45f00c6ff0 2023-11-28T21:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45f6780640 1 -- 172.21.15.167:0/1904055754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f00c6ff0 msgr2=0x7f45f00c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45f6780640 1 --2- 172.21.15.167:0/1904055754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f00c6ff0 0x7f45f00c4510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45f00cc090 tx=0x7f45e401e700 comp rx=0 tx=0).stop 2023-11-28T21:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45f6780640 1 -- 172.21.15.167:0/1904055754 shutdown_connections 2023-11-28T21:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45f6780640 1 --2- 172.21.15.167:0/1904055754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c5be0 0x7f45f006a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45f6780640 1 --2- 172.21.15.167:0/1904055754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f00c6ff0 0x7f45f00c4510 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45f6780640 1 --2- 172.21.15.167:0/1904055754 >> v2:172.21.15.178:3300/0 conn(0x7f45f0150b40 0x7f45f0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.254+0000 7f45f6780640 1 -- 172.21.15.167:0/1904055754 >> 172.21.15.167:0/1904055754 conn(0x7f45f00cb1e0 msgr2=0x7f45f00cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 -- 172.21.15.167:0/1904055754 shutdown_connections 2023-11-28T21:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 -- 172.21.15.167:0/1904055754 wait complete. 2023-11-28T21:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 Processor -- start 2023-11-28T21:04:17.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 -- start start 2023-11-28T21:04:17.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45f00c5be0 0x7f45f013abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c6ff0 0x7f45f01593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f0150b40 0x7f45f013f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0158880 con 0x7f45f0150b40 2023-11-28T21:04:17.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f01ee7c0 con 0x7f45f00c5be0 2023-11-28T21:04:17.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f6780640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f01ef770 con 0x7f45f00c6ff0 2023-11-28T21:04:17.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45effff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45f00c5be0 msgr2=0x7f45f013abd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:17.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45effff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45f00c5be0 0x7f45f013abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:17.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f4d1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f0150b40 0x7f45f013f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f4d1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f0150b40 0x7f45f013f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49472/0 (socket says 172.21.15.167:49472) 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f4d1d640 1 -- 172.21.15.167:0/4128373471 learned_addr learned my addr 172.21.15.167:0/4128373471 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45ef7fe640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c6ff0 0x7f45f01593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f4d1d640 1 -- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c6ff0 msgr2=0x7f45f01593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f4d1d640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c6ff0 0x7f45f01593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f4d1d640 1 -- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45f00c5be0 msgr2=0x7f45f013abd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f4d1d640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45f00c5be0 0x7f45f013abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f4d1d640 1 -- 172.21.15.167:0/4128373471 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40094d0 con 0x7f45f0150b40 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45ef7fe640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c6ff0 0x7f45f01593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.258+0000 7f45f4d1d640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f0150b40 0x7f45f013f060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009dd0 tx=0x7f45e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:17.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45ecff9640 1 -- 172.21.15.167:0/4128373471 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8014480 con 0x7f45f0150b40 2023-11-28T21:04:17.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45ecff9640 1 -- 172.21.15.167:0/4128373471 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e800f040 con 0x7f45f0150b40 2023-11-28T21:04:17.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f01ef2e0 con 0x7f45f0150b40 2023-11-28T21:04:17.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45ecff9640 1 -- 172.21.15.167:0/4128373471 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8014840 con 0x7f45f0150b40 2023-11-28T21:04:17.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f01ee9b0 con 0x7f45f0150b40 2023-11-28T21:04:17.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f00682c0 con 0x7f45f0150b40 2023-11-28T21:04:17.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45ecff9640 1 -- 172.21.15.167:0/4128373471 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45e80149a0 con 0x7f45f0150b40 2023-11-28T21:04:17.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45ecff9640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f45dc066420 0x7f45dc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45ecff9640 1 -- 172.21.15.167:0/4128373471 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f45e80851f0 con 0x7f45f0150b40 2023-11-28T21:04:17.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.262+0000 7f45effff640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f45dc066420 0x7f45dc0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.266+0000 7f45effff640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f45dc066420 0x7f45dc0688e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f45e0003940 tx=0x7f45e0006d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:17.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.266+0000 7f45ecff9640 1 -- 172.21.15.167:0/4128373471 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45e8052150 con 0x7f45f0150b40 2023-11-28T21:04:17.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.414+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45f0075c90 con 0x7f45f0150b40 2023-11-28T21:04:17.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45ecff9640 1 -- 172.21.15.167:0/4128373471 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45e8055770 con 0x7f45f0150b40 2023-11-28T21:04:17.417 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T21:04:17.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f45dc066420 msgr2=0x7f45dc0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f45dc066420 0x7f45dc0688e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f45e0003940 tx=0x7f45e0006d90 comp rx=0 tx=0).stop 2023-11-28T21:04:17.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f0150b40 msgr2=0x7f45f013f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f0150b40 0x7f45f013f060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009dd0 tx=0x7f45e800c490 comp rx=0 tx=0).stop 2023-11-28T21:04:17.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 shutdown_connections 2023-11-28T21:04:17.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f45dc066420 0x7f45dc0688e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45f0150b40 0x7f45f013f060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45f00c6ff0 0x7f45f01593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 --2- 172.21.15.167:0/4128373471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45f00c5be0 0x7f45f013abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 >> 172.21.15.167:0/4128373471 conn(0x7f45f00cb1e0 msgr2=0x7f45f006ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:17.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 shutdown_connections 2023-11-28T21:04:17.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.418+0000 7f45f6780640 1 -- 172.21.15.167:0/4128373471 wait complete. 2023-11-28T21:04:17.438 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:04:17.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4ea0e3640 1 Processor -- start 2023-11-28T21:04:17.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4ea0e3640 1 -- start start 2023-11-28T21:04:17.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4ea0e3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e4157560 0x7fe4e40c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4ea0e3640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e4157970 con 0x7fe4e4150b40 2023-11-28T21:04:17.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4ea0e3640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e40c6ac0 con 0x7fe4e40c6ff0 2023-11-28T21:04:17.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4ea0e3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e40c62f0 con 0x7fe4e4157560 2023-11-28T21:04:17.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4e2ffd640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7fe4e40c6ff0 legacy=0x7fe4e406a580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:04:17.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4e37fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe4e4150b40 0x7fe4e40c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:32884/0 (socket says 172.21.15.167:32884) 2023-11-28T21:04:17.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4e37fe640 1 -- 172.21.15.167:0/3432029381 learned_addr learned my addr 172.21.15.167:0/3432029381 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:17.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4e3fff640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e4157560 0x7fe4e40c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.578+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964036260 0 0) 0x7fe4e4157970 con 0x7fe4e4150b40 2023-11-28T21:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4cc003530 con 0x7fe4e4150b40 2023-11-28T21:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2581696817 0 0) 0x7fe4cc003530 con 0x7fe4e4150b40 2023-11-28T21:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e4157560 msgr2=0x7fe4e40c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e4157560 0x7fe4e40c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 >> v1:172.21.15.178:6789/0 conn(0x7fe4e40c6ff0 legacy=0x7fe4e406a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e40c6500 con 0x7fe4e4150b40 2023-11-28T21:04:17.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fe4d40016a0 con 0x7fe4e4150b40 2023-11-28T21:04:17.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 >> v1:172.21.15.167:6789/0 conn(0x7fe4e4150b40 legacy=0x7fe4e40c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0039b0 0x7fe4cc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e4157560 0x7fe4cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4cc004d10 0x7fe4cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e40c62f0 con 0x7fe4cc004d10 2023-11-28T21:04:17.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc00dce0 con 0x7fe4cc0039b0 2023-11-28T21:04:17.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc00de50 con 0x7fe4e4157560 2023-11-28T21:04:17.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e37fe640 1 -- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0039b0 msgr2=0x7fe4cc003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:17.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e37fe640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0039b0 0x7fe4cc003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:17.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e2ffd640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e4157560 0x7fe4cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e3fff640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4cc004d10 0x7fe4cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e3fff640 1 -- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e4157560 msgr2=0x7fe4cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:17.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e3fff640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e4157560 0x7fe4cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e3fff640 1 -- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0039b0 msgr2=0x7fe4cc003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:17.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e3fff640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc0039b0 0x7fe4cc003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.582+0000 7fe4e3fff640 1 -- 172.21.15.167:0/3432029381 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc003530 con 0x7fe4cc004d10 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4e3fff640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4cc004d10 0x7fe4cc005190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009fc0 tx=0x7fe4dc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e21758f74d62331 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0a5c70 con 0x7fe4cc004d10 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc00f040 con 0x7fe4cc004d10 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4e27fc640 1 -- 172.21.15.167:0/3432029381 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0ad440 con 0x7fe4cc004d10 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3432029381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4cc004d10 msgr2=0x7fe4cc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 --2- 172.21.15.167:0/3432029381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4cc004d10 0x7fe4cc005190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009fc0 tx=0x7fe4dc01cc60 comp rx=0 tx=0).stop 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4e3fff640 1 -- 172.21.15.167:0/3432029381 reap_dead start 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3432029381 shutdown_connections 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3432029381 >> 172.21.15.167:0/3432029381 conn(0x7fe4e40cb1e0 msgr2=0x7fe4e40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3432029381 shutdown_connections 2023-11-28T21:04:17.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3432029381 wait complete. 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 Processor -- start 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 -- start start 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc004d10 0x7fe4e415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e41546e0 0x7fe4e406a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e41580f0 0x7fe4e4158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e4158ab0 con 0x7fe4e41580f0 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e41eff10 con 0x7fe4e41546e0 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.586+0000 7fe4ea0e3640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e41ef390 con 0x7fe4cc004d10 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e2ffd640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e41546e0 msgr2=0x7fe4e406a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e2ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e41546e0 0x7fe4e406a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e41580f0 0x7fe4e4158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e41580f0 0x7fe4e4158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49486/0 (socket says 172.21.15.167:49486) 2023-11-28T21:04:17.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e3fff640 1 -- 172.21.15.167:0/3520928989 learned_addr learned my addr 172.21.15.167:0/3520928989 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e37fe640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc004d10 0x7fe4e415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e3fff640 1 -- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc004d10 msgr2=0x7fe4e415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e3fff640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc004d10 0x7fe4e415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e3fff640 1 -- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e41546e0 msgr2=0x7fe4e406a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e3fff640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e41546e0 0x7fe4e406a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e3fff640 1 -- 172.21.15.167:0/3520928989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e41ef670 con 0x7fe4e41580f0 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4e3fff640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e41580f0 0x7fe4e4158570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0b0040 tx=0x7fe4dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4cbfff640 1 -- 172.21.15.167:0/3520928989 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0bc070 con 0x7fe4e41580f0 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4cbfff640 1 -- 172.21.15.167:0/3520928989 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc0039a0 con 0x7fe4e41580f0 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4cbfff640 1 -- 172.21.15.167:0/3520928989 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc003b30 con 0x7fe4e41580f0 2023-11-28T21:04:17.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e41ef950 con 0x7fe4e41580f0 2023-11-28T21:04:17.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e4157bd0 con 0x7fe4e41580f0 2023-11-28T21:04:17.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e40682c0 con 0x7fe4e41580f0 2023-11-28T21:04:17.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4cbfff640 1 -- 172.21.15.167:0/3520928989 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4dc0b4040 con 0x7fe4e41580f0 2023-11-28T21:04:17.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4cbfff640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe4d0066420 0x7fe4d00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.590+0000 7fe4cbfff640 1 -- 172.21.15.167:0/3520928989 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fe4dc11e6a0 con 0x7fe4e41580f0 2023-11-28T21:04:17.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.594+0000 7fe4e37fe640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe4d0066420 0x7fe4d00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.594+0000 7fe4e37fe640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe4d0066420 0x7fe4d00688e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40011f0 tx=0x7fe4d40016b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:17.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.594+0000 7fe4cbfff640 1 -- 172.21.15.167:0/3520928989 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4dc0eb600 con 0x7fe4e41580f0 2023-11-28T21:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.742+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4e4075c90 con 0x7fe4e41580f0 2023-11-28T21:04:17.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4cbfff640 1 -- 172.21.15.167:0/3520928989 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4dc0b20a0 con 0x7fe4e41580f0 2023-11-28T21:04:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 64 2023-11-28T21:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe4d0066420 msgr2=0x7fe4d00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe4d0066420 0x7fe4d00688e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40011f0 tx=0x7fe4d40016b0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e41580f0 msgr2=0x7fe4e4158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e41580f0 0x7fe4e4158570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0b0040 tx=0x7fe4dc009750 comp rx=0 tx=0).stop 2023-11-28T21:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 shutdown_connections 2023-11-28T21:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe4d0066420 0x7fe4d00688e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e41580f0 0x7fe4e4158570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4e41546e0 0x7fe4e406a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 --2- 172.21.15.167:0/3520928989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4cc004d10 0x7fe4e415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 >> 172.21.15.167:0/3520928989 conn(0x7fe4e40cb1e0 msgr2=0x7fe4e4071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 shutdown_connections 2023-11-28T21:04:17.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.746+0000 7fe4ea0e3640 1 -- 172.21.15.167:0/3520928989 wait complete. 2023-11-28T21:04:17.766 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-28T21:04:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36ee157640 1 Processor -- start 2023-11-28T21:04:17.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36ee157640 1 -- start start 2023-11-28T21:04:17.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36ee157640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f36e8153fa0 0x7f36e80c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36ee157640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f36e815de80 0x7f36e806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36ee157640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e815ada0 con 0x7f36e80c63d0 2023-11-28T21:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36ee157640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e8159f40 con 0x7f36e815de80 2023-11-28T21:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36ee157640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e815a220 con 0x7f36e8153fa0 2023-11-28T21:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36e7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f36e815de80 0x7f36e806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36e77fe640 1 -- >> v2:172.21.15.178:3300/0 conn(0x7f36e8153fa0 msgr2=0x7f36e80c5e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36e7fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f36e815de80 0x7f36e806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49494/0 (socket says 172.21.15.167:49494) 2023-11-28T21:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36e77fe640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f36e8153fa0 0x7f36e80c5e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:17.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.906+0000 7f36e7fff640 1 -- 172.21.15.167:0/1233344277 learned_addr learned my addr 172.21.15.167:0/1233344277 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36e7fff640 1 -- 172.21.15.167:0/1233344277 >> v2:172.21.15.178:3300/0 conn(0x7f36e8153fa0 msgr2=0x7f36e80c5e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36e7fff640 1 --2- 172.21.15.167:0/1233344277 >> v2:172.21.15.178:3300/0 conn(0x7f36e8153fa0 0x7f36e80c5e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36e7fff640 1 -- 172.21.15.167:0/1233344277 >> v1:172.21.15.167:6789/0 conn(0x7f36e80c63d0 legacy=0x7f36e815d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36e7fff640 1 -- 172.21.15.167:0/1233344277 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e815a500 con 0x7f36e815de80 2023-11-28T21:04:17.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36e7fff640 1 --2- 172.21.15.167:0/1233344277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e815de80 0x7f36e806a580 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36e806fe30 tx=0x7f36e001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40f49875f0f6426 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:17.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36e6ffd640 1 -- 172.21.15.167:0/1233344277 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00a5790 con 0x7f36e815de80 2023-11-28T21:04:17.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36e6ffd640 1 -- 172.21.15.167:0/1233344277 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e00a58f0 con 0x7f36e815de80 2023-11-28T21:04:17.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36e6ffd640 1 -- 172.21.15.167:0/1233344277 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00a5c80 con 0x7f36e815de80 2023-11-28T21:04:17.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36ee157640 1 -- 172.21.15.167:0/1233344277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e815de80 msgr2=0x7f36e806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.910+0000 7f36ee157640 1 --2- 172.21.15.167:0/1233344277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e815de80 0x7f36e806a580 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f36e806fe30 tx=0x7f36e001c9c0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 -- 172.21.15.167:0/1233344277 shutdown_connections 2023-11-28T21:04:17.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 --2- 172.21.15.167:0/1233344277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e815de80 0x7f36e806a580 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 --2- 172.21.15.167:0/1233344277 >> v2:172.21.15.178:3300/0 conn(0x7f36e8153fa0 0x7f36e80c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 -- 172.21.15.167:0/1233344277 >> 172.21.15.167:0/1233344277 conn(0x7f36e80cb1e0 msgr2=0x7f36e80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:17.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 -- 172.21.15.167:0/1233344277 shutdown_connections 2023-11-28T21:04:17.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 -- 172.21.15.167:0/1233344277 wait complete. 2023-11-28T21:04:17.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 Processor -- start 2023-11-28T21:04:17.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 -- start start 2023-11-28T21:04:17.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36e80c63d0 0x7f36e815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e8153fa0 0x7f36e815c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36e815de80 0x7f36e80c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8145310 con 0x7f36e8153fa0 2023-11-28T21:04:17.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80ca810 con 0x7f36e815de80 2023-11-28T21:04:17.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8146cc0 con 0x7f36e80c63d0 2023-11-28T21:04:17.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36dffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e8153fa0 0x7f36e815c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36e7fff640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36e815de80 msgr2=0x7f36e80c3c70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:17.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36e7fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36e815de80 0x7f36e80c3c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:17.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36dffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e8153fa0 0x7f36e815c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49504/0 (socket says 172.21.15.167:49504) 2023-11-28T21:04:17.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36dffff640 1 -- 172.21.15.167:0/2767622527 learned_addr learned my addr 172.21.15.167:0/2767622527 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:17.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36e77fe640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36e80c63d0 0x7f36e815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36dffff640 1 -- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36e80c63d0 msgr2=0x7f36e815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:17.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36dffff640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36e80c63d0 0x7f36e815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36dffff640 1 -- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36e815de80 msgr2=0x7f36e80c3c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:17.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36dffff640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36e815de80 0x7f36e80c3c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:17.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36dffff640 1 -- 172.21.15.167:0/2767622527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e0009b30 con 0x7f36e8153fa0 2023-11-28T21:04:17.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36dffff640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e8153fa0 0x7f36e815c700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36d000c500 tx=0x7f36d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:17.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36e4ff9640 1 -- 172.21.15.167:0/2767622527 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0005220 con 0x7f36e8153fa0 2023-11-28T21:04:17.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36e4ff9640 1 -- 172.21.15.167:0/2767622527 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d0005380 con 0x7f36e8153fa0 2023-11-28T21:04:17.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36e4ff9640 1 -- 172.21.15.167:0/2767622527 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0007270 con 0x7f36e8153fa0 2023-11-28T21:04:17.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.914+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e80caec0 con 0x7f36e8153fa0 2023-11-28T21:04:17.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.918+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e8157d80 con 0x7f36e8153fa0 2023-11-28T21:04:17.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.918+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e80682c0 con 0x7f36e8153fa0 2023-11-28T21:04:17.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.918+0000 7f36e4ff9640 1 -- 172.21.15.167:0/2767622527 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f36d00073d0 con 0x7f36e8153fa0 2023-11-28T21:04:17.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.918+0000 7f36e4ff9640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c8066420 0x7f36c80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:17.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.918+0000 7f36e4ff9640 1 -- 172.21.15.167:0/2767622527 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f36d0083a70 con 0x7f36e8153fa0 2023-11-28T21:04:17.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.918+0000 7f36e77fe640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c8066420 0x7f36c80688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:17.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.918+0000 7f36e77fe640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c8066420 0x7f36c80688e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f36d8006fd0 tx=0x7f36d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:17.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:17.922+0000 7f36e4ff9640 1 -- 172.21.15.167:0/2767622527 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36d0050a70 con 0x7f36e8153fa0 2023-11-28T21:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.070+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f36e815ada0 con 0x7f36e8153fa0 2023-11-28T21:04:18.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.070+0000 7f36e4ff9640 1 -- 172.21.15.167:0/2767622527 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v51) v1 ==== 103+0+11 (secure 0 0 0) 0x7f36e815ada0 con 0x7f36e8153fa0 2023-11-28T21:04:18.071 INFO:teuthology.orchestra.run.smithi167.stdout:pg_num: 32 2023-11-28T21:04:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.070+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c8066420 msgr2=0x7f36c80688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.070+0000 7f36ee157640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c8066420 0x7f36c80688e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f36d8006fd0 tx=0x7f36d8008040 comp rx=0 tx=0).stop 2023-11-28T21:04:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e8153fa0 msgr2=0x7f36e815c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:18.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e8153fa0 0x7f36e815c700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36d000c500 tx=0x7f36d000c9c0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 shutdown_connections 2023-11-28T21:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36c8066420 0x7f36c80688e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36e815de80 0x7f36e80c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36e8153fa0 0x7f36e815c700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 --2- 172.21.15.167:0/2767622527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36e80c63d0 0x7f36e815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 >> 172.21.15.167:0/2767622527 conn(0x7f36e80cb1e0 msgr2=0x7f36e80cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 shutdown_connections 2023-11-28T21:04:18.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.074+0000 7f36ee157640 1 -- 172.21.15.167:0/2767622527 wait complete. 2023-11-28T21:04:18.093 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T21:04:18.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.230+0000 7fefeade6640 1 Processor -- start 2023-11-28T21:04:18.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.230+0000 7fefeade6640 1 -- start start 2023-11-28T21:04:18.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefeade6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fefe40c6ff0 0x7fefe4157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:18.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefeade6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c4510 0x7fefe406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:18.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefeade6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40c4920 con 0x7fefe4150b40 2023-11-28T21:04:18.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefeade6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40c62f0 con 0x7fefe40c6ff0 2023-11-28T21:04:18.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefeade6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c6ac0 con 0x7fefe40c4510 2023-11-28T21:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefe8b82640 1 -- >> v1:172.21.15.178:6789/0 conn(0x7fefe4150b40 legacy=0x7fefe40c5be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefe3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fefe40c6ff0 0x7fefe4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefe3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fefe40c6ff0 0x7fefe4157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49514/0 (socket says 172.21.15.167:49514) 2023-11-28T21:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefe3fff640 1 -- 172.21.15.167:0/436533158 learned_addr learned my addr 172.21.15.167:0/436533158 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefe9383640 1 --2- 172.21.15.167:0/436533158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c4510 0x7fefe406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefe3fff640 1 -- 172.21.15.167:0/436533158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c4510 msgr2=0x7fefe406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefe3fff640 1 --2- 172.21.15.167:0/436533158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c4510 0x7fefe406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefe3fff640 1 -- 172.21.15.167:0/436533158 >> v1:172.21.15.178:6789/0 conn(0x7fefe4150b40 legacy=0x7fefe40c5be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:18.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.234+0000 7fefe3fff640 1 -- 172.21.15.167:0/436533158 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40c6500 con 0x7fefe40c6ff0 2023-11-28T21:04:18.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefe3fff640 1 --2- 172.21.15.167:0/436533158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 0x7fefe4157560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefe406bba0 tx=0x7fefd001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7db48d05bd2544 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:18.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefe37fe640 1 -- 172.21.15.167:0/436533158 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00ad680 con 0x7fefe40c6ff0 2023-11-28T21:04:18.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefe37fe640 1 -- 172.21.15.167:0/436533158 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00ad7e0 con 0x7fefe40c6ff0 2023-11-28T21:04:18.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefe37fe640 1 -- 172.21.15.167:0/436533158 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00adb70 con 0x7fefe40c6ff0 2023-11-28T21:04:18.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 -- 172.21.15.167:0/436533158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 msgr2=0x7fefe4157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:18.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 --2- 172.21.15.167:0/436533158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 0x7fefe4157560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefe406bba0 tx=0x7fefd001c4b0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 -- 172.21.15.167:0/436533158 shutdown_connections 2023-11-28T21:04:18.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 --2- 172.21.15.167:0/436533158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c4510 0x7fefe406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 --2- 172.21.15.167:0/436533158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 0x7fefe4157560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 -- 172.21.15.167:0/436533158 >> 172.21.15.167:0/436533158 conn(0x7fefe40cb1e0 msgr2=0x7fefe40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 -- 172.21.15.167:0/436533158 shutdown_connections 2023-11-28T21:04:18.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 -- 172.21.15.167:0/436533158 wait complete. 2023-11-28T21:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 Processor -- start 2023-11-28T21:04:18.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.238+0000 7fefeade6640 1 -- start start 2023-11-28T21:04:18.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefeade6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe40c4510 0x7fefe406e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:18.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefeade6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 0x7fefe4144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefeade6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe4150b40 0x7fefe4145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefeade6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe415a920 con 0x7fefe40c6ff0 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefeade6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe41589a0 con 0x7fefe40c4510 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefeade6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4159da0 con 0x7fefe4150b40 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe8b82640 1 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe40c4510 msgr2=0x7fefe406e030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe8b82640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe40c4510 0x7fefe406e030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 0x7fefe4144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 0x7fefe4144fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49524/0 (socket says 172.21.15.167:49524) 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe3fff640 1 -- 172.21.15.167:0/1549149043 learned_addr learned my addr 172.21.15.167:0/1549149043 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe9383640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe4150b40 0x7fefe4145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe3fff640 1 -- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe4150b40 msgr2=0x7fefe4145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:18.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe3fff640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe4150b40 0x7fefe4145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe3fff640 1 -- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe40c4510 msgr2=0x7fefe406e030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:18.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe3fff640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe40c4510 0x7fefe406e030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe3fff640 1 -- 172.21.15.167:0/1549149043 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00094d0 con 0x7fefe40c6ff0 2023-11-28T21:04:18.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe3fff640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 0x7fefe4144fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefd001ab60 tx=0x7fefd001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:18.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe17fa640 1 -- 172.21.15.167:0/1549149043 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00adde0 con 0x7fefe40c6ff0 2023-11-28T21:04:18.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe17fa640 1 -- 172.21.15.167:0/1549149043 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00b8450 con 0x7fefe40c6ff0 2023-11-28T21:04:18.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe415a080 con 0x7fefe40c6ff0 2023-11-28T21:04:18.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe17fa640 1 -- 172.21.15.167:0/1549149043 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00b87c0 con 0x7fefe40c6ff0 2023-11-28T21:04:18.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe415a640 con 0x7fefe40c6ff0 2023-11-28T21:04:18.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40682c0 con 0x7fefe40c6ff0 2023-11-28T21:04:18.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.242+0000 7fefe17fa640 1 -- 172.21.15.167:0/1549149043 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fefd00b4070 con 0x7fefe40c6ff0 2023-11-28T21:04:18.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.246+0000 7fefe17fa640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefc8066420 0x7fefc80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:18.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.246+0000 7fefe17fa640 1 -- 172.21.15.167:0/1549149043 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fefd011e3b0 con 0x7fefe40c6ff0 2023-11-28T21:04:18.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.246+0000 7fefe8b82640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefc8066420 0x7fefc80688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:18.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.246+0000 7fefe8b82640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefc8066420 0x7fefc80688e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fefd8003940 tx=0x7fefd8006d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:18.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.246+0000 7fefe17fa640 1 -- 172.21.15.167:0/1549149043 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fefd00eb3a0 con 0x7fefe40c6ff0 2023-11-28T21:04:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.410+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fefe4075c90 con 0x7fefe40c6ff0 2023-11-28T21:04:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefe17fa640 1 -- 172.21.15.167:0/1549149043 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) v1 ==== 80+0+0 (secure 0 0 0) 0x7fefd00ee9c0 con 0x7fefe40c6ff0 2023-11-28T21:04:18.413 INFO:teuthology.orchestra.run.smithi167.stderr:listed 0 entries 2023-11-28T21:04:18.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefc8066420 msgr2=0x7fefc80688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:18.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefc8066420 0x7fefc80688e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fefd8003940 tx=0x7fefd8006d90 comp rx=0 tx=0).stop 2023-11-28T21:04:18.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 msgr2=0x7fefe4144fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:18.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 0x7fefe4144fe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefd001ab60 tx=0x7fefd001acf0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 shutdown_connections 2023-11-28T21:04:18.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fefc8066420 0x7fefc80688e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe4150b40 0x7fefe4145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefe40c6ff0 0x7fefe4144fe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 --2- 172.21.15.167:0/1549149043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe40c4510 0x7fefe406e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:18.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 >> 172.21.15.167:0/1549149043 conn(0x7fefe40cb1e0 msgr2=0x7fefe40cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:18.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 shutdown_connections 2023-11-28T21:04:18.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:18.414+0000 7fefeade6640 1 -- 172.21.15.167:0/1549149043 wait complete. 2023-11-28T21:04:18.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T21:04:18.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:04:18.435 DEBUG:teuthology.orchestra.run.smithi167:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-28T21:04:18.474 INFO:tasks.workunit.client.0.smithi167.stderr:fatal: failed to stat '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph': Input/output error 2023-11-28T21:04:19.697 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:04:19.989 INFO:teuthology.orchestra.run.smithi167.stderr:umount: /home/ubuntu/cephtest/mnt.0: target is busy. 2023-11-28T21:04:19.989 DEBUG:teuthology.orchestra.run:got remote process result: 128 2023-11-28T21:04:19.989 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2023-11-28T21:04:19.989 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-28T21:04:19.990 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-28T21:04:19.990 DEBUG:tasks.cephfs.kernel_mount:Killing processes on client.0... 2023-11-28T21:04:19.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:04:19.991 DEBUG:teuthology.orchestra.run.smithi167:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-11-28T21:04:22.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.358+0000 7f980a29e640 1 Processor -- start 2023-11-28T21:04:22.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.358+0000 7f980a29e640 1 -- start start 2023-11-28T21:04:22.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.358+0000 7f980a29e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f980406e6b0 0x7f980406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:22.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.358+0000 7f9803fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f98041640b0 0x7f98040c63d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:32902/0 (socket says 172.21.15.167:32902) 2023-11-28T21:04:22.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.358+0000 7f9803fff640 1 -- 172.21.15.167:0/1836171612 learned_addr learned my addr 172.21.15.167:0/1836171612 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:22.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.358+0000 7f980883b640 1 -- 172.21.15.167:0/1836171612 >> v1:172.21.15.178:6789/0 conn(0x7f980406db60 legacy=0x7f98041712c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:04:22.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.358+0000 7f980a29e640 1 -- 172.21.15.167:0/1836171612 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040c5f40 con 0x7f98041640b0 2023-11-28T21:04:22.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.358+0000 7f980a29e640 1 -- 172.21.15.167:0/1836171612 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9804164490 con 0x7f980406db60 2023-11-28T21:04:22.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.358+0000 7f980a29e640 1 -- 172.21.15.167:0/1836171612 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98040c7850 con 0x7f980406e6b0 2023-11-28T21:04:22.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.578+0000 7f980883b640 1 -- 172.21.15.167:0/1836171612 >> v1:172.21.15.178:6789/0 conn(0x7f980406db60 legacy=0x7f98041712c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:04:22.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.926+0000 7f98037fe640 1 --2- 172.21.15.167:0/1836171612 >> v2:172.21.15.167:3300/0 conn(0x7f980406e6b0 0x7f980406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:22.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.926+0000 7f98037fe640 1 -- 172.21.15.167:0/1836171612 >> v1:172.21.15.178:6789/0 conn(0x7f980406db60 legacy=0x7f98041712c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:22.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.926+0000 7f98037fe640 1 -- 172.21.15.167:0/1836171612 >> v1:172.21.15.167:6789/0 conn(0x7f98041640b0 legacy=0x7f98040c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:22.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.926+0000 7f98037fe640 1 -- 172.21.15.167:0/1836171612 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98041674a0 con 0x7f980406e6b0 2023-11-28T21:04:22.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:22.926+0000 7f98037fe640 1 --2- 172.21.15.167:0/1836171612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f980406e6b0 0x7f980406d620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f97f4008840 tx=0x7f97f40211a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f845d1d57e92b904 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f9802ffd640 1 -- 172.21.15.167:0/1836171612 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40b1600 con 0x7f980406e6b0 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f9802ffd640 1 -- 172.21.15.167:0/1836171612 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f40ad050 con 0x7f980406e6b0 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f9802ffd640 1 -- 172.21.15.167:0/1836171612 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40b1960 con 0x7f980406e6b0 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- 172.21.15.167:0/1836171612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f980406e6b0 msgr2=0x7f980406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 --2- 172.21.15.167:0/1836171612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f980406e6b0 0x7f980406d620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f97f4008840 tx=0x7f97f40211a0 comp rx=0 tx=0).stop 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- 172.21.15.167:0/1836171612 shutdown_connections 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 --2- 172.21.15.167:0/1836171612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f980406e6b0 0x7f980406d620 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- 172.21.15.167:0/1836171612 >> 172.21.15.167:0/1836171612 conn(0x7f98040c7c50 msgr2=0x7f98040c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- 172.21.15.167:0/1836171612 shutdown_connections 2023-11-28T21:04:23.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- 172.21.15.167:0/1836171612 wait complete. 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 Processor -- start 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- start start 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f980406db60 0x7f98041f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98041640b0 0x7f9804200810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98041fd580 0x7f98041eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98041f26c0 con 0x7f98041fd580 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98041fd160 con 0x7f980406db60 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98041fc890 con 0x7f98041640b0 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980883b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98041fd580 0x7f98041eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980883b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98041fd580 0x7f98041eeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51206/0 (socket says 172.21.15.167:51206) 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980883b640 1 -- 172.21.15.167:0/1958846611 learned_addr learned my addr 172.21.15.167:0/1958846611 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980883b640 1 -- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98041640b0 msgr2=0x7f9804200810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T21:04:23.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980883b640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98041640b0 0x7f9804200810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980883b640 1 -- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f980406db60 msgr2=0x7f98041f1a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980883b640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f980406db60 0x7f98041f1a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980883b640 1 -- 172.21.15.167:0/1958846611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40084a0 con 0x7f98041fd580 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980883b640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98041fd580 0x7f98041eeb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97f800b3f0 tx=0x7f97f800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f9800ff9640 1 -- 172.21.15.167:0/1958846611 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8003e50 con 0x7f98041fd580 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f9800ff9640 1 -- 172.21.15.167:0/1958846611 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f8005070 con 0x7f98041fd580 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f9800ff9640 1 -- 172.21.15.167:0/1958846611 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8005420 con 0x7f98041fd580 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- 172.21.15.167:0/1958846611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9804200d50 con 0x7f98041fd580 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f980a29e640 1 -- 172.21.15.167:0/1958846611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98041f23e0 con 0x7f98041fd580 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f9800ff9640 1 -- 172.21.15.167:0/1958846611 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97f8005580 con 0x7f98041fd580 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f9800ff9640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97f0066470 0x7f97f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.310+0000 7f97ea7fc640 1 -- 172.21.15.167:0/1958846611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980404e850 con 0x7f98041fd580 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.330+0000 7f9800ff9640 1 -- 172.21.15.167:0/1958846611 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f97f8054a40 con 0x7f98041fd580 2023-11-28T21:04:23.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:23.330+0000 7f9800ff9640 1 -- 172.21.15.167:0/1958846611 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97f8053e80 con 0x7f98041fd580 2023-11-28T21:04:23.429 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi167 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2023-11-28T21:04:23.542 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ee0fa62093e746448668608eb2d2fe4b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi167 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2023-11-28T21:04:23.546 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2023-11-28T21:04:23.555 INFO:tasks.mon_thrash:joining mon_thrasher 2023-11-28T21:04:23.810 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:04:28.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:26.406+0000 7f97ea7fc640 1 -- 172.21.15.167:0/1958846611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9804200d50 con 0x7f98041fd580 2023-11-28T21:04:28.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:26.406+0000 7f9803fff640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97f0066470 0x7f97f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:29.597 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:04:29.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:29.602+0000 7f9803fff640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97f0066470 0x7f97f0068930 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f97fc001f70 tx=0x7f97fc001560 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:29.702 INFO:teuthology.orchestra.run.smithi167.stderr:lsof: WARNING: can't stat() ceph file system /home/ubuntu/cephtest/mnt.0 2023-11-28T21:04:29.703 INFO:teuthology.orchestra.run.smithi167.stderr: Output information may be incomplete. 2023-11-28T21:04:31.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f9800ff9640 1 -- 172.21.15.167:0/1958846611 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7f9804200d50 con 0x7f98041fd580 2023-11-28T21:04:31.487 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":200,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:04:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 -- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97f0066470 msgr2=0x7f97f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97f0066470 0x7f97f0068930 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f97fc001f70 tx=0x7f97fc001560 comp rx=0 tx=0).stop 2023-11-28T21:04:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 -- 172.21.15.167:0/1958846611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98041fd580 msgr2=0x7f98041eeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98041fd580 0x7f98041eeb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97f800b3f0 tx=0x7f97f800b8b0 comp rx=0 tx=0).stop 2023-11-28T21:04:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 -- 172.21.15.167:0/1958846611 shutdown_connections 2023-11-28T21:04:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f97f0066470 0x7f97f0068930 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98041fd580 0x7f98041eeb90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98041640b0 0x7f9804200810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 --2- 172.21.15.167:0/1958846611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f980406db60 0x7f98041f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 -- 172.21.15.167:0/1958846611 >> 172.21.15.167:0/1958846611 conn(0x7f98040c7c50 msgr2=0x7f98040c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.486+0000 7f97ea7fc640 1 -- 172.21.15.167:0/1958846611 shutdown_connections 2023-11-28T21:04:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.490+0000 7f97ea7fc640 1 -- 172.21.15.167:0/1958846611 wait complete. 2023-11-28T21:04:31.509 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2023-11-28T21:04:31.510 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2023-11-28T21:04:31.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:04:31.653 INFO:teuthology.orchestra.run.smithi167.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-11-28T21:04:31.653 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.653 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.654 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root txt REG 8,1 1849992 19775 /usr/lib/systemd/systemd 2023-11-28T21:04:31.654 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.654 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.654 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.654 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.654 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.655 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.655 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.655 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.655 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.655 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-28T21:04:31.655 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:31.655 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.655 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.656 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-28T21:04:31.656 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.656 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:31.656 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.656 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-28T21:04:31.656 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-28T21:04:31.656 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:31.656 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.657 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-28T21:04:31.657 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.657 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.657 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.657 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.657 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-11-28T21:04:31.657 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 4u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.657 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 5u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.658 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 6r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.658 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 7r DIR 0,26 0 1 /sys/fs/cgroup 2023-11-28T21:04:31.658 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 8u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.658 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 9u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.658 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 10r REG 0,21 0 9537 /proc/1/mountinfo 2023-11-28T21:04:31.658 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 11r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.658 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 12r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.658 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 13r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.659 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 14r REG 0,21 0 4026532078 /proc/swaps 2023-11-28T21:04:31.659 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 15u netlink 0t0 9538 KOBJECT_UEVENT 2023-11-28T21:04:31.659 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 16r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.660 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 17r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.660 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 19u unix 0xffff98ee0b60a580 0t0 9542 /run/systemd/private type=STREAM 2023-11-28T21:04:31.660 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 20u unix 0xffff98ee0b60ad00 0t0 9544 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM 2023-11-28T21:04:31.660 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 21u unix 0xffff98ee0b60b480 0t0 9545 /run/systemd/io.system.ManagedOOM type=STREAM 2023-11-28T21:04:31.660 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 23u unix 0xffff98ee0b608f00 0t0 9539 /run/systemd/notify type=DGRAM 2023-11-28T21:04:31.660 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 24u unix 0xffff98ee0b609680 0t0 9540 type=DGRAM 2023-11-28T21:04:31.660 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 28r CHR 10,235 0t0 443 /dev/autofs 2023-11-28T21:04:31.660 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 29u unix 0xffff98ee0a976180 0t0 115308 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.661 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 30u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.661 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 32u unix 0xffff98ee0b609e00 0t0 9541 type=DGRAM 2023-11-28T21:04:31.661 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 35u unix 0xffff98ee0b279680 0t0 3402 type=DGRAM 2023-11-28T21:04:31.661 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 36u unix 0xffff98ee0b278f00 0t0 3403 type=DGRAM 2023-11-28T21:04:31.661 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 37u netlink 0t0 3150 ROUTE 2023-11-28T21:04:31.661 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 38u unix 0xffff98ee7d1bbc00 0t0 3151 /run/udev/control type=SEQPACKET 2023-11-28T21:04:31.661 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 39u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:31.661 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 40u netlink 0t0 3153 KOBJECT_UEVENT 2023-11-28T21:04:31.662 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 41u unix 0xffff98ee7d1ba580 0t0 3144 /run/systemd/journal/dev-log type=DGRAM 2023-11-28T21:04:31.662 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 42u unix 0xffff98ee7d1bad00 0t0 3146 /run/systemd/journal/socket type=DGRAM 2023-11-28T21:04:31.662 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 46u unix 0xffff98ee7d1bb480 0t0 3148 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.662 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 47u unix 0xffff98ee7d1b9680 0t0 3135 /run/systemd/journal/syslog type=DGRAM 2023-11-28T21:04:31.662 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 48u FIFO 0,23 0t0 435 /run/initctl 2023-11-28T21:04:31.662 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 49u unix 0xffff98ee0b60bc00 0t0 9577 type=DGRAM 2023-11-28T21:04:31.663 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 50u netlink 0t0 9578 AUDIT 2023-11-28T21:04:31.663 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 52u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.663 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 56u unix 0xffff98ee7d1b9e00 0t0 3137 /run/systemd/fsck.progress type=STREAM 2023-11-28T21:04:31.663 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 58u unix 0xffff98ee05c43480 0t0 8535 /run/uuidd/request type=STREAM 2023-11-28T21:04:31.663 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 62u unix 0xffff98ee01f0d280 0t0 6467 type=STREAM 2023-11-28T21:04:31.663 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 63u unix 0xffff98ee05c43c00 0t0 8534 @ISCSIADM_ABSTRACT_NAMESPACE type=STREAM 2023-11-28T21:04:31.663 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 65r FIFO 0,13 0t0 3124 pipe 2023-11-28T21:04:31.664 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 72u FIFO 0,23 0t0 428 /run/dmeventd-server 2023-11-28T21:04:31.664 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 75u FIFO 0,23 0t0 429 /run/dmeventd-client 2023-11-28T21:04:31.664 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 79u unix 0xffff98ee05c44380 0t0 8530 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.664 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 82u unix 0xffff98ee053bf800 0t0 115094 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.664 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 83u unix 0xffff98ee053bda00 0t0 108229 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.664 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 84u unix 0xffff98ee04fdc380 0t0 55973 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.664 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 85u unix 0xffff98ee70cc1e00 0t0 10220 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.664 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 86u unix 0xffff98ee0b60cb00 0t0 2739 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.665 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 87u unix 0xffff98ee70cc0f00 0t0 9959 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.665 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 88u unix 0xffff98ee08f31680 0t0 9958 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.665 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 89u unix 0xffff98ee0a971680 0t0 9956 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.665 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 90u unix 0xffff98ee09eba580 0t0 9896 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.665 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 91u unix 0xffff98ee05c40000 0t0 9772 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.665 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 92u unix 0xffff98ee04fdda00 0t0 9769 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.665 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 93u unix 0xffff98ee04fdbc00 0t0 9763 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.666 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 94u unix 0xffff98ee0a3c3480 0t0 9762 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.666 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 95u unix 0xffff98ee09ebe180 0t0 9761 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.666 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 96u unix 0xffff98ee0b27ad00 0t0 9758 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.666 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 97u unix 0xffff98ee05c42580 0t0 9757 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.666 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 99u unix 0xffff98ee7d1bc380 0t0 5380 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.666 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 100u unix 0xffff98ee7d1bf080 0t0 4201 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.666 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 125u unix 0xffff98ee053b9680 0t0 9627 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.666 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 126u unix 0xffff98ee01f09680 0t0 101662 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.667 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 127u unix 0xffff98ee01f0b480 0t0 113450 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.667 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 128u unix 0xffff98ee7d1b8000 0t0 3127 /run/lvm/lvmpolld.socket type=STREAM 2023-11-28T21:04:31.667 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 129u netlink 0t0 3143 AUDIT 2023-11-28T21:04:31.667 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 130u unix 0xffff98ee7d1b8780 0t0 3129 /run/rpcbind.sock type=STREAM 2023-11-28T21:04:31.667 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 131u IPv4 3131 0t0 TCP *:sunrpc (LISTEN) 2023-11-28T21:04:31.667 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 132u IPv4 3132 0t0 UDP *:sunrpc 2023-11-28T21:04:31.667 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 133u IPv6 3133 0t0 TCP *:sunrpc (LISTEN) 2023-11-28T21:04:31.668 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1 root 134u IPv6 3134 0t0 UDP *:sunrpc 2023-11-28T21:04:31.668 INFO:teuthology.orchestra.run.smithi167.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.668 INFO:teuthology.orchestra.run.smithi167.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.668 INFO:teuthology.orchestra.run.smithi167.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-11-28T21:04:31.668 INFO:teuthology.orchestra.run.smithi167.stdout:pool_work 3 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.668 INFO:teuthology.orchestra.run.smithi167.stdout:pool_work 3 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.668 INFO:teuthology.orchestra.run.smithi167.stdout:pool_work 3 root txt unknown /proc/3/exe 2023-11-28T21:04:31.668 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 4 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.669 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 4 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.669 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 4 root txt unknown /proc/4/exe 2023-11-28T21:04:31.669 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 5 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.669 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 5 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.669 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 5 root txt unknown /proc/5/exe 2023-11-28T21:04:31.669 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 6 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.669 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 6 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.670 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 6 root txt unknown /proc/6/exe 2023-11-28T21:04:31.670 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 7 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.670 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 7 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.670 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 7 root txt unknown /proc/7/exe 2023-11-28T21:04:31.670 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 10 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.670 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 10 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.671 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 10 root txt unknown /proc/10/exe 2023-11-28T21:04:31.671 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 12 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.671 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 12 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.671 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 12 root txt unknown /proc/12/exe 2023-11-28T21:04:31.671 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.671 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.672 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-11-28T21:04:31.672 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.672 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.672 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-11-28T21:04:31.672 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_tasks 15 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.672 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_tasks 15 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.672 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_tasks 15 root txt unknown /proc/15/exe 2023-11-28T21:04:31.672 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 16 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.673 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 16 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.673 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 16 root txt unknown /proc/16/exe 2023-11-28T21:04:31.673 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_preem 17 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.673 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_preem 17 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.673 INFO:teuthology.orchestra.run.smithi167.stdout:rcu_preem 17 root txt unknown /proc/17/exe 2023-11-28T21:04:31.673 INFO:teuthology.orchestra.run.smithi167.stdout:migration 18 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.673 INFO:teuthology.orchestra.run.smithi167.stdout:migration 18 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.673 INFO:teuthology.orchestra.run.smithi167.stdout:migration 18 root txt unknown /proc/18/exe 2023-11-28T21:04:31.673 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 19 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.674 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 19 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.674 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 19 root txt unknown /proc/19/exe 2023-11-28T21:04:31.674 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/0 20 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.674 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/0 20 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.674 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/0 20 root txt unknown /proc/20/exe 2023-11-28T21:04:31.674 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/1 21 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.674 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/1 21 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/1 21 root txt unknown /proc/21/exe 2023-11-28T21:04:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 22 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 22 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 22 root txt unknown /proc/22/exe 2023-11-28T21:04:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:migration 23 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:migration 23 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:migration 23 root txt unknown /proc/23/exe 2023-11-28T21:04:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 24 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.675 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 24 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.676 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 24 root txt unknown /proc/24/exe 2023-11-28T21:04:31.676 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 26 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.676 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 26 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.676 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 26 root txt unknown /proc/26/exe 2023-11-28T21:04:31.676 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/2 27 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.676 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/2 27 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.676 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/2 27 root txt unknown /proc/27/exe 2023-11-28T21:04:31.677 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 28 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.677 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 28 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.677 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 28 root txt unknown /proc/28/exe 2023-11-28T21:04:31.677 INFO:teuthology.orchestra.run.smithi167.stdout:migration 29 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.677 INFO:teuthology.orchestra.run.smithi167.stdout:migration 29 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.677 INFO:teuthology.orchestra.run.smithi167.stdout:migration 29 root txt unknown /proc/29/exe 2023-11-28T21:04:31.677 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 30 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.677 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 30 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.678 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 30 root txt unknown /proc/30/exe 2023-11-28T21:04:31.678 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 32 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.678 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 32 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.678 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 32 root txt unknown /proc/32/exe 2023-11-28T21:04:31.678 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/3 33 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.678 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/3 33 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.678 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/3 33 root txt unknown /proc/33/exe 2023-11-28T21:04:31.678 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 34 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.679 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 34 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.679 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 34 root txt unknown /proc/34/exe 2023-11-28T21:04:31.679 INFO:teuthology.orchestra.run.smithi167.stdout:migration 35 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.679 INFO:teuthology.orchestra.run.smithi167.stdout:migration 35 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.679 INFO:teuthology.orchestra.run.smithi167.stdout:migration 35 root txt unknown /proc/35/exe 2023-11-28T21:04:31.679 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 36 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.680 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 36 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.680 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 36 root txt unknown /proc/36/exe 2023-11-28T21:04:31.680 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 38 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.680 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 38 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.680 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 38 root txt unknown /proc/38/exe 2023-11-28T21:04:31.680 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/4 39 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.681 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/4 39 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.681 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/4 39 root txt unknown /proc/39/exe 2023-11-28T21:04:31.681 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 40 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.681 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 40 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.681 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 40 root txt unknown /proc/40/exe 2023-11-28T21:04:31.681 INFO:teuthology.orchestra.run.smithi167.stdout:migration 41 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.682 INFO:teuthology.orchestra.run.smithi167.stdout:migration 41 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.682 INFO:teuthology.orchestra.run.smithi167.stdout:migration 41 root txt unknown /proc/41/exe 2023-11-28T21:04:31.682 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 42 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.682 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 42 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.683 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 42 root txt unknown /proc/42/exe 2023-11-28T21:04:31.683 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 44 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.683 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 44 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.683 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 44 root txt unknown /proc/44/exe 2023-11-28T21:04:31.683 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/5 45 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.683 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/5 45 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.683 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/5 45 root txt unknown /proc/45/exe 2023-11-28T21:04:31.683 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 46 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.684 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 46 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.684 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 46 root txt unknown /proc/46/exe 2023-11-28T21:04:31.684 INFO:teuthology.orchestra.run.smithi167.stdout:migration 47 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.684 INFO:teuthology.orchestra.run.smithi167.stdout:migration 47 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.684 INFO:teuthology.orchestra.run.smithi167.stdout:migration 47 root txt unknown /proc/47/exe 2023-11-28T21:04:31.684 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 48 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.684 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 48 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.685 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 48 root txt unknown /proc/48/exe 2023-11-28T21:04:31.685 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 50 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.685 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 50 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.685 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 50 root txt unknown /proc/50/exe 2023-11-28T21:04:31.685 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/6 51 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.685 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/6 51 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.685 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/6 51 root txt unknown /proc/51/exe 2023-11-28T21:04:31.685 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 52 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.686 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 52 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.686 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 52 root txt unknown /proc/52/exe 2023-11-28T21:04:31.686 INFO:teuthology.orchestra.run.smithi167.stdout:migration 53 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.686 INFO:teuthology.orchestra.run.smithi167.stdout:migration 53 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.686 INFO:teuthology.orchestra.run.smithi167.stdout:migration 53 root txt unknown /proc/53/exe 2023-11-28T21:04:31.686 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 54 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.686 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 54 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.686 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 54 root txt unknown /proc/54/exe 2023-11-28T21:04:31.687 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 56 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.687 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 56 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.687 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 56 root txt unknown /proc/56/exe 2023-11-28T21:04:31.687 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/7 57 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.687 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/7 57 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.687 INFO:teuthology.orchestra.run.smithi167.stdout:cpuhp/7 57 root txt unknown /proc/57/exe 2023-11-28T21:04:31.687 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 58 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.688 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 58 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.688 INFO:teuthology.orchestra.run.smithi167.stdout:idle_inje 58 root txt unknown /proc/58/exe 2023-11-28T21:04:31.688 INFO:teuthology.orchestra.run.smithi167.stdout:migration 59 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.688 INFO:teuthology.orchestra.run.smithi167.stdout:migration 59 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.688 INFO:teuthology.orchestra.run.smithi167.stdout:migration 59 root txt unknown /proc/59/exe 2023-11-28T21:04:31.688 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 60 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.688 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 60 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.688 INFO:teuthology.orchestra.run.smithi167.stdout:ksoftirqd 60 root txt unknown /proc/60/exe 2023-11-28T21:04:31.689 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 62 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.689 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 62 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.689 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 62 root txt unknown /proc/62/exe 2023-11-28T21:04:31.689 INFO:teuthology.orchestra.run.smithi167.stdout:kdevtmpfs 63 root cwd DIR 0,5 4320 1 / 2023-11-28T21:04:31.689 INFO:teuthology.orchestra.run.smithi167.stdout:kdevtmpfs 63 root rtd DIR 0,5 4320 1 / 2023-11-28T21:04:31.689 INFO:teuthology.orchestra.run.smithi167.stdout:kdevtmpfs 63 root txt unknown /proc/63/exe 2023-11-28T21:04:31.689 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 71 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.689 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 71 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.690 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 71 root txt unknown /proc/71/exe 2023-11-28T21:04:31.690 INFO:teuthology.orchestra.run.smithi167.stdout:kauditd 72 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.690 INFO:teuthology.orchestra.run.smithi167.stdout:kauditd 72 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.690 INFO:teuthology.orchestra.run.smithi167.stdout:kauditd 72 root txt unknown /proc/72/exe 2023-11-28T21:04:31.690 INFO:teuthology.orchestra.run.smithi167.stdout:khungtask 73 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.691 INFO:teuthology.orchestra.run.smithi167.stdout:khungtask 73 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.691 INFO:teuthology.orchestra.run.smithi167.stdout:khungtask 73 root txt unknown /proc/73/exe 2023-11-28T21:04:31.691 INFO:teuthology.orchestra.run.smithi167.stdout:oom_reape 75 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.691 INFO:teuthology.orchestra.run.smithi167.stdout:oom_reape 75 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.691 INFO:teuthology.orchestra.run.smithi167.stdout:oom_reape 75 root txt unknown /proc/75/exe 2023-11-28T21:04:31.691 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 77 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.691 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 77 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.692 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 77 root txt unknown /proc/77/exe 2023-11-28T21:04:31.692 INFO:teuthology.orchestra.run.smithi167.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.692 INFO:teuthology.orchestra.run.smithi167.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.692 INFO:teuthology.orchestra.run.smithi167.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-11-28T21:04:31.692 INFO:teuthology.orchestra.run.smithi167.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.692 INFO:teuthology.orchestra.run.smithi167.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.692 INFO:teuthology.orchestra.run.smithi167.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-11-28T21:04:31.693 INFO:teuthology.orchestra.run.smithi167.stdout:khugepage 80 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.693 INFO:teuthology.orchestra.run.smithi167.stdout:khugepage 80 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.693 INFO:teuthology.orchestra.run.smithi167.stdout:khugepage 80 root txt unknown /proc/80/exe 2023-11-28T21:04:31.693 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 81 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.693 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 81 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.693 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 81 root txt unknown /proc/81/exe 2023-11-28T21:04:31.693 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 82 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.693 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 82 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.694 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 82 root txt unknown /proc/82/exe 2023-11-28T21:04:31.694 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 83 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.694 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 83 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.694 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 83 root txt unknown /proc/83/exe 2023-11-28T21:04:31.694 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 84 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.694 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 84 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.694 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 84 root txt unknown /proc/84/exe 2023-11-28T21:04:31.694 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 85 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.695 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 85 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.695 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 85 root txt unknown /proc/85/exe 2023-11-28T21:04:31.695 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 86 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.695 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 86 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.695 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 86 root txt unknown /proc/86/exe 2023-11-28T21:04:31.695 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 87 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.695 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 87 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.695 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 87 root txt unknown /proc/87/exe 2023-11-28T21:04:31.696 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 88 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.696 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 88 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.696 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 88 root txt unknown /proc/88/exe 2023-11-28T21:04:31.696 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 89 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.696 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 89 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.696 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 89 root txt unknown /proc/89/exe 2023-11-28T21:04:31.696 INFO:teuthology.orchestra.run.smithi167.stdout:watchdogd 90 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.697 INFO:teuthology.orchestra.run.smithi167.stdout:watchdogd 90 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.697 INFO:teuthology.orchestra.run.smithi167.stdout:watchdogd 90 root txt unknown /proc/90/exe 2023-11-28T21:04:31.697 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 91 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.697 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 91 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.697 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 91 root txt unknown /proc/91/exe 2023-11-28T21:04:31.697 INFO:teuthology.orchestra.run.smithi167.stdout:kswapd0 92 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.697 INFO:teuthology.orchestra.run.smithi167.stdout:kswapd0 92 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.697 INFO:teuthology.orchestra.run.smithi167.stdout:kswapd0 92 root txt unknown /proc/92/exe 2023-11-28T21:04:31.698 INFO:teuthology.orchestra.run.smithi167.stdout:ecryptfs- 93 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.698 INFO:teuthology.orchestra.run.smithi167.stdout:ecryptfs- 93 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.698 INFO:teuthology.orchestra.run.smithi167.stdout:ecryptfs- 93 root txt unknown /proc/93/exe 2023-11-28T21:04:31.698 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 94 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.698 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 94 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.698 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 94 root txt unknown /proc/94/exe 2023-11-28T21:04:31.698 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 95 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.698 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 95 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.699 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 95 root txt unknown /proc/95/exe 2023-11-28T21:04:31.699 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 100 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.699 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 100 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.699 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 100 root txt unknown /proc/100/exe 2023-11-28T21:04:31.699 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 101 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.699 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 101 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.699 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 101 root txt unknown /proc/101/exe 2023-11-28T21:04:31.699 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 105 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.700 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 105 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.700 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 105 root txt unknown /proc/105/exe 2023-11-28T21:04:31.700 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 127 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.700 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 127 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.700 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 127 root txt unknown /proc/127/exe 2023-11-28T21:04:31.700 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 131 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.700 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 131 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.700 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 131 root txt unknown /proc/131/exe 2023-11-28T21:04:31.701 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 144 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.701 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 144 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.701 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 144 root txt unknown /proc/144/exe 2023-11-28T21:04:31.701 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 145 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.701 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 145 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.701 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 145 root txt unknown /proc/145/exe 2023-11-28T21:04:31.702 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 146 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.702 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 146 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.702 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 146 root txt unknown /proc/146/exe 2023-11-28T21:04:31.702 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 147 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.702 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 147 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.702 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 147 root txt unknown /proc/147/exe 2023-11-28T21:04:31.702 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 150 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.702 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 150 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.703 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 150 root txt unknown /proc/150/exe 2023-11-28T21:04:31.703 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 156 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.703 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 156 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.703 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 156 root txt unknown /proc/156/exe 2023-11-28T21:04:31.703 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 157 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.703 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 157 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.703 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 157 root txt unknown /proc/157/exe 2023-11-28T21:04:31.703 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 158 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.704 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 158 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.704 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 158 root txt unknown /proc/158/exe 2023-11-28T21:04:31.704 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_0 171 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.704 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_0 171 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.704 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_0 171 root txt unknown /proc/171/exe 2023-11-28T21:04:31.704 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 172 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.704 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 172 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.705 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 172 root txt unknown /proc/172/exe 2023-11-28T21:04:31.705 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 173 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.705 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 173 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.705 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 173 root txt unknown /proc/173/exe 2023-11-28T21:04:31.705 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_1 174 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.705 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_1 174 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.705 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_1 174 root txt unknown /proc/174/exe 2023-11-28T21:04:31.705 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 175 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.706 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 175 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.706 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 175 root txt unknown /proc/175/exe 2023-11-28T21:04:31.706 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_2 176 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.706 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_2 176 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.706 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_2 176 root txt unknown /proc/176/exe 2023-11-28T21:04:31.706 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 177 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.706 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 177 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.706 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 177 root txt unknown /proc/177/exe 2023-11-28T21:04:31.707 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_3 179 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.707 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_3 179 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.707 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_3 179 root txt unknown /proc/179/exe 2023-11-28T21:04:31.707 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 180 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.707 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 180 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.707 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 180 root txt unknown /proc/180/exe 2023-11-28T21:04:31.707 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_4 203 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.707 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_4 203 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.708 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_4 203 root txt unknown /proc/203/exe 2023-11-28T21:04:31.708 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 204 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.708 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 204 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.708 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 204 root txt unknown /proc/204/exe 2023-11-28T21:04:31.708 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_5 205 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.708 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_5 205 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.708 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_5 205 root txt unknown /proc/205/exe 2023-11-28T21:04:31.708 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 206 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.709 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 206 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.709 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 206 root txt unknown /proc/206/exe 2023-11-28T21:04:31.709 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_6 207 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.709 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_6 207 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.709 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_6 207 root txt unknown /proc/207/exe 2023-11-28T21:04:31.709 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 208 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.709 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 208 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.709 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 208 root txt unknown /proc/208/exe 2023-11-28T21:04:31.710 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_7 209 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.710 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_7 209 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.710 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_7 209 root txt unknown /proc/209/exe 2023-11-28T21:04:31.710 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 210 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.710 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 210 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.710 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 210 root txt unknown /proc/210/exe 2023-11-28T21:04:31.710 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_8 211 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.710 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_8 211 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.711 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_8 211 root txt unknown /proc/211/exe 2023-11-28T21:04:31.711 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 212 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.711 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 212 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.711 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 212 root txt unknown /proc/212/exe 2023-11-28T21:04:31.711 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_9 213 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.711 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_9 213 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.712 INFO:teuthology.orchestra.run.smithi167.stdout:scsi_eh_9 213 root txt unknown /proc/213/exe 2023-11-28T21:04:31.712 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 214 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.712 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 214 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.712 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 214 root txt unknown /proc/214/exe 2023-11-28T21:04:31.712 INFO:teuthology.orchestra.run.smithi167.stdout:jbd2/sda1 250 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.712 INFO:teuthology.orchestra.run.smithi167.stdout:jbd2/sda1 250 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.712 INFO:teuthology.orchestra.run.smithi167.stdout:jbd2/sda1 250 root txt unknown /proc/250/exe 2023-11-28T21:04:31.712 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 251 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 251 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 251 root txt unknown /proc/251/exe 2023-11-28T21:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root txt REG 8,1 162176 19789 /usr/lib/systemd/systemd-journald 2023-11-28T21:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 8388608 658238 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000.journal 2023-11-28T21:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 8388608 658054 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal 2023-11-28T21:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 8388608 6947 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000@1c610e37cfe048218dd2d71cb64a5844-0000000000006556-00060b3c2aa44f47.journal 2023-11-28T21:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-28T21:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-28T21:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-28T21:04:31.716 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:31.716 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.716 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.716 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-28T21:04:31.716 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.716 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.716 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root mem REG 0,23 8 448 /run/systemd/journal/kernel-seqnum 2023-11-28T21:04:31.716 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.717 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.717 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.717 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 3u netlink 0t0 3143 AUDIT 2023-11-28T21:04:31.717 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 4u unix 0xffff98ee7d1ba580 0t0 3144 /run/systemd/journal/dev-log type=DGRAM 2023-11-28T21:04:31.717 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 5u unix 0xffff98ee7d1bad00 0t0 3146 /run/systemd/journal/socket type=DGRAM 2023-11-28T21:04:31.717 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 6u unix 0xffff98ee7d1bb480 0t0 3148 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.717 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 7w CHR 1,11 0t0 10 /dev/kmsg 2023-11-28T21:04:31.717 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.718 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 9u CHR 1,11 0t0 10 /dev/kmsg 2023-11-28T21:04:31.718 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 10u unix 0xffff98ee01f0a580 0t0 6304 /run/systemd/journal/io.systemd.journal type=STREAM 2023-11-28T21:04:31.718 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 11r REG 0,21 0 6305 /proc/sys/kernel/hostname 2023-11-28T21:04:31.718 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 12u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.718 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 13u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.718 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 14u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.718 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 15u unix 0xffff98ee01f0ad00 0t0 6306 type=DGRAM 2023-11-28T21:04:31.718 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 16u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 17u unix 0xffff98ee053b9680 0t0 9627 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 18u unix 0xffff98ee7d1bc380 0t0 5380 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 19u unix 0xffff98ee05c42580 0t0 9757 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 20u unix 0xffff98ee7d1bf080 0t0 4201 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 21u unix 0xffff98ee01f09680 0t0 101662 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.719 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 22u unix 0xffff98ee0b27ad00 0t0 9758 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.720 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 23u unix 0xffff98ee04fdc380 0t0 55973 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.720 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 24u unix 0xffff98ee70cc1e00 0t0 10220 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.720 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 25u unix 0xffff98ee09ebe180 0t0 9761 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.720 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 26u unix 0xffff98ee0a3c3480 0t0 9762 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.720 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 27u unix 0xffff98ee04fdbc00 0t0 9763 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.720 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 28u REG 8,1 8388608 6947 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000@1c610e37cfe048218dd2d71cb64a5844-0000000000006556-00060b3c2aa44f47.journal 2023-11-28T21:04:31.720 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 29u unix 0xffff98ee04fdda00 0t0 9769 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.720 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 30u unix 0xffff98ee0b60cb00 0t0 2739 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.721 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 31u unix 0xffff98ee09eba580 0t0 9896 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.721 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 32u REG 8,1 8388608 658054 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal 2023-11-28T21:04:31.721 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 33u unix 0xffff98ee70cc0f00 0t0 9959 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.721 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 34u unix 0xffff98ee05c40000 0t0 9772 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.721 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 35u REG 8,1 8388608 658238 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000.journal 2023-11-28T21:04:31.721 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 36u unix 0xffff98ee0a971680 0t0 9956 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.721 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 37u unix 0xffff98ee053bda00 0t0 108229 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.721 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 38u unix 0xffff98ee08f31680 0t0 9958 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.722 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 39u unix 0xffff98ee01f0b480 0t0 113450 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.722 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 40u unix 0xffff98ee053bf800 0t0 115094 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.722 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 root 42u unix 0xffff98ee0a976180 0t0 115308 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.722 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.722 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.722 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root txt REG 8,1 162176 19789 /usr/lib/systemd/systemd-journald 2023-11-28T21:04:31.722 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 8388608 658238 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000.journal 2023-11-28T21:04:31.722 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 8388608 658054 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal 2023-11-28T21:04:31.723 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 8388608 6947 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000@1c610e37cfe048218dd2d71cb64a5844-0000000000006556-00060b3c2aa44f47.journal 2023-11-28T21:04:31.723 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:31.723 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.723 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.723 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.723 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.723 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.723 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.724 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-28T21:04:31.724 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.724 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:31.724 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.724 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.724 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.724 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.725 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-28T21:04:31.725 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-28T21:04:31.725 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:31.725 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.725 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.725 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-28T21:04:31.725 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.725 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.726 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root mem REG 0,23 8 448 /run/systemd/journal/kernel-seqnum 2023-11-28T21:04:31.726 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.726 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 1w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.726 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.726 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 3u netlink 0t0 3143 AUDIT 2023-11-28T21:04:31.726 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 4u unix 0xffff98ee7d1ba580 0t0 3144 /run/systemd/journal/dev-log type=DGRAM 2023-11-28T21:04:31.726 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 5u unix 0xffff98ee7d1bad00 0t0 3146 /run/systemd/journal/socket type=DGRAM 2023-11-28T21:04:31.727 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 6u unix 0xffff98ee7d1bb480 0t0 3148 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.727 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 7w CHR 1,11 0t0 10 /dev/kmsg 2023-11-28T21:04:31.727 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.727 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 9u CHR 1,11 0t0 10 /dev/kmsg 2023-11-28T21:04:31.727 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 10u unix 0xffff98ee01f0a580 0t0 6304 /run/systemd/journal/io.systemd.journal type=STREAM 2023-11-28T21:04:31.727 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 11r REG 0,21 0 6305 /proc/sys/kernel/hostname 2023-11-28T21:04:31.727 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 12u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.728 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 13u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.728 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 14u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.728 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 15u unix 0xffff98ee01f0ad00 0t0 6306 type=DGRAM 2023-11-28T21:04:31.728 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 16u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.728 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 17u unix 0xffff98ee053b9680 0t0 9627 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.728 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 18u unix 0xffff98ee7d1bc380 0t0 5380 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.728 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 19u unix 0xffff98ee05c42580 0t0 9757 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.728 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 20u unix 0xffff98ee7d1bf080 0t0 4201 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.729 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 21u unix 0xffff98ee01f09680 0t0 101662 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.729 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 22u unix 0xffff98ee0b27ad00 0t0 9758 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.729 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 23u unix 0xffff98ee04fdc380 0t0 55973 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.729 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 24u unix 0xffff98ee70cc1e00 0t0 10220 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.729 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 25u unix 0xffff98ee09ebe180 0t0 9761 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.729 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 26u unix 0xffff98ee0a3c3480 0t0 9762 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.729 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 27u unix 0xffff98ee04fdbc00 0t0 9763 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.729 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 28u REG 8,1 8388608 6947 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000@1c610e37cfe048218dd2d71cb64a5844-0000000000006556-00060b3c2aa44f47.journal 2023-11-28T21:04:31.730 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 29u unix 0xffff98ee04fdda00 0t0 9769 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.730 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 30u unix 0xffff98ee0b60cb00 0t0 2739 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.730 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 31u unix 0xffff98ee09eba580 0t0 9896 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.730 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 32u REG 8,1 8388608 658054 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal 2023-11-28T21:04:31.730 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 33u unix 0xffff98ee70cc0f00 0t0 9959 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.730 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 34u unix 0xffff98ee05c40000 0t0 9772 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.730 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 35u REG 8,1 8388608 658238 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000.journal 2023-11-28T21:04:31.730 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 36u unix 0xffff98ee0a971680 0t0 9956 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.731 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 37u unix 0xffff98ee053bda00 0t0 108229 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.731 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 38u unix 0xffff98ee08f31680 0t0 9958 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.731 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 39u unix 0xffff98ee01f0b480 0t0 113450 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.731 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 40u unix 0xffff98ee053bf800 0t0 115094 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.731 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-j 294 60562 journal-o root 42u unix 0xffff98ee0a976180 0t0 115308 /run/systemd/journal/stdout type=STREAM 2023-11-28T21:04:31.731 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 295 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.731 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 295 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.732 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 295 root txt unknown /proc/295/exe 2023-11-28T21:04:31.732 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 296 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.732 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 296 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.732 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 296 root txt unknown /proc/296/exe 2023-11-28T21:04:31.732 INFO:teuthology.orchestra.run.smithi167.stdout:ext4lazyi 324 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.732 INFO:teuthology.orchestra.run.smithi167.stdout:ext4lazyi 324 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.732 INFO:teuthology.orchestra.run.smithi167.stdout:ext4lazyi 324 root txt unknown /proc/324/exe 2023-11-28T21:04:31.732 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 326 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.733 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 326 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.733 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 326 root txt unknown /proc/326/exe 2023-11-28T21:04:31.733 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.733 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.733 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root txt REG 8,1 1131856 13517 /usr/bin/udevadm 2023-11-28T21:04:31.733 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 11124932 33003 /usr/lib/udev/hwdb.bin 2023-11-28T21:04:31.733 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.733 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.734 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.734 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.734 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.734 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.734 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.734 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.735 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.735 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.735 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.735 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-28T21:04:31.735 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.735 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.735 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.735 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.736 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.736 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 1u unix 0xffff98ee053b9e00 0t0 5289 type=STREAM 2023-11-28T21:04:31.736 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 2u unix 0xffff98ee053b9e00 0t0 5289 type=STREAM 2023-11-28T21:04:31.736 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 3u netlink 0t0 3153 KOBJECT_UEVENT 2023-11-28T21:04:31.736 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 4u unix 0xffff98ee7d1bbc00 0t0 3151 /run/udev/control type=SEQPACKET 2023-11-28T21:04:31.736 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 5u unix 0xffff98ee053b8f00 0t0 5298 type=DGRAM 2023-11-28T21:04:31.736 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 6u unix 0xffff98ee053b8780 0t0 5302 type=DGRAM 2023-11-28T21:04:31.736 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 7u unix 0xffff98ee053b8000 0t0 5303 type=DGRAM 2023-11-28T21:04:31.737 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 8r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.737 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 9u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.737 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 10u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.737 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 11u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.737 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 12r REG 8,1 11124932 33003 /usr/lib/udev/hwdb.bin 2023-11-28T21:04:31.737 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-u 360 root 13u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.737 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 417 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.737 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 417 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.738 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 417 root txt unknown /proc/417/exe 2023-11-28T21:04:31.738 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.738 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.738 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc txt REG 8,1 63912 4337 /usr/sbin/rpcbind 2023-11-28T21:04:31.738 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:31.738 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:31.738 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.738 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:31.739 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:31.739 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:31.739 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.739 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.739 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.739 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:31.739 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:31.740 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.740 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.740 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.740 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:31.740 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-28T21:04:31.740 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:31.740 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:31.740 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.741 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.741 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 1u unix 0xffff98ee7d1be900 0t0 3313 type=STREAM 2023-11-28T21:04:31.741 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 2u unix 0xffff98ee7d1be900 0t0 3313 type=STREAM 2023-11-28T21:04:31.741 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 3u unix 0xffff98ee7d1b8780 0t0 3129 /run/rpcbind.sock type=STREAM 2023-11-28T21:04:31.741 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 4u IPv4 3131 0t0 TCP *:sunrpc (LISTEN) 2023-11-28T21:04:31.741 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 5u IPv4 3132 0t0 UDP *:sunrpc 2023-11-28T21:04:31.741 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 6u IPv6 3133 0t0 TCP *:sunrpc (LISTEN) 2023-11-28T21:04:31.741 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 7u IPv6 3134 0t0 UDP *:sunrpc 2023-11-28T21:04:31.742 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 8rW REG 0,23 0 1140 /run/rpcbind.lock 2023-11-28T21:04:31.742 INFO:teuthology.orchestra.run.smithi167.stdout:rpcbind 419 _rpc 9u unix 0xffff98ee0b608000 0t0 2728 /run/rpcbind.sock type=STREAM 2023-11-28T21:04:31.742 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.742 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.742 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network txt REG 8,1 1513936 19795 /usr/lib/systemd/systemd-networkd 2023-11-28T21:04:31.742 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.743 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.743 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.743 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.743 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:31.743 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.743 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.743 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-28T21:04:31.743 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.743 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.744 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.744 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-28T21:04:31.744 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:31.744 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.744 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.744 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.744 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-28T21:04:31.745 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:31.745 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.745 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.745 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-28T21:04:31.745 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.745 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.745 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 1u unix 0xffff98ee7d1bf800 0t0 3335 type=STREAM 2023-11-28T21:04:31.745 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 2u unix 0xffff98ee7d1bf800 0t0 3335 type=STREAM 2023-11-28T21:04:31.746 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 3u netlink 0t0 3150 ROUTE 2023-11-28T21:04:31.746 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 4u unix 0xffff98ee7d1bcb00 0t0 3354 type=DGRAM 2023-11-28T21:04:31.746 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.746 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 6u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.746 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 7u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.746 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 8u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.746 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 9u netlink 0t0 3358 GENERIC 2023-11-28T21:04:31.746 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 10u netlink 0t0 3359 KOBJECT_UEVENT 2023-11-28T21:04:31.747 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 11u unix 0xffff98ee7d1bda00 0t0 3360 type=DGRAM 2023-11-28T21:04:31.747 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 12u unix 0xffff98ee7d1be180 0t0 3361 type=DGRAM 2023-11-28T21:04:31.747 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 13u unix 0xffff98ee0b278000 0t0 3362 type=DGRAM 2023-11-28T21:04:31.747 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 14u unix 0xffff98ee0b278780 0t0 3363 type=DGRAM 2023-11-28T21:04:31.747 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 15u IPv4 2663 0t0 UDP smithi167.front.sepia.ceph.com:bootpc 2023-11-28T21:04:31.747 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 16u sock 0,8 0t0 7323 protocol: UDP 2023-11-28T21:04:31.747 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 17u pack 5397 0t0 35020 type=SOCK_RAW 2023-11-28T21:04:31.747 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 18u unix 0xffff98ee04fd9680 0t0 5398 type=STREAM 2023-11-28T21:04:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 19u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-n 420 systemd-network 20u raw6 0t0 5951 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-11-28T21:04:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 432 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 432 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 432 root txt unknown /proc/432/exe 2023-11-28T21:04:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:kipmi0 482 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:kipmi0 482 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:kipmi0 482 root txt unknown /proc/482/exe 2023-11-28T21:04:31.748 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root txt REG 8,1 39224 2570 /usr/sbin/blkmapd 2023-11-28T21:04:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:31.750 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.750 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.750 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.750 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.750 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root 3wW REG 0,23 4 1183 /run/blkmapd.pid 2023-11-28T21:04:31.750 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root 4r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.751 INFO:teuthology.orchestra.run.smithi167.stdout:blkmapd 497 root 5u unix 0xffff98ee0b279e00 0t0 3374 type=DGRAM 2023-11-28T21:04:31.751 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.751 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.751 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root txt REG 8,1 47592 3135 /usr/sbin/rpc.idmapd 2023-11-28T21:04:31.751 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.751 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root mem REG 8,1 211136 486 /usr/lib/x86_64-linux-gnu/libevent_core-2.1.so.7.0.1 2023-11-28T21:04:31.751 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root mem REG 8,1 39584 4155 /usr/lib/x86_64-linux-gnu/libnfsidmap.so.1.0.0 2023-11-28T21:04:31.751 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root mem REG 8,1 35480 48372 /usr/lib/x86_64-linux-gnu/libnfsidmap/nsswitch.so 2023-11-28T21:04:31.752 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.752 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.752 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.752 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.752 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 4u unix 0xffff98ee01f0da00 0t0 6460 type=DGRAM 2023-11-28T21:04:31.752 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.752 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 6r FIFO 0,13 0t0 6463 pipe 2023-11-28T21:04:31.752 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 7w FIFO 0,13 0t0 6463 pipe 2023-11-28T21:04:31.753 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 8u REG 0,21 0 4026532452 /proc/502/net/rpc/nfs4.nametoid/channel 2023-11-28T21:04:31.753 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 9u REG 0,21 0 4026532448 /proc/502/net/rpc/nfs4.idtoname/channel 2023-11-28T21:04:31.753 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.idmap 502 root 10r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.753 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.753 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.753 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-28T21:04:31.753 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.753 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.754 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-28T21:04:31.754 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-28T21:04:31.754 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.754 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.754 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.754 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.754 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root 3u unix 0xffff98ee04fd8f00 0t0 5393 type=DGRAM 2023-11-28T21:04:31.755 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root 4r FIFO 0,13 0t0 8541 pipe 2023-11-28T21:04:31.755 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root 6w FIFO 0,13 0t0 8541 pipe 2023-11-28T21:04:31.755 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root 7w REG 8,1 1120 460 /var/lib/dhcp/dhclient.enp3s0f1.leases 2023-11-28T21:04:31.755 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root 8u pack 8598 0t0 ALL type=SOCK_RAW 2023-11-28T21:04:31.755 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 root 9u IPv4 5950 0t0 UDP *:bootpc 2023-11-28T21:04:31.755 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.755 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.755 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-28T21:04:31.756 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.756 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.756 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-28T21:04:31.756 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-28T21:04:31.756 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.756 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.756 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.757 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.757 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root 3u unix 0xffff98ee04fd8f00 0t0 5393 type=DGRAM 2023-11-28T21:04:31.757 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root 4r FIFO 0,13 0t0 8541 pipe 2023-11-28T21:04:31.757 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root 6w FIFO 0,13 0t0 8541 pipe 2023-11-28T21:04:31.757 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root 7w REG 8,1 1120 460 /var/lib/dhcp/dhclient.enp3s0f1.leases 2023-11-28T21:04:31.757 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root 8u pack 8598 0t0 ALL type=SOCK_RAW 2023-11-28T21:04:31.757 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 506 isc-worke root 9u IPv4 5950 0t0 UDP *:bootpc 2023-11-28T21:04:31.757 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.758 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.758 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-28T21:04:31.758 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.758 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.758 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-28T21:04:31.758 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-28T21:04:31.759 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.759 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.759 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.759 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.759 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root 3u unix 0xffff98ee04fd8f00 0t0 5393 type=DGRAM 2023-11-28T21:04:31.759 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root 4r FIFO 0,13 0t0 8541 pipe 2023-11-28T21:04:31.759 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root 6w FIFO 0,13 0t0 8541 pipe 2023-11-28T21:04:31.761 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root 7w REG 8,1 1120 460 /var/lib/dhcp/dhclient.enp3s0f1.leases 2023-11-28T21:04:31.761 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root 8u pack 8598 0t0 ALL type=SOCK_RAW 2023-11-28T21:04:31.761 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 507 isc-socke root 9u IPv4 5950 0t0 UDP *:bootpc 2023-11-28T21:04:31.761 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.761 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.761 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-28T21:04:31.762 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.762 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.762 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-28T21:04:31.762 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-28T21:04:31.762 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.762 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.762 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.762 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.763 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root 3u unix 0xffff98ee04fd8f00 0t0 5393 type=DGRAM 2023-11-28T21:04:31.763 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root 4r FIFO 0,13 0t0 8541 pipe 2023-11-28T21:04:31.763 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root 6w FIFO 0,13 0t0 8541 pipe 2023-11-28T21:04:31.763 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root 7w REG 8,1 1120 460 /var/lib/dhcp/dhclient.enp3s0f1.leases 2023-11-28T21:04:31.763 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root 8u pack 8598 0t0 ALL type=SOCK_RAW 2023-11-28T21:04:31.763 INFO:teuthology.orchestra.run.smithi167.stdout:dhclient 503 508 isc-timer root 9u IPv4 5950 0t0 UDP *:bootpc 2023-11-28T21:04:31.763 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.764 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.764 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root txt REG 8,1 55864 3888 /usr/sbin/nfsdcld 2023-11-28T21:04:31.764 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.764 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.764 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.764 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:31.764 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root mem REG 8,1 211136 486 /usr/lib/x86_64-linux-gnu/libevent_core-2.1.so.7.0.1 2023-11-28T21:04:31.764 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.765 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.765 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.765 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.765 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.765 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root 4r FIFO 0,13 0t0 8529 pipe 2023-11-28T21:04:31.765 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root 5w FIFO 0,13 0t0 8529 pipe 2023-11-28T21:04:31.765 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root 6u REG 8,1 32768 139416 /var/lib/nfs/nfsdcld/main.sqlite 2023-11-28T21:04:31.766 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.766 INFO:teuthology.orchestra.run.smithi167.stdout:nfsdcld 504 root 8u FIFO 0,35 0t0 113 /run/rpc_pipefs/nfsd/cld 2023-11-28T21:04:31.766 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.766 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.766 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root txt REG 8,1 166328 9721 /usr/libexec/accounts-daemon 2023-11-28T21:04:31.766 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:31.766 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.766 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.767 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.767 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.767 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.767 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.767 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.767 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:31.767 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.767 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:31.768 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.768 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.768 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.768 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:31.768 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.768 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:31.768 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.769 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:31.769 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:31.769 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:31.769 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:31.769 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:31.769 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:31.769 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.770 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.770 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root 1u unix 0xffff98ee05c42d00 0t0 8554 type=STREAM 2023-11-28T21:04:31.770 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root 2u unix 0xffff98ee05c42d00 0t0 8554 type=STREAM 2023-11-28T21:04:31.770 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.770 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.770 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root 5u sock 0,8 0t0 9767 protocol: UNIX-STREAM 2023-11-28T21:04:31.770 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root 6u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.771 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.771 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.771 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.771 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root txt REG 8,1 166328 9721 /usr/libexec/accounts-daemon 2023-11-28T21:04:31.771 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:31.771 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.771 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.771 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.772 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.772 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.772 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.772 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.772 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:31.772 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.772 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:31.772 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.773 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.773 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.773 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:31.773 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.773 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:31.773 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.773 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:31.773 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:31.774 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:31.774 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:31.774 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:31.774 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:31.774 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.774 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.774 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root 1u unix 0xffff98ee05c42d00 0t0 8554 type=STREAM 2023-11-28T21:04:31.774 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root 2u unix 0xffff98ee05c42d00 0t0 8554 type=STREAM 2023-11-28T21:04:31.775 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.775 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.775 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root 5u sock 0,8 0t0 9767 protocol: UNIX-STREAM 2023-11-28T21:04:31.775 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root 6u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.775 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 536 gmain root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.775 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.775 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.775 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root txt REG 8,1 166328 9721 /usr/libexec/accounts-daemon 2023-11-28T21:04:31.776 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:31.776 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.776 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.776 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.776 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.776 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.776 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.777 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.777 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:31.777 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.777 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:31.777 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.777 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.777 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.777 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:31.778 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.778 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:31.778 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.778 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:31.778 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:31.778 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:31.778 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:31.778 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:31.779 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:31.779 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.779 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.779 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root 1u unix 0xffff98ee05c42d00 0t0 8554 type=STREAM 2023-11-28T21:04:31.779 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root 2u unix 0xffff98ee05c42d00 0t0 8554 type=STREAM 2023-11-28T21:04:31.779 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.779 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.780 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root 5u sock 0,8 0t0 9767 protocol: UNIX-STREAM 2023-11-28T21:04:31.780 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root 6u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.780 INFO:teuthology.orchestra.run.smithi167.stdout:accounts- 511 579 gdbus root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.780 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.780 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.780 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus txt REG 8,1 232776 9094 /usr/bin/dbus-daemon 2023-11-28T21:04:31.780 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:31.781 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.781 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.781 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.781 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.781 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.781 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.781 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.781 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.782 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-28T21:04:31.782 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.782 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:31.782 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.782 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:31.782 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:31.782 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-28T21:04:31.783 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.783 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.783 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 1u unix 0xffff98ee0b27a580 0t0 3406 type=STREAM 2023-11-28T21:04:31.783 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 2u unix 0xffff98ee0b27a580 0t0 3406 type=STREAM 2023-11-28T21:04:31.783 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 3u unix 0xffff98ee05c44380 0t0 8530 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.783 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 4u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.783 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 5u sock 0,8 0t0 9814 protocol: NETLINK 2023-11-28T21:04:31.784 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 6r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.784 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 7u unix 0xffff98ee0b60f080 0t0 9815 type=STREAM 2023-11-28T21:04:31.784 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 8u unix 0xffff98ee0b60e900 0t0 9816 type=STREAM 2023-11-28T21:04:31.784 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 9u unix 0xffff98ee04fd9e00 0t0 9817 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.784 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 10u unix 0xffff98ee01f0e180 0t0 9818 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.784 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 11u sock 0,8 0t0 9819 protocol: UNIX-STREAM 2023-11-28T21:04:31.785 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 12u unix 0xffff98ee0a3c6180 0t0 9820 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.785 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 13u unix 0xffff98ee01f0c380 0t0 6501 type=DGRAM 2023-11-28T21:04:31.785 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 14u unix 0xffff98ee0b27e180 0t0 9843 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.785 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 15u unix 0xffff98ee04fdad00 0t0 9844 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.785 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 16u unix 0xffff98ee7e524380 0t0 6577 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.785 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 17u unix 0xffff98ee0b27f080 0t0 7412 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.785 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 18u unix 0xffff98ee01f0bc00 0t0 112368 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.785 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 19u unix 0xffff98ee61061e00 0t0 6977 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 20u unix 0xffff98ee0a970780 0t0 57478 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 21u unix 0xffff98ee053bc380 0t0 110497 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:dbus-daem 513 messagebus 23u unix 0xffff98ee4c1d8780 0t0 112600 /run/dbus/system_bus_socket type=STREAM 2023-11-28T21:04:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root txt REG 8,1 68464 2451 /usr/sbin/irqbalance 2023-11-28T21:04:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:31.787 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.788 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root 1u unix 0xffff98ee09ebda00 0t0 4226 type=STREAM 2023-11-28T21:04:31.789 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root 2u unix 0xffff98ee09ebda00 0t0 4226 type=STREAM 2023-11-28T21:04:31.789 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.789 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.789 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 root 5u unix 0xffff98ee09ebe900 0t0 4232 /run/irqbalance/irqbalance518.sock type=STREAM 2023-11-28T21:04:31.789 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.789 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.789 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root txt REG 8,1 68464 2451 /usr/sbin/irqbalance 2023-11-28T21:04:31.789 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.790 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.790 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.790 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.790 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.790 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.790 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.790 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:31.791 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.791 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.791 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:31.791 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:31.791 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.791 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.791 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.791 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root 1u unix 0xffff98ee09ebda00 0t0 4226 type=STREAM 2023-11-28T21:04:31.792 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root 2u unix 0xffff98ee09ebda00 0t0 4226 type=STREAM 2023-11-28T21:04:31.792 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.792 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.792 INFO:teuthology.orchestra.run.smithi167.stdout:irqbalanc 518 526 gmain root 5u unix 0xffff98ee09ebe900 0t0 4232 /run/irqbalance/irqbalance518.sock type=STREAM 2023-11-28T21:04:31.792 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.792 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.793 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.793 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.793 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.793 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.793 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.793 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.793 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.793 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.794 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.794 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.794 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.794 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.794 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.794 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.794 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.794 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.795 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.795 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.795 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.795 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.795 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.795 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.795 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.795 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.796 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.796 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.796 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.796 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.796 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.796 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.796 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.797 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.797 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.797 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.797 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.797 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.797 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.797 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.797 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.798 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.798 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.798 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.798 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.798 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.798 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.798 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.799 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.799 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.799 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.799 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.799 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.799 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.799 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.799 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.800 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.800 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.800 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.800 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.800 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.800 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.801 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.801 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.801 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.801 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.801 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.801 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.801 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.801 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.802 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.802 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.802 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.802 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.802 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.802 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.802 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.803 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.803 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.803 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.803 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.803 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.803 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.803 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.803 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.804 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.804 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.804 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.804 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.804 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.804 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.804 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.804 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.805 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.805 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.805 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.805 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.805 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.805 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.805 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.805 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.806 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.806 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.806 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.806 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.806 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.806 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.806 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.806 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.807 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.807 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.807 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.807 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.807 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.807 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.807 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.809 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.809 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.809 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.809 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.809 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.809 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.809 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.810 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.810 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.810 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.810 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.810 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.810 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.810 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.810 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.811 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.811 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.811 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.811 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.811 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.811 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.811 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.812 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.812 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.812 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.812 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.812 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.812 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.812 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.812 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.813 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.813 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.813 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.813 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.813 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.813 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.813 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.813 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.813 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.814 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.814 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.814 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.814 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.814 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.814 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.814 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.815 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.815 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.815 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.815 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.815 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.815 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.815 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.815 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.816 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.816 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.816 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.816 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.816 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.816 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.816 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.816 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.817 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 581 HT\x20cle root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.817 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.817 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.817 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.817 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.817 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.817 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.818 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.818 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.818 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.818 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.818 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.818 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.818 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.819 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.819 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.819 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.819 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.819 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.819 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.819 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.819 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.820 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.820 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.820 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.820 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.820 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.820 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.820 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.820 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.821 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.821 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.821 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.821 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.821 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.821 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.821 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.821 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.822 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.822 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.822 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.822 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.822 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.822 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.822 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.823 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.823 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.823 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.823 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.823 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.823 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.823 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.824 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.824 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.824 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.824 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.824 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.824 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.824 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.824 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.825 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.825 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.825 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.825 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.825 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.825 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.825 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.825 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.826 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.826 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.826 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.826 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.826 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.826 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.827 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.827 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.827 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.827 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.827 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.827 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.827 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.827 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.828 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.828 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.828 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.828 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.828 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.828 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.828 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.828 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.829 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.829 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.829 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.829 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 583 lttng-ses root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.829 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.829 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.829 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.829 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.830 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.830 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.830 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.830 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.830 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.830 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.830 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.830 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.831 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.831 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.831 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.831 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.831 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.831 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.831 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.831 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.832 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.832 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.832 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.832 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.832 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.832 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.832 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.832 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.833 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.833 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.833 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.833 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.833 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.833 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.833 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.833 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.834 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.834 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.834 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.834 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.834 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.834 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.835 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.835 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.835 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.835 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.835 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.835 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.835 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.835 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.836 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.836 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.836 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.836 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.836 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.836 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.836 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.837 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.837 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.837 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.837 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.837 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.837 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.837 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.837 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.838 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.838 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.838 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.838 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.838 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.838 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.838 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.838 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.839 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.839 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.839 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.839 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.839 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.839 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.839 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.839 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.840 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.840 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.840 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.840 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.840 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.840 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.840 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.841 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.841 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.841 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.841 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.841 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 584 Health root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.841 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.841 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.841 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.842 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.842 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.842 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.842 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.842 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.842 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.842 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.842 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.843 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.843 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.843 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.843 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.843 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.843 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.844 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.844 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.844 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.844 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.844 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.844 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.844 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.844 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.845 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.845 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.845 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.845 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.845 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.845 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.845 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.845 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.846 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.846 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.846 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.846 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.846 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.846 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.846 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.846 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.847 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.847 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.847 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.847 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.847 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.847 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.847 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.847 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.848 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.848 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.848 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.848 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.848 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.848 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.848 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.848 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.849 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.849 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.849 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.849 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.849 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.849 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.849 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.849 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.850 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.850 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.850 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.850 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.850 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.850 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.850 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.851 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.851 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.851 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.851 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.851 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.851 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.851 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.852 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.852 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.852 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.852 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.852 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.852 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.852 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.852 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.853 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.853 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.853 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.853 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.853 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.853 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 585 Notificat root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.853 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.853 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.854 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.854 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.854 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.854 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.854 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.854 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.854 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.854 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.855 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.855 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.855 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.855 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.855 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.855 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.855 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.855 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.856 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.856 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.856 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.856 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.856 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.856 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.856 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.856 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.857 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.857 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.857 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.857 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.857 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.857 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.857 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.857 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.858 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.858 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.858 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.858 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.858 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.858 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.858 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.858 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.859 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.859 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.859 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.859 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.859 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.859 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.860 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.860 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.860 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.860 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.860 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.860 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.860 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.860 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.861 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.861 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.861 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.861 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.861 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.861 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.861 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.862 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.862 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.862 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.862 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.862 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.862 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.862 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.862 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.863 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.863 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.863 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.863 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.863 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.863 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.863 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.864 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.864 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.864 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.864 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.864 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.864 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.864 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.864 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.865 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.865 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.865 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.865 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.865 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.865 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.865 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 586 Action root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.865 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.866 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.866 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.866 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.866 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.866 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.866 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.866 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.866 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.867 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.867 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.867 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.867 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.867 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.867 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.867 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.867 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.868 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.868 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.868 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.868 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.869 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.869 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.869 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.869 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.869 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.869 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.869 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.869 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.870 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.870 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.870 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.870 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.870 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.870 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.870 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.870 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.871 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.871 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.871 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.871 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.871 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.871 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.871 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.872 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.872 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.872 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.872 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.872 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.872 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.872 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.872 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.873 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.874 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.874 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.874 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.874 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.874 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.874 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.874 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.874 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.875 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.875 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.875 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.875 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.875 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.875 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.875 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.875 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.876 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.876 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.876 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.876 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.876 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.876 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.876 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.876 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.877 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.877 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.877 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.877 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.877 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.877 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.878 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.878 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.878 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 587 Timer root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.878 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.878 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.878 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.878 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.879 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.879 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.879 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.879 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.879 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.879 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.879 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.879 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.880 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.880 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.880 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.880 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.880 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.880 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.880 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.880 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.881 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.881 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.881 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.881 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.881 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.881 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.881 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.881 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.882 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.882 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.882 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.882 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.882 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.882 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.882 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.883 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.883 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.883 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.883 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.883 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.883 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.883 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.883 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.884 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.884 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.884 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.884 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.884 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.884 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.884 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.884 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.885 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.885 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.885 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.885 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.885 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.885 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.885 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.886 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.886 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.886 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.886 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.886 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.886 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.886 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.887 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.887 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.887 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.887 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.887 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.887 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.887 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.887 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.888 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.888 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.888 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.888 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.888 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.888 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.888 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.888 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.889 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.889 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.889 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.889 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.889 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.889 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.889 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.890 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.890 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.890 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.890 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.890 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 588 Rotation root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.890 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.890 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.890 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.891 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.891 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.891 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.891 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.891 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.891 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.891 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.892 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.892 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.892 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.892 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.892 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.892 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.892 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.892 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.893 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.893 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.893 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.893 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.893 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.893 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.893 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.894 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.894 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.894 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.894 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.894 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.894 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.894 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.895 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.895 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.895 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.895 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.895 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.895 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.895 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.895 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.896 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.896 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.896 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.896 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.896 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.896 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.896 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.896 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.897 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.897 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.897 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.897 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.897 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.897 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.897 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.897 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.898 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.898 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.898 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.898 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.898 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.898 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.898 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.898 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.899 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.899 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.899 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.899 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.899 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.899 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.899 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.899 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.900 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.900 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.900 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.900 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.900 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.900 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.900 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.900 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.901 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.901 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.901 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.901 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.901 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.901 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.901 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.901 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.902 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.902 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.902 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.902 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.902 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 589 Client root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.902 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.903 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.903 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.903 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.903 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.903 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.903 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.903 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.904 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.904 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.904 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.904 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.904 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.904 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.904 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.904 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.905 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.905 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.905 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.905 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.905 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.905 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.905 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.905 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.906 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.906 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.906 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.906 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.906 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.906 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.906 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.907 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.907 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.907 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.907 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.907 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.907 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.907 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.907 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.908 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.908 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.908 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.908 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.908 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.908 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.908 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.908 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.909 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.909 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.909 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.909 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.909 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.909 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.909 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.909 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.910 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.910 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.910 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.910 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.910 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.910 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.910 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.910 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.911 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.911 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.911 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.911 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.911 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.911 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.911 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.912 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.912 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.912 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.912 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.912 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.912 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.912 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.913 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.913 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.913 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.913 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.913 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.913 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.913 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.913 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.914 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.914 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.914 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.914 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.914 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.914 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.914 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.914 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 590 UST\x20re root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.915 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.915 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.915 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.915 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.915 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.915 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.915 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.915 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.916 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.916 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.916 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.916 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.916 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.916 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.916 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.916 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.917 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.917 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.917 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.917 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.917 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.917 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.917 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.918 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.918 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.918 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.918 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.918 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.918 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.918 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.918 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.919 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.919 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.919 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.919 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.919 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.919 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.920 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.920 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.920 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.920 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.920 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.920 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.920 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.920 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.921 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.921 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.921 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.921 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.921 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.921 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.921 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.922 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.922 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.922 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.922 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.922 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.922 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.922 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.923 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.923 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.923 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.923 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.923 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.923 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.923 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.923 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.924 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.924 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.924 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.924 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.924 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.924 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.924 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.925 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.925 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.925 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.925 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.925 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.925 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.925 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.925 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.926 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.926 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.926 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.926 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.926 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.926 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.926 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.927 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.927 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.927 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.927 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 591 UST\x20ap root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.927 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.927 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.927 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.927 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.928 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.928 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.928 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.928 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.928 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.928 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.932 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.932 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.932 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.932 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.932 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.932 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.932 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.933 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.933 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.933 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.933 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.933 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.933 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.933 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.933 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.934 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.934 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.934 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.934 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.934 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.934 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.934 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.934 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.935 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.935 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.935 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.935 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.935 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.935 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.935 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.935 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.936 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.936 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.936 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.936 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.936 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.936 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.937 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.937 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.937 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.937 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.937 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.937 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.937 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.937 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.938 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.938 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.938 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.938 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.938 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.938 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.938 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.939 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.939 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.939 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.939 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.939 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.939 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.939 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 592 UST\x20ap root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.939 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.940 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.940 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.940 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.940 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.940 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.940 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.940 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.940 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.941 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.941 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.941 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.941 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.941 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.941 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.941 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.941 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.942 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.942 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.942 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.942 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.942 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.942 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.942 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.943 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.943 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.943 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.943 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.943 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.943 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.943 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.943 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.944 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.944 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.944 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.944 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.944 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.944 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.944 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.944 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.945 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.945 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.945 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.945 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.945 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.945 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.946 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.946 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.946 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.946 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.946 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.946 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.946 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.947 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.947 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.947 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.947 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.947 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.947 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.947 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.947 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.948 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.948 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.948 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.948 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.948 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.948 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.948 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.948 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.949 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.949 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.949 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.949 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.949 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.949 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.949 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.949 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.950 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.950 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.950 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.950 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.950 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.950 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.950 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.950 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.951 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.951 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.951 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.951 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.951 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.951 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.951 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.951 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 593 Applicati root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.952 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.952 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.952 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.952 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.952 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.952 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.952 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.952 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.953 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.953 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.953 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.953 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.953 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.953 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.953 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.954 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.954 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.954 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.954 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.954 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.954 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.954 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.955 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.955 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.955 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.955 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.955 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.955 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.955 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.955 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.956 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.956 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.956 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.956 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.956 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.956 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.956 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.956 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.956 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.957 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.957 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.957 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.957 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.957 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.957 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.957 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.959 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.959 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.959 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.959 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.959 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.959 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.959 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.959 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.960 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.960 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.960 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.960 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.960 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.960 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.960 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.960 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.961 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.961 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.961 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.961 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.961 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.961 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.961 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.961 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.962 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.962 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.962 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.962 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.962 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.962 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.963 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.965 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 594 Agent\x20 root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.966 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 624107 529105 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T21:04:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 309363 529116 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T21:04:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 232548 529111 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T21:04:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.967 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:31.968 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.968 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.968 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.968 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:31.968 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:31.968 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:31.968 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:31.968 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:31.969 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:31.969 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:31.969 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.969 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 9821 529108 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T21:04:31.969 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 23428 529107 /usr/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T21:04:31.969 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.969 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root mem REG 0,24 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-28T21:04:31.969 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.970 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.970 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:31.970 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 3wW REG 0,23 0 1251 /run/lttng/lttng-sessiond.lck 2023-11-28T21:04:31.970 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 4u unix 0xffff98ee0a3c4380 0t0 2637 type=STREAM 2023-11-28T21:04:31.970 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 5r FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.970 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 6w FIFO 0,13 0t0 2639 pipe 2023-11-28T21:04:31.970 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 7r FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.971 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 8w FIFO 0,13 0t0 2640 pipe 2023-11-28T21:04:31.971 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 9r FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.971 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 10w FIFO 0,13 0t0 2641 pipe 2023-11-28T21:04:31.971 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 11r FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.971 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 12w FIFO 0,13 0t0 2642 pipe 2023-11-28T21:04:31.971 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 13u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.971 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 14r FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.971 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 15w FIFO 0,13 0t0 2643 pipe 2023-11-28T21:04:31.972 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 16r FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.972 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 17w FIFO 0,13 0t0 2644 pipe 2023-11-28T21:04:31.972 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 18r FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.972 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 19w FIFO 0,13 0t0 2645 pipe 2023-11-28T21:04:31.972 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 20u unix 0xffff98ee0a3c1680 0t0 2648 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-28T21:04:31.972 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 21u unix 0xffff98ee0a3c0f00 0t0 2649 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-28T21:04:31.973 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 22u unix 0xffff98ee0a3c0780 0t0 2650 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-28T21:04:31.973 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 23r FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.973 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 24w FIFO 0,13 0t0 2651 pipe 2023-11-28T21:04:31.973 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 25r FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.973 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 26w FIFO 0,13 0t0 2652 pipe 2023-11-28T21:04:31.973 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 27r FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.973 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 28w FIFO 0,13 0t0 2653 pipe 2023-11-28T21:04:31.973 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 29r FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.974 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 30w FIFO 0,13 0t0 2656 pipe 2023-11-28T21:04:31.974 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 31u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.974 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 32u unix 0xffff98ee04fde900 0t0 5957 /var/run/lttng/sessiond-health type=STREAM 2023-11-28T21:04:31.974 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 33r FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.974 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 34w FIFO 0,13 0t0 2657 pipe 2023-11-28T21:04:31.974 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 35u unix 0xffff98ee09ebb480 0t0 4247 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.974 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 36u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.974 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 37r FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.975 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 38w FIFO 0,13 0t0 7369 pipe 2023-11-28T21:04:31.975 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 39r FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.975 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 40w FIFO 0,13 0t0 7370 pipe 2023-11-28T21:04:31.975 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 41u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.975 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 42u unix 0xffff98ee7e527800 0t0 7371 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-28T21:04:31.975 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 43u unix 0xffff98ee0a3c0000 0t0 2658 type=STREAM 2023-11-28T21:04:31.975 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 44u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.975 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 45u unix 0xffff98ee0a3c4b00 0t0 7372 /var/run/lttng/sessiond-notification type=STREAM 2023-11-28T21:04:31.976 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 46r FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.976 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 47w FIFO 0,13 0t0 7373 pipe 2023-11-28T21:04:31.976 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 48u unix 0xffff98ee7e527080 0t0 7374 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-28T21:04:31.976 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 49u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.976 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 50r FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.976 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 51w FIFO 0,13 0t0 7375 pipe 2023-11-28T21:04:31.976 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 52u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.977 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 53r FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.977 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 54w FIFO 0,13 0t0 7376 pipe 2023-11-28T21:04:31.977 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 55r FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.977 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 56u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.977 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 57w FIFO 0,13 0t0 7377 pipe 2023-11-28T21:04:31.977 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 58u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.977 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 59u IPv4 8619 0t0 TCP localhost:5345 (LISTEN) 2023-11-28T21:04:31.977 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 60r FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.978 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 61w FIFO 0,13 0t0 7378 pipe 2023-11-28T21:04:31.978 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 62u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.978 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-ses 519 595 Kernel root 63u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.978 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.978 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.978 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:31.978 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:31.978 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:31.979 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:31.979 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.979 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.979 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.979 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.979 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.979 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.979 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:31.980 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-28T21:04:31.980 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 168152 4430 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:31.980 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 206984 100435 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-11-28T21:04:31.980 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.980 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.980 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.980 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.981 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:31.981 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:31.981 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:31.981 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:31.981 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 348656 25613 /usr/lib/python3/dist-packages/gi/_gi.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:31.981 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:31.981 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:31.981 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:31.982 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 137288 25527 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-11-28T21:04:31.982 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.982 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 23040 4497 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:31.982 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:31.982 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:31.982 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:31.982 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:31.983 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.983 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:31.983 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.983 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.983 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root 1u unix 0xffff98ee04fdb480 0t0 5401 type=STREAM 2023-11-28T21:04:31.983 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root 2u unix 0xffff98ee04fdb480 0t0 5401 type=STREAM 2023-11-28T21:04:31.983 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root 3u unix 0xffff98ee7e524b00 0t0 7398 type=STREAM 2023-11-28T21:04:31.983 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:31.984 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root 5u unix 0xffff98ee7e523480 0t0 7400 type=STREAM 2023-11-28T21:04:31.984 INFO:teuthology.orchestra.run.smithi167.stdout:networkd- 520 root 6u unix 0xffff98ee7e522d00 0t0 7401 type=STREAM 2023-11-28T21:04:31.984 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.984 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.984 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root txt REG 8,1 601248 21354 /usr/sbin/smartd 2023-11-28T21:04:31.984 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.984 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.984 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.985 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.985 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.985 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.985 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:31.985 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.985 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.985 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.985 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:31.986 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.986 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:31.986 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.986 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.986 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.986 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.986 INFO:teuthology.orchestra.run.smithi167.stdout:smartd 539 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.987 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.987 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.987 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root txt REG 8,1 264712 19791 /usr/lib/systemd/systemd-logind 2023-11-28T21:04:31.987 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:31.987 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.987 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:31.987 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.987 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.988 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.988 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.988 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.988 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-28T21:04:31.988 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:31.988 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.989 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.989 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.989 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.989 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.989 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-28T21:04:31.989 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.989 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:31.990 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.990 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-28T21:04:31.990 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.990 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-28T21:04:31.990 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.990 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.990 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 1u unix 0xffff98ee04fdd280 0t0 5414 type=STREAM 2023-11-28T21:04:31.990 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 2u unix 0xffff98ee04fdd280 0t0 5414 type=STREAM 2023-11-28T21:04:31.991 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 3u unix 0xffff98ee0a3c1e00 0t0 2616 type=DGRAM 2023-11-28T21:04:31.991 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 4u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.991 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 5u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.991 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 6u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.991 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 7r REG 0,20 4096 25581 /sys/devices/virtual/tty/tty0/active 2023-11-28T21:04:31.991 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 8u netlink 0t0 2623 KOBJECT_UEVENT 2023-11-28T21:04:31.991 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 9r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.992 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 10r FIFO 0,23 0t0 1384 /run/systemd/inhibit/1.ref 2023-11-28T21:04:31.992 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 11u netlink 0t0 2624 KOBJECT_UEVENT 2023-11-28T21:04:31.992 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 12u netlink 0t0 2625 KOBJECT_UEVENT 2023-11-28T21:04:31.992 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 13u netlink 0t0 2626 KOBJECT_UEVENT 2023-11-28T21:04:31.992 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 14u unix 0xffff98ee0a3c6900 0t0 2627 type=STREAM 2023-11-28T21:04:31.992 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 15u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.992 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 16u CHR 13,65 0t0 162 /dev/input/event1 2023-11-28T21:04:31.992 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 17u CHR 13,64 0t0 161 /dev/input/event0 2023-11-28T21:04:31.993 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 18u CHR 13,66 0t0 413 /dev/input/event2 2023-11-28T21:04:31.993 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-11-28T21:04:31.993 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 20r FIFO 0,23 0t0 1944 /run/systemd/sessions/4.ref 2023-11-28T21:04:31.993 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 22r FIFO 0,23 0t0 3172 /run/systemd/inhibit/8.ref 2023-11-28T21:04:31.993 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-l 546 root 23r FIFO 0,23 0t0 3472 /run/systemd/inhibit/9.ref 2023-11-28T21:04:31.993 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve cwd DIR 8,1 4096 2 / 2023-11-28T21:04:31.993 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve rtd DIR 8,1 4096 2 / 2023-11-28T21:04:31.993 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve txt REG 8,1 489904 19802 /usr/lib/systemd/systemd-resolved 2023-11-28T21:04:31.994 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:31.994 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:31.994 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:31.994 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:31.994 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:31.994 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:31.994 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:31.994 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:31.995 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:31.995 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:31.995 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:31.995 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:31.995 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:31.995 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:31.995 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:31.995 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:31.996 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-28T21:04:31.996 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:31.996 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:31.996 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:31.996 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:31.996 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:31.997 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:31.997 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:31.997 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-28T21:04:31.997 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:31.997 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-28T21:04:31.997 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:31.997 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:31.998 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-28T21:04:31.998 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:31.998 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:31.998 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:31.998 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 1u unix 0xffff98ee05c40f00 0t0 8586 type=STREAM 2023-11-28T21:04:31.998 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 2u unix 0xffff98ee05c40f00 0t0 8586 type=STREAM 2023-11-28T21:04:31.998 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 3u unix 0xffff98ee0b27d280 0t0 3488 type=DGRAM 2023-11-28T21:04:31.999 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 4u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:31.999 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 5u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:31.999 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 6u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.999 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 7r REG 0,41 0 3502 /proc/sys/kernel/hostname 2023-11-28T21:04:31.999 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 8r a_inode 0,14 0 42 inotify 2023-11-28T21:04:31.999 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 9u netlink 0t0 3503 ROUTE 2023-11-28T21:04:31.999 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 10u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:31.999 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 12u unix 0xffff98ee0b27e900 0t0 3504 type=STREAM 2023-11-28T21:04:32.000 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 13u IPv4 3505 0t0 UDP localhost:domain 2023-11-28T21:04:32.000 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 14u IPv4 3506 0t0 TCP localhost:domain (LISTEN) 2023-11-28T21:04:32.000 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 15u unix 0xffff98ee0b27da00 0t0 3507 /run/systemd/resolve/io.systemd.Resolve type=STREAM 2023-11-28T21:04:32.000 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 16u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:32.000 INFO:teuthology.orchestra.run.smithi167.stdout:systemd-r 548 systemd-resolve 17u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:32.000 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.000 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.001 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-28T21:04:32.001 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.001 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.001 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.001 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.001 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.001 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.001 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.002 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-28T21:04:32.002 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.002 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.002 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.002 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.002 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-28T21:04:32.002 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.002 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-28T21:04:32.003 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-28T21:04:32.003 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-28T21:04:32.003 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-28T21:04:32.003 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:32.003 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.003 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.003 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root 1u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:32.003 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root 2u unix 0xffff98ee0a3c7800 0t0 2604 type=STREAM 2023-11-28T21:04:32.004 INFO:teuthology.orchestra.run.smithi167.stdout:lttng-run 580 root 5u unix 0xffff98ee0a3c3c00 0t0 2638 type=STREAM 2023-11-28T21:04:32.004 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.004 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.004 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root txt REG 8,1 121504 11947 /usr/libexec/polkitd 2023-11-28T21:04:32.004 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.004 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.005 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.005 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.005 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.005 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.005 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.005 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.005 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.006 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.006 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.006 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.006 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.006 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.006 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.006 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.006 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.007 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.007 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.007 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.007 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.007 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:32.007 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.007 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.007 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.008 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.008 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.008 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.008 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 4u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.008 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 5u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.008 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 6u unix 0xffff98ee04fde180 0t0 5959 type=STREAM 2023-11-28T21:04:32.008 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 7u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.008 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 8r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.009 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 root 9r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.009 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.009 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.009 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root txt REG 8,1 121504 11947 /usr/libexec/polkitd 2023-11-28T21:04:32.009 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.009 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.009 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.010 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.010 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.010 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.010 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.010 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.010 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.010 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.010 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.011 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.011 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.011 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.011 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.011 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.011 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.011 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.012 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.012 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.012 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.012 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:32.012 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.012 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.013 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.013 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.013 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.013 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.013 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 4u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.013 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 5u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.013 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 6u unix 0xffff98ee04fde180 0t0 5959 type=STREAM 2023-11-28T21:04:32.013 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 7u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.014 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 8r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.014 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 601 gmain root 9r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.014 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.014 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.014 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root txt REG 8,1 121504 11947 /usr/libexec/polkitd 2023-11-28T21:04:32.014 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.014 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.014 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.015 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.015 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.015 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.015 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.015 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.015 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.015 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.015 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.016 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.016 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.016 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.016 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.016 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.016 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.016 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.016 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.017 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.017 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.017 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:32.017 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.017 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.017 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.017 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.017 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.018 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.018 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 4u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.018 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 5u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.018 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 6u unix 0xffff98ee04fde180 0t0 5959 type=STREAM 2023-11-28T21:04:32.018 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 7u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.018 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 8r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.018 INFO:teuthology.orchestra.run.smithi167.stdout:polkitd 600 603 gdbus root 9r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.019 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.019 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.019 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root txt REG 8,1 120640 3891 /usr/sbin/rpc.mountd 2023-11-28T21:04:32.019 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.019 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.019 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.019 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.019 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.020 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.020 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.020 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.020 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.020 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.020 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.021 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.021 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-28T21:04:32.021 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.021 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.021 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.021 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.021 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 3u REG 0,21 0 4026532419 /proc/788/net/rpc/auth.unix.ip/channel 2023-11-28T21:04:32.022 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 4u IPv4 8664 0t0 UDP *:49355 2023-11-28T21:04:32.022 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 5u IPv4 8666 0t0 TCP *:50851 (LISTEN) 2023-11-28T21:04:32.022 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 6u IPv6 8668 0t0 UDP *:38136 2023-11-28T21:04:32.022 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 7u IPv6 8670 0t0 TCP *:41863 (LISTEN) 2023-11-28T21:04:32.022 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 8u IPv4 8672 0t0 UDP *:57330 2023-11-28T21:04:32.022 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 9u IPv4 8674 0t0 TCP *:58169 (LISTEN) 2023-11-28T21:04:32.022 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 10u IPv6 8676 0t0 UDP *:55248 2023-11-28T21:04:32.022 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 11u IPv6 8678 0t0 TCP *:45143 (LISTEN) 2023-11-28T21:04:32.023 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 12u IPv4 8680 0t0 UDP *:57550 2023-11-28T21:04:32.023 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 13u IPv4 8682 0t0 TCP *:53675 (LISTEN) 2023-11-28T21:04:32.023 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 14u IPv6 8684 0t0 UDP *:50596 2023-11-28T21:04:32.023 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 15u IPv6 8686 0t0 TCP *:41965 (LISTEN) 2023-11-28T21:04:32.023 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 16u REG 0,21 0 4026532423 /proc/788/net/rpc/auth.unix.gid/channel 2023-11-28T21:04:32.023 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 17u REG 0,21 0 4026532440 /proc/788/net/rpc/nfsd.export/channel 2023-11-28T21:04:32.023 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 18u REG 0,21 0 4026532444 /proc/788/net/rpc/nfsd.fh/channel 2023-11-28T21:04:32.024 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 19r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.024 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.mount 788 root 20u unix 0xffff98ee7e525280 0t0 7395 type=DGRAM 2023-11-28T21:04:32.024 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root cwd DIR 8,1 4096 1160 /var/spool/cron 2023-11-28T21:04:32.024 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.024 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root txt REG 8,1 51792 1461 /usr/sbin/cron 2023-11-28T21:04:32.024 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.024 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.024 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.025 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.025 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.025 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.025 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.025 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.025 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.025 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root 1u unix 0xffff98ee09ebad00 0t0 4267 type=STREAM 2023-11-28T21:04:32.025 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root 2u unix 0xffff98ee09ebad00 0t0 4267 type=STREAM 2023-11-28T21:04:32.026 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root 3uW REG 0,23 4 1330 /run/crond.pid 2023-11-28T21:04:32.026 INFO:teuthology.orchestra.run.smithi167.stdout:cron 799 root 4u unix 0xffff98ee09eb9e00 0t0 4286 type=DGRAM 2023-11-28T21:04:32.026 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.026 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.026 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios txt REG 8,1 79096 10043 /usr/sbin/nrpe 2023-11-28T21:04:32.026 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.026 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.027 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.027 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.027 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.027 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.027 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.027 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.027 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.027 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.028 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.028 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-28T21:04:32.028 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios DEL REG 8,1 24692 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.028 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.028 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.028 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios 1w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.028 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.029 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios 3u unix 0xffff98ee70cc2580 0t0 6080 type=DGRAM 2023-11-28T21:04:32.029 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios 4u IPv4 6088 0t0 TCP *:nrpe (LISTEN) 2023-11-28T21:04:32.029 INFO:teuthology.orchestra.run.smithi167.stdout:nrpe 808 nagios 5u IPv6 6089 0t0 TCP *:nrpe (LISTEN) 2023-11-28T21:04:32.029 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd cwd DIR 8,1 4096 5393 /var/lib/nfs 2023-11-28T21:04:32.029 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.029 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd txt REG 8,1 80944 2384 /usr/sbin/rpc.statd 2023-11-28T21:04:32.030 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.030 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.030 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.030 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.030 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.030 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.030 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.030 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.031 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.031 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.031 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.031 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-28T21:04:32.031 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.031 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.031 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.031 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.032 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 4u unix 0xffff98ee0b60c380 0t0 9935 type=DGRAM 2023-11-28T21:04:32.032 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 5u IPv4 9936 0t0 UDP localhost:991 2023-11-28T21:04:32.032 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 6w REG 0,23 4 1346 /run/rpc.statd.pid 2023-11-28T21:04:32.032 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 8u IPv4 9940 0t0 UDP *:50824 2023-11-28T21:04:32.032 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 9u IPv4 9942 0t0 TCP *:38485 (LISTEN) 2023-11-28T21:04:32.032 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 10u IPv6 9944 0t0 UDP *:50023 2023-11-28T21:04:32.032 INFO:teuthology.orchestra.run.smithi167.stdout:rpc.statd 815 statd 11u IPv6 9946 0t0 TCP *:58623 (LISTEN) 2023-11-28T21:04:32.033 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.033 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.033 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root txt REG 8,1 436848 16646 /usr/sbin/tgtd 2023-11-28T21:04:32.033 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.033 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.033 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.033 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.033 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.034 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.034 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.034 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.034 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.034 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.034 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.034 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.034 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:32.035 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.035 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.035 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 1u unix 0xffff98ee0a970f00 0t0 2701 type=STREAM 2023-11-28T21:04:32.035 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 2u unix 0xffff98ee0a970f00 0t0 2701 type=STREAM 2023-11-28T21:04:32.035 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.035 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 4ww REG 0,23 0 1359 /run/tgtd/socket.0.lock 2023-11-28T21:04:32.035 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 5u unix 0xffff98ee0a971e00 0t0 2717 /var/run/tgtd/socket.0 type=STREAM 2023-11-28T21:04:32.035 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 6u IPv4 4357 0t0 TCP *:iscsi-target (LISTEN) 2023-11-28T21:04:32.036 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 7u IPv6 4358 0t0 TCP *:iscsi-target (LISTEN) 2023-11-28T21:04:32.036 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 8u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:32.036 INFO:teuthology.orchestra.run.smithi167.stdout:tgtd 819 root 9u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.036 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.036 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.036 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:32.036 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.036 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-28T21:04:32.037 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.037 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.037 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.037 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-28T21:04:32.037 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 347096 12961 /usr/lib/python3/dist-packages/apt_pkg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.037 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 206984 100435 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-11-28T21:04:32.038 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.038 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.038 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.038 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.038 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.038 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 137288 25527 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-11-28T21:04:32.038 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.039 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 348656 25613 /usr/lib/python3/dist-packages/gi/_gi.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.039 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.039 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.039 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.039 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.039 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.039 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.039 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-28T21:04:32.040 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.040 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.040 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.040 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.040 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.040 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.040 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 168152 4430 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.040 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.041 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 23040 4497 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.041 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.041 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.041 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.041 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.041 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.041 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.041 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.042 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.042 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 1u unix 0xffff98ee08f30f00 0t0 4323 type=STREAM 2023-11-28T21:04:32.042 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 2u unix 0xffff98ee08f30f00 0t0 4323 type=STREAM 2023-11-28T21:04:32.042 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 3w REG 8,1 113 655466 /var/log/unattended-upgrades/unattended-upgrades-shutdown.log 2023-11-28T21:04:32.042 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 4u unix 0xffff98ee0b27cb00 0t0 3649 type=STREAM 2023-11-28T21:04:32.042 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 5u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.042 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 6u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.042 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 7u unix 0xffff98ee0b27c380 0t0 3652 type=STREAM 2023-11-28T21:04:32.043 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 8w FIFO 0,23 0t0 1384 /run/systemd/inhibit/1.ref 2023-11-28T21:04:32.043 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 root 9u unix 0xffff98ee0b27f800 0t0 3653 type=STREAM 2023-11-28T21:04:32.043 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.043 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.043 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:32.043 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.043 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-28T21:04:32.043 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.044 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.044 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.044 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-28T21:04:32.044 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 347096 12961 /usr/lib/python3/dist-packages/apt_pkg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.044 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 206984 100435 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-11-28T21:04:32.044 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.045 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.045 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.045 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.045 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.045 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 137288 25527 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-11-28T21:04:32.045 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.045 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 348656 25613 /usr/lib/python3/dist-packages/gi/_gi.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.045 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.046 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.046 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.046 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.046 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.046 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.046 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-28T21:04:32.046 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.047 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.047 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.047 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.047 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.047 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.047 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 168152 4430 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.047 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.047 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 23040 4497 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.048 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.048 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.048 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.048 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.048 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.048 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.048 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.048 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.048 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 1u unix 0xffff98ee08f30f00 0t0 4323 type=STREAM 2023-11-28T21:04:32.049 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 2u unix 0xffff98ee08f30f00 0t0 4323 type=STREAM 2023-11-28T21:04:32.049 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 3w REG 8,1 113 655466 /var/log/unattended-upgrades/unattended-upgrades-shutdown.log 2023-11-28T21:04:32.049 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 4u unix 0xffff98ee0b27cb00 0t0 3649 type=STREAM 2023-11-28T21:04:32.049 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 5u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.049 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 6u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.049 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 7u unix 0xffff98ee0b27c380 0t0 3652 type=STREAM 2023-11-28T21:04:32.049 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 8w FIFO 0,23 0t0 1384 /run/systemd/inhibit/1.ref 2023-11-28T21:04:32.050 INFO:teuthology.orchestra.run.smithi167.stdout:unattende 821 981 gmain root 9u unix 0xffff98ee0b27f800 0t0 3653 type=STREAM 2023-11-28T21:04:32.050 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.050 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.050 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.050 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.050 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.050 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.050 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.051 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.051 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.051 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.051 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.051 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.051 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.051 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.051 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.052 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.052 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.052 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.052 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.052 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.052 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.052 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.053 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.053 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.053 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.053 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.053 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.053 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.053 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.053 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.054 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.054 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.054 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.054 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.054 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.054 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.054 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.055 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.055 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.055 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.055 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.055 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.055 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.055 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1049 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.055 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.056 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.056 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.056 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.056 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.056 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.056 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.056 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.056 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.057 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.057 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.057 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.057 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.057 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.057 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.057 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.057 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.058 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.058 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.058 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.058 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.058 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1050 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.058 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.058 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.058 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.059 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.059 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.059 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.059 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.059 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.059 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.059 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.059 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.060 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.060 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.060 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.060 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.060 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.060 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.061 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.061 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.061 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.061 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.061 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1051 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.061 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.061 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.061 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.062 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.062 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.062 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.062 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.062 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.062 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.062 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.062 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.063 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.063 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.063 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.063 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.063 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.063 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.063 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.063 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.064 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.064 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.064 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1052 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.064 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.064 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.064 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.064 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.064 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.065 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.065 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.065 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.065 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.065 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.065 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.065 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.065 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.066 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.066 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.066 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.066 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.066 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.066 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.066 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.067 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.067 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1053 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.067 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.067 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.067 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.067 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.067 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.067 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.068 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.068 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.068 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.068 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.068 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.068 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.068 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.069 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.069 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.069 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.069 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.069 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.069 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.069 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.069 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.070 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1087 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.070 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.070 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.070 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.070 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.070 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.070 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.071 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.071 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.071 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.071 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.071 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.071 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.071 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.071 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.072 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.072 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.072 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.072 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.072 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.072 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.072 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.072 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1089 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.073 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.073 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.073 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.073 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.073 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.073 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.073 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.073 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.074 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.074 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.074 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.074 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.074 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.074 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.074 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.074 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.075 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.075 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.075 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.075 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.075 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.075 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1090 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.075 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.075 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.076 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.076 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.076 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.076 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.076 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.076 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.076 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.077 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.077 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.077 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.077 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.077 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.077 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.077 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.077 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.078 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.078 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.078 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.078 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.078 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1091 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.078 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.078 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.079 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.079 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.079 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.079 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.079 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.079 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.079 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.079 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.080 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.080 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.080 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.080 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.080 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.080 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.080 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.080 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.081 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.081 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.081 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.081 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1101 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.081 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.081 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.081 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.081 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.082 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.082 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.082 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.082 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.082 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.082 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.082 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.082 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.083 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.083 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.083 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.083 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.083 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.083 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.083 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.084 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.084 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.084 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1102 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.084 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.084 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.084 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.084 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.084 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.085 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.085 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.085 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.085 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.085 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.086 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.086 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.086 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.086 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.086 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.086 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.086 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.086 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.087 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.087 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.087 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.087 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 1103 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.087 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.087 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.087 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-28T21:04:32.088 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.088 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.088 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.088 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.088 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 1u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.088 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 2u unix 0xffff98ee70cc0780 0t0 6048 type=STREAM 2023-11-28T21:04:32.088 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 3u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.088 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 4r FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.089 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 5w FIFO 0,13 0t0 4389 pipe 2023-11-28T21:04:32.089 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-28T21:04:32.089 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.089 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.089 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 9r FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.089 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 10w FIFO 0,13 0t0 10031 pipe 2023-11-28T21:04:32.089 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 11u unix 0xffff98ee053bf080 0t0 10032 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-28T21:04:32.089 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 12u unix 0xffff98ee053ba580 0t0 10034 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.090 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 13u IPv4 3684 0t0 TCP localhost:37245 (LISTEN) 2023-11-28T21:04:32.090 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 14u unix 0xffff98ee70ebc380 0t0 102530 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.090 INFO:teuthology.orchestra.run.smithi167.stdout:container 827 7077 container root 15u unix 0xffff98ee01f08000 0t0 102532 /run/containerd/containerd.sock type=STREAM 2023-11-28T21:04:32.090 INFO:teuthology.orchestra.run.smithi167.stdout:lockd 851 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.090 INFO:teuthology.orchestra.run.smithi167.stdout:lockd 851 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.090 INFO:teuthology.orchestra.run.smithi167.stdout:lockd 851 root txt unknown /proc/851/exe 2023-11-28T21:04:32.090 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.091 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.091 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root txt REG 8,1 917192 24518 /usr/sbin/sshd 2023-11-28T21:04:32.091 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.091 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.091 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.091 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.091 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.092 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.092 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.092 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.092 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.092 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.092 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.092 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.092 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.092 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.093 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.093 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.093 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.093 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.093 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.093 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.093 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.094 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.094 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.094 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.094 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.094 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-28T21:04:32.094 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.094 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.095 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root 1u unix 0xffff98ee0b60e180 0t0 9979 type=STREAM 2023-11-28T21:04:32.095 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root 2u unix 0xffff98ee0b60e180 0t0 9979 type=STREAM 2023-11-28T21:04:32.095 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root 3u IPv4 9988 0t0 TCP *:ssh (LISTEN) 2023-11-28T21:04:32.095 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 856 root 4u IPv6 9990 0t0 TCP *:ssh (LISTEN) 2023-11-28T21:04:32.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 963 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 963 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 963 root txt unknown /proc/963/exe 2023-11-28T21:04:32.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 964 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 964 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 964 root txt unknown /proc/964/exe 2023-11-28T21:04:32.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 965 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 965 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 965 root txt unknown /proc/965/exe 2023-11-28T21:04:32.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 966 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 966 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 966 root txt unknown /proc/966/exe 2023-11-28T21:04:32.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 969 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 969 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 969 root txt unknown /proc/969/exe 2023-11-28T21:04:32.097 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 971 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.097 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 971 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.097 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 971 root txt unknown /proc/971/exe 2023-11-28T21:04:32.097 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 972 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.097 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 972 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.098 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 972 root txt unknown /proc/972/exe 2023-11-28T21:04:32.098 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 973 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.098 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 973 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.098 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 973 root txt unknown /proc/973/exe 2023-11-28T21:04:32.098 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 974 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.098 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 974 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.098 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 974 root txt unknown /proc/974/exe 2023-11-28T21:04:32.098 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 975 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.099 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 975 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.099 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 975 root txt unknown /proc/975/exe 2023-11-28T21:04:32.099 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 976 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.099 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 976 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.099 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 976 root txt unknown /proc/976/exe 2023-11-28T21:04:32.099 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 977 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.099 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 977 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.099 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 977 root txt unknown /proc/977/exe 2023-11-28T21:04:32.100 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 978 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.100 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 978 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.100 INFO:teuthology.orchestra.run.smithi167.stdout:nfsd 978 root txt unknown /proc/978/exe 2023-11-28T21:04:32.100 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.100 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.100 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root txt REG 8,1 56888 3161 /usr/sbin/agetty 2023-11-28T21:04:32.100 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.101 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.101 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.101 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root 0u CHR 4,65 0t0 89 /dev/ttyS1 2023-11-28T21:04:32.101 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root 1u CHR 4,65 0t0 89 /dev/ttyS1 2023-11-28T21:04:32.101 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root 2u CHR 4,65 0t0 89 /dev/ttyS1 2023-11-28T21:04:32.101 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1065 root 4r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.101 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.101 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.101 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root txt REG 8,1 56888 3161 /usr/sbin/agetty 2023-11-28T21:04:32.102 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root mem REG 8,1 353616 44555 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-28T21:04:32.102 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.102 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.102 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.102 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.102 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root 0u CHR 4,1 0t0 20 /dev/tty1 2023-11-28T21:04:32.103 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root 1u CHR 4,1 0t0 20 /dev/tty1 2023-11-28T21:04:32.103 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root 2u CHR 4,1 0t0 20 /dev/tty1 2023-11-28T21:04:32.103 INFO:teuthology.orchestra.run.smithi167.stdout:agetty 1067 root 4r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.103 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.103 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.103 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root txt REG 8,1 3798008 15961 /usr/bin/perl 2023-11-28T21:04:32.103 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.103 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.104 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.104 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 35416 47035 /usr/lib/x86_64-linux-gnu/perl/5.34.0/auto/Time/HiRes/HiRes.so 2023-11-28T21:04:32.104 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 68400 46935 /usr/lib/x86_64-linux-gnu/perl/5.34.0/auto/Compress/Raw/Zlib/Zlib.so 2023-11-28T21:04:32.104 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 60360 33580 /usr/lib/x86_64-linux-gnu/perl-base/auto/List/Util/Util.so 2023-11-28T21:04:32.104 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 23064 47032 /usr/lib/x86_64-linux-gnu/perl/5.34.0/auto/Sys/Syslog/Syslog.so 2023-11-28T21:04:32.104 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 31568 33577 /usr/lib/x86_64-linux-gnu/perl-base/auto/File/Glob/Glob.so 2023-11-28T21:04:32.104 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 18992 33575 /usr/lib/x86_64-linux-gnu/perl-base/auto/Cwd/Cwd.so 2023-11-28T21:04:32.104 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 47816 33582 /usr/lib/x86_64-linux-gnu/perl-base/auto/Socket/Socket.so 2023-11-28T21:04:32.105 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 23152 33579 /usr/lib/x86_64-linux-gnu/perl-base/auto/IO/IO.so 2023-11-28T21:04:32.105 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 110424 33581 /usr/lib/x86_64-linux-gnu/perl-base/auto/POSIX/POSIX.so 2023-11-28T21:04:32.105 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.105 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.105 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 22896 33576 /usr/lib/x86_64-linux-gnu/perl-base/auto/Fcntl/Fcntl.so 2023-11-28T21:04:32.105 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.105 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.105 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root 1w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.106 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.106 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root 3r DIR 0,21 0 1 /proc 2023-11-28T21:04:32.106 INFO:teuthology.orchestra.run.smithi167.stdout:collectl 1132 root 4w REG 8,1 2017633 655424 /var/log/collectl/smithi167-20231128-202512.raw.gz 2023-11-28T21:04:32.106 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.106 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.106 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu txt REG 8,1 1849992 19775 /usr/lib/systemd/systemd 2023-11-28T21:04:32.106 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.106 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.107 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.107 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.107 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.107 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.107 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.107 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-28T21:04:32.107 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.107 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.108 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-28T21:04:32.108 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.108 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.108 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.108 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-28T21:04:32.108 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-28T21:04:32.108 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:32.108 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.108 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.109 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.109 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.109 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-28T21:04:32.109 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.109 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.109 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 1u unix 0xffff98ee70cc0000 0t0 10421 type=STREAM 2023-11-28T21:04:32.110 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 2u unix 0xffff98ee70cc0000 0t0 10421 type=STREAM 2023-11-28T21:04:32.110 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 3u unix 0xffff98ee70cc1680 0t0 10442 type=DGRAM 2023-11-28T21:04:32.110 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 4u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.110 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 5u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.110 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 6r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.110 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 7r DIR 0,26 0 4946 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-11-28T21:04:32.110 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 8u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:32.110 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 9u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.111 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 10r REG 0,21 0 10453 /proc/1294/mountinfo 2023-11-28T21:04:32.111 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 11r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.111 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 12u unix 0xffff98ee61062580 0t0 10469 /run/user/1000/bus type=STREAM 2023-11-28T21:04:32.111 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 13r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.111 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 14r REG 0,21 0 4026532078 /proc/swaps 2023-11-28T21:04:32.111 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 15u netlink 0t0 10454 KOBJECT_UEVENT 2023-11-28T21:04:32.111 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 16u unix 0xffff98ee70cc6180 0t0 10460 /run/user/1000/systemd/notify type=DGRAM 2023-11-28T21:04:32.111 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 17u unix 0xffff98ee61060000 0t0 10461 type=DGRAM 2023-11-28T21:04:32.112 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 18u unix 0xffff98ee61060780 0t0 10462 type=DGRAM 2023-11-28T21:04:32.112 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 19u unix 0xffff98ee61060f00 0t0 10463 /run/user/1000/systemd/private type=STREAM 2023-11-28T21:04:32.112 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 20u unix 0xffff98ee61061680 0t0 10465 type=STREAM 2023-11-28T21:04:32.112 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 21u a_inode 0,14 0 42 [timerfd] 2023-11-28T21:04:32.112 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 26u unix 0xffff98ee61062d00 0t0 10471 /run/user/1000/gnupg/S.dirmngr type=STREAM 2023-11-28T21:04:32.112 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 27u unix 0xffff98ee61063480 0t0 10473 /run/user/1000/gnupg/S.gpg-agent.browser type=STREAM 2023-11-28T21:04:32.112 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 28u unix 0xffff98ee61063c00 0t0 10475 /run/user/1000/gnupg/S.gpg-agent.extra type=STREAM 2023-11-28T21:04:32.112 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 29u unix 0xffff98ee61064380 0t0 10477 /run/user/1000/gnupg/S.gpg-agent.ssh type=STREAM 2023-11-28T21:04:32.113 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 30u unix 0xffff98ee61064b00 0t0 10479 /run/user/1000/gnupg/S.gpg-agent type=STREAM 2023-11-28T21:04:32.113 INFO:teuthology.orchestra.run.smithi167.stdout:systemd 1294 ubuntu 31u unix 0xffff98ee61065280 0t0 10481 /run/user/1000/pk-debconf-socket type=STREAM 2023-11-28T21:04:32.113 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.113 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.113 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu txt REG 8,1 1849992 19775 /usr/lib/systemd/systemd 2023-11-28T21:04:32.113 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:32.113 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:32.113 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:32.114 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 14328 14474 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-11-28T21:04:32.114 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:32.114 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:32.114 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.114 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.114 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.114 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.115 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.115 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.115 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.115 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.115 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 26616 14492 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-11-28T21:04:32.115 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.115 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.115 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.116 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.116 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.116 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 14328 14479 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-11-28T21:04:32.116 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.116 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.116 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:32.116 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.116 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.117 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.117 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.117 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-28T21:04:32.117 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.117 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.117 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.117 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-28T21:04:32.118 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-28T21:04:32.118 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.118 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.118 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-28T21:04:32.118 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-28T21:04:32.118 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.118 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.118 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-28T21:04:32.119 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:32.119 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:32.119 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.119 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.119 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu 1u unix 0xffff98ee70cc0000 0t0 10421 type=STREAM 2023-11-28T21:04:32.119 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu 2u unix 0xffff98ee70cc0000 0t0 10421 type=STREAM 2023-11-28T21:04:32.119 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.119 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.120 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu 6w FIFO 0,13 0t0 10424 pipe 2023-11-28T21:04:32.120 INFO:teuthology.orchestra.run.smithi167.stdout:(sd-pam) 1295 ubuntu 7u unix 0xffff98ee70cc6900 0t0 10432 type=DGRAM 2023-11-28T21:04:32.120 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.120 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.120 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-28T21:04:32.120 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.120 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-28T21:04:32.120 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-28T21:04:32.121 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.121 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.121 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.121 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.121 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.121 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.121 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.121 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.122 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.122 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-28T21:04:32.122 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-28T21:04:32.122 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.122 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.122 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-28T21:04:32.122 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.122 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.123 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 1w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.123 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.123 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 3u unix 0xffff98ee7d1b9680 0t0 3135 /run/systemd/journal/syslog type=DGRAM 2023-11-28T21:04:32.123 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 4r CHR 1,9 0t0 9 /dev/urandom 2023-11-28T21:04:32.123 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 5r REG 0,21 0 4026532037 /proc/kmsg 2023-11-28T21:04:32.123 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 6u unix 0xffff98ee7e526180 0t0 7524 type=DGRAM 2023-11-28T21:04:32.123 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 7w REG 8,1 782468 115293 /var/log/syslog 2023-11-28T21:04:32.123 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 8w REG 8,1 1018653 658050 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T21:04:32.123 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 9w REG 8,1 631716 655464 /var/log/auth.log 2023-11-28T21:04:32.124 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 10w REG 8,1 381472 115294 /var/log/kern.log 2023-11-28T21:04:32.124 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 syslog 11w REG 8,1 316849 658049 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T21:04:32.124 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.124 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.124 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-28T21:04:32.124 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.124 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-28T21:04:32.125 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-28T21:04:32.125 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.125 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.125 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.125 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.125 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.125 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.126 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.126 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.126 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.126 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-28T21:04:32.126 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-28T21:04:32.126 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.126 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.127 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-28T21:04:32.127 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.127 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.127 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 1w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.127 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.127 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 3u unix 0xffff98ee7d1b9680 0t0 3135 /run/systemd/journal/syslog type=DGRAM 2023-11-28T21:04:32.127 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 4r CHR 1,9 0t0 9 /dev/urandom 2023-11-28T21:04:32.127 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 5r REG 0,21 0 4026532037 /proc/kmsg 2023-11-28T21:04:32.128 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 6u unix 0xffff98ee7e526180 0t0 7524 type=DGRAM 2023-11-28T21:04:32.128 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 7w REG 8,1 782468 115293 /var/log/syslog 2023-11-28T21:04:32.128 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 8w REG 8,1 1018653 658050 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T21:04:32.128 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 9w REG 8,1 631716 655464 /var/log/auth.log 2023-11-28T21:04:32.128 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 10w REG 8,1 381472 115294 /var/log/kern.log 2023-11-28T21:04:32.128 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1344 in:imuxso syslog 11w REG 8,1 316849 658049 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T21:04:32.128 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.128 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.129 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-28T21:04:32.129 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.129 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-28T21:04:32.129 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-28T21:04:32.129 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.129 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.129 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.129 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.130 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.130 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.130 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.130 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.130 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.130 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-28T21:04:32.130 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-28T21:04:32.130 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.131 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.131 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-28T21:04:32.131 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.131 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.131 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 1w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.131 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.131 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 3u unix 0xffff98ee7d1b9680 0t0 3135 /run/systemd/journal/syslog type=DGRAM 2023-11-28T21:04:32.131 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 4r CHR 1,9 0t0 9 /dev/urandom 2023-11-28T21:04:32.132 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 5r REG 0,21 0 4026532037 /proc/kmsg 2023-11-28T21:04:32.132 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 6u unix 0xffff98ee7e526180 0t0 7524 type=DGRAM 2023-11-28T21:04:32.132 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 7w REG 8,1 782468 115293 /var/log/syslog 2023-11-28T21:04:32.132 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 8w REG 8,1 1018653 658050 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T21:04:32.132 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 9w REG 8,1 631716 655464 /var/log/auth.log 2023-11-28T21:04:32.132 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 10w REG 8,1 381472 115294 /var/log/kern.log 2023-11-28T21:04:32.133 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1345 in:imklog syslog 11w REG 8,1 316849 658049 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T21:04:32.133 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.133 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.133 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-28T21:04:32.133 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.133 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-28T21:04:32.133 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-28T21:04:32.133 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.134 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.134 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.134 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.134 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.134 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.134 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.134 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.134 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.135 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-28T21:04:32.135 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-28T21:04:32.135 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.135 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.135 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-28T21:04:32.135 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.135 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.135 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 1w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.136 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.136 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 3u unix 0xffff98ee7d1b9680 0t0 3135 /run/systemd/journal/syslog type=DGRAM 2023-11-28T21:04:32.136 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 4r CHR 1,9 0t0 9 /dev/urandom 2023-11-28T21:04:32.136 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 5r REG 0,21 0 4026532037 /proc/kmsg 2023-11-28T21:04:32.136 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 6u unix 0xffff98ee7e526180 0t0 7524 type=DGRAM 2023-11-28T21:04:32.136 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 7w REG 8,1 782468 115293 /var/log/syslog 2023-11-28T21:04:32.136 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 8w REG 8,1 1018653 658050 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T21:04:32.136 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 9w REG 8,1 631716 655464 /var/log/auth.log 2023-11-28T21:04:32.137 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 10w REG 8,1 381472 115294 /var/log/kern.log 2023-11-28T21:04:32.137 INFO:teuthology.orchestra.run.smithi167.stdout:rsyslogd 1343 1346 rs:main syslog 11w REG 8,1 316849 658049 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T21:04:32.137 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.137 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.137 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root txt REG 8,1 301576 16829 /usr/libexec/packagekitd 2023-11-28T21:04:32.137 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.137 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.137 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.138 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.138 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.138 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.138 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.138 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.138 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.138 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.138 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.139 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.139 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.139 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.139 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.139 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.139 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 31440 4482 /usr/lib/x86_64-linux-gnu/libdebuginfod-0.186.so 2023-11-28T21:04:32.139 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.140 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.140 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.140 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.140 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.140 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.140 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.141 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.141 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.141 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.141 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.141 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 117400 4466 /usr/lib/x86_64-linux-gnu/libelf-0.186.so 2023-11-28T21:04:32.141 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 825848 1712 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-11-28T21:04:32.141 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.141 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.141 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 170056 4111 /usr/lib/x86_64-linux-gnu/libxmlb.so.2.0.0 2023-11-28T21:04:32.142 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-28T21:04:32.142 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 700800 596 /usr/lib/x86_64-linux-gnu/libdw-0.186.so 2023-11-28T21:04:32.142 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.142 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.142 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.142 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.142 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 531656 4130 /usr/lib/x86_64-linux-gnu/libappstream.so.0.15.2 2023-11-28T21:04:32.143 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 1371192 18416 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.2003.0 2023-11-28T21:04:32.143 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-28T21:04:32.143 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.143 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-28T21:04:32.143 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.143 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.143 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 358272 16234 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-11-28T21:04:32.143 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.144 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.144 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.144 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.144 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.144 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.144 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.144 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.145 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.145 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.145 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.145 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.145 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.145 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.145 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.145 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.146 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.146 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:32.146 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.146 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.146 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.146 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.146 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 418280 18355 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-11-28T21:04:32.146 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.147 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.147 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.147 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 1u unix 0xffff98ee04fdf800 0t0 51026 type=STREAM 2023-11-28T21:04:32.147 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 2u unix 0xffff98ee04fdf800 0t0 51026 type=STREAM 2023-11-28T21:04:32.147 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 3u unix 0xffff98ee04fda580 0t0 51029 type=DGRAM 2023-11-28T21:04:32.147 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.148 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 5u netlink 0t0 51032 ROUTE 2023-11-28T21:04:32.148 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 6u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.148 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.148 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 8u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.148 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 9u unix 0xffff98ee0a974b00 0t0 55038 type=STREAM 2023-11-28T21:04:32.148 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 root 10u REG 8,1 32768 5265 /var/lib/PackageKit/transactions.db 2023-11-28T21:04:32.148 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.148 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.149 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root txt REG 8,1 301576 16829 /usr/libexec/packagekitd 2023-11-28T21:04:32.149 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.149 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.149 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.149 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.149 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.149 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.149 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.150 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.150 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.150 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.150 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.150 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.150 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.150 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.150 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.151 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.151 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 31440 4482 /usr/lib/x86_64-linux-gnu/libdebuginfod-0.186.so 2023-11-28T21:04:32.151 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.151 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.151 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.151 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.151 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.151 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.152 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.152 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.152 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.152 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.152 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.152 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 117400 4466 /usr/lib/x86_64-linux-gnu/libelf-0.186.so 2023-11-28T21:04:32.152 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 825848 1712 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-11-28T21:04:32.152 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.153 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.153 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 170056 4111 /usr/lib/x86_64-linux-gnu/libxmlb.so.2.0.0 2023-11-28T21:04:32.153 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-28T21:04:32.153 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 700800 596 /usr/lib/x86_64-linux-gnu/libdw-0.186.so 2023-11-28T21:04:32.153 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.153 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.153 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.153 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.154 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 531656 4130 /usr/lib/x86_64-linux-gnu/libappstream.so.0.15.2 2023-11-28T21:04:32.154 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 1371192 18416 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.2003.0 2023-11-28T21:04:32.154 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-28T21:04:32.154 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.154 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-28T21:04:32.154 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.154 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.154 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 358272 16234 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-11-28T21:04:32.155 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.155 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.155 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.155 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.155 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.155 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.155 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.156 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.156 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.156 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.156 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.156 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.156 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.156 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.156 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.157 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.157 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.157 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:32.157 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.157 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.157 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.157 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.157 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 418280 18355 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-11-28T21:04:32.158 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.158 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.158 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.158 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 1u unix 0xffff98ee04fdf800 0t0 51026 type=STREAM 2023-11-28T21:04:32.158 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 2u unix 0xffff98ee04fdf800 0t0 51026 type=STREAM 2023-11-28T21:04:32.158 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 3u unix 0xffff98ee04fda580 0t0 51029 type=DGRAM 2023-11-28T21:04:32.158 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.158 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 5u netlink 0t0 51032 ROUTE 2023-11-28T21:04:32.159 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 6u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.159 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.159 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 8u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.159 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 9u unix 0xffff98ee0a974b00 0t0 55038 type=STREAM 2023-11-28T21:04:32.159 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13517 gmain root 10u REG 8,1 32768 5265 /var/lib/PackageKit/transactions.db 2023-11-28T21:04:32.159 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.159 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.159 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root txt REG 8,1 301576 16829 /usr/libexec/packagekitd 2023-11-28T21:04:32.160 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.160 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.160 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.160 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.160 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.160 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.160 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.160 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.161 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.161 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.161 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.161 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.161 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.161 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.161 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.161 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.162 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 31440 4482 /usr/lib/x86_64-linux-gnu/libdebuginfod-0.186.so 2023-11-28T21:04:32.162 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.162 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.162 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.162 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.162 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.163 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.163 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.163 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.163 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.163 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.163 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.163 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 117400 4466 /usr/lib/x86_64-linux-gnu/libelf-0.186.so 2023-11-28T21:04:32.163 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 825848 1712 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-11-28T21:04:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 170056 4111 /usr/lib/x86_64-linux-gnu/libxmlb.so.2.0.0 2023-11-28T21:04:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-28T21:04:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 700800 596 /usr/lib/x86_64-linux-gnu/libdw-0.186.so 2023-11-28T21:04:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.165 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.165 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 531656 4130 /usr/lib/x86_64-linux-gnu/libappstream.so.0.15.2 2023-11-28T21:04:32.165 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 1371192 18416 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.2003.0 2023-11-28T21:04:32.165 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-28T21:04:32.165 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.165 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-28T21:04:32.165 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.165 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.166 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 358272 16234 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-11-28T21:04:32.166 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.166 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.166 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.166 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.166 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.166 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.166 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.167 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.167 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.167 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.167 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.167 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.167 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.167 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.167 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.168 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.168 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.168 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:32.168 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.168 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.168 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.168 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.168 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 418280 18355 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-11-28T21:04:32.169 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.169 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.169 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.169 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 1u unix 0xffff98ee04fdf800 0t0 51026 type=STREAM 2023-11-28T21:04:32.169 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 2u unix 0xffff98ee04fdf800 0t0 51026 type=STREAM 2023-11-28T21:04:32.169 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 3u unix 0xffff98ee04fda580 0t0 51029 type=DGRAM 2023-11-28T21:04:32.169 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.170 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 5u netlink 0t0 51032 ROUTE 2023-11-28T21:04:32.170 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 6u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.170 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 7r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.170 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 8u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.170 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 9u unix 0xffff98ee0a974b00 0t0 55038 type=STREAM 2023-11-28T21:04:32.170 INFO:teuthology.orchestra.run.smithi167.stdout:packageki 13516 13518 gdbus root 10u REG 8,1 32768 5265 /var/lib/PackageKit/transactions.db 2023-11-28T21:04:32.170 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 16998 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.170 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 16998 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.171 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 16998 root txt unknown /proc/16998/exe 2023-11-28T21:04:32.171 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17030 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.171 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17030 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.171 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17030 root txt unknown /proc/17030/exe 2023-11-28T21:04:32.171 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17062 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.171 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17062 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.171 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17062 root txt unknown /proc/17062/exe 2023-11-28T21:04:32.171 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17094 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.172 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17094 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.172 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17094 root txt unknown /proc/17094/exe 2023-11-28T21:04:32.172 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17126 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.172 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17126 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.172 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17126 root txt unknown /proc/17126/exe 2023-11-28T21:04:32.172 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17320 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.172 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17320 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.173 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17320 root txt unknown /proc/17320/exe 2023-11-28T21:04:32.173 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17321 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.173 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17321 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.173 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17321 root txt unknown /proc/17321/exe 2023-11-28T21:04:32.173 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17322 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.173 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17322 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.173 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17322 root txt unknown /proc/17322/exe 2023-11-28T21:04:32.173 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17323 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.174 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17323 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.174 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17323 root txt unknown /proc/17323/exe 2023-11-28T21:04:32.174 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17324 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.174 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17324 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.174 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17324 root txt unknown /proc/17324/exe 2023-11-28T21:04:32.174 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17325 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.174 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17325 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.174 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17325 root txt unknown /proc/17325/exe 2023-11-28T21:04:32.175 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17326 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.175 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17326 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.175 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17326 root txt unknown /proc/17326/exe 2023-11-28T21:04:32.175 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17327 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.175 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17327 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.175 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17327 root txt unknown /proc/17327/exe 2023-11-28T21:04:32.175 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17328 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.175 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17328 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.176 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 17328 root txt unknown /proc/17328/exe 2023-11-28T21:04:32.176 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 17329 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.176 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 17329 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.176 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 17329 root txt unknown /proc/17329/exe 2023-11-28T21:04:32.176 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.176 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.176 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.176 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.177 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.177 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.177 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.177 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.177 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.177 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.177 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.177 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.178 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.178 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.178 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.178 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.178 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.178 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.179 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.179 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.179 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.179 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.179 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.179 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.179 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.179 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.180 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.180 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.180 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.180 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.180 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.180 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.180 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.180 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.181 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.181 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.181 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.181 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.181 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.181 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.181 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.181 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.182 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.182 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.182 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.182 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.182 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.182 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.182 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.182 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.183 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.183 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.183 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.183 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.183 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.183 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.183 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.183 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.184 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.184 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.184 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.184 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.184 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.184 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.184 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.184 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.185 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.185 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.185 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.185 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.185 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.185 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.185 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.185 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.186 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.186 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.186 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.186 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.186 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.186 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.186 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.187 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.187 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.187 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.187 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.187 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.187 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.187 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.188 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.188 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27676 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.188 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.188 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.188 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.188 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.188 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.188 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.189 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.189 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.189 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.189 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.189 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.189 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.189 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.189 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.190 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.190 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.190 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.190 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.190 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.190 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.190 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.190 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.191 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.191 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.191 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.191 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.191 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.191 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.191 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.191 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.192 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.192 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.192 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.192 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.192 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.192 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.192 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.192 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.193 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.193 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.193 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.193 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.193 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.193 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.193 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27677 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.193 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.194 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.194 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.194 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.194 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.194 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.194 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.195 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.195 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.195 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.195 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.195 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.195 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.195 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.195 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.196 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.196 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.196 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.196 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.196 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.196 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.196 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.196 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.197 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.197 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.197 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.197 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.197 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.197 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.197 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.197 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.198 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.198 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.198 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.198 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.198 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.198 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.198 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.198 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.199 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.199 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.199 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.199 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.199 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.199 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27678 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.199 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.199 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.200 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.200 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.200 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.200 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.200 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.200 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.200 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.200 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.201 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.201 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.201 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.201 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.201 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.201 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.201 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.202 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.202 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.202 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.202 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.202 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.202 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.202 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.202 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.203 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.203 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.203 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.203 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.203 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.203 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.203 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.203 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.204 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.205 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.205 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.205 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.205 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27679 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.205 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.205 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.205 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.205 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.206 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.206 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.206 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.206 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.206 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.206 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.206 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.207 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.207 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.207 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.207 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.207 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.207 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.207 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.207 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.208 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.208 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.208 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.208 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.208 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.208 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.208 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.208 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.209 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.209 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.209 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.209 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.209 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.209 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.210 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.210 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.210 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.210 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.210 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.210 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.210 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.210 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.211 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.211 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.211 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.211 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27680 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.211 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.211 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.211 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.212 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.212 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.212 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.212 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.212 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.212 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.212 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.212 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.213 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.213 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.213 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.213 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.213 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.213 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.213 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.214 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.214 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.214 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.214 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.214 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.214 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.214 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.214 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.215 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.215 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.215 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.215 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.215 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.215 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.215 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.216 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.216 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.216 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.216 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.216 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.216 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.216 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.217 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.217 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.217 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.217 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.217 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27681 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.217 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.217 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.217 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.218 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.218 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.218 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.218 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.218 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.218 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.219 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.219 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.219 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.219 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.219 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.219 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.219 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.220 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.220 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.220 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.220 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.220 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.220 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.220 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.220 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.221 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.221 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.221 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.221 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.221 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.221 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.221 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.221 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.222 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.222 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.222 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.222 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.222 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.222 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.222 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.223 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.223 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.223 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.223 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.223 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.223 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27682 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.223 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.223 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.224 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.224 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.224 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.224 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.224 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.224 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.224 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.224 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.225 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.225 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.225 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.225 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.225 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.225 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.225 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.225 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.226 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.226 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.226 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.226 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.226 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.226 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.227 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.227 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.227 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.227 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.227 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.227 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.227 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.227 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.228 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.228 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.228 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.228 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.228 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.228 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.228 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.228 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.229 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.229 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.229 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.229 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.229 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27683 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.229 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.229 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.229 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.230 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.230 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.230 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.230 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.230 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.230 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.230 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.231 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.231 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.231 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.231 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.231 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.231 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.231 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.231 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.232 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.232 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.232 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.232 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.232 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.232 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.232 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.232 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.233 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.233 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.233 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.233 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.233 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.233 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.233 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.234 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.234 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.234 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.234 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.234 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.234 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.235 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.235 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.235 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.235 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.235 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.235 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27684 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.235 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.235 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.236 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.236 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.236 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.236 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.236 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.236 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.236 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.236 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.237 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.237 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.237 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.237 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.237 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.237 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.237 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.237 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.238 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.238 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.238 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.238 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.238 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.238 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.238 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.238 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.239 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.239 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.239 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.239 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.239 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.239 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.239 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.239 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.240 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.240 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.240 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.240 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.240 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.240 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.240 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.241 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.241 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.241 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.241 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27685 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.241 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.241 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.241 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.241 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.242 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.242 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.242 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.242 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.242 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.242 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.242 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.243 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.243 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.243 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.243 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.243 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.243 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.243 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.243 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.244 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.244 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.244 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.244 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.244 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.244 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.244 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.245 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.245 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.245 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.245 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.245 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.245 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.245 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.245 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.246 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.246 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.246 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.246 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.246 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.246 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.246 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.246 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.247 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.247 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.247 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27781 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.247 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.247 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.247 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.247 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.248 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.248 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.248 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.248 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.248 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.248 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.248 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.248 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.249 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.249 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.249 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.249 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.249 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.249 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.249 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.250 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.250 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.250 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.250 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.250 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.250 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.250 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.251 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.251 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.251 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.251 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.251 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.251 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.251 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.251 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.252 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.252 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.252 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.252 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.252 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.252 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.252 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.253 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.253 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.253 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.253 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27782 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.253 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.253 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.253 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-28T21:04:32.253 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.254 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.254 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.254 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.254 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.254 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.254 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.254 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.254 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.255 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.255 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.255 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.255 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.255 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.255 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.255 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.256 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.256 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.256 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.256 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.256 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.256 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.256 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 1u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.256 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 2u unix 0xffff98ee01f08780 0t0 99600 type=STREAM 2023-11-28T21:04:32.257 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 3u unix 0xffff98ee01f0e900 0t0 99610 /var/run/docker/metrics.sock type=STREAM 2023-11-28T21:04:32.257 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 4u unix 0xffff98ee05c45280 0t0 8532 /run/docker.sock type=STREAM 2023-11-28T21:04:32.257 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.257 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 6r FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.257 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 7w FIFO 0,13 0t0 99605 pipe 2023-11-28T21:04:32.257 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 8u unix 0xffff98ee70ebbc00 0t0 94146 type=STREAM 2023-11-28T21:04:32.257 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 9u unix 0xffff98ee01f08f00 0t0 99611 type=STREAM 2023-11-28T21:04:32.257 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-28T21:04:32.258 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.258 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 12u netlink 0t0 101736 ROUTE 2023-11-28T21:04:32.258 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 13u netlink 0t0 101737 XFRM 2023-11-28T21:04:32.258 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 14u netlink 0t0 101738 NETFILTER 2023-11-28T21:04:32.258 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 15u unix 0xffff98ee053bb480 0t0 101783 /var/run/docker/libnetwork/54a367162eaa.sock type=STREAM 2023-11-28T21:04:32.258 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-28T21:04:32.259 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-28T21:04:32.259 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-28T21:04:32.259 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-28T21:04:32.259 INFO:teuthology.orchestra.run.smithi167.stdout:dockerd 27675 27783 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-28T21:04:32.259 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.259 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.259 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root txt REG 8,1 917192 24518 /usr/sbin/sshd 2023-11-28T21:04:32.260 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.260 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:32.260 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:32.260 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 18424 14480 /usr/lib/x86_64-linux-gnu/security/pam_mail.so 2023-11-28T21:04:32.260 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:32.260 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 18424 14482 /usr/lib/x86_64-linux-gnu/security/pam_motd.so 2023-11-28T21:04:32.260 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:32.260 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:32.261 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 14328 14474 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-11-28T21:04:32.261 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 14328 14479 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-11-28T21:04:32.261 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 26616 14492 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-11-28T21:04:32.261 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 14328 14484 /usr/lib/x86_64-linux-gnu/security/pam_nologin.so 2023-11-28T21:04:32.261 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:32.261 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:32.261 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.261 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.262 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.262 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.262 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.262 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.262 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.262 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.262 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.262 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.263 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.263 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.263 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.263 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.263 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.263 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.263 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.263 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.264 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.264 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.264 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.264 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.264 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.264 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.264 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.264 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-28T21:04:32.265 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:32.265 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:32.265 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.265 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.265 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.265 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.265 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root 3u unix 0xffff98ee08f33480 0t0 104499 type=DGRAM 2023-11-28T21:04:32.266 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root 4u IPv4 101971 0t0 TCP smithi167.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:35282 (ESTABLISHED) 2023-11-28T21:04:32.266 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root 6u unix 0xffff98ee08f36900 0t0 104485 type=STREAM 2023-11-28T21:04:32.266 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root 7u unix 0xffff98ee08f32d00 0t0 104507 type=STREAM 2023-11-28T21:04:32.266 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27946 root 8w FIFO 0,23 0t0 1944 /run/systemd/sessions/4.ref 2023-11-28T21:04:32.266 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.266 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.266 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu txt REG 8,1 917192 24518 /usr/sbin/sshd 2023-11-28T21:04:32.266 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.267 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:32.267 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:32.267 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 18424 14480 /usr/lib/x86_64-linux-gnu/security/pam_mail.so 2023-11-28T21:04:32.267 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:32.267 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 18424 14482 /usr/lib/x86_64-linux-gnu/security/pam_motd.so 2023-11-28T21:04:32.267 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:32.267 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:32.267 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 14328 14474 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-11-28T21:04:32.268 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 14328 14479 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-11-28T21:04:32.268 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 26616 14492 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-11-28T21:04:32.268 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 14328 14484 /usr/lib/x86_64-linux-gnu/security/pam_nologin.so 2023-11-28T21:04:32.268 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:32.268 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:32.268 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.268 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.268 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.269 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.269 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.269 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.269 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.269 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.269 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.269 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.269 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.270 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.270 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.270 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.270 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.270 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.270 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.270 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.270 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.271 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.271 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.271 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.271 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.271 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.271 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.271 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-28T21:04:32.272 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:32.272 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:32.272 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.272 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.272 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.272 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.272 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 3u unix 0xffff98ee08f33480 0t0 104499 type=DGRAM 2023-11-28T21:04:32.273 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 4u IPv4 101971 0t0 TCP smithi167.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:35282 (ESTABLISHED) 2023-11-28T21:04:32.273 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 5u unix 0xffff98ee08f37800 0t0 104506 type=STREAM 2023-11-28T21:04:32.273 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 6u unix 0xffff98ee08f36900 0t0 104485 type=STREAM 2023-11-28T21:04:32.273 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 8w FIFO 0,23 0t0 1944 /run/systemd/sessions/4.ref 2023-11-28T21:04:32.273 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 9w FIFO 0,13 0t0 193565 pipe 2023-11-28T21:04:32.273 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 11w FIFO 0,13 0t0 120592 pipe 2023-11-28T21:04:32.273 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 12r FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:32.273 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 13r FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.274 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 14w FIFO 0,13 0t0 122222 pipe 2023-11-28T21:04:32.274 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 15r FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.274 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 16r FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:32.274 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 17w FIFO 0,13 0t0 122225 pipe 2023-11-28T21:04:32.274 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 18r FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:32.274 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 19r FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:32.274 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 20w FIFO 0,13 0t0 122228 pipe 2023-11-28T21:04:32.274 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 21r FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:32.275 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 22r FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:32.275 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 23w FIFO 0,13 0t0 122231 pipe 2023-11-28T21:04:32.275 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 24r FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:32.275 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 25r FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:32.275 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 26w FIFO 0,13 0t0 119542 pipe 2023-11-28T21:04:32.275 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 27r FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:32.275 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 28r FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:32.276 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 29r FIFO 0,13 0t0 193746 pipe 2023-11-28T21:04:32.276 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 30r FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:32.276 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 31r FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:32.276 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 32w FIFO 0,13 0t0 119548 pipe 2023-11-28T21:04:32.276 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 34r FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:32.276 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 35r FIFO 0,13 0t0 193747 pipe 2023-11-28T21:04:32.276 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 36r FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:32.276 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 40r FIFO 0,13 0t0 187972 pipe 2023-11-28T21:04:32.277 INFO:teuthology.orchestra.run.smithi167.stdout:sshd 27967 ubuntu 42r FIFO 0,13 0t0 187973 pipe 2023-11-28T21:04:32.277 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.277 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.277 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp txt REG 8,1 879688 5353 /usr/sbin/ntpd 2023-11-28T21:04:32.277 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.277 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.277 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.277 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.278 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.278 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp mem REG 8,1 140800 30041 /usr/lib/x86_64-linux-gnu/libopts.so.25.17.1 2023-11-28T21:04:32.278 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.278 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.278 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.278 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 1r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.278 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 2r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.278 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 3u unix 0xffff98ee70cc3c00 0t0 99670 type=DGRAM 2023-11-28T21:04:32.279 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 4w REG 8,1 49140 365 /var/log/ntpstats/rawstats.20231128 2023-11-28T21:04:32.279 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 6w REG 8,1 4775 463 /var/log/ntpstats/peerstats.20231128 2023-11-28T21:04:32.279 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 7w REG 8,1 652 658052 /var/log/ntpstats/loopstats.20231128 2023-11-28T21:04:32.279 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 16u IPv6 99678 0t0 UDP *:ntp 2023-11-28T21:04:32.279 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 17u IPv4 99681 0t0 UDP *:ntp 2023-11-28T21:04:32.279 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 18u IPv4 99685 0t0 UDP localhost:ntp 2023-11-28T21:04:32.279 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 19u IPv4 99687 0t0 UDP smithi167.front.sepia.ceph.com:ntp 2023-11-28T21:04:32.280 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 20u IPv6 99689 0t0 UDP localhost:ntp 2023-11-28T21:04:32.280 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 21u IPv6 99691 0t0 UDP smithi167:ntp 2023-11-28T21:04:32.280 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 22u netlink 0t0 99692 ROUTE 2023-11-28T21:04:32.280 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 23u unix 0xffff98ee70cc4380 0t0 99693 type=STREAM 2023-11-28T21:04:32.280 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 24u unix 0xffff98ee70cc4b00 0t0 99694 type=STREAM 2023-11-28T21:04:32.280 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 25u IPv4 127721 0t0 UDP smithi167:ntp 2023-11-28T21:04:32.280 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 26u IPv6 130807 0t0 UDP smithi167:ntp 2023-11-28T21:04:32.280 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 ntp 27u IPv6 130809 0t0 UDP smithi167:ntp 2023-11-28T21:04:32.281 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.281 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.281 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp txt REG 8,1 879688 5353 /usr/sbin/ntpd 2023-11-28T21:04:32.281 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.281 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.281 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.281 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.282 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.282 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp mem REG 8,1 140800 30041 /usr/lib/x86_64-linux-gnu/libopts.so.25.17.1 2023-11-28T21:04:32.282 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.282 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.282 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.282 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 1r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.282 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 2r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.283 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 3u unix 0xffff98ee70cc3c00 0t0 99670 type=DGRAM 2023-11-28T21:04:32.283 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 4w REG 8,1 49140 365 /var/log/ntpstats/rawstats.20231128 2023-11-28T21:04:32.283 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 6w REG 8,1 4775 463 /var/log/ntpstats/peerstats.20231128 2023-11-28T21:04:32.283 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 7w REG 8,1 652 658052 /var/log/ntpstats/loopstats.20231128 2023-11-28T21:04:32.283 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 16u IPv6 99678 0t0 UDP *:ntp 2023-11-28T21:04:32.283 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 17u IPv4 99681 0t0 UDP *:ntp 2023-11-28T21:04:32.283 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 18u IPv4 99685 0t0 UDP localhost:ntp 2023-11-28T21:04:32.283 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 19u IPv4 99687 0t0 UDP smithi167.front.sepia.ceph.com:ntp 2023-11-28T21:04:32.284 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 20u IPv6 99689 0t0 UDP localhost:ntp 2023-11-28T21:04:32.284 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 21u IPv6 99691 0t0 UDP smithi167:ntp 2023-11-28T21:04:32.284 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 22u netlink 0t0 99692 ROUTE 2023-11-28T21:04:32.284 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 23u unix 0xffff98ee70cc4380 0t0 99693 type=STREAM 2023-11-28T21:04:32.284 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 24u unix 0xffff98ee70cc4b00 0t0 99694 type=STREAM 2023-11-28T21:04:32.284 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 25u IPv4 127721 0t0 UDP smithi167:ntp 2023-11-28T21:04:32.284 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 26u IPv6 130807 0t0 UDP smithi167:ntp 2023-11-28T21:04:32.284 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd 27986 27987 ntpd ntp 27u IPv6 130809 0t0 UDP smithi167:ntp 2023-11-28T21:04:32.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:32.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph 1u unix 0xffff98ee053bcb00 0t0 112867 type=STREAM 2023-11-28T21:04:32.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-cras 30775 ceph 2u unix 0xffff98ee053bcb00 0t0 112867 type=STREAM 2023-11-28T21:04:32.287 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.287 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.287 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root txt REG 8,1 3397048 798945 /usr/sbin/wpa_supplicant 2023-11-28T21:04:32.287 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.287 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.288 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.288 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.288 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.288 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.288 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.288 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.288 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.288 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-28T21:04:32.289 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.289 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 43064 16927 /usr/lib/x86_64-linux-gnu/libpcsclite.so.1.0.0 2023-11-28T21:04:32.289 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.289 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.289 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 32256 26981 /usr/lib/x86_64-linux-gnu/libnl-genl-3.so.200.26.0 2023-11-28T21:04:32.290 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.290 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.290 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.290 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root 1u unix 0xffff98ee01f0f800 0t0 115048 type=STREAM 2023-11-28T21:04:32.290 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root 2u unix 0xffff98ee01f0f800 0t0 115048 type=STREAM 2023-11-28T21:04:32.290 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root 3u unix 0xffff98ee01f09e00 0t0 115051 type=DGRAM 2023-11-28T21:04:32.290 INFO:teuthology.orchestra.run.smithi167.stdout:wpa_suppl 32439 root 4u unix 0xffff98ee01f0cb00 0t0 115052 type=STREAM 2023-11-28T21:04:32.291 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.291 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.291 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root txt REG 8,1 3255560 796827 /usr/sbin/NetworkManager 2023-11-28T21:04:32.291 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 43160 796825 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-settings-plugin-ifupdown.so 2023-11-28T21:04:32.291 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 39168 796819 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-adsl.so 2023-11-28T21:04:32.291 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 298240 796822 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wifi.so 2023-11-28T21:04:32.291 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-28T21:04:32.291 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 59864 74945 /usr/lib/x86_64-linux-gnu/libjansson.so.4.13.0 2023-11-28T21:04:32.292 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 47400 796821 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-team.so 2023-11-28T21:04:32.292 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 1144904 796407 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-28T21:04:32.292 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 100584 796826 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-wwan.so 2023-11-28T21:04:32.292 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.292 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 194000 796280 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.6 2023-11-28T21:04:32.292 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 35120 796823 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wwan.so 2023-11-28T21:04:32.292 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.292 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 27144 796637 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-11-28T21:04:32.293 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 96544 796820 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-bluetooth.so 2023-11-28T21:04:32.293 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.293 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.293 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.293 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.293 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.293 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.293 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.294 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.294 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.294 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.294 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.294 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.294 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.294 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.295 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.295 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.295 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.295 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.295 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.295 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.295 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.295 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.296 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.296 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.296 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.296 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.296 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.296 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.296 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.296 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.297 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.297 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.297 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.297 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.297 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.297 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.297 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.298 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.298 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.298 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.298 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.298 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.298 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-28T21:04:32.298 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.299 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.299 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.299 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 27280 796420 /usr/lib/x86_64-linux-gnu/libndp.so.0.2.0 2023-11-28T21:04:32.299 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.299 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.299 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.299 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.299 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.300 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.300 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 1u unix 0xffff98ee053be180 0t0 113523 type=STREAM 2023-11-28T21:04:32.300 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 2u unix 0xffff98ee053be180 0t0 113523 type=STREAM 2023-11-28T21:04:32.300 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.300 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.300 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 5u unix 0xffff98ee053bbc00 0t0 113528 type=DGRAM 2023-11-28T21:04:32.300 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 6u unix 0xffff98ee053bd280 0t0 113529 type=STREAM 2023-11-28T21:04:32.301 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 7u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.301 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 8r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.301 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 9r REG 0,4 0 4026532704 mnt 2023-11-28T21:04:32.301 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 10u netlink 0t0 117126 KOBJECT_UEVENT 2023-11-28T21:04:32.301 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 11u netlink 0t0 117127 GENERIC 2023-11-28T21:04:32.301 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 12u netlink 0t0 117128 ROUTE 2023-11-28T21:04:32.301 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 13r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.301 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 14r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.302 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 15u netlink 0t0 113530 KOBJECT_UEVENT 2023-11-28T21:04:32.302 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 16u netlink 0t0 113531 KOBJECT_UEVENT 2023-11-28T21:04:32.302 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 17u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.302 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 root 19w FIFO 0,23 0t0 3172 /run/systemd/inhibit/8.ref 2023-11-28T21:04:32.302 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.302 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.302 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root txt REG 8,1 3255560 796827 /usr/sbin/NetworkManager 2023-11-28T21:04:32.302 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 43160 796825 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-settings-plugin-ifupdown.so 2023-11-28T21:04:32.303 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 39168 796819 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-adsl.so 2023-11-28T21:04:32.303 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 298240 796822 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wifi.so 2023-11-28T21:04:32.303 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-28T21:04:32.303 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 59864 74945 /usr/lib/x86_64-linux-gnu/libjansson.so.4.13.0 2023-11-28T21:04:32.303 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 47400 796821 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-team.so 2023-11-28T21:04:32.303 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 1144904 796407 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-28T21:04:32.303 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 100584 796826 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-wwan.so 2023-11-28T21:04:32.304 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.304 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 194000 796280 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.6 2023-11-28T21:04:32.304 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 35120 796823 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wwan.so 2023-11-28T21:04:32.304 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.304 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 27144 796637 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-11-28T21:04:32.304 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 96544 796820 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-bluetooth.so 2023-11-28T21:04:32.304 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.305 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.305 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.305 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.305 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.305 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.305 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.305 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.305 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.306 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.306 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.306 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.306 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.306 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.306 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.306 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.306 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.307 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.307 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.307 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.307 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.307 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.307 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.307 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.308 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.308 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.308 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.308 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.308 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.308 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.308 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.308 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.308 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.309 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.309 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.309 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.309 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.309 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.309 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.309 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.309 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.310 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.310 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-28T21:04:32.310 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.310 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.310 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.310 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 27280 796420 /usr/lib/x86_64-linux-gnu/libndp.so.0.2.0 2023-11-28T21:04:32.310 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.311 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.311 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.311 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.311 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.311 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.311 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 1u unix 0xffff98ee053be180 0t0 113523 type=STREAM 2023-11-28T21:04:32.311 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 2u unix 0xffff98ee053be180 0t0 113523 type=STREAM 2023-11-28T21:04:32.311 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.312 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.312 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 5u unix 0xffff98ee053bbc00 0t0 113528 type=DGRAM 2023-11-28T21:04:32.312 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 6u unix 0xffff98ee053bd280 0t0 113529 type=STREAM 2023-11-28T21:04:32.312 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 7u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.312 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 8r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.312 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 9r REG 0,4 0 4026532704 mnt 2023-11-28T21:04:32.312 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 10u netlink 0t0 117126 KOBJECT_UEVENT 2023-11-28T21:04:32.313 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 11u netlink 0t0 117127 GENERIC 2023-11-28T21:04:32.313 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 12u netlink 0t0 117128 ROUTE 2023-11-28T21:04:32.313 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 13r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.313 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 14r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.313 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 15u netlink 0t0 113530 KOBJECT_UEVENT 2023-11-28T21:04:32.313 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 16u netlink 0t0 113531 KOBJECT_UEVENT 2023-11-28T21:04:32.313 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 17u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.314 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32622 gmain root 19w FIFO 0,23 0t0 3172 /run/systemd/inhibit/8.ref 2023-11-28T21:04:32.314 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.314 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.314 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root txt REG 8,1 3255560 796827 /usr/sbin/NetworkManager 2023-11-28T21:04:32.314 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 43160 796825 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-settings-plugin-ifupdown.so 2023-11-28T21:04:32.314 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 39168 796819 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-adsl.so 2023-11-28T21:04:32.314 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 298240 796822 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wifi.so 2023-11-28T21:04:32.314 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-28T21:04:32.315 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 59864 74945 /usr/lib/x86_64-linux-gnu/libjansson.so.4.13.0 2023-11-28T21:04:32.315 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 47400 796821 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-team.so 2023-11-28T21:04:32.315 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 1144904 796407 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-28T21:04:32.315 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 100584 796826 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-wwan.so 2023-11-28T21:04:32.315 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.315 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 194000 796280 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.6 2023-11-28T21:04:32.315 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 35120 796823 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wwan.so 2023-11-28T21:04:32.315 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.316 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 27144 796637 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-11-28T21:04:32.316 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 96544 796820 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-bluetooth.so 2023-11-28T21:04:32.316 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.316 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.316 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.316 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.316 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.317 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.317 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.317 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.317 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.317 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.317 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.317 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.317 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.318 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.318 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.318 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.318 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.318 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.318 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.318 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.318 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.319 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.319 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.319 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.319 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.319 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.319 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.320 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.320 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.320 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.320 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.320 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.320 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.320 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.321 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.321 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.321 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.321 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.321 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.321 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.321 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.321 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.322 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-28T21:04:32.322 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.322 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.322 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.322 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 27280 796420 /usr/lib/x86_64-linux-gnu/libndp.so.0.2.0 2023-11-28T21:04:32.322 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.322 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.322 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.323 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.323 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.323 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.323 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 1u unix 0xffff98ee053be180 0t0 113523 type=STREAM 2023-11-28T21:04:32.323 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 2u unix 0xffff98ee053be180 0t0 113523 type=STREAM 2023-11-28T21:04:32.323 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.323 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.323 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 5u unix 0xffff98ee053bbc00 0t0 113528 type=DGRAM 2023-11-28T21:04:32.324 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 6u unix 0xffff98ee053bd280 0t0 113529 type=STREAM 2023-11-28T21:04:32.324 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 7u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.324 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 8r REG 0,4 0 4026531840 net 2023-11-28T21:04:32.324 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 9r REG 0,4 0 4026532704 mnt 2023-11-28T21:04:32.324 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 10u netlink 0t0 117126 KOBJECT_UEVENT 2023-11-28T21:04:32.324 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 11u netlink 0t0 117127 GENERIC 2023-11-28T21:04:32.324 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 12u netlink 0t0 117128 ROUTE 2023-11-28T21:04:32.324 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 13r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.325 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 14r a_inode 0,14 0 42 inotify 2023-11-28T21:04:32.325 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 15u netlink 0t0 113530 KOBJECT_UEVENT 2023-11-28T21:04:32.325 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 16u netlink 0t0 113531 KOBJECT_UEVENT 2023-11-28T21:04:32.325 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 17u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.325 INFO:teuthology.orchestra.run.smithi167.stdout:NetworkMa 32621 32623 gdbus root 19w FIFO 0,23 0t0 3172 /run/systemd/inhibit/8.ref 2023-11-28T21:04:32.325 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres cwd DIR 8,1 4096 799263 /var/lib/postgresql/14/main 2023-11-28T21:04:32.325 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.325 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres txt REG 8,1 9509856 797502 /usr/lib/postgresql/14/bin/postgres 2023-11-28T21:04:32.326 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres DEL REG 0,1 3076 /dev/zero 2023-11-28T21:04:32.326 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.326 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.326 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.326 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.326 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.326 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.326 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.327 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.327 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.327 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.327 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.327 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.327 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.328 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.328 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.328 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.328 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.328 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.328 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.328 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.329 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.329 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.329 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.329 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.329 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-28T21:04:32.329 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.329 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.329 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.330 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.330 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.330 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.330 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.330 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.330 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.330 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.331 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.331 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.331 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.331 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.331 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.331 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.331 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 0,24 26976 18 /dev/shm/PostgreSQL.3772725000 2023-11-28T21:04:32.331 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.332 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres DEL REG 0,1 4 /SYSV000c321f 2023-11-28T21:04:32.332 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.332 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres 1w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.332 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres 2w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.332 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres 3r FIFO 0,13 0t0 117828 pipe 2023-11-28T21:04:32.332 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres 4w FIFO 0,13 0t0 117828 pipe 2023-11-28T21:04:32.332 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres 5u IPv6 117834 0t0 TCP localhost:postgresql (LISTEN) 2023-11-28T21:04:32.332 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres 6u IPv4 117835 0t0 TCP localhost:postgresql (LISTEN) 2023-11-28T21:04:32.333 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres 7u unix 0xffff98ee08f34380 0t0 117836 /var/run/postgresql/.s.PGSQL.5432 type=STREAM 2023-11-28T21:04:32.333 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33151 postgres 8u IPv6 117840 0t0 UDP localhost:38563->localhost:38563 2023-11-28T21:04:32.333 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres cwd DIR 8,1 4096 799263 /var/lib/postgresql/14/main 2023-11-28T21:04:32.333 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.333 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres txt REG 8,1 9509856 797502 /usr/lib/postgresql/14/bin/postgres 2023-11-28T21:04:32.333 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres DEL REG 0,1 3076 /dev/zero 2023-11-28T21:04:32.333 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.333 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.334 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.334 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.334 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.334 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.334 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.334 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.334 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.335 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.335 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.335 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.335 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.335 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.335 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.335 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.336 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.336 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.336 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.336 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.336 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.336 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.336 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.336 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.337 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-28T21:04:32.337 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.337 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.337 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.337 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.337 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.337 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.337 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.338 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.338 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.338 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.338 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.338 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.338 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.338 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.339 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.339 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.339 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 0,24 26976 18 /dev/shm/PostgreSQL.3772725000 2023-11-28T21:04:32.339 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.339 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres DEL REG 0,1 4 /SYSV000c321f 2023-11-28T21:04:32.339 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.339 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres 1w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.339 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres 2w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.340 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres 3r FIFO 0,13 0t0 117828 pipe 2023-11-28T21:04:32.340 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres 4u REG 8,1 16777216 799293 /var/lib/postgresql/14/main/pg_wal/000000010000000000000001 2023-11-28T21:04:32.340 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres 8u IPv6 117840 0t0 UDP localhost:38563->localhost:38563 2023-11-28T21:04:32.340 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres 9u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.340 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33153 postgres 10u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.340 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres cwd DIR 8,1 4096 799263 /var/lib/postgresql/14/main 2023-11-28T21:04:32.340 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.341 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres txt REG 8,1 9509856 797502 /usr/lib/postgresql/14/bin/postgres 2023-11-28T21:04:32.341 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres DEL REG 0,1 3076 /dev/zero 2023-11-28T21:04:32.341 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.341 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.341 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.341 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.341 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.341 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.342 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.342 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.342 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.342 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.342 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.342 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.343 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.343 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.343 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.343 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.343 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.343 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.343 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.344 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.344 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.344 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.344 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.344 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.344 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-28T21:04:32.344 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.344 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.345 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.345 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.345 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.345 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.345 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.345 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.345 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.345 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.346 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.346 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.346 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.346 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.346 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.346 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.346 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 0,24 26976 18 /dev/shm/PostgreSQL.3772725000 2023-11-28T21:04:32.347 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.347 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres DEL REG 0,1 4 /SYSV000c321f 2023-11-28T21:04:32.347 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.347 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres 1w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.347 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres 2w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.347 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres 3r FIFO 0,13 0t0 117828 pipe 2023-11-28T21:04:32.347 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres 8u IPv6 117840 0t0 UDP localhost:38563->localhost:38563 2023-11-28T21:04:32.347 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres 9u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.348 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33154 postgres 10u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.348 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres cwd DIR 8,1 4096 799263 /var/lib/postgresql/14/main 2023-11-28T21:04:32.348 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.348 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres txt REG 8,1 9509856 797502 /usr/lib/postgresql/14/bin/postgres 2023-11-28T21:04:32.348 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres DEL REG 0,1 3076 /dev/zero 2023-11-28T21:04:32.348 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.348 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.348 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.349 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.349 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.349 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.349 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.349 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.349 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.349 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.350 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.350 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.350 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.350 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.350 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.350 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.350 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.351 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.351 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.351 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.351 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.351 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.351 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.351 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.352 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-28T21:04:32.352 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.352 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.352 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.352 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.352 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.352 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.352 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.353 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.353 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.353 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.353 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.353 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.353 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.353 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.353 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.354 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.354 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 0,24 26976 18 /dev/shm/PostgreSQL.3772725000 2023-11-28T21:04:32.354 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.354 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres DEL REG 0,1 4 /SYSV000c321f 2023-11-28T21:04:32.354 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.354 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres 1w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.354 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres 2w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.355 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres 3r FIFO 0,13 0t0 117828 pipe 2023-11-28T21:04:32.355 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres 4u REG 8,1 16777216 799293 /var/lib/postgresql/14/main/pg_wal/000000010000000000000001 2023-11-28T21:04:32.355 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres 8u IPv6 117840 0t0 UDP localhost:38563->localhost:38563 2023-11-28T21:04:32.355 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres 9u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.355 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33155 postgres 10u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.355 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres cwd DIR 8,1 4096 799263 /var/lib/postgresql/14/main 2023-11-28T21:04:32.355 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.355 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres txt REG 8,1 9509856 797502 /usr/lib/postgresql/14/bin/postgres 2023-11-28T21:04:32.356 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres DEL REG 0,1 3076 /dev/zero 2023-11-28T21:04:32.356 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.356 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.356 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.356 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.356 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.356 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.356 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.357 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.357 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.357 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.357 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.357 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.357 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.357 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.357 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.358 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.358 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.358 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.358 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.358 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.358 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.359 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.359 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.359 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.359 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-28T21:04:32.359 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.359 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.359 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.359 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.360 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.360 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.360 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.360 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.360 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.360 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.360 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 0,24 26976 18 /dev/shm/PostgreSQL.3772725000 2023-11-28T21:04:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.361 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres DEL REG 0,1 4 /SYSV000c321f 2023-11-28T21:04:32.362 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.362 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres 1w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.362 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres 2w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.362 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres 3r FIFO 0,13 0t0 117828 pipe 2023-11-28T21:04:32.362 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres 4u REG 8,1 8192 799341 /var/lib/postgresql/14/main/global/1262 2023-11-28T21:04:32.362 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres 8u IPv6 117840 0t0 UDP localhost:38563->localhost:38563 2023-11-28T21:04:32.362 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres 9u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.363 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33156 postgres 10u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.363 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres cwd DIR 8,1 4096 799263 /var/lib/postgresql/14/main 2023-11-28T21:04:32.363 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.363 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres txt REG 8,1 9509856 797502 /usr/lib/postgresql/14/bin/postgres 2023-11-28T21:04:32.363 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.363 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.363 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.363 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.364 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.364 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.364 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.364 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.364 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.364 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.364 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.364 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.365 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.365 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.365 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.365 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.365 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.365 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.366 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.366 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.366 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.366 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.366 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.366 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.366 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-28T21:04:32.366 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.367 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.367 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.367 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.367 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.367 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.367 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.367 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.367 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.368 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.369 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.369 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres 1w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.369 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres 2w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.369 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres 3r FIFO 0,13 0t0 117828 pipe 2023-11-28T21:04:32.369 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres 4u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.369 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres 8u IPv6 117840 0t0 UDP localhost:38563->localhost:38563 2023-11-28T21:04:32.369 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres 9u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.369 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33157 postgres 10u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.370 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres cwd DIR 8,1 4096 799263 /var/lib/postgresql/14/main 2023-11-28T21:04:32.370 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.370 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres txt REG 8,1 9509856 797502 /usr/lib/postgresql/14/bin/postgres 2023-11-28T21:04:32.370 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres DEL REG 0,1 3076 /dev/zero 2023-11-28T21:04:32.370 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.370 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.370 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.371 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-28T21:04:32.371 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.371 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.371 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.371 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.371 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.371 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.371 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.373 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.373 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.373 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.373 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.373 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.374 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.374 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.374 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.374 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.374 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.374 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.374 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.375 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-28T21:04:32.375 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-28T21:04:32.375 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.375 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.375 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.375 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.375 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.376 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.376 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.376 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.376 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.376 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.376 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.376 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.376 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.377 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.377 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-28T21:04:32.377 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.377 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 0,24 26976 18 /dev/shm/PostgreSQL.3772725000 2023-11-28T21:04:32.377 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.377 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres DEL REG 0,1 4 /SYSV000c321f 2023-11-28T21:04:32.377 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.377 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres 1w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.378 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres 2w REG 8,1 651 799291 /var/log/postgresql/postgresql-14-main.log 2023-11-28T21:04:32.378 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres 3r FIFO 0,13 0t0 117828 pipe 2023-11-28T21:04:32.378 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres 4u REG 8,1 0 799372 /var/lib/postgresql/14/main/global/6100 2023-11-28T21:04:32.378 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres 8u IPv6 117840 0t0 UDP localhost:38563->localhost:38563 2023-11-28T21:04:32.378 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres 9u a_inode 0,14 0 42 [signalfd] 2023-11-28T21:04:32.378 INFO:teuthology.orchestra.run.smithi167.stdout:postgres 33158 postgres 10u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.378 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.378 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.379 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root txt REG 8,1 2194240 796733 /usr/sbin/ModemManager 2023-11-28T21:04:32.379 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14384 796687 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-11-28T21:04:32.379 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 63776 796716 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-11-28T21:04:32.379 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14352 796696 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-11-28T21:04:32.379 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 100632 796720 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-11-28T21:04:32.379 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 18608 796700 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-11-28T21:04:32.379 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14440 796704 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-11-28T21:04:32.379 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 47384 796708 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-11-28T21:04:32.380 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14392 796694 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-11-28T21:04:32.380 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 22736 796686 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-11-28T21:04:32.380 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 30912 796722 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-11-28T21:04:32.380 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 22872 796705 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-11-28T21:04:32.380 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14512 796702 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-11-28T21:04:32.380 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 47392 796685 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-11-28T21:04:32.380 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 22816 796689 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-11-28T21:04:32.380 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 18760 796714 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-11-28T21:04:32.381 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 43336 796712 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-11-28T21:04:32.381 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 18720 796710 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-11-28T21:04:32.381 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 30992 796703 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-11-28T21:04:32.381 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14504 796717 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-11-28T21:04:32.381 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14464 796707 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-11-28T21:04:32.381 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 26944 796723 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-11-28T21:04:32.381 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14416 796715 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-11-28T21:04:32.382 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14424 796711 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-11-28T21:04:32.382 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 31008 796724 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-11-28T21:04:32.382 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14392 796693 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-11-28T21:04:32.382 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14360 796713 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-11-28T21:04:32.382 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 22784 796721 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-11-28T21:04:32.382 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 18616 796698 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-intel.so 2023-11-28T21:04:32.382 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 137544 796688 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-11-28T21:04:32.383 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14384 796719 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-11-28T21:04:32.383 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 129376 796697 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-11-28T21:04:32.383 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 22704 796718 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-11-28T21:04:32.383 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 26944 796699 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-11-28T21:04:32.383 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14384 796690 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-11-28T21:04:32.383 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 39352 796706 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-11-28T21:04:32.383 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 63808 796691 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-11-28T21:04:32.383 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14416 796695 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-11-28T21:04:32.384 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 43280 796692 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-11-28T21:04:32.384 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 22800 796701 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-11-28T21:04:32.384 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 43176 796728 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-11-28T21:04:32.384 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 80120 796727 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-11-28T21:04:32.384 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 88312 796731 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-11-28T21:04:32.384 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 30968 796729 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-11-28T21:04:32.384 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 63736 796730 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-11-28T21:04:32.384 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 22696 796726 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-11-28T21:04:32.385 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 63736 796732 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-11-28T21:04:32.385 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 18704 29008 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-11-28T21:04:32.385 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 18680 796725 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-fibocom.so 2023-11-28T21:04:32.385 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 18720 29113 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-11-28T21:04:32.385 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.385 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.385 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.385 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.386 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.386 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.386 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.386 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.386 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.386 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.386 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.386 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.387 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.387 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.387 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.387 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 632904 796384 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.7.0 2023-11-28T21:04:32.387 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 3528776 796459 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.9.0 2023-11-28T21:04:32.387 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.387 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.387 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:32.388 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 51272 18682 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.3.0 2023-11-28T21:04:32.388 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.388 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.388 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.388 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.388 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 1144904 796407 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-28T21:04:32.388 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 14400 796709 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-11-28T21:04:32.389 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.389 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.389 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.389 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 1u unix 0xffff98ee0a973480 0t0 117391 type=STREAM 2023-11-28T21:04:32.389 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.389 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.389 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.389 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 5u unix 0xffff98ee0a977800 0t0 117396 type=DGRAM 2023-11-28T21:04:32.390 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 6u unix 0xffff98ee4c1d8000 0t0 119931 type=STREAM 2023-11-28T21:04:32.390 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 7u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.390 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 8u netlink 0t0 117397 KOBJECT_UEVENT 2023-11-28T21:04:32.390 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 root 9w FIFO 0,23 0t0 3472 /run/systemd/inhibit/9.ref 2023-11-28T21:04:32.390 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.390 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.390 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root txt REG 8,1 2194240 796733 /usr/sbin/ModemManager 2023-11-28T21:04:32.390 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14384 796687 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-11-28T21:04:32.391 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 63776 796716 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-11-28T21:04:32.391 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14352 796696 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-11-28T21:04:32.391 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 100632 796720 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-11-28T21:04:32.391 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 18608 796700 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-11-28T21:04:32.391 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14440 796704 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-11-28T21:04:32.391 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 47384 796708 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-11-28T21:04:32.391 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14392 796694 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-11-28T21:04:32.391 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 22736 796686 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-11-28T21:04:32.392 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 30912 796722 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-11-28T21:04:32.392 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 22872 796705 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-11-28T21:04:32.392 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14512 796702 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-11-28T21:04:32.392 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 47392 796685 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-11-28T21:04:32.392 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 22816 796689 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-11-28T21:04:32.392 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 18760 796714 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-11-28T21:04:32.392 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 43336 796712 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-11-28T21:04:32.392 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 18720 796710 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-11-28T21:04:32.392 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 30992 796703 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-11-28T21:04:32.393 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14504 796717 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-11-28T21:04:32.393 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14464 796707 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-11-28T21:04:32.393 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 26944 796723 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-11-28T21:04:32.393 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14416 796715 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-11-28T21:04:32.393 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14424 796711 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-11-28T21:04:32.393 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 31008 796724 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-11-28T21:04:32.393 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14392 796693 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-11-28T21:04:32.394 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14360 796713 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-11-28T21:04:32.394 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 22784 796721 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-11-28T21:04:32.394 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 18616 796698 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-intel.so 2023-11-28T21:04:32.394 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 137544 796688 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-11-28T21:04:32.394 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14384 796719 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-11-28T21:04:32.394 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 129376 796697 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-11-28T21:04:32.394 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 22704 796718 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-11-28T21:04:32.394 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 26944 796699 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-11-28T21:04:32.395 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14384 796690 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-11-28T21:04:32.395 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 39352 796706 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-11-28T21:04:32.395 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 63808 796691 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-11-28T21:04:32.395 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14416 796695 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-11-28T21:04:32.395 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 43280 796692 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-11-28T21:04:32.395 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 22800 796701 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-11-28T21:04:32.395 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 43176 796728 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-11-28T21:04:32.396 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 80120 796727 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-11-28T21:04:32.396 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 88312 796731 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-11-28T21:04:32.396 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 30968 796729 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-11-28T21:04:32.396 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 63736 796730 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-11-28T21:04:32.396 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 22696 796726 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-11-28T21:04:32.396 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 63736 796732 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-11-28T21:04:32.396 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 18704 29008 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-11-28T21:04:32.396 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 18680 796725 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-fibocom.so 2023-11-28T21:04:32.397 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 18720 29113 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-11-28T21:04:32.397 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.397 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.397 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.397 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.397 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.397 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.398 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.398 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.398 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.398 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.398 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.398 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.398 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.398 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.399 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.399 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 632904 796384 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.7.0 2023-11-28T21:04:32.399 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 3528776 796459 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.9.0 2023-11-28T21:04:32.399 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.399 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.399 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:32.399 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 51272 18682 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.3.0 2023-11-28T21:04:32.399 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.400 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.400 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.400 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.400 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 1144904 796407 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-28T21:04:32.400 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 14400 796709 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-11-28T21:04:32.400 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.400 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.400 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.401 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 1u unix 0xffff98ee0a973480 0t0 117391 type=STREAM 2023-11-28T21:04:32.401 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.401 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.401 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.401 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 5u unix 0xffff98ee0a977800 0t0 117396 type=DGRAM 2023-11-28T21:04:32.401 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 6u unix 0xffff98ee4c1d8000 0t0 119931 type=STREAM 2023-11-28T21:04:32.401 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 7u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.401 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 8u netlink 0t0 117397 KOBJECT_UEVENT 2023-11-28T21:04:32.402 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33233 gmain root 9w FIFO 0,23 0t0 3472 /run/systemd/inhibit/9.ref 2023-11-28T21:04:32.402 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.402 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.402 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root txt REG 8,1 2194240 796733 /usr/sbin/ModemManager 2023-11-28T21:04:32.402 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14384 796687 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-11-28T21:04:32.402 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 63776 796716 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-11-28T21:04:32.402 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14352 796696 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-11-28T21:04:32.403 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 100632 796720 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-11-28T21:04:32.403 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 18608 796700 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-11-28T21:04:32.403 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14440 796704 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-11-28T21:04:32.403 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 47384 796708 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-11-28T21:04:32.403 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14392 796694 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-11-28T21:04:32.403 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 22736 796686 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-11-28T21:04:32.403 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 30912 796722 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-11-28T21:04:32.404 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 22872 796705 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-11-28T21:04:32.404 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14512 796702 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-11-28T21:04:32.404 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 47392 796685 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-11-28T21:04:32.404 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 22816 796689 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-11-28T21:04:32.404 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 18760 796714 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-11-28T21:04:32.404 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 43336 796712 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-11-28T21:04:32.404 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 18720 796710 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-11-28T21:04:32.404 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 30992 796703 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-11-28T21:04:32.405 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14504 796717 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-11-28T21:04:32.405 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14464 796707 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-11-28T21:04:32.405 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 26944 796723 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-11-28T21:04:32.405 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14416 796715 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-11-28T21:04:32.405 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14424 796711 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-11-28T21:04:32.405 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 31008 796724 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-11-28T21:04:32.405 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14392 796693 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-11-28T21:04:32.405 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14360 796713 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-11-28T21:04:32.406 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 22784 796721 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-11-28T21:04:32.406 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 18616 796698 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-intel.so 2023-11-28T21:04:32.406 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 137544 796688 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-11-28T21:04:32.406 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14384 796719 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-11-28T21:04:32.406 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 129376 796697 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-11-28T21:04:32.406 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 22704 796718 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-11-28T21:04:32.406 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 26944 796699 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-11-28T21:04:32.406 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14384 796690 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-11-28T21:04:32.407 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 39352 796706 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-11-28T21:04:32.407 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 63808 796691 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-11-28T21:04:32.407 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14416 796695 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-11-28T21:04:32.407 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 43280 796692 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-11-28T21:04:32.407 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 22800 796701 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-11-28T21:04:32.407 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 43176 796728 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-11-28T21:04:32.407 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 80120 796727 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-11-28T21:04:32.407 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 88312 796731 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-11-28T21:04:32.408 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 30968 796729 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-11-28T21:04:32.408 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 63736 796730 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-11-28T21:04:32.408 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 22696 796726 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-11-28T21:04:32.408 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 63736 796732 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-11-28T21:04:32.408 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 18704 29008 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-11-28T21:04:32.408 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 18680 796725 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-fibocom.so 2023-11-28T21:04:32.408 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 18720 29113 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-11-28T21:04:32.409 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-28T21:04:32.409 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.409 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.409 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-28T21:04:32.409 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.409 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.409 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.410 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.410 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.410 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-28T21:04:32.410 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.410 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.410 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.410 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-28T21:04:32.410 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-28T21:04:32.411 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 632904 796384 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.7.0 2023-11-28T21:04:32.411 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 3528776 796459 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.9.0 2023-11-28T21:04:32.411 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.411 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.411 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-28T21:04:32.411 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 51272 18682 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.3.0 2023-11-28T21:04:32.411 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-28T21:04:32.411 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-28T21:04:32.412 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-28T21:04:32.412 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-28T21:04:32.412 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 1144904 796407 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-28T21:04:32.412 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 14400 796709 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-11-28T21:04:32.412 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.412 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.412 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.412 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 1u unix 0xffff98ee0a973480 0t0 117391 type=STREAM 2023-11-28T21:04:32.413 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 2w CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.413 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 3u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.413 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 4u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.413 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 5u unix 0xffff98ee0a977800 0t0 117396 type=DGRAM 2023-11-28T21:04:32.413 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 6u unix 0xffff98ee4c1d8000 0t0 119931 type=STREAM 2023-11-28T21:04:32.413 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 7u a_inode 0,14 0 42 [eventfd] 2023-11-28T21:04:32.413 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 8u netlink 0t0 117397 KOBJECT_UEVENT 2023-11-28T21:04:32.413 INFO:teuthology.orchestra.run.smithi167.stdout:ModemMana 33232 33236 gdbus root 9w FIFO 0,23 0t0 3472 /run/systemd/inhibit/9.ref 2023-11-28T21:04:32.414 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33498 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.414 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33498 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.414 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33498 root txt unknown /proc/33498/exe 2023-11-28T21:04:32.414 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33499 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.414 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33499 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.414 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33499 root txt unknown /proc/33499/exe 2023-11-28T21:04:32.414 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33500 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.414 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33500 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.415 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33500 root txt unknown /proc/33500/exe 2023-11-28T21:04:32.415 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33501 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.415 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33501 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.415 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33501 root txt unknown /proc/33501/exe 2023-11-28T21:04:32.415 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33502 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.415 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33502 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.415 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33502 root txt unknown /proc/33502/exe 2023-11-28T21:04:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33503 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33503 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33503 root txt unknown /proc/33503/exe 2023-11-28T21:04:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33504 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33504 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33504 root txt unknown /proc/33504/exe 2023-11-28T21:04:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33505 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.417 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33505 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.417 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33505 root txt unknown /proc/33505/exe 2023-11-28T21:04:32.417 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33516 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.417 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33516 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.417 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33516 root txt unknown /proc/33516/exe 2023-11-28T21:04:32.417 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33517 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.417 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33517 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.417 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33517 root txt unknown /proc/33517/exe 2023-11-28T21:04:32.418 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33518 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.418 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33518 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.418 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33518 root txt unknown /proc/33518/exe 2023-11-28T21:04:32.418 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33519 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.418 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33519 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.418 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33519 root txt unknown /proc/33519/exe 2023-11-28T21:04:32.418 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33520 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.418 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33520 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.419 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33520 root txt unknown /proc/33520/exe 2023-11-28T21:04:32.419 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33521 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.419 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33521 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.419 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33521 root txt unknown /proc/33521/exe 2023-11-28T21:04:32.419 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33522 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.419 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33522 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.419 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33522 root txt unknown /proc/33522/exe 2023-11-28T21:04:32.419 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33523 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.420 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33523 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.420 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33523 root txt unknown /proc/33523/exe 2023-11-28T21:04:32.420 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33534 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.420 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33534 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.420 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33534 root txt unknown /proc/33534/exe 2023-11-28T21:04:32.420 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33535 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.420 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33535 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.420 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33535 root txt unknown /proc/33535/exe 2023-11-28T21:04:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33536 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33536 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33536 root txt unknown /proc/33536/exe 2023-11-28T21:04:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33537 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33537 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33537 root txt unknown /proc/33537/exe 2023-11-28T21:04:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33538 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33538 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.422 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33538 root txt unknown /proc/33538/exe 2023-11-28T21:04:32.422 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33539 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.422 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33539 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.422 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33539 root txt unknown /proc/33539/exe 2023-11-28T21:04:32.422 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33540 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.422 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33540 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.422 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33540 root txt unknown /proc/33540/exe 2023-11-28T21:04:32.422 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33541 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.423 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33541 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.423 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33541 root txt unknown /proc/33541/exe 2023-11-28T21:04:32.423 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33552 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.423 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33552 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.423 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33552 root txt unknown /proc/33552/exe 2023-11-28T21:04:32.423 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33553 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.423 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33553 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.424 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33553 root txt unknown /proc/33553/exe 2023-11-28T21:04:32.424 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33554 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.424 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33554 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.424 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33554 root txt unknown /proc/33554/exe 2023-11-28T21:04:32.424 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33555 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.424 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33555 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.424 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33555 root txt unknown /proc/33555/exe 2023-11-28T21:04:32.425 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33556 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.425 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33556 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.425 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33556 root txt unknown /proc/33556/exe 2023-11-28T21:04:32.425 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33557 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.425 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33557 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.425 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33557 root txt unknown /proc/33557/exe 2023-11-28T21:04:32.425 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33558 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.425 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33558 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.426 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33558 root txt unknown /proc/33558/exe 2023-11-28T21:04:32.426 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33559 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.426 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33559 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.426 INFO:teuthology.orchestra.run.smithi167.stdout:xfsaild/d 33559 root txt unknown /proc/33559/exe 2023-11-28T21:04:32.426 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33572 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.426 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33572 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.426 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 33572 root txt unknown /proc/33572/exe 2023-11-28T21:04:32.427 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 34702 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.427 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 34702 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.427 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 34702 root txt unknown /proc/34702/exe 2023-11-28T21:04:32.427 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 35832 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.427 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 35832 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.427 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 35832 root txt unknown /proc/35832/exe 2023-11-28T21:04:32.427 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 36962 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:32.428 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 36962 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.428 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 36962 root txt unknown /proc/36962/exe 2023-11-28T21:04:32.428 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.428 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.428 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-28T21:04:32.428 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:32.428 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.428 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:32.429 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:32.429 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.429 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.429 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.429 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.429 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.429 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.429 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.430 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.430 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.430 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:32.430 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.430 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.430 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:32.430 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:32.431 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:32.431 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-28T21:04:32.431 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.431 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.431 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.431 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:32.431 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.431 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.432 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.432 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-28T21:04:32.432 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.432 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.432 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:32.432 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.432 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root 0r FIFO 0,13 0t0 120592 pipe 2023-11-28T21:04:32.432 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.433 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.433 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root 3r FIFO 0,13 0t0 118628 pipe 2023-11-28T21:04:32.433 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root 4w FIFO 0,13 0t0 118628 pipe 2023-11-28T21:04:32.433 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root 5r REG 8,1 1698 658047 /etc/sudoers 2023-11-28T21:04:32.433 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root 6u netlink 0t0 118637 AUDIT 2023-11-28T21:04:32.433 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38220 root 7u unix 0xffff98ee08f34b00 0t0 118638 type=DGRAM 2023-11-28T21:04:32.433 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.434 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.434 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:32.434 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.434 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.434 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.434 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.434 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.435 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.435 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.435 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.435 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.435 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.435 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.435 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.435 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root 0r FIFO 0,13 0t0 120592 pipe 2023-11-28T21:04:32.436 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.436 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38223 root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38265 log root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38267 msgr-work root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38268 msgr-work root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38269 msgr-work root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38293 service root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38294 admin_soc root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38295 ceph_time root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38296 fn_anonym root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38297 signal_ha root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38298 mgrsb-fin root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38299 ms_dispat root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38300 ms_local root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38301 io_contex root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38302 io_contex root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38303 safe_time root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38304 safe_time root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38305 safe_time root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38306 fn_anonym root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38307 flusher root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38308 safe_time root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38409 ceph-mgr root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38410 ceph-mgr root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38411 ceph-mgr root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38412 ceph-mgr root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38413 ceph-mgr root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38414 ceph-mgr root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root txt REG 8,1 4333424 80322 /usr/bin/ceph-mgr 2023-11-28T21:04:32.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-28T21:04:32.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-28T21:04:32.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-28T21:04:32.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-28T21:04:32.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-28T21:04:32.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-28T21:04:32.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 7352832 50517 /usr/lib/librbd.so.1.18.0 2023-11-28T21:04:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-28T21:04:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-28T21:04:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-28T21:04:32.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-28T21:04:32.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 1112896 50562 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 104672 795912 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-28T21:04:32.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-28T21:04:32.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 49936 792404 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-28T21:04:32.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 1898968 50527 /usr/lib/libcephfs.so.2.0.0 2023-11-28T21:04:32.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 509272 50547 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-28T21:04:32.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 43336 787248 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-28T21:04:32.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 1116728 50533 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 14848 664388 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 1612792 50508 /usr/lib/librados.so.2.0.0 2023-11-28T21:04:32.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:32.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-28T21:04:32.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-28T21:04:32.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 303840 80307 /usr/lib/libcephsqlite.so 2023-11-28T21:04:32.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 1w FIFO 0,13 0t0 120593 pipe 2023-11-28T21:04:32.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 2w FIFO 0,13 0t0 120594 pipe 2023-11-28T21:04:32.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 3r FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 4w FIFO 0,13 0t0 119402 pipe 2023-11-28T21:04:32.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 6r FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 7w FIFO 0,13 0t0 119403 pipe 2023-11-28T21:04:32.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 9r FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 10w FIFO 0,13 0t0 119404 pipe 2023-11-28T21:04:32.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 12r FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 13w FIFO 0,13 0t0 119405 pipe 2023-11-28T21:04:32.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 14w REG 8,1 1792367 664531 /var/log/ceph/ceph-mgr.y.log 2023-11-28T21:04:32.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 15uW REG 0,23 6 3519 /run/ceph/ceph-mgr.y.pid 2023-11-28T21:04:32.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 16r FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 17w FIFO 0,13 0t0 123923 pipe 2023-11-28T21:04:32.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 18u unix 0xffff98ee7e520780 0t0 123924 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-28T21:04:32.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 19r FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 20w FIFO 0,13 0t0 123927 pipe 2023-11-28T21:04:32.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 21r FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 22w FIFO 0,13 0t0 123928 pipe 2023-11-28T21:04:32.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 23u IPv4 126138 0t0 TCP smithi167.front.sepia.ceph.com:38780->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:32.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mgr 38247 38415 ceph-mgr root 26u IPv4 184198 0t0 TCP smithi167.front.sepia.ceph.com:38432->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:32.952 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.952 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.952 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-28T21:04:32.953 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:32.953 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.953 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:32.953 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:32.953 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.953 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.953 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.953 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.954 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.954 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.954 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:32.954 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.954 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.954 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.954 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.954 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.955 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.955 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.955 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:32.955 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:32.955 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:32.955 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:32.955 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-28T21:04:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-28T21:04:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:32.957 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.957 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root 0r FIFO 0,13 0t0 122222 pipe 2023-11-28T21:04:32.957 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:32.957 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:32.957 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root 3r FIFO 0,13 0t0 118711 pipe 2023-11-28T21:04:32.957 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root 4w FIFO 0,13 0t0 118711 pipe 2023-11-28T21:04:32.957 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root 5r REG 8,1 1698 658047 /etc/sudoers 2023-11-28T21:04:32.957 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root 6u netlink 0t0 118720 AUDIT 2023-11-28T21:04:32.958 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38319 root 7u unix 0xffff98ee08f36180 0t0 118721 type=DGRAM 2023-11-28T21:04:32.958 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.958 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.958 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-28T21:04:32.958 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:32.958 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.958 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:32.958 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.959 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.960 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.960 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.960 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:32.960 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.960 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.960 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.960 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:32.960 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:32.961 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:32.961 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.961 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.961 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.961 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-28T21:04:32.961 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.961 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.961 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-28T21:04:32.961 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.962 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.962 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:32.962 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.962 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root 0r FIFO 0,13 0t0 122225 pipe 2023-11-28T21:04:32.962 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:32.962 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:32.962 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root 3r FIFO 0,13 0t0 125081 pipe 2023-11-28T21:04:32.963 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root 4w FIFO 0,13 0t0 125081 pipe 2023-11-28T21:04:32.963 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root 5r REG 8,1 1698 658047 /etc/sudoers 2023-11-28T21:04:32.963 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root 6u netlink 0t0 125090 AUDIT 2023-11-28T21:04:32.963 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38320 root 7u unix 0xffff98ee4c1da580 0t0 125091 type=DGRAM 2023-11-28T21:04:32.963 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.963 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.963 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-28T21:04:32.964 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:32.964 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:32.964 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.964 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.964 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.964 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.964 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.964 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.965 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.965 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:32.965 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.965 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.965 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.965 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.965 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.965 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.966 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:32.966 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:32.966 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:32.966 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.966 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-28T21:04:32.966 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.966 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.966 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:32.967 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:32.967 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.967 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.967 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-28T21:04:32.967 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.967 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.967 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:32.967 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.968 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root 0r FIFO 0,13 0t0 122228 pipe 2023-11-28T21:04:32.968 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:32.968 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:32.968 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root 3r FIFO 0,13 0t0 122899 pipe 2023-11-28T21:04:32.968 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root 4w FIFO 0,13 0t0 122899 pipe 2023-11-28T21:04:32.968 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root 5r REG 8,1 1698 658047 /etc/sudoers 2023-11-28T21:04:32.968 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root 6u netlink 0t0 122908 AUDIT 2023-11-28T21:04:32.968 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38321 root 7u unix 0xffff98ee0a977080 0t0 122909 type=DGRAM 2023-11-28T21:04:32.969 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.969 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.969 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-28T21:04:32.969 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:32.969 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.969 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:32.969 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:32.970 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.970 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.970 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.970 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.970 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.970 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:32.970 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:32.970 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.971 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:32.971 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:32.971 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:32.971 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-28T21:04:32.971 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.971 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:32.971 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:32.971 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:32.972 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.972 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:32.972 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.972 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.972 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:32.972 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:32.972 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:32.972 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-28T21:04:32.973 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:32.973 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:32.973 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:32.973 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.973 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root 0r FIFO 0,13 0t0 122231 pipe 2023-11-28T21:04:32.973 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:32.973 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:32.973 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root 3r FIFO 0,13 0t0 126020 pipe 2023-11-28T21:04:32.974 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root 4w FIFO 0,13 0t0 126020 pipe 2023-11-28T21:04:32.974 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root 5r REG 8,1 1698 658047 /etc/sudoers 2023-11-28T21:04:32.974 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root 6u netlink 0t0 126029 AUDIT 2023-11-28T21:04:32.974 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 38322 root 7u unix 0xffff98ee70eb9e00 0t0 126030 type=DGRAM 2023-11-28T21:04:32.974 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.974 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.974 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:32.974 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.975 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.975 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.975 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.975 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.975 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.975 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.975 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.975 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.976 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.976 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.976 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.976 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root 0r FIFO 0,13 0t0 122222 pipe 2023-11-28T21:04:32.976 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:32.976 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38323 root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:32.976 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.976 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.977 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:32.977 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.977 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.977 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.977 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.977 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.977 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.977 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.978 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.978 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.978 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.978 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.978 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.978 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root 0r FIFO 0,13 0t0 122225 pipe 2023-11-28T21:04:32.978 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:32.979 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38325 root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:32.979 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.979 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.979 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:32.979 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.979 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.979 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.979 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.980 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.980 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.980 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.980 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.980 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.980 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.980 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.980 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.981 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root 0r FIFO 0,13 0t0 122228 pipe 2023-11-28T21:04:32.981 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:32.981 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38327 root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:32.981 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.981 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.981 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:32.981 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.981 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:32.982 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:32.982 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.982 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.982 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:32.982 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:32.982 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.982 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:32.982 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.983 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:32.983 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.983 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root 0r FIFO 0,13 0t0 122231 pipe 2023-11-28T21:04:32.983 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:32.983 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 38330 root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:32.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:32.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:32.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:32.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:32.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:32.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:32.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:32.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:32.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:32.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:32.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:32.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:32.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:32.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:32.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:32.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:32.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:32.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:32.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:32.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:32.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:32.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:32.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:32.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:32.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:32.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:32.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:32.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:32.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:32.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:32.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:32.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:32.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:32.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:32.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:32.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:32.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:32.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:32.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:32.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:32.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:32.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:32.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:32.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:32.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:32.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:32.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:32.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:32.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:32.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:32.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:32.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:32.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:32.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:32.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:32.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:32.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:32.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:32.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:32.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:32.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:32.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:32.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:32.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:32.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:32.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:32.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:32.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:32.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:32.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:32.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:32.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:32.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:32.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:32.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:32.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:32.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:32.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:32.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:32.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:32.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:32.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:32.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:32.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:32.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:32.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:32.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:32.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:32.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:32.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:32.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:32.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:32.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:32.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 14w REG 8,1 1605950491 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38337 log root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 14w REG 8,1 1605950491 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38339 msgr-work root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 14w REG 8,1 1605950491 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38340 msgr-work root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 14w REG 8,1 1605950491 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38341 msgr-work root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 14w REG 8,1 1605950491 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38347 service root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 14w REG 8,1 1605950491 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38348 admin_soc root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38416 signal_ha root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38417 io_contex root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38418 io_contex root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38432 OpHistory root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38433 ceph_time root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38466 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38476 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38485 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38493 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38501 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38509 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38517 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38525 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38526 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38527 safe_time root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38528 safe_time root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38529 safe_time root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.622+0000 7fef28a9e640 1 Processor -- start 2023-11-28T21:04:33.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.622+0000 7fef28a9e640 1 -- start start 2023-11-28T21:04:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fef240cb770 0x7fef2415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2415ac00 con 0x7fef240cf860 2023-11-28T21:04:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240cbd60 con 0x7fef240cfc40 2023-11-28T21:04:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef24159ff0 con 0x7fef240cb770 2023-11-28T21:04:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef2259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fef240cf860 0x7fef240ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51578/0 (socket says 172.21.15.167:51578) 2023-11-28T21:04:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef2259c640 1 -- 172.21.15.167:0/138999688 learned_addr learned my addr 172.21.15.167:0/138999688 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef22d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fef240cb770 0x7fef2415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef21d9b640 1 -- 172.21.15.167:0/138999688 >> v1:172.21.15.178:6789/0 conn(0x7fef240cfc40 legacy=0x7fef24153ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.178:6789/0 2023-11-28T21:04:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef22d9d640 1 -- 172.21.15.167:0/138999688 >> v1:172.21.15.178:6789/0 conn(0x7fef240cfc40 legacy=0x7fef24153ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef22d9d640 1 -- 172.21.15.167:0/138999688 >> v1:172.21.15.167:6789/0 conn(0x7fef240cf860 legacy=0x7fef240ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef22d9d640 1 -- 172.21.15.167:0/138999688 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2415a2d0 con 0x7fef240cb770 2023-11-28T21:04:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef2159a640 1 -- 172.21.15.167:0/138999688 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13013495 0 0) 0x7fef2415ac00 con 0x7fef240cf860 2023-11-28T21:04:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef22d9d640 1 --2- 172.21.15.167:0/138999688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 0x7fef2415d4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009d90 tx=0x7fef1c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4b74aea08a536 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef2159a640 1 -- 172.21.15.167:0/138999688 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0a59a0 con 0x7fef240cb770 2023-11-28T21:04:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef2159a640 1 -- 172.21.15.167:0/138999688 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c0a5b00 con 0x7fef240cb770 2023-11-28T21:04:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef2159a640 1 -- 172.21.15.167:0/138999688 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0a5e90 con 0x7fef240cb770 2023-11-28T21:04:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 -- 172.21.15.167:0/138999688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 msgr2=0x7fef2415d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 --2- 172.21.15.167:0/138999688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 0x7fef2415d4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009d90 tx=0x7fef1c01c8e0 comp rx=0 tx=0).stop 2023-11-28T21:04:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 -- 172.21.15.167:0/138999688 shutdown_connections 2023-11-28T21:04:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 --2- 172.21.15.167:0/138999688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 0x7fef2415d4d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 -- 172.21.15.167:0/138999688 >> 172.21.15.167:0/138999688 conn(0x7fef2406c1f0 msgr2=0x7fef24071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 -- 172.21.15.167:0/138999688 shutdown_connections 2023-11-28T21:04:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.626+0000 7fef28a9e640 1 -- 172.21.15.167:0/138999688 wait complete. 2023-11-28T21:04:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 Processor -- start 2023-11-28T21:04:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 -- start start 2023-11-28T21:04:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 0x7fef241491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef240cf860 0x7fef24152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef240cfc40 0x7fef240b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24149730 con 0x7fef240cb770 2023-11-28T21:04:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef241522b0 con 0x7fef240cf860 2023-11-28T21:04:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2414a660 con 0x7fef240cfc40 2023-11-28T21:04:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef2259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 0x7fef241491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef2259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 0x7fef241491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:51226/0 (socket says 172.21.15.167:51226) 2023-11-28T21:04:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef2259c640 1 -- 172.21.15.167:0/683269437 learned_addr learned my addr 172.21.15.167:0/683269437 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef21d9b640 1 -- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef240cf860 msgr2=0x7fef24152740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef21d9b640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef240cf860 0x7fef24152740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef2259c640 1 -- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef240cfc40 msgr2=0x7fef240b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:33.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef2259c640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef240cfc40 0x7fef240b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:33.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef2259c640 1 -- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef240cf860 msgr2=0x7fef24152740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:33.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef2259c640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef240cf860 0x7fef24152740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:33.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef2259c640 1 -- 172.21.15.167:0/683269437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009a70 con 0x7fef240cb770 2023-11-28T21:04:33.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef2259c640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 0x7fef241491f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef1400c480 tx=0x7fef1400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:33.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef140074e0 con 0x7fef240cb770 2023-11-28T21:04:33.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14007660 con 0x7fef240cb770 2023-11-28T21:04:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240b57e0 con 0x7fef240cb770 2023-11-28T21:04:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14004a30 con 0x7fef240cb770 2023-11-28T21:04:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef24151f40 con 0x7fef240cb770 2023-11-28T21:04:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240b5310 0x7fef240b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24072860 con 0x7fef240b5310 2023-11-28T21:04:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.630+0000 7fef21d9b640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240b5310 0x7fef240b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef21d9b640 1 -- 172.21.15.167:0/683269437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef24159cc0 con 0x7fef240b5310 2023-11-28T21:04:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef21d9b640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240b5310 0x7fef240b4290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef240cefe0 tx=0x7fef1800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18003dd0 con 0x7fef240b5310 2023-11-28T21:04:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fef18005070 con 0x7fef240b5310 2023-11-28T21:04:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240b5310 msgr2=0x7fef240b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef12ffd640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240b5310 0x7fef240b4290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef240cefe0 tx=0x7fef1800b8e0 comp rx=0 tx=0).stop 2023-11-28T21:04:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240b5310 msgr2=0x7fef240b4290 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef12ffd640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240b5310 0x7fef240b4290 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef240cefe0 tx=0x7fef1800b8e0 comp rx=0 tx=0).stop 2023-11-28T21:04:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef14004b90 con 0x7fef240cb770 2023-11-28T21:04:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef12ffd640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef04066220 0x7fef040686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:33.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fef14083400 con 0x7fef240cb770 2023-11-28T21:04:33.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef21d9b640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef04066220 0x7fef040686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:33.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.634+0000 7fef21d9b640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef04066220 0x7fef040686e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fef240cefe0 tx=0x7fef18008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:33.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef24152c80 0x7fef2413baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:33.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24152420 con 0x7fef24152c80 2023-11-28T21:04:33.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef22d9d640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef24152c80 0x7fef2413baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:33.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef22d9d640 1 -- 172.21.15.167:0/683269437 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fef240b47d0 con 0x7fef24152c80 2023-11-28T21:04:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef22d9d640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef24152c80 0x7fef2413baf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef240d03b0 tx=0x7fef1c0adb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0add70 con 0x7fef24152c80 2023-11-28T21:04:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5114 (secure 0 0 0) 0x7fef1c0b7410 con 0x7fef24152c80 2023-11-28T21:04:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef24152c80 msgr2=0x7fef2413baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef12ffd640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef24152c80 0x7fef2413baf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef240d03b0 tx=0x7fef1c0adb00 comp rx=0 tx=0).stop 2023-11-28T21:04:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef12ffd640 1 -- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef24152c80 msgr2=0x7fef2413baf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef12ffd640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef24152c80 0x7fef2413baf0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef240d03b0 tx=0x7fef1c0adb00 comp rx=0 tx=0).stop 2023-11-28T21:04:33.591 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:04:33.591 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:33.591 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:33.591 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:04:33.591 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 200, 2023-11-28T21:04:33.591 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:04:33.592 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:04:33.592 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:04:33.592 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:33.592 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:04:33.592 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:33.592 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:04:33.592 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:04:33.593 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:33.593 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:33.593 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:33.593 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:33.593 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:33.593 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:33.593 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:33.593 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:33.593 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:33.594 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:33.594 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:33.594 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:04:33.594 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:04:33.594 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:33.594 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:33.594 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:33.594 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:33.595 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:33.595 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:33.595 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:33.595 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:33.595 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:33.595 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:33.595 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:33.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.596 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:04:33.596 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:04:33.596 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:04:33.596 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:04:33.596 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:04:33.596 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:04:33.596 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:33.597 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:33.597 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:04:33.597 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:04:33.597 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:04:33.597 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:04:33.597 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:04:33.597 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:04:33.598 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:04:33.598 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:33.598 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:04:33.598 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:33.598 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:33.598 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:33.598 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:33.599 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:33.599 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:33.599 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:33.599 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:33.599 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:33.599 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:33.599 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:33.599 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:04:33.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.600 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:04:33.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.600 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:33.600 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:33.600 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:33.600 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:33.600 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.601 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:33.601 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:04:33.601 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:33.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.601 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.601 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:33.601 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:04:33.602 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:33.602 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:33.602 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:33.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.602 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:04:33.602 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:04:33.602 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:33.602 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:33.603 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:33.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.603 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:33.603 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:33.603 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:33.603 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:33.603 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.604 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:33.604 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:04:33.604 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:33.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.604 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.604 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:33.604 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:04:33.604 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:33.605 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:33.605 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:33.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.605 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:04:33.605 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:04:33.605 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:33.605 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:33.606 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:33.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.606 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.606 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:33.606 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:33.606 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:33.606 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:33.606 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.607 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:33.607 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:04:33.607 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:33.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.607 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.607 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:33.607 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:04:33.608 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:33.608 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:33.608 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:33.608 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.608 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:04:33.608 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:04:33.608 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:33.608 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:33.609 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:33.609 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:33.609 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:33.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.609 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:04:33.609 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:04:33.609 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.610 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:33.610 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:33.610 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:33.610 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:33.610 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:33.610 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:04:33.610 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.610 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:33.611 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:33.611 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:04:33.611 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:33.611 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:33.611 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:04:33.611 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.611 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:33.612 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:33.612 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:04:33.612 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:33.612 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:33.612 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:04:33.612 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.612 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:04:33.612 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:33.613 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:33.613 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.613 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.613 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:33.613 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:33.613 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:04:33.613 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:33.614 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:33.614 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:04:33.614 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:33.614 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:33.614 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:33.614 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:33.614 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:33.615 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:33.615 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:33.615 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:04:33.615 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:04:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef04066220 msgr2=0x7fef040686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fef04066220 0x7fef040686e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fef240cefe0 tx=0x7fef18008030 comp rx=0 tx=0).stop 2023-11-28T21:04:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 msgr2=0x7fef241491f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 0x7fef241491f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef1400c480 tx=0x7fef1400c940 comp rx=0 tx=0).stop 2023-11-28T21:04:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef22d9d640 1 -- 172.21.15.167:0/683269437 reap_dead start 2023-11-28T21:04:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 shutdown_connections 2023-11-28T21:04:33.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 --2- 172.21.15.167:0/683269437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef240cb770 0x7fef241491f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:33.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 >> 172.21.15.167:0/683269437 conn(0x7fef2406c1f0 msgr2=0x7fef240ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:33.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 shutdown_connections 2023-11-28T21:04:33.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:31.638+0000 7fef28a9e640 1 -- 172.21.15.167:0/683269437 wait complete. 2023-11-28T21:04:33.619 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:04:33.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2023-11-28T21:04:33.619 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:04:33.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 14w REG 8,1 1605950778 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38530 safe_time root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38531 fn_anonym root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38534 rocksdb:l root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38535 rocksdb:l root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38536 rocksdb:l root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 38537 rocksdb:h root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40025 bstore_ai root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40753 bstore_ai root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40934 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40935 cfin root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40936 bstore_kv root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40937 bstore_kv root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40938 bstore_me root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:33.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:33.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:33.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:33.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:33.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:33.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:33.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:33.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:33.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:33.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:33.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:33.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:33.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:33.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:33.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:33.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:33.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:33.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:33.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:33.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:33.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:33.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:33.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:33.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:33.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:33.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:33.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:33.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:33.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:33.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:33.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:33.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:33.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:33.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:33.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:33.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:33.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:33.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:33.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:33.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:33.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:33.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:33.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:33.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:33.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:33.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:33.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:33.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:33.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:33.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:33.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:33.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:33.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:33.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:33.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:33.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:33.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:33.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:33.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:33.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:33.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:33.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:33.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:33.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:33.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:33.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:33.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:33.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:33.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:33.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:33.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:33.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:33.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:33.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:33.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:33.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:33.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:33.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:33.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:33.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:33.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:33.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:33.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:33.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:33.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:33.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:33.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:33.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:33.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:33.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:33.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:33.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:33.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:33.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:33.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:33.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:33.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:33.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:33.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:33.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:33.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:33.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:33.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:33.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:33.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:33.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:33.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:33.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:33.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:33.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:33.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:33.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:33.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:33.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:33.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:33.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:33.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:33.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:33.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:33.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:33.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:33.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:33.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:33.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:33.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:33.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:33.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:33.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:33.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:33.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:33.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:33.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:33.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:33.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:33.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:33.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:33.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40939 ms_dispat root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:33.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:33.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:33.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40940 ms_local root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40941 safe_time root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40942 safe_time root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40943 ms_dispat root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 14w REG 8,1 1605951065 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40944 ms_local root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40945 ms_dispat root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40946 ms_local root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40947 ms_dispat root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40948 ms_local root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40949 ms_dispat root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40950 ms_local root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40951 ms_dispat root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40952 ms_local root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40953 ms_dispat root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40954 ms_local root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40955 fn_anonym root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40956 finisher root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40957 safe_time root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40958 safe_time root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40959 ceph-osd root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40960 osd_srv_a root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40961 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 14w REG 8,1 1605951352 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40962 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40963 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40964 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40965 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40966 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40967 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40968 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40969 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40970 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40971 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40972 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40973 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40974 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40975 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40976 tp_osd_tp root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root DEL REG 0,18 126136 /[aio] 2023-11-28T21:04:34.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root DEL REG 0,18 126134 /[aio] 2023-11-28T21:04:34.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 0,14 127175 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 1w FIFO 0,13 0t0 122223 pipe 2023-11-28T21:04:34.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 2w FIFO 0,13 0t0 122224 pipe 2023-11-28T21:04:34.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 3r FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 4w FIFO 0,13 0t0 118745 pipe 2023-11-28T21:04:34.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 6r FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 7w FIFO 0,13 0t0 118746 pipe 2023-11-28T21:04:34.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 9r FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 10w FIFO 0,13 0t0 118747 pipe 2023-11-28T21:04:34.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 12r FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 13w FIFO 0,13 0t0 118748 pipe 2023-11-28T21:04:34.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 14w REG 8,1 1605951639 664525 /var/log/ceph/ceph-osd.0.log 2023-11-28T21:04:34.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 15uW REG 0,23 6 3521 /run/ceph/ceph-osd.0.pid 2023-11-28T21:04:34.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 16r FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 17w FIFO 0,13 0t0 121294 pipe 2023-11-28T21:04:34.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 18u unix 0xffff98ee5afad280 0t0 121295 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-28T21:04:34.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 19u IPv4 123951 0t0 TCP *:6800 (LISTEN) 2023-11-28T21:04:34.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 20u IPv4 123953 0t0 TCP *:6801 (LISTEN) 2023-11-28T21:04:34.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 21u IPv4 123956 0t0 TCP *:6802 (LISTEN) 2023-11-28T21:04:34.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 22u IPv4 123960 0t0 TCP *:6803 (LISTEN) 2023-11-28T21:04:34.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 23u IPv4 123965 0t0 TCP *:6804 (LISTEN) 2023-11-28T21:04:34.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 24u IPv4 123971 0t0 TCP *:6805 (LISTEN) 2023-11-28T21:04:34.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 25u IPv4 123978 0t0 TCP *:6806 (LISTEN) 2023-11-28T21:04:34.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 26u IPv4 123986 0t0 TCP *:6807 (LISTEN) 2023-11-28T21:04:34.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 27r FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 28w FIFO 0,13 0t0 126086 pipe 2023-11-28T21:04:34.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 29r FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 30w FIFO 0,13 0t0 126087 pipe 2023-11-28T21:04:34.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 31u sock 0,8 0t0 127171 protocol: UDPv6 2023-11-28T21:04:34.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 32r DIR 252,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-28T21:04:34.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 33uW REG 252,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-28T21:04:34.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 34u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 35u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 36u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 37u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 38u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 39u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 40u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 41u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 42u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 43u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 44u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 45u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 46u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 47u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 48u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 49u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 50u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 51u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 52u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 53u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 54u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 55u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 56u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 57u REG 252,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-28T21:04:34.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 58u a_inode 0,14 0 127175 [io_uring] 2023-11-28T21:04:34.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 59u IPv4 184909 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:32992 (ESTABLISHED) 2023-11-28T21:04:34.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 60r FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 61w FIFO 0,13 0t0 121390 pipe 2023-11-28T21:04:34.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 62r FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 63w FIFO 0,13 0t0 121391 pipe 2023-11-28T21:04:34.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 64u IPv4 186730 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:52172 (ESTABLISHED) 2023-11-28T21:04:34.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 65u IPv4 186170 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:53048 (ESTABLISHED) 2023-11-28T21:04:34.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 66u IPv4 184912 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:41544 (ESTABLISHED) 2023-11-28T21:04:34.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 67u IPv4 186173 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:42530 (ESTABLISHED) 2023-11-28T21:04:34.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 68u IPv4 193638 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:37362 (ESTABLISHED) 2023-11-28T21:04:34.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 69u IPv4 193641 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi178.front.sepia.ceph.com:55504 (ESTABLISHED) 2023-11-28T21:04:34.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 70u IPv4 188768 0t0 TCP smithi167.front.sepia.ceph.com:36660->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 71u IPv4 173433 0t0 TCP smithi167.front.sepia.ceph.com:39112->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 72u IPv4 191597 0t0 TCP smithi167.front.sepia.ceph.com:45462->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 73u IPv4 188769 0t0 TCP smithi167.front.sepia.ceph.com:48404->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 74u IPv4 186912 0t0 TCP smithi167.front.sepia.ceph.com:58160->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 75u IPv4 188869 0t0 TCP smithi167.front.sepia.ceph.com:53742->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 76u IPv4 186913 0t0 TCP smithi167.front.sepia.ceph.com:48108->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 77u IPv4 175398 0t0 TCP smithi167.front.sepia.ceph.com:39448->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 78u IPv4 186733 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi178.front.sepia.ceph.com:42652 (ESTABLISHED) 2023-11-28T21:04:34.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 79u IPv4 179069 0t0 TCP smithi167.front.sepia.ceph.com:46746->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 80u IPv4 175522 0t0 TCP smithi167.front.sepia.ceph.com:37442->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 81u IPv4 186854 0t0 TCP smithi167.front.sepia.ceph.com:55996->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 82u IPv4 179070 0t0 TCP smithi167.front.sepia.ceph.com:36140->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 83u IPv4 175492 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:60546 (ESTABLISHED) 2023-11-28T21:04:34.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 84u IPv4 175495 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:46078 (ESTABLISHED) 2023-11-28T21:04:34.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 85u IPv4 185982 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:39262 (ESTABLISHED) 2023-11-28T21:04:34.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 86u IPv4 185985 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:54272 (ESTABLISHED) 2023-11-28T21:04:34.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 87u IPv4 168706 0t0 TCP smithi167.front.sepia.ceph.com:6806->smithi167.front.sepia.ceph.com:49116 (ESTABLISHED) 2023-11-28T21:04:34.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 88u IPv4 168709 0t0 TCP smithi167.front.sepia.ceph.com:6804->smithi167.front.sepia.ceph.com:51268 (ESTABLISHED) 2023-11-28T21:04:34.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 90u IPv4 191550 0t0 TCP smithi167.front.sepia.ceph.com:40136->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 91u IPv4 186158 0t0 TCP smithi167.front.sepia.ceph.com:41744->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 92u IPv4 182032 0t0 TCP smithi167.front.sepia.ceph.com:53060->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:34.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 93u IPv4 186159 0t0 TCP smithi167.front.sepia.ceph.com:45712->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 94u IPv4 181829 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:33500 (ESTABLISHED) 2023-11-28T21:04:34.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 95u IPv4 186855 0t0 TCP smithi167.front.sepia.ceph.com:54000->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 96u IPv4 193648 0t0 TCP smithi167.front.sepia.ceph.com:44736->smithi167.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-28T21:04:34.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 97u IPv4 176254 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:44460 (ESTABLISHED) 2023-11-28T21:04:34.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 98u IPv4 183720 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:56204 (ESTABLISHED) 2023-11-28T21:04:34.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 99u IPv4 187503 0t0 TCP smithi167.front.sepia.ceph.com:35784->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:34.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 100u IPv4 192525 0t0 TCP smithi167.front.sepia.ceph.com:38110->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:34.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 102u IPv4 183630 0t0 TCP smithi167.front.sepia.ceph.com:6800->smithi178.front.sepia.ceph.com:52140 (ESTABLISHED) 2023-11-28T21:04:34.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 103u IPv4 190808 0t0 TCP smithi167.front.sepia.ceph.com:49400->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:34.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38334 40977 osd_srv_h root 105u IPv4 182014 0t0 TCP smithi167.front.sepia.ceph.com:6802->smithi178.front.sepia.ceph.com:39898 (ESTABLISHED) 2023-11-28T21:04:34.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:34.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:34.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:34.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:34.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:34.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:34.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:34.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:34.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:34.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:34.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:34.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:34.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:34.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:34.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:34.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:34.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:34.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:34.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:34.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:34.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:34.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:34.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:34.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:34.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:34.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:34.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:34.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:34.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:34.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:34.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:34.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:34.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:34.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:34.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:34.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:34.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:34.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:34.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:34.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:34.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:34.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:34.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:34.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:34.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:34.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:34.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:34.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:34.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:34.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:34.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:34.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:34.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:34.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:34.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:34.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:34.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:34.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:34.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:34.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:34.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:34.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:34.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:34.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:34.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:34.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:34.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:34.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:34.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:34.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:34.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:34.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:34.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:34.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:34.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:34.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:34.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:34.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:34.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:34.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:34.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:34.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:34.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:34.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:34.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:34.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:34.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:34.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:34.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:34.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:34.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:34.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:34.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:34.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:34.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:34.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:34.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:34.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:34.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:34.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:34.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:34.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:34.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:34.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:34.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:34.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:34.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:34.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:34.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:34.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:34.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:34.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:34.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:34.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:34.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:34.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:34.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:34.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:34.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:34.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:34.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:34.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:34.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:34.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:34.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:34.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:34.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:34.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:34.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:34.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:34.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:34.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:34.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:34.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:34.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:34.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:34.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:34.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:34.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:34.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:34.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:34.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:34.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:34.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:34.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:34.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:34.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:34.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:34.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:34.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:34.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:34.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:34.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:34.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:34.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:34.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:34.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:34.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:34.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:34.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:34.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:34.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:34.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:34.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:34.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:34.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:34.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:34.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:34.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:34.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:34.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:34.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:34.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:34.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:34.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:34.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:34.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:34.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:34.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:34.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:34.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:34.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:34.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:34.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:34.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38351 log root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:34.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:34.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:34.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:34.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:34.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:34.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:34.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:34.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:34.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:34.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:34.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:34.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:34.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:34.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:34.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:34.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:34.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:34.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:34.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:34.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:34.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:34.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:34.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:34.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:34.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:34.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:34.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:34.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:34.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:34.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:34.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:34.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:34.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:34.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:34.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:34.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:34.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38353 msgr-work root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38354 msgr-work root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38355 msgr-work root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38359 service root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38360 admin_soc root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38420 signal_ha root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38421 io_contex root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38422 io_contex root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38435 OpHistory root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38438 ceph_time root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 14w REG 8,1 1836538623 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38470 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38478 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38487 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38495 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38503 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38511 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38521 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38911 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38912 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38913 safe_time root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38914 safe_time root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38915 safe_time root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38916 safe_time root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38917 fn_anonym root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38920 rocksdb:l root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38921 rocksdb:l root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38922 rocksdb:l root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 38923 rocksdb:h root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 14w REG 8,1 1836538910 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 40316 bstore_ai root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41099 bstore_ai root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41346 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41347 cfin root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41348 bstore_kv root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41349 bstore_kv root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41350 bstore_me root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41533 ms_dispat root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:35.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:35.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:35.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:35.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:35.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:35.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:35.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:35.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:35.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:35.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:35.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:35.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:35.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:35.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:35.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:35.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:35.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:35.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:35.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:35.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:35.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:35.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:35.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:35.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:35.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:35.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:35.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:35.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:35.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:35.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:35.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:35.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:35.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:35.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:35.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:35.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:35.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:35.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:35.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:35.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:35.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:35.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:35.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:35.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:35.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:35.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:35.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:35.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:35.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:35.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:35.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:35.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:35.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:35.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:35.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:35.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:35.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:35.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:35.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:35.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:35.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:35.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:35.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:35.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:35.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:35.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:35.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:35.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:35.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:35.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:35.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:35.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:35.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:35.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:35.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:35.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:35.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:35.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:35.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:35.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41534 ms_local root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:35.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:35.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:35.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:35.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:35.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:35.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:35.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:35.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:35.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:35.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:35.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:35.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:35.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:35.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:35.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:35.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:35.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:35.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:35.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:35.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:35.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:35.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:35.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:35.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:35.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:35.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:35.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:35.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:35.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:35.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:35.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:35.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:35.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:35.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:35.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:35.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:35.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:35.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:35.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:35.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:35.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:35.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:35.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:35.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:35.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:35.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:35.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:35.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:35.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:35.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:35.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:35.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:35.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:35.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:35.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:35.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:35.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:35.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:35.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:35.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:35.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:35.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:35.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:35.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:35.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41536 safe_time root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 14w REG 8,1 1836539197 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41538 safe_time root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 14w REG 8,1 1836541999 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41540 ms_dispat root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 14w REG 8,1 1836544829 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41542 ms_local root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 14w REG 8,1 1836544829 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41544 ms_dispat root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 14w REG 8,1 1836544829 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41546 ms_local root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 14w REG 8,1 1836544829 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41548 ms_dispat root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 14w REG 8,1 1836544829 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41549 ms_local root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 14w REG 8,1 1836544829 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41554 ms_dispat root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 14w REG 8,1 1836545040 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41556 ms_local root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41558 ms_dispat root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41560 ms_local root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41563 ms_dispat root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41565 ms_local root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41567 fn_anonym root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41569 finisher root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41571 safe_time root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41573 safe_time root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41575 ceph-osd root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41576 osd_srv_a root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41577 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41579 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41581 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41584 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41586 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41587 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41589 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 14w REG 8,1 1836546088 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41591 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41593 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41595 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41596 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41598 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41600 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41602 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41604 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41605 tp_osd_tp root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root DEL REG 0,18 124021 /[aio] 2023-11-28T21:04:36.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root DEL REG 0,18 124010 /[aio] 2023-11-28T21:04:36.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 0,14 119444 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 1w FIFO 0,13 0t0 122226 pipe 2023-11-28T21:04:36.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 2w FIFO 0,13 0t0 122227 pipe 2023-11-28T21:04:36.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 3r FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 4w FIFO 0,13 0t0 126067 pipe 2023-11-28T21:04:36.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 6r FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 7w FIFO 0,13 0t0 126068 pipe 2023-11-28T21:04:36.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 9r FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 10w FIFO 0,13 0t0 126069 pipe 2023-11-28T21:04:36.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 12r FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 13w FIFO 0,13 0t0 126070 pipe 2023-11-28T21:04:36.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 14w REG 8,1 1836546375 664526 /var/log/ceph/ceph-osd.1.log 2023-11-28T21:04:36.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 15uW REG 0,23 6 3523 /run/ceph/ceph-osd.1.pid 2023-11-28T21:04:36.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 16r FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 17w FIFO 0,13 0t0 121305 pipe 2023-11-28T21:04:36.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 18u unix 0xffff98ee5afaf080 0t0 121306 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-28T21:04:36.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 19u IPv4 121320 0t0 TCP *:6808 (LISTEN) 2023-11-28T21:04:36.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 20u IPv4 121330 0t0 TCP *:6809 (LISTEN) 2023-11-28T21:04:36.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 21u IPv4 121341 0t0 TCP *:6810 (LISTEN) 2023-11-28T21:04:36.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 22u IPv4 121353 0t0 TCP *:6811 (LISTEN) 2023-11-28T21:04:36.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 23u IPv4 121366 0t0 TCP *:6812 (LISTEN) 2023-11-28T21:04:36.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 24u IPv4 121380 0t0 TCP *:6813 (LISTEN) 2023-11-28T21:04:36.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 25u IPv4 118770 0t0 TCP *:6814 (LISTEN) 2023-11-28T21:04:36.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 26u IPv4 126978 0t0 TCP *:6815 (LISTEN) 2023-11-28T21:04:36.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 27r FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 28w FIFO 0,13 0t0 119426 pipe 2023-11-28T21:04:36.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 29r FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 30w FIFO 0,13 0t0 119427 pipe 2023-11-28T21:04:36.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 31u sock 0,8 0t0 119440 protocol: UDPv6 2023-11-28T21:04:36.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 32r DIR 252,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-28T21:04:36.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 33uW REG 252,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-28T21:04:36.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 34u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 35u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 36u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 37u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 38u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 39u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 40u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 41u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 42u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 43u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 44u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 45u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 46u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 47u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 48u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 49u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 50u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 51u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 52u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 53u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 54u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 55u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 56u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 57u REG 252,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-28T21:04:36.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 58u a_inode 0,14 0 119444 [io_uring] 2023-11-28T21:04:36.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 59r FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 60w FIFO 0,13 0t0 127195 pipe 2023-11-28T21:04:36.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 61u IPv4 183752 0t0 TCP smithi167.front.sepia.ceph.com:34804->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 62r FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 63w FIFO 0,13 0t0 127196 pipe 2023-11-28T21:04:36.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 64u IPv4 174489 0t0 TCP smithi167.front.sepia.ceph.com:46078->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 65u IPv4 177628 0t0 TCP smithi167.front.sepia.ceph.com:45396->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 66u IPv4 187777 0t0 TCP smithi167.front.sepia.ceph.com:51326->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 67u IPv4 172832 0t0 TCP smithi167.front.sepia.ceph.com:43730->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:36.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 68u IPv4 173951 0t0 TCP smithi167.front.sepia.ceph.com:45526->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:36.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 69u IPv4 176941 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57016 (ESTABLISHED) 2023-11-28T21:04:36.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 70u IPv4 187778 0t0 TCP smithi167.front.sepia.ceph.com:59594->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 71u IPv4 169852 0t0 TCP smithi167.front.sepia.ceph.com:60546->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 72u IPv4 182030 0t0 TCP smithi167.front.sepia.ceph.com:43328->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 73u IPv4 190062 0t0 TCP smithi167.front.sepia.ceph.com:53730->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 74u IPv4 187304 0t0 TCP smithi167.front.sepia.ceph.com:45456->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 75u IPv4 186217 0t0 TCP smithi167.front.sepia.ceph.com:44644->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 76u IPv4 193674 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:37286 (ESTABLISHED) 2023-11-28T21:04:36.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 77u IPv4 187673 0t0 TCP smithi167.front.sepia.ceph.com:50876->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 78u IPv4 193677 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:39938 (ESTABLISHED) 2023-11-28T21:04:36.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 79u IPv4 192576 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:34484 (ESTABLISHED) 2023-11-28T21:04:36.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 80u IPv4 192579 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41526 (ESTABLISHED) 2023-11-28T21:04:36.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 81u IPv4 185307 0t0 TCP smithi167.front.sepia.ceph.com:49694->smithi178.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-28T21:04:36.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 82u IPv4 178712 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:39956 (ESTABLISHED) 2023-11-28T21:04:36.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 83u IPv4 178709 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:60370 (ESTABLISHED) 2023-11-28T21:04:36.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 84u IPv4 174989 0t0 TCP smithi167.front.sepia.ceph.com:54006->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 85u IPv4 188004 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:49746 (ESTABLISHED) 2023-11-28T21:04:36.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 86u IPv4 177939 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:39856 (ESTABLISHED) 2023-11-28T21:04:36.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 87u IPv4 189672 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi167.front.sepia.ceph.com:41744 (ESTABLISHED) 2023-11-28T21:04:36.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 88u IPv4 189675 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi167.front.sepia.ceph.com:45712 (ESTABLISHED) 2023-11-28T21:04:36.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 89u IPv4 190668 0t0 TCP smithi167.front.sepia.ceph.com:46936->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 90u IPv4 190477 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:42052 (ESTABLISHED) 2023-11-28T21:04:36.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 91u IPv4 190262 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:35526 (ESTABLISHED) 2023-11-28T21:04:36.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 92u IPv4 180181 0t0 TCP smithi167.front.sepia.ceph.com:6814->smithi178.front.sepia.ceph.com:51106 (ESTABLISHED) 2023-11-28T21:04:36.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 93u IPv4 180184 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:55206 (ESTABLISHED) 2023-11-28T21:04:36.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 94u IPv4 190660 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:40136 (ESTABLISHED) 2023-11-28T21:04:36.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 95u IPv4 187790 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:58870 (ESTABLISHED) 2023-11-28T21:04:36.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 96u IPv4 174500 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:44790 (ESTABLISHED) 2023-11-28T21:04:36.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 97u IPv4 181799 0t0 TCP smithi167.front.sepia.ceph.com:6808->smithi178.front.sepia.ceph.com:57332 (ESTABLISHED) 2023-11-28T21:04:36.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 98u IPv4 190255 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi167.front.sepia.ceph.com:59808 (ESTABLISHED) 2023-11-28T21:04:36.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 99u IPv4 183916 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:52214 (ESTABLISHED) 2023-11-28T21:04:36.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 101u IPv4 177942 0t0 TCP smithi167.front.sepia.ceph.com:6812->smithi178.front.sepia.ceph.com:41332 (ESTABLISHED) 2023-11-28T21:04:36.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 103u IPv4 187623 0t0 TCP smithi167.front.sepia.ceph.com:6810->smithi178.front.sepia.ceph.com:40064 (ESTABLISHED) 2023-11-28T21:04:36.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38336 41607 osd_srv_h root 104u IPv4 186151 0t0 TCP smithi167.front.sepia.ceph.com:38382->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:36.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:36.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:36.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:36.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:36.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:36.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:36.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:36.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:36.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:36.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:36.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:36.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:36.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:36.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:36.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:36.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:36.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:36.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:36.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:36.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:36.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:36.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:36.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:36.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:36.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:36.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:36.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:36.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:36.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:36.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:36.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:36.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:36.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:36.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:36.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:36.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:36.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:36.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:36.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:36.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:36.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:36.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:36.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:36.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:36.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:36.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:36.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:36.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:36.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:36.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:36.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:36.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:36.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:36.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:36.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:36.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:36.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:36.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:36.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:36.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:36.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:36.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:36.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:36.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:36.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:36.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:36.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:36.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:36.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:36.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:36.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:36.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:36.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:36.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:36.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:36.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:36.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:36.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:36.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:36.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:36.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:36.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:36.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:36.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:36.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:36.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:36.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:36.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:36.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:36.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:36.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:36.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:36.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:36.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:36.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:36.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:36.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:36.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:36.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:36.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:36.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:36.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:36.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:36.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:36.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:36.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:36.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:36.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:36.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:36.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:36.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:36.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:36.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:36.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:36.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:36.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:36.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:36.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:36.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:36.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:36.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:36.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38363 log root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:36.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:36.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:36.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:36.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:36.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:36.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:36.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:36.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:36.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:36.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:36.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:36.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:36.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:36.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:36.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:36.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:36.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:36.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:36.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:36.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:36.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:36.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:36.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:36.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:36.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:36.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:36.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:36.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:36.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:36.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:36.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:36.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:36.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:36.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:36.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:36.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:36.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:36.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:36.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:36.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:36.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:36.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:36.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:36.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:36.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:36.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:36.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:36.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:36.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:36.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:36.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:36.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:36.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:36.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:36.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:36.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:36.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:36.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:36.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:36.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:36.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:36.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:36.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38365 msgr-work root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:36.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:36.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:36.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:36.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:36.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:36.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:36.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:36.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:36.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:36.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:36.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:36.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:36.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:36.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:36.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:36.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:36.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:36.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:36.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:36.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:36.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:36.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:36.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:36.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:36.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:36.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:36.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:36.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:36.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:36.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:36.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:36.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:36.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:36.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:36.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:36.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:36.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:36.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:36.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:36.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:36.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:36.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:36.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:36.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:36.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:36.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:36.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:36.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:36.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:36.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:36.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:36.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:36.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:36.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:36.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:36.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:36.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:36.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:36.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:36.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:36.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:36.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:36.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:36.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:36.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:36.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:36.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:36.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:36.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:36.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:36.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:36.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:36.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:36.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:36.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:36.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:36.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:36.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:36.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:36.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:36.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:36.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:36.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:36.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:36.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:36.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:36.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:36.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:36.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:36.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:36.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:36.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:36.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:36.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:36.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:36.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:36.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:36.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:36.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:36.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:36.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:36.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:36.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:36.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:36.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:36.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:36.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:36.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:36.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:36.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:36.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:36.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:36.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:36.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:36.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:36.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:36.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:36.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:36.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:36.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:36.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:36.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:36.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:36.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:36.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:36.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:36.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:36.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:36.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:36.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:36.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:36.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:36.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:36.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:36.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:36.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:36.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:36.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:36.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:36.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:36.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:36.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:36.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38366 msgr-work root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38367 msgr-work root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38371 service root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38372 admin_soc root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38424 signal_ha root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38425 io_contex root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38426 io_contex root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 14w REG 8,1 1175684823 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38436 OpHistory root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38437 ceph_time root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38472 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38480 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38489 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38497 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38505 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38513 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76d0e5a640 1 Processor -- start 2023-11-28T21:04:37.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76d0e5a640 1 -- start start 2023-11-28T21:04:37.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76d0e5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76cc0cfc40 0x7f76cc0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:37.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76d0e5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc153ae0 0x7f76cc153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:37.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76d0e5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc15ac00 con 0x7f76cc0cf860 2023-11-28T21:04:37.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76d0e5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc0cbd60 con 0x7f76cc0cfc40 2023-11-28T21:04:37.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76d0e5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc159ff0 con 0x7f76cc153ae0 2023-11-28T21:04:37.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76c3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76cc0cfc40 0x7f76cc0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:37.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76ca59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f76cc0cf860 0x7f76cc0ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:52620/0 (socket says 172.21.15.167:52620) 2023-11-28T21:04:37.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76c3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76cc0cfc40 0x7f76cc0cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:41942/0 (socket says 172.21.15.167:41942) 2023-11-28T21:04:37.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76ca59c640 1 -- 172.21.15.167:0/212252014 learned_addr learned my addr 172.21.15.167:0/212252014 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:37.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.494+0000 7f76cad9d640 1 --2- 172.21.15.167:0/212252014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc153ae0 0x7f76cc153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:37.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76c3fff640 1 -- 172.21.15.167:0/212252014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc153ae0 msgr2=0x7f76cc153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:04:37.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76c3fff640 1 --2- 172.21.15.167:0/212252014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc153ae0 0x7f76cc153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:37.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76c3fff640 1 -- 172.21.15.167:0/212252014 >> v1:172.21.15.167:6789/0 conn(0x7f76cc0cf860 legacy=0x7f76cc0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:37.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76c3fff640 1 -- 172.21.15.167:0/212252014 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc15a2d0 con 0x7f76cc0cfc40 2023-11-28T21:04:37.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76c9d9b640 1 -- 172.21.15.167:0/212252014 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466859301 0 0) 0x7f76cc15ac00 con 0x7f76cc0cf860 2023-11-28T21:04:37.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76c3fff640 1 --2- 172.21.15.167:0/212252014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc0cfc40 0x7f76cc0cb770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097c0 tx=0x7f76b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584b2c8e7d892ddb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:37.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76c9d9b640 1 -- 172.21.15.167:0/212252014 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b40ab680 con 0x7f76cc0cfc40 2023-11-28T21:04:37.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76c9d9b640 1 -- 172.21.15.167:0/212252014 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b40ab7e0 con 0x7f76cc0cfc40 2023-11-28T21:04:37.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76c9d9b640 1 -- 172.21.15.167:0/212252014 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b40abb70 con 0x7f76cc0cfc40 2023-11-28T21:04:37.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76d0e5a640 1 -- 172.21.15.167:0/212252014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc0cfc40 msgr2=0x7f76cc0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:37.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76d0e5a640 1 --2- 172.21.15.167:0/212252014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc0cfc40 0x7f76cc0cb770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097c0 tx=0x7f76b401c480 comp rx=0 tx=0).stop 2023-11-28T21:04:37.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76d0e5a640 1 -- 172.21.15.167:0/212252014 shutdown_connections 2023-11-28T21:04:37.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76d0e5a640 1 --2- 172.21.15.167:0/212252014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc0cfc40 0x7f76cc0cb770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:37.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76d0e5a640 1 --2- 172.21.15.167:0/212252014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc153ae0 0x7f76cc153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:37.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76d0e5a640 1 -- 172.21.15.167:0/212252014 >> 172.21.15.167:0/212252014 conn(0x7f76cc06c1f0 msgr2=0x7f76cc071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:37.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76d0e5a640 1 -- 172.21.15.167:0/212252014 shutdown_connections 2023-11-28T21:04:37.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.498+0000 7f76d0e5a640 1 -- 172.21.15.167:0/212252014 wait complete. 2023-11-28T21:04:37.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 Processor -- start 2023-11-28T21:04:37.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 -- start start 2023-11-28T21:04:37.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0cf860 0x7f76cc0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:37.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76cc0cfc40 0x7f76cc159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:37.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc153ae0 0x7f76cc154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:37.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1f3910 con 0x7f76cc153ae0 2023-11-28T21:04:37.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc156700 con 0x7f76cc0cfc40 2023-11-28T21:04:37.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1f2ab0 con 0x7f76cc0cf860 2023-11-28T21:04:37.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76cad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc153ae0 0x7f76cc154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:37.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76cad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc153ae0 0x7f76cc154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:41958/0 (socket says 172.21.15.167:41958) 2023-11-28T21:04:37.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76cad9d640 1 -- 172.21.15.167:0/3965414871 learned_addr learned my addr 172.21.15.167:0/3965414871 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:37.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76c3fff640 1 -- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76cc0cfc40 msgr2=0x7f76cc159010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.178:3300/0 2023-11-28T21:04:37.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76c3fff640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76cc0cfc40 0x7f76cc159010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:37.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76cad9d640 1 -- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0cf860 msgr2=0x7f76cc0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:37.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76cad9d640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc0cf860 0x7f76cc0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:37.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76cad9d640 1 -- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76cc0cfc40 msgr2=0x7f76cc159010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:37.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76cad9d640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76cc0cfc40 0x7f76cc159010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:37.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76cad9d640 1 -- 172.21.15.167:0/3965414871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009420 con 0x7f76cc153ae0 2023-11-28T21:04:37.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76cad9d640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc153ae0 0x7f76cc154850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76c4007e40 tx=0x7f76c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:37.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4014620 con 0x7f76cc153ae0 2023-11-28T21:04:37.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c400ee90 con 0x7f76cc153ae0 2023-11-28T21:04:37.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc1f2d90 con 0x7f76cc153ae0 2023-11-28T21:04:37.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40149e0 con 0x7f76cc153ae0 2023-11-28T21:04:37.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc1f3350 con 0x7f76cc153ae0 2023-11-28T21:04:37.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc143e10 0x7f76cc154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:37.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc072860 con 0x7f76cc143e10 2023-11-28T21:04:37.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.502+0000 7f76ca59c640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc143e10 0x7f76cc154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:37.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76c4014b40 con 0x7f76cc153ae0 2023-11-28T21:04:37.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76ca59c640 1 -- 172.21.15.167:0/3965414871 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76cc075c90 con 0x7f76cc143e10 2023-11-28T21:04:37.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76ca59c640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc143e10 0x7f76cc154d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c340 tx=0x7f76bc00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:37.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c2ffd640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76ac066420 0x7f76ac0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:37.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f76c4084ca0 con 0x7f76cc153ae0 2023-11-28T21:04:37.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0074e0 con 0x7f76cc143e10 2023-11-28T21:04:37.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c3fff640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76ac066420 0x7f76ac0688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:37.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f76bc007640 con 0x7f76cc143e10 2023-11-28T21:04:37.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc143e10 msgr2=0x7f76cc154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:37.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c2ffd640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc143e10 0x7f76cc154d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c340 tx=0x7f76bc00c800 comp rx=0 tx=0).stop 2023-11-28T21:04:37.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc143e10 msgr2=0x7f76cc154d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:37.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c2ffd640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc143e10 0x7f76cc154d90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:37.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.506+0000 7f76c3fff640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76ac066420 0x7f76ac0688e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f76b40af000 tx=0x7f76b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:37.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.510+0000 7f76d0e5a640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc166630 0x7f76cc1f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:37.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.510+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1545b0 con 0x7f76cc166630 2023-11-28T21:04:37.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.510+0000 7f76ca59c640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc166630 0x7f76cc1f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:37.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76ca59c640 1 -- 172.21.15.167:0/3965414871 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f76cc153570 con 0x7f76cc166630 2023-11-28T21:04:37.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76ca59c640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc166630 0x7f76cc1f5f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76bc013000 tx=0x7f76bc001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:37.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc020070 con 0x7f76cc166630 2023-11-28T21:04:37.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4969 (secure 0 0 0) 0x7f76bc01b3e0 con 0x7f76cc166630 2023-11-28T21:04:37.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc166630 msgr2=0x7f76cc1f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:37.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76c2ffd640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc166630 0x7f76cc1f5f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76bc013000 tx=0x7f76bc001090 comp rx=0 tx=0).stop 2023-11-28T21:04:37.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76c2ffd640 1 -- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc166630 msgr2=0x7f76cc1f5f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:04:37.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76c2ffd640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76cc166630 0x7f76cc1f5f10 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76bc013000 tx=0x7f76bc001090 comp rx=0 tx=0).stop 2023-11-28T21:04:37.391 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:04:37.391 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:37.392 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:37.392 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:04:37.392 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 200, 2023-11-28T21:04:37.392 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:04:37.392 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:04:37.392 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:04:37.392 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:37.392 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 4, 2023-11-28T21:04:37.393 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:37.393 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:04:37.393 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:04:37.393 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:37.393 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:37.393 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:37.393 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:37.393 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:37.394 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:37.394 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:37.394 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:37.394 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:37.394 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:37.394 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:37.394 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:04:37.394 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:04:37.395 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:37.395 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:37.395 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:37.395 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:37.395 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:37.395 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:37.395 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:37.395 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:37.396 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:37.396 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:37.396 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:37.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.396 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:04:37.396 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:04:37.396 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:04:37.396 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:04:37.396 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:04:37.397 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:04:37.397 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:37.397 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:04:37.397 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:04:37.397 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:04:37.397 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:04:37.397 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:04:37.397 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:04:37.398 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:04:37.398 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:04:37.398 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:04:37.398 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:04:37.398 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:04:37.398 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:04:37.398 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:04:37.399 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:04:37.399 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:04:37.399 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:04:37.399 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:04:37.399 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:04:37.399 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:04:37.399 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:04:37.399 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:37.400 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:04:37.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.400 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:04:37.400 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.400 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:04:37.400 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:04:37.400 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:37.400 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:37.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.401 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:37.401 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:04:37.401 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:37.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.401 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.401 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:37.402 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:04:37.402 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:37.402 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:37.402 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:37.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.402 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:04:37.402 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:04:37.402 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:37.403 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:37.403 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:37.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.403 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.403 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:04:37.403 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:04:37.403 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:37.403 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:37.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.404 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:37.404 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:04:37.404 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:37.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.404 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.404 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:37.404 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:04:37.405 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:37.405 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:37.405 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:37.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.405 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:04:37.405 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:04:37.405 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:37.405 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:37.406 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:37.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.406 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:04:37.406 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:04:37.406 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:04:37.406 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:04:37.406 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.407 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:04:37.407 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:04:37.407 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:37.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.407 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.407 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:04:37.407 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:04:37.407 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:04:37.408 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:37.408 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:37.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.408 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:04:37.408 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:04:37.408 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:04:37.408 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:04:37.408 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:04:37.409 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:37.409 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:37.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.409 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:04:37.409 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:04:37.409 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.409 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:37.409 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:37.410 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:37.410 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:37.410 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:37.410 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:04:37.410 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.410 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:37.410 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:37.410 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:04:37.411 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:37.411 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:37.411 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:04:37.411 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.411 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:37.411 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:37.411 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:04:37.411 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:37.412 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:37.412 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:04:37.412 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.412 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:37.412 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:37.412 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:04:37.412 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:37.412 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:04:37.412 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:04:37.413 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:04:37.413 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:04:37.413 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:04:37.413 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:04:37.413 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:04:37.413 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:04:37.413 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:04:37.414 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:04:37.414 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:04:37.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76ac066420 msgr2=0x7f76ac0688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:37.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76d0e5a640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f76ac066420 0x7f76ac0688e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f76b40af000 tx=0x7f76b4008040 comp rx=0 tx=0).stop 2023-11-28T21:04:37.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc153ae0 msgr2=0x7f76cc154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:37.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76d0e5a640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc153ae0 0x7f76cc154850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76c4007e40 tx=0x7f76c400e4b0 comp rx=0 tx=0).stop 2023-11-28T21:04:37.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76cad9d640 1 -- 172.21.15.167:0/3965414871 reap_dead start 2023-11-28T21:04:37.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 shutdown_connections 2023-11-28T21:04:37.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76d0e5a640 1 --2- 172.21.15.167:0/3965414871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76cc153ae0 0x7f76cc154850 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:37.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 >> 172.21.15.167:0/3965414871 conn(0x7f76cc06c1f0 msgr2=0x7f76cc0ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:37.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 shutdown_connections 2023-11-28T21:04:37.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:35.514+0000 7f76d0e5a640 1 -- 172.21.15.167:0/3965414871 wait complete. 2023-11-28T21:04:37.417 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2023-11-28T21:04:37.417 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2023-11-28T21:04:37.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38519 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38718 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38719 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38720 safe_time root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38721 safe_time root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38722 safe_time root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38723 safe_time root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38724 fn_anonym root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38727 rocksdb:l root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38728 rocksdb:l root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38729 rocksdb:l root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 14w REG 8,1 1175685110 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 38730 rocksdb:h root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40207 bstore_ai root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 40978 bstore_ai root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41302 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41321 cfin root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41323 bstore_kv root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41324 bstore_kv root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41328 bstore_me root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41351 ms_dispat root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41352 ms_local root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:37.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:37.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:37.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:37.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:37.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:37.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:37.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:37.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:37.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:37.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41353 safe_time root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:37.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:37.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:37.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:37.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:37.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:37.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:37.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:37.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:37.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:37.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:37.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:37.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:37.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:37.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:37.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:37.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:37.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:37.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:37.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:37.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:37.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:37.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:37.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:37.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:37.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:37.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:37.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:37.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:37.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:37.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:37.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:37.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:37.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:37.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:37.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:37.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:37.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:37.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:37.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:37.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:37.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:37.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:37.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:37.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:37.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:37.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:37.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:37.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:37.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:37.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:37.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:37.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:37.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:37.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:37.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:37.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:37.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:37.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:37.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:37.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:37.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:37.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:37.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:37.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:37.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:37.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:37.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:37.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:37.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:37.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:37.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:37.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:37.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:37.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:37.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:37.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:37.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:37.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:37.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:37.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:37.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:37.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:37.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:37.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:37.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:37.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:37.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:37.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:37.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:37.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:37.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:37.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:37.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:37.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:37.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:37.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:37.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:37.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:37.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:37.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:37.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:37.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:37.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:37.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:37.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:37.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:37.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:37.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:37.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:37.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:37.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:37.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:37.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:37.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:37.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:37.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:37.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:37.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:37.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:37.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:37.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:37.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:37.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:37.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:37.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:37.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:37.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41354 safe_time root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41355 ms_dispat root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41356 ms_local root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41357 ms_dispat root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41358 ms_local root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41359 ms_dispat root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41360 ms_local root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 14w REG 8,1 1175685397 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41361 ms_dispat root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41362 ms_local root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41363 ms_dispat root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41364 ms_local root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41365 ms_dispat root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41366 ms_local root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41367 fn_anonym root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41368 finisher root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41369 safe_time root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41370 safe_time root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41371 ceph-osd root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41372 osd_srv_a root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41373 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41374 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41375 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41376 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41377 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41378 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41379 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 14w REG 8,1 1175685684 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41380 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41381 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41382 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41383 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41384 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41385 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41386 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41387 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41388 tp_osd_tp root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root DEL REG 0,18 122294 /[aio] 2023-11-28T21:04:38.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root DEL REG 0,18 122291 /[aio] 2023-11-28T21:04:38.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 0,14 122281 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 1w FIFO 0,13 0t0 122229 pipe 2023-11-28T21:04:38.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 2w FIFO 0,13 0t0 122230 pipe 2023-11-28T21:04:38.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 3r FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 4w FIFO 0,13 0t0 125104 pipe 2023-11-28T21:04:38.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 6r FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 7w FIFO 0,13 0t0 125105 pipe 2023-11-28T21:04:38.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 9r FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 10w FIFO 0,13 0t0 125106 pipe 2023-11-28T21:04:38.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 12r FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 13w FIFO 0,13 0t0 125107 pipe 2023-11-28T21:04:38.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 14w REG 8,1 1175685971 664527 /var/log/ceph/ceph-osd.2.log 2023-11-28T21:04:38.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 15uW REG 0,23 6 3525 /run/ceph/ceph-osd.2.pid 2023-11-28T21:04:38.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 16r FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 17w FIFO 0,13 0t0 125110 pipe 2023-11-28T21:04:38.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 18u unix 0xffff98ee4c1dad00 0t0 125111 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-28T21:04:38.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 19u IPv4 126995 0t0 TCP *:6816 (LISTEN) 2023-11-28T21:04:38.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 20u IPv4 127013 0t0 TCP *:6817 (LISTEN) 2023-11-28T21:04:38.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 21u IPv4 127032 0t0 TCP *:6818 (LISTEN) 2023-11-28T21:04:38.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 22u IPv4 127052 0t0 TCP *:6819 (LISTEN) 2023-11-28T21:04:38.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 23u IPv4 127073 0t0 TCP *:6820 (LISTEN) 2023-11-28T21:04:38.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 24u IPv4 127095 0t0 TCP *:6821 (LISTEN) 2023-11-28T21:04:38.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 25u IPv4 127118 0t0 TCP *:6822 (LISTEN) 2023-11-28T21:04:38.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 26u IPv4 127142 0t0 TCP *:6823 (LISTEN) 2023-11-28T21:04:38.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 27r FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 28w FIFO 0,13 0t0 125127 pipe 2023-11-28T21:04:38.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 29r FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 30w FIFO 0,13 0t0 125128 pipe 2023-11-28T21:04:38.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 31u sock 0,8 0t0 122277 protocol: UDPv6 2023-11-28T21:04:38.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 32r DIR 252,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-28T21:04:38.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 33uW REG 252,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-28T21:04:38.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 34u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 35u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 36u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 37u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 38u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 39u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 40u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 41u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 42u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 43u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 44u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 45u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 46u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 47u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 48u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 49u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 50u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 51u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 52u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 53u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 54u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 55u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 56u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 57u REG 252,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-28T21:04:38.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 58u a_inode 0,14 0 122281 [io_uring] 2023-11-28T21:04:38.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 59r FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 60u IPv4 185343 0t0 TCP smithi167.front.sepia.ceph.com:58122->smithi167.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-28T21:04:38.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 61w FIFO 0,13 0t0 127197 pipe 2023-11-28T21:04:38.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 62r FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 63w FIFO 0,13 0t0 127198 pipe 2023-11-28T21:04:38.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 64u IPv4 177397 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:43730 (ESTABLISHED) 2023-11-28T21:04:38.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 65u IPv4 177400 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:45526 (ESTABLISHED) 2023-11-28T21:04:38.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 66u IPv4 188955 0t0 TCP smithi167.front.sepia.ceph.com:37286->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 67u IPv4 179531 0t0 TCP smithi167.front.sepia.ceph.com:58544->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 68u IPv4 176104 0t0 TCP smithi167.front.sepia.ceph.com:36902->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 69u IPv4 187303 0t0 TCP smithi167.front.sepia.ceph.com:47558->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 70u IPv4 177240 0t0 TCP smithi167.front.sepia.ceph.com:50518->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 71u IPv4 188956 0t0 TCP smithi167.front.sepia.ceph.com:39938->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 72u IPv4 191536 0t0 TCP smithi167.front.sepia.ceph.com:46700->smithi167.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 73u IPv4 178564 0t0 TCP smithi167.front.sepia.ceph.com:32774->smithi178.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 74u IPv4 187066 0t0 TCP smithi167.front.sepia.ceph.com:46130->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 75u IPv4 187067 0t0 TCP smithi167.front.sepia.ceph.com:36310->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 76u IPv4 173762 0t0 TCP smithi167.front.sepia.ceph.com:56520->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 77u IPv4 190041 0t0 TCP smithi167.front.sepia.ceph.com:60650->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 78u IPv4 184984 0t0 TCP smithi167.front.sepia.ceph.com:39262->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 79u IPv4 184985 0t0 TCP smithi167.front.sepia.ceph.com:54272->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 80u IPv4 186848 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:59010 (ESTABLISHED) 2023-11-28T21:04:38.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 81u IPv4 186851 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:43258 (ESTABLISHED) 2023-11-28T21:04:38.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 82u IPv4 187120 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:34170 (ESTABLISHED) 2023-11-28T21:04:38.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 83u IPv4 187123 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36744 (ESTABLISHED) 2023-11-28T21:04:38.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 84u IPv4 182616 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:56426 (ESTABLISHED) 2023-11-28T21:04:38.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 85u IPv4 163875 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:39450 (ESTABLISHED) 2023-11-28T21:04:38.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 86u IPv4 182619 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:32944 (ESTABLISHED) 2023-11-28T21:04:38.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 87u IPv4 181116 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi167.front.sepia.ceph.com:46746 (ESTABLISHED) 2023-11-28T21:04:38.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 88u IPv4 184465 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:51168 (ESTABLISHED) 2023-11-28T21:04:38.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 89u IPv4 172440 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:40262 (ESTABLISHED) 2023-11-28T21:04:38.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 90u IPv4 189972 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:55984 (ESTABLISHED) 2023-11-28T21:04:38.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 91u IPv4 163878 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:53328 (ESTABLISHED) 2023-11-28T21:04:38.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 92u IPv4 181119 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi167.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-28T21:04:38.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 93u IPv4 190254 0t0 TCP smithi167.front.sepia.ceph.com:59808->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 94u IPv4 186574 0t0 TCP smithi167.front.sepia.ceph.com:6816->smithi178.front.sepia.ceph.com:47108 (ESTABLISHED) 2023-11-28T21:04:38.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 95u IPv4 172435 0t0 TCP smithi167.front.sepia.ceph.com:37452->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 96u IPv4 189941 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi178.front.sepia.ceph.com:35618 (ESTABLISHED) 2023-11-28T21:04:38.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 97u IPv4 183488 0t0 TCP smithi167.front.sepia.ceph.com:46770->smithi178.front.sepia.ceph.com:6821 (ESTABLISHED) 2023-11-28T21:04:38.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 98u IPv4 167262 0t0 TCP smithi167.front.sepia.ceph.com:6822->smithi178.front.sepia.ceph.com:39354 (ESTABLISHED) 2023-11-28T21:04:38.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 99u IPv4 167265 0t0 TCP smithi167.front.sepia.ceph.com:6820->smithi178.front.sepia.ceph.com:59084 (ESTABLISHED) 2023-11-28T21:04:38.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 100u IPv4 182681 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:53060 (ESTABLISHED) 2023-11-28T21:04:38.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 102u IPv4 187322 0t0 TCP smithi167.front.sepia.ceph.com:49398->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:38.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38345 41389 osd_srv_h root 103u IPv4 184707 0t0 TCP smithi167.front.sepia.ceph.com:6818->smithi167.front.sepia.ceph.com:44164 (ESTABLISHED) 2023-11-28T21:04:38.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:38.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:38.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:38.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:38.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 14w REG 8,1 2128022457 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:38.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:38.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:38.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:38.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:38.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:38.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:38.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:38.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:38.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:38.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:38.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:38.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:38.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:38.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:38.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:38.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:38.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:38.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:38.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:38.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:38.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:38.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:38.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:38.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:38.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:38.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:38.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:38.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:38.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:38.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:38.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:38.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:38.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:38.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:38.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:38.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:38.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:38.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:38.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:38.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:38.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:38.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:38.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:38.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:38.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:38.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:38.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:38.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:38.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:38.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:38.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:38.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:38.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:38.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:38.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:38.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:38.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:38.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:38.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:38.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:38.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:38.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:38.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:38.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:38.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:38.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:38.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:38.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:38.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:38.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:38.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:38.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:38.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:38.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:38.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:38.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:38.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:38.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:38.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:38.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:38.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:38.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:38.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:38.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:38.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:38.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38375 log root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:38.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:38.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:38.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:38.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:38.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:38.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:38.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:38.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:38.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:38.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:38.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:38.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:38.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:38.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:38.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:38.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:38.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:38.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:38.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:38.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:38.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:38.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:38.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:38.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:38.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:38.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:38.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:38.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:38.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:38.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:38.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:38.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:38.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:38.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:38.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:38.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:38.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:38.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:38.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:38.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:38.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:38.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:38.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:38.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:38.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38377 msgr-work root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:38.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:38.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:38.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:38.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:38.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:38.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:38.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:38.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:38.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:38.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:38.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:38.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:38.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:38.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:38.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:38.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:38.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:38.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:38.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:38.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:38.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:38.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:38.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:38.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:38.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:38.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:38.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:38.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:38.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:38.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:38.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:38.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:38.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:38.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:38.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:38.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:38.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:38.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:38.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:38.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:38.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:38.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:38.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:38.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:38.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38378 msgr-work root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:38.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:38.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:38.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:38.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:38.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:38.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:38.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:38.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:38.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:38.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:38.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:38.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:38.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:38.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:38.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:38.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:38.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:38.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:38.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:38.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:38.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:38.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:38.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:38.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:38.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:38.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:38.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:38.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:38.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:38.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:38.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:38.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:38.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:38.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:38.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:38.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:38.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:38.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:38.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:38.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:38.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:38.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:38.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:38.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:38.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38379 msgr-work root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:38.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:38.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:38.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:38.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:38.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:38.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:38.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:38.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:38.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:38.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:38.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:38.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:38.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:38.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:38.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:38.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:38.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:38.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:38.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:38.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:38.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:38.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:38.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:38.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:38.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:38.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:38.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:38.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:38.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:38.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:38.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38383 service root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:38.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:38.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:38.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:38.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:38.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:38.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:38.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:38.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:38.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:38.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:38.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:38.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:38.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:38.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:38.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:38.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:38.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:38.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:38.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:38.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:38.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:38.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:38.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:38.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:38.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:38.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:38.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:38.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:38.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:38.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:38.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:38.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:38.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:38.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:38.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:38.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:38.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:38.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:38.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:38.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:38.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:38.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:38.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:38.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:38.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:38.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:38.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:38.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:38.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:38.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:38.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:38.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:38.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:38.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:38.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:38.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:38.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:38.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:38.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:38.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:38.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:38.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:38.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:38.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:38.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:38.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:38.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:38.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:38.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:38.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:38.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:38.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:38.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:38.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:38.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:38.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:38.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:38.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:38.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:38.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:38.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:38.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:38.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:38.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:38.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:38.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:38.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:38.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:38.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:38.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:38.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:38.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:38.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:38.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:38.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:38.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:38.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:38.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:38.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:38.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:38.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:38.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:38.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:38.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:38.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:38.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:38.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:38.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:38.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:38.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:38.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:38.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:38.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:38.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:38.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:38.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:38.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:38.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:38.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:38.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:38.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:38.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:38.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:38.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:38.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:38.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:38.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:38.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38384 admin_soc root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38428 signal_ha root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38429 io_contex root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38430 io_contex root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38441 OpHistory root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38442 ceph_time root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38474 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 14w REG 8,1 2128020479 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38482 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38491 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38499 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38507 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38515 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 38523 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39104 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39105 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39106 safe_time root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39107 safe_time root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39108 safe_time root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39109 safe_time root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39110 fn_anonym root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39113 rocksdb:l root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39114 rocksdb:l root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39115 rocksdb:l root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 39116 rocksdb:h root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 40571 bstore_ai root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 14w REG 8,1 2128020766 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41345 bstore_ai root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 14w REG 8,1 2128021053 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41609 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 14w REG 8,1 2128021053 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41610 cfin root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 14w REG 8,1 2128021053 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.719 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41611 bstore_kv root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.720 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.721 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.722 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.723 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.724 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.725 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.726 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.727 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.728 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.729 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.730 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.731 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.732 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.733 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.734 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.735 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41612 bstore_kv root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.760 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41613 bstore_me root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41614 ms_dispat root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41615 ms_local root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41616 safe_time root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.854 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.855 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.856 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.857 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.858 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.859 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.860 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.861 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.862 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.863 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.865 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41617 safe_time root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41618 ms_dispat root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41619 ms_local root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41620 ms_dispat root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.964 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41621 ms_local root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:39.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:39.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:39.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:39.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:39.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:39.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:39.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:39.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:39.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:39.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:39.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:39.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:39.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:39.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:39.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:39.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:39.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:39.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:39.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:39.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:39.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:39.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:39.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:39.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:39.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:39.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:39.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:39.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:39.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:39.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:39.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:39.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:39.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:39.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:39.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:39.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:39.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:39.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:39.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:39.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:39.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:39.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:39.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:39.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:39.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:39.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:39.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:39.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:39.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:39.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:39.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:39.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:39.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:39.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:39.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:39.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:39.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:39.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:39.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:39.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:39.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:39.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:39.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:39.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:39.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:39.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:39.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:39.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:39.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:39.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:39.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:39.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:39.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:39.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:39.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:39.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:39.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:39.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:39.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:39.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:39.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:39.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:39.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41622 ms_dispat root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:39.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:39.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:39.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:39.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:39.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:39.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:39.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:39.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:39.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:39.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:39.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:39.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:39.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:39.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:39.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:39.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:39.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:39.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:39.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:39.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:39.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:39.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:39.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:39.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:39.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:39.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:39.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:39.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:39.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:39.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:39.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:39.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:39.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:39.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:39.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:39.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:39.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:39.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:39.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:39.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:39.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:39.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:39.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:39.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:39.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:39.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:39.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:39.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:39.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:39.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:39.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:39.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:39.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:39.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:39.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:39.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:39.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:39.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:39.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:39.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:39.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:39.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:39.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:39.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41623 ms_local root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41624 ms_dispat root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41625 ms_local root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 14w REG 8,1 2128021883 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41626 ms_dispat root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.094 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.095 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.096 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.097 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.098 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.099 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.100 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.101 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.102 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.103 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.104 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.105 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41627 ms_local root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41628 ms_dispat root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41629 ms_local root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.167 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.168 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41630 fn_anonym root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41631 finisher root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41632 safe_time root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41633 safe_time root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41634 ceph-osd root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41635 osd_srv_a root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41636 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41637 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.376 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.377 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41638 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41639 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41640 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41641 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.464 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.465 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.466 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.467 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.469 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.470 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.471 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.472 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.473 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.474 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.475 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.476 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41642 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.477 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.478 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.479 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.480 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.481 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.482 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.483 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.484 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.485 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.486 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.487 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.488 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.489 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.490 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.491 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.492 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.493 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.494 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.495 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.496 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.497 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.498 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41643 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.501 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.502 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.503 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.504 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.505 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.506 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.507 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.508 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.509 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.511 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.512 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.513 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.514 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.515 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.516 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.517 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.518 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.519 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.520 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.521 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.522 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.523 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.524 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41644 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.525 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.526 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.527 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.528 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.529 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.531 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.533 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.534 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.535 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.536 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.537 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 14w REG 8,1 2128022170 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.538 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.539 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.540 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.541 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.542 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.543 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.544 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.545 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.546 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.547 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.548 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.549 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41645 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.550 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.551 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.552 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.553 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.554 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.555 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.556 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.557 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.558 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.559 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.560 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.561 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 14w REG 8,1 2128022457 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.562 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.563 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.564 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.565 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.566 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.567 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.568 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.569 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.570 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.571 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.572 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.573 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41646 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.574 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.575 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.576 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.577 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.578 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.579 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.580 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.581 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.582 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.583 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.584 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.585 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 14w REG 8,1 2128022457 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.586 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.587 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.588 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.589 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.590 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.591 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.592 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.593 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.594 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.595 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.596 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41647 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.597 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.598 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.599 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.600 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.601 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.602 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.603 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.604 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.605 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.606 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.607 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.609 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 14w REG 8,1 2128022457 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.610 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.611 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.612 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.613 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.614 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.615 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.616 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.617 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.618 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.619 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.620 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.621 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41648 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.622 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.623 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.624 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.625 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.626 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.627 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.628 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.629 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.630 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.631 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.632 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.633 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 14w REG 8,1 2128022457 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.634 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.635 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.636 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.637 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.638 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.639 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.640 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.641 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.642 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.643 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.644 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.645 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41649 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.646 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.647 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.648 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.649 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.650 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.651 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.652 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.653 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.655 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.656 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.657 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.658 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 14w REG 8,1 2128022457 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.659 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.660 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.661 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.662 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.663 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.664 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.665 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.666 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.667 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.668 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.669 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41650 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.670 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.671 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.672 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.674 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.675 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.676 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.677 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.678 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.679 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.680 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.681 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.682 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 14w REG 8,1 2128022457 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.683 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.684 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.685 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.686 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.687 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.688 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.689 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.690 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.691 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.692 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.693 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41651 tp_osd_tp root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.694 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root txt REG 8,1 39111208 80344 /usr/bin/ceph-osd 2023-11-28T21:04:40.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 113624 664028 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-28T21:04:40.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 1285744 664027 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-28T21:04:40.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 43800 664031 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-28T21:04:40.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 68688 664013 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-28T21:04:40.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 216168 664016 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-28T21:04:40.695 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 68400 664032 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-28T21:04:40.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 84992 664024 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-28T21:04:40.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 35648 664017 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-28T21:04:40.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 39688 664014 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-28T21:04:40.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 117792 664012 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-28T21:04:40.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 806216 664026 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-28T21:04:40.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 72688 664019 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-28T21:04:40.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 64384 664015 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-28T21:04:40.696 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 47920 664020 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-28T21:04:40.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 80872 664018 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-28T21:04:40.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 396768 664025 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-28T21:04:40.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 67736 50692 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-28T21:04:40.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 27352 664022 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-28T21:04:40.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 68520 664023 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-28T21:04:40.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 35560 664033 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-28T21:04:40.697 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root DEL REG 0,18 122295 /[aio] 2023-11-28T21:04:40.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root DEL REG 0,18 124012 /[aio] 2023-11-28T21:04:40.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:40.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:40.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 64464 664010 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-28T21:04:40.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 31432 663959 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-28T21:04:40.698 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.699 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.700 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.701 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.702 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.703 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:40.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:40.704 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-28T21:04:40.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-28T21:04:40.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 0,14 122987 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:40.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 1w FIFO 0,13 0t0 122232 pipe 2023-11-28T21:04:40.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 2w FIFO 0,13 0t0 122233 pipe 2023-11-28T21:04:40.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 3r FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.705 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 4w FIFO 0,13 0t0 123940 pipe 2023-11-28T21:04:40.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 6r FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 7w FIFO 0,13 0t0 123941 pipe 2023-11-28T21:04:40.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 9r FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 10w FIFO 0,13 0t0 123942 pipe 2023-11-28T21:04:40.706 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 12r FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 13w FIFO 0,13 0t0 123943 pipe 2023-11-28T21:04:40.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 14w REG 8,1 2128022457 664528 /var/log/ceph/ceph-osd.3.log 2023-11-28T21:04:40.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 15uW REG 0,23 6 3527 /run/ceph/ceph-osd.3.pid 2023-11-28T21:04:40.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 16r FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 17w FIFO 0,13 0t0 123944 pipe 2023-11-28T21:04:40.707 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 18u unix 0xffff98ee7e526900 0t0 123945 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-28T21:04:40.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 19u IPv4 125154 0t0 TCP *:6824 (LISTEN) 2023-11-28T21:04:40.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 20u IPv4 125180 0t0 TCP *:6825 (LISTEN) 2023-11-28T21:04:40.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 21u IPv4 125207 0t0 TCP *:6826 (LISTEN) 2023-11-28T21:04:40.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 22u IPv4 125235 0t0 TCP *:6827 (LISTEN) 2023-11-28T21:04:40.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 23u IPv4 125264 0t0 TCP *:6828 (LISTEN) 2023-11-28T21:04:40.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 24u IPv4 125294 0t0 TCP *:6829 (LISTEN) 2023-11-28T21:04:40.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 25u IPv4 126099 0t0 TCP *:6830 (LISTEN) 2023-11-28T21:04:40.708 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 26u IPv4 126131 0t0 TCP *:6831 (LISTEN) 2023-11-28T21:04:40.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 27r FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 28w FIFO 0,13 0t0 123987 pipe 2023-11-28T21:04:40.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 29r FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 30w FIFO 0,13 0t0 123988 pipe 2023-11-28T21:04:40.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 31u sock 0,8 0t0 122983 protocol: UDPv6 2023-11-28T21:04:40.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 32r DIR 252,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-28T21:04:40.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 33uW REG 252,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-28T21:04:40.709 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 34u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 35u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 36u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 37u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 38u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 39u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 40u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.710 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 41u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 42u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 43u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 44u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 45u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 46u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 47u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 48u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.711 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 49u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 50u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 51u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 52u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 53u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 54u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 55u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 56u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.712 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 57u REG 252,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-28T21:04:40.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 58u a_inode 0,14 0 122987 [io_uring] 2023-11-28T21:04:40.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 59r FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 60u IPv4 180515 0t0 TCP smithi167.front.sepia.ceph.com:39956->smithi167.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 61w FIFO 0,13 0t0 122306 pipe 2023-11-28T21:04:40.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 62r FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 63w FIFO 0,13 0t0 122307 pipe 2023-11-28T21:04:40.713 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 64u IPv4 180325 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:45396 (ESTABLISHED) 2023-11-28T21:04:40.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 65u IPv4 180328 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54006 (ESTABLISHED) 2023-11-28T21:04:40.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 66u IPv4 192529 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:58122 (ESTABLISHED) 2023-11-28T21:04:40.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 67u IPv4 187315 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi167.front.sepia.ceph.com:44736 (ESTABLISHED) 2023-11-28T21:04:40.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 68u IPv4 182038 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:58078 (ESTABLISHED) 2023-11-28T21:04:40.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 69u IPv4 182041 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:60756 (ESTABLISHED) 2023-11-28T21:04:40.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 70u IPv4 160546 0t0 TCP smithi167.front.sepia.ceph.com:53434->smithi178.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 71u IPv4 188837 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:47834 (ESTABLISHED) 2023-11-28T21:04:40.714 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 72u IPv4 182579 0t0 TCP smithi167.front.sepia.ceph.com:49972->smithi178.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 73u IPv4 182247 0t0 TCP smithi167.front.sepia.ceph.com:48236->smithi178.front.sepia.ceph.com:6829 (ESTABLISHED) 2023-11-28T21:04:40.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 74u IPv4 159661 0t0 TCP smithi167.front.sepia.ceph.com:40272->smithi178.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 75u IPv4 172173 0t0 TCP smithi167.front.sepia.ceph.com:49116->smithi167.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-28T21:04:40.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 76u IPv4 186313 0t0 TCP smithi167.front.sepia.ceph.com:56552->smithi178.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-28T21:04:40.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 77u IPv4 189815 0t0 TCP smithi167.front.sepia.ceph.com:34170->smithi167.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-28T21:04:40.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 78u IPv4 185939 0t0 TCP smithi167.front.sepia.ceph.com:40190->smithi178.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-28T21:04:40.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 79u IPv4 185940 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:36096 (ESTABLISHED) 2023-11-28T21:04:40.715 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 80u IPv4 181836 0t0 TCP smithi167.front.sepia.ceph.com:33230->smithi178.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-28T21:04:40.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 81u IPv4 185298 0t0 TCP smithi167.front.sepia.ceph.com:43968->smithi178.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-28T21:04:40.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 82u IPv4 174503 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:51194 (ESTABLISHED) 2023-11-28T21:04:40.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 83u IPv4 185221 0t0 TCP smithi167.front.sepia.ceph.com:36744->smithi167.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-28T21:04:40.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 84u IPv4 189641 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:47236 (ESTABLISHED) 2023-11-28T21:04:40.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 85u IPv4 155506 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:46976 (ESTABLISHED) 2023-11-28T21:04:40.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 86u IPv4 155509 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:54522 (ESTABLISHED) 2023-11-28T21:04:40.716 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 87u IPv4 183973 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi167.front.sepia.ceph.com:55996 (ESTABLISHED) 2023-11-28T21:04:40.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 88u IPv4 183976 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:54000 (ESTABLISHED) 2023-11-28T21:04:40.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 89u IPv4 169859 0t0 TCP smithi167.front.sepia.ceph.com:37470->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 90u IPv4 175782 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:59832 (ESTABLISHED) 2023-11-28T21:04:40.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 91u IPv4 175785 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi178.front.sepia.ceph.com:60350 (ESTABLISHED) 2023-11-28T21:04:40.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 92u IPv4 189028 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:38032 (ESTABLISHED) 2023-11-28T21:04:40.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 93u IPv4 189644 0t0 TCP smithi167.front.sepia.ceph.com:6830->smithi178.front.sepia.ceph.com:49494 (ESTABLISHED) 2023-11-28T21:04:40.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 94u IPv4 188817 0t0 TCP smithi167.front.sepia.ceph.com:58870->smithi167.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-28T21:04:40.717 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 96u IPv4 179067 0t0 TCP smithi167.front.sepia.ceph.com:44164->smithi167.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-28T21:04:40.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 97u IPv4 185691 0t0 TCP smithi167.front.sepia.ceph.com:6824->smithi178.front.sepia.ceph.com:37760 (ESTABLISHED) 2023-11-28T21:04:40.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 98u IPv4 192532 0t0 TCP smithi167.front.sepia.ceph.com:6828->smithi167.front.sepia.ceph.com:46700 (ESTABLISHED) 2023-11-28T21:04:40.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 99u IPv4 188833 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:56772 (ESTABLISHED) 2023-11-28T21:04:40.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 100u IPv4 188747 0t0 TCP smithi167.front.sepia.ceph.com:6826->smithi178.front.sepia.ceph.com:52860 (ESTABLISHED) 2023-11-28T21:04:40.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 101u IPv4 187056 0t0 TCP smithi167.front.sepia.ceph.com:38394->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 102u IPv4 180179 0t0 TCP smithi167.front.sepia.ceph.com:60370->smithi167.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-28T21:04:40.718 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-osd 38346 41652 osd_srv_h root 103u IPv4 170543 0t0 TCP smithi167.front.sepia.ceph.com:51268->smithi167.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-28T21:04:40.718 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 41986 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:40.719 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 41986 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.719 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 41986 root txt unknown /proc/41986/exe 2023-11-28T21:04:40.719 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 42149 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:40.719 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 42149 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.719 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 42149 root txt unknown /proc/42149/exe 2023-11-28T21:04:40.719 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 42284 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:40.719 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 42284 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.719 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 42284 root txt unknown /proc/42284/exe 2023-11-28T21:04:40.720 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 42333 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:40.720 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 42333 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.720 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 42333 root txt unknown /proc/42333/exe 2023-11-28T21:04:40.720 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.720 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.720 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-28T21:04:40.720 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:40.721 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:40.721 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.721 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.721 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.721 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.721 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.721 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:40.721 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:40.722 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.722 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.722 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:40.722 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:40.722 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:40.722 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:40.722 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:40.722 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:40.723 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:40.723 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.723 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.723 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:40.723 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.723 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:40.723 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:40.723 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-28T21:04:40.724 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:40.724 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:40.724 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-28T21:04:40.724 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:40.724 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:40.724 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:40.724 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.725 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root 0r FIFO 0,13 0t0 119542 pipe 2023-11-28T21:04:40.725 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.725 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.725 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root 3r FIFO 0,13 0t0 122393 pipe 2023-11-28T21:04:40.725 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root 4w FIFO 0,13 0t0 122393 pipe 2023-11-28T21:04:40.725 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root 5r REG 8,1 1698 658047 /etc/sudoers 2023-11-28T21:04:40.725 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root 6u netlink 0t0 122402 AUDIT 2023-11-28T21:04:40.725 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43418 root 7u unix 0xffff98ee45159e00 0t0 122403 type=DGRAM 2023-11-28T21:04:40.726 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.726 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.726 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-28T21:04:40.726 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:40.726 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:40.726 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:40.726 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.726 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.727 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:40.728 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:40.728 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:40.728 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:40.728 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:40.728 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:40.728 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:40.728 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:40.729 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-28T21:04:40.729 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:40.729 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.729 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.729 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:40.729 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:40.729 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-28T21:04:40.729 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:40.729 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:40.730 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:40.730 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.730 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root 0r FIFO 0,13 0t0 119548 pipe 2023-11-28T21:04:40.730 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:40.730 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:40.730 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root 3r FIFO 0,13 0t0 125445 pipe 2023-11-28T21:04:40.730 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root 4w FIFO 0,13 0t0 125445 pipe 2023-11-28T21:04:40.731 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root 5r REG 8,1 1698 658047 /etc/sudoers 2023-11-28T21:04:40.731 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root 6u netlink 0t0 125454 AUDIT 2023-11-28T21:04:40.731 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 43420 root 7u unix 0xffff98ee4c1de180 0t0 125455 type=DGRAM 2023-11-28T21:04:40.731 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.731 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.731 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:40.731 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.731 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:40.732 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:40.732 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:40.732 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.732 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:40.732 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:40.732 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.732 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:40.732 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.733 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:40.733 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.733 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root 0r FIFO 0,13 0t0 119542 pipe 2023-11-28T21:04:40.733 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.733 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43421 root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.733 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.733 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.734 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:40.734 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.734 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:40.734 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:40.734 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.734 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:40.734 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:40.734 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:40.735 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.735 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:40.735 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.735 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:40.735 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.735 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root 0r FIFO 0,13 0t0 119548 pipe 2023-11-28T21:04:40.735 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:40.735 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 43425 root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:40.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.736 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.737 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.738 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.739 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.740 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.741 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.742 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.743 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 14w REG 8,1 623503 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.744 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.745 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.748 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.749 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.750 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.752 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.753 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.754 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.755 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.756 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43436 log root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.757 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.758 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.759 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.761 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.762 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.763 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.764 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.766 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.767 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.768 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.769 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43443 msgr-work root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.770 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.771 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.772 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.773 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.774 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.775 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.776 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.777 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.778 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.779 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.780 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43444 msgr-work root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.781 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.782 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.783 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.784 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.785 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.786 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.787 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.788 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.789 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.790 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.791 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43445 msgr-work root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.792 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.793 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.794 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.795 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.796 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.797 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.798 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.799 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.800 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.801 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43452 service root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.802 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.803 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.804 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.805 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.806 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.807 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.808 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.809 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.810 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.811 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.812 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43453 admin_soc root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.813 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.814 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.815 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.816 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.817 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.818 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.819 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.820 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.821 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.822 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.823 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43460 signal_ha root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.824 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.825 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.826 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.827 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.828 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.829 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.830 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.831 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.832 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.833 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43461 io_contex root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.834 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.835 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.836 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.837 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.838 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.839 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.840 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.841 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.842 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.843 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.844 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43462 io_contex root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.845 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.846 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.847 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.848 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.849 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.850 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.851 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.852 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.853 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.866 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.867 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.868 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43463 ms_dispat root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.869 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.870 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.871 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.872 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.873 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.874 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.875 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.876 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.877 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.878 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.879 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43464 ms_local root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.880 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.881 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.882 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.884 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.886 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.887 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.888 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.889 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.890 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43467 safe_time root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.891 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.892 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.893 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.894 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.895 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.896 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.897 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.898 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.899 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43476 safe_time root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.901 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.902 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.903 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.904 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.905 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.906 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.907 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.908 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.909 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.910 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.911 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43477 ceph-mds root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.912 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.913 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.914 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.915 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.916 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.917 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.918 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 1w FIFO 0,13 0t0 119543 pipe 2023-11-28T21:04:40.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 2w FIFO 0,13 0t0 119544 pipe 2023-11-28T21:04:40.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 3r FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 4w FIFO 0,13 0t0 119570 pipe 2023-11-28T21:04:40.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 6r FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.919 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 7w FIFO 0,13 0t0 119571 pipe 2023-11-28T21:04:40.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 9r FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 10w FIFO 0,13 0t0 119572 pipe 2023-11-28T21:04:40.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 12r FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 13w FIFO 0,13 0t0 119573 pipe 2023-11-28T21:04:40.920 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 14w REG 8,1 623032 664538 /var/log/ceph/ceph-mds.a.log 2023-11-28T21:04:40.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 15uW REG 0,23 6 3536 /run/ceph/ceph-mds.a.pid 2023-11-28T21:04:40.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 16r FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 17w FIFO 0,13 0t0 119585 pipe 2023-11-28T21:04:40.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 18u unix 0xffff98ee05ee0780 0t0 119586 /var/run/ceph/ceph-mds.a.asok type=STREAM 2023-11-28T21:04:40.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 19u IPv4 126322 0t0 TCP *:6833 (LISTEN) 2023-11-28T21:04:40.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 20u IPv4 127382 0t0 TCP *:6835 (LISTEN) 2023-11-28T21:04:40.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 21r FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.921 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 22w FIFO 0,13 0t0 124131 pipe 2023-11-28T21:04:40.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 23r FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 24w FIFO 0,13 0t0 124132 pipe 2023-11-28T21:04:40.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 25u IPv4 192597 0t0 TCP smithi167.front.sepia.ceph.com:49382->smithi167.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-28T21:04:40.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 26r FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 27w FIFO 0,13 0t0 127384 pipe 2023-11-28T21:04:40.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 28r FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 29w FIFO 0,13 0t0 127385 pipe 2023-11-28T21:04:40.922 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43431 43564 safe_time root 30u IPv4 172456 0t0 TCP smithi167.front.sepia.ceph.com:42314->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.923 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.924 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.925 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.926 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.927 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.928 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.929 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:40.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:40.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.930 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:40.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:40.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.931 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:40.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:40.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:40.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.932 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.933 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.935 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.936 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.937 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.938 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.939 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:40.940 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:40.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.941 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:40.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:40.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.942 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:40.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:40.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:40.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.943 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43434 log root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.944 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.945 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.946 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.947 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.948 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.949 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.950 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:40.951 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:40.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.952 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.953 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:40.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:40.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:40.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.954 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43438 msgr-work root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.955 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.956 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.957 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.958 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.959 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.960 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.961 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:40.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:40.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.962 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.963 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:40.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:40.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.965 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:40.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:40.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:40.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.966 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43439 msgr-work root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.967 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.968 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.969 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.970 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.971 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.972 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:40.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:40.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.974 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.975 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:40.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:40.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:40.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:40.976 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:40.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.977 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43440 msgr-work root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.978 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.980 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.981 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.982 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.983 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.984 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:40.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:40.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.985 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.986 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:40.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:40.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:40.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:40.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:40.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.987 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43450 service root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:40.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:40.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:40.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:40.989 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:40.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:40.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:40.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:40.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:40.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:40.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:40.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:40.990 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:40.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:40.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:40.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:40.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:40.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:40.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:40.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:40.991 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:40.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:40.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:40.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:40.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:40.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:40.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:40.992 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:40.993 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:40.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:40.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:40.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:40.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:40.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:40.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:40.994 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:40.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:40.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:40.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:40.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:40.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:40.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:40.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:40.995 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:40.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:40.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:40.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:40.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.996 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:40.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:40.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:40.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:40.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:40.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:40.997 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:40.998 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:40.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:40.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43451 admin_soc root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:40.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:40.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:40.999 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:41.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.000 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.001 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.002 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.003 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.004 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.005 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:41.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:41.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:41.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.006 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.007 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:41.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:41.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:41.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:41.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:41.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.008 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.009 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43454 signal_ha root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:41.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.010 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.011 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.012 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.013 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.014 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.015 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:41.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:41.016 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:41.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.017 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:41.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:41.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.018 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:41.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:41.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:41.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.019 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43455 io_contex root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:41.020 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.021 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.022 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.023 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.024 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.025 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:41.026 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:41.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:41.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.027 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:41.028 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:41.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:41.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:41.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.029 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43456 io_contex root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.030 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:41.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.031 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.032 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.033 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.034 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.035 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.036 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:41.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:41.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:41.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.037 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.038 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:41.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:41.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:41.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:41.039 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:41.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.040 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43457 ms_dispat root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:41.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.041 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.042 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.043 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.044 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.045 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.046 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:41.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.047 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:41.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:41.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.048 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:41.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:41.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.049 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:41.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:41.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:41.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.050 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43458 ms_local root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.051 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:41.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.052 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.053 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.054 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.055 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.056 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.057 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:41.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:41.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:41.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.058 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.059 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:41.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:41.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:41.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:41.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:41.060 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.061 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43459 safe_time root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:41.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.062 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.063 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.064 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.065 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.066 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.067 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:41.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.069 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:41.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:41.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.070 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:41.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:41.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:41.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.071 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43465 safe_time root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:41.072 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.073 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.074 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.075 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.076 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.077 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.078 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.079 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:41.080 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:41.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:41.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:41.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:41.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.081 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.082 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43466 ceph-mds root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root txt REG 8,1 6279848 787342 /usr/bin/ceph-mds 2023-11-28T21:04:41.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.083 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.084 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.085 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.086 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.087 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.088 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-28T21:04:41.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 1w FIFO 0,13 0t0 119549 pipe 2023-11-28T21:04:41.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 2w FIFO 0,13 0t0 119550 pipe 2023-11-28T21:04:41.089 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 3r FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 4w FIFO 0,13 0t0 123063 pipe 2023-11-28T21:04:41.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 5u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 6r FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 7w FIFO 0,13 0t0 123064 pipe 2023-11-28T21:04:41.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 8u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 9r FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 10w FIFO 0,13 0t0 123065 pipe 2023-11-28T21:04:41.090 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 11u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 12r FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 13w FIFO 0,13 0t0 123066 pipe 2023-11-28T21:04:41.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 14w REG 8,1 573989 664537 /var/log/ceph/ceph-mds.e.log 2023-11-28T21:04:41.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 15uW REG 0,23 6 3534 /run/ceph/ceph-mds.e.pid 2023-11-28T21:04:41.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 16r FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 17w FIFO 0,13 0t0 125465 pipe 2023-11-28T21:04:41.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 18u unix 0xffff98ee4c1de900 0t0 125466 /var/run/ceph/ceph-mds.e.asok type=STREAM 2023-11-28T21:04:41.091 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 19u IPv4 122444 0t0 TCP *:6832 (LISTEN) 2023-11-28T21:04:41.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 20u IPv4 122482 0t0 TCP *:6834 (LISTEN) 2023-11-28T21:04:41.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 21r FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 22w FIFO 0,13 0t0 119587 pipe 2023-11-28T21:04:41.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 23r FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 24w FIFO 0,13 0t0 119588 pipe 2023-11-28T21:04:41.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 25u IPv4 183227 0t0 TCP smithi167.front.sepia.ceph.com:40976->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 26r FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.092 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 27w FIFO 0,13 0t0 119589 pipe 2023-11-28T21:04:41.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 28r FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 29w FIFO 0,13 0t0 119590 pipe 2023-11-28T21:04:41.093 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mds 43433 43478 safe_time root 31u IPv4 185119 0t0 TCP smithi167.front.sepia.ceph.com:38418->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.093 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 46233 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.093 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 46233 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.093 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 46233 root txt unknown /proc/46233/exe 2023-11-28T21:04:41.093 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 46240 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.093 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 46240 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.094 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 46240 root txt unknown /proc/46240/exe 2023-11-28T21:04:41.094 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 46241 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.094 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 46241 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.094 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/R 46241 root txt unknown /proc/46241/exe 2023-11-28T21:04:41.094 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 51834 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.094 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 51834 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.094 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/6 51834 root txt unknown /proc/51834/exe 2023-11-28T21:04:41.094 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 52023 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 52023 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 52023 root txt unknown /proc/52023/exe 2023-11-28T21:04:41.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 52896 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 52896 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/4 52896 root txt unknown /proc/52896/exe 2023-11-28T21:04:41.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 54348 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 54348 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.095 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/7 54348 root txt unknown /proc/54348/exe 2023-11-28T21:04:41.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 55643 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 55643 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 55643 root txt unknown /proc/55643/exe 2023-11-28T21:04:41.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 55646 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 55646 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/1 55646 root txt unknown /proc/55646/exe 2023-11-28T21:04:41.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 56379 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.096 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 56379 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/2 56379 root txt unknown /proc/56379/exe 2023-11-28T21:04:41.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 56944 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 56944 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/5 56944 root txt unknown /proc/56944/exe 2023-11-28T21:04:41.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 56949 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 56949 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 56949 root txt unknown /proc/56949/exe 2023-11-28T21:04:41.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 57335 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.097 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 57335 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.098 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 57335 root txt unknown /proc/57335/exe 2023-11-28T21:04:41.098 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 57340 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.098 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 57340 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.098 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/3 57340 root txt unknown /proc/57340/exe 2023-11-28T21:04:41.098 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 57888 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.098 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 57888 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.098 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/0 57888 root txt unknown /proc/57888/exe 2023-11-28T21:04:41.099 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.099 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.099 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-28T21:04:41.099 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:41.099 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:41.099 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.099 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.099 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.100 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.100 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:41.100 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:41.100 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:41.100 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:41.100 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:41.100 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:41.100 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.101 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.101 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:41.101 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.101 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.101 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:41.101 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:41.101 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:41.101 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:41.101 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:41.102 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.102 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:41.102 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-28T21:04:41.102 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:41.102 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:41.102 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-28T21:04:41.102 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:41.103 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:41.103 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:41.103 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.103 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root 0r FIFO 0,13 0t0 193565 pipe 2023-11-28T21:04:41.103 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.103 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.103 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root 3r FIFO 0,13 0t0 187247 pipe 2023-11-28T21:04:41.103 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root 4w FIFO 0,13 0t0 187247 pipe 2023-11-28T21:04:41.103 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root 5r REG 8,1 1698 658047 /etc/sudoers 2023-11-28T21:04:41.104 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root 6u netlink 0t0 187256 AUDIT 2023-11-28T21:04:41.104 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60022 root 7u unix 0xffff98ee4515d280 0t0 187257 type=DGRAM 2023-11-28T21:04:41.104 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.104 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.104 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-28T21:04:41.104 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.104 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:41.104 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-28T21:04:41.105 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:41.105 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.105 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-28T21:04:41.105 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:41.105 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.105 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-28T21:04:41.105 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.106 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:41.106 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.106 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root 0r FIFO 0,13 0t0 193565 pipe 2023-11-28T21:04:41.106 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.106 INFO:teuthology.orchestra.run.smithi167.stdout:daemon-he 60023 root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.106 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.107 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.108 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.109 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.110 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.111 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.112 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.113 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.114 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.115 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.116 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.117 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.118 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.119 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.120 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.121 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.122 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.123 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.124 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.125 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.126 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 5w REG 8,1 73728233 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.127 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.128 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 18w REG 252,4 425718 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.129 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.130 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.131 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.132 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60026 log root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.133 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.134 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.135 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.136 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.137 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.138 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.139 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 5w REG 8,1 73793255 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.140 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.141 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 18w REG 252,4 425718 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.142 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.143 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.144 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.145 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60027 service root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.146 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.147 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.148 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.149 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.150 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.151 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.152 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.153 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 5w REG 8,1 73796468 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.154 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.155 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.156 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.157 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.158 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60028 admin_soc root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.159 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.160 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.161 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.162 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.163 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.164 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.165 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.166 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.169 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 5w REG 8,1 73798113 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.170 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.171 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.172 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.173 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.174 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60029 signal_ha root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.175 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.176 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.177 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.178 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.179 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.180 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.181 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.182 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 5w REG 8,1 73804523 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.185 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.186 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.187 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60030 rocksdb:l root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.188 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.189 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.190 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.191 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.192 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.193 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.194 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.195 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.196 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 5w REG 8,1 73804523 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.197 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.198 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.199 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.200 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.201 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.202 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.203 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60031 rocksdb:h root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.204 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.205 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.206 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.207 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.208 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.209 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.210 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.211 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.212 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.213 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.214 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.215 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.216 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.217 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.218 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.219 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60047 ceph-mon root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.220 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.221 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.222 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.223 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.224 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.225 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.226 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.227 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.228 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.229 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.230 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.231 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.232 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.233 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.234 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.235 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60048 fn_monsto root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.236 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.237 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.238 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.239 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.240 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.241 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.243 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.244 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.245 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.246 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.247 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.248 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.249 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.250 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.251 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60049 msgr-work root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.252 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.253 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.254 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.255 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.256 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.257 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.258 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.259 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.260 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.261 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.262 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.263 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.264 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.265 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.266 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.267 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60050 msgr-work root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.268 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.269 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.270 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.272 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.273 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.274 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.275 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.276 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.277 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.278 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.279 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.280 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.281 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.282 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.283 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.284 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60051 msgr-work root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.285 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.286 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.287 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.289 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.290 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.291 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.292 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.293 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.294 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.295 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.296 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.297 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.298 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.299 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60052 OpHistory root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.300 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.301 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.302 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.303 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.304 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.305 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.306 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.307 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.308 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.310 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.311 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.312 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.313 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.314 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.315 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60053 fin root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.316 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.317 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.318 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.319 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.320 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.321 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.322 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.323 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.324 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.325 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.326 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.327 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.328 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.329 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.330 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.331 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60054 safe_time root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.332 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.333 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.334 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.335 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.336 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.337 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.338 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.339 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.340 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.341 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.342 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.343 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.344 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.345 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.346 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.347 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60055 cpu_tp root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.348 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.349 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.350 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.351 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.352 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.353 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.354 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.355 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.356 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.357 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.358 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.359 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.360 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.361 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.362 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.363 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60056 cpu_tp root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.364 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.365 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.366 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.367 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.368 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.369 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.370 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.371 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.372 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.373 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.374 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.375 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.378 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.379 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.380 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.381 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60057 cpu_tp root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.382 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.383 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.384 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.385 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.386 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.387 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.388 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.389 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.390 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.391 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.392 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.393 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.394 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60058 cpu_tp root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.395 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.396 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.397 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.398 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.399 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.400 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.401 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.402 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.403 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.404 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.405 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.406 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.407 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.408 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60059 ms_dispat root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.409 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.410 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.411 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.412 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.413 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.414 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.415 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.416 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.417 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.418 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.419 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.420 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.421 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60060 ms_local root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.422 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.424 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.425 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.426 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.427 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.428 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.429 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.430 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.431 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.432 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.433 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.434 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.435 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60061 safe_time root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.436 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.437 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.438 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.439 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.440 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.441 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.442 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.443 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.444 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.445 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.446 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.447 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.448 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60062 ms_dispat root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.449 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root txt REG 8,1 26420120 80329 /usr/bin/ceph-mon 2023-11-28T21:04:41.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 1372216 664004 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-28T21:04:41.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 335232 664000 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-28T21:04:41.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-28T21:04:41.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 51568 50444 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-28T21:04:41.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-28T21:04:41.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-28T21:04:41.450 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-28T21:04:41.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-28T21:04:41.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-28T21:04:41.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-28T21:04:41.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-28T21:04:41.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 4451632 795910 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-28T21:04:41.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.451 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-28T21:04:41.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-28T21:04:41.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-28T21:04:41.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-28T21:04:41.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-28T21:04:41.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-28T21:04:41.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.452 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 667864 795911 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-28T21:04:41.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-28T21:04:41.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-28T21:04:41.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-28T21:04:41.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-28T21:04:41.453 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-28T21:04:41.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-28T21:04:41.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-28T21:04:41.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-28T21:04:41.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 620728 50500 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-28T21:04:41.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-28T21:04:41.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-28T21:04:41.454 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-28T21:04:41.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-28T21:04:41.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-28T21:04:41.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-28T21:04:41.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-28T21:04:41.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 9486288 663276 /usr/lib/ceph/libceph-common.so.2 2023-11-28T21:04:41.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-28T21:04:41.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.455 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-28T21:04:41.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-28T21:04:41.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-28T21:04:41.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-28T21:04:41.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-28T21:04:41.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 0,14 191565 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-28T21:04:41.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.456 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2023-11-28T21:04:41.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 1w FIFO 0,13 0t0 193566 pipe 2023-11-28T21:04:41.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 2w FIFO 0,13 0t0 193567 pipe 2023-11-28T21:04:41.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 3r FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 4w FIFO 0,13 0t0 191559 pipe 2023-11-28T21:04:41.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 5w REG 8,1 73805708 664529 /var/log/ceph/ceph-mon.a.log 2023-11-28T21:04:41.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 6uW REG 0,23 6 3516 /run/ceph/ceph-mon.a.pid 2023-11-28T21:04:41.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 7r FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.457 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 8w FIFO 0,13 0t0 191560 pipe 2023-11-28T21:04:41.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 9u unix 0xffff98ee4c1db480 0t0 191561 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-28T21:04:41.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 10r FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 11w FIFO 0,13 0t0 191563 pipe 2023-11-28T21:04:41.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 12u a_inode 0,14 0 191565 [io_uring] 2023-11-28T21:04:41.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 13r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 14uW REG 252,4 0 50331783 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-28T21:04:41.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 15r DIR 252,4 4096 50331782 /var/lib/ceph/mon/ceph-a/store.db 2023-11-28T21:04:41.458 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 16r REG 252,4 4244794 50331791 /var/lib/ceph/mon/ceph-a/store.db/000074.sst 2023-11-28T21:04:41.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 17r REG 252,4 172590 50331785 /var/lib/ceph/mon/ceph-a/store.db/000077.sst 2023-11-28T21:04:41.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 18w REG 252,4 428737 50331787 /var/lib/ceph/mon/ceph-a/store.db/000078.log 2023-11-28T21:04:41.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 19w REG 252,4 287 50331788 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000079 2023-11-28T21:04:41.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 20u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 21r FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 22w FIFO 0,13 0t0 191571 pipe 2023-11-28T21:04:41.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 23u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.459 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 24r FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 25w FIFO 0,13 0t0 191572 pipe 2023-11-28T21:04:41.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 26u a_inode 0,14 0 42 [eventpoll] 2023-11-28T21:04:41.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 27r FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 28w FIFO 0,13 0t0 191573 pipe 2023-11-28T21:04:41.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 29u IPv4 187261 0t0 TCP smithi167.front.sepia.ceph.com:3300 (LISTEN) 2023-11-28T21:04:41.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 30u IPv4 187262 0t0 TCP smithi167.front.sepia.ceph.com:6789 (LISTEN) 2023-11-28T21:04:41.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 31u IPv4 187263 0t0 TCP smithi167.front.sepia.ceph.com:57468->smithi178.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-28T21:04:41.460 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 32u IPv4 188930 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49382 (ESTABLISHED) 2023-11-28T21:04:41.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 33u IPv4 188844 0t0 TCP smithi167.front.sepia.ceph.com:38372->smithi178.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-28T21:04:41.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 34r FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 35w FIFO 0,13 0t0 190029 pipe 2023-11-28T21:04:41.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 36r FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 37w FIFO 0,13 0t0 190030 pipe 2023-11-28T21:04:41.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 38r FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 39w FIFO 0,13 0t0 190031 pipe 2023-11-28T21:04:41.461 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 40w REG 8,1 130459 664532 /var/log/ceph/ceph.audit.log 2023-11-28T21:04:41.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 41w REG 8,1 303463 664530 /var/log/ceph/ceph.log 2023-11-28T21:04:41.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 42u IPv4 188931 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49398 (ESTABLISHED) 2023-11-28T21:04:41.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 43u IPv4 188932 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi167.front.sepia.ceph.com:49400 (ESTABLISHED) 2023-11-28T21:04:41.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 44u IPv4 188934 0t0 TCP smithi167.front.sepia.ceph.com:6789->192.168.0.1:52808 (ESTABLISHED) 2023-11-28T21:04:41.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 45u IPv4 188936 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54044 (ESTABLISHED) 2023-11-28T21:04:41.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 46u IPv4 188939 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54056 (ESTABLISHED) 2023-11-28T21:04:41.462 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 47u IPv4 188940 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54064 (ESTABLISHED) 2023-11-28T21:04:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 48u IPv4 188941 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54072 (ESTABLISHED) 2023-11-28T21:04:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-mon 60025 60063 ms_local root 49u IPv4 188944 0t0 TCP smithi167.front.sepia.ceph.com:3300->smithi178.front.sepia.ceph.com:54080 (ESTABLISHED) 2023-11-28T21:04:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu txt REG 8,1 1396520 886 /usr/bin/bash 2023-11-28T21:04:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.463 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-28T21:04:41.464 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu mem REG 8,1 200136 8423 /usr/lib/x86_64-linux-gnu/libtinfo.so.6.3 2023-11-28T21:04:41.464 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-28T21:04:41.464 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.464 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu 0r FIFO 0,13 0t0 187971 pipe 2023-11-28T21:04:41.464 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu 1w FIFO 0,13 0t0 187972 pipe 2023-11-28T21:04:41.464 INFO:teuthology.orchestra.run.smithi167.stdout:bash 60515 ubuntu 2w FIFO 0,13 0t0 187973 pipe 2023-11-28T21:04:41.464 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.464 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.465 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-28T21:04:41.465 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-28T21:04:41.465 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-28T21:04:41.465 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-28T21:04:41.465 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-28T21:04:41.465 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.465 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.465 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.466 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.466 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-28T21:04:41.466 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-28T21:04:41.466 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.466 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:41.466 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:41.466 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-28T21:04:41.466 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.467 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.467 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.467 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-28T21:04:41.467 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-28T21:04:41.467 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-28T21:04:41.467 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-28T21:04:41.467 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-28T21:04:41.467 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-28T21:04:41.468 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-28T21:04:41.468 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-28T21:04:41.468 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:41.468 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-28T21:04:41.468 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-28T21:04:41.468 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:41.468 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-28T21:04:41.468 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-28T21:04:41.469 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.469 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root 0r FIFO 0,13 0t0 187971 pipe 2023-11-28T21:04:41.469 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root 1w FIFO 0,13 0t0 187972 pipe 2023-11-28T21:04:41.469 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root 2w FIFO 0,13 0t0 187973 pipe 2023-11-28T21:04:41.469 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root 3r FIFO 0,13 0t0 187991 pipe 2023-11-28T21:04:41.469 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root 4w FIFO 0,13 0t0 187991 pipe 2023-11-28T21:04:41.469 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root 5r REG 8,1 1698 658047 /etc/sudoers 2023-11-28T21:04:41.469 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root 6u netlink 0t0 188000 AUDIT 2023-11-28T21:04:41.470 INFO:teuthology.orchestra.run.smithi167.stdout:sudo 60516 root 7u unix 0xffff98ee61067800 0t0 188001 type=DGRAM 2023-11-28T21:04:41.470 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.470 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.470 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root txt REG 8,1 167544 14991 /usr/bin/lsof 2023-11-28T21:04:41.470 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:41.470 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.470 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.470 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.471 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.471 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.471 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.471 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:41.471 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.471 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.471 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:41.471 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:41.472 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.472 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root 0r FIFO 0,13 0t0 187971 pipe 2023-11-28T21:04:41.472 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root 1w FIFO 0,13 0t0 187972 pipe 2023-11-28T21:04:41.472 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root 2w FIFO 0,13 0t0 187973 pipe 2023-11-28T21:04:41.472 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root 3r DIR 0,21 0 1 /proc 2023-11-28T21:04:41.472 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root 4r DIR 0,21 7 189065 /proc/60520/fd 2023-11-28T21:04:41.472 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root 5w FIFO 0,13 0t0 189070 pipe 2023-11-28T21:04:41.472 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60520 root 6r FIFO 0,13 0t0 189071 pipe 2023-11-28T21:04:41.473 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 60543 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.473 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 60543 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.473 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 60543 root txt unknown /proc/60543/exe 2023-11-28T21:04:41.473 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 60544 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.473 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 60544 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.473 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 60544 root txt unknown /proc/60544/exe 2023-11-28T21:04:41.473 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 60545 root cwd DIR 8,1 4096 2 / 2023-11-28T21:04:41.473 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 60545 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.474 INFO:teuthology.orchestra.run.smithi167.stdout:kworker/u 60545 root txt unknown /proc/60545/exe 2023-11-28T21:04:41.474 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-28T21:04:41.474 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root rtd DIR 8,1 4096 2 / 2023-11-28T21:04:41.474 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root txt REG 8,1 167544 14991 /usr/bin/lsof 2023-11-28T21:04:41.474 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-28T21:04:41.474 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-28T21:04:41.474 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-28T21:04:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-28T21:04:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-28T21:04:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-28T21:04:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-28T21:04:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-28T21:04:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-28T21:04:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-28T21:04:41.475 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-28T21:04:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-28T21:04:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-28T21:04:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root 4r FIFO 0,13 0t0 189070 pipe 2023-11-28T21:04:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:lsof 60548 root 7w FIFO 0,13 0t0 189071 pipe 2023-11-28T21:04:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-11-28T21:04:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:root 2 0.0 0.0 0 0 ? S 20:24 0:00 [kthreadd] 2023-11-28T21:04:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:root 3 0.0 0.0 0 0 ? S 20:24 0:00 \_ [pool_workqueue_release] 2023-11-28T21:04:41.476 INFO:teuthology.orchestra.run.smithi167.stdout:root 4 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-rcu_g] 2023-11-28T21:04:41.477 INFO:teuthology.orchestra.run.smithi167.stdout:root 5 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-rcu_p] 2023-11-28T21:04:41.477 INFO:teuthology.orchestra.run.smithi167.stdout:root 6 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-slub_] 2023-11-28T21:04:41.477 INFO:teuthology.orchestra.run.smithi167.stdout:root 7 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-netns] 2023-11-28T21:04:41.477 INFO:teuthology.orchestra.run.smithi167.stdout:root 10 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/0:0H-events_highpri] 2023-11-28T21:04:41.477 INFO:teuthology.orchestra.run.smithi167.stdout:root 12 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-mm_pe] 2023-11-28T21:04:41.477 INFO:teuthology.orchestra.run.smithi167.stdout:root 13 0.0 0.0 0 0 ? I 20:24 0:00 \_ [rcu_tasks_kthread] 2023-11-28T21:04:41.477 INFO:teuthology.orchestra.run.smithi167.stdout:root 14 0.0 0.0 0 0 ? I 20:24 0:00 \_ [rcu_tasks_rude_kthread] 2023-11-28T21:04:41.477 INFO:teuthology.orchestra.run.smithi167.stdout:root 15 0.0 0.0 0 0 ? I 20:24 0:00 \_ [rcu_tasks_trace_kthread] 2023-11-28T21:04:41.478 INFO:teuthology.orchestra.run.smithi167.stdout:root 16 0.0 0.0 0 0 ? S 20:24 0:00 \_ [ksoftirqd/0] 2023-11-28T21:04:41.478 INFO:teuthology.orchestra.run.smithi167.stdout:root 17 0.0 0.0 0 0 ? I 20:24 0:01 \_ [rcu_preempt] 2023-11-28T21:04:41.478 INFO:teuthology.orchestra.run.smithi167.stdout:root 18 0.0 0.0 0 0 ? S 20:24 0:00 \_ [migration/0] 2023-11-28T21:04:41.478 INFO:teuthology.orchestra.run.smithi167.stdout:root 19 0.0 0.0 0 0 ? S 20:24 0:00 \_ [idle_inject/0] 2023-11-28T21:04:41.478 INFO:teuthology.orchestra.run.smithi167.stdout:root 20 0.0 0.0 0 0 ? S 20:24 0:00 \_ [cpuhp/0] 2023-11-28T21:04:41.478 INFO:teuthology.orchestra.run.smithi167.stdout:root 21 0.0 0.0 0 0 ? S 20:24 0:00 \_ [cpuhp/1] 2023-11-28T21:04:41.478 INFO:teuthology.orchestra.run.smithi167.stdout:root 22 0.0 0.0 0 0 ? S 20:24 0:00 \_ [idle_inject/1] 2023-11-28T21:04:41.478 INFO:teuthology.orchestra.run.smithi167.stdout:root 23 0.0 0.0 0 0 ? S 20:24 0:00 \_ [migration/1] 2023-11-28T21:04:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:root 24 0.0 0.0 0 0 ? S 20:24 0:00 \_ [ksoftirqd/1] 2023-11-28T21:04:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:root 26 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/1:0H-events_highpri] 2023-11-28T21:04:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:root 27 0.0 0.0 0 0 ? S 20:24 0:00 \_ [cpuhp/2] 2023-11-28T21:04:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:root 28 0.0 0.0 0 0 ? S 20:24 0:00 \_ [idle_inject/2] 2023-11-28T21:04:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:root 29 0.0 0.0 0 0 ? S 20:24 0:00 \_ [migration/2] 2023-11-28T21:04:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:root 30 0.0 0.0 0 0 ? S 20:24 0:00 \_ [ksoftirqd/2] 2023-11-28T21:04:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:root 32 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/2:0H-events_highpri] 2023-11-28T21:04:41.479 INFO:teuthology.orchestra.run.smithi167.stdout:root 33 0.0 0.0 0 0 ? S 20:24 0:00 \_ [cpuhp/3] 2023-11-28T21:04:41.480 INFO:teuthology.orchestra.run.smithi167.stdout:root 34 0.0 0.0 0 0 ? S 20:24 0:00 \_ [idle_inject/3] 2023-11-28T21:04:41.480 INFO:teuthology.orchestra.run.smithi167.stdout:root 35 0.0 0.0 0 0 ? S 20:24 0:00 \_ [migration/3] 2023-11-28T21:04:41.480 INFO:teuthology.orchestra.run.smithi167.stdout:root 36 0.0 0.0 0 0 ? S 20:24 0:00 \_ [ksoftirqd/3] 2023-11-28T21:04:41.480 INFO:teuthology.orchestra.run.smithi167.stdout:root 38 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/3:0H-events_highpri] 2023-11-28T21:04:41.480 INFO:teuthology.orchestra.run.smithi167.stdout:root 39 0.0 0.0 0 0 ? S 20:24 0:00 \_ [cpuhp/4] 2023-11-28T21:04:41.480 INFO:teuthology.orchestra.run.smithi167.stdout:root 40 0.0 0.0 0 0 ? S 20:24 0:00 \_ [idle_inject/4] 2023-11-28T21:04:41.480 INFO:teuthology.orchestra.run.smithi167.stdout:root 41 0.0 0.0 0 0 ? S 20:24 0:00 \_ [migration/4] 2023-11-28T21:04:41.480 INFO:teuthology.orchestra.run.smithi167.stdout:root 42 0.0 0.0 0 0 ? S 20:24 0:00 \_ [ksoftirqd/4] 2023-11-28T21:04:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:root 44 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/4:0H-events_highpri] 2023-11-28T21:04:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:root 45 0.0 0.0 0 0 ? S 20:24 0:00 \_ [cpuhp/5] 2023-11-28T21:04:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:root 46 0.0 0.0 0 0 ? S 20:24 0:00 \_ [idle_inject/5] 2023-11-28T21:04:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:root 47 0.0 0.0 0 0 ? S 20:24 0:00 \_ [migration/5] 2023-11-28T21:04:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:root 48 0.0 0.0 0 0 ? S 20:24 0:00 \_ [ksoftirqd/5] 2023-11-28T21:04:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:root 50 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/5:0H-events_highpri] 2023-11-28T21:04:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:root 51 0.0 0.0 0 0 ? S 20:24 0:00 \_ [cpuhp/6] 2023-11-28T21:04:41.481 INFO:teuthology.orchestra.run.smithi167.stdout:root 52 0.0 0.0 0 0 ? S 20:24 0:00 \_ [idle_inject/6] 2023-11-28T21:04:41.482 INFO:teuthology.orchestra.run.smithi167.stdout:root 53 0.0 0.0 0 0 ? S 20:24 0:00 \_ [migration/6] 2023-11-28T21:04:41.482 INFO:teuthology.orchestra.run.smithi167.stdout:root 54 0.0 0.0 0 0 ? S 20:24 0:00 \_ [ksoftirqd/6] 2023-11-28T21:04:41.482 INFO:teuthology.orchestra.run.smithi167.stdout:root 56 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/6:0H-events_highpri] 2023-11-28T21:04:41.482 INFO:teuthology.orchestra.run.smithi167.stdout:root 57 0.0 0.0 0 0 ? S 20:24 0:00 \_ [cpuhp/7] 2023-11-28T21:04:41.482 INFO:teuthology.orchestra.run.smithi167.stdout:root 58 0.0 0.0 0 0 ? S 20:24 0:00 \_ [idle_inject/7] 2023-11-28T21:04:41.482 INFO:teuthology.orchestra.run.smithi167.stdout:root 59 0.0 0.0 0 0 ? S 20:24 0:00 \_ [migration/7] 2023-11-28T21:04:41.482 INFO:teuthology.orchestra.run.smithi167.stdout:root 60 0.0 0.0 0 0 ? S 20:24 0:00 \_ [ksoftirqd/7] 2023-11-28T21:04:41.482 INFO:teuthology.orchestra.run.smithi167.stdout:root 62 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/7:0H-events_highpri] 2023-11-28T21:04:41.483 INFO:teuthology.orchestra.run.smithi167.stdout:root 63 0.0 0.0 0 0 ? S 20:24 0:00 \_ [kdevtmpfs] 2023-11-28T21:04:41.483 INFO:teuthology.orchestra.run.smithi167.stdout:root 71 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-inet_] 2023-11-28T21:04:41.483 INFO:teuthology.orchestra.run.smithi167.stdout:root 72 0.0 0.0 0 0 ? S 20:24 0:00 \_ [kauditd] 2023-11-28T21:04:41.483 INFO:teuthology.orchestra.run.smithi167.stdout:root 73 0.0 0.0 0 0 ? S 20:24 0:00 \_ [khungtaskd] 2023-11-28T21:04:41.483 INFO:teuthology.orchestra.run.smithi167.stdout:root 75 0.0 0.0 0 0 ? S 20:24 0:00 \_ [oom_reaper] 2023-11-28T21:04:41.483 INFO:teuthology.orchestra.run.smithi167.stdout:root 77 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-write] 2023-11-28T21:04:41.483 INFO:teuthology.orchestra.run.smithi167.stdout:root 78 0.0 0.0 0 0 ? S 20:24 0:00 \_ [kcompactd0] 2023-11-28T21:04:41.483 INFO:teuthology.orchestra.run.smithi167.stdout:root 79 0.0 0.0 0 0 ? SN 20:24 0:00 \_ [ksmd] 2023-11-28T21:04:41.484 INFO:teuthology.orchestra.run.smithi167.stdout:root 80 0.0 0.0 0 0 ? SN 20:24 0:00 \_ [khugepaged] 2023-11-28T21:04:41.484 INFO:teuthology.orchestra.run.smithi167.stdout:root 81 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-kinte] 2023-11-28T21:04:41.484 INFO:teuthology.orchestra.run.smithi167.stdout:root 82 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-kbloc] 2023-11-28T21:04:41.484 INFO:teuthology.orchestra.run.smithi167.stdout:root 83 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-blkcg] 2023-11-28T21:04:41.484 INFO:teuthology.orchestra.run.smithi167.stdout:root 84 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-tpm_d] 2023-11-28T21:04:41.484 INFO:teuthology.orchestra.run.smithi167.stdout:root 85 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-ata_s] 2023-11-28T21:04:41.484 INFO:teuthology.orchestra.run.smithi167.stdout:root 86 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-md] 2023-11-28T21:04:41.484 INFO:teuthology.orchestra.run.smithi167.stdout:root 87 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-md_bi] 2023-11-28T21:04:41.485 INFO:teuthology.orchestra.run.smithi167.stdout:root 88 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-edac-] 2023-11-28T21:04:41.485 INFO:teuthology.orchestra.run.smithi167.stdout:root 89 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-devfr] 2023-11-28T21:04:41.485 INFO:teuthology.orchestra.run.smithi167.stdout:root 90 0.0 0.0 0 0 ? S 20:24 0:00 \_ [watchdogd] 2023-11-28T21:04:41.485 INFO:teuthology.orchestra.run.smithi167.stdout:root 91 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/0:1H-xfs-log/dm-4] 2023-11-28T21:04:41.485 INFO:teuthology.orchestra.run.smithi167.stdout:root 92 0.0 0.0 0 0 ? S 20:24 0:00 \_ [kswapd0] 2023-11-28T21:04:41.485 INFO:teuthology.orchestra.run.smithi167.stdout:root 93 0.0 0.0 0 0 ? S 20:24 0:00 \_ [ecryptfs-kthread] 2023-11-28T21:04:41.485 INFO:teuthology.orchestra.run.smithi167.stdout:root 94 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-kthro] 2023-11-28T21:04:41.486 INFO:teuthology.orchestra.run.smithi167.stdout:root 95 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-acpi_] 2023-11-28T21:04:41.486 INFO:teuthology.orchestra.run.smithi167.stdout:root 100 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-mld] 2023-11-28T21:04:41.486 INFO:teuthology.orchestra.run.smithi167.stdout:root 101 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-ipv6_] 2023-11-28T21:04:41.486 INFO:teuthology.orchestra.run.smithi167.stdout:root 105 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/u17:0] 2023-11-28T21:04:41.486 INFO:teuthology.orchestra.run.smithi167.stdout:root 127 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/7:1H-xfs-log/dm-1] 2023-11-28T21:04:41.486 INFO:teuthology.orchestra.run.smithi167.stdout:root 131 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/1:1H-kblockd] 2023-11-28T21:04:41.486 INFO:teuthology.orchestra.run.smithi167.stdout:root 144 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/5:1H-xfs-log/dm-4] 2023-11-28T21:04:41.486 INFO:teuthology.orchestra.run.smithi167.stdout:root 145 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/4:1H-xfs-log/dm-3] 2023-11-28T21:04:41.487 INFO:teuthology.orchestra.run.smithi167.stdout:root 146 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/3:1H-kblockd] 2023-11-28T21:04:41.487 INFO:teuthology.orchestra.run.smithi167.stdout:root 147 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/6:1H-kblockd] 2023-11-28T21:04:41.487 INFO:teuthology.orchestra.run.smithi167.stdout:root 150 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/2:1H-kblockd] 2023-11-28T21:04:41.487 INFO:teuthology.orchestra.run.smithi167.stdout:root 156 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-nvme-] 2023-11-28T21:04:41.487 INFO:teuthology.orchestra.run.smithi167.stdout:root 157 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-nvme-] 2023-11-28T21:04:41.487 INFO:teuthology.orchestra.run.smithi167.stdout:root 158 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-nvme-] 2023-11-28T21:04:41.487 INFO:teuthology.orchestra.run.smithi167.stdout:root 171 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_0] 2023-11-28T21:04:41.487 INFO:teuthology.orchestra.run.smithi167.stdout:root 172 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:root 173 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-ixgbe] 2023-11-28T21:04:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:root 174 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_1] 2023-11-28T21:04:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:root 175 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:root 176 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_2] 2023-11-28T21:04:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:root 177 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:root 179 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_3] 2023-11-28T21:04:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:root 180 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:root 203 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_4] 2023-11-28T21:04:41.488 INFO:teuthology.orchestra.run.smithi167.stdout:root 204 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.489 INFO:teuthology.orchestra.run.smithi167.stdout:root 205 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_5] 2023-11-28T21:04:41.489 INFO:teuthology.orchestra.run.smithi167.stdout:root 206 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.489 INFO:teuthology.orchestra.run.smithi167.stdout:root 207 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_6] 2023-11-28T21:04:41.489 INFO:teuthology.orchestra.run.smithi167.stdout:root 208 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.489 INFO:teuthology.orchestra.run.smithi167.stdout:root 209 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_7] 2023-11-28T21:04:41.489 INFO:teuthology.orchestra.run.smithi167.stdout:root 210 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.489 INFO:teuthology.orchestra.run.smithi167.stdout:root 211 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_8] 2023-11-28T21:04:41.489 INFO:teuthology.orchestra.run.smithi167.stdout:root 212 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.490 INFO:teuthology.orchestra.run.smithi167.stdout:root 213 0.0 0.0 0 0 ? S 20:24 0:00 \_ [scsi_eh_9] 2023-11-28T21:04:41.490 INFO:teuthology.orchestra.run.smithi167.stdout:root 214 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-scsi_] 2023-11-28T21:04:41.490 INFO:teuthology.orchestra.run.smithi167.stdout:root 250 0.0 0.0 0 0 ? S 20:24 0:01 \_ [jbd2/sda1-8] 2023-11-28T21:04:41.490 INFO:teuthology.orchestra.run.smithi167.stdout:root 251 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-ext4-] 2023-11-28T21:04:41.490 INFO:teuthology.orchestra.run.smithi167.stdout:root 295 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-rpcio] 2023-11-28T21:04:41.490 INFO:teuthology.orchestra.run.smithi167.stdout:root 296 0.0 0.0 0 0 ? I< 20:24 0:00 \_ [kworker/R-xprti] 2023-11-28T21:04:41.490 INFO:teuthology.orchestra.run.smithi167.stdout:root 324 0.0 0.0 0 0 ? S 20:25 0:00 \_ [ext4lazyinit] 2023-11-28T21:04:41.491 INFO:teuthology.orchestra.run.smithi167.stdout:root 326 0.0 0.0 0 0 ? I< 20:25 0:00 \_ [kworker/R-iscsi] 2023-11-28T21:04:41.491 INFO:teuthology.orchestra.run.smithi167.stdout:root 417 0.0 0.0 0 0 ? I< 20:25 0:00 \_ [kworker/R-ipmi-] 2023-11-28T21:04:41.491 INFO:teuthology.orchestra.run.smithi167.stdout:root 432 0.0 0.0 0 0 ? I< 20:25 0:00 \_ [kworker/R-crypt] 2023-11-28T21:04:41.491 INFO:teuthology.orchestra.run.smithi167.stdout:root 482 0.0 0.0 0 0 ? SN 20:25 0:00 \_ [kipmi0] 2023-11-28T21:04:41.491 INFO:teuthology.orchestra.run.smithi167.stdout:root 851 0.0 0.0 0 0 ? I 20:25 0:00 \_ [lockd] 2023-11-28T21:04:41.491 INFO:teuthology.orchestra.run.smithi167.stdout:root 963 0.0 0.0 0 0 ? I< 20:25 0:00 \_ [kworker/R-ib-co] 2023-11-28T21:04:41.491 INFO:teuthology.orchestra.run.smithi167.stdout:root 964 0.0 0.0 0 0 ? I< 20:25 0:00 \_ [kworker/R-ib-co] 2023-11-28T21:04:41.491 INFO:teuthology.orchestra.run.smithi167.stdout:root 965 0.0 0.0 0 0 ? I< 20:25 0:00 \_ [kworker/R-ib_mc] 2023-11-28T21:04:41.492 INFO:teuthology.orchestra.run.smithi167.stdout:root 966 0.0 0.0 0 0 ? I< 20:25 0:00 \_ [kworker/R-ib_nl] 2023-11-28T21:04:41.492 INFO:teuthology.orchestra.run.smithi167.stdout:root 969 0.0 0.0 0 0 ? I< 20:25 0:00 \_ [kworker/R-rdma_] 2023-11-28T21:04:41.492 INFO:teuthology.orchestra.run.smithi167.stdout:root 971 0.0 0.0 0 0 ? I 20:25 0:00 \_ [nfsd] 2023-11-28T21:04:41.492 INFO:teuthology.orchestra.run.smithi167.stdout:root 972 0.0 0.0 0 0 ? I 20:25 0:00 \_ [nfsd] 2023-11-28T21:04:41.492 INFO:teuthology.orchestra.run.smithi167.stdout:root 973 0.0 0.0 0 0 ? I 20:25 0:00 \_ [nfsd] 2023-11-28T21:04:41.492 INFO:teuthology.orchestra.run.smithi167.stdout:root 974 0.0 0.0 0 0 ? I 20:25 0:00 \_ [nfsd] 2023-11-28T21:04:41.492 INFO:teuthology.orchestra.run.smithi167.stdout:root 975 0.0 0.0 0 0 ? I 20:25 0:00 \_ [nfsd] 2023-11-28T21:04:41.492 INFO:teuthology.orchestra.run.smithi167.stdout:root 976 0.0 0.0 0 0 ? I 20:25 0:00 \_ [nfsd] 2023-11-28T21:04:41.493 INFO:teuthology.orchestra.run.smithi167.stdout:root 977 0.0 0.0 0 0 ? I 20:25 0:00 \_ [nfsd] 2023-11-28T21:04:41.493 INFO:teuthology.orchestra.run.smithi167.stdout:root 978 0.0 0.0 0 0 ? I 20:25 0:00 \_ [nfsd] 2023-11-28T21:04:41.493 INFO:teuthology.orchestra.run.smithi167.stdout:root 16998 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-kdmfl] 2023-11-28T21:04:41.493 INFO:teuthology.orchestra.run.smithi167.stdout:root 17030 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-kdmfl] 2023-11-28T21:04:41.493 INFO:teuthology.orchestra.run.smithi167.stdout:root 17062 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-kdmfl] 2023-11-28T21:04:41.493 INFO:teuthology.orchestra.run.smithi167.stdout:root 17094 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-kdmfl] 2023-11-28T21:04:41.493 INFO:teuthology.orchestra.run.smithi167.stdout:root 17126 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-kdmfl] 2023-11-28T21:04:41.493 INFO:teuthology.orchestra.run.smithi167.stdout:root 17320 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-xfsal] 2023-11-28T21:04:41.494 INFO:teuthology.orchestra.run.smithi167.stdout:root 17321 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-xfs_m] 2023-11-28T21:04:41.494 INFO:teuthology.orchestra.run.smithi167.stdout:root 17322 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.494 INFO:teuthology.orchestra.run.smithi167.stdout:root 17323 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.494 INFO:teuthology.orchestra.run.smithi167.stdout:root 17324 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-xfs-r] 2023-11-28T21:04:41.494 INFO:teuthology.orchestra.run.smithi167.stdout:root 17325 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.494 INFO:teuthology.orchestra.run.smithi167.stdout:root 17326 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-xfs-i] 2023-11-28T21:04:41.494 INFO:teuthology.orchestra.run.smithi167.stdout:root 17327 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-xfs-l] 2023-11-28T21:04:41.494 INFO:teuthology.orchestra.run.smithi167.stdout:root 17328 0.0 0.0 0 0 ? I< 20:30 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.495 INFO:teuthology.orchestra.run.smithi167.stdout:root 17329 0.0 0.0 0 0 ? S 20:30 0:00 \_ [xfsaild/dm-4] 2023-11-28T21:04:41.495 INFO:teuthology.orchestra.run.smithi167.stdout:root 33498 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.495 INFO:teuthology.orchestra.run.smithi167.stdout:root 33499 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.495 INFO:teuthology.orchestra.run.smithi167.stdout:root 33500 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-r] 2023-11-28T21:04:41.495 INFO:teuthology.orchestra.run.smithi167.stdout:root 33501 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.495 INFO:teuthology.orchestra.run.smithi167.stdout:root 33502 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-i] 2023-11-28T21:04:41.495 INFO:teuthology.orchestra.run.smithi167.stdout:root 33503 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-l] 2023-11-28T21:04:41.495 INFO:teuthology.orchestra.run.smithi167.stdout:root 33504 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.496 INFO:teuthology.orchestra.run.smithi167.stdout:root 33505 0.0 0.0 0 0 ? S 20:37 0:00 \_ [xfsaild/dm-0] 2023-11-28T21:04:41.496 INFO:teuthology.orchestra.run.smithi167.stdout:root 33516 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.496 INFO:teuthology.orchestra.run.smithi167.stdout:root 33517 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.496 INFO:teuthology.orchestra.run.smithi167.stdout:root 33518 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-r] 2023-11-28T21:04:41.496 INFO:teuthology.orchestra.run.smithi167.stdout:root 33519 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.496 INFO:teuthology.orchestra.run.smithi167.stdout:root 33520 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-i] 2023-11-28T21:04:41.496 INFO:teuthology.orchestra.run.smithi167.stdout:root 33521 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-l] 2023-11-28T21:04:41.496 INFO:teuthology.orchestra.run.smithi167.stdout:root 33522 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.497 INFO:teuthology.orchestra.run.smithi167.stdout:root 33523 0.0 0.0 0 0 ? S 20:37 0:00 \_ [xfsaild/dm-1] 2023-11-28T21:04:41.497 INFO:teuthology.orchestra.run.smithi167.stdout:root 33534 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.497 INFO:teuthology.orchestra.run.smithi167.stdout:root 33535 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.497 INFO:teuthology.orchestra.run.smithi167.stdout:root 33536 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-r] 2023-11-28T21:04:41.497 INFO:teuthology.orchestra.run.smithi167.stdout:root 33537 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.497 INFO:teuthology.orchestra.run.smithi167.stdout:root 33538 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-i] 2023-11-28T21:04:41.497 INFO:teuthology.orchestra.run.smithi167.stdout:root 33539 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-l] 2023-11-28T21:04:41.497 INFO:teuthology.orchestra.run.smithi167.stdout:root 33540 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.498 INFO:teuthology.orchestra.run.smithi167.stdout:root 33541 0.0 0.0 0 0 ? S 20:37 0:00 \_ [xfsaild/dm-2] 2023-11-28T21:04:41.498 INFO:teuthology.orchestra.run.smithi167.stdout:root 33552 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.498 INFO:teuthology.orchestra.run.smithi167.stdout:root 33553 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.498 INFO:teuthology.orchestra.run.smithi167.stdout:root 33554 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-r] 2023-11-28T21:04:41.498 INFO:teuthology.orchestra.run.smithi167.stdout:root 33555 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-b] 2023-11-28T21:04:41.498 INFO:teuthology.orchestra.run.smithi167.stdout:root 33556 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-i] 2023-11-28T21:04:41.498 INFO:teuthology.orchestra.run.smithi167.stdout:root 33557 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-l] 2023-11-28T21:04:41.499 INFO:teuthology.orchestra.run.smithi167.stdout:root 33558 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-xfs-c] 2023-11-28T21:04:41.499 INFO:teuthology.orchestra.run.smithi167.stdout:root 33559 0.0 0.0 0 0 ? S 20:37 0:00 \_ [xfsaild/dm-3] 2023-11-28T21:04:41.499 INFO:teuthology.orchestra.run.smithi167.stdout:root 33572 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-dio/d] 2023-11-28T21:04:41.499 INFO:teuthology.orchestra.run.smithi167.stdout:root 34702 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-dio/d] 2023-11-28T21:04:41.499 INFO:teuthology.orchestra.run.smithi167.stdout:root 35832 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-dio/d] 2023-11-28T21:04:41.499 INFO:teuthology.orchestra.run.smithi167.stdout:root 36962 0.0 0.0 0 0 ? I< 20:37 0:00 \_ [kworker/R-dio/d] 2023-11-28T21:04:41.499 INFO:teuthology.orchestra.run.smithi167.stdout:root 41986 0.0 0.0 0 0 ? I 20:38 0:01 \_ [kworker/2:10-mm_percpu_wq] 2023-11-28T21:04:41.499 INFO:teuthology.orchestra.run.smithi167.stdout:root 42149 0.0 0.0 0 0 ? I 20:38 0:01 \_ [kworker/4:83-mm_percpu_wq] 2023-11-28T21:04:41.500 INFO:teuthology.orchestra.run.smithi167.stdout:root 42284 0.1 0.0 0 0 ? I 20:38 0:01 \_ [kworker/1:86-mm_percpu_wq] 2023-11-28T21:04:41.500 INFO:teuthology.orchestra.run.smithi167.stdout:root 42333 0.0 0.0 0 0 ? I 20:38 0:00 \_ [kworker/6:39-events] 2023-11-28T21:04:41.500 INFO:teuthology.orchestra.run.smithi167.stdout:root 46233 0.0 0.0 0 0 ? I< 20:38 0:00 \_ [kworker/R-ceph-] 2023-11-28T21:04:41.500 INFO:teuthology.orchestra.run.smithi167.stdout:root 46240 0.0 0.0 0 0 ? I< 20:38 0:00 \_ [kworker/R-ceph-] 2023-11-28T21:04:41.500 INFO:teuthology.orchestra.run.smithi167.stdout:root 46241 0.0 0.0 0 0 ? I< 20:38 0:00 \_ [kworker/R-ceph-] 2023-11-28T21:04:41.500 INFO:teuthology.orchestra.run.smithi167.stdout:root 51834 0.0 0.0 0 0 ? I 20:45 0:00 \_ [kworker/6:1-dio/dm-0] 2023-11-28T21:04:41.500 INFO:teuthology.orchestra.run.smithi167.stdout:root 52023 0.2 0.0 0 0 ? I 20:46 0:02 \_ [kworker/7:0-ceph-msgr] 2023-11-28T21:04:41.500 INFO:teuthology.orchestra.run.smithi167.stdout:root 52896 0.0 0.0 0 0 ? I 20:47 0:00 \_ [kworker/4:1-dio/dm-3] 2023-11-28T21:04:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:root 54348 0.0 0.0 0 0 ? I 20:50 0:00 \_ [kworker/7:1-ceph-cap] 2023-11-28T21:04:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:root 55643 0.0 0.0 0 0 ? I 20:53 0:00 \_ [kworker/5:1-dio/dm-3] 2023-11-28T21:04:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:root 55646 0.0 0.0 0 0 ? I 20:53 0:00 \_ [kworker/1:2-dio/dm-0] 2023-11-28T21:04:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:root 56379 0.0 0.0 0 0 ? I 20:54 0:00 \_ [kworker/2:2-ceph-msgr] 2023-11-28T21:04:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:root 56944 0.0 0.0 0 0 ? I 20:55 0:00 \_ [kworker/5:4-xfs-conv/dm-4] 2023-11-28T21:04:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:root 56949 0.0 0.0 0 0 ? I 20:56 0:00 \_ [kworker/0:4-dio/dm-3] 2023-11-28T21:04:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:root 57335 0.0 0.0 0 0 ? I 20:57 0:00 \_ [kworker/3:14-ceph-msgr] 2023-11-28T21:04:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:root 57340 0.0 0.0 0 0 ? I 20:57 0:00 \_ [kworker/3:19-xfs-sync/dm-3] 2023-11-28T21:04:41.501 INFO:teuthology.orchestra.run.smithi167.stdout:root 57888 0.0 0.0 0 0 ? I 20:58 0:00 \_ [kworker/0:6-xfs-conv/dm-4] 2023-11-28T21:04:41.502 INFO:teuthology.orchestra.run.smithi167.stdout:root 60543 0.0 0.0 0 0 ? I 21:04 0:00 \_ [kworker/u16:25-flush-252:1] 2023-11-28T21:04:41.502 INFO:teuthology.orchestra.run.smithi167.stdout:root 60544 0.0 0.0 0 0 ? I 21:04 0:00 \_ [kworker/u16:26-events_power_efficient] 2023-11-28T21:04:41.502 INFO:teuthology.orchestra.run.smithi167.stdout:root 60545 0.0 0.0 0 0 ? I 21:04 0:00 \_ [kworker/u16:27-events_power_efficient] 2023-11-28T21:04:41.502 INFO:teuthology.orchestra.run.smithi167.stdout:root 60570 0.0 0.0 0 0 ? I 21:04 0:00 \_ [kworker/u16:28-writeback] 2023-11-28T21:04:41.502 INFO:teuthology.orchestra.run.smithi167.stdout:root 60623 0.0 0.0 0 0 ? I 21:04 0:00 \_ [kworker/u16:29] 2023-11-28T21:04:41.502 INFO:teuthology.orchestra.run.smithi167.stdout:root 1 0.5 0.0 167732 12788 ? Ss 20:24 0:13 /sbin/init 2023-11-28T21:04:41.502 INFO:teuthology.orchestra.run.smithi167.stdout:root 294 0.1 0.0 65356 25176 ? S sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-28T21:04:57.418 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2023-11-28T21:04:57.419 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2023-11-28T21:04:57.419 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T21:04:57.419 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T21:04:57.422 INFO:tasks.ceph.mon.b:Started 2023-11-28T21:04:57.422 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:04:57.423 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:04:57.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc841279640 1 Processor -- start 2023-11-28T21:04:57.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc841279640 1 -- start start 2023-11-28T21:04:57.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc841279640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 0x7fc83c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:57.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc841279640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c153ae0 0x7fc83c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:57.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc841279640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c15ac00 con 0x7fc83c0cfc40 2023-11-28T21:04:57.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc841279640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c0cbd60 con 0x7fc83c0cf860 2023-11-28T21:04:57.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc841279640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c159ff0 con 0x7fc83c153ae0 2023-11-28T21:04:57.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83affd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 0x7fc83c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:57.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83b7fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c153ae0 0x7fc83c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:57.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83a7fc640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fc83c0cfc40 0x7fc83c0ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.167:53522/0 (socket says 172.21.15.167:53522) 2023-11-28T21:04:57.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83a7fc640 1 -- 172.21.15.167:0/849030720 learned_addr learned my addr 172.21.15.167:0/849030720 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:04:57.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83affd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 0x7fc83c0cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:42154/0 (socket says 172.21.15.167:42154) 2023-11-28T21:04:57.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83affd640 1 -- 172.21.15.167:0/849030720 >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 msgr2=0x7fc83c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:04:57.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83affd640 1 -- 172.21.15.167:0/849030720 >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 msgr2=0x7fc83c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:04:57.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83affd640 1 --2- 172.21.15.167:0/849030720 >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 0x7fc83c0cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:04:57.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83affd640 1 --2- 172.21.15.167:0/849030720 >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 0x7fc83c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:57.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83b7fe640 1 -- 172.21.15.167:0/849030720 >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 msgr2=0x7fc83c0cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:04:57.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83b7fe640 1 --2- 172.21.15.167:0/849030720 >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 0x7fc83c0cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83b7fe640 1 -- 172.21.15.167:0/849030720 >> v1:172.21.15.178:6789/0 conn(0x7fc83c0cfc40 legacy=0x7fc83c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:57.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.541+0000 7fc83b7fe640 1 -- 172.21.15.167:0/849030720 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c15a2d0 con 0x7fc83c153ae0 2023-11-28T21:04:57.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc83b7fe640 1 --2- 172.21.15.167:0/849030720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c153ae0 0x7fc83c153f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc8340097c0 tx=0x7fc83401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4522df38d73f5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:57.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc839ffb640 1 -- 172.21.15.167:0/849030720 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340ab680 con 0x7fc83c153ae0 2023-11-28T21:04:57.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc839ffb640 1 -- 172.21.15.167:0/849030720 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8340ab7e0 con 0x7fc83c153ae0 2023-11-28T21:04:57.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc839ffb640 1 -- 172.21.15.167:0/849030720 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340abb70 con 0x7fc83c153ae0 2023-11-28T21:04:57.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc841279640 1 -- 172.21.15.167:0/849030720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c153ae0 msgr2=0x7fc83c153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:57.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc841279640 1 --2- 172.21.15.167:0/849030720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c153ae0 0x7fc83c153f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc8340097c0 tx=0x7fc83401c480 comp rx=0 tx=0).stop 2023-11-28T21:04:57.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc841279640 1 -- 172.21.15.167:0/849030720 shutdown_connections 2023-11-28T21:04:57.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc841279640 1 --2- 172.21.15.167:0/849030720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c153ae0 0x7fc83c153f50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc841279640 1 --2- 172.21.15.167:0/849030720 >> v2:172.21.15.178:3300/0 conn(0x7fc83c0cf860 0x7fc83c0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc841279640 1 -- 172.21.15.167:0/849030720 >> 172.21.15.167:0/849030720 conn(0x7fc83c06c1f0 msgr2=0x7fc83c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:57.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc841279640 1 -- 172.21.15.167:0/849030720 shutdown_connections 2023-11-28T21:04:57.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.545+0000 7fc841279640 1 -- 172.21.15.167:0/849030720 wait complete. 2023-11-28T21:04:57.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 Processor -- start 2023-11-28T21:04:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 -- start start 2023-11-28T21:04:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c0cf860 0x7fc83c13ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc83c0cfc40 0x7fc83c13db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83c153ae0 0x7fc83c13e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c159760 con 0x7fc83c0cfc40 2023-11-28T21:04:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0b5780 con 0x7fc83c153ae0 2023-11-28T21:04:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c159990 con 0x7fc83c0cf860 2023-11-28T21:04:57.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc83c0cfc40 0x7fc83c13db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83a7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc83c0cfc40 0x7fc83c13db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37346/0 (socket says 172.21.15.167:37346) 2023-11-28T21:04:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83a7fc640 1 -- 172.21.15.167:0/2636831605 learned_addr learned my addr 172.21.15.167:0/2636831605 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:04:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83affd640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c0cf860 0x7fc83c13ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83b7fe640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83c153ae0 0x7fc83c13e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83b7fe640 1 -- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83c153ae0 msgr2=0x7fc83c13e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T21:04:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83b7fe640 1 -- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83c153ae0 msgr2=0x7fc83c13e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:04:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83b7fe640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83c153ae0 0x7fc83c13e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:04:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83b7fe640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83c153ae0 0x7fc83c13e0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:04:57.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83a7fc640 1 -- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c0cf860 msgr2=0x7fc83c13ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83a7fc640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c0cf860 0x7fc83c13ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83a7fc640 1 -- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83c153ae0 msgr2=0x7fc83c13e0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T21:04:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83a7fc640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83c153ae0 0x7fc83c13e0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83a7fc640 1 -- 172.21.15.167:0/2636831605 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834009420 con 0x7fc83c0cfc40 2023-11-28T21:04:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc83a7fc640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc83c0cfc40 0x7fc83c13db80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c500 tx=0x7fc83000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc8237fe640 1 -- 172.21.15.167:0/2636831605 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830005cf0 con 0x7fc83c0cfc40 2023-11-28T21:04:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc8237fe640 1 -- 172.21.15.167:0/2636831605 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830005e50 con 0x7fc83c0cfc40 2023-11-28T21:04:57.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c0b3790 con 0x7fc83c0cfc40 2023-11-28T21:04:57.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc8237fe640 1 -- 172.21.15.167:0/2636831605 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300072f0 con 0x7fc83c0cfc40 2023-11-28T21:04:57.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c0b54a0 con 0x7fc83c0cfc40 2023-11-28T21:04:57.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c0b3cb0 con 0x7fc83c0cfc40 2023-11-28T21:04:57.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc8237fe640 1 -- 172.21.15.167:0/2636831605 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc830007450 con 0x7fc83c0cfc40 2023-11-28T21:04:57.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.549+0000 7fc8237fe640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc828066470 0x7fc828068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:04:57.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.553+0000 7fc8237fe640 1 -- 172.21.15.167:0/2636831605 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc830083780 con 0x7fc83c0cfc40 2023-11-28T21:04:57.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.553+0000 7fc83affd640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc828066470 0x7fc828068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:04:57.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.553+0000 7fc83affd640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc828066470 0x7fc828068930 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009610 tx=0x7fc82c009900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:04:57.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.557+0000 7fc8237fe640 1 -- 172.21.15.167:0/2636831605 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8300508b0 con 0x7fc83c0cfc40 2023-11-28T21:04:57.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.753+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc83c075c90 con 0x7fc83c0cfc40 2023-11-28T21:04:57.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.753+0000 7fc8237fe640 1 -- 172.21.15.167:0/2636831605 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fc830017620 con 0x7fc83c0cfc40 2023-11-28T21:04:57.756 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":200,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":26,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:04:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc828066470 msgr2=0x7fc828068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc828066470 0x7fc828068930 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009610 tx=0x7fc82c009900 comp rx=0 tx=0).stop 2023-11-28T21:04:57.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc83c0cfc40 msgr2=0x7fc83c13db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:04:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc83c0cfc40 0x7fc83c13db80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c500 tx=0x7fc83000c9c0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 shutdown_connections 2023-11-28T21:04:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc828066470 0x7fc828068930 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc83c153ae0 0x7fc83c13e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc83c0cfc40 0x7fc83c13db80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 --2- 172.21.15.167:0/2636831605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc83c0cf860 0x7fc83c13ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:04:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 >> 172.21.15.167:0/2636831605 conn(0x7fc83c06c1f0 msgr2=0x7fc83c0c4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:04:57.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 shutdown_connections 2023-11-28T21:04:57.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:04:57.757+0000 7fc841279640 1 -- 172.21.15.167:0/2636831605 wait complete. 2023-11-28T21:04:59.920 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:04:59.923 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:05:00.775 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:05:00.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd6e1f8640 1 Processor -- start 2023-11-28T21:05:00.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd6e1f8640 1 -- start start 2023-11-28T21:05:00.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd6e1f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbd680cfc40 0x7fbd680cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:00.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd6e1f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6815ac00 con 0x7fbd68153ae0 2023-11-28T21:05:00.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd6e1f8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd680cbd60 con 0x7fbd680cf860 2023-11-28T21:05:00.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd6e1f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd68159ff0 con 0x7fbd680cfc40 2023-11-28T21:05:00.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd67fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbd68153ae0 0x7fbd6815d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:59176/0 (socket says 172.21.15.167:59176) 2023-11-28T21:05:00.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd67fff640 1 -- 172.21.15.167:0/1428297569 learned_addr learned my addr 172.21.15.167:0/1428297569 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:00.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd66ffd640 1 --2- 172.21.15.167:0/1428297569 >> v2:172.21.15.178:3300/0 conn(0x7fbd680cfc40 0x7fbd680cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:00.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238674338 0 0) 0x7fbd6815ac00 con 0x7fbd68153ae0 2023-11-28T21:05:00.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd50003530 con 0x7fbd68153ae0 2023-11-28T21:05:00.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd66ffd640 1 -- 172.21.15.167:0/1428297569 >> v2:172.21.15.178:3300/0 conn(0x7fbd680cfc40 msgr2=0x7fbd680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:05:00.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd66ffd640 1 -- 172.21.15.167:0/1428297569 >> v2:172.21.15.178:3300/0 conn(0x7fbd680cfc40 msgr2=0x7fbd680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:00.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd66ffd640 1 --2- 172.21.15.167:0/1428297569 >> v2:172.21.15.178:3300/0 conn(0x7fbd680cfc40 0x7fbd680cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:00.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320803908 0 0) 0x7fbd50003530 con 0x7fbd68153ae0 2023-11-28T21:05:00.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 >> v2:172.21.15.178:3300/0 conn(0x7fbd680cfc40 msgr2=0x7fbd680cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:05:00.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd66ffd640 1 --2- 172.21.15.167:0/1428297569 >> v2:172.21.15.178:3300/0 conn(0x7fbd680cfc40 0x7fbd680cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:05:00.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 --2- 172.21.15.167:0/1428297569 >> v2:172.21.15.178:3300/0 conn(0x7fbd680cfc40 0x7fbd680cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:00.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 >> v1:172.21.15.178:6789/0 conn(0x7fbd680cf860 legacy=0x7fbd680ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:00.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6815a2d0 con 0x7fbd68153ae0 2023-11-28T21:05:00.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fbd60001a00 con 0x7fbd68153ae0 2023-11-28T21:05:00.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 >> v1:172.21.15.167:6789/0 conn(0x7fbd68153ae0 legacy=0x7fbd6815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:00.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd50003980 0x7fbd50003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:00.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd500047d0 0x7fbd50004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:00.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50005190 0x7fbd5000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:00.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd68159ff0 con 0x7fbd50003980 2023-11-28T21:05:00.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5000c0e0 con 0x7fbd50005190 2023-11-28T21:05:00.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5000c2a0 con 0x7fbd500047d0 2023-11-28T21:05:00.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd677fe640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd50003980 0x7fbd50003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:00.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd67fff640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50005190 0x7fbd5000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:00.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd66ffd640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd500047d0 0x7fbd50004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:00.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd677fe640 1 -- 172.21.15.167:0/1428297569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd500047d0 msgr2=0x7fbd50004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:00.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd677fe640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd500047d0 0x7fbd50004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:00.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd677fe640 1 -- 172.21.15.167:0/1428297569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50005190 msgr2=0x7fbd5000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:00.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd677fe640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50005190 0x7fbd5000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:00.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd677fe640 1 -- 172.21.15.167:0/1428297569 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50003530 con 0x7fbd50003980 2023-11-28T21:05:00.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.893+0000 7fbd67fff640 1 -- 172.21.15.167:0/1428297569 reap_dead start 2023-11-28T21:05:00.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd677fe640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd50003980 0x7fbd50003da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd58001780 tx=0x7fbd5801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc135fd1c7a4f6d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:00.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580052d0 con 0x7fbd50003980 2023-11-28T21:05:00.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd580a7050 con 0x7fbd50003980 2023-11-28T21:05:00.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd667fc640 1 -- 172.21.15.167:0/1428297569 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58003600 con 0x7fbd50003980 2023-11-28T21:05:00.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/1428297569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd50003980 msgr2=0x7fbd50003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:00.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd6e1f8640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd50003980 0x7fbd50003da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd58001780 tx=0x7fbd5801c3b0 comp rx=0 tx=0).stop 2023-11-28T21:05:00.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/1428297569 shutdown_connections 2023-11-28T21:05:00.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd6e1f8640 1 --2- 172.21.15.167:0/1428297569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd50003980 0x7fbd50003da0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:00.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/1428297569 >> 172.21.15.167:0/1428297569 conn(0x7fbd6806c1f0 msgr2=0x7fbd68071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:00.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/1428297569 shutdown_connections 2023-11-28T21:05:00.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.897+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/1428297569 wait complete. 2023-11-28T21:05:00.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 Processor -- start 2023-11-28T21:05:00.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 -- start start 2023-11-28T21:05:00.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50003980 0x7fbd68150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:00.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6814f4b0 0x7fbd681462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:00.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6814f8f0 0x7fbd681f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:00.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd681f2bf0 con 0x7fbd6814f4b0 2023-11-28T21:05:00.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd681ea140 con 0x7fbd50003980 2023-11-28T21:05:00.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd681e9600 con 0x7fbd6814f8f0 2023-11-28T21:05:00.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd66ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6814f4b0 0x7fbd681462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:00.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd66ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6814f4b0 0x7fbd681462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:37366/0 (socket says 172.21.15.167:37366) 2023-11-28T21:05:00.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd66ffd640 1 -- 172.21.15.167:0/2702768126 learned_addr learned my addr 172.21.15.167:0/2702768126 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:00.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd67fff640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6814f8f0 0x7fbd681f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:00.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd677fe640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50003980 0x7fbd68150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:00.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd66ffd640 1 -- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6814f8f0 msgr2=0x7fbd681f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:00.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd66ffd640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6814f8f0 0x7fbd681f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:00.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd66ffd640 1 -- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50003980 msgr2=0x7fbd68150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:00.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd66ffd640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50003980 0x7fbd68150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:00.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd66ffd640 1 -- 172.21.15.167:0/2702768126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd681e98a0 con 0x7fbd6814f4b0 2023-11-28T21:05:00.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd677fe640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50003980 0x7fbd68150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:00.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd66ffd640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6814f4b0 0x7fbd681462b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c010890 tx=0x7fbd5c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:00.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd4ffff640 1 -- 172.21.15.167:0/2702768126 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00eae0 con 0x7fbd6814f4b0 2023-11-28T21:05:00.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd4ffff640 1 -- 172.21.15.167:0/2702768126 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c00c050 con 0x7fbd6814f4b0 2023-11-28T21:05:00.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd681e9b80 con 0x7fbd6814f4b0 2023-11-28T21:05:00.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd4ffff640 1 -- 172.21.15.167:0/2702768126 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00ee80 con 0x7fbd6814f4b0 2023-11-28T21:05:00.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd681f6290 con 0x7fbd6814f4b0 2023-11-28T21:05:00.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd68075c90 con 0x7fbd6814f4b0 2023-11-28T21:05:00.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.901+0000 7fbd4ffff640 1 -- 172.21.15.167:0/2702768126 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd5c015470 con 0x7fbd6814f4b0 2023-11-28T21:05:00.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.905+0000 7fbd4ffff640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd54066470 0x7fbd54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:00.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.905+0000 7fbd4ffff640 1 -- 172.21.15.167:0/2702768126 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fbd5c0846b0 con 0x7fbd6814f4b0 2023-11-28T21:05:00.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.905+0000 7fbd677fe640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd54066470 0x7fbd54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:00.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.905+0000 7fbd677fe640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd54066470 0x7fbd54068930 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbd58001750 tx=0x7fbd580011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:00.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:00.909+0000 7fbd4ffff640 1 -- 172.21.15.167:0/2702768126 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd5c051740 con 0x7fbd6814f4b0 2023-11-28T21:05:01.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.101+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbd68067720 con 0x7fbd6814f4b0 2023-11-28T21:05:01.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd4ffff640 1 -- 172.21.15.167:0/2702768126 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fbd5c054d60 con 0x7fbd6814f4b0 2023-11-28T21:05:01.106 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":200,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":29,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:05:01.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd54066470 msgr2=0x7fbd54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:01.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd54066470 0x7fbd54068930 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbd58001750 tx=0x7fbd580011a0 comp rx=0 tx=0).stop 2023-11-28T21:05:01.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6814f4b0 msgr2=0x7fbd681462b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:01.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6814f4b0 0x7fbd681462b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c010890 tx=0x7fbd5c010d50 comp rx=0 tx=0).stop 2023-11-28T21:05:01.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 shutdown_connections 2023-11-28T21:05:01.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd54066470 0x7fbd54068930 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:01.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6814f8f0 0x7fbd681f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:01.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6814f4b0 0x7fbd681462b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:01.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 --2- 172.21.15.167:0/2702768126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd50003980 0x7fbd68150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:01.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 >> 172.21.15.167:0/2702768126 conn(0x7fbd6806c1f0 msgr2=0x7fbd680669f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:01.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 shutdown_connections 2023-11-28T21:05:01.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:01.105+0000 7fbd6e1f8640 1 -- 172.21.15.167:0/2702768126 wait complete. 2023-11-28T21:05:04.125 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:05:04.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceb5757640 1 Processor -- start 2023-11-28T21:05:04.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceb5757640 1 -- start start 2023-11-28T21:05:04.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceb5757640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:04.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceb5757640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:04.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceb5757640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb015ac00 con 0x7fceb0153ae0 2023-11-28T21:05:04.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceb5757640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00cbd60 con 0x7fceb00cf860 2023-11-28T21:05:04.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceb5757640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb0159ff0 con 0x7fceb00cfc40 2023-11-28T21:05:04.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceaeffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:04.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceaeffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53244/0 (socket says 172.21.15.167:53244) 2023-11-28T21:05:04.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 learned_addr learned my addr 172.21.15.167:0/3598023776 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:04.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 msgr2=0x7fceb00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:05:04.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 msgr2=0x7fceb00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:04.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:04.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:05:04.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:04.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 msgr2=0x7fceb00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:05:04.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 msgr2=0x7fceb00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:04.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:04.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.245+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:05:04.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:04.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 msgr2=0x7fceb00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:05:04.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 msgr2=0x7fceb00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:04.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:04.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:05:04.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:04.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 msgr2=0x7fceb00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:05:04.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 msgr2=0x7fceb00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:04.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:04.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.449+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:05:04.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:04.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 msgr2=0x7fceb00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:05:04.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 msgr2=0x7fceb00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:04.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:04.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:05:04.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:04.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 msgr2=0x7fceb00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:05:04.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 msgr2=0x7fceb00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:04.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:04.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:04.853+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:05:05.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:05.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 msgr2=0x7fceb00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:05:05.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 msgr2=0x7fceb00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:05.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:05.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:05:05.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:05.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 msgr2=0x7fceb00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:05:05.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 msgr2=0x7fceb00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:05.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:05.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:05.657+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:05:07.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceacff9640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 msgr2=0x7fceb00ca510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:05:07.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceacff9640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.178:3300/0 conn(0x7fceb00cfc40 0x7fceb00ca510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:07.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceacff9640 1 -- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 msgr2=0x7fceb00cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:05:07.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceacff9640 1 --2- 172.21.15.167:0/3598023776 >> v2:172.21.15.167:3300/0 conn(0x7fceb00cf860 0x7fceb00cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:07.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceacff9640 1 -- 172.21.15.167:0/3598023776 >> v1:172.21.15.178:6789/0 conn(0x7fceb0153ae0 legacy=0x7fceb015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:07.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceacff9640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:07.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceacff9640 1 -- 172.21.15.167:0/3598023776 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb015a2d0 con 0x7fce9c006160 2023-11-28T21:05:07.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceacff9640 1 -- 172.21.15.167:0/3598023776 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00cbd60 con 0x7fce9c0036a0 2023-11-28T21:05:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 msgr2=0x7fce9c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:05:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 msgr2=0x7fce9c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:07.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.245+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:05:07.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.449+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:07.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.449+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 msgr2=0x7fce9c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:05:07.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.449+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 msgr2=0x7fce9c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:07.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.449+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:07.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.449+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T21:05:07.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.853+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:07.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.853+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 msgr2=0x7fce9c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:05:07.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.853+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 msgr2=0x7fce9c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:07.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.853+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:07.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:07.853+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T21:05:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.657+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.657+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 msgr2=0x7fce9c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:05:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.657+0000 7fceaeffd640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 msgr2=0x7fce9c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:08.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.657+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:08.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.657+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T21:05:08.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206480886 0 0) 0x7fceb015a2d0 con 0x7fce9c006160 2023-11-28T21:05:08.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce98003530 con 0x7fce9c006160 2023-11-28T21:05:08.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2821520351 0 0) 0x7fce98003530 con 0x7fce9c006160 2023-11-28T21:05:08.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 msgr2=0x7fce9c005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:05:08.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9c0036a0 0x7fce9c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:08.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c00afb0 con 0x7fce9c006160 2023-11-28T21:05:08.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fcea400e510 con 0x7fce9c006160 2023-11-28T21:05:08.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 >> v1:172.21.15.167:6789/0 conn(0x7fce9c006160 legacy=0x7fce9c008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:08.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceaf7fe640 1 -- 172.21.15.167:0/3598023776 reap_dead start 2023-11-28T21:05:08.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce98003980 0x7fce98003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:08.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce980047d0 0x7fce98004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:08.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 0x7fce9800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:08.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00cbd60 con 0x7fce980047d0 2023-11-28T21:05:08.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9800c1b0 con 0x7fce98005260 2023-11-28T21:05:08.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9800c370 con 0x7fce98003980 2023-11-28T21:05:08.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce980047d0 0x7fce98004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:08.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceaeffd640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce98003980 0x7fce98003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:08.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceaf7fe640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 0x7fce9800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:08.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce98003980 msgr2=0x7fce98003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:08.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce98003980 0x7fce98003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:08.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 msgr2=0x7fce9800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:08.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 0x7fce9800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:08.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.797+0000 7fceae7fc640 1 -- 172.21.15.167:0/3598023776 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98003530 con 0x7fce980047d0 2023-11-28T21:05:08.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceae7fc640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce980047d0 0x7fce98004c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcea4014370 tx=0x7fcea401d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badafa9311887459 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:08.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40a7650 con 0x7fce980047d0 2023-11-28T21:05:08.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400c040 con 0x7fce980047d0 2023-11-28T21:05:08.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceadffb640 1 -- 172.21.15.167:0/3598023776 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40a7a10 con 0x7fce980047d0 2023-11-28T21:05:08.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 -- 172.21.15.167:0/3598023776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce980047d0 msgr2=0x7fce98004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:08.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce980047d0 0x7fce98004c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcea4014370 tx=0x7fcea401d8a0 comp rx=0 tx=0).stop 2023-11-28T21:05:08.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 -- 172.21.15.167:0/3598023776 shutdown_connections 2023-11-28T21:05:08.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 0x7fce9800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:08.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce980047d0 0x7fce98004c50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:08.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 --2- 172.21.15.167:0/3598023776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce98003980 0x7fce98003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:08.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 -- 172.21.15.167:0/3598023776 >> 172.21.15.167:0/3598023776 conn(0x7fceb006c1f0 msgr2=0x7fceb0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:08.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 -- 172.21.15.167:0/3598023776 shutdown_connections 2023-11-28T21:05:08.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 -- 172.21.15.167:0/3598023776 wait complete. 2023-11-28T21:05:08.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 Processor -- start 2023-11-28T21:05:08.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.801+0000 7fceb5757640 1 -- start start 2023-11-28T21:05:08.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceb5757640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce98003980 0x7fceb0158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:08.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceb5757640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce980047d0 0x7fceb0154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceb5757640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 0x7fceb01553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceb5757640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0156300 con 0x7fce98003980 2023-11-28T21:05:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceb5757640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb01f32e0 con 0x7fce98005260 2023-11-28T21:05:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceb5757640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb01f26f0 con 0x7fce980047d0 2023-11-28T21:05:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce98003980 0x7fceb0158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce98003980 0x7fceb0158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53296/0 (socket says 172.21.15.167:53296) 2023-11-28T21:05:08.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaeffd640 1 -- 172.21.15.167:0/1188526774 learned_addr learned my addr 172.21.15.167:0/1188526774 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceae7fc640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce980047d0 0x7fceb0154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaf7fe640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 0x7fceb01553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaeffd640 1 -- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce980047d0 msgr2=0x7fceb0154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaeffd640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce980047d0 0x7fceb0154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaeffd640 1 -- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 msgr2=0x7fceb01553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaeffd640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 0x7fceb01553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaeffd640 1 -- 172.21.15.167:0/1188526774 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00b5360 con 0x7fce98003980 2023-11-28T21:05:08.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceaeffd640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce98003980 0x7fceb0158c10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcea001ada0 tx=0x7fcea0019800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:08.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fce977fe640 1 -- 172.21.15.167:0/1188526774 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea001f070 con 0x7fce98003980 2023-11-28T21:05:08.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fce977fe640 1 -- 172.21.15.167:0/1188526774 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea000f040 con 0x7fce98003980 2023-11-28T21:05:08.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb01f29b0 con 0x7fce98003980 2023-11-28T21:05:08.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fce977fe640 1 -- 172.21.15.167:0/1188526774 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00185d0 con 0x7fce98003980 2023-11-28T21:05:08.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb01f2f70 con 0x7fce98003980 2023-11-28T21:05:08.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb0075c90 con 0x7fce98003980 2023-11-28T21:05:08.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fce977fe640 1 -- 172.21.15.167:0/1188526774 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcea0018730 con 0x7fce98003980 2023-11-28T21:05:08.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fce977fe640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce9c066cb0 0x7fce9c069170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:08.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.805+0000 7fce977fe640 1 -- 172.21.15.167:0/1188526774 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fcea0086000 con 0x7fce98003980 2023-11-28T21:05:08.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.809+0000 7fceae7fc640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce9c066cb0 0x7fce9c069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:08.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.809+0000 7fceae7fc640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce9c066cb0 0x7fce9c069170 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcea40b0000 tx=0x7fcea4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:08.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:08.813+0000 7fce977fe640 1 -- 172.21.15.167:0/1188526774 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcea0053090 con 0x7fce98003980 2023-11-28T21:05:09.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fceb0074f50 con 0x7fce98003980 2023-11-28T21:05:09.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fce977fe640 1 -- 172.21.15.167:0/1188526774 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1546 (secure 0 0 0) 0x7fcea00566b0 con 0x7fce98003980 2023-11-28T21:05:09.015 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":204,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:05:09.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce9c066cb0 msgr2=0x7fce9c069170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:09.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce9c066cb0 0x7fce9c069170 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcea40b0000 tx=0x7fcea4004740 comp rx=0 tx=0).stop 2023-11-28T21:05:09.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce98003980 msgr2=0x7fceb0158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:09.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce98003980 0x7fceb0158c10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcea001ada0 tx=0x7fcea0019800 comp rx=0 tx=0).stop 2023-11-28T21:05:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 shutdown_connections 2023-11-28T21:05:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fce9c066cb0 0x7fce9c069170 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce98005260 0x7fceb01553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce980047d0 0x7fceb0154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 --2- 172.21.15.167:0/1188526774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce98003980 0x7fceb0158c10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 >> 172.21.15.167:0/1188526774 conn(0x7fceb006c1f0 msgr2=0x7fceb00c4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 shutdown_connections 2023-11-28T21:05:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:09.013+0000 7fceb5757640 1 -- 172.21.15.167:0/1188526774 wait complete. 2023-11-28T21:05:12.034 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:05:12.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51e2fd640 1 Processor -- start 2023-11-28T21:05:12.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51e2fd640 1 -- start start 2023-11-28T21:05:12.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51e2fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5180cf860 0x7ff5180cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51e2fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51815ac00 con 0x7ff518153ae0 2023-11-28T21:05:12.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51e2fd640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5180cbd60 con 0x7ff5180cfc40 2023-11-28T21:05:12.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51e2fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff518159ff0 con 0x7ff5180cf860 2023-11-28T21:05:12.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51c89a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff518153ae0 0x7ff51815d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:49326/0 (socket says 172.21.15.167:49326) 2023-11-28T21:05:12.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51c89a640 1 -- 172.21.15.167:0/1349871546 learned_addr learned my addr 172.21.15.167:0/1349871546 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:12.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 --2- 172.21.15.167:0/1349871546 >> v2:172.21.15.178:3300/0 conn(0x7ff5180cf860 0x7ff5180cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518780327 0 0) 0x7ff51815ac00 con 0x7ff518153ae0 2023-11-28T21:05:12.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff504003530 con 0x7ff518153ae0 2023-11-28T21:05:12.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 -- 172.21.15.167:0/1349871546 >> v2:172.21.15.178:3300/0 conn(0x7ff5180cf860 msgr2=0x7ff5180cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T21:05:12.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 -- 172.21.15.167:0/1349871546 >> v2:172.21.15.178:3300/0 conn(0x7ff5180cf860 msgr2=0x7ff5180cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:05:12.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 --2- 172.21.15.167:0/1349871546 >> v2:172.21.15.178:3300/0 conn(0x7ff5180cf860 0x7ff5180cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:12.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 357261071 0 0) 0x7ff504003530 con 0x7ff518153ae0 2023-11-28T21:05:12.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 --2- 172.21.15.167:0/1349871546 >> v2:172.21.15.178:3300/0 conn(0x7ff5180cf860 0x7ff5180cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:05:12.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 >> v2:172.21.15.178:3300/0 conn(0x7ff5180cf860 msgr2=0x7ff5180cb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:05:12.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 --2- 172.21.15.167:0/1349871546 >> v2:172.21.15.178:3300/0 conn(0x7ff5180cf860 0x7ff5180cb770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 >> v1:172.21.15.178:6789/0 conn(0x7ff5180cfc40 legacy=0x7ff5180ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51815a2d0 con 0x7ff518153ae0 2023-11-28T21:05:12.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7ff510001a00 con 0x7ff518153ae0 2023-11-28T21:05:12.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 >> v1:172.21.15.167:6789/0 conn(0x7ff518153ae0 legacy=0x7ff51815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff504003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5040047d0 0x7ff504004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5040051e0 0x7ff50400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518159ff0 con 0x7ff5040039d0 2023-11-28T21:05:12.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50400c130 con 0x7ff5040047d0 2023-11-28T21:05:12.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50400c2f0 con 0x7ff5040051e0 2023-11-28T21:05:12.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff504003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff50ffff640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5040047d0 0x7ff504004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51c89a640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5040051e0 0x7ff50400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 -- 172.21.15.167:0/1349871546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5040051e0 msgr2=0x7ff50400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:12.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5040051e0 0x7ff50400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 -- 172.21.15.167:0/1349871546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5040047d0 msgr2=0x7ff504004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:12.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5040047d0 0x7ff504004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff517fff640 1 -- 172.21.15.167:0/1349871546 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504003530 con 0x7ff5040039d0 2023-11-28T21:05:12.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.153+0000 7ff51c89a640 1 -- 172.21.15.167:0/1349871546 reap_dead start 2023-11-28T21:05:12.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff517fff640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff504003df0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff50800c820 tx=0x7ff50801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d299de1d9d4018c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080ab600 con 0x7ff5040039d0 2023-11-28T21:05:12.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5080ab760 con 0x7ff5040039d0 2023-11-28T21:05:12.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff5177fe640 1 -- 172.21.15.167:0/1349871546 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080abb10 con 0x7ff5040039d0 2023-11-28T21:05:12.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff51e2fd640 1 -- 172.21.15.167:0/1349871546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 msgr2=0x7ff504003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff51e2fd640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff504003df0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff50800c820 tx=0x7ff50801c4c0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff51e2fd640 1 -- 172.21.15.167:0/1349871546 shutdown_connections 2023-11-28T21:05:12.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff51e2fd640 1 --2- 172.21.15.167:0/1349871546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff504003df0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff51e2fd640 1 -- 172.21.15.167:0/1349871546 >> 172.21.15.167:0/1349871546 conn(0x7ff51806c1f0 msgr2=0x7ff518071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:12.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff51e2fd640 1 -- 172.21.15.167:0/1349871546 shutdown_connections 2023-11-28T21:05:12.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff51e2fd640 1 -- 172.21.15.167:0/1349871546 wait complete. 2023-11-28T21:05:12.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff51e2fd640 1 Processor -- start 2023-11-28T21:05:12.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.157+0000 7ff51e2fd640 1 -- start start 2023-11-28T21:05:12.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51e2fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff518152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51e2fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff518151230 0x7ff518155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51e2fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5181f63b0 0x7ff518156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51e2fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181566d0 con 0x7ff5040039d0 2023-11-28T21:05:12.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51e2fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518155990 con 0x7ff518151230 2023-11-28T21:05:12.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51e2fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181588e0 con 0x7ff5181f63b0 2023-11-28T21:05:12.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff517fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff518152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff517fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff518152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53314/0 (socket says 172.21.15.167:53314) 2023-11-28T21:05:12.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff517fff640 1 -- 172.21.15.167:0/2595974977 learned_addr learned my addr 172.21.15.167:0/2595974977 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:12.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff50ffff640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff518151230 0x7ff518155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51c89a640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5181f63b0 0x7ff518156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff517fff640 1 -- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5181f63b0 msgr2=0x7ff518156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff50ffff640 1 -- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff518151230 msgr2=0x7ff518155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-11-28T21:05:12.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff517fff640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5181f63b0 0x7ff518156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff50ffff640 1 -- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff518151230 msgr2=0x7ff518155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-11-28T21:05:12.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff50ffff640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff518151230 0x7ff518155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:05:12.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff517fff640 1 -- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff518151230 msgr2=0x7ff518155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff50ffff640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff518151230 0x7ff518155c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:05:12.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff517fff640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff518151230 0x7ff518155c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff517fff640 1 -- 172.21.15.167:0/2595974977 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518158bc0 con 0x7ff5040039d0 2023-11-28T21:05:12.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff517fff640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff518152bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff5080ad040 tx=0x7ff504005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff5157fa640 1 -- 172.21.15.167:0/2595974977 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080aba10 con 0x7ff5040039d0 2023-11-28T21:05:12.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff5157fa640 1 -- 172.21.15.167:0/2595974977 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5080abb70 con 0x7ff5040039d0 2023-11-28T21:05:12.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff518158ea0 con 0x7ff5040039d0 2023-11-28T21:05:12.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff5157fa640 1 -- 172.21.15.167:0/2595974977 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080bd410 con 0x7ff5040039d0 2023-11-28T21:05:12.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff518159460 con 0x7ff5040039d0 2023-11-28T21:05:12.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff518067c40 con 0x7ff5040039d0 2023-11-28T21:05:12.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff5157fa640 1 -- 172.21.15.167:0/2595974977 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5080b43f0 con 0x7ff5040039d0 2023-11-28T21:05:12.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff5157fa640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4f80664a0 0x7ff4f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff5157fa640 1 -- 172.21.15.167:0/2595974977 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ff50811e0a0 con 0x7ff5040039d0 2023-11-28T21:05:12.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.161+0000 7ff50ffff640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4f80664a0 0x7ff4f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.165+0000 7ff50ffff640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4f80664a0 0x7ff4f8068960 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff518067020 tx=0x7ff500009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.165+0000 7ff5157fa640 1 -- 172.21.15.167:0/2595974977 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5080eb130 con 0x7ff5040039d0 2023-11-28T21:05:12.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff518075c90 con 0x7ff5040039d0 2023-11-28T21:05:12.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff5157fa640 1 -- 172.21.15.167:0/2595974977 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1552 (secure 0 0 0) 0x7ff5080c2620 con 0x7ff5040039d0 2023-11-28T21:05:12.370 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":206,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:05:12.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4f80664a0 msgr2=0x7ff4f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4f80664a0 0x7ff4f8068960 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff518067020 tx=0x7ff500009040 comp rx=0 tx=0).stop 2023-11-28T21:05:12.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 msgr2=0x7ff518152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff518152bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff5080ad040 tx=0x7ff504005800 comp rx=0 tx=0).stop 2023-11-28T21:05:12.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 shutdown_connections 2023-11-28T21:05:12.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7ff4f80664a0 0x7ff4f8068960 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5181f63b0 0x7ff518156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff518151230 0x7ff518155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 --2- 172.21.15.167:0/2595974977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5040039d0 0x7ff518152bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 >> 172.21.15.167:0/2595974977 conn(0x7ff51806c1f0 msgr2=0x7ff518151ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:12.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 shutdown_connections 2023-11-28T21:05:12.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.369+0000 7ff51e2fd640 1 -- 172.21.15.167:0/2595974977 wait complete. 2023-11-28T21:05:12.390 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:05:12.390 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2023-11-28T21:05:12.390 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2023-11-28T21:05:12.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.497+0000 7f47811e6640 1 Processor -- start 2023-11-28T21:05:12.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.497+0000 7f47811e6640 1 -- start start 2023-11-28T21:05:12.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f477c1540d0 0x7f477c0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c0c7680 0x7f477c06f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c15dda0 con 0x7f477c0c80a0 2023-11-28T21:05:12.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c1544b0 con 0x7f477c1540d0 2023-11-28T21:05:12.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15e040 con 0x7f477c0c7680 2023-11-28T21:05:12.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f477ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f477c1540d0 0x7f477c0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f477ad9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f477c1540d0 0x7f477c0c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53316/0 (socket says 172.21.15.167:53316) 2023-11-28T21:05:12.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f477ad9d640 1 -- 172.21.15.167:0/1120941795 learned_addr learned my addr 172.21.15.167:0/1120941795 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:12.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f477a59c640 1 --2- 172.21.15.167:0/1120941795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c0c7680 0x7f477c06f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f477ad9d640 1 -- 172.21.15.167:0/1120941795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c0c7680 msgr2=0x7f477c06f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:12.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f477ad9d640 1 --2- 172.21.15.167:0/1120941795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c0c7680 0x7f477c06f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f477ad9d640 1 -- 172.21.15.167:0/1120941795 >> v1:172.21.15.178:6789/0 conn(0x7f477c0c80a0 legacy=0x7f477c15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:12.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f477ad9d640 1 -- 172.21.15.167:0/1120941795 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0c70c0 con 0x7f477c1540d0 2023-11-28T21:05:12.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f477ad9d640 1 --2- 172.21.15.167:0/1120941795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1540d0 0x7f477c0c8810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f476c009e50 tx=0x7f476c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244e5f7f998681e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f4779d9b640 1 -- 172.21.15.167:0/1120941795 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0af400 con 0x7f477c1540d0 2023-11-28T21:05:12.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f4779d9b640 1 -- 172.21.15.167:0/1120941795 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c0ab050 con 0x7f477c1540d0 2023-11-28T21:05:12.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f4779d9b640 1 -- 172.21.15.167:0/1120941795 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0af780 con 0x7f477c1540d0 2023-11-28T21:05:12.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 -- 172.21.15.167:0/1120941795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1540d0 msgr2=0x7f477c0c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 --2- 172.21.15.167:0/1120941795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1540d0 0x7f477c0c8810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f476c009e50 tx=0x7f476c01f1c0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 -- 172.21.15.167:0/1120941795 shutdown_connections 2023-11-28T21:05:12.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 --2- 172.21.15.167:0/1120941795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c0c7680 0x7f477c06f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 --2- 172.21.15.167:0/1120941795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1540d0 0x7f477c0c8810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 -- 172.21.15.167:0/1120941795 >> 172.21.15.167:0/1120941795 conn(0x7f477c0cc300 msgr2=0x7f477c0cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:12.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 -- 172.21.15.167:0/1120941795 shutdown_connections 2023-11-28T21:05:12.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.501+0000 7f47811e6640 1 -- 172.21.15.167:0/1120941795 wait complete. 2023-11-28T21:05:12.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 Processor -- start 2023-11-28T21:05:12.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 -- start start 2023-11-28T21:05:12.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c0c7680 0x7f477c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f477c0c80a0 0x7f477c1e5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c1540d0 0x7f477c1efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0c4560 con 0x7f477c0c7680 2023-11-28T21:05:12.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c1f3e90 con 0x7f477c0c80a0 2023-11-28T21:05:12.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c152490 con 0x7f477c1540d0 2023-11-28T21:05:12.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c0c7680 0x7f477c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c0c7680 0x7f477c0c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53324/0 (socket says 172.21.15.167:53324) 2023-11-28T21:05:12.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477ad9d640 1 -- 172.21.15.167:0/3043518129 learned_addr learned my addr 172.21.15.167:0/3043518129 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:12.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477a59c640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f477c0c80a0 0x7f477c1e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477b59e640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c1540d0 0x7f477c1efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477ad9d640 1 -- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c1540d0 msgr2=0x7f477c1efff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477ad9d640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c1540d0 0x7f477c1efff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477ad9d640 1 -- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f477c0c80a0 msgr2=0x7f477c1e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477ad9d640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f477c0c80a0 0x7f477c1e5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477ad9d640 1 -- 172.21.15.167:0/3043518129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c009b30 con 0x7f477c0c7680 2023-11-28T21:05:12.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477b59e640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f477c1540d0 0x7f477c1efff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:12.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f477ad9d640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c0c7680 0x7f477c0c5b40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f476c01d870 tx=0x7f476c01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0c0070 con 0x7f477c0c7680 2023-11-28T21:05:12.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c009510 con 0x7f477c0c7680 2023-11-28T21:05:12.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c0c6160 con 0x7f477c0c7680 2023-11-28T21:05:12.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0ba420 con 0x7f477c0c7680 2023-11-28T21:05:12.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c1f3560 con 0x7f477c0c7680 2023-11-28T21:05:12.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1f3750 0x7f477c14ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.505+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c074770 con 0x7f477c1f3750 2023-11-28T21:05:12.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f477a59c640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1f3750 0x7f477c14ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f477a59c640 1 -- 172.21.15.167:0/3043518129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f477c15d420 con 0x7f477c1f3750 2023-11-28T21:05:12.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f477a59c640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1f3750 0x7f477c14ebe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f477c1f1120 tx=0x7f476400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476400a750 con 0x7f477c1f3750 2023-11-28T21:05:12.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f476c0b6040 con 0x7f477c0c7680 2023-11-28T21:05:12.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f47737fe640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f475c066540 0x7f475c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f476c1220d0 con 0x7f477c0c7680 2023-11-28T21:05:12.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f476400a8b0 con 0x7f477c1f3750 2023-11-28T21:05:12.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1f3750 msgr2=0x7f477c14ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f47737fe640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1f3750 0x7f477c14ebe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f477c1f1120 tx=0x7f476400ec00 comp rx=0 tx=0).stop 2023-11-28T21:05:12.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1f3750 msgr2=0x7f477c14ebe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:05:12.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f47737fe640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c1f3750 0x7f477c14ebe0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f477c1f1120 tx=0x7f476400ec00 comp rx=0 tx=0).stop 2023-11-28T21:05:12.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f477b59e640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f475c066540 0x7f475c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.509+0000 7f477b59e640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f475c066540 0x7f475c068a00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4774003dc0 tx=0x7f4774009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.513+0000 7f47811e6640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c14f120 0x7f477c1e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.513+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c1f4000 con 0x7f477c14f120 2023-11-28T21:05:12.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.513+0000 7f477a59c640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c14f120 0x7f477c1e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.513+0000 7f477a59c640 1 -- 172.21.15.167:0/3043518129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f477c0c73a0 con 0x7f477c14f120 2023-11-28T21:05:12.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.513+0000 7f477a59c640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c14f120 0x7f477c1e2f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f477c1f1120 tx=0x7f47640046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.513+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764003b90 con 0x7f477c14f120 2023-11-28T21:05:12.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 <== mon.0 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5125 (secure 0 0 0) 0x7f47640202c0 con 0x7f477c14f120 2023-11-28T21:05:12.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c14f120 msgr2=0x7f477c1e2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47737fe640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c14f120 0x7f477c1e2f20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f477c1f1120 tx=0x7f47640046d0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47737fe640 1 -- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c14f120 msgr2=0x7f477c1e2f20 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:05:12.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47737fe640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c14f120 0x7f477c1e2f20 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f477c1f1120 tx=0x7f47640046d0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.519 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:12.519 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:05:12.519 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:05:12.519 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "leader", 2023-11-28T21:05:12.520 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 206, 2023-11-28T21:05:12.520 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:05:12.520 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:05:12.520 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:05:12.520 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:05:12.520 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.520 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:05:12.520 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:05:12.521 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:05:12.521 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:05:12.521 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:05:12.521 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:05:12.521 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:05:12.521 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:05:12.521 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:05:12.521 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:05:12.522 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:05:12.522 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:05:12.522 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:05:12.522 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:05:12.522 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.522 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:05:12.522 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:05:12.523 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:05:12.523 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:05:12.523 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:05:12.523 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:05:12.523 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:05:12.523 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:05:12.523 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:05:12.523 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:05:12.524 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:05:12.524 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:05:12.524 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.524 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.524 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:05:12.524 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:05:12.524 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:05:12.524 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:05:12.525 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:05:12.525 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:05:12.525 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:05:12.525 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:05:12.525 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:05:12.525 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:05:12.525 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:05:12.525 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:05:12.526 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:05:12.526 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:05:12.526 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:05:12.526 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:05:12.526 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:05:12.526 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:05:12.526 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:05:12.526 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:05:12.527 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:05:12.527 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:05:12.527 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:05:12.527 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:05:12.527 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:05:12.527 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:05:12.527 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:05:12.527 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.528 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:05:12.528 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.528 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:05:12.528 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.528 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:05:12.528 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:05:12.528 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:05:12.528 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:05:12.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.529 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:05:12.529 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:05:12.529 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.529 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.529 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.529 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:05:12.529 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:05:12.530 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.530 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.530 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.530 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.530 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:05:12.530 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:05:12.531 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:05:12.531 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:05:12.531 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:05:12.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.531 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:05:12.531 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:05:12.531 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:05:12.532 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:05:12.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.532 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:05:12.532 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:05:12.532 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.532 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:05:12.532 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:05:12.533 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.533 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.533 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.533 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.533 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:05:12.533 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:05:12.533 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:05:12.534 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:05:12.534 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:05:12.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.534 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.534 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:05:12.534 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:05:12.534 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:05:12.534 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:05:12.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:05:12.535 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:05:12.535 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.535 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.535 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:05:12.535 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:05:12.536 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.536 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.536 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.536 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.536 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:05:12.536 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:05:12.536 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:05:12.537 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:05:12.537 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:05:12.537 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.537 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.537 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.537 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:05:12.537 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:05:12.537 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.538 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.538 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.538 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:05:12.538 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.538 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.538 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:05:12.538 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.539 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.539 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.539 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 2 2023-11-28T21:05:12.539 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.539 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.539 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:05:12.539 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.539 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.539 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.540 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:05:12.540 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.540 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.540 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:05:12.540 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.540 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x2f018fb87aa4aafe", 2023-11-28T21:05:12.540 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.540 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:05:12.541 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.541 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.541 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.541 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.541 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:05:12.541 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.541 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.542 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:05:12.542 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.542 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.542 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.542 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:05:12.542 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.542 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.542 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.543 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:05:12.543 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:12.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f475c066540 msgr2=0x7f475c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47811e6640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f475c066540 0x7f475c068a00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4774003dc0 tx=0x7f4774009040 comp rx=0 tx=0).stop 2023-11-28T21:05:12.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c0c7680 msgr2=0x7f477c0c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47811e6640 1 --2- 172.21.15.167:0/3043518129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f477c0c7680 0x7f477c0c5b40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f476c01d870 tx=0x7f476c01bf60 comp rx=0 tx=0).stop 2023-11-28T21:05:12.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f477b59e640 1 -- 172.21.15.167:0/3043518129 reap_dead start 2023-11-28T21:05:12.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f477b59e640 1 -- 172.21.15.167:0/3043518129 reap_dead start 2023-11-28T21:05:12.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 shutdown_connections 2023-11-28T21:05:12.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 >> 172.21.15.167:0/3043518129 conn(0x7f477c0cc300 msgr2=0x7f477c152860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:12.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 shutdown_connections 2023-11-28T21:05:12.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.517+0000 7f47811e6640 1 -- 172.21.15.167:0/3043518129 wait complete. 2023-11-28T21:05:12.546 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:05:12.546 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2023-11-28T21:05:12.546 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2023-11-28T21:05:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa5333d1640 1 Processor -- start 2023-11-28T21:05:12.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa5333d1640 1 -- start start 2023-11-28T21:05:12.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa5333d1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa52c150b40 0x7fa52c157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa5333d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa52c0c6ff0 0x7fa52c0c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa5333d1640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c0c6ac0 con 0x7fa52c0c5be0 2023-11-28T21:05:12.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa5333d1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52c0c6500 con 0x7fa52c150b40 2023-11-28T21:05:12.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa5333d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0c67e0 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa53116d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa52c150b40 0x7fa52c157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa53116d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa52c150b40 0x7fa52c157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53346/0 (socket says 172.21.15.167:53346) 2023-11-28T21:05:12.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.653+0000 7fa53116d640 1 -- 172.21.15.167:0/2968228438 learned_addr learned my addr 172.21.15.167:0/2968228438 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:12.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa53116d640 1 -- 172.21.15.167:0/2968228438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa52c0c6ff0 msgr2=0x7fa52c0c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:12.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa53116d640 1 --2- 172.21.15.167:0/2968228438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa52c0c6ff0 0x7fa52c0c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa53116d640 1 -- 172.21.15.167:0/2968228438 >> v1:172.21.15.178:6789/0 conn(0x7fa52c0c5be0 legacy=0x7fa52c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:12.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa53116d640 1 -- 172.21.15.167:0/2968228438 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c156a80 con 0x7fa52c150b40 2023-11-28T21:05:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa53116d640 1 --2- 172.21.15.167:0/2968228438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c150b40 0x7fa52c157560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa528009870 tx=0x7fa52801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d871dbe7d474b792 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa523fff640 1 -- 172.21.15.167:0/2968228438 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280aa5f0 con 0x7fa52c150b40 2023-11-28T21:05:12.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa523fff640 1 -- 172.21.15.167:0/2968228438 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5280aa750 con 0x7fa52c150b40 2023-11-28T21:05:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa523fff640 1 -- 172.21.15.167:0/2968228438 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280aaae0 con 0x7fa52c150b40 2023-11-28T21:05:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa5333d1640 1 -- 172.21.15.167:0/2968228438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c150b40 msgr2=0x7fa52c157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa5333d1640 1 --2- 172.21.15.167:0/2968228438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c150b40 0x7fa52c157560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa528009870 tx=0x7fa52801c4d0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa5333d1640 1 -- 172.21.15.167:0/2968228438 shutdown_connections 2023-11-28T21:05:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa5333d1640 1 --2- 172.21.15.167:0/2968228438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa52c0c6ff0 0x7fa52c0c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa5333d1640 1 --2- 172.21.15.167:0/2968228438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c150b40 0x7fa52c157560 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa5333d1640 1 -- 172.21.15.167:0/2968228438 >> 172.21.15.167:0/2968228438 conn(0x7fa52c0cb1e0 msgr2=0x7fa52c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:12.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa5333d1640 1 -- 172.21.15.167:0/2968228438 shutdown_connections 2023-11-28T21:05:12.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.657+0000 7fa5333d1640 1 -- 172.21.15.167:0/2968228438 wait complete. 2023-11-28T21:05:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 Processor -- start 2023-11-28T21:05:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 -- start start 2023-11-28T21:05:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa52c0c5be0 0x7fa52c160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c0c6ff0 0x7fa52c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c150b40 0x7fa52c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c1f6350 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c15a740 con 0x7fa52c150b40 2023-11-28T21:05:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c15a130 con 0x7fa52c0c5be0 2023-11-28T21:05:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53096c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c0c6ff0 0x7fa52c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53096c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c0c6ff0 0x7fa52c155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53358/0 (socket says 172.21.15.167:53358) 2023-11-28T21:05:12.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53096c640 1 -- 172.21.15.167:0/2001007366 learned_addr learned my addr 172.21.15.167:0/2001007366 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:12.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53196e640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c150b40 0x7fa52c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53116d640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa52c0c5be0 0x7fa52c160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53096c640 1 -- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa52c0c5be0 msgr2=0x7fa52c160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53096c640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa52c0c5be0 0x7fa52c160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53096c640 1 -- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c150b40 msgr2=0x7fa52c153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53096c640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c150b40 0x7fa52c153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53096c640 1 -- 172.21.15.167:0/2001007366 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5280094d0 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53116d640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa52c0c5be0 0x7fa52c160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53096c640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c0c6ff0 0x7fa52c155100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00b440 tx=0x7fa51c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c011830 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c0119b0 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52c1f5710 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c011d60 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c1f5c90 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c14b8c0 0x7fa52c14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c074770 con 0x7fa52c14b8c0 2023-11-28T21:05:12.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa53116d640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c14b8c0 0x7fa52c14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.661+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa51c01a400 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa53116d640 1 -- 172.21.15.167:0/2001007366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa52c06ac90 con 0x7fa52c14b8c0 2023-11-28T21:05:12.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa521ffb640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa510066470 0x7fa510068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa51c0843d0 con 0x7fa52c0c6ff0 2023-11-28T21:05:12.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa53116d640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c14b8c0 0x7fa52c14bca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa52c070410 tx=0x7fa52801ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa53196e640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa510066470 0x7fa510068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280bd400 con 0x7fa52c14b8c0 2023-11-28T21:05:12.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa53196e640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa510066470 0x7fa510068930 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa524009ea0 tx=0x7fa524009410 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7fa5280b7070 con 0x7fa52c14b8c0 2023-11-28T21:05:12.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c14b8c0 msgr2=0x7fa52c14bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa521ffb640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c14b8c0 0x7fa52c14bca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa52c070410 tx=0x7fa52801ad10 comp rx=0 tx=0).stop 2023-11-28T21:05:12.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c14b8c0 msgr2=0x7fa52c14bca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:05:12.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.665+0000 7fa521ffb640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c14b8c0 0x7fa52c14bca0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa52c070410 tx=0x7fa52801ad10 comp rx=0 tx=0).stop 2023-11-28T21:05:12.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.669+0000 7fa5333d1640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c149a90 0x7fa52c149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.669+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c0682c0 con 0x7fa52c149a90 2023-11-28T21:05:12.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.669+0000 7fa53116d640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c149a90 0x7fa52c149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa53116d640 1 -- 172.21.15.167:0/2001007366 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa52c075c90 con 0x7fa52c149a90 2023-11-28T21:05:12.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa53116d640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c149a90 0x7fa52c149ea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa52801ab80 tx=0x7fa528019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280c4a80 con 0x7fa52c149a90 2023-11-28T21:05:12.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 <== mon.1 v2:172.21.15.178:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4470 (secure 0 0 0) 0x7fa5280c4be0 con 0x7fa52c149a90 2023-11-28T21:05:12.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c149a90 msgr2=0x7fa52c149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa521ffb640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c149a90 0x7fa52c149ea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa52801ab80 tx=0x7fa528019270 comp rx=0 tx=0).stop 2023-11-28T21:05:12.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa521ffb640 1 -- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c149a90 msgr2=0x7fa52c149ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:05:12.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa521ffb640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa52c149a90 0x7fa52c149ea0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa52801ab80 tx=0x7fa528019270 comp rx=0 tx=0).stop 2023-11-28T21:05:12.676 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:12.676 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:05:12.676 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:05:12.676 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:05:12.677 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 206, 2023-11-28T21:05:12.677 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:05:12.677 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:05:12.677 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:05:12.677 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:05:12.677 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.677 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:05:12.677 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:05:12.678 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:05:12.678 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:05:12.678 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:05:12.678 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:05:12.678 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:05:12.678 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:05:12.679 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:05:12.679 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:05:12.679 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:05:12.679 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:05:12.679 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:05:12.679 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:05:12.679 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.679 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:05:12.680 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:05:12.680 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:05:12.680 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:05:12.680 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:05:12.680 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:05:12.680 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:05:12.680 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:05:12.680 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:05:12.681 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:05:12.681 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:05:12.681 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:05:12.681 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.681 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.681 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:05:12.682 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:05:12.682 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:05:12.682 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:05:12.682 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:05:12.682 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:05:12.682 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:05:12.682 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:05:12.682 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:05:12.683 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:05:12.683 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:05:12.683 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:05:12.683 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:05:12.683 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:05:12.683 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:05:12.683 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:05:12.684 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:05:12.684 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:05:12.684 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:05:12.684 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:05:12.684 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:05:12.684 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:05:12.684 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:05:12.684 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:05:12.685 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:05:12.685 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:05:12.685 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:05:12.685 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.685 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:05:12.685 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.685 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:05:12.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.686 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:05:12.686 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:05:12.686 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:05:12.686 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:05:12.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.686 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:05:12.687 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:05:12.687 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.687 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.687 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:05:12.687 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:05:12.687 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.687 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.687 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.688 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:05:12.688 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:05:12.688 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:05:12.688 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:05:12.688 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:05:12.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.688 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.689 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:05:12.689 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:05:12.689 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:05:12.689 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:05:12.689 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.689 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:05:12.689 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:05:12.689 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.689 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.690 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.690 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:05:12.690 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:05:12.690 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.690 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.690 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.690 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.691 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:05:12.691 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:05:12.691 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:05:12.691 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:05:12.691 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:05:12.691 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.691 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.691 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:05:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:05:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:05:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:05:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:05:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:05:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.692 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:05:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:05:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.693 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:05:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:05:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:05:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:05:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:05:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.694 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:05:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:05:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:05:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.695 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:05:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:05:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.696 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.697 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:05:12.697 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:12.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa510066470 msgr2=0x7fa510068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa5333d1640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa510066470 0x7fa510068930 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa524009ea0 tx=0x7fa524009410 comp rx=0 tx=0).stop 2023-11-28T21:05:12.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c0c6ff0 msgr2=0x7fa52c155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa5333d1640 1 --2- 172.21.15.167:0/2001007366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa52c0c6ff0 0x7fa52c155100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00b440 tx=0x7fa51c00b900 comp rx=0 tx=0).stop 2023-11-28T21:05:12.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa53196e640 1 -- 172.21.15.167:0/2001007366 reap_dead start 2023-11-28T21:05:12.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa53196e640 1 -- 172.21.15.167:0/2001007366 reap_dead start 2023-11-28T21:05:12.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 shutdown_connections 2023-11-28T21:05:12.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 >> 172.21.15.167:0/2001007366 conn(0x7fa52c0cb1e0 msgr2=0x7fa52c0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:12.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 shutdown_connections 2023-11-28T21:05:12.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.673+0000 7fa5333d1640 1 -- 172.21.15.167:0/2001007366 wait complete. 2023-11-28T21:05:12.700 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:05:12.700 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2023-11-28T21:05:12.700 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2023-11-28T21:05:12.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.805+0000 7f33a4bb8640 1 Processor -- start 2023-11-28T21:05:12.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.805+0000 7f33a4bb8640 1 -- start start 2023-11-28T21:05:12.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f33a4bb8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f33a01540d0 0x7f33a00c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f33a4bb8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00c80a0 0x7f33a015a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f33a4bb8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a015dda0 con 0x7f33a00c7680 2023-11-28T21:05:12.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f33a4bb8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a01544b0 con 0x7f33a01540d0 2023-11-28T21:05:12.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f33a4bb8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a015e040 con 0x7f33a00c80a0 2023-11-28T21:05:12.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f33a01540d0 0x7f33a00c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339e59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f33a01540d0 0x7f33a00c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53372/0 (socket says 172.21.15.167:53372) 2023-11-28T21:05:12.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339e59c640 1 -- 172.21.15.167:0/270666482 learned_addr learned my addr 172.21.15.167:0/270666482 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:12.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339ed9d640 1 --2- 172.21.15.167:0/270666482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00c80a0 0x7f33a015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339e59c640 1 -- 172.21.15.167:0/270666482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00c80a0 msgr2=0x7f33a015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:12.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339e59c640 1 --2- 172.21.15.167:0/270666482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00c80a0 0x7f33a015a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339e59c640 1 -- 172.21.15.167:0/270666482 >> v1:172.21.15.178:6789/0 conn(0x7f33a00c7680 legacy=0x7f33a006f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:12.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339e59c640 1 -- 172.21.15.167:0/270666482 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a00c70c0 con 0x7f33a01540d0 2023-11-28T21:05:12.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339e59c640 1 --2- 172.21.15.167:0/270666482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 0x7f33a00c8810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3390009870 tx=0x7f339001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63134ea604d55bdb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339d59a640 1 -- 172.21.15.167:0/270666482 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900a89b0 con 0x7f33a01540d0 2023-11-28T21:05:12.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339d59a640 1 -- 172.21.15.167:0/270666482 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33900a8b10 con 0x7f33a01540d0 2023-11-28T21:05:12.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.809+0000 7f339d59a640 1 -- 172.21.15.167:0/270666482 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900a8ea0 con 0x7f33a01540d0 2023-11-28T21:05:12.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- 172.21.15.167:0/270666482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 msgr2=0x7f33a00c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 --2- 172.21.15.167:0/270666482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 0x7f33a00c8810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3390009870 tx=0x7f339001ecf0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- 172.21.15.167:0/270666482 shutdown_connections 2023-11-28T21:05:12.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 --2- 172.21.15.167:0/270666482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00c80a0 0x7f33a015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 --2- 172.21.15.167:0/270666482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 0x7f33a00c8810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- 172.21.15.167:0/270666482 >> 172.21.15.167:0/270666482 conn(0x7f33a00cc300 msgr2=0x7f33a00cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:12.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- 172.21.15.167:0/270666482 shutdown_connections 2023-11-28T21:05:12.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- 172.21.15.167:0/270666482 wait complete. 2023-11-28T21:05:12.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 Processor -- start 2023-11-28T21:05:12.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- start start 2023-11-28T21:05:12.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00c7680 0x7f33a015c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00c80a0 0x7f33a01f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 0x7f33a0157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01f33a0 con 0x7f33a01540d0 2023-11-28T21:05:12.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01545f0 con 0x7f33a00c7680 2023-11-28T21:05:12.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01f0c70 con 0x7f33a00c80a0 2023-11-28T21:05:12.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 0x7f33a0157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 0x7f33a0157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53384/0 (socket says 172.21.15.167:53384) 2023-11-28T21:05:12.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339ed9d640 1 -- 172.21.15.167:0/1729527995 learned_addr learned my addr 172.21.15.167:0/1729527995 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:12.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339e59c640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00c7680 0x7f33a015c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339dd9b640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00c80a0 0x7f33a01f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339ed9d640 1 -- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00c80a0 msgr2=0x7f33a01f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339ed9d640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00c80a0 0x7f33a01f3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339ed9d640 1 -- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00c7680 msgr2=0x7f33a015c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339ed9d640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00c7680 0x7f33a015c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339ed9d640 1 -- 172.21.15.167:0/1729527995 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900094d0 con 0x7f33a01540d0 2023-11-28T21:05:12.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f339ed9d640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 0x7f33a0157a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f339800cd60 tx=0x7f339800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398003ba0 con 0x7f33a01540d0 2023-11-28T21:05:12.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3398003d20 con 0x7f33a01540d0 2023-11-28T21:05:12.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a01570f0 con 0x7f33a01540d0 2023-11-28T21:05:12.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398004260 con 0x7f33a01540d0 2023-11-28T21:05:12.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.813+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a01f3640 con 0x7f33a01540d0 2023-11-28T21:05:12.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f33a4bb8640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a01f40a0 0x7f33a0145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a0074770 con 0x7f33a01f40a0 2023-11-28T21:05:12.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f339e59c640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a01f40a0 0x7f33a0145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f33980043c0 con 0x7f33a01540d0 2023-11-28T21:05:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f339e59c640 1 -- 172.21.15.167:0/1729527995 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33a006bfa0 con 0x7f33a01f40a0 2023-11-28T21:05:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f339e59c640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a01f40a0 0x7f33a0145d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33a00c36a0 tx=0x7f339001ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f338effd640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33800664a0 0x7f3380068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3398012070 con 0x7f33a01540d0 2023-11-28T21:05:12.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900b0e00 con 0x7f33a01f40a0 2023-11-28T21:05:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f339dd9b640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33800664a0 0x7f3380068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9324 (secure 0 0 0) 0x7f33900c3450 con 0x7f33a01f40a0 2023-11-28T21:05:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a01f40a0 msgr2=0x7f33a0145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f338effd640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a01f40a0 0x7f33a0145d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33a00c36a0 tx=0x7f339001ba90 comp rx=0 tx=0).stop 2023-11-28T21:05:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a01f40a0 msgr2=0x7f33a0145d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:05:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f338effd640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a01f40a0 0x7f33a0145d00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.817+0000 7f339dd9b640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33800664a0 0x7f3380068960 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3394003d60 tx=0x7f3394009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a0157fc0 0x7f33a0146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a0150600 con 0x7f33a0157fc0 2023-11-28T21:05:12.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f339e59c640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a0157fc0 0x7f33a0146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f339e59c640 1 -- 172.21.15.167:0/1729527995 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f33a006fa50 con 0x7f33a0157fc0 2023-11-28T21:05:12.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f339e59c640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a0157fc0 0x7f33a0146240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f339001ed30 tx=0x7f33900aa000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33900c9070 con 0x7f33a0157fc0 2023-11-28T21:05:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 <== mon.2 v2:172.21.15.178:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4980 (secure 0 0 0) 0x7f3390003ea0 con 0x7f33a0157fc0 2023-11-28T21:05:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a0157fc0 msgr2=0x7f33a0146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f338effd640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a0157fc0 0x7f33a0146240 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f339001ed30 tx=0x7f33900aa000 comp rx=0 tx=0).stop 2023-11-28T21:05:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f338effd640 1 -- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a0157fc0 msgr2=0x7f33a0146240 secure :-1 s=STATE_CLOSED l=1).mark_down 2023-11-28T21:05:12.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f338effd640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a0157fc0 0x7f33a0146240 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.829 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:12.829 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:05:12.829 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:05:12.830 INFO:teuthology.orchestra.run.smithi167.stdout: "state": "peon", 2023-11-28T21:05:12.830 INFO:teuthology.orchestra.run.smithi167.stdout: "election_epoch": 206, 2023-11-28T21:05:12.830 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum": [ 2023-11-28T21:05:12.830 INFO:teuthology.orchestra.run.smithi167.stdout: 0, 2023-11-28T21:05:12.830 INFO:teuthology.orchestra.run.smithi167.stdout: 1, 2023-11-28T21:05:12.830 INFO:teuthology.orchestra.run.smithi167.stdout: 2 2023-11-28T21:05:12.830 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.830 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_age": 0, 2023-11-28T21:05:12.831 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:05:12.831 INFO:teuthology.orchestra.run.smithi167.stdout: "required_con": "2449958758054445060", 2023-11-28T21:05:12.831 INFO:teuthology.orchestra.run.smithi167.stdout: "required_mon": [ 2023-11-28T21:05:12.831 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:05:12.831 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:05:12.831 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:05:12.831 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:05:12.832 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:05:12.832 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:05:12.832 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:05:12.832 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:05:12.832 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:05:12.832 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:05:12.832 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.832 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_con": "4540138322906710015", 2023-11-28T21:05:12.833 INFO:teuthology.orchestra.run.smithi167.stdout: "quorum_mon": [ 2023-11-28T21:05:12.833 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:05:12.833 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:05:12.833 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:05:12.833 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:05:12.833 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:05:12.833 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:05:12.833 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:05:12.834 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:05:12.834 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:05:12.834 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:05:12.834 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.834 INFO:teuthology.orchestra.run.smithi167.stdout: "outside_quorum": [], 2023-11-28T21:05:12.834 INFO:teuthology.orchestra.run.smithi167.stdout: "extra_probe_peers": [], 2023-11-28T21:05:12.835 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_provider": [], 2023-11-28T21:05:12.835 INFO:teuthology.orchestra.run.smithi167.stdout: "monmap": { 2023-11-28T21:05:12.835 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1, 2023-11-28T21:05:12.835 INFO:teuthology.orchestra.run.smithi167.stdout: "fsid": "4f385093-4252-4ae9-94ab-503723a001fd", 2023-11-28T21:05:12.835 INFO:teuthology.orchestra.run.smithi167.stdout: "modified": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:05:12.835 INFO:teuthology.orchestra.run.smithi167.stdout: "created": "2023-11-28T20:37:16.182016Z", 2023-11-28T21:05:12.835 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release": 18, 2023-11-28T21:05:12.835 INFO:teuthology.orchestra.run.smithi167.stdout: "min_mon_release_name": "reef", 2023-11-28T21:05:12.836 INFO:teuthology.orchestra.run.smithi167.stdout: "election_strategy": 1, 2023-11-28T21:05:12.836 INFO:teuthology.orchestra.run.smithi167.stdout: "disallowed_leaders: ": "", 2023-11-28T21:05:12.836 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false, 2023-11-28T21:05:12.836 INFO:teuthology.orchestra.run.smithi167.stdout: "tiebreaker_mon": "", 2023-11-28T21:05:12.836 INFO:teuthology.orchestra.run.smithi167.stdout: "removed_ranks: ": "", 2023-11-28T21:05:12.836 INFO:teuthology.orchestra.run.smithi167.stdout: "features": { 2023-11-28T21:05:12.836 INFO:teuthology.orchestra.run.smithi167.stdout: "persistent": [ 2023-11-28T21:05:12.836 INFO:teuthology.orchestra.run.smithi167.stdout: "kraken", 2023-11-28T21:05:12.837 INFO:teuthology.orchestra.run.smithi167.stdout: "luminous", 2023-11-28T21:05:12.837 INFO:teuthology.orchestra.run.smithi167.stdout: "mimic", 2023-11-28T21:05:12.837 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap-prune", 2023-11-28T21:05:12.837 INFO:teuthology.orchestra.run.smithi167.stdout: "nautilus", 2023-11-28T21:05:12.837 INFO:teuthology.orchestra.run.smithi167.stdout: "octopus", 2023-11-28T21:05:12.837 INFO:teuthology.orchestra.run.smithi167.stdout: "pacific", 2023-11-28T21:05:12.838 INFO:teuthology.orchestra.run.smithi167.stdout: "elector-pinging", 2023-11-28T21:05:12.838 INFO:teuthology.orchestra.run.smithi167.stdout: "quincy", 2023-11-28T21:05:12.838 INFO:teuthology.orchestra.run.smithi167.stdout: "reef" 2023-11-28T21:05:12.838 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.838 INFO:teuthology.orchestra.run.smithi167.stdout: "optional": [] 2023-11-28T21:05:12.838 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.838 INFO:teuthology.orchestra.run.smithi167.stdout: "mons": [ 2023-11-28T21:05:12.839 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.839 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 0, 2023-11-28T21:05:12.839 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "a", 2023-11-28T21:05:12.839 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:05:12.839 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:05:12.839 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.839 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:05:12.840 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:3300", 2023-11-28T21:05:12.840 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.840 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.840 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.840 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:05:12.840 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789", 2023-11-28T21:05:12.840 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.841 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.841 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.841 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.841 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.167:6789/0", 2023-11-28T21:05:12.841 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.167:6789/0", 2023-11-28T21:05:12.841 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:05:12.841 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:05:12.842 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:05:12.842 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.842 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.842 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 1, 2023-11-28T21:05:12.842 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "b", 2023-11-28T21:05:12.842 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:05:12.842 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:05:12.842 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.843 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:05:12.843 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3300", 2023-11-28T21:05:12.843 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.843 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.843 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.843 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:05:12.844 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789", 2023-11-28T21:05:12.844 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.844 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.844 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.844 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.844 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6789/0", 2023-11-28T21:05:12.844 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6789/0", 2023-11-28T21:05:12.845 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:05:12.845 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:05:12.845 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:05:12.845 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.845 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.845 INFO:teuthology.orchestra.run.smithi167.stdout: "rank": 2, 2023-11-28T21:05:12.845 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "c", 2023-11-28T21:05:12.846 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addrs": { 2023-11-28T21:05:12.846 INFO:teuthology.orchestra.run.smithi167.stdout: "addrvec": [ 2023-11-28T21:05:12.846 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.846 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v2", 2023-11-28T21:05:12.846 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:3301", 2023-11-28T21:05:12.846 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.846 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.847 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.847 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2023-11-28T21:05:12.847 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790", 2023-11-28T21:05:12.847 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 0 2023-11-28T21:05:12.847 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.847 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.847 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.847 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "172.21.15.178:6790/0", 2023-11-28T21:05:12.848 INFO:teuthology.orchestra.run.smithi167.stdout: "public_addr": "172.21.15.178:6790/0", 2023-11-28T21:05:12.848 INFO:teuthology.orchestra.run.smithi167.stdout: "priority": 0, 2023-11-28T21:05:12.848 INFO:teuthology.orchestra.run.smithi167.stdout: "weight": 0, 2023-11-28T21:05:12.848 INFO:teuthology.orchestra.run.smithi167.stdout: "crush_location": "{}" 2023-11-28T21:05:12.848 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.848 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.848 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.849 INFO:teuthology.orchestra.run.smithi167.stdout: "feature_map": { 2023-11-28T21:05:12.849 INFO:teuthology.orchestra.run.smithi167.stdout: "mon": [ 2023-11-28T21:05:12.849 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.849 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.849 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.849 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:05:12.849 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.850 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.850 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": [ 2023-11-28T21:05:12.850 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.850 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.850 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.850 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 3 2023-11-28T21:05:12.850 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.850 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.851 INFO:teuthology.orchestra.run.smithi167.stdout: "osd": [ 2023-11-28T21:05:12.851 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.851 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.851 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.851 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:05:12.851 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.851 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.852 INFO:teuthology.orchestra.run.smithi167.stdout: "client": [ 2023-11-28T21:05:12.852 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.852 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.852 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.852 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 4 2023-11-28T21:05:12.852 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.852 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-11-28T21:05:12.853 INFO:teuthology.orchestra.run.smithi167.stdout: "mgr": [ 2023-11-28T21:05:12.853 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-11-28T21:05:12.853 INFO:teuthology.orchestra.run.smithi167.stdout: "features": "0x3f01cfbffffdffff", 2023-11-28T21:05:12.853 INFO:teuthology.orchestra.run.smithi167.stdout: "release": "luminous", 2023-11-28T21:05:12.853 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 1 2023-11-28T21:05:12.853 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-11-28T21:05:12.853 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-11-28T21:05:12.854 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-11-28T21:05:12.854 INFO:teuthology.orchestra.run.smithi167.stdout: "stretch_mode": false 2023-11-28T21:05:12.854 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:12.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33800664a0 msgr2=0x7f3380068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f33800664a0 0x7f3380068960 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3394003d60 tx=0x7f3394009040 comp rx=0 tx=0).stop 2023-11-28T21:05:12.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 msgr2=0x7f33a0157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 --2- 172.21.15.167:0/1729527995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33a01540d0 0x7f33a0157a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f339800cd60 tx=0x7f339800a660 comp rx=0 tx=0).stop 2023-11-28T21:05:12.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f339ed9d640 1 -- 172.21.15.167:0/1729527995 reap_dead start 2023-11-28T21:05:12.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f339ed9d640 1 -- 172.21.15.167:0/1729527995 reap_dead start 2023-11-28T21:05:12.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 shutdown_connections 2023-11-28T21:05:12.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 >> 172.21.15.167:0/1729527995 conn(0x7f33a00cc300 msgr2=0x7f33a006eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:12.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 shutdown_connections 2023-11-28T21:05:12.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.825+0000 7f33a4bb8640 1 -- 172.21.15.167:0/1729527995 wait complete. 2023-11-28T21:05:12.857 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2023-11-28T21:05:12.857 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2023-11-28T21:05:12.857 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2023-11-28T21:05:12.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e80c9e640 1 Processor -- start 2023-11-28T21:05:12.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e80c9e640 1 -- start start 2023-11-28T21:05:12.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e80c9e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e7c06e030 0x7f8e7c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e80c9e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c072630 0x7f8e7c1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e80c9e640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7c1571d0 con 0x7f8e7c070480 2023-11-28T21:05:12.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e80c9e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7c071a90 con 0x7f8e7c06e030 2023-11-28T21:05:12.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e80c9e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0c70d0 con 0x7f8e7c072630 2023-11-28T21:05:12.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e7a59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e7c06e030 0x7f8e7c1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e7a59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e7c06e030 0x7f8e7c1500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45734/0 (socket says 172.21.15.167:45734) 2023-11-28T21:05:12.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e7a59c640 1 -- 172.21.15.167:0/1049698934 learned_addr learned my addr 172.21.15.167:0/1049698934 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:12.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e7ad9d640 1 --2- 172.21.15.167:0/1049698934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c072630 0x7f8e7c1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e7a59c640 1 -- 172.21.15.167:0/1049698934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c072630 msgr2=0x7f8e7c1505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:12.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e7a59c640 1 --2- 172.21.15.167:0/1049698934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c072630 0x7f8e7c1505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e7a59c640 1 -- 172.21.15.167:0/1049698934 >> v1:172.21.15.178:6789/0 conn(0x7f8e7c070480 legacy=0x7f8e7c071f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T21:05:12.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e7a59c640 1 -- 172.21.15.167:0/1049698934 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c0c73b0 con 0x7f8e7c06e030 2023-11-28T21:05:12.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.965+0000 7f8e7ad9d640 1 --2- 172.21.15.167:0/1049698934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c072630 0x7f8e7c1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:12.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e7a59c640 1 --2- 172.21.15.167:0/1049698934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c06e030 0x7f8e7c1500b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00aa10 tx=0x7f8e6c01d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6757a09fb687beda server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e79d9b640 1 -- 172.21.15.167:0/1049698934 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0a6910 con 0x7f8e7c06e030 2023-11-28T21:05:12.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e79d9b640 1 -- 172.21.15.167:0/1049698934 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c0a6a70 con 0x7f8e7c06e030 2023-11-28T21:05:12.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e79d9b640 1 -- 172.21.15.167:0/1049698934 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0a6e00 con 0x7f8e7c06e030 2023-11-28T21:05:12.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 -- 172.21.15.167:0/1049698934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c06e030 msgr2=0x7f8e7c1500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 --2- 172.21.15.167:0/1049698934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c06e030 0x7f8e7c1500b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00aa10 tx=0x7f8e6c01d8a0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 -- 172.21.15.167:0/1049698934 shutdown_connections 2023-11-28T21:05:12.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 --2- 172.21.15.167:0/1049698934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c072630 0x7f8e7c1505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 --2- 172.21.15.167:0/1049698934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c06e030 0x7f8e7c1500b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 -- 172.21.15.167:0/1049698934 >> 172.21.15.167:0/1049698934 conn(0x7f8e7c0cb1e0 msgr2=0x7f8e7c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:12.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 -- 172.21.15.167:0/1049698934 shutdown_connections 2023-11-28T21:05:12.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 -- 172.21.15.167:0/1049698934 wait complete. 2023-11-28T21:05:12.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 Processor -- start 2023-11-28T21:05:12.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.969+0000 7f8e80c9e640 1 -- start start 2023-11-28T21:05:12.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e80c9e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c06e030 0x7f8e7c1f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e80c9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c070480 0x7f8e7c142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e80c9e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e7c072630 0x7f8e7c0c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e80c9e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c1f5060 con 0x7f8e7c070480 2023-11-28T21:05:12.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e80c9e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c144270 con 0x7f8e7c072630 2023-11-28T21:05:12.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e80c9e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c1f0ba0 con 0x7f8e7c06e030 2023-11-28T21:05:12.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e73fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c070480 0x7f8e7c142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e73fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c070480 0x7f8e7c142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:45748/0 (socket says 172.21.15.167:45748) 2023-11-28T21:05:12.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e73fff640 1 -- 172.21.15.167:0/3400276734 learned_addr learned my addr 172.21.15.167:0/3400276734 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:12.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e7ad9d640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e7c072630 0x7f8e7c0c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e7a59c640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c06e030 0x7f8e7c1f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e73fff640 1 -- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c06e030 msgr2=0x7f8e7c1f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e73fff640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c06e030 0x7f8e7c1f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e73fff640 1 -- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e7c072630 msgr2=0x7f8e7c0c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:12.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e73fff640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e7c072630 0x7f8e7c0c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:12.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e73fff640 1 -- 172.21.15.167:0/3400276734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c00a670 con 0x7f8e7c070480 2023-11-28T21:05:12.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e7a59c640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c06e030 0x7f8e7c1f4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:12.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e73fff640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c070480 0x7f8e7c142870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400b3e0 tx=0x7f8e6400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e72ffd640 1 -- 172.21.15.167:0/3400276734 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64011830 con 0x7f8e7c070480 2023-11-28T21:05:12.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e72ffd640 1 -- 172.21.15.167:0/3400276734 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64011990 con 0x7f8e7c070480 2023-11-28T21:05:12.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7c144510 con 0x7f8e7c070480 2023-11-28T21:05:12.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e72ffd640 1 -- 172.21.15.167:0/3400276734 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64011d60 con 0x7f8e7c070480 2023-11-28T21:05:12.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7c1f1140 con 0x7f8e7c070480 2023-11-28T21:05:12.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7c0682c0 con 0x7f8e7c070480 2023-11-28T21:05:12.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e72ffd640 1 -- 172.21.15.167:0/3400276734 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8e6401a400 con 0x7f8e7c070480 2023-11-28T21:05:12.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e72ffd640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8e5c066470 0x7f8e5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:12.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e72ffd640 1 -- 172.21.15.167:0/3400276734 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8e64084420 con 0x7f8e7c070480 2023-11-28T21:05:12.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.973+0000 7f8e7a59c640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8e5c066470 0x7f8e5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:12.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.977+0000 7f8e7a59c640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8e5c066470 0x7f8e5c068930 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0b0000 tx=0x7f8e6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:12.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:12.977+0000 7f8e72ffd640 1 -- 172.21.15.167:0/3400276734 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8e640514b0 con 0x7f8e7c070480 2023-11-28T21:05:13.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.177+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f8e7c075c90 con 0x7f8e7c070480 2023-11-28T21:05:13.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e72ffd640 1 -- 172.21.15.167:0/3400276734 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f8e64054ad0 con 0x7f8e7c070480 2023-11-28T21:05:13.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8e5c066470 msgr2=0x7f8e5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:13.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8e5c066470 0x7f8e5c068930 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0b0000 tx=0x7f8e6c008040 comp rx=0 tx=0).stop 2023-11-28T21:05:13.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c070480 msgr2=0x7f8e7c142870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:13.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c070480 0x7f8e7c142870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400b3e0 tx=0x7f8e6400b8a0 comp rx=0 tx=0).stop 2023-11-28T21:05:13.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 shutdown_connections 2023-11-28T21:05:13.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8e5c066470 0x7f8e5c068930 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:13.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e7c072630 0x7f8e7c0c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:13.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c070480 0x7f8e7c142870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:13.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 --2- 172.21.15.167:0/3400276734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e7c06e030 0x7f8e7c1f4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:13.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 >> 172.21.15.167:0/3400276734 conn(0x7f8e7c0cb1e0 msgr2=0x7f8e7c0c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:13.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 shutdown_connections 2023-11-28T21:05:13.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:13.181+0000 7f8e80c9e640 1 -- 172.21.15.167:0/3400276734 wait complete. 2023-11-28T21:05:13.201 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2023-11-28T21:05:23.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:05:23.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.321+0000 7f3661a79640 1 Processor -- start 2023-11-28T21:05:23.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.321+0000 7f3661a79640 1 -- start start 2023-11-28T21:05:23.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.321+0000 7f3661a79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f365c072630 0x7f365c161b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.321+0000 7f3661a79640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c1571d0 con 0x7f365c06e030 2023-11-28T21:05:23.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.321+0000 7f3661a79640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c071a90 con 0x7f365c070480 2023-11-28T21:05:23.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.321+0000 7f3661a79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0c70d0 con 0x7f365c072630 2023-11-28T21:05:23.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.321+0000 7f365b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f365c06e030 0x7f365c1500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50904/0 (socket says 172.21.15.167:50904) 2023-11-28T21:05:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.321+0000 7f365b7fe640 1 -- 172.21.15.167:0/2767422499 learned_addr learned my addr 172.21.15.167:0/2767422499 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691882407 0 0) 0x7f365c1571d0 con 0x7f365c06e030 2023-11-28T21:05:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365bfff640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f365c072630 0x7f365c161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3644003450 con 0x7f365c06e030 2023-11-28T21:05:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1054801770 0 0) 0x7f3644003450 con 0x7f365c06e030 2023-11-28T21:05:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f365c072630 msgr2=0x7f365c161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f365c072630 0x7f365c161b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 >> v1:172.21.15.178:6789/0 conn(0x7f365c070480 legacy=0x7f365c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0c73b0 con 0x7f365c06e030 2023-11-28T21:05:23.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f364c001680 con 0x7f365c06e030 2023-11-28T21:05:23.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365bfff640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f365c072630 0x7f365c161b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:05:23.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 >> v1:172.21.15.167:6789/0 conn(0x7f365c06e030 legacy=0x7f365c1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f365c072630 0x7f3644003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3644004090 0x7f364400a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f364400b030 0x7f364400d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0c70d0 con 0x7f3644004090 2023-11-28T21:05:23.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364400dd00 con 0x7f364400b030 2023-11-28T21:05:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364400dec0 con 0x7f365c072630 2023-11-28T21:05:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365affd640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3644004090 0x7f364400a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365b7fe640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f365c072630 0x7f3644003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365bfff640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f364400b030 0x7f364400d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365affd640 1 -- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f365c072630 msgr2=0x7f3644003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365affd640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f365c072630 0x7f3644003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365affd640 1 -- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f364400b030 msgr2=0x7f364400d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:23.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365affd640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f364400b030 0x7f364400d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365affd640 1 -- 172.21.15.167:0/2767422499 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644003450 con 0x7f3644004090 2023-11-28T21:05:23.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365affd640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3644004090 0x7f364400a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f365c070890 tx=0x7f365001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f45ec7892390a2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:23.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36500052d0 con 0x7f3644004090 2023-11-28T21:05:23.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36500a7050 con 0x7f3644004090 2023-11-28T21:05:23.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365a7fc640 1 -- 172.21.15.167:0/2767422499 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650003600 con 0x7f3644004090 2023-11-28T21:05:23.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f3661a79640 1 -- 172.21.15.167:0/2767422499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3644004090 msgr2=0x7f364400a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f3661a79640 1 --2- 172.21.15.167:0/2767422499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3644004090 0x7f364400a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f365c070890 tx=0x7f365001c3a0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f365bfff640 1 -- 172.21.15.167:0/2767422499 reap_dead start 2023-11-28T21:05:23.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f3661a79640 1 -- 172.21.15.167:0/2767422499 shutdown_connections 2023-11-28T21:05:23.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.325+0000 7f3661a79640 1 -- 172.21.15.167:0/2767422499 >> 172.21.15.167:0/2767422499 conn(0x7f365c0cb1e0 msgr2=0x7f365c0cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:23.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 -- 172.21.15.167:0/2767422499 shutdown_connections 2023-11-28T21:05:23.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 -- 172.21.15.167:0/2767422499 wait complete. 2023-11-28T21:05:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 Processor -- start 2023-11-28T21:05:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 -- start start 2023-11-28T21:05:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3644004090 0x7f365c1ef640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f365c155ac0 0x7f365c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f365c149be0 0x7f365c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c1efb80 con 0x7f365c155ac0 2023-11-28T21:05:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c1ec590 con 0x7f365c149be0 2023-11-28T21:05:23.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c14a5a0 con 0x7f3644004090 2023-11-28T21:05:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f365c155ac0 0x7f365c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f365c155ac0 0x7f365c0c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56752/0 (socket says 172.21.15.167:56752) 2023-11-28T21:05:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365affd640 1 -- 172.21.15.167:0/4213011684 learned_addr learned my addr 172.21.15.167:0/4213011684 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365bfff640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f365c149be0 0x7f365c14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365b7fe640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3644004090 0x7f365c1ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365affd640 1 -- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3644004090 msgr2=0x7f365c1ef640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365affd640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3644004090 0x7f365c1ef640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365affd640 1 -- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f365c149be0 msgr2=0x7f365c14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365affd640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f365c149be0 0x7f365c14a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365affd640 1 -- 172.21.15.167:0/4213011684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c1599b0 con 0x7f365c155ac0 2023-11-28T21:05:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365bfff640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f365c149be0 0x7f365c14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365b7fe640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3644004090 0x7f365c1ef640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f365affd640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f365c155ac0 0x7f365c0c6540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3650005040 tx=0x7f3644003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3643fff640 1 -- 172.21.15.167:0/4213011684 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650007a40 con 0x7f365c155ac0 2023-11-28T21:05:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3643fff640 1 -- 172.21.15.167:0/4213011684 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650007680 con 0x7f365c155ac0 2023-11-28T21:05:23.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c1eb6c0 con 0x7f365c155ac0 2023-11-28T21:05:23.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3643fff640 1 -- 172.21.15.167:0/4213011684 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650006a00 con 0x7f365c155ac0 2023-11-28T21:05:23.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.329+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c1ebc60 con 0x7f365c155ac0 2023-11-28T21:05:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.333+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c0682c0 con 0x7f365c155ac0 2023-11-28T21:05:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.333+0000 7f3643fff640 1 -- 172.21.15.167:0/4213011684 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3650006b60 con 0x7f365c155ac0 2023-11-28T21:05:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.333+0000 7f3643fff640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36480664a0 0x7f3648068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.333+0000 7f3643fff640 1 -- 172.21.15.167:0/4213011684 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f365011e9c0 con 0x7f365c155ac0 2023-11-28T21:05:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.333+0000 7f365b7fe640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36480664a0 0x7f3648068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.333+0000 7f365b7fe640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36480664a0 0x7f3648068960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f364c0017b0 tx=0x7f364c004810 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:23.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.337+0000 7f3643fff640 1 -- 172.21.15.167:0/4213011684 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36500ebba0 con 0x7f365c155ac0 2023-11-28T21:05:23.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.513+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f365c075c90 con 0x7f365c155ac0 2023-11-28T21:05:23.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.513+0000 7f3643fff640 1 -- 172.21.15.167:0/4213011684 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6547 (secure 0 0 0) 0x7f36500ef1c0 con 0x7f365c155ac0 2023-11-28T21:05:23.516 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:05:23.517 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T21:04:07.225155+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4278,"mds_2":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":390,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4278":{"gid":4278,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.167:6837/1234930245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":1234930245},{"type":"v1","addr":"172.21.15.167:6837","nonce":1234930245}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":387,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:05:23.517 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 37 2023-11-28T21:05:23.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36480664a0 msgr2=0x7f3648068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36480664a0 0x7f3648068960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f364c0017b0 tx=0x7f364c004810 comp rx=0 tx=0).stop 2023-11-28T21:05:23.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f365c155ac0 msgr2=0x7f365c0c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f365c155ac0 0x7f365c0c6540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3650005040 tx=0x7f3644003700 comp rx=0 tx=0).stop 2023-11-28T21:05:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 shutdown_connections 2023-11-28T21:05:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f36480664a0 0x7f3648068960 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f365c149be0 0x7f365c14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f365c155ac0 0x7f365c0c6540 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 --2- 172.21.15.167:0/4213011684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3644004090 0x7f365c1ef640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 >> 172.21.15.167:0/4213011684 conn(0x7f365c0cb1e0 msgr2=0x7f365c071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:23.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 shutdown_connections 2023-11-28T21:05:23.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.517+0000 7f3661a79640 1 -- 172.21.15.167:0/4213011684 wait complete. 2023-11-28T21:05:23.534 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2023-11-28T21:05:23.535 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2023-11-28T21:05:23.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0859cfe640 1 Processor -- start 2023-11-28T21:05:23.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0859cfe640 1 -- start start 2023-11-28T21:05:23.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0859cfe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08540cfc40 0x7f08540cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0859cfe640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085415ac00 con 0x7f08540cf860 2023-11-28T21:05:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0859cfe640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08540cbd60 con 0x7f0854153ae0 2023-11-28T21:05:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0859cfe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0854159ff0 con 0x7f08540cfc40 2023-11-28T21:05:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f08537fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f08540cf860 0x7f08540ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50908/0 (socket says 172.21.15.167:50908) 2023-11-28T21:05:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f08537fe640 1 -- 172.21.15.167:0/2398693364 learned_addr learned my addr 172.21.15.167:0/2398693364 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084919472 0 0) 0x7f085415ac00 con 0x7f08540cf860 2023-11-28T21:05:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f084affd640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08540cfc40 0x7f08540cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0840003530 con 0x7f08540cf860 2023-11-28T21:05:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101129452 0 0) 0x7f0840003530 con 0x7f08540cf860 2023-11-28T21:05:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08540cfc40 msgr2=0x7f08540cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08540cfc40 0x7f08540cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 >> v1:172.21.15.178:6789/0 conn(0x7f0854153ae0 legacy=0x7f085415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085415a2d0 con 0x7f08540cf860 2023-11-28T21:05:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f0844001680 con 0x7f08540cf860 2023-11-28T21:05:23.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 >> v1:172.21.15.167:6789/0 conn(0x7f08540cf860 legacy=0x7f08540ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08540cfc40 0x7f08400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f08400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0840004d10 0x7f0840005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0854159ff0 con 0x7f0840003f30 2023-11-28T21:05:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084000ba70 con 0x7f0840004d10 2023-11-28T21:05:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084000bc30 con 0x7f08540cfc40 2023-11-28T21:05:23.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f084affd640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f08400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f08537fe640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08540cfc40 0x7f08400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0853fff640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0840004d10 0x7f0840005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f084affd640 1 -- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08540cfc40 msgr2=0x7f08400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f084affd640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08540cfc40 0x7f08400039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f084affd640 1 -- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0840004d10 msgr2=0x7f0840005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f084affd640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0840004d10 0x7f0840005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f084affd640 1 -- 172.21.15.167:0/2398693364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0840003530 con 0x7f0840003f30 2023-11-28T21:05:23.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.641+0000 7f0853fff640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0840004d10 0x7f0840005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f084affd640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f08400047d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f083c009ae0 tx=0x7f083c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ce021658a0939f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c0a5640 con 0x7f0840003f30 2023-11-28T21:05:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c0a57a0 con 0x7f0840003f30 2023-11-28T21:05:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0852ffd640 1 -- 172.21.15.167:0/2398693364 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c0a5b50 con 0x7f0840003f30 2023-11-28T21:05:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 -- 172.21.15.167:0/2398693364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 msgr2=0x7f08400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 --2- 172.21.15.167:0/2398693364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f08400047d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f083c009ae0 tx=0x7f083c01ca50 comp rx=0 tx=0).stop 2023-11-28T21:05:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0853fff640 1 -- 172.21.15.167:0/2398693364 reap_dead start 2023-11-28T21:05:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 -- 172.21.15.167:0/2398693364 shutdown_connections 2023-11-28T21:05:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 -- 172.21.15.167:0/2398693364 >> 172.21.15.167:0/2398693364 conn(0x7f085406c1f0 msgr2=0x7f0854071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 -- 172.21.15.167:0/2398693364 shutdown_connections 2023-11-28T21:05:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 -- 172.21.15.167:0/2398693364 wait complete. 2023-11-28T21:05:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 Processor -- start 2023-11-28T21:05:23.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 -- start start 2023-11-28T21:05:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f085414d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08541e4380 0x7f085414ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.645+0000 7f0859cfe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0854147650 0x7f08540cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0859cfe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0854157d50 con 0x7f0840003f30 2023-11-28T21:05:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0859cfe640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085414dff0 con 0x7f0854147650 2023-11-28T21:05:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0859cfe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0854147bb0 con 0x7f08541e4380 2023-11-28T21:05:23.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f08537fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f085414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f08537fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f085414d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56766/0 (socket says 172.21.15.167:56766) 2023-11-28T21:05:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f08537fe640 1 -- 172.21.15.167:0/1901579912 learned_addr learned my addr 172.21.15.167:0/1901579912 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0853fff640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0854147650 0x7f08540cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f084affd640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08541e4380 0x7f085414ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f08537fe640 1 -- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08541e4380 msgr2=0x7f085414ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f08537fe640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08541e4380 0x7f085414ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f08537fe640 1 -- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0854147650 msgr2=0x7f08540cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f08537fe640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0854147650 0x7f08540cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f08537fe640 1 -- 172.21.15.167:0/1901579912 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854148660 con 0x7f0840003f30 2023-11-28T21:05:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f084affd640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08541e4380 0x7f085414ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f08537fe640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f085414d850 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0844001210 tx=0x7f084400e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0850ff9640 1 -- 172.21.15.167:0/1901579912 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844010e10 con 0x7f0840003f30 2023-11-28T21:05:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0850ff9640 1 -- 172.21.15.167:0/1901579912 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08440143a0 con 0x7f0840003f30 2023-11-28T21:05:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085414ef80 con 0x7f0840003f30 2023-11-28T21:05:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0850ff9640 1 -- 172.21.15.167:0/1901579912 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844014750 con 0x7f0840003f30 2023-11-28T21:05:23.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085414e240 con 0x7f0840003f30 2023-11-28T21:05:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0854151380 con 0x7f0840003f30 2023-11-28T21:05:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0850ff9640 1 -- 172.21.15.167:0/1901579912 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08440148b0 con 0x7f0840003f30 2023-11-28T21:05:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0850ff9640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0834066470 0x7f0834068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f0850ff9640 1 -- 172.21.15.167:0/1901579912 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f08440871d0 con 0x7f0840003f30 2023-11-28T21:05:23.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f084affd640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0834066470 0x7f0834068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:23.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.649+0000 7f084affd640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0834066470 0x7f0834068930 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f083c0af000 tx=0x7f083c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:23.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.653+0000 7f0850ff9640 1 -- 172.21.15.167:0/1901579912 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f08440542f0 con 0x7f0840003f30 2023-11-28T21:05:23.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.849+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0854075c90 con 0x7f0840003f30 2023-11-28T21:05:23.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.849+0000 7f0850ff9640 1 -- 172.21.15.167:0/1901579912 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1553 (secure 0 0 0) 0x7f0844057910 con 0x7f0840003f30 2023-11-28T21:05:23.853 INFO:teuthology.orchestra.run.smithi167.stdout:{"election_epoch":206,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","modified":"2023-11-28T20:37:16.182016Z","created":"2023-11-28T20:37:16.182016Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3301","nonce":0},{"type":"v1","addr":"172.21.15.178:6790","nonce":0}]},"addr":"172.21.15.178:6790/0","public_addr":"172.21.15.178:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2023-11-28T21:05:23.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0834066470 msgr2=0x7f0834068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0834066470 0x7f0834068930 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f083c0af000 tx=0x7f083c0046d0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 msgr2=0x7f085414d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f085414d850 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0844001210 tx=0x7f084400e4d0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 shutdown_connections 2023-11-28T21:05:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f0834066470 0x7f0834068930 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0854147650 0x7f08540cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08541e4380 0x7f085414ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 --2- 172.21.15.167:0/1901579912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0840003f30 0x7f085414d850 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 >> 172.21.15.167:0/1901579912 conn(0x7f085406c1f0 msgr2=0x7f08540b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 shutdown_connections 2023-11-28T21:05:23.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:23.853+0000 7f0859cfe640 1 -- 172.21.15.167:0/1901579912 wait complete. 2023-11-28T21:05:23.871 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2023-11-28T21:05:23.871 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-28T21:05:23.880 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-28T21:05:23.880 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-11-28T21:05:23.881 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:05:23.887 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354680k,nr_inodes=4088670,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3124 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-11-28T21:05:23.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:05:23.887 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2023-11-28T21:05:23.934 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T21:05:23.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:05:23.935 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:05:23.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:05:23.990 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2023-11-28T21:05:24.167 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T21:05:24.179 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T21:05:24.179 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:05:24.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.285+0000 7fc99b1f8640 1 Processor -- start 2023-11-28T21:05:24.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.285+0000 7fc99b1f8640 1 -- start start 2023-11-28T21:05:24.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc99b1f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 0x7fc994157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc99b1f8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc9940c4510 0x7fc99406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc99b1f8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9940c4940 con 0x7fc9940c6ff0 2023-11-28T21:05:24.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc99b1f8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9940c62f0 con 0x7fc9940c4510 2023-11-28T21:05:24.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc99b1f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9940c6ac0 con 0x7fc994150b40 2023-11-28T21:05:24.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc998f94640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 0x7fc994157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc999795640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc9940c4510 0x7fc99406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc999795640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc9940c4510 0x7fc99406a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55576/0 (socket says 172.21.15.167:55576) 2023-11-28T21:05:24.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc999795640 1 -- 172.21.15.167:0/1433660099 learned_addr learned my addr 172.21.15.167:0/1433660099 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:24.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc998f94640 1 -- 172.21.15.167:0/1433660099 >> v2:172.21.15.178:3300/0 conn(0x7fc9940c4510 msgr2=0x7fc99406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:24.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc998f94640 1 --2- 172.21.15.167:0/1433660099 >> v2:172.21.15.178:3300/0 conn(0x7fc9940c4510 0x7fc99406a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc998f94640 1 -- 172.21.15.167:0/1433660099 >> v1:172.21.15.178:6789/0 conn(0x7fc9940c6ff0 legacy=0x7fc9940c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc998f94640 1 -- 172.21.15.167:0/1433660099 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9940c6500 con 0x7fc994150b40 2023-11-28T21:05:24.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc998f94640 1 --2- 172.21.15.167:0/1433660099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 0x7fc994157560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc9900097c0 tx=0x7fc99001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5098aeb96d8cc764 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:24.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc98b7fe640 1 -- 172.21.15.167:0/1433660099 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900ad660 con 0x7fc994150b40 2023-11-28T21:05:24.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc98b7fe640 1 -- 172.21.15.167:0/1433660099 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9900ad7c0 con 0x7fc994150b40 2023-11-28T21:05:24.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.289+0000 7fc98b7fe640 1 -- 172.21.15.167:0/1433660099 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900adb50 con 0x7fc994150b40 2023-11-28T21:05:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- 172.21.15.167:0/1433660099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 msgr2=0x7fc994157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 --2- 172.21.15.167:0/1433660099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 0x7fc994157560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc9900097c0 tx=0x7fc99001c450 comp rx=0 tx=0).stop 2023-11-28T21:05:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- 172.21.15.167:0/1433660099 shutdown_connections 2023-11-28T21:05:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 --2- 172.21.15.167:0/1433660099 >> v2:172.21.15.178:3300/0 conn(0x7fc9940c4510 0x7fc99406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 --2- 172.21.15.167:0/1433660099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 0x7fc994157560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- 172.21.15.167:0/1433660099 >> 172.21.15.167:0/1433660099 conn(0x7fc9940cb1e0 msgr2=0x7fc9940cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:24.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- 172.21.15.167:0/1433660099 shutdown_connections 2023-11-28T21:05:24.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- 172.21.15.167:0/1433660099 wait complete. 2023-11-28T21:05:24.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 Processor -- start 2023-11-28T21:05:24.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- start start 2023-11-28T21:05:24.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9940c4510 0x7fc994070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9940c6ff0 0x7fc994145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 0x7fc9941520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994071080 con 0x7fc9940c6ff0 2023-11-28T21:05:24.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994147230 con 0x7fc9940c4510 2023-11-28T21:05:24.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9941448b0 con 0x7fc994150b40 2023-11-28T21:05:24.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc98bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9940c6ff0 0x7fc994145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc98bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9940c6ff0 0x7fc994145510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56772/0 (socket says 172.21.15.167:56772) 2023-11-28T21:05:24.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc98bfff640 1 -- 172.21.15.167:0/478052066 learned_addr learned my addr 172.21.15.167:0/478052066 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:24.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc998f94640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9940c4510 0x7fc994070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc999795640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 0x7fc9941520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc98bfff640 1 -- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 msgr2=0x7fc9941520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc98bfff640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 0x7fc9941520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc98bfff640 1 -- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9940c4510 msgr2=0x7fc994070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc98bfff640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9940c4510 0x7fc994070b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc98bfff640 1 -- 172.21.15.167:0/478052066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc990009420 con 0x7fc9940c6ff0 2023-11-28T21:05:24.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc998f94640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9940c4510 0x7fc994070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:05:24.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc98bfff640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9940c6ff0 0x7fc994145510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c420 tx=0x7fc98400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:24.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc9897fa640 1 -- 172.21.15.167:0/478052066 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840052d0 con 0x7fc9940c6ff0 2023-11-28T21:05:24.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc9897fa640 1 -- 172.21.15.167:0/478052066 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc984005430 con 0x7fc9940c6ff0 2023-11-28T21:05:24.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc994144b90 con 0x7fc9940c6ff0 2023-11-28T21:05:24.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc9897fa640 1 -- 172.21.15.167:0/478052066 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984007260 con 0x7fc9940c6ff0 2023-11-28T21:05:24.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.293+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc994146750 con 0x7fc9940c6ff0 2023-11-28T21:05:24.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.297+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9940682c0 con 0x7fc9940c6ff0 2023-11-28T21:05:24.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.297+0000 7fc9897fa640 1 -- 172.21.15.167:0/478052066 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc9840073c0 con 0x7fc9940c6ff0 2023-11-28T21:05:24.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.297+0000 7fc9897fa640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9800664a0 0x7fc980068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.297+0000 7fc9897fa640 1 -- 172.21.15.167:0/478052066 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc9840836e0 con 0x7fc9940c6ff0 2023-11-28T21:05:24.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.297+0000 7fc998f94640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9800664a0 0x7fc980068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.297+0000 7fc998f94640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9800664a0 0x7fc980068960 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc9900af000 tx=0x7fc9900a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:24.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.301+0000 7fc9897fa640 1 -- 172.21.15.167:0/478052066 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9840506d0 con 0x7fc9940c6ff0 2023-11-28T21:05:24.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.445+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc994157040 con 0x7fc9800664a0 2023-11-28T21:05:24.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.473+0000 7fc9897fa640 1 -- 172.21.15.167:0/478052066 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373433 (secure 0 0 0) 0x7fc9900ad930 con 0x7fc9800664a0 2023-11-28T21:05:24.480 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:05:24.482 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T21:05:24.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9800664a0 msgr2=0x7fc980068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9800664a0 0x7fc980068960 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc9900af000 tx=0x7fc9900a7000 comp rx=0 tx=0).stop 2023-11-28T21:05:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9940c6ff0 msgr2=0x7fc994145510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9940c6ff0 0x7fc994145510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c420 tx=0x7fc98400c8e0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 shutdown_connections 2023-11-28T21:05:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc9800664a0 0x7fc980068960 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994150b40 0x7fc9941520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9940c6ff0 0x7fc994145510 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 --2- 172.21.15.167:0/478052066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9940c4510 0x7fc994070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 >> 172.21.15.167:0/478052066 conn(0x7fc9940cb1e0 msgr2=0x7fc99414fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 shutdown_connections 2023-11-28T21:05:24.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.477+0000 7fc99b1f8640 1 -- 172.21.15.167:0/478052066 wait complete. 2023-11-28T21:05:24.496 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2023-11-28T21:05:24.123227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573738351,"num_objects":18293,"num_object_clones":8054,"num_object_copies":71918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18293,"num_whiteouts":7974,"num_read":2751,"num_read_kb":105055,"num_write":63161,"num_write_kb":1870913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98493,"ondisk_log_size":98493,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4529000,"kb_used_data":3173160,"kb_used_omap":12,"kb_used_meta":1355763,"kb_avail":750445720,"statfs":{"total":773094113280,"available":768456417280,"internally_reserved":0,"allocated":3249315840,"data_stored":3246905922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1388301872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005405"},"pg_stats":[{"pgid":"2.1f","version":"51'546","reported_seq":602,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:20.520764+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T21:03:20.520764+0000","last_peered":"2023-11-28T21:03:20.520764+0000","last_clean":"2023-11-28T21:03:20.520764+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T21:03:20.520764+0000","last_undegraded":"2023-11-28T21:03:20.520764+0000","last_fullsized":"2023-11-28T21:03:20.520764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":13,"num_write":501,"num_write_kb":29002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'428","reported_seq":2515,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495354+0000","last_change":"2023-11-28T20:44:35.608330+0000","last_active":"2023-11-28T21:04:30.495354+0000","last_peered":"2023-11-28T21:04:30.495354+0000","last_clean":"2023-11-28T21:04:30.495354+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T21:04:30.495354+0000","last_undegraded":"2023-11-28T21:04:30.495354+0000","last_fullsized":"2023-11-28T21:04:30.495354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:36.704510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012127499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"51'1858","reported_seq":3698,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:41.608342+0000","last_change":"2023-11-28T20:44:35.612490+0000","last_active":"2023-11-28T21:02:41.608342+0000","last_peered":"2023-11-28T21:02:41.608342+0000","last_clean":"2023-11-28T21:02:41.608342+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T21:02:41.608342+0000","last_undegraded":"2023-11-28T21:02:41.608342+0000","last_fullsized":"2023-11-28T21:02:41.608342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:27.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016916996,"stat_sum":{"num_bytes":12268315,"num_objects":556,"num_object_clones":279,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":239,"num_read":31,"num_read_kb":4126,"num_write":1561,"num_write_kb":24667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"51'611","reported_seq":667,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:26.606132+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T21:02:26.606132+0000","last_peered":"2023-11-28T21:02:26.606132+0000","last_clean":"2023-11-28T21:02:26.606132+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T21:02:26.606132+0000","last_undegraded":"2023-11-28T21:02:26.606132+0000","last_fullsized":"2023-11-28T21:02:26.606132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":546,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"51'383","reported_seq":2477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.563998+0000","last_change":"2023-11-28T20:44:35.603931+0000","last_active":"2023-11-28T21:04:28.563998+0000","last_peered":"2023-11-28T21:04:28.563998+0000","last_clean":"2023-11-28T21:04:28.563998+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T21:04:28.563998+0000","last_undegraded":"2023-11-28T21:04:28.563998+0000","last_fullsized":"2023-11-28T21:04:28.563998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:34.323314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010031783000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"51'1843","reported_seq":3720,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.579659+0000","last_change":"2023-11-28T20:44:35.541215+0000","last_active":"2023-11-28T21:02:35.579659+0000","last_peered":"2023-11-28T21:02:35.579659+0000","last_clean":"2023-11-28T21:02:35.579659+0000","last_became_active":"2023-11-28T20:39:01.389891+0000","last_became_peered":"2023-11-28T20:39:01.389891+0000","last_unstale":"2023-11-28T21:02:35.579659+0000","last_undegraded":"2023-11-28T21:02:35.579659+0000","last_fullsized":"2023-11-28T21:02:35.579659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:49.951369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084388650000000003,"stat_sum":{"num_bytes":22024896,"num_objects":578,"num_object_clones":267,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":267,"num_read":47,"num_read_kb":8236,"num_write":1555,"num_write_kb":33440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"51'579","reported_seq":631,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.546713+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T21:00:50.546713+0000","last_peered":"2023-11-28T21:00:50.546713+0000","last_clean":"2023-11-28T21:00:50.546713+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T21:00:50.546713+0000","last_undegraded":"2023-11-28T21:00:50.546713+0000","last_fullsized":"2023-11-28T21:00:50.546713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"51'396","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173832+0000","last_change":"2023-11-28T20:44:35.614099+0000","last_active":"2023-11-28T21:04:23.173832+0000","last_peered":"2023-11-28T21:04:23.173832+0000","last_clean":"2023-11-28T21:04:23.173832+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T21:04:23.173832+0000","last_undegraded":"2023-11-28T21:04:23.173832+0000","last_fullsized":"2023-11-28T21:04:23.173832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:34.672454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016140509000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1696","reported_seq":3582,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558555+0000","last_change":"2023-11-28T20:44:35.542225+0000","last_active":"2023-11-28T21:00:55.558555+0000","last_peered":"2023-11-28T21:00:55.558555+0000","last_clean":"2023-11-28T21:00:55.558555+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T21:00:55.558555+0000","last_undegraded":"2023-11-28T21:00:55.558555+0000","last_fullsized":"2023-11-28T21:00:55.558555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:49.565280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0093789649999999995,"stat_sum":{"num_bytes":11818887,"num_objects":514,"num_object_clones":236,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":236,"num_read":34,"num_read_kb":34,"num_write":1442,"num_write_kb":18567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"51'404","reported_seq":457,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.546585+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T21:00:50.546585+0000","last_peered":"2023-11-28T21:00:50.546585+0000","last_clean":"2023-11-28T21:00:50.546585+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T21:00:50.546585+0000","last_undegraded":"2023-11-28T21:00:50.546585+0000","last_fullsized":"2023-11-28T21:00:50.546585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":354,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"51'394","reported_seq":2485,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173820+0000","last_change":"2023-11-28T20:44:35.618164+0000","last_active":"2023-11-28T21:04:23.173820+0000","last_peered":"2023-11-28T21:04:23.173820+0000","last_clean":"2023-11-28T21:04:23.173820+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T21:04:23.173820+0000","last_undegraded":"2023-11-28T21:04:23.173820+0000","last_fullsized":"2023-11-28T21:04:23.173820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:10.074109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019881585,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"51'1748","reported_seq":3613,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558505+0000","last_change":"2023-11-28T20:44:35.542475+0000","last_active":"2023-11-28T21:00:55.558505+0000","last_peered":"2023-11-28T21:00:55.558505+0000","last_clean":"2023-11-28T21:00:55.558505+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T21:00:55.558505+0000","last_undegraded":"2023-11-28T21:00:55.558505+0000","last_fullsized":"2023-11-28T21:00:55.558505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:42.606296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092901790000000008,"stat_sum":{"num_bytes":16892767,"num_objects":571,"num_object_clones":263,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":571,"num_whiteouts":263,"num_read":40,"num_read_kb":48,"num_write":1465,"num_write_kb":20221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"51'418","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.174499+0000","last_change":"2023-11-28T20:44:35.616278+0000","last_active":"2023-11-28T21:04:23.174499+0000","last_peered":"2023-11-28T21:04:23.174499+0000","last_clean":"2023-11-28T21:04:23.174499+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T21:04:23.174499+0000","last_undegraded":"2023-11-28T21:04:23.174499+0000","last_fullsized":"2023-11-28T21:04:23.174499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:02.355511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017860755999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"51'336","reported_seq":391,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:05.575243+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T21:03:05.575243+0000","last_peered":"2023-11-28T21:03:05.575243+0000","last_clean":"2023-11-28T21:03:05.575243+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T21:03:05.575243+0000","last_undegraded":"2023-11-28T21:03:05.575243+0000","last_fullsized":"2023-11-28T21:03:05.575243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":274,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"51'1713","reported_seq":3605,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558652+0000","last_change":"2023-11-28T20:44:35.546423+0000","last_active":"2023-11-28T21:00:55.558652+0000","last_peered":"2023-11-28T21:00:55.558652+0000","last_clean":"2023-11-28T21:00:55.558652+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T21:00:55.558652+0000","last_undegraded":"2023-11-28T21:00:55.558652+0000","last_fullsized":"2023-11-28T21:00:55.558652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:21.576866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011349794999999999,"stat_sum":{"num_bytes":42075033,"num_objects":519,"num_object_clones":229,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":229,"num_read":33,"num_read_kb":8223,"num_write":1463,"num_write_kb":57658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"51'395","reported_seq":2488,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.567073+0000","last_change":"2023-11-28T20:44:35.615271+0000","last_active":"2023-11-28T21:04:28.567073+0000","last_peered":"2023-11-28T21:04:28.567073+0000","last_clean":"2023-11-28T21:04:28.567073+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T21:04:28.567073+0000","last_undegraded":"2023-11-28T21:04:28.567073+0000","last_fullsized":"2023-11-28T21:04:28.567073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:18.118595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018528307000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"51'468","reported_seq":523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:11.726550+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T21:02:11.726550+0000","last_peered":"2023-11-28T21:02:11.726550+0000","last_clean":"2023-11-28T21:02:11.726550+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T21:02:11.726550+0000","last_undegraded":"2023-11-28T21:02:11.726550+0000","last_fullsized":"2023-11-28T21:02:11.726550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2,"num_read_kb":11,"num_write":693,"num_write_kb":25655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'1827","reported_seq":3709,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558612+0000","last_change":"2023-11-28T20:44:35.543575+0000","last_active":"2023-11-28T21:00:55.558612+0000","last_peered":"2023-11-28T21:00:55.558612+0000","last_clean":"2023-11-28T21:00:55.558612+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T21:00:55.558612+0000","last_undegraded":"2023-11-28T21:00:55.558612+0000","last_fullsized":"2023-11-28T21:00:55.558612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:19.718029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010051028,"stat_sum":{"num_bytes":36081004,"num_objects":549,"num_object_clones":242,"num_object_copies":2196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":242,"num_read":36,"num_read_kb":4131,"num_write":1572,"num_write_kb":47387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"51'429","reported_seq":2522,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.496490+0000","last_change":"2023-11-28T20:44:35.615648+0000","last_active":"2023-11-28T21:04:30.496490+0000","last_peered":"2023-11-28T21:04:30.496490+0000","last_clean":"2023-11-28T21:04:30.496490+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T21:04:30.496490+0000","last_undegraded":"2023-11-28T21:04:30.496490+0000","last_fullsized":"2023-11-28T21:04:30.496490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:53.863754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018799937999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"51'666","reported_seq":721,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:11.726510+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T21:02:11.726510+0000","last_peered":"2023-11-28T21:02:11.726510+0000","last_clean":"2023-11-28T21:02:11.726510+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T21:02:11.726510+0000","last_undegraded":"2023-11-28T21:02:11.726510+0000","last_fullsized":"2023-11-28T21:02:11.726510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":627,"num_write_kb":16946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"51'1842","reported_seq":3706,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:56.717412+0000","last_change":"2023-11-28T20:44:35.608957+0000","last_active":"2023-11-28T21:00:56.717412+0000","last_peered":"2023-11-28T21:00:56.717412+0000","last_clean":"2023-11-28T21:00:56.717412+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T21:00:56.717412+0000","last_undegraded":"2023-11-28T21:00:56.717412+0000","last_fullsized":"2023-11-28T21:00:56.717412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:59.559204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011785257,"stat_sum":{"num_bytes":33810901,"num_objects":586,"num_object_clones":259,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":259,"num_read":37,"num_read_kb":8227,"num_write":1558,"num_write_kb":44779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"51'406","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491184+0000","last_change":"2023-11-28T20:44:35.545606+0000","last_active":"2023-11-28T21:04:30.491184+0000","last_peered":"2023-11-28T21:04:30.491184+0000","last_clean":"2023-11-28T21:04:30.491184+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T21:04:30.491184+0000","last_undegraded":"2023-11-28T21:04:30.491184+0000","last_fullsized":"2023-11-28T21:04:30.491184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:54.158095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011190047999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"51'485","reported_seq":540,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:10.563468+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T21:02:10.563468+0000","last_peered":"2023-11-28T21:02:10.563468+0000","last_clean":"2023-11-28T21:02:10.563468+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T21:02:10.563468+0000","last_undegraded":"2023-11-28T21:02:10.563468+0000","last_fullsized":"2023-11-28T21:02:10.563468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":18,"num_write":441,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"51'1805","reported_seq":3653,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558679+0000","last_change":"2023-11-28T20:44:35.544665+0000","last_active":"2023-11-28T21:00:55.558679+0000","last_peered":"2023-11-28T21:00:55.558679+0000","last_clean":"2023-11-28T21:00:55.558679+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T21:00:55.558679+0000","last_undegraded":"2023-11-28T21:00:55.558679+0000","last_fullsized":"2023-11-28T21:00:55.558679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:22.582437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010413970999999999,"stat_sum":{"num_bytes":29462623,"num_objects":568,"num_object_clones":283,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":243,"num_read":43,"num_read_kb":8342,"num_write":1501,"num_write_kb":36747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"51'401","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.496089+0000","last_change":"2023-11-28T20:44:35.608781+0000","last_active":"2023-11-28T21:04:30.496089+0000","last_peered":"2023-11-28T21:04:30.496089+0000","last_clean":"2023-11-28T21:04:30.496089+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T21:04:30.496089+0000","last_undegraded":"2023-11-28T21:04:30.496089+0000","last_fullsized":"2023-11-28T21:04:30.496089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:44.493316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013760692,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"51'145","reported_seq":202,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:10.559549+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T21:02:10.559549+0000","last_peered":"2023-11-28T21:02:10.559549+0000","last_clean":"2023-11-28T21:02:10.559549+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T21:02:10.559549+0000","last_undegraded":"2023-11-28T21:02:10.559549+0000","last_fullsized":"2023-11-28T21:02:10.559549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":6,"num_read_kb":32,"num_write":106,"num_write_kb":8401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"51'1903","reported_seq":3757,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.563869+0000","last_change":"2023-11-28T20:44:35.542749+0000","last_active":"2023-11-28T21:01:20.563869+0000","last_peered":"2023-11-28T21:01:20.563869+0000","last_clean":"2023-11-28T21:01:20.563869+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T21:01:20.563869+0000","last_undegraded":"2023-11-28T21:01:20.563869+0000","last_fullsized":"2023-11-28T21:01:20.563869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:36:45.378771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092734619999999997,"stat_sum":{"num_bytes":42280101,"num_objects":591,"num_object_clones":269,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":269,"num_read":33,"num_read_kb":4128,"num_write":1621,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"51'381","reported_seq":2474,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564479+0000","last_change":"2023-11-28T20:44:35.614397+0000","last_active":"2023-11-28T21:04:28.564479+0000","last_peered":"2023-11-28T21:04:28.564479+0000","last_clean":"2023-11-28T21:04:28.564479+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T21:04:28.564479+0000","last_undegraded":"2023-11-28T21:04:28.564479+0000","last_fullsized":"2023-11-28T21:04:28.564479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:21.145648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017915146,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"51'420","reported_seq":477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495460+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T21:04:30.495460+0000","last_peered":"2023-11-28T21:04:30.495460+0000","last_clean":"2023-11-28T21:04:30.495460+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T21:04:30.495460+0000","last_undegraded":"2023-11-28T21:04:30.495460+0000","last_fullsized":"2023-11-28T21:04:30.495460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12049925,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":6,"num_read_kb":23,"num_write":692,"num_write_kb":13743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"51'1784","reported_seq":3657,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:31.606632+0000","last_change":"2023-11-28T20:44:35.612546+0000","last_active":"2023-11-28T21:02:31.606632+0000","last_peered":"2023-11-28T21:02:31.606632+0000","last_clean":"2023-11-28T21:02:31.606632+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T21:02:31.606632+0000","last_undegraded":"2023-11-28T21:02:31.606632+0000","last_fullsized":"2023-11-28T21:02:31.606632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:05.737793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016539027000000001,"stat_sum":{"num_bytes":21707636,"num_objects":558,"num_object_clones":259,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":558,"num_whiteouts":259,"num_read":41,"num_read_kb":41,"num_write":1502,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"51'425","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.493811+0000","last_change":"2023-11-28T20:44:35.607913+0000","last_active":"2023-11-28T21:04:30.493811+0000","last_peered":"2023-11-28T21:04:30.493811+0000","last_clean":"2023-11-28T21:04:30.493811+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T21:04:30.493811+0000","last_undegraded":"2023-11-28T21:04:30.493811+0000","last_fullsized":"2023-11-28T21:04:30.493811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:48.810598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014316661,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'350","reported_seq":404,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.553069+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T21:01:20.553069+0000","last_peered":"2023-11-28T21:01:20.553069+0000","last_clean":"2023-11-28T21:01:20.553069+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T21:01:20.553069+0000","last_undegraded":"2023-11-28T21:01:20.553069+0000","last_fullsized":"2023-11-28T21:01:20.553069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360150,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":28962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"51'1789","reported_seq":3654,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.505359+0000","last_change":"2023-11-28T20:44:35.610536+0000","last_active":"2023-11-28T21:01:20.505359+0000","last_peered":"2023-11-28T21:01:20.505359+0000","last_clean":"2023-11-28T21:01:20.505359+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T21:01:20.505359+0000","last_undegraded":"2023-11-28T21:01:20.505359+0000","last_fullsized":"2023-11-28T21:01:20.505359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:15:04.264103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014620091,"stat_sum":{"num_bytes":29165465,"num_objects":561,"num_object_clones":251,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":561,"num_whiteouts":251,"num_read":26,"num_read_kb":26,"num_write":1521,"num_write_kb":34762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"51'414","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.508165+0000","last_change":"2023-11-28T20:44:35.624605+0000","last_active":"2023-11-28T21:04:26.508165+0000","last_peered":"2023-11-28T21:04:26.508165+0000","last_clean":"2023-11-28T21:04:26.508165+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T21:04:26.508165+0000","last_undegraded":"2023-11-28T21:04:26.508165+0000","last_fullsized":"2023-11-28T21:04:26.508165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:38.051342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025775551000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"51'259","reported_seq":313,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:16.719823+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T21:01:16.719823+0000","last_peered":"2023-11-28T21:01:16.719823+0000","last_clean":"2023-11-28T21:01:16.719823+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T21:01:16.719823+0000","last_undegraded":"2023-11-28T21:01:16.719823+0000","last_fullsized":"2023-11-28T21:01:16.719823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":24764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"51'1827","reported_seq":3688,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:56.519697+0000","last_change":"2023-11-28T20:44:35.529967+0000","last_active":"2023-11-28T21:01:56.519697+0000","last_peered":"2023-11-28T21:01:56.519697+0000","last_clean":"2023-11-28T21:01:56.519697+0000","last_became_active":"2023-11-28T20:39:01.570987+0000","last_became_peered":"2023-11-28T20:39:01.570987+0000","last_unstale":"2023-11-28T21:01:56.519697+0000","last_undegraded":"2023-11-28T21:01:56.519697+0000","last_fullsized":"2023-11-28T21:01:56.519697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:41.602286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017641899999999999,"stat_sum":{"num_bytes":29603349,"num_objects":551,"num_object_clones":257,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":257,"num_read":32,"num_read_kb":32,"num_write":1550,"num_write_kb":37188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"51'420","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.557069+0000","last_change":"2023-11-28T20:44:35.545769+0000","last_active":"2023-11-28T21:04:28.557069+0000","last_peered":"2023-11-28T21:04:28.557069+0000","last_clean":"2023-11-28T21:04:28.557069+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T21:04:28.557069+0000","last_undegraded":"2023-11-28T21:04:28.557069+0000","last_fullsized":"2023-11-28T21:04:28.557069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:16.077909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010944188000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"51'420","reported_seq":475,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:15.557955+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T21:01:15.557955+0000","last_peered":"2023-11-28T21:01:15.557955+0000","last_clean":"2023-11-28T21:01:15.557955+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T21:01:15.557955+0000","last_undegraded":"2023-11-28T21:01:15.557955+0000","last_fullsized":"2023-11-28T21:01:15.557955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":379,"num_write_kb":16755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"51'1754","reported_seq":3629,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:21.720349+0000","last_change":"2023-11-28T20:44:35.606459+0000","last_active":"2023-11-28T21:01:21.720349+0000","last_peered":"2023-11-28T21:01:21.720349+0000","last_clean":"2023-11-28T21:01:21.720349+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T21:01:21.720349+0000","last_undegraded":"2023-11-28T21:01:21.720349+0000","last_fullsized":"2023-11-28T21:01:21.720349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:40.726057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012892727999999999,"stat_sum":{"num_bytes":30726234,"num_objects":547,"num_object_clones":244,"num_object_copies":2188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":244,"num_read":30,"num_read_kb":7398,"num_write":1499,"num_write_kb":38104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'416","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494824+0000","last_change":"2023-11-28T20:44:35.602022+0000","last_active":"2023-11-28T21:04:30.494824+0000","last_peered":"2023-11-28T21:04:30.494824+0000","last_clean":"2023-11-28T21:04:30.494824+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T21:04:30.494824+0000","last_undegraded":"2023-11-28T21:04:30.494824+0000","last_fullsized":"2023-11-28T21:04:30.494824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:56:28.293643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0088104640000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"51'904","reported_seq":1395,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.520162+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T21:04:23.520162+0000","last_peered":"2023-11-28T21:04:23.520162+0000","last_clean":"2023-11-28T21:04:23.520162+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T21:04:23.520162+0000","last_undegraded":"2023-11-28T21:04:23.520162+0000","last_fullsized":"2023-11-28T21:04:23.520162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26750948,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":437,"num_read_kb":1190,"num_write":846,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"51'1696","reported_seq":3563,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:16.727464+0000","last_change":"2023-11-28T20:44:35.609122+0000","last_active":"2023-11-28T21:02:16.727464+0000","last_peered":"2023-11-28T21:02:16.727464+0000","last_clean":"2023-11-28T21:02:16.727464+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T21:02:16.727464+0000","last_undegraded":"2023-11-28T21:02:16.727464+0000","last_fullsized":"2023-11-28T21:02:16.727464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:02.039768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744523999999999,"stat_sum":{"num_bytes":4888539,"num_objects":545,"num_object_clones":249,"num_object_copies":2180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":249,"num_read":26,"num_read_kb":26,"num_write":1427,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'419","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559875+0000","last_change":"2023-11-28T20:44:35.607743+0000","last_active":"2023-11-28T21:04:28.559875+0000","last_peered":"2023-11-28T21:04:28.559875+0000","last_clean":"2023-11-28T21:04:28.559875+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T21:04:28.559875+0000","last_undegraded":"2023-11-28T21:04:28.559875+0000","last_fullsized":"2023-11-28T21:04:28.559875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:14.103778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013248289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"51'468","reported_seq":523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:25.566548+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T21:02:25.566548+0000","last_peered":"2023-11-28T21:02:25.566548+0000","last_clean":"2023-11-28T21:02:25.566548+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T21:02:25.566548+0000","last_undegraded":"2023-11-28T21:02:25.566548+0000","last_fullsized":"2023-11-28T21:02:25.566548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"51'1786","reported_seq":3671,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.512440+0000","last_change":"2023-11-28T20:44:35.607810+0000","last_active":"2023-11-28T21:02:15.512440+0000","last_peered":"2023-11-28T21:02:15.512440+0000","last_clean":"2023-11-28T21:02:15.512440+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T21:02:15.512440+0000","last_undegraded":"2023-11-28T21:02:15.512440+0000","last_fullsized":"2023-11-28T21:02:15.512440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:26:41.398324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013136992,"stat_sum":{"num_bytes":25033729,"num_objects":551,"num_object_clones":252,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":252,"num_read":47,"num_read_kb":4142,"num_write":1517,"num_write_kb":28607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'391","reported_seq":2484,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.573272+0000","last_change":"2023-11-28T20:44:35.610823+0000","last_active":"2023-11-28T21:04:28.573272+0000","last_peered":"2023-11-28T21:04:28.573272+0000","last_clean":"2023-11-28T21:04:28.573272+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T21:04:28.573272+0000","last_undegraded":"2023-11-28T21:04:28.573272+0000","last_fullsized":"2023-11-28T21:04:28.573272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:29:14.727147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015322676,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'353","reported_seq":409,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:15.557982+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T21:01:15.557982+0000","last_peered":"2023-11-28T21:01:15.557982+0000","last_clean":"2023-11-28T21:01:15.557982+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T21:01:15.557982+0000","last_undegraded":"2023-11-28T21:01:15.557982+0000","last_fullsized":"2023-11-28T21:01:15.557982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":20,"num_write":319,"num_write_kb":12656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.564511+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T21:02:15.564511+0000","last_peered":"2023-11-28T21:02:15.564511+0000","last_clean":"2023-11-28T21:02:15.564511+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T21:02:15.564511+0000","last_undegraded":"2023-11-28T21:02:15.564511+0000","last_fullsized":"2023-11-28T21:02:15.564511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1795","reported_seq":3660,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:25.550179+0000","last_change":"2023-11-28T20:44:35.608577+0000","last_active":"2023-11-28T21:01:25.550179+0000","last_peered":"2023-11-28T21:01:25.550179+0000","last_clean":"2023-11-28T21:01:25.550179+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T21:01:25.550179+0000","last_undegraded":"2023-11-28T21:01:25.550179+0000","last_fullsized":"2023-11-28T21:01:25.550179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:14.094878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012304083,"stat_sum":{"num_bytes":50974055,"num_objects":563,"num_object_clones":255,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":255,"num_read":30,"num_read_kb":4125,"num_write":1519,"num_write_kb":57288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"51'375","reported_seq":2468,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.170631+0000","last_change":"2023-11-28T20:44:35.637477+0000","last_active":"2023-11-28T21:04:23.170631+0000","last_peered":"2023-11-28T21:04:23.170631+0000","last_clean":"2023-11-28T21:04:23.170631+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T21:04:23.170631+0000","last_undegraded":"2023-11-28T21:04:23.170631+0000","last_fullsized":"2023-11-28T21:04:23.170631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:35.213092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027789237000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"51'212","reported_seq":268,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:06.527993+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T21:03:06.527993+0000","last_peered":"2023-11-28T21:03:06.527993+0000","last_clean":"2023-11-28T21:03:06.527993+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T21:03:06.527993+0000","last_undegraded":"2023-11-28T21:03:06.527993+0000","last_fullsized":"2023-11-28T21:03:06.527993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777798,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":15,"num_write":164,"num_write_kb":16643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"51'1783","reported_seq":3664,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:20.561530+0000","last_change":"2023-11-28T20:44:35.614664+0000","last_active":"2023-11-28T21:02:20.561530+0000","last_peered":"2023-11-28T21:02:20.561530+0000","last_clean":"2023-11-28T21:02:20.561530+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T21:02:20.561530+0000","last_undegraded":"2023-11-28T21:02:20.561530+0000","last_fullsized":"2023-11-28T21:02:20.561530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:12:48.251405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016877468,"stat_sum":{"num_bytes":24953790,"num_objects":536,"num_object_clones":250,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":250,"num_read":41,"num_read_kb":41,"num_write":1520,"num_write_kb":33586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"51'453","reported_seq":2546,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.449547+0000","last_change":"2023-11-28T20:44:35.618675+0000","last_active":"2023-11-28T21:04:26.449547+0000","last_peered":"2023-11-28T21:04:26.449547+0000","last_clean":"2023-11-28T21:04:26.449547+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T21:04:26.449547+0000","last_undegraded":"2023-11-28T21:04:26.449547+0000","last_fullsized":"2023-11-28T21:04:26.449547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:27:00.507693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020341659000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"51'393","reported_seq":447,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:51.716770+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T21:00:51.716770+0000","last_peered":"2023-11-28T21:00:51.716770+0000","last_clean":"2023-11-28T21:00:51.716770+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T21:00:51.716770+0000","last_undegraded":"2023-11-28T21:00:51.716770+0000","last_fullsized":"2023-11-28T21:00:51.716770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777286,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":9,"num_write":342,"num_write_kb":16717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"51'1767","reported_seq":3643,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:10.519491+0000","last_change":"2023-11-28T20:44:35.611130+0000","last_active":"2023-11-28T21:03:10.519491+0000","last_peered":"2023-11-28T21:03:10.519491+0000","last_clean":"2023-11-28T21:03:10.519491+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T21:03:10.519491+0000","last_undegraded":"2023-11-28T21:03:10.519491+0000","last_fullsized":"2023-11-28T21:03:10.519491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:59.725546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014814858,"stat_sum":{"num_bytes":20638408,"num_objects":542,"num_object_clones":251,"num_object_copies":2168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":251,"num_read":37,"num_read_kb":37,"num_write":1496,"num_write_kb":31881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"51'403","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173054+0000","last_change":"2023-11-28T20:44:35.640929+0000","last_active":"2023-11-28T21:04:23.173054+0000","last_peered":"2023-11-28T21:04:23.173054+0000","last_clean":"2023-11-28T21:04:23.173054+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T21:04:23.173054+0000","last_undegraded":"2023-11-28T21:04:23.173054+0000","last_fullsized":"2023-11-28T21:04:23.173054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:27:39.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017837387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"51'371","reported_seq":427,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:51.511992+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T21:00:51.511992+0000","last_peered":"2023-11-28T21:00:51.511992+0000","last_clean":"2023-11-28T21:00:51.511992+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T21:00:51.511992+0000","last_undegraded":"2023-11-28T21:00:51.511992+0000","last_fullsized":"2023-11-28T21:00:51.511992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":22,"num_write":339,"num_write_kb":16887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"51'1847","reported_seq":3731,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.570080+0000","last_change":"2023-11-28T20:44:35.610893+0000","last_active":"2023-11-28T21:02:15.570080+0000","last_peered":"2023-11-28T21:02:15.570080+0000","last_clean":"2023-11-28T21:02:15.570080+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T21:02:15.570080+0000","last_undegraded":"2023-11-28T21:02:15.570080+0000","last_fullsized":"2023-11-28T21:02:15.570080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:13:32.634308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015179433000000001,"stat_sum":{"num_bytes":40252075,"num_objects":555,"num_object_clones":243,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":243,"num_read":37,"num_read_kb":1813,"num_write":1586,"num_write_kb":49527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"51'398","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.172349+0000","last_change":"2023-11-28T20:44:35.639947+0000","last_active":"2023-11-28T21:04:23.172349+0000","last_peered":"2023-11-28T21:04:23.172349+0000","last_clean":"2023-11-28T21:04:23.172349+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T21:04:23.172349+0000","last_undegraded":"2023-11-28T21:04:23.172349+0000","last_fullsized":"2023-11-28T21:04:23.172349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:55.543573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018023955000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"51'400","reported_seq":453,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:10.587072+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T21:03:10.587072+0000","last_peered":"2023-11-28T21:03:10.587072+0000","last_clean":"2023-11-28T21:03:10.587072+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T21:03:10.587072+0000","last_undegraded":"2023-11-28T21:03:10.587072+0000","last_fullsized":"2023-11-28T21:03:10.587072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094443,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":19633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"51'1788","reported_seq":3658,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.575375+0000","last_change":"2023-11-28T20:44:35.541705+0000","last_active":"2023-11-28T21:02:15.575375+0000","last_peered":"2023-11-28T21:02:15.575375+0000","last_clean":"2023-11-28T21:02:15.575375+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T21:02:15.575375+0000","last_undegraded":"2023-11-28T21:02:15.575375+0000","last_fullsized":"2023-11-28T21:02:15.575375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:17.458129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0090848279999999997,"stat_sum":{"num_bytes":25858877,"num_objects":550,"num_object_clones":249,"num_object_copies":2200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":550,"num_whiteouts":249,"num_read":30,"num_read_kb":4125,"num_write":1526,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"51'442","reported_seq":2534,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.171801+0000","last_change":"2023-11-28T20:44:35.636676+0000","last_active":"2023-11-28T21:04:23.171801+0000","last_peered":"2023-11-28T21:04:23.171801+0000","last_clean":"2023-11-28T21:04:23.171801+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T21:04:23.171801+0000","last_undegraded":"2023-11-28T21:04:23.171801+0000","last_fullsized":"2023-11-28T21:04:23.171801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:01:42.241191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020570496000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"51'633","reported_seq":687,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:41.517747+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T21:01:41.517747+0000","last_peered":"2023-11-28T21:01:41.517747+0000","last_clean":"2023-11-28T21:01:41.517747+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T21:01:41.517747+0000","last_undegraded":"2023-11-28T21:01:41.517747+0000","last_fullsized":"2023-11-28T21:01:41.517747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":7,"num_write":598,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"51'1723","reported_seq":3619,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.515230+0000","last_change":"2023-11-28T20:44:35.606276+0000","last_active":"2023-11-28T21:02:35.515230+0000","last_peered":"2023-11-28T21:02:35.515230+0000","last_clean":"2023-11-28T21:02:35.515230+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T21:02:35.515230+0000","last_undegraded":"2023-11-28T21:02:35.515230+0000","last_fullsized":"2023-11-28T21:02:35.515230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:25.189350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011806407999999999,"stat_sum":{"num_bytes":28712373,"num_objects":524,"num_object_clones":239,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":239,"num_read":46,"num_read_kb":46,"num_write":1462,"num_write_kb":31285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"51'407","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.562470+0000","last_change":"2023-11-28T20:44:35.611801+0000","last_active":"2023-11-28T21:04:28.562470+0000","last_peered":"2023-11-28T21:04:28.562470+0000","last_clean":"2023-11-28T21:04:28.562470+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T21:04:28.562470+0000","last_undegraded":"2023-11-28T21:04:28.562470+0000","last_fullsized":"2023-11-28T21:04:28.562470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:13.862302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014629055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"51'458","reported_seq":511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.552953+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T21:01:40.552953+0000","last_peered":"2023-11-28T21:01:40.552953+0000","last_clean":"2023-11-28T21:01:40.552953+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T21:01:40.552953+0000","last_undegraded":"2023-11-28T21:01:40.552953+0000","last_fullsized":"2023-11-28T21:01:40.552953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"51'1831","reported_seq":3699,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:36.607550+0000","last_change":"2023-11-28T20:44:35.613708+0000","last_active":"2023-11-28T21:02:36.607550+0000","last_peered":"2023-11-28T21:02:36.607550+0000","last_clean":"2023-11-28T21:02:36.607550+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T21:02:36.607550+0000","last_undegraded":"2023-11-28T21:02:36.607550+0000","last_fullsized":"2023-11-28T21:02:36.607550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:25.921514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017596898999999999,"stat_sum":{"num_bytes":20840070,"num_objects":572,"num_object_clones":259,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":259,"num_read":39,"num_read_kb":4134,"num_write":1549,"num_write_kb":33741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.172578+0000","last_change":"2023-11-28T20:44:35.639082+0000","last_active":"2023-11-28T21:04:23.172578+0000","last_peered":"2023-11-28T21:04:23.172578+0000","last_clean":"2023-11-28T21:04:23.172578+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T21:04:23.172578+0000","last_undegraded":"2023-11-28T21:04:23.172578+0000","last_fullsized":"2023-11-28T21:04:23.172578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:17.336904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019240779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"51'284","reported_seq":338,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.562767+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T21:01:40.562767+0000","last_peered":"2023-11-28T21:01:40.562767+0000","last_clean":"2023-11-28T21:01:40.562767+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T21:01:40.562767+0000","last_undegraded":"2023-11-28T21:01:40.562767+0000","last_fullsized":"2023-11-28T21:01:40.562767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":238,"num_write_kb":12572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"51'1661","reported_seq":3548,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:51.601005+0000","last_change":"2023-11-28T20:44:35.616111+0000","last_active":"2023-11-28T21:01:51.601005+0000","last_peered":"2023-11-28T21:01:51.601005+0000","last_clean":"2023-11-28T21:01:51.601005+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T21:01:51.601005+0000","last_undegraded":"2023-11-28T21:01:51.601005+0000","last_fullsized":"2023-11-28T21:01:51.601005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:36.330587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018495173,"stat_sum":{"num_bytes":20919340,"num_objects":524,"num_object_clones":235,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":235,"num_read":33,"num_read_kb":33,"num_write":1415,"num_write_kb":40695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"51'413","reported_seq":2505,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.560104+0000","last_change":"2023-11-28T20:44:35.609530+0000","last_active":"2023-11-28T21:04:28.560104+0000","last_peered":"2023-11-28T21:04:28.560104+0000","last_clean":"2023-11-28T21:04:28.560104+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T21:04:28.560104+0000","last_undegraded":"2023-11-28T21:04:28.560104+0000","last_fullsized":"2023-11-28T21:04:28.560104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:39:49.725834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014112118999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"51'405","reported_seq":458,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.507981+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T21:01:40.507981+0000","last_peered":"2023-11-28T21:01:40.507981+0000","last_clean":"2023-11-28T21:01:40.507981+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T21:01:40.507981+0000","last_undegraded":"2023-11-28T21:01:40.507981+0000","last_fullsized":"2023-11-28T21:01:40.507981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":16779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"51'1691","reported_seq":3584,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.574707+0000","last_change":"2023-11-28T20:44:35.613305+0000","last_active":"2023-11-28T21:02:35.574707+0000","last_peered":"2023-11-28T21:02:35.574707+0000","last_clean":"2023-11-28T21:02:35.574707+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T21:02:35.574707+0000","last_undegraded":"2023-11-28T21:02:35.574707+0000","last_fullsized":"2023-11-28T21:02:35.574707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:51.165815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015550285,"stat_sum":{"num_bytes":33895761,"num_objects":515,"num_object_clones":224,"num_object_copies":2060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515,"num_whiteouts":224,"num_read":28,"num_read_kb":28,"num_write":1451,"num_write_kb":37503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"51'394","reported_seq":2486,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.424848+0000","last_change":"2023-11-28T20:44:35.632331+0000","last_active":"2023-11-28T21:04:28.424848+0000","last_peered":"2023-11-28T21:04:28.424848+0000","last_clean":"2023-11-28T21:04:28.424848+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T21:04:28.424848+0000","last_undegraded":"2023-11-28T21:04:28.424848+0000","last_fullsized":"2023-11-28T21:04:28.424848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:35:55.459943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022690017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'566","reported_seq":619,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:05.583299+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T21:04:05.583299+0000","last_peered":"2023-11-28T21:04:05.583299+0000","last_clean":"2023-11-28T21:04:05.583299+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T21:04:05.583299+0000","last_undegraded":"2023-11-28T21:04:05.583299+0000","last_fullsized":"2023-11-28T21:04:05.583299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":24942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"51'1823","reported_seq":3693,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:46.723591+0000","last_change":"2023-11-28T20:44:35.607147+0000","last_active":"2023-11-28T21:01:46.723591+0000","last_peered":"2023-11-28T21:01:46.723591+0000","last_clean":"2023-11-28T21:01:46.723591+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T21:01:46.723591+0000","last_undegraded":"2023-11-28T21:01:46.723591+0000","last_fullsized":"2023-11-28T21:01:46.723591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1823,"log_dups_size":0,"ondisk_log_size":1823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:45.887527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013090108,"stat_sum":{"num_bytes":42607549,"num_objects":556,"num_object_clones":254,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":254,"num_read":36,"num_read_kb":4131,"num_write":1543,"num_write_kb":57518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"51'388","reported_seq":2473,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491642+0000","last_change":"2023-11-28T20:44:35.530346+0000","last_active":"2023-11-28T21:04:30.491642+0000","last_peered":"2023-11-28T21:04:30.491642+0000","last_clean":"2023-11-28T21:04:30.491642+0000","last_became_active":"2023-11-28T20:39:01.848225+0000","last_became_peered":"2023-11-28T20:39:01.848225+0000","last_unstale":"2023-11-28T21:04:30.491642+0000","last_undegraded":"2023-11-28T21:04:30.491642+0000","last_fullsized":"2023-11-28T21:04:30.491642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:47.582113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019608149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'538","reported_seq":591,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:31.729219+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T21:02:31.729219+0000","last_peered":"2023-11-28T21:02:31.729219+0000","last_clean":"2023-11-28T21:02:31.729219+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T21:02:31.729219+0000","last_undegraded":"2023-11-28T21:02:31.729219+0000","last_fullsized":"2023-11-28T21:02:31.729219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":21060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"51'1816","reported_seq":3706,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:45.569384+0000","last_change":"2023-11-28T20:44:35.543972+0000","last_active":"2023-11-28T21:01:45.569384+0000","last_peered":"2023-11-28T21:01:45.569384+0000","last_clean":"2023-11-28T21:01:45.569384+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T21:01:45.569384+0000","last_undegraded":"2023-11-28T21:01:45.569384+0000","last_fullsized":"2023-11-28T21:01:45.569384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:46.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010092998000000001,"stat_sum":{"num_bytes":33600436,"num_objects":568,"num_object_clones":254,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":254,"num_read":57,"num_read_kb":4152,"num_write":1538,"num_write_kb":45454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"51'410","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564086+0000","last_change":"2023-11-28T20:44:35.605933+0000","last_active":"2023-11-28T21:04:28.564086+0000","last_peered":"2023-11-28T21:04:28.564086+0000","last_clean":"2023-11-28T21:04:28.564086+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T21:04:28.564086+0000","last_undegraded":"2023-11-28T21:04:28.564086+0000","last_fullsized":"2023-11-28T21:04:28.564086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:47.440506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744874000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"51'484","reported_seq":538,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.573719+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T21:02:30.573719+0000","last_peered":"2023-11-28T21:02:30.573719+0000","last_clean":"2023-11-28T21:02:30.573719+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T21:02:30.573719+0000","last_undegraded":"2023-11-28T21:02:30.573719+0000","last_fullsized":"2023-11-28T21:02:30.573719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":27,"num_write":437,"num_write_kb":33175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"51'1777","reported_seq":3671,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:46.600267+0000","last_change":"2023-11-28T20:44:35.614798+0000","last_active":"2023-11-28T21:01:46.600267+0000","last_peered":"2023-11-28T21:01:46.600267+0000","last_clean":"2023-11-28T21:01:46.600267+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T21:01:46.600267+0000","last_undegraded":"2023-11-28T21:01:46.600267+0000","last_fullsized":"2023-11-28T21:01:46.600267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:55.011311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018323326000000001,"stat_sum":{"num_bytes":24785841,"num_objects":525,"num_object_clones":238,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":238,"num_read":34,"num_read_kb":34,"num_write":1518,"num_write_kb":32579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178537+0000","last_change":"2023-11-28T20:44:35.621854+0000","last_active":"2023-11-28T21:04:23.178537+0000","last_peered":"2023-11-28T21:04:23.178537+0000","last_clean":"2023-11-28T21:04:23.178537+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T21:04:23.178537+0000","last_undegraded":"2023-11-28T21:04:23.178537+0000","last_fullsized":"2023-11-28T21:04:23.178537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:22.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022293309000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"51'163","reported_seq":216,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.563729+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T21:02:30.563729+0000","last_peered":"2023-11-28T21:02:30.563729+0000","last_clean":"2023-11-28T21:02:30.563729+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T21:02:30.563729+0000","last_undegraded":"2023-11-28T21:02:30.563729+0000","last_fullsized":"2023-11-28T21:02:30.563729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"51'1914","reported_seq":3776,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:46.600301+0000","last_change":"2023-11-28T20:44:35.611992+0000","last_active":"2023-11-28T21:01:46.600301+0000","last_peered":"2023-11-28T21:01:46.600301+0000","last_clean":"2023-11-28T21:01:46.600301+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T21:01:46.600301+0000","last_undegraded":"2023-11-28T21:01:46.600301+0000","last_fullsized":"2023-11-28T21:01:46.600301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:08:22.583119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016210088000000001,"stat_sum":{"num_bytes":26682582,"num_objects":583,"num_object_clones":263,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":583,"num_whiteouts":263,"num_read":39,"num_read_kb":8229,"num_write":1627,"num_write_kb":50263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"51'1808","reported_seq":3653,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.514653+0000","last_change":"2023-11-28T20:44:35.605377+0000","last_active":"2023-11-28T21:02:30.514653+0000","last_peered":"2023-11-28T21:02:30.514653+0000","last_clean":"2023-11-28T21:02:30.514653+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T21:02:30.514653+0000","last_undegraded":"2023-11-28T21:02:30.514653+0000","last_fullsized":"2023-11-28T21:02:30.514653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:55:41.417877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011090378999999999,"stat_sum":{"num_bytes":29341830,"num_objects":589,"num_object_clones":267,"num_object_copies":2356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":267,"num_read":21,"num_read_kb":21,"num_write":1524,"num_write_kb":32957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494763+0000","last_change":"2023-11-28T20:44:35.601680+0000","last_active":"2023-11-28T21:04:30.494763+0000","last_peered":"2023-11-28T21:04:30.494763+0000","last_clean":"2023-11-28T21:04:30.494763+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T21:04:30.494763+0000","last_undegraded":"2023-11-28T21:04:30.494763+0000","last_fullsized":"2023-11-28T21:04:30.494763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:33.094463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0086681780000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"51'600","reported_seq":655,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.573365+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T21:02:30.573365+0000","last_peered":"2023-11-28T21:02:30.573365+0000","last_clean":"2023-11-28T21:02:30.573365+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T21:02:30.573365+0000","last_undegraded":"2023-11-28T21:02:30.573365+0000","last_fullsized":"2023-11-28T21:02:30.573365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":33,"num_write":550,"num_write_kb":45433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"51'1738","reported_seq":3612,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.549285+0000","last_change":"2023-11-28T20:44:35.619807+0000","last_active":"2023-11-28T21:01:20.549285+0000","last_peered":"2023-11-28T21:01:20.549285+0000","last_clean":"2023-11-28T21:01:20.549285+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T21:01:20.549285+0000","last_undegraded":"2023-11-28T21:01:20.549285+0000","last_fullsized":"2023-11-28T21:01:20.549285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1738,"log_dups_size":0,"ondisk_log_size":1738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:00.302899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016829818,"stat_sum":{"num_bytes":16566795,"num_objects":555,"num_object_clones":248,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":248,"num_read":32,"num_read_kb":32,"num_write":1476,"num_write_kb":23281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"51'447","reported_seq":2539,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.567545+0000","last_change":"2023-11-28T20:44:35.615234+0000","last_active":"2023-11-28T21:04:28.567545+0000","last_peered":"2023-11-28T21:04:28.567545+0000","last_clean":"2023-11-28T21:04:28.567545+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T21:04:28.567545+0000","last_undegraded":"2023-11-28T21:04:28.567545+0000","last_fullsized":"2023-11-28T21:04:28.567545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:49.468386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018571445999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"51'758","reported_seq":1302,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:36.607484+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T21:02:36.607484+0000","last_peered":"2023-11-28T21:02:36.607484+0000","last_clean":"2023-11-28T21:02:36.607484+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T21:02:36.607484+0000","last_undegraded":"2023-11-28T21:02:36.607484+0000","last_fullsized":"2023-11-28T21:02:36.607484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18014655,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":492,"num_read_kb":1568,"num_write":714,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"51'1105","reported_seq":1657,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.543016+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T21:00:50.543016+0000","last_peered":"2023-11-28T21:00:50.543016+0000","last_clean":"2023-11-28T21:00:50.543016+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T21:00:50.543016+0000","last_undegraded":"2023-11-28T21:00:50.543016+0000","last_fullsized":"2023-11-28T21:00:50.543016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34584852,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":502,"num_read_kb":1393,"num_write":1050,"num_write_kb":34570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"51'366","reported_seq":2457,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559286+0000","last_change":"2023-11-28T20:44:35.611477+0000","last_active":"2023-11-28T21:04:28.559286+0000","last_peered":"2023-11-28T21:04:28.559286+0000","last_clean":"2023-11-28T21:04:28.559286+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T21:04:28.559286+0000","last_undegraded":"2023-11-28T21:04:28.559286+0000","last_fullsized":"2023-11-28T21:04:28.559286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:56.615977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014791248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"51'1725","reported_seq":3594,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:56.512564+0000","last_change":"2023-11-28T20:44:35.530646+0000","last_active":"2023-11-28T21:00:56.512564+0000","last_peered":"2023-11-28T21:00:56.512564+0000","last_clean":"2023-11-28T21:00:56.512564+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T21:00:56.512564+0000","last_undegraded":"2023-11-28T21:00:56.512564+0000","last_fullsized":"2023-11-28T21:00:56.512564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.553500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022000169999999999,"stat_sum":{"num_bytes":29986576,"num_objects":543,"num_object_clones":248,"num_object_copies":2172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":248,"num_read":29,"num_read_kb":29,"num_write":1454,"num_write_kb":38376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"51'365","reported_seq":417,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:51.592796+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T21:00:51.592796+0000","last_peered":"2023-11-28T21:00:51.592796+0000","last_clean":"2023-11-28T21:00:51.592796+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T21:00:51.592796+0000","last_undegraded":"2023-11-28T21:00:51.592796+0000","last_fullsized":"2023-11-28T21:00:51.592796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":20723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"51'401","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491589+0000","last_change":"2023-11-28T20:44:35.544103+0000","last_active":"2023-11-28T21:04:30.491589+0000","last_peered":"2023-11-28T21:04:30.491589+0000","last_clean":"2023-11-28T21:04:30.491589+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T21:04:30.491589+0000","last_undegraded":"2023-11-28T21:04:30.491589+0000","last_fullsized":"2023-11-28T21:04:30.491589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:40.051010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010086065,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"51'1756","reported_seq":3648,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:56.593503+0000","last_change":"2023-11-28T20:44:35.611344+0000","last_active":"2023-11-28T21:00:56.593503+0000","last_peered":"2023-11-28T21:00:56.593503+0000","last_clean":"2023-11-28T21:00:56.593503+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T21:00:56.593503+0000","last_undegraded":"2023-11-28T21:00:56.593503+0000","last_fullsized":"2023-11-28T21:00:56.593503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:16.879801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015656369999999999,"stat_sum":{"num_bytes":33768985,"num_objects":521,"num_object_clones":238,"num_object_copies":2084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":238,"num_read":45,"num_read_kb":12330,"num_write":1499,"num_write_kb":48802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"51'415","reported_seq":2508,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559730+0000","last_change":"2023-11-28T20:44:35.609721+0000","last_active":"2023-11-28T21:04:28.559730+0000","last_peered":"2023-11-28T21:04:28.559730+0000","last_clean":"2023-11-28T21:04:28.559730+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T21:04:28.559730+0000","last_undegraded":"2023-11-28T21:04:28.559730+0000","last_fullsized":"2023-11-28T21:04:28.559730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:39.776841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013289166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"51'439","reported_seq":2532,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491719+0000","last_change":"2023-11-28T20:44:35.529934+0000","last_active":"2023-11-28T21:04:30.491719+0000","last_peered":"2023-11-28T21:04:30.491719+0000","last_clean":"2023-11-28T21:04:30.491719+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T21:04:30.491719+0000","last_undegraded":"2023-11-28T21:04:30.491719+0000","last_fullsized":"2023-11-28T21:04:30.491719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:44:09.727309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017225739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"51'438","reported_seq":2531,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564572+0000","last_change":"2023-11-28T20:44:35.624744+0000","last_active":"2023-11-28T21:04:28.564572+0000","last_peered":"2023-11-28T21:04:28.564572+0000","last_clean":"2023-11-28T21:04:28.564572+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T21:04:28.564572+0000","last_undegraded":"2023-11-28T21:04:28.564572+0000","last_fullsized":"2023-11-28T21:04:28.564572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:53.447494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018881576000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"51'384","reported_seq":2477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.558946+0000","last_change":"2023-11-28T20:44:35.611177+0000","last_active":"2023-11-28T21:04:28.558946+0000","last_peered":"2023-11-28T21:04:28.558946+0000","last_clean":"2023-11-28T21:04:28.558946+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T21:04:28.558946+0000","last_undegraded":"2023-11-28T21:04:28.558946+0000","last_fullsized":"2023-11-28T21:04:28.558946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:06.242482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014673739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"51'367","reported_seq":2460,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.565973+0000","last_change":"2023-11-28T20:44:35.615657+0000","last_active":"2023-11-28T21:04:28.565973+0000","last_peered":"2023-11-28T21:04:28.565973+0000","last_clean":"2023-11-28T21:04:28.565973+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T21:04:28.565973+0000","last_undegraded":"2023-11-28T21:04:28.565973+0000","last_fullsized":"2023-11-28T21:04:28.565973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:28.718350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017627927000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"51'417","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495102+0000","last_change":"2023-11-28T20:44:35.599239+0000","last_active":"2023-11-28T21:04:30.495102+0000","last_peered":"2023-11-28T21:04:30.495102+0000","last_clean":"2023-11-28T21:04:30.495102+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T21:04:30.495102+0000","last_undegraded":"2023-11-28T21:04:30.495102+0000","last_fullsized":"2023-11-28T21:04:30.495102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:20.147670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061577519999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"51'426","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.177843+0000","last_change":"2023-11-28T20:44:35.619451+0000","last_active":"2023-11-28T21:04:23.177843+0000","last_peered":"2023-11-28T21:04:23.177843+0000","last_clean":"2023-11-28T21:04:23.177843+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T21:04:23.177843+0000","last_undegraded":"2023-11-28T21:04:23.177843+0000","last_fullsized":"2023-11-28T21:04:23.177843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:18.657101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017436297999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"51'394","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564166+0000","last_change":"2023-11-28T20:44:35.614405+0000","last_active":"2023-11-28T21:04:28.564166+0000","last_peered":"2023-11-28T21:04:28.564166+0000","last_clean":"2023-11-28T21:04:28.564166+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T21:04:28.564166+0000","last_undegraded":"2023-11-28T21:04:28.564166+0000","last_fullsized":"2023-11-28T21:04:28.564166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:26:38.450255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018095488999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"51'421","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.454749+0000","last_change":"2023-11-28T20:44:35.611219+0000","last_active":"2023-11-28T21:04:26.454749+0000","last_peered":"2023-11-28T21:04:26.454749+0000","last_clean":"2023-11-28T21:04:26.454749+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T21:04:26.454749+0000","last_undegraded":"2023-11-28T21:04:26.454749+0000","last_fullsized":"2023-11-28T21:04:26.454749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:23.122455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014654275,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"51'411","reported_seq":2504,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:29.587753+0000","last_change":"2023-11-28T20:44:35.613449+0000","last_active":"2023-11-28T21:04:29.587753+0000","last_peered":"2023-11-28T21:04:29.587753+0000","last_clean":"2023-11-28T21:04:29.587753+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T21:04:29.587753+0000","last_undegraded":"2023-11-28T21:04:29.587753+0000","last_fullsized":"2023-11-28T21:04:29.587753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:48.348409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017356489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"51'417","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492103+0000","last_change":"2023-11-28T20:44:35.530341+0000","last_active":"2023-11-28T21:04:30.492103+0000","last_peered":"2023-11-28T21:04:30.492103+0000","last_clean":"2023-11-28T21:04:30.492103+0000","last_became_active":"2023-11-28T20:39:01.848167+0000","last_became_peered":"2023-11-28T20:39:01.848167+0000","last_unstale":"2023-11-28T21:04:30.492103+0000","last_undegraded":"2023-11-28T21:04:30.492103+0000","last_fullsized":"2023-11-28T21:04:30.492103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:22.610505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020579169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"51'422","reported_seq":2515,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.560548+0000","last_change":"2023-11-28T20:44:35.610405+0000","last_active":"2023-11-28T21:04:28.560548+0000","last_peered":"2023-11-28T21:04:28.560548+0000","last_clean":"2023-11-28T21:04:28.560548+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T21:04:28.560548+0000","last_undegraded":"2023-11-28T21:04:28.560548+0000","last_fullsized":"2023-11-28T21:04:28.560548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:42.309551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014291543,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"51'396","reported_seq":2489,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.193454+0000","last_change":"2023-11-28T20:44:35.620800+0000","last_active":"2023-11-28T21:04:23.193454+0000","last_peered":"2023-11-28T21:04:23.193454+0000","last_clean":"2023-11-28T21:04:23.193454+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T21:04:23.193454+0000","last_undegraded":"2023-11-28T21:04:23.193454+0000","last_fullsized":"2023-11-28T21:04:23.193454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:05.581863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017003022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"51'403","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492431+0000","last_change":"2023-11-28T20:44:35.638243+0000","last_active":"2023-11-28T21:04:30.492431+0000","last_peered":"2023-11-28T21:04:30.492431+0000","last_clean":"2023-11-28T21:04:30.492431+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T21:04:30.492431+0000","last_undegraded":"2023-11-28T21:04:30.492431+0000","last_fullsized":"2023-11-28T21:04:30.492431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:50:42.227579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020849563000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"51'393","reported_seq":2485,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491669+0000","last_change":"2023-11-28T20:44:35.530649+0000","last_active":"2023-11-28T21:04:30.491669+0000","last_peered":"2023-11-28T21:04:30.491669+0000","last_clean":"2023-11-28T21:04:30.491669+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T21:04:30.491669+0000","last_undegraded":"2023-11-28T21:04:30.491669+0000","last_fullsized":"2023-11-28T21:04:30.491669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:56.771896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019691359999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"51'430","reported_seq":2522,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178483+0000","last_change":"2023-11-28T20:44:35.617721+0000","last_active":"2023-11-28T21:04:23.178483+0000","last_peered":"2023-11-28T21:04:23.178483+0000","last_clean":"2023-11-28T21:04:23.178483+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T21:04:23.178483+0000","last_undegraded":"2023-11-28T21:04:23.178483+0000","last_fullsized":"2023-11-28T21:04:23.178483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:40.430998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019569492000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"51'421","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559068+0000","last_change":"2023-11-28T20:44:35.612279+0000","last_active":"2023-11-28T21:04:28.559068+0000","last_peered":"2023-11-28T21:04:28.559068+0000","last_clean":"2023-11-28T21:04:28.559068+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T21:04:28.559068+0000","last_undegraded":"2023-11-28T21:04:28.559068+0000","last_fullsized":"2023-11-28T21:04:28.559068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:57.398242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015773832000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"51'435","reported_seq":2527,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491364+0000","last_change":"2023-11-28T20:44:35.606941+0000","last_active":"2023-11-28T21:04:30.491364+0000","last_peered":"2023-11-28T21:04:30.491364+0000","last_clean":"2023-11-28T21:04:30.491364+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T21:04:30.491364+0000","last_undegraded":"2023-11-28T21:04:30.491364+0000","last_fullsized":"2023-11-28T21:04:30.491364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:10.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013692045,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"51'417","reported_seq":2509,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495486+0000","last_change":"2023-11-28T20:44:35.609244+0000","last_active":"2023-11-28T21:04:30.495486+0000","last_peered":"2023-11-28T21:04:30.495486+0000","last_clean":"2023-11-28T21:04:30.495486+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T21:04:30.495486+0000","last_undegraded":"2023-11-28T21:04:30.495486+0000","last_fullsized":"2023-11-28T21:04:30.495486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:51.107877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014004656000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"51'418","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564298+0000","last_change":"2023-11-28T20:44:35.614800+0000","last_active":"2023-11-28T21:04:28.564298+0000","last_peered":"2023-11-28T21:04:28.564298+0000","last_clean":"2023-11-28T21:04:28.564298+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T21:04:28.564298+0000","last_undegraded":"2023-11-28T21:04:28.564298+0000","last_fullsized":"2023-11-28T21:04:28.564298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:23:59.393140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018246884000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"51'374","reported_seq":2466,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.158886+0000","last_change":"2023-11-28T20:44:35.544988+0000","last_active":"2023-11-28T21:04:23.158886+0000","last_peered":"2023-11-28T21:04:23.158886+0000","last_clean":"2023-11-28T21:04:23.158886+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T21:04:23.158886+0000","last_undegraded":"2023-11-28T21:04:23.158886+0000","last_fullsized":"2023-11-28T21:04:23.158886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:16:32.112808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010909501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"51'380","reported_seq":2472,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176371+0000","last_change":"2023-11-28T20:44:35.611282+0000","last_active":"2023-11-28T21:04:23.176371+0000","last_peered":"2023-11-28T21:04:23.176371+0000","last_clean":"2023-11-28T21:04:23.176371+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T21:04:23.176371+0000","last_undegraded":"2023-11-28T21:04:23.176371+0000","last_fullsized":"2023-11-28T21:04:23.176371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:52:02.947575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014265125,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"51'385","reported_seq":2484,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492462+0000","last_change":"2023-11-28T20:44:35.618555+0000","last_active":"2023-11-28T21:04:30.492462+0000","last_peered":"2023-11-28T21:04:30.492462+0000","last_clean":"2023-11-28T21:04:30.492462+0000","last_became_active":"2023-11-28T20:39:01.391291+0000","last_became_peered":"2023-11-28T20:39:01.391291+0000","last_unstale":"2023-11-28T21:04:30.492462+0000","last_undegraded":"2023-11-28T21:04:30.492462+0000","last_fullsized":"2023-11-28T21:04:30.492462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:29.414536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017078507999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"51'419","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176881+0000","last_change":"2023-11-28T20:44:35.640277+0000","last_active":"2023-11-28T21:04:23.176881+0000","last_peered":"2023-11-28T21:04:23.176881+0000","last_clean":"2023-11-28T21:04:23.176881+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T21:04:23.176881+0000","last_undegraded":"2023-11-28T21:04:23.176881+0000","last_fullsized":"2023-11-28T21:04:23.176881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.933807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017711331,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"51'405","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564972+0000","last_change":"2023-11-28T20:44:35.613891+0000","last_active":"2023-11-28T21:04:28.564972+0000","last_peered":"2023-11-28T21:04:28.564972+0000","last_clean":"2023-11-28T21:04:28.564972+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T21:04:28.564972+0000","last_undegraded":"2023-11-28T21:04:28.564972+0000","last_fullsized":"2023-11-28T21:04:28.564972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:40.197882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017616142000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"51'400","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.561114+0000","last_change":"2023-11-28T20:44:35.635891+0000","last_active":"2023-11-28T21:04:28.561114+0000","last_peered":"2023-11-28T21:04:28.561114+0000","last_clean":"2023-11-28T21:04:28.561114+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T21:04:28.561114+0000","last_undegraded":"2023-11-28T21:04:28.561114+0000","last_fullsized":"2023-11-28T21:04:28.561114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:37:28.366415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020312439000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"51'403","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.558229+0000","last_change":"2023-11-28T20:44:35.622789+0000","last_active":"2023-11-28T21:04:28.558229+0000","last_peered":"2023-11-28T21:04:28.558229+0000","last_clean":"2023-11-28T21:04:28.558229+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T21:04:28.558229+0000","last_undegraded":"2023-11-28T21:04:28.558229+0000","last_fullsized":"2023-11-28T21:04:28.558229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:13:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017449602000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"51'416","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492750+0000","last_change":"2023-11-28T20:44:35.638249+0000","last_active":"2023-11-28T21:04:30.492750+0000","last_peered":"2023-11-28T21:04:30.492750+0000","last_clean":"2023-11-28T21:04:30.492750+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T21:04:30.492750+0000","last_undegraded":"2023-11-28T21:04:30.492750+0000","last_fullsized":"2023-11-28T21:04:30.492750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:55.963557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018992159000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"51'397","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.448022+0000","last_change":"2023-11-28T20:44:35.613038+0000","last_active":"2023-11-28T21:04:26.448022+0000","last_peered":"2023-11-28T21:04:26.448022+0000","last_clean":"2023-11-28T21:04:26.448022+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T21:04:26.448022+0000","last_undegraded":"2023-11-28T21:04:26.448022+0000","last_fullsized":"2023-11-28T21:04:26.448022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:29.806450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015371953000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"51'415","reported_seq":2509,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494151+0000","last_change":"2023-11-28T20:44:35.603769+0000","last_active":"2023-11-28T21:04:30.494151+0000","last_peered":"2023-11-28T21:04:30.494151+0000","last_clean":"2023-11-28T21:04:30.494151+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T21:04:30.494151+0000","last_undegraded":"2023-11-28T21:04:30.494151+0000","last_fullsized":"2023-11-28T21:04:30.494151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:16:20.274605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098716120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"51'399","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494927+0000","last_change":"2023-11-28T20:44:35.607958+0000","last_active":"2023-11-28T21:04:30.494927+0000","last_peered":"2023-11-28T21:04:30.494927+0000","last_clean":"2023-11-28T21:04:30.494927+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T21:04:30.494927+0000","last_undegraded":"2023-11-28T21:04:30.494927+0000","last_fullsized":"2023-11-28T21:04:30.494927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:07:12.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011275626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"51'410","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176638+0000","last_change":"2023-11-28T20:44:35.639151+0000","last_active":"2023-11-28T21:04:23.176638+0000","last_peered":"2023-11-28T21:04:23.176638+0000","last_clean":"2023-11-28T21:04:23.176638+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T21:04:23.176638+0000","last_undegraded":"2023-11-28T21:04:23.176638+0000","last_fullsized":"2023-11-28T21:04:23.176638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:25:42.800941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017369464000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":892224822,"num_objects":17666,"num_object_clones":8054,"num_object_copies":70664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17666,"num_whiteouts":7974,"num_read":1150,"num_read_kb":100500,"num_write":48457,"num_write_kb":1187847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1881309184,"data_stored":1881309184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57114,"ondisk_log_size":57114,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26113,"ondisk_log_size":26113,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":680923161,"num_objects":625,"num_object_clones":0,"num_object_copies":1250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":0,"num_read":1485,"num_read_kb":4455,"num_write":14545,"num_write_kb":680650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1362001920,"data_stored":1361846322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15149,"ondisk_log_size":15149,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509770,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":650828,"kb_used_data":461380,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":93721012,"statfs":{"total":96636764160,"available":95970316288,"internally_reserved":0,"allocated":472453120,"data_stored":472148767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":193984967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":42.021000000000001,"5min":8.7739999999999991,"15min":3.2749999999999999},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":873.04100000000005,"5min":873.04100000000005,"15min":873.04100000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.52300000000000002},"min":{"1min":0.24299999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":6.5659999999999998},"last":0.42499999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":1.194,"5min":1.194,"15min":6.9370000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.52400000000000002,"15min":0.54400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.627,"5min":0.79700000000000004,"15min":3.6219999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.8780000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":39.405999999999999,"5min":8.3049999999999997,"15min":3.1909999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.28299999999999997},"max":{"1min":817.63900000000001,"5min":817.63900000000001,"15min":817.63900000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":253.649,"5min":51.384,"15min":17.940000000000001},"min":{"1min":0.56299999999999994,"5min":0.48699999999999999,"15min":0.34799999999999998},"max":{"1min":3268.6419999999998,"5min":3268.6419999999998,"15min":3268.6419999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":253.23400000000001,"5min":51.326999999999998,"15min":17.667999999999999},"min":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"max":{"1min":3232.7750000000001,"5min":3232.7750000000001,"15min":3232.7750000000001},"last":0.80100000000000005}]},{"osd":5,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":229.02799999999999,"5min":46.481999999999999,"15min":16.082999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.42299999999999999},"max":{"1min":3259.5459999999998,"5min":3259.5459999999998,"15min":3259.5459999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":36.899999999999999,"5min":8.0679999999999996,"15min":3.2559999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53300000000000003},"max":{"1min":703.19299999999998,"5min":703.19299999999998,"15min":703.19299999999998},"last":0.749}]},{"osd":6,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":46.119,"5min":9.9299999999999997,"15min":3.9100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":928.99199999999996,"5min":928.99199999999996,"15min":928.99199999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":49.222999999999999,"5min":10.545,"15min":4.1520000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":961.01800000000003,"5min":961.01800000000003,"15min":961.01800000000003},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":44.685000000000002,"5min":9.6370000000000005,"15min":4.1289999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.44600000000000001},"max":{"1min":872.827,"5min":872.827,"15min":872.827},"last":0.78300000000000003},{"interface":"front","average":{"1min":41.890000000000001,"5min":9.0760000000000005,"15min":3.6160000000000001},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.48899999999999999},"max":{"1min":817.84400000000005,"5min":817.84400000000005,"15min":817.84400000000005},"last":0.64600000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509770,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424976,"kb_used_data":277192,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93946864,"statfs":{"total":96636764160,"available":96201588736,"internally_reserved":0,"allocated":283844608,"data_stored":283539830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9790000000000001,"5min":1.5509999999999999,"15min":0.82999999999999996},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":64.087000000000003,"5min":64.087000000000003,"15min":64.087000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":6.0759999999999996,"5min":1.667,"15min":0.95599999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25},"max":{"1min":64.114999999999995,"5min":64.114999999999995,"15min":64.114999999999995},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9960000000000004,"5min":1.647,"15min":0.97199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":64,"5min":64,"15min":64},"last":0.35799999999999998},{"interface":"front","average":{"1min":6.0679999999999996,"5min":1.7,"15min":0.97399999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":64.028999999999996,"5min":64.028999999999996,"15min":64.028999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":144.126,"5min":29.332000000000001,"15min":10.220000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2826.7199999999998,"5min":2826.7199999999998,"15min":2826.7199999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":146.227,"5min":29.651,"15min":10.257999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.307},"max":{"1min":2838.0680000000002,"5min":2838.0680000000002,"15min":2838.0680000000002},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":13.901,"5min":3.4500000000000002,"15min":1.7190000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.38},"max":{"1min":149.43700000000001,"5min":149.43700000000001,"15min":149.43700000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":262.66399999999999,"5min":53.177,"15min":18.265000000000001},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.38800000000000001},"max":{"1min":3288.7310000000002,"5min":3288.7310000000002,"15min":3288.7310000000002},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":308.05099999999999,"5min":62.268999999999998,"15min":21.323},"min":{"1min":0.68500000000000005,"5min":0.54700000000000004,"15min":0.46000000000000002},"max":{"1min":3314.4110000000001,"5min":3314.4110000000001,"15min":3314.4110000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":207.60499999999999,"5min":42.195999999999998,"15min":14.644},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.44900000000000001},"max":{"1min":2139.3159999999998,"5min":2139.3159999999998,"15min":2139.3159999999998},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":317.48099999999999,"5min":64.153999999999996,"15min":21.949000000000002},"min":{"1min":0.64100000000000001,"5min":0.56999999999999995,"15min":0.38700000000000001},"max":{"1min":3288.7730000000001,"5min":3288.7730000000001,"15min":3288.7730000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":254.578,"5min":51.664000000000001,"15min":17.855},"min":{"1min":0.77700000000000002,"5min":0.68500000000000005,"15min":0.42699999999999999},"max":{"1min":2837.9960000000001,"5min":2837.9960000000001,"15min":2837.9960000000001},"last":0.89100000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:04:54 2023","interfaces":[{"interface":"back","average":{"1min":151.316,"5min":30.917999999999999,"15min":10.859999999999999},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.46899999999999997},"max":{"1min":2822.598,"5min":2822.598,"15min":2822.598},"last":0.82099999999999995},{"interface":"front","average":{"1min":235.82599999999999,"5min":47.865000000000002,"15min":16.504999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.45400000000000001},"max":{"1min":2150.9899999999998,"5min":2150.9899999999998,"15min":2150.9899999999998},"last":0.69299999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509771,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660764,"kb_used_data":458836,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93711076,"statfs":{"total":96636764160,"available":95960141824,"internally_reserved":0,"allocated":469848064,"data_stored":469543023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.01,"5min":2.3849999999999998,"15min":1.1799999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":143.76300000000001,"5min":143.76300000000001,"15min":143.76300000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":2.4769999999999999,"5min":0.92200000000000004,"15min":0.71799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":39.768000000000001,"5min":39.768000000000001,"15min":39.768000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":8.2780000000000005,"5min":2.0510000000000002,"15min":1.042},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.252},"max":{"1min":149.34299999999999,"5min":149.34299999999999,"15min":149.34299999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":6.5229999999999997},"last":0.47099999999999997}]},{"osd":3,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.726000000000001,"5min":2.5840000000000001,"15min":1.2589999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26700000000000002},"max":{"1min":147.46899999999999,"5min":147.46899999999999,"15min":147.46899999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":3.6179999999999999,"5min":1.216,"15min":0.85499999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":59.305,"5min":59.305,"15min":59.305},"last":0.44}]},{"osd":4,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":20.18,"5min":4.649,"15min":2.1320000000000001},"min":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.40400000000000003},"max":{"1min":221.76900000000001,"5min":221.76900000000001,"15min":221.76900000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":63.805999999999997,"5min":13.407,"15min":5.4569999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.34300000000000003},"max":{"1min":1198.962,"5min":1198.962,"15min":1198.962},"last":0.629}]},{"osd":5,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":31.141999999999999,"5min":6.9329999999999998,"15min":2.9169999999999998},"min":{"1min":0.60199999999999998,"5min":0.56299999999999994,"15min":0.42599999999999999},"max":{"1min":574.81700000000001,"5min":574.81700000000001,"15min":574.81700000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":2.9430000000000001,"5min":1.341,"15min":1.099},"min":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.501},"max":{"1min":39.896999999999998,"5min":39.896999999999998,"15min":39.896999999999998},"last":0.79900000000000004}]},{"osd":6,"last update":"Tue Nov 28 21:05:10 2023","interfaces":[{"interface":"back","average":{"1min":63.299999999999997,"5min":13.385,"15min":5.0860000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.47099999999999997},"max":{"1min":1168.432,"5min":1168.432,"15min":1168.432},"last":0.77800000000000002},{"interface":"front","average":{"1min":2.9279999999999999,"5min":1.276,"15min":1.0389999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46000000000000002},"max":{"1min":39.863,"5min":39.863,"15min":39.863},"last":0.74199999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":12.673,"5min":3.246,"15min":1.679},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.54000000000000004},"max":{"1min":143.89599999999999,"5min":143.89599999999999,"15min":143.89599999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":63.936,"5min":13.486000000000001,"15min":5.0670000000000002},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1198.933,"5min":1198.933,"15min":1198.933},"last":0.64200000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542474,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":565548,"kb_used_data":417764,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93806292,"statfs":{"total":96636764160,"available":96057643008,"internally_reserved":0,"allocated":427790336,"data_stored":427490226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":151321034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.03300000000002,"5min":93.887,"15min":31.899999999999999},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.29699999999999999},"max":{"1min":3136.5639999999999,"5min":3136.5639999999999,"15min":3136.5639999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":271.74400000000003,"5min":55.098999999999997,"15min":18.936},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.36899999999999999},"max":{"1min":2779.4099999999999,"5min":2779.4099999999999,"15min":2779.4099999999999},"last":1.0960000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":470.35899999999998,"5min":94.754999999999995,"15min":32.216000000000001},"min":{"1min":0.55900000000000005,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":3167.6399999999999,"5min":3167.6399999999999,"15min":3167.6399999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":496.947,"5min":100.057,"15min":33.951000000000001},"min":{"1min":0.61899999999999999,"5min":0.496,"15min":0.46400000000000002},"max":{"1min":4741.7640000000001,"5min":4741.7640000000001,"15min":4741.7640000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":279.05900000000003,"5min":56.529000000000003,"15min":19.739999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.42899999999999999},"max":{"1min":2301.0599999999999,"5min":2301.0599999999999,"15min":2301.0599999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":499.01799999999997,"5min":100.639,"15min":34.240000000000002},"min":{"1min":0.82999999999999996,"5min":0.69299999999999995,"15min":0.42399999999999999},"max":{"1min":4752.8689999999997,"5min":4752.8689999999997,"15min":4752.8689999999997},"last":1.0149999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.53500000000003,"5min":94.042000000000002,"15min":32.265999999999998},"min":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.44700000000000001},"max":{"1min":3147.2719999999999,"5min":3147.2719999999999,"15min":3147.2719999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":298.06700000000001,"5min":60.340000000000003,"15min":20.724},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.44500000000000001},"max":{"1min":2301.1370000000002,"5min":2301.1370000000002,"15min":2301.1370000000002},"last":0.64300000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.91200000000000003,"15min":1.282},"min":{"1min":0.69899999999999995,"5min":0.57499999999999996,"15min":0.38900000000000001},"max":{"1min":1.056,"5min":1.266,"15min":71.313000000000002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.1870000000000001},"min":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.40000000000000002},"max":{"1min":1.2929999999999999,"5min":1.335,"15min":34.881},"last":1.1890000000000001}]},{"osd":5,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0600000000000001,"15min":1.29},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.39700000000000002},"max":{"1min":1.895,"5min":1.895,"15min":44.558},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1339999999999999,"15min":1.1559999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.41399999999999998},"max":{"1min":1.956,"5min":1.956,"15min":3.782},"last":1.1479999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.01,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.44700000000000001},"max":{"1min":1.1879999999999999,"5min":1.47,"15min":7.6769999999999996},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.89100000000000001,"5min":0.71499999999999997,"15min":0.38100000000000001},"max":{"1min":1.645,"5min":1.645,"15min":2.7949999999999999},"last":1.232}]}]},{"osd":6,"up_from":14,"seq":60129542475,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600852,"kb_used_data":439180,"kb_used_omap":1,"kb_used_meta":161662,"kb_avail":93770988,"statfs":{"total":96636764160,"available":96021491712,"internally_reserved":0,"allocated":449720320,"data_stored":449421964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165542342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.524000000000001,"5min":19.795000000000002,"15min":7.1429999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.41299999999999998},"max":{"1min":1038.4960000000001,"5min":1038.4960000000001,"15min":1038.4960000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":95.692999999999998,"5min":19.936,"15min":7.2519999999999998},"min":{"1min":0.79500000000000004,"5min":0.52900000000000003,"15min":0.33600000000000002},"max":{"1min":1038.5619999999999,"5min":1038.5619999999999,"15min":1038.5619999999999},"last":1.0349999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":101.98699999999999,"5min":21.116,"15min":7.6189999999999998},"min":{"1min":0.60899999999999999,"5min":0.52900000000000003,"15min":0.41399999999999998},"max":{"1min":1046.3320000000001,"5min":1046.3320000000001,"15min":1046.3320000000001},"last":0.878},{"interface":"front","average":{"1min":68.814999999999998,"5min":14.573,"15min":5.4710000000000001},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.42899999999999999},"max":{"1min":1087.7460000000001,"5min":1087.7460000000001,"15min":1087.7460000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.518000000000001,"5min":19.795000000000002,"15min":7.1929999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.435},"max":{"1min":1038.309,"5min":1038.309,"15min":1038.309},"last":0.91400000000000003},{"interface":"front","average":{"1min":254.767,"5min":51.676000000000002,"15min":17.823},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.35099999999999998},"max":{"1min":2556.578,"5min":2556.578,"15min":2556.578},"last":1.1080000000000001}]},{"osd":3,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":225.25899999999999,"5min":45.744999999999997,"15min":15.845000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54300000000000004},"max":{"1min":2567.538,"5min":2567.538,"15min":2567.538},"last":0.94499999999999995},{"interface":"front","average":{"1min":176.50999999999999,"5min":36.079000000000001,"15min":12.673},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.39700000000000002},"max":{"1min":1371.7280000000001,"5min":1371.7280000000001,"15min":1371.7280000000001},"last":1.075}]},{"osd":4,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91200000000000003,"15min":1.0449999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":10.151},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.05,"15min":1.056},"min":{"1min":0.71299999999999997,"5min":0.64200000000000002,"15min":0.437},"max":{"1min":1.2689999999999999,"5min":1.5640000000000001,"15min":3.2629999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:05:02 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.071,"15min":1.101},"min":{"1min":0.76700000000000002,"5min":0.58399999999999996,"15min":0.50800000000000001},"max":{"1min":1.218,"5min":1.5449999999999999,"15min":4.5519999999999996},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0629999999999999,"15min":1.1519999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3480000000000001,"5min":1.694,"15min":2.1899999999999999},"last":0.755}]},{"osd":7,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1160000000000001,"15min":1.147},"min":{"1min":0.91600000000000004,"5min":0.77900000000000003,"15min":0.56899999999999995},"max":{"1min":1.3859999999999999,"5min":1.5149999999999999,"15min":4.6639999999999997},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.165,"15min":1.2150000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.651,"15min":3.2029999999999998},"last":0.84799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542475,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505928,"kb_used_data":335936,"kb_used_omap":1,"kb_used_meta":169982,"kb_avail":93865912,"statfs":{"total":96636764160,"available":96118693888,"internally_reserved":0,"allocated":343998464,"data_stored":343698460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":174062021},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:14 2023","interfaces":[{"interface":"back","average":{"1min":84.838999999999999,"5min":17.664000000000001,"15min":6.4409999999999998},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.27100000000000002},"max":{"1min":1605.194,"5min":1605.194,"15min":1605.194},"last":1.2110000000000001},{"interface":"front","average":{"1min":94.373000000000005,"5min":19.542000000000002,"15min":7.0590000000000002},"min":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.27100000000000002},"max":{"1min":1603.2260000000001,"5min":1603.2260000000001,"15min":1603.2260000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":84.260000000000005,"5min":17.545000000000002,"15min":6.4279999999999999},"min":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.253},"max":{"1min":1749.1869999999999,"5min":1749.1869999999999,"15min":1749.1869999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":279.99700000000001,"5min":56.835999999999999,"15min":19.574000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.442},"max":{"1min":3741.5659999999998,"5min":3741.5659999999998,"15min":3741.5659999999998},"last":1.1599999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":8.0679999999999996,"5min":2.411,"15min":1.4319999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.309},"max":{"1min":152.40199999999999,"5min":152.40199999999999,"15min":152.40199999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":279.81599999999997,"5min":56.707000000000001,"15min":19.506},"min":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.435},"max":{"1min":3741.3910000000001,"5min":3741.3910000000001,"15min":3741.3910000000001},"last":1.093}]},{"osd":3,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":327.06200000000001,"5min":66.230999999999995,"15min":22.754999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.34999999999999998},"max":{"1min":3904.835,"5min":3904.835,"15min":3904.835},"last":1.2589999999999999},{"interface":"front","average":{"1min":86.721999999999994,"5min":18.109999999999999,"15min":6.7000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.35299999999999998},"max":{"1min":1785.712,"5min":1785.712,"15min":1785.712},"last":0.96599999999999997}]},{"osd":4,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.28199999999999997},"max":{"1min":1.393,"5min":1.393,"15min":3.7930000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.103,"15min":1.0900000000000001},"min":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.29999999999999999},"max":{"1min":1.3120000000000001,"5min":1.5860000000000001,"15min":4.7320000000000002},"last":1.304}]},{"osd":6,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.1779999999999999},"min":{"1min":0.68200000000000005,"5min":0.65700000000000003,"15min":0.318},"max":{"1min":1.393,"5min":1.728,"15min":5.6600000000000001},"last":1.349},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.77300000000000002,"5min":0.64200000000000002,"15min":0.34000000000000002},"max":{"1min":1.536,"5min":1.6100000000000001,"15min":2.573},"last":1.0680000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1779999999999999,"15min":1.0700000000000001},"min":{"1min":0.69999999999999996,"5min":0.69299999999999995,"15min":0.28299999999999997},"max":{"1min":1.4730000000000001,"5min":1.633,"15min":3.9060000000000001},"last":1.395},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1519999999999999,"15min":1.206},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36899999999999999},"max":{"1min":1.4670000000000001,"5min":1.6519999999999999,"15min":4.8109999999999999},"last":1.123}]}]},{"osd":4,"up_from":14,"seq":60129542474,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616800,"kb_used_data":437080,"kb_used_omap":1,"kb_used_meta":179710,"kb_avail":93755040,"statfs":{"total":96636764160,"available":96005160960,"internally_reserved":0,"allocated":447569920,"data_stored":447273953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":184023493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":370.74799999999999,"5min":74.813999999999993,"15min":25.507999999999999},"min":{"1min":0.54100000000000004,"5min":0.42399999999999999,"15min":0.25600000000000001},"max":{"1min":4472.0990000000002,"5min":4472.0990000000002,"15min":4472.0990000000002},"last":0.625},{"interface":"front","average":{"1min":370.78800000000001,"5min":74.861000000000004,"15min":25.640000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.33000000000000002},"max":{"1min":4472.4799999999996,"5min":4472.4799999999996,"15min":4472.4799999999996},"last":0.88200000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":340.39299999999997,"5min":68.760000000000005,"15min":23.995999999999999},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.34000000000000002},"max":{"1min":2473.319,"5min":2473.319,"15min":2473.319},"last":0.73499999999999999},{"interface":"front","average":{"1min":343.56,"5min":69.445999999999998,"15min":24.108000000000001},"min":{"1min":0.64300000000000002,"5min":0.52400000000000002,"15min":0.40600000000000003},"max":{"1min":2525.277,"5min":2525.277,"15min":2525.277},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":193.78399999999999,"5min":39.509999999999998,"15min":14.141},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.38600000000000001},"max":{"1min":2323.7979999999998,"5min":2323.7979999999998,"15min":2323.7979999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":308.291,"5min":62.448,"15min":21.914000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.35599999999999998},"max":{"1min":2498.6460000000002,"5min":2498.6460000000002,"15min":2498.6460000000002},"last":1.0329999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":311.33499999999998,"5min":63.033000000000001,"15min":21.722999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38900000000000001},"max":{"1min":2516.6700000000001,"5min":2516.6700000000001,"15min":2516.6700000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":321.84899999999999,"5min":65.114000000000004,"15min":22.658000000000001},"min":{"1min":0.75700000000000001,"5min":0.53200000000000003,"15min":0.441},"max":{"1min":2478.165,"5min":2478.165,"15min":2478.165},"last":0.81200000000000006}]},{"osd":5,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":1.292},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.36399999999999999},"max":{"1min":1.1699999999999999,"5min":1.3999999999999999,"15min":19.408999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.016,"15min":1.0940000000000001},"min":{"1min":0.67400000000000004,"5min":0.502,"15min":0.35699999999999998},"max":{"1min":1.3360000000000001,"5min":1.4970000000000001,"15min":9.375},"last":1.1319999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.032,"15min":1.3540000000000001},"min":{"1min":0.67700000000000005,"5min":0.625,"15min":0.42399999999999999},"max":{"1min":1.3460000000000001,"5min":1.415,"15min":36.531999999999996},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.087,"5min":1.111,"15min":1.772},"min":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.42799999999999999},"max":{"1min":1.3440000000000001,"5min":1.4730000000000001,"15min":85.367999999999995},"last":1.081}]},{"osd":7,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.2070000000000001},"min":{"1min":0.73099999999999998,"5min":0.61099999999999999,"15min":0.42999999999999999},"max":{"1min":1.403,"5min":1.5760000000000001,"15min":9.3399999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1499999999999999,"15min":1.4330000000000001},"min":{"1min":0.85399999999999998,"5min":0.78900000000000003,"15min":0.33900000000000002},"max":{"1min":1.5509999999999999,"5min":1.577,"15min":36.591999999999999},"last":1.01}]}]},{"osd":0,"up_from":14,"seq":60129542474,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503304,"kb_used_data":345792,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":93868536,"statfs":{"total":96636764160,"available":96121380864,"internally_reserved":0,"allocated":354091008,"data_stored":353789699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":22.460000000000001,"5min":4.8289999999999997,"15min":1.97},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":297.16899999999998,"5min":297.16899999999998,"15min":297.16899999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":22.552,"5min":4.9340000000000002,"15min":1.984},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":297.202,"5min":297.202,"15min":297.202},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":20.687000000000001,"5min":4.5090000000000003,"15min":1.8580000000000001},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":335.166,"5min":335.166,"15min":335.166},"last":0.32500000000000001},{"interface":"front","average":{"1min":19.943999999999999,"5min":4.4329999999999998,"15min":1.835},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":335.19400000000002,"5min":335.19400000000002,"15min":335.19400000000002},"last":0.371}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":4.274,"5min":1.325,"15min":0.81599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.28399999999999997},"max":{"1min":53.808,"5min":53.808,"15min":53.808},"last":0.41899999999999998},{"interface":"front","average":{"1min":145.27699999999999,"5min":29.565000000000001,"15min":10.308},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35599999999999998},"max":{"1min":2839.3989999999999,"5min":2839.3989999999999,"15min":2839.3989999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":135.411,"5min":27.715,"15min":9.8290000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2822.2359999999999,"5min":2822.2359999999999,"15min":2822.2359999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":135.35900000000001,"5min":27.701000000000001,"15min":9.7970000000000006},"min":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.496},"max":{"1min":2822.212,"5min":2822.212,"15min":2822.212},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":96.162000000000006,"5min":19.890999999999998,"15min":7.1820000000000004},"min":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.47099999999999997},"max":{"1min":1936.5550000000001,"5min":1936.5550000000001,"15min":1936.5550000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":122.643,"5min":25.228999999999999,"15min":8.9879999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.50700000000000001},"max":{"1min":1999.019,"5min":1999.019,"15min":1999.019},"last":0.73099999999999998}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":142.648,"5min":29.18,"15min":10.353999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48199999999999998},"max":{"1min":2832.431,"5min":2832.431,"15min":2832.431},"last":0.52700000000000002},{"interface":"front","average":{"1min":142.119,"5min":29.050999999999998,"15min":10.282999999999999},"min":{"1min":0.56299999999999994,"5min":0.48599999999999999,"15min":0.44700000000000001},"max":{"1min":2822.1840000000002,"5min":2822.1840000000002,"15min":2822.1840000000002},"last":0.754}]},{"osd":7,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":146.452,"5min":30.036999999999999,"15min":10.622},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.53300000000000003},"max":{"1min":1999.058,"5min":1999.058,"15min":1999.058},"last":1.0649999999999999},{"interface":"front","average":{"1min":225.40299999999999,"5min":45.713999999999999,"15min":15.869999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2822.143,"5min":2822.143,"15min":2822.143},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":170106880,"data_stored":170090025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":171458560,"data_stored":171434421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85495808,"data_stored":85471932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":183201792,"data_stored":183178341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":187912192,"data_stored":187897127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171967842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":182108160,"data_stored":182090706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209731584,"data_stored":209715928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":182788096,"data_stored":182788096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":297787392,"data_stored":297787392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":197746688,"data_stored":197746688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":288649216,"data_stored":288649216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259055616,"data_stored":259055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171409408,"data_stored":171409408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":267010048,"data_stored":267010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":216862720,"data_stored":216862720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:05:24.504 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:05:24.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c06d80640 1 Processor -- start 2023-11-28T21:05:24.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c06d80640 1 -- start start 2023-11-28T21:05:24.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c06d80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c00151f60 0x7f9c000c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c06d80640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c000c5c90 0x7f9c000c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c06d80640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0015b220 con 0x7f9c0006a580 2023-11-28T21:05:24.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c06d80640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c000c4da0 con 0x7f9c000c5c90 2023-11-28T21:05:24.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c06d80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000c60f0 con 0x7f9c00151f60 2023-11-28T21:05:24.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9bfffff640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c000c5c90 0x7f9c000c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c04b1c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c00151f60 0x7f9c000c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c04b1c640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c00151f60 0x7f9c000c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:56680/0 (socket says 172.21.15.167:56680) 2023-11-28T21:05:24.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c04b1c640 1 -- 172.21.15.167:0/1092184196 learned_addr learned my addr 172.21.15.167:0/1092184196 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:24.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c04b1c640 1 -- 172.21.15.167:0/1092184196 >> v2:172.21.15.178:3300/0 conn(0x7f9c000c5c90 msgr2=0x7f9c000c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:24.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c04b1c640 1 --2- 172.21.15.167:0/1092184196 >> v2:172.21.15.178:3300/0 conn(0x7f9c000c5c90 0x7f9c000c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c04b1c640 1 -- 172.21.15.167:0/1092184196 >> v1:172.21.15.178:6789/0 conn(0x7f9c0006a580 legacy=0x7f9c0006ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9c04b1c640 1 -- 172.21.15.167:0/1092184196 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00152340 con 0x7f9c00151f60 2023-11-28T21:05:24.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.645+0000 7f9bfffff640 1 --2- 172.21.15.167:0/1092184196 >> v2:172.21.15.178:3300/0 conn(0x7f9c000c5c90 0x7f9c000c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:05:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9c04b1c640 1 --2- 172.21.15.167:0/1092184196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c00151f60 0x7f9c000c75c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009870 tx=0x7f9bf001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37571b8812454960 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9bff7fe640 1 -- 172.21.15.167:0/1092184196 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00ac600 con 0x7f9c00151f60 2023-11-28T21:05:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9bff7fe640 1 -- 172.21.15.167:0/1092184196 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf00a8050 con 0x7f9c00151f60 2023-11-28T21:05:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9bff7fe640 1 -- 172.21.15.167:0/1092184196 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf00ac980 con 0x7f9c00151f60 2023-11-28T21:05:24.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9c06d80640 1 -- 172.21.15.167:0/1092184196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c00151f60 msgr2=0x7f9c000c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9c06d80640 1 --2- 172.21.15.167:0/1092184196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c00151f60 0x7f9c000c75c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009870 tx=0x7f9bf001c4b0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9c06d80640 1 -- 172.21.15.167:0/1092184196 shutdown_connections 2023-11-28T21:05:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9c06d80640 1 --2- 172.21.15.167:0/1092184196 >> v2:172.21.15.178:3300/0 conn(0x7f9c000c5c90 0x7f9c000c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9c06d80640 1 --2- 172.21.15.167:0/1092184196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c00151f60 0x7f9c000c75c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9c06d80640 1 -- 172.21.15.167:0/1092184196 >> 172.21.15.167:0/1092184196 conn(0x7f9c000cb1e0 msgr2=0x7f9c000cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9c06d80640 1 -- 172.21.15.167:0/1092184196 shutdown_connections 2023-11-28T21:05:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.649+0000 7f9c06d80640 1 -- 172.21.15.167:0/1092184196 wait complete. 2023-11-28T21:05:24.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 Processor -- start 2023-11-28T21:05:24.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 -- start start 2023-11-28T21:05:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c0006a580 0x7f9c0014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c000c5c90 0x7f9c001f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c00151f60 0x7f9c001f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c000c91e0 con 0x7f9c000c5c90 2023-11-28T21:05:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c001609a0 con 0x7f9c00151f60 2023-11-28T21:05:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c00160c60 con 0x7f9c0006a580 2023-11-28T21:05:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c000c5c90 0x7f9c001f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c000c5c90 0x7f9c001f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56780/0 (socket says 172.21.15.167:56780) 2023-11-28T21:05:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfffff640 1 -- 172.21.15.167:0/1629618186 learned_addr learned my addr 172.21.15.167:0/1629618186 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c04b1c640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c0006a580 0x7f9c0014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c0531d640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c00151f60 0x7f9c001f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfffff640 1 -- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c0006a580 msgr2=0x7f9c0014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfffff640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c0006a580 0x7f9c0014f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfffff640 1 -- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c00151f60 msgr2=0x7f9c001f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfffff640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c00151f60 0x7f9c001f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfffff640 1 -- 172.21.15.167:0/1629618186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf4009420 con 0x7f9c000c5c90 2023-11-28T21:05:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c04b1c640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c0006a580 0x7f9c0014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:05:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c0531d640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c00151f60 0x7f9c001f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:05:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfffff640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c000c5c90 0x7f9c001f2b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400ebe0 tx=0x7f9bf400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfd7fa640 1 -- 172.21.15.167:0/1629618186 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400eee0 con 0x7f9c000c5c90 2023-11-28T21:05:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf00094d0 con 0x7f9c000c5c90 2023-11-28T21:05:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfd7fa640 1 -- 172.21.15.167:0/1629618186 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf400cc30 con 0x7f9c000c5c90 2023-11-28T21:05:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfd7fa640 1 -- 172.21.15.167:0/1629618186 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4013470 con 0x7f9c000c5c90 2023-11-28T21:05:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0015a640 con 0x7f9c000c5c90 2023-11-28T21:05:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c000682c0 con 0x7f9c000c5c90 2023-11-28T21:05:24.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.653+0000 7f9bfd7fa640 1 -- 172.21.15.167:0/1629618186 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9bf40135d0 con 0x7f9c000c5c90 2023-11-28T21:05:24.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.657+0000 7f9bfd7fa640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9bec0664a0 0x7f9bec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:24.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.657+0000 7f9bfd7fa640 1 -- 172.21.15.167:0/1629618186 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9bf4084500 con 0x7f9c000c5c90 2023-11-28T21:05:24.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.657+0000 7f9c04b1c640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9bec0664a0 0x7f9bec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:24.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.657+0000 7f9c04b1c640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9bec0664a0 0x7f9bec068960 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00ae000 tx=0x7f9bf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:24.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.661+0000 7f9bfd7fa640 1 -- 172.21.15.167:0/1629618186 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9bf40515a0 con 0x7f9c000c5c90 2023-11-28T21:05:24.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.801+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c0014d690 con 0x7f9bec0664a0 2023-11-28T21:05:24.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.829+0000 7f9bfd7fa640 1 -- 172.21.15.167:0/1629618186 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373433 (secure 0 0 0) 0x7f9c0014d690 con 0x7f9bec0664a0 2023-11-28T21:05:24.835 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:05:24.837 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T21:05:24.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9bec0664a0 msgr2=0x7f9bec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9bec0664a0 0x7f9bec068960 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00ae000 tx=0x7f9bf0008040 comp rx=0 tx=0).stop 2023-11-28T21:05:24.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c000c5c90 msgr2=0x7f9c001f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:24.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c000c5c90 0x7f9c001f2b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400ebe0 tx=0x7f9bf400c520 comp rx=0 tx=0).stop 2023-11-28T21:05:24.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 shutdown_connections 2023-11-28T21:05:24.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9bec0664a0 0x7f9bec068960 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c00151f60 0x7f9c001f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c000c5c90 0x7f9c001f2b50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 --2- 172.21.15.167:0/1629618186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c0006a580 0x7f9c0014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:24.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 >> 172.21.15.167:0/1629618186 conn(0x7f9c000cb1e0 msgr2=0x7f9c0006ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:24.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 shutdown_connections 2023-11-28T21:05:24.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:24.833+0000 7f9c06d80640 1 -- 172.21.15.167:0/1629618186 wait complete. 2023-11-28T21:05:24.851 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2023-11-28T21:05:24.123227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573738351,"num_objects":18293,"num_object_clones":8054,"num_object_copies":71918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18293,"num_whiteouts":7974,"num_read":2751,"num_read_kb":105055,"num_write":63161,"num_write_kb":1870913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98493,"ondisk_log_size":98493,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4529000,"kb_used_data":3173160,"kb_used_omap":12,"kb_used_meta":1355763,"kb_avail":750445720,"statfs":{"total":773094113280,"available":768456417280,"internally_reserved":0,"allocated":3249315840,"data_stored":3246905922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1388301872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005405"},"pg_stats":[{"pgid":"2.1f","version":"51'546","reported_seq":602,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:20.520764+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T21:03:20.520764+0000","last_peered":"2023-11-28T21:03:20.520764+0000","last_clean":"2023-11-28T21:03:20.520764+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T21:03:20.520764+0000","last_undegraded":"2023-11-28T21:03:20.520764+0000","last_fullsized":"2023-11-28T21:03:20.520764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":13,"num_write":501,"num_write_kb":29002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'428","reported_seq":2515,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495354+0000","last_change":"2023-11-28T20:44:35.608330+0000","last_active":"2023-11-28T21:04:30.495354+0000","last_peered":"2023-11-28T21:04:30.495354+0000","last_clean":"2023-11-28T21:04:30.495354+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T21:04:30.495354+0000","last_undegraded":"2023-11-28T21:04:30.495354+0000","last_fullsized":"2023-11-28T21:04:30.495354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:36.704510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012127499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"51'1858","reported_seq":3698,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:41.608342+0000","last_change":"2023-11-28T20:44:35.612490+0000","last_active":"2023-11-28T21:02:41.608342+0000","last_peered":"2023-11-28T21:02:41.608342+0000","last_clean":"2023-11-28T21:02:41.608342+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T21:02:41.608342+0000","last_undegraded":"2023-11-28T21:02:41.608342+0000","last_fullsized":"2023-11-28T21:02:41.608342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:27.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016916996,"stat_sum":{"num_bytes":12268315,"num_objects":556,"num_object_clones":279,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":239,"num_read":31,"num_read_kb":4126,"num_write":1561,"num_write_kb":24667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"51'611","reported_seq":667,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:26.606132+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T21:02:26.606132+0000","last_peered":"2023-11-28T21:02:26.606132+0000","last_clean":"2023-11-28T21:02:26.606132+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T21:02:26.606132+0000","last_undegraded":"2023-11-28T21:02:26.606132+0000","last_fullsized":"2023-11-28T21:02:26.606132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":546,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"51'383","reported_seq":2477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.563998+0000","last_change":"2023-11-28T20:44:35.603931+0000","last_active":"2023-11-28T21:04:28.563998+0000","last_peered":"2023-11-28T21:04:28.563998+0000","last_clean":"2023-11-28T21:04:28.563998+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T21:04:28.563998+0000","last_undegraded":"2023-11-28T21:04:28.563998+0000","last_fullsized":"2023-11-28T21:04:28.563998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:34.323314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010031783000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"51'1843","reported_seq":3720,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.579659+0000","last_change":"2023-11-28T20:44:35.541215+0000","last_active":"2023-11-28T21:02:35.579659+0000","last_peered":"2023-11-28T21:02:35.579659+0000","last_clean":"2023-11-28T21:02:35.579659+0000","last_became_active":"2023-11-28T20:39:01.389891+0000","last_became_peered":"2023-11-28T20:39:01.389891+0000","last_unstale":"2023-11-28T21:02:35.579659+0000","last_undegraded":"2023-11-28T21:02:35.579659+0000","last_fullsized":"2023-11-28T21:02:35.579659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:49.951369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084388650000000003,"stat_sum":{"num_bytes":22024896,"num_objects":578,"num_object_clones":267,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":267,"num_read":47,"num_read_kb":8236,"num_write":1555,"num_write_kb":33440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"51'579","reported_seq":631,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.546713+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T21:00:50.546713+0000","last_peered":"2023-11-28T21:00:50.546713+0000","last_clean":"2023-11-28T21:00:50.546713+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T21:00:50.546713+0000","last_undegraded":"2023-11-28T21:00:50.546713+0000","last_fullsized":"2023-11-28T21:00:50.546713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"51'396","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173832+0000","last_change":"2023-11-28T20:44:35.614099+0000","last_active":"2023-11-28T21:04:23.173832+0000","last_peered":"2023-11-28T21:04:23.173832+0000","last_clean":"2023-11-28T21:04:23.173832+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T21:04:23.173832+0000","last_undegraded":"2023-11-28T21:04:23.173832+0000","last_fullsized":"2023-11-28T21:04:23.173832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:34.672454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016140509000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1696","reported_seq":3582,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558555+0000","last_change":"2023-11-28T20:44:35.542225+0000","last_active":"2023-11-28T21:00:55.558555+0000","last_peered":"2023-11-28T21:00:55.558555+0000","last_clean":"2023-11-28T21:00:55.558555+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T21:00:55.558555+0000","last_undegraded":"2023-11-28T21:00:55.558555+0000","last_fullsized":"2023-11-28T21:00:55.558555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:49.565280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0093789649999999995,"stat_sum":{"num_bytes":11818887,"num_objects":514,"num_object_clones":236,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":236,"num_read":34,"num_read_kb":34,"num_write":1442,"num_write_kb":18567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"51'404","reported_seq":457,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.546585+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T21:00:50.546585+0000","last_peered":"2023-11-28T21:00:50.546585+0000","last_clean":"2023-11-28T21:00:50.546585+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T21:00:50.546585+0000","last_undegraded":"2023-11-28T21:00:50.546585+0000","last_fullsized":"2023-11-28T21:00:50.546585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":354,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"51'394","reported_seq":2485,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173820+0000","last_change":"2023-11-28T20:44:35.618164+0000","last_active":"2023-11-28T21:04:23.173820+0000","last_peered":"2023-11-28T21:04:23.173820+0000","last_clean":"2023-11-28T21:04:23.173820+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T21:04:23.173820+0000","last_undegraded":"2023-11-28T21:04:23.173820+0000","last_fullsized":"2023-11-28T21:04:23.173820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:10.074109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019881585,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"51'1748","reported_seq":3613,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558505+0000","last_change":"2023-11-28T20:44:35.542475+0000","last_active":"2023-11-28T21:00:55.558505+0000","last_peered":"2023-11-28T21:00:55.558505+0000","last_clean":"2023-11-28T21:00:55.558505+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T21:00:55.558505+0000","last_undegraded":"2023-11-28T21:00:55.558505+0000","last_fullsized":"2023-11-28T21:00:55.558505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:42.606296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092901790000000008,"stat_sum":{"num_bytes":16892767,"num_objects":571,"num_object_clones":263,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":571,"num_whiteouts":263,"num_read":40,"num_read_kb":48,"num_write":1465,"num_write_kb":20221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"51'418","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.174499+0000","last_change":"2023-11-28T20:44:35.616278+0000","last_active":"2023-11-28T21:04:23.174499+0000","last_peered":"2023-11-28T21:04:23.174499+0000","last_clean":"2023-11-28T21:04:23.174499+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T21:04:23.174499+0000","last_undegraded":"2023-11-28T21:04:23.174499+0000","last_fullsized":"2023-11-28T21:04:23.174499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:02.355511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017860755999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"51'336","reported_seq":391,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:05.575243+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T21:03:05.575243+0000","last_peered":"2023-11-28T21:03:05.575243+0000","last_clean":"2023-11-28T21:03:05.575243+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T21:03:05.575243+0000","last_undegraded":"2023-11-28T21:03:05.575243+0000","last_fullsized":"2023-11-28T21:03:05.575243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":274,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"51'1713","reported_seq":3605,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558652+0000","last_change":"2023-11-28T20:44:35.546423+0000","last_active":"2023-11-28T21:00:55.558652+0000","last_peered":"2023-11-28T21:00:55.558652+0000","last_clean":"2023-11-28T21:00:55.558652+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T21:00:55.558652+0000","last_undegraded":"2023-11-28T21:00:55.558652+0000","last_fullsized":"2023-11-28T21:00:55.558652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:21.576866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011349794999999999,"stat_sum":{"num_bytes":42075033,"num_objects":519,"num_object_clones":229,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":229,"num_read":33,"num_read_kb":8223,"num_write":1463,"num_write_kb":57658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"51'395","reported_seq":2488,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.567073+0000","last_change":"2023-11-28T20:44:35.615271+0000","last_active":"2023-11-28T21:04:28.567073+0000","last_peered":"2023-11-28T21:04:28.567073+0000","last_clean":"2023-11-28T21:04:28.567073+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T21:04:28.567073+0000","last_undegraded":"2023-11-28T21:04:28.567073+0000","last_fullsized":"2023-11-28T21:04:28.567073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:18.118595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018528307000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"51'468","reported_seq":523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:11.726550+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T21:02:11.726550+0000","last_peered":"2023-11-28T21:02:11.726550+0000","last_clean":"2023-11-28T21:02:11.726550+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T21:02:11.726550+0000","last_undegraded":"2023-11-28T21:02:11.726550+0000","last_fullsized":"2023-11-28T21:02:11.726550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2,"num_read_kb":11,"num_write":693,"num_write_kb":25655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'1827","reported_seq":3709,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558612+0000","last_change":"2023-11-28T20:44:35.543575+0000","last_active":"2023-11-28T21:00:55.558612+0000","last_peered":"2023-11-28T21:00:55.558612+0000","last_clean":"2023-11-28T21:00:55.558612+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T21:00:55.558612+0000","last_undegraded":"2023-11-28T21:00:55.558612+0000","last_fullsized":"2023-11-28T21:00:55.558612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:19.718029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010051028,"stat_sum":{"num_bytes":36081004,"num_objects":549,"num_object_clones":242,"num_object_copies":2196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":242,"num_read":36,"num_read_kb":4131,"num_write":1572,"num_write_kb":47387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"51'429","reported_seq":2522,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.496490+0000","last_change":"2023-11-28T20:44:35.615648+0000","last_active":"2023-11-28T21:04:30.496490+0000","last_peered":"2023-11-28T21:04:30.496490+0000","last_clean":"2023-11-28T21:04:30.496490+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T21:04:30.496490+0000","last_undegraded":"2023-11-28T21:04:30.496490+0000","last_fullsized":"2023-11-28T21:04:30.496490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:53.863754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018799937999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"51'666","reported_seq":721,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:11.726510+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T21:02:11.726510+0000","last_peered":"2023-11-28T21:02:11.726510+0000","last_clean":"2023-11-28T21:02:11.726510+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T21:02:11.726510+0000","last_undegraded":"2023-11-28T21:02:11.726510+0000","last_fullsized":"2023-11-28T21:02:11.726510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":627,"num_write_kb":16946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"51'1842","reported_seq":3706,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:56.717412+0000","last_change":"2023-11-28T20:44:35.608957+0000","last_active":"2023-11-28T21:00:56.717412+0000","last_peered":"2023-11-28T21:00:56.717412+0000","last_clean":"2023-11-28T21:00:56.717412+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T21:00:56.717412+0000","last_undegraded":"2023-11-28T21:00:56.717412+0000","last_fullsized":"2023-11-28T21:00:56.717412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:59.559204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011785257,"stat_sum":{"num_bytes":33810901,"num_objects":586,"num_object_clones":259,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":259,"num_read":37,"num_read_kb":8227,"num_write":1558,"num_write_kb":44779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"51'406","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491184+0000","last_change":"2023-11-28T20:44:35.545606+0000","last_active":"2023-11-28T21:04:30.491184+0000","last_peered":"2023-11-28T21:04:30.491184+0000","last_clean":"2023-11-28T21:04:30.491184+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T21:04:30.491184+0000","last_undegraded":"2023-11-28T21:04:30.491184+0000","last_fullsized":"2023-11-28T21:04:30.491184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:54.158095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011190047999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"51'485","reported_seq":540,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:10.563468+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T21:02:10.563468+0000","last_peered":"2023-11-28T21:02:10.563468+0000","last_clean":"2023-11-28T21:02:10.563468+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T21:02:10.563468+0000","last_undegraded":"2023-11-28T21:02:10.563468+0000","last_fullsized":"2023-11-28T21:02:10.563468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":18,"num_write":441,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"51'1805","reported_seq":3653,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558679+0000","last_change":"2023-11-28T20:44:35.544665+0000","last_active":"2023-11-28T21:00:55.558679+0000","last_peered":"2023-11-28T21:00:55.558679+0000","last_clean":"2023-11-28T21:00:55.558679+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T21:00:55.558679+0000","last_undegraded":"2023-11-28T21:00:55.558679+0000","last_fullsized":"2023-11-28T21:00:55.558679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:22.582437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010413970999999999,"stat_sum":{"num_bytes":29462623,"num_objects":568,"num_object_clones":283,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":243,"num_read":43,"num_read_kb":8342,"num_write":1501,"num_write_kb":36747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"51'401","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.496089+0000","last_change":"2023-11-28T20:44:35.608781+0000","last_active":"2023-11-28T21:04:30.496089+0000","last_peered":"2023-11-28T21:04:30.496089+0000","last_clean":"2023-11-28T21:04:30.496089+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T21:04:30.496089+0000","last_undegraded":"2023-11-28T21:04:30.496089+0000","last_fullsized":"2023-11-28T21:04:30.496089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:44.493316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013760692,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"51'145","reported_seq":202,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:10.559549+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T21:02:10.559549+0000","last_peered":"2023-11-28T21:02:10.559549+0000","last_clean":"2023-11-28T21:02:10.559549+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T21:02:10.559549+0000","last_undegraded":"2023-11-28T21:02:10.559549+0000","last_fullsized":"2023-11-28T21:02:10.559549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":6,"num_read_kb":32,"num_write":106,"num_write_kb":8401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"51'1903","reported_seq":3757,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.563869+0000","last_change":"2023-11-28T20:44:35.542749+0000","last_active":"2023-11-28T21:01:20.563869+0000","last_peered":"2023-11-28T21:01:20.563869+0000","last_clean":"2023-11-28T21:01:20.563869+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T21:01:20.563869+0000","last_undegraded":"2023-11-28T21:01:20.563869+0000","last_fullsized":"2023-11-28T21:01:20.563869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:36:45.378771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092734619999999997,"stat_sum":{"num_bytes":42280101,"num_objects":591,"num_object_clones":269,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":269,"num_read":33,"num_read_kb":4128,"num_write":1621,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"51'381","reported_seq":2474,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564479+0000","last_change":"2023-11-28T20:44:35.614397+0000","last_active":"2023-11-28T21:04:28.564479+0000","last_peered":"2023-11-28T21:04:28.564479+0000","last_clean":"2023-11-28T21:04:28.564479+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T21:04:28.564479+0000","last_undegraded":"2023-11-28T21:04:28.564479+0000","last_fullsized":"2023-11-28T21:04:28.564479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:21.145648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017915146,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"51'420","reported_seq":477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495460+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T21:04:30.495460+0000","last_peered":"2023-11-28T21:04:30.495460+0000","last_clean":"2023-11-28T21:04:30.495460+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T21:04:30.495460+0000","last_undegraded":"2023-11-28T21:04:30.495460+0000","last_fullsized":"2023-11-28T21:04:30.495460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12049925,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":6,"num_read_kb":23,"num_write":692,"num_write_kb":13743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"51'1784","reported_seq":3657,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:31.606632+0000","last_change":"2023-11-28T20:44:35.612546+0000","last_active":"2023-11-28T21:02:31.606632+0000","last_peered":"2023-11-28T21:02:31.606632+0000","last_clean":"2023-11-28T21:02:31.606632+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T21:02:31.606632+0000","last_undegraded":"2023-11-28T21:02:31.606632+0000","last_fullsized":"2023-11-28T21:02:31.606632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:05.737793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016539027000000001,"stat_sum":{"num_bytes":21707636,"num_objects":558,"num_object_clones":259,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":558,"num_whiteouts":259,"num_read":41,"num_read_kb":41,"num_write":1502,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"51'425","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.493811+0000","last_change":"2023-11-28T20:44:35.607913+0000","last_active":"2023-11-28T21:04:30.493811+0000","last_peered":"2023-11-28T21:04:30.493811+0000","last_clean":"2023-11-28T21:04:30.493811+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T21:04:30.493811+0000","last_undegraded":"2023-11-28T21:04:30.493811+0000","last_fullsized":"2023-11-28T21:04:30.493811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:48.810598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014316661,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'350","reported_seq":404,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.553069+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T21:01:20.553069+0000","last_peered":"2023-11-28T21:01:20.553069+0000","last_clean":"2023-11-28T21:01:20.553069+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T21:01:20.553069+0000","last_undegraded":"2023-11-28T21:01:20.553069+0000","last_fullsized":"2023-11-28T21:01:20.553069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360150,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":28962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"51'1789","reported_seq":3654,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.505359+0000","last_change":"2023-11-28T20:44:35.610536+0000","last_active":"2023-11-28T21:01:20.505359+0000","last_peered":"2023-11-28T21:01:20.505359+0000","last_clean":"2023-11-28T21:01:20.505359+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T21:01:20.505359+0000","last_undegraded":"2023-11-28T21:01:20.505359+0000","last_fullsized":"2023-11-28T21:01:20.505359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:15:04.264103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014620091,"stat_sum":{"num_bytes":29165465,"num_objects":561,"num_object_clones":251,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":561,"num_whiteouts":251,"num_read":26,"num_read_kb":26,"num_write":1521,"num_write_kb":34762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"51'414","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.508165+0000","last_change":"2023-11-28T20:44:35.624605+0000","last_active":"2023-11-28T21:04:26.508165+0000","last_peered":"2023-11-28T21:04:26.508165+0000","last_clean":"2023-11-28T21:04:26.508165+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T21:04:26.508165+0000","last_undegraded":"2023-11-28T21:04:26.508165+0000","last_fullsized":"2023-11-28T21:04:26.508165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:38.051342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025775551000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"51'259","reported_seq":313,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:16.719823+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T21:01:16.719823+0000","last_peered":"2023-11-28T21:01:16.719823+0000","last_clean":"2023-11-28T21:01:16.719823+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T21:01:16.719823+0000","last_undegraded":"2023-11-28T21:01:16.719823+0000","last_fullsized":"2023-11-28T21:01:16.719823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":24764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"51'1827","reported_seq":3688,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:56.519697+0000","last_change":"2023-11-28T20:44:35.529967+0000","last_active":"2023-11-28T21:01:56.519697+0000","last_peered":"2023-11-28T21:01:56.519697+0000","last_clean":"2023-11-28T21:01:56.519697+0000","last_became_active":"2023-11-28T20:39:01.570987+0000","last_became_peered":"2023-11-28T20:39:01.570987+0000","last_unstale":"2023-11-28T21:01:56.519697+0000","last_undegraded":"2023-11-28T21:01:56.519697+0000","last_fullsized":"2023-11-28T21:01:56.519697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:41.602286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017641899999999999,"stat_sum":{"num_bytes":29603349,"num_objects":551,"num_object_clones":257,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":257,"num_read":32,"num_read_kb":32,"num_write":1550,"num_write_kb":37188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"51'420","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.557069+0000","last_change":"2023-11-28T20:44:35.545769+0000","last_active":"2023-11-28T21:04:28.557069+0000","last_peered":"2023-11-28T21:04:28.557069+0000","last_clean":"2023-11-28T21:04:28.557069+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T21:04:28.557069+0000","last_undegraded":"2023-11-28T21:04:28.557069+0000","last_fullsized":"2023-11-28T21:04:28.557069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:16.077909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010944188000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"51'420","reported_seq":475,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:15.557955+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T21:01:15.557955+0000","last_peered":"2023-11-28T21:01:15.557955+0000","last_clean":"2023-11-28T21:01:15.557955+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T21:01:15.557955+0000","last_undegraded":"2023-11-28T21:01:15.557955+0000","last_fullsized":"2023-11-28T21:01:15.557955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":379,"num_write_kb":16755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"51'1754","reported_seq":3629,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:21.720349+0000","last_change":"2023-11-28T20:44:35.606459+0000","last_active":"2023-11-28T21:01:21.720349+0000","last_peered":"2023-11-28T21:01:21.720349+0000","last_clean":"2023-11-28T21:01:21.720349+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T21:01:21.720349+0000","last_undegraded":"2023-11-28T21:01:21.720349+0000","last_fullsized":"2023-11-28T21:01:21.720349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:40.726057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012892727999999999,"stat_sum":{"num_bytes":30726234,"num_objects":547,"num_object_clones":244,"num_object_copies":2188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":244,"num_read":30,"num_read_kb":7398,"num_write":1499,"num_write_kb":38104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'416","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494824+0000","last_change":"2023-11-28T20:44:35.602022+0000","last_active":"2023-11-28T21:04:30.494824+0000","last_peered":"2023-11-28T21:04:30.494824+0000","last_clean":"2023-11-28T21:04:30.494824+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T21:04:30.494824+0000","last_undegraded":"2023-11-28T21:04:30.494824+0000","last_fullsized":"2023-11-28T21:04:30.494824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:56:28.293643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0088104640000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"51'904","reported_seq":1395,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.520162+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T21:04:23.520162+0000","last_peered":"2023-11-28T21:04:23.520162+0000","last_clean":"2023-11-28T21:04:23.520162+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T21:04:23.520162+0000","last_undegraded":"2023-11-28T21:04:23.520162+0000","last_fullsized":"2023-11-28T21:04:23.520162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26750948,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":437,"num_read_kb":1190,"num_write":846,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"51'1696","reported_seq":3563,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:16.727464+0000","last_change":"2023-11-28T20:44:35.609122+0000","last_active":"2023-11-28T21:02:16.727464+0000","last_peered":"2023-11-28T21:02:16.727464+0000","last_clean":"2023-11-28T21:02:16.727464+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T21:02:16.727464+0000","last_undegraded":"2023-11-28T21:02:16.727464+0000","last_fullsized":"2023-11-28T21:02:16.727464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:02.039768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744523999999999,"stat_sum":{"num_bytes":4888539,"num_objects":545,"num_object_clones":249,"num_object_copies":2180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":249,"num_read":26,"num_read_kb":26,"num_write":1427,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'419","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559875+0000","last_change":"2023-11-28T20:44:35.607743+0000","last_active":"2023-11-28T21:04:28.559875+0000","last_peered":"2023-11-28T21:04:28.559875+0000","last_clean":"2023-11-28T21:04:28.559875+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T21:04:28.559875+0000","last_undegraded":"2023-11-28T21:04:28.559875+0000","last_fullsized":"2023-11-28T21:04:28.559875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:14.103778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013248289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"51'468","reported_seq":523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:25.566548+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T21:02:25.566548+0000","last_peered":"2023-11-28T21:02:25.566548+0000","last_clean":"2023-11-28T21:02:25.566548+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T21:02:25.566548+0000","last_undegraded":"2023-11-28T21:02:25.566548+0000","last_fullsized":"2023-11-28T21:02:25.566548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"51'1786","reported_seq":3671,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.512440+0000","last_change":"2023-11-28T20:44:35.607810+0000","last_active":"2023-11-28T21:02:15.512440+0000","last_peered":"2023-11-28T21:02:15.512440+0000","last_clean":"2023-11-28T21:02:15.512440+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T21:02:15.512440+0000","last_undegraded":"2023-11-28T21:02:15.512440+0000","last_fullsized":"2023-11-28T21:02:15.512440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:26:41.398324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013136992,"stat_sum":{"num_bytes":25033729,"num_objects":551,"num_object_clones":252,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":252,"num_read":47,"num_read_kb":4142,"num_write":1517,"num_write_kb":28607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'391","reported_seq":2484,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.573272+0000","last_change":"2023-11-28T20:44:35.610823+0000","last_active":"2023-11-28T21:04:28.573272+0000","last_peered":"2023-11-28T21:04:28.573272+0000","last_clean":"2023-11-28T21:04:28.573272+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T21:04:28.573272+0000","last_undegraded":"2023-11-28T21:04:28.573272+0000","last_fullsized":"2023-11-28T21:04:28.573272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:29:14.727147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015322676,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'353","reported_seq":409,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:15.557982+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T21:01:15.557982+0000","last_peered":"2023-11-28T21:01:15.557982+0000","last_clean":"2023-11-28T21:01:15.557982+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T21:01:15.557982+0000","last_undegraded":"2023-11-28T21:01:15.557982+0000","last_fullsized":"2023-11-28T21:01:15.557982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":20,"num_write":319,"num_write_kb":12656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.564511+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T21:02:15.564511+0000","last_peered":"2023-11-28T21:02:15.564511+0000","last_clean":"2023-11-28T21:02:15.564511+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T21:02:15.564511+0000","last_undegraded":"2023-11-28T21:02:15.564511+0000","last_fullsized":"2023-11-28T21:02:15.564511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1795","reported_seq":3660,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:25.550179+0000","last_change":"2023-11-28T20:44:35.608577+0000","last_active":"2023-11-28T21:01:25.550179+0000","last_peered":"2023-11-28T21:01:25.550179+0000","last_clean":"2023-11-28T21:01:25.550179+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T21:01:25.550179+0000","last_undegraded":"2023-11-28T21:01:25.550179+0000","last_fullsized":"2023-11-28T21:01:25.550179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:14.094878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012304083,"stat_sum":{"num_bytes":50974055,"num_objects":563,"num_object_clones":255,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":255,"num_read":30,"num_read_kb":4125,"num_write":1519,"num_write_kb":57288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"51'375","reported_seq":2468,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.170631+0000","last_change":"2023-11-28T20:44:35.637477+0000","last_active":"2023-11-28T21:04:23.170631+0000","last_peered":"2023-11-28T21:04:23.170631+0000","last_clean":"2023-11-28T21:04:23.170631+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T21:04:23.170631+0000","last_undegraded":"2023-11-28T21:04:23.170631+0000","last_fullsized":"2023-11-28T21:04:23.170631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:35.213092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027789237000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"51'212","reported_seq":268,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:06.527993+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T21:03:06.527993+0000","last_peered":"2023-11-28T21:03:06.527993+0000","last_clean":"2023-11-28T21:03:06.527993+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T21:03:06.527993+0000","last_undegraded":"2023-11-28T21:03:06.527993+0000","last_fullsized":"2023-11-28T21:03:06.527993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777798,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":15,"num_write":164,"num_write_kb":16643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"51'1783","reported_seq":3664,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:20.561530+0000","last_change":"2023-11-28T20:44:35.614664+0000","last_active":"2023-11-28T21:02:20.561530+0000","last_peered":"2023-11-28T21:02:20.561530+0000","last_clean":"2023-11-28T21:02:20.561530+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T21:02:20.561530+0000","last_undegraded":"2023-11-28T21:02:20.561530+0000","last_fullsized":"2023-11-28T21:02:20.561530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:12:48.251405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016877468,"stat_sum":{"num_bytes":24953790,"num_objects":536,"num_object_clones":250,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":250,"num_read":41,"num_read_kb":41,"num_write":1520,"num_write_kb":33586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"51'453","reported_seq":2546,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.449547+0000","last_change":"2023-11-28T20:44:35.618675+0000","last_active":"2023-11-28T21:04:26.449547+0000","last_peered":"2023-11-28T21:04:26.449547+0000","last_clean":"2023-11-28T21:04:26.449547+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T21:04:26.449547+0000","last_undegraded":"2023-11-28T21:04:26.449547+0000","last_fullsized":"2023-11-28T21:04:26.449547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:27:00.507693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020341659000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"51'393","reported_seq":447,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:51.716770+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T21:00:51.716770+0000","last_peered":"2023-11-28T21:00:51.716770+0000","last_clean":"2023-11-28T21:00:51.716770+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T21:00:51.716770+0000","last_undegraded":"2023-11-28T21:00:51.716770+0000","last_fullsized":"2023-11-28T21:00:51.716770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777286,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":9,"num_write":342,"num_write_kb":16717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"51'1767","reported_seq":3643,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:10.519491+0000","last_change":"2023-11-28T20:44:35.611130+0000","last_active":"2023-11-28T21:03:10.519491+0000","last_peered":"2023-11-28T21:03:10.519491+0000","last_clean":"2023-11-28T21:03:10.519491+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T21:03:10.519491+0000","last_undegraded":"2023-11-28T21:03:10.519491+0000","last_fullsized":"2023-11-28T21:03:10.519491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:59.725546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014814858,"stat_sum":{"num_bytes":20638408,"num_objects":542,"num_object_clones":251,"num_object_copies":2168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":251,"num_read":37,"num_read_kb":37,"num_write":1496,"num_write_kb":31881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"51'403","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173054+0000","last_change":"2023-11-28T20:44:35.640929+0000","last_active":"2023-11-28T21:04:23.173054+0000","last_peered":"2023-11-28T21:04:23.173054+0000","last_clean":"2023-11-28T21:04:23.173054+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T21:04:23.173054+0000","last_undegraded":"2023-11-28T21:04:23.173054+0000","last_fullsized":"2023-11-28T21:04:23.173054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:27:39.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017837387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"51'371","reported_seq":427,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:51.511992+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T21:00:51.511992+0000","last_peered":"2023-11-28T21:00:51.511992+0000","last_clean":"2023-11-28T21:00:51.511992+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T21:00:51.511992+0000","last_undegraded":"2023-11-28T21:00:51.511992+0000","last_fullsized":"2023-11-28T21:00:51.511992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":22,"num_write":339,"num_write_kb":16887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"51'1847","reported_seq":3731,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.570080+0000","last_change":"2023-11-28T20:44:35.610893+0000","last_active":"2023-11-28T21:02:15.570080+0000","last_peered":"2023-11-28T21:02:15.570080+0000","last_clean":"2023-11-28T21:02:15.570080+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T21:02:15.570080+0000","last_undegraded":"2023-11-28T21:02:15.570080+0000","last_fullsized":"2023-11-28T21:02:15.570080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:13:32.634308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015179433000000001,"stat_sum":{"num_bytes":40252075,"num_objects":555,"num_object_clones":243,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":243,"num_read":37,"num_read_kb":1813,"num_write":1586,"num_write_kb":49527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"51'398","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.172349+0000","last_change":"2023-11-28T20:44:35.639947+0000","last_active":"2023-11-28T21:04:23.172349+0000","last_peered":"2023-11-28T21:04:23.172349+0000","last_clean":"2023-11-28T21:04:23.172349+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T21:04:23.172349+0000","last_undegraded":"2023-11-28T21:04:23.172349+0000","last_fullsized":"2023-11-28T21:04:23.172349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:55.543573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018023955000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"51'400","reported_seq":453,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:10.587072+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T21:03:10.587072+0000","last_peered":"2023-11-28T21:03:10.587072+0000","last_clean":"2023-11-28T21:03:10.587072+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T21:03:10.587072+0000","last_undegraded":"2023-11-28T21:03:10.587072+0000","last_fullsized":"2023-11-28T21:03:10.587072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094443,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":19633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"51'1788","reported_seq":3658,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.575375+0000","last_change":"2023-11-28T20:44:35.541705+0000","last_active":"2023-11-28T21:02:15.575375+0000","last_peered":"2023-11-28T21:02:15.575375+0000","last_clean":"2023-11-28T21:02:15.575375+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T21:02:15.575375+0000","last_undegraded":"2023-11-28T21:02:15.575375+0000","last_fullsized":"2023-11-28T21:02:15.575375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:17.458129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0090848279999999997,"stat_sum":{"num_bytes":25858877,"num_objects":550,"num_object_clones":249,"num_object_copies":2200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":550,"num_whiteouts":249,"num_read":30,"num_read_kb":4125,"num_write":1526,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"51'442","reported_seq":2534,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.171801+0000","last_change":"2023-11-28T20:44:35.636676+0000","last_active":"2023-11-28T21:04:23.171801+0000","last_peered":"2023-11-28T21:04:23.171801+0000","last_clean":"2023-11-28T21:04:23.171801+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T21:04:23.171801+0000","last_undegraded":"2023-11-28T21:04:23.171801+0000","last_fullsized":"2023-11-28T21:04:23.171801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:01:42.241191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020570496000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"51'633","reported_seq":687,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:41.517747+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T21:01:41.517747+0000","last_peered":"2023-11-28T21:01:41.517747+0000","last_clean":"2023-11-28T21:01:41.517747+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T21:01:41.517747+0000","last_undegraded":"2023-11-28T21:01:41.517747+0000","last_fullsized":"2023-11-28T21:01:41.517747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":7,"num_write":598,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"51'1723","reported_seq":3619,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.515230+0000","last_change":"2023-11-28T20:44:35.606276+0000","last_active":"2023-11-28T21:02:35.515230+0000","last_peered":"2023-11-28T21:02:35.515230+0000","last_clean":"2023-11-28T21:02:35.515230+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T21:02:35.515230+0000","last_undegraded":"2023-11-28T21:02:35.515230+0000","last_fullsized":"2023-11-28T21:02:35.515230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:25.189350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011806407999999999,"stat_sum":{"num_bytes":28712373,"num_objects":524,"num_object_clones":239,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":239,"num_read":46,"num_read_kb":46,"num_write":1462,"num_write_kb":31285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"51'407","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.562470+0000","last_change":"2023-11-28T20:44:35.611801+0000","last_active":"2023-11-28T21:04:28.562470+0000","last_peered":"2023-11-28T21:04:28.562470+0000","last_clean":"2023-11-28T21:04:28.562470+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T21:04:28.562470+0000","last_undegraded":"2023-11-28T21:04:28.562470+0000","last_fullsized":"2023-11-28T21:04:28.562470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:13.862302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014629055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"51'458","reported_seq":511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.552953+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T21:01:40.552953+0000","last_peered":"2023-11-28T21:01:40.552953+0000","last_clean":"2023-11-28T21:01:40.552953+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T21:01:40.552953+0000","last_undegraded":"2023-11-28T21:01:40.552953+0000","last_fullsized":"2023-11-28T21:01:40.552953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"51'1831","reported_seq":3699,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:36.607550+0000","last_change":"2023-11-28T20:44:35.613708+0000","last_active":"2023-11-28T21:02:36.607550+0000","last_peered":"2023-11-28T21:02:36.607550+0000","last_clean":"2023-11-28T21:02:36.607550+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T21:02:36.607550+0000","last_undegraded":"2023-11-28T21:02:36.607550+0000","last_fullsized":"2023-11-28T21:02:36.607550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:25.921514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017596898999999999,"stat_sum":{"num_bytes":20840070,"num_objects":572,"num_object_clones":259,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":259,"num_read":39,"num_read_kb":4134,"num_write":1549,"num_write_kb":33741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.172578+0000","last_change":"2023-11-28T20:44:35.639082+0000","last_active":"2023-11-28T21:04:23.172578+0000","last_peered":"2023-11-28T21:04:23.172578+0000","last_clean":"2023-11-28T21:04:23.172578+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T21:04:23.172578+0000","last_undegraded":"2023-11-28T21:04:23.172578+0000","last_fullsized":"2023-11-28T21:04:23.172578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:17.336904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019240779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"51'284","reported_seq":338,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.562767+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T21:01:40.562767+0000","last_peered":"2023-11-28T21:01:40.562767+0000","last_clean":"2023-11-28T21:01:40.562767+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T21:01:40.562767+0000","last_undegraded":"2023-11-28T21:01:40.562767+0000","last_fullsized":"2023-11-28T21:01:40.562767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":238,"num_write_kb":12572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"51'1661","reported_seq":3548,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:51.601005+0000","last_change":"2023-11-28T20:44:35.616111+0000","last_active":"2023-11-28T21:01:51.601005+0000","last_peered":"2023-11-28T21:01:51.601005+0000","last_clean":"2023-11-28T21:01:51.601005+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T21:01:51.601005+0000","last_undegraded":"2023-11-28T21:01:51.601005+0000","last_fullsized":"2023-11-28T21:01:51.601005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:36.330587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018495173,"stat_sum":{"num_bytes":20919340,"num_objects":524,"num_object_clones":235,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":235,"num_read":33,"num_read_kb":33,"num_write":1415,"num_write_kb":40695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"51'413","reported_seq":2505,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.560104+0000","last_change":"2023-11-28T20:44:35.609530+0000","last_active":"2023-11-28T21:04:28.560104+0000","last_peered":"2023-11-28T21:04:28.560104+0000","last_clean":"2023-11-28T21:04:28.560104+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T21:04:28.560104+0000","last_undegraded":"2023-11-28T21:04:28.560104+0000","last_fullsized":"2023-11-28T21:04:28.560104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:39:49.725834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014112118999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"51'405","reported_seq":458,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.507981+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T21:01:40.507981+0000","last_peered":"2023-11-28T21:01:40.507981+0000","last_clean":"2023-11-28T21:01:40.507981+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T21:01:40.507981+0000","last_undegraded":"2023-11-28T21:01:40.507981+0000","last_fullsized":"2023-11-28T21:01:40.507981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":16779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"51'1691","reported_seq":3584,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.574707+0000","last_change":"2023-11-28T20:44:35.613305+0000","last_active":"2023-11-28T21:02:35.574707+0000","last_peered":"2023-11-28T21:02:35.574707+0000","last_clean":"2023-11-28T21:02:35.574707+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T21:02:35.574707+0000","last_undegraded":"2023-11-28T21:02:35.574707+0000","last_fullsized":"2023-11-28T21:02:35.574707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:51.165815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015550285,"stat_sum":{"num_bytes":33895761,"num_objects":515,"num_object_clones":224,"num_object_copies":2060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515,"num_whiteouts":224,"num_read":28,"num_read_kb":28,"num_write":1451,"num_write_kb":37503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"51'394","reported_seq":2486,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.424848+0000","last_change":"2023-11-28T20:44:35.632331+0000","last_active":"2023-11-28T21:04:28.424848+0000","last_peered":"2023-11-28T21:04:28.424848+0000","last_clean":"2023-11-28T21:04:28.424848+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T21:04:28.424848+0000","last_undegraded":"2023-11-28T21:04:28.424848+0000","last_fullsized":"2023-11-28T21:04:28.424848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:35:55.459943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022690017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'566","reported_seq":619,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:05.583299+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T21:04:05.583299+0000","last_peered":"2023-11-28T21:04:05.583299+0000","last_clean":"2023-11-28T21:04:05.583299+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T21:04:05.583299+0000","last_undegraded":"2023-11-28T21:04:05.583299+0000","last_fullsized":"2023-11-28T21:04:05.583299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":24942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"51'1823","reported_seq":3693,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:46.723591+0000","last_change":"2023-11-28T20:44:35.607147+0000","last_active":"2023-11-28T21:01:46.723591+0000","last_peered":"2023-11-28T21:01:46.723591+0000","last_clean":"2023-11-28T21:01:46.723591+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T21:01:46.723591+0000","last_undegraded":"2023-11-28T21:01:46.723591+0000","last_fullsized":"2023-11-28T21:01:46.723591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1823,"log_dups_size":0,"ondisk_log_size":1823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:45.887527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013090108,"stat_sum":{"num_bytes":42607549,"num_objects":556,"num_object_clones":254,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":254,"num_read":36,"num_read_kb":4131,"num_write":1543,"num_write_kb":57518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"51'388","reported_seq":2473,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491642+0000","last_change":"2023-11-28T20:44:35.530346+0000","last_active":"2023-11-28T21:04:30.491642+0000","last_peered":"2023-11-28T21:04:30.491642+0000","last_clean":"2023-11-28T21:04:30.491642+0000","last_became_active":"2023-11-28T20:39:01.848225+0000","last_became_peered":"2023-11-28T20:39:01.848225+0000","last_unstale":"2023-11-28T21:04:30.491642+0000","last_undegraded":"2023-11-28T21:04:30.491642+0000","last_fullsized":"2023-11-28T21:04:30.491642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:47.582113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019608149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'538","reported_seq":591,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:31.729219+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T21:02:31.729219+0000","last_peered":"2023-11-28T21:02:31.729219+0000","last_clean":"2023-11-28T21:02:31.729219+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T21:02:31.729219+0000","last_undegraded":"2023-11-28T21:02:31.729219+0000","last_fullsized":"2023-11-28T21:02:31.729219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":21060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"51'1816","reported_seq":3706,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:45.569384+0000","last_change":"2023-11-28T20:44:35.543972+0000","last_active":"2023-11-28T21:01:45.569384+0000","last_peered":"2023-11-28T21:01:45.569384+0000","last_clean":"2023-11-28T21:01:45.569384+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T21:01:45.569384+0000","last_undegraded":"2023-11-28T21:01:45.569384+0000","last_fullsized":"2023-11-28T21:01:45.569384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:46.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010092998000000001,"stat_sum":{"num_bytes":33600436,"num_objects":568,"num_object_clones":254,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":254,"num_read":57,"num_read_kb":4152,"num_write":1538,"num_write_kb":45454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"51'410","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564086+0000","last_change":"2023-11-28T20:44:35.605933+0000","last_active":"2023-11-28T21:04:28.564086+0000","last_peered":"2023-11-28T21:04:28.564086+0000","last_clean":"2023-11-28T21:04:28.564086+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T21:04:28.564086+0000","last_undegraded":"2023-11-28T21:04:28.564086+0000","last_fullsized":"2023-11-28T21:04:28.564086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:47.440506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744874000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"51'484","reported_seq":538,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.573719+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T21:02:30.573719+0000","last_peered":"2023-11-28T21:02:30.573719+0000","last_clean":"2023-11-28T21:02:30.573719+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T21:02:30.573719+0000","last_undegraded":"2023-11-28T21:02:30.573719+0000","last_fullsized":"2023-11-28T21:02:30.573719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":27,"num_write":437,"num_write_kb":33175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"51'1777","reported_seq":3671,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:46.600267+0000","last_change":"2023-11-28T20:44:35.614798+0000","last_active":"2023-11-28T21:01:46.600267+0000","last_peered":"2023-11-28T21:01:46.600267+0000","last_clean":"2023-11-28T21:01:46.600267+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T21:01:46.600267+0000","last_undegraded":"2023-11-28T21:01:46.600267+0000","last_fullsized":"2023-11-28T21:01:46.600267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:55.011311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018323326000000001,"stat_sum":{"num_bytes":24785841,"num_objects":525,"num_object_clones":238,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":238,"num_read":34,"num_read_kb":34,"num_write":1518,"num_write_kb":32579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178537+0000","last_change":"2023-11-28T20:44:35.621854+0000","last_active":"2023-11-28T21:04:23.178537+0000","last_peered":"2023-11-28T21:04:23.178537+0000","last_clean":"2023-11-28T21:04:23.178537+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T21:04:23.178537+0000","last_undegraded":"2023-11-28T21:04:23.178537+0000","last_fullsized":"2023-11-28T21:04:23.178537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:22.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022293309000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"51'163","reported_seq":216,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.563729+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T21:02:30.563729+0000","last_peered":"2023-11-28T21:02:30.563729+0000","last_clean":"2023-11-28T21:02:30.563729+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T21:02:30.563729+0000","last_undegraded":"2023-11-28T21:02:30.563729+0000","last_fullsized":"2023-11-28T21:02:30.563729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"51'1914","reported_seq":3776,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:46.600301+0000","last_change":"2023-11-28T20:44:35.611992+0000","last_active":"2023-11-28T21:01:46.600301+0000","last_peered":"2023-11-28T21:01:46.600301+0000","last_clean":"2023-11-28T21:01:46.600301+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T21:01:46.600301+0000","last_undegraded":"2023-11-28T21:01:46.600301+0000","last_fullsized":"2023-11-28T21:01:46.600301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:08:22.583119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016210088000000001,"stat_sum":{"num_bytes":26682582,"num_objects":583,"num_object_clones":263,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":583,"num_whiteouts":263,"num_read":39,"num_read_kb":8229,"num_write":1627,"num_write_kb":50263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"51'1808","reported_seq":3653,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.514653+0000","last_change":"2023-11-28T20:44:35.605377+0000","last_active":"2023-11-28T21:02:30.514653+0000","last_peered":"2023-11-28T21:02:30.514653+0000","last_clean":"2023-11-28T21:02:30.514653+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T21:02:30.514653+0000","last_undegraded":"2023-11-28T21:02:30.514653+0000","last_fullsized":"2023-11-28T21:02:30.514653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:55:41.417877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011090378999999999,"stat_sum":{"num_bytes":29341830,"num_objects":589,"num_object_clones":267,"num_object_copies":2356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":267,"num_read":21,"num_read_kb":21,"num_write":1524,"num_write_kb":32957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494763+0000","last_change":"2023-11-28T20:44:35.601680+0000","last_active":"2023-11-28T21:04:30.494763+0000","last_peered":"2023-11-28T21:04:30.494763+0000","last_clean":"2023-11-28T21:04:30.494763+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T21:04:30.494763+0000","last_undegraded":"2023-11-28T21:04:30.494763+0000","last_fullsized":"2023-11-28T21:04:30.494763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:33.094463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0086681780000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"51'600","reported_seq":655,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.573365+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T21:02:30.573365+0000","last_peered":"2023-11-28T21:02:30.573365+0000","last_clean":"2023-11-28T21:02:30.573365+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T21:02:30.573365+0000","last_undegraded":"2023-11-28T21:02:30.573365+0000","last_fullsized":"2023-11-28T21:02:30.573365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":33,"num_write":550,"num_write_kb":45433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"51'1738","reported_seq":3612,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.549285+0000","last_change":"2023-11-28T20:44:35.619807+0000","last_active":"2023-11-28T21:01:20.549285+0000","last_peered":"2023-11-28T21:01:20.549285+0000","last_clean":"2023-11-28T21:01:20.549285+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T21:01:20.549285+0000","last_undegraded":"2023-11-28T21:01:20.549285+0000","last_fullsized":"2023-11-28T21:01:20.549285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1738,"log_dups_size":0,"ondisk_log_size":1738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:00.302899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016829818,"stat_sum":{"num_bytes":16566795,"num_objects":555,"num_object_clones":248,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":248,"num_read":32,"num_read_kb":32,"num_write":1476,"num_write_kb":23281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"51'447","reported_seq":2539,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.567545+0000","last_change":"2023-11-28T20:44:35.615234+0000","last_active":"2023-11-28T21:04:28.567545+0000","last_peered":"2023-11-28T21:04:28.567545+0000","last_clean":"2023-11-28T21:04:28.567545+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T21:04:28.567545+0000","last_undegraded":"2023-11-28T21:04:28.567545+0000","last_fullsized":"2023-11-28T21:04:28.567545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:49.468386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018571445999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"51'758","reported_seq":1302,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:36.607484+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T21:02:36.607484+0000","last_peered":"2023-11-28T21:02:36.607484+0000","last_clean":"2023-11-28T21:02:36.607484+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T21:02:36.607484+0000","last_undegraded":"2023-11-28T21:02:36.607484+0000","last_fullsized":"2023-11-28T21:02:36.607484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18014655,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":492,"num_read_kb":1568,"num_write":714,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"51'1105","reported_seq":1657,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.543016+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T21:00:50.543016+0000","last_peered":"2023-11-28T21:00:50.543016+0000","last_clean":"2023-11-28T21:00:50.543016+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T21:00:50.543016+0000","last_undegraded":"2023-11-28T21:00:50.543016+0000","last_fullsized":"2023-11-28T21:00:50.543016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34584852,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":502,"num_read_kb":1393,"num_write":1050,"num_write_kb":34570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"51'366","reported_seq":2457,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559286+0000","last_change":"2023-11-28T20:44:35.611477+0000","last_active":"2023-11-28T21:04:28.559286+0000","last_peered":"2023-11-28T21:04:28.559286+0000","last_clean":"2023-11-28T21:04:28.559286+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T21:04:28.559286+0000","last_undegraded":"2023-11-28T21:04:28.559286+0000","last_fullsized":"2023-11-28T21:04:28.559286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:56.615977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014791248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"51'1725","reported_seq":3594,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:56.512564+0000","last_change":"2023-11-28T20:44:35.530646+0000","last_active":"2023-11-28T21:00:56.512564+0000","last_peered":"2023-11-28T21:00:56.512564+0000","last_clean":"2023-11-28T21:00:56.512564+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T21:00:56.512564+0000","last_undegraded":"2023-11-28T21:00:56.512564+0000","last_fullsized":"2023-11-28T21:00:56.512564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.553500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022000169999999999,"stat_sum":{"num_bytes":29986576,"num_objects":543,"num_object_clones":248,"num_object_copies":2172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":248,"num_read":29,"num_read_kb":29,"num_write":1454,"num_write_kb":38376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"51'365","reported_seq":417,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:51.592796+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T21:00:51.592796+0000","last_peered":"2023-11-28T21:00:51.592796+0000","last_clean":"2023-11-28T21:00:51.592796+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T21:00:51.592796+0000","last_undegraded":"2023-11-28T21:00:51.592796+0000","last_fullsized":"2023-11-28T21:00:51.592796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":20723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"51'401","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491589+0000","last_change":"2023-11-28T20:44:35.544103+0000","last_active":"2023-11-28T21:04:30.491589+0000","last_peered":"2023-11-28T21:04:30.491589+0000","last_clean":"2023-11-28T21:04:30.491589+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T21:04:30.491589+0000","last_undegraded":"2023-11-28T21:04:30.491589+0000","last_fullsized":"2023-11-28T21:04:30.491589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:40.051010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010086065,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"51'1756","reported_seq":3648,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:56.593503+0000","last_change":"2023-11-28T20:44:35.611344+0000","last_active":"2023-11-28T21:00:56.593503+0000","last_peered":"2023-11-28T21:00:56.593503+0000","last_clean":"2023-11-28T21:00:56.593503+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T21:00:56.593503+0000","last_undegraded":"2023-11-28T21:00:56.593503+0000","last_fullsized":"2023-11-28T21:00:56.593503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:16.879801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015656369999999999,"stat_sum":{"num_bytes":33768985,"num_objects":521,"num_object_clones":238,"num_object_copies":2084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":238,"num_read":45,"num_read_kb":12330,"num_write":1499,"num_write_kb":48802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"51'415","reported_seq":2508,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559730+0000","last_change":"2023-11-28T20:44:35.609721+0000","last_active":"2023-11-28T21:04:28.559730+0000","last_peered":"2023-11-28T21:04:28.559730+0000","last_clean":"2023-11-28T21:04:28.559730+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T21:04:28.559730+0000","last_undegraded":"2023-11-28T21:04:28.559730+0000","last_fullsized":"2023-11-28T21:04:28.559730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:39.776841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013289166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"51'439","reported_seq":2532,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491719+0000","last_change":"2023-11-28T20:44:35.529934+0000","last_active":"2023-11-28T21:04:30.491719+0000","last_peered":"2023-11-28T21:04:30.491719+0000","last_clean":"2023-11-28T21:04:30.491719+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T21:04:30.491719+0000","last_undegraded":"2023-11-28T21:04:30.491719+0000","last_fullsized":"2023-11-28T21:04:30.491719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:44:09.727309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017225739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"51'438","reported_seq":2531,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564572+0000","last_change":"2023-11-28T20:44:35.624744+0000","last_active":"2023-11-28T21:04:28.564572+0000","last_peered":"2023-11-28T21:04:28.564572+0000","last_clean":"2023-11-28T21:04:28.564572+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T21:04:28.564572+0000","last_undegraded":"2023-11-28T21:04:28.564572+0000","last_fullsized":"2023-11-28T21:04:28.564572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:53.447494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018881576000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"51'384","reported_seq":2477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.558946+0000","last_change":"2023-11-28T20:44:35.611177+0000","last_active":"2023-11-28T21:04:28.558946+0000","last_peered":"2023-11-28T21:04:28.558946+0000","last_clean":"2023-11-28T21:04:28.558946+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T21:04:28.558946+0000","last_undegraded":"2023-11-28T21:04:28.558946+0000","last_fullsized":"2023-11-28T21:04:28.558946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:06.242482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014673739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"51'367","reported_seq":2460,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.565973+0000","last_change":"2023-11-28T20:44:35.615657+0000","last_active":"2023-11-28T21:04:28.565973+0000","last_peered":"2023-11-28T21:04:28.565973+0000","last_clean":"2023-11-28T21:04:28.565973+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T21:04:28.565973+0000","last_undegraded":"2023-11-28T21:04:28.565973+0000","last_fullsized":"2023-11-28T21:04:28.565973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:28.718350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017627927000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"51'417","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495102+0000","last_change":"2023-11-28T20:44:35.599239+0000","last_active":"2023-11-28T21:04:30.495102+0000","last_peered":"2023-11-28T21:04:30.495102+0000","last_clean":"2023-11-28T21:04:30.495102+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T21:04:30.495102+0000","last_undegraded":"2023-11-28T21:04:30.495102+0000","last_fullsized":"2023-11-28T21:04:30.495102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:20.147670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061577519999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"51'426","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.177843+0000","last_change":"2023-11-28T20:44:35.619451+0000","last_active":"2023-11-28T21:04:23.177843+0000","last_peered":"2023-11-28T21:04:23.177843+0000","last_clean":"2023-11-28T21:04:23.177843+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T21:04:23.177843+0000","last_undegraded":"2023-11-28T21:04:23.177843+0000","last_fullsized":"2023-11-28T21:04:23.177843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:18.657101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017436297999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"51'394","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564166+0000","last_change":"2023-11-28T20:44:35.614405+0000","last_active":"2023-11-28T21:04:28.564166+0000","last_peered":"2023-11-28T21:04:28.564166+0000","last_clean":"2023-11-28T21:04:28.564166+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T21:04:28.564166+0000","last_undegraded":"2023-11-28T21:04:28.564166+0000","last_fullsized":"2023-11-28T21:04:28.564166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:26:38.450255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018095488999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"51'421","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.454749+0000","last_change":"2023-11-28T20:44:35.611219+0000","last_active":"2023-11-28T21:04:26.454749+0000","last_peered":"2023-11-28T21:04:26.454749+0000","last_clean":"2023-11-28T21:04:26.454749+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T21:04:26.454749+0000","last_undegraded":"2023-11-28T21:04:26.454749+0000","last_fullsized":"2023-11-28T21:04:26.454749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:23.122455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014654275,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"51'411","reported_seq":2504,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:29.587753+0000","last_change":"2023-11-28T20:44:35.613449+0000","last_active":"2023-11-28T21:04:29.587753+0000","last_peered":"2023-11-28T21:04:29.587753+0000","last_clean":"2023-11-28T21:04:29.587753+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T21:04:29.587753+0000","last_undegraded":"2023-11-28T21:04:29.587753+0000","last_fullsized":"2023-11-28T21:04:29.587753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:48.348409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017356489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"51'417","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492103+0000","last_change":"2023-11-28T20:44:35.530341+0000","last_active":"2023-11-28T21:04:30.492103+0000","last_peered":"2023-11-28T21:04:30.492103+0000","last_clean":"2023-11-28T21:04:30.492103+0000","last_became_active":"2023-11-28T20:39:01.848167+0000","last_became_peered":"2023-11-28T20:39:01.848167+0000","last_unstale":"2023-11-28T21:04:30.492103+0000","last_undegraded":"2023-11-28T21:04:30.492103+0000","last_fullsized":"2023-11-28T21:04:30.492103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:22.610505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020579169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"51'422","reported_seq":2515,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.560548+0000","last_change":"2023-11-28T20:44:35.610405+0000","last_active":"2023-11-28T21:04:28.560548+0000","last_peered":"2023-11-28T21:04:28.560548+0000","last_clean":"2023-11-28T21:04:28.560548+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T21:04:28.560548+0000","last_undegraded":"2023-11-28T21:04:28.560548+0000","last_fullsized":"2023-11-28T21:04:28.560548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:42.309551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014291543,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"51'396","reported_seq":2489,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.193454+0000","last_change":"2023-11-28T20:44:35.620800+0000","last_active":"2023-11-28T21:04:23.193454+0000","last_peered":"2023-11-28T21:04:23.193454+0000","last_clean":"2023-11-28T21:04:23.193454+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T21:04:23.193454+0000","last_undegraded":"2023-11-28T21:04:23.193454+0000","last_fullsized":"2023-11-28T21:04:23.193454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:05.581863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017003022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"51'403","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492431+0000","last_change":"2023-11-28T20:44:35.638243+0000","last_active":"2023-11-28T21:04:30.492431+0000","last_peered":"2023-11-28T21:04:30.492431+0000","last_clean":"2023-11-28T21:04:30.492431+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T21:04:30.492431+0000","last_undegraded":"2023-11-28T21:04:30.492431+0000","last_fullsized":"2023-11-28T21:04:30.492431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:50:42.227579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020849563000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"51'393","reported_seq":2485,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491669+0000","last_change":"2023-11-28T20:44:35.530649+0000","last_active":"2023-11-28T21:04:30.491669+0000","last_peered":"2023-11-28T21:04:30.491669+0000","last_clean":"2023-11-28T21:04:30.491669+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T21:04:30.491669+0000","last_undegraded":"2023-11-28T21:04:30.491669+0000","last_fullsized":"2023-11-28T21:04:30.491669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:56.771896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019691359999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"51'430","reported_seq":2522,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178483+0000","last_change":"2023-11-28T20:44:35.617721+0000","last_active":"2023-11-28T21:04:23.178483+0000","last_peered":"2023-11-28T21:04:23.178483+0000","last_clean":"2023-11-28T21:04:23.178483+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T21:04:23.178483+0000","last_undegraded":"2023-11-28T21:04:23.178483+0000","last_fullsized":"2023-11-28T21:04:23.178483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:40.430998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019569492000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"51'421","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559068+0000","last_change":"2023-11-28T20:44:35.612279+0000","last_active":"2023-11-28T21:04:28.559068+0000","last_peered":"2023-11-28T21:04:28.559068+0000","last_clean":"2023-11-28T21:04:28.559068+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T21:04:28.559068+0000","last_undegraded":"2023-11-28T21:04:28.559068+0000","last_fullsized":"2023-11-28T21:04:28.559068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:57.398242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015773832000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"51'435","reported_seq":2527,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491364+0000","last_change":"2023-11-28T20:44:35.606941+0000","last_active":"2023-11-28T21:04:30.491364+0000","last_peered":"2023-11-28T21:04:30.491364+0000","last_clean":"2023-11-28T21:04:30.491364+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T21:04:30.491364+0000","last_undegraded":"2023-11-28T21:04:30.491364+0000","last_fullsized":"2023-11-28T21:04:30.491364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:10.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013692045,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"51'417","reported_seq":2509,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495486+0000","last_change":"2023-11-28T20:44:35.609244+0000","last_active":"2023-11-28T21:04:30.495486+0000","last_peered":"2023-11-28T21:04:30.495486+0000","last_clean":"2023-11-28T21:04:30.495486+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T21:04:30.495486+0000","last_undegraded":"2023-11-28T21:04:30.495486+0000","last_fullsized":"2023-11-28T21:04:30.495486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:51.107877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014004656000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"51'418","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564298+0000","last_change":"2023-11-28T20:44:35.614800+0000","last_active":"2023-11-28T21:04:28.564298+0000","last_peered":"2023-11-28T21:04:28.564298+0000","last_clean":"2023-11-28T21:04:28.564298+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T21:04:28.564298+0000","last_undegraded":"2023-11-28T21:04:28.564298+0000","last_fullsized":"2023-11-28T21:04:28.564298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:23:59.393140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018246884000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"51'374","reported_seq":2466,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.158886+0000","last_change":"2023-11-28T20:44:35.544988+0000","last_active":"2023-11-28T21:04:23.158886+0000","last_peered":"2023-11-28T21:04:23.158886+0000","last_clean":"2023-11-28T21:04:23.158886+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T21:04:23.158886+0000","last_undegraded":"2023-11-28T21:04:23.158886+0000","last_fullsized":"2023-11-28T21:04:23.158886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:16:32.112808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010909501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"51'380","reported_seq":2472,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176371+0000","last_change":"2023-11-28T20:44:35.611282+0000","last_active":"2023-11-28T21:04:23.176371+0000","last_peered":"2023-11-28T21:04:23.176371+0000","last_clean":"2023-11-28T21:04:23.176371+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T21:04:23.176371+0000","last_undegraded":"2023-11-28T21:04:23.176371+0000","last_fullsized":"2023-11-28T21:04:23.176371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:52:02.947575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014265125,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"51'385","reported_seq":2484,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492462+0000","last_change":"2023-11-28T20:44:35.618555+0000","last_active":"2023-11-28T21:04:30.492462+0000","last_peered":"2023-11-28T21:04:30.492462+0000","last_clean":"2023-11-28T21:04:30.492462+0000","last_became_active":"2023-11-28T20:39:01.391291+0000","last_became_peered":"2023-11-28T20:39:01.391291+0000","last_unstale":"2023-11-28T21:04:30.492462+0000","last_undegraded":"2023-11-28T21:04:30.492462+0000","last_fullsized":"2023-11-28T21:04:30.492462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:29.414536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017078507999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"51'419","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176881+0000","last_change":"2023-11-28T20:44:35.640277+0000","last_active":"2023-11-28T21:04:23.176881+0000","last_peered":"2023-11-28T21:04:23.176881+0000","last_clean":"2023-11-28T21:04:23.176881+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T21:04:23.176881+0000","last_undegraded":"2023-11-28T21:04:23.176881+0000","last_fullsized":"2023-11-28T21:04:23.176881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.933807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017711331,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"51'405","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564972+0000","last_change":"2023-11-28T20:44:35.613891+0000","last_active":"2023-11-28T21:04:28.564972+0000","last_peered":"2023-11-28T21:04:28.564972+0000","last_clean":"2023-11-28T21:04:28.564972+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T21:04:28.564972+0000","last_undegraded":"2023-11-28T21:04:28.564972+0000","last_fullsized":"2023-11-28T21:04:28.564972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:40.197882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017616142000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"51'400","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.561114+0000","last_change":"2023-11-28T20:44:35.635891+0000","last_active":"2023-11-28T21:04:28.561114+0000","last_peered":"2023-11-28T21:04:28.561114+0000","last_clean":"2023-11-28T21:04:28.561114+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T21:04:28.561114+0000","last_undegraded":"2023-11-28T21:04:28.561114+0000","last_fullsized":"2023-11-28T21:04:28.561114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:37:28.366415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020312439000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"51'403","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.558229+0000","last_change":"2023-11-28T20:44:35.622789+0000","last_active":"2023-11-28T21:04:28.558229+0000","last_peered":"2023-11-28T21:04:28.558229+0000","last_clean":"2023-11-28T21:04:28.558229+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T21:04:28.558229+0000","last_undegraded":"2023-11-28T21:04:28.558229+0000","last_fullsized":"2023-11-28T21:04:28.558229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:13:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017449602000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"51'416","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492750+0000","last_change":"2023-11-28T20:44:35.638249+0000","last_active":"2023-11-28T21:04:30.492750+0000","last_peered":"2023-11-28T21:04:30.492750+0000","last_clean":"2023-11-28T21:04:30.492750+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T21:04:30.492750+0000","last_undegraded":"2023-11-28T21:04:30.492750+0000","last_fullsized":"2023-11-28T21:04:30.492750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:55.963557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018992159000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"51'397","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.448022+0000","last_change":"2023-11-28T20:44:35.613038+0000","last_active":"2023-11-28T21:04:26.448022+0000","last_peered":"2023-11-28T21:04:26.448022+0000","last_clean":"2023-11-28T21:04:26.448022+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T21:04:26.448022+0000","last_undegraded":"2023-11-28T21:04:26.448022+0000","last_fullsized":"2023-11-28T21:04:26.448022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:29.806450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015371953000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"51'415","reported_seq":2509,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494151+0000","last_change":"2023-11-28T20:44:35.603769+0000","last_active":"2023-11-28T21:04:30.494151+0000","last_peered":"2023-11-28T21:04:30.494151+0000","last_clean":"2023-11-28T21:04:30.494151+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T21:04:30.494151+0000","last_undegraded":"2023-11-28T21:04:30.494151+0000","last_fullsized":"2023-11-28T21:04:30.494151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:16:20.274605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098716120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"51'399","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494927+0000","last_change":"2023-11-28T20:44:35.607958+0000","last_active":"2023-11-28T21:04:30.494927+0000","last_peered":"2023-11-28T21:04:30.494927+0000","last_clean":"2023-11-28T21:04:30.494927+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T21:04:30.494927+0000","last_undegraded":"2023-11-28T21:04:30.494927+0000","last_fullsized":"2023-11-28T21:04:30.494927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:07:12.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011275626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"51'410","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176638+0000","last_change":"2023-11-28T20:44:35.639151+0000","last_active":"2023-11-28T21:04:23.176638+0000","last_peered":"2023-11-28T21:04:23.176638+0000","last_clean":"2023-11-28T21:04:23.176638+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T21:04:23.176638+0000","last_undegraded":"2023-11-28T21:04:23.176638+0000","last_fullsized":"2023-11-28T21:04:23.176638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:25:42.800941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017369464000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":892224822,"num_objects":17666,"num_object_clones":8054,"num_object_copies":70664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17666,"num_whiteouts":7974,"num_read":1150,"num_read_kb":100500,"num_write":48457,"num_write_kb":1187847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1881309184,"data_stored":1881309184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57114,"ondisk_log_size":57114,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26113,"ondisk_log_size":26113,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":680923161,"num_objects":625,"num_object_clones":0,"num_object_copies":1250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":0,"num_read":1485,"num_read_kb":4455,"num_write":14545,"num_write_kb":680650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1362001920,"data_stored":1361846322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15149,"ondisk_log_size":15149,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509770,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":650828,"kb_used_data":461380,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":93721012,"statfs":{"total":96636764160,"available":95970316288,"internally_reserved":0,"allocated":472453120,"data_stored":472148767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":193984967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":42.021000000000001,"5min":8.7739999999999991,"15min":3.2749999999999999},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":873.04100000000005,"5min":873.04100000000005,"15min":873.04100000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.52300000000000002},"min":{"1min":0.24299999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":6.5659999999999998},"last":0.42499999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":1.194,"5min":1.194,"15min":6.9370000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.52400000000000002,"15min":0.54400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.627,"5min":0.79700000000000004,"15min":3.6219999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.8780000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":39.405999999999999,"5min":8.3049999999999997,"15min":3.1909999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.28299999999999997},"max":{"1min":817.63900000000001,"5min":817.63900000000001,"15min":817.63900000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":253.649,"5min":51.384,"15min":17.940000000000001},"min":{"1min":0.56299999999999994,"5min":0.48699999999999999,"15min":0.34799999999999998},"max":{"1min":3268.6419999999998,"5min":3268.6419999999998,"15min":3268.6419999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":253.23400000000001,"5min":51.326999999999998,"15min":17.667999999999999},"min":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"max":{"1min":3232.7750000000001,"5min":3232.7750000000001,"15min":3232.7750000000001},"last":0.80100000000000005}]},{"osd":5,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":229.02799999999999,"5min":46.481999999999999,"15min":16.082999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.42299999999999999},"max":{"1min":3259.5459999999998,"5min":3259.5459999999998,"15min":3259.5459999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":36.899999999999999,"5min":8.0679999999999996,"15min":3.2559999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53300000000000003},"max":{"1min":703.19299999999998,"5min":703.19299999999998,"15min":703.19299999999998},"last":0.749}]},{"osd":6,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":46.119,"5min":9.9299999999999997,"15min":3.9100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":928.99199999999996,"5min":928.99199999999996,"15min":928.99199999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":49.222999999999999,"5min":10.545,"15min":4.1520000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":961.01800000000003,"5min":961.01800000000003,"15min":961.01800000000003},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":44.685000000000002,"5min":9.6370000000000005,"15min":4.1289999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.44600000000000001},"max":{"1min":872.827,"5min":872.827,"15min":872.827},"last":0.78300000000000003},{"interface":"front","average":{"1min":41.890000000000001,"5min":9.0760000000000005,"15min":3.6160000000000001},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.48899999999999999},"max":{"1min":817.84400000000005,"5min":817.84400000000005,"15min":817.84400000000005},"last":0.64600000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509770,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424976,"kb_used_data":277192,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93946864,"statfs":{"total":96636764160,"available":96201588736,"internally_reserved":0,"allocated":283844608,"data_stored":283539830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9790000000000001,"5min":1.5509999999999999,"15min":0.82999999999999996},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":64.087000000000003,"5min":64.087000000000003,"15min":64.087000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":6.0759999999999996,"5min":1.667,"15min":0.95599999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25},"max":{"1min":64.114999999999995,"5min":64.114999999999995,"15min":64.114999999999995},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9960000000000004,"5min":1.647,"15min":0.97199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":64,"5min":64,"15min":64},"last":0.35799999999999998},{"interface":"front","average":{"1min":6.0679999999999996,"5min":1.7,"15min":0.97399999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":64.028999999999996,"5min":64.028999999999996,"15min":64.028999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":144.126,"5min":29.332000000000001,"15min":10.220000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2826.7199999999998,"5min":2826.7199999999998,"15min":2826.7199999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":146.227,"5min":29.651,"15min":10.257999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.307},"max":{"1min":2838.0680000000002,"5min":2838.0680000000002,"15min":2838.0680000000002},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":13.901,"5min":3.4500000000000002,"15min":1.7190000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.38},"max":{"1min":149.43700000000001,"5min":149.43700000000001,"15min":149.43700000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":262.66399999999999,"5min":53.177,"15min":18.265000000000001},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.38800000000000001},"max":{"1min":3288.7310000000002,"5min":3288.7310000000002,"15min":3288.7310000000002},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":308.05099999999999,"5min":62.268999999999998,"15min":21.323},"min":{"1min":0.68500000000000005,"5min":0.54700000000000004,"15min":0.46000000000000002},"max":{"1min":3314.4110000000001,"5min":3314.4110000000001,"15min":3314.4110000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":207.60499999999999,"5min":42.195999999999998,"15min":14.644},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.44900000000000001},"max":{"1min":2139.3159999999998,"5min":2139.3159999999998,"15min":2139.3159999999998},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":317.48099999999999,"5min":64.153999999999996,"15min":21.949000000000002},"min":{"1min":0.64100000000000001,"5min":0.56999999999999995,"15min":0.38700000000000001},"max":{"1min":3288.7730000000001,"5min":3288.7730000000001,"15min":3288.7730000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":254.578,"5min":51.664000000000001,"15min":17.855},"min":{"1min":0.77700000000000002,"5min":0.68500000000000005,"15min":0.42699999999999999},"max":{"1min":2837.9960000000001,"5min":2837.9960000000001,"15min":2837.9960000000001},"last":0.89100000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:04:54 2023","interfaces":[{"interface":"back","average":{"1min":151.316,"5min":30.917999999999999,"15min":10.859999999999999},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.46899999999999997},"max":{"1min":2822.598,"5min":2822.598,"15min":2822.598},"last":0.82099999999999995},{"interface":"front","average":{"1min":235.82599999999999,"5min":47.865000000000002,"15min":16.504999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.45400000000000001},"max":{"1min":2150.9899999999998,"5min":2150.9899999999998,"15min":2150.9899999999998},"last":0.69299999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509771,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660764,"kb_used_data":458836,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93711076,"statfs":{"total":96636764160,"available":95960141824,"internally_reserved":0,"allocated":469848064,"data_stored":469543023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.01,"5min":2.3849999999999998,"15min":1.1799999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":143.76300000000001,"5min":143.76300000000001,"15min":143.76300000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":2.4769999999999999,"5min":0.92200000000000004,"15min":0.71799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":39.768000000000001,"5min":39.768000000000001,"15min":39.768000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":8.2780000000000005,"5min":2.0510000000000002,"15min":1.042},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.252},"max":{"1min":149.34299999999999,"5min":149.34299999999999,"15min":149.34299999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":6.5229999999999997},"last":0.47099999999999997}]},{"osd":3,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.726000000000001,"5min":2.5840000000000001,"15min":1.2589999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26700000000000002},"max":{"1min":147.46899999999999,"5min":147.46899999999999,"15min":147.46899999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":3.6179999999999999,"5min":1.216,"15min":0.85499999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":59.305,"5min":59.305,"15min":59.305},"last":0.44}]},{"osd":4,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":20.18,"5min":4.649,"15min":2.1320000000000001},"min":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.40400000000000003},"max":{"1min":221.76900000000001,"5min":221.76900000000001,"15min":221.76900000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":63.805999999999997,"5min":13.407,"15min":5.4569999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.34300000000000003},"max":{"1min":1198.962,"5min":1198.962,"15min":1198.962},"last":0.629}]},{"osd":5,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":31.141999999999999,"5min":6.9329999999999998,"15min":2.9169999999999998},"min":{"1min":0.60199999999999998,"5min":0.56299999999999994,"15min":0.42599999999999999},"max":{"1min":574.81700000000001,"5min":574.81700000000001,"15min":574.81700000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":2.9430000000000001,"5min":1.341,"15min":1.099},"min":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.501},"max":{"1min":39.896999999999998,"5min":39.896999999999998,"15min":39.896999999999998},"last":0.79900000000000004}]},{"osd":6,"last update":"Tue Nov 28 21:05:10 2023","interfaces":[{"interface":"back","average":{"1min":63.299999999999997,"5min":13.385,"15min":5.0860000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.47099999999999997},"max":{"1min":1168.432,"5min":1168.432,"15min":1168.432},"last":0.77800000000000002},{"interface":"front","average":{"1min":2.9279999999999999,"5min":1.276,"15min":1.0389999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46000000000000002},"max":{"1min":39.863,"5min":39.863,"15min":39.863},"last":0.74199999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":12.673,"5min":3.246,"15min":1.679},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.54000000000000004},"max":{"1min":143.89599999999999,"5min":143.89599999999999,"15min":143.89599999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":63.936,"5min":13.486000000000001,"15min":5.0670000000000002},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1198.933,"5min":1198.933,"15min":1198.933},"last":0.64200000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542474,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":565548,"kb_used_data":417764,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93806292,"statfs":{"total":96636764160,"available":96057643008,"internally_reserved":0,"allocated":427790336,"data_stored":427490226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":151321034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.03300000000002,"5min":93.887,"15min":31.899999999999999},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.29699999999999999},"max":{"1min":3136.5639999999999,"5min":3136.5639999999999,"15min":3136.5639999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":271.74400000000003,"5min":55.098999999999997,"15min":18.936},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.36899999999999999},"max":{"1min":2779.4099999999999,"5min":2779.4099999999999,"15min":2779.4099999999999},"last":1.0960000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":470.35899999999998,"5min":94.754999999999995,"15min":32.216000000000001},"min":{"1min":0.55900000000000005,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":3167.6399999999999,"5min":3167.6399999999999,"15min":3167.6399999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":496.947,"5min":100.057,"15min":33.951000000000001},"min":{"1min":0.61899999999999999,"5min":0.496,"15min":0.46400000000000002},"max":{"1min":4741.7640000000001,"5min":4741.7640000000001,"15min":4741.7640000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":279.05900000000003,"5min":56.529000000000003,"15min":19.739999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.42899999999999999},"max":{"1min":2301.0599999999999,"5min":2301.0599999999999,"15min":2301.0599999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":499.01799999999997,"5min":100.639,"15min":34.240000000000002},"min":{"1min":0.82999999999999996,"5min":0.69299999999999995,"15min":0.42399999999999999},"max":{"1min":4752.8689999999997,"5min":4752.8689999999997,"15min":4752.8689999999997},"last":1.0149999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.53500000000003,"5min":94.042000000000002,"15min":32.265999999999998},"min":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.44700000000000001},"max":{"1min":3147.2719999999999,"5min":3147.2719999999999,"15min":3147.2719999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":298.06700000000001,"5min":60.340000000000003,"15min":20.724},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.44500000000000001},"max":{"1min":2301.1370000000002,"5min":2301.1370000000002,"15min":2301.1370000000002},"last":0.64300000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.91200000000000003,"15min":1.282},"min":{"1min":0.69899999999999995,"5min":0.57499999999999996,"15min":0.38900000000000001},"max":{"1min":1.056,"5min":1.266,"15min":71.313000000000002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.1870000000000001},"min":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.40000000000000002},"max":{"1min":1.2929999999999999,"5min":1.335,"15min":34.881},"last":1.1890000000000001}]},{"osd":5,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0600000000000001,"15min":1.29},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.39700000000000002},"max":{"1min":1.895,"5min":1.895,"15min":44.558},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1339999999999999,"15min":1.1559999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.41399999999999998},"max":{"1min":1.956,"5min":1.956,"15min":3.782},"last":1.1479999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.01,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.44700000000000001},"max":{"1min":1.1879999999999999,"5min":1.47,"15min":7.6769999999999996},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.89100000000000001,"5min":0.71499999999999997,"15min":0.38100000000000001},"max":{"1min":1.645,"5min":1.645,"15min":2.7949999999999999},"last":1.232}]}]},{"osd":6,"up_from":14,"seq":60129542475,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600852,"kb_used_data":439180,"kb_used_omap":1,"kb_used_meta":161662,"kb_avail":93770988,"statfs":{"total":96636764160,"available":96021491712,"internally_reserved":0,"allocated":449720320,"data_stored":449421964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165542342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.524000000000001,"5min":19.795000000000002,"15min":7.1429999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.41299999999999998},"max":{"1min":1038.4960000000001,"5min":1038.4960000000001,"15min":1038.4960000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":95.692999999999998,"5min":19.936,"15min":7.2519999999999998},"min":{"1min":0.79500000000000004,"5min":0.52900000000000003,"15min":0.33600000000000002},"max":{"1min":1038.5619999999999,"5min":1038.5619999999999,"15min":1038.5619999999999},"last":1.0349999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":101.98699999999999,"5min":21.116,"15min":7.6189999999999998},"min":{"1min":0.60899999999999999,"5min":0.52900000000000003,"15min":0.41399999999999998},"max":{"1min":1046.3320000000001,"5min":1046.3320000000001,"15min":1046.3320000000001},"last":0.878},{"interface":"front","average":{"1min":68.814999999999998,"5min":14.573,"15min":5.4710000000000001},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.42899999999999999},"max":{"1min":1087.7460000000001,"5min":1087.7460000000001,"15min":1087.7460000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.518000000000001,"5min":19.795000000000002,"15min":7.1929999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.435},"max":{"1min":1038.309,"5min":1038.309,"15min":1038.309},"last":0.91400000000000003},{"interface":"front","average":{"1min":254.767,"5min":51.676000000000002,"15min":17.823},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.35099999999999998},"max":{"1min":2556.578,"5min":2556.578,"15min":2556.578},"last":1.1080000000000001}]},{"osd":3,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":225.25899999999999,"5min":45.744999999999997,"15min":15.845000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54300000000000004},"max":{"1min":2567.538,"5min":2567.538,"15min":2567.538},"last":0.94499999999999995},{"interface":"front","average":{"1min":176.50999999999999,"5min":36.079000000000001,"15min":12.673},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.39700000000000002},"max":{"1min":1371.7280000000001,"5min":1371.7280000000001,"15min":1371.7280000000001},"last":1.075}]},{"osd":4,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91200000000000003,"15min":1.0449999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":10.151},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.05,"15min":1.056},"min":{"1min":0.71299999999999997,"5min":0.64200000000000002,"15min":0.437},"max":{"1min":1.2689999999999999,"5min":1.5640000000000001,"15min":3.2629999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:05:02 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.071,"15min":1.101},"min":{"1min":0.76700000000000002,"5min":0.58399999999999996,"15min":0.50800000000000001},"max":{"1min":1.218,"5min":1.5449999999999999,"15min":4.5519999999999996},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0629999999999999,"15min":1.1519999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3480000000000001,"5min":1.694,"15min":2.1899999999999999},"last":0.755}]},{"osd":7,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1160000000000001,"15min":1.147},"min":{"1min":0.91600000000000004,"5min":0.77900000000000003,"15min":0.56899999999999995},"max":{"1min":1.3859999999999999,"5min":1.5149999999999999,"15min":4.6639999999999997},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.165,"15min":1.2150000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.651,"15min":3.2029999999999998},"last":0.84799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542475,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505928,"kb_used_data":335936,"kb_used_omap":1,"kb_used_meta":169982,"kb_avail":93865912,"statfs":{"total":96636764160,"available":96118693888,"internally_reserved":0,"allocated":343998464,"data_stored":343698460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":174062021},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:14 2023","interfaces":[{"interface":"back","average":{"1min":84.838999999999999,"5min":17.664000000000001,"15min":6.4409999999999998},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.27100000000000002},"max":{"1min":1605.194,"5min":1605.194,"15min":1605.194},"last":1.2110000000000001},{"interface":"front","average":{"1min":94.373000000000005,"5min":19.542000000000002,"15min":7.0590000000000002},"min":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.27100000000000002},"max":{"1min":1603.2260000000001,"5min":1603.2260000000001,"15min":1603.2260000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":84.260000000000005,"5min":17.545000000000002,"15min":6.4279999999999999},"min":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.253},"max":{"1min":1749.1869999999999,"5min":1749.1869999999999,"15min":1749.1869999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":279.99700000000001,"5min":56.835999999999999,"15min":19.574000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.442},"max":{"1min":3741.5659999999998,"5min":3741.5659999999998,"15min":3741.5659999999998},"last":1.1599999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":8.0679999999999996,"5min":2.411,"15min":1.4319999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.309},"max":{"1min":152.40199999999999,"5min":152.40199999999999,"15min":152.40199999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":279.81599999999997,"5min":56.707000000000001,"15min":19.506},"min":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.435},"max":{"1min":3741.3910000000001,"5min":3741.3910000000001,"15min":3741.3910000000001},"last":1.093}]},{"osd":3,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":327.06200000000001,"5min":66.230999999999995,"15min":22.754999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.34999999999999998},"max":{"1min":3904.835,"5min":3904.835,"15min":3904.835},"last":1.2589999999999999},{"interface":"front","average":{"1min":86.721999999999994,"5min":18.109999999999999,"15min":6.7000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.35299999999999998},"max":{"1min":1785.712,"5min":1785.712,"15min":1785.712},"last":0.96599999999999997}]},{"osd":4,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.28199999999999997},"max":{"1min":1.393,"5min":1.393,"15min":3.7930000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.103,"15min":1.0900000000000001},"min":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.29999999999999999},"max":{"1min":1.3120000000000001,"5min":1.5860000000000001,"15min":4.7320000000000002},"last":1.304}]},{"osd":6,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.1779999999999999},"min":{"1min":0.68200000000000005,"5min":0.65700000000000003,"15min":0.318},"max":{"1min":1.393,"5min":1.728,"15min":5.6600000000000001},"last":1.349},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.77300000000000002,"5min":0.64200000000000002,"15min":0.34000000000000002},"max":{"1min":1.536,"5min":1.6100000000000001,"15min":2.573},"last":1.0680000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1779999999999999,"15min":1.0700000000000001},"min":{"1min":0.69999999999999996,"5min":0.69299999999999995,"15min":0.28299999999999997},"max":{"1min":1.4730000000000001,"5min":1.633,"15min":3.9060000000000001},"last":1.395},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1519999999999999,"15min":1.206},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36899999999999999},"max":{"1min":1.4670000000000001,"5min":1.6519999999999999,"15min":4.8109999999999999},"last":1.123}]}]},{"osd":4,"up_from":14,"seq":60129542474,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616800,"kb_used_data":437080,"kb_used_omap":1,"kb_used_meta":179710,"kb_avail":93755040,"statfs":{"total":96636764160,"available":96005160960,"internally_reserved":0,"allocated":447569920,"data_stored":447273953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":184023493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":370.74799999999999,"5min":74.813999999999993,"15min":25.507999999999999},"min":{"1min":0.54100000000000004,"5min":0.42399999999999999,"15min":0.25600000000000001},"max":{"1min":4472.0990000000002,"5min":4472.0990000000002,"15min":4472.0990000000002},"last":0.625},{"interface":"front","average":{"1min":370.78800000000001,"5min":74.861000000000004,"15min":25.640000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.33000000000000002},"max":{"1min":4472.4799999999996,"5min":4472.4799999999996,"15min":4472.4799999999996},"last":0.88200000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":340.39299999999997,"5min":68.760000000000005,"15min":23.995999999999999},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.34000000000000002},"max":{"1min":2473.319,"5min":2473.319,"15min":2473.319},"last":0.73499999999999999},{"interface":"front","average":{"1min":343.56,"5min":69.445999999999998,"15min":24.108000000000001},"min":{"1min":0.64300000000000002,"5min":0.52400000000000002,"15min":0.40600000000000003},"max":{"1min":2525.277,"5min":2525.277,"15min":2525.277},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":193.78399999999999,"5min":39.509999999999998,"15min":14.141},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.38600000000000001},"max":{"1min":2323.7979999999998,"5min":2323.7979999999998,"15min":2323.7979999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":308.291,"5min":62.448,"15min":21.914000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.35599999999999998},"max":{"1min":2498.6460000000002,"5min":2498.6460000000002,"15min":2498.6460000000002},"last":1.0329999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":311.33499999999998,"5min":63.033000000000001,"15min":21.722999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38900000000000001},"max":{"1min":2516.6700000000001,"5min":2516.6700000000001,"15min":2516.6700000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":321.84899999999999,"5min":65.114000000000004,"15min":22.658000000000001},"min":{"1min":0.75700000000000001,"5min":0.53200000000000003,"15min":0.441},"max":{"1min":2478.165,"5min":2478.165,"15min":2478.165},"last":0.81200000000000006}]},{"osd":5,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":1.292},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.36399999999999999},"max":{"1min":1.1699999999999999,"5min":1.3999999999999999,"15min":19.408999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.016,"15min":1.0940000000000001},"min":{"1min":0.67400000000000004,"5min":0.502,"15min":0.35699999999999998},"max":{"1min":1.3360000000000001,"5min":1.4970000000000001,"15min":9.375},"last":1.1319999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.032,"15min":1.3540000000000001},"min":{"1min":0.67700000000000005,"5min":0.625,"15min":0.42399999999999999},"max":{"1min":1.3460000000000001,"5min":1.415,"15min":36.531999999999996},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.087,"5min":1.111,"15min":1.772},"min":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.42799999999999999},"max":{"1min":1.3440000000000001,"5min":1.4730000000000001,"15min":85.367999999999995},"last":1.081}]},{"osd":7,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.2070000000000001},"min":{"1min":0.73099999999999998,"5min":0.61099999999999999,"15min":0.42999999999999999},"max":{"1min":1.403,"5min":1.5760000000000001,"15min":9.3399999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1499999999999999,"15min":1.4330000000000001},"min":{"1min":0.85399999999999998,"5min":0.78900000000000003,"15min":0.33900000000000002},"max":{"1min":1.5509999999999999,"5min":1.577,"15min":36.591999999999999},"last":1.01}]}]},{"osd":0,"up_from":14,"seq":60129542474,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503304,"kb_used_data":345792,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":93868536,"statfs":{"total":96636764160,"available":96121380864,"internally_reserved":0,"allocated":354091008,"data_stored":353789699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":22.460000000000001,"5min":4.8289999999999997,"15min":1.97},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":297.16899999999998,"5min":297.16899999999998,"15min":297.16899999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":22.552,"5min":4.9340000000000002,"15min":1.984},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":297.202,"5min":297.202,"15min":297.202},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":20.687000000000001,"5min":4.5090000000000003,"15min":1.8580000000000001},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":335.166,"5min":335.166,"15min":335.166},"last":0.32500000000000001},{"interface":"front","average":{"1min":19.943999999999999,"5min":4.4329999999999998,"15min":1.835},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":335.19400000000002,"5min":335.19400000000002,"15min":335.19400000000002},"last":0.371}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":4.274,"5min":1.325,"15min":0.81599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.28399999999999997},"max":{"1min":53.808,"5min":53.808,"15min":53.808},"last":0.41899999999999998},{"interface":"front","average":{"1min":145.27699999999999,"5min":29.565000000000001,"15min":10.308},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35599999999999998},"max":{"1min":2839.3989999999999,"5min":2839.3989999999999,"15min":2839.3989999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":135.411,"5min":27.715,"15min":9.8290000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2822.2359999999999,"5min":2822.2359999999999,"15min":2822.2359999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":135.35900000000001,"5min":27.701000000000001,"15min":9.7970000000000006},"min":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.496},"max":{"1min":2822.212,"5min":2822.212,"15min":2822.212},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":96.162000000000006,"5min":19.890999999999998,"15min":7.1820000000000004},"min":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.47099999999999997},"max":{"1min":1936.5550000000001,"5min":1936.5550000000001,"15min":1936.5550000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":122.643,"5min":25.228999999999999,"15min":8.9879999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.50700000000000001},"max":{"1min":1999.019,"5min":1999.019,"15min":1999.019},"last":0.73099999999999998}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":142.648,"5min":29.18,"15min":10.353999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48199999999999998},"max":{"1min":2832.431,"5min":2832.431,"15min":2832.431},"last":0.52700000000000002},{"interface":"front","average":{"1min":142.119,"5min":29.050999999999998,"15min":10.282999999999999},"min":{"1min":0.56299999999999994,"5min":0.48599999999999999,"15min":0.44700000000000001},"max":{"1min":2822.1840000000002,"5min":2822.1840000000002,"15min":2822.1840000000002},"last":0.754}]},{"osd":7,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":146.452,"5min":30.036999999999999,"15min":10.622},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.53300000000000003},"max":{"1min":1999.058,"5min":1999.058,"15min":1999.058},"last":1.0649999999999999},{"interface":"front","average":{"1min":225.40299999999999,"5min":45.713999999999999,"15min":15.869999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2822.143,"5min":2822.143,"15min":2822.143},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":170106880,"data_stored":170090025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":171458560,"data_stored":171434421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85495808,"data_stored":85471932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":183201792,"data_stored":183178341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":187912192,"data_stored":187897127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171967842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":182108160,"data_stored":182090706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209731584,"data_stored":209715928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":182788096,"data_stored":182788096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":297787392,"data_stored":297787392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":197746688,"data_stored":197746688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":288649216,"data_stored":288649216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259055616,"data_stored":259055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171409408,"data_stored":171409408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":267010048,"data_stored":267010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":216862720,"data_stored":216862720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:05:24.857 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T21:05:24.857 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:05:25.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.001+0000 7f689fa91640 1 Processor -- start 2023-11-28T21:05:25.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.001+0000 7f689fa91640 1 -- start start 2023-11-28T21:05:25.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689fa91640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68980b0110 0x7f689815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689fa91640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f689806bda0 0x7f6898066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689fa91640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689806a8d0 con 0x7f68980c8010 2023-11-28T21:05:25.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689fa91640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68980ca230 con 0x7f68980b0110 2023-11-28T21:05:25.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689fa91640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68980c8990 con 0x7f689806bda0 2023-11-28T21:05:25.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689d82d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68980b0110 0x7f689815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689d02c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f68980c8010 0x7f689806b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50922/0 (socket says 172.21.15.167:50922) 2023-11-28T21:05:25.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689d02c640 1 -- 172.21.15.167:0/1083087665 learned_addr learned my addr 172.21.15.167:0/1083087665 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:25.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689e02e640 1 --2- 172.21.15.167:0/1083087665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f689806bda0 0x7f6898066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689d82d640 1 -- 172.21.15.167:0/1083087665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f689806bda0 msgr2=0x7f6898066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:25.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689d82d640 1 --2- 172.21.15.167:0/1083087665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f689806bda0 0x7f6898066730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689d82d640 1 -- 172.21.15.167:0/1083087665 >> v1:172.21.15.167:6789/0 conn(0x7f68980c8010 legacy=0x7f689806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689d82d640 1 -- 172.21.15.167:0/1083087665 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68980ca480 con 0x7f68980b0110 2023-11-28T21:05:25.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689c82b640 1 -- 172.21.15.167:0/1083087665 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463430511 0 0) 0x7f689806a8d0 con 0x7f68980c8010 2023-11-28T21:05:25.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689e02e640 1 --2- 172.21.15.167:0/1083087665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f689806bda0 0x7f6898066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:25.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689d82d640 1 --2- 172.21.15.167:0/1083087665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 0x7f689815d3b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f68940097c0 tx=0x7f689401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd053d18d1e7c0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:25.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689c82b640 1 -- 172.21.15.167:0/1083087665 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940a8970 con 0x7f68980b0110 2023-11-28T21:05:25.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689c82b640 1 -- 172.21.15.167:0/1083087665 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940a8ad0 con 0x7f68980b0110 2023-11-28T21:05:25.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.005+0000 7f689c82b640 1 -- 172.21.15.167:0/1083087665 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940a8e60 con 0x7f68980b0110 2023-11-28T21:05:25.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- 172.21.15.167:0/1083087665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 msgr2=0x7f689815d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 --2- 172.21.15.167:0/1083087665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 0x7f689815d3b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f68940097c0 tx=0x7f689401ec70 comp rx=0 tx=0).stop 2023-11-28T21:05:25.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- 172.21.15.167:0/1083087665 shutdown_connections 2023-11-28T21:05:25.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 --2- 172.21.15.167:0/1083087665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f689806bda0 0x7f6898066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 --2- 172.21.15.167:0/1083087665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 0x7f689815d3b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- 172.21.15.167:0/1083087665 >> 172.21.15.167:0/1083087665 conn(0x7f689806ee30 msgr2=0x7f689806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:25.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- 172.21.15.167:0/1083087665 shutdown_connections 2023-11-28T21:05:25.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- 172.21.15.167:0/1083087665 wait complete. 2023-11-28T21:05:25.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 Processor -- start 2023-11-28T21:05:25.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- start start 2023-11-28T21:05:25.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f689806bda0 0x7f68980c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 0x7f68980c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68980c8010 0x7f6898156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68980c6510 con 0x7f68980b0110 2023-11-28T21:05:25.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689815a270 con 0x7f689806bda0 2023-11-28T21:05:25.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689815a4c0 con 0x7f68980c8010 2023-11-28T21:05:25.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d02c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 0x7f68980c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d02c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 0x7f68980c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56812/0 (socket says 172.21.15.167:56812) 2023-11-28T21:05:25.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d02c640 1 -- 172.21.15.167:0/1216722520 learned_addr learned my addr 172.21.15.167:0/1216722520 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:25.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d82d640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f689806bda0 0x7f68980c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d02c640 1 -- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68980c8010 msgr2=0x7f6898156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d02c640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68980c8010 0x7f6898156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d02c640 1 -- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f689806bda0 msgr2=0x7f68980c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d02c640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f689806bda0 0x7f68980c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d02c640 1 -- 172.21.15.167:0/1216722520 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6894009420 con 0x7f68980b0110 2023-11-28T21:05:25.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689d02c640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 0x7f68980c5b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f688800c480 tx=0x7f688800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:25.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f688e7fc640 1 -- 172.21.15.167:0/1216722520 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68880074e0 con 0x7f68980b0110 2023-11-28T21:05:25.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f688e7fc640 1 -- 172.21.15.167:0/1216722520 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888007660 con 0x7f68980b0110 2023-11-28T21:05:25.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f688e7fc640 1 -- 172.21.15.167:0/1216722520 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888004a30 con 0x7f68980b0110 2023-11-28T21:05:25.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689815a7a0 con 0x7f68980b0110 2023-11-28T21:05:25.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.009+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68980c4b60 con 0x7f68980b0110 2023-11-28T21:05:25.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.013+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6898075c90 con 0x7f68980b0110 2023-11-28T21:05:25.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.013+0000 7f688e7fc640 1 -- 172.21.15.167:0/1216722520 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6888004b90 con 0x7f68980b0110 2023-11-28T21:05:25.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.013+0000 7f688e7fc640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f687c066470 0x7f687c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.013+0000 7f688e7fc640 1 -- 172.21.15.167:0/1216722520 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f68880834d0 con 0x7f68980b0110 2023-11-28T21:05:25.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.013+0000 7f689d82d640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f687c066470 0x7f687c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.013+0000 7f689d82d640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f687c066470 0x7f687c068930 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f68940b2000 tx=0x7f68940aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:25.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.017+0000 7f688e7fc640 1 -- 172.21.15.167:0/1216722520 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6888053f50 con 0x7f68980b0110 2023-11-28T21:05:25.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.161+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68980ca760 con 0x7f687c066470 2023-11-28T21:05:25.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.189+0000 7f688e7fc640 1 -- 172.21.15.167:0/1216722520 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373433 (secure 0 0 0) 0x7f68940bb420 con 0x7f687c066470 2023-11-28T21:05:25.193 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:05:25.196 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T21:05:25.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f687c066470 msgr2=0x7f687c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f687c066470 0x7f687c068930 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f68940b2000 tx=0x7f68940aa070 comp rx=0 tx=0).stop 2023-11-28T21:05:25.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 msgr2=0x7f68980c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 0x7f68980c5b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f688800c480 tx=0x7f688800c940 comp rx=0 tx=0).stop 2023-11-28T21:05:25.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 shutdown_connections 2023-11-28T21:05:25.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f687c066470 0x7f687c068930 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68980c8010 0x7f6898156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68980b0110 0x7f68980c5b80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 --2- 172.21.15.167:0/1216722520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f689806bda0 0x7f68980c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 >> 172.21.15.167:0/1216722520 conn(0x7f689806ee30 msgr2=0x7f689806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:25.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 shutdown_connections 2023-11-28T21:05:25.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.193+0000 7f689fa91640 1 -- 172.21.15.167:0/1216722520 wait complete. 2023-11-28T21:05:25.209 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2023-11-28T21:05:24.123227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573738351,"num_objects":18293,"num_object_clones":8054,"num_object_copies":71918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18293,"num_whiteouts":7974,"num_read":2751,"num_read_kb":105055,"num_write":63161,"num_write_kb":1870913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98493,"ondisk_log_size":98493,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4529000,"kb_used_data":3173160,"kb_used_omap":12,"kb_used_meta":1355763,"kb_avail":750445720,"statfs":{"total":773094113280,"available":768456417280,"internally_reserved":0,"allocated":3249315840,"data_stored":3246905922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1388301872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005405"},"pg_stats":[{"pgid":"2.1f","version":"51'546","reported_seq":602,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:20.520764+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T21:03:20.520764+0000","last_peered":"2023-11-28T21:03:20.520764+0000","last_clean":"2023-11-28T21:03:20.520764+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T21:03:20.520764+0000","last_undegraded":"2023-11-28T21:03:20.520764+0000","last_fullsized":"2023-11-28T21:03:20.520764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:58.469635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":13,"num_write":501,"num_write_kb":29002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'428","reported_seq":2515,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495354+0000","last_change":"2023-11-28T20:44:35.608330+0000","last_active":"2023-11-28T21:04:30.495354+0000","last_peered":"2023-11-28T21:04:30.495354+0000","last_clean":"2023-11-28T21:04:30.495354+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T21:04:30.495354+0000","last_undegraded":"2023-11-28T21:04:30.495354+0000","last_fullsized":"2023-11-28T21:04:30.495354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:36.704510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012127499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"51'1858","reported_seq":3698,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:41.608342+0000","last_change":"2023-11-28T20:44:35.612490+0000","last_active":"2023-11-28T21:02:41.608342+0000","last_peered":"2023-11-28T21:02:41.608342+0000","last_clean":"2023-11-28T21:02:41.608342+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T21:02:41.608342+0000","last_undegraded":"2023-11-28T21:02:41.608342+0000","last_fullsized":"2023-11-28T21:02:41.608342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:27.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016916996,"stat_sum":{"num_bytes":12268315,"num_objects":556,"num_object_clones":279,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":239,"num_read":31,"num_read_kb":4126,"num_write":1561,"num_write_kb":24667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"51'611","reported_seq":667,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:26.606132+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T21:02:26.606132+0000","last_peered":"2023-11-28T21:02:26.606132+0000","last_clean":"2023-11-28T21:02:26.606132+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T21:02:26.606132+0000","last_undegraded":"2023-11-28T21:02:26.606132+0000","last_fullsized":"2023-11-28T21:02:26.606132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:25:59.603624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":546,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"51'383","reported_seq":2477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.563998+0000","last_change":"2023-11-28T20:44:35.603931+0000","last_active":"2023-11-28T21:04:28.563998+0000","last_peered":"2023-11-28T21:04:28.563998+0000","last_clean":"2023-11-28T21:04:28.563998+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T21:04:28.563998+0000","last_undegraded":"2023-11-28T21:04:28.563998+0000","last_fullsized":"2023-11-28T21:04:28.563998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:54:34.323314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010031783000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"51'1843","reported_seq":3720,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.579659+0000","last_change":"2023-11-28T20:44:35.541215+0000","last_active":"2023-11-28T21:02:35.579659+0000","last_peered":"2023-11-28T21:02:35.579659+0000","last_clean":"2023-11-28T21:02:35.579659+0000","last_became_active":"2023-11-28T20:39:01.389891+0000","last_became_peered":"2023-11-28T20:39:01.389891+0000","last_unstale":"2023-11-28T21:02:35.579659+0000","last_undegraded":"2023-11-28T21:02:35.579659+0000","last_fullsized":"2023-11-28T21:02:35.579659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:49.951369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084388650000000003,"stat_sum":{"num_bytes":22024896,"num_objects":578,"num_object_clones":267,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":267,"num_read":47,"num_read_kb":8236,"num_write":1555,"num_write_kb":33440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"51'579","reported_seq":631,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.546713+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T21:00:50.546713+0000","last_peered":"2023-11-28T21:00:50.546713+0000","last_clean":"2023-11-28T21:00:50.546713+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T21:00:50.546713+0000","last_undegraded":"2023-11-28T21:00:50.546713+0000","last_fullsized":"2023-11-28T21:00:50.546713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"51'396","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173832+0000","last_change":"2023-11-28T20:44:35.614099+0000","last_active":"2023-11-28T21:04:23.173832+0000","last_peered":"2023-11-28T21:04:23.173832+0000","last_clean":"2023-11-28T21:04:23.173832+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T21:04:23.173832+0000","last_undegraded":"2023-11-28T21:04:23.173832+0000","last_fullsized":"2023-11-28T21:04:23.173832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:34.672454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016140509000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1696","reported_seq":3582,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558555+0000","last_change":"2023-11-28T20:44:35.542225+0000","last_active":"2023-11-28T21:00:55.558555+0000","last_peered":"2023-11-28T21:00:55.558555+0000","last_clean":"2023-11-28T21:00:55.558555+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T21:00:55.558555+0000","last_undegraded":"2023-11-28T21:00:55.558555+0000","last_fullsized":"2023-11-28T21:00:55.558555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:49.565280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0093789649999999995,"stat_sum":{"num_bytes":11818887,"num_objects":514,"num_object_clones":236,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":236,"num_read":34,"num_read_kb":34,"num_write":1442,"num_write_kb":18567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"51'404","reported_seq":457,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.546585+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T21:00:50.546585+0000","last_peered":"2023-11-28T21:00:50.546585+0000","last_clean":"2023-11-28T21:00:50.546585+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T21:00:50.546585+0000","last_undegraded":"2023-11-28T21:00:50.546585+0000","last_fullsized":"2023-11-28T21:00:50.546585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":354,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"51'394","reported_seq":2485,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173820+0000","last_change":"2023-11-28T20:44:35.618164+0000","last_active":"2023-11-28T21:04:23.173820+0000","last_peered":"2023-11-28T21:04:23.173820+0000","last_clean":"2023-11-28T21:04:23.173820+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T21:04:23.173820+0000","last_undegraded":"2023-11-28T21:04:23.173820+0000","last_fullsized":"2023-11-28T21:04:23.173820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:10.074109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019881585,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"51'1748","reported_seq":3613,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558505+0000","last_change":"2023-11-28T20:44:35.542475+0000","last_active":"2023-11-28T21:00:55.558505+0000","last_peered":"2023-11-28T21:00:55.558505+0000","last_clean":"2023-11-28T21:00:55.558505+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T21:00:55.558505+0000","last_undegraded":"2023-11-28T21:00:55.558505+0000","last_fullsized":"2023-11-28T21:00:55.558505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:42.606296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092901790000000008,"stat_sum":{"num_bytes":16892767,"num_objects":571,"num_object_clones":263,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":571,"num_whiteouts":263,"num_read":40,"num_read_kb":48,"num_write":1465,"num_write_kb":20221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"51'418","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.174499+0000","last_change":"2023-11-28T20:44:35.616278+0000","last_active":"2023-11-28T21:04:23.174499+0000","last_peered":"2023-11-28T21:04:23.174499+0000","last_clean":"2023-11-28T21:04:23.174499+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T21:04:23.174499+0000","last_undegraded":"2023-11-28T21:04:23.174499+0000","last_fullsized":"2023-11-28T21:04:23.174499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:02.355511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017860755999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"51'336","reported_seq":391,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:05.575243+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T21:03:05.575243+0000","last_peered":"2023-11-28T21:03:05.575243+0000","last_clean":"2023-11-28T21:03:05.575243+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T21:03:05.575243+0000","last_undegraded":"2023-11-28T21:03:05.575243+0000","last_fullsized":"2023-11-28T21:03:05.575243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":274,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"51'1713","reported_seq":3605,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558652+0000","last_change":"2023-11-28T20:44:35.546423+0000","last_active":"2023-11-28T21:00:55.558652+0000","last_peered":"2023-11-28T21:00:55.558652+0000","last_clean":"2023-11-28T21:00:55.558652+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T21:00:55.558652+0000","last_undegraded":"2023-11-28T21:00:55.558652+0000","last_fullsized":"2023-11-28T21:00:55.558652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:21.576866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011349794999999999,"stat_sum":{"num_bytes":42075033,"num_objects":519,"num_object_clones":229,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":229,"num_read":33,"num_read_kb":8223,"num_write":1463,"num_write_kb":57658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"51'395","reported_seq":2488,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.567073+0000","last_change":"2023-11-28T20:44:35.615271+0000","last_active":"2023-11-28T21:04:28.567073+0000","last_peered":"2023-11-28T21:04:28.567073+0000","last_clean":"2023-11-28T21:04:28.567073+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T21:04:28.567073+0000","last_undegraded":"2023-11-28T21:04:28.567073+0000","last_fullsized":"2023-11-28T21:04:28.567073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:18.118595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018528307000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"51'468","reported_seq":523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:11.726550+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T21:02:11.726550+0000","last_peered":"2023-11-28T21:02:11.726550+0000","last_clean":"2023-11-28T21:02:11.726550+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T21:02:11.726550+0000","last_undegraded":"2023-11-28T21:02:11.726550+0000","last_fullsized":"2023-11-28T21:02:11.726550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:05.468315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2,"num_read_kb":11,"num_write":693,"num_write_kb":25655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'1827","reported_seq":3709,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558612+0000","last_change":"2023-11-28T20:44:35.543575+0000","last_active":"2023-11-28T21:00:55.558612+0000","last_peered":"2023-11-28T21:00:55.558612+0000","last_clean":"2023-11-28T21:00:55.558612+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T21:00:55.558612+0000","last_undegraded":"2023-11-28T21:00:55.558612+0000","last_fullsized":"2023-11-28T21:00:55.558612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:19.718029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010051028,"stat_sum":{"num_bytes":36081004,"num_objects":549,"num_object_clones":242,"num_object_copies":2196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":242,"num_read":36,"num_read_kb":4131,"num_write":1572,"num_write_kb":47387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"51'429","reported_seq":2522,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.496490+0000","last_change":"2023-11-28T20:44:35.615648+0000","last_active":"2023-11-28T21:04:30.496490+0000","last_peered":"2023-11-28T21:04:30.496490+0000","last_clean":"2023-11-28T21:04:30.496490+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T21:04:30.496490+0000","last_undegraded":"2023-11-28T21:04:30.496490+0000","last_fullsized":"2023-11-28T21:04:30.496490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:18:53.863754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018799937999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"51'666","reported_seq":721,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:11.726510+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T21:02:11.726510+0000","last_peered":"2023-11-28T21:02:11.726510+0000","last_clean":"2023-11-28T21:02:11.726510+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T21:02:11.726510+0000","last_undegraded":"2023-11-28T21:02:11.726510+0000","last_fullsized":"2023-11-28T21:02:11.726510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:33:17.706953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":627,"num_write_kb":16946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"51'1842","reported_seq":3706,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:56.717412+0000","last_change":"2023-11-28T20:44:35.608957+0000","last_active":"2023-11-28T21:00:56.717412+0000","last_peered":"2023-11-28T21:00:56.717412+0000","last_clean":"2023-11-28T21:00:56.717412+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T21:00:56.717412+0000","last_undegraded":"2023-11-28T21:00:56.717412+0000","last_fullsized":"2023-11-28T21:00:56.717412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:20:59.559204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011785257,"stat_sum":{"num_bytes":33810901,"num_objects":586,"num_object_clones":259,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":259,"num_read":37,"num_read_kb":8227,"num_write":1558,"num_write_kb":44779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"51'406","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491184+0000","last_change":"2023-11-28T20:44:35.545606+0000","last_active":"2023-11-28T21:04:30.491184+0000","last_peered":"2023-11-28T21:04:30.491184+0000","last_clean":"2023-11-28T21:04:30.491184+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T21:04:30.491184+0000","last_undegraded":"2023-11-28T21:04:30.491184+0000","last_fullsized":"2023-11-28T21:04:30.491184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:54.158095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011190047999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"51'485","reported_seq":540,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:10.563468+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T21:02:10.563468+0000","last_peered":"2023-11-28T21:02:10.563468+0000","last_clean":"2023-11-28T21:02:10.563468+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T21:02:10.563468+0000","last_undegraded":"2023-11-28T21:02:10.563468+0000","last_fullsized":"2023-11-28T21:02:10.563468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":18,"num_write":441,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"51'1805","reported_seq":3653,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558679+0000","last_change":"2023-11-28T20:44:35.544665+0000","last_active":"2023-11-28T21:00:55.558679+0000","last_peered":"2023-11-28T21:00:55.558679+0000","last_clean":"2023-11-28T21:00:55.558679+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T21:00:55.558679+0000","last_undegraded":"2023-11-28T21:00:55.558679+0000","last_fullsized":"2023-11-28T21:00:55.558679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:22.582437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010413970999999999,"stat_sum":{"num_bytes":29462623,"num_objects":568,"num_object_clones":283,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":243,"num_read":43,"num_read_kb":8342,"num_write":1501,"num_write_kb":36747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"51'401","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.496089+0000","last_change":"2023-11-28T20:44:35.608781+0000","last_active":"2023-11-28T21:04:30.496089+0000","last_peered":"2023-11-28T21:04:30.496089+0000","last_clean":"2023-11-28T21:04:30.496089+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T21:04:30.496089+0000","last_undegraded":"2023-11-28T21:04:30.496089+0000","last_fullsized":"2023-11-28T21:04:30.496089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:49:44.493316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013760692,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"51'145","reported_seq":202,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:10.559549+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T21:02:10.559549+0000","last_peered":"2023-11-28T21:02:10.559549+0000","last_clean":"2023-11-28T21:02:10.559549+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T21:02:10.559549+0000","last_undegraded":"2023-11-28T21:02:10.559549+0000","last_fullsized":"2023-11-28T21:02:10.559549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":6,"num_read_kb":32,"num_write":106,"num_write_kb":8401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"51'1903","reported_seq":3757,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.563869+0000","last_change":"2023-11-28T20:44:35.542749+0000","last_active":"2023-11-28T21:01:20.563869+0000","last_peered":"2023-11-28T21:01:20.563869+0000","last_clean":"2023-11-28T21:01:20.563869+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T21:01:20.563869+0000","last_undegraded":"2023-11-28T21:01:20.563869+0000","last_fullsized":"2023-11-28T21:01:20.563869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:36:45.378771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092734619999999997,"stat_sum":{"num_bytes":42280101,"num_objects":591,"num_object_clones":269,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":269,"num_read":33,"num_read_kb":4128,"num_write":1621,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"51'381","reported_seq":2474,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564479+0000","last_change":"2023-11-28T20:44:35.614397+0000","last_active":"2023-11-28T21:04:28.564479+0000","last_peered":"2023-11-28T21:04:28.564479+0000","last_clean":"2023-11-28T21:04:28.564479+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T21:04:28.564479+0000","last_undegraded":"2023-11-28T21:04:28.564479+0000","last_fullsized":"2023-11-28T21:04:28.564479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:46:21.145648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017915146,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"51'420","reported_seq":477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495460+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T21:04:30.495460+0000","last_peered":"2023-11-28T21:04:30.495460+0000","last_clean":"2023-11-28T21:04:30.495460+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T21:04:30.495460+0000","last_undegraded":"2023-11-28T21:04:30.495460+0000","last_fullsized":"2023-11-28T21:04:30.495460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:19.618124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12049925,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":6,"num_read_kb":23,"num_write":692,"num_write_kb":13743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"51'1784","reported_seq":3657,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:31.606632+0000","last_change":"2023-11-28T20:44:35.612546+0000","last_active":"2023-11-28T21:02:31.606632+0000","last_peered":"2023-11-28T21:02:31.606632+0000","last_clean":"2023-11-28T21:02:31.606632+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T21:02:31.606632+0000","last_undegraded":"2023-11-28T21:02:31.606632+0000","last_fullsized":"2023-11-28T21:02:31.606632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:32:05.737793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016539027000000001,"stat_sum":{"num_bytes":21707636,"num_objects":558,"num_object_clones":259,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":558,"num_whiteouts":259,"num_read":41,"num_read_kb":41,"num_write":1502,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"51'425","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.493811+0000","last_change":"2023-11-28T20:44:35.607913+0000","last_active":"2023-11-28T21:04:30.493811+0000","last_peered":"2023-11-28T21:04:30.493811+0000","last_clean":"2023-11-28T21:04:30.493811+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T21:04:30.493811+0000","last_undegraded":"2023-11-28T21:04:30.493811+0000","last_fullsized":"2023-11-28T21:04:30.493811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:06:48.810598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014316661,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'350","reported_seq":404,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.553069+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T21:01:20.553069+0000","last_peered":"2023-11-28T21:01:20.553069+0000","last_clean":"2023-11-28T21:01:20.553069+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T21:01:20.553069+0000","last_undegraded":"2023-11-28T21:01:20.553069+0000","last_fullsized":"2023-11-28T21:01:20.553069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360150,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":28962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"51'1789","reported_seq":3654,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.505359+0000","last_change":"2023-11-28T20:44:35.610536+0000","last_active":"2023-11-28T21:01:20.505359+0000","last_peered":"2023-11-28T21:01:20.505359+0000","last_clean":"2023-11-28T21:01:20.505359+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T21:01:20.505359+0000","last_undegraded":"2023-11-28T21:01:20.505359+0000","last_fullsized":"2023-11-28T21:01:20.505359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:15:04.264103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014620091,"stat_sum":{"num_bytes":29165465,"num_objects":561,"num_object_clones":251,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":561,"num_whiteouts":251,"num_read":26,"num_read_kb":26,"num_write":1521,"num_write_kb":34762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"51'414","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.508165+0000","last_change":"2023-11-28T20:44:35.624605+0000","last_active":"2023-11-28T21:04:26.508165+0000","last_peered":"2023-11-28T21:04:26.508165+0000","last_clean":"2023-11-28T21:04:26.508165+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T21:04:26.508165+0000","last_undegraded":"2023-11-28T21:04:26.508165+0000","last_fullsized":"2023-11-28T21:04:26.508165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:38.051342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025775551000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"51'259","reported_seq":313,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:16.719823+0000","last_change":"2023-11-28T20:38:18.527228+0000","last_active":"2023-11-28T21:01:16.719823+0000","last_peered":"2023-11-28T21:01:16.719823+0000","last_clean":"2023-11-28T21:01:16.719823+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T21:01:16.719823+0000","last_undegraded":"2023-11-28T21:01:16.719823+0000","last_fullsized":"2023-11-28T21:01:16.719823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:21.356473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":24764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"51'1827","reported_seq":3688,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:56.519697+0000","last_change":"2023-11-28T20:44:35.529967+0000","last_active":"2023-11-28T21:01:56.519697+0000","last_peered":"2023-11-28T21:01:56.519697+0000","last_clean":"2023-11-28T21:01:56.519697+0000","last_became_active":"2023-11-28T20:39:01.570987+0000","last_became_peered":"2023-11-28T20:39:01.570987+0000","last_unstale":"2023-11-28T21:01:56.519697+0000","last_undegraded":"2023-11-28T21:01:56.519697+0000","last_fullsized":"2023-11-28T21:01:56.519697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:41.602286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017641899999999999,"stat_sum":{"num_bytes":29603349,"num_objects":551,"num_object_clones":257,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":257,"num_read":32,"num_read_kb":32,"num_write":1550,"num_write_kb":37188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"51'420","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.557069+0000","last_change":"2023-11-28T20:44:35.545769+0000","last_active":"2023-11-28T21:04:28.557069+0000","last_peered":"2023-11-28T21:04:28.557069+0000","last_clean":"2023-11-28T21:04:28.557069+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T21:04:28.557069+0000","last_undegraded":"2023-11-28T21:04:28.557069+0000","last_fullsized":"2023-11-28T21:04:28.557069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:16.077909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010944188000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"51'420","reported_seq":475,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:15.557955+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T21:01:15.557955+0000","last_peered":"2023-11-28T21:01:15.557955+0000","last_clean":"2023-11-28T21:01:15.557955+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T21:01:15.557955+0000","last_undegraded":"2023-11-28T21:01:15.557955+0000","last_fullsized":"2023-11-28T21:01:15.557955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":379,"num_write_kb":16755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"51'1754","reported_seq":3629,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:21.720349+0000","last_change":"2023-11-28T20:44:35.606459+0000","last_active":"2023-11-28T21:01:21.720349+0000","last_peered":"2023-11-28T21:01:21.720349+0000","last_clean":"2023-11-28T21:01:21.720349+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T21:01:21.720349+0000","last_undegraded":"2023-11-28T21:01:21.720349+0000","last_fullsized":"2023-11-28T21:01:21.720349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:41:40.726057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012892727999999999,"stat_sum":{"num_bytes":30726234,"num_objects":547,"num_object_clones":244,"num_object_copies":2188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":244,"num_read":30,"num_read_kb":7398,"num_write":1499,"num_write_kb":38104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'416","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494824+0000","last_change":"2023-11-28T20:44:35.602022+0000","last_active":"2023-11-28T21:04:30.494824+0000","last_peered":"2023-11-28T21:04:30.494824+0000","last_clean":"2023-11-28T21:04:30.494824+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T21:04:30.494824+0000","last_undegraded":"2023-11-28T21:04:30.494824+0000","last_fullsized":"2023-11-28T21:04:30.494824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:56:28.293643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0088104640000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"51'904","reported_seq":1395,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.520162+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T21:04:23.520162+0000","last_peered":"2023-11-28T21:04:23.520162+0000","last_clean":"2023-11-28T21:04:23.520162+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T21:04:23.520162+0000","last_undegraded":"2023-11-28T21:04:23.520162+0000","last_fullsized":"2023-11-28T21:04:23.520162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:35:09.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26750948,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":437,"num_read_kb":1190,"num_write":846,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"51'1696","reported_seq":3563,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:16.727464+0000","last_change":"2023-11-28T20:44:35.609122+0000","last_active":"2023-11-28T21:02:16.727464+0000","last_peered":"2023-11-28T21:02:16.727464+0000","last_clean":"2023-11-28T21:02:16.727464+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T21:02:16.727464+0000","last_undegraded":"2023-11-28T21:02:16.727464+0000","last_fullsized":"2023-11-28T21:02:16.727464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:02.039768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744523999999999,"stat_sum":{"num_bytes":4888539,"num_objects":545,"num_object_clones":249,"num_object_copies":2180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":249,"num_read":26,"num_read_kb":26,"num_write":1427,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'419","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559875+0000","last_change":"2023-11-28T20:44:35.607743+0000","last_active":"2023-11-28T21:04:28.559875+0000","last_peered":"2023-11-28T21:04:28.559875+0000","last_clean":"2023-11-28T21:04:28.559875+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T21:04:28.559875+0000","last_undegraded":"2023-11-28T21:04:28.559875+0000","last_fullsized":"2023-11-28T21:04:28.559875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:14.103778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013248289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"51'468","reported_seq":523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:25.566548+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T21:02:25.566548+0000","last_peered":"2023-11-28T21:02:25.566548+0000","last_clean":"2023-11-28T21:02:25.566548+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T21:02:25.566548+0000","last_undegraded":"2023-11-28T21:02:25.566548+0000","last_fullsized":"2023-11-28T21:02:25.566548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"51'1786","reported_seq":3671,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.512440+0000","last_change":"2023-11-28T20:44:35.607810+0000","last_active":"2023-11-28T21:02:15.512440+0000","last_peered":"2023-11-28T21:02:15.512440+0000","last_clean":"2023-11-28T21:02:15.512440+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T21:02:15.512440+0000","last_undegraded":"2023-11-28T21:02:15.512440+0000","last_fullsized":"2023-11-28T21:02:15.512440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:26:41.398324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013136992,"stat_sum":{"num_bytes":25033729,"num_objects":551,"num_object_clones":252,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":252,"num_read":47,"num_read_kb":4142,"num_write":1517,"num_write_kb":28607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'391","reported_seq":2484,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.573272+0000","last_change":"2023-11-28T20:44:35.610823+0000","last_active":"2023-11-28T21:04:28.573272+0000","last_peered":"2023-11-28T21:04:28.573272+0000","last_clean":"2023-11-28T21:04:28.573272+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T21:04:28.573272+0000","last_undegraded":"2023-11-28T21:04:28.573272+0000","last_fullsized":"2023-11-28T21:04:28.573272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:29:14.727147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015322676,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'353","reported_seq":409,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:15.557982+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T21:01:15.557982+0000","last_peered":"2023-11-28T21:01:15.557982+0000","last_clean":"2023-11-28T21:01:15.557982+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T21:01:15.557982+0000","last_undegraded":"2023-11-28T21:01:15.557982+0000","last_fullsized":"2023-11-28T21:01:15.557982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":20,"num_write":319,"num_write_kb":12656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.564511+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T21:02:15.564511+0000","last_peered":"2023-11-28T21:02:15.564511+0000","last_clean":"2023-11-28T21:02:15.564511+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T21:02:15.564511+0000","last_undegraded":"2023-11-28T21:02:15.564511+0000","last_fullsized":"2023-11-28T21:02:15.564511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1795","reported_seq":3660,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:25.550179+0000","last_change":"2023-11-28T20:44:35.608577+0000","last_active":"2023-11-28T21:01:25.550179+0000","last_peered":"2023-11-28T21:01:25.550179+0000","last_clean":"2023-11-28T21:01:25.550179+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T21:01:25.550179+0000","last_undegraded":"2023-11-28T21:01:25.550179+0000","last_fullsized":"2023-11-28T21:01:25.550179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:14.094878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012304083,"stat_sum":{"num_bytes":50974055,"num_objects":563,"num_object_clones":255,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":255,"num_read":30,"num_read_kb":4125,"num_write":1519,"num_write_kb":57288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"51'375","reported_seq":2468,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.170631+0000","last_change":"2023-11-28T20:44:35.637477+0000","last_active":"2023-11-28T21:04:23.170631+0000","last_peered":"2023-11-28T21:04:23.170631+0000","last_clean":"2023-11-28T21:04:23.170631+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T21:04:23.170631+0000","last_undegraded":"2023-11-28T21:04:23.170631+0000","last_fullsized":"2023-11-28T21:04:23.170631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:35.213092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027789237000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"51'212","reported_seq":268,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:06.527993+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T21:03:06.527993+0000","last_peered":"2023-11-28T21:03:06.527993+0000","last_clean":"2023-11-28T21:03:06.527993+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T21:03:06.527993+0000","last_undegraded":"2023-11-28T21:03:06.527993+0000","last_fullsized":"2023-11-28T21:03:06.527993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:01.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777798,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":15,"num_write":164,"num_write_kb":16643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"51'1783","reported_seq":3664,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:20.561530+0000","last_change":"2023-11-28T20:44:35.614664+0000","last_active":"2023-11-28T21:02:20.561530+0000","last_peered":"2023-11-28T21:02:20.561530+0000","last_clean":"2023-11-28T21:02:20.561530+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T21:02:20.561530+0000","last_undegraded":"2023-11-28T21:02:20.561530+0000","last_fullsized":"2023-11-28T21:02:20.561530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:12:48.251405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016877468,"stat_sum":{"num_bytes":24953790,"num_objects":536,"num_object_clones":250,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":250,"num_read":41,"num_read_kb":41,"num_write":1520,"num_write_kb":33586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"51'453","reported_seq":2546,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.449547+0000","last_change":"2023-11-28T20:44:35.618675+0000","last_active":"2023-11-28T21:04:26.449547+0000","last_peered":"2023-11-28T21:04:26.449547+0000","last_clean":"2023-11-28T21:04:26.449547+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T21:04:26.449547+0000","last_undegraded":"2023-11-28T21:04:26.449547+0000","last_fullsized":"2023-11-28T21:04:26.449547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:27:00.507693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020341659000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"51'393","reported_seq":447,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:51.716770+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T21:00:51.716770+0000","last_peered":"2023-11-28T21:00:51.716770+0000","last_clean":"2023-11-28T21:00:51.716770+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T21:00:51.716770+0000","last_undegraded":"2023-11-28T21:00:51.716770+0000","last_fullsized":"2023-11-28T21:00:51.716770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:35:00.495687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777286,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":9,"num_write":342,"num_write_kb":16717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"51'1767","reported_seq":3643,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:10.519491+0000","last_change":"2023-11-28T20:44:35.611130+0000","last_active":"2023-11-28T21:03:10.519491+0000","last_peered":"2023-11-28T21:03:10.519491+0000","last_clean":"2023-11-28T21:03:10.519491+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T21:03:10.519491+0000","last_undegraded":"2023-11-28T21:03:10.519491+0000","last_fullsized":"2023-11-28T21:03:10.519491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:59.725546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014814858,"stat_sum":{"num_bytes":20638408,"num_objects":542,"num_object_clones":251,"num_object_copies":2168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":251,"num_read":37,"num_read_kb":37,"num_write":1496,"num_write_kb":31881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"51'403","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173054+0000","last_change":"2023-11-28T20:44:35.640929+0000","last_active":"2023-11-28T21:04:23.173054+0000","last_peered":"2023-11-28T21:04:23.173054+0000","last_clean":"2023-11-28T21:04:23.173054+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T21:04:23.173054+0000","last_undegraded":"2023-11-28T21:04:23.173054+0000","last_fullsized":"2023-11-28T21:04:23.173054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:27:39.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017837387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"51'371","reported_seq":427,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:51.511992+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T21:00:51.511992+0000","last_peered":"2023-11-28T21:00:51.511992+0000","last_clean":"2023-11-28T21:00:51.511992+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T21:00:51.511992+0000","last_undegraded":"2023-11-28T21:00:51.511992+0000","last_fullsized":"2023-11-28T21:00:51.511992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:19.063581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":22,"num_write":339,"num_write_kb":16887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"51'1847","reported_seq":3731,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.570080+0000","last_change":"2023-11-28T20:44:35.610893+0000","last_active":"2023-11-28T21:02:15.570080+0000","last_peered":"2023-11-28T21:02:15.570080+0000","last_clean":"2023-11-28T21:02:15.570080+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T21:02:15.570080+0000","last_undegraded":"2023-11-28T21:02:15.570080+0000","last_fullsized":"2023-11-28T21:02:15.570080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:13:32.634308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015179433000000001,"stat_sum":{"num_bytes":40252075,"num_objects":555,"num_object_clones":243,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":243,"num_read":37,"num_read_kb":1813,"num_write":1586,"num_write_kb":49527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"51'398","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.172349+0000","last_change":"2023-11-28T20:44:35.639947+0000","last_active":"2023-11-28T21:04:23.172349+0000","last_peered":"2023-11-28T21:04:23.172349+0000","last_clean":"2023-11-28T21:04:23.172349+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T21:04:23.172349+0000","last_undegraded":"2023-11-28T21:04:23.172349+0000","last_fullsized":"2023-11-28T21:04:23.172349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:55.543573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018023955000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"51'400","reported_seq":453,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:10.587072+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T21:03:10.587072+0000","last_peered":"2023-11-28T21:03:10.587072+0000","last_clean":"2023-11-28T21:03:10.587072+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T21:03:10.587072+0000","last_undegraded":"2023-11-28T21:03:10.587072+0000","last_fullsized":"2023-11-28T21:03:10.587072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094443,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":19633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"51'1788","reported_seq":3658,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.575375+0000","last_change":"2023-11-28T20:44:35.541705+0000","last_active":"2023-11-28T21:02:15.575375+0000","last_peered":"2023-11-28T21:02:15.575375+0000","last_clean":"2023-11-28T21:02:15.575375+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T21:02:15.575375+0000","last_undegraded":"2023-11-28T21:02:15.575375+0000","last_fullsized":"2023-11-28T21:02:15.575375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:17.458129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0090848279999999997,"stat_sum":{"num_bytes":25858877,"num_objects":550,"num_object_clones":249,"num_object_copies":2200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":550,"num_whiteouts":249,"num_read":30,"num_read_kb":4125,"num_write":1526,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"51'442","reported_seq":2534,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.171801+0000","last_change":"2023-11-28T20:44:35.636676+0000","last_active":"2023-11-28T21:04:23.171801+0000","last_peered":"2023-11-28T21:04:23.171801+0000","last_clean":"2023-11-28T21:04:23.171801+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T21:04:23.171801+0000","last_undegraded":"2023-11-28T21:04:23.171801+0000","last_fullsized":"2023-11-28T21:04:23.171801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:01:42.241191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020570496000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"51'633","reported_seq":687,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:41.517747+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T21:01:41.517747+0000","last_peered":"2023-11-28T21:01:41.517747+0000","last_clean":"2023-11-28T21:01:41.517747+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T21:01:41.517747+0000","last_undegraded":"2023-11-28T21:01:41.517747+0000","last_fullsized":"2023-11-28T21:01:41.517747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:38.450127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":7,"num_write":598,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"51'1723","reported_seq":3619,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.515230+0000","last_change":"2023-11-28T20:44:35.606276+0000","last_active":"2023-11-28T21:02:35.515230+0000","last_peered":"2023-11-28T21:02:35.515230+0000","last_clean":"2023-11-28T21:02:35.515230+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T21:02:35.515230+0000","last_undegraded":"2023-11-28T21:02:35.515230+0000","last_fullsized":"2023-11-28T21:02:35.515230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:14:25.189350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011806407999999999,"stat_sum":{"num_bytes":28712373,"num_objects":524,"num_object_clones":239,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":239,"num_read":46,"num_read_kb":46,"num_write":1462,"num_write_kb":31285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"51'407","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.562470+0000","last_change":"2023-11-28T20:44:35.611801+0000","last_active":"2023-11-28T21:04:28.562470+0000","last_peered":"2023-11-28T21:04:28.562470+0000","last_clean":"2023-11-28T21:04:28.562470+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T21:04:28.562470+0000","last_undegraded":"2023-11-28T21:04:28.562470+0000","last_fullsized":"2023-11-28T21:04:28.562470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:13.862302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014629055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"51'458","reported_seq":511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.552953+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T21:01:40.552953+0000","last_peered":"2023-11-28T21:01:40.552953+0000","last_clean":"2023-11-28T21:01:40.552953+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T21:01:40.552953+0000","last_undegraded":"2023-11-28T21:01:40.552953+0000","last_fullsized":"2023-11-28T21:01:40.552953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"51'1831","reported_seq":3699,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:36.607550+0000","last_change":"2023-11-28T20:44:35.613708+0000","last_active":"2023-11-28T21:02:36.607550+0000","last_peered":"2023-11-28T21:02:36.607550+0000","last_clean":"2023-11-28T21:02:36.607550+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T21:02:36.607550+0000","last_undegraded":"2023-11-28T21:02:36.607550+0000","last_fullsized":"2023-11-28T21:02:36.607550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:16:25.921514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017596898999999999,"stat_sum":{"num_bytes":20840070,"num_objects":572,"num_object_clones":259,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":259,"num_read":39,"num_read_kb":4134,"num_write":1549,"num_write_kb":33741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.172578+0000","last_change":"2023-11-28T20:44:35.639082+0000","last_active":"2023-11-28T21:04:23.172578+0000","last_peered":"2023-11-28T21:04:23.172578+0000","last_clean":"2023-11-28T21:04:23.172578+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T21:04:23.172578+0000","last_undegraded":"2023-11-28T21:04:23.172578+0000","last_fullsized":"2023-11-28T21:04:23.172578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:17.336904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019240779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"51'284","reported_seq":338,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.562767+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T21:01:40.562767+0000","last_peered":"2023-11-28T21:01:40.562767+0000","last_clean":"2023-11-28T21:01:40.562767+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T21:01:40.562767+0000","last_undegraded":"2023-11-28T21:01:40.562767+0000","last_fullsized":"2023-11-28T21:01:40.562767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":238,"num_write_kb":12572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"51'1661","reported_seq":3548,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:51.601005+0000","last_change":"2023-11-28T20:44:35.616111+0000","last_active":"2023-11-28T21:01:51.601005+0000","last_peered":"2023-11-28T21:01:51.601005+0000","last_clean":"2023-11-28T21:01:51.601005+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T21:01:51.601005+0000","last_undegraded":"2023-11-28T21:01:51.601005+0000","last_fullsized":"2023-11-28T21:01:51.601005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:45:36.330587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018495173,"stat_sum":{"num_bytes":20919340,"num_objects":524,"num_object_clones":235,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":235,"num_read":33,"num_read_kb":33,"num_write":1415,"num_write_kb":40695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"51'413","reported_seq":2505,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.560104+0000","last_change":"2023-11-28T20:44:35.609530+0000","last_active":"2023-11-28T21:04:28.560104+0000","last_peered":"2023-11-28T21:04:28.560104+0000","last_clean":"2023-11-28T21:04:28.560104+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T21:04:28.560104+0000","last_undegraded":"2023-11-28T21:04:28.560104+0000","last_fullsized":"2023-11-28T21:04:28.560104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:39:49.725834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014112118999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"51'405","reported_seq":458,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.507981+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T21:01:40.507981+0000","last_peered":"2023-11-28T21:01:40.507981+0000","last_clean":"2023-11-28T21:01:40.507981+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T21:01:40.507981+0000","last_undegraded":"2023-11-28T21:01:40.507981+0000","last_fullsized":"2023-11-28T21:01:40.507981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:39:13.108243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":16779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"51'1691","reported_seq":3584,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.574707+0000","last_change":"2023-11-28T20:44:35.613305+0000","last_active":"2023-11-28T21:02:35.574707+0000","last_peered":"2023-11-28T21:02:35.574707+0000","last_clean":"2023-11-28T21:02:35.574707+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T21:02:35.574707+0000","last_undegraded":"2023-11-28T21:02:35.574707+0000","last_fullsized":"2023-11-28T21:02:35.574707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:51.165815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015550285,"stat_sum":{"num_bytes":33895761,"num_objects":515,"num_object_clones":224,"num_object_copies":2060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515,"num_whiteouts":224,"num_read":28,"num_read_kb":28,"num_write":1451,"num_write_kb":37503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"51'394","reported_seq":2486,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.424848+0000","last_change":"2023-11-28T20:44:35.632331+0000","last_active":"2023-11-28T21:04:28.424848+0000","last_peered":"2023-11-28T21:04:28.424848+0000","last_clean":"2023-11-28T21:04:28.424848+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T21:04:28.424848+0000","last_undegraded":"2023-11-28T21:04:28.424848+0000","last_fullsized":"2023-11-28T21:04:28.424848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:35:55.459943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022690017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'566","reported_seq":619,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:05.583299+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T21:04:05.583299+0000","last_peered":"2023-11-28T21:04:05.583299+0000","last_clean":"2023-11-28T21:04:05.583299+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T21:04:05.583299+0000","last_undegraded":"2023-11-28T21:04:05.583299+0000","last_fullsized":"2023-11-28T21:04:05.583299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":24942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"51'1823","reported_seq":3693,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:46.723591+0000","last_change":"2023-11-28T20:44:35.607147+0000","last_active":"2023-11-28T21:01:46.723591+0000","last_peered":"2023-11-28T21:01:46.723591+0000","last_clean":"2023-11-28T21:01:46.723591+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T21:01:46.723591+0000","last_undegraded":"2023-11-28T21:01:46.723591+0000","last_fullsized":"2023-11-28T21:01:46.723591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1823,"log_dups_size":0,"ondisk_log_size":1823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:44:45.887527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013090108,"stat_sum":{"num_bytes":42607549,"num_objects":556,"num_object_clones":254,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":254,"num_read":36,"num_read_kb":4131,"num_write":1543,"num_write_kb":57518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"51'388","reported_seq":2473,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491642+0000","last_change":"2023-11-28T20:44:35.530346+0000","last_active":"2023-11-28T21:04:30.491642+0000","last_peered":"2023-11-28T21:04:30.491642+0000","last_clean":"2023-11-28T21:04:30.491642+0000","last_became_active":"2023-11-28T20:39:01.848225+0000","last_became_peered":"2023-11-28T20:39:01.848225+0000","last_unstale":"2023-11-28T21:04:30.491642+0000","last_undegraded":"2023-11-28T21:04:30.491642+0000","last_fullsized":"2023-11-28T21:04:30.491642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:13:47.582113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019608149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'538","reported_seq":591,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:31.729219+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T21:02:31.729219+0000","last_peered":"2023-11-28T21:02:31.729219+0000","last_clean":"2023-11-28T21:02:31.729219+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T21:02:31.729219+0000","last_undegraded":"2023-11-28T21:02:31.729219+0000","last_fullsized":"2023-11-28T21:02:31.729219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":21060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"51'1816","reported_seq":3706,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:45.569384+0000","last_change":"2023-11-28T20:44:35.543972+0000","last_active":"2023-11-28T21:01:45.569384+0000","last_peered":"2023-11-28T21:01:45.569384+0000","last_clean":"2023-11-28T21:01:45.569384+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T21:01:45.569384+0000","last_undegraded":"2023-11-28T21:01:45.569384+0000","last_fullsized":"2023-11-28T21:01:45.569384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:46.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010092998000000001,"stat_sum":{"num_bytes":33600436,"num_objects":568,"num_object_clones":254,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":254,"num_read":57,"num_read_kb":4152,"num_write":1538,"num_write_kb":45454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"51'410","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564086+0000","last_change":"2023-11-28T20:44:35.605933+0000","last_active":"2023-11-28T21:04:28.564086+0000","last_peered":"2023-11-28T21:04:28.564086+0000","last_clean":"2023-11-28T21:04:28.564086+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T21:04:28.564086+0000","last_undegraded":"2023-11-28T21:04:28.564086+0000","last_fullsized":"2023-11-28T21:04:28.564086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:47.440506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744874000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"51'484","reported_seq":538,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.573719+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T21:02:30.573719+0000","last_peered":"2023-11-28T21:02:30.573719+0000","last_clean":"2023-11-28T21:02:30.573719+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T21:02:30.573719+0000","last_undegraded":"2023-11-28T21:02:30.573719+0000","last_fullsized":"2023-11-28T21:02:30.573719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":27,"num_write":437,"num_write_kb":33175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"51'1777","reported_seq":3671,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:46.600267+0000","last_change":"2023-11-28T20:44:35.614798+0000","last_active":"2023-11-28T21:01:46.600267+0000","last_peered":"2023-11-28T21:01:46.600267+0000","last_clean":"2023-11-28T21:01:46.600267+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T21:01:46.600267+0000","last_undegraded":"2023-11-28T21:01:46.600267+0000","last_fullsized":"2023-11-28T21:01:46.600267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:55.011311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018323326000000001,"stat_sum":{"num_bytes":24785841,"num_objects":525,"num_object_clones":238,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":238,"num_read":34,"num_read_kb":34,"num_write":1518,"num_write_kb":32579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178537+0000","last_change":"2023-11-28T20:44:35.621854+0000","last_active":"2023-11-28T21:04:23.178537+0000","last_peered":"2023-11-28T21:04:23.178537+0000","last_clean":"2023-11-28T21:04:23.178537+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T21:04:23.178537+0000","last_undegraded":"2023-11-28T21:04:23.178537+0000","last_fullsized":"2023-11-28T21:04:23.178537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:22.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022293309000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"51'163","reported_seq":216,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.563729+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T21:02:30.563729+0000","last_peered":"2023-11-28T21:02:30.563729+0000","last_clean":"2023-11-28T21:02:30.563729+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T21:02:30.563729+0000","last_undegraded":"2023-11-28T21:02:30.563729+0000","last_fullsized":"2023-11-28T21:02:30.563729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"51'1914","reported_seq":3776,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:46.600301+0000","last_change":"2023-11-28T20:44:35.611992+0000","last_active":"2023-11-28T21:01:46.600301+0000","last_peered":"2023-11-28T21:01:46.600301+0000","last_clean":"2023-11-28T21:01:46.600301+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T21:01:46.600301+0000","last_undegraded":"2023-11-28T21:01:46.600301+0000","last_fullsized":"2023-11-28T21:01:46.600301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:08:22.583119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016210088000000001,"stat_sum":{"num_bytes":26682582,"num_objects":583,"num_object_clones":263,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":583,"num_whiteouts":263,"num_read":39,"num_read_kb":8229,"num_write":1627,"num_write_kb":50263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"51'1808","reported_seq":3653,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.514653+0000","last_change":"2023-11-28T20:44:35.605377+0000","last_active":"2023-11-28T21:02:30.514653+0000","last_peered":"2023-11-28T21:02:30.514653+0000","last_clean":"2023-11-28T21:02:30.514653+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T21:02:30.514653+0000","last_undegraded":"2023-11-28T21:02:30.514653+0000","last_fullsized":"2023-11-28T21:02:30.514653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:55:41.417877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011090378999999999,"stat_sum":{"num_bytes":29341830,"num_objects":589,"num_object_clones":267,"num_object_copies":2356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":267,"num_read":21,"num_read_kb":21,"num_write":1524,"num_write_kb":32957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494763+0000","last_change":"2023-11-28T20:44:35.601680+0000","last_active":"2023-11-28T21:04:30.494763+0000","last_peered":"2023-11-28T21:04:30.494763+0000","last_clean":"2023-11-28T21:04:30.494763+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T21:04:30.494763+0000","last_undegraded":"2023-11-28T21:04:30.494763+0000","last_fullsized":"2023-11-28T21:04:30.494763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:33.094463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0086681780000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"51'600","reported_seq":655,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.573365+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T21:02:30.573365+0000","last_peered":"2023-11-28T21:02:30.573365+0000","last_clean":"2023-11-28T21:02:30.573365+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T21:02:30.573365+0000","last_undegraded":"2023-11-28T21:02:30.573365+0000","last_fullsized":"2023-11-28T21:02:30.573365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":33,"num_write":550,"num_write_kb":45433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"51'1738","reported_seq":3612,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.549285+0000","last_change":"2023-11-28T20:44:35.619807+0000","last_active":"2023-11-28T21:01:20.549285+0000","last_peered":"2023-11-28T21:01:20.549285+0000","last_clean":"2023-11-28T21:01:20.549285+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T21:01:20.549285+0000","last_undegraded":"2023-11-28T21:01:20.549285+0000","last_fullsized":"2023-11-28T21:01:20.549285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1738,"log_dups_size":0,"ondisk_log_size":1738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:00.302899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016829818,"stat_sum":{"num_bytes":16566795,"num_objects":555,"num_object_clones":248,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":248,"num_read":32,"num_read_kb":32,"num_write":1476,"num_write_kb":23281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"51'447","reported_seq":2539,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.567545+0000","last_change":"2023-11-28T20:44:35.615234+0000","last_active":"2023-11-28T21:04:28.567545+0000","last_peered":"2023-11-28T21:04:28.567545+0000","last_clean":"2023-11-28T21:04:28.567545+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T21:04:28.567545+0000","last_undegraded":"2023-11-28T21:04:28.567545+0000","last_fullsized":"2023-11-28T21:04:28.567545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:08:49.468386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018571445999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"51'758","reported_seq":1302,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:36.607484+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T21:02:36.607484+0000","last_peered":"2023-11-28T21:02:36.607484+0000","last_clean":"2023-11-28T21:02:36.607484+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T21:02:36.607484+0000","last_undegraded":"2023-11-28T21:02:36.607484+0000","last_fullsized":"2023-11-28T21:02:36.607484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:11:35.798025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18014655,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":492,"num_read_kb":1568,"num_write":714,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"51'1105","reported_seq":1657,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.543016+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T21:00:50.543016+0000","last_peered":"2023-11-28T21:00:50.543016+0000","last_clean":"2023-11-28T21:00:50.543016+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T21:00:50.543016+0000","last_undegraded":"2023-11-28T21:00:50.543016+0000","last_fullsized":"2023-11-28T21:00:50.543016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34584852,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":502,"num_read_kb":1393,"num_write":1050,"num_write_kb":34570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"51'366","reported_seq":2457,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559286+0000","last_change":"2023-11-28T20:44:35.611477+0000","last_active":"2023-11-28T21:04:28.559286+0000","last_peered":"2023-11-28T21:04:28.559286+0000","last_clean":"2023-11-28T21:04:28.559286+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T21:04:28.559286+0000","last_undegraded":"2023-11-28T21:04:28.559286+0000","last_fullsized":"2023-11-28T21:04:28.559286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:08:56.615977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014791248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"51'1725","reported_seq":3594,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:56.512564+0000","last_change":"2023-11-28T20:44:35.530646+0000","last_active":"2023-11-28T21:00:56.512564+0000","last_peered":"2023-11-28T21:00:56.512564+0000","last_clean":"2023-11-28T21:00:56.512564+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T21:00:56.512564+0000","last_undegraded":"2023-11-28T21:00:56.512564+0000","last_fullsized":"2023-11-28T21:00:56.512564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:21.553500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022000169999999999,"stat_sum":{"num_bytes":29986576,"num_objects":543,"num_object_clones":248,"num_object_copies":2172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":248,"num_read":29,"num_read_kb":29,"num_write":1454,"num_write_kb":38376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"51'365","reported_seq":417,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:51.592796+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T21:00:51.592796+0000","last_peered":"2023-11-28T21:00:51.592796+0000","last_clean":"2023-11-28T21:00:51.592796+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T21:00:51.592796+0000","last_undegraded":"2023-11-28T21:00:51.592796+0000","last_fullsized":"2023-11-28T21:00:51.592796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:26:23.823221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":20723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"51'401","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491589+0000","last_change":"2023-11-28T20:44:35.544103+0000","last_active":"2023-11-28T21:04:30.491589+0000","last_peered":"2023-11-28T21:04:30.491589+0000","last_clean":"2023-11-28T21:04:30.491589+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T21:04:30.491589+0000","last_undegraded":"2023-11-28T21:04:30.491589+0000","last_fullsized":"2023-11-28T21:04:30.491589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:40.051010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010086065,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"51'1756","reported_seq":3648,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:56.593503+0000","last_change":"2023-11-28T20:44:35.611344+0000","last_active":"2023-11-28T21:00:56.593503+0000","last_peered":"2023-11-28T21:00:56.593503+0000","last_clean":"2023-11-28T21:00:56.593503+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T21:00:56.593503+0000","last_undegraded":"2023-11-28T21:00:56.593503+0000","last_fullsized":"2023-11-28T21:00:56.593503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:16.879801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015656369999999999,"stat_sum":{"num_bytes":33768985,"num_objects":521,"num_object_clones":238,"num_object_copies":2084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":238,"num_read":45,"num_read_kb":12330,"num_write":1499,"num_write_kb":48802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"51'415","reported_seq":2508,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559730+0000","last_change":"2023-11-28T20:44:35.609721+0000","last_active":"2023-11-28T21:04:28.559730+0000","last_peered":"2023-11-28T21:04:28.559730+0000","last_clean":"2023-11-28T21:04:28.559730+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T21:04:28.559730+0000","last_undegraded":"2023-11-28T21:04:28.559730+0000","last_fullsized":"2023-11-28T21:04:28.559730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:39.776841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013289166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"51'439","reported_seq":2532,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491719+0000","last_change":"2023-11-28T20:44:35.529934+0000","last_active":"2023-11-28T21:04:30.491719+0000","last_peered":"2023-11-28T21:04:30.491719+0000","last_clean":"2023-11-28T21:04:30.491719+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T21:04:30.491719+0000","last_undegraded":"2023-11-28T21:04:30.491719+0000","last_fullsized":"2023-11-28T21:04:30.491719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:44:09.727309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017225739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"51'438","reported_seq":2531,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564572+0000","last_change":"2023-11-28T20:44:35.624744+0000","last_active":"2023-11-28T21:04:28.564572+0000","last_peered":"2023-11-28T21:04:28.564572+0000","last_clean":"2023-11-28T21:04:28.564572+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T21:04:28.564572+0000","last_undegraded":"2023-11-28T21:04:28.564572+0000","last_fullsized":"2023-11-28T21:04:28.564572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:53.447494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018881576000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"51'384","reported_seq":2477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.558946+0000","last_change":"2023-11-28T20:44:35.611177+0000","last_active":"2023-11-28T21:04:28.558946+0000","last_peered":"2023-11-28T21:04:28.558946+0000","last_clean":"2023-11-28T21:04:28.558946+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T21:04:28.558946+0000","last_undegraded":"2023-11-28T21:04:28.558946+0000","last_fullsized":"2023-11-28T21:04:28.558946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:06.242482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014673739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"51'367","reported_seq":2460,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.565973+0000","last_change":"2023-11-28T20:44:35.615657+0000","last_active":"2023-11-28T21:04:28.565973+0000","last_peered":"2023-11-28T21:04:28.565973+0000","last_clean":"2023-11-28T21:04:28.565973+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T21:04:28.565973+0000","last_undegraded":"2023-11-28T21:04:28.565973+0000","last_fullsized":"2023-11-28T21:04:28.565973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:28.718350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017627927000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"51'417","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495102+0000","last_change":"2023-11-28T20:44:35.599239+0000","last_active":"2023-11-28T21:04:30.495102+0000","last_peered":"2023-11-28T21:04:30.495102+0000","last_clean":"2023-11-28T21:04:30.495102+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T21:04:30.495102+0000","last_undegraded":"2023-11-28T21:04:30.495102+0000","last_fullsized":"2023-11-28T21:04:30.495102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:04:20.147670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061577519999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"51'426","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.177843+0000","last_change":"2023-11-28T20:44:35.619451+0000","last_active":"2023-11-28T21:04:23.177843+0000","last_peered":"2023-11-28T21:04:23.177843+0000","last_clean":"2023-11-28T21:04:23.177843+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T21:04:23.177843+0000","last_undegraded":"2023-11-28T21:04:23.177843+0000","last_fullsized":"2023-11-28T21:04:23.177843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:18.657101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017436297999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"51'394","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564166+0000","last_change":"2023-11-28T20:44:35.614405+0000","last_active":"2023-11-28T21:04:28.564166+0000","last_peered":"2023-11-28T21:04:28.564166+0000","last_clean":"2023-11-28T21:04:28.564166+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T21:04:28.564166+0000","last_undegraded":"2023-11-28T21:04:28.564166+0000","last_fullsized":"2023-11-28T21:04:28.564166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:26:38.450255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018095488999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"51'421","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.454749+0000","last_change":"2023-11-28T20:44:35.611219+0000","last_active":"2023-11-28T21:04:26.454749+0000","last_peered":"2023-11-28T21:04:26.454749+0000","last_clean":"2023-11-28T21:04:26.454749+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T21:04:26.454749+0000","last_undegraded":"2023-11-28T21:04:26.454749+0000","last_fullsized":"2023-11-28T21:04:26.454749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:23.122455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014654275,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"51'411","reported_seq":2504,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:29.587753+0000","last_change":"2023-11-28T20:44:35.613449+0000","last_active":"2023-11-28T21:04:29.587753+0000","last_peered":"2023-11-28T21:04:29.587753+0000","last_clean":"2023-11-28T21:04:29.587753+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T21:04:29.587753+0000","last_undegraded":"2023-11-28T21:04:29.587753+0000","last_fullsized":"2023-11-28T21:04:29.587753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:48.348409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017356489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"51'417","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492103+0000","last_change":"2023-11-28T20:44:35.530341+0000","last_active":"2023-11-28T21:04:30.492103+0000","last_peered":"2023-11-28T21:04:30.492103+0000","last_clean":"2023-11-28T21:04:30.492103+0000","last_became_active":"2023-11-28T20:39:01.848167+0000","last_became_peered":"2023-11-28T20:39:01.848167+0000","last_unstale":"2023-11-28T21:04:30.492103+0000","last_undegraded":"2023-11-28T21:04:30.492103+0000","last_fullsized":"2023-11-28T21:04:30.492103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:22.610505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020579169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"51'422","reported_seq":2515,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.560548+0000","last_change":"2023-11-28T20:44:35.610405+0000","last_active":"2023-11-28T21:04:28.560548+0000","last_peered":"2023-11-28T21:04:28.560548+0000","last_clean":"2023-11-28T21:04:28.560548+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T21:04:28.560548+0000","last_undegraded":"2023-11-28T21:04:28.560548+0000","last_fullsized":"2023-11-28T21:04:28.560548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:42.309551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014291543,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"51'396","reported_seq":2489,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.193454+0000","last_change":"2023-11-28T20:44:35.620800+0000","last_active":"2023-11-28T21:04:23.193454+0000","last_peered":"2023-11-28T21:04:23.193454+0000","last_clean":"2023-11-28T21:04:23.193454+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T21:04:23.193454+0000","last_undegraded":"2023-11-28T21:04:23.193454+0000","last_fullsized":"2023-11-28T21:04:23.193454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:05.581863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017003022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"51'403","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492431+0000","last_change":"2023-11-28T20:44:35.638243+0000","last_active":"2023-11-28T21:04:30.492431+0000","last_peered":"2023-11-28T21:04:30.492431+0000","last_clean":"2023-11-28T21:04:30.492431+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T21:04:30.492431+0000","last_undegraded":"2023-11-28T21:04:30.492431+0000","last_fullsized":"2023-11-28T21:04:30.492431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:50:42.227579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020849563000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"51'393","reported_seq":2485,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491669+0000","last_change":"2023-11-28T20:44:35.530649+0000","last_active":"2023-11-28T21:04:30.491669+0000","last_peered":"2023-11-28T21:04:30.491669+0000","last_clean":"2023-11-28T21:04:30.491669+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T21:04:30.491669+0000","last_undegraded":"2023-11-28T21:04:30.491669+0000","last_fullsized":"2023-11-28T21:04:30.491669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:56.771896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019691359999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"51'430","reported_seq":2522,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178483+0000","last_change":"2023-11-28T20:44:35.617721+0000","last_active":"2023-11-28T21:04:23.178483+0000","last_peered":"2023-11-28T21:04:23.178483+0000","last_clean":"2023-11-28T21:04:23.178483+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T21:04:23.178483+0000","last_undegraded":"2023-11-28T21:04:23.178483+0000","last_fullsized":"2023-11-28T21:04:23.178483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:40.430998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019569492000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"51'421","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559068+0000","last_change":"2023-11-28T20:44:35.612279+0000","last_active":"2023-11-28T21:04:28.559068+0000","last_peered":"2023-11-28T21:04:28.559068+0000","last_clean":"2023-11-28T21:04:28.559068+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T21:04:28.559068+0000","last_undegraded":"2023-11-28T21:04:28.559068+0000","last_fullsized":"2023-11-28T21:04:28.559068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:57.398242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015773832000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"51'435","reported_seq":2527,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491364+0000","last_change":"2023-11-28T20:44:35.606941+0000","last_active":"2023-11-28T21:04:30.491364+0000","last_peered":"2023-11-28T21:04:30.491364+0000","last_clean":"2023-11-28T21:04:30.491364+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T21:04:30.491364+0000","last_undegraded":"2023-11-28T21:04:30.491364+0000","last_fullsized":"2023-11-28T21:04:30.491364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:10.397736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013692045,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"51'417","reported_seq":2509,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495486+0000","last_change":"2023-11-28T20:44:35.609244+0000","last_active":"2023-11-28T21:04:30.495486+0000","last_peered":"2023-11-28T21:04:30.495486+0000","last_clean":"2023-11-28T21:04:30.495486+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T21:04:30.495486+0000","last_undegraded":"2023-11-28T21:04:30.495486+0000","last_fullsized":"2023-11-28T21:04:30.495486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:49:51.107877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014004656000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"51'418","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564298+0000","last_change":"2023-11-28T20:44:35.614800+0000","last_active":"2023-11-28T21:04:28.564298+0000","last_peered":"2023-11-28T21:04:28.564298+0000","last_clean":"2023-11-28T21:04:28.564298+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T21:04:28.564298+0000","last_undegraded":"2023-11-28T21:04:28.564298+0000","last_fullsized":"2023-11-28T21:04:28.564298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:23:59.393140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018246884000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"51'374","reported_seq":2466,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.158886+0000","last_change":"2023-11-28T20:44:35.544988+0000","last_active":"2023-11-28T21:04:23.158886+0000","last_peered":"2023-11-28T21:04:23.158886+0000","last_clean":"2023-11-28T21:04:23.158886+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T21:04:23.158886+0000","last_undegraded":"2023-11-28T21:04:23.158886+0000","last_fullsized":"2023-11-28T21:04:23.158886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:16:32.112808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010909501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"51'380","reported_seq":2472,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176371+0000","last_change":"2023-11-28T20:44:35.611282+0000","last_active":"2023-11-28T21:04:23.176371+0000","last_peered":"2023-11-28T21:04:23.176371+0000","last_clean":"2023-11-28T21:04:23.176371+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T21:04:23.176371+0000","last_undegraded":"2023-11-28T21:04:23.176371+0000","last_fullsized":"2023-11-28T21:04:23.176371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:52:02.947575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014265125,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"51'385","reported_seq":2484,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492462+0000","last_change":"2023-11-28T20:44:35.618555+0000","last_active":"2023-11-28T21:04:30.492462+0000","last_peered":"2023-11-28T21:04:30.492462+0000","last_clean":"2023-11-28T21:04:30.492462+0000","last_became_active":"2023-11-28T20:39:01.391291+0000","last_became_peered":"2023-11-28T20:39:01.391291+0000","last_unstale":"2023-11-28T21:04:30.492462+0000","last_undegraded":"2023-11-28T21:04:30.492462+0000","last_fullsized":"2023-11-28T21:04:30.492462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:29.414536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017078507999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"51'419","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176881+0000","last_change":"2023-11-28T20:44:35.640277+0000","last_active":"2023-11-28T21:04:23.176881+0000","last_peered":"2023-11-28T21:04:23.176881+0000","last_clean":"2023-11-28T21:04:23.176881+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T21:04:23.176881+0000","last_undegraded":"2023-11-28T21:04:23.176881+0000","last_fullsized":"2023-11-28T21:04:23.176881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.933807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017711331,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"51'405","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564972+0000","last_change":"2023-11-28T20:44:35.613891+0000","last_active":"2023-11-28T21:04:28.564972+0000","last_peered":"2023-11-28T21:04:28.564972+0000","last_clean":"2023-11-28T21:04:28.564972+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T21:04:28.564972+0000","last_undegraded":"2023-11-28T21:04:28.564972+0000","last_fullsized":"2023-11-28T21:04:28.564972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:11:40.197882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017616142000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"51'400","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.561114+0000","last_change":"2023-11-28T20:44:35.635891+0000","last_active":"2023-11-28T21:04:28.561114+0000","last_peered":"2023-11-28T21:04:28.561114+0000","last_clean":"2023-11-28T21:04:28.561114+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T21:04:28.561114+0000","last_undegraded":"2023-11-28T21:04:28.561114+0000","last_fullsized":"2023-11-28T21:04:28.561114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:37:28.366415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020312439000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"51'403","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.558229+0000","last_change":"2023-11-28T20:44:35.622789+0000","last_active":"2023-11-28T21:04:28.558229+0000","last_peered":"2023-11-28T21:04:28.558229+0000","last_clean":"2023-11-28T21:04:28.558229+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T21:04:28.558229+0000","last_undegraded":"2023-11-28T21:04:28.558229+0000","last_fullsized":"2023-11-28T21:04:28.558229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:13:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017449602000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"51'416","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492750+0000","last_change":"2023-11-28T20:44:35.638249+0000","last_active":"2023-11-28T21:04:30.492750+0000","last_peered":"2023-11-28T21:04:30.492750+0000","last_clean":"2023-11-28T21:04:30.492750+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T21:04:30.492750+0000","last_undegraded":"2023-11-28T21:04:30.492750+0000","last_fullsized":"2023-11-28T21:04:30.492750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:55.963557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018992159000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"51'397","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.448022+0000","last_change":"2023-11-28T20:44:35.613038+0000","last_active":"2023-11-28T21:04:26.448022+0000","last_peered":"2023-11-28T21:04:26.448022+0000","last_clean":"2023-11-28T21:04:26.448022+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T21:04:26.448022+0000","last_undegraded":"2023-11-28T21:04:26.448022+0000","last_fullsized":"2023-11-28T21:04:26.448022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:29.806450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015371953000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"51'415","reported_seq":2509,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494151+0000","last_change":"2023-11-28T20:44:35.603769+0000","last_active":"2023-11-28T21:04:30.494151+0000","last_peered":"2023-11-28T21:04:30.494151+0000","last_clean":"2023-11-28T21:04:30.494151+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T21:04:30.494151+0000","last_undegraded":"2023-11-28T21:04:30.494151+0000","last_fullsized":"2023-11-28T21:04:30.494151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:16:20.274605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098716120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"51'399","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494927+0000","last_change":"2023-11-28T20:44:35.607958+0000","last_active":"2023-11-28T21:04:30.494927+0000","last_peered":"2023-11-28T21:04:30.494927+0000","last_clean":"2023-11-28T21:04:30.494927+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T21:04:30.494927+0000","last_undegraded":"2023-11-28T21:04:30.494927+0000","last_fullsized":"2023-11-28T21:04:30.494927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:07:12.305635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011275626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"51'410","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176638+0000","last_change":"2023-11-28T20:44:35.639151+0000","last_active":"2023-11-28T21:04:23.176638+0000","last_peered":"2023-11-28T21:04:23.176638+0000","last_clean":"2023-11-28T21:04:23.176638+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T21:04:23.176638+0000","last_undegraded":"2023-11-28T21:04:23.176638+0000","last_fullsized":"2023-11-28T21:04:23.176638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:25:42.800941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017369464000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":892224822,"num_objects":17666,"num_object_clones":8054,"num_object_copies":70664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17666,"num_whiteouts":7974,"num_read":1150,"num_read_kb":100500,"num_write":48457,"num_write_kb":1187847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1881309184,"data_stored":1881309184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57114,"ondisk_log_size":57114,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26113,"ondisk_log_size":26113,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":680923161,"num_objects":625,"num_object_clones":0,"num_object_copies":1250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":0,"num_read":1485,"num_read_kb":4455,"num_write":14545,"num_write_kb":680650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1362001920,"data_stored":1361846322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15149,"ondisk_log_size":15149,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509770,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":650828,"kb_used_data":461380,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":93721012,"statfs":{"total":96636764160,"available":95970316288,"internally_reserved":0,"allocated":472453120,"data_stored":472148767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":193984967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":42.021000000000001,"5min":8.7739999999999991,"15min":3.2749999999999999},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":873.04100000000005,"5min":873.04100000000005,"15min":873.04100000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.52300000000000002},"min":{"1min":0.24299999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":6.5659999999999998},"last":0.42499999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":1.194,"5min":1.194,"15min":6.9370000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.52400000000000002,"15min":0.54400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.627,"5min":0.79700000000000004,"15min":3.6219999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.8780000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":39.405999999999999,"5min":8.3049999999999997,"15min":3.1909999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.28299999999999997},"max":{"1min":817.63900000000001,"5min":817.63900000000001,"15min":817.63900000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":253.649,"5min":51.384,"15min":17.940000000000001},"min":{"1min":0.56299999999999994,"5min":0.48699999999999999,"15min":0.34799999999999998},"max":{"1min":3268.6419999999998,"5min":3268.6419999999998,"15min":3268.6419999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":253.23400000000001,"5min":51.326999999999998,"15min":17.667999999999999},"min":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"max":{"1min":3232.7750000000001,"5min":3232.7750000000001,"15min":3232.7750000000001},"last":0.80100000000000005}]},{"osd":5,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":229.02799999999999,"5min":46.481999999999999,"15min":16.082999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.42299999999999999},"max":{"1min":3259.5459999999998,"5min":3259.5459999999998,"15min":3259.5459999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":36.899999999999999,"5min":8.0679999999999996,"15min":3.2559999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53300000000000003},"max":{"1min":703.19299999999998,"5min":703.19299999999998,"15min":703.19299999999998},"last":0.749}]},{"osd":6,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":46.119,"5min":9.9299999999999997,"15min":3.9100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":928.99199999999996,"5min":928.99199999999996,"15min":928.99199999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":49.222999999999999,"5min":10.545,"15min":4.1520000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":961.01800000000003,"5min":961.01800000000003,"15min":961.01800000000003},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":44.685000000000002,"5min":9.6370000000000005,"15min":4.1289999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.44600000000000001},"max":{"1min":872.827,"5min":872.827,"15min":872.827},"last":0.78300000000000003},{"interface":"front","average":{"1min":41.890000000000001,"5min":9.0760000000000005,"15min":3.6160000000000001},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.48899999999999999},"max":{"1min":817.84400000000005,"5min":817.84400000000005,"15min":817.84400000000005},"last":0.64600000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509770,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424976,"kb_used_data":277192,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93946864,"statfs":{"total":96636764160,"available":96201588736,"internally_reserved":0,"allocated":283844608,"data_stored":283539830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9790000000000001,"5min":1.5509999999999999,"15min":0.82999999999999996},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":64.087000000000003,"5min":64.087000000000003,"15min":64.087000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":6.0759999999999996,"5min":1.667,"15min":0.95599999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25},"max":{"1min":64.114999999999995,"5min":64.114999999999995,"15min":64.114999999999995},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9960000000000004,"5min":1.647,"15min":0.97199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":64,"5min":64,"15min":64},"last":0.35799999999999998},{"interface":"front","average":{"1min":6.0679999999999996,"5min":1.7,"15min":0.97399999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":64.028999999999996,"5min":64.028999999999996,"15min":64.028999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":144.126,"5min":29.332000000000001,"15min":10.220000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2826.7199999999998,"5min":2826.7199999999998,"15min":2826.7199999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":146.227,"5min":29.651,"15min":10.257999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.307},"max":{"1min":2838.0680000000002,"5min":2838.0680000000002,"15min":2838.0680000000002},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":13.901,"5min":3.4500000000000002,"15min":1.7190000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.38},"max":{"1min":149.43700000000001,"5min":149.43700000000001,"15min":149.43700000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":262.66399999999999,"5min":53.177,"15min":18.265000000000001},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.38800000000000001},"max":{"1min":3288.7310000000002,"5min":3288.7310000000002,"15min":3288.7310000000002},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":308.05099999999999,"5min":62.268999999999998,"15min":21.323},"min":{"1min":0.68500000000000005,"5min":0.54700000000000004,"15min":0.46000000000000002},"max":{"1min":3314.4110000000001,"5min":3314.4110000000001,"15min":3314.4110000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":207.60499999999999,"5min":42.195999999999998,"15min":14.644},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.44900000000000001},"max":{"1min":2139.3159999999998,"5min":2139.3159999999998,"15min":2139.3159999999998},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":317.48099999999999,"5min":64.153999999999996,"15min":21.949000000000002},"min":{"1min":0.64100000000000001,"5min":0.56999999999999995,"15min":0.38700000000000001},"max":{"1min":3288.7730000000001,"5min":3288.7730000000001,"15min":3288.7730000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":254.578,"5min":51.664000000000001,"15min":17.855},"min":{"1min":0.77700000000000002,"5min":0.68500000000000005,"15min":0.42699999999999999},"max":{"1min":2837.9960000000001,"5min":2837.9960000000001,"15min":2837.9960000000001},"last":0.89100000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:04:54 2023","interfaces":[{"interface":"back","average":{"1min":151.316,"5min":30.917999999999999,"15min":10.859999999999999},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.46899999999999997},"max":{"1min":2822.598,"5min":2822.598,"15min":2822.598},"last":0.82099999999999995},{"interface":"front","average":{"1min":235.82599999999999,"5min":47.865000000000002,"15min":16.504999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.45400000000000001},"max":{"1min":2150.9899999999998,"5min":2150.9899999999998,"15min":2150.9899999999998},"last":0.69299999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509771,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660764,"kb_used_data":458836,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93711076,"statfs":{"total":96636764160,"available":95960141824,"internally_reserved":0,"allocated":469848064,"data_stored":469543023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.01,"5min":2.3849999999999998,"15min":1.1799999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":143.76300000000001,"5min":143.76300000000001,"15min":143.76300000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":2.4769999999999999,"5min":0.92200000000000004,"15min":0.71799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":39.768000000000001,"5min":39.768000000000001,"15min":39.768000000000001},"last":0.32900000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":8.2780000000000005,"5min":2.0510000000000002,"15min":1.042},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.252},"max":{"1min":149.34299999999999,"5min":149.34299999999999,"15min":149.34299999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":6.5229999999999997},"last":0.47099999999999997}]},{"osd":3,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.726000000000001,"5min":2.5840000000000001,"15min":1.2589999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26700000000000002},"max":{"1min":147.46899999999999,"5min":147.46899999999999,"15min":147.46899999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":3.6179999999999999,"5min":1.216,"15min":0.85499999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":59.305,"5min":59.305,"15min":59.305},"last":0.44}]},{"osd":4,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":20.18,"5min":4.649,"15min":2.1320000000000001},"min":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.40400000000000003},"max":{"1min":221.76900000000001,"5min":221.76900000000001,"15min":221.76900000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":63.805999999999997,"5min":13.407,"15min":5.4569999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.34300000000000003},"max":{"1min":1198.962,"5min":1198.962,"15min":1198.962},"last":0.629}]},{"osd":5,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":31.141999999999999,"5min":6.9329999999999998,"15min":2.9169999999999998},"min":{"1min":0.60199999999999998,"5min":0.56299999999999994,"15min":0.42599999999999999},"max":{"1min":574.81700000000001,"5min":574.81700000000001,"15min":574.81700000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":2.9430000000000001,"5min":1.341,"15min":1.099},"min":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.501},"max":{"1min":39.896999999999998,"5min":39.896999999999998,"15min":39.896999999999998},"last":0.79900000000000004}]},{"osd":6,"last update":"Tue Nov 28 21:05:10 2023","interfaces":[{"interface":"back","average":{"1min":63.299999999999997,"5min":13.385,"15min":5.0860000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.47099999999999997},"max":{"1min":1168.432,"5min":1168.432,"15min":1168.432},"last":0.77800000000000002},{"interface":"front","average":{"1min":2.9279999999999999,"5min":1.276,"15min":1.0389999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46000000000000002},"max":{"1min":39.863,"5min":39.863,"15min":39.863},"last":0.74199999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":12.673,"5min":3.246,"15min":1.679},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.54000000000000004},"max":{"1min":143.89599999999999,"5min":143.89599999999999,"15min":143.89599999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":63.936,"5min":13.486000000000001,"15min":5.0670000000000002},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1198.933,"5min":1198.933,"15min":1198.933},"last":0.64200000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542474,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":565548,"kb_used_data":417764,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93806292,"statfs":{"total":96636764160,"available":96057643008,"internally_reserved":0,"allocated":427790336,"data_stored":427490226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":151321034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.03300000000002,"5min":93.887,"15min":31.899999999999999},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.29699999999999999},"max":{"1min":3136.5639999999999,"5min":3136.5639999999999,"15min":3136.5639999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":271.74400000000003,"5min":55.098999999999997,"15min":18.936},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.36899999999999999},"max":{"1min":2779.4099999999999,"5min":2779.4099999999999,"15min":2779.4099999999999},"last":1.0960000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":470.35899999999998,"5min":94.754999999999995,"15min":32.216000000000001},"min":{"1min":0.55900000000000005,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":3167.6399999999999,"5min":3167.6399999999999,"15min":3167.6399999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":496.947,"5min":100.057,"15min":33.951000000000001},"min":{"1min":0.61899999999999999,"5min":0.496,"15min":0.46400000000000002},"max":{"1min":4741.7640000000001,"5min":4741.7640000000001,"15min":4741.7640000000001},"last":0.81399999999999995}]},{"osd":2,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":279.05900000000003,"5min":56.529000000000003,"15min":19.739999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.42899999999999999},"max":{"1min":2301.0599999999999,"5min":2301.0599999999999,"15min":2301.0599999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":499.01799999999997,"5min":100.639,"15min":34.240000000000002},"min":{"1min":0.82999999999999996,"5min":0.69299999999999995,"15min":0.42399999999999999},"max":{"1min":4752.8689999999997,"5min":4752.8689999999997,"15min":4752.8689999999997},"last":1.0149999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.53500000000003,"5min":94.042000000000002,"15min":32.265999999999998},"min":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.44700000000000001},"max":{"1min":3147.2719999999999,"5min":3147.2719999999999,"15min":3147.2719999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":298.06700000000001,"5min":60.340000000000003,"15min":20.724},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.44500000000000001},"max":{"1min":2301.1370000000002,"5min":2301.1370000000002,"15min":2301.1370000000002},"last":0.64300000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.91200000000000003,"15min":1.282},"min":{"1min":0.69899999999999995,"5min":0.57499999999999996,"15min":0.38900000000000001},"max":{"1min":1.056,"5min":1.266,"15min":71.313000000000002},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.1870000000000001},"min":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.40000000000000002},"max":{"1min":1.2929999999999999,"5min":1.335,"15min":34.881},"last":1.1890000000000001}]},{"osd":5,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0600000000000001,"15min":1.29},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.39700000000000002},"max":{"1min":1.895,"5min":1.895,"15min":44.558},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1339999999999999,"15min":1.1559999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.41399999999999998},"max":{"1min":1.956,"5min":1.956,"15min":3.782},"last":1.1479999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.01,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.44700000000000001},"max":{"1min":1.1879999999999999,"5min":1.47,"15min":7.6769999999999996},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.89100000000000001,"5min":0.71499999999999997,"15min":0.38100000000000001},"max":{"1min":1.645,"5min":1.645,"15min":2.7949999999999999},"last":1.232}]}]},{"osd":6,"up_from":14,"seq":60129542475,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600852,"kb_used_data":439180,"kb_used_omap":1,"kb_used_meta":161662,"kb_avail":93770988,"statfs":{"total":96636764160,"available":96021491712,"internally_reserved":0,"allocated":449720320,"data_stored":449421964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165542342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.524000000000001,"5min":19.795000000000002,"15min":7.1429999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.41299999999999998},"max":{"1min":1038.4960000000001,"5min":1038.4960000000001,"15min":1038.4960000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":95.692999999999998,"5min":19.936,"15min":7.2519999999999998},"min":{"1min":0.79500000000000004,"5min":0.52900000000000003,"15min":0.33600000000000002},"max":{"1min":1038.5619999999999,"5min":1038.5619999999999,"15min":1038.5619999999999},"last":1.0349999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":101.98699999999999,"5min":21.116,"15min":7.6189999999999998},"min":{"1min":0.60899999999999999,"5min":0.52900000000000003,"15min":0.41399999999999998},"max":{"1min":1046.3320000000001,"5min":1046.3320000000001,"15min":1046.3320000000001},"last":0.878},{"interface":"front","average":{"1min":68.814999999999998,"5min":14.573,"15min":5.4710000000000001},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.42899999999999999},"max":{"1min":1087.7460000000001,"5min":1087.7460000000001,"15min":1087.7460000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.518000000000001,"5min":19.795000000000002,"15min":7.1929999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.435},"max":{"1min":1038.309,"5min":1038.309,"15min":1038.309},"last":0.91400000000000003},{"interface":"front","average":{"1min":254.767,"5min":51.676000000000002,"15min":17.823},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.35099999999999998},"max":{"1min":2556.578,"5min":2556.578,"15min":2556.578},"last":1.1080000000000001}]},{"osd":3,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":225.25899999999999,"5min":45.744999999999997,"15min":15.845000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54300000000000004},"max":{"1min":2567.538,"5min":2567.538,"15min":2567.538},"last":0.94499999999999995},{"interface":"front","average":{"1min":176.50999999999999,"5min":36.079000000000001,"15min":12.673},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.39700000000000002},"max":{"1min":1371.7280000000001,"5min":1371.7280000000001,"15min":1371.7280000000001},"last":1.075}]},{"osd":4,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91200000000000003,"15min":1.0449999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":10.151},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.05,"15min":1.056},"min":{"1min":0.71299999999999997,"5min":0.64200000000000002,"15min":0.437},"max":{"1min":1.2689999999999999,"5min":1.5640000000000001,"15min":3.2629999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:05:02 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.071,"15min":1.101},"min":{"1min":0.76700000000000002,"5min":0.58399999999999996,"15min":0.50800000000000001},"max":{"1min":1.218,"5min":1.5449999999999999,"15min":4.5519999999999996},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0629999999999999,"15min":1.1519999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3480000000000001,"5min":1.694,"15min":2.1899999999999999},"last":0.755}]},{"osd":7,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1160000000000001,"15min":1.147},"min":{"1min":0.91600000000000004,"5min":0.77900000000000003,"15min":0.56899999999999995},"max":{"1min":1.3859999999999999,"5min":1.5149999999999999,"15min":4.6639999999999997},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.165,"15min":1.2150000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.651,"15min":3.2029999999999998},"last":0.84799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542475,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505928,"kb_used_data":335936,"kb_used_omap":1,"kb_used_meta":169982,"kb_avail":93865912,"statfs":{"total":96636764160,"available":96118693888,"internally_reserved":0,"allocated":343998464,"data_stored":343698460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":174062021},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:14 2023","interfaces":[{"interface":"back","average":{"1min":84.838999999999999,"5min":17.664000000000001,"15min":6.4409999999999998},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.27100000000000002},"max":{"1min":1605.194,"5min":1605.194,"15min":1605.194},"last":1.2110000000000001},{"interface":"front","average":{"1min":94.373000000000005,"5min":19.542000000000002,"15min":7.0590000000000002},"min":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.27100000000000002},"max":{"1min":1603.2260000000001,"5min":1603.2260000000001,"15min":1603.2260000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":84.260000000000005,"5min":17.545000000000002,"15min":6.4279999999999999},"min":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.253},"max":{"1min":1749.1869999999999,"5min":1749.1869999999999,"15min":1749.1869999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":279.99700000000001,"5min":56.835999999999999,"15min":19.574000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.442},"max":{"1min":3741.5659999999998,"5min":3741.5659999999998,"15min":3741.5659999999998},"last":1.1599999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":8.0679999999999996,"5min":2.411,"15min":1.4319999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.309},"max":{"1min":152.40199999999999,"5min":152.40199999999999,"15min":152.40199999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":279.81599999999997,"5min":56.707000000000001,"15min":19.506},"min":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.435},"max":{"1min":3741.3910000000001,"5min":3741.3910000000001,"15min":3741.3910000000001},"last":1.093}]},{"osd":3,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":327.06200000000001,"5min":66.230999999999995,"15min":22.754999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.34999999999999998},"max":{"1min":3904.835,"5min":3904.835,"15min":3904.835},"last":1.2589999999999999},{"interface":"front","average":{"1min":86.721999999999994,"5min":18.109999999999999,"15min":6.7000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.35299999999999998},"max":{"1min":1785.712,"5min":1785.712,"15min":1785.712},"last":0.96599999999999997}]},{"osd":4,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.28199999999999997},"max":{"1min":1.393,"5min":1.393,"15min":3.7930000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.103,"15min":1.0900000000000001},"min":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.29999999999999999},"max":{"1min":1.3120000000000001,"5min":1.5860000000000001,"15min":4.7320000000000002},"last":1.304}]},{"osd":6,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.1779999999999999},"min":{"1min":0.68200000000000005,"5min":0.65700000000000003,"15min":0.318},"max":{"1min":1.393,"5min":1.728,"15min":5.6600000000000001},"last":1.349},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.77300000000000002,"5min":0.64200000000000002,"15min":0.34000000000000002},"max":{"1min":1.536,"5min":1.6100000000000001,"15min":2.573},"last":1.0680000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1779999999999999,"15min":1.0700000000000001},"min":{"1min":0.69999999999999996,"5min":0.69299999999999995,"15min":0.28299999999999997},"max":{"1min":1.4730000000000001,"5min":1.633,"15min":3.9060000000000001},"last":1.395},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1519999999999999,"15min":1.206},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36899999999999999},"max":{"1min":1.4670000000000001,"5min":1.6519999999999999,"15min":4.8109999999999999},"last":1.123}]}]},{"osd":4,"up_from":14,"seq":60129542474,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616800,"kb_used_data":437080,"kb_used_omap":1,"kb_used_meta":179710,"kb_avail":93755040,"statfs":{"total":96636764160,"available":96005160960,"internally_reserved":0,"allocated":447569920,"data_stored":447273953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":184023493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":370.74799999999999,"5min":74.813999999999993,"15min":25.507999999999999},"min":{"1min":0.54100000000000004,"5min":0.42399999999999999,"15min":0.25600000000000001},"max":{"1min":4472.0990000000002,"5min":4472.0990000000002,"15min":4472.0990000000002},"last":0.625},{"interface":"front","average":{"1min":370.78800000000001,"5min":74.861000000000004,"15min":25.640000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.33000000000000002},"max":{"1min":4472.4799999999996,"5min":4472.4799999999996,"15min":4472.4799999999996},"last":0.88200000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":340.39299999999997,"5min":68.760000000000005,"15min":23.995999999999999},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.34000000000000002},"max":{"1min":2473.319,"5min":2473.319,"15min":2473.319},"last":0.73499999999999999},{"interface":"front","average":{"1min":343.56,"5min":69.445999999999998,"15min":24.108000000000001},"min":{"1min":0.64300000000000002,"5min":0.52400000000000002,"15min":0.40600000000000003},"max":{"1min":2525.277,"5min":2525.277,"15min":2525.277},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":193.78399999999999,"5min":39.509999999999998,"15min":14.141},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.38600000000000001},"max":{"1min":2323.7979999999998,"5min":2323.7979999999998,"15min":2323.7979999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":308.291,"5min":62.448,"15min":21.914000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.35599999999999998},"max":{"1min":2498.6460000000002,"5min":2498.6460000000002,"15min":2498.6460000000002},"last":1.0329999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":311.33499999999998,"5min":63.033000000000001,"15min":21.722999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38900000000000001},"max":{"1min":2516.6700000000001,"5min":2516.6700000000001,"15min":2516.6700000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":321.84899999999999,"5min":65.114000000000004,"15min":22.658000000000001},"min":{"1min":0.75700000000000001,"5min":0.53200000000000003,"15min":0.441},"max":{"1min":2478.165,"5min":2478.165,"15min":2478.165},"last":0.81200000000000006}]},{"osd":5,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":1.292},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.36399999999999999},"max":{"1min":1.1699999999999999,"5min":1.3999999999999999,"15min":19.408999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.016,"15min":1.0940000000000001},"min":{"1min":0.67400000000000004,"5min":0.502,"15min":0.35699999999999998},"max":{"1min":1.3360000000000001,"5min":1.4970000000000001,"15min":9.375},"last":1.1319999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.032,"15min":1.3540000000000001},"min":{"1min":0.67700000000000005,"5min":0.625,"15min":0.42399999999999999},"max":{"1min":1.3460000000000001,"5min":1.415,"15min":36.531999999999996},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.087,"5min":1.111,"15min":1.772},"min":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.42799999999999999},"max":{"1min":1.3440000000000001,"5min":1.4730000000000001,"15min":85.367999999999995},"last":1.081}]},{"osd":7,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.2070000000000001},"min":{"1min":0.73099999999999998,"5min":0.61099999999999999,"15min":0.42999999999999999},"max":{"1min":1.403,"5min":1.5760000000000001,"15min":9.3399999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1499999999999999,"15min":1.4330000000000001},"min":{"1min":0.85399999999999998,"5min":0.78900000000000003,"15min":0.33900000000000002},"max":{"1min":1.5509999999999999,"5min":1.577,"15min":36.591999999999999},"last":1.01}]}]},{"osd":0,"up_from":14,"seq":60129542474,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503304,"kb_used_data":345792,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":93868536,"statfs":{"total":96636764160,"available":96121380864,"internally_reserved":0,"allocated":354091008,"data_stored":353789699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":22.460000000000001,"5min":4.8289999999999997,"15min":1.97},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":297.16899999999998,"5min":297.16899999999998,"15min":297.16899999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":22.552,"5min":4.9340000000000002,"15min":1.984},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":297.202,"5min":297.202,"15min":297.202},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":20.687000000000001,"5min":4.5090000000000003,"15min":1.8580000000000001},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":335.166,"5min":335.166,"15min":335.166},"last":0.32500000000000001},{"interface":"front","average":{"1min":19.943999999999999,"5min":4.4329999999999998,"15min":1.835},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":335.19400000000002,"5min":335.19400000000002,"15min":335.19400000000002},"last":0.371}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":4.274,"5min":1.325,"15min":0.81599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.28399999999999997},"max":{"1min":53.808,"5min":53.808,"15min":53.808},"last":0.41899999999999998},{"interface":"front","average":{"1min":145.27699999999999,"5min":29.565000000000001,"15min":10.308},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35599999999999998},"max":{"1min":2839.3989999999999,"5min":2839.3989999999999,"15min":2839.3989999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":135.411,"5min":27.715,"15min":9.8290000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2822.2359999999999,"5min":2822.2359999999999,"15min":2822.2359999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":135.35900000000001,"5min":27.701000000000001,"15min":9.7970000000000006},"min":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.496},"max":{"1min":2822.212,"5min":2822.212,"15min":2822.212},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":96.162000000000006,"5min":19.890999999999998,"15min":7.1820000000000004},"min":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.47099999999999997},"max":{"1min":1936.5550000000001,"5min":1936.5550000000001,"15min":1936.5550000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":122.643,"5min":25.228999999999999,"15min":8.9879999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.50700000000000001},"max":{"1min":1999.019,"5min":1999.019,"15min":1999.019},"last":0.73099999999999998}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":142.648,"5min":29.18,"15min":10.353999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48199999999999998},"max":{"1min":2832.431,"5min":2832.431,"15min":2832.431},"last":0.52700000000000002},{"interface":"front","average":{"1min":142.119,"5min":29.050999999999998,"15min":10.282999999999999},"min":{"1min":0.56299999999999994,"5min":0.48599999999999999,"15min":0.44700000000000001},"max":{"1min":2822.1840000000002,"5min":2822.1840000000002,"15min":2822.1840000000002},"last":0.754}]},{"osd":7,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":146.452,"5min":30.036999999999999,"15min":10.622},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.53300000000000003},"max":{"1min":1999.058,"5min":1999.058,"15min":1999.058},"last":1.0649999999999999},{"interface":"front","average":{"1min":225.40299999999999,"5min":45.713999999999999,"15min":15.869999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2822.143,"5min":2822.143,"15min":2822.143},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":170106880,"data_stored":170090025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":171458560,"data_stored":171434421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85495808,"data_stored":85471932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":183201792,"data_stored":183178341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":187912192,"data_stored":187897127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171967842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":182108160,"data_stored":182090706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209731584,"data_stored":209715928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":182788096,"data_stored":182788096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":297787392,"data_stored":297787392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":197746688,"data_stored":197746688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":288649216,"data_stored":288649216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259055616,"data_stored":259055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171409408,"data_stored":171409408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":267010048,"data_stored":267010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":216862720,"data_stored":216862720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:05:25.216 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:05:25.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.357+0000 7f569e53e640 1 Processor -- start 2023-11-28T21:05:25.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.357+0000 7f569e53e640 1 -- start start 2023-11-28T21:05:25.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5698151f60 0x7f56980c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f569806a580 0x7f569806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56980c6120 con 0x7f56980c5c90 2023-11-28T21:05:25.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569806aed0 con 0x7f569806a580 2023-11-28T21:05:25.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56980c4da0 con 0x7f5698151f60 2023-11-28T21:05:25.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569cadb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f569806a580 0x7f569806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f56977fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f56980c5c90 0x7f56980c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50938/0 (socket says 172.21.15.167:50938) 2023-11-28T21:05:25.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569cadb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f569806a580 0x7f569806a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56818/0 (socket says 172.21.15.167:56818) 2023-11-28T21:05:25.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f56977fe640 1 -- 172.21.15.167:0/3585836363 learned_addr learned my addr 172.21.15.167:0/3585836363 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:25.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f5697fff640 1 --2- 172.21.15.167:0/3585836363 >> v2:172.21.15.178:3300/0 conn(0x7f5698151f60 0x7f56980c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569cadb640 1 -- 172.21.15.167:0/3585836363 >> v2:172.21.15.178:3300/0 conn(0x7f5698151f60 msgr2=0x7f56980c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:25.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569cadb640 1 --2- 172.21.15.167:0/3585836363 >> v2:172.21.15.178:3300/0 conn(0x7f5698151f60 0x7f56980c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569cadb640 1 -- 172.21.15.167:0/3585836363 >> v1:172.21.15.167:6789/0 conn(0x7f56980c5c90 legacy=0x7f56980c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569cadb640 1 -- 172.21.15.167:0/3585836363 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569815b220 con 0x7f569806a580 2023-11-28T21:05:25.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f5697fff640 1 --2- 172.21.15.167:0/3585836363 >> v2:172.21.15.178:3300/0 conn(0x7f5698151f60 0x7f56980c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:25.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569cadb640 1 --2- 172.21.15.167:0/3585836363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f569806a580 0x7f569806a990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f56980c62c0 tx=0x7f569001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8806b7dcc209524f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:25.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f5696ffd640 1 -- 172.21.15.167:0/3585836363 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900a5740 con 0x7f569806a580 2023-11-28T21:05:25.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f5696ffd640 1 -- 172.21.15.167:0/3585836363 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56900a58a0 con 0x7f569806a580 2023-11-28T21:05:25.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f5696ffd640 1 -- 172.21.15.167:0/3585836363 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900a5c30 con 0x7f569806a580 2023-11-28T21:05:25.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 -- 172.21.15.167:0/3585836363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f569806a580 msgr2=0x7f569806a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 --2- 172.21.15.167:0/3585836363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f569806a580 0x7f569806a990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f56980c62c0 tx=0x7f569001c880 comp rx=0 tx=0).stop 2023-11-28T21:05:25.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 -- 172.21.15.167:0/3585836363 shutdown_connections 2023-11-28T21:05:25.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 --2- 172.21.15.167:0/3585836363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f569806a580 0x7f569806a990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 --2- 172.21.15.167:0/3585836363 >> v2:172.21.15.178:3300/0 conn(0x7f5698151f60 0x7f56980c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 -- 172.21.15.167:0/3585836363 >> 172.21.15.167:0/3585836363 conn(0x7f56980cb1e0 msgr2=0x7f56980cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:25.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 -- 172.21.15.167:0/3585836363 shutdown_connections 2023-11-28T21:05:25.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.361+0000 7f569e53e640 1 -- 172.21.15.167:0/3585836363 wait complete. 2023-11-28T21:05:25.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 Processor -- start 2023-11-28T21:05:25.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 -- start start 2023-11-28T21:05:25.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569806a580 0x7f56981f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56980c5c90 0x7f56981f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5698151f60 0x7f56981561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698156fd0 con 0x7f56980c5c90 2023-11-28T21:05:25.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56981f3c00 con 0x7f569806a580 2023-11-28T21:05:25.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569815a280 con 0x7f5698151f60 2023-11-28T21:05:25.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f56977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56980c5c90 0x7f56981f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f56977fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56980c5c90 0x7f56981f4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56832/0 (socket says 172.21.15.167:56832) 2023-11-28T21:05:25.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f56977fe640 1 -- 172.21.15.167:0/244907357 learned_addr learned my addr 172.21.15.167:0/244907357 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:25.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f5697fff640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569806a580 0x7f56981f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569cadb640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5698151f60 0x7f56981561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f56977fe640 1 -- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5698151f60 msgr2=0x7f56981561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f56977fe640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5698151f60 0x7f56981561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f56977fe640 1 -- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569806a580 msgr2=0x7f56981f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f56977fe640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569806a580 0x7f56981f0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f56977fe640 1 -- 172.21.15.167:0/244907357 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009a70 con 0x7f56980c5c90 2023-11-28T21:05:25.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569cadb640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5698151f60 0x7f56981561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:25.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f56977fe640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56980c5c90 0x7f56981f4090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c500 tx=0x7f568c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:25.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f5694ff9640 1 -- 172.21.15.167:0/244907357 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c005cf0 con 0x7f56980c5c90 2023-11-28T21:05:25.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f5694ff9640 1 -- 172.21.15.167:0/244907357 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c005e50 con 0x7f56980c5c90 2023-11-28T21:05:25.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569815a6d0 con 0x7f56980c5c90 2023-11-28T21:05:25.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f5694ff9640 1 -- 172.21.15.167:0/244907357 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c0072f0 con 0x7f56980c5c90 2023-11-28T21:05:25.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.365+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569815ab30 con 0x7f56980c5c90 2023-11-28T21:05:25.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.369+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56980682c0 con 0x7f56980c5c90 2023-11-28T21:05:25.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.369+0000 7f5694ff9640 1 -- 172.21.15.167:0/244907357 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f568c007450 con 0x7f56980c5c90 2023-11-28T21:05:25.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.369+0000 7f5694ff9640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5684066470 0x7f5684068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:25.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.369+0000 7f5694ff9640 1 -- 172.21.15.167:0/244907357 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f568c0834f0 con 0x7f56980c5c90 2023-11-28T21:05:25.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.369+0000 7f5697fff640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5684066470 0x7f5684068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:25.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.369+0000 7f5697fff640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5684066470 0x7f5684068930 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f568800a9a0 tx=0x7f5688008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:25.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.373+0000 7f5694ff9640 1 -- 172.21.15.167:0/244907357 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f568c0506c0 con 0x7f56980c5c90 2023-11-28T21:05:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.517+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56980c6120 con 0x7f56980c5c90 2023-11-28T21:05:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.517+0000 7f5694ff9640 1 -- 172.21.15.167:0/244907357 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+18899 (secure 0 0 0) 0x7f56980c6120 con 0x7f56980c5c90 2023-11-28T21:05:25.522 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:05:25.522 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":51,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T20:44:44.525039+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":504,"length":2}]},{"pool":4,"snaps":[{"begin":504,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:05:25.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5684066470 msgr2=0x7f5684068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5684066470 0x7f5684068930 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f568800a9a0 tx=0x7f5688008040 comp rx=0 tx=0).stop 2023-11-28T21:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56980c5c90 msgr2=0x7f56981f4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56980c5c90 0x7f56981f4090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c500 tx=0x7f568c00c9c0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 shutdown_connections 2023-11-28T21:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f5684066470 0x7f5684068930 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5698151f60 0x7f56981561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56980c5c90 0x7f56981f4090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 --2- 172.21.15.167:0/244907357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f569806a580 0x7f56981f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:25.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 >> 172.21.15.167:0/244907357 conn(0x7f56980cb1e0 msgr2=0x7f56980cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:25.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 shutdown_connections 2023-11-28T21:05:25.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:25.521+0000 7f569e53e640 1 -- 172.21.15.167:0/244907357 wait complete. 2023-11-28T21:05:26.539 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T21:05:26.540 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T21:05:26.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.661+0000 7fc249baa640 1 Processor -- start 2023-11-28T21:05:26.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.661+0000 7fc249baa640 1 -- start start 2023-11-28T21:05:26.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc24415d1a0 0x7fc24415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2440c6460 0x7fc2440715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc244159bb0 con 0x7fc244153c80 2023-11-28T21:05:26.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24415a150 con 0x7fc24415d1a0 2023-11-28T21:05:26.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc244154060 con 0x7fc2440c6460 2023-11-28T21:05:26.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc242ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc24415d1a0 0x7fc24415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc2437fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc244153c80 0x7fc2440c86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50948/0 (socket says 172.21.15.167:50948) 2023-11-28T21:05:26.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc2437fe640 1 -- 172.21.15.167:0/3793478063 learned_addr learned my addr 172.21.15.167:0/3793478063 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:26.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc242ffd640 1 -- 172.21.15.167:0/3793478063 >> v2:172.21.15.178:3300/0 conn(0x7fc2440c6460 msgr2=0x7fc2440715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:26.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc243fff640 1 --2- 172.21.15.167:0/3793478063 >> v2:172.21.15.178:3300/0 conn(0x7fc2440c6460 0x7fc2440715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc242ffd640 1 --2- 172.21.15.167:0/3793478063 >> v2:172.21.15.178:3300/0 conn(0x7fc2440c6460 0x7fc2440715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc242ffd640 1 -- 172.21.15.167:0/3793478063 >> v1:172.21.15.167:6789/0 conn(0x7fc244153c80 legacy=0x7fc2440c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc242ffd640 1 -- 172.21.15.167:0/3793478063 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24415ab20 con 0x7fc24415d1a0 2023-11-28T21:05:26.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc2427fc640 1 -- 172.21.15.167:0/3793478063 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511727389 0 0) 0x7fc244159bb0 con 0x7fc244153c80 2023-11-28T21:05:26.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc242ffd640 1 --2- 172.21.15.167:0/3793478063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc24415d1a0 0x7fc24415a5e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc2440ca1b0 tx=0x7fc23401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a745f16f252639 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:26.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc2427fc640 1 -- 172.21.15.167:0/3793478063 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340a8950 con 0x7fc24415d1a0 2023-11-28T21:05:26.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc2427fc640 1 -- 172.21.15.167:0/3793478063 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2340a8ab0 con 0x7fc24415d1a0 2023-11-28T21:05:26.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc2427fc640 1 -- 172.21.15.167:0/3793478063 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340a8e40 con 0x7fc24415d1a0 2023-11-28T21:05:26.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 -- 172.21.15.167:0/3793478063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc24415d1a0 msgr2=0x7fc24415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 --2- 172.21.15.167:0/3793478063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc24415d1a0 0x7fc24415a5e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc2440ca1b0 tx=0x7fc23401ec50 comp rx=0 tx=0).stop 2023-11-28T21:05:26.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 -- 172.21.15.167:0/3793478063 shutdown_connections 2023-11-28T21:05:26.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 --2- 172.21.15.167:0/3793478063 >> v2:172.21.15.178:3300/0 conn(0x7fc2440c6460 0x7fc2440715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 --2- 172.21.15.167:0/3793478063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc24415d1a0 0x7fc24415a5e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 -- 172.21.15.167:0/3793478063 >> 172.21.15.167:0/3793478063 conn(0x7fc2440c8e00 msgr2=0x7fc2440c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:26.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 -- 172.21.15.167:0/3793478063 shutdown_connections 2023-11-28T21:05:26.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.665+0000 7fc249baa640 1 -- 172.21.15.167:0/3793478063 wait complete. 2023-11-28T21:05:26.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 Processor -- start 2023-11-28T21:05:26.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 -- start start 2023-11-28T21:05:26.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2440c6460 0x7fc2441e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc244153c80 0x7fc24415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc24415d1a0 0x7fc2441e3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24415ad70 con 0x7fc2440c6460 2023-11-28T21:05:26.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24415cab0 con 0x7fc244153c80 2023-11-28T21:05:26.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24415cd10 con 0x7fc24415d1a0 2023-11-28T21:05:26.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc2437fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2440c6460 0x7fc2441e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc2437fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2440c6460 0x7fc2441e4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56846/0 (socket says 172.21.15.167:56846) 2023-11-28T21:05:26.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc2437fe640 1 -- 172.21.15.167:0/2073699742 learned_addr learned my addr 172.21.15.167:0/2073699742 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:26.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc242ffd640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc244153c80 0x7fc24415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc243fff640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc24415d1a0 0x7fc2441e3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc2437fe640 1 -- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc24415d1a0 msgr2=0x7fc2441e3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc2437fe640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc24415d1a0 0x7fc2441e3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc2437fe640 1 -- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc244153c80 msgr2=0x7fc24415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc2437fe640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc244153c80 0x7fc24415b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc2437fe640 1 -- 172.21.15.167:0/2073699742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234009420 con 0x7fc2440c6460 2023-11-28T21:05:26.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc243fff640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc24415d1a0 0x7fc2441e3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:26.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc2437fe640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2440c6460 0x7fc2441e4a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0011f0 tx=0x7fc22c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:26.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc23bfff640 1 -- 172.21.15.167:0/2073699742 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0074e0 con 0x7fc2440c6460 2023-11-28T21:05:26.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc23bfff640 1 -- 172.21.15.167:0/2073699742 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c007640 con 0x7fc2440c6460 2023-11-28T21:05:26.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24415af80 con 0x7fc2440c6460 2023-11-28T21:05:26.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc23bfff640 1 -- 172.21.15.167:0/2073699742 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c004a10 con 0x7fc2440c6460 2023-11-28T21:05:26.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2441e4fa0 con 0x7fc2440c6460 2023-11-28T21:05:26.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.669+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2440c7510 con 0x7fc2440c6460 2023-11-28T21:05:26.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc23bfff640 1 -- 172.21.15.167:0/2073699742 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc22c01b360 con 0x7fc2440c6460 2023-11-28T21:05:26.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc23bfff640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc224066470 0x7fc224068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc23bfff640 1 -- 172.21.15.167:0/2073699742 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc22c083c50 con 0x7fc2440c6460 2023-11-28T21:05:26.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc23bfff640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7fc22406fe50 0x7fc2240722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc23bfff640 1 -- 172.21.15.167:0/2073699742 --> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2240729c0 con 0x7fc22406fe50 2023-11-28T21:05:26.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc23bfff640 1 -- 172.21.15.167:0/2073699742 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc22c0840a0 con 0x7fc2440c6460 2023-11-28T21:05:26.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc243fff640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7fc22406fe50 0x7fc2240722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc242ffd640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc224066470 0x7fc224068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc243fff640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7fc22406fe50 0x7fc2240722f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:26.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc242ffd640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc224066470 0x7fc224068930 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc2340b2000 tx=0x7fc234008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:26.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.673+0000 7fc23bfff640 1 -- 172.21.15.167:0/2073699742 <== osd.0 v2:172.21.15.167:6800/1022160227 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc2240729c0 con 0x7fc22406fe50 2023-11-28T21:05:26.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 --> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc2440c7230 con 0x7fc22406fe50 2023-11-28T21:05:26.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc23bfff640 1 -- 172.21.15.167:0/2073699742 <== osd.0 v2:172.21.15.167:6800/1022160227 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc23c00e3f0 con 0x7fc22406fe50 2023-11-28T21:05:26.688 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:26.688 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T21:05:26.688 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:26.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7fc22406fe50 msgr2=0x7fc2240722f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.167:6800/1022160227,v1:172.21.15.167:6801/1022160227] conn(0x7fc22406fe50 0x7fc2240722f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc224066470 msgr2=0x7fc224068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc224066470 0x7fc224068930 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc2340b2000 tx=0x7fc234008040 comp rx=0 tx=0).stop 2023-11-28T21:05:26.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2440c6460 msgr2=0x7fc2441e4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 --2- 172.21.15.167:0/2073699742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2440c6460 0x7fc2441e4a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0011f0 tx=0x7fc22c00c9b0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc243fff640 1 -- 172.21.15.167:0/2073699742 reap_dead start 2023-11-28T21:05:26.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 shutdown_connections 2023-11-28T21:05:26.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 >> 172.21.15.167:0/2073699742 conn(0x7fc2440c8e00 msgr2=0x7fc2440c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:26.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 shutdown_connections 2023-11-28T21:05:26.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.685+0000 7fc249baa640 1 -- 172.21.15.167:0/2073699742 wait complete. 2023-11-28T21:05:26.704 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T21:05:26.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.809+0000 7f64a9580640 1 Processor -- start 2023-11-28T21:05:26.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.809+0000 7f64a9580640 1 -- start start 2023-11-28T21:05:26.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a9580640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 0x7f64a40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a9580640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64a40cfc40 0x7f64a40ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a9580640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f64a4153ae0 0x7f64a4153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a9580640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a4154470 con 0x7f64a40cfc40 2023-11-28T21:05:26.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a9580640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a415ac00 con 0x7f64a4153ae0 2023-11-28T21:05:26.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a9580640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40cbd60 con 0x7f64a40cf860 2023-11-28T21:05:26.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64a40cfc40 0x7f64a40ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64a40cfc40 0x7f64a40ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56850/0 (socket says 172.21.15.167:56850) 2023-11-28T21:05:26.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a27fc640 1 -- 172.21.15.167:0/565943684 learned_addr learned my addr 172.21.15.167:0/565943684 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:26.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a37fe640 1 --2- 172.21.15.167:0/565943684 >> v2:172.21.15.178:3300/0 conn(0x7f64a4153ae0 0x7f64a4153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a2ffd640 1 --2- 172.21.15.167:0/565943684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 0x7f64a40cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a27fc640 1 -- 172.21.15.167:0/565943684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 msgr2=0x7f64a40cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:26.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a27fc640 1 --2- 172.21.15.167:0/565943684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 0x7f64a40cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a27fc640 1 -- 172.21.15.167:0/565943684 >> v2:172.21.15.178:3300/0 conn(0x7f64a4153ae0 msgr2=0x7f64a4153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:26.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a27fc640 1 --2- 172.21.15.167:0/565943684 >> v2:172.21.15.178:3300/0 conn(0x7f64a4153ae0 0x7f64a4153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a27fc640 1 -- 172.21.15.167:0/565943684 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4159ff0 con 0x7f64a40cfc40 2023-11-28T21:05:26.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a2ffd640 1 --2- 172.21.15.167:0/565943684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 0x7f64a40cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:26.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a37fe640 1 --2- 172.21.15.167:0/565943684 >> v2:172.21.15.178:3300/0 conn(0x7f64a4153ae0 0x7f64a4153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:26.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a27fc640 1 --2- 172.21.15.167:0/565943684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 0x7f64a40ca510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f64a40c9c50 tx=0x7f649801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec5b3222fd2ee4a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:26.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a1ffb640 1 -- 172.21.15.167:0/565943684 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64980aa5f0 con 0x7f64a40cfc40 2023-11-28T21:05:26.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a1ffb640 1 -- 172.21.15.167:0/565943684 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64980aa750 con 0x7f64a40cfc40 2023-11-28T21:05:26.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.813+0000 7f64a1ffb640 1 -- 172.21.15.167:0/565943684 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64980aaae0 con 0x7f64a40cfc40 2023-11-28T21:05:26.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- 172.21.15.167:0/565943684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 msgr2=0x7f64a40ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 --2- 172.21.15.167:0/565943684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 0x7f64a40ca510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f64a40c9c50 tx=0x7f649801c4d0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- 172.21.15.167:0/565943684 shutdown_connections 2023-11-28T21:05:26.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 --2- 172.21.15.167:0/565943684 >> v2:172.21.15.178:3300/0 conn(0x7f64a4153ae0 0x7f64a4153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 --2- 172.21.15.167:0/565943684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 0x7f64a40ca510 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 --2- 172.21.15.167:0/565943684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 0x7f64a40cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- 172.21.15.167:0/565943684 >> 172.21.15.167:0/565943684 conn(0x7f64a406c1f0 msgr2=0x7f64a4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:26.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- 172.21.15.167:0/565943684 shutdown_connections 2023-11-28T21:05:26.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- 172.21.15.167:0/565943684 wait complete. 2023-11-28T21:05:26.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 Processor -- start 2023-11-28T21:05:26.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- start start 2023-11-28T21:05:26.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 0x7f64a415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 0x7f64a41491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64a4153ae0 0x7f64a415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40ce4a0 con 0x7f64a40cfc40 2023-11-28T21:05:26.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40cef90 con 0x7f64a4153ae0 2023-11-28T21:05:26.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40b5570 con 0x7f64a40cf860 2023-11-28T21:05:26.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 0x7f64a41491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 0x7f64a41491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56858/0 (socket says 172.21.15.167:56858) 2023-11-28T21:05:26.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a27fc640 1 -- 172.21.15.167:0/841189721 learned_addr learned my addr 172.21.15.167:0/841189721 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:26.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a2ffd640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 0x7f64a415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a37fe640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64a4153ae0 0x7f64a415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a27fc640 1 -- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 msgr2=0x7f64a415c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a27fc640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 0x7f64a415c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a27fc640 1 -- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64a4153ae0 msgr2=0x7f64a415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a27fc640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64a4153ae0 0x7f64a415b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a27fc640 1 -- 172.21.15.167:0/841189721 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980094d0 con 0x7f64a40cfc40 2023-11-28T21:05:26.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a37fe640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64a4153ae0 0x7f64a415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:26.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a27fc640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 0x7f64a41491e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f64980ac040 tx=0x7f649801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:26.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f648b7fe640 1 -- 172.21.15.167:0/841189721 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64980bd3f0 con 0x7f64a40cfc40 2023-11-28T21:05:26.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f648b7fe640 1 -- 172.21.15.167:0/841189721 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64980bd550 con 0x7f64a40cfc40 2023-11-28T21:05:26.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a40ce6f0 con 0x7f64a40cfc40 2023-11-28T21:05:26.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f648b7fe640 1 -- 172.21.15.167:0/841189721 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64980bd900 con 0x7f64a40cfc40 2023-11-28T21:05:26.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.817+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a40cecb0 con 0x7f64a40cfc40 2023-11-28T21:05:26.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.821+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a40cc000 con 0x7f64a40cfc40 2023-11-28T21:05:26.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.821+0000 7f648b7fe640 1 -- 172.21.15.167:0/841189721 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64980c6440 con 0x7f64a40cfc40 2023-11-28T21:05:26.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.821+0000 7f648b7fe640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6490066470 0x7f6490068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:26.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.821+0000 7f648b7fe640 1 -- 172.21.15.167:0/841189721 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f64980a7070 con 0x7f64a40cfc40 2023-11-28T21:05:26.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.821+0000 7f64a2ffd640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6490066470 0x7f6490068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:26.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.821+0000 7f64a2ffd640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6490066470 0x7f6490068930 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f649400b820 tx=0x7f6494008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:26.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.825+0000 7f648b7fe640 1 -- 172.21.15.167:0/841189721 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64980ebc00 con 0x7f64a40cfc40 2023-11-28T21:05:26.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f64a40caa50 con 0x7f6490066470 2023-11-28T21:05:26.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f648b7fe640 1 -- 172.21.15.167:0/841189721 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f649400c040 con 0x7f6490066470 2023-11-28T21:05:26.974 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T21:05:26.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6490066470 msgr2=0x7f6490068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6490066470 0x7f6490068930 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f649400b820 tx=0x7f6494008040 comp rx=0 tx=0).stop 2023-11-28T21:05:26.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 msgr2=0x7f64a41491e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:26.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 0x7f64a41491e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f64980ac040 tx=0x7f649801ad10 comp rx=0 tx=0).stop 2023-11-28T21:05:26.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 shutdown_connections 2023-11-28T21:05:26.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6490066470 0x7f6490068930 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64a4153ae0 0x7f64a415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64a40cfc40 0x7f64a41491e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 --2- 172.21.15.167:0/841189721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64a40cf860 0x7f64a415c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:26.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 >> 172.21.15.167:0/841189721 conn(0x7f64a406c1f0 msgr2=0x7f64a40b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:26.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 shutdown_connections 2023-11-28T21:05:26.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:26.973+0000 7f64a9580640 1 -- 172.21.15.167:0/841189721 wait complete. 2023-11-28T21:05:26.993 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T21:05:26.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T21:05:27.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb66417640 1 Processor -- start 2023-11-28T21:05:27.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb66417640 1 -- start start 2023-11-28T21:05:27.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb66417640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feb600cf860 0x7feb600cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb66417640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6015ac00 con 0x7feb600cfc40 2023-11-28T21:05:27.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb66417640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb600cbd60 con 0x7feb60153ae0 2023-11-28T21:05:27.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb66417640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb60159ff0 con 0x7feb600cf860 2023-11-28T21:05:27.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7feb600cfc40 0x7feb600ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50958/0 (socket says 172.21.15.167:50958) 2023-11-28T21:05:27.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5f7fe640 1 -- 172.21.15.167:0/718356852 learned_addr learned my addr 172.21.15.167:0/718356852 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:27.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121172456 0 0) 0x7feb6015ac00 con 0x7feb600cfc40 2023-11-28T21:05:27.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5ffff640 1 --2- 172.21.15.167:0/718356852 >> v2:172.21.15.178:3300/0 conn(0x7feb600cf860 0x7feb600cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb48003530 con 0x7feb600cfc40 2023-11-28T21:05:27.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 921046546 0 0) 0x7feb48003530 con 0x7feb600cfc40 2023-11-28T21:05:27.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 >> v2:172.21.15.178:3300/0 conn(0x7feb600cf860 msgr2=0x7feb600cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 --2- 172.21.15.167:0/718356852 >> v2:172.21.15.178:3300/0 conn(0x7feb600cf860 0x7feb600cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 >> v1:172.21.15.178:6789/0 conn(0x7feb60153ae0 legacy=0x7feb6015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6015a2d0 con 0x7feb600cfc40 2023-11-28T21:05:27.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7feb54001680 con 0x7feb600cfc40 2023-11-28T21:05:27.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 >> v1:172.21.15.167:6789/0 conn(0x7feb600cfc40 legacy=0x7feb600ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb48003980 0x7feb48003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480047d0 0x7feb48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb48005190 0x7feb4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb60159ff0 con 0x7feb48005190 2023-11-28T21:05:27.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4800c0c0 con 0x7feb480047d0 2023-11-28T21:05:27.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4800c280 con 0x7feb48003980 2023-11-28T21:05:27.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb649b4640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb48005190 0x7feb4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5f7fe640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480047d0 0x7feb48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5ffff640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb48003980 0x7feb48003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb649b4640 1 -- 172.21.15.167:0/718356852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb48003980 msgr2=0x7feb48003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb649b4640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb48003980 0x7feb48003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb649b4640 1 -- 172.21.15.167:0/718356852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480047d0 msgr2=0x7feb48004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb649b4640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480047d0 0x7feb48004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb649b4640 1 -- 172.21.15.167:0/718356852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48003530 con 0x7feb48005190 2023-11-28T21:05:27.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.105+0000 7feb5f7fe640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480047d0 0x7feb48004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:05:27.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb649b4640 1 -- 172.21.15.167:0/718356852 reap_dead start 2023-11-28T21:05:27.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb649b4640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb48005190 0x7feb4800b990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb58007fd0 tx=0x7feb5801c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea06c2c31bcdb17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580a9660 con 0x7feb48005190 2023-11-28T21:05:27.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb580a97c0 con 0x7feb48005190 2023-11-28T21:05:27.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb5effd640 1 -- 172.21.15.167:0/718356852 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580a9b70 con 0x7feb48005190 2023-11-28T21:05:27.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 -- 172.21.15.167:0/718356852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb48005190 msgr2=0x7feb4800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb48005190 0x7feb4800b990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb58007fd0 tx=0x7feb5801c660 comp rx=0 tx=0).stop 2023-11-28T21:05:27.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 -- 172.21.15.167:0/718356852 shutdown_connections 2023-11-28T21:05:27.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 --2- 172.21.15.167:0/718356852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb48005190 0x7feb4800b990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 -- 172.21.15.167:0/718356852 >> 172.21.15.167:0/718356852 conn(0x7feb6006c1f0 msgr2=0x7feb60071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:27.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 -- 172.21.15.167:0/718356852 shutdown_connections 2023-11-28T21:05:27.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 -- 172.21.15.167:0/718356852 wait complete. 2023-11-28T21:05:27.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 Processor -- start 2023-11-28T21:05:27.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 -- start start 2023-11-28T21:05:27.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb48005190 0x7feb600b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb601571a0 0x7feb6015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb601557b0 0x7feb60155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb601f06f0 con 0x7feb601557b0 2023-11-28T21:05:27.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb601561a0 con 0x7feb48005190 2023-11-28T21:05:27.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.109+0000 7feb66417640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb600cbb00 con 0x7feb601571a0 2023-11-28T21:05:27.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb649b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb601557b0 0x7feb60155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb649b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb601557b0 0x7feb60155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56878/0 (socket says 172.21.15.167:56878) 2023-11-28T21:05:27.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb649b4640 1 -- 172.21.15.167:0/1730918862 learned_addr learned my addr 172.21.15.167:0/1730918862 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:27.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5ffff640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb48005190 0x7feb600b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5f7fe640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb601571a0 0x7feb6015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb649b4640 1 -- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb601571a0 msgr2=0x7feb6015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb649b4640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb601571a0 0x7feb6015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb649b4640 1 -- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb48005190 msgr2=0x7feb600b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb649b4640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb48005190 0x7feb600b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb649b4640 1 -- 172.21.15.167:0/1730918862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb601ef800 con 0x7feb601557b0 2023-11-28T21:05:27.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb649b4640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb601557b0 0x7feb60155c60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb58007fd0 tx=0x7feb48005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5cff9640 1 -- 172.21.15.167:0/1730918862 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580b2870 con 0x7feb601557b0 2023-11-28T21:05:27.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5cff9640 1 -- 172.21.15.167:0/1730918862 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb580b29d0 con 0x7feb601557b0 2023-11-28T21:05:27.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb601efae0 con 0x7feb601557b0 2023-11-28T21:05:27.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5cff9640 1 -- 172.21.15.167:0/1730918862 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580b2d80 con 0x7feb601557b0 2023-11-28T21:05:27.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb601f00a0 con 0x7feb601557b0 2023-11-28T21:05:27.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb6015a890 con 0x7feb601557b0 2023-11-28T21:05:27.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5cff9640 1 -- 172.21.15.167:0/1730918862 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb580bd460 con 0x7feb601557b0 2023-11-28T21:05:27.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5cff9640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb4c0664a0 0x7feb4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5cff9640 1 -- 172.21.15.167:0/1730918862 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7feb5811e7f0 con 0x7feb601557b0 2023-11-28T21:05:27.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5cff9640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7feb4c06fe80 0x7feb4c072320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5cff9640 1 -- 172.21.15.167:0/1730918862 --> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb4c0729f0 con 0x7feb4c06fe80 2023-11-28T21:05:27.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5cff9640 1 -- 172.21.15.167:0/1730918862 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb58120e50 con 0x7feb601557b0 2023-11-28T21:05:27.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5ffff640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb4c0664a0 0x7feb4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5f7fe640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7feb4c06fe80 0x7feb4c072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5f7fe640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7feb4c06fe80 0x7feb4c072320 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.113+0000 7feb5ffff640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb4c0664a0 0x7feb4c068960 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7feb5000f930 tx=0x7feb50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.117+0000 7feb5cff9640 1 -- 172.21.15.167:0/1730918862 <== osd.1 v2:172.21.15.167:6808/3381685754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feb4c0729f0 con 0x7feb4c06fe80 2023-11-28T21:05:27.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 --> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feb600cb770 con 0x7feb4c06fe80 2023-11-28T21:05:27.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb5cff9640 1 -- 172.21.15.167:0/1730918862 <== osd.1 v2:172.21.15.167:6808/3381685754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feb54005b10 con 0x7feb4c06fe80 2023-11-28T21:05:27.130 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:27.130 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T21:05:27.130 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:27.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7feb4c06fe80 msgr2=0x7feb4c072320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.167:6808/3381685754,v1:172.21.15.167:6809/3381685754] conn(0x7feb4c06fe80 0x7feb4c072320 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb4c0664a0 msgr2=0x7feb4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7feb4c0664a0 0x7feb4c068960 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7feb5000f930 tx=0x7feb50008040 comp rx=0 tx=0).stop 2023-11-28T21:05:27.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb601557b0 msgr2=0x7feb60155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 --2- 172.21.15.167:0/1730918862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb601557b0 0x7feb60155c60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb58007fd0 tx=0x7feb48005800 comp rx=0 tx=0).stop 2023-11-28T21:05:27.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb649b4640 1 -- 172.21.15.167:0/1730918862 reap_dead start 2023-11-28T21:05:27.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 shutdown_connections 2023-11-28T21:05:27.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 >> 172.21.15.167:0/1730918862 conn(0x7feb6006c1f0 msgr2=0x7feb600662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:27.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 shutdown_connections 2023-11-28T21:05:27.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.129+0000 7feb66417640 1 -- 172.21.15.167:0/1730918862 wait complete. 2023-11-28T21:05:27.146 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T21:05:27.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa8072fd640 1 Processor -- start 2023-11-28T21:05:27.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa8072fd640 1 -- start start 2023-11-28T21:05:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa8072fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa8000b0110 0x7fa80015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa8072fd640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa8000c8010 0x7fa800066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa8072fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80006a8d0 con 0x7fa80006d530 2023-11-28T21:05:27.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa8072fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000ca230 con 0x7fa8000b0110 2023-11-28T21:05:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa8072fd640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000c8990 con 0x7fa8000c8010 2023-11-28T21:05:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa805099640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa8000b0110 0x7fa80015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa80589a640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa80006d530 0x7fa80006b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50964/0 (socket says 172.21.15.167:50964) 2023-11-28T21:05:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa80589a640 1 -- 172.21.15.167:0/2453816093 learned_addr learned my addr 172.21.15.167:0/2453816093 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa804898640 1 --2- 172.21.15.167:0/2453816093 >> v2:172.21.15.178:3300/0 conn(0x7fa8000c8010 0x7fa800066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa805099640 1 -- 172.21.15.167:0/2453816093 >> v2:172.21.15.178:3300/0 conn(0x7fa8000c8010 msgr2=0x7fa800066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa805099640 1 --2- 172.21.15.167:0/2453816093 >> v2:172.21.15.178:3300/0 conn(0x7fa8000c8010 0x7fa800066730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa805099640 1 -- 172.21.15.167:0/2453816093 >> v1:172.21.15.167:6789/0 conn(0x7fa80006d530 legacy=0x7fa80006b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa7f7fff640 1 -- 172.21.15.167:0/2453816093 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171984674 0 0) 0x7fa80006a8d0 con 0x7fa80006d530 2023-11-28T21:05:27.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.253+0000 7fa805099640 1 -- 172.21.15.167:0/2453816093 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000ca480 con 0x7fa8000b0110 2023-11-28T21:05:27.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa805099640 1 --2- 172.21.15.167:0/2453816093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b0110 0x7fa80015d3b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa800066f30 tx=0x7fa7fc01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea697a613c20c59f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa7f7fff640 1 -- 172.21.15.167:0/2453816093 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc0a8950 con 0x7fa8000b0110 2023-11-28T21:05:27.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa7f7fff640 1 -- 172.21.15.167:0/2453816093 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc0a8ab0 con 0x7fa8000b0110 2023-11-28T21:05:27.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa7f7fff640 1 -- 172.21.15.167:0/2453816093 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc0a8e40 con 0x7fa8000b0110 2023-11-28T21:05:27.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa8072fd640 1 -- 172.21.15.167:0/2453816093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b0110 msgr2=0x7fa80015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa8072fd640 1 --2- 172.21.15.167:0/2453816093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b0110 0x7fa80015d3b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa800066f30 tx=0x7fa7fc01ec50 comp rx=0 tx=0).stop 2023-11-28T21:05:27.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa8072fd640 1 -- 172.21.15.167:0/2453816093 shutdown_connections 2023-11-28T21:05:27.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa8072fd640 1 --2- 172.21.15.167:0/2453816093 >> v2:172.21.15.178:3300/0 conn(0x7fa8000c8010 0x7fa800066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa8072fd640 1 --2- 172.21.15.167:0/2453816093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b0110 0x7fa80015d3b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa8072fd640 1 -- 172.21.15.167:0/2453816093 >> 172.21.15.167:0/2453816093 conn(0x7fa80006ee30 msgr2=0x7fa80006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:27.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa8072fd640 1 -- 172.21.15.167:0/2453816093 shutdown_connections 2023-11-28T21:05:27.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.257+0000 7fa8072fd640 1 -- 172.21.15.167:0/2453816093 wait complete. 2023-11-28T21:05:27.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 Processor -- start 2023-11-28T21:05:27.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 -- start start 2023-11-28T21:05:27.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa80006d530 0x7fa80015af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8000b0110 0x7fa80015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8000c8010 0x7fa80015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8001595b0 con 0x7fa80006d530 2023-11-28T21:05:27.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8001523f0 con 0x7fa8000c8010 2023-11-28T21:05:27.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800159c10 con 0x7fa8000b0110 2023-11-28T21:05:27.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa805099640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa80006d530 0x7fa80015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa805099640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa80006d530 0x7fa80015af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56898/0 (socket says 172.21.15.167:56898) 2023-11-28T21:05:27.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa805099640 1 -- 172.21.15.167:0/3559368540 learned_addr learned my addr 172.21.15.167:0/3559368540 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:27.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa804898640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8000b0110 0x7fa80015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa805099640 1 -- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8000b0110 msgr2=0x7fa80015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa805099640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8000b0110 0x7fa80015bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa80589a640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8000c8010 0x7fa80015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa805099640 1 -- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8000c8010 msgr2=0x7fa80015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa805099640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8000c8010 0x7fa80015c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa805099640 1 -- 172.21.15.167:0/3559368540 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc009420 con 0x7fa80006d530 2023-11-28T21:05:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa80589a640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8000c8010 0x7fa80015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:27.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa805099640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa80006d530 0x7fa80015af70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0b3040 tx=0x7fa7fc01b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa7f5ffb640 1 -- 172.21.15.167:0/3559368540 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc0b9630 con 0x7fa80006d530 2023-11-28T21:05:27.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa7f5ffb640 1 -- 172.21.15.167:0/3559368540 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc0b97b0 con 0x7fa80006d530 2023-11-28T21:05:27.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8001f0220 con 0x7fa80006d530 2023-11-28T21:05:27.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa7f5ffb640 1 -- 172.21.15.167:0/3559368540 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc0b9b60 con 0x7fa80006d530 2023-11-28T21:05:27.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa800159240 con 0x7fa80006d530 2023-11-28T21:05:27.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa800075c90 con 0x7fa80006d530 2023-11-28T21:05:27.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.261+0000 7fa7f5ffb640 1 -- 172.21.15.167:0/3559368540 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7fc0b7040 con 0x7fa80006d530 2023-11-28T21:05:27.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.265+0000 7fa7f5ffb640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7e4066470 0x7fa7e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.265+0000 7fa7f5ffb640 1 -- 172.21.15.167:0/3559368540 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa7fc122390 con 0x7fa80006d530 2023-11-28T21:05:27.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.265+0000 7fa804898640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7e4066470 0x7fa7e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.265+0000 7fa804898640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7e4066470 0x7fa7e4068930 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa8000c3a30 tx=0x7fa7f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.269+0000 7fa7f5ffb640 1 -- 172.21.15.167:0/3559368540 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7fc0ef390 con 0x7fa80006d530 2023-11-28T21:05:27.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8001590c0 con 0x7fa7e4066470 2023-11-28T21:05:27.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa7f5ffb640 1 -- 172.21.15.167:0/3559368540 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa7f000c040 con 0x7fa7e4066470 2023-11-28T21:05:27.415 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T21:05:27.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7e4066470 msgr2=0x7fa7e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7e4066470 0x7fa7e4068930 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa8000c3a30 tx=0x7fa7f0008040 comp rx=0 tx=0).stop 2023-11-28T21:05:27.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa80006d530 msgr2=0x7fa80015af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa80006d530 0x7fa80015af70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0b3040 tx=0x7fa7fc01b9f0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 shutdown_connections 2023-11-28T21:05:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa7e4066470 0x7fa7e4068930 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8000c8010 0x7fa80015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8000b0110 0x7fa80015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 --2- 172.21.15.167:0/3559368540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa80006d530 0x7fa80015af70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 >> 172.21.15.167:0/3559368540 conn(0x7fa80006ee30 msgr2=0x7fa80006b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:27.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 shutdown_connections 2023-11-28T21:05:27.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.413+0000 7fa8072fd640 1 -- 172.21.15.167:0/3559368540 wait complete. 2023-11-28T21:05:27.433 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T21:05:27.433 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T21:05:27.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31d0009640 1 Processor -- start 2023-11-28T21:05:27.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31d0009640 1 -- start start 2023-11-28T21:05:27.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31d0009640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8151ed0 0x7f31c806a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31d0009640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f31c8157d60 0x7f31c81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31d0009640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806baa0 con 0x7f31c8070520 2023-11-28T21:05:27.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31d0009640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c80c5f20 con 0x7f31c8157d60 2023-11-28T21:05:27.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31d0009640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81586e0 con 0x7f31c8151ed0 2023-11-28T21:05:27.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31cdda5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8151ed0 0x7f31c806a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31ce5a6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f31c8157d60 0x7f31c81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31ce5a6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f31c8157d60 0x7f31c81581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55730/0 (socket says 172.21.15.167:55730) 2023-11-28T21:05:27.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31cdda5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8151ed0 0x7f31c806a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:56790/0 (socket says 172.21.15.167:56790) 2023-11-28T21:05:27.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31ce5a6640 1 -- 172.21.15.167:0/1142989449 learned_addr learned my addr 172.21.15.167:0/1142989449 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:27.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31ce5a6640 1 -- 172.21.15.167:0/1142989449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8151ed0 msgr2=0x7f31c806a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31ce5a6640 1 --2- 172.21.15.167:0/1142989449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8151ed0 0x7f31c806a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31ce5a6640 1 -- 172.21.15.167:0/1142989449 >> v1:172.21.15.178:6789/0 conn(0x7f31c8070520 legacy=0x7f31c8071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.545+0000 7f31ce5a6640 1 -- 172.21.15.167:0/1142989449 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c806b4e0 con 0x7f31c8157d60 2023-11-28T21:05:27.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31ce5a6640 1 --2- 172.21.15.167:0/1142989449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c8157d60 0x7f31c81581a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=390d5706d1647ad8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31ccda3640 1 -- 172.21.15.167:0/1142989449 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00ab680 con 0x7f31c8157d60 2023-11-28T21:05:27.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31ccda3640 1 -- 172.21.15.167:0/1142989449 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c00ab7e0 con 0x7f31c8157d60 2023-11-28T21:05:27.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31ccda3640 1 -- 172.21.15.167:0/1142989449 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00abb70 con 0x7f31c8157d60 2023-11-28T21:05:27.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 -- 172.21.15.167:0/1142989449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c8157d60 msgr2=0x7f31c81581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 --2- 172.21.15.167:0/1142989449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c8157d60 0x7f31c81581a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c001c480 comp rx=0 tx=0).stop 2023-11-28T21:05:27.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 -- 172.21.15.167:0/1142989449 shutdown_connections 2023-11-28T21:05:27.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 --2- 172.21.15.167:0/1142989449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c8157d60 0x7f31c81581a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 --2- 172.21.15.167:0/1142989449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8151ed0 0x7f31c806a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 -- 172.21.15.167:0/1142989449 >> 172.21.15.167:0/1142989449 conn(0x7f31c806e030 msgr2=0x7f31c806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:27.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 -- 172.21.15.167:0/1142989449 shutdown_connections 2023-11-28T21:05:27.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 -- 172.21.15.167:0/1142989449 wait complete. 2023-11-28T21:05:27.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 Processor -- start 2023-11-28T21:05:27.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.549+0000 7f31d0009640 1 -- start start 2023-11-28T21:05:27.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31d0009640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8070520 0x7f31c8143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31d0009640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8151ed0 0x7f31c815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31d0009640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c8157d60 0x7f31c815ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31d0009640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8159460 con 0x7f31c8151ed0 2023-11-28T21:05:27.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31d0009640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c815a330 con 0x7f31c8157d60 2023-11-28T21:05:27.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31d0009640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81f15a0 con 0x7f31c8070520 2023-11-28T21:05:27.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cd5a4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8151ed0 0x7f31c815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cd5a4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8151ed0 0x7f31c815a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56902/0 (socket says 172.21.15.167:56902) 2023-11-28T21:05:27.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cd5a4640 1 -- 172.21.15.167:0/1262572742 learned_addr learned my addr 172.21.15.167:0/1262572742 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:27.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31ce5a6640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c8157d60 0x7f31c815ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cdda5640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8070520 0x7f31c8143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cd5a4640 1 -- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8070520 msgr2=0x7f31c8143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cd5a4640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8070520 0x7f31c8143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cd5a4640 1 -- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c8157d60 msgr2=0x7f31c815ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cd5a4640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c8157d60 0x7f31c815ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cd5a4640 1 -- 172.21.15.167:0/1262572742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00094d0 con 0x7f31c8151ed0 2023-11-28T21:05:27.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cd5a4640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8151ed0 0x7f31c815a830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31b800c370 tx=0x7f31b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31be7fc640 1 -- 172.21.15.167:0/1262572742 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b80052d0 con 0x7f31c8151ed0 2023-11-28T21:05:27.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31be7fc640 1 -- 172.21.15.167:0/1262572742 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8005430 con 0x7f31c8151ed0 2023-11-28T21:05:27.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c8159700 con 0x7f31c8151ed0 2023-11-28T21:05:27.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31be7fc640 1 -- 172.21.15.167:0/1262572742 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8007260 con 0x7f31c8151ed0 2023-11-28T21:05:27.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c81f1880 con 0x7f31c8151ed0 2023-11-28T21:05:27.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31c80c64a0 con 0x7f31c8151ed0 2023-11-28T21:05:27.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31be7fc640 1 -- 172.21.15.167:0/1262572742 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31b80073c0 con 0x7f31c8151ed0 2023-11-28T21:05:27.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31be7fc640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f31ac0664a0 0x7f31ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31be7fc640 1 -- 172.21.15.167:0/1262572742 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f31b8083590 con 0x7f31c8151ed0 2023-11-28T21:05:27.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31be7fc640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f31ac06fe00 0x7f31ac0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31be7fc640 1 -- 172.21.15.167:0/1262572742 --> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31ac072970 con 0x7f31ac06fe00 2023-11-28T21:05:27.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31be7fc640 1 -- 172.21.15.167:0/1262572742 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31b8085c50 con 0x7f31c8151ed0 2023-11-28T21:05:27.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31cdda5640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f31ac0664a0 0x7f31ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31ce5a6640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f31ac06fe00 0x7f31ac0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.553+0000 7f31ce5a6640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f31ac06fe00 0x7f31ac0722a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.557+0000 7f31cdda5640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f31ac0664a0 0x7f31ac068960 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f31c40113e0 tx=0x7f31c400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.557+0000 7f31be7fc640 1 -- 172.21.15.167:0/1262572742 <== osd.2 v2:172.21.15.167:6816/3946163569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f31ac072970 con 0x7f31ac06fe00 2023-11-28T21:05:27.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 --> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f31c8075c90 con 0x7f31ac06fe00 2023-11-28T21:05:27.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31be7fc640 1 -- 172.21.15.167:0/1262572742 <== osd.2 v2:172.21.15.167:6816/3946163569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f31c8075c90 con 0x7f31ac06fe00 2023-11-28T21:05:27.570 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:27.571 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T21:05:27.571 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:27.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f31ac06fe00 msgr2=0x7f31ac0722a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.167:6816/3946163569,v1:172.21.15.167:6817/3946163569] conn(0x7f31ac06fe00 0x7f31ac0722a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f31ac0664a0 msgr2=0x7f31ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f31ac0664a0 0x7f31ac068960 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f31c40113e0 tx=0x7f31c400b040 comp rx=0 tx=0).stop 2023-11-28T21:05:27.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8151ed0 msgr2=0x7f31c815a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 --2- 172.21.15.167:0/1262572742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8151ed0 0x7f31c815a830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31b800c370 tx=0x7f31b800c830 comp rx=0 tx=0).stop 2023-11-28T21:05:27.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31ce5a6640 1 -- 172.21.15.167:0/1262572742 reap_dead start 2023-11-28T21:05:27.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 shutdown_connections 2023-11-28T21:05:27.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 >> 172.21.15.167:0/1262572742 conn(0x7f31c806e030 msgr2=0x7f31c8145570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:27.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 shutdown_connections 2023-11-28T21:05:27.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.569+0000 7f31d0009640 1 -- 172.21.15.167:0/1262572742 wait complete. 2023-11-28T21:05:27.586 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T21:05:27.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f1424bf8640 1 Processor -- start 2023-11-28T21:05:27.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f1424bf8640 1 -- start start 2023-11-28T21:05:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f1424bf8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f14200c2630 0x7f14200c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f1424bf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14200c2a10 0x7f14200c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f1424bf8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14200ca230 con 0x7f1420157e30 2023-11-28T21:05:27.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f1424bf8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14200c9b90 con 0x7f14200c2630 2023-11-28T21:05:27.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f1424bf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14200c9e70 con 0x7f14200c2a10 2023-11-28T21:05:27.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141ed9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1420157e30 0x7f1420158280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50972/0 (socket says 172.21.15.167:50972) 2023-11-28T21:05:27.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141ed9d640 1 -- 172.21.15.167:0/2671929451 learned_addr learned my addr 172.21.15.167:0/2671929451 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:27.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141e59c640 1 --2- 172.21.15.167:0/2671929451 >> v2:172.21.15.178:3300/0 conn(0x7f14200c2630 0x7f14200c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141dd9b640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14200c2a10 0x7f14200c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769097209 0 0) 0x7f14200ca230 con 0x7f1420157e30 2023-11-28T21:05:27.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1408003530 con 0x7f1420157e30 2023-11-28T21:05:27.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287470982 0 0) 0x7f1408003530 con 0x7f1420157e30 2023-11-28T21:05:27.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14200c2a10 msgr2=0x7f14200c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14200c2a10 0x7f14200c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 >> v2:172.21.15.178:3300/0 conn(0x7f14200c2630 msgr2=0x7f14200c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 --2- 172.21.15.167:0/2671929451 >> v2:172.21.15.178:3300/0 conn(0x7f14200c2630 0x7f14200c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200ca480 con 0x7f1420157e30 2023-11-28T21:05:27.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f1418001a00 con 0x7f1420157e30 2023-11-28T21:05:27.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 >> v1:172.21.15.167:6789/0 conn(0x7f1420157e30 legacy=0x7f1420158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1408003980 0x7f1408003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14200c2a10 0x7f14080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1408004d10 0x7f1408005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200c9b90 con 0x7f1408003980 2023-11-28T21:05:27.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200c9e70 con 0x7f1408004d10 2023-11-28T21:05:27.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140800b990 con 0x7f14200c2a10 2023-11-28T21:05:27.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141e59c640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1408003980 0x7f1408003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.693+0000 7f141ed9d640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1408004d10 0x7f1408005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141dd9b640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14200c2a10 0x7f14080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141e59c640 1 -- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14200c2a10 msgr2=0x7f14080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141e59c640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14200c2a10 0x7f14080047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141e59c640 1 -- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1408004d10 msgr2=0x7f1408005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141e59c640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1408004d10 0x7f1408005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141e59c640 1 -- 172.21.15.167:0/2671929451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408003530 con 0x7f1408003980 2023-11-28T21:05:27.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141e59c640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1408003980 0x7f1408003da0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1410009ae0 tx=0x7f141001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432f373614e7e31f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100a5570 con 0x7f1408003980 2023-11-28T21:05:27.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14100a56d0 con 0x7f1408003980 2023-11-28T21:05:27.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141d59a640 1 -- 172.21.15.167:0/2671929451 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100a5a80 con 0x7f1408003980 2023-11-28T21:05:27.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f1424bf8640 1 -- 172.21.15.167:0/2671929451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1408003980 msgr2=0x7f1408003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f1424bf8640 1 --2- 172.21.15.167:0/2671929451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1408003980 0x7f1408003da0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1410009ae0 tx=0x7f141001ca90 comp rx=0 tx=0).stop 2023-11-28T21:05:27.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f141ed9d640 1 -- 172.21.15.167:0/2671929451 reap_dead start 2023-11-28T21:05:27.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f1424bf8640 1 -- 172.21.15.167:0/2671929451 shutdown_connections 2023-11-28T21:05:27.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f1424bf8640 1 -- 172.21.15.167:0/2671929451 >> 172.21.15.167:0/2671929451 conn(0x7f142006ee30 msgr2=0x7f142006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:27.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f1424bf8640 1 -- 172.21.15.167:0/2671929451 shutdown_connections 2023-11-28T21:05:27.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.697+0000 7f1424bf8640 1 -- 172.21.15.167:0/2671929451 wait complete. 2023-11-28T21:05:27.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 Processor -- start 2023-11-28T21:05:27.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 -- start start 2023-11-28T21:05:27.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1408003980 0x7f14201ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14200c4ff0 0x7f14201498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14200b27c0 0x7f14200cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420149460 con 0x7f14200b27c0 2023-11-28T21:05:27.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14201ee6c0 con 0x7f14200c4ff0 2023-11-28T21:05:27.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1420149e30 con 0x7f1408003980 2023-11-28T21:05:27.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14200b27c0 0x7f14200cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14200b27c0 0x7f14200cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56928/0 (socket says 172.21.15.167:56928) 2023-11-28T21:05:27.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141ed9d640 1 -- 172.21.15.167:0/893387550 learned_addr learned my addr 172.21.15.167:0/893387550 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:27.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141e59c640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1408003980 0x7f14201ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141dd9b640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14200c4ff0 0x7f14201498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141ed9d640 1 -- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1408003980 msgr2=0x7f14201ee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141ed9d640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1408003980 0x7f14201ee180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141ed9d640 1 -- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14200c4ff0 msgr2=0x7f14201498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141ed9d640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14200c4ff0 0x7f14201498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141ed9d640 1 -- 172.21.15.167:0/893387550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200c4450 con 0x7f14200b27c0 2023-11-28T21:05:27.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141dd9b640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14200c4ff0 0x7f14201498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:27.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f141ed9d640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14200b27c0 0x7f14200cc7f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1420066f30 tx=0x7f1418011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f140effd640 1 -- 172.21.15.167:0/893387550 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800f920 con 0x7f14200b27c0 2023-11-28T21:05:27.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f140effd640 1 -- 172.21.15.167:0/893387550 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141800fa80 con 0x7f14200b27c0 2023-11-28T21:05:27.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14200c4730 con 0x7f14200b27c0 2023-11-28T21:05:27.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f140effd640 1 -- 172.21.15.167:0/893387550 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800fe30 con 0x7f14200b27c0 2023-11-28T21:05:27.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14201490f0 con 0x7f14200b27c0 2023-11-28T21:05:27.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1420075c90 con 0x7f14200b27c0 2023-11-28T21:05:27.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.701+0000 7f140effd640 1 -- 172.21.15.167:0/893387550 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f141801f460 con 0x7f14200b27c0 2023-11-28T21:05:27.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.705+0000 7f140effd640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1400066470 0x7f1400068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.705+0000 7f140effd640 1 -- 172.21.15.167:0/893387550 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f1418087350 con 0x7f14200b27c0 2023-11-28T21:05:27.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.705+0000 7f141e59c640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1400066470 0x7f1400068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.705+0000 7f141e59c640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1400066470 0x7f1400068930 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f14100af000 tx=0x7f14100046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:27.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.709+0000 7f140effd640 1 -- 172.21.15.167:0/893387550 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f14180543e0 con 0x7f14200b27c0 2023-11-28T21:05:27.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f14200c9830 con 0x7f1400066470 2023-11-28T21:05:27.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f140effd640 1 -- 172.21.15.167:0/893387550 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f141000f080 con 0x7f1400066470 2023-11-28T21:05:27.855 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T21:05:27.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1400066470 msgr2=0x7f1400068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1400066470 0x7f1400068930 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f14100af000 tx=0x7f14100046d0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14200b27c0 msgr2=0x7f14200cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14200b27c0 0x7f14200cc7f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1420066f30 tx=0x7f1418011c20 comp rx=0 tx=0).stop 2023-11-28T21:05:27.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 shutdown_connections 2023-11-28T21:05:27.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f1400066470 0x7f1400068930 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14200b27c0 0x7f14200cc7f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14200c4ff0 0x7f14201498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 --2- 172.21.15.167:0/893387550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1408003980 0x7f14201ee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 >> 172.21.15.167:0/893387550 conn(0x7f142006ee30 msgr2=0x7f14200c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:27.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 shutdown_connections 2023-11-28T21:05:27.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.853+0000 7f1424bf8640 1 -- 172.21.15.167:0/893387550 wait complete. 2023-11-28T21:05:27.873 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T21:05:27.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T21:05:27.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.985+0000 7f8e08c5a640 1 Processor -- start 2023-11-28T21:05:27.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.985+0000 7f8e08c5a640 1 -- start start 2023-11-28T21:05:27.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e08c5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e0415d1a0 0x7f8e0415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e08c5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e04159bb0 con 0x7f8e04153c80 2023-11-28T21:05:27.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e08c5a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0415a150 con 0x7f8e040c6460 2023-11-28T21:05:27.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e08c5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04154060 con 0x7f8e0415d1a0 2023-11-28T21:05:27.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e0259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8e04153c80 0x7f8e040c86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50984/0 (socket says 172.21.15.167:50984) 2023-11-28T21:05:27.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e0259c640 1 -- 172.21.15.167:0/1680380341 learned_addr learned my addr 172.21.15.167:0/1680380341 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:27.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8dfbfff640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e0415d1a0 0x7f8e0415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368768433 0 0) 0x7f8e04159bb0 con 0x7f8e04153c80 2023-11-28T21:05:27.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df0003530 con 0x7f8e04153c80 2023-11-28T21:05:27.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3905201632 0 0) 0x7f8df0003530 con 0x7f8e04153c80 2023-11-28T21:05:27.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e0415d1a0 msgr2=0x7f8e0415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e0415d1a0 0x7f8e0415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 >> v1:172.21.15.178:6789/0 conn(0x7f8e040c6460 legacy=0x7f8e040715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0415ab20 con 0x7f8e04153c80 2023-11-28T21:05:27.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f8df4001680 con 0x7f8e04153c80 2023-11-28T21:05:27.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 >> v1:172.21.15.167:6789/0 conn(0x7f8e04153c80 legacy=0x7f8e040c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:27.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 0x7f8df0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e0415d1a0 0x7f8df00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df0004d10 0x7f8df0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:27.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04154060 con 0x7f8df00039b0 2023-11-28T21:05:27.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df000bad0 con 0x7f8df0004d10 2023-11-28T21:05:27.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df000bc90 con 0x7f8e0415d1a0 2023-11-28T21:05:27.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e0259c640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 0x7f8df0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8dfbfff640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e0415d1a0 0x7f8df00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e02d9d640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df0004d10 0x7f8df0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:27.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e0259c640 1 -- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e0415d1a0 msgr2=0x7f8df00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e0259c640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e0415d1a0 0x7f8df00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e0259c640 1 -- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df0004d10 msgr2=0x7f8df0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:27.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e0259c640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df0004d10 0x7f8df0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:27.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e0259c640 1 -- 172.21.15.167:0/1680380341 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0003530 con 0x7f8df00039b0 2023-11-28T21:05:27.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8dfbfff640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e0415d1a0 0x7f8df00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:27.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e02d9d640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8df0004d10 0x7f8df0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:28.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e0259c640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 0x7f8df0003dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8df400c190 tx=0x7f8df401f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9248ae0c7a1516b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.989+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4005ae0 con 0x7f8df00039b0 2023-11-28T21:05:28.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df40ab070 con 0x7f8df00039b0 2023-11-28T21:05:28.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e01d9b640 1 -- 172.21.15.167:0/1680380341 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4005ea0 con 0x7f8df00039b0 2023-11-28T21:05:28.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- 172.21.15.167:0/1680380341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 msgr2=0x7f8df0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 --2- 172.21.15.167:0/1680380341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 0x7f8df0003dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8df400c190 tx=0x7f8df401f350 comp rx=0 tx=0).stop 2023-11-28T21:05:28.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e02d9d640 1 -- 172.21.15.167:0/1680380341 reap_dead start 2023-11-28T21:05:28.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- 172.21.15.167:0/1680380341 shutdown_connections 2023-11-28T21:05:28.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- 172.21.15.167:0/1680380341 >> 172.21.15.167:0/1680380341 conn(0x7f8e040c8e00 msgr2=0x7f8e040c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:28.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- 172.21.15.167:0/1680380341 shutdown_connections 2023-11-28T21:05:28.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- 172.21.15.167:0/1680380341 wait complete. 2023-11-28T21:05:28.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 Processor -- start 2023-11-28T21:05:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- start start 2023-11-28T21:05:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 0x7f8e04154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0414e9a0 0x7f8e041f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e041e3680 0x7f8e041e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04155410 con 0x7f8df00039b0 2023-11-28T21:05:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041e4040 con 0x7f8e0414e9a0 2023-11-28T21:05:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041f3550 con 0x7f8e041e3680 2023-11-28T21:05:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e0259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 0x7f8e04154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e0259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 0x7f8e04154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56954/0 (socket says 172.21.15.167:56954) 2023-11-28T21:05:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e0259c640 1 -- 172.21.15.167:0/463640605 learned_addr learned my addr 172.21.15.167:0/463640605 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8dfbfff640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0414e9a0 0x7f8e041f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e02d9d640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e041e3680 0x7f8e041e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e0259c640 1 -- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e041e3680 msgr2=0x7f8e041e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e0259c640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e041e3680 0x7f8e041e3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e0259c640 1 -- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0414e9a0 msgr2=0x7f8e041f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e0259c640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0414e9a0 0x7f8e041f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e0259c640 1 -- 172.21.15.167:0/463640605 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e041e3180 con 0x7f8df00039b0 2023-11-28T21:05:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e02d9d640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e041e3680 0x7f8e041e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8dfbfff640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0414e9a0 0x7f8e041f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e0259c640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 0x7f8e04154ed0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8df401f180 tx=0x7f8df0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8dfaffd640 1 -- 172.21.15.167:0/463640605 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4001640 con 0x7f8df00039b0 2023-11-28T21:05:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8dfaffd640 1 -- 172.21.15.167:0/463640605 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df4007070 con 0x7f8df00039b0 2023-11-28T21:05:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8dfaffd640 1 -- 172.21.15.167:0/463640605 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4007400 con 0x7f8df00039b0 2023-11-28T21:05:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e041eff60 con 0x7f8df00039b0 2023-11-28T21:05:28.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.993+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e04151d90 con 0x7f8df00039b0 2023-11-28T21:05:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e04155410 con 0x7f8df00039b0 2023-11-28T21:05:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8dfaffd640 1 -- 172.21.15.167:0/463640605 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8df4007560 con 0x7f8df00039b0 2023-11-28T21:05:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8dfaffd640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8de4066470 0x7f8de4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8dfaffd640 1 -- 172.21.15.167:0/463640605 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f8df40b7040 con 0x7f8df00039b0 2023-11-28T21:05:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8dfaffd640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f8de406fe50 0x7f8de40722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8dfaffd640 1 -- 172.21.15.167:0/463640605 --> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8de40729c0 con 0x7f8de406fe50 2023-11-28T21:05:28.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8dfaffd640 1 -- 172.21.15.167:0/463640605 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8df41238b0 con 0x7f8df00039b0 2023-11-28T21:05:28.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8e02d9d640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f8de406fe50 0x7f8de40722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8dfbfff640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8de4066470 0x7f8de4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8e02d9d640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f8de406fe50 0x7f8de40722f0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8dfbfff640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8de4066470 0x7f8de4068930 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8e0414f3f0 tx=0x7f8dec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:27.997+0000 7f8dfaffd640 1 -- 172.21.15.167:0/463640605 <== osd.3 v2:172.21.15.167:6824/1382439964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8de40729c0 con 0x7f8de406fe50 2023-11-28T21:05:28.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.009+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 --> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8e041e3000 con 0x7f8de406fe50 2023-11-28T21:05:28.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.009+0000 7f8dfaffd640 1 -- 172.21.15.167:0/463640605 <== osd.3 v2:172.21.15.167:6824/1382439964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8dfc00d040 con 0x7f8de406fe50 2023-11-28T21:05:28.013 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:28.013 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T21:05:28.014 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:28.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f8de406fe50 msgr2=0x7f8de40722f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.167:6824/1382439964,v1:172.21.15.167:6825/1382439964] conn(0x7f8de406fe50 0x7f8de40722f0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8de4066470 msgr2=0x7f8de4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f8de4066470 0x7f8de4068930 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8e0414f3f0 tx=0x7f8dec008040 comp rx=0 tx=0).stop 2023-11-28T21:05:28.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 msgr2=0x7f8e04154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 --2- 172.21.15.167:0/463640605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8df00039b0 0x7f8e04154ed0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8df401f180 tx=0x7f8df0005800 comp rx=0 tx=0).stop 2023-11-28T21:05:28.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e02d9d640 1 -- 172.21.15.167:0/463640605 reap_dead start 2023-11-28T21:05:28.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 shutdown_connections 2023-11-28T21:05:28.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 >> 172.21.15.167:0/463640605 conn(0x7f8e040c8e00 msgr2=0x7f8e04152050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:28.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 shutdown_connections 2023-11-28T21:05:28.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.013+0000 7f8e08c5a640 1 -- 172.21.15.167:0/463640605 wait complete. 2023-11-28T21:05:28.028 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T21:05:28.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7f79d640 1 Processor -- start 2023-11-28T21:05:28.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7f79d640 1 -- start start 2023-11-28T21:05:28.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7f79d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff78151f60 0x7eff780c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7f79d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff7806a580 0x7eff7806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7f79d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff780c6120 con 0x7eff780c5c90 2023-11-28T21:05:28.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7f79d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7806aed0 con 0x7eff78151f60 2023-11-28T21:05:28.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7f79d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff780c4da0 con 0x7eff7806a580 2023-11-28T21:05:28.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7d539640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff78151f60 0x7eff780c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7d539640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff78151f60 0x7eff780c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56956/0 (socket says 172.21.15.167:56956) 2023-11-28T21:05:28.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7d539640 1 -- 172.21.15.167:0/1435277165 learned_addr learned my addr 172.21.15.167:0/1435277165 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:28.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7dd3a640 1 --2- 172.21.15.167:0/1435277165 >> v2:172.21.15.178:3300/0 conn(0x7eff7806a580 0x7eff7806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7d539640 1 -- 172.21.15.167:0/1435277165 >> v2:172.21.15.178:3300/0 conn(0x7eff7806a580 msgr2=0x7eff7806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:28.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7d539640 1 --2- 172.21.15.167:0/1435277165 >> v2:172.21.15.178:3300/0 conn(0x7eff7806a580 0x7eff7806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7d539640 1 -- 172.21.15.167:0/1435277165 >> v1:172.21.15.178:6789/0 conn(0x7eff780c5c90 legacy=0x7eff780c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:28.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.137+0000 7eff7d539640 1 -- 172.21.15.167:0/1435277165 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7815b220 con 0x7eff78151f60 2023-11-28T21:05:28.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7d539640 1 --2- 172.21.15.167:0/1435277165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 0x7eff780c75c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff780c5580 tx=0x7eff6801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b8111503f45d9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff77fff640 1 -- 172.21.15.167:0/1435277165 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680ab600 con 0x7eff78151f60 2023-11-28T21:05:28.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff77fff640 1 -- 172.21.15.167:0/1435277165 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff680a7050 con 0x7eff78151f60 2023-11-28T21:05:28.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff77fff640 1 -- 172.21.15.167:0/1435277165 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff680ab980 con 0x7eff78151f60 2023-11-28T21:05:28.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 -- 172.21.15.167:0/1435277165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 msgr2=0x7eff780c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 --2- 172.21.15.167:0/1435277165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 0x7eff780c75c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff780c5580 tx=0x7eff6801c430 comp rx=0 tx=0).stop 2023-11-28T21:05:28.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 -- 172.21.15.167:0/1435277165 shutdown_connections 2023-11-28T21:05:28.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 --2- 172.21.15.167:0/1435277165 >> v2:172.21.15.178:3300/0 conn(0x7eff7806a580 0x7eff7806a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 --2- 172.21.15.167:0/1435277165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 0x7eff780c75c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 -- 172.21.15.167:0/1435277165 >> 172.21.15.167:0/1435277165 conn(0x7eff780cb1e0 msgr2=0x7eff780cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:28.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 -- 172.21.15.167:0/1435277165 shutdown_connections 2023-11-28T21:05:28.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 -- 172.21.15.167:0/1435277165 wait complete. 2023-11-28T21:05:28.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 Processor -- start 2023-11-28T21:05:28.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.141+0000 7eff7f79d640 1 -- start start 2023-11-28T21:05:28.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7f79d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7806a580 0x7eff781f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7f79d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff780c5c90 0x7eff78141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7f79d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 0x7eff7814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7f79d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7815aea0 con 0x7eff78151f60 2023-11-28T21:05:28.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7f79d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff781f3a90 con 0x7eff780c5c90 2023-11-28T21:05:28.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7f79d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff781432e0 con 0x7eff7806a580 2023-11-28T21:05:28.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7dd3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 0x7eff7814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7dd3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 0x7eff7814ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56958/0 (socket says 172.21.15.167:56958) 2023-11-28T21:05:28.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7dd3a640 1 -- 172.21.15.167:0/1977772874 learned_addr learned my addr 172.21.15.167:0/1977772874 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:28.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7cd38640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff780c5c90 0x7eff78141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7d539640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7806a580 0x7eff781f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7dd3a640 1 -- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7806a580 msgr2=0x7eff781f3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7dd3a640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7806a580 0x7eff781f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7dd3a640 1 -- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff780c5c90 msgr2=0x7eff78141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7dd3a640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff780c5c90 0x7eff78141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7dd3a640 1 -- 172.21.15.167:0/1977772874 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff680094d0 con 0x7eff78151f60 2023-11-28T21:05:28.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7dd3a640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 0x7eff7814ec30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7eff70007e60 tx=0x7eff7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff75ffb640 1 -- 172.21.15.167:0/1977772874 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70014420 con 0x7eff78151f60 2023-11-28T21:05:28.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff75ffb640 1 -- 172.21.15.167:0/1977772874 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff700145a0 con 0x7eff78151f60 2023-11-28T21:05:28.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff781f4460 con 0x7eff78151f60 2023-11-28T21:05:28.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff75ffb640 1 -- 172.21.15.167:0/1977772874 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70014950 con 0x7eff78151f60 2023-11-28T21:05:28.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7815abc0 con 0x7eff78151f60 2023-11-28T21:05:28.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff780682c0 con 0x7eff78151f60 2023-11-28T21:05:28.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff75ffb640 1 -- 172.21.15.167:0/1977772874 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff70014ab0 con 0x7eff78151f60 2023-11-28T21:05:28.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff75ffb640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7eff64066470 0x7eff64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff75ffb640 1 -- 172.21.15.167:0/1977772874 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7eff70084c30 con 0x7eff78151f60 2023-11-28T21:05:28.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.145+0000 7eff7d539640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7eff64066470 0x7eff64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.149+0000 7eff7d539640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7eff64066470 0x7eff64068930 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7eff680ad000 tx=0x7eff680a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.149+0000 7eff75ffb640 1 -- 172.21.15.167:0/1977772874 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff70051c30 con 0x7eff78151f60 2023-11-28T21:05:28.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.293+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7eff7815ba30 con 0x7eff64066470 2023-11-28T21:05:28.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.293+0000 7eff75ffb640 1 -- 172.21.15.167:0/1977772874 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7eff680ab600 con 0x7eff64066470 2023-11-28T21:05:28.297 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T21:05:28.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7eff64066470 msgr2=0x7eff64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7eff64066470 0x7eff64068930 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7eff680ad000 tx=0x7eff680a6000 comp rx=0 tx=0).stop 2023-11-28T21:05:28.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 msgr2=0x7eff7814ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 0x7eff7814ec30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7eff70007e60 tx=0x7eff7000e4b0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 shutdown_connections 2023-11-28T21:05:28.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7eff64066470 0x7eff64068930 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff78151f60 0x7eff7814ec30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff780c5c90 0x7eff78141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 --2- 172.21.15.167:0/1977772874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff7806a580 0x7eff781f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 >> 172.21.15.167:0/1977772874 conn(0x7eff780cb1e0 msgr2=0x7eff780c6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:28.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 shutdown_connections 2023-11-28T21:05:28.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.297+0000 7eff7f79d640 1 -- 172.21.15.167:0/1977772874 wait complete. 2023-11-28T21:05:28.315 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T21:05:28.315 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T21:05:28.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38fbe6b640 1 Processor -- start 2023-11-28T21:05:28.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38fbe6b640 1 -- start start 2023-11-28T21:05:28.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38fbe6b640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f38f40c84c0 0x7f38f4150830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38fbe6b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c6f20 0x7f38f4150d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38fbe6b640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f40c8e00 con 0x7f38f40c80e0 2023-11-28T21:05:28.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38fbe6b640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f40c7c50 con 0x7f38f40c84c0 2023-11-28T21:05:28.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38fbe6b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f4156a00 con 0x7f38f40c6f20 2023-11-28T21:05:28.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38f9406640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f38f40c84c0 0x7f38f4150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38fa408640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c6f20 0x7f38f4150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38f9406640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f38f40c84c0 0x7f38f4150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55802/0 (socket says 172.21.15.167:55802) 2023-11-28T21:05:28.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38f9406640 1 -- 172.21.15.167:0/1267293088 learned_addr learned my addr 172.21.15.167:0/1267293088 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:28.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38f9406640 1 -- 172.21.15.167:0/1267293088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c6f20 msgr2=0x7f38f4150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:28.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38f9406640 1 --2- 172.21.15.167:0/1267293088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c6f20 0x7f38f4150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38f9406640 1 -- 172.21.15.167:0/1267293088 >> v1:172.21.15.178:6789/0 conn(0x7f38f40c80e0 legacy=0x7f38f40c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.429+0000 7f38f9406640 1 -- 172.21.15.167:0/1267293088 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40c7690 con 0x7f38f40c84c0 2023-11-28T21:05:28.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38f9406640 1 --2- 172.21.15.167:0/1267293088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38f40c84c0 0x7f38f4150830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009870 tx=0x7f38e401c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=916d4e85f8c9a573 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38f8c05640 1 -- 172.21.15.167:0/1267293088 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e40ac600 con 0x7f38f40c84c0 2023-11-28T21:05:28.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38f8c05640 1 -- 172.21.15.167:0/1267293088 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e40a8050 con 0x7f38f40c84c0 2023-11-28T21:05:28.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38f8c05640 1 -- 172.21.15.167:0/1267293088 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e40ac980 con 0x7f38f40c84c0 2023-11-28T21:05:28.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1267293088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38f40c84c0 msgr2=0x7f38f4150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 --2- 172.21.15.167:0/1267293088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38f40c84c0 0x7f38f4150830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f38e4009870 tx=0x7f38e401c4b0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1267293088 shutdown_connections 2023-11-28T21:05:28.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 --2- 172.21.15.167:0/1267293088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c6f20 0x7f38f4150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 --2- 172.21.15.167:0/1267293088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38f40c84c0 0x7f38f4150830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1267293088 >> 172.21.15.167:0/1267293088 conn(0x7f38f406e030 msgr2=0x7f38f406e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:28.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1267293088 shutdown_connections 2023-11-28T21:05:28.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1267293088 wait complete. 2023-11-28T21:05:28.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 Processor -- start 2023-11-28T21:05:28.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.433+0000 7f38fbe6b640 1 -- start start 2023-11-28T21:05:28.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fbe6b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38f40c6f20 0x7f38f406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fbe6b640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c80e0 0x7f38f406a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fbe6b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40c84c0 0x7f38f41f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fbe6b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f414c2b0 con 0x7f38f40c84c0 2023-11-28T21:05:28.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fbe6b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f414c890 con 0x7f38f40c6f20 2023-11-28T21:05:28.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fbe6b640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f41f00f0 con 0x7f38f40c80e0 2023-11-28T21:05:28.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fa408640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40c84c0 0x7f38f41f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fa408640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40c84c0 0x7f38f41f0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56974/0 (socket says 172.21.15.167:56974) 2023-11-28T21:05:28.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fa408640 1 -- 172.21.15.167:0/1063657431 learned_addr learned my addr 172.21.15.167:0/1063657431 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:28.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38f9c07640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38f40c6f20 0x7f38f406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38f9406640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c80e0 0x7f38f406a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fa408640 1 -- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c80e0 msgr2=0x7f38f406a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fa408640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c80e0 0x7f38f406a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fa408640 1 -- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38f40c6f20 msgr2=0x7f38f406b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fa408640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38f40c6f20 0x7f38f406b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fa408640 1 -- 172.21.15.167:0/1063657431 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e40094d0 con 0x7f38f40c84c0 2023-11-28T21:05:28.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38f9406640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38f40c80e0 0x7f38f406a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:28.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fa408640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40c84c0 0x7f38f41f0820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00efc0 tx=0x7f38ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38ea7fc640 1 -- 172.21.15.167:0/1063657431 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec00ced0 con 0x7f38f40c84c0 2023-11-28T21:05:28.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38ea7fc640 1 -- 172.21.15.167:0/1063657431 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec00f040 con 0x7f38f40c84c0 2023-11-28T21:05:28.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f41f0390 con 0x7f38f40c84c0 2023-11-28T21:05:28.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38ea7fc640 1 -- 172.21.15.167:0/1063657431 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec0146c0 con 0x7f38f40c84c0 2023-11-28T21:05:28.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f414b1b0 con 0x7f38f40c84c0 2023-11-28T21:05:28.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38f40c4220 con 0x7f38f40c84c0 2023-11-28T21:05:28.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38ea7fc640 1 -- 172.21.15.167:0/1063657431 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f38ec014820 con 0x7f38f40c84c0 2023-11-28T21:05:28.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38ea7fc640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f38d8066470 0x7f38d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38ea7fc640 1 -- 172.21.15.167:0/1063657431 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f38ec084f10 con 0x7f38f40c84c0 2023-11-28T21:05:28.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38ea7fc640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f38d806fce0 0x7f38d8072180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38ea7fc640 1 -- 172.21.15.167:0/1063657431 --> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38d8072850 con 0x7f38d806fce0 2023-11-28T21:05:28.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38ea7fc640 1 -- 172.21.15.167:0/1063657431 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38ec0874f0 con 0x7f38f40c84c0 2023-11-28T21:05:28.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.437+0000 7f38f9c07640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f38d8066470 0x7f38d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.441+0000 7f38f9406640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f38d806fce0 0x7f38d8072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.441+0000 7f38f9c07640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f38d8066470 0x7f38d8068930 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f38f0000f70 tx=0x7f38f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.441+0000 7f38f9406640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f38d806fce0 0x7f38d8072180 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.441+0000 7f38ea7fc640 1 -- 172.21.15.167:0/1063657431 <== osd.4 v2:172.21.15.178:6800/1470729243 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f38d8072850 con 0x7f38d806fce0 2023-11-28T21:05:28.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 --> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f38f40c8aa0 con 0x7f38d806fce0 2023-11-28T21:05:28.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38ea7fc640 1 -- 172.21.15.167:0/1063657431 <== osd.4 v2:172.21.15.178:6800/1470729243 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f38e40ac6c0 con 0x7f38d806fce0 2023-11-28T21:05:28.456 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:28.457 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T21:05:28.457 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:28.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f38d806fce0 msgr2=0x7f38d8072180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6800/1470729243,v1:172.21.15.178:6801/1470729243] conn(0x7f38d806fce0 0x7f38d8072180 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f38d8066470 msgr2=0x7f38d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f38d8066470 0x7f38d8068930 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f38f0000f70 tx=0x7f38f0009040 comp rx=0 tx=0).stop 2023-11-28T21:05:28.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40c84c0 msgr2=0x7f38f41f0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 --2- 172.21.15.167:0/1063657431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f40c84c0 0x7f38f41f0820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00efc0 tx=0x7f38ec00c490 comp rx=0 tx=0).stop 2023-11-28T21:05:28.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fa408640 1 -- 172.21.15.167:0/1063657431 reap_dead start 2023-11-28T21:05:28.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 shutdown_connections 2023-11-28T21:05:28.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 >> 172.21.15.167:0/1063657431 conn(0x7f38f406e030 msgr2=0x7f38f40c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:28.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.453+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 shutdown_connections 2023-11-28T21:05:28.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.457+0000 7f38fbe6b640 1 -- 172.21.15.167:0/1063657431 wait complete. 2023-11-28T21:05:28.473 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T21:05:28.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc57b809640 1 Processor -- start 2023-11-28T21:05:28.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc57b809640 1 -- start start 2023-11-28T21:05:28.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc57b809640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5740c2ab0 0x7fc5740c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc57b809640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc5740c64f0 0x7fc57415b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc57b809640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5740c5ac0 con 0x7fc574151d00 2023-11-28T21:05:28.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc57b809640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5740c8a10 con 0x7fc5740c2ab0 2023-11-28T21:05:28.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc57b809640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5740c6900 con 0x7fc5740c64f0 2023-11-28T21:05:28.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc578da4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc5740c2ab0 0x7fc5740c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc5795a5640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc574151d00 0x7fc5740c7ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50986/0 (socket says 172.21.15.167:50986) 2023-11-28T21:05:28.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc5795a5640 1 -- 172.21.15.167:0/1279835582 learned_addr learned my addr 172.21.15.167:0/1279835582 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:28.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc579da6640 1 --2- 172.21.15.167:0/1279835582 >> v2:172.21.15.178:3300/0 conn(0x7fc5740c64f0 0x7fc57415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc578da4640 1 -- 172.21.15.167:0/1279835582 >> v2:172.21.15.178:3300/0 conn(0x7fc5740c64f0 msgr2=0x7fc57415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:28.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc578da4640 1 --2- 172.21.15.167:0/1279835582 >> v2:172.21.15.178:3300/0 conn(0x7fc5740c64f0 0x7fc57415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc578da4640 1 -- 172.21.15.167:0/1279835582 >> v1:172.21.15.167:6789/0 conn(0x7fc574151d00 legacy=0x7fc5740c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc56bfff640 1 -- 172.21.15.167:0/1279835582 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892008400 0 0) 0x7fc5740c5ac0 con 0x7fc574151d00 2023-11-28T21:05:28.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.589+0000 7fc578da4640 1 -- 172.21.15.167:0/1279835582 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574157c50 con 0x7fc5740c2ab0 2023-11-28T21:05:28.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc578da4640 1 --2- 172.21.15.167:0/1279835582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5740c2ab0 0x7fc5740c5fb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc574067e30 tx=0x7fc56401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97939d685a63688 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc56bfff640 1 -- 172.21.15.167:0/1279835582 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640a8950 con 0x7fc5740c2ab0 2023-11-28T21:05:28.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc56bfff640 1 -- 172.21.15.167:0/1279835582 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5640a8ab0 con 0x7fc5740c2ab0 2023-11-28T21:05:28.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc56bfff640 1 -- 172.21.15.167:0/1279835582 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640a8e40 con 0x7fc5740c2ab0 2023-11-28T21:05:28.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 -- 172.21.15.167:0/1279835582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5740c2ab0 msgr2=0x7fc5740c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 --2- 172.21.15.167:0/1279835582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5740c2ab0 0x7fc5740c5fb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc574067e30 tx=0x7fc56401ec50 comp rx=0 tx=0).stop 2023-11-28T21:05:28.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 -- 172.21.15.167:0/1279835582 shutdown_connections 2023-11-28T21:05:28.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 --2- 172.21.15.167:0/1279835582 >> v2:172.21.15.178:3300/0 conn(0x7fc5740c64f0 0x7fc57415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 --2- 172.21.15.167:0/1279835582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5740c2ab0 0x7fc5740c5fb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 -- 172.21.15.167:0/1279835582 >> 172.21.15.167:0/1279835582 conn(0x7fc57406a580 msgr2=0x7fc57406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:28.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 -- 172.21.15.167:0/1279835582 shutdown_connections 2023-11-28T21:05:28.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 -- 172.21.15.167:0/1279835582 wait complete. 2023-11-28T21:05:28.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 Processor -- start 2023-11-28T21:05:28.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.593+0000 7fc57b809640 1 -- start start 2023-11-28T21:05:28.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc57b809640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5740c2ab0 0x7fc5741570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc57b809640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5740c64f0 0x7fc574149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc57b809640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc574151d00 0x7fc5741f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc57b809640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5741490b0 con 0x7fc574151d00 2023-11-28T21:05:28.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc57b809640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574148db0 con 0x7fc5740c64f0 2023-11-28T21:05:28.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc57b809640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc574156b60 con 0x7fc5740c2ab0 2023-11-28T21:05:28.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc579da6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc574151d00 0x7fc5741f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc579da6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc574151d00 0x7fc5741f0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56994/0 (socket says 172.21.15.167:56994) 2023-11-28T21:05:28.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc579da6640 1 -- 172.21.15.167:0/1632400978 learned_addr learned my addr 172.21.15.167:0/1632400978 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:28.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc578da4640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5740c64f0 0x7fc574149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc5795a5640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5740c2ab0 0x7fc5741570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc579da6640 1 -- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5740c2ab0 msgr2=0x7fc5741570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc579da6640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5740c2ab0 0x7fc5741570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc579da6640 1 -- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5740c64f0 msgr2=0x7fc574149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc579da6640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5740c64f0 0x7fc574149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc579da6640 1 -- 172.21.15.167:0/1632400978 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc564009420 con 0x7fc574151d00 2023-11-28T21:05:28.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc579da6640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc574151d00 0x7fc5741f0d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc56c007ea0 tx=0x7fc56c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc569ffb640 1 -- 172.21.15.167:0/1632400978 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c014620 con 0x7fc574151d00 2023-11-28T21:05:28.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc569ffb640 1 -- 172.21.15.167:0/1632400978 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c0147a0 con 0x7fc574151d00 2023-11-28T21:05:28.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc574143ea0 con 0x7fc574151d00 2023-11-28T21:05:28.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc569ffb640 1 -- 172.21.15.167:0/1632400978 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c014b50 con 0x7fc574151d00 2023-11-28T21:05:28.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc574144440 con 0x7fc574151d00 2023-11-28T21:05:28.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc574149260 con 0x7fc574151d00 2023-11-28T21:05:28.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc569ffb640 1 -- 172.21.15.167:0/1632400978 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc56c014cb0 con 0x7fc574151d00 2023-11-28T21:05:28.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc569ffb640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc558066470 0x7fc558068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:28.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc569ffb640 1 -- 172.21.15.167:0/1632400978 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fc56c084c80 con 0x7fc574151d00 2023-11-28T21:05:28.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.597+0000 7fc5795a5640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc558066470 0x7fc558068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:28.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.601+0000 7fc5795a5640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc558066470 0x7fc558068930 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc570000f70 tx=0x7fc570007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:28.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.601+0000 7fc569ffb640 1 -- 172.21.15.167:0/1632400978 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc574149260 con 0x7fc574151d00 2023-11-28T21:05:28.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.745+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5740c7b30 con 0x7fc558066470 2023-11-28T21:05:28.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc569ffb640 1 -- 172.21.15.167:0/1632400978 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc5740c7b30 con 0x7fc558066470 2023-11-28T21:05:28.749 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T21:05:28.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc558066470 msgr2=0x7fc558068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc558066470 0x7fc558068930 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc570000f70 tx=0x7fc570007c10 comp rx=0 tx=0).stop 2023-11-28T21:05:28.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc574151d00 msgr2=0x7fc5741f0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:28.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc574151d00 0x7fc5741f0d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc56c007ea0 tx=0x7fc56c007f90 comp rx=0 tx=0).stop 2023-11-28T21:05:28.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 shutdown_connections 2023-11-28T21:05:28.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fc558066470 0x7fc558068930 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc574151d00 0x7fc5741f0d40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5740c64f0 0x7fc574149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 --2- 172.21.15.167:0/1632400978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5740c2ab0 0x7fc5741570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:28.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 >> 172.21.15.167:0/1632400978 conn(0x7fc57406a580 msgr2=0x7fc5740c3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:28.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 shutdown_connections 2023-11-28T21:05:28.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:28.749+0000 7fc57b809640 1 -- 172.21.15.167:0/1632400978 wait complete. 2023-11-28T21:05:28.939 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T21:05:28.939 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T21:05:29.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1fdc4640 1 Processor -- start 2023-11-28T21:05:29.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1fdc4640 1 -- start start 2023-11-28T21:05:29.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1fdc4640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d18150f40 0x7f3d18162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1fdc4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d180c8e00 con 0x7f3d180c84c0 2023-11-28T21:05:29.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1fdc4640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d180c7c50 con 0x7f3d180c80e0 2023-11-28T21:05:29.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1fdc4640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d18156a00 con 0x7f3d18150f40 2023-11-28T21:05:29.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1d35f640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3d180c84c0 0x7f3d18150830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50990/0 (socket says 172.21.15.167:50990) 2023-11-28T21:05:29.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1d35f640 1 -- 172.21.15.167:0/2287127171 learned_addr learned my addr 172.21.15.167:0/2287127171 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:29.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1e361640 1 --2- 172.21.15.167:0/2287127171 >> v2:172.21.15.178:3300/0 conn(0x7f3d18150f40 0x7f3d18162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891347657 0 0) 0x7f3d180c8e00 con 0x7f3d180c84c0 2023-11-28T21:05:29.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d04003530 con 0x7f3d180c84c0 2023-11-28T21:05:29.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944683975 0 0) 0x7f3d04003530 con 0x7f3d180c84c0 2023-11-28T21:05:29.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 >> v2:172.21.15.178:3300/0 conn(0x7f3d18150f40 msgr2=0x7f3d18162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:29.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 --2- 172.21.15.167:0/2287127171 >> v2:172.21.15.178:3300/0 conn(0x7f3d18150f40 0x7f3d18162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 >> v1:172.21.15.178:6789/0 conn(0x7f3d180c80e0 legacy=0x7f3d180c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:29.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d180c7690 con 0x7f3d180c84c0 2023-11-28T21:05:29.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f3d08001680 con 0x7f3d180c84c0 2023-11-28T21:05:29.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 >> v1:172.21.15.167:6789/0 conn(0x7f3d180c84c0 legacy=0x7f3d18150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d04003980 0x7f3d04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d040047d0 0x7f3d04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d04005190 0x7f3d0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18156a00 con 0x7f3d04005190 2023-11-28T21:05:29.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0400c130 con 0x7f3d040047d0 2023-11-28T21:05:29.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0400e500 con 0x7f3d04003980 2023-11-28T21:05:29.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1e361640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d04005190 0x7f3d0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1db60640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d04003980 0x7f3d04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1e361640 1 -- 172.21.15.167:0/2287127171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d04003980 msgr2=0x7f3d04003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:29.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1e361640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d04003980 0x7f3d04003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1e361640 1 -- 172.21.15.167:0/2287127171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d040047d0 msgr2=0x7f3d04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:29.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1e361640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d040047d0 0x7f3d04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.053+0000 7f3d1e361640 1 -- 172.21.15.167:0/2287127171 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04003530 con 0x7f3d04005190 2023-11-28T21:05:29.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1e361640 1 -- 172.21.15.167:0/2287127171 reap_dead start 2023-11-28T21:05:29.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1e361640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d04005190 0x7f3d0400b990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009f90 tx=0x7f3d1001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1497152d43c04a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100a5c70 con 0x7f3d04005190 2023-11-28T21:05:29.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000f040 con 0x7f3d04005190 2023-11-28T21:05:29.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1cb5e640 1 -- 172.21.15.167:0/2287127171 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100039a0 con 0x7f3d04005190 2023-11-28T21:05:29.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/2287127171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d04005190 msgr2=0x7f3d0400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1fdc4640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d04005190 0x7f3d0400b990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009f90 tx=0x7f3d1001cc60 comp rx=0 tx=0).stop 2023-11-28T21:05:29.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/2287127171 shutdown_connections 2023-11-28T21:05:29.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1fdc4640 1 --2- 172.21.15.167:0/2287127171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d04005190 0x7f3d0400b990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/2287127171 >> 172.21.15.167:0/2287127171 conn(0x7f3d1806e030 msgr2=0x7f3d1806e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:29.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/2287127171 shutdown_connections 2023-11-28T21:05:29.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/2287127171 wait complete. 2023-11-28T21:05:29.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1fdc4640 1 Processor -- start 2023-11-28T21:05:29.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.057+0000 7f3d1fdc4640 1 -- start start 2023-11-28T21:05:29.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1fdc4640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d04005190 0x7f3d18152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1fdc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d181483d0 0x7f3d18147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1fdc4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1814a330 0x7f3d1814a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1fdc4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18149db0 con 0x7f3d181483d0 2023-11-28T21:05:29.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1fdc4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18147bf0 con 0x7f3d1814a330 2023-11-28T21:05:29.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1fdc4640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d181481b0 con 0x7f3d04005190 2023-11-28T21:05:29.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1d35f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d181483d0 0x7f3d18147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1d35f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d181483d0 0x7f3d18147100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57002/0 (socket says 172.21.15.167:57002) 2023-11-28T21:05:29.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1d35f640 1 -- 172.21.15.167:0/834118369 learned_addr learned my addr 172.21.15.167:0/834118369 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:29.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1db60640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d04005190 0x7f3d18152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1e361640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1814a330 0x7f3d1814a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1d35f640 1 -- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d04005190 msgr2=0x7f3d18152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1d35f640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d04005190 0x7f3d18152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1d35f640 1 -- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1814a330 msgr2=0x7f3d1814a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1d35f640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d1814a330 0x7f3d1814a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1d35f640 1 -- 172.21.15.167:0/834118369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d181514a0 con 0x7f3d181483d0 2023-11-28T21:05:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1d35f640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d181483d0 0x7f3d18147100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800f370 tx=0x7f3d0800f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d0e7fc640 1 -- 172.21.15.167:0/834118369 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d08007d00 con 0x7f3d181483d0 2023-11-28T21:05:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d0e7fc640 1 -- 172.21.15.167:0/834118369 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d08007e80 con 0x7f3d181483d0 2023-11-28T21:05:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d18151780 con 0x7f3d181483d0 2023-11-28T21:05:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d0e7fc640 1 -- 172.21.15.167:0/834118369 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800a310 con 0x7f3d181483d0 2023-11-28T21:05:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d18152a50 con 0x7f3d181483d0 2023-11-28T21:05:29.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d18148010 con 0x7f3d181483d0 2023-11-28T21:05:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d0e7fc640 1 -- 172.21.15.167:0/834118369 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d0800a470 con 0x7f3d181483d0 2023-11-28T21:05:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d0e7fc640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cfc066470 0x7f3cfc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d0e7fc640 1 -- 172.21.15.167:0/834118369 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f3d08086ef0 con 0x7f3d181483d0 2023-11-28T21:05:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d0e7fc640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7f3cfc06fe50 0x7f3cfc0722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d0e7fc640 1 -- 172.21.15.167:0/834118369 --> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3cfc0729c0 con 0x7f3cfc06fe50 2023-11-28T21:05:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d0e7fc640 1 -- 172.21.15.167:0/834118369 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d080895b0 con 0x7f3d181483d0 2023-11-28T21:05:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1db60640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cfc066470 0x7f3cfc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.061+0000 7f3d1e361640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7f3cfc06fe50 0x7f3cfc0722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.065+0000 7f3d1db60640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cfc066470 0x7f3cfc068930 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3d14007fd0 tx=0x7f3d14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.065+0000 7f3d1e361640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7f3cfc06fe50 0x7f3cfc0722f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.065+0000 7f3d0e7fc640 1 -- 172.21.15.167:0/834118369 <== osd.5 v2:172.21.15.178:6816/929221892 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3cfc0729c0 con 0x7f3cfc06fe50 2023-11-28T21:05:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 --> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3d180c2d00 con 0x7f3cfc06fe50 2023-11-28T21:05:29.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d0e7fc640 1 -- 172.21.15.167:0/834118369 <== osd.5 v2:172.21.15.178:6816/929221892 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3d100039a0 con 0x7f3cfc06fe50 2023-11-28T21:05:29.210 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:29.210 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T21:05:29.210 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7f3cfc06fe50 msgr2=0x7f3cfc0722f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6816/929221892,v1:172.21.15.178:6818/929221892] conn(0x7f3cfc06fe50 0x7f3cfc0722f0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cfc066470 msgr2=0x7f3cfc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3cfc066470 0x7f3cfc068930 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3d14007fd0 tx=0x7f3d14009040 comp rx=0 tx=0).stop 2023-11-28T21:05:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d181483d0 msgr2=0x7f3d18147100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 --2- 172.21.15.167:0/834118369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d181483d0 0x7f3d18147100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800f370 tx=0x7f3d0800f830 comp rx=0 tx=0).stop 2023-11-28T21:05:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1e361640 1 -- 172.21.15.167:0/834118369 reap_dead start 2023-11-28T21:05:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 shutdown_connections 2023-11-28T21:05:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 >> 172.21.15.167:0/834118369 conn(0x7f3d1806e030 msgr2=0x7f3d1806e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 shutdown_connections 2023-11-28T21:05:29.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.077+0000 7f3d1fdc4640 1 -- 172.21.15.167:0/834118369 wait complete. 2023-11-28T21:05:29.213 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T21:05:29.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976f316640 1 Processor -- start 2023-11-28T21:05:29.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976f316640 1 -- start start 2023-11-28T21:05:29.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976f316640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 0x7f97680cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976f316640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97680cfc40 0x7f97680ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976f316640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9768153ae0 0x7f9768153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976f316640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9768154470 con 0x7f9768153ae0 2023-11-28T21:05:29.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976f316640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976815ac00 con 0x7f97680cfc40 2023-11-28T21:05:29.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976f316640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97680cbd60 con 0x7f97680cf860 2023-11-28T21:05:29.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d8b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9768153ae0 0x7f9768153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d8b3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9768153ae0 0x7f9768153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57016/0 (socket says 172.21.15.167:57016) 2023-11-28T21:05:29.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d8b3640 1 -- 172.21.15.167:0/2999352969 learned_addr learned my addr 172.21.15.167:0/2999352969 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:29.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976c8b1640 1 --2- 172.21.15.167:0/2999352969 >> v2:172.21.15.178:3300/0 conn(0x7f97680cfc40 0x7f97680ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d0b2640 1 --2- 172.21.15.167:0/2999352969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 0x7f97680cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d8b3640 1 -- 172.21.15.167:0/2999352969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 msgr2=0x7f97680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:29.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d8b3640 1 --2- 172.21.15.167:0/2999352969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 0x7f97680cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d8b3640 1 -- 172.21.15.167:0/2999352969 >> v2:172.21.15.178:3300/0 conn(0x7f97680cfc40 msgr2=0x7f97680ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:29.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d8b3640 1 --2- 172.21.15.167:0/2999352969 >> v2:172.21.15.178:3300/0 conn(0x7f97680cfc40 0x7f97680ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d8b3640 1 -- 172.21.15.167:0/2999352969 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768159ff0 con 0x7f9768153ae0 2023-11-28T21:05:29.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.321+0000 7f976d0b2640 1 --2- 172.21.15.167:0/2999352969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 0x7f97680cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:05:29.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976d8b3640 1 --2- 172.21.15.167:0/2999352969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 0x7f9768153f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97680cd1c0 tx=0x7f976001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38391ab0792ac57d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f975ffff640 1 -- 172.21.15.167:0/2999352969 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600a5820 con 0x7f9768153ae0 2023-11-28T21:05:29.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f975ffff640 1 -- 172.21.15.167:0/2999352969 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97600a5980 con 0x7f9768153ae0 2023-11-28T21:05:29.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f975ffff640 1 -- 172.21.15.167:0/2999352969 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600a5d10 con 0x7f9768153ae0 2023-11-28T21:05:29.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 -- 172.21.15.167:0/2999352969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 msgr2=0x7f9768153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 --2- 172.21.15.167:0/2999352969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 0x7f9768153f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97680cd1c0 tx=0x7f976001c9a0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 -- 172.21.15.167:0/2999352969 shutdown_connections 2023-11-28T21:05:29.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 --2- 172.21.15.167:0/2999352969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 0x7f9768153f30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 --2- 172.21.15.167:0/2999352969 >> v2:172.21.15.178:3300/0 conn(0x7f97680cfc40 0x7f97680ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 --2- 172.21.15.167:0/2999352969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 0x7f97680cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 -- 172.21.15.167:0/2999352969 >> 172.21.15.167:0/2999352969 conn(0x7f976806c1f0 msgr2=0x7f9768071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 -- 172.21.15.167:0/2999352969 shutdown_connections 2023-11-28T21:05:29.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 -- 172.21.15.167:0/2999352969 wait complete. 2023-11-28T21:05:29.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 Processor -- start 2023-11-28T21:05:29.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 -- start start 2023-11-28T21:05:29.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 0x7f9768159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.325+0000 7f976f316640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97680cfc40 0x7f9768152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976f316640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 0x7f9768148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976f316640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768157ee0 con 0x7f9768153ae0 2023-11-28T21:05:29.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976f316640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768149740 con 0x7f97680cfc40 2023-11-28T21:05:29.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976f316640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976815bc10 con 0x7f97680cf860 2023-11-28T21:05:29.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d8b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 0x7f9768148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d8b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 0x7f9768148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57032/0 (socket says 172.21.15.167:57032) 2023-11-28T21:05:29.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d8b3640 1 -- 172.21.15.167:0/539144121 learned_addr learned my addr 172.21.15.167:0/539144121 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:29.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976c8b1640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97680cfc40 0x7f9768152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d0b2640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 0x7f9768159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d8b3640 1 -- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 msgr2=0x7f9768159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d8b3640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 0x7f9768159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d8b3640 1 -- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97680cfc40 msgr2=0x7f9768152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d8b3640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97680cfc40 0x7f9768152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d8b3640 1 -- 172.21.15.167:0/539144121 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009b30 con 0x7f9768153ae0 2023-11-28T21:05:29.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d8b3640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 0x7f9768148230 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f97600af040 tx=0x7f9760019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f975dffb640 1 -- 172.21.15.167:0/539144121 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600a5cf0 con 0x7f9768153ae0 2023-11-28T21:05:29.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f975dffb640 1 -- 172.21.15.167:0/539144121 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97600a5e90 con 0x7f9768153ae0 2023-11-28T21:05:29.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976815c0a0 con 0x7f9768153ae0 2023-11-28T21:05:29.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f975dffb640 1 -- 172.21.15.167:0/539144121 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600b86b0 con 0x7f9768153ae0 2023-11-28T21:05:29.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976815b000 con 0x7f9768153ae0 2023-11-28T21:05:29.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976815adb0 con 0x7f9768153ae0 2023-11-28T21:05:29.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f975dffb640 1 -- 172.21.15.167:0/539144121 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97600b8810 con 0x7f9768153ae0 2023-11-28T21:05:29.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f975dffb640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f974c0664a0 0x7f974c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f975dffb640 1 -- 172.21.15.167:0/539144121 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f976011f490 con 0x7f9768153ae0 2023-11-28T21:05:29.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.329+0000 7f976d0b2640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f974c0664a0 0x7f974c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.333+0000 7f976d0b2640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f974c0664a0 0x7f974c068960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9764006b20 tx=0x7f9764008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.333+0000 7f975dffb640 1 -- 172.21.15.167:0/539144121 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97600ec5b0 con 0x7f9768153ae0 2023-11-28T21:05:29.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f97680caa50 con 0x7f974c0664a0 2023-11-28T21:05:29.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f975dffb640 1 -- 172.21.15.167:0/539144121 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f976400c050 con 0x7f974c0664a0 2023-11-28T21:05:29.483 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T21:05:29.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f974c0664a0 msgr2=0x7f974c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f974c0664a0 0x7f974c068960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9764006b20 tx=0x7f9764008040 comp rx=0 tx=0).stop 2023-11-28T21:05:29.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 msgr2=0x7f9768148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 0x7f9768148230 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f97600af040 tx=0x7f9760019740 comp rx=0 tx=0).stop 2023-11-28T21:05:29.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 shutdown_connections 2023-11-28T21:05:29.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f974c0664a0 0x7f974c068960 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9768153ae0 0x7f9768148230 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97680cfc40 0x7f9768152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 --2- 172.21.15.167:0/539144121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97680cf860 0x7f9768159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 >> 172.21.15.167:0/539144121 conn(0x7f976806c1f0 msgr2=0x7f97680cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:29.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 shutdown_connections 2023-11-28T21:05:29.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.481+0000 7f976f316640 1 -- 172.21.15.167:0/539144121 wait complete. 2023-11-28T21:05:29.501 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T21:05:29.501 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T21:05:29.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa453b8640 1 Processor -- start 2023-11-28T21:05:29.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa453b8640 1 -- start start 2023-11-28T21:05:29.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa453b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa400ca6b0 0x7faa40159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa453b8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faa400c5c90 0x7faa400c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa453b8640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400cbd40 con 0x7faa40154220 2023-11-28T21:05:29.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa453b8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa400c6660 con 0x7faa400c5c90 2023-11-28T21:05:29.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa453b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa40154600 con 0x7faa400ca6b0 2023-11-28T21:05:29.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa3e7fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa400ca6b0 0x7faa40159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa3f7fe640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faa400c5c90 0x7faa400c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa3e7fc640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa400ca6b0 0x7faa40159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.167:56884/0 (socket says 172.21.15.167:56884) 2023-11-28T21:05:29.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa3e7fc640 1 -- 172.21.15.167:0/2960234630 learned_addr learned my addr 172.21.15.167:0/2960234630 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:29.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa3e7fc640 1 -- 172.21.15.167:0/2960234630 >> v2:172.21.15.178:3300/0 conn(0x7faa400c5c90 msgr2=0x7faa400c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:29.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa3e7fc640 1 --2- 172.21.15.167:0/2960234630 >> v2:172.21.15.178:3300/0 conn(0x7faa400c5c90 0x7faa400c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa3e7fc640 1 -- 172.21.15.167:0/2960234630 >> v1:172.21.15.178:6789/0 conn(0x7faa40154220 legacy=0x7faa400cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.613+0000 7faa3e7fc640 1 -- 172.21.15.167:0/2960234630 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4015ade0 con 0x7faa400ca6b0 2023-11-28T21:05:29.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa3e7fc640 1 --2- 172.21.15.167:0/2960234630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa400ca6b0 0x7faa40159eb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa34009870 tx=0x7faa3401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd60cc83e6a58a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa3dffb640 1 -- 172.21.15.167:0/2960234630 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340a8a30 con 0x7faa400ca6b0 2023-11-28T21:05:29.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa3dffb640 1 -- 172.21.15.167:0/2960234630 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa340a8b90 con 0x7faa400ca6b0 2023-11-28T21:05:29.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa3dffb640 1 -- 172.21.15.167:0/2960234630 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340b0440 con 0x7faa400ca6b0 2023-11-28T21:05:29.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa453b8640 1 -- 172.21.15.167:0/2960234630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa400ca6b0 msgr2=0x7faa40159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa453b8640 1 --2- 172.21.15.167:0/2960234630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa400ca6b0 0x7faa40159eb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa34009870 tx=0x7faa3401ed30 comp rx=0 tx=0).stop 2023-11-28T21:05:29.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa453b8640 1 -- 172.21.15.167:0/2960234630 shutdown_connections 2023-11-28T21:05:29.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa453b8640 1 --2- 172.21.15.167:0/2960234630 >> v2:172.21.15.178:3300/0 conn(0x7faa400c5c90 0x7faa400c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa453b8640 1 --2- 172.21.15.167:0/2960234630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa400ca6b0 0x7faa40159eb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa453b8640 1 -- 172.21.15.167:0/2960234630 >> 172.21.15.167:0/2960234630 conn(0x7faa4006c440 msgr2=0x7faa40071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:29.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa453b8640 1 -- 172.21.15.167:0/2960234630 shutdown_connections 2023-11-28T21:05:29.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.617+0000 7faa453b8640 1 -- 172.21.15.167:0/2960234630 wait complete. 2023-11-28T21:05:29.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 Processor -- start 2023-11-28T21:05:29.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 -- start start 2023-11-28T21:05:29.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa400c5c90 0x7faa4015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa400ca6b0 0x7faa401593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa40154220 0x7faa4015bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa401598f0 con 0x7faa400ca6b0 2023-11-28T21:05:29.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4015c330 con 0x7faa400c5c90 2023-11-28T21:05:29.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa40158f20 con 0x7faa40154220 2023-11-28T21:05:29.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa400ca6b0 0x7faa401593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa400ca6b0 0x7faa401593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57040/0 (socket says 172.21.15.167:57040) 2023-11-28T21:05:29.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3e7fc640 1 -- 172.21.15.167:0/2377756200 learned_addr learned my addr 172.21.15.167:0/2377756200 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:29.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3effd640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa400c5c90 0x7faa4015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3f7fe640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa40154220 0x7faa4015bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3e7fc640 1 -- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa40154220 msgr2=0x7faa4015bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3e7fc640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa40154220 0x7faa4015bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3e7fc640 1 -- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa400c5c90 msgr2=0x7faa4015c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3e7fc640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa400c5c90 0x7faa4015c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3e7fc640 1 -- 172.21.15.167:0/2377756200 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa340094d0 con 0x7faa400ca6b0 2023-11-28T21:05:29.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa3e7fc640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa400ca6b0 0x7faa401593b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa34000c10 tx=0x7faa3401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa277fe640 1 -- 172.21.15.167:0/2377756200 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340bf070 con 0x7faa400ca6b0 2023-11-28T21:05:29.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa277fe640 1 -- 172.21.15.167:0/2377756200 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa340b1be0 con 0x7faa400ca6b0 2023-11-28T21:05:29.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa277fe640 1 -- 172.21.15.167:0/2377756200 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340b9410 con 0x7faa400ca6b0 2023-11-28T21:05:29.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa40159d40 con 0x7faa400ca6b0 2023-11-28T21:05:29.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa401588d0 con 0x7faa400ca6b0 2023-11-28T21:05:29.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa40151690 con 0x7faa400ca6b0 2023-11-28T21:05:29.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa277fe640 1 -- 172.21.15.167:0/2377756200 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa340b7040 con 0x7faa400ca6b0 2023-11-28T21:05:29.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.621+0000 7faa277fe640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 0x7faa2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.625+0000 7faa277fe640 1 -- 172.21.15.167:0/2377756200 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7faa341221f0 con 0x7faa400ca6b0 2023-11-28T21:05:29.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.625+0000 7faa277fe640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7faa2c06fe50 0x7faa2c0722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.625+0000 7faa277fe640 1 -- 172.21.15.167:0/2377756200 --> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa2c0729c0 con 0x7faa2c06fe50 2023-11-28T21:05:29.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.625+0000 7faa277fe640 1 -- 172.21.15.167:0/2377756200 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa34122640 con 0x7faa400ca6b0 2023-11-28T21:05:29.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.625+0000 7faa3effd640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 0x7faa2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.625+0000 7faa3f7fe640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7faa2c06fe50 0x7faa2c0722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.625+0000 7faa3effd640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 0x7faa2c068930 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7faa300015b0 tx=0x7faa30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.625+0000 7faa3f7fe640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7faa2c06fe50 0x7faa2c0722f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.625+0000 7faa277fe640 1 -- 172.21.15.167:0/2377756200 <== osd.6 v2:172.21.15.178:6817/1489101033 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7faa2c0729c0 con 0x7faa2c06fe50 2023-11-28T21:05:29.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.637+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 --> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faa4015ab00 con 0x7faa2c06fe50 2023-11-28T21:05:29.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.637+0000 7faa277fe640 1 -- 172.21.15.167:0/2377756200 <== osd.6 v2:172.21.15.178:6817/1489101033 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7faa3800f040 con 0x7faa2c06fe50 2023-11-28T21:05:29.641 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:29.641 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T21:05:29.641 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:29.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7faa2c06fe50 msgr2=0x7faa2c0722f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6817/1489101033,v1:172.21.15.178:6819/1489101033] conn(0x7faa2c06fe50 0x7faa2c0722f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 msgr2=0x7faa2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7faa2c066470 0x7faa2c068930 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7faa300015b0 tx=0x7faa30009040 comp rx=0 tx=0).stop 2023-11-28T21:05:29.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa400ca6b0 msgr2=0x7faa401593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 --2- 172.21.15.167:0/2377756200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa400ca6b0 0x7faa401593b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa34000c10 tx=0x7faa3401bad0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa3f7fe640 1 -- 172.21.15.167:0/2377756200 reap_dead start 2023-11-28T21:05:29.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 shutdown_connections 2023-11-28T21:05:29.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 >> 172.21.15.167:0/2377756200 conn(0x7faa4006c440 msgr2=0x7faa40071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:29.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 shutdown_connections 2023-11-28T21:05:29.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.641+0000 7faa453b8640 1 -- 172.21.15.167:0/2377756200 wait complete. 2023-11-28T21:05:29.657 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T21:05:29.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd3f9d640 1 Processor -- start 2023-11-28T21:05:29.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd3f9d640 1 -- start start 2023-11-28T21:05:29.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd3f9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6ccc0b0150 0x7f6ccc06b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd3f9d640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6ccc154100 0x7f6ccc06bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd3f9d640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc0c87a0 con 0x7f6ccc153d20 2023-11-28T21:05:29.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd3f9d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc070aa0 con 0x7f6ccc0b0150 2023-11-28T21:05:29.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd3f9d640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc0c8220 con 0x7f6ccc154100 2023-11-28T21:05:29.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd1538640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6ccc0b0150 0x7f6ccc06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd1538640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6ccc0b0150 0x7f6ccc06b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57050/0 (socket says 172.21.15.167:57050) 2023-11-28T21:05:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd1538640 1 -- 172.21.15.167:0/2196656641 learned_addr learned my addr 172.21.15.167:0/2196656641 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd253a640 1 --2- 172.21.15.167:0/2196656641 >> v2:172.21.15.178:3300/0 conn(0x7f6ccc154100 0x7f6ccc06bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd1538640 1 -- 172.21.15.167:0/2196656641 >> v2:172.21.15.178:3300/0 conn(0x7f6ccc154100 msgr2=0x7f6ccc06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd1538640 1 --2- 172.21.15.167:0/2196656641 >> v2:172.21.15.178:3300/0 conn(0x7f6ccc154100 0x7f6ccc06bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd1538640 1 -- 172.21.15.167:0/2196656641 >> v1:172.21.15.178:6789/0 conn(0x7f6ccc153d20 legacy=0x7f6ccc15d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:29.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd1538640 1 -- 172.21.15.167:0/2196656641 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc154570 con 0x7f6ccc0b0150 2023-11-28T21:05:29.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.765+0000 7f6cd253a640 1 --2- 172.21.15.167:0/2196656641 >> v2:172.21.15.178:3300/0 conn(0x7f6ccc154100 0x7f6ccc06bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:05:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd1538640 1 --2- 172.21.15.167:0/2196656641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc0b0150 0x7f6ccc06b690 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0cb530 tx=0x7f6cbc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b9d27d526f25e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd0d37640 1 -- 172.21.15.167:0/2196656641 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0ac600 con 0x7f6ccc0b0150 2023-11-28T21:05:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd0d37640 1 -- 172.21.15.167:0/2196656641 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc0a8050 con 0x7f6ccc0b0150 2023-11-28T21:05:29.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd0d37640 1 -- 172.21.15.167:0/2196656641 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0ac980 con 0x7f6ccc0b0150 2023-11-28T21:05:29.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/2196656641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc0b0150 msgr2=0x7f6ccc06b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 --2- 172.21.15.167:0/2196656641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc0b0150 0x7f6ccc06b690 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0cb530 tx=0x7f6cbc01c490 comp rx=0 tx=0).stop 2023-11-28T21:05:29.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/2196656641 shutdown_connections 2023-11-28T21:05:29.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 --2- 172.21.15.167:0/2196656641 >> v2:172.21.15.178:3300/0 conn(0x7f6ccc154100 0x7f6ccc06bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 --2- 172.21.15.167:0/2196656641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc0b0150 0x7f6ccc06b690 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/2196656641 >> 172.21.15.167:0/2196656641 conn(0x7f6ccc0669b0 msgr2=0x7f6ccc0cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:29.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/2196656641 shutdown_connections 2023-11-28T21:05:29.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/2196656641 wait complete. 2023-11-28T21:05:29.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 Processor -- start 2023-11-28T21:05:29.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 -- start start 2023-11-28T21:05:29.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ccc0b0150 0x7f6ccc1f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ccc153d20 0x7f6ccc0ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc154100 0x7f6ccc0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0b0b50 con 0x7f6ccc154100 2023-11-28T21:05:29.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc1f3450 con 0x7f6ccc153d20 2023-11-28T21:05:29.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd3f9d640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0ae7f0 con 0x7f6ccc0b0150 2023-11-28T21:05:29.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd253a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc154100 0x7f6ccc0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd253a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc154100 0x7f6ccc0b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57060/0 (socket says 172.21.15.167:57060) 2023-11-28T21:05:29.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd253a640 1 -- 172.21.15.167:0/3142743099 learned_addr learned my addr 172.21.15.167:0/3142743099 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:29.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd1538640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ccc153d20 0x7f6ccc0ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.769+0000 7f6cd1d39640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ccc0b0150 0x7f6ccc1f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd253a640 1 -- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ccc0b0150 msgr2=0x7f6ccc1f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd253a640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ccc0b0150 0x7f6ccc1f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd253a640 1 -- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ccc153d20 msgr2=0x7f6ccc0ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd253a640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ccc153d20 0x7f6ccc0ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd253a640 1 -- 172.21.15.167:0/3142743099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0094d0 con 0x7f6ccc154100 2023-11-28T21:05:29.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd253a640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc154100 0x7f6ccc0b2360 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4007ed0 tx=0x7f6cc400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cc27fc640 1 -- 172.21.15.167:0/3142743099 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4003ba0 con 0x7f6ccc154100 2023-11-28T21:05:29.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cc27fc640 1 -- 172.21.15.167:0/3142743099 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc400f040 con 0x7f6ccc154100 2023-11-28T21:05:29.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc15dc10 con 0x7f6ccc154100 2023-11-28T21:05:29.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cc27fc640 1 -- 172.21.15.167:0/3142743099 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400de80 con 0x7f6ccc154100 2023-11-28T21:05:29.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc0b3400 con 0x7f6ccc154100 2023-11-28T21:05:29.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc067c00 con 0x7f6ccc154100 2023-11-28T21:05:29.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cc27fc640 1 -- 172.21.15.167:0/3142743099 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6cc4004030 con 0x7f6ccc154100 2023-11-28T21:05:29.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cc27fc640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6cb0066470 0x7f6cb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:29.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cc27fc640 1 -- 172.21.15.167:0/3142743099 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f6cc4084590 con 0x7f6ccc154100 2023-11-28T21:05:29.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd1d39640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6cb0066470 0x7f6cb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:29.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.773+0000 7f6cd1d39640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6cb0066470 0x7f6cb0068930 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800b810 tx=0x7f6cc8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:29.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.777+0000 7f6cc27fc640 1 -- 172.21.15.167:0/3142743099 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6cc4051590 con 0x7f6ccc154100 2023-11-28T21:05:29.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ccc070580 con 0x7f6cb0066470 2023-11-28T21:05:29.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cc27fc640 1 -- 172.21.15.167:0/3142743099 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6cc800b400 con 0x7f6cb0066470 2023-11-28T21:05:29.926 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T21:05:29.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6cb0066470 msgr2=0x7f6cb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6cb0066470 0x7f6cb0068930 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800b810 tx=0x7f6cc8008040 comp rx=0 tx=0).stop 2023-11-28T21:05:29.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc154100 msgr2=0x7f6ccc0b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:29.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc154100 0x7f6ccc0b2360 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4007ed0 tx=0x7f6cc400d4a0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 shutdown_connections 2023-11-28T21:05:29.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6cb0066470 0x7f6cb0068930 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ccc154100 0x7f6ccc0b2360 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ccc153d20 0x7f6ccc0ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 --2- 172.21.15.167:0/3142743099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ccc0b0150 0x7f6ccc1f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:29.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 >> 172.21.15.167:0/3142743099 conn(0x7f6ccc0669b0 msgr2=0x7f6ccc0caa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:29.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 shutdown_connections 2023-11-28T21:05:29.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:29.921+0000 7f6cd3f9d640 1 -- 172.21.15.167:0/3142743099 wait complete. 2023-11-28T21:05:29.941 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T21:05:29.942 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T21:05:29.974 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:05:29.986 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:05:30.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.061+0000 7f16e03f5640 1 Processor -- start 2023-11-28T21:05:30.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.061+0000 7f16e03f5640 1 -- start start 2023-11-28T21:05:30.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.061+0000 7f16e03f5640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f16d80cfc40 0x7f16d80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.061+0000 7f16e03f5640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d815ac00 con 0x7f16d80cf860 2023-11-28T21:05:30.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.061+0000 7f16e03f5640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d80cbd60 con 0x7f16d8153ae0 2023-11-28T21:05:30.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.061+0000 7f16e03f5640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d8159ff0 con 0x7f16d80cfc40 2023-11-28T21:05:30.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.061+0000 7f16de191640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f16d80cf860 0x7f16d80ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51006/0 (socket says 172.21.15.167:51006) 2023-11-28T21:05:30.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.061+0000 7f16de191640 1 -- 172.21.15.167:0/2160453174 learned_addr learned my addr 172.21.15.167:0/2160453174 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:30.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd990640 1 --2- 172.21.15.167:0/2160453174 >> v2:172.21.15.178:3300/0 conn(0x7f16d80cfc40 0x7f16d80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391589253 0 0) 0x7f16d815ac00 con 0x7f16d80cf860 2023-11-28T21:05:30.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c4003530 con 0x7f16d80cf860 2023-11-28T21:05:30.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2153766688 0 0) 0x7f16c4003530 con 0x7f16d80cf860 2023-11-28T21:05:30.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 >> v2:172.21.15.178:3300/0 conn(0x7f16d80cfc40 msgr2=0x7f16d80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:30.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 --2- 172.21.15.167:0/2160453174 >> v2:172.21.15.178:3300/0 conn(0x7f16d80cfc40 0x7f16d80cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 >> v1:172.21.15.178:6789/0 conn(0x7f16d8153ae0 legacy=0x7f16d815d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d815a2d0 con 0x7f16d80cf860 2023-11-28T21:05:30.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f16d4001a00 con 0x7f16d80cf860 2023-11-28T21:05:30.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 >> v1:172.21.15.167:6789/0 conn(0x7f16d80cf860 legacy=0x7f16d80ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16c4003980 0x7f16c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16c40047d0 0x7f16c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4005190 0x7f16c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d8159ff0 con 0x7f16c4005190 2023-11-28T21:05:30.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c400c030 con 0x7f16c4003980 2023-11-28T21:05:30.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c400c1f0 con 0x7f16c40047d0 2023-11-28T21:05:30.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16de992640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4005190 0x7f16c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16de191640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16c4003980 0x7f16c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd990640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16c40047d0 0x7f16c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16de992640 1 -- 172.21.15.167:0/2160453174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16c40047d0 msgr2=0x7f16c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:30.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16de992640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16c40047d0 0x7f16c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16de992640 1 -- 172.21.15.167:0/2160453174 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16c4003980 msgr2=0x7f16c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:30.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16de992640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16c4003980 0x7f16c4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16de992640 1 -- 172.21.15.167:0/2160453174 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c4003530 con 0x7f16c4005190 2023-11-28T21:05:30.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16de992640 1 -- 172.21.15.167:0/2160453174 reap_dead start 2023-11-28T21:05:30.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16de992640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4005190 0x7f16c400b990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f16d0001780 tx=0x7f16d001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa31b131c01303e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d00052d0 con 0x7f16c4005190 2023-11-28T21:05:30.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d00a7050 con 0x7f16c4005190 2023-11-28T21:05:30.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.065+0000 7f16dd18f640 1 -- 172.21.15.167:0/2160453174 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0003600 con 0x7f16c4005190 2023-11-28T21:05:30.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- 172.21.15.167:0/2160453174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4005190 msgr2=0x7f16c400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4005190 0x7f16c400b990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f16d0001780 tx=0x7f16d001c400 comp rx=0 tx=0).stop 2023-11-28T21:05:30.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- 172.21.15.167:0/2160453174 shutdown_connections 2023-11-28T21:05:30.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 --2- 172.21.15.167:0/2160453174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c4005190 0x7f16c400b990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- 172.21.15.167:0/2160453174 >> 172.21.15.167:0/2160453174 conn(0x7f16d806c1f0 msgr2=0x7f16d8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:30.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- 172.21.15.167:0/2160453174 shutdown_connections 2023-11-28T21:05:30.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- 172.21.15.167:0/2160453174 wait complete. 2023-11-28T21:05:30.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 Processor -- start 2023-11-28T21:05:30.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- start start 2023-11-28T21:05:30.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16c4005190 0x7f16d80cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16d81572e0 0x7f16d8147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d80b5410 0x7f16d8148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d8157890 con 0x7f16d80b5410 2023-11-28T21:05:30.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d81586b0 con 0x7f16c4005190 2023-11-28T21:05:30.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d8157aa0 con 0x7f16d81572e0 2023-11-28T21:05:30.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de992640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d80b5410 0x7f16d8148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de992640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d80b5410 0x7f16d8148460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57066/0 (socket says 172.21.15.167:57066) 2023-11-28T21:05:30.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de992640 1 -- 172.21.15.167:0/2825860086 learned_addr learned my addr 172.21.15.167:0/2825860086 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:30.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16dd990640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16d81572e0 0x7f16d8147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de191640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16c4005190 0x7f16d80cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de992640 1 -- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16d81572e0 msgr2=0x7f16d8147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de992640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16d81572e0 0x7f16d8147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de992640 1 -- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16c4005190 msgr2=0x7f16d80cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de992640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16c4005190 0x7f16d80cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de992640 1 -- 172.21.15.167:0/2825860086 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8157d80 con 0x7f16d80b5410 2023-11-28T21:05:30.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16de992640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d80b5410 0x7f16d8148460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f16d001c230 tx=0x7f16c4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16ceffd640 1 -- 172.21.15.167:0/2825860086 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d00b0070 con 0x7f16d80b5410 2023-11-28T21:05:30.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16ceffd640 1 -- 172.21.15.167:0/2825860086 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d0007a40 con 0x7f16d80b5410 2023-11-28T21:05:30.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d8158060 con 0x7f16d80b5410 2023-11-28T21:05:30.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16ceffd640 1 -- 172.21.15.167:0/2825860086 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0004d10 con 0x7f16d80b5410 2023-11-28T21:05:30.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d80b4770 con 0x7f16d80b5410 2023-11-28T21:05:30.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.069+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16d8158510 con 0x7f16d80b5410 2023-11-28T21:05:30.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16ceffd640 1 -- 172.21.15.167:0/2825860086 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16d0007030 con 0x7f16d80b5410 2023-11-28T21:05:30.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16ceffd640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16bc066470 0x7f16bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16ceffd640 1 -- 172.21.15.167:0/2825860086 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f16d011d820 con 0x7f16d80b5410 2023-11-28T21:05:30.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16ceffd640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f16bc06fe50 0x7f16bc0722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16ceffd640 1 -- 172.21.15.167:0/2825860086 --> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16bc0729c0 con 0x7f16bc06fe50 2023-11-28T21:05:30.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16de191640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16bc066470 0x7f16bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16ceffd640 1 -- 172.21.15.167:0/2825860086 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d011dc70 con 0x7f16d80b5410 2023-11-28T21:05:30.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16dd990640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f16bc06fe50 0x7f16bc0722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16dd990640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f16bc06fe50 0x7f16bc0722f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16de191640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16bc066470 0x7f16bc068930 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f16d4004d10 tx=0x7f16d4006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.073+0000 7f16ceffd640 1 -- 172.21.15.167:0/2825860086 <== osd.7 v2:172.21.15.178:6808/98078411 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f16bc0729c0 con 0x7f16bc06fe50 2023-11-28T21:05:30.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.085+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 --> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f16d8159cc0 con 0x7f16bc06fe50 2023-11-28T21:05:30.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16ceffd640 1 -- 172.21.15.167:0/2825860086 <== osd.7 v2:172.21.15.178:6808/98078411 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f16c8009b90 con 0x7f16bc06fe50 2023-11-28T21:05:30.089 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-11-28T21:05:30.090 INFO:teuthology.orchestra.run.smithi167.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T21:05:30.090 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-11-28T21:05:30.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f16bc06fe50 msgr2=0x7f16bc0722f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6808/98078411,v1:172.21.15.178:6809/98078411] conn(0x7f16bc06fe50 0x7f16bc0722f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16bc066470 msgr2=0x7f16bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f16bc066470 0x7f16bc068930 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f16d4004d10 tx=0x7f16d4006040 comp rx=0 tx=0).stop 2023-11-28T21:05:30.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d80b5410 msgr2=0x7f16d8148460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 --2- 172.21.15.167:0/2825860086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16d80b5410 0x7f16d8148460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f16d001c230 tx=0x7f16c4005800 comp rx=0 tx=0).stop 2023-11-28T21:05:30.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16de992640 1 -- 172.21.15.167:0/2825860086 reap_dead start 2023-11-28T21:05:30.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 shutdown_connections 2023-11-28T21:05:30.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 >> 172.21.15.167:0/2825860086 conn(0x7f16d806c1f0 msgr2=0x7f16d80ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:30.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 shutdown_connections 2023-11-28T21:05:30.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.089+0000 7f16e03f5640 1 -- 172.21.15.167:0/2825860086 wait complete. 2023-11-28T21:05:30.105 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T21:05:30.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae270d6640 1 Processor -- start 2023-11-28T21:05:30.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae270d6640 1 -- start start 2023-11-28T21:05:30.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae270d6640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae2014e710 0x7fae200c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae270d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae20159040 0x7fae201594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae270d6640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae20159a10 con 0x7fae200c97c0 2023-11-28T21:05:30.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae270d6640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200c69e0 con 0x7fae2014e710 2023-11-28T21:05:30.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae270d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae20157ea0 con 0x7fae20159040 2023-11-28T21:05:30.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae24e72640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae2014e710 0x7fae200c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae25673640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae20159040 0x7fae201594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae24e72640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae2014e710 0x7fae200c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:55930/0 (socket says 172.21.15.167:55930) 2023-11-28T21:05:30.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae24e72640 1 -- 172.21.15.167:0/1163276030 learned_addr learned my addr 172.21.15.167:0/1163276030 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:30.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae25673640 1 -- 172.21.15.167:0/1163276030 >> v2:172.21.15.178:3300/0 conn(0x7fae2014e710 msgr2=0x7fae200c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:30.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae25673640 1 --2- 172.21.15.167:0/1163276030 >> v2:172.21.15.178:3300/0 conn(0x7fae2014e710 0x7fae200c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae25673640 1 -- 172.21.15.167:0/1163276030 >> v1:172.21.15.178:6789/0 conn(0x7fae200c97c0 legacy=0x7fae200c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.257+0000 7fae25673640 1 -- 172.21.15.167:0/1163276030 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae20158180 con 0x7fae20159040 2023-11-28T21:05:30.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae25673640 1 --2- 172.21.15.167:0/1163276030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae20159040 0x7fae201594d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae18009d90 tx=0x7fae1801f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d39d9ca0d2b91318 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae1f7fe640 1 -- 172.21.15.167:0/1163276030 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae180af600 con 0x7fae20159040 2023-11-28T21:05:30.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae1f7fe640 1 -- 172.21.15.167:0/1163276030 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae180ab050 con 0x7fae20159040 2023-11-28T21:05:30.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae1f7fe640 1 -- 172.21.15.167:0/1163276030 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae180af980 con 0x7fae20159040 2023-11-28T21:05:30.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae270d6640 1 -- 172.21.15.167:0/1163276030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae20159040 msgr2=0x7fae201594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae270d6640 1 --2- 172.21.15.167:0/1163276030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae20159040 0x7fae201594d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae18009d90 tx=0x7fae1801f130 comp rx=0 tx=0).stop 2023-11-28T21:05:30.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae270d6640 1 -- 172.21.15.167:0/1163276030 shutdown_connections 2023-11-28T21:05:30.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae270d6640 1 --2- 172.21.15.167:0/1163276030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae20159040 0x7fae201594d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae270d6640 1 --2- 172.21.15.167:0/1163276030 >> v2:172.21.15.178:3300/0 conn(0x7fae2014e710 0x7fae200c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae270d6640 1 -- 172.21.15.167:0/1163276030 >> 172.21.15.167:0/1163276030 conn(0x7fae2006a580 msgr2=0x7fae2006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:30.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae270d6640 1 -- 172.21.15.167:0/1163276030 shutdown_connections 2023-11-28T21:05:30.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.261+0000 7fae270d6640 1 -- 172.21.15.167:0/1163276030 wait complete. 2023-11-28T21:05:30.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 Processor -- start 2023-11-28T21:05:30.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 -- start start 2023-11-28T21:05:30.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae200c97c0 0x7fae2014be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae2014e710 0x7fae200cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20159040 0x7fae20155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200caeb0 con 0x7fae20159040 2023-11-28T21:05:30.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2014a510 con 0x7fae2014e710 2023-11-28T21:05:30.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200cb100 con 0x7fae200c97c0 2023-11-28T21:05:30.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae25673640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20159040 0x7fae20155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae25673640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20159040 0x7fae20155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57080/0 (socket says 172.21.15.167:57080) 2023-11-28T21:05:30.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae25673640 1 -- 172.21.15.167:0/2767616412 learned_addr learned my addr 172.21.15.167:0/2767616412 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:30.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae1ffff640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae2014e710 0x7fae200cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae24e72640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae200c97c0 0x7fae2014be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae25673640 1 -- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae200c97c0 msgr2=0x7fae2014be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae25673640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae200c97c0 0x7fae2014be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae25673640 1 -- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae2014e710 msgr2=0x7fae200cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae25673640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae2014e710 0x7fae200cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae25673640 1 -- 172.21.15.167:0/2767616412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae18009a70 con 0x7fae20159040 2023-11-28T21:05:30.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae25673640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20159040 0x7fae20155a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae1801cd60 tx=0x7fae1801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae1d7fa640 1 -- 172.21.15.167:0/2767616412 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18009450 con 0x7fae20159040 2023-11-28T21:05:30.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae1d7fa640 1 -- 172.21.15.167:0/2767616412 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae180afda0 con 0x7fae20159040 2023-11-28T21:05:30.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae200cb3e0 con 0x7fae20159040 2023-11-28T21:05:30.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae1d7fa640 1 -- 172.21.15.167:0/2767616412 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae180ba640 con 0x7fae20159040 2023-11-28T21:05:30.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae200cb9a0 con 0x7fae20159040 2023-11-28T21:05:30.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae20075c90 con 0x7fae20159040 2023-11-28T21:05:30.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.265+0000 7fae1d7fa640 1 -- 172.21.15.167:0/2767616412 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fae180ba7a0 con 0x7fae20159040 2023-11-28T21:05:30.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.269+0000 7fae1d7fa640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fae0c0664a0 0x7fae0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.269+0000 7fae1d7fa640 1 -- 172.21.15.167:0/2767616412 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fae18122b70 con 0x7fae20159040 2023-11-28T21:05:30.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.269+0000 7fae24e72640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fae0c0664a0 0x7fae0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.269+0000 7fae24e72640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fae0c0664a0 0x7fae0c068960 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fae10009a40 tx=0x7fae10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.273+0000 7fae1d7fa640 1 -- 172.21.15.167:0/2767616412 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae180efb80 con 0x7fae20159040 2023-11-28T21:05:30.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fae200c80f0 con 0x7fae0c0664a0 2023-11-28T21:05:30.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae1d7fa640 1 -- 172.21.15.167:0/2767616412 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fae100119a0 con 0x7fae0c0664a0 2023-11-28T21:05:30.419 INFO:teuthology.orchestra.run.smithi167.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T21:05:30.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fae0c0664a0 msgr2=0x7fae0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fae0c0664a0 0x7fae0c068960 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fae10009a40 tx=0x7fae10008040 comp rx=0 tx=0).stop 2023-11-28T21:05:30.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20159040 msgr2=0x7fae20155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20159040 0x7fae20155a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae1801cd60 tx=0x7fae1801bed0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 shutdown_connections 2023-11-28T21:05:30.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fae0c0664a0 0x7fae0c068960 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae20159040 0x7fae20155a60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae2014e710 0x7fae200cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 --2- 172.21.15.167:0/2767616412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae200c97c0 0x7fae2014be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 >> 172.21.15.167:0/2767616412 conn(0x7fae2006a580 msgr2=0x7fae200c6090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:30.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 shutdown_connections 2023-11-28T21:05:30.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.417+0000 7fae270d6640 1 -- 172.21.15.167:0/2767616412 wait complete. 2023-11-28T21:05:30.437 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:05:30.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.549+0000 7efd56165640 1 Processor -- start 2023-11-28T21:05:30.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.549+0000 7efd56165640 1 -- start start 2023-11-28T21:05:30.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 0x7efd500cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efd50153ae0 0x7efd50153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5015ac00 con 0x7efd500cf860 2023-11-28T21:05:30.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd50154470 con 0x7efd50153ae0 2023-11-28T21:05:30.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd500cbd60 con 0x7efd500cfc40 2023-11-28T21:05:30.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efd50153ae0 0x7efd50153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efd50153ae0 0x7efd50153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57094/0 (socket says 172.21.15.167:57094) 2023-11-28T21:05:30.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4ffff640 1 -- 172.21.15.167:0/3795590871 learned_addr learned my addr 172.21.15.167:0/3795590871 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:30.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4effd640 1 --2- 172.21.15.167:0/3795590871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 0x7efd500cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4ffff640 1 -- 172.21.15.167:0/3795590871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 msgr2=0x7efd500cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:30.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4ffff640 1 --2- 172.21.15.167:0/3795590871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 0x7efd500cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4ffff640 1 -- 172.21.15.167:0/3795590871 >> v1:172.21.15.178:6789/0 conn(0x7efd500cf860 legacy=0x7efd500ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:30.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4ffff640 1 -- 172.21.15.167:0/3795590871 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50159ff0 con 0x7efd50153ae0 2023-11-28T21:05:30.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4ffff640 1 --2- 172.21.15.167:0/3795590871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd50153ae0 0x7efd50153f30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd48009e50 tx=0x7efd4801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5dc7a6ae47a41b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4e7fc640 1 -- 172.21.15.167:0/3795590871 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480a5820 con 0x7efd50153ae0 2023-11-28T21:05:30.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4e7fc640 1 -- 172.21.15.167:0/3795590871 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd480a5980 con 0x7efd50153ae0 2023-11-28T21:05:30.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd4e7fc640 1 -- 172.21.15.167:0/3795590871 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480a5d10 con 0x7efd50153ae0 2023-11-28T21:05:30.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 -- 172.21.15.167:0/3795590871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd50153ae0 msgr2=0x7efd50153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 --2- 172.21.15.167:0/3795590871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd50153ae0 0x7efd50153f30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd48009e50 tx=0x7efd4801c9a0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 -- 172.21.15.167:0/3795590871 shutdown_connections 2023-11-28T21:05:30.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 --2- 172.21.15.167:0/3795590871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd50153ae0 0x7efd50153f30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 --2- 172.21.15.167:0/3795590871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 0x7efd500cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 -- 172.21.15.167:0/3795590871 >> 172.21.15.167:0/3795590871 conn(0x7efd5006c1f0 msgr2=0x7efd50071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:30.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 -- 172.21.15.167:0/3795590871 shutdown_connections 2023-11-28T21:05:30.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.553+0000 7efd56165640 1 -- 172.21.15.167:0/3795590871 wait complete. 2023-11-28T21:05:30.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 Processor -- start 2023-11-28T21:05:30.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 -- start start 2023-11-28T21:05:30.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd500cf860 0x7efd500c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 0x7efd5015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd50153ae0 0x7efd500c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50159b40 con 0x7efd500cf860 2023-11-28T21:05:30.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd500c8f80 con 0x7efd50153ae0 2023-11-28T21:05:30.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd500b5710 con 0x7efd500cfc40 2023-11-28T21:05:30.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd500cf860 0x7efd500c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd500cf860 0x7efd500c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57108/0 (socket says 172.21.15.167:57108) 2023-11-28T21:05:30.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4f7fe640 1 -- 172.21.15.167:0/195887975 learned_addr learned my addr 172.21.15.167:0/195887975 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:30.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4ffff640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd50153ae0 0x7efd500c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4effd640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 0x7efd5015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4f7fe640 1 -- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 msgr2=0x7efd5015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4f7fe640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 0x7efd5015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4f7fe640 1 -- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd50153ae0 msgr2=0x7efd500c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4f7fe640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd50153ae0 0x7efd500c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4f7fe640 1 -- 172.21.15.167:0/195887975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48009b30 con 0x7efd500cf860 2023-11-28T21:05:30.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd4f7fe640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd500cf860 0x7efd500c8a40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efd4000b470 tx=0x7efd4000b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd37fff640 1 -- 172.21.15.167:0/195887975 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40004020 con 0x7efd500cf860 2023-11-28T21:05:30.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd37fff640 1 -- 172.21.15.167:0/195887975 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd40004180 con 0x7efd500cf860 2023-11-28T21:05:30.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd500b5430 con 0x7efd500cf860 2023-11-28T21:05:30.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd37fff640 1 -- 172.21.15.167:0/195887975 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40011690 con 0x7efd500cf860 2023-11-28T21:05:30.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.557+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd501f2d10 con 0x7efd500cf860 2023-11-28T21:05:30.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.561+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd50075c90 con 0x7efd500cf860 2023-11-28T21:05:30.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.561+0000 7efd37fff640 1 -- 172.21.15.167:0/195887975 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd400117f0 con 0x7efd500cf860 2023-11-28T21:05:30.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.561+0000 7efd37fff640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efd3c066470 0x7efd3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:30.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.561+0000 7efd37fff640 1 -- 172.21.15.167:0/195887975 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7efd40084150 con 0x7efd500cf860 2023-11-28T21:05:30.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.561+0000 7efd4effd640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efd3c066470 0x7efd3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:30.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.561+0000 7efd4effd640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efd3c066470 0x7efd3c068930 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efd50146da0 tx=0x7efd44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:30.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.565+0000 7efd37fff640 1 -- 172.21.15.167:0/195887975 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd40051270 con 0x7efd500cf860 2023-11-28T21:05:30.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.709+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd50159cc0 con 0x7efd3c066470 2023-11-28T21:05:30.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.737+0000 7efd37fff640 1 -- 172.21.15.167:0/195887975 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371142 (secure 0 0 0) 0x7efd4400b670 con 0x7efd3c066470 2023-11-28T21:05:30.746 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:05:30.748 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T21:05:30.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efd3c066470 msgr2=0x7efd3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efd3c066470 0x7efd3c068930 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efd50146da0 tx=0x7efd44008040 comp rx=0 tx=0).stop 2023-11-28T21:05:30.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd500cf860 msgr2=0x7efd500c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:30.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd500cf860 0x7efd500c8a40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efd4000b470 tx=0x7efd4000b930 comp rx=0 tx=0).stop 2023-11-28T21:05:30.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 shutdown_connections 2023-11-28T21:05:30.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7efd3c066470 0x7efd3c068930 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd50153ae0 0x7efd500c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd500cfc40 0x7efd5015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 --2- 172.21.15.167:0/195887975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd500cf860 0x7efd500c8a40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:30.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 >> 172.21.15.167:0/195887975 conn(0x7efd5006c1f0 msgr2=0x7efd50066b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:30.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 shutdown_connections 2023-11-28T21:05:30.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:30.741+0000 7efd56165640 1 -- 172.21.15.167:0/195887975 wait complete. 2023-11-28T21:05:30.760 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":866,"stamp":"2023-11-28T21:05:30.125813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573738351,"num_objects":18293,"num_object_clones":8054,"num_object_copies":71918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18293,"num_whiteouts":7974,"num_read":2751,"num_read_kb":105055,"num_write":63161,"num_write_kb":1870913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84018,"num_omap_keys":160,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98510,"ondisk_log_size":98510,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4529000,"kb_used_data":3173160,"kb_used_omap":12,"kb_used_meta":1355763,"kb_avail":750445720,"statfs":{"total":773094113280,"available":768456417280,"internally_reserved":0,"allocated":3249315840,"data_stored":3246905922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1388301872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84018,"num_omap_keys":160,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005251"},"pg_stats":[{"pgid":"2.1f","version":"51'546","reported_seq":603,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:23.427236+0000","last_change":"2023-11-28T20:38:18.552947+0000","last_active":"2023-11-28T21:05:23.427236+0000","last_peered":"2023-11-28T21:05:23.427236+0000","last_clean":"2023-11-28T21:05:23.427236+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T21:05:23.427236+0000","last_undegraded":"2023-11-28T21:05:23.427236+0000","last_fullsized":"2023-11-28T21:05:23.427236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":13,"num_write":501,"num_write_kb":29002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'428","reported_seq":2516,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:04.593318+0000","last_change":"2023-11-28T20:44:35.608330+0000","last_active":"2023-11-28T21:05:04.593318+0000","last_peered":"2023-11-28T21:05:04.593318+0000","last_clean":"2023-11-28T21:05:04.593318+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T21:05:04.593318+0000","last_undegraded":"2023-11-28T21:05:04.593318+0000","last_fullsized":"2023-11-28T21:05:04.593318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012127499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"51'1858","reported_seq":3699,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:09.593973+0000","last_change":"2023-11-28T20:44:35.612490+0000","last_active":"2023-11-28T21:05:09.593973+0000","last_peered":"2023-11-28T21:05:09.593973+0000","last_clean":"2023-11-28T21:05:09.593973+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T21:05:09.593973+0000","last_undegraded":"2023-11-28T21:05:09.593973+0000","last_fullsized":"2023-11-28T21:05:09.593973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016916996,"stat_sum":{"num_bytes":12268315,"num_objects":556,"num_object_clones":279,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":239,"num_read":31,"num_read_kb":4126,"num_write":1561,"num_write_kb":24667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"51'611","reported_seq":668,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:29.588792+0000","last_change":"2023-11-28T20:38:18.538925+0000","last_active":"2023-11-28T21:04:29.588792+0000","last_peered":"2023-11-28T21:04:29.588792+0000","last_clean":"2023-11-28T21:04:29.588792+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T21:04:29.588792+0000","last_undegraded":"2023-11-28T21:04:29.588792+0000","last_fullsized":"2023-11-28T21:04:29.588792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":546,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"51'383","reported_seq":2478,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:23.427211+0000","last_change":"2023-11-28T20:44:35.603931+0000","last_active":"2023-11-28T21:05:23.427211+0000","last_peered":"2023-11-28T21:05:23.427211+0000","last_clean":"2023-11-28T21:05:23.427211+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T21:05:23.427211+0000","last_undegraded":"2023-11-28T21:05:23.427211+0000","last_fullsized":"2023-11-28T21:05:23.427211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010031783000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"51'1843","reported_seq":3720,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.579659+0000","last_change":"2023-11-28T20:44:35.541215+0000","last_active":"2023-11-28T21:02:35.579659+0000","last_peered":"2023-11-28T21:02:35.579659+0000","last_clean":"2023-11-28T21:02:35.579659+0000","last_became_active":"2023-11-28T20:39:01.389891+0000","last_became_peered":"2023-11-28T20:39:01.389891+0000","last_unstale":"2023-11-28T21:02:35.579659+0000","last_undegraded":"2023-11-28T21:02:35.579659+0000","last_fullsized":"2023-11-28T21:02:35.579659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:08:49.951369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084388650000000003,"stat_sum":{"num_bytes":22024896,"num_objects":578,"num_object_clones":267,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":267,"num_read":47,"num_read_kb":8236,"num_write":1555,"num_write_kb":33440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"51'579","reported_seq":631,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.546713+0000","last_change":"2023-11-28T20:38:18.567609+0000","last_active":"2023-11-28T21:00:50.546713+0000","last_peered":"2023-11-28T21:00:50.546713+0000","last_clean":"2023-11-28T21:00:50.546713+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T21:00:50.546713+0000","last_undegraded":"2023-11-28T21:00:50.546713+0000","last_fullsized":"2023-11-28T21:00:50.546713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:41.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"51'396","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173832+0000","last_change":"2023-11-28T20:44:35.614099+0000","last_active":"2023-11-28T21:04:23.173832+0000","last_peered":"2023-11-28T21:04:23.173832+0000","last_clean":"2023-11-28T21:04:23.173832+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T21:04:23.173832+0000","last_undegraded":"2023-11-28T21:04:23.173832+0000","last_fullsized":"2023-11-28T21:04:23.173832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:37:34.672454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016140509000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1696","reported_seq":3582,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558555+0000","last_change":"2023-11-28T20:44:35.542225+0000","last_active":"2023-11-28T21:00:55.558555+0000","last_peered":"2023-11-28T21:00:55.558555+0000","last_clean":"2023-11-28T21:00:55.558555+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T21:00:55.558555+0000","last_undegraded":"2023-11-28T21:00:55.558555+0000","last_fullsized":"2023-11-28T21:00:55.558555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:09:49.565280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0093789649999999995,"stat_sum":{"num_bytes":11818887,"num_objects":514,"num_object_clones":236,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":236,"num_read":34,"num_read_kb":34,"num_write":1442,"num_write_kb":18567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"51'404","reported_seq":457,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.546585+0000","last_change":"2023-11-28T20:38:18.573080+0000","last_active":"2023-11-28T21:00:50.546585+0000","last_peered":"2023-11-28T21:00:50.546585+0000","last_clean":"2023-11-28T21:00:50.546585+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T21:00:50.546585+0000","last_undegraded":"2023-11-28T21:00:50.546585+0000","last_fullsized":"2023-11-28T21:00:50.546585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:37.994869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":354,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"51'394","reported_seq":2485,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173820+0000","last_change":"2023-11-28T20:44:35.618164+0000","last_active":"2023-11-28T21:04:23.173820+0000","last_peered":"2023-11-28T21:04:23.173820+0000","last_clean":"2023-11-28T21:04:23.173820+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T21:04:23.173820+0000","last_undegraded":"2023-11-28T21:04:23.173820+0000","last_fullsized":"2023-11-28T21:04:23.173820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:39:10.074109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019881585,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"51'1748","reported_seq":3613,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:55.558505+0000","last_change":"2023-11-28T20:44:35.542475+0000","last_active":"2023-11-28T21:00:55.558505+0000","last_peered":"2023-11-28T21:00:55.558505+0000","last_clean":"2023-11-28T21:00:55.558505+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T21:00:55.558505+0000","last_undegraded":"2023-11-28T21:00:55.558505+0000","last_fullsized":"2023-11-28T21:00:55.558505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:42.606296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092901790000000008,"stat_sum":{"num_bytes":16892767,"num_objects":571,"num_object_clones":263,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":571,"num_whiteouts":263,"num_read":40,"num_read_kb":48,"num_write":1465,"num_write_kb":20221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"51'418","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.174499+0000","last_change":"2023-11-28T20:44:35.616278+0000","last_active":"2023-11-28T21:04:23.174499+0000","last_peered":"2023-11-28T21:04:23.174499+0000","last_clean":"2023-11-28T21:04:23.174499+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T21:04:23.174499+0000","last_undegraded":"2023-11-28T21:04:23.174499+0000","last_fullsized":"2023-11-28T21:04:23.174499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:39:02.355511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017860755999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"51'336","reported_seq":391,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:05.575243+0000","last_change":"2023-11-28T20:38:18.567520+0000","last_active":"2023-11-28T21:03:05.575243+0000","last_peered":"2023-11-28T21:03:05.575243+0000","last_clean":"2023-11-28T21:03:05.575243+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T21:03:05.575243+0000","last_undegraded":"2023-11-28T21:03:05.575243+0000","last_fullsized":"2023-11-28T21:03:05.575243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:30:30.254854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":274,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"51'1713","reported_seq":3606,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:10.587008+0000","last_change":"2023-11-28T20:44:35.546423+0000","last_active":"2023-11-28T21:03:10.587008+0000","last_peered":"2023-11-28T21:03:10.587008+0000","last_clean":"2023-11-28T21:03:10.587008+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T21:03:10.587008+0000","last_undegraded":"2023-11-28T21:03:10.587008+0000","last_fullsized":"2023-11-28T21:03:10.587008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:27:21.576866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011349794999999999,"stat_sum":{"num_bytes":42075033,"num_objects":519,"num_object_clones":229,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":229,"num_read":33,"num_read_kb":8223,"num_write":1463,"num_write_kb":57658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"51'395","reported_seq":2489,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:19.595581+0000","last_change":"2023-11-28T20:44:35.615271+0000","last_active":"2023-11-28T21:05:19.595581+0000","last_peered":"2023-11-28T21:05:19.595581+0000","last_clean":"2023-11-28T21:05:19.595581+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T21:05:19.595581+0000","last_undegraded":"2023-11-28T21:05:19.595581+0000","last_fullsized":"2023-11-28T21:05:19.595581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018528307000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"51'468","reported_seq":524,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:21.746262+0000","last_change":"2023-11-28T20:38:18.537010+0000","last_active":"2023-11-28T21:04:21.746262+0000","last_peered":"2023-11-28T21:04:21.746262+0000","last_clean":"2023-11-28T21:04:21.746262+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T21:04:21.746262+0000","last_undegraded":"2023-11-28T21:04:21.746262+0000","last_fullsized":"2023-11-28T21:04:21.746262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2,"num_read_kb":11,"num_write":693,"num_write_kb":25655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'1827","reported_seq":3710,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:10.586962+0000","last_change":"2023-11-28T20:44:35.543575+0000","last_active":"2023-11-28T21:03:10.586962+0000","last_peered":"2023-11-28T21:03:10.586962+0000","last_clean":"2023-11-28T21:03:10.586962+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T21:03:10.586962+0000","last_undegraded":"2023-11-28T21:03:10.586962+0000","last_fullsized":"2023-11-28T21:03:10.586962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:19.718029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010051028,"stat_sum":{"num_bytes":36081004,"num_objects":549,"num_object_clones":242,"num_object_copies":2196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":242,"num_read":36,"num_read_kb":4131,"num_write":1572,"num_write_kb":47387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"51'429","reported_seq":2523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.496611+0000","last_change":"2023-11-28T20:44:35.615648+0000","last_active":"2023-11-28T21:04:30.496611+0000","last_peered":"2023-11-28T21:04:30.496611+0000","last_clean":"2023-11-28T21:04:30.496611+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T21:04:30.496611+0000","last_undegraded":"2023-11-28T21:04:30.496611+0000","last_fullsized":"2023-11-28T21:04:30.496611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018799937999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"51'666","reported_seq":722,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:21.746186+0000","last_change":"2023-11-28T20:38:18.566739+0000","last_active":"2023-11-28T21:04:21.746186+0000","last_peered":"2023-11-28T21:04:21.746186+0000","last_clean":"2023-11-28T21:04:21.746186+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T21:04:21.746186+0000","last_undegraded":"2023-11-28T21:04:21.746186+0000","last_fullsized":"2023-11-28T21:04:21.746186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":627,"num_write_kb":16946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"51'1842","reported_seq":3708,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:27.417270+0000","last_change":"2023-11-28T20:44:35.608957+0000","last_active":"2023-11-28T21:05:27.417270+0000","last_peered":"2023-11-28T21:05:27.417270+0000","last_clean":"2023-11-28T21:05:27.417270+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T21:05:27.417270+0000","last_undegraded":"2023-11-28T21:05:27.417270+0000","last_fullsized":"2023-11-28T21:05:27.417270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011785257,"stat_sum":{"num_bytes":33810901,"num_objects":586,"num_object_clones":259,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":259,"num_read":37,"num_read_kb":8227,"num_write":1558,"num_write_kb":44779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"51'406","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491184+0000","last_change":"2023-11-28T20:44:35.545606+0000","last_active":"2023-11-28T21:04:30.491184+0000","last_peered":"2023-11-28T21:04:30.491184+0000","last_clean":"2023-11-28T21:04:30.491184+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T21:04:30.491184+0000","last_undegraded":"2023-11-28T21:04:30.491184+0000","last_fullsized":"2023-11-28T21:04:30.491184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:23:54.158095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011190047999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"51'485","reported_seq":540,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:10.563468+0000","last_change":"2023-11-28T20:38:18.570755+0000","last_active":"2023-11-28T21:02:10.563468+0000","last_peered":"2023-11-28T21:02:10.563468+0000","last_clean":"2023-11-28T21:02:10.563468+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T21:02:10.563468+0000","last_undegraded":"2023-11-28T21:02:10.563468+0000","last_fullsized":"2023-11-28T21:02:10.563468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:42:38.551697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":18,"num_write":441,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"51'1805","reported_seq":3654,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:10.587043+0000","last_change":"2023-11-28T20:44:35.544665+0000","last_active":"2023-11-28T21:03:10.587043+0000","last_peered":"2023-11-28T21:03:10.587043+0000","last_clean":"2023-11-28T21:03:10.587043+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T21:03:10.587043+0000","last_undegraded":"2023-11-28T21:03:10.587043+0000","last_fullsized":"2023-11-28T21:03:10.587043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:32:22.582437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010413970999999999,"stat_sum":{"num_bytes":29462623,"num_objects":568,"num_object_clones":283,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":243,"num_read":43,"num_read_kb":8342,"num_write":1501,"num_write_kb":36747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"51'401","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.496239+0000","last_change":"2023-11-28T20:44:35.608781+0000","last_active":"2023-11-28T21:04:30.496239+0000","last_peered":"2023-11-28T21:04:30.496239+0000","last_clean":"2023-11-28T21:04:30.496239+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T21:04:30.496239+0000","last_undegraded":"2023-11-28T21:04:30.496239+0000","last_fullsized":"2023-11-28T21:04:30.496239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013760692,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"51'145","reported_seq":202,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:10.559549+0000","last_change":"2023-11-28T20:38:18.568077+0000","last_active":"2023-11-28T21:02:10.559549+0000","last_peered":"2023-11-28T21:02:10.559549+0000","last_clean":"2023-11-28T21:02:10.559549+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T21:02:10.559549+0000","last_undegraded":"2023-11-28T21:02:10.559549+0000","last_fullsized":"2023-11-28T21:02:10.559549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:07.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":6,"num_read_kb":32,"num_write":106,"num_write_kb":8401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"51'1903","reported_seq":3757,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.563869+0000","last_change":"2023-11-28T20:44:35.542749+0000","last_active":"2023-11-28T21:01:20.563869+0000","last_peered":"2023-11-28T21:01:20.563869+0000","last_clean":"2023-11-28T21:01:20.563869+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T21:01:20.563869+0000","last_undegraded":"2023-11-28T21:01:20.563869+0000","last_fullsized":"2023-11-28T21:01:20.563869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:36:45.378771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092734619999999997,"stat_sum":{"num_bytes":42280101,"num_objects":591,"num_object_clones":269,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":269,"num_read":33,"num_read_kb":4128,"num_write":1621,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"51'381","reported_seq":2475,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564538+0000","last_change":"2023-11-28T20:44:35.614397+0000","last_active":"2023-11-28T21:04:28.564538+0000","last_peered":"2023-11-28T21:04:28.564538+0000","last_clean":"2023-11-28T21:04:28.564538+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T21:04:28.564538+0000","last_undegraded":"2023-11-28T21:04:28.564538+0000","last_fullsized":"2023-11-28T21:04:28.564538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017915146,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"51'420","reported_seq":478,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.499622+0000","last_change":"2023-11-28T20:38:18.548207+0000","last_active":"2023-11-28T21:04:30.499622+0000","last_peered":"2023-11-28T21:04:30.499622+0000","last_clean":"2023-11-28T21:04:30.499622+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T21:04:30.499622+0000","last_undegraded":"2023-11-28T21:04:30.499622+0000","last_fullsized":"2023-11-28T21:04:30.499622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12049925,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":6,"num_read_kb":23,"num_write":692,"num_write_kb":13743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"51'1784","reported_seq":3658,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:34.589715+0000","last_change":"2023-11-28T20:44:35.612546+0000","last_active":"2023-11-28T21:04:34.589715+0000","last_peered":"2023-11-28T21:04:34.589715+0000","last_clean":"2023-11-28T21:04:34.589715+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T21:04:34.589715+0000","last_undegraded":"2023-11-28T21:04:34.589715+0000","last_fullsized":"2023-11-28T21:04:34.589715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016539027000000001,"stat_sum":{"num_bytes":21707636,"num_objects":558,"num_object_clones":259,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":558,"num_whiteouts":259,"num_read":41,"num_read_kb":41,"num_write":1502,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"51'425","reported_seq":2528,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:27.436717+0000","last_change":"2023-11-28T21:05:27.436717+0000","last_active":"2023-11-28T21:05:27.436717+0000","last_peered":"2023-11-28T21:05:27.436717+0000","last_clean":"2023-11-28T21:05:27.436717+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T21:05:27.436717+0000","last_undegraded":"2023-11-28T21:05:27.436717+0000","last_fullsized":"2023-11-28T21:05:27.436717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'425","last_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_deep_scrub":"51'425","last_deep_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_clean_scrub_stamp":"2023-11-28T21:05:27.436622+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:32.946946+0000","scrub_duration":0.001593002,"objects_trimmed":0,"snaptrim_duration":0.014316661,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'350","reported_seq":404,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.553069+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T21:01:20.553069+0000","last_peered":"2023-11-28T21:01:20.553069+0000","last_clean":"2023-11-28T21:01:20.553069+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T21:01:20.553069+0000","last_undegraded":"2023-11-28T21:01:20.553069+0000","last_fullsized":"2023-11-28T21:01:20.553069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:30.308564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360150,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":28962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"51'1789","reported_seq":3655,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:25.521281+0000","last_change":"2023-11-28T20:44:35.610536+0000","last_active":"2023-11-28T21:03:25.521281+0000","last_peered":"2023-11-28T21:03:25.521281+0000","last_clean":"2023-11-28T21:03:25.521281+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T21:03:25.521281+0000","last_undegraded":"2023-11-28T21:03:25.521281+0000","last_fullsized":"2023-11-28T21:03:25.521281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014620091,"stat_sum":{"num_bytes":29165465,"num_objects":561,"num_object_clones":251,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":561,"num_whiteouts":251,"num_read":26,"num_read_kb":26,"num_write":1521,"num_write_kb":34762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"51'414","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.508165+0000","last_change":"2023-11-28T20:44:35.624605+0000","last_active":"2023-11-28T21:04:26.508165+0000","last_peered":"2023-11-28T21:04:26.508165+0000","last_clean":"2023-11-28T21:04:26.508165+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T21:04:26.508165+0000","last_undegraded":"2023-11-28T21:04:26.508165+0000","last_fullsized":"2023-11-28T21:04:26.508165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:38.051342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025775551000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"51'276","reported_seq":340,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:28.525091+0000","last_change":"2023-11-28T21:05:28.525091+0000","last_active":"2023-11-28T21:05:28.525091+0000","last_peered":"2023-11-28T21:05:28.525091+0000","last_clean":"2023-11-28T21:05:28.525091+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T21:05:28.525091+0000","last_undegraded":"2023-11-28T21:05:28.525091+0000","last_fullsized":"2023-11-28T21:05:28.525091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'276","last_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_deep_scrub":"51'276","last_deep_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_clean_scrub_stamp":"2023-11-28T21:05:28.524974+0000","objects_scrubbed":17,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:41:23.890866+0000","scrub_duration":0.056500518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":24764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84018,"num_omap_keys":160,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"51'1827","reported_seq":3689,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:01.534917+0000","last_change":"2023-11-28T20:44:35.529967+0000","last_active":"2023-11-28T21:04:01.534917+0000","last_peered":"2023-11-28T21:04:01.534917+0000","last_clean":"2023-11-28T21:04:01.534917+0000","last_became_active":"2023-11-28T20:39:01.570987+0000","last_became_peered":"2023-11-28T20:39:01.570987+0000","last_unstale":"2023-11-28T21:04:01.534917+0000","last_undegraded":"2023-11-28T21:04:01.534917+0000","last_fullsized":"2023-11-28T21:04:01.534917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017641899999999999,"stat_sum":{"num_bytes":29603349,"num_objects":551,"num_object_clones":257,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":257,"num_read":32,"num_read_kb":32,"num_write":1550,"num_write_kb":37188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"51'420","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.557372+0000","last_change":"2023-11-28T20:44:35.545769+0000","last_active":"2023-11-28T21:04:28.557372+0000","last_peered":"2023-11-28T21:04:28.557372+0000","last_clean":"2023-11-28T21:04:28.557372+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T21:04:28.557372+0000","last_undegraded":"2023-11-28T21:04:28.557372+0000","last_fullsized":"2023-11-28T21:04:28.557372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:58:16.077909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010944188000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"51'420","reported_seq":476,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:20.584227+0000","last_change":"2023-11-28T20:38:18.561210+0000","last_active":"2023-11-28T21:03:20.584227+0000","last_peered":"2023-11-28T21:03:20.584227+0000","last_clean":"2023-11-28T21:03:20.584227+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T21:03:20.584227+0000","last_undegraded":"2023-11-28T21:03:20.584227+0000","last_fullsized":"2023-11-28T21:03:20.584227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:24:15.563471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":379,"num_write_kb":16755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"51'1754","reported_seq":3630,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:26.736186+0000","last_change":"2023-11-28T20:44:35.606459+0000","last_active":"2023-11-28T21:03:26.736186+0000","last_peered":"2023-11-28T21:03:26.736186+0000","last_clean":"2023-11-28T21:03:26.736186+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T21:03:26.736186+0000","last_undegraded":"2023-11-28T21:03:26.736186+0000","last_fullsized":"2023-11-28T21:03:26.736186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012892727999999999,"stat_sum":{"num_bytes":30726234,"num_objects":547,"num_object_clones":244,"num_object_copies":2188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":244,"num_read":30,"num_read_kb":7398,"num_write":1499,"num_write_kb":38104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'416","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494905+0000","last_change":"2023-11-28T20:44:35.602022+0000","last_active":"2023-11-28T21:04:30.494905+0000","last_peered":"2023-11-28T21:04:30.494905+0000","last_clean":"2023-11-28T21:04:30.494905+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T21:04:30.494905+0000","last_undegraded":"2023-11-28T21:04:30.494905+0000","last_fullsized":"2023-11-28T21:04:30.494905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0088104640000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"51'904","reported_seq":1397,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:24.595665+0000","last_change":"2023-11-28T20:38:18.541248+0000","last_active":"2023-11-28T21:05:24.595665+0000","last_peered":"2023-11-28T21:05:24.595665+0000","last_clean":"2023-11-28T21:05:24.595665+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T21:05:24.595665+0000","last_undegraded":"2023-11-28T21:05:24.595665+0000","last_fullsized":"2023-11-28T21:05:24.595665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26750948,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":437,"num_read_kb":1190,"num_write":846,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"51'1696","reported_seq":3564,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:29.588933+0000","last_change":"2023-11-28T20:44:35.609122+0000","last_active":"2023-11-28T21:04:29.588933+0000","last_peered":"2023-11-28T21:04:29.588933+0000","last_clean":"2023-11-28T21:04:29.588933+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T21:04:29.588933+0000","last_undegraded":"2023-11-28T21:04:29.588933+0000","last_fullsized":"2023-11-28T21:04:29.588933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744523999999999,"stat_sum":{"num_bytes":4888539,"num_objects":545,"num_object_clones":249,"num_object_copies":2180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":249,"num_read":26,"num_read_kb":26,"num_write":1427,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'419","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:23.426996+0000","last_change":"2023-11-28T20:44:35.607743+0000","last_active":"2023-11-28T21:05:23.426996+0000","last_peered":"2023-11-28T21:05:23.426996+0000","last_clean":"2023-11-28T21:05:23.426996+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T21:05:23.426996+0000","last_undegraded":"2023-11-28T21:05:23.426996+0000","last_fullsized":"2023-11-28T21:05:23.426996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013248289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"51'468","reported_seq":523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:25.566548+0000","last_change":"2023-11-28T20:38:18.571466+0000","last_active":"2023-11-28T21:02:25.566548+0000","last_peered":"2023-11-28T21:02:25.566548+0000","last_clean":"2023-11-28T21:02:25.566548+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T21:02:25.566548+0000","last_undegraded":"2023-11-28T21:02:25.566548+0000","last_fullsized":"2023-11-28T21:02:25.566548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:53:23.158878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"51'1786","reported_seq":3672,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:22.914081+0000","last_change":"2023-11-28T20:44:35.607810+0000","last_active":"2023-11-28T21:04:22.914081+0000","last_peered":"2023-11-28T21:04:22.914081+0000","last_clean":"2023-11-28T21:04:22.914081+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T21:04:22.914081+0000","last_undegraded":"2023-11-28T21:04:22.914081+0000","last_fullsized":"2023-11-28T21:04:22.914081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013136992,"stat_sum":{"num_bytes":25033729,"num_objects":551,"num_object_clones":252,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":252,"num_read":47,"num_read_kb":4142,"num_write":1517,"num_write_kb":28607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'391","reported_seq":2486,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:24.596124+0000","last_change":"2023-11-28T20:44:35.610823+0000","last_active":"2023-11-28T21:05:24.596124+0000","last_peered":"2023-11-28T21:05:24.596124+0000","last_clean":"2023-11-28T21:05:24.596124+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T21:05:24.596124+0000","last_undegraded":"2023-11-28T21:05:24.596124+0000","last_fullsized":"2023-11-28T21:05:24.596124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015322676,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'353","reported_seq":410,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:20.584278+0000","last_change":"2023-11-28T20:38:18.554943+0000","last_active":"2023-11-28T21:03:20.584278+0000","last_peered":"2023-11-28T21:03:20.584278+0000","last_clean":"2023-11-28T21:03:20.584278+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T21:03:20.584278+0000","last_undegraded":"2023-11-28T21:03:20.584278+0000","last_fullsized":"2023-11-28T21:03:20.584278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:15.435849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":20,"num_write":319,"num_write_kb":12656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.564511+0000","last_change":"2023-11-28T20:38:06.942853+0000","last_active":"2023-11-28T21:02:15.564511+0000","last_peered":"2023-11-28T21:02:15.564511+0000","last_clean":"2023-11-28T21:02:15.564511+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T21:02:15.564511+0000","last_undegraded":"2023-11-28T21:02:15.564511+0000","last_fullsized":"2023-11-28T21:02:15.564511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:05.508885+0000","last_clean_scrub_stamp":"2023-11-28T20:38:05.508885+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:17.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1795","reported_seq":3660,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:25.550179+0000","last_change":"2023-11-28T20:44:35.608577+0000","last_active":"2023-11-28T21:01:25.550179+0000","last_peered":"2023-11-28T21:01:25.550179+0000","last_clean":"2023-11-28T21:01:25.550179+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T21:01:25.550179+0000","last_undegraded":"2023-11-28T21:01:25.550179+0000","last_fullsized":"2023-11-28T21:01:25.550179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:14.094878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012304083,"stat_sum":{"num_bytes":50974055,"num_objects":563,"num_object_clones":255,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":255,"num_read":30,"num_read_kb":4125,"num_write":1519,"num_write_kb":57288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"51'375","reported_seq":2468,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.170631+0000","last_change":"2023-11-28T20:44:35.637477+0000","last_active":"2023-11-28T21:04:23.170631+0000","last_peered":"2023-11-28T21:04:23.170631+0000","last_clean":"2023-11-28T21:04:23.170631+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T21:04:23.170631+0000","last_undegraded":"2023-11-28T21:04:23.170631+0000","last_fullsized":"2023-11-28T21:04:23.170631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:35.213092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027789237000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"51'212","reported_seq":269,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:19.595153+0000","last_change":"2023-11-28T20:38:18.571878+0000","last_active":"2023-11-28T21:05:19.595153+0000","last_peered":"2023-11-28T21:05:19.595153+0000","last_clean":"2023-11-28T21:05:19.595153+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T21:05:19.595153+0000","last_undegraded":"2023-11-28T21:05:19.595153+0000","last_fullsized":"2023-11-28T21:05:19.595153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777798,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":15,"num_write":164,"num_write_kb":16643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"51'1783","reported_seq":3664,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:20.561530+0000","last_change":"2023-11-28T20:44:35.614664+0000","last_active":"2023-11-28T21:02:20.561530+0000","last_peered":"2023-11-28T21:02:20.561530+0000","last_clean":"2023-11-28T21:02:20.561530+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T21:02:20.561530+0000","last_undegraded":"2023-11-28T21:02:20.561530+0000","last_fullsized":"2023-11-28T21:02:20.561530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:12:48.251405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016877468,"stat_sum":{"num_bytes":24953790,"num_objects":536,"num_object_clones":250,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":250,"num_read":41,"num_read_kb":41,"num_write":1520,"num_write_kb":33586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"51'453","reported_seq":2546,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.449547+0000","last_change":"2023-11-28T20:44:35.618675+0000","last_active":"2023-11-28T21:04:26.449547+0000","last_peered":"2023-11-28T21:04:26.449547+0000","last_clean":"2023-11-28T21:04:26.449547+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T21:04:26.449547+0000","last_undegraded":"2023-11-28T21:04:26.449547+0000","last_fullsized":"2023-11-28T21:04:26.449547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:27:00.507693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020341659000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"51'393","reported_seq":449,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:24.595880+0000","last_change":"2023-11-28T20:38:18.540371+0000","last_active":"2023-11-28T21:05:24.595880+0000","last_peered":"2023-11-28T21:05:24.595880+0000","last_clean":"2023-11-28T21:05:24.595880+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T21:05:24.595880+0000","last_undegraded":"2023-11-28T21:05:24.595880+0000","last_fullsized":"2023-11-28T21:05:24.595880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777286,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":9,"num_write":342,"num_write_kb":16717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"51'1767","reported_seq":3644,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:23.427074+0000","last_change":"2023-11-28T20:44:35.611130+0000","last_active":"2023-11-28T21:05:23.427074+0000","last_peered":"2023-11-28T21:05:23.427074+0000","last_clean":"2023-11-28T21:05:23.427074+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T21:05:23.427074+0000","last_undegraded":"2023-11-28T21:05:23.427074+0000","last_fullsized":"2023-11-28T21:05:23.427074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014814858,"stat_sum":{"num_bytes":20638408,"num_objects":542,"num_object_clones":251,"num_object_copies":2168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":251,"num_read":37,"num_read_kb":37,"num_write":1496,"num_write_kb":31881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"51'403","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.173141+0000","last_change":"2023-11-28T20:44:35.640929+0000","last_active":"2023-11-28T21:04:23.173141+0000","last_peered":"2023-11-28T21:04:23.173141+0000","last_clean":"2023-11-28T21:04:23.173141+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T21:04:23.173141+0000","last_undegraded":"2023-11-28T21:04:23.173141+0000","last_fullsized":"2023-11-28T21:04:23.173141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:27:39.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017837387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"51'371","reported_seq":429,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:24.595741+0000","last_change":"2023-11-28T20:38:18.538592+0000","last_active":"2023-11-28T21:05:24.595741+0000","last_peered":"2023-11-28T21:05:24.595741+0000","last_clean":"2023-11-28T21:05:24.595741+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T21:05:24.595741+0000","last_undegraded":"2023-11-28T21:05:24.595741+0000","last_fullsized":"2023-11-28T21:05:24.595741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":22,"num_write":339,"num_write_kb":16887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"51'1847","reported_seq":3731,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.570080+0000","last_change":"2023-11-28T20:44:35.610893+0000","last_active":"2023-11-28T21:02:15.570080+0000","last_peered":"2023-11-28T21:02:15.570080+0000","last_clean":"2023-11-28T21:02:15.570080+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T21:02:15.570080+0000","last_undegraded":"2023-11-28T21:02:15.570080+0000","last_fullsized":"2023-11-28T21:02:15.570080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:13:32.634308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015179433000000001,"stat_sum":{"num_bytes":40252075,"num_objects":555,"num_object_clones":243,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":243,"num_read":37,"num_read_kb":1813,"num_write":1586,"num_write_kb":49527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"51'398","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.172349+0000","last_change":"2023-11-28T20:44:35.639947+0000","last_active":"2023-11-28T21:04:23.172349+0000","last_peered":"2023-11-28T21:04:23.172349+0000","last_clean":"2023-11-28T21:04:23.172349+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T21:04:23.172349+0000","last_undegraded":"2023-11-28T21:04:23.172349+0000","last_fullsized":"2023-11-28T21:04:23.172349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:31:55.543573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018023955000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"51'400","reported_seq":454,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.568088+0000","last_change":"2023-11-28T20:38:18.547113+0000","last_active":"2023-11-28T21:04:28.568088+0000","last_peered":"2023-11-28T21:04:28.568088+0000","last_clean":"2023-11-28T21:04:28.568088+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T21:04:28.568088+0000","last_undegraded":"2023-11-28T21:04:28.568088+0000","last_fullsized":"2023-11-28T21:04:28.568088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:51:01.102815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094443,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":19633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"51'1788","reported_seq":3658,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:15.575375+0000","last_change":"2023-11-28T20:44:35.541705+0000","last_active":"2023-11-28T21:02:15.575375+0000","last_peered":"2023-11-28T21:02:15.575375+0000","last_clean":"2023-11-28T21:02:15.575375+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T21:02:15.575375+0000","last_undegraded":"2023-11-28T21:02:15.575375+0000","last_fullsized":"2023-11-28T21:02:15.575375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:17.458129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0090848279999999997,"stat_sum":{"num_bytes":25858877,"num_objects":550,"num_object_clones":249,"num_object_copies":2200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":550,"num_whiteouts":249,"num_read":30,"num_read_kb":4125,"num_write":1526,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"51'442","reported_seq":2534,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.171801+0000","last_change":"2023-11-28T20:44:35.636676+0000","last_active":"2023-11-28T21:04:23.171801+0000","last_peered":"2023-11-28T21:04:23.171801+0000","last_clean":"2023-11-28T21:04:23.171801+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T21:04:23.171801+0000","last_undegraded":"2023-11-28T21:04:23.171801+0000","last_fullsized":"2023-11-28T21:04:23.171801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:01:42.241191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020570496000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"51'633","reported_seq":688,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:01.534872+0000","last_change":"2023-11-28T20:38:18.535103+0000","last_active":"2023-11-28T21:04:01.534872+0000","last_peered":"2023-11-28T21:04:01.534872+0000","last_clean":"2023-11-28T21:04:01.534872+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T21:04:01.534872+0000","last_undegraded":"2023-11-28T21:04:01.534872+0000","last_fullsized":"2023-11-28T21:04:01.534872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":7,"num_write":598,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"51'1723","reported_seq":3620,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:58.424239+0000","last_change":"2023-11-28T20:44:35.606276+0000","last_active":"2023-11-28T21:04:58.424239+0000","last_peered":"2023-11-28T21:04:58.424239+0000","last_clean":"2023-11-28T21:04:58.424239+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T21:04:58.424239+0000","last_undegraded":"2023-11-28T21:04:58.424239+0000","last_fullsized":"2023-11-28T21:04:58.424239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011806407999999999,"stat_sum":{"num_bytes":28712373,"num_objects":524,"num_object_clones":239,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":239,"num_read":46,"num_read_kb":46,"num_write":1462,"num_write_kb":31285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"51'407","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.562470+0000","last_change":"2023-11-28T20:44:35.611801+0000","last_active":"2023-11-28T21:04:28.562470+0000","last_peered":"2023-11-28T21:04:28.562470+0000","last_clean":"2023-11-28T21:04:28.562470+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T21:04:28.562470+0000","last_undegraded":"2023-11-28T21:04:28.562470+0000","last_fullsized":"2023-11-28T21:04:28.562470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:13.862302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014629055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"51'458","reported_seq":511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.552953+0000","last_change":"2023-11-28T20:38:18.542567+0000","last_active":"2023-11-28T21:01:40.552953+0000","last_peered":"2023-11-28T21:01:40.552953+0000","last_clean":"2023-11-28T21:01:40.552953+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T21:01:40.552953+0000","last_undegraded":"2023-11-28T21:01:40.552953+0000","last_fullsized":"2023-11-28T21:01:40.552953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:46.628278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"51'1831","reported_seq":3700,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:04.593566+0000","last_change":"2023-11-28T20:44:35.613708+0000","last_active":"2023-11-28T21:05:04.593566+0000","last_peered":"2023-11-28T21:05:04.593566+0000","last_clean":"2023-11-28T21:05:04.593566+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T21:05:04.593566+0000","last_undegraded":"2023-11-28T21:05:04.593566+0000","last_fullsized":"2023-11-28T21:05:04.593566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017596898999999999,"stat_sum":{"num_bytes":20840070,"num_objects":572,"num_object_clones":259,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":259,"num_read":39,"num_read_kb":4134,"num_write":1549,"num_write_kb":33741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.172578+0000","last_change":"2023-11-28T20:44:35.639082+0000","last_active":"2023-11-28T21:04:23.172578+0000","last_peered":"2023-11-28T21:04:23.172578+0000","last_clean":"2023-11-28T21:04:23.172578+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T21:04:23.172578+0000","last_undegraded":"2023-11-28T21:04:23.172578+0000","last_fullsized":"2023-11-28T21:04:23.172578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:17.336904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019240779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"51'284","reported_seq":338,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:40.562767+0000","last_change":"2023-11-28T20:38:18.569645+0000","last_active":"2023-11-28T21:01:40.562767+0000","last_peered":"2023-11-28T21:01:40.562767+0000","last_clean":"2023-11-28T21:01:40.562767+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T21:01:40.562767+0000","last_undegraded":"2023-11-28T21:01:40.562767+0000","last_fullsized":"2023-11-28T21:01:40.562767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:20:11.482558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":238,"num_write_kb":12572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"51'1661","reported_seq":3549,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:11.621797+0000","last_change":"2023-11-28T20:44:35.616111+0000","last_active":"2023-11-28T21:04:11.621797+0000","last_peered":"2023-11-28T21:04:11.621797+0000","last_clean":"2023-11-28T21:04:11.621797+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T21:04:11.621797+0000","last_undegraded":"2023-11-28T21:04:11.621797+0000","last_fullsized":"2023-11-28T21:04:11.621797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018495173,"stat_sum":{"num_bytes":20919340,"num_objects":524,"num_object_clones":235,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":235,"num_read":33,"num_read_kb":33,"num_write":1415,"num_write_kb":40695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"51'413","reported_seq":2506,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.560176+0000","last_change":"2023-11-28T20:44:35.609530+0000","last_active":"2023-11-28T21:04:28.560176+0000","last_peered":"2023-11-28T21:04:28.560176+0000","last_clean":"2023-11-28T21:04:28.560176+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T21:04:28.560176+0000","last_undegraded":"2023-11-28T21:04:28.560176+0000","last_fullsized":"2023-11-28T21:04:28.560176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014112118999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"51'405","reported_seq":459,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:00.526479+0000","last_change":"2023-11-28T20:38:18.542354+0000","last_active":"2023-11-28T21:04:00.526479+0000","last_peered":"2023-11-28T21:04:00.526479+0000","last_clean":"2023-11-28T21:04:00.526479+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T21:04:00.526479+0000","last_undegraded":"2023-11-28T21:04:00.526479+0000","last_fullsized":"2023-11-28T21:04:00.526479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":16779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"51'1691","reported_seq":3584,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:35.574707+0000","last_change":"2023-11-28T20:44:35.613305+0000","last_active":"2023-11-28T21:02:35.574707+0000","last_peered":"2023-11-28T21:02:35.574707+0000","last_clean":"2023-11-28T21:02:35.574707+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T21:02:35.574707+0000","last_undegraded":"2023-11-28T21:02:35.574707+0000","last_fullsized":"2023-11-28T21:02:35.574707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:51.165815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015550285,"stat_sum":{"num_bytes":33895761,"num_objects":515,"num_object_clones":224,"num_object_copies":2060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515,"num_whiteouts":224,"num_read":28,"num_read_kb":28,"num_write":1451,"num_write_kb":37503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"51'394","reported_seq":2486,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.424848+0000","last_change":"2023-11-28T20:44:35.632331+0000","last_active":"2023-11-28T21:04:28.424848+0000","last_peered":"2023-11-28T21:04:28.424848+0000","last_clean":"2023-11-28T21:04:28.424848+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T21:04:28.424848+0000","last_undegraded":"2023-11-28T21:04:28.424848+0000","last_fullsized":"2023-11-28T21:04:28.424848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:35:55.459943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022690017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'566","reported_seq":619,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:05.583299+0000","last_change":"2023-11-28T20:38:18.543304+0000","last_active":"2023-11-28T21:04:05.583299+0000","last_peered":"2023-11-28T21:04:05.583299+0000","last_clean":"2023-11-28T21:04:05.583299+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T21:04:05.583299+0000","last_undegraded":"2023-11-28T21:04:05.583299+0000","last_fullsized":"2023-11-28T21:04:05.583299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:57.433180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":24942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"51'1823","reported_seq":3694,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:06.744387+0000","last_change":"2023-11-28T20:44:35.607147+0000","last_active":"2023-11-28T21:04:06.744387+0000","last_peered":"2023-11-28T21:04:06.744387+0000","last_clean":"2023-11-28T21:04:06.744387+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T21:04:06.744387+0000","last_undegraded":"2023-11-28T21:04:06.744387+0000","last_fullsized":"2023-11-28T21:04:06.744387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1823,"log_dups_size":0,"ondisk_log_size":1823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013090108,"stat_sum":{"num_bytes":42607549,"num_objects":556,"num_object_clones":254,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":254,"num_read":36,"num_read_kb":4131,"num_write":1543,"num_write_kb":57518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"51'388","reported_seq":2474,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:49.590863+0000","last_change":"2023-11-28T20:44:35.530346+0000","last_active":"2023-11-28T21:04:49.590863+0000","last_peered":"2023-11-28T21:04:49.590863+0000","last_clean":"2023-11-28T21:04:49.590863+0000","last_became_active":"2023-11-28T20:39:01.848225+0000","last_became_peered":"2023-11-28T20:39:01.848225+0000","last_unstale":"2023-11-28T21:04:49.590863+0000","last_undegraded":"2023-11-28T21:04:49.590863+0000","last_fullsized":"2023-11-28T21:04:49.590863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019608149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'538","reported_seq":592,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:54.591870+0000","last_change":"2023-11-28T20:38:18.570500+0000","last_active":"2023-11-28T21:04:54.591870+0000","last_peered":"2023-11-28T21:04:54.591870+0000","last_clean":"2023-11-28T21:04:54.591870+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T21:04:54.591870+0000","last_undegraded":"2023-11-28T21:04:54.591870+0000","last_fullsized":"2023-11-28T21:04:54.591870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":21060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"51'1816","reported_seq":3706,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:45.569384+0000","last_change":"2023-11-28T20:44:35.543972+0000","last_active":"2023-11-28T21:01:45.569384+0000","last_peered":"2023-11-28T21:01:45.569384+0000","last_clean":"2023-11-28T21:01:45.569384+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T21:01:45.569384+0000","last_undegraded":"2023-11-28T21:01:45.569384+0000","last_fullsized":"2023-11-28T21:01:45.569384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:46.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010092998000000001,"stat_sum":{"num_bytes":33600436,"num_objects":568,"num_object_clones":254,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":254,"num_read":57,"num_read_kb":4152,"num_write":1538,"num_write_kb":45454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"51'410","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:58.424309+0000","last_change":"2023-11-28T20:44:35.605933+0000","last_active":"2023-11-28T21:04:58.424309+0000","last_peered":"2023-11-28T21:04:58.424309+0000","last_clean":"2023-11-28T21:04:58.424309+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T21:04:58.424309+0000","last_undegraded":"2023-11-28T21:04:58.424309+0000","last_fullsized":"2023-11-28T21:04:58.424309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744874000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"51'484","reported_seq":538,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.573719+0000","last_change":"2023-11-28T20:38:18.568777+0000","last_active":"2023-11-28T21:02:30.573719+0000","last_peered":"2023-11-28T21:02:30.573719+0000","last_clean":"2023-11-28T21:02:30.573719+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T21:02:30.573719+0000","last_undegraded":"2023-11-28T21:02:30.573719+0000","last_fullsized":"2023-11-28T21:02:30.573719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:08:05.817659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":27,"num_write":437,"num_write_kb":33175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"51'1777","reported_seq":3672,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:06.620729+0000","last_change":"2023-11-28T20:44:35.614798+0000","last_active":"2023-11-28T21:04:06.620729+0000","last_peered":"2023-11-28T21:04:06.620729+0000","last_clean":"2023-11-28T21:04:06.620729+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T21:04:06.620729+0000","last_undegraded":"2023-11-28T21:04:06.620729+0000","last_fullsized":"2023-11-28T21:04:06.620729+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018323326000000001,"stat_sum":{"num_bytes":24785841,"num_objects":525,"num_object_clones":238,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":238,"num_read":34,"num_read_kb":34,"num_write":1518,"num_write_kb":32579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"51'411","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178537+0000","last_change":"2023-11-28T20:44:35.621854+0000","last_active":"2023-11-28T21:04:23.178537+0000","last_peered":"2023-11-28T21:04:23.178537+0000","last_clean":"2023-11-28T21:04:23.178537+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T21:04:23.178537+0000","last_undegraded":"2023-11-28T21:04:23.178537+0000","last_fullsized":"2023-11-28T21:04:23.178537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:22.775318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022293309000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"51'163","reported_seq":216,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.563729+0000","last_change":"2023-11-28T20:38:18.571725+0000","last_active":"2023-11-28T21:02:30.563729+0000","last_peered":"2023-11-28T21:02:30.563729+0000","last_clean":"2023-11-28T21:02:30.563729+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T21:02:30.563729+0000","last_undegraded":"2023-11-28T21:02:30.563729+0000","last_fullsized":"2023-11-28T21:02:30.563729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:20.276279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"51'1914","reported_seq":3777,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:06.620806+0000","last_change":"2023-11-28T20:44:35.611992+0000","last_active":"2023-11-28T21:04:06.620806+0000","last_peered":"2023-11-28T21:04:06.620806+0000","last_clean":"2023-11-28T21:04:06.620806+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T21:04:06.620806+0000","last_undegraded":"2023-11-28T21:04:06.620806+0000","last_fullsized":"2023-11-28T21:04:06.620806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016210088000000001,"stat_sum":{"num_bytes":26682582,"num_objects":583,"num_object_clones":263,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":583,"num_whiteouts":263,"num_read":39,"num_read_kb":8229,"num_write":1627,"num_write_kb":50263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"51'1808","reported_seq":3654,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:33.420994+0000","last_change":"2023-11-28T20:44:35.605377+0000","last_active":"2023-11-28T21:04:33.420994+0000","last_peered":"2023-11-28T21:04:33.420994+0000","last_clean":"2023-11-28T21:04:33.420994+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T21:04:33.420994+0000","last_undegraded":"2023-11-28T21:04:33.420994+0000","last_fullsized":"2023-11-28T21:04:33.420994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011090378999999999,"stat_sum":{"num_bytes":29341830,"num_objects":589,"num_object_clones":267,"num_object_copies":2356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":267,"num_read":21,"num_read_kb":21,"num_write":1524,"num_write_kb":32957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"51'411","reported_seq":2504,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:59.592513+0000","last_change":"2023-11-28T20:44:35.601680+0000","last_active":"2023-11-28T21:04:59.592513+0000","last_peered":"2023-11-28T21:04:59.592513+0000","last_clean":"2023-11-28T21:04:59.592513+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T21:04:59.592513+0000","last_undegraded":"2023-11-28T21:04:59.592513+0000","last_fullsized":"2023-11-28T21:04:59.592513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0086681780000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"51'600","reported_seq":655,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:02:30.573365+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T21:02:30.573365+0000","last_peered":"2023-11-28T21:02:30.573365+0000","last_clean":"2023-11-28T21:02:30.573365+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T21:02:30.573365+0000","last_undegraded":"2023-11-28T21:02:30.573365+0000","last_fullsized":"2023-11-28T21:02:30.573365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:44.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":33,"num_write":550,"num_write_kb":45433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"51'1738","reported_seq":3612,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:01:20.549285+0000","last_change":"2023-11-28T20:44:35.619807+0000","last_active":"2023-11-28T21:01:20.549285+0000","last_peered":"2023-11-28T21:01:20.549285+0000","last_clean":"2023-11-28T21:01:20.549285+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T21:01:20.549285+0000","last_undegraded":"2023-11-28T21:01:20.549285+0000","last_fullsized":"2023-11-28T21:01:20.549285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1738,"log_dups_size":0,"ondisk_log_size":1738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:09:00.302899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016829818,"stat_sum":{"num_bytes":16566795,"num_objects":555,"num_object_clones":248,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":248,"num_read":32,"num_read_kb":32,"num_write":1476,"num_write_kb":23281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"51'447","reported_seq":2540,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:59.592688+0000","last_change":"2023-11-28T20:44:35.615234+0000","last_active":"2023-11-28T21:04:59.592688+0000","last_peered":"2023-11-28T21:04:59.592688+0000","last_clean":"2023-11-28T21:04:59.592688+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T21:04:59.592688+0000","last_undegraded":"2023-11-28T21:04:59.592688+0000","last_fullsized":"2023-11-28T21:04:59.592688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018571445999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"51'758","reported_seq":1303,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:04.593480+0000","last_change":"2023-11-28T20:38:18.546922+0000","last_active":"2023-11-28T21:05:04.593480+0000","last_peered":"2023-11-28T21:05:04.593480+0000","last_clean":"2023-11-28T21:05:04.593480+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T21:05:04.593480+0000","last_undegraded":"2023-11-28T21:05:04.593480+0000","last_fullsized":"2023-11-28T21:05:04.593480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18014655,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":492,"num_read_kb":1568,"num_write":714,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"51'1105","reported_seq":1657,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:00:50.543016+0000","last_change":"2023-11-28T20:38:18.543853+0000","last_active":"2023-11-28T21:00:50.543016+0000","last_peered":"2023-11-28T21:00:50.543016+0000","last_clean":"2023-11-28T21:00:50.543016+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T21:00:50.543016+0000","last_undegraded":"2023-11-28T21:00:50.543016+0000","last_fullsized":"2023-11-28T21:00:50.543016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:14:49.769084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34584852,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":502,"num_read_kb":1393,"num_write":1050,"num_write_kb":34570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"51'366","reported_seq":2458,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.560614+0000","last_change":"2023-11-28T20:44:35.611477+0000","last_active":"2023-11-28T21:04:28.560614+0000","last_peered":"2023-11-28T21:04:28.560614+0000","last_clean":"2023-11-28T21:04:28.560614+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T21:04:28.560614+0000","last_undegraded":"2023-11-28T21:04:28.560614+0000","last_fullsized":"2023-11-28T21:04:28.560614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014791248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"51'1725","reported_seq":3595,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:26.530330+0000","last_change":"2023-11-28T20:44:35.530646+0000","last_active":"2023-11-28T21:03:26.530330+0000","last_peered":"2023-11-28T21:03:26.530330+0000","last_clean":"2023-11-28T21:03:26.530330+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T21:03:26.530330+0000","last_undegraded":"2023-11-28T21:03:26.530330+0000","last_fullsized":"2023-11-28T21:03:26.530330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022000169999999999,"stat_sum":{"num_bytes":29986576,"num_objects":543,"num_object_clones":248,"num_object_copies":2172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":248,"num_read":29,"num_read_kb":29,"num_write":1454,"num_write_kb":38376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"51'365","reported_seq":418,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:21.614251+0000","last_change":"2023-11-28T20:38:18.553049+0000","last_active":"2023-11-28T21:03:21.614251+0000","last_peered":"2023-11-28T21:03:21.614251+0000","last_clean":"2023-11-28T21:03:21.614251+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T21:03:21.614251+0000","last_undegraded":"2023-11-28T21:03:21.614251+0000","last_fullsized":"2023-11-28T21:03:21.614251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":20723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"51'401","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491589+0000","last_change":"2023-11-28T20:44:35.544103+0000","last_active":"2023-11-28T21:04:30.491589+0000","last_peered":"2023-11-28T21:04:30.491589+0000","last_clean":"2023-11-28T21:04:30.491589+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T21:04:30.491589+0000","last_undegraded":"2023-11-28T21:04:30.491589+0000","last_fullsized":"2023-11-28T21:04:30.491589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:40.051010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010086065,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"51'1756","reported_seq":3649,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:26.614938+0000","last_change":"2023-11-28T20:44:35.611344+0000","last_active":"2023-11-28T21:03:26.614938+0000","last_peered":"2023-11-28T21:03:26.614938+0000","last_clean":"2023-11-28T21:03:26.614938+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T21:03:26.614938+0000","last_undegraded":"2023-11-28T21:03:26.614938+0000","last_fullsized":"2023-11-28T21:03:26.614938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015656369999999999,"stat_sum":{"num_bytes":33768985,"num_objects":521,"num_object_clones":238,"num_object_copies":2084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":238,"num_read":45,"num_read_kb":12330,"num_write":1499,"num_write_kb":48802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"51'415","reported_seq":2509,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559983+0000","last_change":"2023-11-28T20:44:35.609721+0000","last_active":"2023-11-28T21:04:28.559983+0000","last_peered":"2023-11-28T21:04:28.559983+0000","last_clean":"2023-11-28T21:04:28.559983+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T21:04:28.559983+0000","last_undegraded":"2023-11-28T21:04:28.559983+0000","last_fullsized":"2023-11-28T21:04:28.559983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:10:39.776841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013289166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"51'439","reported_seq":2534,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:24.595640+0000","last_change":"2023-11-28T20:44:35.529934+0000","last_active":"2023-11-28T21:05:24.595640+0000","last_peered":"2023-11-28T21:05:24.595640+0000","last_clean":"2023-11-28T21:05:24.595640+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T21:05:24.595640+0000","last_undegraded":"2023-11-28T21:05:24.595640+0000","last_fullsized":"2023-11-28T21:05:24.595640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017225739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"51'438","reported_seq":2532,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564840+0000","last_change":"2023-11-28T20:44:35.624744+0000","last_active":"2023-11-28T21:04:28.564840+0000","last_peered":"2023-11-28T21:04:28.564840+0000","last_clean":"2023-11-28T21:04:28.564840+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T21:04:28.564840+0000","last_undegraded":"2023-11-28T21:04:28.564840+0000","last_fullsized":"2023-11-28T21:04:28.564840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:53.447494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018881576000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"51'384","reported_seq":2478,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559010+0000","last_change":"2023-11-28T20:44:35.611177+0000","last_active":"2023-11-28T21:04:28.559010+0000","last_peered":"2023-11-28T21:04:28.559010+0000","last_clean":"2023-11-28T21:04:28.559010+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T21:04:28.559010+0000","last_undegraded":"2023-11-28T21:04:28.559010+0000","last_fullsized":"2023-11-28T21:04:28.559010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014673739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"51'367","reported_seq":2461,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.566980+0000","last_change":"2023-11-28T20:44:35.615657+0000","last_active":"2023-11-28T21:04:28.566980+0000","last_peered":"2023-11-28T21:04:28.566980+0000","last_clean":"2023-11-28T21:04:28.566980+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T21:04:28.566980+0000","last_undegraded":"2023-11-28T21:04:28.566980+0000","last_fullsized":"2023-11-28T21:04:28.566980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017627927000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"51'417","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495199+0000","last_change":"2023-11-28T20:44:35.599239+0000","last_active":"2023-11-28T21:04:30.495199+0000","last_peered":"2023-11-28T21:04:30.495199+0000","last_clean":"2023-11-28T21:04:30.495199+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T21:04:30.495199+0000","last_undegraded":"2023-11-28T21:04:30.495199+0000","last_fullsized":"2023-11-28T21:04:30.495199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061577519999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"51'426","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.177843+0000","last_change":"2023-11-28T20:44:35.619451+0000","last_active":"2023-11-28T21:04:23.177843+0000","last_peered":"2023-11-28T21:04:23.177843+0000","last_clean":"2023-11-28T21:04:23.177843+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T21:04:23.177843+0000","last_undegraded":"2023-11-28T21:04:23.177843+0000","last_fullsized":"2023-11-28T21:04:23.177843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:18.657101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017436297999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"51'394","reported_seq":2488,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564309+0000","last_change":"2023-11-28T20:44:35.614405+0000","last_active":"2023-11-28T21:04:28.564309+0000","last_peered":"2023-11-28T21:04:28.564309+0000","last_clean":"2023-11-28T21:04:28.564309+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T21:04:28.564309+0000","last_undegraded":"2023-11-28T21:04:28.564309+0000","last_fullsized":"2023-11-28T21:04:28.564309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018095488999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"51'421","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.454749+0000","last_change":"2023-11-28T20:44:35.611219+0000","last_active":"2023-11-28T21:04:26.454749+0000","last_peered":"2023-11-28T21:04:26.454749+0000","last_clean":"2023-11-28T21:04:26.454749+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T21:04:26.454749+0000","last_undegraded":"2023-11-28T21:04:26.454749+0000","last_fullsized":"2023-11-28T21:04:26.454749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:23.122455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014654275,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"51'411","reported_seq":2505,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:19.595543+0000","last_change":"2023-11-28T20:44:35.613449+0000","last_active":"2023-11-28T21:05:19.595543+0000","last_peered":"2023-11-28T21:05:19.595543+0000","last_clean":"2023-11-28T21:05:19.595543+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T21:05:19.595543+0000","last_undegraded":"2023-11-28T21:05:19.595543+0000","last_fullsized":"2023-11-28T21:05:19.595543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017356489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"51'417","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492170+0000","last_change":"2023-11-28T20:44:35.530341+0000","last_active":"2023-11-28T21:04:30.492170+0000","last_peered":"2023-11-28T21:04:30.492170+0000","last_clean":"2023-11-28T21:04:30.492170+0000","last_became_active":"2023-11-28T20:39:01.848167+0000","last_became_peered":"2023-11-28T20:39:01.848167+0000","last_unstale":"2023-11-28T21:04:30.492170+0000","last_undegraded":"2023-11-28T21:04:30.492170+0000","last_fullsized":"2023-11-28T21:04:30.492170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020579169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"51'422","reported_seq":2516,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:23.427054+0000","last_change":"2023-11-28T20:44:35.610405+0000","last_active":"2023-11-28T21:05:23.427054+0000","last_peered":"2023-11-28T21:05:23.427054+0000","last_clean":"2023-11-28T21:05:23.427054+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T21:05:23.427054+0000","last_undegraded":"2023-11-28T21:05:23.427054+0000","last_fullsized":"2023-11-28T21:05:23.427054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014291543,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"51'396","reported_seq":2489,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.193454+0000","last_change":"2023-11-28T20:44:35.620800+0000","last_active":"2023-11-28T21:04:23.193454+0000","last_peered":"2023-11-28T21:04:23.193454+0000","last_clean":"2023-11-28T21:04:23.193454+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T21:04:23.193454+0000","last_undegraded":"2023-11-28T21:04:23.193454+0000","last_fullsized":"2023-11-28T21:04:23.193454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:40:05.581863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017003022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"51'403","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492817+0000","last_change":"2023-11-28T20:44:35.638243+0000","last_active":"2023-11-28T21:04:30.492817+0000","last_peered":"2023-11-28T21:04:30.492817+0000","last_clean":"2023-11-28T21:04:30.492817+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T21:04:30.492817+0000","last_undegraded":"2023-11-28T21:04:30.492817+0000","last_fullsized":"2023-11-28T21:04:30.492817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:50:42.227579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020849563000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"51'393","reported_seq":2486,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491740+0000","last_change":"2023-11-28T20:44:35.530649+0000","last_active":"2023-11-28T21:04:30.491740+0000","last_peered":"2023-11-28T21:04:30.491740+0000","last_clean":"2023-11-28T21:04:30.491740+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T21:04:30.491740+0000","last_undegraded":"2023-11-28T21:04:30.491740+0000","last_fullsized":"2023-11-28T21:04:30.491740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019691359999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"51'430","reported_seq":2522,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178483+0000","last_change":"2023-11-28T20:44:35.617721+0000","last_active":"2023-11-28T21:04:23.178483+0000","last_peered":"2023-11-28T21:04:23.178483+0000","last_clean":"2023-11-28T21:04:23.178483+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T21:04:23.178483+0000","last_undegraded":"2023-11-28T21:04:23.178483+0000","last_fullsized":"2023-11-28T21:04:23.178483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:40.430998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019569492000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"51'421","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559068+0000","last_change":"2023-11-28T20:44:35.612279+0000","last_active":"2023-11-28T21:04:28.559068+0000","last_peered":"2023-11-28T21:04:28.559068+0000","last_clean":"2023-11-28T21:04:28.559068+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T21:04:28.559068+0000","last_undegraded":"2023-11-28T21:04:28.559068+0000","last_fullsized":"2023-11-28T21:04:28.559068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:43:57.398242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015773832000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"51'435","reported_seq":2528,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491441+0000","last_change":"2023-11-28T20:44:35.606941+0000","last_active":"2023-11-28T21:04:30.491441+0000","last_peered":"2023-11-28T21:04:30.491441+0000","last_clean":"2023-11-28T21:04:30.491441+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T21:04:30.491441+0000","last_undegraded":"2023-11-28T21:04:30.491441+0000","last_fullsized":"2023-11-28T21:04:30.491441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013692045,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"51'417","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495614+0000","last_change":"2023-11-28T20:44:35.609244+0000","last_active":"2023-11-28T21:04:30.495614+0000","last_peered":"2023-11-28T21:04:30.495614+0000","last_clean":"2023-11-28T21:04:30.495614+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T21:04:30.495614+0000","last_undegraded":"2023-11-28T21:04:30.495614+0000","last_fullsized":"2023-11-28T21:04:30.495614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014004656000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"51'418","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:54.592127+0000","last_change":"2023-11-28T20:44:35.614800+0000","last_active":"2023-11-28T21:04:54.592127+0000","last_peered":"2023-11-28T21:04:54.592127+0000","last_clean":"2023-11-28T21:04:54.592127+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T21:04:54.592127+0000","last_undegraded":"2023-11-28T21:04:54.592127+0000","last_fullsized":"2023-11-28T21:04:54.592127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018246884000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"51'374","reported_seq":2466,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.158886+0000","last_change":"2023-11-28T20:44:35.544988+0000","last_active":"2023-11-28T21:04:23.158886+0000","last_peered":"2023-11-28T21:04:23.158886+0000","last_clean":"2023-11-28T21:04:23.158886+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T21:04:23.158886+0000","last_undegraded":"2023-11-28T21:04:23.158886+0000","last_fullsized":"2023-11-28T21:04:23.158886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:16:32.112808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010909501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"51'380","reported_seq":2472,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176371+0000","last_change":"2023-11-28T20:44:35.611282+0000","last_active":"2023-11-28T21:04:23.176371+0000","last_peered":"2023-11-28T21:04:23.176371+0000","last_clean":"2023-11-28T21:04:23.176371+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T21:04:23.176371+0000","last_undegraded":"2023-11-28T21:04:23.176371+0000","last_fullsized":"2023-11-28T21:04:23.176371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:52:02.947575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014265125,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"51'385","reported_seq":2484,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492462+0000","last_change":"2023-11-28T20:44:35.618555+0000","last_active":"2023-11-28T21:04:30.492462+0000","last_peered":"2023-11-28T21:04:30.492462+0000","last_clean":"2023-11-28T21:04:30.492462+0000","last_became_active":"2023-11-28T20:39:01.391291+0000","last_became_peered":"2023-11-28T20:39:01.391291+0000","last_unstale":"2023-11-28T21:04:30.492462+0000","last_undegraded":"2023-11-28T21:04:30.492462+0000","last_fullsized":"2023-11-28T21:04:30.492462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:29.414536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017078507999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"51'419","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176881+0000","last_change":"2023-11-28T20:44:35.640277+0000","last_active":"2023-11-28T21:04:23.176881+0000","last_peered":"2023-11-28T21:04:23.176881+0000","last_clean":"2023-11-28T21:04:23.176881+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T21:04:23.176881+0000","last_undegraded":"2023-11-28T21:04:23.176881+0000","last_fullsized":"2023-11-28T21:04:23.176881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:00.933807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017711331,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"51'405","reported_seq":2497,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.565035+0000","last_change":"2023-11-28T20:44:35.613891+0000","last_active":"2023-11-28T21:04:28.565035+0000","last_peered":"2023-11-28T21:04:28.565035+0000","last_clean":"2023-11-28T21:04:28.565035+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T21:04:28.565035+0000","last_undegraded":"2023-11-28T21:04:28.565035+0000","last_fullsized":"2023-11-28T21:04:28.565035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017616142000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"51'400","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.561114+0000","last_change":"2023-11-28T20:44:35.635891+0000","last_active":"2023-11-28T21:04:28.561114+0000","last_peered":"2023-11-28T21:04:28.561114+0000","last_clean":"2023-11-28T21:04:28.561114+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T21:04:28.561114+0000","last_undegraded":"2023-11-28T21:04:28.561114+0000","last_fullsized":"2023-11-28T21:04:28.561114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:37:28.366415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020312439000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"51'403","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.558229+0000","last_change":"2023-11-28T20:44:35.622789+0000","last_active":"2023-11-28T21:04:28.558229+0000","last_peered":"2023-11-28T21:04:28.558229+0000","last_clean":"2023-11-28T21:04:28.558229+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T21:04:28.558229+0000","last_undegraded":"2023-11-28T21:04:28.558229+0000","last_fullsized":"2023-11-28T21:04:28.558229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:13:32.111164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017449602000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"51'416","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492750+0000","last_change":"2023-11-28T20:44:35.638249+0000","last_active":"2023-11-28T21:04:30.492750+0000","last_peered":"2023-11-28T21:04:30.492750+0000","last_clean":"2023-11-28T21:04:30.492750+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T21:04:30.492750+0000","last_undegraded":"2023-11-28T21:04:30.492750+0000","last_fullsized":"2023-11-28T21:04:30.492750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:30:55.963557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018992159000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"51'397","reported_seq":2491,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.448022+0000","last_change":"2023-11-28T20:44:35.613038+0000","last_active":"2023-11-28T21:04:26.448022+0000","last_peered":"2023-11-28T21:04:26.448022+0000","last_clean":"2023-11-28T21:04:26.448022+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T21:04:26.448022+0000","last_undegraded":"2023-11-28T21:04:26.448022+0000","last_fullsized":"2023-11-28T21:04:26.448022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:00:29.806450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015371953000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"51'415","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:23.427126+0000","last_change":"2023-11-28T20:44:35.603769+0000","last_active":"2023-11-28T21:05:23.427126+0000","last_peered":"2023-11-28T21:05:23.427126+0000","last_clean":"2023-11-28T21:05:23.427126+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T21:05:23.427126+0000","last_undegraded":"2023-11-28T21:05:23.427126+0000","last_fullsized":"2023-11-28T21:05:23.427126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098716120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"51'399","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:24.595898+0000","last_change":"2023-11-28T20:44:35.607958+0000","last_active":"2023-11-28T21:05:24.595898+0000","last_peered":"2023-11-28T21:05:24.595898+0000","last_clean":"2023-11-28T21:05:24.595898+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T21:05:24.595898+0000","last_undegraded":"2023-11-28T21:05:24.595898+0000","last_fullsized":"2023-11-28T21:05:24.595898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011275626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"51'410","reported_seq":2504,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176712+0000","last_change":"2023-11-28T20:44:35.639151+0000","last_active":"2023-11-28T21:04:23.176712+0000","last_peered":"2023-11-28T21:04:23.176712+0000","last_clean":"2023-11-28T21:04:23.176712+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T21:04:23.176712+0000","last_undegraded":"2023-11-28T21:04:23.176712+0000","last_fullsized":"2023-11-28T21:04:23.176712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:25:42.800941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017369464000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":892224822,"num_objects":17666,"num_object_clones":8054,"num_object_copies":70664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17666,"num_whiteouts":7974,"num_read":1150,"num_read_kb":100500,"num_write":48457,"num_write_kb":1187847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1881309184,"data_stored":1881309184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57114,"ondisk_log_size":57114,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26113,"ondisk_log_size":26113,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":680923161,"num_objects":625,"num_object_clones":0,"num_object_copies":1250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":0,"num_read":1485,"num_read_kb":4455,"num_write":14545,"num_write_kb":680650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84018,"num_omap_keys":160,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1362001920,"data_stored":1361846322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15166,"ondisk_log_size":15166,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509772,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":650828,"kb_used_data":461380,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":93721012,"statfs":{"total":96636764160,"available":95970316288,"internally_reserved":0,"allocated":472453120,"data_stored":472148767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":193984967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":42.021000000000001,"5min":8.7739999999999991,"15min":3.2749999999999999},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":873.04100000000005,"5min":873.04100000000005,"15min":873.04100000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.52300000000000002},"min":{"1min":0.24299999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":6.5659999999999998},"last":0.35399999999999998}]},{"osd":1,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":1.194,"5min":1.194,"15min":6.9370000000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.52400000000000002,"15min":0.54400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.627,"5min":0.79700000000000004,"15min":3.6219999999999999},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.8780000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":39.405999999999999,"5min":8.3049999999999997,"15min":3.1909999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.28299999999999997},"max":{"1min":817.63900000000001,"5min":817.63900000000001,"15min":817.63900000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":253.649,"5min":51.384,"15min":17.940000000000001},"min":{"1min":0.56299999999999994,"5min":0.48699999999999999,"15min":0.34799999999999998},"max":{"1min":3268.6419999999998,"5min":3268.6419999999998,"15min":3268.6419999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":253.23400000000001,"5min":51.326999999999998,"15min":17.667999999999999},"min":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"max":{"1min":3232.7750000000001,"5min":3232.7750000000001,"15min":3232.7750000000001},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":229.02799999999999,"5min":46.481999999999999,"15min":16.082999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.42299999999999999},"max":{"1min":3259.5459999999998,"5min":3259.5459999999998,"15min":3259.5459999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":36.899999999999999,"5min":8.0679999999999996,"15min":3.2559999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53300000000000003},"max":{"1min":703.19299999999998,"5min":703.19299999999998,"15min":703.19299999999998},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":46.119,"5min":9.9299999999999997,"15min":3.9100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":928.99199999999996,"5min":928.99199999999996,"15min":928.99199999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":49.222999999999999,"5min":10.545,"15min":4.1520000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":961.01800000000003,"5min":961.01800000000003,"15min":961.01800000000003},"last":0.73699999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":44.685000000000002,"5min":9.6370000000000005,"15min":4.1289999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.44600000000000001},"max":{"1min":872.827,"5min":872.827,"15min":872.827},"last":0.61599999999999999},{"interface":"front","average":{"1min":41.890000000000001,"5min":9.0760000000000005,"15min":3.6160000000000001},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.48899999999999999},"max":{"1min":817.84400000000005,"5min":817.84400000000005,"15min":817.84400000000005},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509772,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424976,"kb_used_data":277192,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93946864,"statfs":{"total":96636764160,"available":96201588736,"internally_reserved":0,"allocated":283844608,"data_stored":283539830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9790000000000001,"5min":1.5509999999999999,"15min":0.82999999999999996},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":64.087000000000003,"5min":64.087000000000003,"15min":64.087000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":6.0759999999999996,"5min":1.667,"15min":0.95599999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25},"max":{"1min":64.114999999999995,"5min":64.114999999999995,"15min":64.114999999999995},"last":0.35899999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9960000000000004,"5min":1.647,"15min":0.97199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":64,"5min":64,"15min":64},"last":0.39700000000000002},{"interface":"front","average":{"1min":6.0679999999999996,"5min":1.7,"15min":0.97399999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":64.028999999999996,"5min":64.028999999999996,"15min":64.028999999999996},"last":0.42599999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":144.126,"5min":29.332000000000001,"15min":10.220000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2826.7199999999998,"5min":2826.7199999999998,"15min":2826.7199999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":146.227,"5min":29.651,"15min":10.257999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.307},"max":{"1min":2838.0680000000002,"5min":2838.0680000000002,"15min":2838.0680000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":13.901,"5min":3.4500000000000002,"15min":1.7190000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.38},"max":{"1min":149.43700000000001,"5min":149.43700000000001,"15min":149.43700000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":262.66399999999999,"5min":53.177,"15min":18.265000000000001},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.38800000000000001},"max":{"1min":3288.7310000000002,"5min":3288.7310000000002,"15min":3288.7310000000002},"last":0.94499999999999995}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":308.05099999999999,"5min":62.268999999999998,"15min":21.323},"min":{"1min":0.68500000000000005,"5min":0.54700000000000004,"15min":0.46000000000000002},"max":{"1min":3314.4110000000001,"5min":3314.4110000000001,"15min":3314.4110000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":207.60499999999999,"5min":42.195999999999998,"15min":14.644},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.44900000000000001},"max":{"1min":2139.3159999999998,"5min":2139.3159999999998,"15min":2139.3159999999998},"last":0.71399999999999997}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":317.48099999999999,"5min":64.153999999999996,"15min":21.949000000000002},"min":{"1min":0.64100000000000001,"5min":0.56999999999999995,"15min":0.38700000000000001},"max":{"1min":3288.7730000000001,"5min":3288.7730000000001,"15min":3288.7730000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":254.578,"5min":51.664000000000001,"15min":17.855},"min":{"1min":0.77700000000000002,"5min":0.68500000000000005,"15min":0.42699999999999999},"max":{"1min":2837.9960000000001,"5min":2837.9960000000001,"15min":2837.9960000000001},"last":0.80200000000000005}]},{"osd":7,"last update":"Tue Nov 28 21:04:54 2023","interfaces":[{"interface":"back","average":{"1min":151.316,"5min":30.917999999999999,"15min":10.859999999999999},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.46899999999999997},"max":{"1min":2822.598,"5min":2822.598,"15min":2822.598},"last":0.69299999999999995},{"interface":"front","average":{"1min":235.82599999999999,"5min":47.865000000000002,"15min":16.504999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.45400000000000001},"max":{"1min":2150.9899999999998,"5min":2150.9899999999998,"15min":2150.9899999999998},"last":0.747}]}]},{"osd":1,"up_from":15,"seq":64424509773,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660764,"kb_used_data":458836,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93711076,"statfs":{"total":96636764160,"available":95960141824,"internally_reserved":0,"allocated":469848064,"data_stored":469543023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.01,"5min":2.3849999999999998,"15min":1.1799999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":143.76300000000001,"5min":143.76300000000001,"15min":143.76300000000001},"last":0.373},{"interface":"front","average":{"1min":2.4769999999999999,"5min":0.92200000000000004,"15min":0.71799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":39.768000000000001,"5min":39.768000000000001,"15min":39.768000000000001},"last":0.435}]},{"osd":2,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":8.2780000000000005,"5min":2.0510000000000002,"15min":1.042},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.252},"max":{"1min":149.34299999999999,"5min":149.34299999999999,"15min":149.34299999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":6.5229999999999997},"last":0.35299999999999998}]},{"osd":3,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.726000000000001,"5min":2.5840000000000001,"15min":1.2589999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26700000000000002},"max":{"1min":147.46899999999999,"5min":147.46899999999999,"15min":147.46899999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":3.6179999999999999,"5min":1.216,"15min":0.85499999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":59.305,"5min":59.305,"15min":59.305},"last":0.39400000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":20.18,"5min":4.649,"15min":2.1320000000000001},"min":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.40400000000000003},"max":{"1min":221.76900000000001,"5min":221.76900000000001,"15min":221.76900000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":63.805999999999997,"5min":13.407,"15min":5.4569999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.34300000000000003},"max":{"1min":1198.962,"5min":1198.962,"15min":1198.962},"last":0.79900000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":31.141999999999999,"5min":6.9329999999999998,"15min":2.9169999999999998},"min":{"1min":0.60199999999999998,"5min":0.56299999999999994,"15min":0.42599999999999999},"max":{"1min":574.81700000000001,"5min":574.81700000000001,"15min":574.81700000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":2.9430000000000001,"5min":1.341,"15min":1.099},"min":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.501},"max":{"1min":39.896999999999998,"5min":39.896999999999998,"15min":39.896999999999998},"last":0.67100000000000004}]},{"osd":6,"last update":"Tue Nov 28 21:05:10 2023","interfaces":[{"interface":"back","average":{"1min":63.299999999999997,"5min":13.385,"15min":5.0860000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.47099999999999997},"max":{"1min":1168.432,"5min":1168.432,"15min":1168.432},"last":0.81000000000000005},{"interface":"front","average":{"1min":2.9279999999999999,"5min":1.276,"15min":1.0389999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46000000000000002},"max":{"1min":39.863,"5min":39.863,"15min":39.863},"last":0.623}]},{"osd":7,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":12.673,"5min":3.246,"15min":1.679},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.54000000000000004},"max":{"1min":143.89599999999999,"5min":143.89599999999999,"15min":143.89599999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":63.936,"5min":13.486000000000001,"15min":5.0670000000000002},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1198.933,"5min":1198.933,"15min":1198.933},"last":0.60199999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542475,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":565548,"kb_used_data":417764,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93806292,"statfs":{"total":96636764160,"available":96057643008,"internally_reserved":0,"allocated":427790336,"data_stored":427490226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":151321034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.03300000000002,"5min":93.887,"15min":31.899999999999999},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.29699999999999999},"max":{"1min":3136.5639999999999,"5min":3136.5639999999999,"15min":3136.5639999999999},"last":1.204},{"interface":"front","average":{"1min":271.74400000000003,"5min":55.098999999999997,"15min":18.936},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.36899999999999999},"max":{"1min":2779.4099999999999,"5min":2779.4099999999999,"15min":2779.4099999999999},"last":1.095}]},{"osd":1,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":470.35899999999998,"5min":94.754999999999995,"15min":32.216000000000001},"min":{"1min":0.55900000000000005,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":3167.6399999999999,"5min":3167.6399999999999,"15min":3167.6399999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":496.947,"5min":100.057,"15min":33.951000000000001},"min":{"1min":0.61899999999999999,"5min":0.496,"15min":0.46400000000000002},"max":{"1min":4741.7640000000001,"5min":4741.7640000000001,"15min":4741.7640000000001},"last":0.88600000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":279.05900000000003,"5min":56.529000000000003,"15min":19.739999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.42899999999999999},"max":{"1min":2301.0599999999999,"5min":2301.0599999999999,"15min":2301.0599999999999},"last":0.621},{"interface":"front","average":{"1min":499.01799999999997,"5min":100.639,"15min":34.240000000000002},"min":{"1min":0.82999999999999996,"5min":0.69299999999999995,"15min":0.42399999999999999},"max":{"1min":4752.8689999999997,"5min":4752.8689999999997,"15min":4752.8689999999997},"last":1.0209999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.53500000000003,"5min":94.042000000000002,"15min":32.265999999999998},"min":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.44700000000000001},"max":{"1min":3147.2719999999999,"5min":3147.2719999999999,"15min":3147.2719999999999},"last":1.056},{"interface":"front","average":{"1min":298.06700000000001,"5min":60.340000000000003,"15min":20.724},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.44500000000000001},"max":{"1min":2301.1370000000002,"5min":2301.1370000000002,"15min":2301.1370000000002},"last":0.752}]},{"osd":4,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.91200000000000003,"15min":1.282},"min":{"1min":0.69899999999999995,"5min":0.57499999999999996,"15min":0.38900000000000001},"max":{"1min":1.056,"5min":1.266,"15min":71.313000000000002},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.1870000000000001},"min":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.40000000000000002},"max":{"1min":1.2929999999999999,"5min":1.335,"15min":34.881},"last":1.2909999999999999}]},{"osd":5,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0600000000000001,"15min":1.29},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.39700000000000002},"max":{"1min":1.895,"5min":1.895,"15min":44.558},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1339999999999999,"15min":1.1559999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.41399999999999998},"max":{"1min":1.956,"5min":1.956,"15min":3.782},"last":1.1659999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.01,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.44700000000000001},"max":{"1min":1.1879999999999999,"5min":1.47,"15min":7.6769999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.89100000000000001,"5min":0.71499999999999997,"15min":0.38100000000000001},"max":{"1min":1.645,"5min":1.645,"15min":2.7949999999999999},"last":1.248}]}]},{"osd":6,"up_from":14,"seq":60129542476,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600852,"kb_used_data":439180,"kb_used_omap":1,"kb_used_meta":161662,"kb_avail":93770988,"statfs":{"total":96636764160,"available":96021491712,"internally_reserved":0,"allocated":449720320,"data_stored":449421964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165542342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.524000000000001,"5min":19.795000000000002,"15min":7.1429999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.41299999999999998},"max":{"1min":1038.4960000000001,"5min":1038.4960000000001,"15min":1038.4960000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":95.692999999999998,"5min":19.936,"15min":7.2519999999999998},"min":{"1min":0.79500000000000004,"5min":0.52900000000000003,"15min":0.33600000000000002},"max":{"1min":1038.5619999999999,"5min":1038.5619999999999,"15min":1038.5619999999999},"last":0.80900000000000005}]},{"osd":1,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":101.98699999999999,"5min":21.116,"15min":7.6189999999999998},"min":{"1min":0.60899999999999999,"5min":0.52900000000000003,"15min":0.41399999999999998},"max":{"1min":1046.3320000000001,"5min":1046.3320000000001,"15min":1046.3320000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":68.814999999999998,"5min":14.573,"15min":5.4710000000000001},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.42899999999999999},"max":{"1min":1087.7460000000001,"5min":1087.7460000000001,"15min":1087.7460000000001},"last":0.70299999999999996}]},{"osd":2,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.518000000000001,"5min":19.795000000000002,"15min":7.1929999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.435},"max":{"1min":1038.309,"5min":1038.309,"15min":1038.309},"last":0.88900000000000001},{"interface":"front","average":{"1min":254.767,"5min":51.676000000000002,"15min":17.823},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.35099999999999998},"max":{"1min":2556.578,"5min":2556.578,"15min":2556.578},"last":0.92200000000000004}]},{"osd":3,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":225.25899999999999,"5min":45.744999999999997,"15min":15.845000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54300000000000004},"max":{"1min":2567.538,"5min":2567.538,"15min":2567.538},"last":0.61299999999999999},{"interface":"front","average":{"1min":176.50999999999999,"5min":36.079000000000001,"15min":12.673},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.39700000000000002},"max":{"1min":1371.7280000000001,"5min":1371.7280000000001,"15min":1371.7280000000001},"last":0.75900000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91200000000000003,"15min":1.0449999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":10.151},"last":1.089},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.05,"15min":1.056},"min":{"1min":0.71299999999999997,"5min":0.64200000000000002,"15min":0.437},"max":{"1min":1.2689999999999999,"5min":1.5640000000000001,"15min":3.2629999999999999},"last":0.85699999999999998}]},{"osd":5,"last update":"Tue Nov 28 21:05:02 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.071,"15min":1.101},"min":{"1min":0.76700000000000002,"5min":0.58399999999999996,"15min":0.50800000000000001},"max":{"1min":1.218,"5min":1.5449999999999999,"15min":4.5519999999999996},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0629999999999999,"15min":1.1519999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3480000000000001,"5min":1.694,"15min":2.1899999999999999},"last":0.995}]},{"osd":7,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1160000000000001,"15min":1.147},"min":{"1min":0.91600000000000004,"5min":0.77900000000000003,"15min":0.56899999999999995},"max":{"1min":1.3859999999999999,"5min":1.5149999999999999,"15min":4.6639999999999997},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.165,"15min":1.2150000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.651,"15min":3.2029999999999998},"last":1.0609999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542476,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505928,"kb_used_data":335936,"kb_used_omap":1,"kb_used_meta":169982,"kb_avail":93865912,"statfs":{"total":96636764160,"available":96118693888,"internally_reserved":0,"allocated":343998464,"data_stored":343698460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":174062021},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:14 2023","interfaces":[{"interface":"back","average":{"1min":84.838999999999999,"5min":17.664000000000001,"15min":6.4409999999999998},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.27100000000000002},"max":{"1min":1605.194,"5min":1605.194,"15min":1605.194},"last":1.032},{"interface":"front","average":{"1min":94.373000000000005,"5min":19.542000000000002,"15min":7.0590000000000002},"min":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.27100000000000002},"max":{"1min":1603.2260000000001,"5min":1603.2260000000001,"15min":1603.2260000000001},"last":0.79700000000000004}]},{"osd":1,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":84.260000000000005,"5min":17.545000000000002,"15min":6.4279999999999999},"min":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.253},"max":{"1min":1749.1869999999999,"5min":1749.1869999999999,"15min":1749.1869999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":279.99700000000001,"5min":56.835999999999999,"15min":19.574000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.442},"max":{"1min":3741.5659999999998,"5min":3741.5659999999998,"15min":3741.5659999999998},"last":1.133}]},{"osd":2,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":8.0679999999999996,"5min":2.411,"15min":1.4319999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.309},"max":{"1min":152.40199999999999,"5min":152.40199999999999,"15min":152.40199999999999},"last":0.629},{"interface":"front","average":{"1min":279.81599999999997,"5min":56.707000000000001,"15min":19.506},"min":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.435},"max":{"1min":3741.3910000000001,"5min":3741.3910000000001,"15min":3741.3910000000001},"last":0.85299999999999998}]},{"osd":3,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":327.06200000000001,"5min":66.230999999999995,"15min":22.754999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.34999999999999998},"max":{"1min":3904.835,"5min":3904.835,"15min":3904.835},"last":1.216},{"interface":"front","average":{"1min":86.721999999999994,"5min":18.109999999999999,"15min":6.7000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.35299999999999998},"max":{"1min":1785.712,"5min":1785.712,"15min":1785.712},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.28199999999999997},"max":{"1min":1.393,"5min":1.393,"15min":3.7930000000000001},"last":1.105},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.103,"15min":1.0900000000000001},"min":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.29999999999999999},"max":{"1min":1.3120000000000001,"5min":1.5860000000000001,"15min":4.7320000000000002},"last":1.2969999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.1779999999999999},"min":{"1min":0.68200000000000005,"5min":0.65700000000000003,"15min":0.318},"max":{"1min":1.393,"5min":1.728,"15min":5.6600000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.77300000000000002,"5min":0.64200000000000002,"15min":0.34000000000000002},"max":{"1min":1.536,"5min":1.6100000000000001,"15min":2.573},"last":0.98799999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1779999999999999,"15min":1.0700000000000001},"min":{"1min":0.69999999999999996,"5min":0.69299999999999995,"15min":0.28299999999999997},"max":{"1min":1.4730000000000001,"5min":1.633,"15min":3.9060000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1519999999999999,"15min":1.206},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36899999999999999},"max":{"1min":1.4670000000000001,"5min":1.6519999999999999,"15min":4.8109999999999999},"last":1.3220000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542475,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616800,"kb_used_data":437080,"kb_used_omap":1,"kb_used_meta":179710,"kb_avail":93755040,"statfs":{"total":96636764160,"available":96005160960,"internally_reserved":0,"allocated":447569920,"data_stored":447273953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":184023493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":370.74799999999999,"5min":74.813999999999993,"15min":25.507999999999999},"min":{"1min":0.54100000000000004,"5min":0.42399999999999999,"15min":0.25600000000000001},"max":{"1min":4472.0990000000002,"5min":4472.0990000000002,"15min":4472.0990000000002},"last":0.5},{"interface":"front","average":{"1min":370.78800000000001,"5min":74.861000000000004,"15min":25.640000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.33000000000000002},"max":{"1min":4472.4799999999996,"5min":4472.4799999999996,"15min":4472.4799999999996},"last":0.60199999999999998}]},{"osd":1,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":340.39299999999997,"5min":68.760000000000005,"15min":23.995999999999999},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.34000000000000002},"max":{"1min":2473.319,"5min":2473.319,"15min":2473.319},"last":0.70299999999999996},{"interface":"front","average":{"1min":343.56,"5min":69.445999999999998,"15min":24.108000000000001},"min":{"1min":0.64300000000000002,"5min":0.52400000000000002,"15min":0.40600000000000003},"max":{"1min":2525.277,"5min":2525.277,"15min":2525.277},"last":0.84499999999999997}]},{"osd":2,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":193.78399999999999,"5min":39.509999999999998,"15min":14.141},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.38600000000000001},"max":{"1min":2323.7979999999998,"5min":2323.7979999999998,"15min":2323.7979999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":308.291,"5min":62.448,"15min":21.914000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.35599999999999998},"max":{"1min":2498.6460000000002,"5min":2498.6460000000002,"15min":2498.6460000000002},"last":0.94499999999999995}]},{"osd":3,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":311.33499999999998,"5min":63.033000000000001,"15min":21.722999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38900000000000001},"max":{"1min":2516.6700000000001,"5min":2516.6700000000001,"15min":2516.6700000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":321.84899999999999,"5min":65.114000000000004,"15min":22.658000000000001},"min":{"1min":0.75700000000000001,"5min":0.53200000000000003,"15min":0.441},"max":{"1min":2478.165,"5min":2478.165,"15min":2478.165},"last":0.97899999999999998}]},{"osd":5,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":1.292},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.36399999999999999},"max":{"1min":1.1699999999999999,"5min":1.3999999999999999,"15min":19.408999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.016,"15min":1.0940000000000001},"min":{"1min":0.67400000000000004,"5min":0.502,"15min":0.35699999999999998},"max":{"1min":1.3360000000000001,"5min":1.4970000000000001,"15min":9.375},"last":1.079}]},{"osd":6,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.032,"15min":1.3540000000000001},"min":{"1min":0.67700000000000005,"5min":0.625,"15min":0.42399999999999999},"max":{"1min":1.3460000000000001,"5min":1.415,"15min":36.531999999999996},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.111,"15min":1.772},"min":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.42799999999999999},"max":{"1min":1.3440000000000001,"5min":1.4730000000000001,"15min":85.367999999999995},"last":1.012}]},{"osd":7,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.2070000000000001},"min":{"1min":0.73099999999999998,"5min":0.61099999999999999,"15min":0.42999999999999999},"max":{"1min":1.403,"5min":1.5760000000000001,"15min":9.3399999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1499999999999999,"15min":1.4330000000000001},"min":{"1min":0.85399999999999998,"5min":0.78900000000000003,"15min":0.33900000000000002},"max":{"1min":1.5509999999999999,"5min":1.577,"15min":36.591999999999999},"last":1.052}]}]},{"osd":0,"up_from":14,"seq":60129542475,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503304,"kb_used_data":345792,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":93868536,"statfs":{"total":96636764160,"available":96121380864,"internally_reserved":0,"allocated":354091008,"data_stored":353789699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":22.460000000000001,"5min":4.8289999999999997,"15min":1.97},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":297.16899999999998,"5min":297.16899999999998,"15min":297.16899999999998},"last":0.45800000000000002},{"interface":"front","average":{"1min":22.552,"5min":4.9340000000000002,"15min":1.984},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":297.202,"5min":297.202,"15min":297.202},"last":0.59299999999999997}]},{"osd":2,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":20.687000000000001,"5min":4.5090000000000003,"15min":1.8580000000000001},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":335.166,"5min":335.166,"15min":335.166},"last":0.504},{"interface":"front","average":{"1min":19.943999999999999,"5min":4.4329999999999998,"15min":1.835},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":335.19400000000002,"5min":335.19400000000002,"15min":335.19400000000002},"last":0.57299999999999995}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":4.274,"5min":1.325,"15min":0.81599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.28399999999999997},"max":{"1min":53.808,"5min":53.808,"15min":53.808},"last":0.61599999999999999},{"interface":"front","average":{"1min":145.27699999999999,"5min":29.565000000000001,"15min":10.308},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35599999999999998},"max":{"1min":2839.3989999999999,"5min":2839.3989999999999,"15min":2839.3989999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":135.411,"5min":27.715,"15min":9.8290000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2822.2359999999999,"5min":2822.2359999999999,"15min":2822.2359999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":135.35900000000001,"5min":27.701000000000001,"15min":9.7970000000000006},"min":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.496},"max":{"1min":2822.212,"5min":2822.212,"15min":2822.212},"last":0.89500000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":96.162000000000006,"5min":19.890999999999998,"15min":7.1820000000000004},"min":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.47099999999999997},"max":{"1min":1936.5550000000001,"5min":1936.5550000000001,"15min":1936.5550000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":122.643,"5min":25.228999999999999,"15min":8.9879999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.50700000000000001},"max":{"1min":1999.019,"5min":1999.019,"15min":1999.019},"last":1.008}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":142.648,"5min":29.18,"15min":10.353999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48199999999999998},"max":{"1min":2832.431,"5min":2832.431,"15min":2832.431},"last":0.99099999999999999},{"interface":"front","average":{"1min":142.119,"5min":29.050999999999998,"15min":10.282999999999999},"min":{"1min":0.56299999999999994,"5min":0.48599999999999999,"15min":0.44700000000000001},"max":{"1min":2822.1840000000002,"5min":2822.1840000000002,"15min":2822.1840000000002},"last":0.80100000000000005}]},{"osd":7,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":146.452,"5min":30.036999999999999,"15min":10.622},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.53300000000000003},"max":{"1min":1999.058,"5min":1999.058,"15min":1999.058},"last":1.0369999999999999},{"interface":"front","average":{"1min":225.40299999999999,"5min":45.713999999999999,"15min":15.869999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2822.143,"5min":2822.143,"15min":2822.143},"last":0.872}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":170106880,"data_stored":170090025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":171458560,"data_stored":171434421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85495808,"data_stored":85471932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":183201792,"data_stored":183178341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":187912192,"data_stored":187897127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171967842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":182108160,"data_stored":182090706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209731584,"data_stored":209715928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":182788096,"data_stored":182788096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":297787392,"data_stored":297787392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":197746688,"data_stored":197746688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":288649216,"data_stored":288649216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259055616,"data_stored":259055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171409408,"data_stored":171409408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":267010048,"data_stored":267010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":216862720,"data_stored":216862720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:05:30.769 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.769 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.769 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.769 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.770 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.770 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.770 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.770 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.770 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.770 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.771 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.771 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.771 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.771 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.771 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.772 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.772 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.772 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.772 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.772 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.772 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.773 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.773 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.773 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.773 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.773 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.773 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.774 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.774 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.774 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.774 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.774 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.775 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.775 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.775 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.775 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.775 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.775 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.776 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.776 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.776 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.776 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.777 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.777 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.777 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.777 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T20:38:05.508885+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=5, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.777 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.777 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.778 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.778 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.778 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.778 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.778 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.779 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.779 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.779 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.779 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.779 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.779 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.780 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.780 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.780 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.780 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.780 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.780 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.781 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.781 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.781 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.781 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.781 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.781 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.782 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.782 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.782 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.782 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.782 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.783 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.783 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.783 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.783 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.783 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.783 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.784 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.784 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.784 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.784 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.784 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.784 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.785 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.785 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.785 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.785 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.785 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.785 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.785 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.786 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.786 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.786 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.786 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.786 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.787 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.787 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.787 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.787 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.787 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.787 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.787 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.788 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.788 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.788 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.788 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.788 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.788 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.789 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.789 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.789 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.789 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.789 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.790 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.790 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.790 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.790 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.790 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.791 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.791 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.791 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.791 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:30.791 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T21:05:50.792 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:05:50.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f60357640 1 Processor -- start 2023-11-28T21:05:50.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f60357640 1 -- start start 2023-11-28T21:05:50.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f60357640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f580c6ff0 0x7f9f58157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:50.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f60357640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f580c48f0 con 0x7f9f58150b40 2023-11-28T21:05:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f60357640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f580c6ac0 con 0x7f9f580c4510 2023-11-28T21:05:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f60357640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f580c62f0 con 0x7f9f580c6ff0 2023-11-28T21:05:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5e0f3640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9f58150b40 0x7f9f580c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:51936/0 (socket says 172.21.15.167:51936) 2023-11-28T21:05:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5e0f3640 1 -- 172.21.15.167:0/1853276207 learned_addr learned my addr 172.21.15.167:0/1853276207 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:05:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d8f2640 1 --2- 172.21.15.167:0/1853276207 >> v2:172.21.15.178:3300/0 conn(0x7f9f580c6ff0 0x7f9f58157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972553168 0 0) 0x7f9f580c48f0 con 0x7f9f58150b40 2023-11-28T21:05:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f44003530 con 0x7f9f58150b40 2023-11-28T21:05:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2624479550 0 0) 0x7f9f44003530 con 0x7f9f58150b40 2023-11-28T21:05:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 >> v2:172.21.15.178:3300/0 conn(0x7f9f580c6ff0 msgr2=0x7f9f58157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 --2- 172.21.15.167:0/1853276207 >> v2:172.21.15.178:3300/0 conn(0x7f9f580c6ff0 0x7f9f58157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 >> v1:172.21.15.178:6789/0 conn(0x7f9f580c4510 legacy=0x7f9f5806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f580c6500 con 0x7f9f58150b40 2023-11-28T21:05:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f9f540016a0 con 0x7f9f58150b40 2023-11-28T21:05:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 >> v1:172.21.15.167:6789/0 conn(0x7f9f58150b40 legacy=0x7f9f580c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f44003980 0x7f9f44003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f440047d0 0x7f9f44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f4400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580c62f0 con 0x7f9f44005190 2023-11-28T21:05:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4400c010 con 0x7f9f44003980 2023-11-28T21:05:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4400c1d0 con 0x7f9f440047d0 2023-11-28T21:05:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5e8f4640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f4400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5d8f2640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f440047d0 0x7f9f44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:50.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5e8f4640 1 -- 172.21.15.167:0/1853276207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f440047d0 msgr2=0x7f9f44004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:50.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5e8f4640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f440047d0 0x7f9f44004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:50.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5e8f4640 1 -- 172.21.15.167:0/1853276207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f44003980 msgr2=0x7f9f44003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:05:50.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5e8f4640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f44003980 0x7f9f44003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:50.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.900+0000 7f9f5e8f4640 1 -- 172.21.15.167:0/1853276207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44003530 con 0x7f9f44005190 2023-11-28T21:05:50.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f5e8f4640 1 -- 172.21.15.167:0/1853276207 reap_dead start 2023-11-28T21:05:50.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f5e8f4640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f4400b990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f500044b0 tx=0x7f9f5001e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4253386441eac389 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:50.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f500a7790 con 0x7f9f44005190 2023-11-28T21:05:50.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f500a7910 con 0x7f9f44005190 2023-11-28T21:05:50.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f5d0f1640 1 -- 172.21.15.167:0/1853276207 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f500a7cc0 con 0x7f9f44005190 2023-11-28T21:05:50.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f60357640 1 -- 172.21.15.167:0/1853276207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 msgr2=0x7f9f4400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:50.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f60357640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f4400b990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f500044b0 tx=0x7f9f5001e890 comp rx=0 tx=0).stop 2023-11-28T21:05:50.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f60357640 1 -- 172.21.15.167:0/1853276207 shutdown_connections 2023-11-28T21:05:50.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f60357640 1 --2- 172.21.15.167:0/1853276207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f4400b990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:50.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f60357640 1 -- 172.21.15.167:0/1853276207 >> 172.21.15.167:0/1853276207 conn(0x7f9f580cb1e0 msgr2=0x7f9f580cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:50.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f60357640 1 -- 172.21.15.167:0/1853276207 shutdown_connections 2023-11-28T21:05:50.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.904+0000 7f9f60357640 1 -- 172.21.15.167:0/1853276207 wait complete. 2023-11-28T21:05:50.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 Processor -- start 2023-11-28T21:05:50.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 -- start start 2023-11-28T21:05:50.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f580ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:50.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f580ca6a0 0x7f9f581495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:50.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f58149af0 0x7f9f581eb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:50.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58149f70 con 0x7f9f44005190 2023-11-28T21:05:50.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58151650 con 0x7f9f580ca6a0 2023-11-28T21:05:50.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f581518f0 con 0x7f9f58149af0 2023-11-28T21:05:50.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e0f3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f580ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:50.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e0f3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f580ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:40796/0 (socket says 172.21.15.167:40796) 2023-11-28T21:05:50.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e0f3640 1 -- 172.21.15.167:0/4188819063 learned_addr learned my addr 172.21.15.167:0/4188819063 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:05:50.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e8f4640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f58149af0 0x7f9f581eb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:50.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5d8f2640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f580ca6a0 0x7f9f581495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:50.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e0f3640 1 -- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f58149af0 msgr2=0x7f9f581eb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:50.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e0f3640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f58149af0 0x7f9f581eb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e0f3640 1 -- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f580ca6a0 msgr2=0x7f9f581495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e0f3640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f580ca6a0 0x7f9f581495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e0f3640 1 -- 172.21.15.167:0/4188819063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f581ee830 con 0x7f9f44005190 2023-11-28T21:05:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f5e0f3640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f580ca160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400c730 tx=0x7f9f5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f4effd640 1 -- 172.21.15.167:0/4188819063 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540074e0 con 0x7f9f44005190 2023-11-28T21:05:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f4effd640 1 -- 172.21.15.167:0/4188819063 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54007640 con 0x7f9f44005190 2023-11-28T21:05:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f581eeb10 con 0x7f9f44005190 2023-11-28T21:05:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f4effd640 1 -- 172.21.15.167:0/4188819063 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54004a30 con 0x7f9f44005190 2023-11-28T21:05:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f581ef0d0 con 0x7f9f44005190 2023-11-28T21:05:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f580682c0 con 0x7f9f44005190 2023-11-28T21:05:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.908+0000 7f9f4effd640 1 -- 172.21.15.167:0/4188819063 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f54004b90 con 0x7f9f44005190 2023-11-28T21:05:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.912+0000 7f9f4effd640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9f3c0664a0 0x7f9f3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:05:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.912+0000 7f9f4effd640 1 -- 172.21.15.167:0/4188819063 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f9f540835c0 con 0x7f9f44005190 2023-11-28T21:05:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.912+0000 7f9f5d8f2640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9f3c0664a0 0x7f9f3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:05:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.912+0000 7f9f5d8f2640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9f3c0664a0 0x7f9f3c068960 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9f580c3900 tx=0x7f9f48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:05:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:50.916+0000 7f9f4effd640 1 -- 172.21.15.167:0/4188819063 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f54054190 con 0x7f9f44005190 2023-11-28T21:05:51.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.056+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f580caa80 con 0x7f9f3c0664a0 2023-11-28T21:05:51.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.084+0000 7f9f4effd640 1 -- 172.21.15.167:0/4188819063 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372548 (secure 0 0 0) 0x7f9f580caa80 con 0x7f9f3c0664a0 2023-11-28T21:05:51.091 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:05:51.094 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T21:05:51.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9f3c0664a0 msgr2=0x7f9f3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:51.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9f3c0664a0 0x7f9f3c068960 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9f580c3900 tx=0x7f9f48008040 comp rx=0 tx=0).stop 2023-11-28T21:05:51.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 msgr2=0x7f9f580ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:05:51.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f580ca160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400c730 tx=0x7f9f5400cbf0 comp rx=0 tx=0).stop 2023-11-28T21:05:51.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 shutdown_connections 2023-11-28T21:05:51.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f9f3c0664a0 0x7f9f3c068960 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:51.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f58149af0 0x7f9f581eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:51.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f580ca6a0 0x7f9f581495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:51.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 --2- 172.21.15.167:0/4188819063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f44005190 0x7f9f580ca160 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:05:51.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 >> 172.21.15.167:0/4188819063 conn(0x7f9f580cb1e0 msgr2=0x7f9f58071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:05:51.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 shutdown_connections 2023-11-28T21:05:51.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:05:51.088+0000 7f9f60357640 1 -- 172.21.15.167:0/4188819063 wait complete. 2023-11-28T21:05:51.108 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":876,"stamp":"2023-11-28T21:05:50.134423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573738351,"num_objects":18293,"num_object_clones":8054,"num_object_copies":71918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18293,"num_whiteouts":7974,"num_read":2751,"num_read_kb":105055,"num_write":63161,"num_write_kb":1870913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2615215,"num_omap_keys":4997,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99074,"ondisk_log_size":99074,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4530408,"kb_used_data":3173160,"kb_used_omap":12,"kb_used_meta":1357171,"kb_avail":750444312,"statfs":{"total":773094113280,"available":768454975488,"internally_reserved":0,"allocated":3249315840,"data_stored":3246905922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1389743664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1814625,"num_omap_keys":3524,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004982"},"pg_stats":[{"pgid":"2.1f","version":"51'568","reported_seq":633,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.187926+0000","last_change":"2023-11-28T21:05:32.187967+0000","last_active":"2023-11-28T21:05:32.187926+0000","last_peered":"2023-11-28T21:05:32.187926+0000","last_clean":"2023-11-28T21:05:32.187926+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T21:05:32.187926+0000","last_undegraded":"2023-11-28T21:05:32.187926+0000","last_fullsized":"2023-11-28T21:05:32.187926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'568","last_scrub_stamp":"2023-11-28T21:05:32.187849+0000","last_deep_scrub":"51'568","last_deep_scrub_stamp":"2023-11-28T21:05:32.187849+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.187849+0000","objects_scrubbed":22,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:57:58.029094+0000","scrub_duration":0.086821672000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":13,"num_write":501,"num_write_kb":29002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":102240,"num_omap_keys":193,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'428","reported_seq":2516,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:04.593318+0000","last_change":"2023-11-28T20:44:35.608330+0000","last_active":"2023-11-28T21:05:04.593318+0000","last_peered":"2023-11-28T21:05:04.593318+0000","last_clean":"2023-11-28T21:05:04.593318+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T21:05:04.593318+0000","last_undegraded":"2023-11-28T21:05:04.593318+0000","last_fullsized":"2023-11-28T21:05:04.593318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012127499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"51'1858","reported_seq":3699,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:09.593973+0000","last_change":"2023-11-28T20:44:35.612490+0000","last_active":"2023-11-28T21:05:09.593973+0000","last_peered":"2023-11-28T21:05:09.593973+0000","last_clean":"2023-11-28T21:05:09.593973+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T21:05:09.593973+0000","last_undegraded":"2023-11-28T21:05:09.593973+0000","last_fullsized":"2023-11-28T21:05:09.593973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016916996,"stat_sum":{"num_bytes":12268315,"num_objects":556,"num_object_clones":279,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":239,"num_read":31,"num_read_kb":4126,"num_write":1561,"num_write_kb":24667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"51'629","reported_seq":694,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.376092+0000","last_change":"2023-11-28T21:05:42.376131+0000","last_active":"2023-11-28T21:05:42.376092+0000","last_peered":"2023-11-28T21:05:42.376092+0000","last_clean":"2023-11-28T21:05:42.376092+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T21:05:42.376092+0000","last_undegraded":"2023-11-28T21:05:42.376092+0000","last_fullsized":"2023-11-28T21:05:42.376092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'629","last_scrub_stamp":"2023-11-28T21:05:42.376020+0000","last_deep_scrub":"51'629","last_deep_scrub_stamp":"2023-11-28T21:05:42.376020+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.376020+0000","objects_scrubbed":18,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:29.854245+0000","scrub_duration":0.078645286999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":546,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35806,"num_omap_keys":68,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"51'383","reported_seq":2486,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:48.164466+0000","last_change":"2023-11-28T21:05:48.164491+0000","last_active":"2023-11-28T21:05:48.164466+0000","last_peered":"2023-11-28T21:05:48.164466+0000","last_clean":"2023-11-28T21:05:48.164466+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T21:05:48.164466+0000","last_undegraded":"2023-11-28T21:05:48.164466+0000","last_fullsized":"2023-11-28T21:05:48.164466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'383","last_scrub_stamp":"2023-11-28T21:05:48.164339+0000","last_deep_scrub":"51'383","last_deep_scrub_stamp":"2023-11-28T21:05:48.164339+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.164339+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:11.595753+0000","scrub_duration":0.0027454979999999999,"objects_trimmed":0,"snaptrim_duration":0.010031783000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"51'1843","reported_seq":3752,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.385576+0000","last_change":"2023-11-28T21:05:45.385624+0000","last_active":"2023-11-28T21:05:45.385576+0000","last_peered":"2023-11-28T21:05:45.385576+0000","last_clean":"2023-11-28T21:05:45.385576+0000","last_became_active":"2023-11-28T20:39:01.389891+0000","last_became_peered":"2023-11-28T20:39:01.389891+0000","last_unstale":"2023-11-28T21:05:45.385576+0000","last_undegraded":"2023-11-28T21:05:45.385576+0000","last_fullsized":"2023-11-28T21:05:45.385576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1843","last_scrub_stamp":"2023-11-28T21:05:45.385425+0000","last_deep_scrub":"51'1843","last_deep_scrub_stamp":"2023-11-28T21:05:45.385425+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.385425+0000","objects_scrubbed":578,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:28.388874+0000","scrub_duration":0.43209253600000003,"objects_trimmed":0,"snaptrim_duration":0.0084388650000000003,"stat_sum":{"num_bytes":22024896,"num_objects":578,"num_object_clones":267,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":267,"num_read":47,"num_read_kb":8236,"num_write":1555,"num_write_kb":33440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"51'602","reported_seq":663,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.520672+0000","last_change":"2023-11-28T21:05:45.520765+0000","last_active":"2023-11-28T21:05:45.520672+0000","last_peered":"2023-11-28T21:05:45.520672+0000","last_clean":"2023-11-28T21:05:45.520672+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T21:05:45.520672+0000","last_undegraded":"2023-11-28T21:05:45.520672+0000","last_fullsized":"2023-11-28T21:05:45.520672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'602","last_scrub_stamp":"2023-11-28T21:05:45.520500+0000","last_deep_scrub":"51'602","last_deep_scrub_stamp":"2023-11-28T21:05:45.520500+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.520500+0000","objects_scrubbed":23,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:53.505086+0000","scrub_duration":0.106955033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66384,"num_omap_keys":125,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"51'396","reported_seq":2488,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.174754+0000","last_change":"2023-11-28T20:44:35.614099+0000","last_active":"2023-11-28T21:04:23.174754+0000","last_peered":"2023-11-28T21:04:23.174754+0000","last_clean":"2023-11-28T21:04:23.174754+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T21:04:23.174754+0000","last_undegraded":"2023-11-28T21:04:23.174754+0000","last_fullsized":"2023-11-28T21:04:23.174754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016140509000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1696","reported_seq":3583,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:25.589779+0000","last_change":"2023-11-28T20:44:35.542225+0000","last_active":"2023-11-28T21:03:25.589779+0000","last_peered":"2023-11-28T21:03:25.589779+0000","last_clean":"2023-11-28T21:03:25.589779+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T21:03:25.589779+0000","last_undegraded":"2023-11-28T21:03:25.589779+0000","last_fullsized":"2023-11-28T21:03:25.589779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0093789649999999995,"stat_sum":{"num_bytes":11818887,"num_objects":514,"num_object_clones":236,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":236,"num_read":34,"num_read_kb":34,"num_write":1442,"num_write_kb":18567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"51'415","reported_seq":477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:36.552205+0000","last_change":"2023-11-28T21:05:36.552278+0000","last_active":"2023-11-28T21:05:36.552205+0000","last_peered":"2023-11-28T21:05:36.552205+0000","last_clean":"2023-11-28T21:05:36.552205+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T21:05:36.552205+0000","last_undegraded":"2023-11-28T21:05:36.552205+0000","last_fullsized":"2023-11-28T21:05:36.552205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:36.552022+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:36.552022+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.552022+0000","objects_scrubbed":11,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:51.358100+0000","scrub_duration":0.050659634000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":354,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":50644,"num_omap_keys":93,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"51'394","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.100654+0000","last_change":"2023-11-28T21:05:34.100707+0000","last_active":"2023-11-28T21:05:34.100654+0000","last_peered":"2023-11-28T21:05:34.100654+0000","last_clean":"2023-11-28T21:05:34.100654+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T21:05:34.100654+0000","last_undegraded":"2023-11-28T21:05:34.100654+0000","last_fullsized":"2023-11-28T21:05:34.100654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:34.100435+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:34.100435+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.100435+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:40.322315+0000","scrub_duration":0.0040552970000000002,"objects_trimmed":0,"snaptrim_duration":0.019881585,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"51'1748","reported_seq":3614,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:25.589738+0000","last_change":"2023-11-28T20:44:35.542475+0000","last_active":"2023-11-28T21:03:25.589738+0000","last_peered":"2023-11-28T21:03:25.589738+0000","last_clean":"2023-11-28T21:03:25.589738+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T21:03:25.589738+0000","last_undegraded":"2023-11-28T21:03:25.589738+0000","last_fullsized":"2023-11-28T21:03:25.589738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092901790000000008,"stat_sum":{"num_bytes":16892767,"num_objects":571,"num_object_clones":263,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":571,"num_whiteouts":263,"num_read":40,"num_read_kb":48,"num_write":1465,"num_write_kb":20221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"51'418","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:25.587132+0000","last_change":"2023-11-28T20:44:35.616278+0000","last_active":"2023-11-28T21:04:25.587132+0000","last_peered":"2023-11-28T21:04:25.587132+0000","last_clean":"2023-11-28T21:04:25.587132+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T21:04:25.587132+0000","last_undegraded":"2023-11-28T21:04:25.587132+0000","last_fullsized":"2023-11-28T21:04:25.587132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017860755999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"51'359","reported_seq":423,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:43.550683+0000","last_change":"2023-11-28T21:05:43.550784+0000","last_active":"2023-11-28T21:05:43.550683+0000","last_peered":"2023-11-28T21:05:43.550683+0000","last_clean":"2023-11-28T21:05:43.550683+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T21:05:43.550683+0000","last_undegraded":"2023-11-28T21:05:43.550683+0000","last_fullsized":"2023-11-28T21:05:43.550683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'359","last_scrub_stamp":"2023-11-28T21:05:43.550489+0000","last_deep_scrub":"51'359","last_deep_scrub_stamp":"2023-11-28T21:05:43.550489+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.550489+0000","objects_scrubbed":23,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:36:27.546980+0000","scrub_duration":0.113957661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":274,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89762,"num_omap_keys":171,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"51'1713","reported_seq":3607,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:25.613335+0000","last_change":"2023-11-28T20:44:35.546423+0000","last_active":"2023-11-28T21:05:25.613335+0000","last_peered":"2023-11-28T21:05:25.613335+0000","last_clean":"2023-11-28T21:05:25.613335+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T21:05:25.613335+0000","last_undegraded":"2023-11-28T21:05:25.613335+0000","last_fullsized":"2023-11-28T21:05:25.613335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011349794999999999,"stat_sum":{"num_bytes":42075033,"num_objects":519,"num_object_clones":229,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":229,"num_read":33,"num_read_kb":8223,"num_write":1463,"num_write_kb":57658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"51'395","reported_seq":2497,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.289499+0000","last_change":"2023-11-28T21:05:32.289522+0000","last_active":"2023-11-28T21:05:32.289499+0000","last_peered":"2023-11-28T21:05:32.289499+0000","last_clean":"2023-11-28T21:05:32.289499+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T21:05:32.289499+0000","last_undegraded":"2023-11-28T21:05:32.289499+0000","last_fullsized":"2023-11-28T21:05:32.289499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'395","last_scrub_stamp":"2023-11-28T21:05:32.289412+0000","last_deep_scrub":"51'395","last_deep_scrub_stamp":"2023-11-28T21:05:32.289412+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.289412+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:10.715951+0000","scrub_duration":0.001674711,"objects_trimmed":0,"snaptrim_duration":0.018528307000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"51'488","reported_seq":552,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.677412+0000","last_change":"2023-11-28T21:05:46.677480+0000","last_active":"2023-11-28T21:05:46.677412+0000","last_peered":"2023-11-28T21:05:46.677412+0000","last_clean":"2023-11-28T21:05:46.677412+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T21:05:46.677412+0000","last_undegraded":"2023-11-28T21:05:46.677412+0000","last_fullsized":"2023-11-28T21:05:46.677412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'488","last_scrub_stamp":"2023-11-28T21:05:46.677285+0000","last_deep_scrub":"51'488","last_deep_scrub_stamp":"2023-11-28T21:05:46.677285+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.677285+0000","objects_scrubbed":20,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:36.686128+0000","scrub_duration":0.074223357000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2,"num_read_kb":11,"num_write":693,"num_write_kb":25655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":97994,"num_omap_keys":459,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'1827","reported_seq":3741,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.338445+0000","last_change":"2023-11-28T21:05:41.338497+0000","last_active":"2023-11-28T21:05:41.338445+0000","last_peered":"2023-11-28T21:05:41.338445+0000","last_clean":"2023-11-28T21:05:41.338445+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T21:05:41.338445+0000","last_undegraded":"2023-11-28T21:05:41.338445+0000","last_fullsized":"2023-11-28T21:05:41.338445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1827","last_scrub_stamp":"2023-11-28T21:05:41.338279+0000","last_deep_scrub":"51'1827","last_deep_scrub_stamp":"2023-11-28T21:05:41.338279+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.338279+0000","objects_scrubbed":549,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:26:57.473243+0000","scrub_duration":0.42601145800000001,"objects_trimmed":0,"snaptrim_duration":0.010051028,"stat_sum":{"num_bytes":36081004,"num_objects":549,"num_object_clones":242,"num_object_copies":2196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":242,"num_read":36,"num_read_kb":4131,"num_write":1572,"num_write_kb":47387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"51'429","reported_seq":2531,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.253871+0000","last_change":"2023-11-28T21:05:34.253896+0000","last_active":"2023-11-28T21:05:34.253871+0000","last_peered":"2023-11-28T21:05:34.253871+0000","last_clean":"2023-11-28T21:05:34.253871+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T21:05:34.253871+0000","last_undegraded":"2023-11-28T21:05:34.253871+0000","last_fullsized":"2023-11-28T21:05:34.253871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'429","last_scrub_stamp":"2023-11-28T21:05:34.253775+0000","last_deep_scrub":"51'429","last_deep_scrub_stamp":"2023-11-28T21:05:34.253775+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.253775+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:07.648795+0000","scrub_duration":0.00170806,"objects_trimmed":0,"snaptrim_duration":0.018799937999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"51'685","reported_seq":749,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.707762+0000","last_change":"2023-11-28T21:05:41.707798+0000","last_active":"2023-11-28T21:05:41.707762+0000","last_peered":"2023-11-28T21:05:41.707762+0000","last_clean":"2023-11-28T21:05:41.707762+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T21:05:41.707762+0000","last_undegraded":"2023-11-28T21:05:41.707762+0000","last_fullsized":"2023-11-28T21:05:41.707762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'685","last_scrub_stamp":"2023-11-28T21:05:41.707658+0000","last_deep_scrub":"51'685","last_deep_scrub_stamp":"2023-11-28T21:05:41.707658+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.707658+0000","objects_scrubbed":19,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:00:13.376241+0000","scrub_duration":0.055951230999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":627,"num_write_kb":16946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":109119,"num_omap_keys":206,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"51'1842","reported_seq":3708,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:27.417270+0000","last_change":"2023-11-28T20:44:35.608957+0000","last_active":"2023-11-28T21:05:27.417270+0000","last_peered":"2023-11-28T21:05:27.417270+0000","last_clean":"2023-11-28T21:05:27.417270+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T21:05:27.417270+0000","last_undegraded":"2023-11-28T21:05:27.417270+0000","last_fullsized":"2023-11-28T21:05:27.417270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011785257,"stat_sum":{"num_bytes":33810901,"num_objects":586,"num_object_clones":259,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":259,"num_read":37,"num_read_kb":8227,"num_write":1558,"num_write_kb":44779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"51'406","reported_seq":2508,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.948913+0000","last_change":"2023-11-28T21:05:34.948965+0000","last_active":"2023-11-28T21:05:34.948913+0000","last_peered":"2023-11-28T21:05:34.948913+0000","last_clean":"2023-11-28T21:05:34.948913+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T21:05:34.948913+0000","last_undegraded":"2023-11-28T21:05:34.948913+0000","last_fullsized":"2023-11-28T21:05:34.948913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'406","last_scrub_stamp":"2023-11-28T21:05:34.948705+0000","last_deep_scrub":"51'406","last_deep_scrub_stamp":"2023-11-28T21:05:34.948705+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.948705+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:53.319129+0000","scrub_duration":0.0033768689999999998,"objects_trimmed":0,"snaptrim_duration":0.011190047999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"51'504","reported_seq":568,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:37.522274+0000","last_change":"2023-11-28T21:05:37.522356+0000","last_active":"2023-11-28T21:05:37.522274+0000","last_peered":"2023-11-28T21:05:37.522274+0000","last_clean":"2023-11-28T21:05:37.522274+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T21:05:37.522274+0000","last_undegraded":"2023-11-28T21:05:37.522274+0000","last_fullsized":"2023-11-28T21:05:37.522274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'504","last_scrub_stamp":"2023-11-28T21:05:37.522080+0000","last_deep_scrub":"51'504","last_deep_scrub_stamp":"2023-11-28T21:05:37.522080+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.522080+0000","objects_scrubbed":19,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:21.382578+0000","scrub_duration":0.058407088000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":18,"num_write":441,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":131856,"num_omap_keys":203,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"51'1805","reported_seq":3655,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:25.613365+0000","last_change":"2023-11-28T20:44:35.544665+0000","last_active":"2023-11-28T21:05:25.613365+0000","last_peered":"2023-11-28T21:05:25.613365+0000","last_clean":"2023-11-28T21:05:25.613365+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T21:05:25.613365+0000","last_undegraded":"2023-11-28T21:05:25.613365+0000","last_fullsized":"2023-11-28T21:05:25.613365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010413970999999999,"stat_sum":{"num_bytes":29462623,"num_objects":568,"num_object_clones":283,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":243,"num_read":43,"num_read_kb":8342,"num_write":1501,"num_write_kb":36747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"51'401","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.496239+0000","last_change":"2023-11-28T20:44:35.608781+0000","last_active":"2023-11-28T21:04:30.496239+0000","last_peered":"2023-11-28T21:04:30.496239+0000","last_clean":"2023-11-28T21:04:30.496239+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T21:04:30.496239+0000","last_undegraded":"2023-11-28T21:04:30.496239+0000","last_fullsized":"2023-11-28T21:04:30.496239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013760692,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"51'161","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.266455+0000","last_change":"2023-11-28T21:05:41.266548+0000","last_active":"2023-11-28T21:05:41.266455+0000","last_peered":"2023-11-28T21:05:41.266455+0000","last_clean":"2023-11-28T21:05:41.266455+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T21:05:41.266455+0000","last_undegraded":"2023-11-28T21:05:41.266455+0000","last_fullsized":"2023-11-28T21:05:41.266455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'161","last_scrub_stamp":"2023-11-28T21:05:41.266279+0000","last_deep_scrub":"51'161","last_deep_scrub_stamp":"2023-11-28T21:05:41.266279+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.266279+0000","objects_scrubbed":16,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:32.433096+0000","scrub_duration":0.045962063999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":6,"num_read_kb":32,"num_write":106,"num_write_kb":8401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":68354,"num_omap_keys":112,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"51'1903","reported_seq":3759,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:28.749702+0000","last_change":"2023-11-28T20:44:35.542749+0000","last_active":"2023-11-28T21:05:28.749702+0000","last_peered":"2023-11-28T21:05:28.749702+0000","last_clean":"2023-11-28T21:05:28.749702+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T21:05:28.749702+0000","last_undegraded":"2023-11-28T21:05:28.749702+0000","last_fullsized":"2023-11-28T21:05:28.749702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092734619999999997,"stat_sum":{"num_bytes":42280101,"num_objects":591,"num_object_clones":269,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":269,"num_read":33,"num_read_kb":4128,"num_write":1621,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"51'381","reported_seq":2475,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564538+0000","last_change":"2023-11-28T20:44:35.614397+0000","last_active":"2023-11-28T21:04:28.564538+0000","last_peered":"2023-11-28T21:04:28.564538+0000","last_clean":"2023-11-28T21:04:28.564538+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T21:04:28.564538+0000","last_undegraded":"2023-11-28T21:04:28.564538+0000","last_fullsized":"2023-11-28T21:04:28.564538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017915146,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"51'437","reported_seq":503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.760023+0000","last_change":"2023-11-28T21:05:42.760056+0000","last_active":"2023-11-28T21:05:42.760023+0000","last_peered":"2023-11-28T21:05:42.760023+0000","last_clean":"2023-11-28T21:05:42.760023+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T21:05:42.760023+0000","last_undegraded":"2023-11-28T21:05:42.760023+0000","last_fullsized":"2023-11-28T21:05:42.760023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'437","last_scrub_stamp":"2023-11-28T21:05:42.759951+0000","last_deep_scrub":"51'437","last_deep_scrub_stamp":"2023-11-28T21:05:42.759951+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.759951+0000","objects_scrubbed":17,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:05:37.013105+0000","scrub_duration":0.10748722099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12049925,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":6,"num_read_kb":23,"num_write":692,"num_write_kb":13743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99465,"num_omap_keys":200,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"51'1784","reported_seq":3658,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:34.589715+0000","last_change":"2023-11-28T20:44:35.612546+0000","last_active":"2023-11-28T21:04:34.589715+0000","last_peered":"2023-11-28T21:04:34.589715+0000","last_clean":"2023-11-28T21:04:34.589715+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T21:04:34.589715+0000","last_undegraded":"2023-11-28T21:04:34.589715+0000","last_fullsized":"2023-11-28T21:04:34.589715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016539027000000001,"stat_sum":{"num_bytes":21707636,"num_objects":558,"num_object_clones":259,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":558,"num_whiteouts":259,"num_read":41,"num_read_kb":41,"num_write":1502,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"51'425","reported_seq":2528,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:27.436717+0000","last_change":"2023-11-28T21:05:27.436717+0000","last_active":"2023-11-28T21:05:27.436717+0000","last_peered":"2023-11-28T21:05:27.436717+0000","last_clean":"2023-11-28T21:05:27.436717+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T21:05:27.436717+0000","last_undegraded":"2023-11-28T21:05:27.436717+0000","last_fullsized":"2023-11-28T21:05:27.436717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'425","last_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_deep_scrub":"51'425","last_deep_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_clean_scrub_stamp":"2023-11-28T21:05:27.436622+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:32.946946+0000","scrub_duration":0.001593002,"objects_trimmed":0,"snaptrim_duration":0.014316661,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'350","reported_seq":406,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:30.419402+0000","last_change":"2023-11-28T20:38:18.568785+0000","last_active":"2023-11-28T21:05:30.419402+0000","last_peered":"2023-11-28T21:05:30.419402+0000","last_clean":"2023-11-28T21:05:30.419402+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T21:05:30.419402+0000","last_undegraded":"2023-11-28T21:05:30.419402+0000","last_fullsized":"2023-11-28T21:05:30.419402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360150,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":28962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"51'1789","reported_seq":3656,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:26.976762+0000","last_change":"2023-11-28T20:44:35.610536+0000","last_active":"2023-11-28T21:05:26.976762+0000","last_peered":"2023-11-28T21:05:26.976762+0000","last_clean":"2023-11-28T21:05:26.976762+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T21:05:26.976762+0000","last_undegraded":"2023-11-28T21:05:26.976762+0000","last_fullsized":"2023-11-28T21:05:26.976762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014620091,"stat_sum":{"num_bytes":29165465,"num_objects":561,"num_object_clones":251,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":561,"num_whiteouts":251,"num_read":26,"num_read_kb":26,"num_write":1521,"num_write_kb":34762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"51'414","reported_seq":2509,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:29.483360+0000","last_change":"2023-11-28T20:44:35.624605+0000","last_active":"2023-11-28T21:05:29.483360+0000","last_peered":"2023-11-28T21:05:29.483360+0000","last_clean":"2023-11-28T21:05:29.483360+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T21:05:29.483360+0000","last_undegraded":"2023-11-28T21:05:29.483360+0000","last_fullsized":"2023-11-28T21:05:29.483360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025775551000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"51'276","reported_seq":340,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:28.525091+0000","last_change":"2023-11-28T21:05:28.525091+0000","last_active":"2023-11-28T21:05:28.525091+0000","last_peered":"2023-11-28T21:05:28.525091+0000","last_clean":"2023-11-28T21:05:28.525091+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T21:05:28.525091+0000","last_undegraded":"2023-11-28T21:05:28.525091+0000","last_fullsized":"2023-11-28T21:05:28.525091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'276","last_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_deep_scrub":"51'276","last_deep_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_clean_scrub_stamp":"2023-11-28T21:05:28.524974+0000","objects_scrubbed":17,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:41:23.890866+0000","scrub_duration":0.056500518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":24764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84018,"num_omap_keys":160,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"51'1827","reported_seq":3689,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:01.534917+0000","last_change":"2023-11-28T20:44:35.529967+0000","last_active":"2023-11-28T21:04:01.534917+0000","last_peered":"2023-11-28T21:04:01.534917+0000","last_clean":"2023-11-28T21:04:01.534917+0000","last_became_active":"2023-11-28T20:39:01.570987+0000","last_became_peered":"2023-11-28T20:39:01.570987+0000","last_unstale":"2023-11-28T21:04:01.534917+0000","last_undegraded":"2023-11-28T21:04:01.534917+0000","last_fullsized":"2023-11-28T21:04:01.534917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017641899999999999,"stat_sum":{"num_bytes":29603349,"num_objects":551,"num_object_clones":257,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":257,"num_read":32,"num_read_kb":32,"num_write":1550,"num_write_kb":37188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"51'420","reported_seq":2523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:37.005702+0000","last_change":"2023-11-28T21:05:37.005805+0000","last_active":"2023-11-28T21:05:37.005702+0000","last_peered":"2023-11-28T21:05:37.005702+0000","last_clean":"2023-11-28T21:05:37.005702+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T21:05:37.005702+0000","last_undegraded":"2023-11-28T21:05:37.005702+0000","last_fullsized":"2023-11-28T21:05:37.005702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'420","last_scrub_stamp":"2023-11-28T21:05:37.005456+0000","last_deep_scrub":"51'420","last_deep_scrub_stamp":"2023-11-28T21:05:37.005456+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.005456+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:00:05.751633+0000","scrub_duration":0.003608899,"objects_trimmed":0,"snaptrim_duration":0.010944188000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"51'437","reported_seq":502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.190136+0000","last_change":"2023-11-28T21:05:45.190222+0000","last_active":"2023-11-28T21:05:45.190136+0000","last_peered":"2023-11-28T21:05:45.190136+0000","last_clean":"2023-11-28T21:05:45.190136+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T21:05:45.190136+0000","last_undegraded":"2023-11-28T21:05:45.190136+0000","last_fullsized":"2023-11-28T21:05:45.190136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'437","last_scrub_stamp":"2023-11-28T21:05:45.189981+0000","last_deep_scrub":"51'437","last_deep_scrub_stamp":"2023-11-28T21:05:45.189981+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.189981+0000","objects_scrubbed":17,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:10:13.180761+0000","scrub_duration":0.065732793999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":379,"num_write_kb":16755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99502,"num_omap_keys":179,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"51'1754","reported_seq":3631,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:27.417319+0000","last_change":"2023-11-28T20:44:35.606459+0000","last_active":"2023-11-28T21:05:27.417319+0000","last_peered":"2023-11-28T21:05:27.417319+0000","last_clean":"2023-11-28T21:05:27.417319+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T21:05:27.417319+0000","last_undegraded":"2023-11-28T21:05:27.417319+0000","last_fullsized":"2023-11-28T21:05:27.417319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012892727999999999,"stat_sum":{"num_bytes":30726234,"num_objects":547,"num_object_clones":244,"num_object_copies":2188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":244,"num_read":30,"num_read_kb":7398,"num_write":1499,"num_write_kb":38104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'416","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.494905+0000","last_change":"2023-11-28T20:44:35.602022+0000","last_active":"2023-11-28T21:04:30.494905+0000","last_peered":"2023-11-28T21:04:30.494905+0000","last_clean":"2023-11-28T21:04:30.494905+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T21:04:30.494905+0000","last_undegraded":"2023-11-28T21:04:30.494905+0000","last_fullsized":"2023-11-28T21:04:30.494905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0088104640000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"51'927","reported_seq":1428,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.482036+0000","last_change":"2023-11-28T21:05:45.482078+0000","last_active":"2023-11-28T21:05:45.482036+0000","last_peered":"2023-11-28T21:05:45.482036+0000","last_clean":"2023-11-28T21:05:45.482036+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T21:05:45.482036+0000","last_undegraded":"2023-11-28T21:05:45.482036+0000","last_fullsized":"2023-11-28T21:05:45.482036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'927","last_scrub_stamp":"2023-11-28T21:05:45.481954+0000","last_deep_scrub":"51'927","last_deep_scrub_stamp":"2023-11-28T21:05:45.481954+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.481954+0000","objects_scrubbed":23,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:59.711334+0000","scrub_duration":0.067817884999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26750948,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":437,"num_read_kb":1190,"num_write":846,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106245,"num_omap_keys":198,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"51'1696","reported_seq":3564,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:29.588933+0000","last_change":"2023-11-28T20:44:35.609122+0000","last_active":"2023-11-28T21:04:29.588933+0000","last_peered":"2023-11-28T21:04:29.588933+0000","last_clean":"2023-11-28T21:04:29.588933+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T21:04:29.588933+0000","last_undegraded":"2023-11-28T21:04:29.588933+0000","last_fullsized":"2023-11-28T21:04:29.588933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744523999999999,"stat_sum":{"num_bytes":4888539,"num_objects":545,"num_object_clones":249,"num_object_copies":2180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":249,"num_read":26,"num_read_kb":26,"num_write":1427,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'419","reported_seq":2522,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:47.163660+0000","last_change":"2023-11-28T21:05:47.163684+0000","last_active":"2023-11-28T21:05:47.163660+0000","last_peered":"2023-11-28T21:05:47.163660+0000","last_clean":"2023-11-28T21:05:47.163660+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T21:05:47.163660+0000","last_undegraded":"2023-11-28T21:05:47.163660+0000","last_fullsized":"2023-11-28T21:05:47.163660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'419","last_scrub_stamp":"2023-11-28T21:05:47.163561+0000","last_deep_scrub":"51'419","last_deep_scrub_stamp":"2023-11-28T21:05:47.163561+0000","last_clean_scrub_stamp":"2023-11-28T21:05:47.163561+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:21.174839+0000","scrub_duration":0.0032640490000000002,"objects_trimmed":0,"snaptrim_duration":0.013248289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"51'488","reported_seq":552,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.516156+0000","last_change":"2023-11-28T21:05:42.516251+0000","last_active":"2023-11-28T21:05:42.516156+0000","last_peered":"2023-11-28T21:05:42.516156+0000","last_clean":"2023-11-28T21:05:42.516156+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T21:05:42.516156+0000","last_undegraded":"2023-11-28T21:05:42.516156+0000","last_fullsized":"2023-11-28T21:05:42.516156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'488","last_scrub_stamp":"2023-11-28T21:05:42.515965+0000","last_deep_scrub":"51'488","last_deep_scrub_stamp":"2023-11-28T21:05:42.515965+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.515965+0000","objects_scrubbed":20,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:15.338394+0000","scrub_duration":0.076223933999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":59652,"num_omap_keys":113,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"51'1786","reported_seq":3672,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:22.914081+0000","last_change":"2023-11-28T20:44:35.607810+0000","last_active":"2023-11-28T21:04:22.914081+0000","last_peered":"2023-11-28T21:04:22.914081+0000","last_clean":"2023-11-28T21:04:22.914081+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T21:04:22.914081+0000","last_undegraded":"2023-11-28T21:04:22.914081+0000","last_fullsized":"2023-11-28T21:04:22.914081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013136992,"stat_sum":{"num_bytes":25033729,"num_objects":551,"num_object_clones":252,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":252,"num_read":47,"num_read_kb":4142,"num_write":1517,"num_write_kb":28607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'391","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.276195+0000","last_change":"2023-11-28T21:05:46.276216+0000","last_active":"2023-11-28T21:05:46.276195+0000","last_peered":"2023-11-28T21:05:46.276195+0000","last_clean":"2023-11-28T21:05:46.276195+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T21:05:46.276195+0000","last_undegraded":"2023-11-28T21:05:46.276195+0000","last_fullsized":"2023-11-28T21:05:46.276195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'391","last_scrub_stamp":"2023-11-28T21:05:46.276109+0000","last_deep_scrub":"51'391","last_deep_scrub_stamp":"2023-11-28T21:05:46.276109+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.276109+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:26:05.634209+0000","scrub_duration":0.0021140719999999998,"objects_trimmed":0,"snaptrim_duration":0.015322676,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'371","reported_seq":437,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:39.291951+0000","last_change":"2023-11-28T21:05:39.292032+0000","last_active":"2023-11-28T21:05:39.291951+0000","last_peered":"2023-11-28T21:05:39.291951+0000","last_clean":"2023-11-28T21:05:39.291951+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T21:05:39.291951+0000","last_undegraded":"2023-11-28T21:05:39.291951+0000","last_fullsized":"2023-11-28T21:05:39.291951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'371","last_scrub_stamp":"2023-11-28T21:05:39.291779+0000","last_deep_scrub":"51'371","last_deep_scrub_stamp":"2023-11-28T21:05:39.291779+0000","last_clean_scrub_stamp":"2023-11-28T21:05:39.291779+0000","objects_scrubbed":18,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:03.495198+0000","scrub_duration":0.051458515000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":20,"num_write":319,"num_write_kb":12656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":86488,"num_omap_keys":124,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"51'119","reported_seq":219,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.550562+0000","last_change":"2023-11-28T21:05:34.550643+0000","last_active":"2023-11-28T21:05:34.550562+0000","last_peered":"2023-11-28T21:05:34.550562+0000","last_clean":"2023-11-28T21:05:34.550562+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T21:05:34.550562+0000","last_undegraded":"2023-11-28T21:05:34.550562+0000","last_fullsized":"2023-11-28T21:05:34.550562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'119","last_scrub_stamp":"2023-11-28T21:05:34.550372+0000","last_deep_scrub":"51'119","last_deep_scrub_stamp":"2023-11-28T21:05:34.550372+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.550372+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:36.261369+0000","scrub_duration":0.0093084229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1795","reported_seq":3662,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:29.923602+0000","last_change":"2023-11-28T20:44:35.608577+0000","last_active":"2023-11-28T21:05:29.923602+0000","last_peered":"2023-11-28T21:05:29.923602+0000","last_clean":"2023-11-28T21:05:29.923602+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T21:05:29.923602+0000","last_undegraded":"2023-11-28T21:05:29.923602+0000","last_fullsized":"2023-11-28T21:05:29.923602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012304083,"stat_sum":{"num_bytes":50974055,"num_objects":563,"num_object_clones":255,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":255,"num_read":30,"num_read_kb":4125,"num_write":1519,"num_write_kb":57288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"51'375","reported_seq":2469,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:20.603361+0000","last_change":"2023-11-28T20:44:35.637477+0000","last_active":"2023-11-28T21:05:20.603361+0000","last_peered":"2023-11-28T21:05:20.603361+0000","last_clean":"2023-11-28T21:05:20.603361+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T21:05:20.603361+0000","last_undegraded":"2023-11-28T21:05:20.603361+0000","last_fullsized":"2023-11-28T21:05:20.603361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027789237000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"51'234","reported_seq":299,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:38.489258+0000","last_change":"2023-11-28T21:05:38.489305+0000","last_active":"2023-11-28T21:05:38.489258+0000","last_peered":"2023-11-28T21:05:38.489258+0000","last_clean":"2023-11-28T21:05:38.489258+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T21:05:38.489258+0000","last_undegraded":"2023-11-28T21:05:38.489258+0000","last_fullsized":"2023-11-28T21:05:38.489258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'234","last_scrub_stamp":"2023-11-28T21:05:38.489165+0000","last_deep_scrub":"51'234","last_deep_scrub_stamp":"2023-11-28T21:05:38.489165+0000","last_clean_scrub_stamp":"2023-11-28T21:05:38.489165+0000","objects_scrubbed":22,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:13.325917+0000","scrub_duration":0.055655635000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777798,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":15,"num_write":164,"num_write_kb":16643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":100904,"num_omap_keys":180,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"51'1783","reported_seq":3665,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.588077+0000","last_change":"2023-11-28T20:44:35.614664+0000","last_active":"2023-11-28T21:04:30.588077+0000","last_peered":"2023-11-28T21:04:30.588077+0000","last_clean":"2023-11-28T21:04:30.588077+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T21:04:30.588077+0000","last_undegraded":"2023-11-28T21:04:30.588077+0000","last_fullsized":"2023-11-28T21:04:30.588077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016877468,"stat_sum":{"num_bytes":24953790,"num_objects":536,"num_object_clones":250,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":250,"num_read":41,"num_read_kb":41,"num_write":1520,"num_write_kb":33586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"51'453","reported_seq":2547,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:20.611004+0000","last_change":"2023-11-28T20:44:35.618675+0000","last_active":"2023-11-28T21:05:20.611004+0000","last_peered":"2023-11-28T21:05:20.611004+0000","last_clean":"2023-11-28T21:05:20.611004+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T21:05:20.611004+0000","last_undegraded":"2023-11-28T21:05:20.611004+0000","last_fullsized":"2023-11-28T21:05:20.611004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020341659000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"51'411","reported_seq":475,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.581577+0000","last_change":"2023-11-28T21:05:34.581615+0000","last_active":"2023-11-28T21:05:34.581577+0000","last_peered":"2023-11-28T21:05:34.581577+0000","last_clean":"2023-11-28T21:05:34.581577+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T21:05:34.581577+0000","last_undegraded":"2023-11-28T21:05:34.581577+0000","last_fullsized":"2023-11-28T21:05:34.581577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:34.581495+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:34.581495+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.581495+0000","objects_scrubbed":18,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:15.488699+0000","scrub_duration":0.059633824000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777286,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":9,"num_write":342,"num_write_kb":16717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76134,"num_omap_keys":129,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"51'1767","reported_seq":3644,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:23.427074+0000","last_change":"2023-11-28T20:44:35.611130+0000","last_active":"2023-11-28T21:05:23.427074+0000","last_peered":"2023-11-28T21:05:23.427074+0000","last_clean":"2023-11-28T21:05:23.427074+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T21:05:23.427074+0000","last_undegraded":"2023-11-28T21:05:23.427074+0000","last_fullsized":"2023-11-28T21:05:23.427074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014814858,"stat_sum":{"num_bytes":20638408,"num_objects":542,"num_object_clones":251,"num_object_copies":2168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":251,"num_read":37,"num_read_kb":37,"num_write":1496,"num_write_kb":31881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"51'403","reported_seq":2497,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:25.604487+0000","last_change":"2023-11-28T20:44:35.640929+0000","last_active":"2023-11-28T21:05:25.604487+0000","last_peered":"2023-11-28T21:05:25.604487+0000","last_clean":"2023-11-28T21:05:25.604487+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T21:05:25.604487+0000","last_undegraded":"2023-11-28T21:05:25.604487+0000","last_fullsized":"2023-11-28T21:05:25.604487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017837387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"51'392","reported_seq":458,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:33.538157+0000","last_change":"2023-11-28T21:05:33.538219+0000","last_active":"2023-11-28T21:05:33.538157+0000","last_peered":"2023-11-28T21:05:33.538157+0000","last_clean":"2023-11-28T21:05:33.538157+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T21:05:33.538157+0000","last_undegraded":"2023-11-28T21:05:33.538157+0000","last_fullsized":"2023-11-28T21:05:33.538157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'392","last_scrub_stamp":"2023-11-28T21:05:33.538069+0000","last_deep_scrub":"51'392","last_deep_scrub_stamp":"2023-11-28T21:05:33.538069+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.538069+0000","objects_scrubbed":21,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:56.665928+0000","scrub_duration":0.051903592999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":22,"num_write":339,"num_write_kb":16887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":98369,"num_omap_keys":186,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"51'1847","reported_seq":3732,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:25.598211+0000","last_change":"2023-11-28T20:44:35.610893+0000","last_active":"2023-11-28T21:04:25.598211+0000","last_peered":"2023-11-28T21:04:25.598211+0000","last_clean":"2023-11-28T21:04:25.598211+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T21:04:25.598211+0000","last_undegraded":"2023-11-28T21:04:25.598211+0000","last_fullsized":"2023-11-28T21:04:25.598211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015179433000000001,"stat_sum":{"num_bytes":40252075,"num_objects":555,"num_object_clones":243,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":243,"num_read":37,"num_read_kb":1813,"num_write":1586,"num_write_kb":49527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"51'398","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:20.603430+0000","last_change":"2023-11-28T20:44:35.639947+0000","last_active":"2023-11-28T21:05:20.603430+0000","last_peered":"2023-11-28T21:05:20.603430+0000","last_clean":"2023-11-28T21:05:20.603430+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T21:05:20.603430+0000","last_undegraded":"2023-11-28T21:05:20.603430+0000","last_fullsized":"2023-11-28T21:05:20.603430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018023955000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"51'418","reported_seq":481,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:30.052529+0000","last_change":"2023-11-28T21:05:30.052590+0000","last_active":"2023-11-28T21:05:30.052529+0000","last_peered":"2023-11-28T21:05:30.052529+0000","last_clean":"2023-11-28T21:05:30.052529+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T21:05:30.052529+0000","last_undegraded":"2023-11-28T21:05:30.052529+0000","last_fullsized":"2023-11-28T21:05:30.052529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:05:30.052426+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:05:30.052426+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.052426+0000","objects_scrubbed":18,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:50.919481+0000","scrub_duration":0.059053013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094443,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":19633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":68276,"num_omap_keys":142,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"51'1788","reported_seq":3659,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:25.601061+0000","last_change":"2023-11-28T20:44:35.541705+0000","last_active":"2023-11-28T21:04:25.601061+0000","last_peered":"2023-11-28T21:04:25.601061+0000","last_clean":"2023-11-28T21:04:25.601061+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T21:04:25.601061+0000","last_undegraded":"2023-11-28T21:04:25.601061+0000","last_fullsized":"2023-11-28T21:04:25.601061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0090848279999999997,"stat_sum":{"num_bytes":25858877,"num_objects":550,"num_object_clones":249,"num_object_copies":2200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":550,"num_whiteouts":249,"num_read":30,"num_read_kb":4125,"num_write":1526,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"51'442","reported_seq":2535,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.171919+0000","last_change":"2023-11-28T20:44:35.636676+0000","last_active":"2023-11-28T21:04:23.171919+0000","last_peered":"2023-11-28T21:04:23.171919+0000","last_clean":"2023-11-28T21:04:23.171919+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T21:04:23.171919+0000","last_undegraded":"2023-11-28T21:04:23.171919+0000","last_fullsized":"2023-11-28T21:04:23.171919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020570496000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"51'657","reported_seq":720,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.430216+0000","last_change":"2023-11-28T21:05:41.430262+0000","last_active":"2023-11-28T21:05:41.430216+0000","last_peered":"2023-11-28T21:05:41.430216+0000","last_clean":"2023-11-28T21:05:41.430216+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T21:05:41.430216+0000","last_undegraded":"2023-11-28T21:05:41.430216+0000","last_fullsized":"2023-11-28T21:05:41.430216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'657","last_scrub_stamp":"2023-11-28T21:05:41.430137+0000","last_deep_scrub":"51'657","last_deep_scrub_stamp":"2023-11-28T21:05:41.430137+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.430137+0000","objects_scrubbed":24,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:12:56.869809+0000","scrub_duration":0.042827776999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":7,"num_write":598,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":62330,"num_omap_keys":118,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"51'1723","reported_seq":3620,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:58.424239+0000","last_change":"2023-11-28T20:44:35.606276+0000","last_active":"2023-11-28T21:04:58.424239+0000","last_peered":"2023-11-28T21:04:58.424239+0000","last_clean":"2023-11-28T21:04:58.424239+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T21:04:58.424239+0000","last_undegraded":"2023-11-28T21:04:58.424239+0000","last_fullsized":"2023-11-28T21:04:58.424239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011806407999999999,"stat_sum":{"num_bytes":28712373,"num_objects":524,"num_object_clones":239,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":239,"num_read":46,"num_read_kb":46,"num_write":1462,"num_write_kb":31285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"51'407","reported_seq":2508,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:44.161556+0000","last_change":"2023-11-28T21:05:44.161668+0000","last_active":"2023-11-28T21:05:44.161556+0000","last_peered":"2023-11-28T21:05:44.161556+0000","last_clean":"2023-11-28T21:05:44.161556+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T21:05:44.161556+0000","last_undegraded":"2023-11-28T21:05:44.161556+0000","last_fullsized":"2023-11-28T21:05:44.161556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'407","last_scrub_stamp":"2023-11-28T21:05:44.161256+0000","last_deep_scrub":"51'407","last_deep_scrub_stamp":"2023-11-28T21:05:44.161256+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.161256+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:10.673180+0000","scrub_duration":0.0042608810000000002,"objects_trimmed":0,"snaptrim_duration":0.014629055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"51'473","reported_seq":535,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:33.374245+0000","last_change":"2023-11-28T21:05:33.374328+0000","last_active":"2023-11-28T21:05:33.374245+0000","last_peered":"2023-11-28T21:05:33.374245+0000","last_clean":"2023-11-28T21:05:33.374245+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T21:05:33.374245+0000","last_undegraded":"2023-11-28T21:05:33.374245+0000","last_fullsized":"2023-11-28T21:05:33.374245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'473","last_scrub_stamp":"2023-11-28T21:05:33.374073+0000","last_deep_scrub":"51'473","last_deep_scrub_stamp":"2023-11-28T21:05:33.374073+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.374073+0000","objects_scrubbed":15,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:57:31.084888+0000","scrub_duration":0.075804628999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":57473,"num_omap_keys":100,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"51'1831","reported_seq":3700,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:04.593566+0000","last_change":"2023-11-28T20:44:35.613708+0000","last_active":"2023-11-28T21:05:04.593566+0000","last_peered":"2023-11-28T21:05:04.593566+0000","last_clean":"2023-11-28T21:05:04.593566+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T21:05:04.593566+0000","last_undegraded":"2023-11-28T21:05:04.593566+0000","last_fullsized":"2023-11-28T21:05:04.593566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017596898999999999,"stat_sum":{"num_bytes":20840070,"num_objects":572,"num_object_clones":259,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":259,"num_read":39,"num_read_kb":4134,"num_write":1549,"num_write_kb":33741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"51'411","reported_seq":2504,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.176481+0000","last_change":"2023-11-28T20:44:35.639082+0000","last_active":"2023-11-28T21:04:23.176481+0000","last_peered":"2023-11-28T21:04:23.176481+0000","last_clean":"2023-11-28T21:04:23.176481+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T21:04:23.176481+0000","last_undegraded":"2023-11-28T21:04:23.176481+0000","last_fullsized":"2023-11-28T21:04:23.176481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019240779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"51'299","reported_seq":362,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:43.228836+0000","last_change":"2023-11-28T21:05:43.228912+0000","last_active":"2023-11-28T21:05:43.228836+0000","last_peered":"2023-11-28T21:05:43.228836+0000","last_clean":"2023-11-28T21:05:43.228836+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T21:05:43.228836+0000","last_undegraded":"2023-11-28T21:05:43.228836+0000","last_fullsized":"2023-11-28T21:05:43.228836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'299","last_scrub_stamp":"2023-11-28T21:05:43.228655+0000","last_deep_scrub":"51'299","last_deep_scrub_stamp":"2023-11-28T21:05:43.228655+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.228655+0000","objects_scrubbed":15,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:39:18.023290+0000","scrub_duration":0.053656686000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":238,"num_write_kb":12572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73750,"num_omap_keys":139,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"51'1661","reported_seq":3549,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:11.621797+0000","last_change":"2023-11-28T20:44:35.616111+0000","last_active":"2023-11-28T21:04:11.621797+0000","last_peered":"2023-11-28T21:04:11.621797+0000","last_clean":"2023-11-28T21:04:11.621797+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T21:04:11.621797+0000","last_undegraded":"2023-11-28T21:04:11.621797+0000","last_fullsized":"2023-11-28T21:04:11.621797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018495173,"stat_sum":{"num_bytes":20919340,"num_objects":524,"num_object_clones":235,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":235,"num_read":33,"num_read_kb":33,"num_write":1415,"num_write_kb":40695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"51'413","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:30.161985+0000","last_change":"2023-11-28T21:05:30.162003+0000","last_active":"2023-11-28T21:05:30.161985+0000","last_peered":"2023-11-28T21:05:30.161985+0000","last_clean":"2023-11-28T21:05:30.161985+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T21:05:30.161985+0000","last_undegraded":"2023-11-28T21:05:30.161985+0000","last_fullsized":"2023-11-28T21:05:30.161985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'413","last_scrub_stamp":"2023-11-28T21:05:30.161904+0000","last_deep_scrub":"51'413","last_deep_scrub_stamp":"2023-11-28T21:05:30.161904+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.161904+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:00.574298+0000","scrub_duration":0.0026842540000000001,"objects_trimmed":0,"snaptrim_duration":0.014112118999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"51'422","reported_seq":484,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:31.170323+0000","last_change":"2023-11-28T21:05:31.170458+0000","last_active":"2023-11-28T21:05:31.170323+0000","last_peered":"2023-11-28T21:05:31.170323+0000","last_clean":"2023-11-28T21:05:31.170323+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T21:05:31.170323+0000","last_undegraded":"2023-11-28T21:05:31.170323+0000","last_fullsized":"2023-11-28T21:05:31.170323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'422","last_scrub_stamp":"2023-11-28T21:05:31.170251+0000","last_deep_scrub":"51'422","last_deep_scrub_stamp":"2023-11-28T21:05:31.170251+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.170251+0000","objects_scrubbed":17,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:48.673212+0000","scrub_duration":0.054918677999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":16779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":77628,"num_omap_keys":149,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"51'1691","reported_seq":3585,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:00.606435+0000","last_change":"2023-11-28T20:44:35.613305+0000","last_active":"2023-11-28T21:05:00.606435+0000","last_peered":"2023-11-28T21:05:00.606435+0000","last_clean":"2023-11-28T21:05:00.606435+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T21:05:00.606435+0000","last_undegraded":"2023-11-28T21:05:00.606435+0000","last_fullsized":"2023-11-28T21:05:00.606435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015550285,"stat_sum":{"num_bytes":33895761,"num_objects":515,"num_object_clones":224,"num_object_copies":2060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515,"num_whiteouts":224,"num_read":28,"num_read_kb":28,"num_write":1451,"num_write_kb":37503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"51'394","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:33.531106+0000","last_change":"2023-11-28T21:05:33.531160+0000","last_active":"2023-11-28T21:05:33.531106+0000","last_peered":"2023-11-28T21:05:33.531106+0000","last_clean":"2023-11-28T21:05:33.531106+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T21:05:33.531106+0000","last_undegraded":"2023-11-28T21:05:33.531106+0000","last_fullsized":"2023-11-28T21:05:33.531106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:33.530916+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:33.530916+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.530916+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:51.990509+0000","scrub_duration":0.00324325,"objects_trimmed":0,"snaptrim_duration":0.022690017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'585","reported_seq":647,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:36.348680+0000","last_change":"2023-11-28T21:05:36.348768+0000","last_active":"2023-11-28T21:05:36.348680+0000","last_peered":"2023-11-28T21:05:36.348680+0000","last_clean":"2023-11-28T21:05:36.348680+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T21:05:36.348680+0000","last_undegraded":"2023-11-28T21:05:36.348680+0000","last_fullsized":"2023-11-28T21:05:36.348680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'585","last_scrub_stamp":"2023-11-28T21:05:36.348472+0000","last_deep_scrub":"51'585","last_deep_scrub_stamp":"2023-11-28T21:05:36.348472+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.348472+0000","objects_scrubbed":19,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:44:00.211075+0000","scrub_duration":0.085323616000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":24942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82322,"num_omap_keys":142,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"51'1823","reported_seq":3694,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:06.744387+0000","last_change":"2023-11-28T20:44:35.607147+0000","last_active":"2023-11-28T21:04:06.744387+0000","last_peered":"2023-11-28T21:04:06.744387+0000","last_clean":"2023-11-28T21:04:06.744387+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T21:04:06.744387+0000","last_undegraded":"2023-11-28T21:04:06.744387+0000","last_fullsized":"2023-11-28T21:04:06.744387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1823,"log_dups_size":0,"ondisk_log_size":1823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013090108,"stat_sum":{"num_bytes":42607549,"num_objects":556,"num_object_clones":254,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":254,"num_read":36,"num_read_kb":4131,"num_write":1543,"num_write_kb":57518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"51'388","reported_seq":2474,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:49.590863+0000","last_change":"2023-11-28T20:44:35.530346+0000","last_active":"2023-11-28T21:04:49.590863+0000","last_peered":"2023-11-28T21:04:49.590863+0000","last_clean":"2023-11-28T21:04:49.590863+0000","last_became_active":"2023-11-28T20:39:01.848225+0000","last_became_peered":"2023-11-28T20:39:01.848225+0000","last_unstale":"2023-11-28T21:04:49.590863+0000","last_undegraded":"2023-11-28T21:04:49.590863+0000","last_fullsized":"2023-11-28T21:04:49.590863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019608149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'561","reported_seq":623,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:30.590008+0000","last_change":"2023-11-28T21:05:30.590054+0000","last_active":"2023-11-28T21:05:30.590008+0000","last_peered":"2023-11-28T21:05:30.590008+0000","last_clean":"2023-11-28T21:05:30.590008+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T21:05:30.590008+0000","last_undegraded":"2023-11-28T21:05:30.590008+0000","last_fullsized":"2023-11-28T21:05:30.590008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'561","last_scrub_stamp":"2023-11-28T21:05:30.589932+0000","last_deep_scrub":"51'561","last_deep_scrub_stamp":"2023-11-28T21:05:30.589932+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.589932+0000","objects_scrubbed":23,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:24:21.359666+0000","scrub_duration":0.070269200000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":21060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":120182,"num_omap_keys":228,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"51'1816","reported_seq":3738,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.324169+0000","last_change":"2023-11-28T21:05:42.324200+0000","last_active":"2023-11-28T21:05:42.324169+0000","last_peered":"2023-11-28T21:05:42.324169+0000","last_clean":"2023-11-28T21:05:42.324169+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T21:05:42.324169+0000","last_undegraded":"2023-11-28T21:05:42.324169+0000","last_fullsized":"2023-11-28T21:05:42.324169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1816","last_scrub_stamp":"2023-11-28T21:05:42.324029+0000","last_deep_scrub":"51'1816","last_deep_scrub_stamp":"2023-11-28T21:05:42.324029+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.324029+0000","objects_scrubbed":568,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:37.426481+0000","scrub_duration":0.39091050599999999,"objects_trimmed":0,"snaptrim_duration":0.010092998000000001,"stat_sum":{"num_bytes":33600436,"num_objects":568,"num_object_clones":254,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":254,"num_read":57,"num_read_kb":4152,"num_write":1538,"num_write_kb":45454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"51'410","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:58.424309+0000","last_change":"2023-11-28T20:44:35.605933+0000","last_active":"2023-11-28T21:04:58.424309+0000","last_peered":"2023-11-28T21:04:58.424309+0000","last_clean":"2023-11-28T21:04:58.424309+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T21:04:58.424309+0000","last_undegraded":"2023-11-28T21:04:58.424309+0000","last_fullsized":"2023-11-28T21:04:58.424309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744874000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"51'506","reported_seq":569,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:44.276724+0000","last_change":"2023-11-28T21:05:44.276812+0000","last_active":"2023-11-28T21:05:44.276724+0000","last_peered":"2023-11-28T21:05:44.276724+0000","last_clean":"2023-11-28T21:05:44.276724+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T21:05:44.276724+0000","last_undegraded":"2023-11-28T21:05:44.276724+0000","last_fullsized":"2023-11-28T21:05:44.276724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'506","last_scrub_stamp":"2023-11-28T21:05:44.276499+0000","last_deep_scrub":"51'506","last_deep_scrub_stamp":"2023-11-28T21:05:44.276499+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.276499+0000","objects_scrubbed":22,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:33.316636+0000","scrub_duration":0.12046440999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":27,"num_write":437,"num_write_kb":33175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130075,"num_omap_keys":234,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"51'1777","reported_seq":3672,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:06.620729+0000","last_change":"2023-11-28T20:44:35.614798+0000","last_active":"2023-11-28T21:04:06.620729+0000","last_peered":"2023-11-28T21:04:06.620729+0000","last_clean":"2023-11-28T21:04:06.620729+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T21:04:06.620729+0000","last_undegraded":"2023-11-28T21:04:06.620729+0000","last_fullsized":"2023-11-28T21:04:06.620729+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018323326000000001,"stat_sum":{"num_bytes":24785841,"num_objects":525,"num_object_clones":238,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":238,"num_read":34,"num_read_kb":34,"num_write":1518,"num_write_kb":32579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"51'411","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.162096+0000","last_change":"2023-11-28T21:05:32.162153+0000","last_active":"2023-11-28T21:05:32.162096+0000","last_peered":"2023-11-28T21:05:32.162096+0000","last_clean":"2023-11-28T21:05:32.162096+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T21:05:32.162096+0000","last_undegraded":"2023-11-28T21:05:32.162096+0000","last_fullsized":"2023-11-28T21:05:32.162096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:32.161774+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:32.161774+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.161774+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:08.878532+0000","scrub_duration":0.0040654100000000002,"objects_trimmed":0,"snaptrim_duration":0.022293309000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"51'182","reported_seq":244,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:43.191960+0000","last_change":"2023-11-28T21:05:43.192141+0000","last_active":"2023-11-28T21:05:43.191960+0000","last_peered":"2023-11-28T21:05:43.191960+0000","last_clean":"2023-11-28T21:05:43.191960+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T21:05:43.191960+0000","last_undegraded":"2023-11-28T21:05:43.191960+0000","last_fullsized":"2023-11-28T21:05:43.191960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'182","last_scrub_stamp":"2023-11-28T21:05:43.191676+0000","last_deep_scrub":"51'182","last_deep_scrub_stamp":"2023-11-28T21:05:43.191676+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.191676+0000","objects_scrubbed":19,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:26.130737+0000","scrub_duration":0.043839175000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71130,"num_omap_keys":135,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"51'1914","reported_seq":3777,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:06.620806+0000","last_change":"2023-11-28T20:44:35.611992+0000","last_active":"2023-11-28T21:04:06.620806+0000","last_peered":"2023-11-28T21:04:06.620806+0000","last_clean":"2023-11-28T21:04:06.620806+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T21:04:06.620806+0000","last_undegraded":"2023-11-28T21:04:06.620806+0000","last_fullsized":"2023-11-28T21:04:06.620806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016210088000000001,"stat_sum":{"num_bytes":26682582,"num_objects":583,"num_object_clones":263,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":583,"num_whiteouts":263,"num_read":39,"num_read_kb":8229,"num_write":1627,"num_write_kb":50263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"51'1808","reported_seq":3654,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:33.420994+0000","last_change":"2023-11-28T20:44:35.605377+0000","last_active":"2023-11-28T21:04:33.420994+0000","last_peered":"2023-11-28T21:04:33.420994+0000","last_clean":"2023-11-28T21:04:33.420994+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T21:04:33.420994+0000","last_undegraded":"2023-11-28T21:04:33.420994+0000","last_fullsized":"2023-11-28T21:04:33.420994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011090378999999999,"stat_sum":{"num_bytes":29341830,"num_objects":589,"num_object_clones":267,"num_object_copies":2356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":267,"num_read":21,"num_read_kb":21,"num_write":1524,"num_write_kb":32957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"51'411","reported_seq":2504,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:59.592513+0000","last_change":"2023-11-28T20:44:35.601680+0000","last_active":"2023-11-28T21:04:59.592513+0000","last_peered":"2023-11-28T21:04:59.592513+0000","last_clean":"2023-11-28T21:04:59.592513+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T21:04:59.592513+0000","last_undegraded":"2023-11-28T21:04:59.592513+0000","last_fullsized":"2023-11-28T21:04:59.592513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0086681780000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"51'600","reported_seq":656,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:55.605131+0000","last_change":"2023-11-28T20:38:18.568634+0000","last_active":"2023-11-28T21:04:55.605131+0000","last_peered":"2023-11-28T21:04:55.605131+0000","last_clean":"2023-11-28T21:04:55.605131+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T21:04:55.605131+0000","last_undegraded":"2023-11-28T21:04:55.605131+0000","last_fullsized":"2023-11-28T21:04:55.605131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:17.491041+0000","last_clean_scrub_stamp":"2023-11-28T20:38:17.491041+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":33,"num_write":550,"num_write_kb":45433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"51'1738","reported_seq":3614,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:29.923470+0000","last_change":"2023-11-28T20:44:35.619807+0000","last_active":"2023-11-28T21:05:29.923470+0000","last_peered":"2023-11-28T21:05:29.923470+0000","last_clean":"2023-11-28T21:05:29.923470+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T21:05:29.923470+0000","last_undegraded":"2023-11-28T21:05:29.923470+0000","last_fullsized":"2023-11-28T21:05:29.923470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1738,"log_dups_size":0,"ondisk_log_size":1738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016829818,"stat_sum":{"num_bytes":16566795,"num_objects":555,"num_object_clones":248,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":248,"num_read":32,"num_read_kb":32,"num_write":1476,"num_write_kb":23281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"51'447","reported_seq":2540,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:59.592688+0000","last_change":"2023-11-28T20:44:35.615234+0000","last_active":"2023-11-28T21:04:59.592688+0000","last_peered":"2023-11-28T21:04:59.592688+0000","last_clean":"2023-11-28T21:04:59.592688+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T21:04:59.592688+0000","last_undegraded":"2023-11-28T21:04:59.592688+0000","last_fullsized":"2023-11-28T21:04:59.592688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018571445999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"51'779","reported_seq":1332,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:40.356204+0000","last_change":"2023-11-28T21:05:40.356317+0000","last_active":"2023-11-28T21:05:40.356204+0000","last_peered":"2023-11-28T21:05:40.356204+0000","last_clean":"2023-11-28T21:05:40.356204+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T21:05:40.356204+0000","last_undegraded":"2023-11-28T21:05:40.356204+0000","last_fullsized":"2023-11-28T21:05:40.356204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'779","last_scrub_stamp":"2023-11-28T21:05:40.356117+0000","last_deep_scrub":"51'779","last_deep_scrub_stamp":"2023-11-28T21:05:40.356117+0000","last_clean_scrub_stamp":"2023-11-28T21:05:40.356117+0000","objects_scrubbed":21,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:37.255476+0000","scrub_duration":0.062204162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18014655,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":492,"num_read_kb":1568,"num_write":714,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":112125,"num_omap_keys":180,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"51'1133","reported_seq":1695,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:35.448844+0000","last_change":"2023-11-28T21:05:35.448895+0000","last_active":"2023-11-28T21:05:35.448844+0000","last_peered":"2023-11-28T21:05:35.448844+0000","last_clean":"2023-11-28T21:05:35.448844+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T21:05:35.448844+0000","last_undegraded":"2023-11-28T21:05:35.448844+0000","last_fullsized":"2023-11-28T21:05:35.448844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1133","last_scrub_stamp":"2023-11-28T21:05:35.448625+0000","last_deep_scrub":"51'1133","last_deep_scrub_stamp":"2023-11-28T21:05:35.448625+0000","last_clean_scrub_stamp":"2023-11-28T21:05:35.448625+0000","objects_scrubbed":28,"log_size":1133,"log_dups_size":0,"ondisk_log_size":1133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:29.305578+0000","scrub_duration":0.13673348099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34584852,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":502,"num_read_kb":1393,"num_write":1050,"num_write_kb":34570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":116270,"num_omap_keys":186,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"51'366","reported_seq":2467,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.102549+0000","last_change":"2023-11-28T21:05:34.102549+0000","last_active":"2023-11-28T21:05:34.102549+0000","last_peered":"2023-11-28T21:05:34.102549+0000","last_clean":"2023-11-28T21:05:34.102549+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T21:05:34.102549+0000","last_undegraded":"2023-11-28T21:05:34.102549+0000","last_fullsized":"2023-11-28T21:05:34.102549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'366","last_scrub_stamp":"2023-11-28T21:05:34.102426+0000","last_deep_scrub":"51'366","last_deep_scrub_stamp":"2023-11-28T21:05:34.102426+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.102426+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:05.296824+0000","scrub_duration":0.0029151789999999999,"objects_trimmed":0,"snaptrim_duration":0.014791248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"51'1725","reported_seq":3595,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:26.530330+0000","last_change":"2023-11-28T20:44:35.530646+0000","last_active":"2023-11-28T21:03:26.530330+0000","last_peered":"2023-11-28T21:03:26.530330+0000","last_clean":"2023-11-28T21:03:26.530330+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T21:03:26.530330+0000","last_undegraded":"2023-11-28T21:03:26.530330+0000","last_fullsized":"2023-11-28T21:03:26.530330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022000169999999999,"stat_sum":{"num_bytes":29986576,"num_objects":543,"num_object_clones":248,"num_object_copies":2172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":248,"num_read":29,"num_read_kb":29,"num_write":1454,"num_write_kb":38376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"51'379","reported_seq":441,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.311875+0000","last_change":"2023-11-28T21:05:41.311875+0000","last_active":"2023-11-28T21:05:41.311875+0000","last_peered":"2023-11-28T21:05:41.311875+0000","last_clean":"2023-11-28T21:05:41.311875+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T21:05:41.311875+0000","last_undegraded":"2023-11-28T21:05:41.311875+0000","last_fullsized":"2023-11-28T21:05:41.311875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'379","last_scrub_stamp":"2023-11-28T21:05:41.311729+0000","last_deep_scrub":"51'379","last_deep_scrub_stamp":"2023-11-28T21:05:41.311729+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.311729+0000","objects_scrubbed":14,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:36:23.970191+0000","scrub_duration":0.046276848000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":20723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80718,"num_omap_keys":145,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"51'401","reported_seq":2501,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:30.976442+0000","last_change":"2023-11-28T21:05:30.976527+0000","last_active":"2023-11-28T21:05:30.976442+0000","last_peered":"2023-11-28T21:05:30.976442+0000","last_clean":"2023-11-28T21:05:30.976442+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T21:05:30.976442+0000","last_undegraded":"2023-11-28T21:05:30.976442+0000","last_fullsized":"2023-11-28T21:05:30.976442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'401","last_scrub_stamp":"2023-11-28T21:05:30.976211+0000","last_deep_scrub":"51'401","last_deep_scrub_stamp":"2023-11-28T21:05:30.976211+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.976211+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:05.312126+0000","scrub_duration":0.003806191,"objects_trimmed":0,"snaptrim_duration":0.010086065,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"51'1756","reported_seq":3649,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:03:26.614938+0000","last_change":"2023-11-28T20:44:35.611344+0000","last_active":"2023-11-28T21:03:26.614938+0000","last_peered":"2023-11-28T21:03:26.614938+0000","last_clean":"2023-11-28T21:03:26.614938+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T21:03:26.614938+0000","last_undegraded":"2023-11-28T21:03:26.614938+0000","last_fullsized":"2023-11-28T21:03:26.614938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015656369999999999,"stat_sum":{"num_bytes":33768985,"num_objects":521,"num_object_clones":238,"num_object_copies":2084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":238,"num_read":45,"num_read_kb":12330,"num_write":1499,"num_write_kb":48802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"51'415","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:25.598544+0000","last_change":"2023-11-28T20:44:35.609721+0000","last_active":"2023-11-28T21:05:25.598544+0000","last_peered":"2023-11-28T21:05:25.598544+0000","last_clean":"2023-11-28T21:05:25.598544+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T21:05:25.598544+0000","last_undegraded":"2023-11-28T21:05:25.598544+0000","last_fullsized":"2023-11-28T21:05:25.598544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013289166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"51'439","reported_seq":2534,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:24.595640+0000","last_change":"2023-11-28T20:44:35.529934+0000","last_active":"2023-11-28T21:05:24.595640+0000","last_peered":"2023-11-28T21:05:24.595640+0000","last_clean":"2023-11-28T21:05:24.595640+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T21:05:24.595640+0000","last_undegraded":"2023-11-28T21:05:24.595640+0000","last_fullsized":"2023-11-28T21:05:24.595640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017225739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"51'438","reported_seq":2533,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:25.611966+0000","last_change":"2023-11-28T20:44:35.624744+0000","last_active":"2023-11-28T21:05:25.611966+0000","last_peered":"2023-11-28T21:05:25.611966+0000","last_clean":"2023-11-28T21:05:25.611966+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T21:05:25.611966+0000","last_undegraded":"2023-11-28T21:05:25.611966+0000","last_fullsized":"2023-11-28T21:05:25.611966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018881576000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"51'384","reported_seq":2479,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:26.976686+0000","last_change":"2023-11-28T20:44:35.611177+0000","last_active":"2023-11-28T21:05:26.976686+0000","last_peered":"2023-11-28T21:05:26.976686+0000","last_clean":"2023-11-28T21:05:26.976686+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T21:05:26.976686+0000","last_undegraded":"2023-11-28T21:05:26.976686+0000","last_fullsized":"2023-11-28T21:05:26.976686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014673739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"51'367","reported_seq":2469,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:37.282943+0000","last_change":"2023-11-28T21:05:37.282985+0000","last_active":"2023-11-28T21:05:37.282943+0000","last_peered":"2023-11-28T21:05:37.282943+0000","last_clean":"2023-11-28T21:05:37.282943+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T21:05:37.282943+0000","last_undegraded":"2023-11-28T21:05:37.282943+0000","last_fullsized":"2023-11-28T21:05:37.282943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'367","last_scrub_stamp":"2023-11-28T21:05:37.282834+0000","last_deep_scrub":"51'367","last_deep_scrub_stamp":"2023-11-28T21:05:37.282834+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.282834+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:54:01.725224+0000","scrub_duration":0.003284698,"objects_trimmed":0,"snaptrim_duration":0.017627927000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"51'417","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.495199+0000","last_change":"2023-11-28T20:44:35.599239+0000","last_active":"2023-11-28T21:04:30.495199+0000","last_peered":"2023-11-28T21:04:30.495199+0000","last_clean":"2023-11-28T21:04:30.495199+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T21:04:30.495199+0000","last_undegraded":"2023-11-28T21:04:30.495199+0000","last_fullsized":"2023-11-28T21:04:30.495199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061577519999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"51'426","reported_seq":2520,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178016+0000","last_change":"2023-11-28T20:44:35.619451+0000","last_active":"2023-11-28T21:04:23.178016+0000","last_peered":"2023-11-28T21:04:23.178016+0000","last_clean":"2023-11-28T21:04:23.178016+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T21:04:23.178016+0000","last_undegraded":"2023-11-28T21:04:23.178016+0000","last_fullsized":"2023-11-28T21:04:23.178016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017436297999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"51'394","reported_seq":2488,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.564309+0000","last_change":"2023-11-28T20:44:35.614405+0000","last_active":"2023-11-28T21:04:28.564309+0000","last_peered":"2023-11-28T21:04:28.564309+0000","last_clean":"2023-11-28T21:04:28.564309+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T21:04:28.564309+0000","last_undegraded":"2023-11-28T21:04:28.564309+0000","last_fullsized":"2023-11-28T21:04:28.564309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018095488999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"51'421","reported_seq":2515,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.455511+0000","last_change":"2023-11-28T20:44:35.611219+0000","last_active":"2023-11-28T21:04:26.455511+0000","last_peered":"2023-11-28T21:04:26.455511+0000","last_clean":"2023-11-28T21:04:26.455511+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T21:04:26.455511+0000","last_undegraded":"2023-11-28T21:04:26.455511+0000","last_fullsized":"2023-11-28T21:04:26.455511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014654275,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"51'411","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:31.244390+0000","last_change":"2023-11-28T21:05:31.244410+0000","last_active":"2023-11-28T21:05:31.244390+0000","last_peered":"2023-11-28T21:05:31.244390+0000","last_clean":"2023-11-28T21:05:31.244390+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T21:05:31.244390+0000","last_undegraded":"2023-11-28T21:05:31.244390+0000","last_fullsized":"2023-11-28T21:05:31.244390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:31.244317+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:31.244317+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.244317+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:48:02.680662+0000","scrub_duration":0.0027735979999999999,"objects_trimmed":0,"snaptrim_duration":0.017356489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"51'417","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.492170+0000","last_change":"2023-11-28T20:44:35.530341+0000","last_active":"2023-11-28T21:04:30.492170+0000","last_peered":"2023-11-28T21:04:30.492170+0000","last_clean":"2023-11-28T21:04:30.492170+0000","last_became_active":"2023-11-28T20:39:01.848167+0000","last_became_peered":"2023-11-28T20:39:01.848167+0000","last_unstale":"2023-11-28T21:04:30.492170+0000","last_undegraded":"2023-11-28T21:04:30.492170+0000","last_fullsized":"2023-11-28T21:04:30.492170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020579169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"51'422","reported_seq":2524,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.031640+0000","last_change":"2023-11-28T21:05:42.031660+0000","last_active":"2023-11-28T21:05:42.031640+0000","last_peered":"2023-11-28T21:05:42.031640+0000","last_clean":"2023-11-28T21:05:42.031640+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T21:05:42.031640+0000","last_undegraded":"2023-11-28T21:05:42.031640+0000","last_fullsized":"2023-11-28T21:05:42.031640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'422","last_scrub_stamp":"2023-11-28T21:05:42.031561+0000","last_deep_scrub":"51'422","last_deep_scrub_stamp":"2023-11-28T21:05:42.031561+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.031561+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:36.205746+0000","scrub_duration":0.0024639100000000001,"objects_trimmed":0,"snaptrim_duration":0.014291543,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"51'396","reported_seq":2490,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:20.597721+0000","last_change":"2023-11-28T20:44:35.620800+0000","last_active":"2023-11-28T21:05:20.597721+0000","last_peered":"2023-11-28T21:05:20.597721+0000","last_clean":"2023-11-28T21:05:20.597721+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T21:05:20.597721+0000","last_undegraded":"2023-11-28T21:05:20.597721+0000","last_fullsized":"2023-11-28T21:05:20.597721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017003022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"51'403","reported_seq":2497,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:25.604396+0000","last_change":"2023-11-28T20:44:35.638243+0000","last_active":"2023-11-28T21:05:25.604396+0000","last_peered":"2023-11-28T21:05:25.604396+0000","last_clean":"2023-11-28T21:05:25.604396+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T21:05:25.604396+0000","last_undegraded":"2023-11-28T21:05:25.604396+0000","last_fullsized":"2023-11-28T21:05:25.604396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020849563000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"51'393","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.385033+0000","last_change":"2023-11-28T21:05:46.385054+0000","last_active":"2023-11-28T21:05:46.385033+0000","last_peered":"2023-11-28T21:05:46.385033+0000","last_clean":"2023-11-28T21:05:46.385033+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T21:05:46.385033+0000","last_undegraded":"2023-11-28T21:05:46.385033+0000","last_fullsized":"2023-11-28T21:05:46.385033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'393","last_scrub_stamp":"2023-11-28T21:05:46.384910+0000","last_deep_scrub":"51'393","last_deep_scrub_stamp":"2023-11-28T21:05:46.384910+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.384910+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:01.362037+0000","scrub_duration":0.002739965,"objects_trimmed":0,"snaptrim_duration":0.0019691359999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"51'430","reported_seq":2523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178629+0000","last_change":"2023-11-28T20:44:35.617721+0000","last_active":"2023-11-28T21:04:23.178629+0000","last_peered":"2023-11-28T21:04:23.178629+0000","last_clean":"2023-11-28T21:04:23.178629+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T21:04:23.178629+0000","last_undegraded":"2023-11-28T21:04:23.178629+0000","last_fullsized":"2023-11-28T21:04:23.178629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019569492000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"51'421","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559344+0000","last_change":"2023-11-28T20:44:35.612279+0000","last_active":"2023-11-28T21:04:28.559344+0000","last_peered":"2023-11-28T21:04:28.559344+0000","last_clean":"2023-11-28T21:04:28.559344+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T21:04:28.559344+0000","last_undegraded":"2023-11-28T21:04:28.559344+0000","last_fullsized":"2023-11-28T21:04:28.559344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015773832000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"51'435","reported_seq":2528,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.491441+0000","last_change":"2023-11-28T20:44:35.606941+0000","last_active":"2023-11-28T21:04:30.491441+0000","last_peered":"2023-11-28T21:04:30.491441+0000","last_clean":"2023-11-28T21:04:30.491441+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T21:04:30.491441+0000","last_undegraded":"2023-11-28T21:04:30.491441+0000","last_fullsized":"2023-11-28T21:04:30.491441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013692045,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"51'417","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:36.093153+0000","last_change":"2023-11-28T21:05:36.093176+0000","last_active":"2023-11-28T21:05:36.093153+0000","last_peered":"2023-11-28T21:05:36.093153+0000","last_clean":"2023-11-28T21:05:36.093153+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T21:05:36.093153+0000","last_undegraded":"2023-11-28T21:05:36.093153+0000","last_fullsized":"2023-11-28T21:05:36.093153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:05:36.093051+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:05:36.093051+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.093051+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:20:01.197729+0000","scrub_duration":0.0019047210000000001,"objects_trimmed":0,"snaptrim_duration":0.014004656000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"51'418","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:54.592127+0000","last_change":"2023-11-28T20:44:35.614800+0000","last_active":"2023-11-28T21:04:54.592127+0000","last_peered":"2023-11-28T21:04:54.592127+0000","last_clean":"2023-11-28T21:04:54.592127+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T21:04:54.592127+0000","last_undegraded":"2023-11-28T21:04:54.592127+0000","last_fullsized":"2023-11-28T21:04:54.592127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018246884000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"51'374","reported_seq":2475,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:38.970555+0000","last_change":"2023-11-28T21:05:38.970607+0000","last_active":"2023-11-28T21:05:38.970555+0000","last_peered":"2023-11-28T21:05:38.970555+0000","last_clean":"2023-11-28T21:05:38.970555+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T21:05:38.970555+0000","last_undegraded":"2023-11-28T21:05:38.970555+0000","last_fullsized":"2023-11-28T21:05:38.970555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'374","last_scrub_stamp":"2023-11-28T21:05:38.970355+0000","last_deep_scrub":"51'374","last_deep_scrub_stamp":"2023-11-28T21:05:38.970355+0000","last_clean_scrub_stamp":"2023-11-28T21:05:38.970355+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:16.855297+0000","scrub_duration":0.00371595,"objects_trimmed":0,"snaptrim_duration":0.010909501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"51'380","reported_seq":2473,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:55.593012+0000","last_change":"2023-11-28T20:44:35.611282+0000","last_active":"2023-11-28T21:04:55.593012+0000","last_peered":"2023-11-28T21:04:55.593012+0000","last_clean":"2023-11-28T21:04:55.593012+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T21:04:55.593012+0000","last_undegraded":"2023-11-28T21:04:55.593012+0000","last_fullsized":"2023-11-28T21:04:55.593012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014265125,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"51'385","reported_seq":2485,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:55.593046+0000","last_change":"2023-11-28T20:44:35.618555+0000","last_active":"2023-11-28T21:04:55.593046+0000","last_peered":"2023-11-28T21:04:55.593046+0000","last_clean":"2023-11-28T21:04:55.593046+0000","last_became_active":"2023-11-28T20:39:01.391291+0000","last_became_peered":"2023-11-28T20:39:01.391291+0000","last_unstale":"2023-11-28T21:04:55.593046+0000","last_undegraded":"2023-11-28T21:04:55.593046+0000","last_fullsized":"2023-11-28T21:04:55.593046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017078507999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"51'419","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:00.599208+0000","last_change":"2023-11-28T20:44:35.640277+0000","last_active":"2023-11-28T21:05:00.599208+0000","last_peered":"2023-11-28T21:05:00.599208+0000","last_clean":"2023-11-28T21:05:00.599208+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T21:05:00.599208+0000","last_undegraded":"2023-11-28T21:05:00.599208+0000","last_fullsized":"2023-11-28T21:05:00.599208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017711331,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"51'405","reported_seq":2506,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:44.232745+0000","last_change":"2023-11-28T21:05:44.232745+0000","last_active":"2023-11-28T21:05:44.232745+0000","last_peered":"2023-11-28T21:05:44.232745+0000","last_clean":"2023-11-28T21:05:44.232745+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T21:05:44.232745+0000","last_undegraded":"2023-11-28T21:05:44.232745+0000","last_fullsized":"2023-11-28T21:05:44.232745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'405","last_scrub_stamp":"2023-11-28T21:05:44.232593+0000","last_deep_scrub":"51'405","last_deep_scrub_stamp":"2023-11-28T21:05:44.232593+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.232593+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:38.822888+0000","scrub_duration":0.0029742990000000001,"objects_trimmed":0,"snaptrim_duration":0.017616142000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"51'400","reported_seq":2500,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:31.601940+0000","last_change":"2023-11-28T21:05:31.601994+0000","last_active":"2023-11-28T21:05:31.601940+0000","last_peered":"2023-11-28T21:05:31.601940+0000","last_clean":"2023-11-28T21:05:31.601940+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T21:05:31.601940+0000","last_undegraded":"2023-11-28T21:05:31.601940+0000","last_fullsized":"2023-11-28T21:05:31.601940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'400","last_scrub_stamp":"2023-11-28T21:05:31.601754+0000","last_deep_scrub":"51'400","last_deep_scrub_stamp":"2023-11-28T21:05:31.601754+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.601754+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:43.804359+0000","scrub_duration":0.003376469,"objects_trimmed":0,"snaptrim_duration":0.020312439000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"51'403","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.558797+0000","last_change":"2023-11-28T20:44:35.622789+0000","last_active":"2023-11-28T21:04:28.558797+0000","last_peered":"2023-11-28T21:04:28.558797+0000","last_clean":"2023-11-28T21:04:28.558797+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T21:04:28.558797+0000","last_undegraded":"2023-11-28T21:04:28.558797+0000","last_fullsized":"2023-11-28T21:04:28.558797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017449602000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"51'416","reported_seq":2508,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:30.493017+0000","last_change":"2023-11-28T20:44:35.638249+0000","last_active":"2023-11-28T21:04:30.493017+0000","last_peered":"2023-11-28T21:04:30.493017+0000","last_clean":"2023-11-28T21:04:30.493017+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T21:04:30.493017+0000","last_undegraded":"2023-11-28T21:04:30.493017+0000","last_fullsized":"2023-11-28T21:04:30.493017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018992159000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"51'397","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.448632+0000","last_change":"2023-11-28T20:44:35.613038+0000","last_active":"2023-11-28T21:04:26.448632+0000","last_peered":"2023-11-28T21:04:26.448632+0000","last_clean":"2023-11-28T21:04:26.448632+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T21:04:26.448632+0000","last_undegraded":"2023-11-28T21:04:26.448632+0000","last_fullsized":"2023-11-28T21:04:26.448632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015371953000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"51'415","reported_seq":2510,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:23.427126+0000","last_change":"2023-11-28T20:44:35.603769+0000","last_active":"2023-11-28T21:05:23.427126+0000","last_peered":"2023-11-28T21:05:23.427126+0000","last_clean":"2023-11-28T21:05:23.427126+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T21:05:23.427126+0000","last_undegraded":"2023-11-28T21:05:23.427126+0000","last_fullsized":"2023-11-28T21:05:23.427126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098716120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"51'399","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:24.595898+0000","last_change":"2023-11-28T20:44:35.607958+0000","last_active":"2023-11-28T21:05:24.595898+0000","last_peered":"2023-11-28T21:05:24.595898+0000","last_clean":"2023-11-28T21:05:24.595898+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T21:05:24.595898+0000","last_undegraded":"2023-11-28T21:05:24.595898+0000","last_fullsized":"2023-11-28T21:05:24.595898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011275626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"51'410","reported_seq":2505,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:25.604452+0000","last_change":"2023-11-28T20:44:35.639151+0000","last_active":"2023-11-28T21:05:25.604452+0000","last_peered":"2023-11-28T21:05:25.604452+0000","last_clean":"2023-11-28T21:05:25.604452+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T21:05:25.604452+0000","last_undegraded":"2023-11-28T21:05:25.604452+0000","last_fullsized":"2023-11-28T21:05:25.604452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017369464000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":892224822,"num_objects":17666,"num_object_clones":8054,"num_object_copies":70664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17666,"num_whiteouts":7974,"num_read":1150,"num_read_kb":100500,"num_write":48457,"num_write_kb":1187847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1881309184,"data_stored":1881309184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57114,"ondisk_log_size":57114,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26113,"ondisk_log_size":26113,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":680923161,"num_objects":625,"num_object_clones":0,"num_object_copies":1250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":0,"num_read":1485,"num_read_kb":4455,"num_write":14545,"num_write_kb":680650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2615215,"num_omap_keys":4997,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1362001920,"data_stored":1361846322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15728,"ondisk_log_size":15728,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509776,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":650828,"kb_used_data":461380,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":93721012,"statfs":{"total":96636764160,"available":95970316288,"internally_reserved":0,"allocated":472453120,"data_stored":472148767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":193984967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":42.021000000000001,"5min":8.7739999999999991,"15min":3.2749999999999999},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":873.04100000000005,"5min":873.04100000000005,"15min":873.04100000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.52300000000000002},"min":{"1min":0.24299999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.872,"5min":0.872,"15min":6.5659999999999998},"last":0.44700000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29899999999999999},"max":{"1min":1.194,"5min":1.194,"15min":6.9370000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.52400000000000002,"15min":0.54400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.627,"5min":0.79700000000000004,"15min":3.6219999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.8780000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":39.405999999999999,"5min":8.3049999999999997,"15min":3.1909999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.28299999999999997},"max":{"1min":817.63900000000001,"5min":817.63900000000001,"15min":817.63900000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":253.649,"5min":51.384,"15min":17.940000000000001},"min":{"1min":0.56299999999999994,"5min":0.48699999999999999,"15min":0.34799999999999998},"max":{"1min":3268.6419999999998,"5min":3268.6419999999998,"15min":3268.6419999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":253.23400000000001,"5min":51.326999999999998,"15min":17.667999999999999},"min":{"1min":0.61199999999999999,"5min":0.54400000000000004,"15min":0.51000000000000001},"max":{"1min":3232.7750000000001,"5min":3232.7750000000001,"15min":3232.7750000000001},"last":0.94799999999999995}]},{"osd":5,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":229.02799999999999,"5min":46.481999999999999,"15min":16.082999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.42299999999999999},"max":{"1min":3259.5459999999998,"5min":3259.5459999999998,"15min":3259.5459999999998},"last":0.82399999999999995},{"interface":"front","average":{"1min":36.899999999999999,"5min":8.0679999999999996,"15min":3.2559999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53300000000000003},"max":{"1min":703.19299999999998,"5min":703.19299999999998,"15min":703.19299999999998},"last":0.93600000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":46.119,"5min":9.9299999999999997,"15min":3.9100000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.51600000000000001},"max":{"1min":928.99199999999996,"5min":928.99199999999996,"15min":928.99199999999996},"last":0.89500000000000002},{"interface":"front","average":{"1min":49.222999999999999,"5min":10.545,"15min":4.1520000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":961.01800000000003,"5min":961.01800000000003,"15min":961.01800000000003},"last":0.79900000000000004}]},{"osd":7,"last update":"Tue Nov 28 21:05:04 2023","interfaces":[{"interface":"back","average":{"1min":44.685000000000002,"5min":9.6370000000000005,"15min":4.1289999999999996},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.44600000000000001},"max":{"1min":872.827,"5min":872.827,"15min":872.827},"last":1.0820000000000001},{"interface":"front","average":{"1min":41.890000000000001,"5min":9.0760000000000005,"15min":3.6160000000000001},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.48899999999999999},"max":{"1min":817.84400000000005,"5min":817.84400000000005,"15min":817.84400000000005},"last":0.83899999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509776,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424976,"kb_used_data":277192,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93946864,"statfs":{"total":96636764160,"available":96201588736,"internally_reserved":0,"allocated":283844608,"data_stored":283539830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9790000000000001,"5min":1.5509999999999999,"15min":0.82999999999999996},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":64.087000000000003,"5min":64.087000000000003,"15min":64.087000000000003},"last":0.34300000000000003},{"interface":"front","average":{"1min":6.0759999999999996,"5min":1.667,"15min":0.95599999999999996},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.25},"max":{"1min":64.114999999999995,"5min":64.114999999999995,"15min":64.114999999999995},"last":0.36699999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":5.9960000000000004,"5min":1.647,"15min":0.97199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":64,"5min":64,"15min":64},"last":0.30499999999999999},{"interface":"front","average":{"1min":6.0679999999999996,"5min":1.7,"15min":0.97399999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":64.028999999999996,"5min":64.028999999999996,"15min":64.028999999999996},"last":0.40899999999999997}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":144.126,"5min":29.332000000000001,"15min":10.220000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":2826.7199999999998,"5min":2826.7199999999998,"15min":2826.7199999999998},"last":0.28499999999999998},{"interface":"front","average":{"1min":146.227,"5min":29.651,"15min":10.257999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.307},"max":{"1min":2838.0680000000002,"5min":2838.0680000000002,"15min":2838.0680000000002},"last":0.38800000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":13.901,"5min":3.4500000000000002,"15min":1.7190000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.38},"max":{"1min":149.43700000000001,"5min":149.43700000000001,"15min":149.43700000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":262.66399999999999,"5min":53.177,"15min":18.265000000000001},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.38800000000000001},"max":{"1min":3288.7310000000002,"5min":3288.7310000000002,"15min":3288.7310000000002},"last":0.67200000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":308.05099999999999,"5min":62.268999999999998,"15min":21.323},"min":{"1min":0.68500000000000005,"5min":0.54700000000000004,"15min":0.46000000000000002},"max":{"1min":3314.4110000000001,"5min":3314.4110000000001,"15min":3314.4110000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":207.60499999999999,"5min":42.195999999999998,"15min":14.644},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.44900000000000001},"max":{"1min":2139.3159999999998,"5min":2139.3159999999998,"15min":2139.3159999999998},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":317.48099999999999,"5min":64.153999999999996,"15min":21.949000000000002},"min":{"1min":0.64100000000000001,"5min":0.56999999999999995,"15min":0.38700000000000001},"max":{"1min":3288.7730000000001,"5min":3288.7730000000001,"15min":3288.7730000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":254.578,"5min":51.664000000000001,"15min":17.855},"min":{"1min":0.77700000000000002,"5min":0.68500000000000005,"15min":0.42699999999999999},"max":{"1min":2837.9960000000001,"5min":2837.9960000000001,"15min":2837.9960000000001},"last":0.77300000000000002}]},{"osd":7,"last update":"Tue Nov 28 21:04:54 2023","interfaces":[{"interface":"back","average":{"1min":151.316,"5min":30.917999999999999,"15min":10.859999999999999},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.46899999999999997},"max":{"1min":2822.598,"5min":2822.598,"15min":2822.598},"last":0.60899999999999999},{"interface":"front","average":{"1min":235.82599999999999,"5min":47.865000000000002,"15min":16.504999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.45400000000000001},"max":{"1min":2150.9899999999998,"5min":2150.9899999999998,"15min":2150.9899999999998},"last":0.64900000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509777,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660764,"kb_used_data":458836,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93711076,"statfs":{"total":96636764160,"available":95960141824,"internally_reserved":0,"allocated":469848064,"data_stored":469543023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.01,"5min":2.3849999999999998,"15min":1.1799999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":143.76300000000001,"5min":143.76300000000001,"15min":143.76300000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":2.4769999999999999,"5min":0.92200000000000004,"15min":0.71799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":39.768000000000001,"5min":39.768000000000001,"15min":39.768000000000001},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":8.2780000000000005,"5min":2.0510000000000002,"15min":1.042},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.252},"max":{"1min":149.34299999999999,"5min":149.34299999999999,"15min":149.34299999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":6.5229999999999997},"last":0.25800000000000001}]},{"osd":3,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.726000000000001,"5min":2.5840000000000001,"15min":1.2589999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26700000000000002},"max":{"1min":147.46899999999999,"5min":147.46899999999999,"15min":147.46899999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":3.6179999999999999,"5min":1.216,"15min":0.85499999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":59.305,"5min":59.305,"15min":59.305},"last":0.311}]},{"osd":4,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":20.18,"5min":4.649,"15min":2.1320000000000001},"min":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.40400000000000003},"max":{"1min":221.76900000000001,"5min":221.76900000000001,"15min":221.76900000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":63.805999999999997,"5min":13.407,"15min":5.4569999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.34300000000000003},"max":{"1min":1198.962,"5min":1198.962,"15min":1198.962},"last":0.59099999999999997}]},{"osd":5,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":31.141999999999999,"5min":6.9329999999999998,"15min":2.9169999999999998},"min":{"1min":0.60199999999999998,"5min":0.56299999999999994,"15min":0.42599999999999999},"max":{"1min":574.81700000000001,"5min":574.81700000000001,"15min":574.81700000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":2.9430000000000001,"5min":1.341,"15min":1.099},"min":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.501},"max":{"1min":39.896999999999998,"5min":39.896999999999998,"15min":39.896999999999998},"last":0.67800000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:05:10 2023","interfaces":[{"interface":"back","average":{"1min":63.299999999999997,"5min":13.385,"15min":5.0860000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.47099999999999997},"max":{"1min":1168.432,"5min":1168.432,"15min":1168.432},"last":0.70099999999999996},{"interface":"front","average":{"1min":2.9279999999999999,"5min":1.276,"15min":1.0389999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46000000000000002},"max":{"1min":39.863,"5min":39.863,"15min":39.863},"last":0.72799999999999998}]},{"osd":7,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":12.673,"5min":3.246,"15min":1.679},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.54000000000000004},"max":{"1min":143.89599999999999,"5min":143.89599999999999,"15min":143.89599999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":63.936,"5min":13.486000000000001,"15min":5.0670000000000002},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1198.933,"5min":1198.933,"15min":1198.933},"last":0.54000000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542479,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583596,"kb_used_data":417764,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":93788244,"statfs":{"total":96636764160,"available":96039161856,"internally_reserved":0,"allocated":427790336,"data_stored":427490226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":169802186},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.03300000000002,"5min":93.887,"15min":31.899999999999999},"min":{"1min":0.55900000000000005,"5min":0.46700000000000003,"15min":0.29699999999999999},"max":{"1min":3136.5639999999999,"5min":3136.5639999999999,"15min":3136.5639999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":271.74400000000003,"5min":55.098999999999997,"15min":18.936},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.36899999999999999},"max":{"1min":2779.4099999999999,"5min":2779.4099999999999,"15min":2779.4099999999999},"last":1.0449999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":470.35899999999998,"5min":94.754999999999995,"15min":32.216000000000001},"min":{"1min":0.55900000000000005,"5min":0.433,"15min":0.34499999999999997},"max":{"1min":3167.6399999999999,"5min":3167.6399999999999,"15min":3167.6399999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":496.947,"5min":100.057,"15min":33.951000000000001},"min":{"1min":0.61899999999999999,"5min":0.496,"15min":0.46400000000000002},"max":{"1min":4741.7640000000001,"5min":4741.7640000000001,"15min":4741.7640000000001},"last":1.113}]},{"osd":2,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":279.05900000000003,"5min":56.529000000000003,"15min":19.739999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.42899999999999999},"max":{"1min":2301.0599999999999,"5min":2301.0599999999999,"15min":2301.0599999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":499.01799999999997,"5min":100.639,"15min":34.240000000000002},"min":{"1min":0.82999999999999996,"5min":0.69299999999999995,"15min":0.42399999999999999},"max":{"1min":4752.8689999999997,"5min":4752.8689999999997,"15min":4752.8689999999997},"last":1.1870000000000001}]},{"osd":3,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":466.53500000000003,"5min":94.042000000000002,"15min":32.265999999999998},"min":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.44700000000000001},"max":{"1min":3147.2719999999999,"5min":3147.2719999999999,"15min":3147.2719999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":298.06700000000001,"5min":60.340000000000003,"15min":20.724},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.44500000000000001},"max":{"1min":2301.1370000000002,"5min":2301.1370000000002,"15min":2301.1370000000002},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.91200000000000003,"15min":1.282},"min":{"1min":0.69899999999999995,"5min":0.57499999999999996,"15min":0.38900000000000001},"max":{"1min":1.056,"5min":1.266,"15min":71.313000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.95199999999999996,"15min":1.1870000000000001},"min":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.40000000000000002},"max":{"1min":1.2929999999999999,"5min":1.335,"15min":34.881},"last":0.95899999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0600000000000001,"15min":1.29},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.39700000000000002},"max":{"1min":1.895,"5min":1.895,"15min":44.558},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1339999999999999,"15min":1.1559999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.41399999999999998},"max":{"1min":1.956,"5min":1.956,"15min":3.782},"last":1.2949999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.01,"15min":1.115},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.44700000000000001},"max":{"1min":1.1879999999999999,"5min":1.47,"15min":7.6769999999999996},"last":1.018},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.159},"min":{"1min":0.89100000000000001,"5min":0.71499999999999997,"15min":0.38100000000000001},"max":{"1min":1.645,"5min":1.645,"15min":2.7949999999999999},"last":1.46}]}]},{"osd":6,"up_from":14,"seq":60129542480,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600852,"kb_used_data":439180,"kb_used_omap":1,"kb_used_meta":161662,"kb_avail":93770988,"statfs":{"total":96636764160,"available":96021491712,"internally_reserved":0,"allocated":449720320,"data_stored":449421964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165542342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.524000000000001,"5min":19.795000000000002,"15min":7.1429999999999998},"min":{"1min":0.56499999999999995,"5min":0.44600000000000001,"15min":0.41299999999999998},"max":{"1min":1038.4960000000001,"5min":1038.4960000000001,"15min":1038.4960000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":95.692999999999998,"5min":19.936,"15min":7.2519999999999998},"min":{"1min":0.79500000000000004,"5min":0.52900000000000003,"15min":0.33600000000000002},"max":{"1min":1038.5619999999999,"5min":1038.5619999999999,"15min":1038.5619999999999},"last":0.52800000000000002}]},{"osd":1,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":101.98699999999999,"5min":21.116,"15min":7.6189999999999998},"min":{"1min":0.60899999999999999,"5min":0.52900000000000003,"15min":0.41399999999999998},"max":{"1min":1046.3320000000001,"5min":1046.3320000000001,"15min":1046.3320000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":68.814999999999998,"5min":14.573,"15min":5.4710000000000001},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.42899999999999999},"max":{"1min":1087.7460000000001,"5min":1087.7460000000001,"15min":1087.7460000000001},"last":0.35599999999999998}]},{"osd":2,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":95.518000000000001,"5min":19.795000000000002,"15min":7.1929999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.435},"max":{"1min":1038.309,"5min":1038.309,"15min":1038.309},"last":0.56399999999999995},{"interface":"front","average":{"1min":254.767,"5min":51.676000000000002,"15min":17.823},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.35099999999999998},"max":{"1min":2556.578,"5min":2556.578,"15min":2556.578},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":225.25899999999999,"5min":45.744999999999997,"15min":15.845000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54300000000000004},"max":{"1min":2567.538,"5min":2567.538,"15min":2567.538},"last":0.46999999999999997},{"interface":"front","average":{"1min":176.50999999999999,"5min":36.079000000000001,"15min":12.673},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.39700000000000002},"max":{"1min":1371.7280000000001,"5min":1371.7280000000001,"15min":1371.7280000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91200000000000003,"15min":1.0449999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":10.151},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.05,"15min":1.056},"min":{"1min":0.71299999999999997,"5min":0.64200000000000002,"15min":0.437},"max":{"1min":1.2689999999999999,"5min":1.5640000000000001,"15min":3.2629999999999999},"last":0.64800000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:05:02 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.071,"15min":1.101},"min":{"1min":0.76700000000000002,"5min":0.58399999999999996,"15min":0.50800000000000001},"max":{"1min":1.218,"5min":1.5449999999999999,"15min":4.5519999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0629999999999999,"15min":1.1519999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3480000000000001,"5min":1.694,"15min":2.1899999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:04:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1160000000000001,"15min":1.147},"min":{"1min":0.91600000000000004,"5min":0.77900000000000003,"15min":0.56899999999999995},"max":{"1min":1.3859999999999999,"5min":1.5149999999999999,"15min":4.6639999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.165,"15min":1.2150000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.2949999999999999,"5min":1.651,"15min":3.2029999999999998},"last":0.77500000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542480,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":489288,"kb_used_data":335936,"kb_used_omap":1,"kb_used_meta":153342,"kb_avail":93882552,"statfs":{"total":96636764160,"available":96135733248,"internally_reserved":0,"allocated":343998464,"data_stored":343698460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":157022661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:14 2023","interfaces":[{"interface":"back","average":{"1min":84.838999999999999,"5min":17.664000000000001,"15min":6.4409999999999998},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.27100000000000002},"max":{"1min":1605.194,"5min":1605.194,"15min":1605.194},"last":0.61299999999999999},{"interface":"front","average":{"1min":94.373000000000005,"5min":19.542000000000002,"15min":7.0590000000000002},"min":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.27100000000000002},"max":{"1min":1603.2260000000001,"5min":1603.2260000000001,"15min":1603.2260000000001},"last":0.95699999999999996}]},{"osd":1,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":84.260000000000005,"5min":17.545000000000002,"15min":6.4279999999999999},"min":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.253},"max":{"1min":1749.1869999999999,"5min":1749.1869999999999,"15min":1749.1869999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":279.99700000000001,"5min":56.835999999999999,"15min":19.574000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.442},"max":{"1min":3741.5659999999998,"5min":3741.5659999999998,"15min":3741.5659999999998},"last":0.76900000000000002}]},{"osd":2,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":8.0679999999999996,"5min":2.411,"15min":1.4319999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.309},"max":{"1min":152.40199999999999,"5min":152.40199999999999,"15min":152.40199999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":279.81599999999997,"5min":56.707000000000001,"15min":19.506},"min":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.435},"max":{"1min":3741.3910000000001,"5min":3741.3910000000001,"15min":3741.3910000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":327.06200000000001,"5min":66.230999999999995,"15min":22.754999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.34999999999999998},"max":{"1min":3904.835,"5min":3904.835,"15min":3904.835},"last":0.996},{"interface":"front","average":{"1min":86.721999999999994,"5min":18.109999999999999,"15min":6.7000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.35299999999999998},"max":{"1min":1785.712,"5min":1785.712,"15min":1785.712},"last":0.86399999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":0.89500000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.28199999999999997},"max":{"1min":1.393,"5min":1.393,"15min":3.7930000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.103,"15min":1.0900000000000001},"min":{"1min":0.71299999999999997,"5min":0.65800000000000003,"15min":0.29999999999999999},"max":{"1min":1.3120000000000001,"5min":1.5860000000000001,"15min":4.7320000000000002},"last":1.1120000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.1779999999999999},"min":{"1min":0.68200000000000005,"5min":0.65700000000000003,"15min":0.318},"max":{"1min":1.393,"5min":1.728,"15min":5.6600000000000001},"last":1.204},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0600000000000001,"15min":1.052},"min":{"1min":0.77300000000000002,"5min":0.64200000000000002,"15min":0.34000000000000002},"max":{"1min":1.536,"5min":1.6100000000000001,"15min":2.573},"last":1.0329999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:04:59 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1779999999999999,"15min":1.0700000000000001},"min":{"1min":0.69999999999999996,"5min":0.69299999999999995,"15min":0.28299999999999997},"max":{"1min":1.4730000000000001,"5min":1.633,"15min":3.9060000000000001},"last":1.159},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1519999999999999,"15min":1.206},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36899999999999999},"max":{"1min":1.4670000000000001,"5min":1.6519999999999999,"15min":4.8109999999999999},"last":0.89800000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542479,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616800,"kb_used_data":437080,"kb_used_omap":1,"kb_used_meta":179710,"kb_avail":93755040,"statfs":{"total":96636764160,"available":96005160960,"internally_reserved":0,"allocated":447569920,"data_stored":447273953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":184023493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":370.74799999999999,"5min":74.813999999999993,"15min":25.507999999999999},"min":{"1min":0.54100000000000004,"5min":0.42399999999999999,"15min":0.25600000000000001},"max":{"1min":4472.0990000000002,"5min":4472.0990000000002,"15min":4472.0990000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":370.78800000000001,"5min":74.861000000000004,"15min":25.640000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.33000000000000002},"max":{"1min":4472.4799999999996,"5min":4472.4799999999996,"15min":4472.4799999999996},"last":1.1140000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":340.39299999999997,"5min":68.760000000000005,"15min":23.995999999999999},"min":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.34000000000000002},"max":{"1min":2473.319,"5min":2473.319,"15min":2473.319},"last":0.86299999999999999},{"interface":"front","average":{"1min":343.56,"5min":69.445999999999998,"15min":24.108000000000001},"min":{"1min":0.64300000000000002,"5min":0.52400000000000002,"15min":0.40600000000000003},"max":{"1min":2525.277,"5min":2525.277,"15min":2525.277},"last":0.60799999999999998}]},{"osd":2,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":193.78399999999999,"5min":39.509999999999998,"15min":14.141},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.38600000000000001},"max":{"1min":2323.7979999999998,"5min":2323.7979999999998,"15min":2323.7979999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":308.291,"5min":62.448,"15min":21.914000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.35599999999999998},"max":{"1min":2498.6460000000002,"5min":2498.6460000000002,"15min":2498.6460000000002},"last":1.016}]},{"osd":3,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":311.33499999999998,"5min":63.033000000000001,"15min":21.722999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38900000000000001},"max":{"1min":2516.6700000000001,"5min":2516.6700000000001,"15min":2516.6700000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":321.84899999999999,"5min":65.114000000000004,"15min":22.658000000000001},"min":{"1min":0.75700000000000001,"5min":0.53200000000000003,"15min":0.441},"max":{"1min":2478.165,"5min":2478.165,"15min":2478.165},"last":1.056}]},{"osd":5,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.97699999999999998,"15min":1.292},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.36399999999999999},"max":{"1min":1.1699999999999999,"5min":1.3999999999999999,"15min":19.408999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.016,"15min":1.0940000000000001},"min":{"1min":0.67400000000000004,"5min":0.502,"15min":0.35699999999999998},"max":{"1min":1.3360000000000001,"5min":1.4970000000000001,"15min":9.375},"last":1.2090000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.032,"15min":1.3540000000000001},"min":{"1min":0.67700000000000005,"5min":0.625,"15min":0.42399999999999999},"max":{"1min":1.3460000000000001,"5min":1.415,"15min":36.531999999999996},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.111,"15min":1.772},"min":{"1min":0.76400000000000001,"5min":0.70599999999999996,"15min":0.42799999999999999},"max":{"1min":1.3440000000000001,"5min":1.4730000000000001,"15min":85.367999999999995},"last":1.5529999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:04:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0900000000000001,"15min":1.2070000000000001},"min":{"1min":0.73099999999999998,"5min":0.61099999999999999,"15min":0.42999999999999999},"max":{"1min":1.403,"5min":1.5760000000000001,"15min":9.3399999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1499999999999999,"15min":1.4330000000000001},"min":{"1min":0.85399999999999998,"5min":0.78900000000000003,"15min":0.33900000000000002},"max":{"1min":1.5509999999999999,"5min":1.577,"15min":36.591999999999999},"last":1.1519999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542479,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503304,"kb_used_data":345792,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":93868536,"statfs":{"total":96636764160,"available":96121380864,"internally_reserved":0,"allocated":354091008,"data_stored":353789699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":22.460000000000001,"5min":4.8289999999999997,"15min":1.97},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":297.16899999999998,"5min":297.16899999999998,"15min":297.16899999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":22.552,"5min":4.9340000000000002,"15min":1.984},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":297.202,"5min":297.202,"15min":297.202},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":20.687000000000001,"5min":4.5090000000000003,"15min":1.8580000000000001},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":335.166,"5min":335.166,"15min":335.166},"last":0.318},{"interface":"front","average":{"1min":19.943999999999999,"5min":4.4329999999999998,"15min":1.835},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":335.19400000000002,"5min":335.19400000000002,"15min":335.19400000000002},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":4.274,"5min":1.325,"15min":0.81599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.28399999999999997},"max":{"1min":53.808,"5min":53.808,"15min":53.808},"last":0.38800000000000001},{"interface":"front","average":{"1min":145.27699999999999,"5min":29.565000000000001,"15min":10.308},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35599999999999998},"max":{"1min":2839.3989999999999,"5min":2839.3989999999999,"15min":2839.3989999999999},"last":0.46200000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":135.411,"5min":27.715,"15min":9.8290000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2822.2359999999999,"5min":2822.2359999999999,"15min":2822.2359999999999},"last":0.627},{"interface":"front","average":{"1min":135.35900000000001,"5min":27.701000000000001,"15min":9.7970000000000006},"min":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.496},"max":{"1min":2822.212,"5min":2822.212,"15min":2822.212},"last":0.79900000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":96.162000000000006,"5min":19.890999999999998,"15min":7.1820000000000004},"min":{"1min":0.59899999999999998,"5min":0.59199999999999997,"15min":0.47099999999999997},"max":{"1min":1936.5550000000001,"5min":1936.5550000000001,"15min":1936.5550000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":122.643,"5min":25.228999999999999,"15min":8.9879999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.50700000000000001},"max":{"1min":1999.019,"5min":1999.019,"15min":1999.019},"last":0.73599999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":142.648,"5min":29.18,"15min":10.353999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48199999999999998},"max":{"1min":2832.431,"5min":2832.431,"15min":2832.431},"last":0.69099999999999995},{"interface":"front","average":{"1min":142.119,"5min":29.050999999999998,"15min":10.282999999999999},"min":{"1min":0.56299999999999994,"5min":0.48599999999999999,"15min":0.44700000000000001},"max":{"1min":2822.1840000000002,"5min":2822.1840000000002,"15min":2822.1840000000002},"last":0.57699999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:04:51 2023","interfaces":[{"interface":"back","average":{"1min":146.452,"5min":30.036999999999999,"15min":10.622},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.53300000000000003},"max":{"1min":1999.058,"5min":1999.058,"15min":1999.058},"last":0.78600000000000003},{"interface":"front","average":{"1min":225.40299999999999,"5min":45.713999999999999,"15min":15.869999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2822.143,"5min":2822.143,"15min":2822.143},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":170106880,"data_stored":170090025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":171458560,"data_stored":171434421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85495808,"data_stored":85471932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":183201792,"data_stored":183178341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":187912192,"data_stored":187897127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171967842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":182108160,"data_stored":182090706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209731584,"data_stored":209715928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":182788096,"data_stored":182788096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":297787392,"data_stored":297787392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":197746688,"data_stored":197746688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":288649216,"data_stored":288649216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259055616,"data_stored":259055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171409408,"data_stored":171409408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":267010048,"data_stored":267010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":216862720,"data_stored":216862720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:05:51.117 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.117 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.118 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.118 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.118 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.118 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.118 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.119 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.119 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.119 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.119 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.120 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.120 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.120 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.120 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.120 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.121 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.121 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.121 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.121 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.121 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.121 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.122 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.122 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.122 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.122 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.122 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.123 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.123 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.123 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.123 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.123 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.123 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.124 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.124 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.124 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.124 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.124 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.125 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.125 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.125 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.125 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.125 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.125 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-11-28T20:38:17.491041+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=17, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.126 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.126 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.126 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.126 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.126 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.127 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.127 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.127 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.127 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.127 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.127 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.128 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.128 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.128 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.128 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.128 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.129 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.129 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.129 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.129 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.129 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.129 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.130 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.130 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.130 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.130 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.131 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.131 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:05:51.131 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T21:06:00.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:00.033 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:11.132 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:06:11.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd71c5a640 1 Processor -- start 2023-11-28T21:06:11.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd71c5a640 1 -- start start 2023-11-28T21:06:11.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd71c5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd6c0cb770 0x7fbd6c15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:11.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd71c5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c15ac00 con 0x7fbd6c0cf860 2023-11-28T21:06:11.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd71c5a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c0cbd60 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd71c5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c159ff0 con 0x7fbd6c0cb770 2023-11-28T21:06:11.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd6bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbd6c0cb770 0x7fbd6c15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:11.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd6b7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbd6c0cf860 0x7fbd6c0ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:55672/0 (socket says 172.21.15.167:55672) 2023-11-28T21:06:11.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd6b7fe640 1 -- 172.21.15.167:0/377591764 learned_addr learned my addr 172.21.15.167:0/377591764 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:11.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd6bfff640 1 -- 172.21.15.167:0/377591764 >> v1:172.21.15.178:6789/0 conn(0x7fbd6c0cfc40 legacy=0x7fbd6c153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:11.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd6bfff640 1 -- 172.21.15.167:0/377591764 >> v1:172.21.15.167:6789/0 conn(0x7fbd6c0cf860 legacy=0x7fbd6c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:11.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.240+0000 7fbd6bfff640 1 -- 172.21.15.167:0/377591764 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c15a2d0 con 0x7fbd6c0cb770 2023-11-28T21:06:11.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd6bfff640 1 --2- 172.21.15.167:0/377591764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cb770 0x7fbd6c15d4d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbd640097c0 tx=0x7fbd6401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8953c32b8f550dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:11.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd6a7fc640 1 -- 172.21.15.167:0/377591764 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd640ab610 con 0x7fbd6c0cb770 2023-11-28T21:06:11.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd6a7fc640 1 -- 172.21.15.167:0/377591764 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd640ab770 con 0x7fbd6c0cb770 2023-11-28T21:06:11.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd6a7fc640 1 -- 172.21.15.167:0/377591764 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd640abb00 con 0x7fbd6c0cb770 2023-11-28T21:06:11.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 -- 172.21.15.167:0/377591764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cb770 msgr2=0x7fbd6c15d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:11.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 --2- 172.21.15.167:0/377591764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cb770 0x7fbd6c15d4d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbd640097c0 tx=0x7fbd6401c410 comp rx=0 tx=0).stop 2023-11-28T21:06:11.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 -- 172.21.15.167:0/377591764 shutdown_connections 2023-11-28T21:06:11.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 --2- 172.21.15.167:0/377591764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cb770 0x7fbd6c15d4d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:11.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 -- 172.21.15.167:0/377591764 >> 172.21.15.167:0/377591764 conn(0x7fbd6c06c1f0 msgr2=0x7fbd6c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:11.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 -- 172.21.15.167:0/377591764 shutdown_connections 2023-11-28T21:06:11.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 -- 172.21.15.167:0/377591764 wait complete. 2023-11-28T21:06:11.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 Processor -- start 2023-11-28T21:06:11.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 -- start start 2023-11-28T21:06:11.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c0cb770 0x7fbd6c1479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:11.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6c0cf860 0x7fbd6c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:11.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cfc40 0x7fbd6c1f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:11.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c148b50 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c149180 con 0x7fbd6c0cb770 2023-11-28T21:06:11.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd71c5a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c149460 con 0x7fbd6c0cf860 2023-11-28T21:06:11.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd6bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cfc40 0x7fbd6c1f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:11.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd6bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cfc40 0x7fbd6c1f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:54020/0 (socket says 172.21.15.167:54020) 2023-11-28T21:06:11.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.244+0000 7fbd6bfff640 1 -- 172.21.15.167:0/1588720499 learned_addr learned my addr 172.21.15.167:0/1588720499 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:11.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6b7fe640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c0cb770 0x7fbd6c1479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:11.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6affd640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6c0cf860 0x7fbd6c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:11.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6bfff640 1 -- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6c0cf860 msgr2=0x7fbd6c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:11.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6bfff640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6c0cf860 0x7fbd6c0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:11.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6bfff640 1 -- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c0cb770 msgr2=0x7fbd6c1479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:11.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6bfff640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c0cb770 0x7fbd6c1479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:11.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6bfff640 1 -- 172.21.15.167:0/1588720499 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd64009420 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6b7fe640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c0cb770 0x7fbd6c1479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:06:11.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6affd640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6c0cf860 0x7fbd6c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:06:11.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6bfff640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cfc40 0x7fbd6c1f4030 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbd640ad040 tx=0x7fbd6401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:11.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd53fff640 1 -- 172.21.15.167:0/1588720499 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd640b5810 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd53fff640 1 -- 172.21.15.167:0/1588720499 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd640b5970 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c149980 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd53fff640 1 -- 172.21.15.167:0/1588720499 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd640b5d00 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c147f00 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c067c40 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd53fff640 1 -- 172.21.15.167:0/1588720499 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd640bf410 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd53fff640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd580664a0 0x7fbd58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:11.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd53fff640 1 -- 172.21.15.167:0/1588720499 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fbd6411f1a0 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.248+0000 7fbd6b7fe640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd580664a0 0x7fbd58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:11.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.252+0000 7fbd6b7fe640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd580664a0 0x7fbd58068960 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005c10 tx=0x7fbd5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:11.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.252+0000 7fbd53fff640 1 -- 172.21.15.167:0/1588720499 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd640ec350 con 0x7fbd6c0cfc40 2023-11-28T21:06:11.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.396+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd6c159cc0 con 0x7fbd580664a0 2023-11-28T21:06:11.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.424+0000 7fbd53fff640 1 -- 172.21.15.167:0/1588720499 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+375393 (secure 0 0 0) 0x7fbd5c00dc30 con 0x7fbd580664a0 2023-11-28T21:06:11.431 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:06:11.434 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T21:06:11.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd580664a0 msgr2=0x7fbd58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:11.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd580664a0 0x7fbd58068960 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c005c10 tx=0x7fbd5c009040 comp rx=0 tx=0).stop 2023-11-28T21:06:11.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cfc40 msgr2=0x7fbd6c1f4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:11.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cfc40 0x7fbd6c1f4030 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbd640ad040 tx=0x7fbd6401ac50 comp rx=0 tx=0).stop 2023-11-28T21:06:11.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 shutdown_connections 2023-11-28T21:06:11.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fbd580664a0 0x7fbd58068960 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:11.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd6c0cfc40 0x7fbd6c1f4030 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:11.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd6c0cf860 0x7fbd6c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:11.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 --2- 172.21.15.167:0/1588720499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c0cb770 0x7fbd6c1479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:11.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 >> 172.21.15.167:0/1588720499 conn(0x7fbd6c06c1f0 msgr2=0x7fbd6c0cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:11.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 shutdown_connections 2023-11-28T21:06:11.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:11.428+0000 7fbd71c5a640 1 -- 172.21.15.167:0/1588720499 wait complete. 2023-11-28T21:06:11.447 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":886,"stamp":"2023-11-28T21:06:10.142649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573738351,"num_objects":18293,"num_object_clones":8054,"num_object_copies":71918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18293,"num_whiteouts":7974,"num_read":2751,"num_read_kb":105055,"num_write":63161,"num_write_kb":1870913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2848462,"num_omap_keys":5441,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99120,"ondisk_log_size":99120,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4530408,"kb_used_data":3173160,"kb_used_omap":12,"kb_used_meta":1357171,"kb_avail":750444312,"statfs":{"total":773094113280,"available":768454975488,"internally_reserved":0,"allocated":3249315840,"data_stored":3246905922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1389743664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004599"},"pg_stats":[{"pgid":"2.1f","version":"51'568","reported_seq":633,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.187926+0000","last_change":"2023-11-28T21:05:32.187967+0000","last_active":"2023-11-28T21:05:32.187926+0000","last_peered":"2023-11-28T21:05:32.187926+0000","last_clean":"2023-11-28T21:05:32.187926+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T21:05:32.187926+0000","last_undegraded":"2023-11-28T21:05:32.187926+0000","last_fullsized":"2023-11-28T21:05:32.187926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'568","last_scrub_stamp":"2023-11-28T21:05:32.187849+0000","last_deep_scrub":"51'568","last_deep_scrub_stamp":"2023-11-28T21:05:32.187849+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.187849+0000","objects_scrubbed":22,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:57:58.029094+0000","scrub_duration":0.086821672000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":13,"num_write":501,"num_write_kb":29002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":102240,"num_omap_keys":193,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'428","reported_seq":2516,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:04.593318+0000","last_change":"2023-11-28T20:44:35.608330+0000","last_active":"2023-11-28T21:05:04.593318+0000","last_peered":"2023-11-28T21:05:04.593318+0000","last_clean":"2023-11-28T21:05:04.593318+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T21:05:04.593318+0000","last_undegraded":"2023-11-28T21:05:04.593318+0000","last_fullsized":"2023-11-28T21:05:04.593318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012127499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"51'1858","reported_seq":3729,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:06.768268+0000","last_change":"2023-11-28T21:06:06.768298+0000","last_active":"2023-11-28T21:06:06.768268+0000","last_peered":"2023-11-28T21:06:06.768268+0000","last_clean":"2023-11-28T21:06:06.768268+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T21:06:06.768268+0000","last_undegraded":"2023-11-28T21:06:06.768268+0000","last_fullsized":"2023-11-28T21:06:06.768268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1858","last_scrub_stamp":"2023-11-28T21:06:06.768177+0000","last_deep_scrub":"51'1858","last_deep_scrub_stamp":"2023-11-28T21:06:06.768177+0000","last_clean_scrub_stamp":"2023-11-28T21:06:06.768177+0000","objects_scrubbed":556,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:26.026085+0000","scrub_duration":0.27094379299999999,"objects_trimmed":0,"snaptrim_duration":0.016916996,"stat_sum":{"num_bytes":12268315,"num_objects":556,"num_object_clones":279,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":239,"num_read":31,"num_read_kb":4126,"num_write":1561,"num_write_kb":24667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"51'629","reported_seq":694,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.376092+0000","last_change":"2023-11-28T21:05:42.376131+0000","last_active":"2023-11-28T21:05:42.376092+0000","last_peered":"2023-11-28T21:05:42.376092+0000","last_clean":"2023-11-28T21:05:42.376092+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T21:05:42.376092+0000","last_undegraded":"2023-11-28T21:05:42.376092+0000","last_fullsized":"2023-11-28T21:05:42.376092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'629","last_scrub_stamp":"2023-11-28T21:05:42.376020+0000","last_deep_scrub":"51'629","last_deep_scrub_stamp":"2023-11-28T21:05:42.376020+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.376020+0000","objects_scrubbed":18,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:29.854245+0000","scrub_duration":0.078645286999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":546,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35806,"num_omap_keys":68,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"51'383","reported_seq":2486,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:48.164466+0000","last_change":"2023-11-28T21:05:48.164491+0000","last_active":"2023-11-28T21:05:48.164466+0000","last_peered":"2023-11-28T21:05:48.164466+0000","last_clean":"2023-11-28T21:05:48.164466+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T21:05:48.164466+0000","last_undegraded":"2023-11-28T21:05:48.164466+0000","last_fullsized":"2023-11-28T21:05:48.164466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'383","last_scrub_stamp":"2023-11-28T21:05:48.164339+0000","last_deep_scrub":"51'383","last_deep_scrub_stamp":"2023-11-28T21:05:48.164339+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.164339+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:11.595753+0000","scrub_duration":0.0027454979999999999,"objects_trimmed":0,"snaptrim_duration":0.010031783000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"51'1843","reported_seq":3752,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.385576+0000","last_change":"2023-11-28T21:05:45.385624+0000","last_active":"2023-11-28T21:05:45.385576+0000","last_peered":"2023-11-28T21:05:45.385576+0000","last_clean":"2023-11-28T21:05:45.385576+0000","last_became_active":"2023-11-28T20:39:01.389891+0000","last_became_peered":"2023-11-28T20:39:01.389891+0000","last_unstale":"2023-11-28T21:05:45.385576+0000","last_undegraded":"2023-11-28T21:05:45.385576+0000","last_fullsized":"2023-11-28T21:05:45.385576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1843","last_scrub_stamp":"2023-11-28T21:05:45.385425+0000","last_deep_scrub":"51'1843","last_deep_scrub_stamp":"2023-11-28T21:05:45.385425+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.385425+0000","objects_scrubbed":578,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:28.388874+0000","scrub_duration":0.43209253600000003,"objects_trimmed":0,"snaptrim_duration":0.0084388650000000003,"stat_sum":{"num_bytes":22024896,"num_objects":578,"num_object_clones":267,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":267,"num_read":47,"num_read_kb":8236,"num_write":1555,"num_write_kb":33440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"51'602","reported_seq":664,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.520765+0000","last_change":"2023-11-28T21:05:45.520765+0000","last_active":"2023-11-28T21:05:45.520765+0000","last_peered":"2023-11-28T21:05:45.520765+0000","last_clean":"2023-11-28T21:05:45.520765+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T21:05:45.520765+0000","last_undegraded":"2023-11-28T21:05:45.520765+0000","last_fullsized":"2023-11-28T21:05:45.520765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'602","last_scrub_stamp":"2023-11-28T21:05:45.520500+0000","last_deep_scrub":"51'602","last_deep_scrub_stamp":"2023-11-28T21:05:45.520500+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.520500+0000","objects_scrubbed":23,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:53.505086+0000","scrub_duration":0.106955033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66384,"num_omap_keys":125,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"51'396","reported_seq":2497,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.204063+0000","last_change":"2023-11-28T21:06:01.204087+0000","last_active":"2023-11-28T21:06:01.204063+0000","last_peered":"2023-11-28T21:06:01.204063+0000","last_clean":"2023-11-28T21:06:01.204063+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T21:06:01.204063+0000","last_undegraded":"2023-11-28T21:06:01.204063+0000","last_fullsized":"2023-11-28T21:06:01.204063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'396","last_scrub_stamp":"2023-11-28T21:06:01.203924+0000","last_deep_scrub":"51'396","last_deep_scrub_stamp":"2023-11-28T21:06:01.203924+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.203924+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:35:35.838187+0000","scrub_duration":0.0020324029999999999,"objects_trimmed":0,"snaptrim_duration":0.016140509000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1696","reported_seq":3612,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:59.371803+0000","last_change":"2023-11-28T21:05:59.371925+0000","last_active":"2023-11-28T21:05:59.371803+0000","last_peered":"2023-11-28T21:05:59.371803+0000","last_clean":"2023-11-28T21:05:59.371803+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T21:05:59.371803+0000","last_undegraded":"2023-11-28T21:05:59.371803+0000","last_fullsized":"2023-11-28T21:05:59.371803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1696","last_scrub_stamp":"2023-11-28T21:05:59.371622+0000","last_deep_scrub":"51'1696","last_deep_scrub_stamp":"2023-11-28T21:05:59.371622+0000","last_clean_scrub_stamp":"2023-11-28T21:05:59.371622+0000","objects_scrubbed":514,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:52.871982+0000","scrub_duration":0.38753573200000002,"objects_trimmed":0,"snaptrim_duration":0.0093789649999999995,"stat_sum":{"num_bytes":11818887,"num_objects":514,"num_object_clones":236,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":236,"num_read":34,"num_read_kb":34,"num_write":1442,"num_write_kb":18567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"51'415","reported_seq":478,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:36.552278+0000","last_change":"2023-11-28T21:05:36.552278+0000","last_active":"2023-11-28T21:05:36.552278+0000","last_peered":"2023-11-28T21:05:36.552278+0000","last_clean":"2023-11-28T21:05:36.552278+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T21:05:36.552278+0000","last_undegraded":"2023-11-28T21:05:36.552278+0000","last_fullsized":"2023-11-28T21:05:36.552278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:36.552022+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:36.552022+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.552022+0000","objects_scrubbed":11,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:51.358100+0000","scrub_duration":0.050659634000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":354,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":50644,"num_omap_keys":93,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"51'394","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.100707+0000","last_change":"2023-11-28T21:05:34.100707+0000","last_active":"2023-11-28T21:05:34.100707+0000","last_peered":"2023-11-28T21:05:34.100707+0000","last_clean":"2023-11-28T21:05:34.100707+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T21:05:34.100707+0000","last_undegraded":"2023-11-28T21:05:34.100707+0000","last_fullsized":"2023-11-28T21:05:34.100707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:34.100435+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:34.100435+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.100435+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:40.322315+0000","scrub_duration":0.0040552970000000002,"objects_trimmed":0,"snaptrim_duration":0.019881585,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"51'1748","reported_seq":3646,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.363166+0000","last_change":"2023-11-28T21:06:01.363192+0000","last_active":"2023-11-28T21:06:01.363166+0000","last_peered":"2023-11-28T21:06:01.363166+0000","last_clean":"2023-11-28T21:06:01.363166+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T21:06:01.363166+0000","last_undegraded":"2023-11-28T21:06:01.363166+0000","last_fullsized":"2023-11-28T21:06:01.363166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1748","last_scrub_stamp":"2023-11-28T21:06:01.363087+0000","last_deep_scrub":"51'1748","last_deep_scrub_stamp":"2023-11-28T21:06:01.363087+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.363087+0000","objects_scrubbed":571,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:41:33.947041+0000","scrub_duration":0.36192317400000001,"objects_trimmed":0,"snaptrim_duration":0.0092901790000000008,"stat_sum":{"num_bytes":16892767,"num_objects":571,"num_object_clones":263,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":571,"num_whiteouts":263,"num_read":40,"num_read_kb":48,"num_write":1465,"num_write_kb":20221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"51'418","reported_seq":2520,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:49.175103+0000","last_change":"2023-11-28T21:05:49.175162+0000","last_active":"2023-11-28T21:05:49.175103+0000","last_peered":"2023-11-28T21:05:49.175103+0000","last_clean":"2023-11-28T21:05:49.175103+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T21:05:49.175103+0000","last_undegraded":"2023-11-28T21:05:49.175103+0000","last_fullsized":"2023-11-28T21:05:49.175103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:05:49.174902+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:05:49.174902+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.174902+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:12.677483+0000","scrub_duration":0.0035801940000000001,"objects_trimmed":0,"snaptrim_duration":0.017860755999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"51'359","reported_seq":423,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:43.550683+0000","last_change":"2023-11-28T21:05:43.550784+0000","last_active":"2023-11-28T21:05:43.550683+0000","last_peered":"2023-11-28T21:05:43.550683+0000","last_clean":"2023-11-28T21:05:43.550683+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T21:05:43.550683+0000","last_undegraded":"2023-11-28T21:05:43.550683+0000","last_fullsized":"2023-11-28T21:05:43.550683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'359","last_scrub_stamp":"2023-11-28T21:05:43.550489+0000","last_deep_scrub":"51'359","last_deep_scrub_stamp":"2023-11-28T21:05:43.550489+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.550489+0000","objects_scrubbed":23,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:36:27.546980+0000","scrub_duration":0.113957661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":12,"num_write":274,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89762,"num_omap_keys":171,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"51'1713","reported_seq":3636,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.393733+0000","last_change":"2023-11-28T21:05:56.393797+0000","last_active":"2023-11-28T21:05:56.393733+0000","last_peered":"2023-11-28T21:05:56.393733+0000","last_clean":"2023-11-28T21:05:56.393733+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T21:05:56.393733+0000","last_undegraded":"2023-11-28T21:05:56.393733+0000","last_fullsized":"2023-11-28T21:05:56.393733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1713","last_scrub_stamp":"2023-11-28T21:05:56.393516+0000","last_deep_scrub":"51'1713","last_deep_scrub_stamp":"2023-11-28T21:05:56.393516+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.393516+0000","objects_scrubbed":519,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:14.037824+0000","scrub_duration":0.41489545799999999,"objects_trimmed":0,"snaptrim_duration":0.011349794999999999,"stat_sum":{"num_bytes":42075033,"num_objects":519,"num_object_clones":229,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":229,"num_read":33,"num_read_kb":8223,"num_write":1463,"num_write_kb":57658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"51'395","reported_seq":2497,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.289499+0000","last_change":"2023-11-28T21:05:32.289522+0000","last_active":"2023-11-28T21:05:32.289499+0000","last_peered":"2023-11-28T21:05:32.289499+0000","last_clean":"2023-11-28T21:05:32.289499+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T21:05:32.289499+0000","last_undegraded":"2023-11-28T21:05:32.289499+0000","last_fullsized":"2023-11-28T21:05:32.289499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'395","last_scrub_stamp":"2023-11-28T21:05:32.289412+0000","last_deep_scrub":"51'395","last_deep_scrub_stamp":"2023-11-28T21:05:32.289412+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.289412+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:10.715951+0000","scrub_duration":0.001674711,"objects_trimmed":0,"snaptrim_duration":0.018528307000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"51'488","reported_seq":552,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.677412+0000","last_change":"2023-11-28T21:05:46.677480+0000","last_active":"2023-11-28T21:05:46.677412+0000","last_peered":"2023-11-28T21:05:46.677412+0000","last_clean":"2023-11-28T21:05:46.677412+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T21:05:46.677412+0000","last_undegraded":"2023-11-28T21:05:46.677412+0000","last_fullsized":"2023-11-28T21:05:46.677412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'488","last_scrub_stamp":"2023-11-28T21:05:46.677285+0000","last_deep_scrub":"51'488","last_deep_scrub_stamp":"2023-11-28T21:05:46.677285+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.677285+0000","objects_scrubbed":20,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:36.686128+0000","scrub_duration":0.074223357000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":2,"num_read_kb":11,"num_write":693,"num_write_kb":25655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":97994,"num_omap_keys":459,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'1827","reported_seq":3741,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.338445+0000","last_change":"2023-11-28T21:05:41.338497+0000","last_active":"2023-11-28T21:05:41.338445+0000","last_peered":"2023-11-28T21:05:41.338445+0000","last_clean":"2023-11-28T21:05:41.338445+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T21:05:41.338445+0000","last_undegraded":"2023-11-28T21:05:41.338445+0000","last_fullsized":"2023-11-28T21:05:41.338445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1827","last_scrub_stamp":"2023-11-28T21:05:41.338279+0000","last_deep_scrub":"51'1827","last_deep_scrub_stamp":"2023-11-28T21:05:41.338279+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.338279+0000","objects_scrubbed":549,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:26:57.473243+0000","scrub_duration":0.42601145800000001,"objects_trimmed":0,"snaptrim_duration":0.010051028,"stat_sum":{"num_bytes":36081004,"num_objects":549,"num_object_clones":242,"num_object_copies":2196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":242,"num_read":36,"num_read_kb":4131,"num_write":1572,"num_write_kb":47387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"51'429","reported_seq":2531,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.253871+0000","last_change":"2023-11-28T21:05:34.253896+0000","last_active":"2023-11-28T21:05:34.253871+0000","last_peered":"2023-11-28T21:05:34.253871+0000","last_clean":"2023-11-28T21:05:34.253871+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T21:05:34.253871+0000","last_undegraded":"2023-11-28T21:05:34.253871+0000","last_fullsized":"2023-11-28T21:05:34.253871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'429","last_scrub_stamp":"2023-11-28T21:05:34.253775+0000","last_deep_scrub":"51'429","last_deep_scrub_stamp":"2023-11-28T21:05:34.253775+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.253775+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:07.648795+0000","scrub_duration":0.00170806,"objects_trimmed":0,"snaptrim_duration":0.018799937999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"51'685","reported_seq":749,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.707762+0000","last_change":"2023-11-28T21:05:41.707798+0000","last_active":"2023-11-28T21:05:41.707762+0000","last_peered":"2023-11-28T21:05:41.707762+0000","last_clean":"2023-11-28T21:05:41.707762+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T21:05:41.707762+0000","last_undegraded":"2023-11-28T21:05:41.707762+0000","last_fullsized":"2023-11-28T21:05:41.707762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'685","last_scrub_stamp":"2023-11-28T21:05:41.707658+0000","last_deep_scrub":"51'685","last_deep_scrub_stamp":"2023-11-28T21:05:41.707658+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.707658+0000","objects_scrubbed":19,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:00:13.376241+0000","scrub_duration":0.055951230999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":627,"num_write_kb":16946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":109119,"num_omap_keys":206,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"51'1842","reported_seq":3708,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:27.417270+0000","last_change":"2023-11-28T20:44:35.608957+0000","last_active":"2023-11-28T21:05:27.417270+0000","last_peered":"2023-11-28T21:05:27.417270+0000","last_clean":"2023-11-28T21:05:27.417270+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T21:05:27.417270+0000","last_undegraded":"2023-11-28T21:05:27.417270+0000","last_fullsized":"2023-11-28T21:05:27.417270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011785257,"stat_sum":{"num_bytes":33810901,"num_objects":586,"num_object_clones":259,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":259,"num_read":37,"num_read_kb":8227,"num_write":1558,"num_write_kb":44779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"51'406","reported_seq":2508,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.948913+0000","last_change":"2023-11-28T21:05:34.948965+0000","last_active":"2023-11-28T21:05:34.948913+0000","last_peered":"2023-11-28T21:05:34.948913+0000","last_clean":"2023-11-28T21:05:34.948913+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T21:05:34.948913+0000","last_undegraded":"2023-11-28T21:05:34.948913+0000","last_fullsized":"2023-11-28T21:05:34.948913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'406","last_scrub_stamp":"2023-11-28T21:05:34.948705+0000","last_deep_scrub":"51'406","last_deep_scrub_stamp":"2023-11-28T21:05:34.948705+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.948705+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:53.319129+0000","scrub_duration":0.0033768689999999998,"objects_trimmed":0,"snaptrim_duration":0.011190047999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"51'504","reported_seq":568,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:37.522274+0000","last_change":"2023-11-28T21:05:37.522356+0000","last_active":"2023-11-28T21:05:37.522274+0000","last_peered":"2023-11-28T21:05:37.522274+0000","last_clean":"2023-11-28T21:05:37.522274+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T21:05:37.522274+0000","last_undegraded":"2023-11-28T21:05:37.522274+0000","last_fullsized":"2023-11-28T21:05:37.522274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'504","last_scrub_stamp":"2023-11-28T21:05:37.522080+0000","last_deep_scrub":"51'504","last_deep_scrub_stamp":"2023-11-28T21:05:37.522080+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.522080+0000","objects_scrubbed":19,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:21.382578+0000","scrub_duration":0.058407088000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2,"num_read_kb":18,"num_write":441,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":131856,"num_omap_keys":203,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"51'1805","reported_seq":3686,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:54.481088+0000","last_change":"2023-11-28T21:05:54.481128+0000","last_active":"2023-11-28T21:05:54.481088+0000","last_peered":"2023-11-28T21:05:54.481088+0000","last_clean":"2023-11-28T21:05:54.481088+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T21:05:54.481088+0000","last_undegraded":"2023-11-28T21:05:54.481088+0000","last_fullsized":"2023-11-28T21:05:54.481088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1805","last_scrub_stamp":"2023-11-28T21:05:54.480945+0000","last_deep_scrub":"51'1805","last_deep_scrub_stamp":"2023-11-28T21:05:54.480945+0000","last_clean_scrub_stamp":"2023-11-28T21:05:54.480945+0000","objects_scrubbed":568,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:25.439678+0000","scrub_duration":0.45725488600000003,"objects_trimmed":0,"snaptrim_duration":0.010413970999999999,"stat_sum":{"num_bytes":29462623,"num_objects":568,"num_object_clones":283,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":243,"num_read":43,"num_read_kb":8342,"num_write":1501,"num_write_kb":36747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"51'401","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:53.334896+0000","last_change":"2023-11-28T21:05:53.334942+0000","last_active":"2023-11-28T21:05:53.334896+0000","last_peered":"2023-11-28T21:05:53.334896+0000","last_clean":"2023-11-28T21:05:53.334896+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T21:05:53.334896+0000","last_undegraded":"2023-11-28T21:05:53.334896+0000","last_fullsized":"2023-11-28T21:05:53.334896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'401","last_scrub_stamp":"2023-11-28T21:05:53.334782+0000","last_deep_scrub":"51'401","last_deep_scrub_stamp":"2023-11-28T21:05:53.334782+0000","last_clean_scrub_stamp":"2023-11-28T21:05:53.334782+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.959693+0000","scrub_duration":0.0020351340000000001,"objects_trimmed":0,"snaptrim_duration":0.013760692,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"51'161","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.266455+0000","last_change":"2023-11-28T21:05:41.266548+0000","last_active":"2023-11-28T21:05:41.266455+0000","last_peered":"2023-11-28T21:05:41.266455+0000","last_clean":"2023-11-28T21:05:41.266455+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T21:05:41.266455+0000","last_undegraded":"2023-11-28T21:05:41.266455+0000","last_fullsized":"2023-11-28T21:05:41.266455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'161","last_scrub_stamp":"2023-11-28T21:05:41.266279+0000","last_deep_scrub":"51'161","last_deep_scrub_stamp":"2023-11-28T21:05:41.266279+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.266279+0000","objects_scrubbed":16,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:32.433096+0000","scrub_duration":0.045962063999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":6,"num_read_kb":32,"num_write":106,"num_write_kb":8401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":68354,"num_omap_keys":112,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"51'1903","reported_seq":3791,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.299634+0000","last_change":"2023-11-28T21:06:00.299659+0000","last_active":"2023-11-28T21:06:00.299634+0000","last_peered":"2023-11-28T21:06:00.299634+0000","last_clean":"2023-11-28T21:06:00.299634+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T21:06:00.299634+0000","last_undegraded":"2023-11-28T21:06:00.299634+0000","last_fullsized":"2023-11-28T21:06:00.299634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1903","last_scrub_stamp":"2023-11-28T21:06:00.299527+0000","last_deep_scrub":"51'1903","last_deep_scrub_stamp":"2023-11-28T21:06:00.299527+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.299527+0000","objects_scrubbed":591,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:59.660036+0000","scrub_duration":0.30872005899999999,"objects_trimmed":0,"snaptrim_duration":0.0092734619999999997,"stat_sum":{"num_bytes":42280101,"num_objects":591,"num_object_clones":269,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":269,"num_read":33,"num_read_kb":4128,"num_write":1621,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"51'381","reported_seq":2483,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:04.433785+0000","last_change":"2023-11-28T21:06:04.433823+0000","last_active":"2023-11-28T21:06:04.433785+0000","last_peered":"2023-11-28T21:06:04.433785+0000","last_clean":"2023-11-28T21:06:04.433785+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T21:06:04.433785+0000","last_undegraded":"2023-11-28T21:06:04.433785+0000","last_fullsized":"2023-11-28T21:06:04.433785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'381","last_scrub_stamp":"2023-11-28T21:06:04.433650+0000","last_deep_scrub":"51'381","last_deep_scrub_stamp":"2023-11-28T21:06:04.433650+0000","last_clean_scrub_stamp":"2023-11-28T21:06:04.433650+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:50.065403+0000","scrub_duration":0.0027321860000000002,"objects_trimmed":0,"snaptrim_duration":0.017915146,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"51'437","reported_seq":503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.760023+0000","last_change":"2023-11-28T21:05:42.760056+0000","last_active":"2023-11-28T21:05:42.760023+0000","last_peered":"2023-11-28T21:05:42.760023+0000","last_clean":"2023-11-28T21:05:42.760023+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T21:05:42.760023+0000","last_undegraded":"2023-11-28T21:05:42.760023+0000","last_fullsized":"2023-11-28T21:05:42.760023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'437","last_scrub_stamp":"2023-11-28T21:05:42.759951+0000","last_deep_scrub":"51'437","last_deep_scrub_stamp":"2023-11-28T21:05:42.759951+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.759951+0000","objects_scrubbed":17,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:05:37.013105+0000","scrub_duration":0.10748722099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12049925,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":6,"num_read_kb":23,"num_write":692,"num_write_kb":13743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99465,"num_omap_keys":200,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"51'1784","reported_seq":3674,"reported_epoch":51,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-28T21:06:09.591696+0000","last_change":"2023-11-28T21:06:09.446196+0000","last_active":"2023-11-28T21:06:09.591696+0000","last_peered":"2023-11-28T21:06:09.591696+0000","last_clean":"2023-11-28T21:06:09.591696+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T21:06:09.591696+0000","last_undegraded":"2023-11-28T21:06:09.591696+0000","last_fullsized":"2023-11-28T21:06:09.591696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":293,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016539027000000001,"stat_sum":{"num_bytes":21707636,"num_objects":558,"num_object_clones":259,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":558,"num_whiteouts":259,"num_read":41,"num_read_kb":41,"num_write":1502,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"51'425","reported_seq":2528,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:27.436717+0000","last_change":"2023-11-28T21:05:27.436717+0000","last_active":"2023-11-28T21:05:27.436717+0000","last_peered":"2023-11-28T21:05:27.436717+0000","last_clean":"2023-11-28T21:05:27.436717+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T21:05:27.436717+0000","last_undegraded":"2023-11-28T21:05:27.436717+0000","last_fullsized":"2023-11-28T21:05:27.436717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'425","last_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_deep_scrub":"51'425","last_deep_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_clean_scrub_stamp":"2023-11-28T21:05:27.436622+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:32.946946+0000","scrub_duration":0.001593002,"objects_trimmed":0,"snaptrim_duration":0.014316661,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'372","reported_seq":436,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:48.419007+0000","last_change":"2023-11-28T21:05:48.419105+0000","last_active":"2023-11-28T21:05:48.419007+0000","last_peered":"2023-11-28T21:05:48.419007+0000","last_clean":"2023-11-28T21:05:48.419007+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T21:05:48.419007+0000","last_undegraded":"2023-11-28T21:05:48.419007+0000","last_fullsized":"2023-11-28T21:05:48.419007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'372","last_scrub_stamp":"2023-11-28T21:05:48.418878+0000","last_deep_scrub":"51'372","last_deep_scrub_stamp":"2023-11-28T21:05:48.418878+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.418878+0000","objects_scrubbed":22,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:20.957815+0000","scrub_duration":0.077448291000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360150,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":28962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":127124,"num_omap_keys":243,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"51'1789","reported_seq":3686,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:02.738134+0000","last_change":"2023-11-28T21:06:02.738163+0000","last_active":"2023-11-28T21:06:02.738134+0000","last_peered":"2023-11-28T21:06:02.738134+0000","last_clean":"2023-11-28T21:06:02.738134+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T21:06:02.738134+0000","last_undegraded":"2023-11-28T21:06:02.738134+0000","last_fullsized":"2023-11-28T21:06:02.738134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1789","last_scrub_stamp":"2023-11-28T21:06:02.738026+0000","last_deep_scrub":"51'1789","last_deep_scrub_stamp":"2023-11-28T21:06:02.738026+0000","last_clean_scrub_stamp":"2023-11-28T21:06:02.738026+0000","objects_scrubbed":561,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:43.969615+0000","scrub_duration":0.34158208299999998,"objects_trimmed":0,"snaptrim_duration":0.014620091,"stat_sum":{"num_bytes":29165465,"num_objects":561,"num_object_clones":251,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":561,"num_whiteouts":251,"num_read":26,"num_read_kb":26,"num_write":1521,"num_write_kb":34762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"51'414","reported_seq":2517,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:05.352963+0000","last_change":"2023-11-28T21:06:05.353017+0000","last_active":"2023-11-28T21:06:05.352963+0000","last_peered":"2023-11-28T21:06:05.352963+0000","last_clean":"2023-11-28T21:06:05.352963+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T21:06:05.352963+0000","last_undegraded":"2023-11-28T21:06:05.352963+0000","last_fullsized":"2023-11-28T21:06:05.352963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'414","last_scrub_stamp":"2023-11-28T21:06:05.352767+0000","last_deep_scrub":"51'414","last_deep_scrub_stamp":"2023-11-28T21:06:05.352767+0000","last_clean_scrub_stamp":"2023-11-28T21:06:05.352767+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:55:54.182673+0000","scrub_duration":0.003418333,"objects_trimmed":0,"snaptrim_duration":0.025775551000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"51'276","reported_seq":340,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:28.525091+0000","last_change":"2023-11-28T21:05:28.525091+0000","last_active":"2023-11-28T21:05:28.525091+0000","last_peered":"2023-11-28T21:05:28.525091+0000","last_clean":"2023-11-28T21:05:28.525091+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T21:05:28.525091+0000","last_undegraded":"2023-11-28T21:05:28.525091+0000","last_fullsized":"2023-11-28T21:05:28.525091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'276","last_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_deep_scrub":"51'276","last_deep_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_clean_scrub_stamp":"2023-11-28T21:05:28.524974+0000","objects_scrubbed":17,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:41:23.890866+0000","scrub_duration":0.056500518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":24764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84018,"num_omap_keys":160,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"51'1827","reported_seq":3720,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.938959+0000","last_change":"2023-11-28T21:06:00.938959+0000","last_active":"2023-11-28T21:06:00.938959+0000","last_peered":"2023-11-28T21:06:00.938959+0000","last_clean":"2023-11-28T21:06:00.938959+0000","last_became_active":"2023-11-28T20:39:01.570987+0000","last_became_peered":"2023-11-28T20:39:01.570987+0000","last_unstale":"2023-11-28T21:06:00.938959+0000","last_undegraded":"2023-11-28T21:06:00.938959+0000","last_fullsized":"2023-11-28T21:06:00.938959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1827","last_scrub_stamp":"2023-11-28T21:06:00.938820+0000","last_deep_scrub":"51'1827","last_deep_scrub_stamp":"2023-11-28T21:06:00.938820+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.938820+0000","objects_scrubbed":551,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:29.062000+0000","scrub_duration":0.35707936699999998,"objects_trimmed":0,"snaptrim_duration":0.0017641899999999999,"stat_sum":{"num_bytes":29603349,"num_objects":551,"num_object_clones":257,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":257,"num_read":32,"num_read_kb":32,"num_write":1550,"num_write_kb":37188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"51'420","reported_seq":2523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:37.005702+0000","last_change":"2023-11-28T21:05:37.005805+0000","last_active":"2023-11-28T21:05:37.005702+0000","last_peered":"2023-11-28T21:05:37.005702+0000","last_clean":"2023-11-28T21:05:37.005702+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T21:05:37.005702+0000","last_undegraded":"2023-11-28T21:05:37.005702+0000","last_fullsized":"2023-11-28T21:05:37.005702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'420","last_scrub_stamp":"2023-11-28T21:05:37.005456+0000","last_deep_scrub":"51'420","last_deep_scrub_stamp":"2023-11-28T21:05:37.005456+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.005456+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:00:05.751633+0000","scrub_duration":0.003608899,"objects_trimmed":0,"snaptrim_duration":0.010944188000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"51'437","reported_seq":502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.190136+0000","last_change":"2023-11-28T21:05:45.190222+0000","last_active":"2023-11-28T21:05:45.190136+0000","last_peered":"2023-11-28T21:05:45.190136+0000","last_clean":"2023-11-28T21:05:45.190136+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T21:05:45.190136+0000","last_undegraded":"2023-11-28T21:05:45.190136+0000","last_fullsized":"2023-11-28T21:05:45.190136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'437","last_scrub_stamp":"2023-11-28T21:05:45.189981+0000","last_deep_scrub":"51'437","last_deep_scrub_stamp":"2023-11-28T21:05:45.189981+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.189981+0000","objects_scrubbed":17,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:10:13.180761+0000","scrub_duration":0.065732793999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":379,"num_write_kb":16755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99502,"num_omap_keys":179,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"51'1754","reported_seq":3631,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:27.417319+0000","last_change":"2023-11-28T20:44:35.606459+0000","last_active":"2023-11-28T21:05:27.417319+0000","last_peered":"2023-11-28T21:05:27.417319+0000","last_clean":"2023-11-28T21:05:27.417319+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T21:05:27.417319+0000","last_undegraded":"2023-11-28T21:05:27.417319+0000","last_fullsized":"2023-11-28T21:05:27.417319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012892727999999999,"stat_sum":{"num_bytes":30726234,"num_objects":547,"num_object_clones":244,"num_object_copies":2188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":244,"num_read":30,"num_read_kb":7398,"num_write":1499,"num_write_kb":38104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'416","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:49.697188+0000","last_change":"2023-11-28T21:05:49.697230+0000","last_active":"2023-11-28T21:05:49.697188+0000","last_peered":"2023-11-28T21:05:49.697188+0000","last_clean":"2023-11-28T21:05:49.697188+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T21:05:49.697188+0000","last_undegraded":"2023-11-28T21:05:49.697188+0000","last_fullsized":"2023-11-28T21:05:49.697188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'416","last_scrub_stamp":"2023-11-28T21:05:49.697078+0000","last_deep_scrub":"51'416","last_deep_scrub_stamp":"2023-11-28T21:05:49.697078+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.697078+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:01.881093+0000","scrub_duration":0.001761695,"objects_trimmed":0,"snaptrim_duration":0.0088104640000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"51'927","reported_seq":1428,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.482036+0000","last_change":"2023-11-28T21:05:45.482078+0000","last_active":"2023-11-28T21:05:45.482036+0000","last_peered":"2023-11-28T21:05:45.482036+0000","last_clean":"2023-11-28T21:05:45.482036+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T21:05:45.482036+0000","last_undegraded":"2023-11-28T21:05:45.482036+0000","last_fullsized":"2023-11-28T21:05:45.482036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'927","last_scrub_stamp":"2023-11-28T21:05:45.481954+0000","last_deep_scrub":"51'927","last_deep_scrub_stamp":"2023-11-28T21:05:45.481954+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.481954+0000","objects_scrubbed":23,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:59.711334+0000","scrub_duration":0.067817884999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26750948,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":437,"num_read_kb":1190,"num_write":846,"num_write_kb":26790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106245,"num_omap_keys":198,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"51'1696","reported_seq":3564,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:29.588933+0000","last_change":"2023-11-28T20:44:35.609122+0000","last_active":"2023-11-28T21:04:29.588933+0000","last_peered":"2023-11-28T21:04:29.588933+0000","last_clean":"2023-11-28T21:04:29.588933+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T21:04:29.588933+0000","last_undegraded":"2023-11-28T21:04:29.588933+0000","last_fullsized":"2023-11-28T21:04:29.588933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011744523999999999,"stat_sum":{"num_bytes":4888539,"num_objects":545,"num_object_clones":249,"num_object_copies":2180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":249,"num_read":26,"num_read_kb":26,"num_write":1427,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'419","reported_seq":2522,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:47.163660+0000","last_change":"2023-11-28T21:05:47.163684+0000","last_active":"2023-11-28T21:05:47.163660+0000","last_peered":"2023-11-28T21:05:47.163660+0000","last_clean":"2023-11-28T21:05:47.163660+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T21:05:47.163660+0000","last_undegraded":"2023-11-28T21:05:47.163660+0000","last_fullsized":"2023-11-28T21:05:47.163660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'419","last_scrub_stamp":"2023-11-28T21:05:47.163561+0000","last_deep_scrub":"51'419","last_deep_scrub_stamp":"2023-11-28T21:05:47.163561+0000","last_clean_scrub_stamp":"2023-11-28T21:05:47.163561+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:21.174839+0000","scrub_duration":0.0032640490000000002,"objects_trimmed":0,"snaptrim_duration":0.013248289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"51'488","reported_seq":552,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.516156+0000","last_change":"2023-11-28T21:05:42.516251+0000","last_active":"2023-11-28T21:05:42.516156+0000","last_peered":"2023-11-28T21:05:42.516156+0000","last_clean":"2023-11-28T21:05:42.516156+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T21:05:42.516156+0000","last_undegraded":"2023-11-28T21:05:42.516156+0000","last_fullsized":"2023-11-28T21:05:42.516156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'488","last_scrub_stamp":"2023-11-28T21:05:42.515965+0000","last_deep_scrub":"51'488","last_deep_scrub_stamp":"2023-11-28T21:05:42.515965+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.515965+0000","objects_scrubbed":20,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:15.338394+0000","scrub_duration":0.076223933999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":59652,"num_omap_keys":113,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"51'1786","reported_seq":3702,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:07.753873+0000","last_change":"2023-11-28T21:06:07.753915+0000","last_active":"2023-11-28T21:06:07.753873+0000","last_peered":"2023-11-28T21:06:07.753873+0000","last_clean":"2023-11-28T21:06:07.753873+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T21:06:07.753873+0000","last_undegraded":"2023-11-28T21:06:07.753873+0000","last_fullsized":"2023-11-28T21:06:07.753873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1786","last_scrub_stamp":"2023-11-28T21:06:07.753763+0000","last_deep_scrub":"51'1786","last_deep_scrub_stamp":"2023-11-28T21:06:07.753763+0000","last_clean_scrub_stamp":"2023-11-28T21:06:07.753763+0000","objects_scrubbed":551,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:41.631390+0000","scrub_duration":0.27959615799999998,"objects_trimmed":0,"snaptrim_duration":0.013136992,"stat_sum":{"num_bytes":25033729,"num_objects":551,"num_object_clones":252,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":252,"num_read":47,"num_read_kb":4142,"num_write":1517,"num_write_kb":28607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'391","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.276195+0000","last_change":"2023-11-28T21:05:46.276216+0000","last_active":"2023-11-28T21:05:46.276195+0000","last_peered":"2023-11-28T21:05:46.276195+0000","last_clean":"2023-11-28T21:05:46.276195+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T21:05:46.276195+0000","last_undegraded":"2023-11-28T21:05:46.276195+0000","last_fullsized":"2023-11-28T21:05:46.276195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'391","last_scrub_stamp":"2023-11-28T21:05:46.276109+0000","last_deep_scrub":"51'391","last_deep_scrub_stamp":"2023-11-28T21:05:46.276109+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.276109+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:26:05.634209+0000","scrub_duration":0.0021140719999999998,"objects_trimmed":0,"snaptrim_duration":0.015322676,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'371","reported_seq":437,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:39.291951+0000","last_change":"2023-11-28T21:05:39.292032+0000","last_active":"2023-11-28T21:05:39.291951+0000","last_peered":"2023-11-28T21:05:39.291951+0000","last_clean":"2023-11-28T21:05:39.291951+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T21:05:39.291951+0000","last_undegraded":"2023-11-28T21:05:39.291951+0000","last_fullsized":"2023-11-28T21:05:39.291951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'371","last_scrub_stamp":"2023-11-28T21:05:39.291779+0000","last_deep_scrub":"51'371","last_deep_scrub_stamp":"2023-11-28T21:05:39.291779+0000","last_clean_scrub_stamp":"2023-11-28T21:05:39.291779+0000","objects_scrubbed":18,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:03.495198+0000","scrub_duration":0.051458515000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":20,"num_write":319,"num_write_kb":12656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":86488,"num_omap_keys":124,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"51'119","reported_seq":219,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.550562+0000","last_change":"2023-11-28T21:05:34.550643+0000","last_active":"2023-11-28T21:05:34.550562+0000","last_peered":"2023-11-28T21:05:34.550562+0000","last_clean":"2023-11-28T21:05:34.550562+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T21:05:34.550562+0000","last_undegraded":"2023-11-28T21:05:34.550562+0000","last_fullsized":"2023-11-28T21:05:34.550562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'119","last_scrub_stamp":"2023-11-28T21:05:34.550372+0000","last_deep_scrub":"51'119","last_deep_scrub_stamp":"2023-11-28T21:05:34.550372+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.550372+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:36.261369+0000","scrub_duration":0.0093084229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1795","reported_seq":3662,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:29.923602+0000","last_change":"2023-11-28T20:44:35.608577+0000","last_active":"2023-11-28T21:05:29.923602+0000","last_peered":"2023-11-28T21:05:29.923602+0000","last_clean":"2023-11-28T21:05:29.923602+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T21:05:29.923602+0000","last_undegraded":"2023-11-28T21:05:29.923602+0000","last_fullsized":"2023-11-28T21:05:29.923602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012304083,"stat_sum":{"num_bytes":50974055,"num_objects":563,"num_object_clones":255,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":255,"num_read":30,"num_read_kb":4125,"num_write":1519,"num_write_kb":57288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"51'375","reported_seq":2477,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:53.325876+0000","last_change":"2023-11-28T21:05:53.325977+0000","last_active":"2023-11-28T21:05:53.325876+0000","last_peered":"2023-11-28T21:05:53.325876+0000","last_clean":"2023-11-28T21:05:53.325876+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T21:05:53.325876+0000","last_undegraded":"2023-11-28T21:05:53.325876+0000","last_fullsized":"2023-11-28T21:05:53.325876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'375","last_scrub_stamp":"2023-11-28T21:05:53.325669+0000","last_deep_scrub":"51'375","last_deep_scrub_stamp":"2023-11-28T21:05:53.325669+0000","last_clean_scrub_stamp":"2023-11-28T21:05:53.325669+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:31:36.453431+0000","scrub_duration":0.0035168999999999999,"objects_trimmed":0,"snaptrim_duration":0.027789237000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"51'234","reported_seq":299,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:38.489258+0000","last_change":"2023-11-28T21:05:38.489305+0000","last_active":"2023-11-28T21:05:38.489258+0000","last_peered":"2023-11-28T21:05:38.489258+0000","last_clean":"2023-11-28T21:05:38.489258+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T21:05:38.489258+0000","last_undegraded":"2023-11-28T21:05:38.489258+0000","last_fullsized":"2023-11-28T21:05:38.489258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'234","last_scrub_stamp":"2023-11-28T21:05:38.489165+0000","last_deep_scrub":"51'234","last_deep_scrub_stamp":"2023-11-28T21:05:38.489165+0000","last_clean_scrub_stamp":"2023-11-28T21:05:38.489165+0000","objects_scrubbed":22,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:13.325917+0000","scrub_duration":0.055655635000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777798,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":15,"num_write":164,"num_write_kb":16643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":100904,"num_omap_keys":180,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"51'1783","reported_seq":3695,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.360473+0000","last_change":"2023-11-28T21:06:01.360509+0000","last_active":"2023-11-28T21:06:01.360473+0000","last_peered":"2023-11-28T21:06:01.360473+0000","last_clean":"2023-11-28T21:06:01.360473+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T21:06:01.360473+0000","last_undegraded":"2023-11-28T21:06:01.360473+0000","last_fullsized":"2023-11-28T21:06:01.360473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1783","last_scrub_stamp":"2023-11-28T21:06:01.360370+0000","last_deep_scrub":"51'1783","last_deep_scrub_stamp":"2023-11-28T21:06:01.360370+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.360370+0000","objects_scrubbed":536,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:39.318206+0000","scrub_duration":1.2571291090000001,"objects_trimmed":0,"snaptrim_duration":0.016877468,"stat_sum":{"num_bytes":24953790,"num_objects":536,"num_object_clones":250,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":250,"num_read":41,"num_read_kb":41,"num_write":1520,"num_write_kb":33586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"51'453","reported_seq":2555,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:52.212159+0000","last_change":"2023-11-28T21:05:52.212215+0000","last_active":"2023-11-28T21:05:52.212159+0000","last_peered":"2023-11-28T21:05:52.212159+0000","last_clean":"2023-11-28T21:05:52.212159+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T21:05:52.212159+0000","last_undegraded":"2023-11-28T21:05:52.212159+0000","last_fullsized":"2023-11-28T21:05:52.212159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'453","last_scrub_stamp":"2023-11-28T21:05:52.211875+0000","last_deep_scrub":"51'453","last_deep_scrub_stamp":"2023-11-28T21:05:52.211875+0000","last_clean_scrub_stamp":"2023-11-28T21:05:52.211875+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:44.912509+0000","scrub_duration":0.0042240020000000001,"objects_trimmed":0,"snaptrim_duration":0.020341659000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"51'411","reported_seq":475,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.581577+0000","last_change":"2023-11-28T21:05:34.581615+0000","last_active":"2023-11-28T21:05:34.581577+0000","last_peered":"2023-11-28T21:05:34.581577+0000","last_clean":"2023-11-28T21:05:34.581577+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T21:05:34.581577+0000","last_undegraded":"2023-11-28T21:05:34.581577+0000","last_fullsized":"2023-11-28T21:05:34.581577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:34.581495+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:34.581495+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.581495+0000","objects_scrubbed":18,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:15.488699+0000","scrub_duration":0.059633824000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777286,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":2,"num_read_kb":9,"num_write":342,"num_write_kb":16717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76134,"num_omap_keys":129,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"51'1767","reported_seq":3675,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:58.681644+0000","last_change":"2023-11-28T21:05:58.681668+0000","last_active":"2023-11-28T21:05:58.681644+0000","last_peered":"2023-11-28T21:05:58.681644+0000","last_clean":"2023-11-28T21:05:58.681644+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T21:05:58.681644+0000","last_undegraded":"2023-11-28T21:05:58.681644+0000","last_fullsized":"2023-11-28T21:05:58.681644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1767","last_scrub_stamp":"2023-11-28T21:05:58.681536+0000","last_deep_scrub":"51'1767","last_deep_scrub_stamp":"2023-11-28T21:05:58.681536+0000","last_clean_scrub_stamp":"2023-11-28T21:05:58.681536+0000","objects_scrubbed":542,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:52.399186+0000","scrub_duration":0.34306325599999998,"objects_trimmed":0,"snaptrim_duration":0.014814858,"stat_sum":{"num_bytes":20638408,"num_objects":542,"num_object_clones":251,"num_object_copies":2168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":251,"num_read":37,"num_read_kb":37,"num_write":1496,"num_write_kb":31881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"51'403","reported_seq":2497,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:25.604487+0000","last_change":"2023-11-28T20:44:35.640929+0000","last_active":"2023-11-28T21:05:25.604487+0000","last_peered":"2023-11-28T21:05:25.604487+0000","last_clean":"2023-11-28T21:05:25.604487+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T21:05:25.604487+0000","last_undegraded":"2023-11-28T21:05:25.604487+0000","last_fullsized":"2023-11-28T21:05:25.604487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017837387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"51'392","reported_seq":458,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:33.538157+0000","last_change":"2023-11-28T21:05:33.538219+0000","last_active":"2023-11-28T21:05:33.538157+0000","last_peered":"2023-11-28T21:05:33.538157+0000","last_clean":"2023-11-28T21:05:33.538157+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T21:05:33.538157+0000","last_undegraded":"2023-11-28T21:05:33.538157+0000","last_fullsized":"2023-11-28T21:05:33.538157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'392","last_scrub_stamp":"2023-11-28T21:05:33.538069+0000","last_deep_scrub":"51'392","last_deep_scrub_stamp":"2023-11-28T21:05:33.538069+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.538069+0000","objects_scrubbed":21,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:56.665928+0000","scrub_duration":0.051903592999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":22,"num_write":339,"num_write_kb":16887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":98369,"num_omap_keys":186,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"51'1847","reported_seq":3732,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:25.598211+0000","last_change":"2023-11-28T20:44:35.610893+0000","last_active":"2023-11-28T21:04:25.598211+0000","last_peered":"2023-11-28T21:04:25.598211+0000","last_clean":"2023-11-28T21:04:25.598211+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T21:04:25.598211+0000","last_undegraded":"2023-11-28T21:04:25.598211+0000","last_fullsized":"2023-11-28T21:04:25.598211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015179433000000001,"stat_sum":{"num_bytes":40252075,"num_objects":555,"num_object_clones":243,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":243,"num_read":37,"num_read_kb":1813,"num_write":1586,"num_write_kb":49527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"51'398","reported_seq":2500,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:59.226548+0000","last_change":"2023-11-28T21:05:59.226601+0000","last_active":"2023-11-28T21:05:59.226548+0000","last_peered":"2023-11-28T21:05:59.226548+0000","last_clean":"2023-11-28T21:05:59.226548+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T21:05:59.226548+0000","last_undegraded":"2023-11-28T21:05:59.226548+0000","last_fullsized":"2023-11-28T21:05:59.226548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'398","last_scrub_stamp":"2023-11-28T21:05:59.226364+0000","last_deep_scrub":"51'398","last_deep_scrub_stamp":"2023-11-28T21:05:59.226364+0000","last_clean_scrub_stamp":"2023-11-28T21:05:59.226364+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:38:10.027325+0000","scrub_duration":0.0033335109999999999,"objects_trimmed":0,"snaptrim_duration":0.018023955000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"51'418","reported_seq":481,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:30.052529+0000","last_change":"2023-11-28T21:05:30.052590+0000","last_active":"2023-11-28T21:05:30.052529+0000","last_peered":"2023-11-28T21:05:30.052529+0000","last_clean":"2023-11-28T21:05:30.052529+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T21:05:30.052529+0000","last_undegraded":"2023-11-28T21:05:30.052529+0000","last_fullsized":"2023-11-28T21:05:30.052529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:05:30.052426+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:05:30.052426+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.052426+0000","objects_scrubbed":18,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:50.919481+0000","scrub_duration":0.059053013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094443,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":19633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":68276,"num_omap_keys":142,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"51'1788","reported_seq":3689,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:48.411775+0000","last_change":"2023-11-28T21:05:48.411833+0000","last_active":"2023-11-28T21:05:48.411775+0000","last_peered":"2023-11-28T21:05:48.411775+0000","last_clean":"2023-11-28T21:05:48.411775+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T21:05:48.411775+0000","last_undegraded":"2023-11-28T21:05:48.411775+0000","last_fullsized":"2023-11-28T21:05:48.411775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1788","last_scrub_stamp":"2023-11-28T21:05:48.411642+0000","last_deep_scrub":"51'1788","last_deep_scrub_stamp":"2023-11-28T21:05:48.411642+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.411642+0000","objects_scrubbed":550,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:56.054395+0000","scrub_duration":0.44116404300000001,"objects_trimmed":0,"snaptrim_duration":0.0090848279999999997,"stat_sum":{"num_bytes":25858877,"num_objects":550,"num_object_clones":249,"num_object_copies":2200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":550,"num_whiteouts":249,"num_read":30,"num_read_kb":4125,"num_write":1526,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"51'442","reported_seq":2543,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:57.251939+0000","last_change":"2023-11-28T21:05:57.251995+0000","last_active":"2023-11-28T21:05:57.251939+0000","last_peered":"2023-11-28T21:05:57.251939+0000","last_clean":"2023-11-28T21:05:57.251939+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T21:05:57.251939+0000","last_undegraded":"2023-11-28T21:05:57.251939+0000","last_fullsized":"2023-11-28T21:05:57.251939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'442","last_scrub_stamp":"2023-11-28T21:05:57.251745+0000","last_deep_scrub":"51'442","last_deep_scrub_stamp":"2023-11-28T21:05:57.251745+0000","last_clean_scrub_stamp":"2023-11-28T21:05:57.251745+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:45.560688+0000","scrub_duration":0.0038352299999999998,"objects_trimmed":0,"snaptrim_duration":0.020570496000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"51'657","reported_seq":720,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.430216+0000","last_change":"2023-11-28T21:05:41.430262+0000","last_active":"2023-11-28T21:05:41.430216+0000","last_peered":"2023-11-28T21:05:41.430216+0000","last_clean":"2023-11-28T21:05:41.430216+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T21:05:41.430216+0000","last_undegraded":"2023-11-28T21:05:41.430216+0000","last_fullsized":"2023-11-28T21:05:41.430216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'657","last_scrub_stamp":"2023-11-28T21:05:41.430137+0000","last_deep_scrub":"51'657","last_deep_scrub_stamp":"2023-11-28T21:05:41.430137+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.430137+0000","objects_scrubbed":24,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:12:56.869809+0000","scrub_duration":0.042827776999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":7,"num_write":598,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":62330,"num_omap_keys":118,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"51'1723","reported_seq":3649,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:57.622174+0000","last_change":"2023-11-28T21:05:57.622219+0000","last_active":"2023-11-28T21:05:57.622174+0000","last_peered":"2023-11-28T21:05:57.622174+0000","last_clean":"2023-11-28T21:05:57.622174+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T21:05:57.622174+0000","last_undegraded":"2023-11-28T21:05:57.622174+0000","last_fullsized":"2023-11-28T21:05:57.622174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1723","last_scrub_stamp":"2023-11-28T21:05:57.622068+0000","last_deep_scrub":"51'1723","last_deep_scrub_stamp":"2023-11-28T21:05:57.622068+0000","last_clean_scrub_stamp":"2023-11-28T21:05:57.622068+0000","objects_scrubbed":524,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:16.174973+0000","scrub_duration":0.29220352900000002,"objects_trimmed":0,"snaptrim_duration":0.011806407999999999,"stat_sum":{"num_bytes":28712373,"num_objects":524,"num_object_clones":239,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":239,"num_read":46,"num_read_kb":46,"num_write":1462,"num_write_kb":31285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"51'407","reported_seq":2508,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:44.161556+0000","last_change":"2023-11-28T21:05:44.161668+0000","last_active":"2023-11-28T21:05:44.161556+0000","last_peered":"2023-11-28T21:05:44.161556+0000","last_clean":"2023-11-28T21:05:44.161556+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T21:05:44.161556+0000","last_undegraded":"2023-11-28T21:05:44.161556+0000","last_fullsized":"2023-11-28T21:05:44.161556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'407","last_scrub_stamp":"2023-11-28T21:05:44.161256+0000","last_deep_scrub":"51'407","last_deep_scrub_stamp":"2023-11-28T21:05:44.161256+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.161256+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:10.673180+0000","scrub_duration":0.0042608810000000002,"objects_trimmed":0,"snaptrim_duration":0.014629055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"51'473","reported_seq":535,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:33.374245+0000","last_change":"2023-11-28T21:05:33.374328+0000","last_active":"2023-11-28T21:05:33.374245+0000","last_peered":"2023-11-28T21:05:33.374245+0000","last_clean":"2023-11-28T21:05:33.374245+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T21:05:33.374245+0000","last_undegraded":"2023-11-28T21:05:33.374245+0000","last_fullsized":"2023-11-28T21:05:33.374245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'473","last_scrub_stamp":"2023-11-28T21:05:33.374073+0000","last_deep_scrub":"51'473","last_deep_scrub_stamp":"2023-11-28T21:05:33.374073+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.374073+0000","objects_scrubbed":15,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:57:31.084888+0000","scrub_duration":0.075804628999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":57473,"num_omap_keys":100,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"51'1831","reported_seq":3700,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:04.593566+0000","last_change":"2023-11-28T20:44:35.613708+0000","last_active":"2023-11-28T21:05:04.593566+0000","last_peered":"2023-11-28T21:05:04.593566+0000","last_clean":"2023-11-28T21:05:04.593566+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T21:05:04.593566+0000","last_undegraded":"2023-11-28T21:05:04.593566+0000","last_fullsized":"2023-11-28T21:05:04.593566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017596898999999999,"stat_sum":{"num_bytes":20840070,"num_objects":572,"num_object_clones":259,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":259,"num_read":39,"num_read_kb":4134,"num_write":1549,"num_write_kb":33741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"51'411","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:52.355685+0000","last_change":"2023-11-28T21:05:52.355786+0000","last_active":"2023-11-28T21:05:52.355685+0000","last_peered":"2023-11-28T21:05:52.355685+0000","last_clean":"2023-11-28T21:05:52.355685+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T21:05:52.355685+0000","last_undegraded":"2023-11-28T21:05:52.355685+0000","last_fullsized":"2023-11-28T21:05:52.355685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:52.355472+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:52.355472+0000","last_clean_scrub_stamp":"2023-11-28T21:05:52.355472+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:37.533653+0000","scrub_duration":0.003268642,"objects_trimmed":0,"snaptrim_duration":0.019240779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"51'299","reported_seq":362,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:43.228836+0000","last_change":"2023-11-28T21:05:43.228912+0000","last_active":"2023-11-28T21:05:43.228836+0000","last_peered":"2023-11-28T21:05:43.228836+0000","last_clean":"2023-11-28T21:05:43.228836+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T21:05:43.228836+0000","last_undegraded":"2023-11-28T21:05:43.228836+0000","last_fullsized":"2023-11-28T21:05:43.228836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'299","last_scrub_stamp":"2023-11-28T21:05:43.228655+0000","last_deep_scrub":"51'299","last_deep_scrub_stamp":"2023-11-28T21:05:43.228655+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.228655+0000","objects_scrubbed":15,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:39:18.023290+0000","scrub_duration":0.053656686000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":238,"num_write_kb":12572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73750,"num_omap_keys":139,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"51'1661","reported_seq":3549,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:11.621797+0000","last_change":"2023-11-28T20:44:35.616111+0000","last_active":"2023-11-28T21:04:11.621797+0000","last_peered":"2023-11-28T21:04:11.621797+0000","last_clean":"2023-11-28T21:04:11.621797+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T21:04:11.621797+0000","last_undegraded":"2023-11-28T21:04:11.621797+0000","last_fullsized":"2023-11-28T21:04:11.621797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018495173,"stat_sum":{"num_bytes":20919340,"num_objects":524,"num_object_clones":235,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":235,"num_read":33,"num_read_kb":33,"num_write":1415,"num_write_kb":40695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"51'413","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:30.161985+0000","last_change":"2023-11-28T21:05:30.162003+0000","last_active":"2023-11-28T21:05:30.161985+0000","last_peered":"2023-11-28T21:05:30.161985+0000","last_clean":"2023-11-28T21:05:30.161985+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T21:05:30.161985+0000","last_undegraded":"2023-11-28T21:05:30.161985+0000","last_fullsized":"2023-11-28T21:05:30.161985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'413","last_scrub_stamp":"2023-11-28T21:05:30.161904+0000","last_deep_scrub":"51'413","last_deep_scrub_stamp":"2023-11-28T21:05:30.161904+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.161904+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:00.574298+0000","scrub_duration":0.0026842540000000001,"objects_trimmed":0,"snaptrim_duration":0.014112118999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"51'422","reported_seq":484,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:31.170323+0000","last_change":"2023-11-28T21:05:31.170458+0000","last_active":"2023-11-28T21:05:31.170323+0000","last_peered":"2023-11-28T21:05:31.170323+0000","last_clean":"2023-11-28T21:05:31.170323+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T21:05:31.170323+0000","last_undegraded":"2023-11-28T21:05:31.170323+0000","last_fullsized":"2023-11-28T21:05:31.170323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'422","last_scrub_stamp":"2023-11-28T21:05:31.170251+0000","last_deep_scrub":"51'422","last_deep_scrub_stamp":"2023-11-28T21:05:31.170251+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.170251+0000","objects_scrubbed":17,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:48.673212+0000","scrub_duration":0.054918677999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":16779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":77628,"num_omap_keys":149,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"51'1691","reported_seq":3585,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:00.606435+0000","last_change":"2023-11-28T20:44:35.613305+0000","last_active":"2023-11-28T21:05:00.606435+0000","last_peered":"2023-11-28T21:05:00.606435+0000","last_clean":"2023-11-28T21:05:00.606435+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T21:05:00.606435+0000","last_undegraded":"2023-11-28T21:05:00.606435+0000","last_fullsized":"2023-11-28T21:05:00.606435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015550285,"stat_sum":{"num_bytes":33895761,"num_objects":515,"num_object_clones":224,"num_object_copies":2060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515,"num_whiteouts":224,"num_read":28,"num_read_kb":28,"num_write":1451,"num_write_kb":37503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"51'394","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:33.531106+0000","last_change":"2023-11-28T21:05:33.531160+0000","last_active":"2023-11-28T21:05:33.531106+0000","last_peered":"2023-11-28T21:05:33.531106+0000","last_clean":"2023-11-28T21:05:33.531106+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T21:05:33.531106+0000","last_undegraded":"2023-11-28T21:05:33.531106+0000","last_fullsized":"2023-11-28T21:05:33.531106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:33.530916+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:33.530916+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.530916+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:51.990509+0000","scrub_duration":0.00324325,"objects_trimmed":0,"snaptrim_duration":0.022690017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'585","reported_seq":647,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:36.348680+0000","last_change":"2023-11-28T21:05:36.348768+0000","last_active":"2023-11-28T21:05:36.348680+0000","last_peered":"2023-11-28T21:05:36.348680+0000","last_clean":"2023-11-28T21:05:36.348680+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T21:05:36.348680+0000","last_undegraded":"2023-11-28T21:05:36.348680+0000","last_fullsized":"2023-11-28T21:05:36.348680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'585","last_scrub_stamp":"2023-11-28T21:05:36.348472+0000","last_deep_scrub":"51'585","last_deep_scrub_stamp":"2023-11-28T21:05:36.348472+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.348472+0000","objects_scrubbed":19,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:44:00.211075+0000","scrub_duration":0.085323616000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":24942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82322,"num_omap_keys":142,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"51'1823","reported_seq":3724,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:04.982945+0000","last_change":"2023-11-28T21:06:04.982984+0000","last_active":"2023-11-28T21:06:04.982945+0000","last_peered":"2023-11-28T21:06:04.982945+0000","last_clean":"2023-11-28T21:06:04.982945+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T21:06:04.982945+0000","last_undegraded":"2023-11-28T21:06:04.982945+0000","last_fullsized":"2023-11-28T21:06:04.982945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1823","last_scrub_stamp":"2023-11-28T21:06:04.982842+0000","last_deep_scrub":"51'1823","last_deep_scrub_stamp":"2023-11-28T21:06:04.982842+0000","last_clean_scrub_stamp":"2023-11-28T21:06:04.982842+0000","objects_scrubbed":556,"log_size":1823,"log_dups_size":0,"ondisk_log_size":1823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:30:42.213272+0000","scrub_duration":0.30750132200000002,"objects_trimmed":0,"snaptrim_duration":0.013090108,"stat_sum":{"num_bytes":42607549,"num_objects":556,"num_object_clones":254,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":254,"num_read":36,"num_read_kb":4131,"num_write":1543,"num_write_kb":57518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"51'388","reported_seq":2474,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:49.590863+0000","last_change":"2023-11-28T20:44:35.530346+0000","last_active":"2023-11-28T21:04:49.590863+0000","last_peered":"2023-11-28T21:04:49.590863+0000","last_clean":"2023-11-28T21:04:49.590863+0000","last_became_active":"2023-11-28T20:39:01.848225+0000","last_became_peered":"2023-11-28T20:39:01.848225+0000","last_unstale":"2023-11-28T21:04:49.590863+0000","last_undegraded":"2023-11-28T21:04:49.590863+0000","last_fullsized":"2023-11-28T21:04:49.590863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019608149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'561","reported_seq":623,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:30.590008+0000","last_change":"2023-11-28T21:05:30.590054+0000","last_active":"2023-11-28T21:05:30.590008+0000","last_peered":"2023-11-28T21:05:30.590008+0000","last_clean":"2023-11-28T21:05:30.590008+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T21:05:30.590008+0000","last_undegraded":"2023-11-28T21:05:30.590008+0000","last_fullsized":"2023-11-28T21:05:30.590008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'561","last_scrub_stamp":"2023-11-28T21:05:30.589932+0000","last_deep_scrub":"51'561","last_deep_scrub_stamp":"2023-11-28T21:05:30.589932+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.589932+0000","objects_scrubbed":23,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:24:21.359666+0000","scrub_duration":0.070269200000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":21060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":120182,"num_omap_keys":228,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"51'1816","reported_seq":3738,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.324169+0000","last_change":"2023-11-28T21:05:42.324200+0000","last_active":"2023-11-28T21:05:42.324169+0000","last_peered":"2023-11-28T21:05:42.324169+0000","last_clean":"2023-11-28T21:05:42.324169+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T21:05:42.324169+0000","last_undegraded":"2023-11-28T21:05:42.324169+0000","last_fullsized":"2023-11-28T21:05:42.324169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1816","last_scrub_stamp":"2023-11-28T21:05:42.324029+0000","last_deep_scrub":"51'1816","last_deep_scrub_stamp":"2023-11-28T21:05:42.324029+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.324029+0000","objects_scrubbed":568,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:37.426481+0000","scrub_duration":0.39091050599999999,"objects_trimmed":0,"snaptrim_duration":0.010092998000000001,"stat_sum":{"num_bytes":33600436,"num_objects":568,"num_object_clones":254,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":254,"num_read":57,"num_read_kb":4152,"num_write":1538,"num_write_kb":45454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"51'410","reported_seq":2511,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:49.207502+0000","last_change":"2023-11-28T21:05:49.207521+0000","last_active":"2023-11-28T21:05:49.207502+0000","last_peered":"2023-11-28T21:05:49.207502+0000","last_clean":"2023-11-28T21:05:49.207502+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T21:05:49.207502+0000","last_undegraded":"2023-11-28T21:05:49.207502+0000","last_fullsized":"2023-11-28T21:05:49.207502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'410","last_scrub_stamp":"2023-11-28T21:05:49.207417+0000","last_deep_scrub":"51'410","last_deep_scrub_stamp":"2023-11-28T21:05:49.207417+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.207417+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:00.311308+0000","scrub_duration":0.002803495,"objects_trimmed":0,"snaptrim_duration":0.011744874000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"51'506","reported_seq":569,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:44.276724+0000","last_change":"2023-11-28T21:05:44.276812+0000","last_active":"2023-11-28T21:05:44.276724+0000","last_peered":"2023-11-28T21:05:44.276724+0000","last_clean":"2023-11-28T21:05:44.276724+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T21:05:44.276724+0000","last_undegraded":"2023-11-28T21:05:44.276724+0000","last_fullsized":"2023-11-28T21:05:44.276724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'506","last_scrub_stamp":"2023-11-28T21:05:44.276499+0000","last_deep_scrub":"51'506","last_deep_scrub_stamp":"2023-11-28T21:05:44.276499+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.276499+0000","objects_scrubbed":22,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:33.316636+0000","scrub_duration":0.12046440999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2,"num_read_kb":27,"num_write":437,"num_write_kb":33175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130075,"num_omap_keys":234,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"51'1777","reported_seq":3672,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:06.620729+0000","last_change":"2023-11-28T20:44:35.614798+0000","last_active":"2023-11-28T21:04:06.620729+0000","last_peered":"2023-11-28T21:04:06.620729+0000","last_clean":"2023-11-28T21:04:06.620729+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T21:04:06.620729+0000","last_undegraded":"2023-11-28T21:04:06.620729+0000","last_fullsized":"2023-11-28T21:04:06.620729+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018323326000000001,"stat_sum":{"num_bytes":24785841,"num_objects":525,"num_object_clones":238,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":238,"num_read":34,"num_read_kb":34,"num_write":1518,"num_write_kb":32579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"51'411","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.162096+0000","last_change":"2023-11-28T21:05:32.162153+0000","last_active":"2023-11-28T21:05:32.162096+0000","last_peered":"2023-11-28T21:05:32.162096+0000","last_clean":"2023-11-28T21:05:32.162096+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T21:05:32.162096+0000","last_undegraded":"2023-11-28T21:05:32.162096+0000","last_fullsized":"2023-11-28T21:05:32.162096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:32.161774+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:32.161774+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.161774+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:08.878532+0000","scrub_duration":0.0040654100000000002,"objects_trimmed":0,"snaptrim_duration":0.022293309000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"51'182","reported_seq":244,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:43.191960+0000","last_change":"2023-11-28T21:05:43.192141+0000","last_active":"2023-11-28T21:05:43.191960+0000","last_peered":"2023-11-28T21:05:43.191960+0000","last_clean":"2023-11-28T21:05:43.191960+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T21:05:43.191960+0000","last_undegraded":"2023-11-28T21:05:43.191960+0000","last_fullsized":"2023-11-28T21:05:43.191960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'182","last_scrub_stamp":"2023-11-28T21:05:43.191676+0000","last_deep_scrub":"51'182","last_deep_scrub_stamp":"2023-11-28T21:05:43.191676+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.191676+0000","objects_scrubbed":19,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:26.130737+0000","scrub_duration":0.043839175000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71130,"num_omap_keys":135,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"51'1914","reported_seq":3808,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:08.845393+0000","last_change":"2023-11-28T21:06:08.845464+0000","last_active":"2023-11-28T21:06:08.845393+0000","last_peered":"2023-11-28T21:06:08.845393+0000","last_clean":"2023-11-28T21:06:08.845393+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T21:06:08.845393+0000","last_undegraded":"2023-11-28T21:06:08.845393+0000","last_fullsized":"2023-11-28T21:06:08.845393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1914","last_scrub_stamp":"2023-11-28T21:06:08.845233+0000","last_deep_scrub":"51'1914","last_deep_scrub_stamp":"2023-11-28T21:06:08.845233+0000","last_clean_scrub_stamp":"2023-11-28T21:06:08.845233+0000","objects_scrubbed":583,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:20:09.557293+0000","scrub_duration":0.364030248,"objects_trimmed":0,"snaptrim_duration":0.016210088000000001,"stat_sum":{"num_bytes":26682582,"num_objects":583,"num_object_clones":263,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":583,"num_whiteouts":263,"num_read":39,"num_read_kb":8229,"num_write":1627,"num_write_kb":50263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"51'1808","reported_seq":3654,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:33.420994+0000","last_change":"2023-11-28T20:44:35.605377+0000","last_active":"2023-11-28T21:04:33.420994+0000","last_peered":"2023-11-28T21:04:33.420994+0000","last_clean":"2023-11-28T21:04:33.420994+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T21:04:33.420994+0000","last_undegraded":"2023-11-28T21:04:33.420994+0000","last_fullsized":"2023-11-28T21:04:33.420994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011090378999999999,"stat_sum":{"num_bytes":29341830,"num_objects":589,"num_object_clones":267,"num_object_copies":2356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":267,"num_read":21,"num_read_kb":21,"num_write":1524,"num_write_kb":32957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"51'411","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.649083+0000","last_change":"2023-11-28T21:06:00.649105+0000","last_active":"2023-11-28T21:06:00.649083+0000","last_peered":"2023-11-28T21:06:00.649083+0000","last_clean":"2023-11-28T21:06:00.649083+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T21:06:00.649083+0000","last_undegraded":"2023-11-28T21:06:00.649083+0000","last_fullsized":"2023-11-28T21:06:00.649083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:06:00.648992+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:06:00.648992+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.648992+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:44.955477+0000","scrub_duration":0.00140313,"objects_trimmed":0,"snaptrim_duration":0.0086681780000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"51'624","reported_seq":688,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:49.331733+0000","last_change":"2023-11-28T21:05:49.331811+0000","last_active":"2023-11-28T21:05:49.331733+0000","last_peered":"2023-11-28T21:05:49.331733+0000","last_clean":"2023-11-28T21:05:49.331733+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T21:05:49.331733+0000","last_undegraded":"2023-11-28T21:05:49.331733+0000","last_fullsized":"2023-11-28T21:05:49.331733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'624","last_scrub_stamp":"2023-11-28T21:05:49.331608+0000","last_deep_scrub":"51'624","last_deep_scrub_stamp":"2023-11-28T21:05:49.331608+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.331608+0000","objects_scrubbed":24,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:45:25.450650+0000","scrub_duration":0.152492033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":33,"num_write":550,"num_write_kb":45433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106123,"num_omap_keys":201,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"51'1738","reported_seq":3644,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.408174+0000","last_change":"2023-11-28T21:06:01.408217+0000","last_active":"2023-11-28T21:06:01.408174+0000","last_peered":"2023-11-28T21:06:01.408174+0000","last_clean":"2023-11-28T21:06:01.408174+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T21:06:01.408174+0000","last_undegraded":"2023-11-28T21:06:01.408174+0000","last_fullsized":"2023-11-28T21:06:01.408174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1738","last_scrub_stamp":"2023-11-28T21:06:01.408067+0000","last_deep_scrub":"51'1738","last_deep_scrub_stamp":"2023-11-28T21:06:01.408067+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.408067+0000","objects_scrubbed":555,"log_size":1738,"log_dups_size":0,"ondisk_log_size":1738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:34.270910+0000","scrub_duration":0.28393545399999998,"objects_trimmed":0,"snaptrim_duration":0.016829818,"stat_sum":{"num_bytes":16566795,"num_objects":555,"num_object_clones":248,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":248,"num_read":32,"num_read_kb":32,"num_write":1476,"num_write_kb":23281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"51'447","reported_seq":2548,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:54.403895+0000","last_change":"2023-11-28T21:05:54.403912+0000","last_active":"2023-11-28T21:05:54.403895+0000","last_peered":"2023-11-28T21:05:54.403895+0000","last_clean":"2023-11-28T21:05:54.403895+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T21:05:54.403895+0000","last_undegraded":"2023-11-28T21:05:54.403895+0000","last_fullsized":"2023-11-28T21:05:54.403895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'447","last_scrub_stamp":"2023-11-28T21:05:54.403818+0000","last_deep_scrub":"51'447","last_deep_scrub_stamp":"2023-11-28T21:05:54.403818+0000","last_clean_scrub_stamp":"2023-11-28T21:05:54.403818+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:54.550566+0000","scrub_duration":0.00144692,"objects_trimmed":0,"snaptrim_duration":0.018571445999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"51'779","reported_seq":1332,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:40.356204+0000","last_change":"2023-11-28T21:05:40.356317+0000","last_active":"2023-11-28T21:05:40.356204+0000","last_peered":"2023-11-28T21:05:40.356204+0000","last_clean":"2023-11-28T21:05:40.356204+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T21:05:40.356204+0000","last_undegraded":"2023-11-28T21:05:40.356204+0000","last_fullsized":"2023-11-28T21:05:40.356204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'779","last_scrub_stamp":"2023-11-28T21:05:40.356117+0000","last_deep_scrub":"51'779","last_deep_scrub_stamp":"2023-11-28T21:05:40.356117+0000","last_clean_scrub_stamp":"2023-11-28T21:05:40.356117+0000","objects_scrubbed":21,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:37.255476+0000","scrub_duration":0.062204162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18014655,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":492,"num_read_kb":1568,"num_write":714,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":112125,"num_omap_keys":180,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"51'1133","reported_seq":1696,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:35.448895+0000","last_change":"2023-11-28T21:05:35.448895+0000","last_active":"2023-11-28T21:05:35.448895+0000","last_peered":"2023-11-28T21:05:35.448895+0000","last_clean":"2023-11-28T21:05:35.448895+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T21:05:35.448895+0000","last_undegraded":"2023-11-28T21:05:35.448895+0000","last_fullsized":"2023-11-28T21:05:35.448895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1133","last_scrub_stamp":"2023-11-28T21:05:35.448625+0000","last_deep_scrub":"51'1133","last_deep_scrub_stamp":"2023-11-28T21:05:35.448625+0000","last_clean_scrub_stamp":"2023-11-28T21:05:35.448625+0000","objects_scrubbed":28,"log_size":1133,"log_dups_size":0,"ondisk_log_size":1133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:29.305578+0000","scrub_duration":0.13673348099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34584852,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":502,"num_read_kb":1393,"num_write":1050,"num_write_kb":34570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":116270,"num_omap_keys":186,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"51'366","reported_seq":2467,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.102549+0000","last_change":"2023-11-28T21:05:34.102549+0000","last_active":"2023-11-28T21:05:34.102549+0000","last_peered":"2023-11-28T21:05:34.102549+0000","last_clean":"2023-11-28T21:05:34.102549+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T21:05:34.102549+0000","last_undegraded":"2023-11-28T21:05:34.102549+0000","last_fullsized":"2023-11-28T21:05:34.102549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'366","last_scrub_stamp":"2023-11-28T21:05:34.102426+0000","last_deep_scrub":"51'366","last_deep_scrub_stamp":"2023-11-28T21:05:34.102426+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.102426+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:05.296824+0000","scrub_duration":0.0029151789999999999,"objects_trimmed":0,"snaptrim_duration":0.014791248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"51'1725","reported_seq":3626,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:59.882174+0000","last_change":"2023-11-28T21:05:59.882197+0000","last_active":"2023-11-28T21:05:59.882174+0000","last_peered":"2023-11-28T21:05:59.882174+0000","last_clean":"2023-11-28T21:05:59.882174+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T21:05:59.882174+0000","last_undegraded":"2023-11-28T21:05:59.882174+0000","last_fullsized":"2023-11-28T21:05:59.882174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1725","last_scrub_stamp":"2023-11-28T21:05:59.882081+0000","last_deep_scrub":"51'1725","last_deep_scrub_stamp":"2023-11-28T21:05:59.882081+0000","last_clean_scrub_stamp":"2023-11-28T21:05:59.882081+0000","objects_scrubbed":543,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:27:37.396820+0000","scrub_duration":0.28759110399999999,"objects_trimmed":0,"snaptrim_duration":0.0022000169999999999,"stat_sum":{"num_bytes":29986576,"num_objects":543,"num_object_clones":248,"num_object_copies":2172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":248,"num_read":29,"num_read_kb":29,"num_write":1454,"num_write_kb":38376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"51'379","reported_seq":441,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.311875+0000","last_change":"2023-11-28T21:05:41.311875+0000","last_active":"2023-11-28T21:05:41.311875+0000","last_peered":"2023-11-28T21:05:41.311875+0000","last_clean":"2023-11-28T21:05:41.311875+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T21:05:41.311875+0000","last_undegraded":"2023-11-28T21:05:41.311875+0000","last_fullsized":"2023-11-28T21:05:41.311875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'379","last_scrub_stamp":"2023-11-28T21:05:41.311729+0000","last_deep_scrub":"51'379","last_deep_scrub_stamp":"2023-11-28T21:05:41.311729+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.311729+0000","objects_scrubbed":14,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:36:23.970191+0000","scrub_duration":0.046276848000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":20723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80718,"num_omap_keys":145,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"51'401","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:30.976527+0000","last_change":"2023-11-28T21:05:30.976527+0000","last_active":"2023-11-28T21:05:30.976527+0000","last_peered":"2023-11-28T21:05:30.976527+0000","last_clean":"2023-11-28T21:05:30.976527+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T21:05:30.976527+0000","last_undegraded":"2023-11-28T21:05:30.976527+0000","last_fullsized":"2023-11-28T21:05:30.976527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'401","last_scrub_stamp":"2023-11-28T21:05:30.976211+0000","last_deep_scrub":"51'401","last_deep_scrub_stamp":"2023-11-28T21:05:30.976211+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.976211+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:05.312126+0000","scrub_duration":0.003806191,"objects_trimmed":0,"snaptrim_duration":0.010086065,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"51'1756","reported_seq":3650,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:28.299279+0000","last_change":"2023-11-28T20:44:35.611344+0000","last_active":"2023-11-28T21:05:28.299279+0000","last_peered":"2023-11-28T21:05:28.299279+0000","last_clean":"2023-11-28T21:05:28.299279+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T21:05:28.299279+0000","last_undegraded":"2023-11-28T21:05:28.299279+0000","last_fullsized":"2023-11-28T21:05:28.299279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015656369999999999,"stat_sum":{"num_bytes":33768985,"num_objects":521,"num_object_clones":238,"num_object_copies":2084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":238,"num_read":45,"num_read_kb":12330,"num_write":1499,"num_write_kb":48802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"51'415","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.157650+0000","last_change":"2023-11-28T21:05:46.157704+0000","last_active":"2023-11-28T21:05:46.157650+0000","last_peered":"2023-11-28T21:05:46.157650+0000","last_clean":"2023-11-28T21:05:46.157650+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T21:05:46.157650+0000","last_undegraded":"2023-11-28T21:05:46.157650+0000","last_fullsized":"2023-11-28T21:05:46.157650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:46.157455+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:46.157455+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.157455+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:01.464161+0000","scrub_duration":0.0035157970000000002,"objects_trimmed":0,"snaptrim_duration":0.013289166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"51'439","reported_seq":2542,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.580350+0000","last_change":"2023-11-28T21:05:56.580370+0000","last_active":"2023-11-28T21:05:56.580350+0000","last_peered":"2023-11-28T21:05:56.580350+0000","last_clean":"2023-11-28T21:05:56.580350+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T21:05:56.580350+0000","last_undegraded":"2023-11-28T21:05:56.580350+0000","last_fullsized":"2023-11-28T21:05:56.580350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'439","last_scrub_stamp":"2023-11-28T21:05:56.580265+0000","last_deep_scrub":"51'439","last_deep_scrub_stamp":"2023-11-28T21:05:56.580265+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.580265+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:47.658268+0000","scrub_duration":0.002380643,"objects_trimmed":0,"snaptrim_duration":0.0017225739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"51'438","reported_seq":2541,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:51.180792+0000","last_change":"2023-11-28T21:05:51.180845+0000","last_active":"2023-11-28T21:05:51.180792+0000","last_peered":"2023-11-28T21:05:51.180792+0000","last_clean":"2023-11-28T21:05:51.180792+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T21:05:51.180792+0000","last_undegraded":"2023-11-28T21:05:51.180792+0000","last_fullsized":"2023-11-28T21:05:51.180792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'438","last_scrub_stamp":"2023-11-28T21:05:51.180603+0000","last_deep_scrub":"51'438","last_deep_scrub_stamp":"2023-11-28T21:05:51.180603+0000","last_clean_scrub_stamp":"2023-11-28T21:05:51.180603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:28:01.061034+0000","scrub_duration":0.003385809,"objects_trimmed":0,"snaptrim_duration":0.018881576000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"51'384","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.256052+0000","last_change":"2023-11-28T21:05:50.256071+0000","last_active":"2023-11-28T21:05:50.256052+0000","last_peered":"2023-11-28T21:05:50.256052+0000","last_clean":"2023-11-28T21:05:50.256052+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T21:05:50.256052+0000","last_undegraded":"2023-11-28T21:05:50.256052+0000","last_fullsized":"2023-11-28T21:05:50.256052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'384","last_scrub_stamp":"2023-11-28T21:05:50.255966+0000","last_deep_scrub":"51'384","last_deep_scrub_stamp":"2023-11-28T21:05:50.255966+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.255966+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:17:07.873629+0000","scrub_duration":0.0014328069999999999,"objects_trimmed":0,"snaptrim_duration":0.014673739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"51'367","reported_seq":2469,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:37.282943+0000","last_change":"2023-11-28T21:05:37.282985+0000","last_active":"2023-11-28T21:05:37.282943+0000","last_peered":"2023-11-28T21:05:37.282943+0000","last_clean":"2023-11-28T21:05:37.282943+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T21:05:37.282943+0000","last_undegraded":"2023-11-28T21:05:37.282943+0000","last_fullsized":"2023-11-28T21:05:37.282943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'367","last_scrub_stamp":"2023-11-28T21:05:37.282834+0000","last_deep_scrub":"51'367","last_deep_scrub_stamp":"2023-11-28T21:05:37.282834+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.282834+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:54:01.725224+0000","scrub_duration":0.003284698,"objects_trimmed":0,"snaptrim_duration":0.017627927000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"51'417","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:02.642839+0000","last_change":"2023-11-28T21:06:02.642870+0000","last_active":"2023-11-28T21:06:02.642839+0000","last_peered":"2023-11-28T21:06:02.642839+0000","last_clean":"2023-11-28T21:06:02.642839+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T21:06:02.642839+0000","last_undegraded":"2023-11-28T21:06:02.642839+0000","last_fullsized":"2023-11-28T21:06:02.642839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:06:02.642763+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:06:02.642763+0000","last_clean_scrub_stamp":"2023-11-28T21:06:02.642763+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:58.776930+0000","scrub_duration":0.0015502129999999999,"objects_trimmed":0,"snaptrim_duration":0.0061577519999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"51'426","reported_seq":2528,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:57.197929+0000","last_change":"2023-11-28T21:05:57.197980+0000","last_active":"2023-11-28T21:05:57.197929+0000","last_peered":"2023-11-28T21:05:57.197929+0000","last_clean":"2023-11-28T21:05:57.197929+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T21:05:57.197929+0000","last_undegraded":"2023-11-28T21:05:57.197929+0000","last_fullsized":"2023-11-28T21:05:57.197929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'426","last_scrub_stamp":"2023-11-28T21:05:57.197730+0000","last_deep_scrub":"51'426","last_deep_scrub_stamp":"2023-11-28T21:05:57.197730+0000","last_clean_scrub_stamp":"2023-11-28T21:05:57.197730+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:58:18.112114+0000","scrub_duration":0.0043408559999999997,"objects_trimmed":0,"snaptrim_duration":0.017436297999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"51'394","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.388211+0000","last_change":"2023-11-28T21:05:50.388232+0000","last_active":"2023-11-28T21:05:50.388211+0000","last_peered":"2023-11-28T21:05:50.388211+0000","last_clean":"2023-11-28T21:05:50.388211+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T21:05:50.388211+0000","last_undegraded":"2023-11-28T21:05:50.388211+0000","last_fullsized":"2023-11-28T21:05:50.388211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:50.388128+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:50.388128+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.388128+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:19.796234+0000","scrub_duration":0.0025192349999999999,"objects_trimmed":0,"snaptrim_duration":0.018095488999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"51'421","reported_seq":2523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.239121+0000","last_change":"2023-11-28T21:05:56.239169+0000","last_active":"2023-11-28T21:05:56.239121+0000","last_peered":"2023-11-28T21:05:56.239121+0000","last_clean":"2023-11-28T21:05:56.239121+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T21:05:56.239121+0000","last_undegraded":"2023-11-28T21:05:56.239121+0000","last_fullsized":"2023-11-28T21:05:56.239121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'421","last_scrub_stamp":"2023-11-28T21:05:56.238950+0000","last_deep_scrub":"51'421","last_deep_scrub_stamp":"2023-11-28T21:05:56.238950+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.238950+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:40.811185+0000","scrub_duration":0.0031363070000000001,"objects_trimmed":0,"snaptrim_duration":0.014654275,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"51'411","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:31.244390+0000","last_change":"2023-11-28T21:05:31.244410+0000","last_active":"2023-11-28T21:05:31.244390+0000","last_peered":"2023-11-28T21:05:31.244390+0000","last_clean":"2023-11-28T21:05:31.244390+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T21:05:31.244390+0000","last_undegraded":"2023-11-28T21:05:31.244390+0000","last_fullsized":"2023-11-28T21:05:31.244390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:31.244317+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:31.244317+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.244317+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:48:02.680662+0000","scrub_duration":0.0027735979999999999,"objects_trimmed":0,"snaptrim_duration":0.017356489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"51'417","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.554519+0000","last_change":"2023-11-28T21:06:01.554567+0000","last_active":"2023-11-28T21:06:01.554519+0000","last_peered":"2023-11-28T21:06:01.554519+0000","last_clean":"2023-11-28T21:06:01.554519+0000","last_became_active":"2023-11-28T20:39:01.848167+0000","last_became_peered":"2023-11-28T20:39:01.848167+0000","last_unstale":"2023-11-28T21:06:01.554519+0000","last_undegraded":"2023-11-28T21:06:01.554519+0000","last_fullsized":"2023-11-28T21:06:01.554519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:06:01.554435+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:06:01.554435+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.554435+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:52.240195+0000","scrub_duration":0.0025598880000000002,"objects_trimmed":0,"snaptrim_duration":0.0020579169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"51'422","reported_seq":2524,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.031640+0000","last_change":"2023-11-28T21:05:42.031660+0000","last_active":"2023-11-28T21:05:42.031640+0000","last_peered":"2023-11-28T21:05:42.031640+0000","last_clean":"2023-11-28T21:05:42.031640+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T21:05:42.031640+0000","last_undegraded":"2023-11-28T21:05:42.031640+0000","last_fullsized":"2023-11-28T21:05:42.031640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'422","last_scrub_stamp":"2023-11-28T21:05:42.031561+0000","last_deep_scrub":"51'422","last_deep_scrub_stamp":"2023-11-28T21:05:42.031561+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.031561+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:36.205746+0000","scrub_duration":0.0024639100000000001,"objects_trimmed":0,"snaptrim_duration":0.014291543,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"51'396","reported_seq":2498,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:52.187432+0000","last_change":"2023-11-28T21:05:52.187484+0000","last_active":"2023-11-28T21:05:52.187432+0000","last_peered":"2023-11-28T21:05:52.187432+0000","last_clean":"2023-11-28T21:05:52.187432+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T21:05:52.187432+0000","last_undegraded":"2023-11-28T21:05:52.187432+0000","last_fullsized":"2023-11-28T21:05:52.187432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'396","last_scrub_stamp":"2023-11-28T21:05:52.187215+0000","last_deep_scrub":"51'396","last_deep_scrub_stamp":"2023-11-28T21:05:52.187215+0000","last_clean_scrub_stamp":"2023-11-28T21:05:52.187215+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:57:49.350881+0000","scrub_duration":0.0037497770000000001,"objects_trimmed":0,"snaptrim_duration":0.017003022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"51'403","reported_seq":2505,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:04.270326+0000","last_change":"2023-11-28T21:06:04.270382+0000","last_active":"2023-11-28T21:06:04.270326+0000","last_peered":"2023-11-28T21:06:04.270326+0000","last_clean":"2023-11-28T21:06:04.270326+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T21:06:04.270326+0000","last_undegraded":"2023-11-28T21:06:04.270326+0000","last_fullsized":"2023-11-28T21:06:04.270326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'403","last_scrub_stamp":"2023-11-28T21:06:04.270122+0000","last_deep_scrub":"51'403","last_deep_scrub_stamp":"2023-11-28T21:06:04.270122+0000","last_clean_scrub_stamp":"2023-11-28T21:06:04.270122+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:21.810163+0000","scrub_duration":0.0038017139999999999,"objects_trimmed":0,"snaptrim_duration":0.020849563000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"51'393","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.385033+0000","last_change":"2023-11-28T21:05:46.385054+0000","last_active":"2023-11-28T21:05:46.385033+0000","last_peered":"2023-11-28T21:05:46.385033+0000","last_clean":"2023-11-28T21:05:46.385033+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T21:05:46.385033+0000","last_undegraded":"2023-11-28T21:05:46.385033+0000","last_fullsized":"2023-11-28T21:05:46.385033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'393","last_scrub_stamp":"2023-11-28T21:05:46.384910+0000","last_deep_scrub":"51'393","last_deep_scrub_stamp":"2023-11-28T21:05:46.384910+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.384910+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:01.362037+0000","scrub_duration":0.002739965,"objects_trimmed":0,"snaptrim_duration":0.0019691359999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"51'430","reported_seq":2523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:23.178629+0000","last_change":"2023-11-28T20:44:35.617721+0000","last_active":"2023-11-28T21:04:23.178629+0000","last_peered":"2023-11-28T21:04:23.178629+0000","last_clean":"2023-11-28T21:04:23.178629+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T21:04:23.178629+0000","last_undegraded":"2023-11-28T21:04:23.178629+0000","last_fullsized":"2023-11-28T21:04:23.178629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019569492000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"51'421","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:28.559344+0000","last_change":"2023-11-28T20:44:35.612279+0000","last_active":"2023-11-28T21:04:28.559344+0000","last_peered":"2023-11-28T21:04:28.559344+0000","last_clean":"2023-11-28T21:04:28.559344+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T21:04:28.559344+0000","last_undegraded":"2023-11-28T21:04:28.559344+0000","last_fullsized":"2023-11-28T21:04:28.559344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015773832000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"51'435","reported_seq":2536,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.721745+0000","last_change":"2023-11-28T21:05:50.721764+0000","last_active":"2023-11-28T21:05:50.721745+0000","last_peered":"2023-11-28T21:05:50.721745+0000","last_clean":"2023-11-28T21:05:50.721745+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T21:05:50.721745+0000","last_undegraded":"2023-11-28T21:05:50.721745+0000","last_fullsized":"2023-11-28T21:05:50.721745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'435","last_scrub_stamp":"2023-11-28T21:05:50.721632+0000","last_deep_scrub":"51'435","last_deep_scrub_stamp":"2023-11-28T21:05:50.721632+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.721632+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:09.219521+0000","scrub_duration":0.0027464899999999999,"objects_trimmed":0,"snaptrim_duration":0.013692045,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"51'417","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:36.093153+0000","last_change":"2023-11-28T21:05:36.093176+0000","last_active":"2023-11-28T21:05:36.093153+0000","last_peered":"2023-11-28T21:05:36.093153+0000","last_clean":"2023-11-28T21:05:36.093153+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T21:05:36.093153+0000","last_undegraded":"2023-11-28T21:05:36.093153+0000","last_fullsized":"2023-11-28T21:05:36.093153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:05:36.093051+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:05:36.093051+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.093051+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:20:01.197729+0000","scrub_duration":0.0019047210000000001,"objects_trimmed":0,"snaptrim_duration":0.014004656000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"51'418","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.463934+0000","last_change":"2023-11-28T21:06:00.463978+0000","last_active":"2023-11-28T21:06:00.463934+0000","last_peered":"2023-11-28T21:06:00.463934+0000","last_clean":"2023-11-28T21:06:00.463934+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T21:06:00.463934+0000","last_undegraded":"2023-11-28T21:06:00.463934+0000","last_fullsized":"2023-11-28T21:06:00.463934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:06:00.463822+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:06:00.463822+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.463822+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:56.712408+0000","scrub_duration":0.0025889039999999999,"objects_trimmed":0,"snaptrim_duration":0.018246884000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"51'374","reported_seq":2475,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:38.970555+0000","last_change":"2023-11-28T21:05:38.970607+0000","last_active":"2023-11-28T21:05:38.970555+0000","last_peered":"2023-11-28T21:05:38.970555+0000","last_clean":"2023-11-28T21:05:38.970555+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T21:05:38.970555+0000","last_undegraded":"2023-11-28T21:05:38.970555+0000","last_fullsized":"2023-11-28T21:05:38.970555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'374","last_scrub_stamp":"2023-11-28T21:05:38.970355+0000","last_deep_scrub":"51'374","last_deep_scrub_stamp":"2023-11-28T21:05:38.970355+0000","last_clean_scrub_stamp":"2023-11-28T21:05:38.970355+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:16.855297+0000","scrub_duration":0.00371595,"objects_trimmed":0,"snaptrim_duration":0.010909501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"51'380","reported_seq":2481,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.191664+0000","last_change":"2023-11-28T21:05:56.191770+0000","last_active":"2023-11-28T21:05:56.191664+0000","last_peered":"2023-11-28T21:05:56.191664+0000","last_clean":"2023-11-28T21:05:56.191664+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T21:05:56.191664+0000","last_undegraded":"2023-11-28T21:05:56.191664+0000","last_fullsized":"2023-11-28T21:05:56.191664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'380","last_scrub_stamp":"2023-11-28T21:05:56.191432+0000","last_deep_scrub":"51'380","last_deep_scrub_stamp":"2023-11-28T21:05:56.191432+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.191432+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:00.175266+0000","scrub_duration":0.0041991600000000004,"objects_trimmed":0,"snaptrim_duration":0.014265125,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"51'385","reported_seq":2485,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:55.593046+0000","last_change":"2023-11-28T20:44:35.618555+0000","last_active":"2023-11-28T21:04:55.593046+0000","last_peered":"2023-11-28T21:04:55.593046+0000","last_clean":"2023-11-28T21:04:55.593046+0000","last_became_active":"2023-11-28T20:39:01.391291+0000","last_became_peered":"2023-11-28T20:39:01.391291+0000","last_unstale":"2023-11-28T21:04:55.593046+0000","last_undegraded":"2023-11-28T21:04:55.593046+0000","last_fullsized":"2023-11-28T21:04:55.593046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017078507999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"51'419","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:00.599208+0000","last_change":"2023-11-28T20:44:35.640277+0000","last_active":"2023-11-28T21:05:00.599208+0000","last_peered":"2023-11-28T21:05:00.599208+0000","last_clean":"2023-11-28T21:05:00.599208+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T21:05:00.599208+0000","last_undegraded":"2023-11-28T21:05:00.599208+0000","last_fullsized":"2023-11-28T21:05:00.599208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017711331,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"51'405","reported_seq":2506,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:44.232745+0000","last_change":"2023-11-28T21:05:44.232745+0000","last_active":"2023-11-28T21:05:44.232745+0000","last_peered":"2023-11-28T21:05:44.232745+0000","last_clean":"2023-11-28T21:05:44.232745+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T21:05:44.232745+0000","last_undegraded":"2023-11-28T21:05:44.232745+0000","last_fullsized":"2023-11-28T21:05:44.232745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'405","last_scrub_stamp":"2023-11-28T21:05:44.232593+0000","last_deep_scrub":"51'405","last_deep_scrub_stamp":"2023-11-28T21:05:44.232593+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.232593+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:38.822888+0000","scrub_duration":0.0029742990000000001,"objects_trimmed":0,"snaptrim_duration":0.017616142000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"51'400","reported_seq":2501,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:31.601994+0000","last_change":"2023-11-28T21:05:31.601994+0000","last_active":"2023-11-28T21:05:31.601994+0000","last_peered":"2023-11-28T21:05:31.601994+0000","last_clean":"2023-11-28T21:05:31.601994+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T21:05:31.601994+0000","last_undegraded":"2023-11-28T21:05:31.601994+0000","last_fullsized":"2023-11-28T21:05:31.601994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'400","last_scrub_stamp":"2023-11-28T21:05:31.601754+0000","last_deep_scrub":"51'400","last_deep_scrub_stamp":"2023-11-28T21:05:31.601754+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.601754+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:43.804359+0000","scrub_duration":0.003376469,"objects_trimmed":0,"snaptrim_duration":0.020312439000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"51'403","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:29.483551+0000","last_change":"2023-11-28T20:44:35.622789+0000","last_active":"2023-11-28T21:05:29.483551+0000","last_peered":"2023-11-28T21:05:29.483551+0000","last_clean":"2023-11-28T21:05:29.483551+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T21:05:29.483551+0000","last_undegraded":"2023-11-28T21:05:29.483551+0000","last_fullsized":"2023-11-28T21:05:29.483551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017449602000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"51'416","reported_seq":2517,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.349772+0000","last_change":"2023-11-28T21:05:50.349772+0000","last_active":"2023-11-28T21:05:50.349772+0000","last_peered":"2023-11-28T21:05:50.349772+0000","last_clean":"2023-11-28T21:05:50.349772+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T21:05:50.349772+0000","last_undegraded":"2023-11-28T21:05:50.349772+0000","last_fullsized":"2023-11-28T21:05:50.349772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'416","last_scrub_stamp":"2023-11-28T21:05:50.349526+0000","last_deep_scrub":"51'416","last_deep_scrub_stamp":"2023-11-28T21:05:50.349526+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.349526+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:01.261893+0000","scrub_duration":0.0031862489999999999,"objects_trimmed":0,"snaptrim_duration":0.018992159000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"51'397","reported_seq":2492,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:04:26.448632+0000","last_change":"2023-11-28T20:44:35.613038+0000","last_active":"2023-11-28T21:04:26.448632+0000","last_peered":"2023-11-28T21:04:26.448632+0000","last_clean":"2023-11-28T21:04:26.448632+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T21:04:26.448632+0000","last_undegraded":"2023-11-28T21:04:26.448632+0000","last_fullsized":"2023-11-28T21:04:26.448632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015371953000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"51'415","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.377454+0000","last_change":"2023-11-28T21:05:56.377471+0000","last_active":"2023-11-28T21:05:56.377454+0000","last_peered":"2023-11-28T21:05:56.377454+0000","last_clean":"2023-11-28T21:05:56.377454+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T21:05:56.377454+0000","last_undegraded":"2023-11-28T21:05:56.377454+0000","last_fullsized":"2023-11-28T21:05:56.377454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:56.377367+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:56.377367+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.377367+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:54.660446+0000","scrub_duration":0.001620766,"objects_trimmed":0,"snaptrim_duration":0.0098716120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"51'399","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:51.732331+0000","last_change":"2023-11-28T21:05:51.732352+0000","last_active":"2023-11-28T21:05:51.732331+0000","last_peered":"2023-11-28T21:05:51.732331+0000","last_clean":"2023-11-28T21:05:51.732331+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T21:05:51.732331+0000","last_undegraded":"2023-11-28T21:05:51.732331+0000","last_fullsized":"2023-11-28T21:05:51.732331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'399","last_scrub_stamp":"2023-11-28T21:05:51.732211+0000","last_deep_scrub":"51'399","last_deep_scrub_stamp":"2023-11-28T21:05:51.732211+0000","last_clean_scrub_stamp":"2023-11-28T21:05:51.732211+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:01.333629+0000","scrub_duration":0.001767425,"objects_trimmed":0,"snaptrim_duration":0.011275626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"51'410","reported_seq":2505,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:25.604452+0000","last_change":"2023-11-28T20:44:35.639151+0000","last_active":"2023-11-28T21:05:25.604452+0000","last_peered":"2023-11-28T21:05:25.604452+0000","last_clean":"2023-11-28T21:05:25.604452+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T21:05:25.604452+0000","last_undegraded":"2023-11-28T21:05:25.604452+0000","last_fullsized":"2023-11-28T21:05:25.604452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:18.500380+0000","last_clean_scrub_stamp":"2023-11-28T20:38:18.500380+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017369464000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":892224822,"num_objects":17666,"num_object_clones":8054,"num_object_copies":70664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17666,"num_whiteouts":7974,"num_read":1150,"num_read_kb":100500,"num_write":48457,"num_write_kb":1187847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1881309184,"data_stored":1881309184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57114,"ondisk_log_size":57114,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26113,"ondisk_log_size":26113,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":680923161,"num_objects":625,"num_object_clones":0,"num_object_copies":1250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":0,"num_read":1485,"num_read_kb":4455,"num_write":14545,"num_write_kb":680650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2848462,"num_omap_keys":5441,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1362001920,"data_stored":1361846322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15774,"ondisk_log_size":15774,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509780,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":650828,"kb_used_data":461380,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":93721012,"statfs":{"total":96636764160,"available":95970316288,"internally_reserved":0,"allocated":472453120,"data_stored":472148767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":193984967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":8.7539999999999996,"15min":3.2719999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.50600000000000001,"5min":873.04100000000005,"15min":873.04100000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.46500000000000002,"15min":0.51800000000000002},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24099999999999999},"max":{"1min":0.48899999999999999,"5min":0.872,"15min":6.5659999999999998},"last":0.27400000000000002}]},{"osd":1,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.53700000000000003,"15min":0.57499999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.54000000000000004,"5min":1.194,"15min":6.9370000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.503,"15min":0.53900000000000003},"min":{"1min":0.31900000000000001,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":0.54800000000000004,"5min":0.79700000000000004,"15min":3.6219999999999999},"last":0.307}]},{"osd":2,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.56799999999999995,"15min":0.60099999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52100000000000002,"5min":6.0309999999999997,"15min":6.8780000000000001},"last":0.378},{"interface":"front","average":{"1min":0.41599999999999998,"5min":8.2840000000000007,"15min":3.1880000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28299999999999997},"max":{"1min":0.56299999999999994,"5min":817.63900000000001,"15min":817.63900000000001},"last":0.28999999999999998}]},{"osd":4,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":51.350999999999999,"15min":17.934999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":3268.6419999999998,"15min":3268.6419999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":51.310000000000002,"15min":17.669},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":3232.7750000000001,"15min":3232.7750000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":46.462000000000003,"15min":16.082999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.42299999999999999},"max":{"1min":1.014,"5min":3259.5459999999998,"15min":3259.5459999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":8.0329999999999995,"15min":3.2509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93600000000000005,"5min":703.19299999999998,"15min":703.19299999999998},"last":0.79800000000000004}]},{"osd":6,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":9.8960000000000008,"15min":3.8969999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.92300000000000004,"5min":928.99199999999996,"15min":928.99199999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":10.500999999999999,"15min":4.1470000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89000000000000001,"5min":961.01800000000003,"15min":961.01800000000003},"last":0.77800000000000002}]},{"osd":7,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":9.6129999999999995,"15min":4.1260000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.44600000000000001},"max":{"1min":1.0820000000000001,"5min":872.827,"15min":872.827},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":9.0449999999999999,"15min":3.6110000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48899999999999999},"max":{"1min":0.83899999999999997,"5min":817.84400000000005,"15min":817.84400000000005},"last":0.81100000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509780,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424976,"kb_used_data":277192,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93946864,"statfs":{"total":96636764160,"available":96201588736,"internally_reserved":0,"allocated":283844608,"data_stored":283539830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":1.52,"15min":0.82199999999999995},"min":{"1min":0.22800000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.40200000000000002,"5min":64.087000000000003,"15min":64.087000000000003},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":1.6419999999999999,"15min":0.94999999999999996},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.25},"max":{"1min":0.58999999999999997,"5min":64.114999999999995,"15min":64.114999999999995},"last":0.47399999999999998}]},{"osd":1,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":1.6020000000000001,"15min":0.96199999999999997},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.498,"5min":64,"15min":64},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.6679999999999999,"15min":0.97499999999999998},"min":{"1min":0.37,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.62,"5min":64.028999999999996,"15min":64.028999999999996},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":29.27,"15min":10.208},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47799999999999998,"5min":2826.7199999999998,"15min":2826.7199999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":29.638999999999999,"15min":10.252000000000001},"min":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.307},"max":{"1min":0.59199999999999997,"5min":2838.0680000000002,"15min":2838.0680000000002},"last":0.5}]},{"osd":4,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":3.4169999999999998,"15min":1.712},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":149.43700000000001,"15min":149.43700000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73899999999999999,"5min":53.168999999999997,"15min":18.263999999999999},"min":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.38800000000000001},"max":{"1min":0.94499999999999995,"5min":3288.7310000000002,"15min":3288.7310000000002},"last":0.85099999999999998}]},{"osd":5,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":62.241999999999997,"15min":21.312000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.46000000000000002},"max":{"1min":0.81899999999999995,"5min":3314.4110000000001,"15min":3314.4110000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":42.167000000000002,"15min":14.640000000000001},"min":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.44900000000000001},"max":{"1min":0.85999999999999999,"5min":2139.3159999999998,"15min":2139.3159999999998},"last":0.75600000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":64.135000000000005,"15min":21.940000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.38700000000000001},"max":{"1min":0.93999999999999995,"5min":3288.7730000000001,"15min":3288.7730000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":51.640000000000001,"15min":17.850000000000001},"min":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.42699999999999999},"max":{"1min":0.99399999999999999,"5min":2837.9960000000001,"15min":2837.9960000000001},"last":0.91600000000000004}]},{"osd":7,"last update":"Tue Nov 28 21:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":30.893999999999998,"15min":10.855},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.46899999999999997},"max":{"1min":0.82099999999999995,"5min":2822.598,"15min":2822.598},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":47.838000000000001,"15min":16.495999999999999},"min":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.45400000000000001},"max":{"1min":0.92900000000000005,"5min":2150.9899999999998,"15min":2150.9899999999998},"last":0.79200000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509781,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660764,"kb_used_data":458836,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93711076,"statfs":{"total":96636764160,"available":95960141824,"internally_reserved":0,"allocated":469848064,"data_stored":469543023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.01,"5min":2.3849999999999998,"15min":1.1799999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":143.76300000000001,"5min":143.76300000000001,"15min":143.76300000000001},"last":0.317},{"interface":"front","average":{"1min":2.4769999999999999,"5min":0.92200000000000004,"15min":0.71799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":39.768000000000001,"5min":39.768000000000001,"15min":39.768000000000001},"last":0.23699999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":8.2780000000000005,"5min":2.0510000000000002,"15min":1.042},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.252},"max":{"1min":149.34299999999999,"5min":149.34299999999999,"15min":149.34299999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":6.5229999999999997},"last":0.29799999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":10.726000000000001,"5min":2.5840000000000001,"15min":1.2589999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26700000000000002},"max":{"1min":147.46899999999999,"5min":147.46899999999999,"15min":147.46899999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":3.6179999999999999,"5min":1.216,"15min":0.85499999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":59.305,"5min":59.305,"15min":59.305},"last":0.437}]},{"osd":4,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":20.18,"5min":4.649,"15min":2.1320000000000001},"min":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.40400000000000003},"max":{"1min":221.76900000000001,"5min":221.76900000000001,"15min":221.76900000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":63.805999999999997,"5min":13.407,"15min":5.4569999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.34300000000000003},"max":{"1min":1198.962,"5min":1198.962,"15min":1198.962},"last":0.60899999999999999}]},{"osd":5,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":31.141999999999999,"5min":6.9329999999999998,"15min":2.9169999999999998},"min":{"1min":0.60199999999999998,"5min":0.56299999999999994,"15min":0.42599999999999999},"max":{"1min":574.81700000000001,"5min":574.81700000000001,"15min":574.81700000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":2.9430000000000001,"5min":1.341,"15min":1.099},"min":{"1min":0.67800000000000005,"5min":0.63900000000000001,"15min":0.501},"max":{"1min":39.896999999999998,"5min":39.896999999999998,"15min":39.896999999999998},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Nov 28 21:05:10 2023","interfaces":[{"interface":"back","average":{"1min":63.299999999999997,"5min":13.385,"15min":5.0860000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.47099999999999997},"max":{"1min":1168.432,"5min":1168.432,"15min":1168.432},"last":0.51800000000000002},{"interface":"front","average":{"1min":2.9279999999999999,"5min":1.276,"15min":1.0389999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46000000000000002},"max":{"1min":39.863,"5min":39.863,"15min":39.863},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Nov 28 21:05:05 2023","interfaces":[{"interface":"back","average":{"1min":12.673,"5min":3.246,"15min":1.679},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.54000000000000004},"max":{"1min":143.89599999999999,"5min":143.89599999999999,"15min":143.89599999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":63.936,"5min":13.486000000000001,"15min":5.0670000000000002},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1198.933,"5min":1198.933,"15min":1198.933},"last":0.73899999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542483,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583596,"kb_used_data":417764,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":93788244,"statfs":{"total":96636764160,"available":96039161856,"internally_reserved":0,"allocated":427790336,"data_stored":427490226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":169802186},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":93.894999999999996,"15min":31.896999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.29699999999999999},"max":{"1min":1.2290000000000001,"5min":3136.5639999999999,"15min":3136.5639999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":55.112000000000002,"15min":18.943999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.36899999999999999},"max":{"1min":1.236,"5min":2779.4099999999999,"15min":2779.4099999999999},"last":0.93300000000000005}]},{"osd":1,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":94.733999999999995,"15min":32.204000000000001},"min":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.34499999999999997},"max":{"1min":1.0600000000000001,"5min":3167.6399999999999,"15min":3167.6399999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":100.066,"15min":33.939999999999998},"min":{"1min":0.625,"5min":0.56000000000000005,"15min":0.46400000000000002},"max":{"1min":1.113,"5min":4741.7640000000001,"15min":4741.7640000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":56.523000000000003,"15min":19.741},"min":{"1min":0.621,"5min":0.497,"15min":0.42899999999999999},"max":{"1min":1.3240000000000001,"5min":2301.0599999999999,"15min":2301.0599999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0049999999999999,"5min":100.627,"15min":34.234999999999999},"min":{"1min":0.69899999999999995,"5min":0.69299999999999995,"15min":0.42399999999999999},"max":{"1min":1.1890000000000001,"5min":4752.8689999999997,"15min":4752.8689999999997},"last":1.1240000000000001}]},{"osd":3,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":94.033000000000001,"15min":32.264000000000003},"min":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.44700000000000001},"max":{"1min":1.232,"5min":3147.2719999999999,"15min":3147.2719999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":60.307000000000002,"15min":20.715},"min":{"1min":0.60799999999999998,"5min":0.59899999999999998,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":2301.1370000000002,"15min":2301.1370000000002},"last":1.075}]},{"osd":4,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91800000000000004,"15min":1.276},"min":{"1min":0.66100000000000003,"5min":0.57499999999999996,"15min":0.38900000000000001},"max":{"1min":1.1160000000000001,"5min":1.266,"15min":71.313000000000002},"last":1.381},{"interface":"front","average":{"1min":1.046,"5min":0.95799999999999996,"15min":1.1870000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40000000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":34.881},"last":1.177}]},{"osd":5,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0840000000000001,"15min":1.2869999999999999},"min":{"1min":0.78000000000000003,"5min":0.69999999999999996,"15min":0.39700000000000002},"max":{"1min":1.4019999999999999,"5min":1.895,"15min":44.558},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1279999999999999,"15min":1.159},"min":{"1min":0.73399999999999999,"5min":0.64700000000000002,"15min":0.41399999999999998},"max":{"1min":1.49,"5min":1.956,"15min":3.782},"last":1.2130000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.998,"15min":1.1060000000000001},"min":{"1min":0.754,"5min":0.65800000000000003,"15min":0.44700000000000001},"max":{"1min":1.325,"5min":1.47,"15min":7.6769999999999996},"last":1.24},{"interface":"front","average":{"1min":1.22,"5min":1.1499999999999999,"15min":1.1639999999999999},"min":{"1min":0.96899999999999997,"5min":0.71499999999999997,"15min":0.38100000000000001},"max":{"1min":1.649,"5min":1.649,"15min":2.7949999999999999},"last":1.327}]}]},{"osd":6,"up_from":14,"seq":60129542484,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600852,"kb_used_data":439180,"kb_used_omap":1,"kb_used_meta":161662,"kb_avail":93770988,"statfs":{"total":96636764160,"available":96021491712,"internally_reserved":0,"allocated":449720320,"data_stored":449421964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165542342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":19.780999999999999,"15min":7.1459999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1919999999999999,"5min":1038.4960000000001,"15min":1038.4960000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":19.934999999999999,"15min":7.2640000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.33600000000000002},"max":{"1min":1.1739999999999999,"5min":1038.5619999999999,"15min":1038.5619999999999},"last":0.90600000000000003}]},{"osd":1,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":21.085000000000001,"15min":7.6150000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41399999999999998},"max":{"1min":0.98799999999999999,"5min":1046.3320000000001,"15min":1046.3320000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":14.5,"15min":5.4660000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98399999999999999,"5min":1087.7460000000001,"15min":1087.7460000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":19.806000000000001,"15min":7.1950000000000003},"min":{"1min":0.56399999999999995,"5min":0.503,"15min":0.47699999999999998},"max":{"1min":1.153,"5min":1038.309,"15min":1038.309},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":51.655000000000001,"15min":17.821999999999999},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.35099999999999998},"max":{"1min":1.222,"5min":2556.578,"15min":2556.578},"last":1.0489999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":45.720999999999997,"15min":15.842000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.099,"5min":2567.538,"15min":2567.538},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":36.046999999999997,"15min":12.67},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.39700000000000002},"max":{"1min":1.196,"5min":1371.7280000000001,"15min":1371.7280000000001},"last":0.84599999999999997}]},{"osd":4,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.93999999999999995,"15min":1.0469999999999999},"min":{"1min":0.61499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2709999999999999,"5min":1.3400000000000001,"15min":10.151},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.034,"15min":1.0569999999999999},"min":{"1min":0.64800000000000002,"5min":0.64200000000000002,"15min":0.437},"max":{"1min":1.329,"5min":1.5640000000000001,"15min":3.2629999999999999},"last":1.0760000000000001}]},{"osd":5,"last update":"Tue Nov 28 21:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.071,"15min":1.1000000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.50800000000000001},"max":{"1min":1.3069999999999999,"5min":1.51,"15min":4.5519999999999996},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0189999999999999,"15min":1.1499999999999999},"min":{"1min":0.63200000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.363,"5min":1.423,"15min":2.1899999999999999},"last":1.1000000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.109,"15min":1.145},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.56899999999999995},"max":{"1min":1.4359999999999999,"5min":1.5149999999999999,"15min":4.6639999999999997},"last":1.147},{"interface":"front","average":{"1min":1.095,"5min":1.139,"15min":1.218},"min":{"1min":0.77500000000000002,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.27,"5min":1.651,"15min":3.2029999999999998},"last":1.196}]}]},{"osd":5,"up_from":14,"seq":60129542484,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":489288,"kb_used_data":335936,"kb_used_omap":1,"kb_used_meta":153342,"kb_avail":93882552,"statfs":{"total":96636764160,"available":96135733248,"internally_reserved":0,"allocated":343998464,"data_stored":343698460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":157022661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:14 2023","interfaces":[{"interface":"back","average":{"1min":84.838999999999999,"5min":17.664000000000001,"15min":6.4409999999999998},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.27100000000000002},"max":{"1min":1605.194,"5min":1605.194,"15min":1605.194},"last":0.82699999999999996},{"interface":"front","average":{"1min":94.373000000000005,"5min":19.542000000000002,"15min":7.0590000000000002},"min":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.27100000000000002},"max":{"1min":1603.2260000000001,"5min":1603.2260000000001,"15min":1603.2260000000001},"last":0.93400000000000005}]},{"osd":1,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":17.541,"15min":6.4180000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.253},"max":{"1min":1.0229999999999999,"5min":1749.1869999999999,"15min":1749.1869999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.997,"5min":56.825000000000003,"15min":19.577999999999999},"min":{"1min":0.76900000000000002,"5min":0.53100000000000003,"15min":0.442},"max":{"1min":1.1599999999999999,"5min":3741.5659999999998,"15min":3741.5659999999998},"last":1.2070000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":2.403,"15min":1.4239999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.309},"max":{"1min":1.1559999999999999,"5min":152.40199999999999,"15min":152.40199999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.008,"5min":56.719000000000001,"15min":19.510999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.435},"max":{"1min":1.238,"5min":3741.3910000000001,"15min":3741.3910000000001},"last":0.96799999999999997}]},{"osd":3,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":66.242999999999995,"15min":22.757000000000001},"min":{"1min":0.69999999999999996,"5min":0.60499999999999998,"15min":0.34999999999999998},"max":{"1min":1.2589999999999999,"5min":3904.835,"15min":3904.835},"last":1.03},{"interface":"front","average":{"1min":0.84399999999999997,"5min":18.091000000000001,"15min":6.6870000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.35299999999999998},"max":{"1min":1.069,"5min":1785.712,"15min":1785.712},"last":0.872}]},{"osd":4,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88600000000000001,"15min":0.88300000000000001},"min":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.28199999999999997},"max":{"1min":1.105,"5min":1.393,"15min":1.952},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1279999999999999,"15min":1.0960000000000001},"min":{"1min":0.98099999999999998,"5min":0.65800000000000003,"15min":0.29999999999999999},"max":{"1min":1.343,"5min":1.5860000000000001,"15min":4.7320000000000002},"last":1.107}]},{"osd":6,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.196,"15min":1.1850000000000001},"min":{"1min":1.1000000000000001,"5min":0.65700000000000003,"15min":0.318},"max":{"1min":1.5640000000000001,"5min":1.728,"15min":5.6600000000000001},"last":1.254},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.05,"15min":1.0429999999999999},"min":{"1min":0.749,"5min":0.64200000000000002,"15min":0.34000000000000002},"max":{"1min":1.234,"5min":1.6100000000000001,"15min":2.573},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2310000000000001,"15min":1.085},"min":{"1min":1.04,"5min":0.69999999999999996,"15min":0.28299999999999997},"max":{"1min":1.677,"5min":1.677,"15min":2.298},"last":1.306},{"interface":"front","average":{"1min":1.004,"5min":1.1020000000000001,"15min":1.1879999999999999},"min":{"1min":0.752,"5min":0.72299999999999998,"15min":0.36899999999999999},"max":{"1min":1.3220000000000001,"5min":1.6519999999999999,"15min":4.8109999999999999},"last":0.77200000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542483,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616800,"kb_used_data":437080,"kb_used_omap":1,"kb_used_meta":179710,"kb_avail":93755040,"statfs":{"total":96636764160,"available":96005160960,"internally_reserved":0,"allocated":447569920,"data_stored":447273953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":184023493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":74.793999999999997,"15min":25.492999999999999},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.25600000000000001},"max":{"1min":0.97699999999999998,"5min":4472.0990000000002,"15min":4472.0990000000002},"last":0.753},{"interface":"front","average":{"1min":0.80200000000000005,"5min":74.838999999999999,"15min":25.632000000000001},"min":{"1min":0.51300000000000001,"5min":0.433,"15min":0.33000000000000002},"max":{"1min":1.1140000000000001,"5min":4472.4799999999996,"15min":4472.4799999999996},"last":0.61399999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":68.733999999999995,"15min":23.989000000000001},"min":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":2473.319,"15min":2473.319},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":69.427999999999997,"15min":24.09},"min":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.40600000000000003},"max":{"1min":1.216,"5min":2525.277,"15min":2525.277},"last":0.79400000000000004}]},{"osd":2,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":39.482999999999997,"15min":14.124000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.38600000000000001},"max":{"1min":0.98299999999999998,"5min":2323.7979999999998,"15min":2323.7979999999998},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":62.450000000000003,"15min":21.917000000000002},"min":{"1min":0.66200000000000003,"5min":0.60199999999999998,"15min":0.35599999999999998},"max":{"1min":1.1160000000000001,"5min":2498.6460000000002,"15min":2498.6460000000002},"last":0.84099999999999997}]},{"osd":3,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":63.005000000000003,"15min":21.709},"min":{"1min":0.56299999999999994,"5min":0.47699999999999998,"15min":0.38900000000000001},"max":{"1min":1.087,"5min":2516.6700000000001,"15min":2516.6700000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.874,"5min":65.099999999999994,"15min":22.652000000000001},"min":{"1min":0.624,"5min":0.53200000000000003,"15min":0.441},"max":{"1min":1.1859999999999999,"5min":2478.165,"15min":2478.165},"last":0.89000000000000001}]},{"osd":5,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97099999999999997,"15min":1.2849999999999999},"min":{"1min":0.74099999999999999,"5min":0.55100000000000005,"15min":0.36399999999999999},"max":{"1min":1.173,"5min":1.3999999999999999,"15min":19.408999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.028,"15min":1.1020000000000001},"min":{"1min":0.91100000000000003,"5min":0.64800000000000002,"15min":0.35699999999999998},"max":{"1min":1.262,"5min":1.4970000000000001,"15min":9.375},"last":1.107}]},{"osd":6,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0429999999999999,"15min":1.355},"min":{"1min":0.85099999999999998,"5min":0.63700000000000001,"15min":0.44600000000000001},"max":{"1min":1.341,"5min":1.347,"15min":36.531999999999996},"last":1.077},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1060000000000001,"15min":1.762},"min":{"1min":0.93799999999999994,"5min":0.745,"15min":0.42799999999999999},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":85.367999999999995},"last":1.1950000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.081,"15min":1.208},"min":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.45200000000000001},"max":{"1min":1.2310000000000001,"5min":1.5760000000000001,"15min":9.3399999999999999},"last":1.04},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1459999999999999,"15min":1.4379999999999999},"min":{"1min":0.97499999999999998,"5min":0.78900000000000003,"15min":0.41299999999999998},"max":{"1min":1.4330000000000001,"5min":1.577,"15min":36.591999999999999},"last":1.2569999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542483,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503304,"kb_used_data":345792,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":93868536,"statfs":{"total":96636764160,"available":96121380864,"internally_reserved":0,"allocated":354091008,"data_stored":353789699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":4.8230000000000004,"15min":1.964},"min":{"1min":0.20999999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.56100000000000005,"5min":297.16899999999998,"15min":297.16899999999998},"last":0.432},{"interface":"front","average":{"1min":0.44700000000000001,"5min":4.9260000000000002,"15min":1.9830000000000001},"min":{"1min":0.25700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.59799999999999998,"5min":297.202,"15min":297.202},"last":0.52600000000000002}]},{"osd":2,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":4.5019999999999998,"15min":1.8480000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52200000000000002,"5min":335.166,"15min":335.166},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":4.4240000000000004,"15min":1.829},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.622,"5min":335.19400000000002,"15min":335.19400000000002},"last":0.505}]},{"osd":3,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":1.3100000000000001,"15min":0.81000000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.28399999999999997},"max":{"1min":0.61599999999999999,"5min":53.808,"15min":53.808},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.51700000000000002,"5min":29.550999999999998,"15min":10.304},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71399999999999997,"5min":2839.3989999999999,"15min":2839.3989999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":27.709,"15min":9.8179999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1499999999999999,"5min":2822.2359999999999,"15min":2822.2359999999999},"last":0.752},{"interface":"front","average":{"1min":0.72199999999999998,"5min":27.696999999999999,"15min":9.7840000000000007},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89500000000000002,"5min":2822.212,"15min":2822.212},"last":0.90500000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":19.888999999999999,"15min":7.1749999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.47099999999999997},"max":{"1min":0.96999999999999997,"5min":1936.5550000000001,"15min":1936.5550000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":25.221,"15min":8.9809999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.008,"5min":1999.019,"15min":1999.019},"last":0.76400000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":29.164999999999999,"15min":10.345000000000001},"min":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.48199999999999998},"max":{"1min":1.083,"5min":2832.431,"15min":2832.431},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":29.058,"15min":10.275},"min":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":2822.1840000000002,"15min":2822.1840000000002},"last":0.80600000000000005}]},{"osd":7,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":30.033999999999999,"15min":10.619999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1999.058,"15min":1999.058},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":45.722999999999999,"15min":15.859999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.054,"5min":2822.143,"15min":2822.143},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":170106880,"data_stored":170090025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":171458560,"data_stored":171434421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85495808,"data_stored":85471932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":183201792,"data_stored":183178341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":187912192,"data_stored":187897127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171967842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":182108160,"data_stored":182090706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209731584,"data_stored":209715928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":182788096,"data_stored":182788096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":297787392,"data_stored":297787392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":197746688,"data_stored":197746688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":288649216,"data_stored":288649216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259055616,"data_stored":259055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171409408,"data_stored":171409408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":267010048,"data_stored":267010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":216862720,"data_stored":216862720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:06:11.454 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.455 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.455 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.456 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.456 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.456 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.456 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.457 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.457 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.457 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.457 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.458 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.458 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.458 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.458 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.459 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.459 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.459 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.459 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.460 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.460 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.460 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-11-28T20:38:18.500380+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=18, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:11.460 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T21:06:30.093 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:30.096 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:31.461 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:06:31.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.576+0000 7f228c479640 1 Processor -- start 2023-11-28T21:06:31.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.576+0000 7f228c479640 1 -- start start 2023-11-28T21:06:31.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2284150b40 0x7f2284157560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:31.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22840c4510 0x7f228406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:31.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22840c48f0 con 0x7f22840c6ff0 2023-11-28T21:06:31.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22840c62f0 con 0x7f22840c4510 2023-11-28T21:06:31.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22840c6ac0 con 0x7f2284150b40 2023-11-28T21:06:31.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228aa16640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22840c4510 0x7f228406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:31.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f2289a14640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f22840c6ff0 0x7f22840c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:38206/0 (socket says 172.21.15.167:38206) 2023-11-28T21:06:31.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f2289a14640 1 -- 172.21.15.167:0/3847215697 learned_addr learned my addr 172.21.15.167:0/3847215697 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:31.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228a215640 1 --2- 172.21.15.167:0/3847215697 >> v2:172.21.15.178:3300/0 conn(0x7f2284150b40 0x7f2284157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:31.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228aa16640 1 -- 172.21.15.167:0/3847215697 >> v2:172.21.15.178:3300/0 conn(0x7f2284150b40 msgr2=0x7f2284157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:31.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228aa16640 1 --2- 172.21.15.167:0/3847215697 >> v2:172.21.15.178:3300/0 conn(0x7f2284150b40 0x7f2284157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228aa16640 1 -- 172.21.15.167:0/3847215697 >> v1:172.21.15.167:6789/0 conn(0x7f22840c6ff0 legacy=0x7f22840c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:31.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228aa16640 1 -- 172.21.15.167:0/3847215697 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840c6500 con 0x7f22840c4510 2023-11-28T21:06:31.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f2289213640 1 -- 172.21.15.167:0/3847215697 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255864392 0 0) 0x7f22840c48f0 con 0x7f22840c6ff0 2023-11-28T21:06:31.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228aa16640 1 --2- 172.21.15.167:0/3847215697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 0x7f228406a580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f22840cc090 tx=0x7f227c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f39476116164ad6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:31.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f2289213640 1 -- 172.21.15.167:0/3847215697 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a58b0 con 0x7f22840c4510 2023-11-28T21:06:31.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f2289213640 1 -- 172.21.15.167:0/3847215697 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c0a5a10 con 0x7f22840c4510 2023-11-28T21:06:31.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f2289213640 1 -- 172.21.15.167:0/3847215697 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a5da0 con 0x7f22840c4510 2023-11-28T21:06:31.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 -- 172.21.15.167:0/3847215697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 msgr2=0x7f228406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:31.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 --2- 172.21.15.167:0/3847215697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 0x7f228406a580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f22840cc090 tx=0x7f227c01c8e0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 -- 172.21.15.167:0/3847215697 shutdown_connections 2023-11-28T21:06:31.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 --2- 172.21.15.167:0/3847215697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 0x7f228406a580 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 --2- 172.21.15.167:0/3847215697 >> v2:172.21.15.178:3300/0 conn(0x7f2284150b40 0x7f2284157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.580+0000 7f228c479640 1 -- 172.21.15.167:0/3847215697 >> 172.21.15.167:0/3847215697 conn(0x7f22840cb1e0 msgr2=0x7f22840cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:31.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 -- 172.21.15.167:0/3847215697 shutdown_connections 2023-11-28T21:06:31.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 -- 172.21.15.167:0/3847215697 wait complete. 2023-11-28T21:06:31.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 Processor -- start 2023-11-28T21:06:31.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 -- start start 2023-11-28T21:06:31.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 0x7f2284070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:31.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22840c6ff0 0x7f2284143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:31.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2284150b40 0x7f2284143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:31.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284158dc0 con 0x7f22840c4510 2023-11-28T21:06:31.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284157b30 con 0x7f22840c6ff0 2023-11-28T21:06:31.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2284159d80 con 0x7f2284150b40 2023-11-28T21:06:31.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228a215640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 0x7f2284070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:31.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228a215640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 0x7f2284070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:57124/0 (socket says 172.21.15.167:57124) 2023-11-28T21:06:31.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228a215640 1 -- 172.21.15.167:0/2567937694 learned_addr learned my addr 172.21.15.167:0/2567937694 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:31.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f2289a14640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22840c6ff0 0x7f2284143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:31.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228aa16640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2284150b40 0x7f2284143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228a215640 1 -- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2284150b40 msgr2=0x7f2284143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228a215640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2284150b40 0x7f2284143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228a215640 1 -- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22840c6ff0 msgr2=0x7f2284143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228a215640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22840c6ff0 0x7f2284143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228a215640 1 -- 172.21.15.167:0/2567937694 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c009a70 con 0x7f22840c4510 2023-11-28T21:06:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228a215640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 0x7f2284070800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f228000c7f0 tx=0x7f228000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f227affd640 1 -- 172.21.15.167:0/2567937694 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280007820 con 0x7f22840c4510 2023-11-28T21:06:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f227affd640 1 -- 172.21.15.167:0/2567937694 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280007980 con 0x7f22840c4510 2023-11-28T21:06:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2284157d80 con 0x7f22840c4510 2023-11-28T21:06:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f227affd640 1 -- 172.21.15.167:0/2567937694 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280007d30 con 0x7f22840c4510 2023-11-28T21:06:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2284159aa0 con 0x7f22840c4510 2023-11-28T21:06:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.584+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22840682c0 con 0x7f22840c4510 2023-11-28T21:06:31.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.588+0000 7f227affd640 1 -- 172.21.15.167:0/2567937694 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22800113f0 con 0x7f22840c4510 2023-11-28T21:06:31.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.588+0000 7f227affd640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2268066470 0x7f2268068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.588+0000 7f227affd640 1 -- 172.21.15.167:0/2567937694 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f2280084470 con 0x7f22840c4510 2023-11-28T21:06:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.588+0000 7f2289a14640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2268066470 0x7f2268068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.588+0000 7f2289a14640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2268066470 0x7f2268068930 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f22840714c0 tx=0x7f2274009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.592+0000 7f227affd640 1 -- 172.21.15.167:0/2567937694 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2280051570 con 0x7f22840c4510 2023-11-28T21:06:31.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.732+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2284157040 con 0x7f2268066470 2023-11-28T21:06:31.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.760+0000 7f227affd640 1 -- 172.21.15.167:0/2567937694 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+376786 (secure 0 0 0) 0x7f22740013e0 con 0x7f2268066470 2023-11-28T21:06:31.768 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:06:31.770 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T21:06:31.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2268066470 msgr2=0x7f2268068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:31.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2268066470 0x7f2268068930 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f22840714c0 tx=0x7f2274009040 comp rx=0 tx=0).stop 2023-11-28T21:06:31.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 msgr2=0x7f2284070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:31.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 0x7f2284070800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f228000c7f0 tx=0x7f228000ccb0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 shutdown_connections 2023-11-28T21:06:31.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2268066470 0x7f2268068930 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2284150b40 0x7f2284143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22840c6ff0 0x7f2284143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 --2- 172.21.15.167:0/2567937694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22840c4510 0x7f2284070800 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:31.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 >> 172.21.15.167:0/2567937694 conn(0x7f22840cb1e0 msgr2=0x7f228406ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:31.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 shutdown_connections 2023-11-28T21:06:31.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:31.764+0000 7f228c479640 1 -- 172.21.15.167:0/2567937694 wait complete. 2023-11-28T21:06:31.784 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":897,"stamp":"2023-11-28T21:06:30.151478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573758178,"num_objects":18293,"num_object_clones":8054,"num_object_copies":71918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18293,"num_whiteouts":7974,"num_read":2812,"num_read_kb":299859,"num_write":63166,"num_write_kb":1870934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2848462,"num_omap_keys":5441,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99130,"ondisk_log_size":99130,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4530548,"kb_used_data":3173296,"kb_used_omap":12,"kb_used_meta":1357171,"kb_avail":750444172,"statfs":{"total":773094113280,"available":768454832128,"internally_reserved":0,"allocated":3249455104,"data_stored":3247001856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1389743664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19827,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":194804,"num_write":5,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005249"},"pg_stats":[{"pgid":"2.1f","version":"51'568","reported_seq":635,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.968269+0000","last_change":"2023-11-28T21:05:32.187967+0000","last_active":"2023-11-28T21:06:14.968269+0000","last_peered":"2023-11-28T21:06:14.968269+0000","last_clean":"2023-11-28T21:06:14.968269+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T21:06:14.968269+0000","last_undegraded":"2023-11-28T21:06:14.968269+0000","last_fullsized":"2023-11-28T21:06:14.968269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'568","last_scrub_stamp":"2023-11-28T21:05:32.187849+0000","last_deep_scrub":"51'568","last_deep_scrub_stamp":"2023-11-28T21:05:32.187849+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.187849+0000","objects_scrubbed":22,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:57:58.029094+0000","scrub_duration":0.086821672000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3,"num_read_kb":4109,"num_write":501,"num_write_kb":29002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":102240,"num_omap_keys":193,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'428","reported_seq":2525,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:26.562996+0000","last_change":"2023-11-28T21:06:26.563035+0000","last_active":"2023-11-28T21:06:26.562996+0000","last_peered":"2023-11-28T21:06:26.562996+0000","last_clean":"2023-11-28T21:06:26.562996+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T21:06:26.562996+0000","last_undegraded":"2023-11-28T21:06:26.562996+0000","last_fullsized":"2023-11-28T21:06:26.562996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'428","last_scrub_stamp":"2023-11-28T21:06:26.562872+0000","last_deep_scrub":"51'428","last_deep_scrub_stamp":"2023-11-28T21:06:26.562872+0000","last_clean_scrub_stamp":"2023-11-28T21:06:26.562872+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:11.056747+0000","scrub_duration":0.0030981450000000001,"objects_trimmed":0,"snaptrim_duration":0.012127499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"51'1858","reported_seq":3730,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:06.768298+0000","last_change":"2023-11-28T21:06:06.768298+0000","last_active":"2023-11-28T21:06:06.768298+0000","last_peered":"2023-11-28T21:06:06.768298+0000","last_clean":"2023-11-28T21:06:06.768298+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T21:06:06.768298+0000","last_undegraded":"2023-11-28T21:06:06.768298+0000","last_fullsized":"2023-11-28T21:06:06.768298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1858","last_scrub_stamp":"2023-11-28T21:06:06.768177+0000","last_deep_scrub":"51'1858","last_deep_scrub_stamp":"2023-11-28T21:06:06.768177+0000","last_clean_scrub_stamp":"2023-11-28T21:06:06.768177+0000","objects_scrubbed":556,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:26.026085+0000","scrub_duration":0.27094379299999999,"objects_trimmed":0,"snaptrim_duration":0.016916996,"stat_sum":{"num_bytes":12268315,"num_objects":556,"num_object_clones":279,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":239,"num_read":31,"num_read_kb":4126,"num_write":1561,"num_write_kb":24667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"52'630","reported_seq":699,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:23.780983+0000","last_change":"2023-11-28T21:05:42.376131+0000","last_active":"2023-11-28T21:06:23.780983+0000","last_peered":"2023-11-28T21:06:23.780983+0000","last_clean":"2023-11-28T21:06:23.780983+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T21:06:23.780983+0000","last_undegraded":"2023-11-28T21:06:23.780983+0000","last_fullsized":"2023-11-28T21:06:23.780983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'629","last_scrub_stamp":"2023-11-28T21:05:42.376020+0000","last_deep_scrub":"51'629","last_deep_scrub_stamp":"2023-11-28T21:05:42.376020+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.376020+0000","objects_scrubbed":18,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:29.854245+0000","scrub_duration":0.078645286999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":8204,"num_write":546,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35806,"num_omap_keys":68,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"51'383","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:48.164491+0000","last_change":"2023-11-28T21:05:48.164491+0000","last_active":"2023-11-28T21:05:48.164491+0000","last_peered":"2023-11-28T21:05:48.164491+0000","last_clean":"2023-11-28T21:05:48.164491+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T21:05:48.164491+0000","last_undegraded":"2023-11-28T21:05:48.164491+0000","last_fullsized":"2023-11-28T21:05:48.164491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'383","last_scrub_stamp":"2023-11-28T21:05:48.164339+0000","last_deep_scrub":"51'383","last_deep_scrub_stamp":"2023-11-28T21:05:48.164339+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.164339+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:11.595753+0000","scrub_duration":0.0027454979999999999,"objects_trimmed":0,"snaptrim_duration":0.010031783000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"51'1843","reported_seq":3753,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.385624+0000","last_change":"2023-11-28T21:05:45.385624+0000","last_active":"2023-11-28T21:05:45.385624+0000","last_peered":"2023-11-28T21:05:45.385624+0000","last_clean":"2023-11-28T21:05:45.385624+0000","last_became_active":"2023-11-28T20:39:01.389891+0000","last_became_peered":"2023-11-28T20:39:01.389891+0000","last_unstale":"2023-11-28T21:05:45.385624+0000","last_undegraded":"2023-11-28T21:05:45.385624+0000","last_fullsized":"2023-11-28T21:05:45.385624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1843","last_scrub_stamp":"2023-11-28T21:05:45.385425+0000","last_deep_scrub":"51'1843","last_deep_scrub_stamp":"2023-11-28T21:05:45.385425+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.385425+0000","objects_scrubbed":578,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:28.388874+0000","scrub_duration":0.43209253600000003,"objects_trimmed":0,"snaptrim_duration":0.0084388650000000003,"stat_sum":{"num_bytes":22024896,"num_objects":578,"num_object_clones":267,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":267,"num_read":47,"num_read_kb":8236,"num_write":1555,"num_write_kb":33440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"51'602","reported_seq":666,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.945924+0000","last_change":"2023-11-28T21:05:45.520765+0000","last_active":"2023-11-28T21:06:14.945924+0000","last_peered":"2023-11-28T21:06:14.945924+0000","last_clean":"2023-11-28T21:06:14.945924+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T21:06:14.945924+0000","last_undegraded":"2023-11-28T21:06:14.945924+0000","last_fullsized":"2023-11-28T21:06:14.945924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'602","last_scrub_stamp":"2023-11-28T21:05:45.520500+0000","last_deep_scrub":"51'602","last_deep_scrub_stamp":"2023-11-28T21:05:45.520500+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.520500+0000","objects_scrubbed":23,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:53.505086+0000","scrub_duration":0.106955033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":539,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66384,"num_omap_keys":125,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"51'396","reported_seq":2498,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.204087+0000","last_change":"2023-11-28T21:06:01.204087+0000","last_active":"2023-11-28T21:06:01.204087+0000","last_peered":"2023-11-28T21:06:01.204087+0000","last_clean":"2023-11-28T21:06:01.204087+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T21:06:01.204087+0000","last_undegraded":"2023-11-28T21:06:01.204087+0000","last_fullsized":"2023-11-28T21:06:01.204087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'396","last_scrub_stamp":"2023-11-28T21:06:01.203924+0000","last_deep_scrub":"51'396","last_deep_scrub_stamp":"2023-11-28T21:06:01.203924+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.203924+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:35:35.838187+0000","scrub_duration":0.0020324029999999999,"objects_trimmed":0,"snaptrim_duration":0.016140509000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1696","reported_seq":3613,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:59.371925+0000","last_change":"2023-11-28T21:05:59.371925+0000","last_active":"2023-11-28T21:05:59.371925+0000","last_peered":"2023-11-28T21:05:59.371925+0000","last_clean":"2023-11-28T21:05:59.371925+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T21:05:59.371925+0000","last_undegraded":"2023-11-28T21:05:59.371925+0000","last_fullsized":"2023-11-28T21:05:59.371925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1696","last_scrub_stamp":"2023-11-28T21:05:59.371622+0000","last_deep_scrub":"51'1696","last_deep_scrub_stamp":"2023-11-28T21:05:59.371622+0000","last_clean_scrub_stamp":"2023-11-28T21:05:59.371622+0000","objects_scrubbed":514,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:52.871982+0000","scrub_duration":0.38753573200000002,"objects_trimmed":0,"snaptrim_duration":0.0093789649999999995,"stat_sum":{"num_bytes":11818887,"num_objects":514,"num_object_clones":236,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":236,"num_read":34,"num_read_kb":34,"num_write":1442,"num_write_kb":18567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"51'415","reported_seq":479,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.609836+0000","last_change":"2023-11-28T21:05:36.552278+0000","last_active":"2023-11-28T21:05:50.609836+0000","last_peered":"2023-11-28T21:05:50.609836+0000","last_clean":"2023-11-28T21:05:50.609836+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T21:05:50.609836+0000","last_undegraded":"2023-11-28T21:05:50.609836+0000","last_fullsized":"2023-11-28T21:05:50.609836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:36.552022+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:36.552022+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.552022+0000","objects_scrubbed":11,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:51.358100+0000","scrub_duration":0.050659634000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":354,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":50644,"num_omap_keys":93,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"51'394","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.617089+0000","last_change":"2023-11-28T21:05:34.100707+0000","last_active":"2023-11-28T21:05:50.617089+0000","last_peered":"2023-11-28T21:05:50.617089+0000","last_clean":"2023-11-28T21:05:50.617089+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T21:05:50.617089+0000","last_undegraded":"2023-11-28T21:05:50.617089+0000","last_fullsized":"2023-11-28T21:05:50.617089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:34.100435+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:34.100435+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.100435+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:40.322315+0000","scrub_duration":0.0040552970000000002,"objects_trimmed":0,"snaptrim_duration":0.019881585,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"51'1748","reported_seq":3647,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.363192+0000","last_change":"2023-11-28T21:06:01.363192+0000","last_active":"2023-11-28T21:06:01.363192+0000","last_peered":"2023-11-28T21:06:01.363192+0000","last_clean":"2023-11-28T21:06:01.363192+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T21:06:01.363192+0000","last_undegraded":"2023-11-28T21:06:01.363192+0000","last_fullsized":"2023-11-28T21:06:01.363192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1748","last_scrub_stamp":"2023-11-28T21:06:01.363087+0000","last_deep_scrub":"51'1748","last_deep_scrub_stamp":"2023-11-28T21:06:01.363087+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.363087+0000","objects_scrubbed":571,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:41:33.947041+0000","scrub_duration":0.36192317400000001,"objects_trimmed":0,"snaptrim_duration":0.0092901790000000008,"stat_sum":{"num_bytes":16892767,"num_objects":571,"num_object_clones":263,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":571,"num_whiteouts":263,"num_read":40,"num_read_kb":48,"num_write":1465,"num_write_kb":20221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"51'418","reported_seq":2521,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:49.175162+0000","last_change":"2023-11-28T21:05:49.175162+0000","last_active":"2023-11-28T21:05:49.175162+0000","last_peered":"2023-11-28T21:05:49.175162+0000","last_clean":"2023-11-28T21:05:49.175162+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T21:05:49.175162+0000","last_undegraded":"2023-11-28T21:05:49.175162+0000","last_fullsized":"2023-11-28T21:05:49.175162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:05:49.174902+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:05:49.174902+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.174902+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:12.677483+0000","scrub_duration":0.0035801940000000001,"objects_trimmed":0,"snaptrim_duration":0.017860755999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"51'359","reported_seq":425,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.945105+0000","last_change":"2023-11-28T21:05:43.550784+0000","last_active":"2023-11-28T21:06:14.945105+0000","last_peered":"2023-11-28T21:06:14.945105+0000","last_clean":"2023-11-28T21:06:14.945105+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T21:06:14.945105+0000","last_undegraded":"2023-11-28T21:06:14.945105+0000","last_fullsized":"2023-11-28T21:06:14.945105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'359","last_scrub_stamp":"2023-11-28T21:05:43.550489+0000","last_deep_scrub":"51'359","last_deep_scrub_stamp":"2023-11-28T21:05:43.550489+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.550489+0000","objects_scrubbed":23,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:36:27.546980+0000","scrub_duration":0.113957661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":4108,"num_write":274,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89762,"num_omap_keys":171,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"51'1713","reported_seq":3637,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.393797+0000","last_change":"2023-11-28T21:05:56.393797+0000","last_active":"2023-11-28T21:05:56.393797+0000","last_peered":"2023-11-28T21:05:56.393797+0000","last_clean":"2023-11-28T21:05:56.393797+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T21:05:56.393797+0000","last_undegraded":"2023-11-28T21:05:56.393797+0000","last_fullsized":"2023-11-28T21:05:56.393797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1713","last_scrub_stamp":"2023-11-28T21:05:56.393516+0000","last_deep_scrub":"51'1713","last_deep_scrub_stamp":"2023-11-28T21:05:56.393516+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.393516+0000","objects_scrubbed":519,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:14.037824+0000","scrub_duration":0.41489545799999999,"objects_trimmed":0,"snaptrim_duration":0.011349794999999999,"stat_sum":{"num_bytes":42075033,"num_objects":519,"num_object_clones":229,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":229,"num_read":33,"num_read_kb":8223,"num_write":1463,"num_write_kb":57658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"51'395","reported_seq":2498,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.289522+0000","last_change":"2023-11-28T21:05:32.289522+0000","last_active":"2023-11-28T21:05:32.289522+0000","last_peered":"2023-11-28T21:05:32.289522+0000","last_clean":"2023-11-28T21:05:32.289522+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T21:05:32.289522+0000","last_undegraded":"2023-11-28T21:05:32.289522+0000","last_fullsized":"2023-11-28T21:05:32.289522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'395","last_scrub_stamp":"2023-11-28T21:05:32.289412+0000","last_deep_scrub":"51'395","last_deep_scrub_stamp":"2023-11-28T21:05:32.289412+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.289412+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:10.715951+0000","scrub_duration":0.001674711,"objects_trimmed":0,"snaptrim_duration":0.018528307000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"51'488","reported_seq":555,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:19.959283+0000","last_change":"2023-11-28T21:05:46.677480+0000","last_active":"2023-11-28T21:06:19.959283+0000","last_peered":"2023-11-28T21:06:19.959283+0000","last_clean":"2023-11-28T21:06:19.959283+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T21:06:19.959283+0000","last_undegraded":"2023-11-28T21:06:19.959283+0000","last_fullsized":"2023-11-28T21:06:19.959283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'488","last_scrub_stamp":"2023-11-28T21:05:46.677285+0000","last_deep_scrub":"51'488","last_deep_scrub_stamp":"2023-11-28T21:05:46.677285+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.677285+0000","objects_scrubbed":20,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:36.686128+0000","scrub_duration":0.074223357000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5,"num_read_kb":4129,"num_write":693,"num_write_kb":25655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":97994,"num_omap_keys":459,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'1827","reported_seq":3742,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.338497+0000","last_change":"2023-11-28T21:05:41.338497+0000","last_active":"2023-11-28T21:05:41.338497+0000","last_peered":"2023-11-28T21:05:41.338497+0000","last_clean":"2023-11-28T21:05:41.338497+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T21:05:41.338497+0000","last_undegraded":"2023-11-28T21:05:41.338497+0000","last_fullsized":"2023-11-28T21:05:41.338497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1827","last_scrub_stamp":"2023-11-28T21:05:41.338279+0000","last_deep_scrub":"51'1827","last_deep_scrub_stamp":"2023-11-28T21:05:41.338279+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.338279+0000","objects_scrubbed":549,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:26:57.473243+0000","scrub_duration":0.42601145800000001,"objects_trimmed":0,"snaptrim_duration":0.010051028,"stat_sum":{"num_bytes":36081004,"num_objects":549,"num_object_clones":242,"num_object_copies":2196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":242,"num_read":36,"num_read_kb":4131,"num_write":1572,"num_write_kb":47387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"51'429","reported_seq":2532,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.253896+0000","last_change":"2023-11-28T21:05:34.253896+0000","last_active":"2023-11-28T21:05:34.253896+0000","last_peered":"2023-11-28T21:05:34.253896+0000","last_clean":"2023-11-28T21:05:34.253896+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T21:05:34.253896+0000","last_undegraded":"2023-11-28T21:05:34.253896+0000","last_fullsized":"2023-11-28T21:05:34.253896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'429","last_scrub_stamp":"2023-11-28T21:05:34.253775+0000","last_deep_scrub":"51'429","last_deep_scrub_stamp":"2023-11-28T21:05:34.253775+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.253775+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:07.648795+0000","scrub_duration":0.00170806,"objects_trimmed":0,"snaptrim_duration":0.018799937999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"51'685","reported_seq":752,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:19.944885+0000","last_change":"2023-11-28T21:05:41.707798+0000","last_active":"2023-11-28T21:06:19.944885+0000","last_peered":"2023-11-28T21:06:19.944885+0000","last_clean":"2023-11-28T21:06:19.944885+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T21:06:19.944885+0000","last_undegraded":"2023-11-28T21:06:19.944885+0000","last_fullsized":"2023-11-28T21:06:19.944885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'685","last_scrub_stamp":"2023-11-28T21:05:41.707658+0000","last_deep_scrub":"51'685","last_deep_scrub_stamp":"2023-11-28T21:05:41.707658+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.707658+0000","objects_scrubbed":19,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:00:13.376241+0000","scrub_duration":0.055951230999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":4105,"num_write":627,"num_write_kb":16946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":109119,"num_omap_keys":206,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"51'1842","reported_seq":3740,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:15.046691+0000","last_change":"2023-11-28T21:06:15.046725+0000","last_active":"2023-11-28T21:06:15.046691+0000","last_peered":"2023-11-28T21:06:15.046691+0000","last_clean":"2023-11-28T21:06:15.046691+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T21:06:15.046691+0000","last_undegraded":"2023-11-28T21:06:15.046691+0000","last_fullsized":"2023-11-28T21:06:15.046691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1842","last_scrub_stamp":"2023-11-28T21:06:15.046590+0000","last_deep_scrub":"51'1842","last_deep_scrub_stamp":"2023-11-28T21:06:15.046590+0000","last_clean_scrub_stamp":"2023-11-28T21:06:15.046590+0000","objects_scrubbed":586,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:39:05.370043+0000","scrub_duration":0.35698871999999998,"objects_trimmed":0,"snaptrim_duration":0.011785257,"stat_sum":{"num_bytes":33810901,"num_objects":586,"num_object_clones":259,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":259,"num_read":37,"num_read_kb":8227,"num_write":1558,"num_write_kb":44779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"51'406","reported_seq":2509,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:34.948965+0000","last_change":"2023-11-28T21:05:34.948965+0000","last_active":"2023-11-28T21:05:34.948965+0000","last_peered":"2023-11-28T21:05:34.948965+0000","last_clean":"2023-11-28T21:05:34.948965+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T21:05:34.948965+0000","last_undegraded":"2023-11-28T21:05:34.948965+0000","last_fullsized":"2023-11-28T21:05:34.948965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'406","last_scrub_stamp":"2023-11-28T21:05:34.948705+0000","last_deep_scrub":"51'406","last_deep_scrub_stamp":"2023-11-28T21:05:34.948705+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.948705+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:53.319129+0000","scrub_duration":0.0033768689999999998,"objects_trimmed":0,"snaptrim_duration":0.011190047999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"51'504","reported_seq":571,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.183414+0000","last_change":"2023-11-28T21:05:37.522356+0000","last_active":"2023-11-28T21:06:20.183414+0000","last_peered":"2023-11-28T21:06:20.183414+0000","last_clean":"2023-11-28T21:06:20.183414+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T21:06:20.183414+0000","last_undegraded":"2023-11-28T21:06:20.183414+0000","last_fullsized":"2023-11-28T21:06:20.183414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'504","last_scrub_stamp":"2023-11-28T21:05:37.522080+0000","last_deep_scrub":"51'504","last_deep_scrub_stamp":"2023-11-28T21:05:37.522080+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.522080+0000","objects_scrubbed":19,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:21.382578+0000","scrub_duration":0.058407088000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":8210,"num_write":441,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":131856,"num_omap_keys":203,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"51'1805","reported_seq":3687,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:54.481128+0000","last_change":"2023-11-28T21:05:54.481128+0000","last_active":"2023-11-28T21:05:54.481128+0000","last_peered":"2023-11-28T21:05:54.481128+0000","last_clean":"2023-11-28T21:05:54.481128+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T21:05:54.481128+0000","last_undegraded":"2023-11-28T21:05:54.481128+0000","last_fullsized":"2023-11-28T21:05:54.481128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1805","last_scrub_stamp":"2023-11-28T21:05:54.480945+0000","last_deep_scrub":"51'1805","last_deep_scrub_stamp":"2023-11-28T21:05:54.480945+0000","last_clean_scrub_stamp":"2023-11-28T21:05:54.480945+0000","objects_scrubbed":568,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:25.439678+0000","scrub_duration":0.45725488600000003,"objects_trimmed":0,"snaptrim_duration":0.010413970999999999,"stat_sum":{"num_bytes":29462623,"num_objects":568,"num_object_clones":283,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":243,"num_read":43,"num_read_kb":8342,"num_write":1501,"num_write_kb":36747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"51'401","reported_seq":2504,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:53.334942+0000","last_change":"2023-11-28T21:05:53.334942+0000","last_active":"2023-11-28T21:05:53.334942+0000","last_peered":"2023-11-28T21:05:53.334942+0000","last_clean":"2023-11-28T21:05:53.334942+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T21:05:53.334942+0000","last_undegraded":"2023-11-28T21:05:53.334942+0000","last_fullsized":"2023-11-28T21:05:53.334942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'401","last_scrub_stamp":"2023-11-28T21:05:53.334782+0000","last_deep_scrub":"51'401","last_deep_scrub_stamp":"2023-11-28T21:05:53.334782+0000","last_clean_scrub_stamp":"2023-11-28T21:05:53.334782+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.959693+0000","scrub_duration":0.0020351340000000001,"objects_trimmed":0,"snaptrim_duration":0.013760692,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"51'161","reported_seq":229,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.971751+0000","last_change":"2023-11-28T21:05:41.266548+0000","last_active":"2023-11-28T21:06:14.971751+0000","last_peered":"2023-11-28T21:06:14.971751+0000","last_clean":"2023-11-28T21:06:14.971751+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T21:06:14.971751+0000","last_undegraded":"2023-11-28T21:06:14.971751+0000","last_fullsized":"2023-11-28T21:06:14.971751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'161","last_scrub_stamp":"2023-11-28T21:05:41.266279+0000","last_deep_scrub":"51'161","last_deep_scrub_stamp":"2023-11-28T21:05:41.266279+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.266279+0000","objects_scrubbed":16,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:32.433096+0000","scrub_duration":0.045962063999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":7,"num_read_kb":4128,"num_write":106,"num_write_kb":8401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":68354,"num_omap_keys":112,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"51'1903","reported_seq":3792,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.299659+0000","last_change":"2023-11-28T21:06:00.299659+0000","last_active":"2023-11-28T21:06:00.299659+0000","last_peered":"2023-11-28T21:06:00.299659+0000","last_clean":"2023-11-28T21:06:00.299659+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T21:06:00.299659+0000","last_undegraded":"2023-11-28T21:06:00.299659+0000","last_fullsized":"2023-11-28T21:06:00.299659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1903","last_scrub_stamp":"2023-11-28T21:06:00.299527+0000","last_deep_scrub":"51'1903","last_deep_scrub_stamp":"2023-11-28T21:06:00.299527+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.299527+0000","objects_scrubbed":591,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:59.660036+0000","scrub_duration":0.30872005899999999,"objects_trimmed":0,"snaptrim_duration":0.0092734619999999997,"stat_sum":{"num_bytes":42280101,"num_objects":591,"num_object_clones":269,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":269,"num_read":33,"num_read_kb":4128,"num_write":1621,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"51'381","reported_seq":2485,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.957070+0000","last_change":"2023-11-28T21:06:04.433823+0000","last_active":"2023-11-28T21:06:14.957070+0000","last_peered":"2023-11-28T21:06:14.957070+0000","last_clean":"2023-11-28T21:06:14.957070+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T21:06:14.957070+0000","last_undegraded":"2023-11-28T21:06:14.957070+0000","last_fullsized":"2023-11-28T21:06:14.957070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'381","last_scrub_stamp":"2023-11-28T21:06:04.433650+0000","last_deep_scrub":"51'381","last_deep_scrub_stamp":"2023-11-28T21:06:04.433650+0000","last_clean_scrub_stamp":"2023-11-28T21:06:04.433650+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:50.065403+0000","scrub_duration":0.0027321860000000002,"objects_trimmed":0,"snaptrim_duration":0.017915146,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"52'440","reported_seq":509,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:23.782025+0000","last_change":"2023-11-28T21:05:42.760056+0000","last_active":"2023-11-28T21:06:23.782025+0000","last_peered":"2023-11-28T21:06:23.782025+0000","last_clean":"2023-11-28T21:06:23.782025+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T21:06:23.782025+0000","last_undegraded":"2023-11-28T21:06:23.782025+0000","last_fullsized":"2023-11-28T21:06:23.782025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'437","last_scrub_stamp":"2023-11-28T21:05:42.759951+0000","last_deep_scrub":"51'437","last_deep_scrub_stamp":"2023-11-28T21:05:42.759951+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.759951+0000","objects_scrubbed":17,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:05:37.013105+0000","scrub_duration":0.10748722099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12069752,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":7,"num_read_kb":4119,"num_write":694,"num_write_kb":13763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99465,"num_omap_keys":200,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"51'1784","reported_seq":3690,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:09.736263+0000","last_change":"2023-11-28T21:06:09.736263+0000","last_active":"2023-11-28T21:06:09.736263+0000","last_peered":"2023-11-28T21:06:09.736263+0000","last_clean":"2023-11-28T21:06:09.736263+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T21:06:09.736263+0000","last_undegraded":"2023-11-28T21:06:09.736263+0000","last_fullsized":"2023-11-28T21:06:09.736263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1784","last_scrub_stamp":"2023-11-28T21:06:09.736108+0000","last_deep_scrub":"51'1784","last_deep_scrub_stamp":"2023-11-28T21:06:09.736108+0000","last_clean_scrub_stamp":"2023-11-28T21:06:09.736108+0000","objects_scrubbed":558,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:23.947901+0000","scrub_duration":0.28977997599999999,"objects_trimmed":0,"snaptrim_duration":0.016539027000000001,"stat_sum":{"num_bytes":21707636,"num_objects":558,"num_object_clones":259,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":558,"num_whiteouts":259,"num_read":41,"num_read_kb":41,"num_write":1502,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"51'425","reported_seq":2529,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:29.596563+0000","last_change":"2023-11-28T21:05:27.436717+0000","last_active":"2023-11-28T21:05:29.596563+0000","last_peered":"2023-11-28T21:05:29.596563+0000","last_clean":"2023-11-28T21:05:29.596563+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T21:05:29.596563+0000","last_undegraded":"2023-11-28T21:05:29.596563+0000","last_fullsized":"2023-11-28T21:05:29.596563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'425","last_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_deep_scrub":"51'425","last_deep_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_clean_scrub_stamp":"2023-11-28T21:05:27.436622+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:32.946946+0000","scrub_duration":0.001593002,"objects_trimmed":0,"snaptrim_duration":0.014316661,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'372","reported_seq":440,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.142195+0000","last_change":"2023-11-28T21:05:48.419105+0000","last_active":"2023-11-28T21:06:20.142195+0000","last_peered":"2023-11-28T21:06:20.142195+0000","last_clean":"2023-11-28T21:06:20.142195+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T21:06:20.142195+0000","last_undegraded":"2023-11-28T21:06:20.142195+0000","last_fullsized":"2023-11-28T21:06:20.142195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'372","last_scrub_stamp":"2023-11-28T21:05:48.418878+0000","last_deep_scrub":"51'372","last_deep_scrub_stamp":"2023-11-28T21:05:48.418878+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.418878+0000","objects_scrubbed":22,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:20.957815+0000","scrub_duration":0.077448291000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360150,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3,"num_read_kb":4097,"num_write":289,"num_write_kb":28962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":127124,"num_omap_keys":243,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"51'1789","reported_seq":3687,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:02.738163+0000","last_change":"2023-11-28T21:06:02.738163+0000","last_active":"2023-11-28T21:06:02.738163+0000","last_peered":"2023-11-28T21:06:02.738163+0000","last_clean":"2023-11-28T21:06:02.738163+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T21:06:02.738163+0000","last_undegraded":"2023-11-28T21:06:02.738163+0000","last_fullsized":"2023-11-28T21:06:02.738163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1789","last_scrub_stamp":"2023-11-28T21:06:02.738026+0000","last_deep_scrub":"51'1789","last_deep_scrub_stamp":"2023-11-28T21:06:02.738026+0000","last_clean_scrub_stamp":"2023-11-28T21:06:02.738026+0000","objects_scrubbed":561,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:43.969615+0000","scrub_duration":0.34158208299999998,"objects_trimmed":0,"snaptrim_duration":0.014620091,"stat_sum":{"num_bytes":29165465,"num_objects":561,"num_object_clones":251,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":561,"num_whiteouts":251,"num_read":26,"num_read_kb":26,"num_write":1521,"num_write_kb":34762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"51'414","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:05.353017+0000","last_change":"2023-11-28T21:06:05.353017+0000","last_active":"2023-11-28T21:06:05.353017+0000","last_peered":"2023-11-28T21:06:05.353017+0000","last_clean":"2023-11-28T21:06:05.353017+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T21:06:05.353017+0000","last_undegraded":"2023-11-28T21:06:05.353017+0000","last_fullsized":"2023-11-28T21:06:05.353017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'414","last_scrub_stamp":"2023-11-28T21:06:05.352767+0000","last_deep_scrub":"51'414","last_deep_scrub_stamp":"2023-11-28T21:06:05.352767+0000","last_clean_scrub_stamp":"2023-11-28T21:06:05.352767+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:55:54.182673+0000","scrub_duration":0.003418333,"objects_trimmed":0,"snaptrim_duration":0.025775551000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"51'276","reported_seq":345,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:22.893237+0000","last_change":"2023-11-28T21:05:28.525091+0000","last_active":"2023-11-28T21:06:22.893237+0000","last_peered":"2023-11-28T21:06:22.893237+0000","last_clean":"2023-11-28T21:06:22.893237+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T21:06:22.893237+0000","last_undegraded":"2023-11-28T21:06:22.893237+0000","last_fullsized":"2023-11-28T21:06:22.893237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'276","last_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_deep_scrub":"51'276","last_deep_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_clean_scrub_stamp":"2023-11-28T21:05:28.524974+0000","objects_scrubbed":17,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:41:23.890866+0000","scrub_duration":0.056500518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":212,"num_write_kb":24764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84018,"num_omap_keys":160,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"51'1827","reported_seq":3721,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:04.600423+0000","last_change":"2023-11-28T21:06:00.938959+0000","last_active":"2023-11-28T21:06:04.600423+0000","last_peered":"2023-11-28T21:06:04.600423+0000","last_clean":"2023-11-28T21:06:04.600423+0000","last_became_active":"2023-11-28T20:39:01.570987+0000","last_became_peered":"2023-11-28T20:39:01.570987+0000","last_unstale":"2023-11-28T21:06:04.600423+0000","last_undegraded":"2023-11-28T21:06:04.600423+0000","last_fullsized":"2023-11-28T21:06:04.600423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1827","last_scrub_stamp":"2023-11-28T21:06:00.938820+0000","last_deep_scrub":"51'1827","last_deep_scrub_stamp":"2023-11-28T21:06:00.938820+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.938820+0000","objects_scrubbed":551,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:29.062000+0000","scrub_duration":0.35707936699999998,"objects_trimmed":0,"snaptrim_duration":0.0017641899999999999,"stat_sum":{"num_bytes":29603349,"num_objects":551,"num_object_clones":257,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":257,"num_read":32,"num_read_kb":32,"num_write":1550,"num_write_kb":37188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"51'420","reported_seq":2524,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:37.005805+0000","last_change":"2023-11-28T21:05:37.005805+0000","last_active":"2023-11-28T21:05:37.005805+0000","last_peered":"2023-11-28T21:05:37.005805+0000","last_clean":"2023-11-28T21:05:37.005805+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T21:05:37.005805+0000","last_undegraded":"2023-11-28T21:05:37.005805+0000","last_fullsized":"2023-11-28T21:05:37.005805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'420","last_scrub_stamp":"2023-11-28T21:05:37.005456+0000","last_deep_scrub":"51'420","last_deep_scrub_stamp":"2023-11-28T21:05:37.005456+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.005456+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:00:05.751633+0000","scrub_duration":0.003608899,"objects_trimmed":0,"snaptrim_duration":0.010944188000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"52'438","reported_seq":505,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:21.018324+0000","last_change":"2023-11-28T21:05:45.190222+0000","last_active":"2023-11-28T21:06:21.018324+0000","last_peered":"2023-11-28T21:06:21.018324+0000","last_clean":"2023-11-28T21:06:21.018324+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T21:06:21.018324+0000","last_undegraded":"2023-11-28T21:06:21.018324+0000","last_fullsized":"2023-11-28T21:06:21.018324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'437","last_scrub_stamp":"2023-11-28T21:05:45.189981+0000","last_deep_scrub":"51'437","last_deep_scrub_stamp":"2023-11-28T21:05:45.189981+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.189981+0000","objects_scrubbed":17,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:10:13.180761+0000","scrub_duration":0.065732793999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":3,"num_read_kb":4106,"num_write":379,"num_write_kb":16755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99502,"num_omap_keys":179,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"51'1754","reported_seq":3662,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:13.048999+0000","last_change":"2023-11-28T21:06:13.048999+0000","last_active":"2023-11-28T21:06:13.048999+0000","last_peered":"2023-11-28T21:06:13.048999+0000","last_clean":"2023-11-28T21:06:13.048999+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T21:06:13.048999+0000","last_undegraded":"2023-11-28T21:06:13.048999+0000","last_fullsized":"2023-11-28T21:06:13.048999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1754","last_scrub_stamp":"2023-11-28T21:06:13.048812+0000","last_deep_scrub":"51'1754","last_deep_scrub_stamp":"2023-11-28T21:06:13.048812+0000","last_clean_scrub_stamp":"2023-11-28T21:06:13.048812+0000","objects_scrubbed":547,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:30:01.450632+0000","scrub_duration":0.34026673299999999,"objects_trimmed":0,"snaptrim_duration":0.012892727999999999,"stat_sum":{"num_bytes":30726234,"num_objects":547,"num_object_clones":244,"num_object_copies":2188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":244,"num_read":30,"num_read_kb":7398,"num_write":1499,"num_write_kb":38104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'416","reported_seq":2521,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.950857+0000","last_change":"2023-11-28T21:05:49.697230+0000","last_active":"2023-11-28T21:06:14.950857+0000","last_peered":"2023-11-28T21:06:14.950857+0000","last_clean":"2023-11-28T21:06:14.950857+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T21:06:14.950857+0000","last_undegraded":"2023-11-28T21:06:14.950857+0000","last_fullsized":"2023-11-28T21:06:14.950857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'416","last_scrub_stamp":"2023-11-28T21:05:49.697078+0000","last_deep_scrub":"51'416","last_deep_scrub_stamp":"2023-11-28T21:05:49.697078+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.697078+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:01.881093+0000","scrub_duration":0.001761695,"objects_trimmed":0,"snaptrim_duration":0.0088104640000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"52'928","reported_seq":1433,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:22.172110+0000","last_change":"2023-11-28T21:05:45.482078+0000","last_active":"2023-11-28T21:06:22.172110+0000","last_peered":"2023-11-28T21:06:22.172110+0000","last_clean":"2023-11-28T21:06:22.172110+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T21:06:22.172110+0000","last_undegraded":"2023-11-28T21:06:22.172110+0000","last_fullsized":"2023-11-28T21:06:22.172110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'927","last_scrub_stamp":"2023-11-28T21:05:45.481954+0000","last_deep_scrub":"51'927","last_deep_scrub_stamp":"2023-11-28T21:05:45.481954+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.481954+0000","objects_scrubbed":23,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:59.711334+0000","scrub_duration":0.067817884999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26750948,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":440,"num_read_kb":13478,"num_write":847,"num_write_kb":26791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106245,"num_omap_keys":198,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"51'1696","reported_seq":3595,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:19.989425+0000","last_change":"2023-11-28T21:06:19.989450+0000","last_active":"2023-11-28T21:06:19.989425+0000","last_peered":"2023-11-28T21:06:19.989425+0000","last_clean":"2023-11-28T21:06:19.989425+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T21:06:19.989425+0000","last_undegraded":"2023-11-28T21:06:19.989425+0000","last_fullsized":"2023-11-28T21:06:19.989425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1696","last_scrub_stamp":"2023-11-28T21:06:19.989316+0000","last_deep_scrub":"51'1696","last_deep_scrub_stamp":"2023-11-28T21:06:19.989316+0000","last_clean_scrub_stamp":"2023-11-28T21:06:19.989316+0000","objects_scrubbed":545,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:57.876603+0000","scrub_duration":0.28222937199999998,"objects_trimmed":0,"snaptrim_duration":0.011744523999999999,"stat_sum":{"num_bytes":4888539,"num_objects":545,"num_object_clones":249,"num_object_copies":2180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":249,"num_read":26,"num_read_kb":26,"num_write":1427,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'419","reported_seq":2523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:47.163684+0000","last_change":"2023-11-28T21:05:47.163684+0000","last_active":"2023-11-28T21:05:47.163684+0000","last_peered":"2023-11-28T21:05:47.163684+0000","last_clean":"2023-11-28T21:05:47.163684+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T21:05:47.163684+0000","last_undegraded":"2023-11-28T21:05:47.163684+0000","last_fullsized":"2023-11-28T21:05:47.163684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'419","last_scrub_stamp":"2023-11-28T21:05:47.163561+0000","last_deep_scrub":"51'419","last_deep_scrub_stamp":"2023-11-28T21:05:47.163561+0000","last_clean_scrub_stamp":"2023-11-28T21:05:47.163561+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:21.174839+0000","scrub_duration":0.0032640490000000002,"objects_trimmed":0,"snaptrim_duration":0.013248289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"51'488","reported_seq":557,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:21.527595+0000","last_change":"2023-11-28T21:05:42.516251+0000","last_active":"2023-11-28T21:06:21.527595+0000","last_peered":"2023-11-28T21:06:21.527595+0000","last_clean":"2023-11-28T21:06:21.527595+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T21:06:21.527595+0000","last_undegraded":"2023-11-28T21:06:21.527595+0000","last_fullsized":"2023-11-28T21:06:21.527595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'488","last_scrub_stamp":"2023-11-28T21:05:42.515965+0000","last_deep_scrub":"51'488","last_deep_scrub_stamp":"2023-11-28T21:05:42.515965+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.515965+0000","objects_scrubbed":20,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:15.338394+0000","scrub_duration":0.076223933999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":421,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":59652,"num_omap_keys":113,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"51'1786","reported_seq":3703,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:07.753915+0000","last_change":"2023-11-28T21:06:07.753915+0000","last_active":"2023-11-28T21:06:07.753915+0000","last_peered":"2023-11-28T21:06:07.753915+0000","last_clean":"2023-11-28T21:06:07.753915+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T21:06:07.753915+0000","last_undegraded":"2023-11-28T21:06:07.753915+0000","last_fullsized":"2023-11-28T21:06:07.753915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1786","last_scrub_stamp":"2023-11-28T21:06:07.753763+0000","last_deep_scrub":"51'1786","last_deep_scrub_stamp":"2023-11-28T21:06:07.753763+0000","last_clean_scrub_stamp":"2023-11-28T21:06:07.753763+0000","objects_scrubbed":551,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:41.631390+0000","scrub_duration":0.27959615799999998,"objects_trimmed":0,"snaptrim_duration":0.013136992,"stat_sum":{"num_bytes":25033729,"num_objects":551,"num_object_clones":252,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":252,"num_read":47,"num_read_kb":4142,"num_write":1517,"num_write_kb":28607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'391","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.276216+0000","last_change":"2023-11-28T21:05:46.276216+0000","last_active":"2023-11-28T21:05:46.276216+0000","last_peered":"2023-11-28T21:05:46.276216+0000","last_clean":"2023-11-28T21:05:46.276216+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T21:05:46.276216+0000","last_undegraded":"2023-11-28T21:05:46.276216+0000","last_fullsized":"2023-11-28T21:05:46.276216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'391","last_scrub_stamp":"2023-11-28T21:05:46.276109+0000","last_deep_scrub":"51'391","last_deep_scrub_stamp":"2023-11-28T21:05:46.276109+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.276109+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:26:05.634209+0000","scrub_duration":0.0021140719999999998,"objects_trimmed":0,"snaptrim_duration":0.015322676,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'371","reported_seq":441,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.374501+0000","last_change":"2023-11-28T21:05:39.292032+0000","last_active":"2023-11-28T21:06:20.374501+0000","last_peered":"2023-11-28T21:06:20.374501+0000","last_clean":"2023-11-28T21:06:20.374501+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T21:06:20.374501+0000","last_undegraded":"2023-11-28T21:06:20.374501+0000","last_fullsized":"2023-11-28T21:06:20.374501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'371","last_scrub_stamp":"2023-11-28T21:05:39.291779+0000","last_deep_scrub":"51'371","last_deep_scrub_stamp":"2023-11-28T21:05:39.291779+0000","last_clean_scrub_stamp":"2023-11-28T21:05:39.291779+0000","objects_scrubbed":18,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:03.495198+0000","scrub_duration":0.051458515000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":8214,"num_write":319,"num_write_kb":12656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":86488,"num_omap_keys":124,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"51'119","reported_seq":221,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.943980+0000","last_change":"2023-11-28T21:05:34.550643+0000","last_active":"2023-11-28T21:06:14.943980+0000","last_peered":"2023-11-28T21:06:14.943980+0000","last_clean":"2023-11-28T21:06:14.943980+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T21:06:14.943980+0000","last_undegraded":"2023-11-28T21:06:14.943980+0000","last_fullsized":"2023-11-28T21:06:14.943980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'119","last_scrub_stamp":"2023-11-28T21:05:34.550372+0000","last_deep_scrub":"51'119","last_deep_scrub_stamp":"2023-11-28T21:05:34.550372+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.550372+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:36.261369+0000","scrub_duration":0.0093084229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1795","reported_seq":3693,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:07.396262+0000","last_change":"2023-11-28T21:06:07.396262+0000","last_active":"2023-11-28T21:06:07.396262+0000","last_peered":"2023-11-28T21:06:07.396262+0000","last_clean":"2023-11-28T21:06:07.396262+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T21:06:07.396262+0000","last_undegraded":"2023-11-28T21:06:07.396262+0000","last_fullsized":"2023-11-28T21:06:07.396262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1795","last_scrub_stamp":"2023-11-28T21:06:07.396108+0000","last_deep_scrub":"51'1795","last_deep_scrub_stamp":"2023-11-28T21:06:07.396108+0000","last_clean_scrub_stamp":"2023-11-28T21:06:07.396108+0000","objects_scrubbed":563,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:29:39.329391+0000","scrub_duration":0.37906948899999998,"objects_trimmed":0,"snaptrim_duration":0.012304083,"stat_sum":{"num_bytes":50974055,"num_objects":563,"num_object_clones":255,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":255,"num_read":30,"num_read_kb":4125,"num_write":1519,"num_write_kb":57288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"51'375","reported_seq":2478,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:53.325977+0000","last_change":"2023-11-28T21:05:53.325977+0000","last_active":"2023-11-28T21:05:53.325977+0000","last_peered":"2023-11-28T21:05:53.325977+0000","last_clean":"2023-11-28T21:05:53.325977+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T21:05:53.325977+0000","last_undegraded":"2023-11-28T21:05:53.325977+0000","last_fullsized":"2023-11-28T21:05:53.325977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'375","last_scrub_stamp":"2023-11-28T21:05:53.325669+0000","last_deep_scrub":"51'375","last_deep_scrub_stamp":"2023-11-28T21:05:53.325669+0000","last_clean_scrub_stamp":"2023-11-28T21:05:53.325669+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:31:36.453431+0000","scrub_duration":0.0035168999999999999,"objects_trimmed":0,"snaptrim_duration":0.027789237000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"51'234","reported_seq":301,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.940116+0000","last_change":"2023-11-28T21:05:38.489305+0000","last_active":"2023-11-28T21:06:14.940116+0000","last_peered":"2023-11-28T21:06:14.940116+0000","last_clean":"2023-11-28T21:06:14.940116+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T21:06:14.940116+0000","last_undegraded":"2023-11-28T21:06:14.940116+0000","last_fullsized":"2023-11-28T21:06:14.940116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'234","last_scrub_stamp":"2023-11-28T21:05:38.489165+0000","last_deep_scrub":"51'234","last_deep_scrub_stamp":"2023-11-28T21:05:38.489165+0000","last_clean_scrub_stamp":"2023-11-28T21:05:38.489165+0000","objects_scrubbed":22,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:13.325917+0000","scrub_duration":0.055655635000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777798,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":5,"num_read_kb":4111,"num_write":164,"num_write_kb":16643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":100904,"num_omap_keys":180,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"51'1783","reported_seq":3696,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.360509+0000","last_change":"2023-11-28T21:06:01.360509+0000","last_active":"2023-11-28T21:06:01.360509+0000","last_peered":"2023-11-28T21:06:01.360509+0000","last_clean":"2023-11-28T21:06:01.360509+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T21:06:01.360509+0000","last_undegraded":"2023-11-28T21:06:01.360509+0000","last_fullsized":"2023-11-28T21:06:01.360509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1783","last_scrub_stamp":"2023-11-28T21:06:01.360370+0000","last_deep_scrub":"51'1783","last_deep_scrub_stamp":"2023-11-28T21:06:01.360370+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.360370+0000","objects_scrubbed":536,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:39.318206+0000","scrub_duration":1.2571291090000001,"objects_trimmed":0,"snaptrim_duration":0.016877468,"stat_sum":{"num_bytes":24953790,"num_objects":536,"num_object_clones":250,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":250,"num_read":41,"num_read_kb":41,"num_write":1520,"num_write_kb":33586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"51'453","reported_seq":2556,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:52.212215+0000","last_change":"2023-11-28T21:05:52.212215+0000","last_active":"2023-11-28T21:05:52.212215+0000","last_peered":"2023-11-28T21:05:52.212215+0000","last_clean":"2023-11-28T21:05:52.212215+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T21:05:52.212215+0000","last_undegraded":"2023-11-28T21:05:52.212215+0000","last_fullsized":"2023-11-28T21:05:52.212215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'453","last_scrub_stamp":"2023-11-28T21:05:52.211875+0000","last_deep_scrub":"51'453","last_deep_scrub_stamp":"2023-11-28T21:05:52.211875+0000","last_clean_scrub_stamp":"2023-11-28T21:05:52.211875+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:44.912509+0000","scrub_duration":0.0042240020000000001,"objects_trimmed":0,"snaptrim_duration":0.020341659000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"52'412","reported_seq":478,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:21.910474+0000","last_change":"2023-11-28T21:05:34.581615+0000","last_active":"2023-11-28T21:06:21.910474+0000","last_peered":"2023-11-28T21:06:21.910474+0000","last_clean":"2023-11-28T21:06:21.910474+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T21:06:21.910474+0000","last_undegraded":"2023-11-28T21:06:21.910474+0000","last_fullsized":"2023-11-28T21:06:21.910474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:34.581495+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:34.581495+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.581495+0000","objects_scrubbed":18,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:15.488699+0000","scrub_duration":0.059633824000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777286,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":4105,"num_write":342,"num_write_kb":16717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76134,"num_omap_keys":129,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"51'1767","reported_seq":3676,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:58.681668+0000","last_change":"2023-11-28T21:05:58.681668+0000","last_active":"2023-11-28T21:05:58.681668+0000","last_peered":"2023-11-28T21:05:58.681668+0000","last_clean":"2023-11-28T21:05:58.681668+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T21:05:58.681668+0000","last_undegraded":"2023-11-28T21:05:58.681668+0000","last_fullsized":"2023-11-28T21:05:58.681668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1767","last_scrub_stamp":"2023-11-28T21:05:58.681536+0000","last_deep_scrub":"51'1767","last_deep_scrub_stamp":"2023-11-28T21:05:58.681536+0000","last_clean_scrub_stamp":"2023-11-28T21:05:58.681536+0000","objects_scrubbed":542,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:52.399186+0000","scrub_duration":0.34306325599999998,"objects_trimmed":0,"snaptrim_duration":0.014814858,"stat_sum":{"num_bytes":20638408,"num_objects":542,"num_object_clones":251,"num_object_copies":2168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":251,"num_read":37,"num_read_kb":37,"num_write":1496,"num_write_kb":31881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"51'403","reported_seq":2506,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.429860+0000","last_change":"2023-11-28T21:06:14.429860+0000","last_active":"2023-11-28T21:06:14.429860+0000","last_peered":"2023-11-28T21:06:14.429860+0000","last_clean":"2023-11-28T21:06:14.429860+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T21:06:14.429860+0000","last_undegraded":"2023-11-28T21:06:14.429860+0000","last_fullsized":"2023-11-28T21:06:14.429860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'403","last_scrub_stamp":"2023-11-28T21:06:14.429591+0000","last_deep_scrub":"51'403","last_deep_scrub_stamp":"2023-11-28T21:06:14.429591+0000","last_clean_scrub_stamp":"2023-11-28T21:06:14.429591+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:13.586769+0000","scrub_duration":0.0036556269999999998,"objects_trimmed":0,"snaptrim_duration":0.017837387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"51'392","reported_seq":460,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.940139+0000","last_change":"2023-11-28T21:05:33.538219+0000","last_active":"2023-11-28T21:06:14.940139+0000","last_peered":"2023-11-28T21:06:14.940139+0000","last_clean":"2023-11-28T21:06:14.940139+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T21:06:14.940139+0000","last_undegraded":"2023-11-28T21:06:14.940139+0000","last_fullsized":"2023-11-28T21:06:14.940139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'392","last_scrub_stamp":"2023-11-28T21:05:33.538069+0000","last_deep_scrub":"51'392","last_deep_scrub_stamp":"2023-11-28T21:05:33.538069+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.538069+0000","objects_scrubbed":21,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:56.665928+0000","scrub_duration":0.051903592999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":7,"num_read_kb":4118,"num_write":339,"num_write_kb":16887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":98369,"num_omap_keys":186,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"51'1847","reported_seq":3733,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:29.483674+0000","last_change":"2023-11-28T20:44:35.610893+0000","last_active":"2023-11-28T21:05:29.483674+0000","last_peered":"2023-11-28T21:05:29.483674+0000","last_clean":"2023-11-28T21:05:29.483674+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T21:05:29.483674+0000","last_undegraded":"2023-11-28T21:05:29.483674+0000","last_fullsized":"2023-11-28T21:05:29.483674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015179433000000001,"stat_sum":{"num_bytes":40252075,"num_objects":555,"num_object_clones":243,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":243,"num_read":37,"num_read_kb":1813,"num_write":1586,"num_write_kb":49527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"51'398","reported_seq":2501,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:59.226601+0000","last_change":"2023-11-28T21:05:59.226601+0000","last_active":"2023-11-28T21:05:59.226601+0000","last_peered":"2023-11-28T21:05:59.226601+0000","last_clean":"2023-11-28T21:05:59.226601+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T21:05:59.226601+0000","last_undegraded":"2023-11-28T21:05:59.226601+0000","last_fullsized":"2023-11-28T21:05:59.226601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'398","last_scrub_stamp":"2023-11-28T21:05:59.226364+0000","last_deep_scrub":"51'398","last_deep_scrub_stamp":"2023-11-28T21:05:59.226364+0000","last_clean_scrub_stamp":"2023-11-28T21:05:59.226364+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:38:10.027325+0000","scrub_duration":0.0033335109999999999,"objects_trimmed":0,"snaptrim_duration":0.018023955000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"52'420","reported_seq":487,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:23.410419+0000","last_change":"2023-11-28T21:05:30.052590+0000","last_active":"2023-11-28T21:06:23.410419+0000","last_peered":"2023-11-28T21:06:23.410419+0000","last_clean":"2023-11-28T21:06:23.410419+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T21:06:23.410419+0000","last_undegraded":"2023-11-28T21:06:23.410419+0000","last_fullsized":"2023-11-28T21:06:23.410419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:05:30.052426+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:05:30.052426+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.052426+0000","objects_scrubbed":18,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:50.919481+0000","scrub_duration":0.059053013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094443,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":6359,"num_write":658,"num_write_kb":19633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":68276,"num_omap_keys":142,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"51'1788","reported_seq":3690,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:48.411833+0000","last_change":"2023-11-28T21:05:48.411833+0000","last_active":"2023-11-28T21:05:48.411833+0000","last_peered":"2023-11-28T21:05:48.411833+0000","last_clean":"2023-11-28T21:05:48.411833+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T21:05:48.411833+0000","last_undegraded":"2023-11-28T21:05:48.411833+0000","last_fullsized":"2023-11-28T21:05:48.411833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1788","last_scrub_stamp":"2023-11-28T21:05:48.411642+0000","last_deep_scrub":"51'1788","last_deep_scrub_stamp":"2023-11-28T21:05:48.411642+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.411642+0000","objects_scrubbed":550,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:56.054395+0000","scrub_duration":0.44116404300000001,"objects_trimmed":0,"snaptrim_duration":0.0090848279999999997,"stat_sum":{"num_bytes":25858877,"num_objects":550,"num_object_clones":249,"num_object_copies":2200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":550,"num_whiteouts":249,"num_read":30,"num_read_kb":4125,"num_write":1526,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"51'442","reported_seq":2545,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.943544+0000","last_change":"2023-11-28T21:05:57.251995+0000","last_active":"2023-11-28T21:06:14.943544+0000","last_peered":"2023-11-28T21:06:14.943544+0000","last_clean":"2023-11-28T21:06:14.943544+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T21:06:14.943544+0000","last_undegraded":"2023-11-28T21:06:14.943544+0000","last_fullsized":"2023-11-28T21:06:14.943544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'442","last_scrub_stamp":"2023-11-28T21:05:57.251745+0000","last_deep_scrub":"51'442","last_deep_scrub_stamp":"2023-11-28T21:05:57.251745+0000","last_clean_scrub_stamp":"2023-11-28T21:05:57.251745+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:45.560688+0000","scrub_duration":0.0038352299999999998,"objects_trimmed":0,"snaptrim_duration":0.020570496000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"52'658","reported_seq":723,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:19.603737+0000","last_change":"2023-11-28T21:05:41.430262+0000","last_active":"2023-11-28T21:06:19.603737+0000","last_peered":"2023-11-28T21:06:19.603737+0000","last_clean":"2023-11-28T21:06:19.603737+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T21:06:19.603737+0000","last_undegraded":"2023-11-28T21:06:19.603737+0000","last_fullsized":"2023-11-28T21:06:19.603737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'657","last_scrub_stamp":"2023-11-28T21:05:41.430137+0000","last_deep_scrub":"51'657","last_deep_scrub_stamp":"2023-11-28T21:05:41.430137+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.430137+0000","objects_scrubbed":24,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:12:56.869809+0000","scrub_duration":0.042827776999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":7,"num_write":598,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":62330,"num_omap_keys":118,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"51'1723","reported_seq":3650,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:57.622219+0000","last_change":"2023-11-28T21:05:57.622219+0000","last_active":"2023-11-28T21:05:57.622219+0000","last_peered":"2023-11-28T21:05:57.622219+0000","last_clean":"2023-11-28T21:05:57.622219+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T21:05:57.622219+0000","last_undegraded":"2023-11-28T21:05:57.622219+0000","last_fullsized":"2023-11-28T21:05:57.622219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1723","last_scrub_stamp":"2023-11-28T21:05:57.622068+0000","last_deep_scrub":"51'1723","last_deep_scrub_stamp":"2023-11-28T21:05:57.622068+0000","last_clean_scrub_stamp":"2023-11-28T21:05:57.622068+0000","objects_scrubbed":524,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:16.174973+0000","scrub_duration":0.29220352900000002,"objects_trimmed":0,"snaptrim_duration":0.011806407999999999,"stat_sum":{"num_bytes":28712373,"num_objects":524,"num_object_clones":239,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":239,"num_read":46,"num_read_kb":46,"num_write":1462,"num_write_kb":31285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"51'407","reported_seq":2510,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.968623+0000","last_change":"2023-11-28T21:05:44.161668+0000","last_active":"2023-11-28T21:06:14.968623+0000","last_peered":"2023-11-28T21:06:14.968623+0000","last_clean":"2023-11-28T21:06:14.968623+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T21:06:14.968623+0000","last_undegraded":"2023-11-28T21:06:14.968623+0000","last_fullsized":"2023-11-28T21:06:14.968623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'407","last_scrub_stamp":"2023-11-28T21:05:44.161256+0000","last_deep_scrub":"51'407","last_deep_scrub_stamp":"2023-11-28T21:05:44.161256+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.161256+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:10.673180+0000","scrub_duration":0.0042608810000000002,"objects_trimmed":0,"snaptrim_duration":0.014629055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"51'473","reported_seq":540,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.609766+0000","last_change":"2023-11-28T21:05:33.374328+0000","last_active":"2023-11-28T21:06:20.609766+0000","last_peered":"2023-11-28T21:06:20.609766+0000","last_clean":"2023-11-28T21:06:20.609766+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T21:06:20.609766+0000","last_undegraded":"2023-11-28T21:06:20.609766+0000","last_fullsized":"2023-11-28T21:06:20.609766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'473","last_scrub_stamp":"2023-11-28T21:05:33.374073+0000","last_deep_scrub":"51'473","last_deep_scrub_stamp":"2023-11-28T21:05:33.374073+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.374073+0000","objects_scrubbed":15,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:57:31.084888+0000","scrub_duration":0.075804628999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":416,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":57473,"num_omap_keys":100,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"51'1831","reported_seq":3732,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:12.821411+0000","last_change":"2023-11-28T21:06:12.821411+0000","last_active":"2023-11-28T21:06:12.821411+0000","last_peered":"2023-11-28T21:06:12.821411+0000","last_clean":"2023-11-28T21:06:12.821411+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T21:06:12.821411+0000","last_undegraded":"2023-11-28T21:06:12.821411+0000","last_fullsized":"2023-11-28T21:06:12.821411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1831","last_scrub_stamp":"2023-11-28T21:06:12.821221+0000","last_deep_scrub":"51'1831","last_deep_scrub_stamp":"2023-11-28T21:06:12.821221+0000","last_clean_scrub_stamp":"2023-11-28T21:06:12.821221+0000","objects_scrubbed":572,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:11.692677+0000","scrub_duration":0.38320025200000002,"objects_trimmed":0,"snaptrim_duration":0.017596898999999999,"stat_sum":{"num_bytes":20840070,"num_objects":572,"num_object_clones":259,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":259,"num_read":39,"num_read_kb":4134,"num_write":1549,"num_write_kb":33741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"51'411","reported_seq":2514,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.944309+0000","last_change":"2023-11-28T21:05:52.355786+0000","last_active":"2023-11-28T21:06:14.944309+0000","last_peered":"2023-11-28T21:06:14.944309+0000","last_clean":"2023-11-28T21:06:14.944309+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T21:06:14.944309+0000","last_undegraded":"2023-11-28T21:06:14.944309+0000","last_fullsized":"2023-11-28T21:06:14.944309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:52.355472+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:52.355472+0000","last_clean_scrub_stamp":"2023-11-28T21:05:52.355472+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:37.533653+0000","scrub_duration":0.003268642,"objects_trimmed":0,"snaptrim_duration":0.019240779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"51'299","reported_seq":366,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.625361+0000","last_change":"2023-11-28T21:05:43.228912+0000","last_active":"2023-11-28T21:06:20.625361+0000","last_peered":"2023-11-28T21:06:20.625361+0000","last_clean":"2023-11-28T21:06:20.625361+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T21:06:20.625361+0000","last_undegraded":"2023-11-28T21:06:20.625361+0000","last_fullsized":"2023-11-28T21:06:20.625361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'299","last_scrub_stamp":"2023-11-28T21:05:43.228655+0000","last_deep_scrub":"51'299","last_deep_scrub_stamp":"2023-11-28T21:05:43.228655+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.228655+0000","objects_scrubbed":15,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:39:18.023290+0000","scrub_duration":0.053656686000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":8208,"num_write":238,"num_write_kb":12572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73750,"num_omap_keys":139,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"51'1661","reported_seq":3579,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:10.763802+0000","last_change":"2023-11-28T21:06:10.763802+0000","last_active":"2023-11-28T21:06:10.763802+0000","last_peered":"2023-11-28T21:06:10.763802+0000","last_clean":"2023-11-28T21:06:10.763802+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T21:06:10.763802+0000","last_undegraded":"2023-11-28T21:06:10.763802+0000","last_fullsized":"2023-11-28T21:06:10.763802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1661","last_scrub_stamp":"2023-11-28T21:06:10.763688+0000","last_deep_scrub":"51'1661","last_deep_scrub_stamp":"2023-11-28T21:06:10.763688+0000","last_clean_scrub_stamp":"2023-11-28T21:06:10.763688+0000","objects_scrubbed":524,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:25.727299+0000","scrub_duration":0.327626743,"objects_trimmed":0,"snaptrim_duration":0.018495173,"stat_sum":{"num_bytes":20919340,"num_objects":524,"num_object_clones":235,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":235,"num_read":33,"num_read_kb":33,"num_write":1415,"num_write_kb":40695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"51'413","reported_seq":2516,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.966939+0000","last_change":"2023-11-28T21:05:30.162003+0000","last_active":"2023-11-28T21:06:14.966939+0000","last_peered":"2023-11-28T21:06:14.966939+0000","last_clean":"2023-11-28T21:06:14.966939+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T21:06:14.966939+0000","last_undegraded":"2023-11-28T21:06:14.966939+0000","last_fullsized":"2023-11-28T21:06:14.966939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'413","last_scrub_stamp":"2023-11-28T21:05:30.161904+0000","last_deep_scrub":"51'413","last_deep_scrub_stamp":"2023-11-28T21:05:30.161904+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.161904+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:00.574298+0000","scrub_duration":0.0026842540000000001,"objects_trimmed":0,"snaptrim_duration":0.014112118999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"51'422","reported_seq":488,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:22.939398+0000","last_change":"2023-11-28T21:05:31.170458+0000","last_active":"2023-11-28T21:06:22.939398+0000","last_peered":"2023-11-28T21:06:22.939398+0000","last_clean":"2023-11-28T21:06:22.939398+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T21:06:22.939398+0000","last_undegraded":"2023-11-28T21:06:22.939398+0000","last_fullsized":"2023-11-28T21:06:22.939398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'422","last_scrub_stamp":"2023-11-28T21:05:31.170251+0000","last_deep_scrub":"51'422","last_deep_scrub_stamp":"2023-11-28T21:05:31.170251+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.170251+0000","objects_scrubbed":17,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:48.673212+0000","scrub_duration":0.054918677999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":364,"num_write_kb":16779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":77628,"num_omap_keys":149,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"51'1691","reported_seq":3586,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:29.483698+0000","last_change":"2023-11-28T20:44:35.613305+0000","last_active":"2023-11-28T21:05:29.483698+0000","last_peered":"2023-11-28T21:05:29.483698+0000","last_clean":"2023-11-28T21:05:29.483698+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T21:05:29.483698+0000","last_undegraded":"2023-11-28T21:05:29.483698+0000","last_fullsized":"2023-11-28T21:05:29.483698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T20:38:22.532017+0000","last_clean_scrub_stamp":"2023-11-28T20:38:22.532017+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015550285,"stat_sum":{"num_bytes":33895761,"num_objects":515,"num_object_clones":224,"num_object_copies":2060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515,"num_whiteouts":224,"num_read":28,"num_read_kb":28,"num_write":1451,"num_write_kb":37503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"51'394","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:33.531160+0000","last_change":"2023-11-28T21:05:33.531160+0000","last_active":"2023-11-28T21:05:33.531160+0000","last_peered":"2023-11-28T21:05:33.531160+0000","last_clean":"2023-11-28T21:05:33.531160+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T21:05:33.531160+0000","last_undegraded":"2023-11-28T21:05:33.531160+0000","last_fullsized":"2023-11-28T21:05:33.531160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:33.530916+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:33.530916+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.530916+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:51.990509+0000","scrub_duration":0.00324325,"objects_trimmed":0,"snaptrim_duration":0.022690017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'585","reported_seq":650,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:22.670122+0000","last_change":"2023-11-28T21:05:36.348768+0000","last_active":"2023-11-28T21:06:22.670122+0000","last_peered":"2023-11-28T21:06:22.670122+0000","last_clean":"2023-11-28T21:06:22.670122+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T21:06:22.670122+0000","last_undegraded":"2023-11-28T21:06:22.670122+0000","last_fullsized":"2023-11-28T21:06:22.670122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'585","last_scrub_stamp":"2023-11-28T21:05:36.348472+0000","last_deep_scrub":"51'585","last_deep_scrub_stamp":"2023-11-28T21:05:36.348472+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.348472+0000","objects_scrubbed":19,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:44:00.211075+0000","scrub_duration":0.085323616000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":504,"num_write_kb":24942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82322,"num_omap_keys":142,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"51'1823","reported_seq":3726,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.950970+0000","last_change":"2023-11-28T21:06:04.982984+0000","last_active":"2023-11-28T21:06:14.950970+0000","last_peered":"2023-11-28T21:06:14.950970+0000","last_clean":"2023-11-28T21:06:14.950970+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T21:06:14.950970+0000","last_undegraded":"2023-11-28T21:06:14.950970+0000","last_fullsized":"2023-11-28T21:06:14.950970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1823","last_scrub_stamp":"2023-11-28T21:06:04.982842+0000","last_deep_scrub":"51'1823","last_deep_scrub_stamp":"2023-11-28T21:06:04.982842+0000","last_clean_scrub_stamp":"2023-11-28T21:06:04.982842+0000","objects_scrubbed":556,"log_size":1823,"log_dups_size":0,"ondisk_log_size":1823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:30:42.213272+0000","scrub_duration":0.30750132200000002,"objects_trimmed":0,"snaptrim_duration":0.013090108,"stat_sum":{"num_bytes":42607549,"num_objects":556,"num_object_clones":254,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":254,"num_read":36,"num_read_kb":4131,"num_write":1543,"num_write_kb":57518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"51'388","reported_seq":2483,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:12.520851+0000","last_change":"2023-11-28T21:06:12.520851+0000","last_active":"2023-11-28T21:06:12.520851+0000","last_peered":"2023-11-28T21:06:12.520851+0000","last_clean":"2023-11-28T21:06:12.520851+0000","last_became_active":"2023-11-28T20:39:01.848225+0000","last_became_peered":"2023-11-28T20:39:01.848225+0000","last_unstale":"2023-11-28T21:06:12.520851+0000","last_undegraded":"2023-11-28T21:06:12.520851+0000","last_fullsized":"2023-11-28T21:06:12.520851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'388","last_scrub_stamp":"2023-11-28T21:06:12.520744+0000","last_deep_scrub":"51'388","last_deep_scrub_stamp":"2023-11-28T21:06:12.520744+0000","last_clean_scrub_stamp":"2023-11-28T21:06:12.520744+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:49.760120+0000","scrub_duration":0.0031430189999999999,"objects_trimmed":0,"snaptrim_duration":0.0019608149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'561","reported_seq":625,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.952737+0000","last_change":"2023-11-28T21:05:30.590054+0000","last_active":"2023-11-28T21:06:14.952737+0000","last_peered":"2023-11-28T21:06:14.952737+0000","last_clean":"2023-11-28T21:06:14.952737+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T21:06:14.952737+0000","last_undegraded":"2023-11-28T21:06:14.952737+0000","last_fullsized":"2023-11-28T21:06:14.952737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'561","last_scrub_stamp":"2023-11-28T21:05:30.589932+0000","last_deep_scrub":"51'561","last_deep_scrub_stamp":"2023-11-28T21:05:30.589932+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.589932+0000","objects_scrubbed":23,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:24:21.359666+0000","scrub_duration":0.070269200000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":502,"num_write_kb":21060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":120182,"num_omap_keys":228,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"51'1816","reported_seq":3740,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.961559+0000","last_change":"2023-11-28T21:05:42.324200+0000","last_active":"2023-11-28T21:06:14.961559+0000","last_peered":"2023-11-28T21:06:14.961559+0000","last_clean":"2023-11-28T21:06:14.961559+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T21:06:14.961559+0000","last_undegraded":"2023-11-28T21:06:14.961559+0000","last_fullsized":"2023-11-28T21:06:14.961559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1816","last_scrub_stamp":"2023-11-28T21:05:42.324029+0000","last_deep_scrub":"51'1816","last_deep_scrub_stamp":"2023-11-28T21:05:42.324029+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.324029+0000","objects_scrubbed":568,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:37.426481+0000","scrub_duration":0.39091050599999999,"objects_trimmed":0,"snaptrim_duration":0.010092998000000001,"stat_sum":{"num_bytes":33600436,"num_objects":568,"num_object_clones":254,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":254,"num_read":57,"num_read_kb":4152,"num_write":1538,"num_write_kb":45454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"51'410","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:49.207521+0000","last_change":"2023-11-28T21:05:49.207521+0000","last_active":"2023-11-28T21:05:49.207521+0000","last_peered":"2023-11-28T21:05:49.207521+0000","last_clean":"2023-11-28T21:05:49.207521+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T21:05:49.207521+0000","last_undegraded":"2023-11-28T21:05:49.207521+0000","last_fullsized":"2023-11-28T21:05:49.207521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'410","last_scrub_stamp":"2023-11-28T21:05:49.207417+0000","last_deep_scrub":"51'410","last_deep_scrub_stamp":"2023-11-28T21:05:49.207417+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.207417+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:00.311308+0000","scrub_duration":0.002803495,"objects_trimmed":0,"snaptrim_duration":0.011744874000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"51'506","reported_seq":572,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.273561+0000","last_change":"2023-11-28T21:05:44.276812+0000","last_active":"2023-11-28T21:06:20.273561+0000","last_peered":"2023-11-28T21:06:20.273561+0000","last_clean":"2023-11-28T21:06:20.273561+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T21:06:20.273561+0000","last_undegraded":"2023-11-28T21:06:20.273561+0000","last_fullsized":"2023-11-28T21:06:20.273561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'506","last_scrub_stamp":"2023-11-28T21:05:44.276499+0000","last_deep_scrub":"51'506","last_deep_scrub_stamp":"2023-11-28T21:05:44.276499+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.276499+0000","objects_scrubbed":22,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:33.316636+0000","scrub_duration":0.12046440999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":8219,"num_write":437,"num_write_kb":33175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130075,"num_omap_keys":234,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"51'1777","reported_seq":3703,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:18.714476+0000","last_change":"2023-11-28T21:06:18.714476+0000","last_active":"2023-11-28T21:06:18.714476+0000","last_peered":"2023-11-28T21:06:18.714476+0000","last_clean":"2023-11-28T21:06:18.714476+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T21:06:18.714476+0000","last_undegraded":"2023-11-28T21:06:18.714476+0000","last_fullsized":"2023-11-28T21:06:18.714476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1777","last_scrub_stamp":"2023-11-28T21:06:18.714278+0000","last_deep_scrub":"51'1777","last_deep_scrub_stamp":"2023-11-28T21:06:18.714278+0000","last_clean_scrub_stamp":"2023-11-28T21:06:18.714278+0000","objects_scrubbed":525,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:44.463407+0000","scrub_duration":0.31533417000000002,"objects_trimmed":0,"snaptrim_duration":0.018323326000000001,"stat_sum":{"num_bytes":24785841,"num_objects":525,"num_object_clones":238,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":238,"num_read":34,"num_read_kb":34,"num_write":1518,"num_write_kb":32579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"51'411","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.162153+0000","last_change":"2023-11-28T21:05:32.162153+0000","last_active":"2023-11-28T21:05:32.162153+0000","last_peered":"2023-11-28T21:05:32.162153+0000","last_clean":"2023-11-28T21:05:32.162153+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T21:05:32.162153+0000","last_undegraded":"2023-11-28T21:05:32.162153+0000","last_fullsized":"2023-11-28T21:05:32.162153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:32.161774+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:32.161774+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.161774+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:08.878532+0000","scrub_duration":0.0040654100000000002,"objects_trimmed":0,"snaptrim_duration":0.022293309000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"51'182","reported_seq":246,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.971553+0000","last_change":"2023-11-28T21:05:43.192141+0000","last_active":"2023-11-28T21:06:14.971553+0000","last_peered":"2023-11-28T21:06:14.971553+0000","last_clean":"2023-11-28T21:06:14.971553+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T21:06:14.971553+0000","last_undegraded":"2023-11-28T21:06:14.971553+0000","last_fullsized":"2023-11-28T21:06:14.971553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'182","last_scrub_stamp":"2023-11-28T21:05:43.191676+0000","last_deep_scrub":"51'182","last_deep_scrub_stamp":"2023-11-28T21:05:43.191676+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.191676+0000","objects_scrubbed":19,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:26.130737+0000","scrub_duration":0.043839175000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":125,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71130,"num_omap_keys":135,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"51'1914","reported_seq":3810,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.955518+0000","last_change":"2023-11-28T21:06:08.845464+0000","last_active":"2023-11-28T21:06:14.955518+0000","last_peered":"2023-11-28T21:06:14.955518+0000","last_clean":"2023-11-28T21:06:14.955518+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T21:06:14.955518+0000","last_undegraded":"2023-11-28T21:06:14.955518+0000","last_fullsized":"2023-11-28T21:06:14.955518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1914","last_scrub_stamp":"2023-11-28T21:06:08.845233+0000","last_deep_scrub":"51'1914","last_deep_scrub_stamp":"2023-11-28T21:06:08.845233+0000","last_clean_scrub_stamp":"2023-11-28T21:06:08.845233+0000","objects_scrubbed":583,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:20:09.557293+0000","scrub_duration":0.364030248,"objects_trimmed":0,"snaptrim_duration":0.016210088000000001,"stat_sum":{"num_bytes":26682582,"num_objects":583,"num_object_clones":263,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":583,"num_whiteouts":263,"num_read":39,"num_read_kb":8229,"num_write":1627,"num_write_kb":50263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"51'1808","reported_seq":3686,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:10.831997+0000","last_change":"2023-11-28T21:06:10.831997+0000","last_active":"2023-11-28T21:06:10.831997+0000","last_peered":"2023-11-28T21:06:10.831997+0000","last_clean":"2023-11-28T21:06:10.831997+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T21:06:10.831997+0000","last_undegraded":"2023-11-28T21:06:10.831997+0000","last_fullsized":"2023-11-28T21:06:10.831997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1808","last_scrub_stamp":"2023-11-28T21:06:10.831867+0000","last_deep_scrub":"51'1808","last_deep_scrub_stamp":"2023-11-28T21:06:10.831867+0000","last_clean_scrub_stamp":"2023-11-28T21:06:10.831867+0000","objects_scrubbed":589,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:38:48.507456+0000","scrub_duration":0.31114296499999999,"objects_trimmed":0,"snaptrim_duration":0.011090378999999999,"stat_sum":{"num_bytes":29341830,"num_objects":589,"num_object_clones":267,"num_object_copies":2356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":267,"num_read":21,"num_read_kb":21,"num_write":1524,"num_write_kb":32957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"51'411","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.649105+0000","last_change":"2023-11-28T21:06:00.649105+0000","last_active":"2023-11-28T21:06:00.649105+0000","last_peered":"2023-11-28T21:06:00.649105+0000","last_clean":"2023-11-28T21:06:00.649105+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T21:06:00.649105+0000","last_undegraded":"2023-11-28T21:06:00.649105+0000","last_fullsized":"2023-11-28T21:06:00.649105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:06:00.648992+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:06:00.648992+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.648992+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:44.955477+0000","scrub_duration":0.00140313,"objects_trimmed":0,"snaptrim_duration":0.0086681780000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"51'624","reported_seq":690,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.967215+0000","last_change":"2023-11-28T21:05:49.331811+0000","last_active":"2023-11-28T21:06:14.967215+0000","last_peered":"2023-11-28T21:06:14.967215+0000","last_clean":"2023-11-28T21:06:14.967215+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T21:06:14.967215+0000","last_undegraded":"2023-11-28T21:06:14.967215+0000","last_fullsized":"2023-11-28T21:06:14.967215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'624","last_scrub_stamp":"2023-11-28T21:05:49.331608+0000","last_deep_scrub":"51'624","last_deep_scrub_stamp":"2023-11-28T21:05:49.331608+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.331608+0000","objects_scrubbed":24,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:45:25.450650+0000","scrub_duration":0.152492033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":5,"num_read_kb":4129,"num_write":550,"num_write_kb":45433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106123,"num_omap_keys":201,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"51'1738","reported_seq":3645,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.408217+0000","last_change":"2023-11-28T21:06:01.408217+0000","last_active":"2023-11-28T21:06:01.408217+0000","last_peered":"2023-11-28T21:06:01.408217+0000","last_clean":"2023-11-28T21:06:01.408217+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T21:06:01.408217+0000","last_undegraded":"2023-11-28T21:06:01.408217+0000","last_fullsized":"2023-11-28T21:06:01.408217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1738","last_scrub_stamp":"2023-11-28T21:06:01.408067+0000","last_deep_scrub":"51'1738","last_deep_scrub_stamp":"2023-11-28T21:06:01.408067+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.408067+0000","objects_scrubbed":555,"log_size":1738,"log_dups_size":0,"ondisk_log_size":1738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:34.270910+0000","scrub_duration":0.28393545399999998,"objects_trimmed":0,"snaptrim_duration":0.016829818,"stat_sum":{"num_bytes":16566795,"num_objects":555,"num_object_clones":248,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":248,"num_read":32,"num_read_kb":32,"num_write":1476,"num_write_kb":23281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"51'447","reported_seq":2549,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:54.403912+0000","last_change":"2023-11-28T21:05:54.403912+0000","last_active":"2023-11-28T21:05:54.403912+0000","last_peered":"2023-11-28T21:05:54.403912+0000","last_clean":"2023-11-28T21:05:54.403912+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T21:05:54.403912+0000","last_undegraded":"2023-11-28T21:05:54.403912+0000","last_fullsized":"2023-11-28T21:05:54.403912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'447","last_scrub_stamp":"2023-11-28T21:05:54.403818+0000","last_deep_scrub":"51'447","last_deep_scrub_stamp":"2023-11-28T21:05:54.403818+0000","last_clean_scrub_stamp":"2023-11-28T21:05:54.403818+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:54.550566+0000","scrub_duration":0.00144692,"objects_trimmed":0,"snaptrim_duration":0.018571445999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"51'779","reported_seq":1337,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:21.402713+0000","last_change":"2023-11-28T21:05:40.356317+0000","last_active":"2023-11-28T21:06:21.402713+0000","last_peered":"2023-11-28T21:06:21.402713+0000","last_clean":"2023-11-28T21:06:21.402713+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T21:06:21.402713+0000","last_undegraded":"2023-11-28T21:06:21.402713+0000","last_fullsized":"2023-11-28T21:06:21.402713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'779","last_scrub_stamp":"2023-11-28T21:05:40.356117+0000","last_deep_scrub":"51'779","last_deep_scrub_stamp":"2023-11-28T21:05:40.356117+0000","last_clean_scrub_stamp":"2023-11-28T21:05:40.356117+0000","objects_scrubbed":21,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:37.255476+0000","scrub_duration":0.062204162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18014655,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":496,"num_read_kb":9760,"num_write":714,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":112125,"num_omap_keys":180,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"51'1133","reported_seq":1700,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.635468+0000","last_change":"2023-11-28T21:05:35.448895+0000","last_active":"2023-11-28T21:06:20.635468+0000","last_peered":"2023-11-28T21:06:20.635468+0000","last_clean":"2023-11-28T21:06:20.635468+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T21:06:20.635468+0000","last_undegraded":"2023-11-28T21:06:20.635468+0000","last_fullsized":"2023-11-28T21:06:20.635468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1133","last_scrub_stamp":"2023-11-28T21:05:35.448625+0000","last_deep_scrub":"51'1133","last_deep_scrub_stamp":"2023-11-28T21:05:35.448625+0000","last_clean_scrub_stamp":"2023-11-28T21:05:35.448625+0000","objects_scrubbed":28,"log_size":1133,"log_dups_size":0,"ondisk_log_size":1133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:29.305578+0000","scrub_duration":0.13673348099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34584852,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":505,"num_read_kb":13681,"num_write":1050,"num_write_kb":34570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":116270,"num_omap_keys":186,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"51'366","reported_seq":2468,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:48.430275+0000","last_change":"2023-11-28T21:05:34.102549+0000","last_active":"2023-11-28T21:05:48.430275+0000","last_peered":"2023-11-28T21:05:48.430275+0000","last_clean":"2023-11-28T21:05:48.430275+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T21:05:48.430275+0000","last_undegraded":"2023-11-28T21:05:48.430275+0000","last_fullsized":"2023-11-28T21:05:48.430275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'366","last_scrub_stamp":"2023-11-28T21:05:34.102426+0000","last_deep_scrub":"51'366","last_deep_scrub_stamp":"2023-11-28T21:05:34.102426+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.102426+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:05.296824+0000","scrub_duration":0.0029151789999999999,"objects_trimmed":0,"snaptrim_duration":0.014791248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"51'1725","reported_seq":3627,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:59.882197+0000","last_change":"2023-11-28T21:05:59.882197+0000","last_active":"2023-11-28T21:05:59.882197+0000","last_peered":"2023-11-28T21:05:59.882197+0000","last_clean":"2023-11-28T21:05:59.882197+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T21:05:59.882197+0000","last_undegraded":"2023-11-28T21:05:59.882197+0000","last_fullsized":"2023-11-28T21:05:59.882197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1725","last_scrub_stamp":"2023-11-28T21:05:59.882081+0000","last_deep_scrub":"51'1725","last_deep_scrub_stamp":"2023-11-28T21:05:59.882081+0000","last_clean_scrub_stamp":"2023-11-28T21:05:59.882081+0000","objects_scrubbed":543,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:27:37.396820+0000","scrub_duration":0.28759110399999999,"objects_trimmed":0,"snaptrim_duration":0.0022000169999999999,"stat_sum":{"num_bytes":29986576,"num_objects":543,"num_object_clones":248,"num_object_copies":2172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":248,"num_read":29,"num_read_kb":29,"num_write":1454,"num_write_kb":38376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"51'379","reported_seq":445,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.156269+0000","last_change":"2023-11-28T21:05:41.311875+0000","last_active":"2023-11-28T21:06:20.156269+0000","last_peered":"2023-11-28T21:06:20.156269+0000","last_clean":"2023-11-28T21:06:20.156269+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T21:06:20.156269+0000","last_undegraded":"2023-11-28T21:06:20.156269+0000","last_fullsized":"2023-11-28T21:06:20.156269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'379","last_scrub_stamp":"2023-11-28T21:05:41.311729+0000","last_deep_scrub":"51'379","last_deep_scrub_stamp":"2023-11-28T21:05:41.311729+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.311729+0000","objects_scrubbed":14,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:36:23.970191+0000","scrub_duration":0.046276848000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":307,"num_write_kb":20723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80718,"num_omap_keys":145,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"51'401","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.618049+0000","last_change":"2023-11-28T21:05:30.976527+0000","last_active":"2023-11-28T21:05:50.618049+0000","last_peered":"2023-11-28T21:05:50.618049+0000","last_clean":"2023-11-28T21:05:50.618049+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T21:05:50.618049+0000","last_undegraded":"2023-11-28T21:05:50.618049+0000","last_fullsized":"2023-11-28T21:05:50.618049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'401","last_scrub_stamp":"2023-11-28T21:05:30.976211+0000","last_deep_scrub":"51'401","last_deep_scrub_stamp":"2023-11-28T21:05:30.976211+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.976211+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:05.312126+0000","scrub_duration":0.003806191,"objects_trimmed":0,"snaptrim_duration":0.010086065,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"51'1756","reported_seq":3680,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.739682+0000","last_change":"2023-11-28T21:06:14.739682+0000","last_active":"2023-11-28T21:06:14.739682+0000","last_peered":"2023-11-28T21:06:14.739682+0000","last_clean":"2023-11-28T21:06:14.739682+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T21:06:14.739682+0000","last_undegraded":"2023-11-28T21:06:14.739682+0000","last_fullsized":"2023-11-28T21:06:14.739682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1756","last_scrub_stamp":"2023-11-28T21:06:14.739519+0000","last_deep_scrub":"51'1756","last_deep_scrub_stamp":"2023-11-28T21:06:14.739519+0000","last_clean_scrub_stamp":"2023-11-28T21:06:14.739519+0000","objects_scrubbed":521,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:16:42.351367+0000","scrub_duration":0.30613888500000003,"objects_trimmed":0,"snaptrim_duration":0.015656369999999999,"stat_sum":{"num_bytes":33768985,"num_objects":521,"num_object_clones":238,"num_object_copies":2084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":238,"num_read":45,"num_read_kb":12330,"num_write":1499,"num_write_kb":48802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"51'415","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.157704+0000","last_change":"2023-11-28T21:05:46.157704+0000","last_active":"2023-11-28T21:05:46.157704+0000","last_peered":"2023-11-28T21:05:46.157704+0000","last_clean":"2023-11-28T21:05:46.157704+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T21:05:46.157704+0000","last_undegraded":"2023-11-28T21:05:46.157704+0000","last_fullsized":"2023-11-28T21:05:46.157704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:46.157455+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:46.157455+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.157455+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:01.464161+0000","scrub_duration":0.0035157970000000002,"objects_trimmed":0,"snaptrim_duration":0.013289166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"51'439","reported_seq":2543,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.580370+0000","last_change":"2023-11-28T21:05:56.580370+0000","last_active":"2023-11-28T21:05:56.580370+0000","last_peered":"2023-11-28T21:05:56.580370+0000","last_clean":"2023-11-28T21:05:56.580370+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T21:05:56.580370+0000","last_undegraded":"2023-11-28T21:05:56.580370+0000","last_fullsized":"2023-11-28T21:05:56.580370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'439","last_scrub_stamp":"2023-11-28T21:05:56.580265+0000","last_deep_scrub":"51'439","last_deep_scrub_stamp":"2023-11-28T21:05:56.580265+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.580265+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:47.658268+0000","scrub_duration":0.002380643,"objects_trimmed":0,"snaptrim_duration":0.0017225739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"51'438","reported_seq":2542,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:51.180845+0000","last_change":"2023-11-28T21:05:51.180845+0000","last_active":"2023-11-28T21:05:51.180845+0000","last_peered":"2023-11-28T21:05:51.180845+0000","last_clean":"2023-11-28T21:05:51.180845+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T21:05:51.180845+0000","last_undegraded":"2023-11-28T21:05:51.180845+0000","last_fullsized":"2023-11-28T21:05:51.180845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'438","last_scrub_stamp":"2023-11-28T21:05:51.180603+0000","last_deep_scrub":"51'438","last_deep_scrub_stamp":"2023-11-28T21:05:51.180603+0000","last_clean_scrub_stamp":"2023-11-28T21:05:51.180603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:28:01.061034+0000","scrub_duration":0.003385809,"objects_trimmed":0,"snaptrim_duration":0.018881576000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"51'384","reported_seq":2488,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.256071+0000","last_change":"2023-11-28T21:05:50.256071+0000","last_active":"2023-11-28T21:05:50.256071+0000","last_peered":"2023-11-28T21:05:50.256071+0000","last_clean":"2023-11-28T21:05:50.256071+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T21:05:50.256071+0000","last_undegraded":"2023-11-28T21:05:50.256071+0000","last_fullsized":"2023-11-28T21:05:50.256071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'384","last_scrub_stamp":"2023-11-28T21:05:50.255966+0000","last_deep_scrub":"51'384","last_deep_scrub_stamp":"2023-11-28T21:05:50.255966+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.255966+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:17:07.873629+0000","scrub_duration":0.0014328069999999999,"objects_trimmed":0,"snaptrim_duration":0.014673739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"51'367","reported_seq":2471,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.956782+0000","last_change":"2023-11-28T21:05:37.282985+0000","last_active":"2023-11-28T21:06:14.956782+0000","last_peered":"2023-11-28T21:06:14.956782+0000","last_clean":"2023-11-28T21:06:14.956782+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T21:06:14.956782+0000","last_undegraded":"2023-11-28T21:06:14.956782+0000","last_fullsized":"2023-11-28T21:06:14.956782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'367","last_scrub_stamp":"2023-11-28T21:05:37.282834+0000","last_deep_scrub":"51'367","last_deep_scrub_stamp":"2023-11-28T21:05:37.282834+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.282834+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:54:01.725224+0000","scrub_duration":0.003284698,"objects_trimmed":0,"snaptrim_duration":0.017627927000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"51'417","reported_seq":2521,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.952380+0000","last_change":"2023-11-28T21:06:02.642870+0000","last_active":"2023-11-28T21:06:14.952380+0000","last_peered":"2023-11-28T21:06:14.952380+0000","last_clean":"2023-11-28T21:06:14.952380+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T21:06:14.952380+0000","last_undegraded":"2023-11-28T21:06:14.952380+0000","last_fullsized":"2023-11-28T21:06:14.952380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:06:02.642763+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:06:02.642763+0000","last_clean_scrub_stamp":"2023-11-28T21:06:02.642763+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:58.776930+0000","scrub_duration":0.0015502129999999999,"objects_trimmed":0,"snaptrim_duration":0.0061577519999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"51'426","reported_seq":2529,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:57.197980+0000","last_change":"2023-11-28T21:05:57.197980+0000","last_active":"2023-11-28T21:05:57.197980+0000","last_peered":"2023-11-28T21:05:57.197980+0000","last_clean":"2023-11-28T21:05:57.197980+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T21:05:57.197980+0000","last_undegraded":"2023-11-28T21:05:57.197980+0000","last_fullsized":"2023-11-28T21:05:57.197980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'426","last_scrub_stamp":"2023-11-28T21:05:57.197730+0000","last_deep_scrub":"51'426","last_deep_scrub_stamp":"2023-11-28T21:05:57.197730+0000","last_clean_scrub_stamp":"2023-11-28T21:05:57.197730+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:58:18.112114+0000","scrub_duration":0.0043408559999999997,"objects_trimmed":0,"snaptrim_duration":0.017436297999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"51'394","reported_seq":2497,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.388232+0000","last_change":"2023-11-28T21:05:50.388232+0000","last_active":"2023-11-28T21:05:50.388232+0000","last_peered":"2023-11-28T21:05:50.388232+0000","last_clean":"2023-11-28T21:05:50.388232+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T21:05:50.388232+0000","last_undegraded":"2023-11-28T21:05:50.388232+0000","last_fullsized":"2023-11-28T21:05:50.388232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:50.388128+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:50.388128+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.388128+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:19.796234+0000","scrub_duration":0.0025192349999999999,"objects_trimmed":0,"snaptrim_duration":0.018095488999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"51'421","reported_seq":2524,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.239169+0000","last_change":"2023-11-28T21:05:56.239169+0000","last_active":"2023-11-28T21:05:56.239169+0000","last_peered":"2023-11-28T21:05:56.239169+0000","last_clean":"2023-11-28T21:05:56.239169+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T21:05:56.239169+0000","last_undegraded":"2023-11-28T21:05:56.239169+0000","last_fullsized":"2023-11-28T21:05:56.239169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'421","last_scrub_stamp":"2023-11-28T21:05:56.238950+0000","last_deep_scrub":"51'421","last_deep_scrub_stamp":"2023-11-28T21:05:56.238950+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.238950+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:40.811185+0000","scrub_duration":0.0031363070000000001,"objects_trimmed":0,"snaptrim_duration":0.014654275,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"51'411","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:31.244410+0000","last_change":"2023-11-28T21:05:31.244410+0000","last_active":"2023-11-28T21:05:31.244410+0000","last_peered":"2023-11-28T21:05:31.244410+0000","last_clean":"2023-11-28T21:05:31.244410+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T21:05:31.244410+0000","last_undegraded":"2023-11-28T21:05:31.244410+0000","last_fullsized":"2023-11-28T21:05:31.244410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:31.244317+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:31.244317+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.244317+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:48:02.680662+0000","scrub_duration":0.0027735979999999999,"objects_trimmed":0,"snaptrim_duration":0.017356489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"51'417","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.554567+0000","last_change":"2023-11-28T21:06:01.554567+0000","last_active":"2023-11-28T21:06:01.554567+0000","last_peered":"2023-11-28T21:06:01.554567+0000","last_clean":"2023-11-28T21:06:01.554567+0000","last_became_active":"2023-11-28T20:39:01.848167+0000","last_became_peered":"2023-11-28T20:39:01.848167+0000","last_unstale":"2023-11-28T21:06:01.554567+0000","last_undegraded":"2023-11-28T21:06:01.554567+0000","last_fullsized":"2023-11-28T21:06:01.554567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:06:01.554435+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:06:01.554435+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.554435+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:52.240195+0000","scrub_duration":0.0025598880000000002,"objects_trimmed":0,"snaptrim_duration":0.0020579169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"51'422","reported_seq":2525,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.031660+0000","last_change":"2023-11-28T21:05:42.031660+0000","last_active":"2023-11-28T21:05:42.031660+0000","last_peered":"2023-11-28T21:05:42.031660+0000","last_clean":"2023-11-28T21:05:42.031660+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T21:05:42.031660+0000","last_undegraded":"2023-11-28T21:05:42.031660+0000","last_fullsized":"2023-11-28T21:05:42.031660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'422","last_scrub_stamp":"2023-11-28T21:05:42.031561+0000","last_deep_scrub":"51'422","last_deep_scrub_stamp":"2023-11-28T21:05:42.031561+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.031561+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:36.205746+0000","scrub_duration":0.0024639100000000001,"objects_trimmed":0,"snaptrim_duration":0.014291543,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"51'396","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:52.187484+0000","last_change":"2023-11-28T21:05:52.187484+0000","last_active":"2023-11-28T21:05:52.187484+0000","last_peered":"2023-11-28T21:05:52.187484+0000","last_clean":"2023-11-28T21:05:52.187484+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T21:05:52.187484+0000","last_undegraded":"2023-11-28T21:05:52.187484+0000","last_fullsized":"2023-11-28T21:05:52.187484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'396","last_scrub_stamp":"2023-11-28T21:05:52.187215+0000","last_deep_scrub":"51'396","last_deep_scrub_stamp":"2023-11-28T21:05:52.187215+0000","last_clean_scrub_stamp":"2023-11-28T21:05:52.187215+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:57:49.350881+0000","scrub_duration":0.0037497770000000001,"objects_trimmed":0,"snaptrim_duration":0.017003022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"51'403","reported_seq":2506,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:04.270382+0000","last_change":"2023-11-28T21:06:04.270382+0000","last_active":"2023-11-28T21:06:04.270382+0000","last_peered":"2023-11-28T21:06:04.270382+0000","last_clean":"2023-11-28T21:06:04.270382+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T21:06:04.270382+0000","last_undegraded":"2023-11-28T21:06:04.270382+0000","last_fullsized":"2023-11-28T21:06:04.270382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'403","last_scrub_stamp":"2023-11-28T21:06:04.270122+0000","last_deep_scrub":"51'403","last_deep_scrub_stamp":"2023-11-28T21:06:04.270122+0000","last_clean_scrub_stamp":"2023-11-28T21:06:04.270122+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:21.810163+0000","scrub_duration":0.0038017139999999999,"objects_trimmed":0,"snaptrim_duration":0.020849563000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"51'393","reported_seq":2496,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.939762+0000","last_change":"2023-11-28T21:05:46.385054+0000","last_active":"2023-11-28T21:06:14.939762+0000","last_peered":"2023-11-28T21:06:14.939762+0000","last_clean":"2023-11-28T21:06:14.939762+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T21:06:14.939762+0000","last_undegraded":"2023-11-28T21:06:14.939762+0000","last_fullsized":"2023-11-28T21:06:14.939762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'393","last_scrub_stamp":"2023-11-28T21:05:46.384910+0000","last_deep_scrub":"51'393","last_deep_scrub_stamp":"2023-11-28T21:05:46.384910+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.384910+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:01.362037+0000","scrub_duration":0.002739965,"objects_trimmed":0,"snaptrim_duration":0.0019691359999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"51'430","reported_seq":2533,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.969824+0000","last_change":"2023-11-28T21:06:10.431195+0000","last_active":"2023-11-28T21:06:14.969824+0000","last_peered":"2023-11-28T21:06:14.969824+0000","last_clean":"2023-11-28T21:06:14.969824+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T21:06:14.969824+0000","last_undegraded":"2023-11-28T21:06:14.969824+0000","last_fullsized":"2023-11-28T21:06:14.969824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'430","last_scrub_stamp":"2023-11-28T21:06:10.430886+0000","last_deep_scrub":"51'430","last_deep_scrub_stamp":"2023-11-28T21:06:10.430886+0000","last_clean_scrub_stamp":"2023-11-28T21:06:10.430886+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:09:52.612580+0000","scrub_duration":0.003839257,"objects_trimmed":0,"snaptrim_duration":0.019569492000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"51'421","reported_seq":2524,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:16.407796+0000","last_change":"2023-11-28T21:06:16.407796+0000","last_active":"2023-11-28T21:06:16.407796+0000","last_peered":"2023-11-28T21:06:16.407796+0000","last_clean":"2023-11-28T21:06:16.407796+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T21:06:16.407796+0000","last_undegraded":"2023-11-28T21:06:16.407796+0000","last_fullsized":"2023-11-28T21:06:16.407796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'421","last_scrub_stamp":"2023-11-28T21:06:16.407554+0000","last_deep_scrub":"51'421","last_deep_scrub_stamp":"2023-11-28T21:06:16.407554+0000","last_clean_scrub_stamp":"2023-11-28T21:06:16.407554+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.725301+0000","scrub_duration":0.0034831269999999999,"objects_trimmed":0,"snaptrim_duration":0.015773832000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"51'435","reported_seq":2538,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.950934+0000","last_change":"2023-11-28T21:05:50.721764+0000","last_active":"2023-11-28T21:06:14.950934+0000","last_peered":"2023-11-28T21:06:14.950934+0000","last_clean":"2023-11-28T21:06:14.950934+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T21:06:14.950934+0000","last_undegraded":"2023-11-28T21:06:14.950934+0000","last_fullsized":"2023-11-28T21:06:14.950934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'435","last_scrub_stamp":"2023-11-28T21:05:50.721632+0000","last_deep_scrub":"51'435","last_deep_scrub_stamp":"2023-11-28T21:05:50.721632+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.721632+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:09.219521+0000","scrub_duration":0.0027464899999999999,"objects_trimmed":0,"snaptrim_duration":0.013692045,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"51'417","reported_seq":2520,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.967258+0000","last_change":"2023-11-28T21:05:36.093176+0000","last_active":"2023-11-28T21:06:14.967258+0000","last_peered":"2023-11-28T21:06:14.967258+0000","last_clean":"2023-11-28T21:06:14.967258+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T21:06:14.967258+0000","last_undegraded":"2023-11-28T21:06:14.967258+0000","last_fullsized":"2023-11-28T21:06:14.967258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:05:36.093051+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:05:36.093051+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.093051+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:20:01.197729+0000","scrub_duration":0.0019047210000000001,"objects_trimmed":0,"snaptrim_duration":0.014004656000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"51'418","reported_seq":2520,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.463978+0000","last_change":"2023-11-28T21:06:00.463978+0000","last_active":"2023-11-28T21:06:00.463978+0000","last_peered":"2023-11-28T21:06:00.463978+0000","last_clean":"2023-11-28T21:06:00.463978+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T21:06:00.463978+0000","last_undegraded":"2023-11-28T21:06:00.463978+0000","last_fullsized":"2023-11-28T21:06:00.463978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:06:00.463822+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:06:00.463822+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.463822+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:56.712408+0000","scrub_duration":0.0025889039999999999,"objects_trimmed":0,"snaptrim_duration":0.018246884000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"51'374","reported_seq":2476,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:38.970607+0000","last_change":"2023-11-28T21:05:38.970607+0000","last_active":"2023-11-28T21:05:38.970607+0000","last_peered":"2023-11-28T21:05:38.970607+0000","last_clean":"2023-11-28T21:05:38.970607+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T21:05:38.970607+0000","last_undegraded":"2023-11-28T21:05:38.970607+0000","last_fullsized":"2023-11-28T21:05:38.970607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'374","last_scrub_stamp":"2023-11-28T21:05:38.970355+0000","last_deep_scrub":"51'374","last_deep_scrub_stamp":"2023-11-28T21:05:38.970355+0000","last_clean_scrub_stamp":"2023-11-28T21:05:38.970355+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:16.855297+0000","scrub_duration":0.00371595,"objects_trimmed":0,"snaptrim_duration":0.010909501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"51'380","reported_seq":2482,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.191770+0000","last_change":"2023-11-28T21:05:56.191770+0000","last_active":"2023-11-28T21:05:56.191770+0000","last_peered":"2023-11-28T21:05:56.191770+0000","last_clean":"2023-11-28T21:05:56.191770+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T21:05:56.191770+0000","last_undegraded":"2023-11-28T21:05:56.191770+0000","last_fullsized":"2023-11-28T21:05:56.191770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'380","last_scrub_stamp":"2023-11-28T21:05:56.191432+0000","last_deep_scrub":"51'380","last_deep_scrub_stamp":"2023-11-28T21:05:56.191432+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.191432+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:00.175266+0000","scrub_duration":0.0041991600000000004,"objects_trimmed":0,"snaptrim_duration":0.014265125,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"51'385","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:07.974845+0000","last_change":"2023-11-28T21:06:07.974845+0000","last_active":"2023-11-28T21:06:07.974845+0000","last_peered":"2023-11-28T21:06:07.974845+0000","last_clean":"2023-11-28T21:06:07.974845+0000","last_became_active":"2023-11-28T20:39:01.391291+0000","last_became_peered":"2023-11-28T20:39:01.391291+0000","last_unstale":"2023-11-28T21:06:07.974845+0000","last_undegraded":"2023-11-28T21:06:07.974845+0000","last_fullsized":"2023-11-28T21:06:07.974845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'385","last_scrub_stamp":"2023-11-28T21:06:07.974521+0000","last_deep_scrub":"51'385","last_deep_scrub_stamp":"2023-11-28T21:06:07.974521+0000","last_clean_scrub_stamp":"2023-11-28T21:06:07.974521+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:08.841834+0000","scrub_duration":0.0033903169999999999,"objects_trimmed":0,"snaptrim_duration":0.017078507999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"51'419","reported_seq":2521,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:11.413158+0000","last_change":"2023-11-28T21:06:11.413158+0000","last_active":"2023-11-28T21:06:11.413158+0000","last_peered":"2023-11-28T21:06:11.413158+0000","last_clean":"2023-11-28T21:06:11.413158+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T21:06:11.413158+0000","last_undegraded":"2023-11-28T21:06:11.413158+0000","last_fullsized":"2023-11-28T21:06:11.413158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'419","last_scrub_stamp":"2023-11-28T21:06:11.412882+0000","last_deep_scrub":"51'419","last_deep_scrub_stamp":"2023-11-28T21:06:11.412882+0000","last_clean_scrub_stamp":"2023-11-28T21:06:11.412882+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:07.695855+0000","scrub_duration":0.0039167610000000004,"objects_trimmed":0,"snaptrim_duration":0.017711331,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"51'405","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:49.599050+0000","last_change":"2023-11-28T21:05:44.232745+0000","last_active":"2023-11-28T21:05:49.599050+0000","last_peered":"2023-11-28T21:05:49.599050+0000","last_clean":"2023-11-28T21:05:49.599050+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T21:05:49.599050+0000","last_undegraded":"2023-11-28T21:05:49.599050+0000","last_fullsized":"2023-11-28T21:05:49.599050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'405","last_scrub_stamp":"2023-11-28T21:05:44.232593+0000","last_deep_scrub":"51'405","last_deep_scrub_stamp":"2023-11-28T21:05:44.232593+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.232593+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:38.822888+0000","scrub_duration":0.0029742990000000001,"objects_trimmed":0,"snaptrim_duration":0.017616142000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"51'400","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.609728+0000","last_change":"2023-11-28T21:05:31.601994+0000","last_active":"2023-11-28T21:05:50.609728+0000","last_peered":"2023-11-28T21:05:50.609728+0000","last_clean":"2023-11-28T21:05:50.609728+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T21:05:50.609728+0000","last_undegraded":"2023-11-28T21:05:50.609728+0000","last_fullsized":"2023-11-28T21:05:50.609728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'400","last_scrub_stamp":"2023-11-28T21:05:31.601754+0000","last_deep_scrub":"51'400","last_deep_scrub_stamp":"2023-11-28T21:05:31.601754+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.601754+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:43.804359+0000","scrub_duration":0.003376469,"objects_trimmed":0,"snaptrim_duration":0.020312439000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"51'403","reported_seq":2505,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:15.428175+0000","last_change":"2023-11-28T21:06:15.428227+0000","last_active":"2023-11-28T21:06:15.428175+0000","last_peered":"2023-11-28T21:06:15.428175+0000","last_clean":"2023-11-28T21:06:15.428175+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T21:06:15.428175+0000","last_undegraded":"2023-11-28T21:06:15.428175+0000","last_fullsized":"2023-11-28T21:06:15.428175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'403","last_scrub_stamp":"2023-11-28T21:06:15.427968+0000","last_deep_scrub":"51'403","last_deep_scrub_stamp":"2023-11-28T21:06:15.427968+0000","last_clean_scrub_stamp":"2023-11-28T21:06:15.427968+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T09:02:59.830739+0000","scrub_duration":0.0031732430000000001,"objects_trimmed":0,"snaptrim_duration":0.017449602000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"51'416","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.609783+0000","last_change":"2023-11-28T21:05:50.349772+0000","last_active":"2023-11-28T21:05:50.609783+0000","last_peered":"2023-11-28T21:05:50.609783+0000","last_clean":"2023-11-28T21:05:50.609783+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T21:05:50.609783+0000","last_undegraded":"2023-11-28T21:05:50.609783+0000","last_fullsized":"2023-11-28T21:05:50.609783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'416","last_scrub_stamp":"2023-11-28T21:05:50.349526+0000","last_deep_scrub":"51'416","last_deep_scrub_stamp":"2023-11-28T21:05:50.349526+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.349526+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:01.261893+0000","scrub_duration":0.0031862489999999999,"objects_trimmed":0,"snaptrim_duration":0.018992159000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"51'397","reported_seq":2502,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.455157+0000","last_change":"2023-11-28T21:06:20.455157+0000","last_active":"2023-11-28T21:06:20.455157+0000","last_peered":"2023-11-28T21:06:20.455157+0000","last_clean":"2023-11-28T21:06:20.455157+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T21:06:20.455157+0000","last_undegraded":"2023-11-28T21:06:20.455157+0000","last_fullsized":"2023-11-28T21:06:20.455157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'397","last_scrub_stamp":"2023-11-28T21:06:20.454899+0000","last_deep_scrub":"51'397","last_deep_scrub_stamp":"2023-11-28T21:06:20.454899+0000","last_clean_scrub_stamp":"2023-11-28T21:06:20.454899+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:11.402445+0000","scrub_duration":0.0033112950000000001,"objects_trimmed":0,"snaptrim_duration":0.015371953000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"51'415","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.377471+0000","last_change":"2023-11-28T21:05:56.377471+0000","last_active":"2023-11-28T21:05:56.377471+0000","last_peered":"2023-11-28T21:05:56.377471+0000","last_clean":"2023-11-28T21:05:56.377471+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T21:05:56.377471+0000","last_undegraded":"2023-11-28T21:05:56.377471+0000","last_fullsized":"2023-11-28T21:05:56.377471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:56.377367+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:56.377367+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.377367+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:54.660446+0000","scrub_duration":0.001620766,"objects_trimmed":0,"snaptrim_duration":0.0098716120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"51'399","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:51.732352+0000","last_change":"2023-11-28T21:05:51.732352+0000","last_active":"2023-11-28T21:05:51.732352+0000","last_peered":"2023-11-28T21:05:51.732352+0000","last_clean":"2023-11-28T21:05:51.732352+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T21:05:51.732352+0000","last_undegraded":"2023-11-28T21:05:51.732352+0000","last_fullsized":"2023-11-28T21:05:51.732352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'399","last_scrub_stamp":"2023-11-28T21:05:51.732211+0000","last_deep_scrub":"51'399","last_deep_scrub_stamp":"2023-11-28T21:05:51.732211+0000","last_clean_scrub_stamp":"2023-11-28T21:05:51.732211+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:01.333629+0000","scrub_duration":0.001767425,"objects_trimmed":0,"snaptrim_duration":0.011275626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"51'410","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:09.376555+0000","last_change":"2023-11-28T21:06:09.376555+0000","last_active":"2023-11-28T21:06:09.376555+0000","last_peered":"2023-11-28T21:06:09.376555+0000","last_clean":"2023-11-28T21:06:09.376555+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T21:06:09.376555+0000","last_undegraded":"2023-11-28T21:06:09.376555+0000","last_fullsized":"2023-11-28T21:06:09.376555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'410","last_scrub_stamp":"2023-11-28T21:06:09.376319+0000","last_deep_scrub":"51'410","last_deep_scrub_stamp":"2023-11-28T21:06:09.376319+0000","last_clean_scrub_stamp":"2023-11-28T21:06:09.376319+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:38:08.438225+0000","scrub_duration":0.0035951540000000001,"objects_trimmed":0,"snaptrim_duration":0.017369464000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":892224822,"num_objects":17666,"num_object_clones":8054,"num_object_copies":70664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17666,"num_whiteouts":7974,"num_read":1150,"num_read_kb":100500,"num_write":48457,"num_write_kb":1187847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1881309184,"data_stored":1881309184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57114,"ondisk_log_size":57114,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26113,"ondisk_log_size":26113,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":680942988,"num_objects":625,"num_object_clones":0,"num_object_copies":1250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":0,"num_read":1546,"num_read_kb":199259,"num_write":14550,"num_write_kb":680671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2848462,"num_omap_keys":5441,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1362042880,"data_stored":1361885976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15784,"ondisk_log_size":15784,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509784,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":650840,"kb_used_data":461392,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":93721000,"statfs":{"total":96636764160,"available":95970304000,"internally_reserved":0,"allocated":472465408,"data_stored":472155802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":193984967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":8.7539999999999996,"15min":3.2719999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.50600000000000001,"5min":873.04100000000005,"15min":873.04100000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.46500000000000002,"15min":0.51800000000000002},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24099999999999999},"max":{"1min":0.48899999999999999,"5min":0.872,"15min":6.5659999999999998},"last":0.311}]},{"osd":1,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.53700000000000003,"15min":0.57499999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.54000000000000004,"5min":1.194,"15min":6.9370000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.503,"15min":0.53900000000000003},"min":{"1min":0.31900000000000001,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":0.54800000000000004,"5min":0.79700000000000004,"15min":3.6219999999999999},"last":0.57199999999999995}]},{"osd":2,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.56799999999999995,"15min":0.60099999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52100000000000002,"5min":6.0309999999999997,"15min":6.8780000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":8.2840000000000007,"15min":3.1880000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28299999999999997},"max":{"1min":0.56299999999999994,"5min":817.63900000000001,"15min":817.63900000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":51.350999999999999,"15min":17.934999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":3268.6419999999998,"15min":3268.6419999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":51.310000000000002,"15min":17.669},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":3232.7750000000001,"15min":3232.7750000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":46.462000000000003,"15min":16.082999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.42299999999999999},"max":{"1min":1.014,"5min":3259.5459999999998,"15min":3259.5459999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":8.0329999999999995,"15min":3.2509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93600000000000005,"5min":703.19299999999998,"15min":703.19299999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":9.8960000000000008,"15min":3.8969999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.92300000000000004,"5min":928.99199999999996,"15min":928.99199999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":10.500999999999999,"15min":4.1470000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89000000000000001,"5min":961.01800000000003,"15min":961.01800000000003},"last":0.67300000000000004}]},{"osd":7,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":9.6129999999999995,"15min":4.1260000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.44600000000000001},"max":{"1min":1.0820000000000001,"5min":872.827,"15min":872.827},"last":0.503},{"interface":"front","average":{"1min":0.73399999999999999,"5min":9.0449999999999999,"15min":3.6110000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48899999999999999},"max":{"1min":0.83899999999999997,"5min":817.84400000000005,"15min":817.84400000000005},"last":0.624}]}]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424988,"kb_used_data":277204,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93946852,"statfs":{"total":96636764160,"available":96201576448,"internally_reserved":0,"allocated":283856896,"data_stored":283546865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":1.52,"15min":0.82199999999999995},"min":{"1min":0.22800000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.40200000000000002,"5min":64.087000000000003,"15min":64.087000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":1.6419999999999999,"15min":0.94999999999999996},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.25},"max":{"1min":0.58999999999999997,"5min":64.114999999999995,"15min":64.114999999999995},"last":0.41799999999999998}]},{"osd":1,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":1.6020000000000001,"15min":0.96199999999999997},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.498,"5min":64,"15min":64},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.6679999999999999,"15min":0.97499999999999998},"min":{"1min":0.37,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.62,"5min":64.028999999999996,"15min":64.028999999999996},"last":0.47199999999999998}]},{"osd":3,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":29.27,"15min":10.208},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47799999999999998,"5min":2826.7199999999998,"15min":2826.7199999999998},"last":0.378},{"interface":"front","average":{"1min":0.45100000000000001,"5min":29.638999999999999,"15min":10.252000000000001},"min":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.307},"max":{"1min":0.59199999999999997,"5min":2838.0680000000002,"15min":2838.0680000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":3.4169999999999998,"15min":1.712},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":149.43700000000001,"15min":149.43700000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":53.168999999999997,"15min":18.263999999999999},"min":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.38800000000000001},"max":{"1min":0.94499999999999995,"5min":3288.7310000000002,"15min":3288.7310000000002},"last":0.69499999999999995}]},{"osd":5,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":62.241999999999997,"15min":21.312000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.46000000000000002},"max":{"1min":0.81899999999999995,"5min":3314.4110000000001,"15min":3314.4110000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":42.167000000000002,"15min":14.640000000000001},"min":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.44900000000000001},"max":{"1min":0.85999999999999999,"5min":2139.3159999999998,"15min":2139.3159999999998},"last":0.82299999999999995}]},{"osd":6,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":64.135000000000005,"15min":21.940000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.38700000000000001},"max":{"1min":0.93999999999999995,"5min":3288.7730000000001,"15min":3288.7730000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":51.640000000000001,"15min":17.850000000000001},"min":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.42699999999999999},"max":{"1min":0.99399999999999999,"5min":2837.9960000000001,"15min":2837.9960000000001},"last":0.875}]},{"osd":7,"last update":"Tue Nov 28 21:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":30.893999999999998,"15min":10.855},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.46899999999999997},"max":{"1min":0.82099999999999995,"5min":2822.598,"15min":2822.598},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":47.838000000000001,"15min":16.495999999999999},"min":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.45400000000000001},"max":{"1min":0.92900000000000005,"5min":2150.9899999999998,"15min":2150.9899999999998},"last":0.85299999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509785,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660796,"kb_used_data":458868,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93711044,"statfs":{"total":96636764160,"available":95960109056,"internally_reserved":0,"allocated":469880832,"data_stored":469569885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":2.3719999999999999,"15min":1.1779999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.623,"5min":143.76300000000001,"15min":143.76300000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.90000000000000002,"15min":0.71199999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60899999999999999,"5min":39.768000000000001,"15min":39.768000000000001},"last":0.34000000000000002}]},{"osd":2,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":2.0350000000000001,"15min":1.038},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.60099999999999998,"5min":149.34299999999999,"15min":149.34299999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.55300000000000005,"15min":0.60099999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.71699999999999997,"5min":3.1349999999999998,"15min":6.5229999999999997},"last":0.313}]},{"osd":3,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":2.5600000000000001,"15min":1.254},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66800000000000004,"5min":147.46899999999999,"15min":147.46899999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":1.1910000000000001,"15min":0.85099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":59.305,"15min":59.305},"last":0.442}]},{"osd":4,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":4.6269999999999998,"15min":2.1240000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40400000000000003},"max":{"1min":1.01,"5min":221.76900000000001,"15min":221.76900000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":13.384,"15min":5.444},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.34300000000000003},"max":{"1min":0.92400000000000004,"5min":1198.962,"15min":1198.962},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":6.9080000000000004,"15min":2.9089999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.04,"5min":574.81700000000001,"15min":574.81700000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.3140000000000001,"15min":1.0920000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.501},"max":{"1min":1.075,"5min":39.896999999999998,"15min":39.896999999999998},"last":0.85499999999999998}]},{"osd":6,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":13.356999999999999,"15min":5.0759999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96699999999999997,"5min":1168.432,"15min":1168.432},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.2669999999999999,"15min":1.0369999999999999},"min":{"1min":0.623,"5min":0.52800000000000002,"15min":0.46000000000000002},"max":{"1min":0.97399999999999998,"5min":39.863,"15min":39.863},"last":0.878}]},{"osd":7,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":3.222,"15min":1.673},"min":{"1min":0.61299999999999999,"5min":0.59199999999999997,"15min":0.54300000000000004},"max":{"1min":0.95599999999999996,"5min":143.89599999999999,"15min":143.89599999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":13.459,"15min":5.0599999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.98099999999999998,"5min":1198.933,"15min":1198.933},"last":0.77500000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542487,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583612,"kb_used_data":417776,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":93788228,"statfs":{"total":96636764160,"available":96039145472,"internally_reserved":0,"allocated":427802624,"data_stored":427497261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":169802186},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":93.894999999999996,"15min":31.896999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.29699999999999999},"max":{"1min":1.2290000000000001,"5min":3136.5639999999999,"15min":3136.5639999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":55.112000000000002,"15min":18.943999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.36899999999999999},"max":{"1min":1.236,"5min":2779.4099999999999,"15min":2779.4099999999999},"last":0.95399999999999996}]},{"osd":1,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":94.733999999999995,"15min":32.204000000000001},"min":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.34499999999999997},"max":{"1min":1.0600000000000001,"5min":3167.6399999999999,"15min":3167.6399999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":100.066,"15min":33.939999999999998},"min":{"1min":0.625,"5min":0.56000000000000005,"15min":0.46400000000000002},"max":{"1min":1.113,"5min":4741.7640000000001,"15min":4741.7640000000001},"last":0.68600000000000005}]},{"osd":2,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":56.523000000000003,"15min":19.741},"min":{"1min":0.621,"5min":0.497,"15min":0.42899999999999999},"max":{"1min":1.3240000000000001,"5min":2301.0599999999999,"15min":2301.0599999999999},"last":0.997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":100.627,"15min":34.234999999999999},"min":{"1min":0.69899999999999995,"5min":0.69299999999999995,"15min":0.42399999999999999},"max":{"1min":1.1890000000000001,"5min":4752.8689999999997,"15min":4752.8689999999997},"last":0.85499999999999998}]},{"osd":3,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":94.033000000000001,"15min":32.264000000000003},"min":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.44700000000000001},"max":{"1min":1.232,"5min":3147.2719999999999,"15min":3147.2719999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":60.307000000000002,"15min":20.715},"min":{"1min":0.60799999999999998,"5min":0.59899999999999998,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":2301.1370000000002,"15min":2301.1370000000002},"last":0.80700000000000005}]},{"osd":4,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91800000000000004,"15min":1.276},"min":{"1min":0.66100000000000003,"5min":0.57499999999999996,"15min":0.38900000000000001},"max":{"1min":1.1160000000000001,"5min":1.266,"15min":71.313000000000002},"last":1.073},{"interface":"front","average":{"1min":1.046,"5min":0.95799999999999996,"15min":1.1870000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40000000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":34.881},"last":1.121}]},{"osd":5,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0840000000000001,"15min":1.2869999999999999},"min":{"1min":0.78000000000000003,"5min":0.69999999999999996,"15min":0.39700000000000002},"max":{"1min":1.4019999999999999,"5min":1.895,"15min":44.558},"last":1.173},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1279999999999999,"15min":1.159},"min":{"1min":0.73399999999999999,"5min":0.64700000000000002,"15min":0.41399999999999998},"max":{"1min":1.49,"5min":1.956,"15min":3.782},"last":1.04}]},{"osd":6,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.998,"15min":1.1060000000000001},"min":{"1min":0.754,"5min":0.65800000000000003,"15min":0.44700000000000001},"max":{"1min":1.325,"5min":1.47,"15min":7.6769999999999996},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.22,"5min":1.1499999999999999,"15min":1.1639999999999999},"min":{"1min":0.96899999999999997,"5min":0.71499999999999997,"15min":0.38100000000000001},"max":{"1min":1.649,"5min":1.649,"15min":2.7949999999999999},"last":1.0900000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542488,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600884,"kb_used_data":439212,"kb_used_omap":1,"kb_used_meta":161662,"kb_avail":93770956,"statfs":{"total":96636764160,"available":96021458944,"internally_reserved":0,"allocated":449753088,"data_stored":449448826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165542342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":19.780999999999999,"15min":7.1459999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1919999999999999,"5min":1038.4960000000001,"15min":1038.4960000000001},"last":1.151},{"interface":"front","average":{"1min":0.96399999999999997,"5min":19.934999999999999,"15min":7.2640000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.33600000000000002},"max":{"1min":1.1739999999999999,"5min":1038.5619999999999,"15min":1038.5619999999999},"last":1.2270000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":21.085000000000001,"15min":7.6150000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41399999999999998},"max":{"1min":0.98799999999999999,"5min":1046.3320000000001,"15min":1046.3320000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":14.5,"15min":5.4660000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98399999999999999,"5min":1087.7460000000001,"15min":1087.7460000000001},"last":0.78400000000000003}]},{"osd":2,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":19.806000000000001,"15min":7.1950000000000003},"min":{"1min":0.56399999999999995,"5min":0.503,"15min":0.47699999999999998},"max":{"1min":1.153,"5min":1038.309,"15min":1038.309},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":51.655000000000001,"15min":17.821999999999999},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.35099999999999998},"max":{"1min":1.222,"5min":2556.578,"15min":2556.578},"last":1.0660000000000001}]},{"osd":3,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":45.720999999999997,"15min":15.842000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.099,"5min":2567.538,"15min":2567.538},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":36.046999999999997,"15min":12.67},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.39700000000000002},"max":{"1min":1.196,"5min":1371.7280000000001,"15min":1371.7280000000001},"last":0.72099999999999997}]},{"osd":4,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.93999999999999995,"15min":1.0469999999999999},"min":{"1min":0.61499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2709999999999999,"5min":1.3400000000000001,"15min":10.151},"last":1.304},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.034,"15min":1.0569999999999999},"min":{"1min":0.64800000000000002,"5min":0.64200000000000002,"15min":0.437},"max":{"1min":1.329,"5min":1.5640000000000001,"15min":3.2629999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.071,"15min":1.1000000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.50800000000000001},"max":{"1min":1.3069999999999999,"5min":1.51,"15min":4.5519999999999996},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0189999999999999,"15min":1.1499999999999999},"min":{"1min":0.63200000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.363,"5min":1.423,"15min":2.1899999999999999},"last":0.98399999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.109,"15min":1.145},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.56899999999999995},"max":{"1min":1.4359999999999999,"5min":1.5149999999999999,"15min":4.6639999999999997},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.139,"15min":1.218},"min":{"1min":0.77500000000000002,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.27,"5min":1.651,"15min":3.2029999999999998},"last":1.1040000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542488,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":489300,"kb_used_data":335948,"kb_used_omap":1,"kb_used_meta":153342,"kb_avail":93882540,"statfs":{"total":96636764160,"available":96135720960,"internally_reserved":0,"allocated":344010752,"data_stored":343705495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":157022661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":17.654,"15min":6.4320000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.27100000000000002},"max":{"1min":1.2629999999999999,"5min":1605.194,"15min":1605.194},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":19.523,"15min":7.0499999999999998},"min":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.27100000000000002},"max":{"1min":0.95799999999999996,"5min":1603.2260000000001,"15min":1603.2260000000001},"last":0.82699999999999996}]},{"osd":1,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":17.541,"15min":6.4180000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.253},"max":{"1min":1.0229999999999999,"5min":1749.1869999999999,"15min":1749.1869999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.997,"5min":56.825000000000003,"15min":19.577999999999999},"min":{"1min":0.76900000000000002,"5min":0.53100000000000003,"15min":0.442},"max":{"1min":1.1599999999999999,"5min":3741.5659999999998,"15min":3741.5659999999998},"last":0.99199999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":2.403,"15min":1.4239999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.309},"max":{"1min":1.1559999999999999,"5min":152.40199999999999,"15min":152.40199999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.008,"5min":56.719000000000001,"15min":19.510999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.435},"max":{"1min":1.238,"5min":3741.3910000000001,"15min":3741.3910000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":66.242999999999995,"15min":22.757000000000001},"min":{"1min":0.69999999999999996,"5min":0.60499999999999998,"15min":0.34999999999999998},"max":{"1min":1.2589999999999999,"5min":3904.835,"15min":3904.835},"last":1.048},{"interface":"front","average":{"1min":0.84399999999999997,"5min":18.091000000000001,"15min":6.6870000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.35299999999999998},"max":{"1min":1.069,"5min":1785.712,"15min":1785.712},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88600000000000001,"15min":0.88300000000000001},"min":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.28199999999999997},"max":{"1min":1.105,"5min":1.393,"15min":1.952},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1279999999999999,"15min":1.0960000000000001},"min":{"1min":0.98099999999999998,"5min":0.65800000000000003,"15min":0.29999999999999999},"max":{"1min":1.343,"5min":1.5860000000000001,"15min":4.7320000000000002},"last":1.155}]},{"osd":6,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.196,"15min":1.1850000000000001},"min":{"1min":1.1000000000000001,"5min":0.65700000000000003,"15min":0.318},"max":{"1min":1.5640000000000001,"5min":1.728,"15min":5.6600000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.05,"15min":1.0429999999999999},"min":{"1min":0.749,"5min":0.64200000000000002,"15min":0.34000000000000002},"max":{"1min":1.234,"5min":1.6100000000000001,"15min":2.573},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2310000000000001,"15min":1.085},"min":{"1min":1.04,"5min":0.69999999999999996,"15min":0.28299999999999997},"max":{"1min":1.677,"5min":1.677,"15min":2.298},"last":1.099},{"interface":"front","average":{"1min":1.004,"5min":1.1020000000000001,"15min":1.1879999999999999},"min":{"1min":0.752,"5min":0.72299999999999998,"15min":0.36899999999999999},"max":{"1min":1.3220000000000001,"5min":1.6519999999999999,"15min":4.8109999999999999},"last":0.80400000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542487,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616812,"kb_used_data":437092,"kb_used_omap":1,"kb_used_meta":179710,"kb_avail":93755028,"statfs":{"total":96636764160,"available":96005148672,"internally_reserved":0,"allocated":447582208,"data_stored":447280988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":184023493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":74.793999999999997,"15min":25.492999999999999},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.25600000000000001},"max":{"1min":0.97699999999999998,"5min":4472.0990000000002,"15min":4472.0990000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":74.838999999999999,"15min":25.632000000000001},"min":{"1min":0.51300000000000001,"5min":0.433,"15min":0.33000000000000002},"max":{"1min":1.1140000000000001,"5min":4472.4799999999996,"15min":4472.4799999999996},"last":0.80700000000000005}]},{"osd":1,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":68.733999999999995,"15min":23.989000000000001},"min":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":2473.319,"15min":2473.319},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":69.427999999999997,"15min":24.09},"min":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.40600000000000003},"max":{"1min":1.216,"5min":2525.277,"15min":2525.277},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":39.482999999999997,"15min":14.124000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.38600000000000001},"max":{"1min":0.98299999999999998,"5min":2323.7979999999998,"15min":2323.7979999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.95699999999999996,"5min":62.450000000000003,"15min":21.917000000000002},"min":{"1min":0.66200000000000003,"5min":0.60199999999999998,"15min":0.35599999999999998},"max":{"1min":1.1160000000000001,"5min":2498.6460000000002,"15min":2498.6460000000002},"last":1.022}]},{"osd":3,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":63.005000000000003,"15min":21.709},"min":{"1min":0.56299999999999994,"5min":0.47699999999999998,"15min":0.38900000000000001},"max":{"1min":1.087,"5min":2516.6700000000001,"15min":2516.6700000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.874,"5min":65.099999999999994,"15min":22.652000000000001},"min":{"1min":0.624,"5min":0.53200000000000003,"15min":0.441},"max":{"1min":1.1859999999999999,"5min":2478.165,"15min":2478.165},"last":0.97999999999999998}]},{"osd":5,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97099999999999997,"15min":1.2849999999999999},"min":{"1min":0.74099999999999999,"5min":0.55100000000000005,"15min":0.36399999999999999},"max":{"1min":1.173,"5min":1.3999999999999999,"15min":19.408999999999999},"last":1.254},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.028,"15min":1.1020000000000001},"min":{"1min":0.91100000000000003,"5min":0.64800000000000002,"15min":0.35699999999999998},"max":{"1min":1.262,"5min":1.4970000000000001,"15min":9.375},"last":1.117}]},{"osd":6,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0429999999999999,"15min":1.355},"min":{"1min":0.85099999999999998,"5min":0.63700000000000001,"15min":0.44600000000000001},"max":{"1min":1.341,"5min":1.347,"15min":36.531999999999996},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1060000000000001,"15min":1.762},"min":{"1min":0.93799999999999994,"5min":0.745,"15min":0.42799999999999999},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":85.367999999999995},"last":1.5649999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.081,"15min":1.208},"min":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.45200000000000001},"max":{"1min":1.2310000000000001,"5min":1.5760000000000001,"15min":9.3399999999999999},"last":1.365},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1459999999999999,"15min":1.4379999999999999},"min":{"1min":0.97499999999999998,"5min":0.78900000000000003,"15min":0.41299999999999998},"max":{"1min":1.4330000000000001,"5min":1.577,"15min":36.591999999999999},"last":1.1779999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542487,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503316,"kb_used_data":345804,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":93868524,"statfs":{"total":96636764160,"available":96121368576,"internally_reserved":0,"allocated":354103296,"data_stored":353796734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":4.8230000000000004,"15min":1.964},"min":{"1min":0.20999999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.56100000000000005,"5min":297.16899999999998,"15min":297.16899999999998},"last":0.375},{"interface":"front","average":{"1min":0.44700000000000001,"5min":4.9260000000000002,"15min":1.9830000000000001},"min":{"1min":0.25700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.59799999999999998,"5min":297.202,"15min":297.202},"last":0.439}]},{"osd":2,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":4.5019999999999998,"15min":1.8480000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52200000000000002,"5min":335.166,"15min":335.166},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":4.4240000000000004,"15min":1.829},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.622,"5min":335.19400000000002,"15min":335.19400000000002},"last":0.41599999999999998}]},{"osd":3,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":1.3100000000000001,"15min":0.81000000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.28399999999999997},"max":{"1min":0.61599999999999999,"5min":53.808,"15min":53.808},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":29.550999999999998,"15min":10.304},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71399999999999997,"5min":2839.3989999999999,"15min":2839.3989999999999},"last":0.46999999999999997}]},{"osd":4,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":27.709,"15min":9.8179999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1499999999999999,"5min":2822.2359999999999,"15min":2822.2359999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":27.696999999999999,"15min":9.7840000000000007},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89500000000000002,"5min":2822.212,"15min":2822.212},"last":0.66100000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":19.888999999999999,"15min":7.1749999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.47099999999999997},"max":{"1min":0.96999999999999997,"5min":1936.5550000000001,"15min":1936.5550000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":25.221,"15min":8.9809999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.008,"5min":1999.019,"15min":1999.019},"last":0.83999999999999997}]},{"osd":6,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":29.164999999999999,"15min":10.345000000000001},"min":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.48199999999999998},"max":{"1min":1.083,"5min":2832.431,"15min":2832.431},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":29.058,"15min":10.275},"min":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":2822.1840000000002,"15min":2822.1840000000002},"last":0.75900000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":30.033999999999999,"15min":10.619999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1999.058,"15min":1999.058},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78300000000000003,"5min":45.722999999999999,"15min":15.859999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.054,"5min":2822.143,"15min":2822.143},"last":0.64000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":170106880,"data_stored":170090025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":171479040,"data_stored":171454248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85495808,"data_stored":85471932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":183201792,"data_stored":183178341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":187912192,"data_stored":187897127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171967842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":182128640,"data_stored":182110533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209731584,"data_stored":209715928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":182788096,"data_stored":182788096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":297787392,"data_stored":297787392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":197746688,"data_stored":197746688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":288649216,"data_stored":288649216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259055616,"data_stored":259055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171409408,"data_stored":171409408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":267010048,"data_stored":267010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":216862720,"data_stored":216862720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:06:31.792 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:31.792 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-11-28T20:38:22.532017+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=20, tm_min=38, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=5, tm_sec=25, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T21:06:31.793 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T21:06:51.794 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:06:51.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36597df640 1 Processor -- start 2023-11-28T21:06:51.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36597df640 1 -- start start 2023-11-28T21:06:51.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36597df640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36540cfc40 0x7f36540cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:51.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36597df640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3654153ae0 0x7f3654153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:51.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36597df640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365415ac00 con 0x7f36540cf860 2023-11-28T21:06:51.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36597df640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3654154470 con 0x7f3654153ae0 2023-11-28T21:06:51.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36597df640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36540cbd60 con 0x7f36540cfc40 2023-11-28T21:06:51.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f3652ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f36540cf860 0x7f36540ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57972/0 (socket says 172.21.15.167:57972) 2023-11-28T21:06:51.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f3652ffd640 1 -- 172.21.15.167:0/2957166529 learned_addr learned my addr 172.21.15.167:0/2957166529 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:51.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36537fe640 1 --2- 172.21.15.167:0/2957166529 >> v2:172.21.15.178:3300/0 conn(0x7f3654153ae0 0x7f3654153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:51.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f364a7fc640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36540cfc40 0x7f36540cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:51.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331062969 0 0) 0x7f365415ac00 con 0x7f36540cf860 2023-11-28T21:06:51.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3640003530 con 0x7f36540cf860 2023-11-28T21:06:51.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 773411700 0 0) 0x7f3640003530 con 0x7f36540cf860 2023-11-28T21:06:51.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36540cfc40 msgr2=0x7f36540cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:51.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36540cfc40 0x7f36540cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:51.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 >> v2:172.21.15.178:3300/0 conn(0x7f3654153ae0 msgr2=0x7f3654153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:51.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 --2- 172.21.15.167:0/2957166529 >> v2:172.21.15.178:3300/0 conn(0x7f3654153ae0 0x7f3654153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:51.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3654159ff0 con 0x7f36540cf860 2023-11-28T21:06:51.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f3644001680 con 0x7f36540cf860 2023-11-28T21:06:51.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 >> v1:172.21.15.167:6789/0 conn(0x7f36540cf860 legacy=0x7f36540ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:51.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3640003980 0x7f3640003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:51.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36540cfc40 0x7f36400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:51.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3640004d10 0x7f3640005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3654154470 con 0x7f3640003980 2023-11-28T21:06:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36540cbd60 con 0x7f3640004d10 2023-11-28T21:06:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364000b990 con 0x7f36540cfc40 2023-11-28T21:06:51.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f3652ffd640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3640003980 0x7f3640003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f3652ffd640 1 -- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36540cfc40 msgr2=0x7f36400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f3652ffd640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36540cfc40 0x7f36400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f3652ffd640 1 -- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3640004d10 msgr2=0x7f3640005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f36537fe640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3640004d10 0x7f3640005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f3652ffd640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3640004d10 0x7f3640005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:51.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.911+0000 7f3652ffd640 1 -- 172.21.15.167:0/2957166529 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640003530 con 0x7f3640003980 2023-11-28T21:06:51.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f3652ffd640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3640003980 0x7f3640003da0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f364400c240 tx=0x7f364401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8aa2b87f579f7ec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:51.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36440058e0 con 0x7f3640003980 2023-11-28T21:06:51.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3644005a40 con 0x7f3640003980 2023-11-28T21:06:51.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36527fc640 1 -- 172.21.15.167:0/2957166529 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644005df0 con 0x7f3640003980 2023-11-28T21:06:51.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36597df640 1 -- 172.21.15.167:0/2957166529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3640003980 msgr2=0x7f3640003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:51.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36597df640 1 --2- 172.21.15.167:0/2957166529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3640003980 0x7f3640003da0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f364400c240 tx=0x7f364401cbf0 comp rx=0 tx=0).stop 2023-11-28T21:06:51.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36537fe640 1 -- 172.21.15.167:0/2957166529 reap_dead start 2023-11-28T21:06:51.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36597df640 1 -- 172.21.15.167:0/2957166529 shutdown_connections 2023-11-28T21:06:51.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36597df640 1 -- 172.21.15.167:0/2957166529 >> 172.21.15.167:0/2957166529 conn(0x7f365406c1f0 msgr2=0x7f3654071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:51.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36597df640 1 -- 172.21.15.167:0/2957166529 shutdown_connections 2023-11-28T21:06:51.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.915+0000 7f36597df640 1 -- 172.21.15.167:0/2957166529 wait complete. 2023-11-28T21:06:51.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 Processor -- start 2023-11-28T21:06:51.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 -- start start 2023-11-28T21:06:51.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3640003980 0x7f3654159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3654157aa0 0x7f3654157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36540b41e0 0x7f36540b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3654142f00 con 0x7f36540b41e0 2023-11-28T21:06:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36540b4ba0 con 0x7f3640003980 2023-11-28T21:06:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36540b3d00 con 0x7f3654157aa0 2023-11-28T21:06:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36537fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36540b41e0 0x7f36540b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36537fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36540b41e0 0x7f36540b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58398/0 (socket says 172.21.15.167:58398) 2023-11-28T21:06:51.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36537fe640 1 -- 172.21.15.167:0/1341665507 learned_addr learned my addr 172.21.15.167:0/1341665507 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f3652ffd640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3640003980 0x7f3654159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f364a7fc640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3654157aa0 0x7f3654157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36537fe640 1 -- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3654157aa0 msgr2=0x7f3654157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36537fe640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3654157aa0 0x7f3654157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36537fe640 1 -- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3640003980 msgr2=0x7f3654159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36537fe640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3640003980 0x7f3654159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36537fe640 1 -- 172.21.15.167:0/1341665507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3654159570 con 0x7f36540b41e0 2023-11-28T21:06:51.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36537fe640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36540b41e0 0x7f36540b4660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36540b2240 tx=0x7f364c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f364bfff640 1 -- 172.21.15.167:0/1341665507 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c016620 con 0x7f36540b41e0 2023-11-28T21:06:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f364bfff640 1 -- 172.21.15.167:0/1341665507 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c0167a0 con 0x7f36540b41e0 2023-11-28T21:06:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f364bfff640 1 -- 172.21.15.167:0/1341665507 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c016b50 con 0x7f36540b41e0 2023-11-28T21:06:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36540c4b10 con 0x7f36540b41e0 2023-11-28T21:06:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3654142c20 con 0x7f36540b41e0 2023-11-28T21:06:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3654067c40 con 0x7f36540b41e0 2023-11-28T21:06:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.919+0000 7f364bfff640 1 -- 172.21.15.167:0/1341665507 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f364c016cb0 con 0x7f36540b41e0 2023-11-28T21:06:51.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.923+0000 7f364bfff640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3634066470 0x7f3634068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.923+0000 7f364bfff640 1 -- 172.21.15.167:0/1341665507 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f364c085150 con 0x7f36540b41e0 2023-11-28T21:06:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.923+0000 7f3652ffd640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3634066470 0x7f3634068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.923+0000 7f3652ffd640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3634066470 0x7f3634068930 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f36440aa000 tx=0x7f3644000ff0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:51.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:51.927+0000 7f364bfff640 1 -- 172.21.15.167:0/1341665507 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f364c0521c0 con 0x7f36540b41e0 2023-11-28T21:06:52.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.071+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 --> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3654159cc0 con 0x7f3634066470 2023-11-28T21:06:52.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f364bfff640 1 -- 172.21.15.167:0/1341665507 <== mgr.4103 v2:172.21.15.178:6832/824645964 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+376912 (secure 0 0 0) 0x7f3644005bb0 con 0x7f3634066470 2023-11-28T21:06:52.105 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:06:52.107 INFO:teuthology.orchestra.run.smithi167.stderr:dumped all 2023-11-28T21:06:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3634066470 msgr2=0x7f3634068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3634066470 0x7f3634068930 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f36440aa000 tx=0x7f3644000ff0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36540b41e0 msgr2=0x7f36540b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36540b41e0 0x7f36540b4660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36540b2240 tx=0x7f364c00f520 comp rx=0 tx=0).stop 2023-11-28T21:06:52.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 shutdown_connections 2023-11-28T21:06:52.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f3634066470 0x7f3634068930 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36540b41e0 0x7f36540b4660 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3654157aa0 0x7f3654157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 --2- 172.21.15.167:0/1341665507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3640003980 0x7f3654159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 >> 172.21.15.167:0/1341665507 conn(0x7f365406c1f0 msgr2=0x7f36540cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 shutdown_connections 2023-11-28T21:06:52.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.099+0000 7f36597df640 1 -- 172.21.15.167:0/1341665507 wait complete. 2023-11-28T21:06:52.121 INFO:teuthology.orchestra.run.smithi167.stdout:{"pg_ready":true,"pg_map":{"version":907,"stamp":"2023-11-28T21:06:50.159846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573758178,"num_objects":18293,"num_object_clones":8054,"num_object_copies":71918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18293,"num_whiteouts":7974,"num_read":2812,"num_read_kb":299859,"num_write":63166,"num_write_kb":1870934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2848462,"num_omap_keys":5441,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99130,"ondisk_log_size":99130,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4530544,"kb_used_data":3173296,"kb_used_omap":12,"kb_used_meta":1357171,"kb_avail":750444176,"statfs":{"total":773094113280,"available":768454836224,"internally_reserved":0,"allocated":3249455104,"data_stored":3247001856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1389743664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004729"},"pg_stats":[{"pgid":"2.1f","version":"51'568","reported_seq":635,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.968269+0000","last_change":"2023-11-28T21:05:32.187967+0000","last_active":"2023-11-28T21:06:14.968269+0000","last_peered":"2023-11-28T21:06:14.968269+0000","last_clean":"2023-11-28T21:06:14.968269+0000","last_became_active":"2023-11-28T20:38:18.552560+0000","last_became_peered":"2023-11-28T20:38:18.552560+0000","last_unstale":"2023-11-28T21:06:14.968269+0000","last_undegraded":"2023-11-28T21:06:14.968269+0000","last_fullsized":"2023-11-28T21:06:14.968269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'568","last_scrub_stamp":"2023-11-28T21:05:32.187849+0000","last_deep_scrub":"51'568","last_deep_scrub_stamp":"2023-11-28T21:05:32.187849+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.187849+0000","objects_scrubbed":22,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:57:58.029094+0000","scrub_duration":0.086821672000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3,"num_read_kb":4109,"num_write":501,"num_write_kb":29002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":102240,"num_omap_keys":193,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'428","reported_seq":2525,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:26.562996+0000","last_change":"2023-11-28T21:06:26.563035+0000","last_active":"2023-11-28T21:06:26.562996+0000","last_peered":"2023-11-28T21:06:26.562996+0000","last_clean":"2023-11-28T21:06:26.562996+0000","last_became_active":"2023-11-28T20:39:01.387176+0000","last_became_peered":"2023-11-28T20:39:01.387176+0000","last_unstale":"2023-11-28T21:06:26.562996+0000","last_undegraded":"2023-11-28T21:06:26.562996+0000","last_fullsized":"2023-11-28T21:06:26.562996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'428","last_scrub_stamp":"2023-11-28T21:06:26.562872+0000","last_deep_scrub":"51'428","last_deep_scrub_stamp":"2023-11-28T21:06:26.562872+0000","last_clean_scrub_stamp":"2023-11-28T21:06:26.562872+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:54:11.056747+0000","scrub_duration":0.0030981450000000001,"objects_trimmed":0,"snaptrim_duration":0.012127499,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"51'1858","reported_seq":3730,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:06.768298+0000","last_change":"2023-11-28T21:06:06.768298+0000","last_active":"2023-11-28T21:06:06.768298+0000","last_peered":"2023-11-28T21:06:06.768298+0000","last_clean":"2023-11-28T21:06:06.768298+0000","last_became_active":"2023-11-28T20:38:23.778913+0000","last_became_peered":"2023-11-28T20:38:23.778913+0000","last_unstale":"2023-11-28T21:06:06.768298+0000","last_undegraded":"2023-11-28T21:06:06.768298+0000","last_fullsized":"2023-11-28T21:06:06.768298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1858","last_scrub_stamp":"2023-11-28T21:06:06.768177+0000","last_deep_scrub":"51'1858","last_deep_scrub_stamp":"2023-11-28T21:06:06.768177+0000","last_clean_scrub_stamp":"2023-11-28T21:06:06.768177+0000","objects_scrubbed":556,"log_size":1858,"log_dups_size":0,"ondisk_log_size":1858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:26.026085+0000","scrub_duration":0.27094379299999999,"objects_trimmed":0,"snaptrim_duration":0.016916996,"stat_sum":{"num_bytes":12268315,"num_objects":556,"num_object_clones":279,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":239,"num_read":31,"num_read_kb":4126,"num_write":1561,"num_write_kb":24667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"52'630","reported_seq":699,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:23.780983+0000","last_change":"2023-11-28T21:05:42.376131+0000","last_active":"2023-11-28T21:06:23.780983+0000","last_peered":"2023-11-28T21:06:23.780983+0000","last_clean":"2023-11-28T21:06:23.780983+0000","last_became_active":"2023-11-28T20:38:18.538518+0000","last_became_peered":"2023-11-28T20:38:18.538518+0000","last_unstale":"2023-11-28T21:06:23.780983+0000","last_undegraded":"2023-11-28T21:06:23.780983+0000","last_fullsized":"2023-11-28T21:06:23.780983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'629","last_scrub_stamp":"2023-11-28T21:05:42.376020+0000","last_deep_scrub":"51'629","last_deep_scrub_stamp":"2023-11-28T21:05:42.376020+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.376020+0000","objects_scrubbed":18,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:05:29.854245+0000","scrub_duration":0.078645286999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":8204,"num_write":546,"num_write_kb":37274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35806,"num_omap_keys":68,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"51'383","reported_seq":2487,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:48.164491+0000","last_change":"2023-11-28T21:05:48.164491+0000","last_active":"2023-11-28T21:05:48.164491+0000","last_peered":"2023-11-28T21:05:48.164491+0000","last_clean":"2023-11-28T21:05:48.164491+0000","last_became_active":"2023-11-28T20:38:19.385516+0000","last_became_peered":"2023-11-28T20:38:19.385516+0000","last_unstale":"2023-11-28T21:05:48.164491+0000","last_undegraded":"2023-11-28T21:05:48.164491+0000","last_fullsized":"2023-11-28T21:05:48.164491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'383","last_scrub_stamp":"2023-11-28T21:05:48.164339+0000","last_deep_scrub":"51'383","last_deep_scrub_stamp":"2023-11-28T21:05:48.164339+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.164339+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:11.595753+0000","scrub_duration":0.0027454979999999999,"objects_trimmed":0,"snaptrim_duration":0.010031783000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"51'1843","reported_seq":3753,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:45.385624+0000","last_change":"2023-11-28T21:05:45.385624+0000","last_active":"2023-11-28T21:05:45.385624+0000","last_peered":"2023-11-28T21:05:45.385624+0000","last_clean":"2023-11-28T21:05:45.385624+0000","last_became_active":"2023-11-28T20:39:01.389891+0000","last_became_peered":"2023-11-28T20:39:01.389891+0000","last_unstale":"2023-11-28T21:05:45.385624+0000","last_undegraded":"2023-11-28T21:05:45.385624+0000","last_fullsized":"2023-11-28T21:05:45.385624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1843","last_scrub_stamp":"2023-11-28T21:05:45.385425+0000","last_deep_scrub":"51'1843","last_deep_scrub_stamp":"2023-11-28T21:05:45.385425+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.385425+0000","objects_scrubbed":578,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:28.388874+0000","scrub_duration":0.43209253600000003,"objects_trimmed":0,"snaptrim_duration":0.0084388650000000003,"stat_sum":{"num_bytes":22024896,"num_objects":578,"num_object_clones":267,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":578,"num_whiteouts":267,"num_read":47,"num_read_kb":8236,"num_write":1555,"num_write_kb":33440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"51'602","reported_seq":666,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.945924+0000","last_change":"2023-11-28T21:05:45.520765+0000","last_active":"2023-11-28T21:06:14.945924+0000","last_peered":"2023-11-28T21:06:14.945924+0000","last_clean":"2023-11-28T21:06:14.945924+0000","last_became_active":"2023-11-28T20:38:18.566940+0000","last_became_peered":"2023-11-28T20:38:18.566940+0000","last_unstale":"2023-11-28T21:06:14.945924+0000","last_undegraded":"2023-11-28T21:06:14.945924+0000","last_fullsized":"2023-11-28T21:06:14.945924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'602","last_scrub_stamp":"2023-11-28T21:05:45.520500+0000","last_deep_scrub":"51'602","last_deep_scrub_stamp":"2023-11-28T21:05:45.520500+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.520500+0000","objects_scrubbed":23,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:53.505086+0000","scrub_duration":0.106955033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":539,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66384,"num_omap_keys":125,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"51'396","reported_seq":2498,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.204087+0000","last_change":"2023-11-28T21:06:01.204087+0000","last_active":"2023-11-28T21:06:01.204087+0000","last_peered":"2023-11-28T21:06:01.204087+0000","last_clean":"2023-11-28T21:06:01.204087+0000","last_became_active":"2023-11-28T20:38:19.403601+0000","last_became_peered":"2023-11-28T20:38:19.403601+0000","last_unstale":"2023-11-28T21:06:01.204087+0000","last_undegraded":"2023-11-28T21:06:01.204087+0000","last_fullsized":"2023-11-28T21:06:01.204087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'396","last_scrub_stamp":"2023-11-28T21:06:01.203924+0000","last_deep_scrub":"51'396","last_deep_scrub_stamp":"2023-11-28T21:06:01.203924+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.203924+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:35:35.838187+0000","scrub_duration":0.0020324029999999999,"objects_trimmed":0,"snaptrim_duration":0.016140509000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1696","reported_seq":3613,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:59.371925+0000","last_change":"2023-11-28T21:05:59.371925+0000","last_active":"2023-11-28T21:05:59.371925+0000","last_peered":"2023-11-28T21:05:59.371925+0000","last_clean":"2023-11-28T21:05:59.371925+0000","last_became_active":"2023-11-28T20:38:23.593724+0000","last_became_peered":"2023-11-28T20:38:23.593724+0000","last_unstale":"2023-11-28T21:05:59.371925+0000","last_undegraded":"2023-11-28T21:05:59.371925+0000","last_fullsized":"2023-11-28T21:05:59.371925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1696","last_scrub_stamp":"2023-11-28T21:05:59.371622+0000","last_deep_scrub":"51'1696","last_deep_scrub_stamp":"2023-11-28T21:05:59.371622+0000","last_clean_scrub_stamp":"2023-11-28T21:05:59.371622+0000","objects_scrubbed":514,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:09:52.871982+0000","scrub_duration":0.38753573200000002,"objects_trimmed":0,"snaptrim_duration":0.0093789649999999995,"stat_sum":{"num_bytes":11818887,"num_objects":514,"num_object_clones":236,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":236,"num_read":34,"num_read_kb":34,"num_write":1442,"num_write_kb":18567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"51'415","reported_seq":479,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.609836+0000","last_change":"2023-11-28T21:05:36.552278+0000","last_active":"2023-11-28T21:05:50.609836+0000","last_peered":"2023-11-28T21:05:50.609836+0000","last_clean":"2023-11-28T21:05:50.609836+0000","last_became_active":"2023-11-28T20:38:18.572433+0000","last_became_peered":"2023-11-28T20:38:18.572433+0000","last_unstale":"2023-11-28T21:05:50.609836+0000","last_undegraded":"2023-11-28T21:05:50.609836+0000","last_fullsized":"2023-11-28T21:05:50.609836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:36.552022+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:36.552022+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.552022+0000","objects_scrubbed":11,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:51.358100+0000","scrub_duration":0.050659634000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2,"num_read_kb":16,"num_write":354,"num_write_kb":8454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":50644,"num_omap_keys":93,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"51'394","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.617089+0000","last_change":"2023-11-28T21:05:34.100707+0000","last_active":"2023-11-28T21:05:50.617089+0000","last_peered":"2023-11-28T21:05:50.617089+0000","last_clean":"2023-11-28T21:05:50.617089+0000","last_became_active":"2023-11-28T20:38:19.379466+0000","last_became_peered":"2023-11-28T20:38:19.379466+0000","last_unstale":"2023-11-28T21:05:50.617089+0000","last_undegraded":"2023-11-28T21:05:50.617089+0000","last_fullsized":"2023-11-28T21:05:50.617089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:34.100435+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:34.100435+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.100435+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:14:40.322315+0000","scrub_duration":0.0040552970000000002,"objects_trimmed":0,"snaptrim_duration":0.019881585,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"51'1748","reported_seq":3647,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.363192+0000","last_change":"2023-11-28T21:06:01.363192+0000","last_active":"2023-11-28T21:06:01.363192+0000","last_peered":"2023-11-28T21:06:01.363192+0000","last_clean":"2023-11-28T21:06:01.363192+0000","last_became_active":"2023-11-28T20:38:23.599678+0000","last_became_peered":"2023-11-28T20:38:23.599678+0000","last_unstale":"2023-11-28T21:06:01.363192+0000","last_undegraded":"2023-11-28T21:06:01.363192+0000","last_fullsized":"2023-11-28T21:06:01.363192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1748","last_scrub_stamp":"2023-11-28T21:06:01.363087+0000","last_deep_scrub":"51'1748","last_deep_scrub_stamp":"2023-11-28T21:06:01.363087+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.363087+0000","objects_scrubbed":571,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:41:33.947041+0000","scrub_duration":0.36192317400000001,"objects_trimmed":0,"snaptrim_duration":0.0092901790000000008,"stat_sum":{"num_bytes":16892767,"num_objects":571,"num_object_clones":263,"num_object_copies":2284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":571,"num_whiteouts":263,"num_read":40,"num_read_kb":48,"num_write":1465,"num_write_kb":20221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"51'418","reported_seq":2522,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.969208+0000","last_change":"2023-11-28T21:05:49.175162+0000","last_active":"2023-11-28T21:06:14.969208+0000","last_peered":"2023-11-28T21:06:14.969208+0000","last_clean":"2023-11-28T21:06:14.969208+0000","last_became_active":"2023-11-28T20:38:19.399714+0000","last_became_peered":"2023-11-28T20:38:19.399714+0000","last_unstale":"2023-11-28T21:06:14.969208+0000","last_undegraded":"2023-11-28T21:06:14.969208+0000","last_fullsized":"2023-11-28T21:06:14.969208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:05:49.174902+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:05:49.174902+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.174902+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:12.677483+0000","scrub_duration":0.0035801940000000001,"objects_trimmed":0,"snaptrim_duration":0.017860755999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"51'359","reported_seq":425,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.945105+0000","last_change":"2023-11-28T21:05:43.550784+0000","last_active":"2023-11-28T21:06:14.945105+0000","last_peered":"2023-11-28T21:06:14.945105+0000","last_clean":"2023-11-28T21:06:14.945105+0000","last_became_active":"2023-11-28T20:38:18.566849+0000","last_became_peered":"2023-11-28T20:38:18.566849+0000","last_unstale":"2023-11-28T21:06:14.945105+0000","last_undegraded":"2023-11-28T21:06:14.945105+0000","last_fullsized":"2023-11-28T21:06:14.945105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'359","last_scrub_stamp":"2023-11-28T21:05:43.550489+0000","last_deep_scrub":"51'359","last_deep_scrub_stamp":"2023-11-28T21:05:43.550489+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.550489+0000","objects_scrubbed":23,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:36:27.546980+0000","scrub_duration":0.113957661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":4108,"num_write":274,"num_write_kb":33007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89762,"num_omap_keys":171,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"51'1713","reported_seq":3637,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.393797+0000","last_change":"2023-11-28T21:05:56.393797+0000","last_active":"2023-11-28T21:05:56.393797+0000","last_peered":"2023-11-28T21:05:56.393797+0000","last_clean":"2023-11-28T21:05:56.393797+0000","last_became_active":"2023-11-28T20:38:23.600113+0000","last_became_peered":"2023-11-28T20:38:23.600113+0000","last_unstale":"2023-11-28T21:05:56.393797+0000","last_undegraded":"2023-11-28T21:05:56.393797+0000","last_fullsized":"2023-11-28T21:05:56.393797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1713","last_scrub_stamp":"2023-11-28T21:05:56.393516+0000","last_deep_scrub":"51'1713","last_deep_scrub_stamp":"2023-11-28T21:05:56.393516+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.393516+0000","objects_scrubbed":519,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:51:14.037824+0000","scrub_duration":0.41489545799999999,"objects_trimmed":0,"snaptrim_duration":0.011349794999999999,"stat_sum":{"num_bytes":42075033,"num_objects":519,"num_object_clones":229,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":229,"num_read":33,"num_read_kb":8223,"num_write":1463,"num_write_kb":57658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"51'395","reported_seq":2498,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.289522+0000","last_change":"2023-11-28T21:05:32.289522+0000","last_active":"2023-11-28T21:05:32.289522+0000","last_peered":"2023-11-28T21:05:32.289522+0000","last_clean":"2023-11-28T21:05:32.289522+0000","last_became_active":"2023-11-28T20:38:19.355263+0000","last_became_peered":"2023-11-28T20:38:19.355263+0000","last_unstale":"2023-11-28T21:05:32.289522+0000","last_undegraded":"2023-11-28T21:05:32.289522+0000","last_fullsized":"2023-11-28T21:05:32.289522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'395","last_scrub_stamp":"2023-11-28T21:05:32.289412+0000","last_deep_scrub":"51'395","last_deep_scrub_stamp":"2023-11-28T21:05:32.289412+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.289412+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:35:10.715951+0000","scrub_duration":0.001674711,"objects_trimmed":0,"snaptrim_duration":0.018528307000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"51'488","reported_seq":556,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:21.276622+0000","last_change":"2023-11-28T21:05:46.677480+0000","last_active":"2023-11-28T21:06:21.276622+0000","last_peered":"2023-11-28T21:06:21.276622+0000","last_clean":"2023-11-28T21:06:21.276622+0000","last_became_active":"2023-11-28T20:38:18.536697+0000","last_became_peered":"2023-11-28T20:38:18.536697+0000","last_unstale":"2023-11-28T21:06:21.276622+0000","last_undegraded":"2023-11-28T21:06:21.276622+0000","last_fullsized":"2023-11-28T21:06:21.276622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'488","last_scrub_stamp":"2023-11-28T21:05:46.677285+0000","last_deep_scrub":"51'488","last_deep_scrub_stamp":"2023-11-28T21:05:46.677285+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.677285+0000","objects_scrubbed":20,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:36.686128+0000","scrub_duration":0.074223357000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5,"num_read_kb":4129,"num_write":693,"num_write_kb":25655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":97994,"num_omap_keys":459,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"51'1827","reported_seq":3742,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:41.338497+0000","last_change":"2023-11-28T21:05:41.338497+0000","last_active":"2023-11-28T21:05:41.338497+0000","last_peered":"2023-11-28T21:05:41.338497+0000","last_clean":"2023-11-28T21:05:41.338497+0000","last_became_active":"2023-11-28T20:38:23.594352+0000","last_became_peered":"2023-11-28T20:38:23.594352+0000","last_unstale":"2023-11-28T21:05:41.338497+0000","last_undegraded":"2023-11-28T21:05:41.338497+0000","last_fullsized":"2023-11-28T21:05:41.338497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1827","last_scrub_stamp":"2023-11-28T21:05:41.338279+0000","last_deep_scrub":"51'1827","last_deep_scrub_stamp":"2023-11-28T21:05:41.338279+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.338279+0000","objects_scrubbed":549,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:26:57.473243+0000","scrub_duration":0.42601145800000001,"objects_trimmed":0,"snaptrim_duration":0.010051028,"stat_sum":{"num_bytes":36081004,"num_objects":549,"num_object_clones":242,"num_object_copies":2196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":242,"num_read":36,"num_read_kb":4131,"num_write":1572,"num_write_kb":47387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"51'429","reported_seq":2533,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.956382+0000","last_change":"2023-11-28T21:05:34.253896+0000","last_active":"2023-11-28T21:06:14.956382+0000","last_peered":"2023-11-28T21:06:14.956382+0000","last_clean":"2023-11-28T21:06:14.956382+0000","last_became_active":"2023-11-28T20:38:19.351754+0000","last_became_peered":"2023-11-28T20:38:19.351754+0000","last_unstale":"2023-11-28T21:06:14.956382+0000","last_undegraded":"2023-11-28T21:06:14.956382+0000","last_fullsized":"2023-11-28T21:06:14.956382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'429","last_scrub_stamp":"2023-11-28T21:05:34.253775+0000","last_deep_scrub":"51'429","last_deep_scrub_stamp":"2023-11-28T21:05:34.253775+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.253775+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:07.648795+0000","scrub_duration":0.00170806,"objects_trimmed":0,"snaptrim_duration":0.018799937999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"51'685","reported_seq":753,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.155402+0000","last_change":"2023-11-28T21:05:41.707798+0000","last_active":"2023-11-28T21:06:20.155402+0000","last_peered":"2023-11-28T21:06:20.155402+0000","last_clean":"2023-11-28T21:06:20.155402+0000","last_became_active":"2023-11-28T20:38:18.566450+0000","last_became_peered":"2023-11-28T20:38:18.566450+0000","last_unstale":"2023-11-28T21:06:20.155402+0000","last_undegraded":"2023-11-28T21:06:20.155402+0000","last_fullsized":"2023-11-28T21:06:20.155402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'685","last_scrub_stamp":"2023-11-28T21:05:41.707658+0000","last_deep_scrub":"51'685","last_deep_scrub_stamp":"2023-11-28T21:05:41.707658+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.707658+0000","objects_scrubbed":19,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:00:13.376241+0000","scrub_duration":0.055951230999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":4105,"num_write":627,"num_write_kb":16946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":109119,"num_omap_keys":206,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"51'1842","reported_seq":3740,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:15.046691+0000","last_change":"2023-11-28T21:06:15.046725+0000","last_active":"2023-11-28T21:06:15.046691+0000","last_peered":"2023-11-28T21:06:15.046691+0000","last_clean":"2023-11-28T21:06:15.046691+0000","last_became_active":"2023-11-28T20:38:23.778964+0000","last_became_peered":"2023-11-28T20:38:23.778964+0000","last_unstale":"2023-11-28T21:06:15.046691+0000","last_undegraded":"2023-11-28T21:06:15.046691+0000","last_fullsized":"2023-11-28T21:06:15.046691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1842","last_scrub_stamp":"2023-11-28T21:06:15.046590+0000","last_deep_scrub":"51'1842","last_deep_scrub_stamp":"2023-11-28T21:06:15.046590+0000","last_clean_scrub_stamp":"2023-11-28T21:06:15.046590+0000","objects_scrubbed":586,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:39:05.370043+0000","scrub_duration":0.35698871999999998,"objects_trimmed":0,"snaptrim_duration":0.011785257,"stat_sum":{"num_bytes":33810901,"num_objects":586,"num_object_clones":259,"num_object_copies":2344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":586,"num_whiteouts":259,"num_read":37,"num_read_kb":8227,"num_write":1558,"num_write_kb":44779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"51'406","reported_seq":2510,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.960577+0000","last_change":"2023-11-28T21:05:34.948965+0000","last_active":"2023-11-28T21:06:14.960577+0000","last_peered":"2023-11-28T21:06:14.960577+0000","last_clean":"2023-11-28T21:06:14.960577+0000","last_became_active":"2023-11-28T20:38:19.397350+0000","last_became_peered":"2023-11-28T20:38:19.397350+0000","last_unstale":"2023-11-28T21:06:14.960577+0000","last_undegraded":"2023-11-28T21:06:14.960577+0000","last_fullsized":"2023-11-28T21:06:14.960577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'406","last_scrub_stamp":"2023-11-28T21:05:34.948705+0000","last_deep_scrub":"51'406","last_deep_scrub_stamp":"2023-11-28T21:05:34.948705+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.948705+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:53.319129+0000","scrub_duration":0.0033768689999999998,"objects_trimmed":0,"snaptrim_duration":0.011190047999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"51'504","reported_seq":572,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.768246+0000","last_change":"2023-11-28T21:05:37.522356+0000","last_active":"2023-11-28T21:06:20.768246+0000","last_peered":"2023-11-28T21:06:20.768246+0000","last_clean":"2023-11-28T21:06:20.768246+0000","last_became_active":"2023-11-28T20:38:18.570180+0000","last_became_peered":"2023-11-28T20:38:18.570180+0000","last_unstale":"2023-11-28T21:06:20.768246+0000","last_undegraded":"2023-11-28T21:06:20.768246+0000","last_fullsized":"2023-11-28T21:06:20.768246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'504","last_scrub_stamp":"2023-11-28T21:05:37.522080+0000","last_deep_scrub":"51'504","last_deep_scrub_stamp":"2023-11-28T21:05:37.522080+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.522080+0000","objects_scrubbed":19,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:21.382578+0000","scrub_duration":0.058407088000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":8210,"num_write":441,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":131856,"num_omap_keys":203,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"51'1805","reported_seq":3687,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:54.481128+0000","last_change":"2023-11-28T21:05:54.481128+0000","last_active":"2023-11-28T21:05:54.481128+0000","last_peered":"2023-11-28T21:05:54.481128+0000","last_clean":"2023-11-28T21:05:54.481128+0000","last_became_active":"2023-11-28T20:38:23.599055+0000","last_became_peered":"2023-11-28T20:38:23.599055+0000","last_unstale":"2023-11-28T21:05:54.481128+0000","last_undegraded":"2023-11-28T21:05:54.481128+0000","last_fullsized":"2023-11-28T21:05:54.481128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1805","last_scrub_stamp":"2023-11-28T21:05:54.480945+0000","last_deep_scrub":"51'1805","last_deep_scrub_stamp":"2023-11-28T21:05:54.480945+0000","last_clean_scrub_stamp":"2023-11-28T21:05:54.480945+0000","objects_scrubbed":568,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:25.439678+0000","scrub_duration":0.45725488600000003,"objects_trimmed":0,"snaptrim_duration":0.010413970999999999,"stat_sum":{"num_bytes":29462623,"num_objects":568,"num_object_clones":283,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":243,"num_read":43,"num_read_kb":8342,"num_write":1501,"num_write_kb":36747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"51'401","reported_seq":2505,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.967900+0000","last_change":"2023-11-28T21:05:53.334942+0000","last_active":"2023-11-28T21:06:14.967900+0000","last_peered":"2023-11-28T21:06:14.967900+0000","last_clean":"2023-11-28T21:06:14.967900+0000","last_became_active":"2023-11-28T20:38:19.363004+0000","last_became_peered":"2023-11-28T20:38:19.363004+0000","last_unstale":"2023-11-28T21:06:14.967900+0000","last_undegraded":"2023-11-28T21:06:14.967900+0000","last_fullsized":"2023-11-28T21:06:14.967900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'401","last_scrub_stamp":"2023-11-28T21:05:53.334782+0000","last_deep_scrub":"51'401","last_deep_scrub_stamp":"2023-11-28T21:05:53.334782+0000","last_clean_scrub_stamp":"2023-11-28T21:05:53.334782+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.959693+0000","scrub_duration":0.0020351340000000001,"objects_trimmed":0,"snaptrim_duration":0.013760692,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"51'161","reported_seq":230,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:22.294475+0000","last_change":"2023-11-28T21:05:41.266548+0000","last_active":"2023-11-28T21:06:22.294475+0000","last_peered":"2023-11-28T21:06:22.294475+0000","last_clean":"2023-11-28T21:06:22.294475+0000","last_became_active":"2023-11-28T20:38:18.567472+0000","last_became_peered":"2023-11-28T20:38:18.567472+0000","last_unstale":"2023-11-28T21:06:22.294475+0000","last_undegraded":"2023-11-28T21:06:22.294475+0000","last_fullsized":"2023-11-28T21:06:22.294475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'161","last_scrub_stamp":"2023-11-28T21:05:41.266279+0000","last_deep_scrub":"51'161","last_deep_scrub_stamp":"2023-11-28T21:05:41.266279+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.266279+0000","objects_scrubbed":16,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:03:32.433096+0000","scrub_duration":0.045962063999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":7,"num_read_kb":4128,"num_write":106,"num_write_kb":8401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":68354,"num_omap_keys":112,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"51'1903","reported_seq":3792,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.299659+0000","last_change":"2023-11-28T21:06:00.299659+0000","last_active":"2023-11-28T21:06:00.299659+0000","last_peered":"2023-11-28T21:06:00.299659+0000","last_clean":"2023-11-28T21:06:00.299659+0000","last_became_active":"2023-11-28T20:38:23.778890+0000","last_became_peered":"2023-11-28T20:38:23.778890+0000","last_unstale":"2023-11-28T21:06:00.299659+0000","last_undegraded":"2023-11-28T21:06:00.299659+0000","last_fullsized":"2023-11-28T21:06:00.299659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1903","last_scrub_stamp":"2023-11-28T21:06:00.299527+0000","last_deep_scrub":"51'1903","last_deep_scrub_stamp":"2023-11-28T21:06:00.299527+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.299527+0000","objects_scrubbed":591,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:59.660036+0000","scrub_duration":0.30872005899999999,"objects_trimmed":0,"snaptrim_duration":0.0092734619999999997,"stat_sum":{"num_bytes":42280101,"num_objects":591,"num_object_clones":269,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":591,"num_whiteouts":269,"num_read":33,"num_read_kb":4128,"num_write":1621,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"51'381","reported_seq":2485,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.957070+0000","last_change":"2023-11-28T21:06:04.433823+0000","last_active":"2023-11-28T21:06:14.957070+0000","last_peered":"2023-11-28T21:06:14.957070+0000","last_clean":"2023-11-28T21:06:14.957070+0000","last_became_active":"2023-11-28T20:38:19.389447+0000","last_became_peered":"2023-11-28T20:38:19.389447+0000","last_unstale":"2023-11-28T21:06:14.957070+0000","last_undegraded":"2023-11-28T21:06:14.957070+0000","last_fullsized":"2023-11-28T21:06:14.957070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'381","last_scrub_stamp":"2023-11-28T21:06:04.433650+0000","last_deep_scrub":"51'381","last_deep_scrub_stamp":"2023-11-28T21:06:04.433650+0000","last_clean_scrub_stamp":"2023-11-28T21:06:04.433650+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:50.065403+0000","scrub_duration":0.0027321860000000002,"objects_trimmed":0,"snaptrim_duration":0.017915146,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"52'440","reported_seq":509,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:23.782025+0000","last_change":"2023-11-28T21:05:42.760056+0000","last_active":"2023-11-28T21:06:23.782025+0000","last_peered":"2023-11-28T21:06:23.782025+0000","last_clean":"2023-11-28T21:06:23.782025+0000","last_became_active":"2023-11-28T20:38:18.547913+0000","last_became_peered":"2023-11-28T20:38:18.547913+0000","last_unstale":"2023-11-28T21:06:23.782025+0000","last_undegraded":"2023-11-28T21:06:23.782025+0000","last_fullsized":"2023-11-28T21:06:23.782025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'437","last_scrub_stamp":"2023-11-28T21:05:42.759951+0000","last_deep_scrub":"51'437","last_deep_scrub_stamp":"2023-11-28T21:05:42.759951+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.759951+0000","objects_scrubbed":17,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:05:37.013105+0000","scrub_duration":0.10748722099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12069752,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":7,"num_read_kb":4119,"num_write":694,"num_write_kb":13763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99465,"num_omap_keys":200,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"51'1784","reported_seq":3690,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:09.736263+0000","last_change":"2023-11-28T21:06:09.736263+0000","last_active":"2023-11-28T21:06:09.736263+0000","last_peered":"2023-11-28T21:06:09.736263+0000","last_clean":"2023-11-28T21:06:09.736263+0000","last_became_active":"2023-11-28T20:38:23.777826+0000","last_became_peered":"2023-11-28T20:38:23.777826+0000","last_unstale":"2023-11-28T21:06:09.736263+0000","last_undegraded":"2023-11-28T21:06:09.736263+0000","last_fullsized":"2023-11-28T21:06:09.736263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1784","last_scrub_stamp":"2023-11-28T21:06:09.736108+0000","last_deep_scrub":"51'1784","last_deep_scrub_stamp":"2023-11-28T21:06:09.736108+0000","last_clean_scrub_stamp":"2023-11-28T21:06:09.736108+0000","objects_scrubbed":558,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:23.947901+0000","scrub_duration":0.28977997599999999,"objects_trimmed":0,"snaptrim_duration":0.016539027000000001,"stat_sum":{"num_bytes":21707636,"num_objects":558,"num_object_clones":259,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":558,"num_whiteouts":259,"num_read":41,"num_read_kb":41,"num_write":1502,"num_write_kb":25456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"51'425","reported_seq":2529,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:29.596563+0000","last_change":"2023-11-28T21:05:27.436717+0000","last_active":"2023-11-28T21:05:29.596563+0000","last_peered":"2023-11-28T21:05:29.596563+0000","last_clean":"2023-11-28T21:05:29.596563+0000","last_became_active":"2023-11-28T20:38:19.353700+0000","last_became_peered":"2023-11-28T20:38:19.353700+0000","last_unstale":"2023-11-28T21:05:29.596563+0000","last_undegraded":"2023-11-28T21:05:29.596563+0000","last_fullsized":"2023-11-28T21:05:29.596563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'425","last_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_deep_scrub":"51'425","last_deep_scrub_stamp":"2023-11-28T21:05:27.436622+0000","last_clean_scrub_stamp":"2023-11-28T21:05:27.436622+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:32.946946+0000","scrub_duration":0.001593002,"objects_trimmed":0,"snaptrim_duration":0.014316661,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"51'372","reported_seq":440,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.142195+0000","last_change":"2023-11-28T21:05:48.419105+0000","last_active":"2023-11-28T21:06:20.142195+0000","last_peered":"2023-11-28T21:06:20.142195+0000","last_clean":"2023-11-28T21:06:20.142195+0000","last_became_active":"2023-11-28T20:38:18.568189+0000","last_became_peered":"2023-11-28T20:38:18.568189+0000","last_unstale":"2023-11-28T21:06:20.142195+0000","last_undegraded":"2023-11-28T21:06:20.142195+0000","last_fullsized":"2023-11-28T21:06:20.142195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'372","last_scrub_stamp":"2023-11-28T21:05:48.418878+0000","last_deep_scrub":"51'372","last_deep_scrub_stamp":"2023-11-28T21:05:48.418878+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.418878+0000","objects_scrubbed":22,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:03:20.957815+0000","scrub_duration":0.077448291000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360150,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3,"num_read_kb":4097,"num_write":289,"num_write_kb":28962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":127124,"num_omap_keys":243,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"51'1789","reported_seq":3687,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:02.738163+0000","last_change":"2023-11-28T21:06:02.738163+0000","last_active":"2023-11-28T21:06:02.738163+0000","last_peered":"2023-11-28T21:06:02.738163+0000","last_clean":"2023-11-28T21:06:02.738163+0000","last_became_active":"2023-11-28T20:38:23.773671+0000","last_became_peered":"2023-11-28T20:38:23.773671+0000","last_unstale":"2023-11-28T21:06:02.738163+0000","last_undegraded":"2023-11-28T21:06:02.738163+0000","last_fullsized":"2023-11-28T21:06:02.738163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1789","last_scrub_stamp":"2023-11-28T21:06:02.738026+0000","last_deep_scrub":"51'1789","last_deep_scrub_stamp":"2023-11-28T21:06:02.738026+0000","last_clean_scrub_stamp":"2023-11-28T21:06:02.738026+0000","objects_scrubbed":561,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:00:43.969615+0000","scrub_duration":0.34158208299999998,"objects_trimmed":0,"snaptrim_duration":0.014620091,"stat_sum":{"num_bytes":29165465,"num_objects":561,"num_object_clones":251,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":561,"num_whiteouts":251,"num_read":26,"num_read_kb":26,"num_write":1521,"num_write_kb":34762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"51'414","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:05.353017+0000","last_change":"2023-11-28T21:06:05.353017+0000","last_active":"2023-11-28T21:06:05.353017+0000","last_peered":"2023-11-28T21:06:05.353017+0000","last_clean":"2023-11-28T21:06:05.353017+0000","last_became_active":"2023-11-28T20:38:19.364529+0000","last_became_peered":"2023-11-28T20:38:19.364529+0000","last_unstale":"2023-11-28T21:06:05.353017+0000","last_undegraded":"2023-11-28T21:06:05.353017+0000","last_fullsized":"2023-11-28T21:06:05.353017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'414","last_scrub_stamp":"2023-11-28T21:06:05.352767+0000","last_deep_scrub":"51'414","last_deep_scrub_stamp":"2023-11-28T21:06:05.352767+0000","last_clean_scrub_stamp":"2023-11-28T21:06:05.352767+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:55:54.182673+0000","scrub_duration":0.003418333,"objects_trimmed":0,"snaptrim_duration":0.025775551000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"51'276","reported_seq":345,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:22.893237+0000","last_change":"2023-11-28T21:05:28.525091+0000","last_active":"2023-11-28T21:06:22.893237+0000","last_peered":"2023-11-28T21:06:22.893237+0000","last_clean":"2023-11-28T21:06:22.893237+0000","last_became_active":"2023-11-28T20:38:18.526930+0000","last_became_peered":"2023-11-28T20:38:18.526930+0000","last_unstale":"2023-11-28T21:06:22.893237+0000","last_undegraded":"2023-11-28T21:06:22.893237+0000","last_fullsized":"2023-11-28T21:06:22.893237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'276","last_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_deep_scrub":"51'276","last_deep_scrub_stamp":"2023-11-28T21:05:28.524974+0000","last_clean_scrub_stamp":"2023-11-28T21:05:28.524974+0000","objects_scrubbed":17,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:41:23.890866+0000","scrub_duration":0.056500518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":212,"num_write_kb":24764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84018,"num_omap_keys":160,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"51'1827","reported_seq":3721,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:04.600423+0000","last_change":"2023-11-28T21:06:00.938959+0000","last_active":"2023-11-28T21:06:04.600423+0000","last_peered":"2023-11-28T21:06:04.600423+0000","last_clean":"2023-11-28T21:06:04.600423+0000","last_became_active":"2023-11-28T20:39:01.570987+0000","last_became_peered":"2023-11-28T20:39:01.570987+0000","last_unstale":"2023-11-28T21:06:04.600423+0000","last_undegraded":"2023-11-28T21:06:04.600423+0000","last_fullsized":"2023-11-28T21:06:04.600423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1827","last_scrub_stamp":"2023-11-28T21:06:00.938820+0000","last_deep_scrub":"51'1827","last_deep_scrub_stamp":"2023-11-28T21:06:00.938820+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.938820+0000","objects_scrubbed":551,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:52:29.062000+0000","scrub_duration":0.35707936699999998,"objects_trimmed":0,"snaptrim_duration":0.0017641899999999999,"stat_sum":{"num_bytes":29603349,"num_objects":551,"num_object_clones":257,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":257,"num_read":32,"num_read_kb":32,"num_write":1550,"num_write_kb":37188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,0],"acting":[2,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"51'420","reported_seq":2524,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:37.005805+0000","last_change":"2023-11-28T21:05:37.005805+0000","last_active":"2023-11-28T21:05:37.005805+0000","last_peered":"2023-11-28T21:05:37.005805+0000","last_clean":"2023-11-28T21:05:37.005805+0000","last_became_active":"2023-11-28T20:38:19.397379+0000","last_became_peered":"2023-11-28T20:38:19.397379+0000","last_unstale":"2023-11-28T21:05:37.005805+0000","last_undegraded":"2023-11-28T21:05:37.005805+0000","last_fullsized":"2023-11-28T21:05:37.005805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'420","last_scrub_stamp":"2023-11-28T21:05:37.005456+0000","last_deep_scrub":"51'420","last_deep_scrub_stamp":"2023-11-28T21:05:37.005456+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.005456+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:00:05.751633+0000","scrub_duration":0.003608899,"objects_trimmed":0,"snaptrim_duration":0.010944188000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"52'438","reported_seq":505,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:21.018324+0000","last_change":"2023-11-28T21:05:45.190222+0000","last_active":"2023-11-28T21:06:21.018324+0000","last_peered":"2023-11-28T21:06:21.018324+0000","last_clean":"2023-11-28T21:06:21.018324+0000","last_became_active":"2023-11-28T20:38:18.560406+0000","last_became_peered":"2023-11-28T20:38:18.560406+0000","last_unstale":"2023-11-28T21:06:21.018324+0000","last_undegraded":"2023-11-28T21:06:21.018324+0000","last_fullsized":"2023-11-28T21:06:21.018324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'437","last_scrub_stamp":"2023-11-28T21:05:45.189981+0000","last_deep_scrub":"51'437","last_deep_scrub_stamp":"2023-11-28T21:05:45.189981+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.189981+0000","objects_scrubbed":17,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:10:13.180761+0000","scrub_duration":0.065732793999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":3,"num_read_kb":4106,"num_write":379,"num_write_kb":16755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99502,"num_omap_keys":179,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"51'1754","reported_seq":3662,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:13.048999+0000","last_change":"2023-11-28T21:06:13.048999+0000","last_active":"2023-11-28T21:06:13.048999+0000","last_peered":"2023-11-28T21:06:13.048999+0000","last_clean":"2023-11-28T21:06:13.048999+0000","last_became_active":"2023-11-28T20:38:23.583964+0000","last_became_peered":"2023-11-28T20:38:23.583964+0000","last_unstale":"2023-11-28T21:06:13.048999+0000","last_undegraded":"2023-11-28T21:06:13.048999+0000","last_fullsized":"2023-11-28T21:06:13.048999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1754","last_scrub_stamp":"2023-11-28T21:06:13.048812+0000","last_deep_scrub":"51'1754","last_deep_scrub_stamp":"2023-11-28T21:06:13.048812+0000","last_clean_scrub_stamp":"2023-11-28T21:06:13.048812+0000","objects_scrubbed":547,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:30:01.450632+0000","scrub_duration":0.34026673299999999,"objects_trimmed":0,"snaptrim_duration":0.012892727999999999,"stat_sum":{"num_bytes":30726234,"num_objects":547,"num_object_clones":244,"num_object_copies":2188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":244,"num_read":30,"num_read_kb":7398,"num_write":1499,"num_write_kb":38104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"51'416","reported_seq":2521,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.950857+0000","last_change":"2023-11-28T21:05:49.697230+0000","last_active":"2023-11-28T21:06:14.950857+0000","last_peered":"2023-11-28T21:06:14.950857+0000","last_clean":"2023-11-28T21:06:14.950857+0000","last_became_active":"2023-11-28T20:38:19.353738+0000","last_became_peered":"2023-11-28T20:38:19.353738+0000","last_unstale":"2023-11-28T21:06:14.950857+0000","last_undegraded":"2023-11-28T21:06:14.950857+0000","last_fullsized":"2023-11-28T21:06:14.950857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'416","last_scrub_stamp":"2023-11-28T21:05:49.697078+0000","last_deep_scrub":"51'416","last_deep_scrub_stamp":"2023-11-28T21:05:49.697078+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.697078+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:47:01.881093+0000","scrub_duration":0.001761695,"objects_trimmed":0,"snaptrim_duration":0.0088104640000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"52'928","reported_seq":1433,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:22.172110+0000","last_change":"2023-11-28T21:05:45.482078+0000","last_active":"2023-11-28T21:06:22.172110+0000","last_peered":"2023-11-28T21:06:22.172110+0000","last_clean":"2023-11-28T21:06:22.172110+0000","last_became_active":"2023-11-28T20:38:18.540707+0000","last_became_peered":"2023-11-28T20:38:18.540707+0000","last_unstale":"2023-11-28T21:06:22.172110+0000","last_undegraded":"2023-11-28T21:06:22.172110+0000","last_fullsized":"2023-11-28T21:06:22.172110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'927","last_scrub_stamp":"2023-11-28T21:05:45.481954+0000","last_deep_scrub":"51'927","last_deep_scrub_stamp":"2023-11-28T21:05:45.481954+0000","last_clean_scrub_stamp":"2023-11-28T21:05:45.481954+0000","objects_scrubbed":23,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:58:59.711334+0000","scrub_duration":0.067817884999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26750948,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":440,"num_read_kb":13478,"num_write":847,"num_write_kb":26791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106245,"num_omap_keys":198,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"51'1696","reported_seq":3596,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:19.989450+0000","last_change":"2023-11-28T21:06:19.989450+0000","last_active":"2023-11-28T21:06:19.989450+0000","last_peered":"2023-11-28T21:06:19.989450+0000","last_clean":"2023-11-28T21:06:19.989450+0000","last_became_active":"2023-11-28T20:38:23.587640+0000","last_became_peered":"2023-11-28T20:38:23.587640+0000","last_unstale":"2023-11-28T21:06:19.989450+0000","last_undegraded":"2023-11-28T21:06:19.989450+0000","last_fullsized":"2023-11-28T21:06:19.989450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1696","last_scrub_stamp":"2023-11-28T21:06:19.989316+0000","last_deep_scrub":"51'1696","last_deep_scrub_stamp":"2023-11-28T21:06:19.989316+0000","last_clean_scrub_stamp":"2023-11-28T21:06:19.989316+0000","objects_scrubbed":545,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:57.876603+0000","scrub_duration":0.28222937199999998,"objects_trimmed":0,"snaptrim_duration":0.011744523999999999,"stat_sum":{"num_bytes":4888539,"num_objects":545,"num_object_clones":249,"num_object_copies":2180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":545,"num_whiteouts":249,"num_read":26,"num_read_kb":26,"num_write":1427,"num_write_kb":11921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'419","reported_seq":2523,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:47.163684+0000","last_change":"2023-11-28T21:05:47.163684+0000","last_active":"2023-11-28T21:05:47.163684+0000","last_peered":"2023-11-28T21:05:47.163684+0000","last_clean":"2023-11-28T21:05:47.163684+0000","last_became_active":"2023-11-28T20:38:19.398265+0000","last_became_peered":"2023-11-28T20:38:19.398265+0000","last_unstale":"2023-11-28T21:05:47.163684+0000","last_undegraded":"2023-11-28T21:05:47.163684+0000","last_fullsized":"2023-11-28T21:05:47.163684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'419","last_scrub_stamp":"2023-11-28T21:05:47.163561+0000","last_deep_scrub":"51'419","last_deep_scrub_stamp":"2023-11-28T21:05:47.163561+0000","last_clean_scrub_stamp":"2023-11-28T21:05:47.163561+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:21.174839+0000","scrub_duration":0.0032640490000000002,"objects_trimmed":0,"snaptrim_duration":0.013248289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"51'488","reported_seq":557,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:21.527595+0000","last_change":"2023-11-28T21:05:42.516251+0000","last_active":"2023-11-28T21:06:21.527595+0000","last_peered":"2023-11-28T21:06:21.527595+0000","last_clean":"2023-11-28T21:06:21.527595+0000","last_became_active":"2023-11-28T20:38:18.570839+0000","last_became_peered":"2023-11-28T20:38:18.570839+0000","last_unstale":"2023-11-28T21:06:21.527595+0000","last_undegraded":"2023-11-28T21:06:21.527595+0000","last_fullsized":"2023-11-28T21:06:21.527595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'488","last_scrub_stamp":"2023-11-28T21:05:42.515965+0000","last_deep_scrub":"51'488","last_deep_scrub_stamp":"2023-11-28T21:05:42.515965+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.515965+0000","objects_scrubbed":20,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:15.338394+0000","scrub_duration":0.076223933999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":421,"num_write_kb":24975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":59652,"num_omap_keys":113,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"51'1786","reported_seq":3704,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.967428+0000","last_change":"2023-11-28T21:06:07.753915+0000","last_active":"2023-11-28T21:06:14.967428+0000","last_peered":"2023-11-28T21:06:14.967428+0000","last_clean":"2023-11-28T21:06:14.967428+0000","last_became_active":"2023-11-28T20:38:23.773587+0000","last_became_peered":"2023-11-28T20:38:23.773587+0000","last_unstale":"2023-11-28T21:06:14.967428+0000","last_undegraded":"2023-11-28T21:06:14.967428+0000","last_fullsized":"2023-11-28T21:06:14.967428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1786","last_scrub_stamp":"2023-11-28T21:06:07.753763+0000","last_deep_scrub":"51'1786","last_deep_scrub_stamp":"2023-11-28T21:06:07.753763+0000","last_clean_scrub_stamp":"2023-11-28T21:06:07.753763+0000","objects_scrubbed":551,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:29:41.631390+0000","scrub_duration":0.27959615799999998,"objects_trimmed":0,"snaptrim_duration":0.013136992,"stat_sum":{"num_bytes":25033729,"num_objects":551,"num_object_clones":252,"num_object_copies":2204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":551,"num_whiteouts":252,"num_read":47,"num_read_kb":4142,"num_write":1517,"num_write_kb":28607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"51'391","reported_seq":2495,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.276216+0000","last_change":"2023-11-28T21:05:46.276216+0000","last_active":"2023-11-28T21:05:46.276216+0000","last_peered":"2023-11-28T21:05:46.276216+0000","last_clean":"2023-11-28T21:05:46.276216+0000","last_became_active":"2023-11-28T20:38:19.378962+0000","last_became_peered":"2023-11-28T20:38:19.378962+0000","last_unstale":"2023-11-28T21:05:46.276216+0000","last_undegraded":"2023-11-28T21:05:46.276216+0000","last_fullsized":"2023-11-28T21:05:46.276216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'391","last_scrub_stamp":"2023-11-28T21:05:46.276109+0000","last_deep_scrub":"51'391","last_deep_scrub_stamp":"2023-11-28T21:05:46.276109+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.276109+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:26:05.634209+0000","scrub_duration":0.0021140719999999998,"objects_trimmed":0,"snaptrim_duration":0.015322676,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"51'371","reported_seq":441,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.374501+0000","last_change":"2023-11-28T21:05:39.292032+0000","last_active":"2023-11-28T21:06:20.374501+0000","last_peered":"2023-11-28T21:06:20.374501+0000","last_clean":"2023-11-28T21:06:20.374501+0000","last_became_active":"2023-11-28T20:38:18.554179+0000","last_became_peered":"2023-11-28T20:38:18.554179+0000","last_unstale":"2023-11-28T21:06:20.374501+0000","last_undegraded":"2023-11-28T21:06:20.374501+0000","last_fullsized":"2023-11-28T21:06:20.374501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'371","last_scrub_stamp":"2023-11-28T21:05:39.291779+0000","last_deep_scrub":"51'371","last_deep_scrub_stamp":"2023-11-28T21:05:39.291779+0000","last_clean_scrub_stamp":"2023-11-28T21:05:39.291779+0000","objects_scrubbed":18,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:49:03.495198+0000","scrub_duration":0.051458515000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582946,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":8214,"num_write":319,"num_write_kb":12656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":86488,"num_omap_keys":124,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"51'119","reported_seq":221,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.943980+0000","last_change":"2023-11-28T21:05:34.550643+0000","last_active":"2023-11-28T21:06:14.943980+0000","last_peered":"2023-11-28T21:06:14.943980+0000","last_clean":"2023-11-28T21:06:14.943980+0000","last_became_active":"2023-11-28T20:38:06.941083+0000","last_became_peered":"2023-11-28T20:38:06.941083+0000","last_unstale":"2023-11-28T21:06:14.943980+0000","last_undegraded":"2023-11-28T21:06:14.943980+0000","last_fullsized":"2023-11-28T21:06:14.943980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'119","last_scrub_stamp":"2023-11-28T21:05:34.550372+0000","last_deep_scrub":"51'119","last_deep_scrub_stamp":"2023-11-28T21:05:34.550372+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.550372+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:58:36.261369+0000","scrub_duration":0.0093084229999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1795","reported_seq":3693,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:07.396262+0000","last_change":"2023-11-28T21:06:07.396262+0000","last_active":"2023-11-28T21:06:07.396262+0000","last_peered":"2023-11-28T21:06:07.396262+0000","last_clean":"2023-11-28T21:06:07.396262+0000","last_became_active":"2023-11-28T20:38:23.780102+0000","last_became_peered":"2023-11-28T20:38:23.780102+0000","last_unstale":"2023-11-28T21:06:07.396262+0000","last_undegraded":"2023-11-28T21:06:07.396262+0000","last_fullsized":"2023-11-28T21:06:07.396262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1795","last_scrub_stamp":"2023-11-28T21:06:07.396108+0000","last_deep_scrub":"51'1795","last_deep_scrub_stamp":"2023-11-28T21:06:07.396108+0000","last_clean_scrub_stamp":"2023-11-28T21:06:07.396108+0000","objects_scrubbed":563,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:29:39.329391+0000","scrub_duration":0.37906948899999998,"objects_trimmed":0,"snaptrim_duration":0.012304083,"stat_sum":{"num_bytes":50974055,"num_objects":563,"num_object_clones":255,"num_object_copies":2252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":255,"num_read":30,"num_read_kb":4125,"num_write":1519,"num_write_kb":57288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"51'375","reported_seq":2478,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:53.325977+0000","last_change":"2023-11-28T21:05:53.325977+0000","last_active":"2023-11-28T21:05:53.325977+0000","last_peered":"2023-11-28T21:05:53.325977+0000","last_clean":"2023-11-28T21:05:53.325977+0000","last_became_active":"2023-11-28T20:38:19.399413+0000","last_became_peered":"2023-11-28T20:38:19.399413+0000","last_unstale":"2023-11-28T21:05:53.325977+0000","last_undegraded":"2023-11-28T21:05:53.325977+0000","last_fullsized":"2023-11-28T21:05:53.325977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'375","last_scrub_stamp":"2023-11-28T21:05:53.325669+0000","last_deep_scrub":"51'375","last_deep_scrub_stamp":"2023-11-28T21:05:53.325669+0000","last_clean_scrub_stamp":"2023-11-28T21:05:53.325669+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:31:36.453431+0000","scrub_duration":0.0035168999999999999,"objects_trimmed":0,"snaptrim_duration":0.027789237000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"51'234","reported_seq":301,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.940116+0000","last_change":"2023-11-28T21:05:38.489305+0000","last_active":"2023-11-28T21:06:14.940116+0000","last_peered":"2023-11-28T21:06:14.940116+0000","last_clean":"2023-11-28T21:06:14.940116+0000","last_became_active":"2023-11-28T20:38:18.571540+0000","last_became_peered":"2023-11-28T20:38:18.571540+0000","last_unstale":"2023-11-28T21:06:14.940116+0000","last_undegraded":"2023-11-28T21:06:14.940116+0000","last_fullsized":"2023-11-28T21:06:14.940116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'234","last_scrub_stamp":"2023-11-28T21:05:38.489165+0000","last_deep_scrub":"51'234","last_deep_scrub_stamp":"2023-11-28T21:05:38.489165+0000","last_clean_scrub_stamp":"2023-11-28T21:05:38.489165+0000","objects_scrubbed":22,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:13.325917+0000","scrub_duration":0.055655635000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777798,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":5,"num_read_kb":4111,"num_write":164,"num_write_kb":16643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":100904,"num_omap_keys":180,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"51'1783","reported_seq":3696,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.360509+0000","last_change":"2023-11-28T21:06:01.360509+0000","last_active":"2023-11-28T21:06:01.360509+0000","last_peered":"2023-11-28T21:06:01.360509+0000","last_clean":"2023-11-28T21:06:01.360509+0000","last_became_active":"2023-11-28T20:38:23.774522+0000","last_became_peered":"2023-11-28T20:38:23.774522+0000","last_unstale":"2023-11-28T21:06:01.360509+0000","last_undegraded":"2023-11-28T21:06:01.360509+0000","last_fullsized":"2023-11-28T21:06:01.360509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1783","last_scrub_stamp":"2023-11-28T21:06:01.360370+0000","last_deep_scrub":"51'1783","last_deep_scrub_stamp":"2023-11-28T21:06:01.360370+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.360370+0000","objects_scrubbed":536,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:39.318206+0000","scrub_duration":1.2571291090000001,"objects_trimmed":0,"snaptrim_duration":0.016877468,"stat_sum":{"num_bytes":24953790,"num_objects":536,"num_object_clones":250,"num_object_copies":2144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":536,"num_whiteouts":250,"num_read":41,"num_read_kb":41,"num_write":1520,"num_write_kb":33586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"51'453","reported_seq":2556,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:52.212215+0000","last_change":"2023-11-28T21:05:52.212215+0000","last_active":"2023-11-28T21:05:52.212215+0000","last_peered":"2023-11-28T21:05:52.212215+0000","last_clean":"2023-11-28T21:05:52.212215+0000","last_became_active":"2023-11-28T20:38:19.364503+0000","last_became_peered":"2023-11-28T20:38:19.364503+0000","last_unstale":"2023-11-28T21:05:52.212215+0000","last_undegraded":"2023-11-28T21:05:52.212215+0000","last_fullsized":"2023-11-28T21:05:52.212215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'453","last_scrub_stamp":"2023-11-28T21:05:52.211875+0000","last_deep_scrub":"51'453","last_deep_scrub_stamp":"2023-11-28T21:05:52.211875+0000","last_clean_scrub_stamp":"2023-11-28T21:05:52.211875+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:42:44.912509+0000","scrub_duration":0.0042240020000000001,"objects_trimmed":0,"snaptrim_duration":0.020341659000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"52'412","reported_seq":478,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:21.910474+0000","last_change":"2023-11-28T21:05:34.581615+0000","last_active":"2023-11-28T21:06:21.910474+0000","last_peered":"2023-11-28T21:06:21.910474+0000","last_clean":"2023-11-28T21:06:21.910474+0000","last_became_active":"2023-11-28T20:38:18.540140+0000","last_became_peered":"2023-11-28T20:38:18.540140+0000","last_unstale":"2023-11-28T21:06:21.910474+0000","last_undegraded":"2023-11-28T21:06:21.910474+0000","last_fullsized":"2023-11-28T21:06:21.910474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:34.581495+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:34.581495+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.581495+0000","objects_scrubbed":18,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:15.488699+0000","scrub_duration":0.059633824000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777286,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":4105,"num_write":342,"num_write_kb":16717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76134,"num_omap_keys":129,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"51'1767","reported_seq":3676,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:58.681668+0000","last_change":"2023-11-28T21:05:58.681668+0000","last_active":"2023-11-28T21:05:58.681668+0000","last_peered":"2023-11-28T21:05:58.681668+0000","last_clean":"2023-11-28T21:05:58.681668+0000","last_became_active":"2023-11-28T20:38:23.591465+0000","last_became_peered":"2023-11-28T20:38:23.591465+0000","last_unstale":"2023-11-28T21:05:58.681668+0000","last_undegraded":"2023-11-28T21:05:58.681668+0000","last_fullsized":"2023-11-28T21:05:58.681668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1767","last_scrub_stamp":"2023-11-28T21:05:58.681536+0000","last_deep_scrub":"51'1767","last_deep_scrub_stamp":"2023-11-28T21:05:58.681536+0000","last_clean_scrub_stamp":"2023-11-28T21:05:58.681536+0000","objects_scrubbed":542,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:32:52.399186+0000","scrub_duration":0.34306325599999998,"objects_trimmed":0,"snaptrim_duration":0.014814858,"stat_sum":{"num_bytes":20638408,"num_objects":542,"num_object_clones":251,"num_object_copies":2168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":542,"num_whiteouts":251,"num_read":37,"num_read_kb":37,"num_write":1496,"num_write_kb":31881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"51'403","reported_seq":2506,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.429860+0000","last_change":"2023-11-28T21:06:14.429860+0000","last_active":"2023-11-28T21:06:14.429860+0000","last_peered":"2023-11-28T21:06:14.429860+0000","last_clean":"2023-11-28T21:06:14.429860+0000","last_became_active":"2023-11-28T20:38:19.406791+0000","last_became_peered":"2023-11-28T20:38:19.406791+0000","last_unstale":"2023-11-28T21:06:14.429860+0000","last_undegraded":"2023-11-28T21:06:14.429860+0000","last_fullsized":"2023-11-28T21:06:14.429860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'403","last_scrub_stamp":"2023-11-28T21:06:14.429591+0000","last_deep_scrub":"51'403","last_deep_scrub_stamp":"2023-11-28T21:06:14.429591+0000","last_clean_scrub_stamp":"2023-11-28T21:06:14.429591+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:48:13.586769+0000","scrub_duration":0.0036556269999999998,"objects_trimmed":0,"snaptrim_duration":0.017837387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"51'392","reported_seq":460,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.940139+0000","last_change":"2023-11-28T21:05:33.538219+0000","last_active":"2023-11-28T21:06:14.940139+0000","last_peered":"2023-11-28T21:06:14.940139+0000","last_clean":"2023-11-28T21:06:14.940139+0000","last_became_active":"2023-11-28T20:38:18.538289+0000","last_became_peered":"2023-11-28T20:38:18.538289+0000","last_unstale":"2023-11-28T21:06:14.940139+0000","last_undegraded":"2023-11-28T21:06:14.940139+0000","last_fullsized":"2023-11-28T21:06:14.940139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'392","last_scrub_stamp":"2023-11-28T21:05:33.538069+0000","last_deep_scrub":"51'392","last_deep_scrub_stamp":"2023-11-28T21:05:33.538069+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.538069+0000","objects_scrubbed":21,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:56.665928+0000","scrub_duration":0.051903592999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":7,"num_read_kb":4118,"num_write":339,"num_write_kb":16887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":98369,"num_omap_keys":186,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"51'1847","reported_seq":3764,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:26.896927+0000","last_change":"2023-11-28T21:06:26.896927+0000","last_active":"2023-11-28T21:06:26.896927+0000","last_peered":"2023-11-28T21:06:26.896927+0000","last_clean":"2023-11-28T21:06:26.896927+0000","last_became_active":"2023-11-28T20:38:23.779057+0000","last_became_peered":"2023-11-28T20:38:23.779057+0000","last_unstale":"2023-11-28T21:06:26.896927+0000","last_undegraded":"2023-11-28T21:06:26.896927+0000","last_fullsized":"2023-11-28T21:06:26.896927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1847","last_scrub_stamp":"2023-11-28T21:06:26.896793+0000","last_deep_scrub":"51'1847","last_deep_scrub_stamp":"2023-11-28T21:06:26.896793+0000","last_clean_scrub_stamp":"2023-11-28T21:06:26.896793+0000","objects_scrubbed":555,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:17:22.456020+0000","scrub_duration":0.33588409800000002,"objects_trimmed":0,"snaptrim_duration":0.015179433000000001,"stat_sum":{"num_bytes":40252075,"num_objects":555,"num_object_clones":243,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":243,"num_read":37,"num_read_kb":1813,"num_write":1586,"num_write_kb":49527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"51'398","reported_seq":2501,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:59.226601+0000","last_change":"2023-11-28T21:05:59.226601+0000","last_active":"2023-11-28T21:05:59.226601+0000","last_peered":"2023-11-28T21:05:59.226601+0000","last_clean":"2023-11-28T21:05:59.226601+0000","last_became_active":"2023-11-28T20:38:19.406714+0000","last_became_peered":"2023-11-28T20:38:19.406714+0000","last_unstale":"2023-11-28T21:05:59.226601+0000","last_undegraded":"2023-11-28T21:05:59.226601+0000","last_fullsized":"2023-11-28T21:05:59.226601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'398","last_scrub_stamp":"2023-11-28T21:05:59.226364+0000","last_deep_scrub":"51'398","last_deep_scrub_stamp":"2023-11-28T21:05:59.226364+0000","last_clean_scrub_stamp":"2023-11-28T21:05:59.226364+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:38:10.027325+0000","scrub_duration":0.0033335109999999999,"objects_trimmed":0,"snaptrim_duration":0.018023955000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"52'420","reported_seq":487,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:23.410419+0000","last_change":"2023-11-28T21:05:30.052590+0000","last_active":"2023-11-28T21:06:23.410419+0000","last_peered":"2023-11-28T21:06:23.410419+0000","last_clean":"2023-11-28T21:06:23.410419+0000","last_became_active":"2023-11-28T20:38:18.546319+0000","last_became_peered":"2023-11-28T20:38:18.546319+0000","last_unstale":"2023-11-28T21:06:23.410419+0000","last_undegraded":"2023-11-28T21:06:23.410419+0000","last_fullsized":"2023-11-28T21:06:23.410419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:05:30.052426+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:05:30.052426+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.052426+0000","objects_scrubbed":18,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:50.919481+0000","scrub_duration":0.059053013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094443,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":6359,"num_write":658,"num_write_kb":19633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":68276,"num_omap_keys":142,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"51'1788","reported_seq":3691,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.959784+0000","last_change":"2023-11-28T21:05:48.411833+0000","last_active":"2023-11-28T21:06:14.959784+0000","last_peered":"2023-11-28T21:06:14.959784+0000","last_clean":"2023-11-28T21:06:14.959784+0000","last_became_active":"2023-11-28T20:38:23.594047+0000","last_became_peered":"2023-11-28T20:38:23.594047+0000","last_unstale":"2023-11-28T21:06:14.959784+0000","last_undegraded":"2023-11-28T21:06:14.959784+0000","last_fullsized":"2023-11-28T21:06:14.959784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1788","last_scrub_stamp":"2023-11-28T21:05:48.411642+0000","last_deep_scrub":"51'1788","last_deep_scrub_stamp":"2023-11-28T21:05:48.411642+0000","last_clean_scrub_stamp":"2023-11-28T21:05:48.411642+0000","objects_scrubbed":550,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:56.054395+0000","scrub_duration":0.44116404300000001,"objects_trimmed":0,"snaptrim_duration":0.0090848279999999997,"stat_sum":{"num_bytes":25858877,"num_objects":550,"num_object_clones":249,"num_object_copies":2200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":550,"num_whiteouts":249,"num_read":30,"num_read_kb":4125,"num_write":1526,"num_write_kb":33058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"51'442","reported_seq":2545,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.943544+0000","last_change":"2023-11-28T21:05:57.251995+0000","last_active":"2023-11-28T21:06:14.943544+0000","last_peered":"2023-11-28T21:06:14.943544+0000","last_clean":"2023-11-28T21:06:14.943544+0000","last_became_active":"2023-11-28T20:38:19.406749+0000","last_became_peered":"2023-11-28T20:38:19.406749+0000","last_unstale":"2023-11-28T21:06:14.943544+0000","last_undegraded":"2023-11-28T21:06:14.943544+0000","last_fullsized":"2023-11-28T21:06:14.943544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'442","last_scrub_stamp":"2023-11-28T21:05:57.251745+0000","last_deep_scrub":"51'442","last_deep_scrub_stamp":"2023-11-28T21:05:57.251745+0000","last_clean_scrub_stamp":"2023-11-28T21:05:57.251745+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:28:45.560688+0000","scrub_duration":0.0038352299999999998,"objects_trimmed":0,"snaptrim_duration":0.020570496000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"52'658","reported_seq":723,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:19.603737+0000","last_change":"2023-11-28T21:05:41.430262+0000","last_active":"2023-11-28T21:06:19.603737+0000","last_peered":"2023-11-28T21:06:19.603737+0000","last_clean":"2023-11-28T21:06:19.603737+0000","last_became_active":"2023-11-28T20:38:18.534796+0000","last_became_peered":"2023-11-28T20:38:18.534796+0000","last_unstale":"2023-11-28T21:06:19.603737+0000","last_undegraded":"2023-11-28T21:06:19.603737+0000","last_fullsized":"2023-11-28T21:06:19.603737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'657","last_scrub_stamp":"2023-11-28T21:05:41.430137+0000","last_deep_scrub":"51'657","last_deep_scrub_stamp":"2023-11-28T21:05:41.430137+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.430137+0000","objects_scrubbed":24,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:12:56.869809+0000","scrub_duration":0.042827776999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583024,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":7,"num_write":598,"num_write_kb":12973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":62330,"num_omap_keys":118,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"51'1723","reported_seq":3650,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:57.622219+0000","last_change":"2023-11-28T21:05:57.622219+0000","last_active":"2023-11-28T21:05:57.622219+0000","last_peered":"2023-11-28T21:05:57.622219+0000","last_clean":"2023-11-28T21:05:57.622219+0000","last_became_active":"2023-11-28T20:38:23.584756+0000","last_became_peered":"2023-11-28T20:38:23.584756+0000","last_unstale":"2023-11-28T21:05:57.622219+0000","last_undegraded":"2023-11-28T21:05:57.622219+0000","last_fullsized":"2023-11-28T21:05:57.622219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1723","last_scrub_stamp":"2023-11-28T21:05:57.622068+0000","last_deep_scrub":"51'1723","last_deep_scrub_stamp":"2023-11-28T21:05:57.622068+0000","last_clean_scrub_stamp":"2023-11-28T21:05:57.622068+0000","objects_scrubbed":524,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:16.174973+0000","scrub_duration":0.29220352900000002,"objects_trimmed":0,"snaptrim_duration":0.011806407999999999,"stat_sum":{"num_bytes":28712373,"num_objects":524,"num_object_clones":239,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":239,"num_read":46,"num_read_kb":46,"num_write":1462,"num_write_kb":31285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"51'407","reported_seq":2510,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.968623+0000","last_change":"2023-11-28T21:05:44.161668+0000","last_active":"2023-11-28T21:06:14.968623+0000","last_peered":"2023-11-28T21:06:14.968623+0000","last_clean":"2023-11-28T21:06:14.968623+0000","last_became_active":"2023-11-28T20:38:19.376286+0000","last_became_peered":"2023-11-28T20:38:19.376286+0000","last_unstale":"2023-11-28T21:06:14.968623+0000","last_undegraded":"2023-11-28T21:06:14.968623+0000","last_fullsized":"2023-11-28T21:06:14.968623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'407","last_scrub_stamp":"2023-11-28T21:05:44.161256+0000","last_deep_scrub":"51'407","last_deep_scrub_stamp":"2023-11-28T21:05:44.161256+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.161256+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:26:10.673180+0000","scrub_duration":0.0042608810000000002,"objects_trimmed":0,"snaptrim_duration":0.014629055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"51'473","reported_seq":540,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.609766+0000","last_change":"2023-11-28T21:05:33.374328+0000","last_active":"2023-11-28T21:06:20.609766+0000","last_peered":"2023-11-28T21:06:20.609766+0000","last_clean":"2023-11-28T21:06:20.609766+0000","last_became_active":"2023-11-28T20:38:18.541734+0000","last_became_peered":"2023-11-28T20:38:18.541734+0000","last_unstale":"2023-11-28T21:06:20.609766+0000","last_undegraded":"2023-11-28T21:06:20.609766+0000","last_fullsized":"2023-11-28T21:06:20.609766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'473","last_scrub_stamp":"2023-11-28T21:05:33.374073+0000","last_deep_scrub":"51'473","last_deep_scrub_stamp":"2023-11-28T21:05:33.374073+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.374073+0000","objects_scrubbed":15,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:57:31.084888+0000","scrub_duration":0.075804628999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":416,"num_write_kb":20890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":57473,"num_omap_keys":100,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"51'1831","reported_seq":3732,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:12.821411+0000","last_change":"2023-11-28T21:06:12.821411+0000","last_active":"2023-11-28T21:06:12.821411+0000","last_peered":"2023-11-28T21:06:12.821411+0000","last_clean":"2023-11-28T21:06:12.821411+0000","last_became_active":"2023-11-28T20:38:23.773492+0000","last_became_peered":"2023-11-28T20:38:23.773492+0000","last_unstale":"2023-11-28T21:06:12.821411+0000","last_undegraded":"2023-11-28T21:06:12.821411+0000","last_fullsized":"2023-11-28T21:06:12.821411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1831","last_scrub_stamp":"2023-11-28T21:06:12.821221+0000","last_deep_scrub":"51'1831","last_deep_scrub_stamp":"2023-11-28T21:06:12.821221+0000","last_clean_scrub_stamp":"2023-11-28T21:06:12.821221+0000","objects_scrubbed":572,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:03:11.692677+0000","scrub_duration":0.38320025200000002,"objects_trimmed":0,"snaptrim_duration":0.017596898999999999,"stat_sum":{"num_bytes":20840070,"num_objects":572,"num_object_clones":259,"num_object_copies":2288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":259,"num_read":39,"num_read_kb":4134,"num_write":1549,"num_write_kb":33741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"51'411","reported_seq":2514,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.944309+0000","last_change":"2023-11-28T21:05:52.355786+0000","last_active":"2023-11-28T21:06:14.944309+0000","last_peered":"2023-11-28T21:06:14.944309+0000","last_clean":"2023-11-28T21:06:14.944309+0000","last_became_active":"2023-11-28T20:38:19.401825+0000","last_became_peered":"2023-11-28T20:38:19.401825+0000","last_unstale":"2023-11-28T21:06:14.944309+0000","last_undegraded":"2023-11-28T21:06:14.944309+0000","last_fullsized":"2023-11-28T21:06:14.944309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:52.355472+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:52.355472+0000","last_clean_scrub_stamp":"2023-11-28T21:05:52.355472+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:37.533653+0000","scrub_duration":0.003268642,"objects_trimmed":0,"snaptrim_duration":0.019240779,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"51'299","reported_seq":366,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.625361+0000","last_change":"2023-11-28T21:05:43.228912+0000","last_active":"2023-11-28T21:06:20.625361+0000","last_peered":"2023-11-28T21:06:20.625361+0000","last_clean":"2023-11-28T21:06:20.625361+0000","last_became_active":"2023-11-28T20:38:18.567932+0000","last_became_peered":"2023-11-28T20:38:18.567932+0000","last_unstale":"2023-11-28T21:06:20.625361+0000","last_undegraded":"2023-11-28T21:06:20.625361+0000","last_fullsized":"2023-11-28T21:06:20.625361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'299","last_scrub_stamp":"2023-11-28T21:05:43.228655+0000","last_deep_scrub":"51'299","last_deep_scrub_stamp":"2023-11-28T21:05:43.228655+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.228655+0000","objects_scrubbed":15,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:39:18.023290+0000","scrub_duration":0.053656686000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":8208,"num_write":238,"num_write_kb":12572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73750,"num_omap_keys":139,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"51'1661","reported_seq":3580,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.956114+0000","last_change":"2023-11-28T21:06:10.763802+0000","last_active":"2023-11-28T21:06:14.956114+0000","last_peered":"2023-11-28T21:06:14.956114+0000","last_clean":"2023-11-28T21:06:14.956114+0000","last_became_active":"2023-11-28T20:38:23.777922+0000","last_became_peered":"2023-11-28T20:38:23.777922+0000","last_unstale":"2023-11-28T21:06:14.956114+0000","last_undegraded":"2023-11-28T21:06:14.956114+0000","last_fullsized":"2023-11-28T21:06:14.956114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1661","last_scrub_stamp":"2023-11-28T21:06:10.763688+0000","last_deep_scrub":"51'1661","last_deep_scrub_stamp":"2023-11-28T21:06:10.763688+0000","last_clean_scrub_stamp":"2023-11-28T21:06:10.763688+0000","objects_scrubbed":524,"log_size":1661,"log_dups_size":0,"ondisk_log_size":1661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:35:25.727299+0000","scrub_duration":0.327626743,"objects_trimmed":0,"snaptrim_duration":0.018495173,"stat_sum":{"num_bytes":20919340,"num_objects":524,"num_object_clones":235,"num_object_copies":2096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":524,"num_whiteouts":235,"num_read":33,"num_read_kb":33,"num_write":1415,"num_write_kb":40695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"51'413","reported_seq":2516,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.966939+0000","last_change":"2023-11-28T21:05:30.162003+0000","last_active":"2023-11-28T21:06:14.966939+0000","last_peered":"2023-11-28T21:06:14.966939+0000","last_clean":"2023-11-28T21:06:14.966939+0000","last_became_active":"2023-11-28T20:38:19.389378+0000","last_became_peered":"2023-11-28T20:38:19.389378+0000","last_unstale":"2023-11-28T21:06:14.966939+0000","last_undegraded":"2023-11-28T21:06:14.966939+0000","last_fullsized":"2023-11-28T21:06:14.966939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'413","last_scrub_stamp":"2023-11-28T21:05:30.161904+0000","last_deep_scrub":"51'413","last_deep_scrub_stamp":"2023-11-28T21:05:30.161904+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.161904+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:36:00.574298+0000","scrub_duration":0.0026842540000000001,"objects_trimmed":0,"snaptrim_duration":0.014112118999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"51'422","reported_seq":488,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:22.939398+0000","last_change":"2023-11-28T21:05:31.170458+0000","last_active":"2023-11-28T21:06:22.939398+0000","last_peered":"2023-11-28T21:06:22.939398+0000","last_clean":"2023-11-28T21:06:22.939398+0000","last_became_active":"2023-11-28T20:38:18.542070+0000","last_became_peered":"2023-11-28T20:38:18.542070+0000","last_unstale":"2023-11-28T21:06:22.939398+0000","last_undegraded":"2023-11-28T21:06:22.939398+0000","last_fullsized":"2023-11-28T21:06:22.939398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'422","last_scrub_stamp":"2023-11-28T21:05:31.170251+0000","last_deep_scrub":"51'422","last_deep_scrub_stamp":"2023-11-28T21:05:31.170251+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.170251+0000","objects_scrubbed":17,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:48.673212+0000","scrub_duration":0.054918677999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":364,"num_write_kb":16779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":77628,"num_omap_keys":149,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"51'1691","reported_seq":3614,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:29.005391+0000","last_change":"2023-11-28T21:06:29.005481+0000","last_active":"2023-11-28T21:06:29.005391+0000","last_peered":"2023-11-28T21:06:29.005391+0000","last_clean":"2023-11-28T21:06:29.005391+0000","last_became_active":"2023-11-28T20:38:23.779080+0000","last_became_peered":"2023-11-28T20:38:23.779080+0000","last_unstale":"2023-11-28T21:06:29.005391+0000","last_undegraded":"2023-11-28T21:06:29.005391+0000","last_fullsized":"2023-11-28T21:06:29.005391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1691","last_scrub_stamp":"2023-11-28T21:06:29.005162+0000","last_deep_scrub":"51'1691","last_deep_scrub_stamp":"2023-11-28T21:06:29.005162+0000","last_clean_scrub_stamp":"2023-11-28T21:06:29.005162+0000","objects_scrubbed":515,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:09:55.037896+0000","scrub_duration":0.40757348300000001,"objects_trimmed":0,"snaptrim_duration":0.015550285,"stat_sum":{"num_bytes":33895761,"num_objects":515,"num_object_clones":224,"num_object_copies":2060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":515,"num_whiteouts":224,"num_read":28,"num_read_kb":28,"num_write":1451,"num_write_kb":37503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"51'394","reported_seq":2496,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:33.531160+0000","last_change":"2023-11-28T21:05:33.531160+0000","last_active":"2023-11-28T21:05:33.531160+0000","last_peered":"2023-11-28T21:05:33.531160+0000","last_clean":"2023-11-28T21:05:33.531160+0000","last_became_active":"2023-11-28T20:38:19.394865+0000","last_became_peered":"2023-11-28T20:38:19.394865+0000","last_unstale":"2023-11-28T21:05:33.531160+0000","last_undegraded":"2023-11-28T21:05:33.531160+0000","last_fullsized":"2023-11-28T21:05:33.531160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:33.530916+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:33.530916+0000","last_clean_scrub_stamp":"2023-11-28T21:05:33.530916+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:12:51.990509+0000","scrub_duration":0.00324325,"objects_trimmed":0,"snaptrim_duration":0.022690017,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"51'585","reported_seq":650,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:22.670122+0000","last_change":"2023-11-28T21:05:36.348768+0000","last_active":"2023-11-28T21:06:22.670122+0000","last_peered":"2023-11-28T21:06:22.670122+0000","last_clean":"2023-11-28T21:06:22.670122+0000","last_became_active":"2023-11-28T20:38:18.542561+0000","last_became_peered":"2023-11-28T20:38:18.542561+0000","last_unstale":"2023-11-28T21:06:22.670122+0000","last_undegraded":"2023-11-28T21:06:22.670122+0000","last_fullsized":"2023-11-28T21:06:22.670122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'585","last_scrub_stamp":"2023-11-28T21:05:36.348472+0000","last_deep_scrub":"51'585","last_deep_scrub_stamp":"2023-11-28T21:05:36.348472+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.348472+0000","objects_scrubbed":19,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:44:00.211075+0000","scrub_duration":0.085323616000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":504,"num_write_kb":24942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82322,"num_omap_keys":142,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"51'1823","reported_seq":3726,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.950970+0000","last_change":"2023-11-28T21:06:04.982984+0000","last_active":"2023-11-28T21:06:14.950970+0000","last_peered":"2023-11-28T21:06:14.950970+0000","last_clean":"2023-11-28T21:06:14.950970+0000","last_became_active":"2023-11-28T20:38:23.594437+0000","last_became_peered":"2023-11-28T20:38:23.594437+0000","last_unstale":"2023-11-28T21:06:14.950970+0000","last_undegraded":"2023-11-28T21:06:14.950970+0000","last_fullsized":"2023-11-28T21:06:14.950970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1823","last_scrub_stamp":"2023-11-28T21:06:04.982842+0000","last_deep_scrub":"51'1823","last_deep_scrub_stamp":"2023-11-28T21:06:04.982842+0000","last_clean_scrub_stamp":"2023-11-28T21:06:04.982842+0000","objects_scrubbed":556,"log_size":1823,"log_dups_size":0,"ondisk_log_size":1823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:30:42.213272+0000","scrub_duration":0.30750132200000002,"objects_trimmed":0,"snaptrim_duration":0.013090108,"stat_sum":{"num_bytes":42607549,"num_objects":556,"num_object_clones":254,"num_object_copies":2224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":556,"num_whiteouts":254,"num_read":36,"num_read_kb":4131,"num_write":1543,"num_write_kb":57518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"51'388","reported_seq":2483,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:12.520851+0000","last_change":"2023-11-28T21:06:12.520851+0000","last_active":"2023-11-28T21:06:12.520851+0000","last_peered":"2023-11-28T21:06:12.520851+0000","last_clean":"2023-11-28T21:06:12.520851+0000","last_became_active":"2023-11-28T20:39:01.848225+0000","last_became_peered":"2023-11-28T20:39:01.848225+0000","last_unstale":"2023-11-28T21:06:12.520851+0000","last_undegraded":"2023-11-28T21:06:12.520851+0000","last_fullsized":"2023-11-28T21:06:12.520851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'388","last_scrub_stamp":"2023-11-28T21:06:12.520744+0000","last_deep_scrub":"51'388","last_deep_scrub_stamp":"2023-11-28T21:06:12.520744+0000","last_clean_scrub_stamp":"2023-11-28T21:06:12.520744+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:39:49.760120+0000","scrub_duration":0.0031430189999999999,"objects_trimmed":0,"snaptrim_duration":0.0019608149999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.15","version":"51'561","reported_seq":625,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.952737+0000","last_change":"2023-11-28T21:05:30.590054+0000","last_active":"2023-11-28T21:06:14.952737+0000","last_peered":"2023-11-28T21:06:14.952737+0000","last_clean":"2023-11-28T21:06:14.952737+0000","last_became_active":"2023-11-28T20:38:18.569943+0000","last_became_peered":"2023-11-28T20:38:18.569943+0000","last_unstale":"2023-11-28T21:06:14.952737+0000","last_undegraded":"2023-11-28T21:06:14.952737+0000","last_fullsized":"2023-11-28T21:06:14.952737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'561","last_scrub_stamp":"2023-11-28T21:05:30.589932+0000","last_deep_scrub":"51'561","last_deep_scrub_stamp":"2023-11-28T21:05:30.589932+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.589932+0000","objects_scrubbed":23,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:24:21.359666+0000","scrub_duration":0.070269200000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":502,"num_write_kb":21060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":120182,"num_omap_keys":228,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"51'1816","reported_seq":3740,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.961559+0000","last_change":"2023-11-28T21:05:42.324200+0000","last_active":"2023-11-28T21:06:14.961559+0000","last_peered":"2023-11-28T21:06:14.961559+0000","last_clean":"2023-11-28T21:06:14.961559+0000","last_became_active":"2023-11-28T20:38:23.593381+0000","last_became_peered":"2023-11-28T20:38:23.593381+0000","last_unstale":"2023-11-28T21:06:14.961559+0000","last_undegraded":"2023-11-28T21:06:14.961559+0000","last_fullsized":"2023-11-28T21:06:14.961559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1816","last_scrub_stamp":"2023-11-28T21:05:42.324029+0000","last_deep_scrub":"51'1816","last_deep_scrub_stamp":"2023-11-28T21:05:42.324029+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.324029+0000","objects_scrubbed":568,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:23:37.426481+0000","scrub_duration":0.39091050599999999,"objects_trimmed":0,"snaptrim_duration":0.010092998000000001,"stat_sum":{"num_bytes":33600436,"num_objects":568,"num_object_clones":254,"num_object_copies":2272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":254,"num_read":57,"num_read_kb":4152,"num_write":1538,"num_write_kb":45454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"51'410","reported_seq":2512,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:49.207521+0000","last_change":"2023-11-28T21:05:49.207521+0000","last_active":"2023-11-28T21:05:49.207521+0000","last_peered":"2023-11-28T21:05:49.207521+0000","last_clean":"2023-11-28T21:05:49.207521+0000","last_became_active":"2023-11-28T20:38:19.385390+0000","last_became_peered":"2023-11-28T20:38:19.385390+0000","last_unstale":"2023-11-28T21:05:49.207521+0000","last_undegraded":"2023-11-28T21:05:49.207521+0000","last_fullsized":"2023-11-28T21:05:49.207521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'410","last_scrub_stamp":"2023-11-28T21:05:49.207417+0000","last_deep_scrub":"51'410","last_deep_scrub_stamp":"2023-11-28T21:05:49.207417+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.207417+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:23:00.311308+0000","scrub_duration":0.002803495,"objects_trimmed":0,"snaptrim_duration":0.011744874000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"51'506","reported_seq":572,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.273561+0000","last_change":"2023-11-28T21:05:44.276812+0000","last_active":"2023-11-28T21:06:20.273561+0000","last_peered":"2023-11-28T21:06:20.273561+0000","last_clean":"2023-11-28T21:06:20.273561+0000","last_became_active":"2023-11-28T20:38:18.568130+0000","last_became_peered":"2023-11-28T20:38:18.568130+0000","last_unstale":"2023-11-28T21:06:20.273561+0000","last_undegraded":"2023-11-28T21:06:20.273561+0000","last_fullsized":"2023-11-28T21:06:20.273561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'506","last_scrub_stamp":"2023-11-28T21:05:44.276499+0000","last_deep_scrub":"51'506","last_deep_scrub_stamp":"2023-11-28T21:05:44.276499+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.276499+0000","objects_scrubbed":22,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:47:33.316636+0000","scrub_duration":0.12046440999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":8219,"num_write":437,"num_write_kb":33175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130075,"num_omap_keys":234,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"51'1777","reported_seq":3703,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:18.714476+0000","last_change":"2023-11-28T21:06:18.714476+0000","last_active":"2023-11-28T21:06:18.714476+0000","last_peered":"2023-11-28T21:06:18.714476+0000","last_clean":"2023-11-28T21:06:18.714476+0000","last_became_active":"2023-11-28T20:39:01.386315+0000","last_became_peered":"2023-11-28T20:39:01.386315+0000","last_unstale":"2023-11-28T21:06:18.714476+0000","last_undegraded":"2023-11-28T21:06:18.714476+0000","last_fullsized":"2023-11-28T21:06:18.714476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1777","last_scrub_stamp":"2023-11-28T21:06:18.714278+0000","last_deep_scrub":"51'1777","last_deep_scrub_stamp":"2023-11-28T21:06:18.714278+0000","last_clean_scrub_stamp":"2023-11-28T21:06:18.714278+0000","objects_scrubbed":525,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:07:44.463407+0000","scrub_duration":0.31533417000000002,"objects_trimmed":0,"snaptrim_duration":0.018323326000000001,"stat_sum":{"num_bytes":24785841,"num_objects":525,"num_object_clones":238,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":238,"num_read":34,"num_read_kb":34,"num_write":1518,"num_write_kb":32579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"51'411","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:32.162153+0000","last_change":"2023-11-28T21:05:32.162153+0000","last_active":"2023-11-28T21:05:32.162153+0000","last_peered":"2023-11-28T21:05:32.162153+0000","last_clean":"2023-11-28T21:05:32.162153+0000","last_became_active":"2023-11-28T20:38:19.392184+0000","last_became_peered":"2023-11-28T20:38:19.392184+0000","last_unstale":"2023-11-28T21:05:32.162153+0000","last_undegraded":"2023-11-28T21:05:32.162153+0000","last_fullsized":"2023-11-28T21:05:32.162153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:32.161774+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:32.161774+0000","last_clean_scrub_stamp":"2023-11-28T21:05:32.161774+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:33:08.878532+0000","scrub_duration":0.0040654100000000002,"objects_trimmed":0,"snaptrim_duration":0.022293309000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"51'182","reported_seq":246,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.971553+0000","last_change":"2023-11-28T21:05:43.192141+0000","last_active":"2023-11-28T21:06:14.971553+0000","last_peered":"2023-11-28T21:06:14.971553+0000","last_clean":"2023-11-28T21:06:14.971553+0000","last_became_active":"2023-11-28T20:38:18.571047+0000","last_became_peered":"2023-11-28T20:38:18.571047+0000","last_unstale":"2023-11-28T21:06:14.971553+0000","last_undegraded":"2023-11-28T21:06:14.971553+0000","last_fullsized":"2023-11-28T21:06:14.971553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'182","last_scrub_stamp":"2023-11-28T21:05:43.191676+0000","last_deep_scrub":"51'182","last_deep_scrub_stamp":"2023-11-28T21:05:43.191676+0000","last_clean_scrub_stamp":"2023-11-28T21:05:43.191676+0000","objects_scrubbed":19,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:26.130737+0000","scrub_duration":0.043839175000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":125,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71130,"num_omap_keys":135,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"51'1914","reported_seq":3810,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.955518+0000","last_change":"2023-11-28T21:06:08.845464+0000","last_active":"2023-11-28T21:06:14.955518+0000","last_peered":"2023-11-28T21:06:14.955518+0000","last_clean":"2023-11-28T21:06:14.955518+0000","last_became_active":"2023-11-28T20:38:23.777899+0000","last_became_peered":"2023-11-28T20:38:23.777899+0000","last_unstale":"2023-11-28T21:06:14.955518+0000","last_undegraded":"2023-11-28T21:06:14.955518+0000","last_fullsized":"2023-11-28T21:06:14.955518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1914","last_scrub_stamp":"2023-11-28T21:06:08.845233+0000","last_deep_scrub":"51'1914","last_deep_scrub_stamp":"2023-11-28T21:06:08.845233+0000","last_clean_scrub_stamp":"2023-11-28T21:06:08.845233+0000","objects_scrubbed":583,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:20:09.557293+0000","scrub_duration":0.364030248,"objects_trimmed":0,"snaptrim_duration":0.016210088000000001,"stat_sum":{"num_bytes":26682582,"num_objects":583,"num_object_clones":263,"num_object_copies":2332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":583,"num_whiteouts":263,"num_read":39,"num_read_kb":8229,"num_write":1627,"num_write_kb":50263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"51'1808","reported_seq":3687,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.966929+0000","last_change":"2023-11-28T21:06:10.831997+0000","last_active":"2023-11-28T21:06:14.966929+0000","last_peered":"2023-11-28T21:06:14.966929+0000","last_clean":"2023-11-28T21:06:14.966929+0000","last_became_active":"2023-11-28T20:38:23.777845+0000","last_became_peered":"2023-11-28T20:38:23.777845+0000","last_unstale":"2023-11-28T21:06:14.966929+0000","last_undegraded":"2023-11-28T21:06:14.966929+0000","last_fullsized":"2023-11-28T21:06:14.966929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1808","last_scrub_stamp":"2023-11-28T21:06:10.831867+0000","last_deep_scrub":"51'1808","last_deep_scrub_stamp":"2023-11-28T21:06:10.831867+0000","last_clean_scrub_stamp":"2023-11-28T21:06:10.831867+0000","objects_scrubbed":589,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:38:48.507456+0000","scrub_duration":0.31114296499999999,"objects_trimmed":0,"snaptrim_duration":0.011090378999999999,"stat_sum":{"num_bytes":29341830,"num_objects":589,"num_object_clones":267,"num_object_copies":2356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":589,"num_whiteouts":267,"num_read":21,"num_read_kb":21,"num_write":1524,"num_write_kb":32957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"51'411","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.649105+0000","last_change":"2023-11-28T21:06:00.649105+0000","last_active":"2023-11-28T21:06:00.649105+0000","last_peered":"2023-11-28T21:06:00.649105+0000","last_clean":"2023-11-28T21:06:00.649105+0000","last_became_active":"2023-11-28T20:38:19.361995+0000","last_became_peered":"2023-11-28T20:38:19.361995+0000","last_unstale":"2023-11-28T21:06:00.649105+0000","last_undegraded":"2023-11-28T21:06:00.649105+0000","last_fullsized":"2023-11-28T21:06:00.649105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:06:00.648992+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:06:00.648992+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.648992+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:44.955477+0000","scrub_duration":0.00140313,"objects_trimmed":0,"snaptrim_duration":0.0086681780000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"51'624","reported_seq":690,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.967215+0000","last_change":"2023-11-28T21:05:49.331811+0000","last_active":"2023-11-28T21:06:14.967215+0000","last_peered":"2023-11-28T21:06:14.967215+0000","last_clean":"2023-11-28T21:06:14.967215+0000","last_became_active":"2023-11-28T20:38:18.567965+0000","last_became_peered":"2023-11-28T20:38:18.567965+0000","last_unstale":"2023-11-28T21:06:14.967215+0000","last_undegraded":"2023-11-28T21:06:14.967215+0000","last_fullsized":"2023-11-28T21:06:14.967215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'624","last_scrub_stamp":"2023-11-28T21:05:49.331608+0000","last_deep_scrub":"51'624","last_deep_scrub_stamp":"2023-11-28T21:05:49.331608+0000","last_clean_scrub_stamp":"2023-11-28T21:05:49.331608+0000","objects_scrubbed":24,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:45:25.450650+0000","scrub_duration":0.152492033,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":5,"num_read_kb":4129,"num_write":550,"num_write_kb":45433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106123,"num_omap_keys":201,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"51'1738","reported_seq":3645,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.408217+0000","last_change":"2023-11-28T21:06:01.408217+0000","last_active":"2023-11-28T21:06:01.408217+0000","last_peered":"2023-11-28T21:06:01.408217+0000","last_clean":"2023-11-28T21:06:01.408217+0000","last_became_active":"2023-11-28T20:38:23.583819+0000","last_became_peered":"2023-11-28T20:38:23.583819+0000","last_unstale":"2023-11-28T21:06:01.408217+0000","last_undegraded":"2023-11-28T21:06:01.408217+0000","last_fullsized":"2023-11-28T21:06:01.408217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1738","last_scrub_stamp":"2023-11-28T21:06:01.408067+0000","last_deep_scrub":"51'1738","last_deep_scrub_stamp":"2023-11-28T21:06:01.408067+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.408067+0000","objects_scrubbed":555,"log_size":1738,"log_dups_size":0,"ondisk_log_size":1738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:14:34.270910+0000","scrub_duration":0.28393545399999998,"objects_trimmed":0,"snaptrim_duration":0.016829818,"stat_sum":{"num_bytes":16566795,"num_objects":555,"num_object_clones":248,"num_object_copies":2220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":555,"num_whiteouts":248,"num_read":32,"num_read_kb":32,"num_write":1476,"num_write_kb":23281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"51'447","reported_seq":2549,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:54.403912+0000","last_change":"2023-11-28T21:05:54.403912+0000","last_active":"2023-11-28T21:05:54.403912+0000","last_peered":"2023-11-28T21:05:54.403912+0000","last_clean":"2023-11-28T21:05:54.403912+0000","last_became_active":"2023-11-28T20:38:19.354198+0000","last_became_peered":"2023-11-28T20:38:19.354198+0000","last_unstale":"2023-11-28T21:05:54.403912+0000","last_undegraded":"2023-11-28T21:05:54.403912+0000","last_fullsized":"2023-11-28T21:05:54.403912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'447","last_scrub_stamp":"2023-11-28T21:05:54.403818+0000","last_deep_scrub":"51'447","last_deep_scrub_stamp":"2023-11-28T21:05:54.403818+0000","last_clean_scrub_stamp":"2023-11-28T21:05:54.403818+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:10:54.550566+0000","scrub_duration":0.00144692,"objects_trimmed":0,"snaptrim_duration":0.018571445999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"51'779","reported_seq":1337,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:21.402713+0000","last_change":"2023-11-28T21:05:40.356317+0000","last_active":"2023-11-28T21:06:21.402713+0000","last_peered":"2023-11-28T21:06:21.402713+0000","last_clean":"2023-11-28T21:06:21.402713+0000","last_became_active":"2023-11-28T20:38:18.546670+0000","last_became_peered":"2023-11-28T20:38:18.546670+0000","last_unstale":"2023-11-28T21:06:21.402713+0000","last_undegraded":"2023-11-28T21:06:21.402713+0000","last_fullsized":"2023-11-28T21:06:21.402713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'779","last_scrub_stamp":"2023-11-28T21:05:40.356117+0000","last_deep_scrub":"51'779","last_deep_scrub_stamp":"2023-11-28T21:05:40.356117+0000","last_clean_scrub_stamp":"2023-11-28T21:05:40.356117+0000","objects_scrubbed":21,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:38:37.255476+0000","scrub_duration":0.062204162,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18014655,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":496,"num_read_kb":9760,"num_write":714,"num_write_kb":18182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":112125,"num_omap_keys":180,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"51'1133","reported_seq":1700,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.635468+0000","last_change":"2023-11-28T21:05:35.448895+0000","last_active":"2023-11-28T21:06:20.635468+0000","last_peered":"2023-11-28T21:06:20.635468+0000","last_clean":"2023-11-28T21:06:20.635468+0000","last_became_active":"2023-11-28T20:38:18.541584+0000","last_became_peered":"2023-11-28T20:38:18.541584+0000","last_unstale":"2023-11-28T21:06:20.635468+0000","last_undegraded":"2023-11-28T21:06:20.635468+0000","last_fullsized":"2023-11-28T21:06:20.635468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1133","last_scrub_stamp":"2023-11-28T21:05:35.448625+0000","last_deep_scrub":"51'1133","last_deep_scrub_stamp":"2023-11-28T21:05:35.448625+0000","last_clean_scrub_stamp":"2023-11-28T21:05:35.448625+0000","objects_scrubbed":28,"log_size":1133,"log_dups_size":0,"ondisk_log_size":1133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:29.305578+0000","scrub_duration":0.13673348099999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34584852,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":505,"num_read_kb":13681,"num_write":1050,"num_write_kb":34570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":116270,"num_omap_keys":186,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"51'366","reported_seq":2468,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:48.430275+0000","last_change":"2023-11-28T21:05:34.102549+0000","last_active":"2023-11-28T21:05:48.430275+0000","last_peered":"2023-11-28T21:05:48.430275+0000","last_clean":"2023-11-28T21:05:48.430275+0000","last_became_active":"2023-11-28T20:38:19.377608+0000","last_became_peered":"2023-11-28T20:38:19.377608+0000","last_unstale":"2023-11-28T21:05:48.430275+0000","last_undegraded":"2023-11-28T21:05:48.430275+0000","last_fullsized":"2023-11-28T21:05:48.430275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'366","last_scrub_stamp":"2023-11-28T21:05:34.102426+0000","last_deep_scrub":"51'366","last_deep_scrub_stamp":"2023-11-28T21:05:34.102426+0000","last_clean_scrub_stamp":"2023-11-28T21:05:34.102426+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:11:05.296824+0000","scrub_duration":0.0029151789999999999,"objects_trimmed":0,"snaptrim_duration":0.014791248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"51'1725","reported_seq":3627,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:59.882197+0000","last_change":"2023-11-28T21:05:59.882197+0000","last_active":"2023-11-28T21:05:59.882197+0000","last_peered":"2023-11-28T21:05:59.882197+0000","last_clean":"2023-11-28T21:05:59.882197+0000","last_became_active":"2023-11-28T20:38:23.589407+0000","last_became_peered":"2023-11-28T20:38:23.589407+0000","last_unstale":"2023-11-28T21:05:59.882197+0000","last_undegraded":"2023-11-28T21:05:59.882197+0000","last_fullsized":"2023-11-28T21:05:59.882197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1725","last_scrub_stamp":"2023-11-28T21:05:59.882081+0000","last_deep_scrub":"51'1725","last_deep_scrub_stamp":"2023-11-28T21:05:59.882081+0000","last_clean_scrub_stamp":"2023-11-28T21:05:59.882081+0000","objects_scrubbed":543,"log_size":1725,"log_dups_size":0,"ondisk_log_size":1725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:27:37.396820+0000","scrub_duration":0.28759110399999999,"objects_trimmed":0,"snaptrim_duration":0.0022000169999999999,"stat_sum":{"num_bytes":29986576,"num_objects":543,"num_object_clones":248,"num_object_copies":2172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":248,"num_read":29,"num_read_kb":29,"num_write":1454,"num_write_kb":38376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"51'379","reported_seq":445,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.156269+0000","last_change":"2023-11-28T21:05:41.311875+0000","last_active":"2023-11-28T21:06:20.156269+0000","last_peered":"2023-11-28T21:06:20.156269+0000","last_clean":"2023-11-28T21:06:20.156269+0000","last_became_active":"2023-11-28T20:38:18.552723+0000","last_became_peered":"2023-11-28T20:38:18.552723+0000","last_unstale":"2023-11-28T21:06:20.156269+0000","last_undegraded":"2023-11-28T21:06:20.156269+0000","last_fullsized":"2023-11-28T21:06:20.156269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'379","last_scrub_stamp":"2023-11-28T21:05:41.311729+0000","last_deep_scrub":"51'379","last_deep_scrub_stamp":"2023-11-28T21:05:41.311729+0000","last_clean_scrub_stamp":"2023-11-28T21:05:41.311729+0000","objects_scrubbed":14,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:36:23.970191+0000","scrub_duration":0.046276848000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":307,"num_write_kb":20723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80718,"num_omap_keys":145,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"51'401","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.618049+0000","last_change":"2023-11-28T21:05:30.976527+0000","last_active":"2023-11-28T21:05:50.618049+0000","last_peered":"2023-11-28T21:05:50.618049+0000","last_clean":"2023-11-28T21:05:50.618049+0000","last_became_active":"2023-11-28T20:38:19.397509+0000","last_became_peered":"2023-11-28T20:38:19.397509+0000","last_unstale":"2023-11-28T21:05:50.618049+0000","last_undegraded":"2023-11-28T21:05:50.618049+0000","last_fullsized":"2023-11-28T21:05:50.618049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'401","last_scrub_stamp":"2023-11-28T21:05:30.976211+0000","last_deep_scrub":"51'401","last_deep_scrub_stamp":"2023-11-28T21:05:30.976211+0000","last_clean_scrub_stamp":"2023-11-28T21:05:30.976211+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:38:05.312126+0000","scrub_duration":0.003806191,"objects_trimmed":0,"snaptrim_duration":0.010086065,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"51'1756","reported_seq":3680,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.739682+0000","last_change":"2023-11-28T21:06:14.739682+0000","last_active":"2023-11-28T21:06:14.739682+0000","last_peered":"2023-11-28T21:06:14.739682+0000","last_clean":"2023-11-28T21:06:14.739682+0000","last_became_active":"2023-11-28T20:38:23.590716+0000","last_became_peered":"2023-11-28T20:38:23.590716+0000","last_unstale":"2023-11-28T21:06:14.739682+0000","last_undegraded":"2023-11-28T21:06:14.739682+0000","last_fullsized":"2023-11-28T21:06:14.739682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'1756","last_scrub_stamp":"2023-11-28T21:06:14.739519+0000","last_deep_scrub":"51'1756","last_deep_scrub_stamp":"2023-11-28T21:06:14.739519+0000","last_clean_scrub_stamp":"2023-11-28T21:06:14.739519+0000","objects_scrubbed":521,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:16:42.351367+0000","scrub_duration":0.30613888500000003,"objects_trimmed":0,"snaptrim_duration":0.015656369999999999,"stat_sum":{"num_bytes":33768985,"num_objects":521,"num_object_clones":238,"num_object_copies":2084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":238,"num_read":45,"num_read_kb":12330,"num_write":1499,"num_write_kb":48802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"51'415","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:46.157704+0000","last_change":"2023-11-28T21:05:46.157704+0000","last_active":"2023-11-28T21:05:46.157704+0000","last_peered":"2023-11-28T21:05:46.157704+0000","last_clean":"2023-11-28T21:05:46.157704+0000","last_became_active":"2023-11-28T20:38:19.376437+0000","last_became_peered":"2023-11-28T20:38:19.376437+0000","last_unstale":"2023-11-28T21:05:46.157704+0000","last_undegraded":"2023-11-28T21:05:46.157704+0000","last_fullsized":"2023-11-28T21:05:46.157704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:46.157455+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:46.157455+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.157455+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:01.464161+0000","scrub_duration":0.0035157970000000002,"objects_trimmed":0,"snaptrim_duration":0.013289166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"51'439","reported_seq":2543,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.580370+0000","last_change":"2023-11-28T21:05:56.580370+0000","last_active":"2023-11-28T21:05:56.580370+0000","last_peered":"2023-11-28T21:05:56.580370+0000","last_clean":"2023-11-28T21:05:56.580370+0000","last_became_active":"2023-11-28T20:38:19.384747+0000","last_became_peered":"2023-11-28T20:38:19.384747+0000","last_unstale":"2023-11-28T21:05:56.580370+0000","last_undegraded":"2023-11-28T21:05:56.580370+0000","last_fullsized":"2023-11-28T21:05:56.580370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'439","last_scrub_stamp":"2023-11-28T21:05:56.580265+0000","last_deep_scrub":"51'439","last_deep_scrub_stamp":"2023-11-28T21:05:56.580265+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.580265+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:47.658268+0000","scrub_duration":0.002380643,"objects_trimmed":0,"snaptrim_duration":0.0017225739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"51'438","reported_seq":2542,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:51.180845+0000","last_change":"2023-11-28T21:05:51.180845+0000","last_active":"2023-11-28T21:05:51.180845+0000","last_peered":"2023-11-28T21:05:51.180845+0000","last_clean":"2023-11-28T21:05:51.180845+0000","last_became_active":"2023-11-28T20:38:19.366912+0000","last_became_peered":"2023-11-28T20:38:19.366912+0000","last_unstale":"2023-11-28T21:05:51.180845+0000","last_undegraded":"2023-11-28T21:05:51.180845+0000","last_fullsized":"2023-11-28T21:05:51.180845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'438","last_scrub_stamp":"2023-11-28T21:05:51.180603+0000","last_deep_scrub":"51'438","last_deep_scrub_stamp":"2023-11-28T21:05:51.180603+0000","last_clean_scrub_stamp":"2023-11-28T21:05:51.180603+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:28:01.061034+0000","scrub_duration":0.003385809,"objects_trimmed":0,"snaptrim_duration":0.018881576000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"51'384","reported_seq":2488,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.256071+0000","last_change":"2023-11-28T21:05:50.256071+0000","last_active":"2023-11-28T21:05:50.256071+0000","last_peered":"2023-11-28T21:05:50.256071+0000","last_clean":"2023-11-28T21:05:50.256071+0000","last_became_active":"2023-11-28T20:38:19.358076+0000","last_became_peered":"2023-11-28T20:38:19.358076+0000","last_unstale":"2023-11-28T21:05:50.256071+0000","last_undegraded":"2023-11-28T21:05:50.256071+0000","last_fullsized":"2023-11-28T21:05:50.256071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'384","last_scrub_stamp":"2023-11-28T21:05:50.255966+0000","last_deep_scrub":"51'384","last_deep_scrub_stamp":"2023-11-28T21:05:50.255966+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.255966+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:17:07.873629+0000","scrub_duration":0.0014328069999999999,"objects_trimmed":0,"snaptrim_duration":0.014673739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"51'367","reported_seq":2471,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.956782+0000","last_change":"2023-11-28T21:05:37.282985+0000","last_active":"2023-11-28T21:06:14.956782+0000","last_peered":"2023-11-28T21:06:14.956782+0000","last_clean":"2023-11-28T21:06:14.956782+0000","last_became_active":"2023-11-28T20:38:19.406255+0000","last_became_peered":"2023-11-28T20:38:19.406255+0000","last_unstale":"2023-11-28T21:06:14.956782+0000","last_undegraded":"2023-11-28T21:06:14.956782+0000","last_fullsized":"2023-11-28T21:06:14.956782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'367","last_scrub_stamp":"2023-11-28T21:05:37.282834+0000","last_deep_scrub":"51'367","last_deep_scrub_stamp":"2023-11-28T21:05:37.282834+0000","last_clean_scrub_stamp":"2023-11-28T21:05:37.282834+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:54:01.725224+0000","scrub_duration":0.003284698,"objects_trimmed":0,"snaptrim_duration":0.017627927000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"51'417","reported_seq":2521,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.952380+0000","last_change":"2023-11-28T21:06:02.642870+0000","last_active":"2023-11-28T21:06:14.952380+0000","last_peered":"2023-11-28T21:06:14.952380+0000","last_clean":"2023-11-28T21:06:14.952380+0000","last_became_active":"2023-11-28T20:38:19.362029+0000","last_became_peered":"2023-11-28T20:38:19.362029+0000","last_unstale":"2023-11-28T21:06:14.952380+0000","last_undegraded":"2023-11-28T21:06:14.952380+0000","last_fullsized":"2023-11-28T21:06:14.952380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:06:02.642763+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:06:02.642763+0000","last_clean_scrub_stamp":"2023-11-28T21:06:02.642763+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:58.776930+0000","scrub_duration":0.0015502129999999999,"objects_trimmed":0,"snaptrim_duration":0.0061577519999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"51'426","reported_seq":2530,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.972136+0000","last_change":"2023-11-28T21:05:57.197980+0000","last_active":"2023-11-28T21:06:14.972136+0000","last_peered":"2023-11-28T21:06:14.972136+0000","last_clean":"2023-11-28T21:06:14.972136+0000","last_became_active":"2023-11-28T20:38:19.391400+0000","last_became_peered":"2023-11-28T20:38:19.391400+0000","last_unstale":"2023-11-28T21:06:14.972136+0000","last_undegraded":"2023-11-28T21:06:14.972136+0000","last_fullsized":"2023-11-28T21:06:14.972136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'426","last_scrub_stamp":"2023-11-28T21:05:57.197730+0000","last_deep_scrub":"51'426","last_deep_scrub_stamp":"2023-11-28T21:05:57.197730+0000","last_clean_scrub_stamp":"2023-11-28T21:05:57.197730+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:58:18.112114+0000","scrub_duration":0.0043408559999999997,"objects_trimmed":0,"snaptrim_duration":0.017436297999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"51'394","reported_seq":2498,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.956677+0000","last_change":"2023-11-28T21:05:50.388232+0000","last_active":"2023-11-28T21:06:14.956677+0000","last_peered":"2023-11-28T21:06:14.956677+0000","last_clean":"2023-11-28T21:06:14.956677+0000","last_became_active":"2023-11-28T20:38:19.377476+0000","last_became_peered":"2023-11-28T20:38:19.377476+0000","last_unstale":"2023-11-28T21:06:14.956677+0000","last_undegraded":"2023-11-28T21:06:14.956677+0000","last_fullsized":"2023-11-28T21:06:14.956677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'394","last_scrub_stamp":"2023-11-28T21:05:50.388128+0000","last_deep_scrub":"51'394","last_deep_scrub_stamp":"2023-11-28T21:05:50.388128+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.388128+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:11:19.796234+0000","scrub_duration":0.0025192349999999999,"objects_trimmed":0,"snaptrim_duration":0.018095488999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"51'421","reported_seq":2525,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.966605+0000","last_change":"2023-11-28T21:05:56.239169+0000","last_active":"2023-11-28T21:06:14.966605+0000","last_peered":"2023-11-28T21:06:14.966605+0000","last_clean":"2023-11-28T21:06:14.966605+0000","last_became_active":"2023-11-28T20:38:19.364865+0000","last_became_peered":"2023-11-28T20:38:19.364865+0000","last_unstale":"2023-11-28T21:06:14.966605+0000","last_undegraded":"2023-11-28T21:06:14.966605+0000","last_fullsized":"2023-11-28T21:06:14.966605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'421","last_scrub_stamp":"2023-11-28T21:05:56.238950+0000","last_deep_scrub":"51'421","last_deep_scrub_stamp":"2023-11-28T21:05:56.238950+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.238950+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:12:40.811185+0000","scrub_duration":0.0031363070000000001,"objects_trimmed":0,"snaptrim_duration":0.014654275,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"51'411","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:31.244410+0000","last_change":"2023-11-28T21:05:31.244410+0000","last_active":"2023-11-28T21:05:31.244410+0000","last_peered":"2023-11-28T21:05:31.244410+0000","last_clean":"2023-11-28T21:05:31.244410+0000","last_became_active":"2023-11-28T20:38:19.398236+0000","last_became_peered":"2023-11-28T20:38:19.398236+0000","last_unstale":"2023-11-28T21:05:31.244410+0000","last_undegraded":"2023-11-28T21:05:31.244410+0000","last_fullsized":"2023-11-28T21:05:31.244410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'411","last_scrub_stamp":"2023-11-28T21:05:31.244317+0000","last_deep_scrub":"51'411","last_deep_scrub_stamp":"2023-11-28T21:05:31.244317+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.244317+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:48:02.680662+0000","scrub_duration":0.0027735979999999999,"objects_trimmed":0,"snaptrim_duration":0.017356489999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"51'417","reported_seq":2513,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:01.554567+0000","last_change":"2023-11-28T21:06:01.554567+0000","last_active":"2023-11-28T21:06:01.554567+0000","last_peered":"2023-11-28T21:06:01.554567+0000","last_clean":"2023-11-28T21:06:01.554567+0000","last_became_active":"2023-11-28T20:39:01.848167+0000","last_became_peered":"2023-11-28T20:39:01.848167+0000","last_unstale":"2023-11-28T21:06:01.554567+0000","last_undegraded":"2023-11-28T21:06:01.554567+0000","last_fullsized":"2023-11-28T21:06:01.554567+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:06:01.554435+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:06:01.554435+0000","last_clean_scrub_stamp":"2023-11-28T21:06:01.554435+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:59:52.240195+0000","scrub_duration":0.0025598880000000002,"objects_trimmed":0,"snaptrim_duration":0.0020579169999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"51'422","reported_seq":2525,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:42.031660+0000","last_change":"2023-11-28T21:05:42.031660+0000","last_active":"2023-11-28T21:05:42.031660+0000","last_peered":"2023-11-28T21:05:42.031660+0000","last_clean":"2023-11-28T21:05:42.031660+0000","last_became_active":"2023-11-28T20:38:19.390741+0000","last_became_peered":"2023-11-28T20:38:19.390741+0000","last_unstale":"2023-11-28T21:05:42.031660+0000","last_undegraded":"2023-11-28T21:05:42.031660+0000","last_fullsized":"2023-11-28T21:05:42.031660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'422","last_scrub_stamp":"2023-11-28T21:05:42.031561+0000","last_deep_scrub":"51'422","last_deep_scrub_stamp":"2023-11-28T21:05:42.031561+0000","last_clean_scrub_stamp":"2023-11-28T21:05:42.031561+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:36.205746+0000","scrub_duration":0.0024639100000000001,"objects_trimmed":0,"snaptrim_duration":0.014291543,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"51'396","reported_seq":2499,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:52.187484+0000","last_change":"2023-11-28T21:05:52.187484+0000","last_active":"2023-11-28T21:05:52.187484+0000","last_peered":"2023-11-28T21:05:52.187484+0000","last_clean":"2023-11-28T21:05:52.187484+0000","last_became_active":"2023-11-28T20:38:19.406935+0000","last_became_peered":"2023-11-28T20:38:19.406935+0000","last_unstale":"2023-11-28T21:05:52.187484+0000","last_undegraded":"2023-11-28T21:05:52.187484+0000","last_fullsized":"2023-11-28T21:05:52.187484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'396","last_scrub_stamp":"2023-11-28T21:05:52.187215+0000","last_deep_scrub":"51'396","last_deep_scrub_stamp":"2023-11-28T21:05:52.187215+0000","last_clean_scrub_stamp":"2023-11-28T21:05:52.187215+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:57:49.350881+0000","scrub_duration":0.0037497770000000001,"objects_trimmed":0,"snaptrim_duration":0.017003022,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"51'403","reported_seq":2506,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:04.270382+0000","last_change":"2023-11-28T21:06:04.270382+0000","last_active":"2023-11-28T21:06:04.270382+0000","last_peered":"2023-11-28T21:06:04.270382+0000","last_clean":"2023-11-28T21:06:04.270382+0000","last_became_active":"2023-11-28T20:38:19.396015+0000","last_became_peered":"2023-11-28T20:38:19.396015+0000","last_unstale":"2023-11-28T21:06:04.270382+0000","last_undegraded":"2023-11-28T21:06:04.270382+0000","last_fullsized":"2023-11-28T21:06:04.270382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'403","last_scrub_stamp":"2023-11-28T21:06:04.270122+0000","last_deep_scrub":"51'403","last_deep_scrub_stamp":"2023-11-28T21:06:04.270122+0000","last_clean_scrub_stamp":"2023-11-28T21:06:04.270122+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:21.810163+0000","scrub_duration":0.0038017139999999999,"objects_trimmed":0,"snaptrim_duration":0.020849563000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"51'393","reported_seq":2496,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.939762+0000","last_change":"2023-11-28T21:05:46.385054+0000","last_active":"2023-11-28T21:06:14.939762+0000","last_peered":"2023-11-28T21:06:14.939762+0000","last_clean":"2023-11-28T21:06:14.939762+0000","last_became_active":"2023-11-28T20:38:19.383254+0000","last_became_peered":"2023-11-28T20:38:19.383254+0000","last_unstale":"2023-11-28T21:06:14.939762+0000","last_undegraded":"2023-11-28T21:06:14.939762+0000","last_fullsized":"2023-11-28T21:06:14.939762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'393","last_scrub_stamp":"2023-11-28T21:05:46.384910+0000","last_deep_scrub":"51'393","last_deep_scrub_stamp":"2023-11-28T21:05:46.384910+0000","last_clean_scrub_stamp":"2023-11-28T21:05:46.384910+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:37:01.362037+0000","scrub_duration":0.002739965,"objects_trimmed":0,"snaptrim_duration":0.0019691359999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"51'430","reported_seq":2533,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.969824+0000","last_change":"2023-11-28T21:06:10.431195+0000","last_active":"2023-11-28T21:06:14.969824+0000","last_peered":"2023-11-28T21:06:14.969824+0000","last_clean":"2023-11-28T21:06:14.969824+0000","last_became_active":"2023-11-28T20:38:19.390066+0000","last_became_peered":"2023-11-28T20:38:19.390066+0000","last_unstale":"2023-11-28T21:06:14.969824+0000","last_undegraded":"2023-11-28T21:06:14.969824+0000","last_fullsized":"2023-11-28T21:06:14.969824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'430","last_scrub_stamp":"2023-11-28T21:06:10.430886+0000","last_deep_scrub":"51'430","last_deep_scrub_stamp":"2023-11-28T21:06:10.430886+0000","last_clean_scrub_stamp":"2023-11-28T21:06:10.430886+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:09:52.612580+0000","scrub_duration":0.003839257,"objects_trimmed":0,"snaptrim_duration":0.019569492000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"51'421","reported_seq":2524,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:16.407796+0000","last_change":"2023-11-28T21:06:16.407796+0000","last_active":"2023-11-28T21:06:16.407796+0000","last_peered":"2023-11-28T21:06:16.407796+0000","last_clean":"2023-11-28T21:06:16.407796+0000","last_became_active":"2023-11-28T20:38:19.365184+0000","last_became_peered":"2023-11-28T20:38:19.365184+0000","last_unstale":"2023-11-28T21:06:16.407796+0000","last_undegraded":"2023-11-28T21:06:16.407796+0000","last_fullsized":"2023-11-28T21:06:16.407796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'421","last_scrub_stamp":"2023-11-28T21:06:16.407554+0000","last_deep_scrub":"51'421","last_deep_scrub_stamp":"2023-11-28T21:06:16.407554+0000","last_clean_scrub_stamp":"2023-11-28T21:06:16.407554+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:18:17.725301+0000","scrub_duration":0.0034831269999999999,"objects_trimmed":0,"snaptrim_duration":0.015773832000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"51'435","reported_seq":2538,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.950934+0000","last_change":"2023-11-28T21:05:50.721764+0000","last_active":"2023-11-28T21:06:14.950934+0000","last_peered":"2023-11-28T21:06:14.950934+0000","last_clean":"2023-11-28T21:06:14.950934+0000","last_became_active":"2023-11-28T20:38:19.377998+0000","last_became_peered":"2023-11-28T20:38:19.377998+0000","last_unstale":"2023-11-28T21:06:14.950934+0000","last_undegraded":"2023-11-28T21:06:14.950934+0000","last_fullsized":"2023-11-28T21:06:14.950934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'435","last_scrub_stamp":"2023-11-28T21:05:50.721632+0000","last_deep_scrub":"51'435","last_deep_scrub_stamp":"2023-11-28T21:05:50.721632+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.721632+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:58:09.219521+0000","scrub_duration":0.0027464899999999999,"objects_trimmed":0,"snaptrim_duration":0.013692045,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"51'417","reported_seq":2520,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:14.967258+0000","last_change":"2023-11-28T21:05:36.093176+0000","last_active":"2023-11-28T21:06:14.967258+0000","last_peered":"2023-11-28T21:06:14.967258+0000","last_clean":"2023-11-28T21:06:14.967258+0000","last_became_active":"2023-11-28T20:38:19.362712+0000","last_became_peered":"2023-11-28T20:38:19.362712+0000","last_unstale":"2023-11-28T21:06:14.967258+0000","last_undegraded":"2023-11-28T21:06:14.967258+0000","last_fullsized":"2023-11-28T21:06:14.967258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'417","last_scrub_stamp":"2023-11-28T21:05:36.093051+0000","last_deep_scrub":"51'417","last_deep_scrub_stamp":"2023-11-28T21:05:36.093051+0000","last_clean_scrub_stamp":"2023-11-28T21:05:36.093051+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:20:01.197729+0000","scrub_duration":0.0019047210000000001,"objects_trimmed":0,"snaptrim_duration":0.014004656000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"51'418","reported_seq":2520,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:00.463978+0000","last_change":"2023-11-28T21:06:00.463978+0000","last_active":"2023-11-28T21:06:00.463978+0000","last_peered":"2023-11-28T21:06:00.463978+0000","last_clean":"2023-11-28T21:06:00.463978+0000","last_became_active":"2023-11-28T20:38:19.383374+0000","last_became_peered":"2023-11-28T20:38:19.383374+0000","last_unstale":"2023-11-28T21:06:00.463978+0000","last_undegraded":"2023-11-28T21:06:00.463978+0000","last_fullsized":"2023-11-28T21:06:00.463978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'418","last_scrub_stamp":"2023-11-28T21:06:00.463822+0000","last_deep_scrub":"51'418","last_deep_scrub_stamp":"2023-11-28T21:06:00.463822+0000","last_clean_scrub_stamp":"2023-11-28T21:06:00.463822+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:48:56.712408+0000","scrub_duration":0.0025889039999999999,"objects_trimmed":0,"snaptrim_duration":0.018246884000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"51'374","reported_seq":2476,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:38.970607+0000","last_change":"2023-11-28T21:05:38.970607+0000","last_active":"2023-11-28T21:05:38.970607+0000","last_peered":"2023-11-28T21:05:38.970607+0000","last_clean":"2023-11-28T21:05:38.970607+0000","last_became_active":"2023-11-28T20:38:19.399831+0000","last_became_peered":"2023-11-28T20:38:19.399831+0000","last_unstale":"2023-11-28T21:05:38.970607+0000","last_undegraded":"2023-11-28T21:05:38.970607+0000","last_fullsized":"2023-11-28T21:05:38.970607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'374","last_scrub_stamp":"2023-11-28T21:05:38.970355+0000","last_deep_scrub":"51'374","last_deep_scrub_stamp":"2023-11-28T21:05:38.970355+0000","last_clean_scrub_stamp":"2023-11-28T21:05:38.970355+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:55:16.855297+0000","scrub_duration":0.00371595,"objects_trimmed":0,"snaptrim_duration":0.010909501,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"51'380","reported_seq":2482,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.191770+0000","last_change":"2023-11-28T21:05:56.191770+0000","last_active":"2023-11-28T21:05:56.191770+0000","last_peered":"2023-11-28T21:05:56.191770+0000","last_clean":"2023-11-28T21:05:56.191770+0000","last_became_active":"2023-11-28T20:38:19.385941+0000","last_became_peered":"2023-11-28T20:38:19.385941+0000","last_unstale":"2023-11-28T21:05:56.191770+0000","last_undegraded":"2023-11-28T21:05:56.191770+0000","last_fullsized":"2023-11-28T21:05:56.191770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'380","last_scrub_stamp":"2023-11-28T21:05:56.191432+0000","last_deep_scrub":"51'380","last_deep_scrub_stamp":"2023-11-28T21:05:56.191432+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.191432+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:00.175266+0000","scrub_duration":0.0041991600000000004,"objects_trimmed":0,"snaptrim_duration":0.014265125,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"51'385","reported_seq":2494,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:07.974845+0000","last_change":"2023-11-28T21:06:07.974845+0000","last_active":"2023-11-28T21:06:07.974845+0000","last_peered":"2023-11-28T21:06:07.974845+0000","last_clean":"2023-11-28T21:06:07.974845+0000","last_became_active":"2023-11-28T20:39:01.391291+0000","last_became_peered":"2023-11-28T20:39:01.391291+0000","last_unstale":"2023-11-28T21:06:07.974845+0000","last_undegraded":"2023-11-28T21:06:07.974845+0000","last_fullsized":"2023-11-28T21:06:07.974845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'385","last_scrub_stamp":"2023-11-28T21:06:07.974521+0000","last_deep_scrub":"51'385","last_deep_scrub_stamp":"2023-11-28T21:06:07.974521+0000","last_clean_scrub_stamp":"2023-11-28T21:06:07.974521+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:37:08.841834+0000","scrub_duration":0.0033903169999999999,"objects_trimmed":0,"snaptrim_duration":0.017078507999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"51'419","reported_seq":2521,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:11.413158+0000","last_change":"2023-11-28T21:06:11.413158+0000","last_active":"2023-11-28T21:06:11.413158+0000","last_peered":"2023-11-28T21:06:11.413158+0000","last_clean":"2023-11-28T21:06:11.413158+0000","last_became_active":"2023-11-28T20:38:19.401970+0000","last_became_peered":"2023-11-28T20:38:19.401970+0000","last_unstale":"2023-11-28T21:06:11.413158+0000","last_undegraded":"2023-11-28T21:06:11.413158+0000","last_fullsized":"2023-11-28T21:06:11.413158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'419","last_scrub_stamp":"2023-11-28T21:06:11.412882+0000","last_deep_scrub":"51'419","last_deep_scrub_stamp":"2023-11-28T21:06:11.412882+0000","last_clean_scrub_stamp":"2023-11-28T21:06:11.412882+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:29:07.695855+0000","scrub_duration":0.0039167610000000004,"objects_trimmed":0,"snaptrim_duration":0.017711331,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"51'405","reported_seq":2507,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:49.599050+0000","last_change":"2023-11-28T21:05:44.232745+0000","last_active":"2023-11-28T21:05:49.599050+0000","last_peered":"2023-11-28T21:05:49.599050+0000","last_clean":"2023-11-28T21:05:49.599050+0000","last_became_active":"2023-11-28T20:38:19.366326+0000","last_became_peered":"2023-11-28T20:38:19.366326+0000","last_unstale":"2023-11-28T21:05:49.599050+0000","last_undegraded":"2023-11-28T21:05:49.599050+0000","last_fullsized":"2023-11-28T21:05:49.599050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'405","last_scrub_stamp":"2023-11-28T21:05:44.232593+0000","last_deep_scrub":"51'405","last_deep_scrub_stamp":"2023-11-28T21:05:44.232593+0000","last_clean_scrub_stamp":"2023-11-28T21:05:44.232593+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:38.822888+0000","scrub_duration":0.0029742990000000001,"objects_trimmed":0,"snaptrim_duration":0.017616142000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"51'400","reported_seq":2502,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.609728+0000","last_change":"2023-11-28T21:05:31.601994+0000","last_active":"2023-11-28T21:05:50.609728+0000","last_peered":"2023-11-28T21:05:50.609728+0000","last_clean":"2023-11-28T21:05:50.609728+0000","last_became_active":"2023-11-28T20:38:19.393764+0000","last_became_peered":"2023-11-28T20:38:19.393764+0000","last_unstale":"2023-11-28T21:05:50.609728+0000","last_undegraded":"2023-11-28T21:05:50.609728+0000","last_fullsized":"2023-11-28T21:05:50.609728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'400","last_scrub_stamp":"2023-11-28T21:05:31.601754+0000","last_deep_scrub":"51'400","last_deep_scrub_stamp":"2023-11-28T21:05:31.601754+0000","last_clean_scrub_stamp":"2023-11-28T21:05:31.601754+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:23:43.804359+0000","scrub_duration":0.003376469,"objects_trimmed":0,"snaptrim_duration":0.020312439000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"51'403","reported_seq":2505,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:15.428175+0000","last_change":"2023-11-28T21:06:15.428227+0000","last_active":"2023-11-28T21:06:15.428175+0000","last_peered":"2023-11-28T21:06:15.428175+0000","last_clean":"2023-11-28T21:06:15.428175+0000","last_became_active":"2023-11-28T20:38:19.367750+0000","last_became_peered":"2023-11-28T20:38:19.367750+0000","last_unstale":"2023-11-28T21:06:15.428175+0000","last_undegraded":"2023-11-28T21:06:15.428175+0000","last_fullsized":"2023-11-28T21:06:15.428175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'403","last_scrub_stamp":"2023-11-28T21:06:15.427968+0000","last_deep_scrub":"51'403","last_deep_scrub_stamp":"2023-11-28T21:06:15.427968+0000","last_clean_scrub_stamp":"2023-11-28T21:06:15.427968+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T09:02:59.830739+0000","scrub_duration":0.0031732430000000001,"objects_trimmed":0,"snaptrim_duration":0.017449602000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"51'416","reported_seq":2518,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:50.609783+0000","last_change":"2023-11-28T21:05:50.349772+0000","last_active":"2023-11-28T21:05:50.609783+0000","last_peered":"2023-11-28T21:05:50.609783+0000","last_clean":"2023-11-28T21:05:50.609783+0000","last_became_active":"2023-11-28T20:38:19.390241+0000","last_became_peered":"2023-11-28T20:38:19.390241+0000","last_unstale":"2023-11-28T21:05:50.609783+0000","last_undegraded":"2023-11-28T21:05:50.609783+0000","last_fullsized":"2023-11-28T21:05:50.609783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'416","last_scrub_stamp":"2023-11-28T21:05:50.349526+0000","last_deep_scrub":"51'416","last_deep_scrub_stamp":"2023-11-28T21:05:50.349526+0000","last_clean_scrub_stamp":"2023-11-28T21:05:50.349526+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:01.261893+0000","scrub_duration":0.0031862489999999999,"objects_trimmed":0,"snaptrim_duration":0.018992159000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"51'397","reported_seq":2502,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-28T21:06:20.455157+0000","last_change":"2023-11-28T21:06:20.455157+0000","last_active":"2023-11-28T21:06:20.455157+0000","last_peered":"2023-11-28T21:06:20.455157+0000","last_clean":"2023-11-28T21:06:20.455157+0000","last_became_active":"2023-11-28T20:38:19.365979+0000","last_became_peered":"2023-11-28T20:38:19.365979+0000","last_unstale":"2023-11-28T21:06:20.455157+0000","last_undegraded":"2023-11-28T21:06:20.455157+0000","last_fullsized":"2023-11-28T21:06:20.455157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'397","last_scrub_stamp":"2023-11-28T21:06:20.454899+0000","last_deep_scrub":"51'397","last_deep_scrub_stamp":"2023-11-28T21:06:20.454899+0000","last_clean_scrub_stamp":"2023-11-28T21:06:20.454899+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:36:11.402445+0000","scrub_duration":0.0033112950000000001,"objects_trimmed":0,"snaptrim_duration":0.015371953000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"51'415","reported_seq":2519,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:56.377471+0000","last_change":"2023-11-28T21:05:56.377471+0000","last_active":"2023-11-28T21:05:56.377471+0000","last_peered":"2023-11-28T21:05:56.377471+0000","last_clean":"2023-11-28T21:05:56.377471+0000","last_became_active":"2023-11-28T20:38:19.359532+0000","last_became_peered":"2023-11-28T20:38:19.359532+0000","last_unstale":"2023-11-28T21:05:56.377471+0000","last_undegraded":"2023-11-28T21:05:56.377471+0000","last_fullsized":"2023-11-28T21:05:56.377471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'415","last_scrub_stamp":"2023-11-28T21:05:56.377367+0000","last_deep_scrub":"51'415","last_deep_scrub_stamp":"2023-11-28T21:05:56.377367+0000","last_clean_scrub_stamp":"2023-11-28T21:05:56.377367+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:16:54.660446+0000","scrub_duration":0.001620766,"objects_trimmed":0,"snaptrim_duration":0.0098716120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"51'399","reported_seq":2503,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:05:51.732352+0000","last_change":"2023-11-28T21:05:51.732352+0000","last_active":"2023-11-28T21:05:51.732352+0000","last_peered":"2023-11-28T21:05:51.732352+0000","last_clean":"2023-11-28T21:05:51.732352+0000","last_became_active":"2023-11-28T20:38:19.357287+0000","last_became_peered":"2023-11-28T20:38:19.357287+0000","last_unstale":"2023-11-28T21:05:51.732352+0000","last_undegraded":"2023-11-28T21:05:51.732352+0000","last_fullsized":"2023-11-28T21:05:51.732352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'399","last_scrub_stamp":"2023-11-28T21:05:51.732211+0000","last_deep_scrub":"51'399","last_deep_scrub_stamp":"2023-11-28T21:05:51.732211+0000","last_clean_scrub_stamp":"2023-11-28T21:05:51.732211+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:13:01.333629+0000","scrub_duration":0.001767425,"objects_trimmed":0,"snaptrim_duration":0.011275626,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"51'410","reported_seq":2514,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-11-28T21:06:09.376555+0000","last_change":"2023-11-28T21:06:09.376555+0000","last_active":"2023-11-28T21:06:09.376555+0000","last_peered":"2023-11-28T21:06:09.376555+0000","last_clean":"2023-11-28T21:06:09.376555+0000","last_became_active":"2023-11-28T20:38:19.389961+0000","last_became_peered":"2023-11-28T20:38:19.389961+0000","last_unstale":"2023-11-28T21:06:09.376555+0000","last_undegraded":"2023-11-28T21:06:09.376555+0000","last_fullsized":"2023-11-28T21:06:09.376555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"51'410","last_scrub_stamp":"2023-11-28T21:06:09.376319+0000","last_deep_scrub":"51'410","last_deep_scrub_stamp":"2023-11-28T21:06:09.376319+0000","last_clean_scrub_stamp":"2023-11-28T21:06:09.376319+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:38:08.438225+0000","scrub_duration":0.0035951540000000001,"objects_trimmed":0,"snaptrim_duration":0.017369464000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":892224822,"num_objects":17666,"num_object_clones":8054,"num_object_copies":70664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17666,"num_whiteouts":7974,"num_read":1150,"num_read_kb":100500,"num_write":48457,"num_write_kb":1187847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1881309184,"data_stored":1881309184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57114,"ondisk_log_size":57114,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26113,"ondisk_log_size":26113,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":680942988,"num_objects":625,"num_object_clones":0,"num_object_copies":1250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":625,"num_whiteouts":0,"num_read":1546,"num_read_kb":199259,"num_write":14550,"num_write_kb":680671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":419,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2848462,"num_omap_keys":5441,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1362042880,"data_stored":1361885976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15784,"ondisk_log_size":15784,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509788,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":650840,"kb_used_data":461392,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":93721000,"statfs":{"total":96636764160,"available":95970304000,"internally_reserved":0,"allocated":472465408,"data_stored":472155802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":193984967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":8.7539999999999996,"15min":3.2719999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.50600000000000001,"5min":873.04100000000005,"15min":873.04100000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.46500000000000002,"15min":0.51800000000000002},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24099999999999999},"max":{"1min":0.48899999999999999,"5min":0.872,"15min":6.5659999999999998},"last":0.44400000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.53700000000000003,"15min":0.57499999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.54000000000000004,"5min":1.194,"15min":6.9370000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.503,"15min":0.53900000000000003},"min":{"1min":0.31900000000000001,"5min":0.26500000000000001,"15min":0.26200000000000001},"max":{"1min":0.54800000000000004,"5min":0.79700000000000004,"15min":3.6219999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.56799999999999995,"15min":0.60099999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.52100000000000002,"5min":6.0309999999999997,"15min":6.8780000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":8.2840000000000007,"15min":3.1880000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28299999999999997},"max":{"1min":0.56299999999999994,"5min":817.63900000000001,"15min":817.63900000000001},"last":0.378}]},{"osd":4,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":51.350999999999999,"15min":17.934999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":3268.6419999999998,"15min":3268.6419999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76200000000000001,"5min":51.310000000000002,"15min":17.669},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":3232.7750000000001,"15min":3232.7750000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":46.462000000000003,"15min":16.082999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.42299999999999999},"max":{"1min":1.014,"5min":3259.5459999999998,"15min":3259.5459999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":8.0329999999999995,"15min":3.2509999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93600000000000005,"5min":703.19299999999998,"15min":703.19299999999998},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":9.8960000000000008,"15min":3.8969999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.92300000000000004,"5min":928.99199999999996,"15min":928.99199999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":10.500999999999999,"15min":4.1470000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.89000000000000001,"5min":961.01800000000003,"15min":961.01800000000003},"last":0.72199999999999998}]},{"osd":7,"last update":"Tue Nov 28 21:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":9.6129999999999995,"15min":4.1260000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.44600000000000001},"max":{"1min":1.0820000000000001,"5min":872.827,"15min":872.827},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73399999999999999,"5min":9.0449999999999999,"15min":3.6110000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48899999999999999},"max":{"1min":0.83899999999999997,"5min":817.84400000000005,"15min":817.84400000000005},"last":0.63700000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509788,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424988,"kb_used_data":277204,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":93946852,"statfs":{"total":96636764160,"available":96201576448,"internally_reserved":0,"allocated":283856896,"data_stored":283546865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":1.52,"15min":0.82199999999999995},"min":{"1min":0.22800000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.40200000000000002,"5min":64.087000000000003,"15min":64.087000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":1.6419999999999999,"15min":0.94999999999999996},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.25},"max":{"1min":0.58999999999999997,"5min":64.114999999999995,"15min":64.114999999999995},"last":0.44800000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":1.6020000000000001,"15min":0.96199999999999997},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.498,"5min":64,"15min":64},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":1.6679999999999999,"15min":0.97499999999999998},"min":{"1min":0.37,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.62,"5min":64.028999999999996,"15min":64.028999999999996},"last":0.47399999999999998}]},{"osd":3,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":29.27,"15min":10.208},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.47799999999999998,"5min":2826.7199999999998,"15min":2826.7199999999998},"last":0.309},{"interface":"front","average":{"1min":0.45100000000000001,"5min":29.638999999999999,"15min":10.252000000000001},"min":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.307},"max":{"1min":0.59199999999999997,"5min":2838.0680000000002,"15min":2838.0680000000002},"last":0.42199999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":3.4169999999999998,"15min":1.712},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":149.43700000000001,"15min":149.43700000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":53.168999999999997,"15min":18.263999999999999},"min":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.38800000000000001},"max":{"1min":0.94499999999999995,"5min":3288.7310000000002,"15min":3288.7310000000002},"last":0.65300000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":62.241999999999997,"15min":21.312000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.46000000000000002},"max":{"1min":0.81899999999999995,"5min":3314.4110000000001,"15min":3314.4110000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":42.167000000000002,"15min":14.640000000000001},"min":{"1min":0.59399999999999997,"5min":0.57599999999999996,"15min":0.44900000000000001},"max":{"1min":0.85999999999999999,"5min":2139.3159999999998,"15min":2139.3159999999998},"last":0.755}]},{"osd":6,"last update":"Tue Nov 28 21:05:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":64.135000000000005,"15min":21.940000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.38700000000000001},"max":{"1min":0.93999999999999995,"5min":3288.7730000000001,"15min":3288.7730000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":51.640000000000001,"15min":17.850000000000001},"min":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.42699999999999999},"max":{"1min":0.99399999999999999,"5min":2837.9960000000001,"15min":2837.9960000000001},"last":0.72099999999999997}]},{"osd":7,"last update":"Tue Nov 28 21:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":30.893999999999998,"15min":10.855},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.46899999999999997},"max":{"1min":0.82099999999999995,"5min":2822.598,"15min":2822.598},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":47.838000000000001,"15min":16.495999999999999},"min":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.45400000000000001},"max":{"1min":0.92900000000000005,"5min":2150.9899999999998,"15min":2150.9899999999998},"last":0.64100000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509789,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":660796,"kb_used_data":458868,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93711044,"statfs":{"total":96636764160,"available":95960109056,"internally_reserved":0,"allocated":469880832,"data_stored":469569885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206764485},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":2.3719999999999999,"15min":1.1779999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.623,"5min":143.76300000000001,"15min":143.76300000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.90000000000000002,"15min":0.71199999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60899999999999999,"5min":39.768000000000001,"15min":39.768000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":2.0350000000000001,"15min":1.038},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.60099999999999998,"5min":149.34299999999999,"15min":149.34299999999999},"last":0.496},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.55300000000000005,"15min":0.60099999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.71699999999999997,"5min":3.1349999999999998,"15min":6.5229999999999997},"last":0.66800000000000004}]},{"osd":3,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":2.5600000000000001,"15min":1.254},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.66800000000000004,"5min":147.46899999999999,"15min":147.46899999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":1.1910000000000001,"15min":0.85099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.26800000000000002},"max":{"1min":0.94199999999999995,"5min":59.305,"15min":59.305},"last":0.65600000000000003}]},{"osd":4,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":4.6269999999999998,"15min":2.1240000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40400000000000003},"max":{"1min":1.01,"5min":221.76900000000001,"15min":221.76900000000001},"last":1.002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":13.384,"15min":5.444},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.34300000000000003},"max":{"1min":0.92400000000000004,"5min":1198.962,"15min":1198.962},"last":0.83499999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":6.9080000000000004,"15min":2.9089999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.44500000000000001},"max":{"1min":1.04,"5min":574.81700000000001,"15min":574.81700000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.3140000000000001,"15min":1.0920000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.501},"max":{"1min":1.075,"5min":39.896999999999998,"15min":39.896999999999998},"last":1.046}]},{"osd":6,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":13.356999999999999,"15min":5.0759999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96699999999999997,"5min":1168.432,"15min":1168.432},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.2669999999999999,"15min":1.0369999999999999},"min":{"1min":0.623,"5min":0.52800000000000002,"15min":0.46000000000000002},"max":{"1min":0.97399999999999998,"5min":39.863,"15min":39.863},"last":1.0189999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:06:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":3.222,"15min":1.673},"min":{"1min":0.61299999999999999,"5min":0.59199999999999997,"15min":0.54300000000000004},"max":{"1min":0.95599999999999996,"5min":143.89599999999999,"15min":143.89599999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":13.459,"15min":5.0599999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.98099999999999998,"5min":1198.933,"15min":1198.933},"last":0.96699999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542491,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583608,"kb_used_data":417776,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":93788232,"statfs":{"total":96636764160,"available":96039149568,"internally_reserved":0,"allocated":427802624,"data_stored":427497261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":169802186},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":93.894999999999996,"15min":31.896999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.29699999999999999},"max":{"1min":1.2290000000000001,"5min":3136.5639999999999,"15min":3136.5639999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":55.112000000000002,"15min":18.943999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.36899999999999999},"max":{"1min":1.236,"5min":2779.4099999999999,"15min":2779.4099999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":94.733999999999995,"15min":32.204000000000001},"min":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.34499999999999997},"max":{"1min":1.0600000000000001,"5min":3167.6399999999999,"15min":3167.6399999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":100.066,"15min":33.939999999999998},"min":{"1min":0.625,"5min":0.56000000000000005,"15min":0.46400000000000002},"max":{"1min":1.113,"5min":4741.7640000000001,"15min":4741.7640000000001},"last":0.90600000000000003}]},{"osd":2,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":56.523000000000003,"15min":19.741},"min":{"1min":0.621,"5min":0.497,"15min":0.42899999999999999},"max":{"1min":1.3240000000000001,"5min":2301.0599999999999,"15min":2301.0599999999999},"last":1.222},{"interface":"front","average":{"1min":1.0049999999999999,"5min":100.627,"15min":34.234999999999999},"min":{"1min":0.69899999999999995,"5min":0.69299999999999995,"15min":0.42399999999999999},"max":{"1min":1.1890000000000001,"5min":4752.8689999999997,"15min":4752.8689999999997},"last":0.72099999999999997}]},{"osd":3,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":94.033000000000001,"15min":32.264000000000003},"min":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.44700000000000001},"max":{"1min":1.232,"5min":3147.2719999999999,"15min":3147.2719999999999},"last":1.145},{"interface":"front","average":{"1min":0.78200000000000003,"5min":60.307000000000002,"15min":20.715},"min":{"1min":0.60799999999999998,"5min":0.59899999999999998,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":2301.1370000000002,"15min":2301.1370000000002},"last":0.65900000000000003}]},{"osd":4,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91800000000000004,"15min":1.276},"min":{"1min":0.66100000000000003,"5min":0.57499999999999996,"15min":0.38900000000000001},"max":{"1min":1.1160000000000001,"5min":1.266,"15min":71.313000000000002},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.046,"5min":0.95799999999999996,"15min":1.1870000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.40000000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":34.881},"last":1.371}]},{"osd":5,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0840000000000001,"15min":1.2869999999999999},"min":{"1min":0.78000000000000003,"5min":0.69999999999999996,"15min":0.39700000000000002},"max":{"1min":1.4019999999999999,"5min":1.895,"15min":44.558},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1279999999999999,"15min":1.159},"min":{"1min":0.73399999999999999,"5min":0.64700000000000002,"15min":0.41399999999999998},"max":{"1min":1.49,"5min":1.956,"15min":3.782},"last":0.876}]},{"osd":6,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.998,"15min":1.1060000000000001},"min":{"1min":0.754,"5min":0.65800000000000003,"15min":0.44700000000000001},"max":{"1min":1.325,"5min":1.47,"15min":7.6769999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.22,"5min":1.1499999999999999,"15min":1.1639999999999999},"min":{"1min":0.96899999999999997,"5min":0.71499999999999997,"15min":0.38100000000000001},"max":{"1min":1.649,"5min":1.649,"15min":2.7949999999999999},"last":0.97899999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542492,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":600884,"kb_used_data":439212,"kb_used_omap":1,"kb_used_meta":161662,"kb_avail":93770956,"statfs":{"total":96636764160,"available":96021458944,"internally_reserved":0,"allocated":449753088,"data_stored":449448826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165542342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":19.780999999999999,"15min":7.1459999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1919999999999999,"5min":1038.4960000000001,"15min":1038.4960000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.96399999999999997,"5min":19.934999999999999,"15min":7.2640000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.33600000000000002},"max":{"1min":1.1739999999999999,"5min":1038.5619999999999,"15min":1038.5619999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":21.085000000000001,"15min":7.6150000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41399999999999998},"max":{"1min":0.98799999999999999,"5min":1046.3320000000001,"15min":1046.3320000000001},"last":1.032},{"interface":"front","average":{"1min":0.73399999999999999,"5min":14.5,"15min":5.4660000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98399999999999999,"5min":1087.7460000000001,"15min":1087.7460000000001},"last":0.873}]},{"osd":2,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":19.806000000000001,"15min":7.1950000000000003},"min":{"1min":0.56399999999999995,"5min":0.503,"15min":0.47699999999999998},"max":{"1min":1.153,"5min":1038.309,"15min":1038.309},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":51.655000000000001,"15min":17.821999999999999},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.35099999999999998},"max":{"1min":1.222,"5min":2556.578,"15min":2556.578},"last":0.70199999999999996}]},{"osd":3,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":45.720999999999997,"15min":15.842000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.099,"5min":2567.538,"15min":2567.538},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":36.046999999999997,"15min":12.67},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.39700000000000002},"max":{"1min":1.196,"5min":1371.7280000000001,"15min":1371.7280000000001},"last":1.002}]},{"osd":4,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.93999999999999995,"15min":1.0469999999999999},"min":{"1min":0.61499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2709999999999999,"5min":1.3400000000000001,"15min":10.151},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.034,"15min":1.0569999999999999},"min":{"1min":0.64800000000000002,"5min":0.64200000000000002,"15min":0.437},"max":{"1min":1.329,"5min":1.5640000000000001,"15min":3.2629999999999999},"last":1.0640000000000001}]},{"osd":5,"last update":"Tue Nov 28 21:06:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.071,"15min":1.1000000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.50800000000000001},"max":{"1min":1.3069999999999999,"5min":1.51,"15min":4.5519999999999996},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0189999999999999,"15min":1.1499999999999999},"min":{"1min":0.63200000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.363,"5min":1.423,"15min":2.1899999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.109,"15min":1.145},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.56899999999999995},"max":{"1min":1.4359999999999999,"5min":1.5149999999999999,"15min":4.6639999999999997},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.139,"15min":1.218},"min":{"1min":0.77500000000000002,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.27,"5min":1.651,"15min":3.2029999999999998},"last":1.0880000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542492,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":489300,"kb_used_data":335948,"kb_used_omap":1,"kb_used_meta":153342,"kb_avail":93882540,"statfs":{"total":96636764160,"available":96135720960,"internally_reserved":0,"allocated":344010752,"data_stored":343705495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":157022661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:06:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":17.654,"15min":6.4320000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.27100000000000002},"max":{"1min":1.2629999999999999,"5min":1605.194,"15min":1605.194},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":19.523,"15min":7.0499999999999998},"min":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.27100000000000002},"max":{"1min":0.95799999999999996,"5min":1603.2260000000001,"15min":1603.2260000000001},"last":1.226}]},{"osd":1,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":17.541,"15min":6.4180000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.253},"max":{"1min":1.0229999999999999,"5min":1749.1869999999999,"15min":1749.1869999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.997,"5min":56.825000000000003,"15min":19.577999999999999},"min":{"1min":0.76900000000000002,"5min":0.53100000000000003,"15min":0.442},"max":{"1min":1.1599999999999999,"5min":3741.5659999999998,"15min":3741.5659999999998},"last":1.127}]},{"osd":2,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":2.403,"15min":1.4239999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.309},"max":{"1min":1.1559999999999999,"5min":152.40199999999999,"15min":152.40199999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.008,"5min":56.719000000000001,"15min":19.510999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.435},"max":{"1min":1.238,"5min":3741.3910000000001,"15min":3741.3910000000001},"last":1.181}]},{"osd":3,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":66.242999999999995,"15min":22.757000000000001},"min":{"1min":0.69999999999999996,"5min":0.60499999999999998,"15min":0.34999999999999998},"max":{"1min":1.2589999999999999,"5min":3904.835,"15min":3904.835},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":18.091000000000001,"15min":6.6870000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.35299999999999998},"max":{"1min":1.069,"5min":1785.712,"15min":1785.712},"last":0.90700000000000003}]},{"osd":4,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.88600000000000001,"15min":0.88300000000000001},"min":{"1min":0.64400000000000002,"5min":0.57399999999999995,"15min":0.28199999999999997},"max":{"1min":1.105,"5min":1.393,"15min":1.952},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1279999999999999,"15min":1.0960000000000001},"min":{"1min":0.98099999999999998,"5min":0.65800000000000003,"15min":0.29999999999999999},"max":{"1min":1.343,"5min":1.5860000000000001,"15min":4.7320000000000002},"last":0.80300000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.196,"15min":1.1850000000000001},"min":{"1min":1.1000000000000001,"5min":0.65700000000000003,"15min":0.318},"max":{"1min":1.5640000000000001,"5min":1.728,"15min":5.6600000000000001},"last":1.026},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.05,"15min":1.0429999999999999},"min":{"1min":0.749,"5min":0.64200000000000002,"15min":0.34000000000000002},"max":{"1min":1.234,"5min":1.6100000000000001,"15min":2.573},"last":0.66300000000000003}]},{"osd":7,"last update":"Tue Nov 28 21:06:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2310000000000001,"15min":1.085},"min":{"1min":1.04,"5min":0.69999999999999996,"15min":0.28299999999999997},"max":{"1min":1.677,"5min":1.677,"15min":2.298},"last":1.282},{"interface":"front","average":{"1min":1.004,"5min":1.1020000000000001,"15min":1.1879999999999999},"min":{"1min":0.752,"5min":0.72299999999999998,"15min":0.36899999999999999},"max":{"1min":1.3220000000000001,"5min":1.6519999999999999,"15min":4.8109999999999999},"last":0.99099999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542491,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":616812,"kb_used_data":437092,"kb_used_omap":1,"kb_used_meta":179710,"kb_avail":93755028,"statfs":{"total":96636764160,"available":96005148672,"internally_reserved":0,"allocated":447582208,"data_stored":447280988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":184023493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":74.793999999999997,"15min":25.492999999999999},"min":{"1min":0.48199999999999998,"5min":0.42399999999999999,"15min":0.25600000000000001},"max":{"1min":0.97699999999999998,"5min":4472.0990000000002,"15min":4472.0990000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":74.838999999999999,"15min":25.632000000000001},"min":{"1min":0.51300000000000001,"5min":0.433,"15min":0.33000000000000002},"max":{"1min":1.1140000000000001,"5min":4472.4799999999996,"15min":4472.4799999999996},"last":0.92400000000000004}]},{"osd":1,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":68.733999999999995,"15min":23.989000000000001},"min":{"1min":0.57899999999999996,"5min":0.57499999999999996,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":2473.319,"15min":2473.319},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":69.427999999999997,"15min":24.09},"min":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.40600000000000003},"max":{"1min":1.216,"5min":2525.277,"15min":2525.277},"last":0.64400000000000002}]},{"osd":2,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":39.482999999999997,"15min":14.124000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.38600000000000001},"max":{"1min":0.98299999999999998,"5min":2323.7979999999998,"15min":2323.7979999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":62.450000000000003,"15min":21.917000000000002},"min":{"1min":0.66200000000000003,"5min":0.60199999999999998,"15min":0.35599999999999998},"max":{"1min":1.1160000000000001,"5min":2498.6460000000002,"15min":2498.6460000000002},"last":0.60499999999999998}]},{"osd":3,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":63.005000000000003,"15min":21.709},"min":{"1min":0.56299999999999994,"5min":0.47699999999999998,"15min":0.38900000000000001},"max":{"1min":1.087,"5min":2516.6700000000001,"15min":2516.6700000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.874,"5min":65.099999999999994,"15min":22.652000000000001},"min":{"1min":0.624,"5min":0.53200000000000003,"15min":0.441},"max":{"1min":1.1859999999999999,"5min":2478.165,"15min":2478.165},"last":0.80000000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.97099999999999997,"15min":1.2849999999999999},"min":{"1min":0.74099999999999999,"5min":0.55100000000000005,"15min":0.36399999999999999},"max":{"1min":1.173,"5min":1.3999999999999999,"15min":19.408999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.028,"15min":1.1020000000000001},"min":{"1min":0.91100000000000003,"5min":0.64800000000000002,"15min":0.35699999999999998},"max":{"1min":1.262,"5min":1.4970000000000001,"15min":9.375},"last":1.0600000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0429999999999999,"15min":1.355},"min":{"1min":0.85099999999999998,"5min":0.63700000000000001,"15min":0.44600000000000001},"max":{"1min":1.341,"5min":1.347,"15min":36.531999999999996},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1060000000000001,"15min":1.762},"min":{"1min":0.93799999999999994,"5min":0.745,"15min":0.42799999999999999},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":85.367999999999995},"last":1.135}]},{"osd":7,"last update":"Tue Nov 28 21:05:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.081,"15min":1.208},"min":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.45200000000000001},"max":{"1min":1.2310000000000001,"5min":1.5760000000000001,"15min":9.3399999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1459999999999999,"15min":1.4379999999999999},"min":{"1min":0.97499999999999998,"5min":0.78900000000000003,"15min":0.41299999999999998},"max":{"1min":1.4330000000000001,"5min":1.577,"15min":36.591999999999999},"last":0.98499999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542491,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503316,"kb_used_data":345804,"kb_used_omap":1,"kb_used_meta":157502,"kb_avail":93868524,"statfs":{"total":96636764160,"available":96121368576,"internally_reserved":0,"allocated":354103296,"data_stored":353796734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161282501},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":4.8230000000000004,"15min":1.964},"min":{"1min":0.20999999999999999,"5min":0.153,"15min":0.153},"max":{"1min":0.56100000000000005,"5min":297.16899999999998,"15min":297.16899999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":4.9260000000000002,"15min":1.9830000000000001},"min":{"1min":0.25700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.59799999999999998,"5min":297.202,"15min":297.202},"last":0.48399999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":4.5019999999999998,"15min":1.8480000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.52200000000000002,"5min":335.166,"15min":335.166},"last":0.433},{"interface":"front","average":{"1min":0.46200000000000002,"5min":4.4240000000000004,"15min":1.829},"min":{"1min":0.308,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.622,"5min":335.19400000000002,"15min":335.19400000000002},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":1.3100000000000001,"15min":0.81000000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.28399999999999997},"max":{"1min":0.61599999999999999,"5min":53.808,"15min":53.808},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":29.550999999999998,"15min":10.304},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71399999999999997,"5min":2839.3989999999999,"15min":2839.3989999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":27.709,"15min":9.8179999999999996},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1499999999999999,"5min":2822.2359999999999,"15min":2822.2359999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":27.696999999999999,"15min":9.7840000000000007},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89500000000000002,"5min":2822.212,"15min":2822.212},"last":0.85699999999999998}]},{"osd":5,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":19.888999999999999,"15min":7.1749999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.47099999999999997},"max":{"1min":0.96999999999999997,"5min":1936.5550000000001,"15min":1936.5550000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":25.221,"15min":8.9809999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.008,"5min":1999.019,"15min":1999.019},"last":0.70199999999999996}]},{"osd":6,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":29.164999999999999,"15min":10.345000000000001},"min":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.48199999999999998},"max":{"1min":1.083,"5min":2832.431,"15min":2832.431},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":29.058,"15min":10.275},"min":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.44700000000000001},"max":{"1min":1.042,"5min":2822.1840000000002,"15min":2822.1840000000002},"last":0.71499999999999997}]},{"osd":7,"last update":"Tue Nov 28 21:05:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":30.033999999999999,"15min":10.619999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0649999999999999,"5min":1999.058,"15min":1999.058},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":45.722999999999999,"15min":15.859999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.054,"5min":2822.143,"15min":2822.143},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":170106880,"data_stored":170090025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":171479040,"data_stored":171454248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85495808,"data_stored":85471932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":183201792,"data_stored":183178341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":187912192,"data_stored":187897127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171967842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":182128640,"data_stored":182110533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":209731584,"data_stored":209715928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":182788096,"data_stored":182788096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":297787392,"data_stored":297787392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":197746688,"data_stored":197746688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":288649216,"data_stored":288649216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259055616,"data_stored":259055616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":171409408,"data_stored":171409408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":267010048,"data_stored":267010048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":216862720,"data_stored":216862720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:06:52.130 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T21:06:52.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.267+0000 7fb3fc765640 1 Processor -- start 2023-11-28T21:06:52.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fc765640 1 -- start start 2023-11-28T21:06:52.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fc765640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb3f4070480 0x7fb3f4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fc765640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f41571d0 con 0x7fb3f406e030 2023-11-28T21:06:52.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fc765640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f4071a90 con 0x7fb3f406e410 2023-11-28T21:06:52.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fc765640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f40c70d0 con 0x7fb3f4070480 2023-11-28T21:06:52.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fa501640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb3f406e030 0x7fb3f41500b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57974/0 (socket says 172.21.15.167:57974) 2023-11-28T21:06:52.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fa501640 1 -- 172.21.15.167:0/3574946471 learned_addr learned my addr 172.21.15.167:0/3574946471 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:52.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585275203 0 0) 0x7fb3f41571d0 con 0x7fb3f406e030 2023-11-28T21:06:52.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3dc004640 con 0x7fb3f406e030 2023-11-28T21:06:52.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f9d00640 1 --2- 172.21.15.167:0/3574946471 >> v2:172.21.15.178:3300/0 conn(0x7fb3f4070480 0x7fb3f4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115360676 0 0) 0x7fb3dc004640 con 0x7fb3f406e030 2023-11-28T21:06:52.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 >> v2:172.21.15.178:3300/0 conn(0x7fb3f4070480 msgr2=0x7fb3f4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 --2- 172.21.15.167:0/3574946471 >> v2:172.21.15.178:3300/0 conn(0x7fb3f4070480 0x7fb3f4071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 >> v1:172.21.15.178:6789/0 conn(0x7fb3f406e410 legacy=0x7fb3f4160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40c73b0 con 0x7fb3f406e030 2023-11-28T21:06:52.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fb3ec001680 con 0x7fb3f406e030 2023-11-28T21:06:52.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 >> v1:172.21.15.167:6789/0 conn(0x7fb3f406e030 legacy=0x7fb3f41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3dc004a90 0x7fb3dc004e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3dc0058e0 0x7fb3dc005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3dc0062a0 0x7fb3dc00caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40c70d0 con 0x7fb3dc004a90 2023-11-28T21:06:52.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc00d1d0 con 0x7fb3dc0062a0 2023-11-28T21:06:52.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc00d390 con 0x7fb3dc0058e0 2023-11-28T21:06:52.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fa501640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3dc004a90 0x7fb3dc004e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fad02640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3dc0062a0 0x7fb3dc00caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fa501640 1 -- 172.21.15.167:0/3574946471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3dc0058e0 msgr2=0x7fb3dc005d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fa501640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3dc0058e0 0x7fb3dc005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fa501640 1 -- 172.21.15.167:0/3574946471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3dc0062a0 msgr2=0x7fb3dc00caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fa501640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3dc0062a0 0x7fb3dc00caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fa501640 1 -- 172.21.15.167:0/3574946471 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc004640 con 0x7fb3dc004a90 2023-11-28T21:06:52.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fad02640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3dc0062a0 0x7fb3dc00caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:06:52.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.271+0000 7fb3fad02640 1 -- 172.21.15.167:0/3574946471 reap_dead start 2023-11-28T21:06:52.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fa501640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3dc004a90 0x7fb3dc004e90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec001ec0 tx=0x7fb3ec01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08425da65952709 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:52.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec005ae0 con 0x7fb3dc004a90 2023-11-28T21:06:52.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec005c60 con 0x7fb3dc004a90 2023-11-28T21:06:52.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3f94ff640 1 -- 172.21.15.167:0/3574946471 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0a5b10 con 0x7fb3dc004a90 2023-11-28T21:06:52.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 -- 172.21.15.167:0/3574946471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3dc004a90 msgr2=0x7fb3dc004e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3dc004a90 0x7fb3dc004e90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec001ec0 tx=0x7fb3ec01cbf0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 -- 172.21.15.167:0/3574946471 shutdown_connections 2023-11-28T21:06:52.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 --2- 172.21.15.167:0/3574946471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3dc004a90 0x7fb3dc004e90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 -- 172.21.15.167:0/3574946471 >> 172.21.15.167:0/3574946471 conn(0x7fb3f40cb1e0 msgr2=0x7fb3f40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:52.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 -- 172.21.15.167:0/3574946471 shutdown_connections 2023-11-28T21:06:52.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 -- 172.21.15.167:0/3574946471 wait complete. 2023-11-28T21:06:52.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 Processor -- start 2023-11-28T21:06:52.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 -- start start 2023-11-28T21:06:52.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3dc004a90 0x7fb3f41e3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3f41e5c70 0x7fb3f41f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f41f3470 0x7fb3f4153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f41f6cc0 con 0x7fb3f41f3470 2023-11-28T21:06:52.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f41f2b10 con 0x7fb3f41e5c70 2023-11-28T21:06:52.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fc765640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f41e6400 con 0x7fb3dc004a90 2023-11-28T21:06:52.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fad02640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f41f3470 0x7fb3f4153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fad02640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f41f3470 0x7fb3f4153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58418/0 (socket says 172.21.15.167:58418) 2023-11-28T21:06:52.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fad02640 1 -- 172.21.15.167:0/1537323795 learned_addr learned my addr 172.21.15.167:0/1537323795 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:52.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3f9d00640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3f41e5c70 0x7fb3f41f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.275+0000 7fb3fa501640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3dc004a90 0x7fb3f41e3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fad02640 1 -- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3dc004a90 msgr2=0x7fb3f41e3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fad02640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3dc004a90 0x7fb3f41e3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fad02640 1 -- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3f41e5c70 msgr2=0x7fb3f41f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fad02640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3f41e5c70 0x7fb3f41f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fad02640 1 -- 172.21.15.167:0/1537323795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f41f6140 con 0x7fb3f41f3470 2023-11-28T21:06:52.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fad02640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f41f3470 0x7fb3f4153360 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40c5870 tx=0x7fb3e400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:52.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3f2ffd640 1 -- 172.21.15.167:0/1537323795 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4018070 con 0x7fb3f41f3470 2023-11-28T21:06:52.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3f2ffd640 1 -- 172.21.15.167:0/1537323795 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e4006b60 con 0x7fb3f41f3470 2023-11-28T21:06:52.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f41f6420 con 0x7fb3f41f3470 2023-11-28T21:06:52.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3f2ffd640 1 -- 172.21.15.167:0/1537323795 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4012600 con 0x7fb3f41f3470 2023-11-28T21:06:52.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f41f69e0 con 0x7fb3f41f3470 2023-11-28T21:06:52.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f40682c0 con 0x7fb3f41f3470 2023-11-28T21:06:52.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3f2ffd640 1 -- 172.21.15.167:0/1537323795 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3e4012760 con 0x7fb3f41f3470 2023-11-28T21:06:52.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3f2ffd640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3e0066470 0x7fb3e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3f2ffd640 1 -- 172.21.15.167:0/1537323795 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fb3e40838a0 con 0x7fb3f41f3470 2023-11-28T21:06:52.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fa501640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3e0066470 0x7fb3e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.279+0000 7fb3fa501640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3e0066470 0x7fb3e0068930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0ab000 tx=0x7fb3ec0b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:52.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.283+0000 7fb3f2ffd640 1 -- 172.21.15.167:0/1537323795 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3e40509a0 con 0x7fb3f41f3470 2023-11-28T21:06:52.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.427+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb3f41f2c50 con 0x7fb3f41f3470 2023-11-28T21:06:52.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.435+0000 7fb3f2ffd640 1 -- 172.21.15.167:0/1537323795 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb3f41f2c50 con 0x7fb3f41f3470 2023-11-28T21:06:52.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.435+0000 7fb3f2ffd640 1 -- 172.21.15.167:0/1537323795 <== mon.0 v2:172.21.15.167:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb3e40509a0 con 0x7fb3f41f3470 2023-11-28T21:06:52.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3e0066470 msgr2=0x7fb3e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3e0066470 0x7fb3e0068930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0ab000 tx=0x7fb3ec0b1040 comp rx=0 tx=0).stop 2023-11-28T21:06:52.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f41f3470 msgr2=0x7fb3f4153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f41f3470 0x7fb3f4153360 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40c5870 tx=0x7fb3e400d9d0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 shutdown_connections 2023-11-28T21:06:52.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fb3e0066470 0x7fb3e0068930 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f41f3470 0x7fb3f4153360 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3f41e5c70 0x7fb3f41f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 --2- 172.21.15.167:0/1537323795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3dc004a90 0x7fb3f41e3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 >> 172.21.15.167:0/1537323795 conn(0x7fb3f40cb1e0 msgr2=0x7fb3f41e5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 shutdown_connections 2023-11-28T21:06:52.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.439+0000 7fb3fc765640 1 -- 172.21.15.167:0/1537323795 wait complete. 2023-11-28T21:06:52.458 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T21:06:52.458 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:06:52.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.563+0000 7f736bd57640 1 Processor -- start 2023-11-28T21:06:52.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.563+0000 7f736bd57640 1 -- start start 2023-11-28T21:06:52.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.563+0000 7f736bd57640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f73640cfc40 0x7f73640cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.563+0000 7f736bd57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7364153ae0 0x7f7364153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.563+0000 7f736bd57640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736415ac00 con 0x7f73640cf860 2023-11-28T21:06:52.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.563+0000 7f736bd57640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73640cbd60 con 0x7f73640cfc40 2023-11-28T21:06:52.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.563+0000 7f736bd57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7364159ff0 con 0x7f7364153ae0 2023-11-28T21:06:52.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.563+0000 7f7369af3640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f73640cf860 0x7f73640ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:57990/0 (socket says 172.21.15.167:57990) 2023-11-28T21:06:52.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.563+0000 7f7369af3640 1 -- 172.21.15.167:0/209847763 learned_addr learned my addr 172.21.15.167:0/209847763 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:52.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f73692f2640 1 --2- 172.21.15.167:0/209847763 >> v2:172.21.15.178:3300/0 conn(0x7f73640cfc40 0x7f73640cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f736a2f4640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7364153ae0 0x7f7364153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627274740 0 0) 0x7f736415ac00 con 0x7f73640cf860 2023-11-28T21:06:52.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7350003530 con 0x7f73640cf860 2023-11-28T21:06:52.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719744657 0 0) 0x7f7350003530 con 0x7f73640cf860 2023-11-28T21:06:52.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7364153ae0 msgr2=0x7f7364153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7364153ae0 0x7f7364153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 >> v2:172.21.15.178:3300/0 conn(0x7f73640cfc40 msgr2=0x7f73640cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 --2- 172.21.15.167:0/209847763 >> v2:172.21.15.178:3300/0 conn(0x7f73640cfc40 0x7f73640cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736415a2d0 con 0x7f73640cf860 2023-11-28T21:06:52.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7f7354001680 con 0x7f73640cf860 2023-11-28T21:06:52.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 >> v1:172.21.15.167:6789/0 conn(0x7f73640cf860 legacy=0x7f73640ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7364153ae0 0x7f7350003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7350003f00 0x7f73500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7350004d10 0x7f7350005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73640cbd60 con 0x7f7350003f00 2023-11-28T21:06:52.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7364159ff0 con 0x7f7350004d10 2023-11-28T21:06:52.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735000b990 con 0x7f7364153ae0 2023-11-28T21:06:52.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f73692f2640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7350003f00 0x7f73500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7369af3640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7364153ae0 0x7f7350003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f73692f2640 1 -- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7364153ae0 msgr2=0x7f7350003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f73692f2640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7364153ae0 0x7f7350003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f73692f2640 1 -- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7350004d10 msgr2=0x7f7350005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f73692f2640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7350004d10 0x7f7350005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f73692f2640 1 -- 172.21.15.167:0/209847763 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7350003530 con 0x7f7350003f00 2023-11-28T21:06:52.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7369af3640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7364153ae0 0x7f7350003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:06:52.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f73692f2640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7350003f00 0x7f73500047d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7360009ae0 tx=0x7f736001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41caa90d3917ced7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:52.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600a5680 con 0x7f7350003f00 2023-11-28T21:06:52.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f73600a57e0 con 0x7f7350003f00 2023-11-28T21:06:52.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f7368af1640 1 -- 172.21.15.167:0/209847763 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600a5bb0 con 0x7f7350003f00 2023-11-28T21:06:52.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f736bd57640 1 -- 172.21.15.167:0/209847763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7350003f00 msgr2=0x7f73500047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f736bd57640 1 --2- 172.21.15.167:0/209847763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7350003f00 0x7f73500047d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7360009ae0 tx=0x7f736001ca30 comp rx=0 tx=0).stop 2023-11-28T21:06:52.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.567+0000 7f736a2f4640 1 -- 172.21.15.167:0/209847763 reap_dead start 2023-11-28T21:06:52.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- 172.21.15.167:0/209847763 shutdown_connections 2023-11-28T21:06:52.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- 172.21.15.167:0/209847763 >> 172.21.15.167:0/209847763 conn(0x7f736406c1f0 msgr2=0x7f7364071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:52.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- 172.21.15.167:0/209847763 shutdown_connections 2023-11-28T21:06:52.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- 172.21.15.167:0/209847763 wait complete. 2023-11-28T21:06:52.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 Processor -- start 2023-11-28T21:06:52.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- start start 2023-11-28T21:06:52.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7350003f00 0x7f736414fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73640cf050 0x7f736415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73641f01c0 0x7f73640b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736415c5c0 con 0x7f73640cf050 2023-11-28T21:06:52.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73641f06b0 con 0x7f73641f01c0 2023-11-28T21:06:52.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73640cd580 con 0x7f7350003f00 2023-11-28T21:06:52.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f73692f2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73640cf050 0x7f736415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f73692f2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73640cf050 0x7f736415ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58430/0 (socket says 172.21.15.167:58430) 2023-11-28T21:06:52.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f73692f2640 1 -- 172.21.15.167:0/85663208 learned_addr learned my addr 172.21.15.167:0/85663208 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:52.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f7369af3640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7350003f00 0x7f736414fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f73692f2640 1 -- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7350003f00 msgr2=0x7f736414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f73692f2640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7350003f00 0x7f736414fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f73692f2640 1 -- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73641f01c0 msgr2=0x7f73640b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736a2f4640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73641f01c0 0x7f73640b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f73692f2640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73641f01c0 0x7f73640b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f73692f2640 1 -- 172.21.15.167:0/85663208 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73640c9920 con 0x7f73640cf050 2023-11-28T21:06:52.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f73692f2640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73640cf050 0x7f736415ae60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7360009ae0 tx=0x7f7350005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:52.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f735a7fc640 1 -- 172.21.15.167:0/85663208 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600be070 con 0x7f73640cf050 2023-11-28T21:06:52.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f735a7fc640 1 -- 172.21.15.167:0/85663208 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7360004020 con 0x7f73640cf050 2023-11-28T21:06:52.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73640cd820 con 0x7f73640cf050 2023-11-28T21:06:52.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f735a7fc640 1 -- 172.21.15.167:0/85663208 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73600043b0 con 0x7f73640cf050 2023-11-28T21:06:52.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.571+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73640cdde0 con 0x7f73640cf050 2023-11-28T21:06:52.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.575+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7364075c90 con 0x7f73640cf050 2023-11-28T21:06:52.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.575+0000 7f735a7fc640 1 -- 172.21.15.167:0/85663208 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f73600b4040 con 0x7f73640cf050 2023-11-28T21:06:52.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.575+0000 7f735a7fc640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f73480664a0 0x7f7348068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.575+0000 7f735a7fc640 1 -- 172.21.15.167:0/85663208 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f736011e270 con 0x7f73640cf050 2023-11-28T21:06:52.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.575+0000 7f7369af3640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f73480664a0 0x7f7348068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.575+0000 7f7369af3640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f73480664a0 0x7f7348068960 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7354004880 tx=0x7f7354001660 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:52.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.579+0000 7f735a7fc640 1 -- 172.21.15.167:0/85663208 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f73600eb370 con 0x7f73640cf050 2023-11-28T21:06:52.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.751+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73640cb070 con 0x7f73640cf050 2023-11-28T21:06:52.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.751+0000 7f735a7fc640 1 -- 172.21.15.167:0/85663208 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+5757 (secure 0 0 0) 0x7f73600ee990 con 0x7f73640cf050 2023-11-28T21:06:52.756 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:06:52.756 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T21:06:29.015672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4269,"mds_2":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"e","rank":1,"incarnation":38,"state":"up:reconnect","state_seq":425,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4276":{"gid":4276,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":390,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":387,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:06:52.757 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 40 2023-11-28T21:06:52.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f73480664a0 msgr2=0x7f7348068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f73480664a0 0x7f7348068960 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7354004880 tx=0x7f7354001660 comp rx=0 tx=0).stop 2023-11-28T21:06:52.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73640cf050 msgr2=0x7f736415ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73640cf050 0x7f736415ae60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7360009ae0 tx=0x7f7350005800 comp rx=0 tx=0).stop 2023-11-28T21:06:52.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 shutdown_connections 2023-11-28T21:06:52.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f73480664a0 0x7f7348068960 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73641f01c0 0x7f73640b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73640cf050 0x7f736415ae60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 --2- 172.21.15.167:0/85663208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7350003f00 0x7f736414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 >> 172.21.15.167:0/85663208 conn(0x7f736406c1f0 msgr2=0x7f73640c55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:52.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 shutdown_connections 2023-11-28T21:06:52.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.755+0000 7f736bd57640 1 -- 172.21.15.167:0/85663208 wait complete. 2023-11-28T21:06:52.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:06:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f0a409640 1 Processor -- start 2023-11-28T21:06:52.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f0a409640 1 -- start start 2023-11-28T21:06:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f0a409640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f040cf860 0x7f2f040cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f0a409640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f040cfc40 0x7f2f040ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f0a409640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0415ac00 con 0x7f2f04153ae0 2023-11-28T21:06:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f0a409640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f040cbd60 con 0x7f2f040cf860 2023-11-28T21:06:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f0a409640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f04159ff0 con 0x7f2f040cfc40 2023-11-28T21:06:52.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f03fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f040cf860 0x7f2f040cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f03fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f040cf860 0x7f2f040cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52842/0 (socket says 172.21.15.167:52842) 2023-11-28T21:06:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f03fff640 1 -- 172.21.15.167:0/4205573595 learned_addr learned my addr 172.21.15.167:0/4205573595 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f03fff640 1 -- 172.21.15.167:0/4205573595 >> v2:172.21.15.178:3300/0 conn(0x7f2f040cfc40 msgr2=0x7f2f040ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f037fe640 1 --2- 172.21.15.167:0/4205573595 >> v2:172.21.15.178:3300/0 conn(0x7f2f040cfc40 0x7f2f040ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f03fff640 1 --2- 172.21.15.167:0/4205573595 >> v2:172.21.15.178:3300/0 conn(0x7f2f040cfc40 0x7f2f040ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f03fff640 1 -- 172.21.15.167:0/4205573595 >> v1:172.21.15.178:6789/0 conn(0x7f2f04153ae0 legacy=0x7f2f0415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:52.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f03fff640 1 -- 172.21.15.167:0/4205573595 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0415a2d0 con 0x7f2f040cf860 2023-11-28T21:06:52.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.879+0000 7f2f03fff640 1 --2- 172.21.15.167:0/4205573595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f040cf860 0x7f2f040cb770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f040c9c50 tx=0x7f2ef401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a5a45112f84bbc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:52.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f02ffd640 1 -- 172.21.15.167:0/4205573595 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40aa5f0 con 0x7f2f040cf860 2023-11-28T21:06:52.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f02ffd640 1 -- 172.21.15.167:0/4205573595 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2ef40aa750 con 0x7f2f040cf860 2023-11-28T21:06:52.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f02ffd640 1 -- 172.21.15.167:0/4205573595 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40aab00 con 0x7f2f040cf860 2023-11-28T21:06:52.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- 172.21.15.167:0/4205573595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f040cf860 msgr2=0x7f2f040cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 --2- 172.21.15.167:0/4205573595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f040cf860 0x7f2f040cb770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f040c9c50 tx=0x7f2ef401c490 comp rx=0 tx=0).stop 2023-11-28T21:06:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- 172.21.15.167:0/4205573595 shutdown_connections 2023-11-28T21:06:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 --2- 172.21.15.167:0/4205573595 >> v2:172.21.15.178:3300/0 conn(0x7f2f040cfc40 0x7f2f040ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 --2- 172.21.15.167:0/4205573595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f040cf860 0x7f2f040cb770 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- 172.21.15.167:0/4205573595 >> 172.21.15.167:0/4205573595 conn(0x7f2f0406c1f0 msgr2=0x7f2f04071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- 172.21.15.167:0/4205573595 shutdown_connections 2023-11-28T21:06:52.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- 172.21.15.167:0/4205573595 wait complete. 2023-11-28T21:06:52.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 Processor -- start 2023-11-28T21:06:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- start start 2023-11-28T21:06:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f040cf860 0x7f2f041f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f040cfc40 0x7f2f0415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f04153ae0 0x7f2f0415c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f041f7290 con 0x7f2f04153ae0 2023-11-28T21:06:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040cf3f0 con 0x7f2f040cfc40 2023-11-28T21:06:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040cee70 con 0x7f2f040cf860 2023-11-28T21:06:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f089a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f04153ae0 0x7f2f0415c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f089a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f04153ae0 0x7f2f0415c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52844/0 (socket says 172.21.15.167:52844) 2023-11-28T21:06:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f089a6640 1 -- 172.21.15.167:0/2143367382 learned_addr learned my addr 172.21.15.167:0/2143367382 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f03fff640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f040cf860 0x7f2f041f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f037fe640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f040cfc40 0x7f2f0415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f089a6640 1 -- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f040cf860 msgr2=0x7f2f041f3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f089a6640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f040cf860 0x7f2f041f3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f089a6640 1 -- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f040cfc40 msgr2=0x7f2f0415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f089a6640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f040cfc40 0x7f2f0415c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f089a6640 1 -- 172.21.15.167:0/2143367382 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef40094d0 con 0x7f2f04153ae0 2023-11-28T21:06:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f089a6640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f04153ae0 0x7f2f0415c600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c780 tx=0x7f2efc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f00ff9640 1 -- 172.21.15.167:0/2143367382 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc003d90 con 0x7f2f04153ae0 2023-11-28T21:06:52.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f00ff9640 1 -- 172.21.15.167:0/2143367382 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2efc00ce90 con 0x7f2f04153ae0 2023-11-28T21:06:52.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f040cf110 con 0x7f2f04153ae0 2023-11-28T21:06:52.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.883+0000 7f2f00ff9640 1 -- 172.21.15.167:0/2143367382 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0052d0 con 0x7f2f04153ae0 2023-11-28T21:06:52.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.887+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f041f3230 con 0x7f2f04153ae0 2023-11-28T21:06:52.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.887+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f041f2db0 con 0x7f2f04153ae0 2023-11-28T21:06:52.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.887+0000 7f2f00ff9640 1 -- 172.21.15.167:0/2143367382 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2efc005430 con 0x7f2f04153ae0 2023-11-28T21:06:52.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.887+0000 7f2f00ff9640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ef0066470 0x7f2ef0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:52.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.887+0000 7f2f00ff9640 1 -- 172.21.15.167:0/2143367382 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f2efc083c40 con 0x7f2f04153ae0 2023-11-28T21:06:52.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.887+0000 7f2f03fff640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ef0066470 0x7f2ef0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:52.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.887+0000 7f2f03fff640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ef0066470 0x7f2ef0068930 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40ae000 tx=0x7f2ef40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:52.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:52.891+0000 7f2f00ff9640 1 -- 172.21.15.167:0/2143367382 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f041f2db0 con 0x7f2f04153ae0 2023-11-28T21:06:53.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.071+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f041f2db0 con 0x7f2f04153ae0 2023-11-28T21:06:53.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.071+0000 7f2f00ff9640 1 -- 172.21.15.167:0/2143367382 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+5757 (secure 0 0 0) 0x7f2f041f2db0 con 0x7f2f04153ae0 2023-11-28T21:06:53.076 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:06:53.076 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4155525660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4155525660},{"type":"v1","addr":"172.21.15.178:6835","nonce":4155525660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2486183061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":2486183061},{"type":"v1","addr":"172.21.15.167:6835","nonce":2486183061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T20:38:18.895715+0000","modified":"2023-11-28T21:06:29.015672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4279,"mds_1":4269,"mds_2":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"e","rank":1,"incarnation":38,"state":"up:reconnect","state_seq":425,"addr":"172.21.15.167:6834/2631649215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2631649215},{"type":"v1","addr":"172.21.15.167:6834","nonce":2631649215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4276":{"gid":4276,"name":"f","rank":2,"incarnation":13,"state":"up:active","state_seq":390,"addr":"172.21.15.178:6838/3161530579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3161530579},{"type":"v1","addr":"172.21.15.178:6838","nonce":3161530579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":387,"addr":"172.21.15.178:6839/4165916206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6837","nonce":4165916206},{"type":"v1","addr":"172.21.15.178:6839","nonce":4165916206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:06:53.076 INFO:teuthology.orchestra.run.smithi167.stderr:dumped fsmap epoch 40 2023-11-28T21:06:53.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ef0066470 msgr2=0x7f2ef0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ef0066470 0x7f2ef0068930 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40ae000 tx=0x7f2ef40a7000 comp rx=0 tx=0).stop 2023-11-28T21:06:53.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f04153ae0 msgr2=0x7f2f0415c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f04153ae0 0x7f2f0415c600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c780 tx=0x7f2efc00cc40 comp rx=0 tx=0).stop 2023-11-28T21:06:53.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 shutdown_connections 2023-11-28T21:06:53.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f2ef0066470 0x7f2ef0068930 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f04153ae0 0x7f2f0415c600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f040cfc40 0x7f2f0415c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 --2- 172.21.15.167:0/2143367382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f040cf860 0x7f2f041f3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 >> 172.21.15.167:0/2143367382 conn(0x7f2f0406c1f0 msgr2=0x7f2f040d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:53.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 shutdown_connections 2023-11-28T21:06:53.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.075+0000 7f2f0a409640 1 -- 172.21.15.167:0/2143367382 wait complete. 2023-11-28T21:06:53.093 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:06:53.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa493d65640 1 Processor -- start 2023-11-28T21:06:53.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa493d65640 1 -- start start 2023-11-28T21:06:53.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa493d65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa48c0cfc40 0x7fa48c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa493d65640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa48c153ae0 0x7fa48c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa493d65640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c15ac00 con 0x7fa48c0cf860 2023-11-28T21:06:53.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa493d65640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c154470 con 0x7fa48c153ae0 2023-11-28T21:06:53.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa493d65640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0cbd60 con 0x7fa48c0cfc40 2023-11-28T21:06:53.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa492302640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa48c153ae0 0x7fa48c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa491b01640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa48c0cf860 0x7fa48c0ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:42636/0 (socket says 172.21.15.167:42636) 2023-11-28T21:06:53.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa492302640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa48c153ae0 0x7fa48c153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52854/0 (socket says 172.21.15.167:52854) 2023-11-28T21:06:53.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa491b01640 1 -- 172.21.15.167:0/3328876875 learned_addr learned my addr 172.21.15.167:0/3328876875 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:53.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa492302640 1 -- 172.21.15.167:0/3328876875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa48c0cfc40 msgr2=0x7fa48c0cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:53.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa492302640 1 --2- 172.21.15.167:0/3328876875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa48c0cfc40 0x7fa48c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa492302640 1 -- 172.21.15.167:0/3328876875 >> v1:172.21.15.167:6789/0 conn(0x7fa48c0cf860 legacy=0x7fa48c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa492302640 1 -- 172.21.15.167:0/3328876875 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c159ff0 con 0x7fa48c153ae0 2023-11-28T21:06:53.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.199+0000 7fa490aff640 1 -- 172.21.15.167:0/3328876875 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945447173 0 0) 0x7fa48c15ac00 con 0x7fa48c0cf860 2023-11-28T21:06:53.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa492302640 1 --2- 172.21.15.167:0/3328876875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c153ae0 0x7fa48c153f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa484009d90 tx=0x7fa48401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf295a25eb185242 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:53.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa490aff640 1 -- 172.21.15.167:0/3328876875 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840a59e0 con 0x7fa48c153ae0 2023-11-28T21:06:53.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa490aff640 1 -- 172.21.15.167:0/3328876875 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa4840a5b40 con 0x7fa48c153ae0 2023-11-28T21:06:53.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa490aff640 1 -- 172.21.15.167:0/3328876875 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840ad440 con 0x7fa48c153ae0 2023-11-28T21:06:53.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- 172.21.15.167:0/3328876875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c153ae0 msgr2=0x7fa48c153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 --2- 172.21.15.167:0/3328876875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c153ae0 0x7fa48c153f30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa484009d90 tx=0x7fa48401c920 comp rx=0 tx=0).stop 2023-11-28T21:06:53.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- 172.21.15.167:0/3328876875 shutdown_connections 2023-11-28T21:06:53.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 --2- 172.21.15.167:0/3328876875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c153ae0 0x7fa48c153f30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 --2- 172.21.15.167:0/3328876875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa48c0cfc40 0x7fa48c0cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- 172.21.15.167:0/3328876875 >> 172.21.15.167:0/3328876875 conn(0x7fa48c06c1f0 msgr2=0x7fa48c071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:53.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- 172.21.15.167:0/3328876875 shutdown_connections 2023-11-28T21:06:53.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- 172.21.15.167:0/3328876875 wait complete. 2023-11-28T21:06:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 Processor -- start 2023-11-28T21:06:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- start start 2023-11-28T21:06:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c0cf860 0x7fa48c1ec490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48c0cfc40 0x7fa48c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa48c153ae0 0x7fa48c0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0b5410 con 0x7fa48c0cf860 2023-11-28T21:06:53.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0b56f0 con 0x7fa48c0cfc40 2023-11-28T21:06:53.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c1eb6d0 con 0x7fa48c153ae0 2023-11-28T21:06:53.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491b01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c0cf860 0x7fa48c1ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491b01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c0cf860 0x7fa48c1ec490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52864/0 (socket says 172.21.15.167:52864) 2023-11-28T21:06:53.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491b01640 1 -- 172.21.15.167:0/1368221482 learned_addr learned my addr 172.21.15.167:0/1368221482 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:53.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491b01640 1 -- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa48c153ae0 msgr2=0x7fa48c0b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491b01640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa48c153ae0 0x7fa48c0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491b01640 1 -- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48c0cfc40 msgr2=0x7fa48c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491300640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48c0cfc40 0x7fa48c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491b01640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48c0cfc40 0x7fa48c0b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491b01640 1 -- 172.21.15.167:0/1368221482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484009a70 con 0x7fa48c0cf860 2023-11-28T21:06:53.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa491b01640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c0cf860 0x7fa48c1ec490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c480 tx=0x7fa48800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:53.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa4827fc640 1 -- 172.21.15.167:0/1368221482 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4880074e0 con 0x7fa48c0cf860 2023-11-28T21:06:53.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa4827fc640 1 -- 172.21.15.167:0/1368221482 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa488007660 con 0x7fa48c0cf860 2023-11-28T21:06:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c1eb9b0 con 0x7fa48c0cf860 2023-11-28T21:06:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa4827fc640 1 -- 172.21.15.167:0/1368221482 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488004a50 con 0x7fa48c0cf860 2023-11-28T21:06:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.203+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c1ebf70 con 0x7fa48c0cf860 2023-11-28T21:06:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.207+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48c067c40 con 0x7fa48c0cf860 2023-11-28T21:06:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.207+0000 7fa4827fc640 1 -- 172.21.15.167:0/1368221482 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa488004bb0 con 0x7fa48c0cf860 2023-11-28T21:06:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.207+0000 7fa4827fc640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa4700664a0 0x7fa470068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.207+0000 7fa4827fc640 1 -- 172.21.15.167:0/1368221482 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa4880835f0 con 0x7fa48c0cf860 2023-11-28T21:06:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.207+0000 7fa491300640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa4700664a0 0x7fa470068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.207+0000 7fa491300640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa4700664a0 0x7fa470068960 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0caf40 tx=0x7fa47c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.211+0000 7fa4827fc640 1 -- 172.21.15.167:0/1368221482 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa488053f40 con 0x7fa48c0cf860 2023-11-28T21:06:53.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.355+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa48c1ec160 con 0x7fa48c0cf860 2023-11-28T21:06:53.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.355+0000 7fa4827fc640 1 -- 172.21.15.167:0/1368221482 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18939 (secure 0 0 0) 0x7fa488004e60 con 0x7fa48c0cf860 2023-11-28T21:06:53.361 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-11-28T21:06:53.361 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":52,"fsid":"4f385093-4252-4ae9-94ab-503723a001fd","created":"2023-11-28T20:37:54.568913+0000","modified":"2023-11-28T21:06:14.933819+0000","last_up_change":"2023-11-28T20:38:05.508885+0000","last_in_change":"2023-11-28T20:37:56.868471+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T20:38:05.507993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T20:38:17.477871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T20:38:17.884061+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-28T20:38:21.578587+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8a0f86cc-d969-4253-a608-79a4910723d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6801","nonce":1022160227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6803","nonce":1022160227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6807","nonce":1022160227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1022160227},{"type":"v1","addr":"172.21.15.167:6805","nonce":1022160227}]},"public_addr":"172.21.15.167:6801/1022160227","cluster_addr":"172.21.15.167:6803/1022160227","heartbeat_back_addr":"172.21.15.167:6807/1022160227","heartbeat_front_addr":"172.21.15.167:6805/1022160227","state":["exists","up"]},{"osd":1,"uuid":"a3334ea7-c714-4f46-babe-4b5383cdeed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6809","nonce":3381685754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6811","nonce":3381685754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6815","nonce":3381685754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3381685754},{"type":"v1","addr":"172.21.15.167:6813","nonce":3381685754}]},"public_addr":"172.21.15.167:6809/3381685754","cluster_addr":"172.21.15.167:6811/3381685754","heartbeat_back_addr":"172.21.15.167:6815/3381685754","heartbeat_front_addr":"172.21.15.167:6813/3381685754","state":["exists","up"]},{"osd":2,"uuid":"b9bde8b0-f97c-4c4b-ae7a-9ff0ff74b0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6817","nonce":3946163569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6819","nonce":3946163569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6823","nonce":3946163569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3946163569},{"type":"v1","addr":"172.21.15.167:6821","nonce":3946163569}]},"public_addr":"172.21.15.167:6817/3946163569","cluster_addr":"172.21.15.167:6819/3946163569","heartbeat_back_addr":"172.21.15.167:6823/3946163569","heartbeat_front_addr":"172.21.15.167:6821/3946163569","state":["exists","up"]},{"osd":3,"uuid":"e511ed6d-d15e-4e1d-b624-77f89c872381","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6825","nonce":1382439964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6827","nonce":1382439964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6831","nonce":1382439964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1382439964},{"type":"v1","addr":"172.21.15.167:6829","nonce":1382439964}]},"public_addr":"172.21.15.167:6825/1382439964","cluster_addr":"172.21.15.167:6827/1382439964","heartbeat_back_addr":"172.21.15.167:6831/1382439964","heartbeat_front_addr":"172.21.15.167:6829/1382439964","state":["exists","up"]},{"osd":4,"uuid":"ee2a0e49-a098-4bb4-921f-842eb9c68bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6801","nonce":1470729243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6803","nonce":1470729243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6807","nonce":1470729243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1470729243},{"type":"v1","addr":"172.21.15.178:6805","nonce":1470729243}]},"public_addr":"172.21.15.178:6801/1470729243","cluster_addr":"172.21.15.178:6803/1470729243","heartbeat_back_addr":"172.21.15.178:6807/1470729243","heartbeat_front_addr":"172.21.15.178:6805/1470729243","state":["exists","up"]},{"osd":5,"uuid":"db07d3fe-f253-4d06-835e-69591c096694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6818","nonce":929221892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6822","nonce":929221892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6830","nonce":929221892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":929221892},{"type":"v1","addr":"172.21.15.178:6826","nonce":929221892}]},"public_addr":"172.21.15.178:6818/929221892","cluster_addr":"172.21.15.178:6822/929221892","heartbeat_back_addr":"172.21.15.178:6830/929221892","heartbeat_front_addr":"172.21.15.178:6826/929221892","state":["exists","up"]},{"osd":6,"uuid":"f0e6673c-6f52-4eac-a615-2d7656938515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6819","nonce":1489101033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6823","nonce":1489101033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6831","nonce":1489101033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6825","nonce":1489101033},{"type":"v1","addr":"172.21.15.178:6827","nonce":1489101033}]},"public_addr":"172.21.15.178:6819/1489101033","cluster_addr":"172.21.15.178:6823/1489101033","heartbeat_back_addr":"172.21.15.178:6831/1489101033","heartbeat_front_addr":"172.21.15.178:6827/1489101033","state":["exists","up"]},{"osd":7,"uuid":"359243a1-c3b8-4c25-9376-b964dcfe2d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6809","nonce":98078411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6811","nonce":98078411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6815","nonce":98078411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":98078411},{"type":"v1","addr":"172.21.15.178:6813","nonce":98078411}]},"public_addr":"172.21.15.178:6809/98078411","cluster_addr":"172.21.15.178:6811/98078411","heartbeat_back_addr":"172.21.15.178:6815/98078411","heartbeat_front_addr":"172.21.15.178:6813/98078411","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.403627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.567764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.528802+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.570709+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.321390+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.152407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.467599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T20:38:02.086249+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/1234930245":"2023-11-29T21:06:14.933758+0000","172.21.15.167:6836/1234930245":"2023-11-29T21:06:14.933758+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:06:53.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa4700664a0 msgr2=0x7fa470068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa4700664a0 0x7fa470068960 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0caf40 tx=0x7fa47c008040 comp rx=0 tx=0).stop 2023-11-28T21:06:53.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c0cf860 msgr2=0x7fa48c1ec490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c0cf860 0x7fa48c1ec490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c480 tx=0x7fa48800c940 comp rx=0 tx=0).stop 2023-11-28T21:06:53.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 shutdown_connections 2023-11-28T21:06:53.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa4700664a0 0x7fa470068960 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa48c153ae0 0x7fa48c0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48c0cfc40 0x7fa48c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 --2- 172.21.15.167:0/1368221482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa48c0cf860 0x7fa48c1ec490 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 >> 172.21.15.167:0/1368221482 conn(0x7fa48c06c1f0 msgr2=0x7fa48c0c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:53.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 shutdown_connections 2023-11-28T21:06:53.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.359+0000 7fa493d65640 1 -- 172.21.15.167:0/1368221482 wait complete. 2023-11-28T21:06:53.379 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T21:06:53.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.483+0000 7f619b4fe640 1 Processor -- start 2023-11-28T21:06:53.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619b4fe640 1 -- start start 2023-11-28T21:06:53.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619b4fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61940b0110 0x7f619415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619b4fe640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619406a8d0 con 0x7f61940c8010 2023-11-28T21:06:53.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619b4fe640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61940ca230 con 0x7f619406bda0 2023-11-28T21:06:53.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619b4fe640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61940c8990 con 0x7f61940b0110 2023-11-28T21:06:53.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619929a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61940b0110 0x7f619415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f6198a99640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f61940c8010 0x7f619406b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:42638/0 (socket says 172.21.15.167:42638) 2023-11-28T21:06:53.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f6198a99640 1 -- 172.21.15.167:0/3399333229 learned_addr learned my addr 172.21.15.167:0/3399333229 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:53.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619929a640 1 -- 172.21.15.167:0/3399333229 >> v1:172.21.15.178:6789/0 conn(0x7f619406bda0 legacy=0x7f61941646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:53.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619929a640 1 -- 172.21.15.167:0/3399333229 >> v1:172.21.15.167:6789/0 conn(0x7f61940c8010 legacy=0x7f619406b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619929a640 1 -- 172.21.15.167:0/3399333229 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61940ca480 con 0x7f61940b0110 2023-11-28T21:06:53.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f618bfff640 1 -- 172.21.15.167:0/3399333229 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706747255 0 0) 0x7f619406a8d0 con 0x7f61940c8010 2023-11-28T21:06:53.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f619929a640 1 --2- 172.21.15.167:0/3399333229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61940b0110 0x7f619415d3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f61900097c0 tx=0x7f619001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762717d02880e5c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:53.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f618bfff640 1 -- 172.21.15.167:0/3399333229 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900a8930 con 0x7f61940b0110 2023-11-28T21:06:53.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f618bfff640 1 -- 172.21.15.167:0/3399333229 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f61900a8a90 con 0x7f61940b0110 2023-11-28T21:06:53.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.487+0000 7f618bfff640 1 -- 172.21.15.167:0/3399333229 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900a8e40 con 0x7f61940b0110 2023-11-28T21:06:53.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- 172.21.15.167:0/3399333229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61940b0110 msgr2=0x7f619415d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 --2- 172.21.15.167:0/3399333229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61940b0110 0x7f619415d3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f61900097c0 tx=0x7f619001ec30 comp rx=0 tx=0).stop 2023-11-28T21:06:53.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- 172.21.15.167:0/3399333229 shutdown_connections 2023-11-28T21:06:53.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 --2- 172.21.15.167:0/3399333229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61940b0110 0x7f619415d3b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- 172.21.15.167:0/3399333229 >> 172.21.15.167:0/3399333229 conn(0x7f619406ee30 msgr2=0x7f619406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:53.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- 172.21.15.167:0/3399333229 shutdown_connections 2023-11-28T21:06:53.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- 172.21.15.167:0/3399333229 wait complete. 2023-11-28T21:06:53.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 Processor -- start 2023-11-28T21:06:53.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- start start 2023-11-28T21:06:53.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619406bda0 0x7f61940b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61940b0110 0x7f61940af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61940c8010 0x7f61941f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61940b0a20 con 0x7f619406bda0 2023-11-28T21:06:53.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61941f2b10 con 0x7f61940b0110 2023-11-28T21:06:53.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61941f2830 con 0x7f61940c8010 2023-11-28T21:06:53.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619929a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619406bda0 0x7f61940b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619929a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619406bda0 0x7f61940b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52890/0 (socket says 172.21.15.167:52890) 2023-11-28T21:06:53.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619929a640 1 -- 172.21.15.167:0/2708224654 learned_addr learned my addr 172.21.15.167:0/2708224654 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:53.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f6198a99640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61940b0110 0x7f61940af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f6199a9b640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61940c8010 0x7f61941f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619929a640 1 -- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61940c8010 msgr2=0x7f61941f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619929a640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61940c8010 0x7f61941f2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619929a640 1 -- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61940b0110 msgr2=0x7f61940af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619929a640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61940b0110 0x7f61940af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619929a640 1 -- 172.21.15.167:0/2708224654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190009420 con 0x7f619406bda0 2023-11-28T21:06:53.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f6198a99640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61940b0110 0x7f61940af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:06:53.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619929a640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619406bda0 0x7f61940b23e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61900097c0 tx=0x7f619001d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:53.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f6189ffb640 1 -- 172.21.15.167:0/2708224654 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900a8930 con 0x7f619406bda0 2023-11-28T21:06:53.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f6189ffb640 1 -- 172.21.15.167:0/2708224654 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6190004030 con 0x7f619406bda0 2023-11-28T21:06:53.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619415b9c0 con 0x7f619406bda0 2023-11-28T21:06:53.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f6189ffb640 1 -- 172.21.15.167:0/2708224654 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900043a0 con 0x7f619406bda0 2023-11-28T21:06:53.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.491+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61940b0ed0 con 0x7f619406bda0 2023-11-28T21:06:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.495+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6194075c90 con 0x7f619406bda0 2023-11-28T21:06:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.495+0000 7f6189ffb640 1 -- 172.21.15.167:0/2708224654 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6190003620 con 0x7f619406bda0 2023-11-28T21:06:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.495+0000 7f6189ffb640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6178066470 0x7f6178068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.495+0000 7f6189ffb640 1 -- 172.21.15.167:0/2708224654 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f6190122270 con 0x7f619406bda0 2023-11-28T21:06:53.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.495+0000 7f6198a99640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6178066470 0x7f6178068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.495+0000 7f6198a99640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6178066470 0x7f6178068930 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f619406cd00 tx=0x7f6184009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:53.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.499+0000 7f6189ffb640 1 -- 172.21.15.167:0/2708224654 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61900ef120 con 0x7f619406bda0 2023-11-28T21:06:53.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.675+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f61940cafb0 con 0x7f619406bda0 2023-11-28T21:06:53.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f6189ffb640 1 -- 172.21.15.167:0/2708224654 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f61900c2090 con 0x7f619406bda0 2023-11-28T21:06:53.684 INFO:teuthology.orchestra.run.smithi167.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T21:06:53.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6178066470 msgr2=0x7f6178068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6178066470 0x7f6178068930 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f619406cd00 tx=0x7f6184009040 comp rx=0 tx=0).stop 2023-11-28T21:06:53.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619406bda0 msgr2=0x7f61940b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619406bda0 0x7f61940b23e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61900097c0 tx=0x7f619001d470 comp rx=0 tx=0).stop 2023-11-28T21:06:53.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 shutdown_connections 2023-11-28T21:06:53.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f6178066470 0x7f6178068930 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61940c8010 0x7f61941f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61940b0110 0x7f61940af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 --2- 172.21.15.167:0/2708224654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619406bda0 0x7f61940b23e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 >> 172.21.15.167:0/2708224654 conn(0x7f619406ee30 msgr2=0x7f61940c3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:53.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.679+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 shutdown_connections 2023-11-28T21:06:53.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.683+0000 7f619b4fe640 1 -- 172.21.15.167:0/2708224654 wait complete. 2023-11-28T21:06:53.704 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T21:06:53.731 INFO:tasks.ceph.mds.e.smithi167.stdout:starting mds.e at 2023-11-28T21:06:53.766 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-11-28T21:06:53.776 INFO:tasks.ceph.mds.f.smithi178.stdout:starting mds.f at 2023-11-28T21:06:53.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9ac52a640 1 Processor -- start 2023-11-28T21:06:53.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9ac52a640 1 -- start start 2023-11-28T21:06:53.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9ac52a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 0x7fa9a40c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9ac52a640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa9a41582c0 0x7fa9a40c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9ac52a640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a406a8c0 con 0x7fa9a40c8010 2023-11-28T21:06:53.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9ac52a640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a40c2f50 con 0x7fa9a41582c0 2023-11-28T21:06:53.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9ac52a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40c94d0 con 0x7fa9a40c2630 2023-11-28T21:06:53.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9aaac7640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa9a41582c0 0x7fa9a40c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9aa2c6640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 0x7fa9a40c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9aaac7640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa9a41582c0 0x7fa9a40c2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.167:46390/0 (socket says 172.21.15.167:46390) 2023-11-28T21:06:53.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9aaac7640 1 -- 172.21.15.167:0/3026110370 learned_addr learned my addr 172.21.15.167:0/3026110370 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:53.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9aaac7640 1 -- 172.21.15.167:0/3026110370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 msgr2=0x7fa9a40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:53.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9aaac7640 1 --2- 172.21.15.167:0/3026110370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 0x7fa9a40c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9aaac7640 1 -- 172.21.15.167:0/3026110370 >> v1:172.21.15.178:6789/0 conn(0x7fa9a40c8010 legacy=0x7fa9a4157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.815+0000 7fa9aaac7640 1 -- 172.21.15.167:0/3026110370 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a40ca850 con 0x7fa9a41582c0 2023-11-28T21:06:53.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9aaac7640 1 --2- 172.21.15.167:0/3026110370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 0x7fa9a40c2a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009e50 tx=0x7fa99c01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27816d5d2660dfb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:53.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9a92c4640 1 -- 172.21.15.167:0/3026110370 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c0a58a0 con 0x7fa9a41582c0 2023-11-28T21:06:53.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9a92c4640 1 -- 172.21.15.167:0/3026110370 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa99c0a5a00 con 0x7fa9a41582c0 2023-11-28T21:06:53.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9a92c4640 1 -- 172.21.15.167:0/3026110370 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99c0a5db0 con 0x7fa9a41582c0 2023-11-28T21:06:53.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3026110370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 msgr2=0x7fa9a40c2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 --2- 172.21.15.167:0/3026110370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 0x7fa9a40c2a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009e50 tx=0x7fa99c01c9e0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3026110370 shutdown_connections 2023-11-28T21:06:53.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 --2- 172.21.15.167:0/3026110370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 0x7fa9a40c2a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 --2- 172.21.15.167:0/3026110370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 0x7fa9a40c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3026110370 >> 172.21.15.167:0/3026110370 conn(0x7fa9a406ee00 msgr2=0x7fa9a406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:53.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3026110370 shutdown_connections 2023-11-28T21:06:53.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3026110370 wait complete. 2023-11-28T21:06:53.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 Processor -- start 2023-11-28T21:06:53.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 -- start start 2023-11-28T21:06:53.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 0x7fa9a414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a40c8010 0x7fa9a415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 0x7fa9a415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a41423e0 con 0x7fa9a40c8010 2023-11-28T21:06:53.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a41f1ae0 con 0x7fa9a41582c0 2023-11-28T21:06:53.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9ac52a640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a41f0f40 con 0x7fa9a40c2630 2023-11-28T21:06:53.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9a9ac5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a40c8010 0x7fa9a415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9a9ac5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a40c8010 0x7fa9a415b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52906/0 (socket says 172.21.15.167:52906) 2023-11-28T21:06:53.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9a9ac5640 1 -- 172.21.15.167:0/3838629991 learned_addr learned my addr 172.21.15.167:0/3838629991 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:53.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9aaac7640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 0x7fa9a415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.819+0000 7fa9aa2c6640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 0x7fa9a414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9a9ac5640 1 -- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 msgr2=0x7fa9a414bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9a9ac5640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 0x7fa9a414bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9a9ac5640 1 -- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 msgr2=0x7fa9a415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:53.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9a9ac5640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 0x7fa9a415b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:53.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9a9ac5640 1 -- 172.21.15.167:0/3838629991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c009b30 con 0x7fa9a40c8010 2023-11-28T21:06:53.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9aaac7640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 0x7fa9a415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:06:53.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9a9ac5640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a40c8010 0x7fa9a415b350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c530 tx=0x7fa99400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:53.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa99affd640 1 -- 172.21.15.167:0/3838629991 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994005220 con 0x7fa9a40c8010 2023-11-28T21:06:53.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa99affd640 1 -- 172.21.15.167:0/3838629991 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa994005380 con 0x7fa9a40c8010 2023-11-28T21:06:53.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a40b28e0 con 0x7fa9a40c8010 2023-11-28T21:06:53.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa99affd640 1 -- 172.21.15.167:0/3838629991 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994007290 con 0x7fa9a40c8010 2023-11-28T21:06:53.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a41f1490 con 0x7fa9a40c8010 2023-11-28T21:06:53.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a4075c90 con 0x7fa9a40c8010 2023-11-28T21:06:53.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa99affd640 1 -- 172.21.15.167:0/3838629991 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa9940073f0 con 0x7fa9a40c8010 2023-11-28T21:06:53.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa99affd640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa988066470 0x7fa988068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:53.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa99affd640 1 -- 172.21.15.167:0/3838629991 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fa994083b10 con 0x7fa9a40c8010 2023-11-28T21:06:53.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9aa2c6640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa988066470 0x7fa988068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:53.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.823+0000 7fa9aa2c6640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa988066470 0x7fa988068930 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009b60 tx=0x7fa9a0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:53.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:53.827+0000 7fa99affd640 1 -- 172.21.15.167:0/3838629991 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa994050bc0 con 0x7fa9a40c8010 2023-11-28T21:06:54.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.003+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa9a4144c10 con 0x7fa9a40c8010 2023-11-28T21:06:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.679+0000 7fa99affd640 1 -- 172.21.15.167:0/3838629991 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa9940541e0 con 0x7fa9a40c8010 2023-11-28T21:06:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa988066470 msgr2=0x7fa988068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa988066470 0x7fa988068930 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009b60 tx=0x7fa9a0009190 comp rx=0 tx=0).stop 2023-11-28T21:06:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a40c8010 msgr2=0x7fa9a415b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a40c8010 0x7fa9a415b350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c530 tx=0x7fa99400c9f0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 shutdown_connections 2023-11-28T21:06:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa988066470 0x7fa988068930 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9a41582c0 0x7fa9a415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9a40c8010 0x7fa9a415b350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 --2- 172.21.15.167:0/3838629991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9a40c2630 0x7fa9a414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 >> 172.21.15.167:0/3838629991 conn(0x7fa9a406ee00 msgr2=0x7fa9a4144e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:54.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 shutdown_connections 2023-11-28T21:06:54.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.683+0000 7fa9ac52a640 1 -- 172.21.15.167:0/3838629991 wait complete. 2023-11-28T21:06:54.704 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T21:06:54.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa82dd96640 1 Processor -- start 2023-11-28T21:06:54.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa82dd96640 1 -- start start 2023-11-28T21:06:54.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa82dd96640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa828154220 0x7fa828159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:54.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa82dd96640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8280c5c90 0x7fa8280c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:54.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa82dd96640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8280cbd40 con 0x7fa8280ca6b0 2023-11-28T21:06:54.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa82dd96640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8280c6660 con 0x7fa828154220 2023-11-28T21:06:54.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa82dd96640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa828154600 con 0x7fa8280c5c90 2023-11-28T21:06:54.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa826ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa8280ca6b0 0x7fa8280cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:42646/0 (socket says 172.21.15.167:42646) 2023-11-28T21:06:54.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa826ffd640 1 -- 172.21.15.167:0/1911720866 learned_addr learned my addr 172.21.15.167:0/1911720866 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:54.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8277fe640 1 --2- 172.21.15.167:0/1911720866 >> v2:172.21.15.178:3300/0 conn(0x7fa828154220 0x7fa828159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:54.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa827fff640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8280c5c90 0x7fa8280c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:54.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854582818 0 0) 0x7fa8280cbd40 con 0x7fa8280ca6b0 2023-11-28T21:06:54.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa810003530 con 0x7fa8280ca6b0 2023-11-28T21:06:54.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3786310249 0 0) 0x7fa810003530 con 0x7fa8280ca6b0 2023-11-28T21:06:54.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8280c5c90 msgr2=0x7fa8280c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:54.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8280c5c90 0x7fa8280c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 >> v2:172.21.15.178:3300/0 conn(0x7fa828154220 msgr2=0x7fa828159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:54.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 --2- 172.21.15.167:0/1911720866 >> v2:172.21.15.178:3300/0 conn(0x7fa828154220 0x7fa828159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82815ade0 con 0x7fa8280ca6b0 2023-11-28T21:06:54.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fa81c001680 con 0x7fa8280ca6b0 2023-11-28T21:06:54.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 >> v1:172.21.15.167:6789/0 conn(0x7fa8280ca6b0 legacy=0x7fa8280cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:54.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8280c5c90 0x7fa810003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:54.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:54.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810004d10 0x7fa810005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:54.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280c6660 con 0x7fa810003f00 2023-11-28T21:06:54.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa828154600 con 0x7fa810004d10 2023-11-28T21:06:54.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81000b9c0 con 0x7fa8280c5c90 2023-11-28T21:06:54.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa826ffd640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:54.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa8277fe640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8280c5c90 0x7fa810003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:54.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa827fff640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810004d10 0x7fa810005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:54.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa826ffd640 1 -- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8280c5c90 msgr2=0x7fa810003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:54.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa826ffd640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8280c5c90 0x7fa810003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa826ffd640 1 -- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810004d10 msgr2=0x7fa810005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:54.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa826ffd640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810004d10 0x7fa810005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa826ffd640 1 -- 172.21.15.167:0/1911720866 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810003530 con 0x7fa810003f00 2023-11-28T21:06:54.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.859+0000 7fa827fff640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810004d10 0x7fa810005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:06:54.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa826ffd640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8100047d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c290 tx=0x7fa81c01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d6f722ba9ac29c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:54.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0a5950 con 0x7fa810003f00 2023-11-28T21:06:54.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa81c0a5ab0 con 0x7fa810003f00 2023-11-28T21:06:54.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa8267fc640 1 -- 172.21.15.167:0/1911720866 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0a5e80 con 0x7fa810003f00 2023-11-28T21:06:54.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa82dd96640 1 -- 172.21.15.167:0/1911720866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 msgr2=0x7fa8100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:54.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa82dd96640 1 --2- 172.21.15.167:0/1911720866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8100047d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c290 tx=0x7fa81c01cce0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa827fff640 1 -- 172.21.15.167:0/1911720866 reap_dead start 2023-11-28T21:06:54.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa82dd96640 1 -- 172.21.15.167:0/1911720866 shutdown_connections 2023-11-28T21:06:54.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa82dd96640 1 -- 172.21.15.167:0/1911720866 >> 172.21.15.167:0/1911720866 conn(0x7fa82806c440 msgr2=0x7fa828071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:54.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa82dd96640 1 -- 172.21.15.167:0/1911720866 shutdown_connections 2023-11-28T21:06:54.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa82dd96640 1 -- 172.21.15.167:0/1911720866 wait complete. 2023-11-28T21:06:54.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa82dd96640 1 Processor -- start 2023-11-28T21:06:54.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.863+0000 7fa82dd96640 1 -- start start 2023-11-28T21:06:54.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa82dd96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8280c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:54.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa82dd96640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa828159a10 0x7fa8280ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:54.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa82dd96640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8280c6970 0x7fa8280c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:54.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa82dd96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa828159630 con 0x7fa810003f00 2023-11-28T21:06:54.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa82dd96640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa828159e30 con 0x7fa8280c6970 2023-11-28T21:06:54.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa82dd96640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82815a0c0 con 0x7fa828159a10 2023-11-28T21:06:54.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa8277fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8280c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:54.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa8277fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8280c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52924/0 (socket says 172.21.15.167:52924) 2023-11-28T21:06:54.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa8277fe640 1 -- 172.21.15.167:0/836847108 learned_addr learned my addr 172.21.15.167:0/836847108 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:54.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa827fff640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8280c6970 0x7fa8280c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:54.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa826ffd640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa828159a10 0x7fa8280ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:54.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa8277fe640 1 -- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa828159a10 msgr2=0x7fa8280ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:54.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa8277fe640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa828159a10 0x7fa8280ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa8277fe640 1 -- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8280c6970 msgr2=0x7fa8280c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:54.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa8277fe640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8280c6970 0x7fa8280c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:54.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa8277fe640 1 -- 172.21.15.167:0/836847108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828158590 con 0x7fa810003f00 2023-11-28T21:06:54.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa827fff640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8280c6970 0x7fa8280c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:06:54.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa8277fe640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8280c95c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa818007f30 tx=0x7fa818011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:54.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa80ffff640 1 -- 172.21.15.167:0/836847108 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81800e030 con 0x7fa810003f00 2023-11-28T21:06:54.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa80ffff640 1 -- 172.21.15.167:0/836847108 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa818016470 con 0x7fa810003f00 2023-11-28T21:06:54.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa828158870 con 0x7fa810003f00 2023-11-28T21:06:54.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa80ffff640 1 -- 172.21.15.167:0/836847108 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818016840 con 0x7fa810003f00 2023-11-28T21:06:54.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa828158e30 con 0x7fa810003f00 2023-11-28T21:06:54.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa828067c00 con 0x7fa810003f00 2023-11-28T21:06:54.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa80ffff640 1 -- 172.21.15.167:0/836847108 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8180169a0 con 0x7fa810003f00 2023-11-28T21:06:54.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa80ffff640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa814066470 0x7fa814068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:54.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.867+0000 7fa80ffff640 1 -- 172.21.15.167:0/836847108 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fa81800f070 con 0x7fa810003f00 2023-11-28T21:06:54.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.871+0000 7fa826ffd640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa814066470 0x7fa814068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:54.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.871+0000 7fa826ffd640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa814066470 0x7fa814068930 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0aa000 tx=0x7fa81c001a10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:54.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:54.871+0000 7fa80ffff640 1 -- 172.21.15.167:0/836847108 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa818052390 con 0x7fa810003f00 2023-11-28T21:06:55.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.027+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa828075c90 con 0x7fa810003f00 2023-11-28T21:06:55.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.979+0000 7fa80ffff640 1 -- 172.21.15.167:0/836847108 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa8180559b0 con 0x7fa810003f00 2023-11-28T21:06:55.985 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_metadata' removed 2023-11-28T21:06:55.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa814066470 msgr2=0x7fa814068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:55.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa814066470 0x7fa814068930 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0aa000 tx=0x7fa81c001a10 comp rx=0 tx=0).stop 2023-11-28T21:06:55.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 msgr2=0x7fa8280c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:55.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8280c95c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa818007f30 tx=0x7fa818011660 comp rx=0 tx=0).stop 2023-11-28T21:06:55.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 shutdown_connections 2023-11-28T21:06:55.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fa814066470 0x7fa814068930 secure :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0aa000 tx=0x7fa81c001a10 comp rx=0 tx=0).stop 2023-11-28T21:06:55.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8280c6970 0x7fa8280c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:55.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa828159a10 0x7fa8280ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:55.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 --2- 172.21.15.167:0/836847108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa810003f00 0x7fa8280c95c0 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa818007f30 tx=0x7fa818011660 comp rx=0 tx=0).stop 2023-11-28T21:06:55.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 >> 172.21.15.167:0/836847108 conn(0x7fa82806c440 msgr2=0x7fa828071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:55.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 shutdown_connections 2023-11-28T21:06:55.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:55.983+0000 7fa82dd96640 1 -- 172.21.15.167:0/836847108 wait complete. 2023-11-28T21:06:56.016 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T21:06:56.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe57d45f640 1 Processor -- start 2023-11-28T21:06:56.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe57d45f640 1 -- start start 2023-11-28T21:06:56.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe57d45f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154220 0x7fe578159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:56.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe57d45f640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe5780c5c90 0x7fe5780c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:56.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe57d45f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5780cbd40 con 0x7fe5780ca6b0 2023-11-28T21:06:56.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe57d45f640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5780c6660 con 0x7fe5780c5c90 2023-11-28T21:06:56.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe57d45f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe578154600 con 0x7fe578154220 2023-11-28T21:06:56.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe56ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe5780ca6b0 0x7fe5780cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:42662/0 (socket says 172.21.15.167:42662) 2023-11-28T21:06:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe56ffff640 1 -- 172.21.15.167:0/2884654593 learned_addr learned my addr 172.21.15.167:0/2884654593 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5777fe640 1 --2- 172.21.15.167:0/2884654593 >> v2:172.21.15.178:3300/0 conn(0x7fe5780c5c90 0x7fe5780c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe576ffd640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154220 0x7fe578159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938311669 0 0) 0x7fe5780cbd40 con 0x7fe5780ca6b0 2023-11-28T21:06:56.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe564003530 con 0x7fe5780ca6b0 2023-11-28T21:06:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 <== mon.0 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3863850309 0 0) 0x7fe564003530 con 0x7fe5780ca6b0 2023-11-28T21:06:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154220 msgr2=0x7fe578159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154220 0x7fe578159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 >> v2:172.21.15.178:3300/0 conn(0x7fe5780c5c90 msgr2=0x7fe5780c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 --2- 172.21.15.167:0/2884654593 >> v2:172.21.15.178:3300/0 conn(0x7fe5780c5c90 0x7fe5780c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57815ade0 con 0x7fe5780ca6b0 2023-11-28T21:06:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 <== mon.0 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524442168 0 0) 0x7fe560001680 con 0x7fe5780ca6b0 2023-11-28T21:06:56.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 >> v1:172.21.15.167:6789/0 conn(0x7fe5780ca6b0 legacy=0x7fe5780cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe564003980 0x7fe564003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5640047d0 0x7fe564004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154220 0x7fe564005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780c6660 con 0x7fe564003980 2023-11-28T21:06:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe578154600 con 0x7fe5640047d0 2023-11-28T21:06:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56400b990 con 0x7fe578154220 2023-11-28T21:06:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe576ffd640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe564003980 0x7fe564003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:56.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe5777fe640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154220 0x7fe564005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:56.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe56ffff640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5640047d0 0x7fe564004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:56.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe576ffd640 1 -- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154220 msgr2=0x7fe564005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:56.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe576ffd640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154220 0x7fe564005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:56.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe576ffd640 1 -- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5640047d0 msgr2=0x7fe564004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:56.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe576ffd640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5640047d0 0x7fe564004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:56.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.143+0000 7fe576ffd640 1 -- 172.21.15.167:0/2884654593 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564003530 con 0x7fe564003980 2023-11-28T21:06:56.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe576ffd640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe564003980 0x7fe564003da0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe568009ae0 tx=0x7fe56801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e6601535c33252 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:56.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680a5560 con 0x7fe564003980 2023-11-28T21:06:56.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe5680a56c0 con 0x7fe564003980 2023-11-28T21:06:56.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe5767fc640 1 -- 172.21.15.167:0/2884654593 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680a5890 con 0x7fe564003980 2023-11-28T21:06:56.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe57d45f640 1 -- 172.21.15.167:0/2884654593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe564003980 msgr2=0x7fe564003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:56.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe57d45f640 1 --2- 172.21.15.167:0/2884654593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe564003980 0x7fe564003da0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe568009ae0 tx=0x7fe56801ca50 comp rx=0 tx=0).stop 2023-11-28T21:06:56.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe5777fe640 1 -- 172.21.15.167:0/2884654593 reap_dead start 2023-11-28T21:06:56.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe57d45f640 1 -- 172.21.15.167:0/2884654593 shutdown_connections 2023-11-28T21:06:56.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe57d45f640 1 -- 172.21.15.167:0/2884654593 >> 172.21.15.167:0/2884654593 conn(0x7fe57806c440 msgr2=0x7fe578071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:56.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe57d45f640 1 -- 172.21.15.167:0/2884654593 shutdown_connections 2023-11-28T21:06:56.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe57d45f640 1 -- 172.21.15.167:0/2884654593 wait complete. 2023-11-28T21:06:56.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe57d45f640 1 Processor -- start 2023-11-28T21:06:56.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.147+0000 7fe57d45f640 1 -- start start 2023-11-28T21:06:56.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe57d45f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe564003980 0x7fe5781f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:56.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe57d45f640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154820 0x7fe5781f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:56.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe57d45f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5780c6fc0 0x7fe5780c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:56.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe57d45f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe578157ba0 con 0x7fe5780c6fc0 2023-11-28T21:06:56.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe57d45f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780c9500 con 0x7fe564003980 2023-11-28T21:06:56.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe57d45f640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780c99f0 con 0x7fe578154820 2023-11-28T21:06:56.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe5777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5780c6fc0 0x7fe5780c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:56.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe5777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5780c6fc0 0x7fe5780c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52946/0 (socket says 172.21.15.167:52946) 2023-11-28T21:06:56.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe5777fe640 1 -- 172.21.15.167:0/1308019879 learned_addr learned my addr 172.21.15.167:0/1308019879 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:56.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe576ffd640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe564003980 0x7fe5781f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:56.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe5777fe640 1 -- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154820 msgr2=0x7fe5781f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:56.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe5777fe640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154820 0x7fe5781f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:56.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe5777fe640 1 -- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe564003980 msgr2=0x7fe5781f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:56.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe5777fe640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe564003980 0x7fe5781f2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:56.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe5777fe640 1 -- 172.21.15.167:0/1308019879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5780c79b0 con 0x7fe5780c6fc0 2023-11-28T21:06:56.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe5777fe640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5780c6fc0 0x7fe5780c7470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe57808d180 tx=0x7fe57000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:56.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe56f7fe640 1 -- 172.21.15.167:0/1308019879 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570017400 con 0x7fe5780c6fc0 2023-11-28T21:06:56.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe56f7fe640 1 -- 172.21.15.167:0/1308019879 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe570011040 con 0x7fe5780c6fc0 2023-11-28T21:06:56.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5781f3710 con 0x7fe5780c6fc0 2023-11-28T21:06:56.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe56f7fe640 1 -- 172.21.15.167:0/1308019879 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5700177e0 con 0x7fe5780c6fc0 2023-11-28T21:06:56.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5781f0070 con 0x7fe5780c6fc0 2023-11-28T21:06:56.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe578067c00 con 0x7fe5780c6fc0 2023-11-28T21:06:56.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe56f7fe640 1 -- 172.21.15.167:0/1308019879 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe570017940 con 0x7fe5780c6fc0 2023-11-28T21:06:56.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe56f7fe640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe558066470 0x7fe558068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:56.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.151+0000 7fe56f7fe640 1 -- 172.21.15.167:0/1308019879 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6569+0+0 (secure 0 0 0) 0x7fe5700842c0 con 0x7fe5780c6fc0 2023-11-28T21:06:56.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.155+0000 7fe576ffd640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe558066470 0x7fe558068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:56.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.155+0000 7fe576ffd640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe558066470 0x7fe558068930 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe5680af000 tx=0x7fe5680046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:56.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.159+0000 7fe56f7fe640 1 -- 172.21.15.167:0/1308019879 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe570051490 con 0x7fe5780c6fc0 2023-11-28T21:06:56.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.303+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe578075c90 con 0x7fe5780c6fc0 2023-11-28T21:06:57.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe56f7fe640 1 -- 172.21.15.167:0/1308019879 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe570054ab0 con 0x7fe5780c6fc0 2023-11-28T21:06:57.006 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_data' removed 2023-11-28T21:06:57.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe558066470 msgr2=0x7fe558068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:57.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe57d45f640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe558066470 0x7fe558068930 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe5680af000 tx=0x7fe5680046d0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5780c6fc0 msgr2=0x7fe5780c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:57.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe57d45f640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5780c6fc0 0x7fe5780c7470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe57808d180 tx=0x7fe57000f4a0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 shutdown_connections 2023-11-28T21:06:57.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe57d45f640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7fe558066470 0x7fe558068930 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe57d45f640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe5780c6fc0 0x7fe5780c7470 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe57d45f640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe578154820 0x7fe5781f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:56.999+0000 7fe57d45f640 1 --2- 172.21.15.167:0/1308019879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe564003980 0x7fe5781f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.003+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 >> 172.21.15.167:0/1308019879 conn(0x7fe57806c440 msgr2=0x7fe5780cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:57.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.003+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 shutdown_connections 2023-11-28T21:06:57.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.003+0000 7fe57d45f640 1 -- 172.21.15.167:0/1308019879 wait complete. 2023-11-28T21:06:57.027 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-28T21:06:57.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d6ff8640 1 Processor -- start 2023-11-28T21:06:57.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d6ff8640 1 -- start start 2023-11-28T21:06:57.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d6ff8640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f58d00cfc40 0x7f58d00cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:57.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d6ff8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f58d0153ae0 0x7f58d0153f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:57.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d6ff8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d015ac00 con 0x7f58d00cf860 2023-11-28T21:06:57.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d6ff8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00cbd60 con 0x7f58d0153ae0 2023-11-28T21:06:57.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d6ff8640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d0159ff0 con 0x7f58d00cfc40 2023-11-28T21:06:57.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d5595640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f58d0153ae0 0x7f58d0153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:57.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d4d94640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f58d00cf860 0x7f58d00ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:42678/0 (socket says 172.21.15.167:42678) 2023-11-28T21:06:57.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d4d94640 1 -- 172.21.15.167:0/597407807 learned_addr learned my addr 172.21.15.167:0/597407807 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-11-28T21:06:57.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58c7fff640 1 --2- 172.21.15.167:0/597407807 >> v2:172.21.15.178:3300/0 conn(0x7f58d00cfc40 0x7f58d00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:57.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d5595640 1 -- 172.21.15.167:0/597407807 >> v2:172.21.15.178:3300/0 conn(0x7f58d00cfc40 msgr2=0x7f58d00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:06:57.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d5595640 1 --2- 172.21.15.167:0/597407807 >> v2:172.21.15.178:3300/0 conn(0x7f58d00cfc40 0x7f58d00cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d5595640 1 -- 172.21.15.167:0/597407807 >> v1:172.21.15.167:6789/0 conn(0x7f58d00cf860 legacy=0x7f58d00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:57.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58d5595640 1 -- 172.21.15.167:0/597407807 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d015a2d0 con 0x7f58d0153ae0 2023-11-28T21:06:57.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58c77fe640 1 -- 172.21.15.167:0/597407807 <== mon.0 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278872957 0 0) 0x7f58d015ac00 con 0x7f58d00cf860 2023-11-28T21:06:57.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.139+0000 7f58c7fff640 1 --2- 172.21.15.167:0/597407807 >> v2:172.21.15.178:3300/0 conn(0x7f58d00cfc40 0x7f58d00cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:06:57.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d5595640 1 --2- 172.21.15.167:0/597407807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 0x7f58d0153f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f58d00c9c50 tx=0x7f58c801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a464e5a12a68f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:57.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58c77fe640 1 -- 172.21.15.167:0/597407807 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c80a59d0 con 0x7f58d0153ae0 2023-11-28T21:06:57.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58c77fe640 1 -- 172.21.15.167:0/597407807 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f58c80a5b30 con 0x7f58d0153ae0 2023-11-28T21:06:57.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58c77fe640 1 -- 172.21.15.167:0/597407807 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c80ad440 con 0x7f58d0153ae0 2023-11-28T21:06:57.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 -- 172.21.15.167:0/597407807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 msgr2=0x7f58d0153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:57.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 --2- 172.21.15.167:0/597407807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 0x7f58d0153f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f58d00c9c50 tx=0x7f58c801c910 comp rx=0 tx=0).stop 2023-11-28T21:06:57.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 -- 172.21.15.167:0/597407807 shutdown_connections 2023-11-28T21:06:57.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 --2- 172.21.15.167:0/597407807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 0x7f58d0153f50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 --2- 172.21.15.167:0/597407807 >> v2:172.21.15.178:3300/0 conn(0x7f58d00cfc40 0x7f58d00cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 -- 172.21.15.167:0/597407807 >> 172.21.15.167:0/597407807 conn(0x7f58d006c1f0 msgr2=0x7f58d0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:57.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 -- 172.21.15.167:0/597407807 shutdown_connections 2023-11-28T21:06:57.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 -- 172.21.15.167:0/597407807 wait complete. 2023-11-28T21:06:57.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 Processor -- start 2023-11-28T21:06:57.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 -- start start 2023-11-28T21:06:57.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d00cf860 0x7f58d0157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:57.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00cfc40 0x7f58d00b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:57.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 0x7f58d00b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:57.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0148610 con 0x7f58d0153ae0 2023-11-28T21:06:57.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0149650 con 0x7f58d00cfc40 2023-11-28T21:06:57.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.143+0000 7f58d6ff8640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01f69a0 con 0x7f58d00cf860 2023-11-28T21:06:57.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d5595640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 0x7f58d00b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:57.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d5595640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 0x7f58d00b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:52968/0 (socket says 172.21.15.167:52968) 2023-11-28T21:06:57.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d5595640 1 -- 172.21.15.167:0/4105105511 learned_addr learned my addr 172.21.15.167:0/4105105511 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-11-28T21:06:57.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d4d94640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d00cf860 0x7f58d0157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:57.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58c7fff640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00cfc40 0x7f58d00b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:57.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d5595640 1 -- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d00cf860 msgr2=0x7f58d0157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:57.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d5595640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d00cf860 0x7f58d0157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d5595640 1 -- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00cfc40 msgr2=0x7f58d00b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d5595640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00cfc40 0x7f58d00b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d5595640 1 -- 172.21.15.167:0/4105105511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c8009a70 con 0x7f58d0153ae0 2023-11-28T21:06:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d5595640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 0x7f58d00b5010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c090 tx=0x7f58c80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:57.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58c57fa640 1 -- 172.21.15.167:0/4105105511 <== mon.0 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c80a59d0 con 0x7f58d0153ae0 2023-11-28T21:06:57.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58c57fa640 1 -- 172.21.15.167:0/4105105511 <== mon.0 v2:172.21.15.167:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f58c8009450 con 0x7f58d0153ae0 2023-11-28T21:06:57.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d0148890 con 0x7f58d0153ae0 2023-11-28T21:06:57.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58c57fa640 1 -- 172.21.15.167:0/4105105511 <== mon.0 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8003be0 con 0x7f58d0153ae0 2023-11-28T21:06:57.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d0148e50 con 0x7f58d0153ae0 2023-11-28T21:06:57.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d0075c90 con 0x7f58d0153ae0 2023-11-28T21:06:57.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58c57fa640 1 -- 172.21.15.167:0/4105105511 <== mon.0 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58c80b4050 con 0x7f58d0153ae0 2023-11-28T21:06:57.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58c57fa640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f58bc066470 0x7f58bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:06:57.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58c57fa640 1 -- 172.21.15.167:0/4105105511 <== mon.0 v2:172.21.15.167:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6039+0+0 (secure 0 0 0) 0x7f58c811e270 con 0x7f58d0153ae0 2023-11-28T21:06:57.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d4d94640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f58bc066470 0x7f58bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:06:57.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.147+0000 7f58d4d94640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f58bc066470 0x7f58bc068930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f58cc000f70 tx=0x7f58cc007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:06:57.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.151+0000 7f58c57fa640 1 -- 172.21.15.167:0/4105105511 <== mon.0 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58c80eb5c0 con 0x7f58d0153ae0 2023-11-28T21:06:57.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:57.299+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f58d00c5c00 con 0x7f58d0153ae0 2023-11-28T21:06:58.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.003+0000 7f58c57fa640 1 -- 172.21.15.167:0/4105105511 <== mon.0 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v56) v1 ==== 178+0+0 (secure 0 0 0) 0x7f58c80eebe0 con 0x7f58d0153ae0 2023-11-28T21:06:58.006 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'cephfs_data_ec' removed 2023-11-28T21:06:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.003+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f58bc066470 msgr2=0x7f58bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.003+0000 7f58d6ff8640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f58bc066470 0x7f58bc068930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f58cc000f70 tx=0x7f58cc007df0 comp rx=0 tx=0).stop 2023-11-28T21:06:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.003+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 msgr2=0x7f58d00b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:06:58.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.003+0000 7f58d6ff8640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 0x7f58d00b5010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c090 tx=0x7f58c80196b0 comp rx=0 tx=0).stop 2023-11-28T21:06:58.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.007+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 shutdown_connections 2023-11-28T21:06:58.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.007+0000 7f58d6ff8640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:6832/824645964,v1:172.21.15.178:6833/824645964] conn(0x7f58bc066470 0x7f58bc068930 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:58.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.007+0000 7f58d6ff8640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0153ae0 0x7f58d00b5010 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:58.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.007+0000 7f58d6ff8640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00cfc40 0x7f58d00b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:58.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.007+0000 7f58d6ff8640 1 --2- 172.21.15.167:0/4105105511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d00cf860 0x7f58d0157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:06:58.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.007+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 >> 172.21.15.167:0/4105105511 conn(0x7f58d006c1f0 msgr2=0x7f58d01475b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:06:58.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.011+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 shutdown_connections 2023-11-28T21:06:58.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-11-28T21:06:58.011+0000 7f58d6ff8640 1 -- 172.21.15.167:0/4105105511 wait complete. 2023-11-28T21:06:58.043 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T21:06:58.043 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T21:06:58.043 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:06:58.058 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T21:06:58.058 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T21:06:58.058 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:06:58.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:06:58.059 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi167 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-28T21:06:58.067 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T21:06:58.067 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-11-28T21:06:58.067 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:06:58.112 INFO:tasks.ceph.mds.e:Stopped 2023-11-28T21:06:58.112 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T21:06:58.112 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:06:58.126 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T21:06:58.126 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T21:06:58.126 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:06:58.180 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T21:06:58.181 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-11-28T21:06:58.181 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:06:58.234 INFO:tasks.ceph.mds.f:Stopped 2023-11-28T21:06:58.235 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T21:06:58.235 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T21:06:58.235 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:00.140 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:00.142 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:04.337 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T21:07:04.337 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T21:07:04.337 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:04.430 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T21:07:04.430 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T21:07:04.430 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:04.527 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T21:07:04.527 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T21:07:04.528 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:10.629 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T21:07:10.630 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T21:07:10.630 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:10.725 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T21:07:10.725 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T21:07:10.725 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:10.818 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T21:07:10.819 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T21:07:10.819 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:16.920 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T21:07:16.921 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T21:07:16.921 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:16.988 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T21:07:16.988 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T21:07:16.988 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T21:07:16.988 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:17.020 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T21:07:17.021 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T21:07:17.021 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:17.050 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T21:07:17.051 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T21:07:17.051 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T21:07:17.051 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:17.074 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T21:07:17.075 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T21:07:17.075 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:17.110 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T21:07:17.111 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T21:07:17.111 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:07:17.167 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T21:07:17.167 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T21:07:17.167 DEBUG:teuthology.orchestra.run.smithi167:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | head -n 1 2023-11-28T21:07:17.191 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi167.front.sepia.ceph.com 2023-11-28T21:07:17.192 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T21:07:30.253 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:30.260 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:00.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:01.678 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:31.728 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:31.731 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:01.808 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:01.811 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:31.869 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:31.873 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:41.536 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-11-28T21:09:41.554 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-11-28T21:10:01.998 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:09.602 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:39.717 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:39.722 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:09.854 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:09.858 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:39.983 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:39.987 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:10.029 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:10.032 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:40.123 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:40.126 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:10.253 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:10.257 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:40.314 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:40.317 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:10.394 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:10.397 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:40.446 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:40.450 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:10.512 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:10.515 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:40.639 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:40.642 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:10.775 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:10.778 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:40.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:40.824 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:10.866 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:10.870 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:40.922 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:40.926 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:10.973 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:10.977 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:41.027 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:41.031 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:11.090 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:11.094 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:41.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:41.146 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:11.216 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:11.220 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:41.258 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:41.262 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:11.346 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:15.980 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:46.115 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:46.118 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:16.236 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:16.240 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:46.398 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:46.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:16.519 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:16.522 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:46.569 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:46.572 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:16.718 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:16.721 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:46.814 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:46.817 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:16.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:16.888 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:46.946 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:46.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:17.075 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:17.078 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:47.128 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:47.131 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:17.224 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:17.228 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:47.444 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:47.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:17.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:17.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:47.628 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:47.631 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:17.705 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:17.709 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:47.777 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:47.780 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:17.897 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:17.900 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:48.018 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:48.022 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:18.188 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:22.439 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:52.558 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:52.561 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:22.603 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:22.607 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:52.649 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:52.652 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:22.769 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:22.773 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:52.831 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:52.834 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:22.952 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:22.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:53.080 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:53.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:23.152 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:23.156 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:53.196 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:53.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:23.391 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:23.394 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:53.446 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:53.449 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:23.505 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:23.509 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:53.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:53.640 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:23.690 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:23.694 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:53.745 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:53.749 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:23.816 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:23.821 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:53.885 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:53.891 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:24.014 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:24.018 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:54.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:54.071 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:24.346 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:24.349 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:54.475 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:54.478 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:24.561 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:24.565 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:54.615 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:54.619 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:24.794 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:24.797 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:54.840 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:54.844 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:25.210 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:25.214 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:55.268 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:55.271 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:25.340 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:25.344 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:55.405 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:55.408 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:25.550 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:25.554 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:55.604 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:55.608 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:25.724 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:25.730 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:55.862 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:55.865 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:25.915 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:25.919 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:56.027 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:56.030 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:26.098 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:26.101 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:56.143 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:56.146 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:50:26.281 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:50:31.414 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:01.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:01.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:31.521 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:31.524 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:01.607 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:01.611 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:31.661 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:31.664 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:01.716 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:01.719 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:31.827 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:31.830 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:02.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:02.185 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:32.355 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:32.358 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:02.408 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:02.412 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:32.481 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:32.487 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:02.536 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:02.540 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:32.591 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:32.595 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:02.647 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:02.651 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:32.705 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:32.709 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:58:02.758 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:58:02.761 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:58:32.814 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:58:32.817 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:59:02.867 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:59:02.871 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:59:32.939 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:59:32.943 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:03.017 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:03.020 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:33.138 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:33.141 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:03.191 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:03.195 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:33.305 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:33.308 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:03.442 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:03.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:33.519 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:39.532 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:09.577 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:09.584 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:39.951 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:39.962 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:10.085 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:10.089 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:40.159 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:40.162 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:10.213 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:20.269 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:50.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:50.331 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:20.451 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:20.455 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:50.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:50.592 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:20.934 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:20.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:50.982 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:50.985 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:21.258 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:21.261 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:51.311 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:51.315 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:21.441 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:21.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:51.552 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:51.555 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:21.659 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:21.663 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:51.709 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:51.713 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:21.763 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:21.767 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:51.818 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:51.822 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:21.955 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:21.959 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:52.058 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:52.062 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:22.112 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:22.115 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:52.215 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:52.219 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:22.269 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:22.273 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:52.340 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:53.370 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:23.488 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:23.492 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:53.610 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:53.614 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:23.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:23.729 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:53.869 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:53.872 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:23.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:23.928 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:54.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:54.065 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:24.193 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:24.197 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:54.282 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:54.285 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:24.396 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:24.399 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:54.552 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:54.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:24.815 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:24.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:54.868 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:54.872 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:25.022 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:25.026 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:55.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:55.154 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:25.220 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:25.224 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:55.273 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:55.277 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:25.385 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:25.389 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:55.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:55.504 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:25.614 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:25.617 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:55.727 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:55.730 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:25.798 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:25.802 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:55.855 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:55.859 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:25.967 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:25.970 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:56.021 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:56.025 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:26.150 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:26.153 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:56.278 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:56.282 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:26.540 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:26.544 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:56.769 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:56.772 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:26.822 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:26.825 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:56.909 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:56.913 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:26.975 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:26.978 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:57.025 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:57.029 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:27.162 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:27.166 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:57.283 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:57.288 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:27.336 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:27.340 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:57.657 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:57.661 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:33:27.769 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:33:27.772 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:33:57.822 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:33:58.060 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:28.116 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:28.119 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:58.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:58.475 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:28.534 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:28.538 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:58.663 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:04.666 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:34.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:34.777 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:04.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:04.907 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:34.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:34.950 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:04.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:04.996 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:35.122 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:35.126 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:05.166 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:05.170 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:35.290 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:35.294 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:05.450 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:05.453 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:35.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:35.596 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:05.708 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:05.711 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:35.811 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:35.815 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:05.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:05.929 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:36.043 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:41.975 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:12.070 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:12.074 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:42.273 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:42.277 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:12.337 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:12.340 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:42.449 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:42.452 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:12.627 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:12.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:42.840 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:42.843 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:12.952 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:12.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:43.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:43.008 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:13.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:13.154 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:43.288 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:43.292 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:13.342 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:13.345 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:43.403 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:43.406 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:13.582 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:13.585 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:43.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:43.639 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:13.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:13.717 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:43.826 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:43.830 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:13.871 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:13.874 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:43.980 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:43.983 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:14.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:14.116 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:44.166 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:44.170 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:14.287 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:14.290 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:44.440 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:44.443 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:14.555 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:14.559 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:44.698 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:44.701 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:14.824 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:14.828 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:44.888 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:44.891 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:15.026 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:15.030 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:45.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:45.118 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:15.250 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:15.253 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:45.362 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:45.443 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:15.507 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:15.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:45.562 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:45.565 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:15.656 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:15.660 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:45.709 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:45.713 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:15.837 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:15.846 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:45.908 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:45.912 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:16.046 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:16.049 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:46.099 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:46.103 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:16.153 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:16.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:46.272 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:46.275 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:16.591 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:16.595 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:46.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:46.741 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:16.810 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:16.815 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:46.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:46.933 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:17.284 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:17.287 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:47.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:47.503 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:17.625 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:17.629 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:47.736 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:47.739 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:17.782 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:19.067 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:49.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:49.116 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:19.281 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:19.284 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:49.418 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:49.421 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:19.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:19.523 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:49.650 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:49.653 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:19.804 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:19.808 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:49.952 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:49.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:20.057 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:20.060 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:50.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:50.174 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:20.292 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:20.296 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:50.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:50.417 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:20.544 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:20.548 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:50.683 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:50.686 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:20.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:20.791 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:50.845 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:50.849 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:20.964 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:20.969 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:51.020 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:51.023 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:21.141 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:21.145 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:51.272 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:51.275 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:21.400 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:21.403 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:51.548 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:51.551 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:21.670 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:21.673 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:51.727 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:51.730 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:21.856 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:21.860 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:52.118 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:52.121 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:22.215 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:22.219 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:52.280 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:52.283 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:22.328 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:22.331 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:52.382 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:52.385 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:22.660 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:22.664 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:52.758 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:52.762 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:22.880 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:22.884 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:53.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:53.017 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:23.349 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:23.353 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:53.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:53.474 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:23.724 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:23.728 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:54.081 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:54.084 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:24.315 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:24.322 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:54.535 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:54.539 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:24.647 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:24.651 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:54.760 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:54.764 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:24.878 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:24.881 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:54.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:54.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:25.042 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:25.045 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:55.173 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:55.177 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:25.343 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:25.347 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:55.681 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:55.684 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:25.809 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:25.812 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:56.045 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:56.049 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:26.099 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:26.102 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:56.261 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:56.264 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:26.516 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:26.520 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:56.614 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:56.616 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:26.709 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:26.712 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:56.814 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:56.817 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:26.962 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:26.966 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:57.025 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:57.028 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:27.155 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:27.158 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:57.278 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:57.281 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:27.383 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:27.386 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:57.540 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:57.543 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:27.659 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:27.663 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:57.938 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:57.941 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:28.178 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:28.181 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:58.299 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:58.303 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:28.458 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:28.461 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:58.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:58.513 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:28.632 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:28.636 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:58.760 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:58.764 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:28.880 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:28.883 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:59.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:59.017 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:29.146 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:29.150 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:59.465 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:59.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:29.778 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:29.782 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:59.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:59.909 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:30.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:30.072 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:00.228 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:00.231 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:30.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:30.371 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:00.421 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:00.424 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:30.561 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:30.564 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:00.695 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:00.698 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:30.774 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:30.792 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:00.917 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:00.921 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:31.039 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:31.042 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:01.135 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:01.139 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:31.213 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:31.216 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:01.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:01.344 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:31.403 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:31.407 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:01.625 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:01.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:31.761 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:31.766 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:01.875 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:01.879 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:31.993 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:31.996 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:02.047 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:02.051 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:32.159 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:32.163 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:02.296 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:02.299 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:32.375 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:32.378 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:02.439 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:02.443 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:32.766 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:32.769 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:02.819 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:02.823 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:32.873 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:32.877 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:02.985 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:02.988 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:33.038 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:33.042 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:03.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:03.096 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:33.212 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:33.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:03.283 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:03.286 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:33.428 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:33.431 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:33.440 INFO:teuthology.orchestra.run.smithi167.stderr:error: state file /var/lib/logrotate/status is already locked 2023-11-29T00:00:33.441 INFO:teuthology.orchestra.run.smithi167.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-11-29T00:00:33.441 DEBUG:teuthology.orchestra.run:got remote process result: 3 2023-11-29T00:00:33.442 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi167 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T00:00:33.451 INFO:teuthology.orchestra.run.smithi178.stderr:error: state file /var/lib/logrotate/status is already locked 2023-11-29T00:00:33.451 INFO:teuthology.orchestra.run.smithi178.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-11-29T08:23:14.438 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-11-29T08:23:14.472 DEBUG:teuthology.task.console_log:Killing console logger for smithi167 2023-11-29T08:23:14.474 DEBUG:teuthology.task.console_log:Killing console logger for smithi178 2023-11-29T08:23:14.474 DEBUG:teuthology.exit:Finished running handlers